00:00:00.001 Started by upstream project "autotest-per-patch" build number 121266 00:00:00.001 originally caused by: 00:00:00.001 Started by user sys_sgci 00:00:00.105 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.106 The recommended git tool is: git 00:00:00.106 using credential 00000000-0000-0000-0000-000000000002 00:00:00.108 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.148 Fetching changes from the remote Git repository 00:00:00.150 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.196 Using shallow fetch with depth 1 00:00:00.196 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.196 > git --version # timeout=10 00:00:00.243 > git --version # 'git version 2.39.2' 00:00:00.244 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.244 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.244 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:07.384 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:07.396 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:07.408 Checking out Revision f964f6d3463483adf05cc5c086f2abd292e05f1d (FETCH_HEAD) 00:00:07.408 > git config core.sparsecheckout # timeout=10 00:00:07.419 > git read-tree -mu HEAD # timeout=10 00:00:07.438 > git checkout -f f964f6d3463483adf05cc5c086f2abd292e05f1d # timeout=5 00:00:07.460 Commit message: "ansible/roles/custom_facts: Drop nvme features" 00:00:07.460 > git rev-list --no-walk f964f6d3463483adf05cc5c086f2abd292e05f1d # timeout=10 00:00:07.565 [Pipeline] Start of Pipeline 00:00:07.581 [Pipeline] library 00:00:07.582 Loading library shm_lib@master 00:00:07.582 Library shm_lib@master is cached. Copying from home. 00:00:07.602 [Pipeline] node 00:00:07.624 Running on WFP5 in /var/jenkins/workspace/nvmf-phy-autotest 00:00:07.626 [Pipeline] { 00:00:07.639 [Pipeline] catchError 00:00:07.641 [Pipeline] { 00:00:07.657 [Pipeline] wrap 00:00:07.668 [Pipeline] { 00:00:07.676 [Pipeline] stage 00:00:07.678 [Pipeline] { (Prologue) 00:00:07.879 [Pipeline] sh 00:00:08.158 + logger -p user.info -t JENKINS-CI 00:00:08.178 [Pipeline] echo 00:00:08.181 Node: WFP5 00:00:08.191 [Pipeline] sh 00:00:08.494 [Pipeline] setCustomBuildProperty 00:00:08.511 [Pipeline] echo 00:00:08.514 Cleanup processes 00:00:08.524 [Pipeline] sh 00:00:08.811 + sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:00:08.811 3046243 sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:00:08.825 [Pipeline] sh 00:00:09.104 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:00:09.104 ++ grep -v 'sudo pgrep' 00:00:09.104 ++ awk '{print $1}' 00:00:09.104 + sudo kill -9 00:00:09.104 + true 00:00:09.122 [Pipeline] cleanWs 00:00:09.134 [WS-CLEANUP] Deleting project workspace... 00:00:09.134 [WS-CLEANUP] Deferred wipeout is used... 00:00:09.140 [WS-CLEANUP] done 00:00:09.147 [Pipeline] setCustomBuildProperty 00:00:09.162 [Pipeline] sh 00:00:09.441 + sudo git config --global --replace-all safe.directory '*' 00:00:09.514 [Pipeline] nodesByLabel 00:00:09.515 Found a total of 1 nodes with the 'sorcerer' label 00:00:09.526 [Pipeline] httpRequest 00:00:09.531 HttpMethod: GET 00:00:09.532 URL: http://10.211.164.96/packages/jbp_f964f6d3463483adf05cc5c086f2abd292e05f1d.tar.gz 00:00:09.533 Sending request to url: http://10.211.164.96/packages/jbp_f964f6d3463483adf05cc5c086f2abd292e05f1d.tar.gz 00:00:09.546 Response Code: HTTP/1.1 200 OK 00:00:09.546 Success: Status code 200 is in the accepted range: 200,404 00:00:09.547 Saving response body to /var/jenkins/workspace/nvmf-phy-autotest/jbp_f964f6d3463483adf05cc5c086f2abd292e05f1d.tar.gz 00:00:12.820 [Pipeline] sh 00:00:13.106 + tar --no-same-owner -xf jbp_f964f6d3463483adf05cc5c086f2abd292e05f1d.tar.gz 00:00:13.124 [Pipeline] httpRequest 00:00:13.128 HttpMethod: GET 00:00:13.128 URL: http://10.211.164.96/packages/spdk_bca9154a042b3b4d2ec09c2b3bf0dcd75141dcf7.tar.gz 00:00:13.129 Sending request to url: http://10.211.164.96/packages/spdk_bca9154a042b3b4d2ec09c2b3bf0dcd75141dcf7.tar.gz 00:00:13.140 Response Code: HTTP/1.1 200 OK 00:00:13.141 Success: Status code 200 is in the accepted range: 200,404 00:00:13.141 Saving response body to /var/jenkins/workspace/nvmf-phy-autotest/spdk_bca9154a042b3b4d2ec09c2b3bf0dcd75141dcf7.tar.gz 00:00:29.564 [Pipeline] sh 00:00:29.848 + tar --no-same-owner -xf spdk_bca9154a042b3b4d2ec09c2b3bf0dcd75141dcf7.tar.gz 00:00:32.393 [Pipeline] sh 00:00:32.676 + git -C spdk log --oneline -n5 00:00:32.676 bca9154a0 [TEST] Run `sw_hotplug` test with ASAN 00:00:32.676 e29339c01 [TEST] release claimed base bdevs for raids in configuring state 00:00:32.676 06472fb6d lib/idxd: fix batch size in kernel IDXD 00:00:32.676 44dcf4fb9 pkgdep/idxd: Add dependency for accel-config used in kernel IDXD 00:00:32.676 3dbaa93c1 nvmf: pass command dword 12 and 13 for write 00:00:32.687 [Pipeline] } 00:00:32.701 [Pipeline] // stage 00:00:32.711 [Pipeline] stage 00:00:32.713 [Pipeline] { (Prepare) 00:00:32.732 [Pipeline] writeFile 00:00:32.752 [Pipeline] sh 00:00:33.079 + logger -p user.info -t JENKINS-CI 00:00:33.091 [Pipeline] sh 00:00:33.371 + logger -p user.info -t JENKINS-CI 00:00:33.383 [Pipeline] sh 00:00:33.666 + cat autorun-spdk.conf 00:00:33.666 SPDK_RUN_FUNCTIONAL_TEST=1 00:00:33.666 SPDK_TEST_NVMF=1 00:00:33.666 SPDK_TEST_NVME_CLI=1 00:00:33.666 SPDK_TEST_NVMF_NICS=mlx5 00:00:33.666 SPDK_RUN_UBSAN=1 00:00:33.666 NET_TYPE=phy 00:00:33.673 RUN_NIGHTLY=0 00:00:33.679 [Pipeline] readFile 00:00:33.704 [Pipeline] withEnv 00:00:33.706 [Pipeline] { 00:00:33.720 [Pipeline] sh 00:00:34.003 + set -ex 00:00:34.003 + [[ -f /var/jenkins/workspace/nvmf-phy-autotest/autorun-spdk.conf ]] 00:00:34.003 + source /var/jenkins/workspace/nvmf-phy-autotest/autorun-spdk.conf 00:00:34.003 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:00:34.003 ++ SPDK_TEST_NVMF=1 00:00:34.003 ++ SPDK_TEST_NVME_CLI=1 00:00:34.003 ++ SPDK_TEST_NVMF_NICS=mlx5 00:00:34.003 ++ SPDK_RUN_UBSAN=1 00:00:34.003 ++ NET_TYPE=phy 00:00:34.004 ++ RUN_NIGHTLY=0 00:00:34.004 + case $SPDK_TEST_NVMF_NICS in 00:00:34.004 + DRIVERS=mlx5_ib 00:00:34.004 + [[ -n mlx5_ib ]] 00:00:34.004 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:00:34.004 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:00:40.571 rmmod: ERROR: Module irdma is not currently loaded 00:00:40.571 rmmod: ERROR: Module i40iw is not currently loaded 00:00:40.571 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:00:40.571 + true 00:00:40.571 + for D in $DRIVERS 00:00:40.571 + sudo modprobe mlx5_ib 00:00:40.571 + exit 0 00:00:40.583 [Pipeline] } 00:00:40.606 [Pipeline] // withEnv 00:00:40.612 [Pipeline] } 00:00:40.629 [Pipeline] // stage 00:00:40.640 [Pipeline] catchError 00:00:40.642 [Pipeline] { 00:00:40.658 [Pipeline] timeout 00:00:40.658 Timeout set to expire in 40 min 00:00:40.660 [Pipeline] { 00:00:40.675 [Pipeline] stage 00:00:40.677 [Pipeline] { (Tests) 00:00:40.693 [Pipeline] sh 00:00:40.977 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-phy-autotest 00:00:40.978 ++ readlink -f /var/jenkins/workspace/nvmf-phy-autotest 00:00:40.978 + DIR_ROOT=/var/jenkins/workspace/nvmf-phy-autotest 00:00:40.978 + [[ -n /var/jenkins/workspace/nvmf-phy-autotest ]] 00:00:40.978 + DIR_SPDK=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:00:40.978 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-phy-autotest/output 00:00:40.978 + [[ -d /var/jenkins/workspace/nvmf-phy-autotest/spdk ]] 00:00:40.978 + [[ ! -d /var/jenkins/workspace/nvmf-phy-autotest/output ]] 00:00:40.978 + mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/output 00:00:40.978 + [[ -d /var/jenkins/workspace/nvmf-phy-autotest/output ]] 00:00:40.978 + cd /var/jenkins/workspace/nvmf-phy-autotest 00:00:40.978 + source /etc/os-release 00:00:40.978 ++ NAME='Fedora Linux' 00:00:40.978 ++ VERSION='38 (Cloud Edition)' 00:00:40.978 ++ ID=fedora 00:00:40.978 ++ VERSION_ID=38 00:00:40.978 ++ VERSION_CODENAME= 00:00:40.978 ++ PLATFORM_ID=platform:f38 00:00:40.978 ++ PRETTY_NAME='Fedora Linux 38 (Cloud Edition)' 00:00:40.978 ++ ANSI_COLOR='0;38;2;60;110;180' 00:00:40.978 ++ LOGO=fedora-logo-icon 00:00:40.978 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:38 00:00:40.978 ++ HOME_URL=https://fedoraproject.org/ 00:00:40.978 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f38/system-administrators-guide/ 00:00:40.978 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:00:40.978 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:00:40.978 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:00:40.978 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=38 00:00:40.978 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:00:40.978 ++ REDHAT_SUPPORT_PRODUCT_VERSION=38 00:00:40.978 ++ SUPPORT_END=2024-05-14 00:00:40.978 ++ VARIANT='Cloud Edition' 00:00:40.978 ++ VARIANT_ID=cloud 00:00:40.978 + uname -a 00:00:40.978 Linux spdk-wfp-05 6.7.0-68.fc38.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jan 15 00:59:40 UTC 2024 x86_64 GNU/Linux 00:00:40.978 + sudo /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh status 00:00:43.514 Hugepages 00:00:43.514 node hugesize free / total 00:00:43.514 node0 1048576kB 0 / 0 00:00:43.514 node0 2048kB 0 / 0 00:00:43.514 node1 1048576kB 0 / 0 00:00:43.514 node1 2048kB 0 / 0 00:00:43.514 00:00:43.514 Type BDF Vendor Device NUMA Driver Device Block devices 00:00:43.514 I/OAT 0000:00:04.0 8086 2021 0 ioatdma - - 00:00:43.514 I/OAT 0000:00:04.1 8086 2021 0 ioatdma - - 00:00:43.514 I/OAT 0000:00:04.2 8086 2021 0 ioatdma - - 00:00:43.515 I/OAT 0000:00:04.3 8086 2021 0 ioatdma - - 00:00:43.515 I/OAT 0000:00:04.4 8086 2021 0 ioatdma - - 00:00:43.515 I/OAT 0000:00:04.5 8086 2021 0 ioatdma - - 00:00:43.515 I/OAT 0000:00:04.6 8086 2021 0 ioatdma - - 00:00:43.515 I/OAT 0000:00:04.7 8086 2021 0 ioatdma - - 00:00:43.515 NVMe 0000:5f:00.0 8086 0a54 0 nvme nvme0 nvme0n1 00:00:43.515 I/OAT 0000:80:04.0 8086 2021 1 ioatdma - - 00:00:43.515 I/OAT 0000:80:04.1 8086 2021 1 ioatdma - - 00:00:43.515 I/OAT 0000:80:04.2 8086 2021 1 ioatdma - - 00:00:43.515 I/OAT 0000:80:04.3 8086 2021 1 ioatdma - - 00:00:43.515 I/OAT 0000:80:04.4 8086 2021 1 ioatdma - - 00:00:43.515 I/OAT 0000:80:04.5 8086 2021 1 ioatdma - - 00:00:43.515 I/OAT 0000:80:04.6 8086 2021 1 ioatdma - - 00:00:43.515 I/OAT 0000:80:04.7 8086 2021 1 ioatdma - - 00:00:43.515 + rm -f /tmp/spdk-ld-path 00:00:43.515 + source autorun-spdk.conf 00:00:43.515 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:00:43.515 ++ SPDK_TEST_NVMF=1 00:00:43.515 ++ SPDK_TEST_NVME_CLI=1 00:00:43.515 ++ SPDK_TEST_NVMF_NICS=mlx5 00:00:43.515 ++ SPDK_RUN_UBSAN=1 00:00:43.515 ++ NET_TYPE=phy 00:00:43.515 ++ RUN_NIGHTLY=0 00:00:43.515 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:00:43.515 + [[ -n '' ]] 00:00:43.515 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:00:43.515 + for M in /var/spdk/build-*-manifest.txt 00:00:43.515 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:00:43.515 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-phy-autotest/output/ 00:00:43.515 + for M in /var/spdk/build-*-manifest.txt 00:00:43.515 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:00:43.515 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-phy-autotest/output/ 00:00:43.515 ++ uname 00:00:43.515 + [[ Linux == \L\i\n\u\x ]] 00:00:43.515 + sudo dmesg -T 00:00:43.515 + sudo dmesg --clear 00:00:43.515 + dmesg_pid=3047173 00:00:43.515 + [[ Fedora Linux == FreeBSD ]] 00:00:43.515 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:00:43.515 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:00:43.515 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:00:43.515 + export VM_IMAGE=/var/spdk/dependencies/vhost/spdk_test_image.qcow2 00:00:43.515 + VM_IMAGE=/var/spdk/dependencies/vhost/spdk_test_image.qcow2 00:00:43.515 + [[ -x /usr/src/fio-static/fio ]] 00:00:43.515 + export FIO_BIN=/usr/src/fio-static/fio 00:00:43.515 + FIO_BIN=/usr/src/fio-static/fio 00:00:43.515 + sudo dmesg -Tw 00:00:43.515 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:00:43.515 + [[ ! -v VFIO_QEMU_BIN ]] 00:00:43.515 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:00:43.515 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:00:43.515 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:00:43.515 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:00:43.515 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:00:43.515 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:00:43.515 + spdk/autorun.sh /var/jenkins/workspace/nvmf-phy-autotest/autorun-spdk.conf 00:00:43.515 Test configuration: 00:00:43.515 SPDK_RUN_FUNCTIONAL_TEST=1 00:00:43.515 SPDK_TEST_NVMF=1 00:00:43.515 SPDK_TEST_NVME_CLI=1 00:00:43.515 SPDK_TEST_NVMF_NICS=mlx5 00:00:43.515 SPDK_RUN_UBSAN=1 00:00:43.515 NET_TYPE=phy 00:00:43.515 RUN_NIGHTLY=0 15:29:41 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:00:43.515 15:29:41 -- scripts/common.sh@508 -- $ [[ -e /bin/wpdk_common.sh ]] 00:00:43.515 15:29:41 -- scripts/common.sh@516 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:00:43.515 15:29:41 -- scripts/common.sh@517 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:00:43.515 15:29:41 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:43.515 15:29:41 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:43.515 15:29:41 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:43.515 15:29:41 -- paths/export.sh@5 -- $ export PATH 00:00:43.515 15:29:41 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:43.515 15:29:41 -- common/autobuild_common.sh@434 -- $ out=/var/jenkins/workspace/nvmf-phy-autotest/spdk/../output 00:00:43.515 15:29:41 -- common/autobuild_common.sh@435 -- $ date +%s 00:00:43.515 15:29:41 -- common/autobuild_common.sh@435 -- $ mktemp -dt spdk_1714138181.XXXXXX 00:00:43.515 15:29:41 -- common/autobuild_common.sh@435 -- $ SPDK_WORKSPACE=/tmp/spdk_1714138181.s9SPWO 00:00:43.515 15:29:41 -- common/autobuild_common.sh@437 -- $ [[ -n '' ]] 00:00:43.515 15:29:41 -- common/autobuild_common.sh@441 -- $ '[' -n '' ']' 00:00:43.515 15:29:41 -- common/autobuild_common.sh@444 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/' 00:00:43.515 15:29:41 -- common/autobuild_common.sh@448 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/xnvme --exclude /tmp' 00:00:43.515 15:29:41 -- common/autobuild_common.sh@450 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:00:43.515 15:29:41 -- common/autobuild_common.sh@451 -- $ get_config_params 00:00:43.515 15:29:41 -- common/autotest_common.sh@385 -- $ xtrace_disable 00:00:43.515 15:29:41 -- common/autotest_common.sh@10 -- $ set +x 00:00:43.515 15:29:41 -- common/autobuild_common.sh@451 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:00:43.515 15:29:41 -- common/autobuild_common.sh@453 -- $ start_monitor_resources 00:00:43.515 15:29:41 -- pm/common@17 -- $ local monitor 00:00:43.515 15:29:41 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:00:43.515 15:29:41 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=3047207 00:00:43.515 15:29:41 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:00:43.515 15:29:41 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=3047209 00:00:43.515 15:29:41 -- pm/common@21 -- $ date +%s 00:00:43.515 15:29:41 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:00:43.515 15:29:41 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=3047211 00:00:43.515 15:29:41 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:00:43.515 15:29:41 -- pm/common@21 -- $ date +%s 00:00:43.515 15:29:41 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=3047214 00:00:43.515 15:29:41 -- pm/common@21 -- $ date +%s 00:00:43.515 15:29:41 -- pm/common@26 -- $ sleep 1 00:00:43.515 15:29:41 -- pm/common@21 -- $ date +%s 00:00:43.515 15:29:41 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1714138181 00:00:43.515 15:29:41 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1714138181 00:00:43.515 15:29:41 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1714138181 00:00:43.515 15:29:41 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1714138181 00:00:43.515 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1714138181_collect-bmc-pm.bmc.pm.log 00:00:43.515 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1714138181_collect-vmstat.pm.log 00:00:43.515 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1714138181_collect-cpu-load.pm.log 00:00:43.515 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1714138181_collect-cpu-temp.pm.log 00:00:44.451 15:29:42 -- common/autobuild_common.sh@454 -- $ trap stop_monitor_resources EXIT 00:00:44.451 15:29:42 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:00:44.451 15:29:42 -- spdk/autobuild.sh@12 -- $ umask 022 00:00:44.451 15:29:42 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:00:44.451 15:29:42 -- spdk/autobuild.sh@16 -- $ date -u 00:00:44.451 Fri Apr 26 01:29:42 PM UTC 2024 00:00:44.451 15:29:42 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:00:44.451 v24.05-pre-450-gbca9154a0 00:00:44.451 15:29:42 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:00:44.451 15:29:42 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:00:44.451 15:29:42 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:00:44.451 15:29:42 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:00:44.451 15:29:42 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:00:44.451 15:29:42 -- common/autotest_common.sh@10 -- $ set +x 00:00:44.710 ************************************ 00:00:44.710 START TEST ubsan 00:00:44.710 ************************************ 00:00:44.710 15:29:43 -- common/autotest_common.sh@1111 -- $ echo 'using ubsan' 00:00:44.710 using ubsan 00:00:44.710 00:00:44.710 real 0m0.000s 00:00:44.710 user 0m0.000s 00:00:44.710 sys 0m0.000s 00:00:44.710 15:29:43 -- common/autotest_common.sh@1112 -- $ xtrace_disable 00:00:44.710 15:29:43 -- common/autotest_common.sh@10 -- $ set +x 00:00:44.710 ************************************ 00:00:44.710 END TEST ubsan 00:00:44.710 ************************************ 00:00:44.710 15:29:43 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:00:44.710 15:29:43 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:00:44.710 15:29:43 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:00:44.710 15:29:43 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:00:44.710 15:29:43 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:00:44.710 15:29:43 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:00:44.710 15:29:43 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:00:44.710 15:29:43 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:00:44.710 15:29:43 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-shared 00:00:44.710 Using default SPDK env in /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk 00:00:44.710 Using default DPDK in /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:00:44.968 Using 'verbs' RDMA provider 00:00:58.126 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-phy-autotest/spdk/.spdk-isal.log)...done. 00:01:10.342 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-phy-autotest/spdk/.spdk-isal-crypto.log)...done. 00:01:10.342 Creating mk/config.mk...done. 00:01:10.342 Creating mk/cc.flags.mk...done. 00:01:10.342 Type 'make' to build. 00:01:10.342 15:30:07 -- spdk/autobuild.sh@69 -- $ run_test make make -j96 00:01:10.342 15:30:07 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:10.342 15:30:07 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:10.342 15:30:07 -- common/autotest_common.sh@10 -- $ set +x 00:01:10.342 ************************************ 00:01:10.342 START TEST make 00:01:10.342 ************************************ 00:01:10.342 15:30:07 -- common/autotest_common.sh@1111 -- $ make -j96 00:01:10.342 make[1]: Nothing to be done for 'all'. 00:01:18.485 The Meson build system 00:01:18.485 Version: 1.3.1 00:01:18.485 Source dir: /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk 00:01:18.485 Build dir: /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build-tmp 00:01:18.485 Build type: native build 00:01:18.485 Program cat found: YES (/usr/bin/cat) 00:01:18.485 Project name: DPDK 00:01:18.485 Project version: 23.11.0 00:01:18.485 C compiler for the host machine: cc (gcc 13.2.1 "cc (GCC) 13.2.1 20231011 (Red Hat 13.2.1-4)") 00:01:18.485 C linker for the host machine: cc ld.bfd 2.39-16 00:01:18.485 Host machine cpu family: x86_64 00:01:18.485 Host machine cpu: x86_64 00:01:18.485 Message: ## Building in Developer Mode ## 00:01:18.485 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:18.485 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:01:18.485 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:01:18.485 Program python3 found: YES (/usr/bin/python3) 00:01:18.485 Program cat found: YES (/usr/bin/cat) 00:01:18.485 Compiler for C supports arguments -march=native: YES 00:01:18.485 Checking for size of "void *" : 8 00:01:18.485 Checking for size of "void *" : 8 (cached) 00:01:18.485 Library m found: YES 00:01:18.485 Library numa found: YES 00:01:18.485 Has header "numaif.h" : YES 00:01:18.485 Library fdt found: NO 00:01:18.485 Library execinfo found: NO 00:01:18.485 Has header "execinfo.h" : YES 00:01:18.485 Found pkg-config: YES (/usr/bin/pkg-config) 1.8.0 00:01:18.485 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:18.485 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:18.485 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:18.485 Run-time dependency openssl found: YES 3.0.9 00:01:18.485 Run-time dependency libpcap found: YES 1.10.4 00:01:18.485 Has header "pcap.h" with dependency libpcap: YES 00:01:18.485 Compiler for C supports arguments -Wcast-qual: YES 00:01:18.485 Compiler for C supports arguments -Wdeprecated: YES 00:01:18.485 Compiler for C supports arguments -Wformat: YES 00:01:18.485 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:18.485 Compiler for C supports arguments -Wformat-security: NO 00:01:18.485 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:18.485 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:18.485 Compiler for C supports arguments -Wnested-externs: YES 00:01:18.485 Compiler for C supports arguments -Wold-style-definition: YES 00:01:18.485 Compiler for C supports arguments -Wpointer-arith: YES 00:01:18.485 Compiler for C supports arguments -Wsign-compare: YES 00:01:18.485 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:18.485 Compiler for C supports arguments -Wundef: YES 00:01:18.485 Compiler for C supports arguments -Wwrite-strings: YES 00:01:18.485 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:18.485 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:18.485 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:18.485 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:18.485 Program objdump found: YES (/usr/bin/objdump) 00:01:18.485 Compiler for C supports arguments -mavx512f: YES 00:01:18.485 Checking if "AVX512 checking" compiles: YES 00:01:18.485 Fetching value of define "__SSE4_2__" : 1 00:01:18.485 Fetching value of define "__AES__" : 1 00:01:18.485 Fetching value of define "__AVX__" : 1 00:01:18.485 Fetching value of define "__AVX2__" : 1 00:01:18.485 Fetching value of define "__AVX512BW__" : 1 00:01:18.485 Fetching value of define "__AVX512CD__" : 1 00:01:18.485 Fetching value of define "__AVX512DQ__" : 1 00:01:18.485 Fetching value of define "__AVX512F__" : 1 00:01:18.485 Fetching value of define "__AVX512VL__" : 1 00:01:18.485 Fetching value of define "__PCLMUL__" : 1 00:01:18.485 Fetching value of define "__RDRND__" : 1 00:01:18.485 Fetching value of define "__RDSEED__" : 1 00:01:18.485 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:18.485 Fetching value of define "__znver1__" : (undefined) 00:01:18.485 Fetching value of define "__znver2__" : (undefined) 00:01:18.485 Fetching value of define "__znver3__" : (undefined) 00:01:18.485 Fetching value of define "__znver4__" : (undefined) 00:01:18.485 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:18.485 Message: lib/log: Defining dependency "log" 00:01:18.485 Message: lib/kvargs: Defining dependency "kvargs" 00:01:18.485 Message: lib/telemetry: Defining dependency "telemetry" 00:01:18.485 Checking for function "getentropy" : NO 00:01:18.485 Message: lib/eal: Defining dependency "eal" 00:01:18.485 Message: lib/ring: Defining dependency "ring" 00:01:18.485 Message: lib/rcu: Defining dependency "rcu" 00:01:18.485 Message: lib/mempool: Defining dependency "mempool" 00:01:18.485 Message: lib/mbuf: Defining dependency "mbuf" 00:01:18.485 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:18.485 Fetching value of define "__AVX512F__" : 1 (cached) 00:01:18.485 Fetching value of define "__AVX512BW__" : 1 (cached) 00:01:18.485 Fetching value of define "__AVX512DQ__" : 1 (cached) 00:01:18.485 Fetching value of define "__AVX512VL__" : 1 (cached) 00:01:18.485 Fetching value of define "__VPCLMULQDQ__" : (undefined) (cached) 00:01:18.485 Compiler for C supports arguments -mpclmul: YES 00:01:18.485 Compiler for C supports arguments -maes: YES 00:01:18.485 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:18.485 Compiler for C supports arguments -mavx512bw: YES 00:01:18.485 Compiler for C supports arguments -mavx512dq: YES 00:01:18.485 Compiler for C supports arguments -mavx512vl: YES 00:01:18.485 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:18.485 Compiler for C supports arguments -mavx2: YES 00:01:18.485 Compiler for C supports arguments -mavx: YES 00:01:18.485 Message: lib/net: Defining dependency "net" 00:01:18.485 Message: lib/meter: Defining dependency "meter" 00:01:18.485 Message: lib/ethdev: Defining dependency "ethdev" 00:01:18.485 Message: lib/pci: Defining dependency "pci" 00:01:18.485 Message: lib/cmdline: Defining dependency "cmdline" 00:01:18.485 Message: lib/hash: Defining dependency "hash" 00:01:18.485 Message: lib/timer: Defining dependency "timer" 00:01:18.485 Message: lib/compressdev: Defining dependency "compressdev" 00:01:18.485 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:18.485 Message: lib/dmadev: Defining dependency "dmadev" 00:01:18.485 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:18.485 Message: lib/power: Defining dependency "power" 00:01:18.485 Message: lib/reorder: Defining dependency "reorder" 00:01:18.485 Message: lib/security: Defining dependency "security" 00:01:18.485 Has header "linux/userfaultfd.h" : YES 00:01:18.485 Has header "linux/vduse.h" : YES 00:01:18.485 Message: lib/vhost: Defining dependency "vhost" 00:01:18.485 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:18.485 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:18.485 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:18.485 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:18.485 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:01:18.485 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:01:18.485 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:01:18.485 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:01:18.485 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:01:18.485 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:01:18.485 Program doxygen found: YES (/usr/bin/doxygen) 00:01:18.485 Configuring doxy-api-html.conf using configuration 00:01:18.485 Configuring doxy-api-man.conf using configuration 00:01:18.485 Program mandb found: YES (/usr/bin/mandb) 00:01:18.485 Program sphinx-build found: NO 00:01:18.485 Configuring rte_build_config.h using configuration 00:01:18.485 Message: 00:01:18.485 ================= 00:01:18.485 Applications Enabled 00:01:18.485 ================= 00:01:18.485 00:01:18.485 apps: 00:01:18.485 00:01:18.485 00:01:18.485 Message: 00:01:18.486 ================= 00:01:18.486 Libraries Enabled 00:01:18.486 ================= 00:01:18.486 00:01:18.486 libs: 00:01:18.486 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:18.486 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:01:18.486 cryptodev, dmadev, power, reorder, security, vhost, 00:01:18.486 00:01:18.486 Message: 00:01:18.486 =============== 00:01:18.486 Drivers Enabled 00:01:18.486 =============== 00:01:18.486 00:01:18.486 common: 00:01:18.486 00:01:18.486 bus: 00:01:18.486 pci, vdev, 00:01:18.486 mempool: 00:01:18.486 ring, 00:01:18.486 dma: 00:01:18.486 00:01:18.486 net: 00:01:18.486 00:01:18.486 crypto: 00:01:18.486 00:01:18.486 compress: 00:01:18.486 00:01:18.486 vdpa: 00:01:18.486 00:01:18.486 00:01:18.486 Message: 00:01:18.486 ================= 00:01:18.486 Content Skipped 00:01:18.486 ================= 00:01:18.486 00:01:18.486 apps: 00:01:18.486 dumpcap: explicitly disabled via build config 00:01:18.486 graph: explicitly disabled via build config 00:01:18.486 pdump: explicitly disabled via build config 00:01:18.486 proc-info: explicitly disabled via build config 00:01:18.486 test-acl: explicitly disabled via build config 00:01:18.486 test-bbdev: explicitly disabled via build config 00:01:18.486 test-cmdline: explicitly disabled via build config 00:01:18.486 test-compress-perf: explicitly disabled via build config 00:01:18.486 test-crypto-perf: explicitly disabled via build config 00:01:18.486 test-dma-perf: explicitly disabled via build config 00:01:18.486 test-eventdev: explicitly disabled via build config 00:01:18.486 test-fib: explicitly disabled via build config 00:01:18.486 test-flow-perf: explicitly disabled via build config 00:01:18.486 test-gpudev: explicitly disabled via build config 00:01:18.486 test-mldev: explicitly disabled via build config 00:01:18.486 test-pipeline: explicitly disabled via build config 00:01:18.486 test-pmd: explicitly disabled via build config 00:01:18.486 test-regex: explicitly disabled via build config 00:01:18.486 test-sad: explicitly disabled via build config 00:01:18.486 test-security-perf: explicitly disabled via build config 00:01:18.486 00:01:18.486 libs: 00:01:18.486 metrics: explicitly disabled via build config 00:01:18.486 acl: explicitly disabled via build config 00:01:18.486 bbdev: explicitly disabled via build config 00:01:18.486 bitratestats: explicitly disabled via build config 00:01:18.486 bpf: explicitly disabled via build config 00:01:18.486 cfgfile: explicitly disabled via build config 00:01:18.486 distributor: explicitly disabled via build config 00:01:18.486 efd: explicitly disabled via build config 00:01:18.486 eventdev: explicitly disabled via build config 00:01:18.486 dispatcher: explicitly disabled via build config 00:01:18.486 gpudev: explicitly disabled via build config 00:01:18.486 gro: explicitly disabled via build config 00:01:18.486 gso: explicitly disabled via build config 00:01:18.486 ip_frag: explicitly disabled via build config 00:01:18.486 jobstats: explicitly disabled via build config 00:01:18.486 latencystats: explicitly disabled via build config 00:01:18.486 lpm: explicitly disabled via build config 00:01:18.486 member: explicitly disabled via build config 00:01:18.486 pcapng: explicitly disabled via build config 00:01:18.486 rawdev: explicitly disabled via build config 00:01:18.486 regexdev: explicitly disabled via build config 00:01:18.486 mldev: explicitly disabled via build config 00:01:18.486 rib: explicitly disabled via build config 00:01:18.486 sched: explicitly disabled via build config 00:01:18.486 stack: explicitly disabled via build config 00:01:18.486 ipsec: explicitly disabled via build config 00:01:18.486 pdcp: explicitly disabled via build config 00:01:18.486 fib: explicitly disabled via build config 00:01:18.486 port: explicitly disabled via build config 00:01:18.486 pdump: explicitly disabled via build config 00:01:18.486 table: explicitly disabled via build config 00:01:18.486 pipeline: explicitly disabled via build config 00:01:18.486 graph: explicitly disabled via build config 00:01:18.486 node: explicitly disabled via build config 00:01:18.486 00:01:18.486 drivers: 00:01:18.486 common/cpt: not in enabled drivers build config 00:01:18.486 common/dpaax: not in enabled drivers build config 00:01:18.486 common/iavf: not in enabled drivers build config 00:01:18.486 common/idpf: not in enabled drivers build config 00:01:18.486 common/mvep: not in enabled drivers build config 00:01:18.486 common/octeontx: not in enabled drivers build config 00:01:18.486 bus/auxiliary: not in enabled drivers build config 00:01:18.486 bus/cdx: not in enabled drivers build config 00:01:18.486 bus/dpaa: not in enabled drivers build config 00:01:18.486 bus/fslmc: not in enabled drivers build config 00:01:18.486 bus/ifpga: not in enabled drivers build config 00:01:18.486 bus/platform: not in enabled drivers build config 00:01:18.486 bus/vmbus: not in enabled drivers build config 00:01:18.486 common/cnxk: not in enabled drivers build config 00:01:18.486 common/mlx5: not in enabled drivers build config 00:01:18.486 common/nfp: not in enabled drivers build config 00:01:18.486 common/qat: not in enabled drivers build config 00:01:18.486 common/sfc_efx: not in enabled drivers build config 00:01:18.486 mempool/bucket: not in enabled drivers build config 00:01:18.486 mempool/cnxk: not in enabled drivers build config 00:01:18.486 mempool/dpaa: not in enabled drivers build config 00:01:18.486 mempool/dpaa2: not in enabled drivers build config 00:01:18.486 mempool/octeontx: not in enabled drivers build config 00:01:18.486 mempool/stack: not in enabled drivers build config 00:01:18.486 dma/cnxk: not in enabled drivers build config 00:01:18.486 dma/dpaa: not in enabled drivers build config 00:01:18.486 dma/dpaa2: not in enabled drivers build config 00:01:18.486 dma/hisilicon: not in enabled drivers build config 00:01:18.486 dma/idxd: not in enabled drivers build config 00:01:18.486 dma/ioat: not in enabled drivers build config 00:01:18.486 dma/skeleton: not in enabled drivers build config 00:01:18.486 net/af_packet: not in enabled drivers build config 00:01:18.486 net/af_xdp: not in enabled drivers build config 00:01:18.486 net/ark: not in enabled drivers build config 00:01:18.486 net/atlantic: not in enabled drivers build config 00:01:18.486 net/avp: not in enabled drivers build config 00:01:18.486 net/axgbe: not in enabled drivers build config 00:01:18.486 net/bnx2x: not in enabled drivers build config 00:01:18.486 net/bnxt: not in enabled drivers build config 00:01:18.486 net/bonding: not in enabled drivers build config 00:01:18.486 net/cnxk: not in enabled drivers build config 00:01:18.486 net/cpfl: not in enabled drivers build config 00:01:18.486 net/cxgbe: not in enabled drivers build config 00:01:18.486 net/dpaa: not in enabled drivers build config 00:01:18.486 net/dpaa2: not in enabled drivers build config 00:01:18.486 net/e1000: not in enabled drivers build config 00:01:18.486 net/ena: not in enabled drivers build config 00:01:18.486 net/enetc: not in enabled drivers build config 00:01:18.486 net/enetfec: not in enabled drivers build config 00:01:18.486 net/enic: not in enabled drivers build config 00:01:18.486 net/failsafe: not in enabled drivers build config 00:01:18.486 net/fm10k: not in enabled drivers build config 00:01:18.486 net/gve: not in enabled drivers build config 00:01:18.486 net/hinic: not in enabled drivers build config 00:01:18.486 net/hns3: not in enabled drivers build config 00:01:18.486 net/i40e: not in enabled drivers build config 00:01:18.486 net/iavf: not in enabled drivers build config 00:01:18.486 net/ice: not in enabled drivers build config 00:01:18.486 net/idpf: not in enabled drivers build config 00:01:18.486 net/igc: not in enabled drivers build config 00:01:18.486 net/ionic: not in enabled drivers build config 00:01:18.486 net/ipn3ke: not in enabled drivers build config 00:01:18.486 net/ixgbe: not in enabled drivers build config 00:01:18.486 net/mana: not in enabled drivers build config 00:01:18.486 net/memif: not in enabled drivers build config 00:01:18.486 net/mlx4: not in enabled drivers build config 00:01:18.486 net/mlx5: not in enabled drivers build config 00:01:18.486 net/mvneta: not in enabled drivers build config 00:01:18.486 net/mvpp2: not in enabled drivers build config 00:01:18.486 net/netvsc: not in enabled drivers build config 00:01:18.486 net/nfb: not in enabled drivers build config 00:01:18.486 net/nfp: not in enabled drivers build config 00:01:18.486 net/ngbe: not in enabled drivers build config 00:01:18.486 net/null: not in enabled drivers build config 00:01:18.486 net/octeontx: not in enabled drivers build config 00:01:18.486 net/octeon_ep: not in enabled drivers build config 00:01:18.486 net/pcap: not in enabled drivers build config 00:01:18.486 net/pfe: not in enabled drivers build config 00:01:18.486 net/qede: not in enabled drivers build config 00:01:18.486 net/ring: not in enabled drivers build config 00:01:18.486 net/sfc: not in enabled drivers build config 00:01:18.486 net/softnic: not in enabled drivers build config 00:01:18.486 net/tap: not in enabled drivers build config 00:01:18.486 net/thunderx: not in enabled drivers build config 00:01:18.486 net/txgbe: not in enabled drivers build config 00:01:18.486 net/vdev_netvsc: not in enabled drivers build config 00:01:18.486 net/vhost: not in enabled drivers build config 00:01:18.486 net/virtio: not in enabled drivers build config 00:01:18.486 net/vmxnet3: not in enabled drivers build config 00:01:18.486 raw/*: missing internal dependency, "rawdev" 00:01:18.486 crypto/armv8: not in enabled drivers build config 00:01:18.487 crypto/bcmfs: not in enabled drivers build config 00:01:18.487 crypto/caam_jr: not in enabled drivers build config 00:01:18.487 crypto/ccp: not in enabled drivers build config 00:01:18.487 crypto/cnxk: not in enabled drivers build config 00:01:18.487 crypto/dpaa_sec: not in enabled drivers build config 00:01:18.487 crypto/dpaa2_sec: not in enabled drivers build config 00:01:18.487 crypto/ipsec_mb: not in enabled drivers build config 00:01:18.487 crypto/mlx5: not in enabled drivers build config 00:01:18.487 crypto/mvsam: not in enabled drivers build config 00:01:18.487 crypto/nitrox: not in enabled drivers build config 00:01:18.487 crypto/null: not in enabled drivers build config 00:01:18.487 crypto/octeontx: not in enabled drivers build config 00:01:18.487 crypto/openssl: not in enabled drivers build config 00:01:18.487 crypto/scheduler: not in enabled drivers build config 00:01:18.487 crypto/uadk: not in enabled drivers build config 00:01:18.487 crypto/virtio: not in enabled drivers build config 00:01:18.487 compress/isal: not in enabled drivers build config 00:01:18.487 compress/mlx5: not in enabled drivers build config 00:01:18.487 compress/octeontx: not in enabled drivers build config 00:01:18.487 compress/zlib: not in enabled drivers build config 00:01:18.487 regex/*: missing internal dependency, "regexdev" 00:01:18.487 ml/*: missing internal dependency, "mldev" 00:01:18.487 vdpa/ifc: not in enabled drivers build config 00:01:18.487 vdpa/mlx5: not in enabled drivers build config 00:01:18.487 vdpa/nfp: not in enabled drivers build config 00:01:18.487 vdpa/sfc: not in enabled drivers build config 00:01:18.487 event/*: missing internal dependency, "eventdev" 00:01:18.487 baseband/*: missing internal dependency, "bbdev" 00:01:18.487 gpu/*: missing internal dependency, "gpudev" 00:01:18.487 00:01:18.487 00:01:18.487 Build targets in project: 85 00:01:18.487 00:01:18.487 DPDK 23.11.0 00:01:18.487 00:01:18.487 User defined options 00:01:18.487 buildtype : debug 00:01:18.487 default_library : shared 00:01:18.487 libdir : lib 00:01:18.487 prefix : /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:01:18.487 c_args : -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds -fPIC -Werror 00:01:18.487 c_link_args : 00:01:18.487 cpu_instruction_set: native 00:01:18.487 disable_apps : test-acl,test-bbdev,test-crypto-perf,test-fib,test-pipeline,test-gpudev,test-flow-perf,pdump,dumpcap,test-sad,test-cmdline,test-eventdev,proc-info,test,test-dma-perf,test-pmd,test-mldev,test-compress-perf,test-security-perf,graph,test-regex 00:01:18.487 disable_libs : pipeline,member,eventdev,efd,bbdev,cfgfile,rib,sched,mldev,metrics,lpm,latencystats,pdump,pdcp,bpf,ipsec,fib,ip_frag,table,port,stack,gro,jobstats,regexdev,rawdev,pcapng,dispatcher,node,bitratestats,acl,gpudev,distributor,graph,gso 00:01:18.487 enable_docs : false 00:01:18.487 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:01:18.487 enable_kmods : false 00:01:18.487 tests : false 00:01:18.487 00:01:18.487 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:18.487 ninja: Entering directory `/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build-tmp' 00:01:18.487 [1/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:18.487 [2/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:18.487 [3/265] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:18.487 [4/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:18.487 [5/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:18.487 [6/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:18.487 [7/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:18.487 [8/265] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:18.487 [9/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:18.487 [10/265] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:18.487 [11/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:18.487 [12/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:18.487 [13/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:18.487 [14/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:18.487 [15/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:18.487 [16/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:18.487 [17/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:18.487 [18/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:18.487 [19/265] Linking static target lib/librte_log.a 00:01:18.487 [20/265] Linking static target lib/librte_kvargs.a 00:01:18.487 [21/265] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:18.487 [22/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:18.487 [23/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:18.487 [24/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:18.487 [25/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:18.487 [26/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:18.487 [27/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:18.487 [28/265] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:18.487 [29/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:18.487 [30/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:18.487 [31/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:18.487 [32/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:18.487 [33/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:18.487 [34/265] Linking static target lib/librte_pci.a 00:01:18.487 [35/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:18.487 [36/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:18.487 [37/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:18.746 [38/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:18.746 [39/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:18.746 [40/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:18.746 [41/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:18.746 [42/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:18.746 [43/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:18.746 [44/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:18.746 [45/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:18.746 [46/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:18.746 [47/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:18.746 [48/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:18.746 [49/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:18.746 [50/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:18.746 [51/265] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:18.746 [52/265] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:18.746 [53/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:18.746 [54/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:18.746 [55/265] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:18.746 [56/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:18.746 [57/265] Linking static target lib/librte_meter.a 00:01:18.746 [58/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:18.746 [59/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:18.746 [60/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:18.746 [61/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:18.746 [62/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:18.746 [63/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:18.746 [64/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:18.746 [65/265] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:18.746 [66/265] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:18.746 [67/265] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:18.746 [68/265] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:18.746 [69/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:18.746 [70/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:18.746 [71/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:18.746 [72/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:18.746 [73/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:18.746 [74/265] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:18.746 [75/265] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:18.746 [76/265] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:18.746 [77/265] Linking static target lib/librte_ring.a 00:01:18.746 [78/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:18.746 [79/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:18.746 [80/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:18.746 [81/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:18.746 [82/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:18.746 [83/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:18.746 [84/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:18.746 [85/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:18.746 [86/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:18.746 [87/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:18.746 [88/265] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:18.746 [89/265] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:18.746 [90/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:18.746 [91/265] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:18.746 [92/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:18.746 [93/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:18.746 [94/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:18.746 [95/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:19.006 [96/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:19.006 [97/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:19.006 [98/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:19.006 [99/265] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:19.006 [100/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:19.006 [101/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:19.006 [102/265] Linking static target lib/librte_telemetry.a 00:01:19.006 [103/265] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:19.006 [104/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:19.006 [105/265] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:19.006 [106/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:19.006 [107/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:19.006 [108/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:19.006 [109/265] Linking static target lib/librte_net.a 00:01:19.006 [110/265] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:19.006 [111/265] Linking static target lib/librte_cmdline.a 00:01:19.006 [112/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:19.006 [113/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:19.006 [114/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:19.006 [115/265] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:19.006 [116/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:19.006 [117/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:19.006 [118/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:19.006 [119/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:19.006 [120/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:19.006 [121/265] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:19.006 [122/265] Linking static target lib/librte_rcu.a 00:01:19.006 [123/265] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:19.006 [124/265] Linking static target lib/librte_timer.a 00:01:19.006 [125/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:19.006 [126/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:19.006 [127/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:19.006 [128/265] Linking static target lib/librte_mempool.a 00:01:19.006 [129/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:19.006 [130/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:19.006 [131/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:19.006 [132/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:19.006 [133/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:19.006 [134/265] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:19.006 [135/265] Linking static target lib/librte_eal.a 00:01:19.006 [136/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:19.006 [137/265] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:19.006 [138/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:19.006 [139/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:19.006 [140/265] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:19.006 [141/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:19.006 [142/265] Linking target lib/librte_log.so.24.0 00:01:19.006 [143/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:19.006 [144/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:19.006 [145/265] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:19.006 [146/265] Linking static target lib/librte_mbuf.a 00:01:19.265 [147/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:19.265 [148/265] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:19.265 [149/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:19.265 [150/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:19.265 [151/265] Linking static target lib/librte_compressdev.a 00:01:19.265 [152/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:19.265 [153/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:19.265 [154/265] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:19.265 [155/265] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:19.265 [156/265] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:19.265 [157/265] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:19.265 [158/265] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:19.265 [159/265] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:19.265 [160/265] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:19.265 [161/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:19.265 [162/265] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:19.265 [163/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:19.265 [164/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:19.265 [165/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:19.265 [166/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:19.265 [167/265] Linking target lib/librte_kvargs.so.24.0 00:01:19.265 [168/265] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:19.265 [169/265] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:19.265 [170/265] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:19.265 [171/265] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:19.265 [172/265] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:19.265 [173/265] Linking static target lib/librte_reorder.a 00:01:19.265 [174/265] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:19.265 [175/265] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:19.265 [176/265] Linking static target lib/librte_hash.a 00:01:19.266 [177/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:19.266 [178/265] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:19.266 [179/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:19.266 [180/265] Linking static target lib/librte_dmadev.a 00:01:19.524 [181/265] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:19.524 [182/265] Linking target lib/librte_telemetry.so.24.0 00:01:19.524 [183/265] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:19.524 [184/265] Linking static target lib/librte_security.a 00:01:19.524 [185/265] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:19.524 [186/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:19.524 [187/265] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:19.524 [188/265] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:19.524 [189/265] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:19.524 [190/265] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:19.524 [191/265] Linking static target drivers/librte_bus_vdev.a 00:01:19.524 [192/265] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:19.524 [193/265] Linking static target lib/librte_power.a 00:01:19.524 [194/265] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:19.524 [195/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:19.524 [196/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:19.524 [197/265] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:19.524 [198/265] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:19.524 [199/265] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:19.524 [200/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:19.524 [201/265] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:19.784 [202/265] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:19.784 [203/265] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:19.784 [204/265] Linking static target drivers/librte_bus_pci.a 00:01:19.784 [205/265] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:19.784 [206/265] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:19.784 [207/265] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:19.784 [208/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:19.784 [209/265] Linking static target drivers/librte_mempool_ring.a 00:01:19.784 [210/265] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:19.784 [211/265] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:19.784 [212/265] Linking static target lib/librte_cryptodev.a 00:01:19.784 [213/265] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:19.784 [214/265] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:19.784 [215/265] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:19.784 [216/265] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:20.042 [217/265] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:20.042 [218/265] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:20.042 [219/265] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:20.042 [220/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:20.042 [221/265] Linking static target lib/librte_ethdev.a 00:01:20.042 [222/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:01:20.301 [223/265] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:20.301 [224/265] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:21.237 [225/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:01:21.237 [226/265] Linking static target lib/librte_vhost.a 00:01:21.496 [227/265] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:23.404 [228/265] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:01:27.613 [229/265] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:28.991 [230/265] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:28.991 [231/265] Linking target lib/librte_eal.so.24.0 00:01:29.249 [232/265] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:01:29.249 [233/265] Linking target lib/librte_ring.so.24.0 00:01:29.249 [234/265] Linking target lib/librte_meter.so.24.0 00:01:29.249 [235/265] Linking target lib/librte_timer.so.24.0 00:01:29.249 [236/265] Linking target drivers/librte_bus_vdev.so.24.0 00:01:29.249 [237/265] Linking target lib/librte_pci.so.24.0 00:01:29.249 [238/265] Linking target lib/librte_dmadev.so.24.0 00:01:29.249 [239/265] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:01:29.249 [240/265] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:01:29.249 [241/265] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:01:29.249 [242/265] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:01:29.249 [243/265] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:01:29.507 [244/265] Linking target lib/librte_rcu.so.24.0 00:01:29.507 [245/265] Linking target lib/librte_mempool.so.24.0 00:01:29.507 [246/265] Linking target drivers/librte_bus_pci.so.24.0 00:01:29.507 [247/265] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:01:29.507 [248/265] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:01:29.507 [249/265] Linking target lib/librte_mbuf.so.24.0 00:01:29.507 [250/265] Linking target drivers/librte_mempool_ring.so.24.0 00:01:29.766 [251/265] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:01:29.766 [252/265] Linking target lib/librte_net.so.24.0 00:01:29.766 [253/265] Linking target lib/librte_compressdev.so.24.0 00:01:29.766 [254/265] Linking target lib/librte_cryptodev.so.24.0 00:01:29.766 [255/265] Linking target lib/librte_reorder.so.24.0 00:01:29.766 [256/265] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:01:29.766 [257/265] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:01:30.025 [258/265] Linking target lib/librte_hash.so.24.0 00:01:30.025 [259/265] Linking target lib/librte_cmdline.so.24.0 00:01:30.025 [260/265] Linking target lib/librte_security.so.24.0 00:01:30.025 [261/265] Linking target lib/librte_ethdev.so.24.0 00:01:30.025 [262/265] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:01:30.025 [263/265] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:01:30.025 [264/265] Linking target lib/librte_power.so.24.0 00:01:30.025 [265/265] Linking target lib/librte_vhost.so.24.0 00:01:30.025 INFO: autodetecting backend as ninja 00:01:30.025 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build-tmp -j 96 00:01:31.032 CC lib/ut_mock/mock.o 00:01:31.032 CC lib/log/log.o 00:01:31.032 CC lib/log/log_flags.o 00:01:31.032 CC lib/log/log_deprecated.o 00:01:31.032 CC lib/ut/ut.o 00:01:31.290 LIB libspdk_ut_mock.a 00:01:31.290 LIB libspdk_log.a 00:01:31.290 SO libspdk_ut_mock.so.6.0 00:01:31.290 LIB libspdk_ut.a 00:01:31.290 SO libspdk_log.so.7.0 00:01:31.290 SYMLINK libspdk_ut_mock.so 00:01:31.290 SO libspdk_ut.so.2.0 00:01:31.290 SYMLINK libspdk_log.so 00:01:31.290 SYMLINK libspdk_ut.so 00:01:31.549 CC lib/util/base64.o 00:01:31.549 CC lib/util/cpuset.o 00:01:31.549 CC lib/util/bit_array.o 00:01:31.549 CC lib/util/crc16.o 00:01:31.549 CC lib/util/crc32.o 00:01:31.549 CC lib/util/crc32c.o 00:01:31.549 CC lib/util/crc64.o 00:01:31.549 CC lib/util/crc32_ieee.o 00:01:31.549 CC lib/util/dif.o 00:01:31.549 CC lib/util/file.o 00:01:31.549 CC lib/util/fd.o 00:01:31.549 CC lib/util/iov.o 00:01:31.549 CC lib/util/hexlify.o 00:01:31.549 CC lib/util/math.o 00:01:31.549 CC lib/dma/dma.o 00:01:31.549 CC lib/util/pipe.o 00:01:31.549 CC lib/util/strerror_tls.o 00:01:31.549 CC lib/util/fd_group.o 00:01:31.549 CC lib/util/string.o 00:01:31.549 CC lib/util/uuid.o 00:01:31.549 CC lib/util/xor.o 00:01:31.549 CC lib/util/zipf.o 00:01:31.549 CXX lib/trace_parser/trace.o 00:01:31.549 CC lib/ioat/ioat.o 00:01:31.808 CC lib/vfio_user/host/vfio_user_pci.o 00:01:31.808 CC lib/vfio_user/host/vfio_user.o 00:01:31.808 LIB libspdk_dma.a 00:01:31.808 SO libspdk_dma.so.4.0 00:01:31.808 SYMLINK libspdk_dma.so 00:01:31.808 LIB libspdk_ioat.a 00:01:32.066 LIB libspdk_vfio_user.a 00:01:32.066 SO libspdk_ioat.so.7.0 00:01:32.066 SO libspdk_vfio_user.so.5.0 00:01:32.066 LIB libspdk_util.a 00:01:32.066 SYMLINK libspdk_ioat.so 00:01:32.066 SYMLINK libspdk_vfio_user.so 00:01:32.066 SO libspdk_util.so.9.0 00:01:32.066 SYMLINK libspdk_util.so 00:01:32.324 LIB libspdk_trace_parser.a 00:01:32.324 SO libspdk_trace_parser.so.5.0 00:01:32.324 SYMLINK libspdk_trace_parser.so 00:01:32.583 CC lib/env_dpdk/env.o 00:01:32.583 CC lib/env_dpdk/memory.o 00:01:32.583 CC lib/env_dpdk/pci.o 00:01:32.583 CC lib/env_dpdk/init.o 00:01:32.583 CC lib/env_dpdk/threads.o 00:01:32.583 CC lib/env_dpdk/pci_virtio.o 00:01:32.583 CC lib/env_dpdk/pci_ioat.o 00:01:32.583 CC lib/env_dpdk/pci_vmd.o 00:01:32.583 CC lib/env_dpdk/pci_idxd.o 00:01:32.583 CC lib/env_dpdk/pci_event.o 00:01:32.583 CC lib/env_dpdk/sigbus_handler.o 00:01:32.583 CC lib/env_dpdk/pci_dpdk.o 00:01:32.583 CC lib/env_dpdk/pci_dpdk_2211.o 00:01:32.583 CC lib/env_dpdk/pci_dpdk_2207.o 00:01:32.583 CC lib/vmd/vmd.o 00:01:32.583 CC lib/vmd/led.o 00:01:32.583 CC lib/json/json_parse.o 00:01:32.583 CC lib/json/json_util.o 00:01:32.583 CC lib/json/json_write.o 00:01:32.583 CC lib/conf/conf.o 00:01:32.583 CC lib/idxd/idxd.o 00:01:32.583 CC lib/idxd/idxd_user.o 00:01:32.583 CC lib/rdma/common.o 00:01:32.583 CC lib/rdma/rdma_verbs.o 00:01:32.583 LIB libspdk_conf.a 00:01:32.842 SO libspdk_conf.so.6.0 00:01:32.842 LIB libspdk_json.a 00:01:32.842 LIB libspdk_rdma.a 00:01:32.842 SYMLINK libspdk_conf.so 00:01:32.842 SO libspdk_rdma.so.6.0 00:01:32.842 SO libspdk_json.so.6.0 00:01:32.842 SYMLINK libspdk_rdma.so 00:01:32.842 SYMLINK libspdk_json.so 00:01:32.842 LIB libspdk_idxd.a 00:01:32.842 SO libspdk_idxd.so.12.0 00:01:32.842 LIB libspdk_vmd.a 00:01:33.100 SO libspdk_vmd.so.6.0 00:01:33.100 SYMLINK libspdk_idxd.so 00:01:33.100 SYMLINK libspdk_vmd.so 00:01:33.100 CC lib/jsonrpc/jsonrpc_server.o 00:01:33.100 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:01:33.100 CC lib/jsonrpc/jsonrpc_client.o 00:01:33.100 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:01:33.359 LIB libspdk_jsonrpc.a 00:01:33.359 SO libspdk_jsonrpc.so.6.0 00:01:33.359 LIB libspdk_env_dpdk.a 00:01:33.359 SYMLINK libspdk_jsonrpc.so 00:01:33.618 SO libspdk_env_dpdk.so.14.0 00:01:33.618 SYMLINK libspdk_env_dpdk.so 00:01:33.618 CC lib/rpc/rpc.o 00:01:33.877 LIB libspdk_rpc.a 00:01:33.877 SO libspdk_rpc.so.6.0 00:01:33.877 SYMLINK libspdk_rpc.so 00:01:34.444 CC lib/trace/trace.o 00:01:34.444 CC lib/trace/trace_rpc.o 00:01:34.444 CC lib/trace/trace_flags.o 00:01:34.444 CC lib/keyring/keyring_rpc.o 00:01:34.444 CC lib/keyring/keyring.o 00:01:34.444 CC lib/notify/notify.o 00:01:34.444 CC lib/notify/notify_rpc.o 00:01:34.444 LIB libspdk_notify.a 00:01:34.444 LIB libspdk_trace.a 00:01:34.444 LIB libspdk_keyring.a 00:01:34.444 SO libspdk_notify.so.6.0 00:01:34.444 SO libspdk_trace.so.10.0 00:01:34.444 SO libspdk_keyring.so.1.0 00:01:34.444 SYMLINK libspdk_notify.so 00:01:34.444 SYMLINK libspdk_trace.so 00:01:34.444 SYMLINK libspdk_keyring.so 00:01:35.012 CC lib/thread/thread.o 00:01:35.012 CC lib/thread/iobuf.o 00:01:35.012 CC lib/sock/sock.o 00:01:35.012 CC lib/sock/sock_rpc.o 00:01:35.271 LIB libspdk_sock.a 00:01:35.271 SO libspdk_sock.so.9.0 00:01:35.271 SYMLINK libspdk_sock.so 00:01:35.529 CC lib/nvme/nvme_ctrlr_cmd.o 00:01:35.529 CC lib/nvme/nvme_ctrlr.o 00:01:35.529 CC lib/nvme/nvme_ns_cmd.o 00:01:35.529 CC lib/nvme/nvme_fabric.o 00:01:35.529 CC lib/nvme/nvme_ns.o 00:01:35.529 CC lib/nvme/nvme_pcie_common.o 00:01:35.529 CC lib/nvme/nvme_qpair.o 00:01:35.529 CC lib/nvme/nvme_pcie.o 00:01:35.529 CC lib/nvme/nvme_quirks.o 00:01:35.529 CC lib/nvme/nvme.o 00:01:35.529 CC lib/nvme/nvme_transport.o 00:01:35.529 CC lib/nvme/nvme_discovery.o 00:01:35.529 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:01:35.529 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:01:35.529 CC lib/nvme/nvme_tcp.o 00:01:35.529 CC lib/nvme/nvme_opal.o 00:01:35.529 CC lib/nvme/nvme_io_msg.o 00:01:35.529 CC lib/nvme/nvme_poll_group.o 00:01:35.529 CC lib/nvme/nvme_zns.o 00:01:35.529 CC lib/nvme/nvme_stubs.o 00:01:35.529 CC lib/nvme/nvme_auth.o 00:01:35.529 CC lib/nvme/nvme_cuse.o 00:01:35.529 CC lib/nvme/nvme_rdma.o 00:01:35.787 LIB libspdk_thread.a 00:01:36.045 SO libspdk_thread.so.10.0 00:01:36.045 SYMLINK libspdk_thread.so 00:01:36.303 CC lib/virtio/virtio.o 00:01:36.303 CC lib/virtio/virtio_vfio_user.o 00:01:36.303 CC lib/virtio/virtio_vhost_user.o 00:01:36.303 CC lib/virtio/virtio_pci.o 00:01:36.303 CC lib/accel/accel_rpc.o 00:01:36.303 CC lib/accel/accel.o 00:01:36.303 CC lib/accel/accel_sw.o 00:01:36.303 CC lib/blob/blobstore.o 00:01:36.303 CC lib/blob/request.o 00:01:36.303 CC lib/blob/zeroes.o 00:01:36.303 CC lib/blob/blob_bs_dev.o 00:01:36.303 CC lib/init/json_config.o 00:01:36.303 CC lib/init/subsystem.o 00:01:36.303 CC lib/init/subsystem_rpc.o 00:01:36.303 CC lib/init/rpc.o 00:01:36.561 LIB libspdk_init.a 00:01:36.561 LIB libspdk_virtio.a 00:01:36.561 SO libspdk_init.so.5.0 00:01:36.561 SO libspdk_virtio.so.7.0 00:01:36.561 SYMLINK libspdk_init.so 00:01:36.561 SYMLINK libspdk_virtio.so 00:01:36.820 CC lib/event/app.o 00:01:36.820 CC lib/event/reactor.o 00:01:36.820 CC lib/event/log_rpc.o 00:01:36.820 CC lib/event/app_rpc.o 00:01:36.820 CC lib/event/scheduler_static.o 00:01:37.079 LIB libspdk_accel.a 00:01:37.079 SO libspdk_accel.so.15.0 00:01:37.079 SYMLINK libspdk_accel.so 00:01:37.079 LIB libspdk_nvme.a 00:01:37.079 LIB libspdk_event.a 00:01:37.079 SO libspdk_event.so.13.0 00:01:37.338 SO libspdk_nvme.so.13.0 00:01:37.338 SYMLINK libspdk_event.so 00:01:37.338 CC lib/bdev/bdev.o 00:01:37.338 CC lib/bdev/bdev_rpc.o 00:01:37.338 CC lib/bdev/bdev_zone.o 00:01:37.338 CC lib/bdev/part.o 00:01:37.338 CC lib/bdev/scsi_nvme.o 00:01:37.338 SYMLINK libspdk_nvme.so 00:01:38.274 LIB libspdk_blob.a 00:01:38.274 SO libspdk_blob.so.11.0 00:01:38.274 SYMLINK libspdk_blob.so 00:01:38.532 CC lib/lvol/lvol.o 00:01:38.532 CC lib/blobfs/blobfs.o 00:01:38.532 CC lib/blobfs/tree.o 00:01:39.099 LIB libspdk_bdev.a 00:01:39.099 LIB libspdk_blobfs.a 00:01:39.099 SO libspdk_bdev.so.15.0 00:01:39.099 LIB libspdk_lvol.a 00:01:39.099 SO libspdk_blobfs.so.10.0 00:01:39.357 SO libspdk_lvol.so.10.0 00:01:39.357 SYMLINK libspdk_bdev.so 00:01:39.357 SYMLINK libspdk_lvol.so 00:01:39.357 SYMLINK libspdk_blobfs.so 00:01:39.615 CC lib/scsi/dev.o 00:01:39.615 CC lib/scsi/lun.o 00:01:39.615 CC lib/scsi/port.o 00:01:39.615 CC lib/nbd/nbd.o 00:01:39.615 CC lib/scsi/scsi.o 00:01:39.615 CC lib/scsi/scsi_bdev.o 00:01:39.615 CC lib/nbd/nbd_rpc.o 00:01:39.615 CC lib/scsi/scsi_pr.o 00:01:39.615 CC lib/scsi/scsi_rpc.o 00:01:39.615 CC lib/nvmf/ctrlr.o 00:01:39.615 CC lib/scsi/task.o 00:01:39.615 CC lib/nvmf/ctrlr_discovery.o 00:01:39.615 CC lib/nvmf/ctrlr_bdev.o 00:01:39.615 CC lib/nvmf/subsystem.o 00:01:39.615 CC lib/nvmf/nvmf.o 00:01:39.615 CC lib/nvmf/nvmf_rpc.o 00:01:39.615 CC lib/nvmf/transport.o 00:01:39.615 CC lib/nvmf/tcp.o 00:01:39.615 CC lib/nvmf/rdma.o 00:01:39.615 CC lib/ftl/ftl_core.o 00:01:39.615 CC lib/ftl/ftl_init.o 00:01:39.615 CC lib/ftl/ftl_layout.o 00:01:39.615 CC lib/ftl/ftl_debug.o 00:01:39.615 CC lib/ftl/ftl_io.o 00:01:39.615 CC lib/ftl/ftl_sb.o 00:01:39.615 CC lib/ftl/ftl_l2p.o 00:01:39.615 CC lib/ftl/ftl_l2p_flat.o 00:01:39.615 CC lib/ftl/ftl_nv_cache.o 00:01:39.615 CC lib/ftl/ftl_band.o 00:01:39.615 CC lib/ftl/ftl_band_ops.o 00:01:39.615 CC lib/ftl/ftl_writer.o 00:01:39.615 CC lib/ftl/ftl_rq.o 00:01:39.615 CC lib/ftl/ftl_reloc.o 00:01:39.615 CC lib/ftl/ftl_l2p_cache.o 00:01:39.615 CC lib/ftl/ftl_p2l.o 00:01:39.615 CC lib/ftl/mngt/ftl_mngt.o 00:01:39.615 CC lib/ublk/ublk.o 00:01:39.615 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:01:39.615 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:01:39.615 CC lib/ftl/mngt/ftl_mngt_startup.o 00:01:39.615 CC lib/ublk/ublk_rpc.o 00:01:39.615 CC lib/ftl/mngt/ftl_mngt_md.o 00:01:39.615 CC lib/ftl/mngt/ftl_mngt_misc.o 00:01:39.615 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:01:39.615 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:01:39.615 CC lib/ftl/mngt/ftl_mngt_band.o 00:01:39.615 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:01:39.615 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:01:39.615 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:01:39.615 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:01:39.615 CC lib/ftl/utils/ftl_md.o 00:01:39.615 CC lib/ftl/utils/ftl_conf.o 00:01:39.615 CC lib/ftl/utils/ftl_mempool.o 00:01:39.615 CC lib/ftl/utils/ftl_bitmap.o 00:01:39.615 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:01:39.615 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:01:39.615 CC lib/ftl/utils/ftl_property.o 00:01:39.615 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:01:39.615 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:01:39.615 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:01:39.615 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:01:39.615 CC lib/ftl/upgrade/ftl_sb_v3.o 00:01:39.615 CC lib/ftl/upgrade/ftl_sb_v5.o 00:01:39.615 CC lib/ftl/nvc/ftl_nvc_dev.o 00:01:39.615 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:01:39.615 CC lib/ftl/base/ftl_base_dev.o 00:01:39.615 CC lib/ftl/base/ftl_base_bdev.o 00:01:39.615 CC lib/ftl/ftl_trace.o 00:01:40.180 LIB libspdk_nbd.a 00:01:40.180 SO libspdk_nbd.so.7.0 00:01:40.180 LIB libspdk_scsi.a 00:01:40.180 SYMLINK libspdk_nbd.so 00:01:40.180 SO libspdk_scsi.so.9.0 00:01:40.180 SYMLINK libspdk_scsi.so 00:01:40.180 LIB libspdk_ublk.a 00:01:40.438 SO libspdk_ublk.so.3.0 00:01:40.438 SYMLINK libspdk_ublk.so 00:01:40.438 LIB libspdk_ftl.a 00:01:40.438 CC lib/vhost/vhost.o 00:01:40.438 CC lib/vhost/vhost_rpc.o 00:01:40.438 CC lib/vhost/rte_vhost_user.o 00:01:40.438 CC lib/vhost/vhost_scsi.o 00:01:40.438 CC lib/vhost/vhost_blk.o 00:01:40.696 SO libspdk_ftl.so.9.0 00:01:40.696 CC lib/iscsi/conn.o 00:01:40.696 CC lib/iscsi/init_grp.o 00:01:40.696 CC lib/iscsi/md5.o 00:01:40.696 CC lib/iscsi/iscsi.o 00:01:40.696 CC lib/iscsi/param.o 00:01:40.696 CC lib/iscsi/portal_grp.o 00:01:40.696 CC lib/iscsi/tgt_node.o 00:01:40.696 CC lib/iscsi/iscsi_rpc.o 00:01:40.696 CC lib/iscsi/iscsi_subsystem.o 00:01:40.696 CC lib/iscsi/task.o 00:01:40.954 SYMLINK libspdk_ftl.so 00:01:41.213 LIB libspdk_nvmf.a 00:01:41.213 SO libspdk_nvmf.so.18.0 00:01:41.472 LIB libspdk_vhost.a 00:01:41.472 SO libspdk_vhost.so.8.0 00:01:41.472 SYMLINK libspdk_nvmf.so 00:01:41.472 SYMLINK libspdk_vhost.so 00:01:41.472 LIB libspdk_iscsi.a 00:01:41.472 SO libspdk_iscsi.so.8.0 00:01:41.731 SYMLINK libspdk_iscsi.so 00:01:42.299 CC module/env_dpdk/env_dpdk_rpc.o 00:01:42.299 CC module/blob/bdev/blob_bdev.o 00:01:42.299 CC module/sock/posix/posix.o 00:01:42.299 CC module/accel/iaa/accel_iaa.o 00:01:42.299 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:01:42.299 LIB libspdk_env_dpdk_rpc.a 00:01:42.299 CC module/accel/iaa/accel_iaa_rpc.o 00:01:42.299 CC module/keyring/file/keyring.o 00:01:42.299 CC module/keyring/file/keyring_rpc.o 00:01:42.299 CC module/accel/error/accel_error.o 00:01:42.299 CC module/accel/error/accel_error_rpc.o 00:01:42.300 CC module/scheduler/dynamic/scheduler_dynamic.o 00:01:42.300 CC module/scheduler/gscheduler/gscheduler.o 00:01:42.300 CC module/accel/ioat/accel_ioat.o 00:01:42.300 CC module/accel/dsa/accel_dsa.o 00:01:42.300 CC module/accel/ioat/accel_ioat_rpc.o 00:01:42.300 CC module/accel/dsa/accel_dsa_rpc.o 00:01:42.300 SO libspdk_env_dpdk_rpc.so.6.0 00:01:42.300 SYMLINK libspdk_env_dpdk_rpc.so 00:01:42.559 LIB libspdk_scheduler_gscheduler.a 00:01:42.559 LIB libspdk_keyring_file.a 00:01:42.559 LIB libspdk_scheduler_dpdk_governor.a 00:01:42.559 LIB libspdk_accel_error.a 00:01:42.559 SO libspdk_scheduler_gscheduler.so.4.0 00:01:42.559 SO libspdk_keyring_file.so.1.0 00:01:42.559 LIB libspdk_accel_iaa.a 00:01:42.559 LIB libspdk_accel_ioat.a 00:01:42.559 LIB libspdk_scheduler_dynamic.a 00:01:42.559 SO libspdk_scheduler_dpdk_governor.so.4.0 00:01:42.559 SO libspdk_accel_error.so.2.0 00:01:42.559 LIB libspdk_accel_dsa.a 00:01:42.559 SYMLINK libspdk_scheduler_gscheduler.so 00:01:42.559 SO libspdk_accel_ioat.so.6.0 00:01:42.559 SO libspdk_accel_iaa.so.3.0 00:01:42.559 SO libspdk_scheduler_dynamic.so.4.0 00:01:42.559 LIB libspdk_blob_bdev.a 00:01:42.559 SYMLINK libspdk_scheduler_dpdk_governor.so 00:01:42.559 SYMLINK libspdk_keyring_file.so 00:01:42.559 SO libspdk_accel_dsa.so.5.0 00:01:42.559 SO libspdk_blob_bdev.so.11.0 00:01:42.559 SYMLINK libspdk_accel_error.so 00:01:42.559 SYMLINK libspdk_scheduler_dynamic.so 00:01:42.559 SYMLINK libspdk_accel_ioat.so 00:01:42.559 SYMLINK libspdk_accel_iaa.so 00:01:42.559 SYMLINK libspdk_blob_bdev.so 00:01:42.559 SYMLINK libspdk_accel_dsa.so 00:01:42.818 LIB libspdk_sock_posix.a 00:01:42.818 SO libspdk_sock_posix.so.6.0 00:01:43.077 SYMLINK libspdk_sock_posix.so 00:01:43.077 CC module/blobfs/bdev/blobfs_bdev.o 00:01:43.077 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:01:43.077 CC module/bdev/split/vbdev_split.o 00:01:43.077 CC module/bdev/split/vbdev_split_rpc.o 00:01:43.077 CC module/bdev/ftl/bdev_ftl.o 00:01:43.077 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:01:43.077 CC module/bdev/ftl/bdev_ftl_rpc.o 00:01:43.077 CC module/bdev/iscsi/bdev_iscsi.o 00:01:43.077 CC module/bdev/nvme/bdev_nvme_rpc.o 00:01:43.077 CC module/bdev/nvme/bdev_nvme.o 00:01:43.077 CC module/bdev/zone_block/vbdev_zone_block.o 00:01:43.077 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:01:43.077 CC module/bdev/nvme/nvme_rpc.o 00:01:43.077 CC module/bdev/nvme/vbdev_opal_rpc.o 00:01:43.077 CC module/bdev/nvme/bdev_mdns_client.o 00:01:43.077 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:01:43.077 CC module/bdev/lvol/vbdev_lvol.o 00:01:43.077 CC module/bdev/nvme/vbdev_opal.o 00:01:43.077 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:01:43.077 CC module/bdev/passthru/vbdev_passthru.o 00:01:43.077 CC module/bdev/aio/bdev_aio.o 00:01:43.077 CC module/bdev/null/bdev_null.o 00:01:43.077 CC module/bdev/malloc/bdev_malloc.o 00:01:43.077 CC module/bdev/null/bdev_null_rpc.o 00:01:43.077 CC module/bdev/error/vbdev_error.o 00:01:43.077 CC module/bdev/gpt/gpt.o 00:01:43.077 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:01:43.077 CC module/bdev/gpt/vbdev_gpt.o 00:01:43.077 CC module/bdev/malloc/bdev_malloc_rpc.o 00:01:43.077 CC module/bdev/raid/bdev_raid.o 00:01:43.077 CC module/bdev/aio/bdev_aio_rpc.o 00:01:43.077 CC module/bdev/delay/vbdev_delay_rpc.o 00:01:43.077 CC module/bdev/error/vbdev_error_rpc.o 00:01:43.077 CC module/bdev/delay/vbdev_delay.o 00:01:43.077 CC module/bdev/virtio/bdev_virtio_blk.o 00:01:43.077 CC module/bdev/virtio/bdev_virtio_scsi.o 00:01:43.077 CC module/bdev/virtio/bdev_virtio_rpc.o 00:01:43.077 CC module/bdev/raid/bdev_raid_rpc.o 00:01:43.077 CC module/bdev/raid/bdev_raid_sb.o 00:01:43.077 CC module/bdev/raid/raid0.o 00:01:43.077 CC module/bdev/raid/raid1.o 00:01:43.077 CC module/bdev/raid/concat.o 00:01:43.335 LIB libspdk_blobfs_bdev.a 00:01:43.335 LIB libspdk_bdev_split.a 00:01:43.335 SO libspdk_blobfs_bdev.so.6.0 00:01:43.335 LIB libspdk_bdev_null.a 00:01:43.335 SO libspdk_bdev_split.so.6.0 00:01:43.335 LIB libspdk_bdev_ftl.a 00:01:43.335 SO libspdk_bdev_null.so.6.0 00:01:43.335 LIB libspdk_bdev_passthru.a 00:01:43.335 LIB libspdk_bdev_gpt.a 00:01:43.335 SYMLINK libspdk_blobfs_bdev.so 00:01:43.335 LIB libspdk_bdev_error.a 00:01:43.335 SO libspdk_bdev_ftl.so.6.0 00:01:43.335 LIB libspdk_bdev_zone_block.a 00:01:43.335 SO libspdk_bdev_passthru.so.6.0 00:01:43.335 SYMLINK libspdk_bdev_split.so 00:01:43.335 LIB libspdk_bdev_aio.a 00:01:43.335 SO libspdk_bdev_gpt.so.6.0 00:01:43.335 SO libspdk_bdev_error.so.6.0 00:01:43.335 SO libspdk_bdev_zone_block.so.6.0 00:01:43.335 SYMLINK libspdk_bdev_null.so 00:01:43.335 SO libspdk_bdev_aio.so.6.0 00:01:43.594 LIB libspdk_bdev_malloc.a 00:01:43.594 SYMLINK libspdk_bdev_passthru.so 00:01:43.594 LIB libspdk_bdev_delay.a 00:01:43.595 SYMLINK libspdk_bdev_ftl.so 00:01:43.595 LIB libspdk_bdev_iscsi.a 00:01:43.595 SYMLINK libspdk_bdev_gpt.so 00:01:43.595 SYMLINK libspdk_bdev_error.so 00:01:43.595 SO libspdk_bdev_iscsi.so.6.0 00:01:43.595 SO libspdk_bdev_malloc.so.6.0 00:01:43.595 SO libspdk_bdev_delay.so.6.0 00:01:43.595 SYMLINK libspdk_bdev_zone_block.so 00:01:43.595 SYMLINK libspdk_bdev_aio.so 00:01:43.595 LIB libspdk_bdev_lvol.a 00:01:43.595 SYMLINK libspdk_bdev_delay.so 00:01:43.595 SYMLINK libspdk_bdev_iscsi.so 00:01:43.595 SYMLINK libspdk_bdev_malloc.so 00:01:43.595 LIB libspdk_bdev_virtio.a 00:01:43.595 SO libspdk_bdev_lvol.so.6.0 00:01:43.595 SO libspdk_bdev_virtio.so.6.0 00:01:43.595 SYMLINK libspdk_bdev_lvol.so 00:01:43.595 SYMLINK libspdk_bdev_virtio.so 00:01:43.853 LIB libspdk_bdev_raid.a 00:01:43.853 SO libspdk_bdev_raid.so.6.0 00:01:43.853 SYMLINK libspdk_bdev_raid.so 00:01:44.790 LIB libspdk_bdev_nvme.a 00:01:44.790 SO libspdk_bdev_nvme.so.7.0 00:01:44.790 SYMLINK libspdk_bdev_nvme.so 00:01:45.357 CC module/event/subsystems/keyring/keyring.o 00:01:45.357 CC module/event/subsystems/sock/sock.o 00:01:45.357 CC module/event/subsystems/scheduler/scheduler.o 00:01:45.357 CC module/event/subsystems/iobuf/iobuf.o 00:01:45.357 CC module/event/subsystems/vmd/vmd.o 00:01:45.357 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:01:45.357 CC module/event/subsystems/vmd/vmd_rpc.o 00:01:45.357 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:01:45.616 LIB libspdk_event_keyring.a 00:01:45.616 SO libspdk_event_keyring.so.1.0 00:01:45.616 LIB libspdk_event_sock.a 00:01:45.616 LIB libspdk_event_scheduler.a 00:01:45.616 LIB libspdk_event_vhost_blk.a 00:01:45.616 LIB libspdk_event_vmd.a 00:01:45.616 LIB libspdk_event_iobuf.a 00:01:45.616 SO libspdk_event_sock.so.5.0 00:01:45.616 SO libspdk_event_vmd.so.6.0 00:01:45.616 SO libspdk_event_scheduler.so.4.0 00:01:45.616 SYMLINK libspdk_event_keyring.so 00:01:45.616 SO libspdk_event_vhost_blk.so.3.0 00:01:45.616 SO libspdk_event_iobuf.so.3.0 00:01:45.616 SYMLINK libspdk_event_sock.so 00:01:45.616 SYMLINK libspdk_event_vhost_blk.so 00:01:45.616 SYMLINK libspdk_event_vmd.so 00:01:45.616 SYMLINK libspdk_event_scheduler.so 00:01:45.616 SYMLINK libspdk_event_iobuf.so 00:01:45.874 CC module/event/subsystems/accel/accel.o 00:01:46.133 LIB libspdk_event_accel.a 00:01:46.133 SO libspdk_event_accel.so.6.0 00:01:46.133 SYMLINK libspdk_event_accel.so 00:01:46.392 CC module/event/subsystems/bdev/bdev.o 00:01:46.650 LIB libspdk_event_bdev.a 00:01:46.650 SO libspdk_event_bdev.so.6.0 00:01:46.650 SYMLINK libspdk_event_bdev.so 00:01:46.909 CC module/event/subsystems/scsi/scsi.o 00:01:46.909 CC module/event/subsystems/ublk/ublk.o 00:01:46.909 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:01:46.909 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:01:46.909 CC module/event/subsystems/nbd/nbd.o 00:01:47.168 LIB libspdk_event_scsi.a 00:01:47.168 LIB libspdk_event_ublk.a 00:01:47.168 SO libspdk_event_scsi.so.6.0 00:01:47.168 LIB libspdk_event_nbd.a 00:01:47.168 SO libspdk_event_ublk.so.3.0 00:01:47.168 SO libspdk_event_nbd.so.6.0 00:01:47.168 SYMLINK libspdk_event_scsi.so 00:01:47.168 LIB libspdk_event_nvmf.a 00:01:47.168 SYMLINK libspdk_event_ublk.so 00:01:47.168 SYMLINK libspdk_event_nbd.so 00:01:47.168 SO libspdk_event_nvmf.so.6.0 00:01:47.427 SYMLINK libspdk_event_nvmf.so 00:01:47.427 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:01:47.427 CC module/event/subsystems/iscsi/iscsi.o 00:01:47.686 LIB libspdk_event_vhost_scsi.a 00:01:47.686 LIB libspdk_event_iscsi.a 00:01:47.686 SO libspdk_event_vhost_scsi.so.3.0 00:01:47.686 SO libspdk_event_iscsi.so.6.0 00:01:47.686 SYMLINK libspdk_event_vhost_scsi.so 00:01:47.686 SYMLINK libspdk_event_iscsi.so 00:01:47.945 SO libspdk.so.6.0 00:01:47.945 SYMLINK libspdk.so 00:01:48.205 TEST_HEADER include/spdk/accel.h 00:01:48.205 TEST_HEADER include/spdk/barrier.h 00:01:48.205 TEST_HEADER include/spdk/accel_module.h 00:01:48.205 TEST_HEADER include/spdk/assert.h 00:01:48.205 TEST_HEADER include/spdk/base64.h 00:01:48.205 TEST_HEADER include/spdk/bdev_module.h 00:01:48.205 TEST_HEADER include/spdk/bdev_zone.h 00:01:48.205 TEST_HEADER include/spdk/bit_array.h 00:01:48.205 TEST_HEADER include/spdk/bdev.h 00:01:48.205 TEST_HEADER include/spdk/bit_pool.h 00:01:48.205 TEST_HEADER include/spdk/blob_bdev.h 00:01:48.205 TEST_HEADER include/spdk/blobfs_bdev.h 00:01:48.205 CC app/trace_record/trace_record.o 00:01:48.205 TEST_HEADER include/spdk/blobfs.h 00:01:48.205 TEST_HEADER include/spdk/blob.h 00:01:48.205 TEST_HEADER include/spdk/conf.h 00:01:48.205 CXX app/trace/trace.o 00:01:48.205 TEST_HEADER include/spdk/config.h 00:01:48.205 CC app/spdk_nvme_identify/identify.o 00:01:48.205 CC test/rpc_client/rpc_client_test.o 00:01:48.205 TEST_HEADER include/spdk/crc16.h 00:01:48.205 CC app/spdk_lspci/spdk_lspci.o 00:01:48.205 TEST_HEADER include/spdk/cpuset.h 00:01:48.205 TEST_HEADER include/spdk/crc32.h 00:01:48.205 CC app/spdk_top/spdk_top.o 00:01:48.206 CC app/spdk_nvme_discover/discovery_aer.o 00:01:48.206 CC app/spdk_nvme_perf/perf.o 00:01:48.206 TEST_HEADER include/spdk/crc64.h 00:01:48.206 TEST_HEADER include/spdk/dif.h 00:01:48.206 TEST_HEADER include/spdk/dma.h 00:01:48.206 TEST_HEADER include/spdk/endian.h 00:01:48.206 TEST_HEADER include/spdk/env_dpdk.h 00:01:48.206 TEST_HEADER include/spdk/env.h 00:01:48.206 TEST_HEADER include/spdk/event.h 00:01:48.206 TEST_HEADER include/spdk/fd_group.h 00:01:48.206 TEST_HEADER include/spdk/fd.h 00:01:48.206 TEST_HEADER include/spdk/file.h 00:01:48.206 TEST_HEADER include/spdk/ftl.h 00:01:48.206 TEST_HEADER include/spdk/gpt_spec.h 00:01:48.206 TEST_HEADER include/spdk/hexlify.h 00:01:48.206 TEST_HEADER include/spdk/histogram_data.h 00:01:48.206 TEST_HEADER include/spdk/idxd.h 00:01:48.206 TEST_HEADER include/spdk/idxd_spec.h 00:01:48.206 TEST_HEADER include/spdk/init.h 00:01:48.206 TEST_HEADER include/spdk/ioat.h 00:01:48.206 TEST_HEADER include/spdk/ioat_spec.h 00:01:48.206 TEST_HEADER include/spdk/iscsi_spec.h 00:01:48.206 TEST_HEADER include/spdk/json.h 00:01:48.206 TEST_HEADER include/spdk/jsonrpc.h 00:01:48.206 TEST_HEADER include/spdk/keyring.h 00:01:48.206 TEST_HEADER include/spdk/keyring_module.h 00:01:48.206 TEST_HEADER include/spdk/likely.h 00:01:48.206 TEST_HEADER include/spdk/log.h 00:01:48.206 TEST_HEADER include/spdk/mmio.h 00:01:48.206 TEST_HEADER include/spdk/lvol.h 00:01:48.206 TEST_HEADER include/spdk/memory.h 00:01:48.206 TEST_HEADER include/spdk/nbd.h 00:01:48.206 TEST_HEADER include/spdk/notify.h 00:01:48.206 TEST_HEADER include/spdk/nvme.h 00:01:48.206 TEST_HEADER include/spdk/nvme_intel.h 00:01:48.206 TEST_HEADER include/spdk/nvme_ocssd.h 00:01:48.206 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:01:48.206 TEST_HEADER include/spdk/nvme_spec.h 00:01:48.206 TEST_HEADER include/spdk/nvme_zns.h 00:01:48.206 TEST_HEADER include/spdk/nvmf_cmd.h 00:01:48.206 TEST_HEADER include/spdk/nvmf.h 00:01:48.206 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:01:48.206 TEST_HEADER include/spdk/nvmf_spec.h 00:01:48.206 TEST_HEADER include/spdk/nvmf_transport.h 00:01:48.206 TEST_HEADER include/spdk/opal.h 00:01:48.206 TEST_HEADER include/spdk/opal_spec.h 00:01:48.206 TEST_HEADER include/spdk/pci_ids.h 00:01:48.206 TEST_HEADER include/spdk/pipe.h 00:01:48.206 TEST_HEADER include/spdk/reduce.h 00:01:48.206 TEST_HEADER include/spdk/rpc.h 00:01:48.206 TEST_HEADER include/spdk/queue.h 00:01:48.206 TEST_HEADER include/spdk/scheduler.h 00:01:48.206 CC examples/interrupt_tgt/interrupt_tgt.o 00:01:48.206 TEST_HEADER include/spdk/scsi.h 00:01:48.206 TEST_HEADER include/spdk/scsi_spec.h 00:01:48.206 TEST_HEADER include/spdk/sock.h 00:01:48.206 TEST_HEADER include/spdk/stdinc.h 00:01:48.206 TEST_HEADER include/spdk/string.h 00:01:48.206 TEST_HEADER include/spdk/thread.h 00:01:48.206 TEST_HEADER include/spdk/trace.h 00:01:48.206 CC app/iscsi_tgt/iscsi_tgt.o 00:01:48.206 TEST_HEADER include/spdk/trace_parser.h 00:01:48.206 CC app/spdk_dd/spdk_dd.o 00:01:48.206 TEST_HEADER include/spdk/tree.h 00:01:48.206 TEST_HEADER include/spdk/ublk.h 00:01:48.206 TEST_HEADER include/spdk/util.h 00:01:48.206 TEST_HEADER include/spdk/uuid.h 00:01:48.206 TEST_HEADER include/spdk/version.h 00:01:48.206 TEST_HEADER include/spdk/vfio_user_pci.h 00:01:48.206 TEST_HEADER include/spdk/vfio_user_spec.h 00:01:48.206 TEST_HEADER include/spdk/vmd.h 00:01:48.206 TEST_HEADER include/spdk/vhost.h 00:01:48.206 TEST_HEADER include/spdk/xor.h 00:01:48.206 TEST_HEADER include/spdk/zipf.h 00:01:48.206 CXX test/cpp_headers/accel.o 00:01:48.206 CXX test/cpp_headers/accel_module.o 00:01:48.206 CXX test/cpp_headers/assert.o 00:01:48.206 CXX test/cpp_headers/barrier.o 00:01:48.206 CXX test/cpp_headers/base64.o 00:01:48.206 CXX test/cpp_headers/bdev.o 00:01:48.206 CXX test/cpp_headers/bdev_module.o 00:01:48.206 CXX test/cpp_headers/bdev_zone.o 00:01:48.471 CC app/vhost/vhost.o 00:01:48.471 CXX test/cpp_headers/bit_pool.o 00:01:48.471 CXX test/cpp_headers/bit_array.o 00:01:48.471 CXX test/cpp_headers/blob_bdev.o 00:01:48.471 CXX test/cpp_headers/blobfs_bdev.o 00:01:48.471 CXX test/cpp_headers/blobfs.o 00:01:48.471 CC app/nvmf_tgt/nvmf_main.o 00:01:48.471 CXX test/cpp_headers/blob.o 00:01:48.471 CXX test/cpp_headers/conf.o 00:01:48.471 CXX test/cpp_headers/config.o 00:01:48.471 CXX test/cpp_headers/cpuset.o 00:01:48.471 CXX test/cpp_headers/crc16.o 00:01:48.471 CXX test/cpp_headers/crc32.o 00:01:48.471 CXX test/cpp_headers/crc64.o 00:01:48.471 CXX test/cpp_headers/dif.o 00:01:48.471 CC app/spdk_tgt/spdk_tgt.o 00:01:48.471 CXX test/cpp_headers/dma.o 00:01:48.471 CC test/env/vtophys/vtophys.o 00:01:48.471 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:01:48.471 CC test/env/pci/pci_ut.o 00:01:48.471 CC test/thread/poller_perf/poller_perf.o 00:01:48.471 CC test/event/event_perf/event_perf.o 00:01:48.471 CC test/nvme/overhead/overhead.o 00:01:48.471 CC test/app/histogram_perf/histogram_perf.o 00:01:48.471 CC test/app/jsoncat/jsoncat.o 00:01:48.471 CC examples/sock/hello_world/hello_sock.o 00:01:48.471 CC app/fio/nvme/fio_plugin.o 00:01:48.471 CC test/nvme/simple_copy/simple_copy.o 00:01:48.471 CC test/nvme/doorbell_aers/doorbell_aers.o 00:01:48.471 CC test/event/reactor_perf/reactor_perf.o 00:01:48.471 CC examples/nvme/arbitration/arbitration.o 00:01:48.471 CC test/env/memory/memory_ut.o 00:01:48.471 CC test/nvme/e2edp/nvme_dp.o 00:01:48.471 CC test/nvme/aer/aer.o 00:01:48.471 CC examples/nvme/nvme_manage/nvme_manage.o 00:01:48.471 CC examples/ioat/verify/verify.o 00:01:48.471 CC test/nvme/sgl/sgl.o 00:01:48.471 CC examples/idxd/perf/perf.o 00:01:48.471 CC test/nvme/startup/startup.o 00:01:48.471 CC examples/vmd/lsvmd/lsvmd.o 00:01:48.471 CC examples/ioat/perf/perf.o 00:01:48.471 CC test/nvme/compliance/nvme_compliance.o 00:01:48.471 CC examples/vmd/led/led.o 00:01:48.471 CC examples/util/zipf/zipf.o 00:01:48.471 CC test/nvme/fused_ordering/fused_ordering.o 00:01:48.471 CC test/event/reactor/reactor.o 00:01:48.471 CC examples/nvme/hotplug/hotplug.o 00:01:48.471 CC examples/nvme/abort/abort.o 00:01:48.471 CC examples/accel/perf/accel_perf.o 00:01:48.471 CC examples/nvme/reconnect/reconnect.o 00:01:48.471 CC examples/nvme/cmb_copy/cmb_copy.o 00:01:48.471 CC test/nvme/cuse/cuse.o 00:01:48.471 CC examples/bdev/hello_world/hello_bdev.o 00:01:48.471 CC test/nvme/reset/reset.o 00:01:48.471 CC test/app/stub/stub.o 00:01:48.471 CC test/nvme/reserve/reserve.o 00:01:48.471 CC examples/blob/cli/blobcli.o 00:01:48.471 CC test/nvme/connect_stress/connect_stress.o 00:01:48.471 CC test/app/bdev_svc/bdev_svc.o 00:01:48.471 CC examples/blob/hello_world/hello_blob.o 00:01:48.471 CC examples/nvme/hello_world/hello_world.o 00:01:48.471 CC test/nvme/boot_partition/boot_partition.o 00:01:48.471 CC test/bdev/bdevio/bdevio.o 00:01:48.471 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:01:48.471 CC test/accel/dif/dif.o 00:01:48.471 CC test/nvme/err_injection/err_injection.o 00:01:48.471 CC test/event/app_repeat/app_repeat.o 00:01:48.471 CC test/blobfs/mkfs/mkfs.o 00:01:48.471 CC examples/thread/thread/thread_ex.o 00:01:48.471 CC test/nvme/fdp/fdp.o 00:01:48.471 CC app/fio/bdev/fio_plugin.o 00:01:48.471 CC examples/nvmf/nvmf/nvmf.o 00:01:48.471 CC test/dma/test_dma/test_dma.o 00:01:48.471 CC test/event/scheduler/scheduler.o 00:01:48.471 CC examples/bdev/bdevperf/bdevperf.o 00:01:48.730 LINK spdk_lspci 00:01:48.730 LINK interrupt_tgt 00:01:48.730 CC test/env/mem_callbacks/mem_callbacks.o 00:01:48.730 LINK rpc_client_test 00:01:48.730 LINK spdk_nvme_discover 00:01:48.730 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:01:48.730 LINK vtophys 00:01:48.991 LINK event_perf 00:01:48.991 CC test/lvol/esnap/esnap.o 00:01:48.991 LINK iscsi_tgt 00:01:48.991 LINK vhost 00:01:48.991 LINK poller_perf 00:01:48.991 LINK env_dpdk_post_init 00:01:48.991 LINK led 00:01:48.991 CXX test/cpp_headers/endian.o 00:01:48.991 LINK reactor 00:01:48.991 LINK nvmf_tgt 00:01:48.991 CXX test/cpp_headers/env_dpdk.o 00:01:48.991 LINK spdk_trace_record 00:01:48.991 CXX test/cpp_headers/env.o 00:01:48.991 CXX test/cpp_headers/event.o 00:01:48.991 CXX test/cpp_headers/fd_group.o 00:01:48.991 LINK spdk_tgt 00:01:48.991 LINK reactor_perf 00:01:48.991 LINK lsvmd 00:01:48.991 LINK jsoncat 00:01:48.991 LINK histogram_perf 00:01:48.991 LINK app_repeat 00:01:48.991 CXX test/cpp_headers/fd.o 00:01:48.991 CXX test/cpp_headers/file.o 00:01:48.991 CXX test/cpp_headers/ftl.o 00:01:48.991 LINK cmb_copy 00:01:48.991 CXX test/cpp_headers/gpt_spec.o 00:01:48.991 LINK boot_partition 00:01:48.991 CXX test/cpp_headers/hexlify.o 00:01:48.991 LINK verify 00:01:48.991 LINK zipf 00:01:48.991 LINK simple_copy 00:01:48.991 LINK ioat_perf 00:01:48.991 LINK stub 00:01:48.991 LINK startup 00:01:48.991 LINK connect_stress 00:01:48.991 CXX test/cpp_headers/histogram_data.o 00:01:48.991 LINK hello_sock 00:01:48.991 LINK hello_world 00:01:48.991 CXX test/cpp_headers/idxd.o 00:01:48.991 CXX test/cpp_headers/idxd_spec.o 00:01:48.991 LINK doorbell_aers 00:01:48.991 CXX test/cpp_headers/init.o 00:01:48.991 CXX test/cpp_headers/ioat.o 00:01:48.991 CXX test/cpp_headers/ioat_spec.o 00:01:48.991 CXX test/cpp_headers/iscsi_spec.o 00:01:48.991 LINK bdev_svc 00:01:48.991 CXX test/cpp_headers/json.o 00:01:48.991 CXX test/cpp_headers/jsonrpc.o 00:01:48.991 LINK err_injection 00:01:48.991 LINK spdk_dd 00:01:48.991 LINK hello_blob 00:01:48.991 LINK scheduler 00:01:48.991 LINK pmr_persistence 00:01:48.991 LINK overhead 00:01:48.991 LINK fused_ordering 00:01:48.991 LINK mkfs 00:01:48.991 CXX test/cpp_headers/keyring.o 00:01:48.991 LINK thread 00:01:48.991 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:01:48.991 CXX test/cpp_headers/keyring_module.o 00:01:48.991 LINK aer 00:01:48.991 LINK reserve 00:01:49.254 CXX test/cpp_headers/likely.o 00:01:49.254 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:01:49.254 LINK hello_bdev 00:01:49.254 CXX test/cpp_headers/lvol.o 00:01:49.254 LINK hotplug 00:01:49.254 CXX test/cpp_headers/log.o 00:01:49.254 CXX test/cpp_headers/memory.o 00:01:49.254 LINK nvme_dp 00:01:49.254 LINK arbitration 00:01:49.254 LINK sgl 00:01:49.254 CXX test/cpp_headers/mmio.o 00:01:49.254 LINK nvme_compliance 00:01:49.254 LINK spdk_trace 00:01:49.254 CXX test/cpp_headers/nbd.o 00:01:49.254 CXX test/cpp_headers/notify.o 00:01:49.254 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:01:49.254 CXX test/cpp_headers/nvme.o 00:01:49.254 CXX test/cpp_headers/nvme_intel.o 00:01:49.254 CXX test/cpp_headers/nvme_ocssd.o 00:01:49.254 LINK reset 00:01:49.254 LINK pci_ut 00:01:49.254 CXX test/cpp_headers/nvme_ocssd_spec.o 00:01:49.254 LINK reconnect 00:01:49.254 CXX test/cpp_headers/nvme_spec.o 00:01:49.254 LINK nvmf 00:01:49.254 CXX test/cpp_headers/nvme_zns.o 00:01:49.254 LINK dif 00:01:49.254 CXX test/cpp_headers/nvmf_cmd.o 00:01:49.254 CXX test/cpp_headers/nvmf_fc_spec.o 00:01:49.254 LINK idxd_perf 00:01:49.254 CXX test/cpp_headers/nvmf.o 00:01:49.254 CXX test/cpp_headers/nvmf_spec.o 00:01:49.254 CXX test/cpp_headers/nvmf_transport.o 00:01:49.254 CXX test/cpp_headers/opal.o 00:01:49.254 LINK fdp 00:01:49.254 CXX test/cpp_headers/opal_spec.o 00:01:49.254 CXX test/cpp_headers/pci_ids.o 00:01:49.254 CXX test/cpp_headers/pipe.o 00:01:49.254 CXX test/cpp_headers/queue.o 00:01:49.254 CXX test/cpp_headers/reduce.o 00:01:49.254 LINK abort 00:01:49.254 CXX test/cpp_headers/rpc.o 00:01:49.254 CXX test/cpp_headers/scheduler.o 00:01:49.254 CXX test/cpp_headers/scsi_spec.o 00:01:49.254 CXX test/cpp_headers/scsi.o 00:01:49.254 CXX test/cpp_headers/sock.o 00:01:49.254 CXX test/cpp_headers/stdinc.o 00:01:49.254 LINK bdevio 00:01:49.254 CXX test/cpp_headers/thread.o 00:01:49.254 CXX test/cpp_headers/string.o 00:01:49.515 CXX test/cpp_headers/trace.o 00:01:49.515 CXX test/cpp_headers/tree.o 00:01:49.515 CXX test/cpp_headers/trace_parser.o 00:01:49.515 CXX test/cpp_headers/util.o 00:01:49.515 CXX test/cpp_headers/ublk.o 00:01:49.515 CXX test/cpp_headers/uuid.o 00:01:49.515 LINK test_dma 00:01:49.515 CXX test/cpp_headers/version.o 00:01:49.515 CXX test/cpp_headers/vfio_user_pci.o 00:01:49.515 LINK spdk_nvme 00:01:49.515 CXX test/cpp_headers/vfio_user_spec.o 00:01:49.515 CXX test/cpp_headers/vhost.o 00:01:49.515 CXX test/cpp_headers/vmd.o 00:01:49.515 CXX test/cpp_headers/xor.o 00:01:49.515 LINK spdk_bdev 00:01:49.515 CXX test/cpp_headers/zipf.o 00:01:49.515 LINK nvme_fuzz 00:01:49.515 LINK accel_perf 00:01:49.515 LINK blobcli 00:01:49.515 LINK nvme_manage 00:01:49.773 LINK spdk_nvme_identify 00:01:49.773 LINK mem_callbacks 00:01:49.773 LINK spdk_nvme_perf 00:01:49.773 LINK spdk_top 00:01:49.773 LINK vhost_fuzz 00:01:49.773 LINK bdevperf 00:01:50.031 LINK memory_ut 00:01:50.031 LINK cuse 00:01:50.597 LINK iscsi_fuzz 00:01:52.500 LINK esnap 00:01:52.500 00:01:52.500 real 0m43.098s 00:01:52.500 user 6m35.688s 00:01:52.500 sys 3m28.955s 00:01:52.500 15:30:51 -- common/autotest_common.sh@1112 -- $ xtrace_disable 00:01:52.500 15:30:51 -- common/autotest_common.sh@10 -- $ set +x 00:01:52.500 ************************************ 00:01:52.500 END TEST make 00:01:52.500 ************************************ 00:01:52.759 15:30:51 -- spdk/autobuild.sh@1 -- $ stop_monitor_resources 00:01:52.759 15:30:51 -- pm/common@30 -- $ signal_monitor_resources TERM 00:01:52.759 15:30:51 -- pm/common@41 -- $ local monitor pid pids signal=TERM 00:01:52.759 15:30:51 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:01:52.759 15:30:51 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-cpu-load.pid ]] 00:01:52.759 15:30:51 -- pm/common@45 -- $ pid=3047221 00:01:52.759 15:30:51 -- pm/common@52 -- $ sudo kill -TERM 3047221 00:01:52.759 15:30:51 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:01:52.759 15:30:51 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-vmstat.pid ]] 00:01:52.759 15:30:51 -- pm/common@45 -- $ pid=3047226 00:01:52.759 15:30:51 -- pm/common@52 -- $ sudo kill -TERM 3047226 00:01:52.759 15:30:51 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:01:52.759 15:30:51 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-cpu-temp.pid ]] 00:01:52.759 15:30:51 -- pm/common@45 -- $ pid=3047223 00:01:52.759 15:30:51 -- pm/common@52 -- $ sudo kill -TERM 3047223 00:01:52.759 15:30:51 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:01:52.759 15:30:51 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-bmc-pm.pid ]] 00:01:52.759 15:30:51 -- pm/common@45 -- $ pid=3047227 00:01:52.759 15:30:51 -- pm/common@52 -- $ sudo kill -TERM 3047227 00:01:52.759 15:30:51 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:01:52.759 15:30:51 -- nvmf/common.sh@7 -- # uname -s 00:01:52.759 15:30:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:01:52.759 15:30:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:01:52.759 15:30:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:01:52.759 15:30:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:01:52.759 15:30:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:01:52.759 15:30:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:01:52.759 15:30:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:01:52.759 15:30:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:01:52.759 15:30:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:01:52.759 15:30:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:01:52.759 15:30:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:01:52.759 15:30:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:01:52.759 15:30:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:01:52.759 15:30:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:01:52.759 15:30:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:01:52.759 15:30:51 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:01:52.759 15:30:51 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:01:52.759 15:30:51 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:01:52.759 15:30:51 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:52.759 15:30:51 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:52.759 15:30:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:52.759 15:30:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:52.759 15:30:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:52.759 15:30:51 -- paths/export.sh@5 -- # export PATH 00:01:52.759 15:30:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:52.759 15:30:51 -- nvmf/common.sh@47 -- # : 0 00:01:52.759 15:30:51 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:01:52.759 15:30:51 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:01:52.759 15:30:51 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:01:52.759 15:30:51 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:01:53.026 15:30:51 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:01:53.026 15:30:51 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:01:53.026 15:30:51 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:01:53.026 15:30:51 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:01:53.026 15:30:51 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:01:53.026 15:30:51 -- spdk/autotest.sh@32 -- # uname -s 00:01:53.026 15:30:51 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:01:53.026 15:30:51 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:01:53.026 15:30:51 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/coredumps 00:01:53.026 15:30:51 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:01:53.026 15:30:51 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/coredumps 00:01:53.026 15:30:51 -- spdk/autotest.sh@44 -- # modprobe nbd 00:01:53.026 15:30:51 -- spdk/autotest.sh@46 -- # type -P udevadm 00:01:53.026 15:30:51 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:01:53.026 15:30:51 -- spdk/autotest.sh@48 -- # udevadm_pid=3105424 00:01:53.026 15:30:51 -- spdk/autotest.sh@53 -- # start_monitor_resources 00:01:53.026 15:30:51 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:01:53.026 15:30:51 -- pm/common@17 -- # local monitor 00:01:53.026 15:30:51 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:01:53.026 15:30:51 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=3105425 00:01:53.026 15:30:51 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:01:53.026 15:30:51 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=3105428 00:01:53.026 15:30:51 -- pm/common@21 -- # date +%s 00:01:53.026 15:30:51 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:01:53.026 15:30:51 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=3105432 00:01:53.026 15:30:51 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:01:53.026 15:30:51 -- pm/common@21 -- # date +%s 00:01:53.026 15:30:51 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=3105434 00:01:53.026 15:30:51 -- pm/common@26 -- # sleep 1 00:01:53.026 15:30:51 -- pm/common@21 -- # date +%s 00:01:53.026 15:30:51 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1714138251 00:01:53.026 15:30:51 -- pm/common@21 -- # date +%s 00:01:53.026 15:30:51 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1714138251 00:01:53.026 15:30:51 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1714138251 00:01:53.026 15:30:51 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1714138251 00:01:53.026 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autotest.sh.1714138251_collect-cpu-load.pm.log 00:01:53.026 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autotest.sh.1714138251_collect-vmstat.pm.log 00:01:53.026 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autotest.sh.1714138251_collect-bmc-pm.bmc.pm.log 00:01:53.026 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autotest.sh.1714138251_collect-cpu-temp.pm.log 00:01:53.962 15:30:52 -- spdk/autotest.sh@55 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:01:53.962 15:30:52 -- spdk/autotest.sh@57 -- # timing_enter autotest 00:01:53.962 15:30:52 -- common/autotest_common.sh@710 -- # xtrace_disable 00:01:53.962 15:30:52 -- common/autotest_common.sh@10 -- # set +x 00:01:53.962 15:30:52 -- spdk/autotest.sh@59 -- # create_test_list 00:01:53.962 15:30:52 -- common/autotest_common.sh@734 -- # xtrace_disable 00:01:53.962 15:30:52 -- common/autotest_common.sh@10 -- # set +x 00:01:53.962 15:30:52 -- spdk/autotest.sh@61 -- # dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/autotest.sh 00:01:53.962 15:30:52 -- spdk/autotest.sh@61 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:01:53.962 15:30:52 -- spdk/autotest.sh@61 -- # src=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:01:53.962 15:30:52 -- spdk/autotest.sh@62 -- # out=/var/jenkins/workspace/nvmf-phy-autotest/spdk/../output 00:01:53.962 15:30:52 -- spdk/autotest.sh@63 -- # cd /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:01:53.962 15:30:52 -- spdk/autotest.sh@65 -- # freebsd_update_contigmem_mod 00:01:53.962 15:30:52 -- common/autotest_common.sh@1441 -- # uname 00:01:53.962 15:30:52 -- common/autotest_common.sh@1441 -- # '[' Linux = FreeBSD ']' 00:01:53.962 15:30:52 -- spdk/autotest.sh@66 -- # freebsd_set_maxsock_buf 00:01:53.962 15:30:52 -- common/autotest_common.sh@1461 -- # uname 00:01:53.962 15:30:52 -- common/autotest_common.sh@1461 -- # [[ Linux = FreeBSD ]] 00:01:53.962 15:30:52 -- spdk/autotest.sh@71 -- # grep CC_TYPE mk/cc.mk 00:01:53.962 15:30:52 -- spdk/autotest.sh@71 -- # CC_TYPE=CC_TYPE=gcc 00:01:53.962 15:30:52 -- spdk/autotest.sh@72 -- # hash lcov 00:01:53.962 15:30:52 -- spdk/autotest.sh@72 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:01:53.962 15:30:52 -- spdk/autotest.sh@80 -- # export 'LCOV_OPTS= 00:01:53.962 --rc lcov_branch_coverage=1 00:01:53.962 --rc lcov_function_coverage=1 00:01:53.962 --rc genhtml_branch_coverage=1 00:01:53.962 --rc genhtml_function_coverage=1 00:01:53.962 --rc genhtml_legend=1 00:01:53.962 --rc geninfo_all_blocks=1 00:01:53.962 ' 00:01:53.962 15:30:52 -- spdk/autotest.sh@80 -- # LCOV_OPTS=' 00:01:53.962 --rc lcov_branch_coverage=1 00:01:53.962 --rc lcov_function_coverage=1 00:01:53.962 --rc genhtml_branch_coverage=1 00:01:53.962 --rc genhtml_function_coverage=1 00:01:53.962 --rc genhtml_legend=1 00:01:53.962 --rc geninfo_all_blocks=1 00:01:53.962 ' 00:01:53.962 15:30:52 -- spdk/autotest.sh@81 -- # export 'LCOV=lcov 00:01:53.962 --rc lcov_branch_coverage=1 00:01:53.962 --rc lcov_function_coverage=1 00:01:53.962 --rc genhtml_branch_coverage=1 00:01:53.962 --rc genhtml_function_coverage=1 00:01:53.962 --rc genhtml_legend=1 00:01:53.962 --rc geninfo_all_blocks=1 00:01:53.962 --no-external' 00:01:53.962 15:30:52 -- spdk/autotest.sh@81 -- # LCOV='lcov 00:01:53.962 --rc lcov_branch_coverage=1 00:01:53.962 --rc lcov_function_coverage=1 00:01:53.962 --rc genhtml_branch_coverage=1 00:01:53.962 --rc genhtml_function_coverage=1 00:01:53.962 --rc genhtml_legend=1 00:01:53.962 --rc geninfo_all_blocks=1 00:01:53.962 --no-external' 00:01:53.962 15:30:52 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -v 00:01:53.962 lcov: LCOV version 1.14 00:01:53.962 15:30:52 -- spdk/autotest.sh@85 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -i -t Baseline -d /var/jenkins/workspace/nvmf-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_base.info 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/base64.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/base64.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/barrier.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/barrier.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/accel_module.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/accel_module.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/accel.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/accel.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/assert.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/assert.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bit_array.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bit_array.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blobfs.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blobfs.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/conf.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/conf.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blob.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blob.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/config.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/config.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc32.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc32.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc64.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc64.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/dif.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/dif.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/cpuset.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/cpuset.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc16.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc16.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/dma.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/dma.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/endian.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/endian.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/env.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/env.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/event.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/event.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/fd_group.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/fd_group.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/fd.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/fd.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/file.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/file.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ftl.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ftl.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/hexlify.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/hexlify.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/idxd.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/idxd.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ioat.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ioat.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/json.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/json.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/init.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/init.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/keyring.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/keyring.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/keyring_module.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/keyring_module.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/likely.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/likely.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/lvol.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/lvol.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/memory.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/memory.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/log.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/log.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/mmio.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/mmio.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nbd.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nbd.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/notify.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/notify.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/opal.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/opal.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/pipe.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/pipe.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/queue.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/queue.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/reduce.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/reduce.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/rpc.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/rpc.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scheduler.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scheduler.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scsi.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scsi.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/sock.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/sock.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/thread.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/thread.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/stdinc.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/stdinc.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/trace.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/trace.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/string.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/string.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/tree.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/tree.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/util.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/util.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ublk.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ublk.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/uuid.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/uuid.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/version.gcno:no functions found 00:02:00.600 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/version.gcno 00:02:00.600 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno:no functions found 00:02:00.601 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno 00:02:00.601 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno:no functions found 00:02:00.601 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno 00:02:00.601 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vhost.gcno:no functions found 00:02:00.601 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vhost.gcno 00:02:00.601 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vmd.gcno:no functions found 00:02:00.601 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vmd.gcno 00:02:00.601 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/xor.gcno:no functions found 00:02:00.601 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/xor.gcno 00:02:00.601 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/zipf.gcno:no functions found 00:02:00.601 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/zipf.gcno 00:02:03.132 /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/nvme/nvme_stubs.gcno:no functions found 00:02:03.132 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/nvme/nvme_stubs.gcno 00:02:11.241 /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:02:11.241 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:02:11.241 /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:02:11.241 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:02:11.241 /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:02:11.241 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:02:16.506 15:31:14 -- spdk/autotest.sh@89 -- # timing_enter pre_cleanup 00:02:16.506 15:31:14 -- common/autotest_common.sh@710 -- # xtrace_disable 00:02:16.506 15:31:14 -- common/autotest_common.sh@10 -- # set +x 00:02:16.506 15:31:14 -- spdk/autotest.sh@91 -- # rm -f 00:02:16.506 15:31:14 -- spdk/autotest.sh@94 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:02:19.051 0000:5f:00.0 (8086 0a54): Already using the nvme driver 00:02:19.051 0000:00:04.7 (8086 2021): Already using the ioatdma driver 00:02:19.051 0000:00:04.6 (8086 2021): Already using the ioatdma driver 00:02:19.051 0000:00:04.5 (8086 2021): Already using the ioatdma driver 00:02:19.051 0000:00:04.4 (8086 2021): Already using the ioatdma driver 00:02:19.052 0000:00:04.3 (8086 2021): Already using the ioatdma driver 00:02:19.052 0000:00:04.2 (8086 2021): Already using the ioatdma driver 00:02:19.052 0000:00:04.1 (8086 2021): Already using the ioatdma driver 00:02:19.052 0000:00:04.0 (8086 2021): Already using the ioatdma driver 00:02:19.052 0000:80:04.7 (8086 2021): Already using the ioatdma driver 00:02:19.052 0000:80:04.6 (8086 2021): Already using the ioatdma driver 00:02:19.052 0000:80:04.5 (8086 2021): Already using the ioatdma driver 00:02:19.052 0000:80:04.4 (8086 2021): Already using the ioatdma driver 00:02:19.052 0000:80:04.3 (8086 2021): Already using the ioatdma driver 00:02:19.052 0000:80:04.2 (8086 2021): Already using the ioatdma driver 00:02:19.052 0000:80:04.1 (8086 2021): Already using the ioatdma driver 00:02:19.052 0000:80:04.0 (8086 2021): Already using the ioatdma driver 00:02:19.313 15:31:17 -- spdk/autotest.sh@96 -- # get_zoned_devs 00:02:19.313 15:31:17 -- common/autotest_common.sh@1655 -- # zoned_devs=() 00:02:19.313 15:31:17 -- common/autotest_common.sh@1655 -- # local -gA zoned_devs 00:02:19.313 15:31:17 -- common/autotest_common.sh@1656 -- # local nvme bdf 00:02:19.313 15:31:17 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:02:19.313 15:31:17 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme0n1 00:02:19.313 15:31:17 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:02:19.313 15:31:17 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:02:19.314 15:31:17 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:02:19.314 15:31:17 -- spdk/autotest.sh@98 -- # (( 0 > 0 )) 00:02:19.314 15:31:17 -- spdk/autotest.sh@110 -- # for dev in /dev/nvme*n!(*p*) 00:02:19.314 15:31:17 -- spdk/autotest.sh@112 -- # [[ -z '' ]] 00:02:19.314 15:31:17 -- spdk/autotest.sh@113 -- # block_in_use /dev/nvme0n1 00:02:19.314 15:31:17 -- scripts/common.sh@378 -- # local block=/dev/nvme0n1 pt 00:02:19.314 15:31:17 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:02:19.314 No valid GPT data, bailing 00:02:19.314 15:31:17 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:02:19.314 15:31:17 -- scripts/common.sh@391 -- # pt= 00:02:19.314 15:31:17 -- scripts/common.sh@392 -- # return 1 00:02:19.314 15:31:17 -- spdk/autotest.sh@114 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:02:19.314 1+0 records in 00:02:19.314 1+0 records out 00:02:19.314 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578367 s, 181 MB/s 00:02:19.314 15:31:17 -- spdk/autotest.sh@118 -- # sync 00:02:19.314 15:31:17 -- spdk/autotest.sh@120 -- # xtrace_disable_per_cmd reap_spdk_processes 00:02:19.314 15:31:17 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:02:19.314 15:31:17 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:02:24.584 15:31:22 -- spdk/autotest.sh@124 -- # uname -s 00:02:24.584 15:31:22 -- spdk/autotest.sh@124 -- # '[' Linux = Linux ']' 00:02:24.584 15:31:22 -- spdk/autotest.sh@125 -- # run_test setup.sh /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/test-setup.sh 00:02:24.584 15:31:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:24.584 15:31:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:24.584 15:31:22 -- common/autotest_common.sh@10 -- # set +x 00:02:24.585 ************************************ 00:02:24.585 START TEST setup.sh 00:02:24.585 ************************************ 00:02:24.585 15:31:22 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/test-setup.sh 00:02:24.585 * Looking for test storage... 00:02:24.585 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup 00:02:24.585 15:31:22 -- setup/test-setup.sh@10 -- # uname -s 00:02:24.585 15:31:22 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:02:24.585 15:31:22 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/acl.sh 00:02:24.585 15:31:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:24.585 15:31:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:24.585 15:31:22 -- common/autotest_common.sh@10 -- # set +x 00:02:24.585 ************************************ 00:02:24.585 START TEST acl 00:02:24.585 ************************************ 00:02:24.585 15:31:22 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/acl.sh 00:02:24.585 * Looking for test storage... 00:02:24.585 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup 00:02:24.585 15:31:23 -- setup/acl.sh@10 -- # get_zoned_devs 00:02:24.585 15:31:23 -- common/autotest_common.sh@1655 -- # zoned_devs=() 00:02:24.585 15:31:23 -- common/autotest_common.sh@1655 -- # local -gA zoned_devs 00:02:24.585 15:31:23 -- common/autotest_common.sh@1656 -- # local nvme bdf 00:02:24.585 15:31:23 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:02:24.585 15:31:23 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme0n1 00:02:24.585 15:31:23 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:02:24.585 15:31:23 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:02:24.585 15:31:23 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:02:24.585 15:31:23 -- setup/acl.sh@12 -- # devs=() 00:02:24.585 15:31:23 -- setup/acl.sh@12 -- # declare -a devs 00:02:24.585 15:31:23 -- setup/acl.sh@13 -- # drivers=() 00:02:24.585 15:31:23 -- setup/acl.sh@13 -- # declare -A drivers 00:02:24.585 15:31:23 -- setup/acl.sh@51 -- # setup reset 00:02:24.585 15:31:23 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:24.585 15:31:23 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:02:27.884 15:31:25 -- setup/acl.sh@52 -- # collect_setup_devs 00:02:27.884 15:31:25 -- setup/acl.sh@16 -- # local dev driver 00:02:27.884 15:31:25 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:27.884 15:31:25 -- setup/acl.sh@15 -- # setup output status 00:02:27.884 15:31:25 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:27.884 15:31:25 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh status 00:02:30.424 Hugepages 00:02:30.424 node hugesize free / total 00:02:30.424 15:31:28 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:02:30.424 15:31:28 -- setup/acl.sh@19 -- # continue 00:02:30.424 15:31:28 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:30.424 15:31:28 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:02:30.424 15:31:28 -- setup/acl.sh@19 -- # continue 00:02:30.424 15:31:28 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:30.424 15:31:28 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:02:30.424 15:31:28 -- setup/acl.sh@19 -- # continue 00:02:30.424 15:31:28 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:30.424 00:02:30.424 Type BDF Vendor Device NUMA Driver Device Block devices 00:02:30.424 15:31:28 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:02:30.424 15:31:28 -- setup/acl.sh@19 -- # continue 00:02:30.424 15:31:28 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:30.424 15:31:28 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:02:30.424 15:31:28 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:30.424 15:31:28 -- setup/acl.sh@20 -- # continue 00:02:30.424 15:31:28 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:30.424 15:31:28 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:02:30.424 15:31:28 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:30.424 15:31:28 -- setup/acl.sh@20 -- # continue 00:02:30.424 15:31:28 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:30.424 15:31:28 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:02:30.424 15:31:28 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:30.424 15:31:28 -- setup/acl.sh@20 -- # continue 00:02:30.424 15:31:28 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:30.424 15:31:28 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:02:30.424 15:31:28 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:30.424 15:31:28 -- setup/acl.sh@20 -- # continue 00:02:30.424 15:31:28 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:30.424 15:31:28 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:02:30.424 15:31:28 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:30.424 15:31:28 -- setup/acl.sh@20 -- # continue 00:02:30.424 15:31:28 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:30.424 15:31:28 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:02:30.424 15:31:28 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:30.424 15:31:28 -- setup/acl.sh@20 -- # continue 00:02:30.424 15:31:28 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:30.424 15:31:28 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:02:30.424 15:31:28 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:30.424 15:31:28 -- setup/acl.sh@20 -- # continue 00:02:30.424 15:31:28 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:30.424 15:31:28 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:02:30.424 15:31:28 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:30.424 15:31:28 -- setup/acl.sh@20 -- # continue 00:02:30.424 15:31:28 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:30.424 15:31:28 -- setup/acl.sh@19 -- # [[ 0000:5f:00.0 == *:*:*.* ]] 00:02:30.424 15:31:28 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:02:30.424 15:31:28 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\5\f\:\0\0\.\0* ]] 00:02:30.424 15:31:28 -- setup/acl.sh@22 -- # devs+=("$dev") 00:02:30.424 15:31:28 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:02:30.424 15:31:28 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:30.424 15:31:28 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:02:30.424 15:31:28 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:30.424 15:31:28 -- setup/acl.sh@20 -- # continue 00:02:30.424 15:31:28 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:30.424 15:31:28 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:02:30.424 15:31:28 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:30.424 15:31:28 -- setup/acl.sh@20 -- # continue 00:02:30.424 15:31:28 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:30.424 15:31:28 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:02:30.424 15:31:28 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:30.424 15:31:28 -- setup/acl.sh@20 -- # continue 00:02:30.424 15:31:28 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:30.424 15:31:28 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:02:30.424 15:31:28 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:30.424 15:31:28 -- setup/acl.sh@20 -- # continue 00:02:30.424 15:31:28 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:30.424 15:31:28 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:02:30.424 15:31:28 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:30.424 15:31:28 -- setup/acl.sh@20 -- # continue 00:02:30.424 15:31:28 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:30.424 15:31:28 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:02:30.424 15:31:28 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:30.424 15:31:28 -- setup/acl.sh@20 -- # continue 00:02:30.424 15:31:28 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:30.424 15:31:28 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:02:30.424 15:31:28 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:30.424 15:31:28 -- setup/acl.sh@20 -- # continue 00:02:30.424 15:31:28 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:30.424 15:31:28 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:02:30.424 15:31:28 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:30.424 15:31:28 -- setup/acl.sh@20 -- # continue 00:02:30.424 15:31:28 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:30.424 15:31:28 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:02:30.424 15:31:28 -- setup/acl.sh@54 -- # run_test denied denied 00:02:30.424 15:31:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:30.424 15:31:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:30.424 15:31:28 -- common/autotest_common.sh@10 -- # set +x 00:02:30.424 ************************************ 00:02:30.424 START TEST denied 00:02:30.424 ************************************ 00:02:30.424 15:31:28 -- common/autotest_common.sh@1111 -- # denied 00:02:30.424 15:31:28 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:5f:00.0' 00:02:30.424 15:31:28 -- setup/acl.sh@38 -- # setup output config 00:02:30.424 15:31:28 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:5f:00.0' 00:02:30.424 15:31:28 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:30.424 15:31:28 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:02:33.712 0000:5f:00.0 (8086 0a54): Skipping denied controller at 0000:5f:00.0 00:02:33.712 15:31:31 -- setup/acl.sh@40 -- # verify 0000:5f:00.0 00:02:33.712 15:31:31 -- setup/acl.sh@28 -- # local dev driver 00:02:33.712 15:31:31 -- setup/acl.sh@30 -- # for dev in "$@" 00:02:33.712 15:31:31 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:5f:00.0 ]] 00:02:33.712 15:31:31 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:5f:00.0/driver 00:02:33.712 15:31:31 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:02:33.712 15:31:31 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:02:33.712 15:31:31 -- setup/acl.sh@41 -- # setup reset 00:02:33.712 15:31:31 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:33.712 15:31:31 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:02:37.900 00:02:37.900 real 0m6.857s 00:02:37.900 user 0m2.218s 00:02:37.900 sys 0m3.940s 00:02:37.900 15:31:35 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:02:37.900 15:31:35 -- common/autotest_common.sh@10 -- # set +x 00:02:37.900 ************************************ 00:02:37.900 END TEST denied 00:02:37.900 ************************************ 00:02:37.900 15:31:35 -- setup/acl.sh@55 -- # run_test allowed allowed 00:02:37.900 15:31:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:37.900 15:31:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:37.900 15:31:35 -- common/autotest_common.sh@10 -- # set +x 00:02:37.900 ************************************ 00:02:37.900 START TEST allowed 00:02:37.900 ************************************ 00:02:37.900 15:31:35 -- common/autotest_common.sh@1111 -- # allowed 00:02:37.900 15:31:35 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:5f:00.0 00:02:37.900 15:31:35 -- setup/acl.sh@45 -- # setup output config 00:02:37.900 15:31:35 -- setup/acl.sh@46 -- # grep -E '0000:5f:00.0 .*: nvme -> .*' 00:02:37.900 15:31:35 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:37.900 15:31:35 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:02:42.090 0000:5f:00.0 (8086 0a54): nvme -> vfio-pci 00:02:42.090 15:31:40 -- setup/acl.sh@47 -- # verify 00:02:42.090 15:31:40 -- setup/acl.sh@28 -- # local dev driver 00:02:42.090 15:31:40 -- setup/acl.sh@48 -- # setup reset 00:02:42.090 15:31:40 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:42.090 15:31:40 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:02:45.380 00:02:45.380 real 0m7.475s 00:02:45.380 user 0m2.247s 00:02:45.380 sys 0m3.868s 00:02:45.380 15:31:43 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:02:45.380 15:31:43 -- common/autotest_common.sh@10 -- # set +x 00:02:45.380 ************************************ 00:02:45.380 END TEST allowed 00:02:45.380 ************************************ 00:02:45.380 00:02:45.380 real 0m20.377s 00:02:45.380 user 0m6.705s 00:02:45.380 sys 0m11.772s 00:02:45.380 15:31:43 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:02:45.380 15:31:43 -- common/autotest_common.sh@10 -- # set +x 00:02:45.380 ************************************ 00:02:45.380 END TEST acl 00:02:45.380 ************************************ 00:02:45.380 15:31:43 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/hugepages.sh 00:02:45.380 15:31:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:45.380 15:31:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:45.380 15:31:43 -- common/autotest_common.sh@10 -- # set +x 00:02:45.380 ************************************ 00:02:45.380 START TEST hugepages 00:02:45.380 ************************************ 00:02:45.380 15:31:43 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/hugepages.sh 00:02:45.380 * Looking for test storage... 00:02:45.380 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup 00:02:45.380 15:31:43 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:02:45.380 15:31:43 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:02:45.380 15:31:43 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:02:45.380 15:31:43 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:02:45.380 15:31:43 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:02:45.380 15:31:43 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:02:45.380 15:31:43 -- setup/common.sh@17 -- # local get=Hugepagesize 00:02:45.380 15:31:43 -- setup/common.sh@18 -- # local node= 00:02:45.380 15:31:43 -- setup/common.sh@19 -- # local var val 00:02:45.380 15:31:43 -- setup/common.sh@20 -- # local mem_f mem 00:02:45.380 15:31:43 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:45.380 15:31:43 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:45.380 15:31:43 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:45.380 15:31:43 -- setup/common.sh@28 -- # mapfile -t mem 00:02:45.380 15:31:43 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.380 15:31:43 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381160 kB' 'MemFree: 168198824 kB' 'MemAvailable: 171372568 kB' 'Buffers: 4144 kB' 'Cached: 14915836 kB' 'SwapCached: 0 kB' 'Active: 11993628 kB' 'Inactive: 3528164 kB' 'Active(anon): 11332880 kB' 'Inactive(anon): 0 kB' 'Active(file): 660748 kB' 'Inactive(file): 3528164 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 605104 kB' 'Mapped: 183720 kB' 'Shmem: 10731068 kB' 'KReclaimable: 258096 kB' 'Slab: 860004 kB' 'SReclaimable: 258096 kB' 'SUnreclaim: 601908 kB' 'KernelStack: 20752 kB' 'PageTables: 9084 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 101982032 kB' 'Committed_AS: 12799432 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316064 kB' 'VmallocChunk: 0 kB' 'Percpu: 70656 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 3288020 kB' 'DirectMap2M: 40431616 kB' 'DirectMap1G: 158334976 kB' 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.380 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.380 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # continue 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # IFS=': ' 00:02:45.381 15:31:43 -- setup/common.sh@31 -- # read -r var val _ 00:02:45.381 15:31:43 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:02:45.381 15:31:43 -- setup/common.sh@33 -- # echo 2048 00:02:45.381 15:31:43 -- setup/common.sh@33 -- # return 0 00:02:45.381 15:31:43 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:02:45.381 15:31:43 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:02:45.381 15:31:43 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:02:45.381 15:31:43 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:02:45.381 15:31:43 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:02:45.381 15:31:43 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:02:45.381 15:31:43 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:02:45.381 15:31:43 -- setup/hugepages.sh@207 -- # get_nodes 00:02:45.381 15:31:43 -- setup/hugepages.sh@27 -- # local node 00:02:45.381 15:31:43 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:45.381 15:31:43 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:02:45.381 15:31:43 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:45.381 15:31:43 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:02:45.381 15:31:43 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:45.381 15:31:43 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:45.381 15:31:43 -- setup/hugepages.sh@208 -- # clear_hp 00:02:45.381 15:31:43 -- setup/hugepages.sh@37 -- # local node hp 00:02:45.381 15:31:43 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:02:45.381 15:31:43 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:45.381 15:31:43 -- setup/hugepages.sh@41 -- # echo 0 00:02:45.381 15:31:43 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:45.381 15:31:43 -- setup/hugepages.sh@41 -- # echo 0 00:02:45.381 15:31:43 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:02:45.381 15:31:43 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:45.381 15:31:43 -- setup/hugepages.sh@41 -- # echo 0 00:02:45.381 15:31:43 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:02:45.381 15:31:43 -- setup/hugepages.sh@41 -- # echo 0 00:02:45.381 15:31:43 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:02:45.381 15:31:43 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:02:45.381 15:31:43 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:02:45.381 15:31:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:45.381 15:31:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:45.381 15:31:43 -- common/autotest_common.sh@10 -- # set +x 00:02:45.381 ************************************ 00:02:45.381 START TEST default_setup 00:02:45.381 ************************************ 00:02:45.381 15:31:43 -- common/autotest_common.sh@1111 -- # default_setup 00:02:45.381 15:31:43 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:02:45.381 15:31:43 -- setup/hugepages.sh@49 -- # local size=2097152 00:02:45.381 15:31:43 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:02:45.381 15:31:43 -- setup/hugepages.sh@51 -- # shift 00:02:45.381 15:31:43 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:02:45.381 15:31:43 -- setup/hugepages.sh@52 -- # local node_ids 00:02:45.381 15:31:43 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:45.381 15:31:43 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:02:45.382 15:31:43 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:02:45.382 15:31:43 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:02:45.382 15:31:43 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:45.382 15:31:43 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:45.382 15:31:43 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:45.382 15:31:43 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:45.382 15:31:43 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:45.382 15:31:43 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:02:45.382 15:31:43 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:02:45.382 15:31:43 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:02:45.382 15:31:43 -- setup/hugepages.sh@73 -- # return 0 00:02:45.382 15:31:43 -- setup/hugepages.sh@137 -- # setup output 00:02:45.382 15:31:43 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:45.382 15:31:43 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:02:47.917 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:02:47.917 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:02:47.917 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:02:47.917 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:02:47.917 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:02:47.917 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:02:47.917 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:02:47.917 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:02:47.917 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:02:47.917 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:02:47.917 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:02:47.917 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:02:47.917 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:02:47.917 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:02:47.917 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:02:47.917 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:02:49.296 0000:5f:00.0 (8086 0a54): nvme -> vfio-pci 00:02:49.296 15:31:47 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:02:49.296 15:31:47 -- setup/hugepages.sh@89 -- # local node 00:02:49.296 15:31:47 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:49.296 15:31:47 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:49.296 15:31:47 -- setup/hugepages.sh@92 -- # local surp 00:02:49.296 15:31:47 -- setup/hugepages.sh@93 -- # local resv 00:02:49.296 15:31:47 -- setup/hugepages.sh@94 -- # local anon 00:02:49.296 15:31:47 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:49.296 15:31:47 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:49.296 15:31:47 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:49.296 15:31:47 -- setup/common.sh@18 -- # local node= 00:02:49.297 15:31:47 -- setup/common.sh@19 -- # local var val 00:02:49.297 15:31:47 -- setup/common.sh@20 -- # local mem_f mem 00:02:49.297 15:31:47 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:49.297 15:31:47 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:49.297 15:31:47 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:49.297 15:31:47 -- setup/common.sh@28 -- # mapfile -t mem 00:02:49.297 15:31:47 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:49.297 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.297 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.297 15:31:47 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381160 kB' 'MemFree: 170380888 kB' 'MemAvailable: 173554424 kB' 'Buffers: 4144 kB' 'Cached: 14915940 kB' 'SwapCached: 0 kB' 'Active: 12013388 kB' 'Inactive: 3528164 kB' 'Active(anon): 11352640 kB' 'Inactive(anon): 0 kB' 'Active(file): 660748 kB' 'Inactive(file): 3528164 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 624728 kB' 'Mapped: 184012 kB' 'Shmem: 10731172 kB' 'KReclaimable: 257680 kB' 'Slab: 859080 kB' 'SReclaimable: 257680 kB' 'SUnreclaim: 601400 kB' 'KernelStack: 21264 kB' 'PageTables: 10408 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030608 kB' 'Committed_AS: 12819552 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316208 kB' 'VmallocChunk: 0 kB' 'Percpu: 70656 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3288020 kB' 'DirectMap2M: 40431616 kB' 'DirectMap1G: 158334976 kB' 00:02:49.297 15:31:47 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.297 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.297 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.297 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.297 15:31:47 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.297 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.297 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.297 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.297 15:31:47 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.297 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.297 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.297 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.297 15:31:47 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.297 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.297 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.297 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.297 15:31:47 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.297 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.297 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.297 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.297 15:31:47 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.297 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.297 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.297 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.297 15:31:47 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.297 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.297 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.297 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.297 15:31:47 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.297 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.297 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.297 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.297 15:31:47 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.297 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.297 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.297 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.297 15:31:47 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.297 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.297 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.297 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.297 15:31:47 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.297 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.297 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.297 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:49.561 15:31:47 -- setup/common.sh@33 -- # echo 0 00:02:49.561 15:31:47 -- setup/common.sh@33 -- # return 0 00:02:49.561 15:31:47 -- setup/hugepages.sh@97 -- # anon=0 00:02:49.561 15:31:47 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:49.561 15:31:47 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:49.561 15:31:47 -- setup/common.sh@18 -- # local node= 00:02:49.561 15:31:47 -- setup/common.sh@19 -- # local var val 00:02:49.561 15:31:47 -- setup/common.sh@20 -- # local mem_f mem 00:02:49.561 15:31:47 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:49.561 15:31:47 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:49.561 15:31:47 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:49.561 15:31:47 -- setup/common.sh@28 -- # mapfile -t mem 00:02:49.561 15:31:47 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.561 15:31:47 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381160 kB' 'MemFree: 170381260 kB' 'MemAvailable: 173554796 kB' 'Buffers: 4144 kB' 'Cached: 14915940 kB' 'SwapCached: 0 kB' 'Active: 12011912 kB' 'Inactive: 3528164 kB' 'Active(anon): 11351164 kB' 'Inactive(anon): 0 kB' 'Active(file): 660748 kB' 'Inactive(file): 3528164 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 623152 kB' 'Mapped: 183856 kB' 'Shmem: 10731172 kB' 'KReclaimable: 257680 kB' 'Slab: 858860 kB' 'SReclaimable: 257680 kB' 'SUnreclaim: 601180 kB' 'KernelStack: 20976 kB' 'PageTables: 9424 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030608 kB' 'Committed_AS: 12819564 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316256 kB' 'VmallocChunk: 0 kB' 'Percpu: 70656 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3288020 kB' 'DirectMap2M: 40431616 kB' 'DirectMap1G: 158334976 kB' 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.561 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.561 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.562 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.562 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.563 15:31:47 -- setup/common.sh@33 -- # echo 0 00:02:49.563 15:31:47 -- setup/common.sh@33 -- # return 0 00:02:49.563 15:31:47 -- setup/hugepages.sh@99 -- # surp=0 00:02:49.563 15:31:47 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:49.563 15:31:47 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:49.563 15:31:47 -- setup/common.sh@18 -- # local node= 00:02:49.563 15:31:47 -- setup/common.sh@19 -- # local var val 00:02:49.563 15:31:47 -- setup/common.sh@20 -- # local mem_f mem 00:02:49.563 15:31:47 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:49.563 15:31:47 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:49.563 15:31:47 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:49.563 15:31:47 -- setup/common.sh@28 -- # mapfile -t mem 00:02:49.563 15:31:47 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.563 15:31:47 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381160 kB' 'MemFree: 170380984 kB' 'MemAvailable: 173554520 kB' 'Buffers: 4144 kB' 'Cached: 14915956 kB' 'SwapCached: 0 kB' 'Active: 12011564 kB' 'Inactive: 3528164 kB' 'Active(anon): 11350816 kB' 'Inactive(anon): 0 kB' 'Active(file): 660748 kB' 'Inactive(file): 3528164 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 622892 kB' 'Mapped: 183856 kB' 'Shmem: 10731188 kB' 'KReclaimable: 257680 kB' 'Slab: 858836 kB' 'SReclaimable: 257680 kB' 'SUnreclaim: 601156 kB' 'KernelStack: 20832 kB' 'PageTables: 9084 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030608 kB' 'Committed_AS: 12819576 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316208 kB' 'VmallocChunk: 0 kB' 'Percpu: 70656 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3288020 kB' 'DirectMap2M: 40431616 kB' 'DirectMap1G: 158334976 kB' 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.563 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.563 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:49.564 15:31:47 -- setup/common.sh@33 -- # echo 0 00:02:49.564 15:31:47 -- setup/common.sh@33 -- # return 0 00:02:49.564 15:31:47 -- setup/hugepages.sh@100 -- # resv=0 00:02:49.564 15:31:47 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:49.564 nr_hugepages=1024 00:02:49.564 15:31:47 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:49.564 resv_hugepages=0 00:02:49.564 15:31:47 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:49.564 surplus_hugepages=0 00:02:49.564 15:31:47 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:49.564 anon_hugepages=0 00:02:49.564 15:31:47 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:49.564 15:31:47 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:49.564 15:31:47 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:49.564 15:31:47 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:49.564 15:31:47 -- setup/common.sh@18 -- # local node= 00:02:49.564 15:31:47 -- setup/common.sh@19 -- # local var val 00:02:49.564 15:31:47 -- setup/common.sh@20 -- # local mem_f mem 00:02:49.564 15:31:47 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:49.564 15:31:47 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:49.564 15:31:47 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:49.564 15:31:47 -- setup/common.sh@28 -- # mapfile -t mem 00:02:49.564 15:31:47 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.564 15:31:47 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381160 kB' 'MemFree: 170379176 kB' 'MemAvailable: 173552712 kB' 'Buffers: 4144 kB' 'Cached: 14915972 kB' 'SwapCached: 0 kB' 'Active: 12011784 kB' 'Inactive: 3528164 kB' 'Active(anon): 11351036 kB' 'Inactive(anon): 0 kB' 'Active(file): 660748 kB' 'Inactive(file): 3528164 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 623104 kB' 'Mapped: 183856 kB' 'Shmem: 10731204 kB' 'KReclaimable: 257680 kB' 'Slab: 858836 kB' 'SReclaimable: 257680 kB' 'SUnreclaim: 601156 kB' 'KernelStack: 20896 kB' 'PageTables: 9212 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030608 kB' 'Committed_AS: 12819344 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316272 kB' 'VmallocChunk: 0 kB' 'Percpu: 70656 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3288020 kB' 'DirectMap2M: 40431616 kB' 'DirectMap1G: 158334976 kB' 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.564 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.564 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.565 15:31:47 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.565 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.565 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.565 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.565 15:31:47 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.565 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.565 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.565 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.565 15:31:47 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.565 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.565 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.565 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.565 15:31:47 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.565 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.565 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.565 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.565 15:31:47 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.565 15:31:47 -- setup/common.sh@32 -- # continue 00:02:49.565 15:31:47 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.565 15:31:47 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.565 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.565 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:49.566 15:31:48 -- setup/common.sh@33 -- # echo 1024 00:02:49.566 15:31:48 -- setup/common.sh@33 -- # return 0 00:02:49.566 15:31:48 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:49.566 15:31:48 -- setup/hugepages.sh@112 -- # get_nodes 00:02:49.566 15:31:48 -- setup/hugepages.sh@27 -- # local node 00:02:49.566 15:31:48 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:49.566 15:31:48 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:02:49.566 15:31:48 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:49.566 15:31:48 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:02:49.566 15:31:48 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:49.566 15:31:48 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:49.566 15:31:48 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:49.566 15:31:48 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:49.566 15:31:48 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:49.566 15:31:48 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:49.566 15:31:48 -- setup/common.sh@18 -- # local node=0 00:02:49.566 15:31:48 -- setup/common.sh@19 -- # local var val 00:02:49.566 15:31:48 -- setup/common.sh@20 -- # local mem_f mem 00:02:49.566 15:31:48 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:49.566 15:31:48 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:49.566 15:31:48 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:49.566 15:31:48 -- setup/common.sh@28 -- # mapfile -t mem 00:02:49.566 15:31:48 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.566 15:31:48 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 97615628 kB' 'MemFree: 86326376 kB' 'MemUsed: 11289252 kB' 'SwapCached: 0 kB' 'Active: 7523864 kB' 'Inactive: 145888 kB' 'Active(anon): 7162544 kB' 'Inactive(anon): 0 kB' 'Active(file): 361320 kB' 'Inactive(file): 145888 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7206704 kB' 'Mapped: 119880 kB' 'AnonPages: 466268 kB' 'Shmem: 6699496 kB' 'KernelStack: 13000 kB' 'PageTables: 6428 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 131240 kB' 'Slab: 450004 kB' 'SReclaimable: 131240 kB' 'SUnreclaim: 318764 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.566 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.566 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.567 15:31:48 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.567 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.567 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.567 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.567 15:31:48 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.567 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.567 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.567 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.567 15:31:48 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.567 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.567 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.567 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.567 15:31:48 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.567 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.567 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.567 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.567 15:31:48 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.567 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.567 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.567 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.567 15:31:48 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.567 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.567 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.567 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.567 15:31:48 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.567 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.567 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.567 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.567 15:31:48 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.567 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.567 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.567 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.567 15:31:48 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.567 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.567 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.567 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.567 15:31:48 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.567 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.567 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.567 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.567 15:31:48 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.567 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.567 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.567 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.567 15:31:48 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.567 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.567 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.567 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.567 15:31:48 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.567 15:31:48 -- setup/common.sh@32 -- # continue 00:02:49.567 15:31:48 -- setup/common.sh@31 -- # IFS=': ' 00:02:49.567 15:31:48 -- setup/common.sh@31 -- # read -r var val _ 00:02:49.567 15:31:48 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:49.567 15:31:48 -- setup/common.sh@33 -- # echo 0 00:02:49.567 15:31:48 -- setup/common.sh@33 -- # return 0 00:02:49.567 15:31:48 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:49.567 15:31:48 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:49.567 15:31:48 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:49.567 15:31:48 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:49.567 15:31:48 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:02:49.567 node0=1024 expecting 1024 00:02:49.567 15:31:48 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:02:49.567 00:02:49.567 real 0m4.263s 00:02:49.567 user 0m1.104s 00:02:49.567 sys 0m1.810s 00:02:49.567 15:31:48 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:02:49.567 15:31:48 -- common/autotest_common.sh@10 -- # set +x 00:02:49.567 ************************************ 00:02:49.567 END TEST default_setup 00:02:49.567 ************************************ 00:02:49.567 15:31:48 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:02:49.567 15:31:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:49.567 15:31:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:49.567 15:31:48 -- common/autotest_common.sh@10 -- # set +x 00:02:49.827 ************************************ 00:02:49.827 START TEST per_node_1G_alloc 00:02:49.827 ************************************ 00:02:49.827 15:31:48 -- common/autotest_common.sh@1111 -- # per_node_1G_alloc 00:02:49.827 15:31:48 -- setup/hugepages.sh@143 -- # local IFS=, 00:02:49.827 15:31:48 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:02:49.827 15:31:48 -- setup/hugepages.sh@49 -- # local size=1048576 00:02:49.827 15:31:48 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:02:49.827 15:31:48 -- setup/hugepages.sh@51 -- # shift 00:02:49.827 15:31:48 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:02:49.827 15:31:48 -- setup/hugepages.sh@52 -- # local node_ids 00:02:49.827 15:31:48 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:49.827 15:31:48 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:02:49.827 15:31:48 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:02:49.827 15:31:48 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:02:49.827 15:31:48 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:49.827 15:31:48 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:02:49.827 15:31:48 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:49.827 15:31:48 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:49.827 15:31:48 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:49.827 15:31:48 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:02:49.827 15:31:48 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:02:49.827 15:31:48 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:02:49.827 15:31:48 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:02:49.827 15:31:48 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:02:49.827 15:31:48 -- setup/hugepages.sh@73 -- # return 0 00:02:49.827 15:31:48 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:02:49.827 15:31:48 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:02:49.827 15:31:48 -- setup/hugepages.sh@146 -- # setup output 00:02:49.827 15:31:48 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:49.827 15:31:48 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:02:52.445 0000:5f:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:52.445 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:02:52.445 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:02:52.445 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:02:52.445 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:02:52.445 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:02:52.445 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:02:52.445 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:02:52.445 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:02:52.445 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:02:52.445 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:02:52.445 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:02:52.445 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:02:52.445 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:02:52.445 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:02:52.445 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:02:52.445 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:02:52.445 15:31:50 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:02:52.445 15:31:50 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:02:52.445 15:31:50 -- setup/hugepages.sh@89 -- # local node 00:02:52.445 15:31:50 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:52.445 15:31:50 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:52.445 15:31:50 -- setup/hugepages.sh@92 -- # local surp 00:02:52.445 15:31:50 -- setup/hugepages.sh@93 -- # local resv 00:02:52.445 15:31:50 -- setup/hugepages.sh@94 -- # local anon 00:02:52.445 15:31:50 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:52.445 15:31:50 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:52.445 15:31:50 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:52.445 15:31:50 -- setup/common.sh@18 -- # local node= 00:02:52.445 15:31:50 -- setup/common.sh@19 -- # local var val 00:02:52.445 15:31:50 -- setup/common.sh@20 -- # local mem_f mem 00:02:52.445 15:31:50 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:52.445 15:31:50 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:52.445 15:31:50 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:52.445 15:31:50 -- setup/common.sh@28 -- # mapfile -t mem 00:02:52.445 15:31:50 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.445 15:31:50 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381160 kB' 'MemFree: 170378324 kB' 'MemAvailable: 173551844 kB' 'Buffers: 4144 kB' 'Cached: 14916060 kB' 'SwapCached: 0 kB' 'Active: 12011708 kB' 'Inactive: 3528164 kB' 'Active(anon): 11350960 kB' 'Inactive(anon): 0 kB' 'Active(file): 660748 kB' 'Inactive(file): 3528164 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 622552 kB' 'Mapped: 183968 kB' 'Shmem: 10731292 kB' 'KReclaimable: 257648 kB' 'Slab: 858536 kB' 'SReclaimable: 257648 kB' 'SUnreclaim: 600888 kB' 'KernelStack: 20848 kB' 'PageTables: 9576 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030608 kB' 'Committed_AS: 12817764 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316128 kB' 'VmallocChunk: 0 kB' 'Percpu: 70656 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3288020 kB' 'DirectMap2M: 40431616 kB' 'DirectMap1G: 158334976 kB' 00:02:52.445 15:31:50 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.445 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.445 15:31:50 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.445 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.445 15:31:50 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.445 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.445 15:31:50 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.445 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.445 15:31:50 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.445 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.445 15:31:50 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.445 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.445 15:31:50 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.445 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.445 15:31:50 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.445 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.445 15:31:50 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.445 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.445 15:31:50 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.445 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.445 15:31:50 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.445 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.445 15:31:50 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.445 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.445 15:31:50 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.445 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.445 15:31:50 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.445 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.445 15:31:50 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.445 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.445 15:31:50 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.445 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.445 15:31:50 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.445 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.445 15:31:50 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.445 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.445 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.445 15:31:50 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:52.446 15:31:50 -- setup/common.sh@33 -- # echo 0 00:02:52.446 15:31:50 -- setup/common.sh@33 -- # return 0 00:02:52.446 15:31:50 -- setup/hugepages.sh@97 -- # anon=0 00:02:52.446 15:31:50 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:52.446 15:31:50 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:52.446 15:31:50 -- setup/common.sh@18 -- # local node= 00:02:52.446 15:31:50 -- setup/common.sh@19 -- # local var val 00:02:52.446 15:31:50 -- setup/common.sh@20 -- # local mem_f mem 00:02:52.446 15:31:50 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:52.446 15:31:50 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:52.446 15:31:50 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:52.446 15:31:50 -- setup/common.sh@28 -- # mapfile -t mem 00:02:52.446 15:31:50 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.446 15:31:50 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381160 kB' 'MemFree: 170379172 kB' 'MemAvailable: 173552692 kB' 'Buffers: 4144 kB' 'Cached: 14916064 kB' 'SwapCached: 0 kB' 'Active: 12011396 kB' 'Inactive: 3528164 kB' 'Active(anon): 11350648 kB' 'Inactive(anon): 0 kB' 'Active(file): 660748 kB' 'Inactive(file): 3528164 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 622688 kB' 'Mapped: 183884 kB' 'Shmem: 10731296 kB' 'KReclaimable: 257648 kB' 'Slab: 858496 kB' 'SReclaimable: 257648 kB' 'SUnreclaim: 600848 kB' 'KernelStack: 20832 kB' 'PageTables: 9488 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030608 kB' 'Committed_AS: 12817776 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316112 kB' 'VmallocChunk: 0 kB' 'Percpu: 70656 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3288020 kB' 'DirectMap2M: 40431616 kB' 'DirectMap1G: 158334976 kB' 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.446 15:31:50 -- setup/common.sh@32 -- # continue 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.446 15:31:50 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.446 15:31:51 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.446 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.446 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.446 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.446 15:31:51 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.446 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.446 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.446 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.446 15:31:51 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.446 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.446 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.446 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.446 15:31:51 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.446 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.446 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.446 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.446 15:31:51 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.446 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.446 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.446 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.447 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.447 15:31:51 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.448 15:31:51 -- setup/common.sh@33 -- # echo 0 00:02:52.448 15:31:51 -- setup/common.sh@33 -- # return 0 00:02:52.448 15:31:51 -- setup/hugepages.sh@99 -- # surp=0 00:02:52.448 15:31:51 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:52.448 15:31:51 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:52.448 15:31:51 -- setup/common.sh@18 -- # local node= 00:02:52.448 15:31:51 -- setup/common.sh@19 -- # local var val 00:02:52.448 15:31:51 -- setup/common.sh@20 -- # local mem_f mem 00:02:52.448 15:31:51 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:52.448 15:31:51 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:52.448 15:31:51 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:52.448 15:31:51 -- setup/common.sh@28 -- # mapfile -t mem 00:02:52.448 15:31:51 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.448 15:31:51 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381160 kB' 'MemFree: 170379424 kB' 'MemAvailable: 173552944 kB' 'Buffers: 4144 kB' 'Cached: 14916088 kB' 'SwapCached: 0 kB' 'Active: 12011104 kB' 'Inactive: 3528164 kB' 'Active(anon): 11350356 kB' 'Inactive(anon): 0 kB' 'Active(file): 660748 kB' 'Inactive(file): 3528164 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 622336 kB' 'Mapped: 183884 kB' 'Shmem: 10731320 kB' 'KReclaimable: 257648 kB' 'Slab: 858496 kB' 'SReclaimable: 257648 kB' 'SUnreclaim: 600848 kB' 'KernelStack: 20832 kB' 'PageTables: 9488 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030608 kB' 'Committed_AS: 12817792 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316112 kB' 'VmallocChunk: 0 kB' 'Percpu: 70656 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3288020 kB' 'DirectMap2M: 40431616 kB' 'DirectMap1G: 158334976 kB' 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.448 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.448 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.449 15:31:51 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.449 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.449 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.449 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.449 15:31:51 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.449 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.449 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.449 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.449 15:31:51 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.711 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.711 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.711 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.711 15:31:51 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.711 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.711 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.711 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.711 15:31:51 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.711 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.711 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.711 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.711 15:31:51 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.711 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.711 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.711 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.711 15:31:51 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.711 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.711 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.711 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.711 15:31:51 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.711 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.711 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.711 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.711 15:31:51 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.711 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.711 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.711 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.711 15:31:51 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.711 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.711 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.711 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.711 15:31:51 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.711 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.711 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.711 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.711 15:31:51 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.711 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.711 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.711 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.711 15:31:51 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.711 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.711 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.711 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.711 15:31:51 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.711 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.711 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.711 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.711 15:31:51 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.711 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.711 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.711 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.711 15:31:51 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.711 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.711 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.711 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.711 15:31:51 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.711 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.711 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.711 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.711 15:31:51 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:52.711 15:31:51 -- setup/common.sh@33 -- # echo 0 00:02:52.711 15:31:51 -- setup/common.sh@33 -- # return 0 00:02:52.711 15:31:51 -- setup/hugepages.sh@100 -- # resv=0 00:02:52.711 15:31:51 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:52.711 nr_hugepages=1024 00:02:52.711 15:31:51 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:52.711 resv_hugepages=0 00:02:52.711 15:31:51 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:52.711 surplus_hugepages=0 00:02:52.711 15:31:51 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:52.711 anon_hugepages=0 00:02:52.711 15:31:51 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:52.711 15:31:51 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:52.711 15:31:51 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:52.711 15:31:51 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:52.711 15:31:51 -- setup/common.sh@18 -- # local node= 00:02:52.711 15:31:51 -- setup/common.sh@19 -- # local var val 00:02:52.711 15:31:51 -- setup/common.sh@20 -- # local mem_f mem 00:02:52.711 15:31:51 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:52.711 15:31:51 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:52.711 15:31:51 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:52.711 15:31:51 -- setup/common.sh@28 -- # mapfile -t mem 00:02:52.711 15:31:51 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:52.711 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.711 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.712 15:31:51 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381160 kB' 'MemFree: 170380396 kB' 'MemAvailable: 173553916 kB' 'Buffers: 4144 kB' 'Cached: 14916088 kB' 'SwapCached: 0 kB' 'Active: 12011420 kB' 'Inactive: 3528164 kB' 'Active(anon): 11350672 kB' 'Inactive(anon): 0 kB' 'Active(file): 660748 kB' 'Inactive(file): 3528164 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 622700 kB' 'Mapped: 183884 kB' 'Shmem: 10731320 kB' 'KReclaimable: 257648 kB' 'Slab: 858496 kB' 'SReclaimable: 257648 kB' 'SUnreclaim: 600848 kB' 'KernelStack: 20832 kB' 'PageTables: 9488 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030608 kB' 'Committed_AS: 12817804 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316112 kB' 'VmallocChunk: 0 kB' 'Percpu: 70656 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3288020 kB' 'DirectMap2M: 40431616 kB' 'DirectMap1G: 158334976 kB' 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.712 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.712 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.713 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.713 15:31:51 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:52.713 15:31:51 -- setup/common.sh@33 -- # echo 1024 00:02:52.713 15:31:51 -- setup/common.sh@33 -- # return 0 00:02:52.713 15:31:51 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:52.714 15:31:51 -- setup/hugepages.sh@112 -- # get_nodes 00:02:52.714 15:31:51 -- setup/hugepages.sh@27 -- # local node 00:02:52.714 15:31:51 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:52.714 15:31:51 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:52.714 15:31:51 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:52.714 15:31:51 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:52.714 15:31:51 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:52.714 15:31:51 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:52.714 15:31:51 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:52.714 15:31:51 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:52.714 15:31:51 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:52.714 15:31:51 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:52.714 15:31:51 -- setup/common.sh@18 -- # local node=0 00:02:52.714 15:31:51 -- setup/common.sh@19 -- # local var val 00:02:52.714 15:31:51 -- setup/common.sh@20 -- # local mem_f mem 00:02:52.714 15:31:51 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:52.714 15:31:51 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:52.714 15:31:51 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:52.714 15:31:51 -- setup/common.sh@28 -- # mapfile -t mem 00:02:52.714 15:31:51 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.714 15:31:51 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 97615628 kB' 'MemFree: 87383400 kB' 'MemUsed: 10232228 kB' 'SwapCached: 0 kB' 'Active: 7523356 kB' 'Inactive: 145888 kB' 'Active(anon): 7162036 kB' 'Inactive(anon): 0 kB' 'Active(file): 361320 kB' 'Inactive(file): 145888 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7206740 kB' 'Mapped: 119908 kB' 'AnonPages: 465688 kB' 'Shmem: 6699532 kB' 'KernelStack: 13032 kB' 'PageTables: 6564 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 131208 kB' 'Slab: 449896 kB' 'SReclaimable: 131208 kB' 'SUnreclaim: 318688 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.714 15:31:51 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.714 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.714 15:31:51 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.714 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.714 15:31:51 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.714 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.714 15:31:51 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.714 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.714 15:31:51 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.714 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.714 15:31:51 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.714 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.714 15:31:51 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.714 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.714 15:31:51 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.714 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.714 15:31:51 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.714 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.714 15:31:51 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.714 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.714 15:31:51 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.714 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.714 15:31:51 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.714 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.714 15:31:51 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.714 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.714 15:31:51 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.714 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.714 15:31:51 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.714 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.714 15:31:51 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.714 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.714 15:31:51 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.714 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.714 15:31:51 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.714 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.714 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.715 15:31:51 -- setup/common.sh@33 -- # echo 0 00:02:52.715 15:31:51 -- setup/common.sh@33 -- # return 0 00:02:52.715 15:31:51 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:52.715 15:31:51 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:52.715 15:31:51 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:52.715 15:31:51 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:02:52.715 15:31:51 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:52.715 15:31:51 -- setup/common.sh@18 -- # local node=1 00:02:52.715 15:31:51 -- setup/common.sh@19 -- # local var val 00:02:52.715 15:31:51 -- setup/common.sh@20 -- # local mem_f mem 00:02:52.715 15:31:51 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:52.715 15:31:51 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:02:52.715 15:31:51 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:02:52.715 15:31:51 -- setup/common.sh@28 -- # mapfile -t mem 00:02:52.715 15:31:51 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.715 15:31:51 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93765532 kB' 'MemFree: 82997164 kB' 'MemUsed: 10768368 kB' 'SwapCached: 0 kB' 'Active: 4488556 kB' 'Inactive: 3382276 kB' 'Active(anon): 4189128 kB' 'Inactive(anon): 0 kB' 'Active(file): 299428 kB' 'Inactive(file): 3382276 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7713520 kB' 'Mapped: 63976 kB' 'AnonPages: 157516 kB' 'Shmem: 4031816 kB' 'KernelStack: 7784 kB' 'PageTables: 2876 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 126440 kB' 'Slab: 408600 kB' 'SReclaimable: 126440 kB' 'SUnreclaim: 282160 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.715 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.715 15:31:51 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.716 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.716 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.717 15:31:51 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.717 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.717 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.717 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.717 15:31:51 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.717 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.717 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.717 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.717 15:31:51 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.717 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.717 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.717 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.717 15:31:51 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.717 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.717 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.717 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.717 15:31:51 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.717 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.717 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.717 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.717 15:31:51 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.717 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.717 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.717 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.717 15:31:51 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.717 15:31:51 -- setup/common.sh@32 -- # continue 00:02:52.717 15:31:51 -- setup/common.sh@31 -- # IFS=': ' 00:02:52.717 15:31:51 -- setup/common.sh@31 -- # read -r var val _ 00:02:52.717 15:31:51 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:52.717 15:31:51 -- setup/common.sh@33 -- # echo 0 00:02:52.717 15:31:51 -- setup/common.sh@33 -- # return 0 00:02:52.717 15:31:51 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:52.717 15:31:51 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:52.717 15:31:51 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:52.717 15:31:51 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:52.717 15:31:51 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:02:52.717 node0=512 expecting 512 00:02:52.717 15:31:51 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:52.717 15:31:51 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:52.717 15:31:51 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:52.717 15:31:51 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:02:52.717 node1=512 expecting 512 00:02:52.717 15:31:51 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:02:52.717 00:02:52.717 real 0m2.954s 00:02:52.717 user 0m1.178s 00:02:52.717 sys 0m1.835s 00:02:52.717 15:31:51 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:02:52.717 15:31:51 -- common/autotest_common.sh@10 -- # set +x 00:02:52.717 ************************************ 00:02:52.717 END TEST per_node_1G_alloc 00:02:52.717 ************************************ 00:02:52.717 15:31:51 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:02:52.717 15:31:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:52.717 15:31:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:52.717 15:31:51 -- common/autotest_common.sh@10 -- # set +x 00:02:52.977 ************************************ 00:02:52.977 START TEST even_2G_alloc 00:02:52.977 ************************************ 00:02:52.977 15:31:51 -- common/autotest_common.sh@1111 -- # even_2G_alloc 00:02:52.977 15:31:51 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:02:52.977 15:31:51 -- setup/hugepages.sh@49 -- # local size=2097152 00:02:52.977 15:31:51 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:02:52.977 15:31:51 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:52.977 15:31:51 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:02:52.977 15:31:51 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:02:52.977 15:31:51 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:52.977 15:31:51 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:52.977 15:31:51 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:52.977 15:31:51 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:52.977 15:31:51 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:52.977 15:31:51 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:52.977 15:31:51 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:52.977 15:31:51 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:02:52.977 15:31:51 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:52.977 15:31:51 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:02:52.977 15:31:51 -- setup/hugepages.sh@83 -- # : 512 00:02:52.977 15:31:51 -- setup/hugepages.sh@84 -- # : 1 00:02:52.977 15:31:51 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:52.977 15:31:51 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:02:52.977 15:31:51 -- setup/hugepages.sh@83 -- # : 0 00:02:52.977 15:31:51 -- setup/hugepages.sh@84 -- # : 0 00:02:52.977 15:31:51 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:52.977 15:31:51 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:02:52.977 15:31:51 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:02:52.977 15:31:51 -- setup/hugepages.sh@153 -- # setup output 00:02:52.977 15:31:51 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:52.977 15:31:51 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:02:55.511 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:02:55.511 0000:5f:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:55.511 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:02:55.511 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:02:55.511 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:02:55.511 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:02:55.511 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:02:55.511 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:02:55.511 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:02:55.511 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:02:55.511 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:02:55.511 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:02:55.511 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:02:55.511 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:02:55.511 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:02:55.511 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:02:55.511 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:02:55.776 15:31:54 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:02:55.776 15:31:54 -- setup/hugepages.sh@89 -- # local node 00:02:55.776 15:31:54 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:55.776 15:31:54 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:55.776 15:31:54 -- setup/hugepages.sh@92 -- # local surp 00:02:55.776 15:31:54 -- setup/hugepages.sh@93 -- # local resv 00:02:55.776 15:31:54 -- setup/hugepages.sh@94 -- # local anon 00:02:55.776 15:31:54 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:55.776 15:31:54 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:55.776 15:31:54 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:55.776 15:31:54 -- setup/common.sh@18 -- # local node= 00:02:55.776 15:31:54 -- setup/common.sh@19 -- # local var val 00:02:55.776 15:31:54 -- setup/common.sh@20 -- # local mem_f mem 00:02:55.776 15:31:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:55.776 15:31:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:55.776 15:31:54 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:55.776 15:31:54 -- setup/common.sh@28 -- # mapfile -t mem 00:02:55.776 15:31:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:55.776 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.776 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.776 15:31:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381160 kB' 'MemFree: 170374168 kB' 'MemAvailable: 173547688 kB' 'Buffers: 4144 kB' 'Cached: 14916180 kB' 'SwapCached: 0 kB' 'Active: 12010532 kB' 'Inactive: 3528164 kB' 'Active(anon): 11349784 kB' 'Inactive(anon): 0 kB' 'Active(file): 660748 kB' 'Inactive(file): 3528164 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 621192 kB' 'Mapped: 182924 kB' 'Shmem: 10731412 kB' 'KReclaimable: 257648 kB' 'Slab: 857620 kB' 'SReclaimable: 257648 kB' 'SUnreclaim: 599972 kB' 'KernelStack: 20688 kB' 'PageTables: 9048 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030608 kB' 'Committed_AS: 12806020 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316112 kB' 'VmallocChunk: 0 kB' 'Percpu: 70656 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3288020 kB' 'DirectMap2M: 40431616 kB' 'DirectMap1G: 158334976 kB' 00:02:55.776 15:31:54 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.776 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.776 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.776 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.776 15:31:54 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.776 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.776 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.776 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.776 15:31:54 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.776 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.776 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.776 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.776 15:31:54 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.776 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.776 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.776 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.776 15:31:54 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.776 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.776 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.776 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.776 15:31:54 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.776 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.776 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.776 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.776 15:31:54 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.776 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.776 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.776 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.776 15:31:54 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.776 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.776 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.776 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.776 15:31:54 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.776 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.776 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.776 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.776 15:31:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.776 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:55.777 15:31:54 -- setup/common.sh@33 -- # echo 0 00:02:55.777 15:31:54 -- setup/common.sh@33 -- # return 0 00:02:55.777 15:31:54 -- setup/hugepages.sh@97 -- # anon=0 00:02:55.777 15:31:54 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:55.777 15:31:54 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:55.777 15:31:54 -- setup/common.sh@18 -- # local node= 00:02:55.777 15:31:54 -- setup/common.sh@19 -- # local var val 00:02:55.777 15:31:54 -- setup/common.sh@20 -- # local mem_f mem 00:02:55.777 15:31:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:55.777 15:31:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:55.777 15:31:54 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:55.777 15:31:54 -- setup/common.sh@28 -- # mapfile -t mem 00:02:55.777 15:31:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.777 15:31:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381160 kB' 'MemFree: 170375336 kB' 'MemAvailable: 173548856 kB' 'Buffers: 4144 kB' 'Cached: 14916184 kB' 'SwapCached: 0 kB' 'Active: 12010152 kB' 'Inactive: 3528164 kB' 'Active(anon): 11349404 kB' 'Inactive(anon): 0 kB' 'Active(file): 660748 kB' 'Inactive(file): 3528164 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 621264 kB' 'Mapped: 182824 kB' 'Shmem: 10731416 kB' 'KReclaimable: 257648 kB' 'Slab: 857576 kB' 'SReclaimable: 257648 kB' 'SUnreclaim: 599928 kB' 'KernelStack: 20688 kB' 'PageTables: 9016 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030608 kB' 'Committed_AS: 12806032 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316080 kB' 'VmallocChunk: 0 kB' 'Percpu: 70656 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3288020 kB' 'DirectMap2M: 40431616 kB' 'DirectMap1G: 158334976 kB' 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.777 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.777 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.778 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.778 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.779 15:31:54 -- setup/common.sh@33 -- # echo 0 00:02:55.779 15:31:54 -- setup/common.sh@33 -- # return 0 00:02:55.779 15:31:54 -- setup/hugepages.sh@99 -- # surp=0 00:02:55.779 15:31:54 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:55.779 15:31:54 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:55.779 15:31:54 -- setup/common.sh@18 -- # local node= 00:02:55.779 15:31:54 -- setup/common.sh@19 -- # local var val 00:02:55.779 15:31:54 -- setup/common.sh@20 -- # local mem_f mem 00:02:55.779 15:31:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:55.779 15:31:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:55.779 15:31:54 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:55.779 15:31:54 -- setup/common.sh@28 -- # mapfile -t mem 00:02:55.779 15:31:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.779 15:31:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381160 kB' 'MemFree: 170375480 kB' 'MemAvailable: 173549000 kB' 'Buffers: 4144 kB' 'Cached: 14916196 kB' 'SwapCached: 0 kB' 'Active: 12010148 kB' 'Inactive: 3528164 kB' 'Active(anon): 11349400 kB' 'Inactive(anon): 0 kB' 'Active(file): 660748 kB' 'Inactive(file): 3528164 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 621252 kB' 'Mapped: 182824 kB' 'Shmem: 10731428 kB' 'KReclaimable: 257648 kB' 'Slab: 857572 kB' 'SReclaimable: 257648 kB' 'SUnreclaim: 599924 kB' 'KernelStack: 20672 kB' 'PageTables: 8944 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030608 kB' 'Committed_AS: 12806048 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316080 kB' 'VmallocChunk: 0 kB' 'Percpu: 70656 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3288020 kB' 'DirectMap2M: 40431616 kB' 'DirectMap1G: 158334976 kB' 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.779 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.779 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:55.780 15:31:54 -- setup/common.sh@33 -- # echo 0 00:02:55.780 15:31:54 -- setup/common.sh@33 -- # return 0 00:02:55.780 15:31:54 -- setup/hugepages.sh@100 -- # resv=0 00:02:55.780 15:31:54 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:02:55.780 nr_hugepages=1024 00:02:55.780 15:31:54 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:55.780 resv_hugepages=0 00:02:55.780 15:31:54 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:55.780 surplus_hugepages=0 00:02:55.780 15:31:54 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:55.780 anon_hugepages=0 00:02:55.780 15:31:54 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:55.780 15:31:54 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:02:55.780 15:31:54 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:55.780 15:31:54 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:55.780 15:31:54 -- setup/common.sh@18 -- # local node= 00:02:55.780 15:31:54 -- setup/common.sh@19 -- # local var val 00:02:55.780 15:31:54 -- setup/common.sh@20 -- # local mem_f mem 00:02:55.780 15:31:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:55.780 15:31:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:55.780 15:31:54 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:55.780 15:31:54 -- setup/common.sh@28 -- # mapfile -t mem 00:02:55.780 15:31:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.780 15:31:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381160 kB' 'MemFree: 170377576 kB' 'MemAvailable: 173551096 kB' 'Buffers: 4144 kB' 'Cached: 14916196 kB' 'SwapCached: 0 kB' 'Active: 12010148 kB' 'Inactive: 3528164 kB' 'Active(anon): 11349400 kB' 'Inactive(anon): 0 kB' 'Active(file): 660748 kB' 'Inactive(file): 3528164 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 621252 kB' 'Mapped: 182824 kB' 'Shmem: 10731428 kB' 'KReclaimable: 257648 kB' 'Slab: 857572 kB' 'SReclaimable: 257648 kB' 'SUnreclaim: 599924 kB' 'KernelStack: 20672 kB' 'PageTables: 8944 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030608 kB' 'Committed_AS: 12806064 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316080 kB' 'VmallocChunk: 0 kB' 'Percpu: 70656 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3288020 kB' 'DirectMap2M: 40431616 kB' 'DirectMap1G: 158334976 kB' 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.780 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.780 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.781 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.781 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:55.782 15:31:54 -- setup/common.sh@33 -- # echo 1024 00:02:55.782 15:31:54 -- setup/common.sh@33 -- # return 0 00:02:55.782 15:31:54 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:02:55.782 15:31:54 -- setup/hugepages.sh@112 -- # get_nodes 00:02:55.782 15:31:54 -- setup/hugepages.sh@27 -- # local node 00:02:55.782 15:31:54 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:55.782 15:31:54 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:55.782 15:31:54 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:55.782 15:31:54 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:55.782 15:31:54 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:55.782 15:31:54 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:55.782 15:31:54 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:55.782 15:31:54 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:55.782 15:31:54 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:55.782 15:31:54 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:55.782 15:31:54 -- setup/common.sh@18 -- # local node=0 00:02:55.782 15:31:54 -- setup/common.sh@19 -- # local var val 00:02:55.782 15:31:54 -- setup/common.sh@20 -- # local mem_f mem 00:02:55.782 15:31:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:55.782 15:31:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:55.782 15:31:54 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:55.782 15:31:54 -- setup/common.sh@28 -- # mapfile -t mem 00:02:55.782 15:31:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.782 15:31:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 97615628 kB' 'MemFree: 87377780 kB' 'MemUsed: 10237848 kB' 'SwapCached: 0 kB' 'Active: 7523384 kB' 'Inactive: 145888 kB' 'Active(anon): 7162064 kB' 'Inactive(anon): 0 kB' 'Active(file): 361320 kB' 'Inactive(file): 145888 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7206772 kB' 'Mapped: 118848 kB' 'AnonPages: 465708 kB' 'Shmem: 6699564 kB' 'KernelStack: 12904 kB' 'PageTables: 6072 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 131208 kB' 'Slab: 449204 kB' 'SReclaimable: 131208 kB' 'SUnreclaim: 317996 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.782 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.782 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.783 15:31:54 -- setup/common.sh@33 -- # echo 0 00:02:55.783 15:31:54 -- setup/common.sh@33 -- # return 0 00:02:55.783 15:31:54 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:55.783 15:31:54 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:55.783 15:31:54 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:55.783 15:31:54 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:02:55.783 15:31:54 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:55.783 15:31:54 -- setup/common.sh@18 -- # local node=1 00:02:55.783 15:31:54 -- setup/common.sh@19 -- # local var val 00:02:55.783 15:31:54 -- setup/common.sh@20 -- # local mem_f mem 00:02:55.783 15:31:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:55.783 15:31:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:02:55.783 15:31:54 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:02:55.783 15:31:54 -- setup/common.sh@28 -- # mapfile -t mem 00:02:55.783 15:31:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:55.783 15:31:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93765532 kB' 'MemFree: 83000812 kB' 'MemUsed: 10764720 kB' 'SwapCached: 0 kB' 'Active: 4486520 kB' 'Inactive: 3382276 kB' 'Active(anon): 4187092 kB' 'Inactive(anon): 0 kB' 'Active(file): 299428 kB' 'Inactive(file): 3382276 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7713612 kB' 'Mapped: 63976 kB' 'AnonPages: 155224 kB' 'Shmem: 4031908 kB' 'KernelStack: 7768 kB' 'PageTables: 2872 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 126440 kB' 'Slab: 408368 kB' 'SReclaimable: 126440 kB' 'SUnreclaim: 281928 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.783 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.783 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.784 15:31:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.784 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.784 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.784 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.784 15:31:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.784 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.784 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.784 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.784 15:31:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.784 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.784 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.784 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.784 15:31:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.784 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.784 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.784 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.784 15:31:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.784 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.784 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.784 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.784 15:31:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.784 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.784 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.784 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.784 15:31:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.784 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.784 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.784 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.784 15:31:54 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.784 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.784 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.784 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.784 15:31:54 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.784 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.784 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.784 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.784 15:31:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.784 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.784 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.784 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.784 15:31:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.784 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.784 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.784 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.784 15:31:54 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.784 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.784 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.784 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.784 15:31:54 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.784 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.784 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.784 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.784 15:31:54 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.784 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.784 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.784 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.784 15:31:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.784 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.784 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.784 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.784 15:31:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.784 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.784 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.784 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.784 15:31:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.784 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.784 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.784 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.784 15:31:54 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.784 15:31:54 -- setup/common.sh@32 -- # continue 00:02:55.784 15:31:54 -- setup/common.sh@31 -- # IFS=': ' 00:02:55.784 15:31:54 -- setup/common.sh@31 -- # read -r var val _ 00:02:55.784 15:31:54 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:55.784 15:31:54 -- setup/common.sh@33 -- # echo 0 00:02:55.784 15:31:54 -- setup/common.sh@33 -- # return 0 00:02:55.784 15:31:54 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:55.784 15:31:54 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:55.784 15:31:54 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:55.784 15:31:54 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:55.784 15:31:54 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:02:55.784 node0=512 expecting 512 00:02:55.784 15:31:54 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:55.784 15:31:54 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:55.784 15:31:54 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:55.784 15:31:54 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:02:55.784 node1=512 expecting 512 00:02:55.784 15:31:54 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:02:55.784 00:02:55.784 real 0m3.025s 00:02:55.784 user 0m1.184s 00:02:55.784 sys 0m1.894s 00:02:55.784 15:31:54 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:02:55.784 15:31:54 -- common/autotest_common.sh@10 -- # set +x 00:02:55.784 ************************************ 00:02:55.784 END TEST even_2G_alloc 00:02:55.784 ************************************ 00:02:56.043 15:31:54 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:02:56.043 15:31:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:56.043 15:31:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:56.043 15:31:54 -- common/autotest_common.sh@10 -- # set +x 00:02:56.043 ************************************ 00:02:56.043 START TEST odd_alloc 00:02:56.043 ************************************ 00:02:56.043 15:31:54 -- common/autotest_common.sh@1111 -- # odd_alloc 00:02:56.043 15:31:54 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:02:56.043 15:31:54 -- setup/hugepages.sh@49 -- # local size=2098176 00:02:56.043 15:31:54 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:02:56.043 15:31:54 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:56.043 15:31:54 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:02:56.043 15:31:54 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:02:56.043 15:31:54 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:56.043 15:31:54 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:56.043 15:31:54 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:02:56.043 15:31:54 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:56.043 15:31:54 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:56.043 15:31:54 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:56.043 15:31:54 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:56.044 15:31:54 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:02:56.044 15:31:54 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:56.044 15:31:54 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:02:56.044 15:31:54 -- setup/hugepages.sh@83 -- # : 513 00:02:56.044 15:31:54 -- setup/hugepages.sh@84 -- # : 1 00:02:56.044 15:31:54 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:56.044 15:31:54 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:02:56.044 15:31:54 -- setup/hugepages.sh@83 -- # : 0 00:02:56.044 15:31:54 -- setup/hugepages.sh@84 -- # : 0 00:02:56.044 15:31:54 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:56.044 15:31:54 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:02:56.044 15:31:54 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:02:56.044 15:31:54 -- setup/hugepages.sh@160 -- # setup output 00:02:56.044 15:31:54 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:56.044 15:31:54 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:02:58.577 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:02:58.577 0000:5f:00.0 (8086 0a54): Already using the vfio-pci driver 00:02:58.577 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:02:58.577 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:02:58.577 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:02:58.577 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:02:58.577 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:02:58.577 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:02:58.577 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:02:58.839 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:02:58.839 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:02:58.840 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:02:58.840 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:02:58.840 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:02:58.840 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:02:58.840 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:02:58.840 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:02:58.840 15:31:57 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:02:58.840 15:31:57 -- setup/hugepages.sh@89 -- # local node 00:02:58.840 15:31:57 -- setup/hugepages.sh@90 -- # local sorted_t 00:02:58.840 15:31:57 -- setup/hugepages.sh@91 -- # local sorted_s 00:02:58.840 15:31:57 -- setup/hugepages.sh@92 -- # local surp 00:02:58.840 15:31:57 -- setup/hugepages.sh@93 -- # local resv 00:02:58.840 15:31:57 -- setup/hugepages.sh@94 -- # local anon 00:02:58.840 15:31:57 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:02:58.840 15:31:57 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:02:58.840 15:31:57 -- setup/common.sh@17 -- # local get=AnonHugePages 00:02:58.840 15:31:57 -- setup/common.sh@18 -- # local node= 00:02:58.840 15:31:57 -- setup/common.sh@19 -- # local var val 00:02:58.840 15:31:57 -- setup/common.sh@20 -- # local mem_f mem 00:02:58.840 15:31:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:58.840 15:31:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:58.840 15:31:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:58.840 15:31:57 -- setup/common.sh@28 -- # mapfile -t mem 00:02:58.840 15:31:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.840 15:31:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381160 kB' 'MemFree: 170374840 kB' 'MemAvailable: 173548360 kB' 'Buffers: 4144 kB' 'Cached: 14916288 kB' 'SwapCached: 0 kB' 'Active: 12014624 kB' 'Inactive: 3528164 kB' 'Active(anon): 11353876 kB' 'Inactive(anon): 0 kB' 'Active(file): 660748 kB' 'Inactive(file): 3528164 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 625024 kB' 'Mapped: 183488 kB' 'Shmem: 10731520 kB' 'KReclaimable: 257648 kB' 'Slab: 858036 kB' 'SReclaimable: 257648 kB' 'SUnreclaim: 600388 kB' 'KernelStack: 20704 kB' 'PageTables: 9088 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103029584 kB' 'Committed_AS: 12810780 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316064 kB' 'VmallocChunk: 0 kB' 'Percpu: 70656 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 3288020 kB' 'DirectMap2M: 40431616 kB' 'DirectMap1G: 158334976 kB' 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.840 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.840 15:31:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:02:58.841 15:31:57 -- setup/common.sh@33 -- # echo 0 00:02:58.841 15:31:57 -- setup/common.sh@33 -- # return 0 00:02:58.841 15:31:57 -- setup/hugepages.sh@97 -- # anon=0 00:02:58.841 15:31:57 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:02:58.841 15:31:57 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:58.841 15:31:57 -- setup/common.sh@18 -- # local node= 00:02:58.841 15:31:57 -- setup/common.sh@19 -- # local var val 00:02:58.841 15:31:57 -- setup/common.sh@20 -- # local mem_f mem 00:02:58.841 15:31:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:58.841 15:31:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:58.841 15:31:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:58.841 15:31:57 -- setup/common.sh@28 -- # mapfile -t mem 00:02:58.841 15:31:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.841 15:31:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381160 kB' 'MemFree: 170375044 kB' 'MemAvailable: 173548564 kB' 'Buffers: 4144 kB' 'Cached: 14916292 kB' 'SwapCached: 0 kB' 'Active: 12016200 kB' 'Inactive: 3528164 kB' 'Active(anon): 11355452 kB' 'Inactive(anon): 0 kB' 'Active(file): 660748 kB' 'Inactive(file): 3528164 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 627220 kB' 'Mapped: 183776 kB' 'Shmem: 10731524 kB' 'KReclaimable: 257648 kB' 'Slab: 858064 kB' 'SReclaimable: 257648 kB' 'SUnreclaim: 600416 kB' 'KernelStack: 20688 kB' 'PageTables: 9028 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103029584 kB' 'Committed_AS: 12812648 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316016 kB' 'VmallocChunk: 0 kB' 'Percpu: 70656 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 3288020 kB' 'DirectMap2M: 40431616 kB' 'DirectMap1G: 158334976 kB' 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.841 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.841 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.842 15:31:57 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:58.842 15:31:57 -- setup/common.sh@33 -- # echo 0 00:02:58.842 15:31:57 -- setup/common.sh@33 -- # return 0 00:02:58.842 15:31:57 -- setup/hugepages.sh@99 -- # surp=0 00:02:58.842 15:31:57 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:02:58.842 15:31:57 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:02:58.842 15:31:57 -- setup/common.sh@18 -- # local node= 00:02:58.842 15:31:57 -- setup/common.sh@19 -- # local var val 00:02:58.842 15:31:57 -- setup/common.sh@20 -- # local mem_f mem 00:02:58.842 15:31:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:58.842 15:31:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:58.842 15:31:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:58.842 15:31:57 -- setup/common.sh@28 -- # mapfile -t mem 00:02:58.842 15:31:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.842 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381160 kB' 'MemFree: 170374292 kB' 'MemAvailable: 173547812 kB' 'Buffers: 4144 kB' 'Cached: 14916292 kB' 'SwapCached: 0 kB' 'Active: 12010352 kB' 'Inactive: 3528164 kB' 'Active(anon): 11349604 kB' 'Inactive(anon): 0 kB' 'Active(file): 660748 kB' 'Inactive(file): 3528164 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 621376 kB' 'Mapped: 183272 kB' 'Shmem: 10731524 kB' 'KReclaimable: 257648 kB' 'Slab: 858064 kB' 'SReclaimable: 257648 kB' 'SUnreclaim: 600416 kB' 'KernelStack: 20704 kB' 'PageTables: 9060 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103029584 kB' 'Committed_AS: 12806544 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316016 kB' 'VmallocChunk: 0 kB' 'Percpu: 70656 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 3288020 kB' 'DirectMap2M: 40431616 kB' 'DirectMap1G: 158334976 kB' 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.843 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.843 15:31:57 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:02:58.844 15:31:57 -- setup/common.sh@33 -- # echo 0 00:02:58.844 15:31:57 -- setup/common.sh@33 -- # return 0 00:02:58.844 15:31:57 -- setup/hugepages.sh@100 -- # resv=0 00:02:58.844 15:31:57 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:02:58.844 nr_hugepages=1025 00:02:58.844 15:31:57 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:02:58.844 resv_hugepages=0 00:02:58.844 15:31:57 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:02:58.844 surplus_hugepages=0 00:02:58.844 15:31:57 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:02:58.844 anon_hugepages=0 00:02:58.844 15:31:57 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:02:58.844 15:31:57 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:02:58.844 15:31:57 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:02:58.844 15:31:57 -- setup/common.sh@17 -- # local get=HugePages_Total 00:02:58.844 15:31:57 -- setup/common.sh@18 -- # local node= 00:02:58.844 15:31:57 -- setup/common.sh@19 -- # local var val 00:02:58.844 15:31:57 -- setup/common.sh@20 -- # local mem_f mem 00:02:58.844 15:31:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:58.844 15:31:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:02:58.844 15:31:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:02:58.844 15:31:57 -- setup/common.sh@28 -- # mapfile -t mem 00:02:58.844 15:31:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.844 15:31:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381160 kB' 'MemFree: 170374292 kB' 'MemAvailable: 173547812 kB' 'Buffers: 4144 kB' 'Cached: 14916292 kB' 'SwapCached: 0 kB' 'Active: 12010756 kB' 'Inactive: 3528164 kB' 'Active(anon): 11350008 kB' 'Inactive(anon): 0 kB' 'Active(file): 660748 kB' 'Inactive(file): 3528164 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 621764 kB' 'Mapped: 182860 kB' 'Shmem: 10731524 kB' 'KReclaimable: 257648 kB' 'Slab: 858064 kB' 'SReclaimable: 257648 kB' 'SUnreclaim: 600416 kB' 'KernelStack: 20688 kB' 'PageTables: 9012 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103029584 kB' 'Committed_AS: 12806560 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316016 kB' 'VmallocChunk: 0 kB' 'Percpu: 70656 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 3288020 kB' 'DirectMap2M: 40431616 kB' 'DirectMap1G: 158334976 kB' 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.844 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.844 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.845 15:31:57 -- setup/common.sh@32 -- # continue 00:02:58.845 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:58.846 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:58.846 15:31:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:02:58.846 15:31:57 -- setup/common.sh@33 -- # echo 1025 00:02:58.846 15:31:57 -- setup/common.sh@33 -- # return 0 00:02:58.846 15:31:57 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:02:58.846 15:31:57 -- setup/hugepages.sh@112 -- # get_nodes 00:02:58.846 15:31:57 -- setup/hugepages.sh@27 -- # local node 00:02:58.846 15:31:57 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:58.846 15:31:57 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:02:58.846 15:31:57 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:02:58.846 15:31:57 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:02:58.846 15:31:57 -- setup/hugepages.sh@32 -- # no_nodes=2 00:02:58.846 15:31:57 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:02:58.846 15:31:57 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:58.846 15:31:57 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:58.846 15:31:57 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:02:59.107 15:31:57 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:59.107 15:31:57 -- setup/common.sh@18 -- # local node=0 00:02:59.107 15:31:57 -- setup/common.sh@19 -- # local var val 00:02:59.107 15:31:57 -- setup/common.sh@20 -- # local mem_f mem 00:02:59.107 15:31:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:59.107 15:31:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:02:59.107 15:31:57 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:02:59.107 15:31:57 -- setup/common.sh@28 -- # mapfile -t mem 00:02:59.107 15:31:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.107 15:31:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 97615628 kB' 'MemFree: 87359956 kB' 'MemUsed: 10255672 kB' 'SwapCached: 0 kB' 'Active: 7523716 kB' 'Inactive: 145888 kB' 'Active(anon): 7162396 kB' 'Inactive(anon): 0 kB' 'Active(file): 361320 kB' 'Inactive(file): 145888 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7206792 kB' 'Mapped: 118884 kB' 'AnonPages: 466028 kB' 'Shmem: 6699584 kB' 'KernelStack: 12888 kB' 'PageTables: 6120 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 131208 kB' 'Slab: 449484 kB' 'SReclaimable: 131208 kB' 'SUnreclaim: 318276 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.107 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.107 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.108 15:31:57 -- setup/common.sh@33 -- # echo 0 00:02:59.108 15:31:57 -- setup/common.sh@33 -- # return 0 00:02:59.108 15:31:57 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:59.108 15:31:57 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:02:59.108 15:31:57 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:02:59.108 15:31:57 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:02:59.108 15:31:57 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:02:59.108 15:31:57 -- setup/common.sh@18 -- # local node=1 00:02:59.108 15:31:57 -- setup/common.sh@19 -- # local var val 00:02:59.108 15:31:57 -- setup/common.sh@20 -- # local mem_f mem 00:02:59.108 15:31:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:02:59.108 15:31:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:02:59.108 15:31:57 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:02:59.108 15:31:57 -- setup/common.sh@28 -- # mapfile -t mem 00:02:59.108 15:31:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.108 15:31:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93765532 kB' 'MemFree: 83015324 kB' 'MemUsed: 10750208 kB' 'SwapCached: 0 kB' 'Active: 4487196 kB' 'Inactive: 3382276 kB' 'Active(anon): 4187768 kB' 'Inactive(anon): 0 kB' 'Active(file): 299428 kB' 'Inactive(file): 3382276 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7713700 kB' 'Mapped: 63976 kB' 'AnonPages: 155916 kB' 'Shmem: 4031996 kB' 'KernelStack: 7864 kB' 'PageTables: 2740 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 126440 kB' 'Slab: 408584 kB' 'SReclaimable: 126440 kB' 'SUnreclaim: 282144 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.108 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.108 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.109 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.109 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.109 15:31:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.109 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.109 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.109 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.109 15:31:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.109 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.109 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.109 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.109 15:31:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.109 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.109 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.109 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.109 15:31:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.109 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.109 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.109 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.109 15:31:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.109 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.109 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.109 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.109 15:31:57 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.109 15:31:57 -- setup/common.sh@32 -- # continue 00:02:59.109 15:31:57 -- setup/common.sh@31 -- # IFS=': ' 00:02:59.109 15:31:57 -- setup/common.sh@31 -- # read -r var val _ 00:02:59.109 15:31:57 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:02:59.109 15:31:57 -- setup/common.sh@33 -- # echo 0 00:02:59.109 15:31:57 -- setup/common.sh@33 -- # return 0 00:02:59.109 15:31:57 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:02:59.109 15:31:57 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:59.109 15:31:57 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:59.109 15:31:57 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:59.109 15:31:57 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:02:59.109 node0=512 expecting 513 00:02:59.109 15:31:57 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:02:59.109 15:31:57 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:02:59.109 15:31:57 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:02:59.109 15:31:57 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:02:59.109 node1=513 expecting 512 00:02:59.109 15:31:57 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:02:59.109 00:02:59.109 real 0m2.988s 00:02:59.109 user 0m1.166s 00:02:59.109 sys 0m1.873s 00:02:59.109 15:31:57 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:02:59.109 15:31:57 -- common/autotest_common.sh@10 -- # set +x 00:02:59.109 ************************************ 00:02:59.109 END TEST odd_alloc 00:02:59.109 ************************************ 00:02:59.109 15:31:57 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:02:59.109 15:31:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:59.109 15:31:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:59.109 15:31:57 -- common/autotest_common.sh@10 -- # set +x 00:02:59.109 ************************************ 00:02:59.109 START TEST custom_alloc 00:02:59.109 ************************************ 00:02:59.109 15:31:57 -- common/autotest_common.sh@1111 -- # custom_alloc 00:02:59.109 15:31:57 -- setup/hugepages.sh@167 -- # local IFS=, 00:02:59.109 15:31:57 -- setup/hugepages.sh@169 -- # local node 00:02:59.109 15:31:57 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:02:59.109 15:31:57 -- setup/hugepages.sh@170 -- # local nodes_hp 00:02:59.109 15:31:57 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:02:59.109 15:31:57 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:02:59.109 15:31:57 -- setup/hugepages.sh@49 -- # local size=1048576 00:02:59.109 15:31:57 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:02:59.109 15:31:57 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:59.109 15:31:57 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:02:59.109 15:31:57 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:02:59.109 15:31:57 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:59.109 15:31:57 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:59.109 15:31:57 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:02:59.109 15:31:57 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:59.109 15:31:57 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:59.109 15:31:57 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:59.109 15:31:57 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:59.109 15:31:57 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:02:59.109 15:31:57 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:59.109 15:31:57 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:02:59.109 15:31:57 -- setup/hugepages.sh@83 -- # : 256 00:02:59.109 15:31:57 -- setup/hugepages.sh@84 -- # : 1 00:02:59.109 15:31:57 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:59.109 15:31:57 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:02:59.109 15:31:57 -- setup/hugepages.sh@83 -- # : 0 00:02:59.109 15:31:57 -- setup/hugepages.sh@84 -- # : 0 00:02:59.109 15:31:57 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:02:59.109 15:31:57 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:02:59.109 15:31:57 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:02:59.109 15:31:57 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:02:59.109 15:31:57 -- setup/hugepages.sh@49 -- # local size=2097152 00:02:59.109 15:31:57 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:02:59.109 15:31:57 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:02:59.109 15:31:57 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:02:59.109 15:31:57 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:02:59.109 15:31:57 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:59.109 15:31:57 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:59.109 15:31:57 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:59.109 15:31:57 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:59.109 15:31:57 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:59.109 15:31:57 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:59.109 15:31:57 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:59.109 15:31:57 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:02:59.109 15:31:57 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:02:59.109 15:31:57 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:02:59.109 15:31:57 -- setup/hugepages.sh@78 -- # return 0 00:02:59.109 15:31:57 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:02:59.109 15:31:57 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:02:59.109 15:31:57 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:02:59.109 15:31:57 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:02:59.109 15:31:57 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:02:59.109 15:31:57 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:02:59.109 15:31:57 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:02:59.109 15:31:57 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:02:59.109 15:31:57 -- setup/hugepages.sh@62 -- # user_nodes=() 00:02:59.109 15:31:57 -- setup/hugepages.sh@62 -- # local user_nodes 00:02:59.109 15:31:57 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:02:59.109 15:31:57 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:02:59.109 15:31:57 -- setup/hugepages.sh@67 -- # nodes_test=() 00:02:59.109 15:31:57 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:02:59.109 15:31:57 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:02:59.109 15:31:57 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:02:59.109 15:31:57 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:02:59.109 15:31:57 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:02:59.109 15:31:57 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:02:59.109 15:31:57 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:02:59.109 15:31:57 -- setup/hugepages.sh@78 -- # return 0 00:02:59.109 15:31:57 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:02:59.109 15:31:57 -- setup/hugepages.sh@187 -- # setup output 00:02:59.109 15:31:57 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:59.109 15:31:57 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:03:02.402 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:03:02.402 0000:5f:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:02.402 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:03:02.402 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:03:02.402 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:03:02.402 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:03:02.402 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:03:02.402 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:03:02.402 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:03:02.402 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:03:02.402 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:03:02.402 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:03:02.402 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:03:02.402 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:03:02.402 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:03:02.402 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:03:02.402 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:03:02.402 15:32:00 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:03:02.402 15:32:00 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:03:02.402 15:32:00 -- setup/hugepages.sh@89 -- # local node 00:03:02.402 15:32:00 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:02.402 15:32:00 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:02.402 15:32:00 -- setup/hugepages.sh@92 -- # local surp 00:03:02.402 15:32:00 -- setup/hugepages.sh@93 -- # local resv 00:03:02.402 15:32:00 -- setup/hugepages.sh@94 -- # local anon 00:03:02.402 15:32:00 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:02.402 15:32:00 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:02.402 15:32:00 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:02.402 15:32:00 -- setup/common.sh@18 -- # local node= 00:03:02.402 15:32:00 -- setup/common.sh@19 -- # local var val 00:03:02.402 15:32:00 -- setup/common.sh@20 -- # local mem_f mem 00:03:02.402 15:32:00 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:02.402 15:32:00 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:02.402 15:32:00 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:02.402 15:32:00 -- setup/common.sh@28 -- # mapfile -t mem 00:03:02.402 15:32:00 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:02.402 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.402 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.402 15:32:00 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381160 kB' 'MemFree: 169358608 kB' 'MemAvailable: 172532128 kB' 'Buffers: 4144 kB' 'Cached: 14916412 kB' 'SwapCached: 0 kB' 'Active: 12013564 kB' 'Inactive: 3528164 kB' 'Active(anon): 11352816 kB' 'Inactive(anon): 0 kB' 'Active(file): 660748 kB' 'Inactive(file): 3528164 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 624304 kB' 'Mapped: 183524 kB' 'Shmem: 10731644 kB' 'KReclaimable: 257648 kB' 'Slab: 857180 kB' 'SReclaimable: 257648 kB' 'SUnreclaim: 599532 kB' 'KernelStack: 20880 kB' 'PageTables: 9480 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 102506320 kB' 'Committed_AS: 12810808 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316384 kB' 'VmallocChunk: 0 kB' 'Percpu: 70656 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 3288020 kB' 'DirectMap2M: 40431616 kB' 'DirectMap1G: 158334976 kB' 00:03:02.402 15:32:00 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.402 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.402 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.402 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.402 15:32:00 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.402 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.402 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.402 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.402 15:32:00 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.402 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.403 15:32:00 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:02.403 15:32:00 -- setup/common.sh@33 -- # echo 0 00:03:02.403 15:32:00 -- setup/common.sh@33 -- # return 0 00:03:02.403 15:32:00 -- setup/hugepages.sh@97 -- # anon=0 00:03:02.403 15:32:00 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:02.403 15:32:00 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:02.403 15:32:00 -- setup/common.sh@18 -- # local node= 00:03:02.403 15:32:00 -- setup/common.sh@19 -- # local var val 00:03:02.403 15:32:00 -- setup/common.sh@20 -- # local mem_f mem 00:03:02.403 15:32:00 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:02.403 15:32:00 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:02.403 15:32:00 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:02.403 15:32:00 -- setup/common.sh@28 -- # mapfile -t mem 00:03:02.403 15:32:00 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:02.403 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.404 15:32:00 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381160 kB' 'MemFree: 169359836 kB' 'MemAvailable: 172533356 kB' 'Buffers: 4144 kB' 'Cached: 14916412 kB' 'SwapCached: 0 kB' 'Active: 12016384 kB' 'Inactive: 3528164 kB' 'Active(anon): 11355636 kB' 'Inactive(anon): 0 kB' 'Active(file): 660748 kB' 'Inactive(file): 3528164 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 627192 kB' 'Mapped: 183516 kB' 'Shmem: 10731644 kB' 'KReclaimable: 257648 kB' 'Slab: 857212 kB' 'SReclaimable: 257648 kB' 'SUnreclaim: 599564 kB' 'KernelStack: 20848 kB' 'PageTables: 9244 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 102506320 kB' 'Committed_AS: 12812228 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316224 kB' 'VmallocChunk: 0 kB' 'Percpu: 70656 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 3288020 kB' 'DirectMap2M: 40431616 kB' 'DirectMap1G: 158334976 kB' 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.404 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.404 15:32:00 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.405 15:32:00 -- setup/common.sh@33 -- # echo 0 00:03:02.405 15:32:00 -- setup/common.sh@33 -- # return 0 00:03:02.405 15:32:00 -- setup/hugepages.sh@99 -- # surp=0 00:03:02.405 15:32:00 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:02.405 15:32:00 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:02.405 15:32:00 -- setup/common.sh@18 -- # local node= 00:03:02.405 15:32:00 -- setup/common.sh@19 -- # local var val 00:03:02.405 15:32:00 -- setup/common.sh@20 -- # local mem_f mem 00:03:02.405 15:32:00 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:02.405 15:32:00 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:02.405 15:32:00 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:02.405 15:32:00 -- setup/common.sh@28 -- # mapfile -t mem 00:03:02.405 15:32:00 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.405 15:32:00 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381160 kB' 'MemFree: 169358760 kB' 'MemAvailable: 172532280 kB' 'Buffers: 4144 kB' 'Cached: 14916416 kB' 'SwapCached: 0 kB' 'Active: 12017092 kB' 'Inactive: 3528164 kB' 'Active(anon): 11356344 kB' 'Inactive(anon): 0 kB' 'Active(file): 660748 kB' 'Inactive(file): 3528164 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 627928 kB' 'Mapped: 183928 kB' 'Shmem: 10731648 kB' 'KReclaimable: 257648 kB' 'Slab: 857288 kB' 'SReclaimable: 257648 kB' 'SUnreclaim: 599640 kB' 'KernelStack: 20688 kB' 'PageTables: 8828 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 102506320 kB' 'Committed_AS: 12813312 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316116 kB' 'VmallocChunk: 0 kB' 'Percpu: 70656 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 3288020 kB' 'DirectMap2M: 40431616 kB' 'DirectMap1G: 158334976 kB' 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.405 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.405 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.406 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.406 15:32:00 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:02.406 15:32:00 -- setup/common.sh@33 -- # echo 0 00:03:02.406 15:32:00 -- setup/common.sh@33 -- # return 0 00:03:02.406 15:32:00 -- setup/hugepages.sh@100 -- # resv=0 00:03:02.406 15:32:00 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:03:02.406 nr_hugepages=1536 00:03:02.406 15:32:00 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:02.406 resv_hugepages=0 00:03:02.406 15:32:00 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:02.406 surplus_hugepages=0 00:03:02.406 15:32:00 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:02.406 anon_hugepages=0 00:03:02.406 15:32:00 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:02.406 15:32:00 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:03:02.406 15:32:00 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:02.406 15:32:00 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:02.406 15:32:00 -- setup/common.sh@18 -- # local node= 00:03:02.406 15:32:00 -- setup/common.sh@19 -- # local var val 00:03:02.406 15:32:00 -- setup/common.sh@20 -- # local mem_f mem 00:03:02.406 15:32:00 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:02.406 15:32:00 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:02.406 15:32:00 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:02.406 15:32:00 -- setup/common.sh@28 -- # mapfile -t mem 00:03:02.406 15:32:00 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:02.407 15:32:00 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381160 kB' 'MemFree: 169358872 kB' 'MemAvailable: 172532392 kB' 'Buffers: 4144 kB' 'Cached: 14916420 kB' 'SwapCached: 0 kB' 'Active: 12011704 kB' 'Inactive: 3528164 kB' 'Active(anon): 11350956 kB' 'Inactive(anon): 0 kB' 'Active(file): 660748 kB' 'Inactive(file): 3528164 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 622548 kB' 'Mapped: 183424 kB' 'Shmem: 10731652 kB' 'KReclaimable: 257648 kB' 'Slab: 857320 kB' 'SReclaimable: 257648 kB' 'SUnreclaim: 599672 kB' 'KernelStack: 20752 kB' 'PageTables: 9196 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 102506320 kB' 'Committed_AS: 12807208 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316128 kB' 'VmallocChunk: 0 kB' 'Percpu: 70656 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 3288020 kB' 'DirectMap2M: 40431616 kB' 'DirectMap1G: 158334976 kB' 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.407 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.407 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:02.408 15:32:00 -- setup/common.sh@33 -- # echo 1536 00:03:02.408 15:32:00 -- setup/common.sh@33 -- # return 0 00:03:02.408 15:32:00 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:02.408 15:32:00 -- setup/hugepages.sh@112 -- # get_nodes 00:03:02.408 15:32:00 -- setup/hugepages.sh@27 -- # local node 00:03:02.408 15:32:00 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:02.408 15:32:00 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:02.408 15:32:00 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:02.408 15:32:00 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:02.408 15:32:00 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:02.408 15:32:00 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:02.408 15:32:00 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:02.408 15:32:00 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:02.408 15:32:00 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:02.408 15:32:00 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:02.408 15:32:00 -- setup/common.sh@18 -- # local node=0 00:03:02.408 15:32:00 -- setup/common.sh@19 -- # local var val 00:03:02.408 15:32:00 -- setup/common.sh@20 -- # local mem_f mem 00:03:02.408 15:32:00 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:02.408 15:32:00 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:02.408 15:32:00 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:02.408 15:32:00 -- setup/common.sh@28 -- # mapfile -t mem 00:03:02.408 15:32:00 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.408 15:32:00 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 97615628 kB' 'MemFree: 87389508 kB' 'MemUsed: 10226120 kB' 'SwapCached: 0 kB' 'Active: 7524848 kB' 'Inactive: 145888 kB' 'Active(anon): 7163528 kB' 'Inactive(anon): 0 kB' 'Active(file): 361320 kB' 'Inactive(file): 145888 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7206824 kB' 'Mapped: 118916 kB' 'AnonPages: 467100 kB' 'Shmem: 6699616 kB' 'KernelStack: 12888 kB' 'PageTables: 6020 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 131208 kB' 'Slab: 448764 kB' 'SReclaimable: 131208 kB' 'SUnreclaim: 317556 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.408 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.408 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.409 15:32:00 -- setup/common.sh@33 -- # echo 0 00:03:02.409 15:32:00 -- setup/common.sh@33 -- # return 0 00:03:02.409 15:32:00 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:02.409 15:32:00 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:02.409 15:32:00 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:02.409 15:32:00 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:02.409 15:32:00 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:02.409 15:32:00 -- setup/common.sh@18 -- # local node=1 00:03:02.409 15:32:00 -- setup/common.sh@19 -- # local var val 00:03:02.409 15:32:00 -- setup/common.sh@20 -- # local mem_f mem 00:03:02.409 15:32:00 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:02.409 15:32:00 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:02.409 15:32:00 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:02.409 15:32:00 -- setup/common.sh@28 -- # mapfile -t mem 00:03:02.409 15:32:00 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.409 15:32:00 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93765532 kB' 'MemFree: 81969708 kB' 'MemUsed: 11795824 kB' 'SwapCached: 0 kB' 'Active: 4486412 kB' 'Inactive: 3382276 kB' 'Active(anon): 4186984 kB' 'Inactive(anon): 0 kB' 'Active(file): 299428 kB' 'Inactive(file): 3382276 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7713792 kB' 'Mapped: 64096 kB' 'AnonPages: 154992 kB' 'Shmem: 4032088 kB' 'KernelStack: 7864 kB' 'PageTables: 3152 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 126440 kB' 'Slab: 408556 kB' 'SReclaimable: 126440 kB' 'SUnreclaim: 282116 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.409 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.409 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # continue 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:02.410 15:32:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:02.410 15:32:00 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:02.410 15:32:00 -- setup/common.sh@33 -- # echo 0 00:03:02.410 15:32:00 -- setup/common.sh@33 -- # return 0 00:03:02.410 15:32:00 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:02.410 15:32:00 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:02.410 15:32:00 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:02.410 15:32:00 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:02.410 15:32:00 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:02.410 node0=512 expecting 512 00:03:02.410 15:32:00 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:02.410 15:32:00 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:02.410 15:32:00 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:02.410 15:32:00 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:03:02.410 node1=1024 expecting 1024 00:03:02.410 15:32:00 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:03:02.410 00:03:02.410 real 0m3.018s 00:03:02.410 user 0m1.214s 00:03:02.410 sys 0m1.867s 00:03:02.410 15:32:00 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:02.410 15:32:00 -- common/autotest_common.sh@10 -- # set +x 00:03:02.410 ************************************ 00:03:02.410 END TEST custom_alloc 00:03:02.410 ************************************ 00:03:02.410 15:32:00 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:03:02.410 15:32:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:02.410 15:32:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:02.410 15:32:00 -- common/autotest_common.sh@10 -- # set +x 00:03:02.410 ************************************ 00:03:02.410 START TEST no_shrink_alloc 00:03:02.410 ************************************ 00:03:02.410 15:32:00 -- common/autotest_common.sh@1111 -- # no_shrink_alloc 00:03:02.410 15:32:00 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:03:02.410 15:32:00 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:02.410 15:32:00 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:02.410 15:32:00 -- setup/hugepages.sh@51 -- # shift 00:03:02.410 15:32:00 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:02.410 15:32:00 -- setup/hugepages.sh@52 -- # local node_ids 00:03:02.410 15:32:00 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:02.410 15:32:00 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:02.410 15:32:00 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:02.410 15:32:00 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:02.410 15:32:00 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:02.410 15:32:00 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:02.410 15:32:00 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:02.410 15:32:00 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:02.410 15:32:00 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:02.410 15:32:00 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:02.410 15:32:00 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:02.410 15:32:00 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:02.410 15:32:00 -- setup/hugepages.sh@73 -- # return 0 00:03:02.410 15:32:00 -- setup/hugepages.sh@198 -- # setup output 00:03:02.410 15:32:00 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:02.410 15:32:00 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:03:04.944 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:03:04.944 0000:5f:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:04.944 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:03:04.944 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:03:04.944 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:03:04.944 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:03:04.944 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:03:04.944 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:03:04.945 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:03:04.945 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:03:04.945 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:03:04.945 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:03:04.945 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:03:04.945 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:03:05.205 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:03:05.205 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:03:05.205 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:03:05.205 15:32:03 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:03:05.205 15:32:03 -- setup/hugepages.sh@89 -- # local node 00:03:05.205 15:32:03 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:05.205 15:32:03 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:05.205 15:32:03 -- setup/hugepages.sh@92 -- # local surp 00:03:05.205 15:32:03 -- setup/hugepages.sh@93 -- # local resv 00:03:05.205 15:32:03 -- setup/hugepages.sh@94 -- # local anon 00:03:05.205 15:32:03 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:05.205 15:32:03 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:05.205 15:32:03 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:05.205 15:32:03 -- setup/common.sh@18 -- # local node= 00:03:05.205 15:32:03 -- setup/common.sh@19 -- # local var val 00:03:05.205 15:32:03 -- setup/common.sh@20 -- # local mem_f mem 00:03:05.205 15:32:03 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:05.205 15:32:03 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:05.205 15:32:03 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:05.205 15:32:03 -- setup/common.sh@28 -- # mapfile -t mem 00:03:05.205 15:32:03 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:05.205 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.205 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.205 15:32:03 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381160 kB' 'MemFree: 170403480 kB' 'MemAvailable: 173577000 kB' 'Buffers: 4144 kB' 'Cached: 14916532 kB' 'SwapCached: 0 kB' 'Active: 12013024 kB' 'Inactive: 3528164 kB' 'Active(anon): 11352276 kB' 'Inactive(anon): 0 kB' 'Active(file): 660748 kB' 'Inactive(file): 3528164 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 623324 kB' 'Mapped: 183028 kB' 'Shmem: 10731764 kB' 'KReclaimable: 257648 kB' 'Slab: 857824 kB' 'SReclaimable: 257648 kB' 'SUnreclaim: 600176 kB' 'KernelStack: 20672 kB' 'PageTables: 8976 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030608 kB' 'Committed_AS: 12807672 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316032 kB' 'VmallocChunk: 0 kB' 'Percpu: 70656 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3288020 kB' 'DirectMap2M: 40431616 kB' 'DirectMap1G: 158334976 kB' 00:03:05.205 15:32:03 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.205 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.205 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.205 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.205 15:32:03 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.205 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.205 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.205 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.205 15:32:03 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.205 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.205 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.205 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.205 15:32:03 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.205 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.205 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.205 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.205 15:32:03 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.205 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.205 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.205 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.205 15:32:03 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.205 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.205 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.205 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.205 15:32:03 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.205 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.205 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.205 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.205 15:32:03 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.205 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.205 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.205 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.205 15:32:03 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.205 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.205 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.205 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.205 15:32:03 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.205 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.205 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.205 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.205 15:32:03 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.205 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.205 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.205 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.205 15:32:03 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.205 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.205 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:05.206 15:32:03 -- setup/common.sh@33 -- # echo 0 00:03:05.206 15:32:03 -- setup/common.sh@33 -- # return 0 00:03:05.206 15:32:03 -- setup/hugepages.sh@97 -- # anon=0 00:03:05.206 15:32:03 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:05.206 15:32:03 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:05.206 15:32:03 -- setup/common.sh@18 -- # local node= 00:03:05.206 15:32:03 -- setup/common.sh@19 -- # local var val 00:03:05.206 15:32:03 -- setup/common.sh@20 -- # local mem_f mem 00:03:05.206 15:32:03 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:05.206 15:32:03 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:05.206 15:32:03 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:05.206 15:32:03 -- setup/common.sh@28 -- # mapfile -t mem 00:03:05.206 15:32:03 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.206 15:32:03 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381160 kB' 'MemFree: 170403224 kB' 'MemAvailable: 173576744 kB' 'Buffers: 4144 kB' 'Cached: 14916536 kB' 'SwapCached: 0 kB' 'Active: 12013032 kB' 'Inactive: 3528164 kB' 'Active(anon): 11352284 kB' 'Inactive(anon): 0 kB' 'Active(file): 660748 kB' 'Inactive(file): 3528164 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 623416 kB' 'Mapped: 182996 kB' 'Shmem: 10731768 kB' 'KReclaimable: 257648 kB' 'Slab: 857816 kB' 'SReclaimable: 257648 kB' 'SUnreclaim: 600168 kB' 'KernelStack: 20720 kB' 'PageTables: 9116 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030608 kB' 'Committed_AS: 12810592 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316016 kB' 'VmallocChunk: 0 kB' 'Percpu: 70656 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3288020 kB' 'DirectMap2M: 40431616 kB' 'DirectMap1G: 158334976 kB' 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.206 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.206 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.207 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.207 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.208 15:32:03 -- setup/common.sh@33 -- # echo 0 00:03:05.208 15:32:03 -- setup/common.sh@33 -- # return 0 00:03:05.208 15:32:03 -- setup/hugepages.sh@99 -- # surp=0 00:03:05.208 15:32:03 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:05.208 15:32:03 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:05.208 15:32:03 -- setup/common.sh@18 -- # local node= 00:03:05.208 15:32:03 -- setup/common.sh@19 -- # local var val 00:03:05.208 15:32:03 -- setup/common.sh@20 -- # local mem_f mem 00:03:05.208 15:32:03 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:05.208 15:32:03 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:05.208 15:32:03 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:05.208 15:32:03 -- setup/common.sh@28 -- # mapfile -t mem 00:03:05.208 15:32:03 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.208 15:32:03 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381160 kB' 'MemFree: 170405544 kB' 'MemAvailable: 173579064 kB' 'Buffers: 4144 kB' 'Cached: 14916536 kB' 'SwapCached: 0 kB' 'Active: 12012372 kB' 'Inactive: 3528164 kB' 'Active(anon): 11351624 kB' 'Inactive(anon): 0 kB' 'Active(file): 660748 kB' 'Inactive(file): 3528164 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 623216 kB' 'Mapped: 182920 kB' 'Shmem: 10731768 kB' 'KReclaimable: 257648 kB' 'Slab: 857768 kB' 'SReclaimable: 257648 kB' 'SUnreclaim: 600120 kB' 'KernelStack: 20672 kB' 'PageTables: 8952 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030608 kB' 'Committed_AS: 12807696 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 315984 kB' 'VmallocChunk: 0 kB' 'Percpu: 70656 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3288020 kB' 'DirectMap2M: 40431616 kB' 'DirectMap1G: 158334976 kB' 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.208 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.208 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.209 15:32:03 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:05.209 15:32:03 -- setup/common.sh@33 -- # echo 0 00:03:05.209 15:32:03 -- setup/common.sh@33 -- # return 0 00:03:05.209 15:32:03 -- setup/hugepages.sh@100 -- # resv=0 00:03:05.209 15:32:03 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:05.209 nr_hugepages=1024 00:03:05.209 15:32:03 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:05.209 resv_hugepages=0 00:03:05.209 15:32:03 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:05.209 surplus_hugepages=0 00:03:05.209 15:32:03 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:05.209 anon_hugepages=0 00:03:05.209 15:32:03 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:05.209 15:32:03 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:05.209 15:32:03 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:05.209 15:32:03 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:05.209 15:32:03 -- setup/common.sh@18 -- # local node= 00:03:05.209 15:32:03 -- setup/common.sh@19 -- # local var val 00:03:05.209 15:32:03 -- setup/common.sh@20 -- # local mem_f mem 00:03:05.209 15:32:03 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:05.209 15:32:03 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:05.209 15:32:03 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:05.209 15:32:03 -- setup/common.sh@28 -- # mapfile -t mem 00:03:05.209 15:32:03 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.209 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.209 15:32:03 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381160 kB' 'MemFree: 170404160 kB' 'MemAvailable: 173577680 kB' 'Buffers: 4144 kB' 'Cached: 14916564 kB' 'SwapCached: 0 kB' 'Active: 12013344 kB' 'Inactive: 3528164 kB' 'Active(anon): 11352596 kB' 'Inactive(anon): 0 kB' 'Active(file): 660748 kB' 'Inactive(file): 3528164 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 624080 kB' 'Mapped: 183424 kB' 'Shmem: 10731796 kB' 'KReclaimable: 257648 kB' 'Slab: 857760 kB' 'SReclaimable: 257648 kB' 'SUnreclaim: 600112 kB' 'KernelStack: 20656 kB' 'PageTables: 8904 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030608 kB' 'Committed_AS: 12809464 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 315984 kB' 'VmallocChunk: 0 kB' 'Percpu: 70656 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3288020 kB' 'DirectMap2M: 40431616 kB' 'DirectMap1G: 158334976 kB' 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.210 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.210 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.211 15:32:03 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.211 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.211 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.211 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.211 15:32:03 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.211 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.211 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.211 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.211 15:32:03 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.211 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.211 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.211 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.211 15:32:03 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.211 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.211 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.211 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.211 15:32:03 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.211 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.211 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.211 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.211 15:32:03 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.211 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.211 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.211 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.211 15:32:03 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.211 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.211 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.211 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.211 15:32:03 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.211 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.211 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.211 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.211 15:32:03 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.211 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.211 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.211 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.211 15:32:03 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.211 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.211 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.211 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.211 15:32:03 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.211 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.211 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.211 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.211 15:32:03 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.211 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.211 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.211 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.211 15:32:03 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.211 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.211 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.211 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.211 15:32:03 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.211 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.211 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.211 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.211 15:32:03 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.211 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.211 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.211 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.211 15:32:03 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:05.211 15:32:03 -- setup/common.sh@33 -- # echo 1024 00:03:05.211 15:32:03 -- setup/common.sh@33 -- # return 0 00:03:05.211 15:32:03 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:05.211 15:32:03 -- setup/hugepages.sh@112 -- # get_nodes 00:03:05.471 15:32:03 -- setup/hugepages.sh@27 -- # local node 00:03:05.471 15:32:03 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:05.471 15:32:03 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:05.471 15:32:03 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:05.471 15:32:03 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:05.471 15:32:03 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:05.471 15:32:03 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:05.471 15:32:03 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:05.471 15:32:03 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:05.471 15:32:03 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:05.471 15:32:03 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:05.471 15:32:03 -- setup/common.sh@18 -- # local node=0 00:03:05.471 15:32:03 -- setup/common.sh@19 -- # local var val 00:03:05.471 15:32:03 -- setup/common.sh@20 -- # local mem_f mem 00:03:05.471 15:32:03 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:05.471 15:32:03 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:05.471 15:32:03 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:05.471 15:32:03 -- setup/common.sh@28 -- # mapfile -t mem 00:03:05.471 15:32:03 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:05.471 15:32:03 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 97615628 kB' 'MemFree: 86329476 kB' 'MemUsed: 11286152 kB' 'SwapCached: 0 kB' 'Active: 7529948 kB' 'Inactive: 145888 kB' 'Active(anon): 7168628 kB' 'Inactive(anon): 0 kB' 'Active(file): 361320 kB' 'Inactive(file): 145888 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7206836 kB' 'Mapped: 119444 kB' 'AnonPages: 472232 kB' 'Shmem: 6699628 kB' 'KernelStack: 12904 kB' 'PageTables: 6076 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 131208 kB' 'Slab: 449296 kB' 'SReclaimable: 131208 kB' 'SUnreclaim: 318088 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:05.471 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.471 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.471 15:32:03 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.471 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.471 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.471 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.471 15:32:03 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.471 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.471 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.471 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.471 15:32:03 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.471 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.471 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.471 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.471 15:32:03 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.471 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.471 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.471 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.471 15:32:03 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.471 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.471 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.471 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.471 15:32:03 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.471 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.471 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.471 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.471 15:32:03 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.471 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.471 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.471 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.471 15:32:03 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.471 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.471 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.471 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.471 15:32:03 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.471 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.471 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.471 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.471 15:32:03 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.471 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.471 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.471 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.471 15:32:03 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.471 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.471 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.471 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # continue 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.472 15:32:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.472 15:32:03 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:05.472 15:32:03 -- setup/common.sh@33 -- # echo 0 00:03:05.472 15:32:03 -- setup/common.sh@33 -- # return 0 00:03:05.472 15:32:03 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:05.472 15:32:03 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:05.472 15:32:03 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:05.472 15:32:03 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:05.472 15:32:03 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:05.472 node0=1024 expecting 1024 00:03:05.472 15:32:03 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:05.472 15:32:03 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:03:05.472 15:32:03 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:03:05.472 15:32:03 -- setup/hugepages.sh@202 -- # setup output 00:03:05.472 15:32:03 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:05.472 15:32:03 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:03:08.011 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:03:08.011 0000:5f:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:08.011 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:03:08.011 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:03:08.011 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:03:08.011 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:03:08.011 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:03:08.011 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:03:08.011 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:03:08.011 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:03:08.011 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:03:08.011 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:03:08.011 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:03:08.011 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:03:08.011 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:03:08.011 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:03:08.011 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:03:08.011 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:03:08.011 15:32:06 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:03:08.011 15:32:06 -- setup/hugepages.sh@89 -- # local node 00:03:08.011 15:32:06 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:08.011 15:32:06 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:08.011 15:32:06 -- setup/hugepages.sh@92 -- # local surp 00:03:08.011 15:32:06 -- setup/hugepages.sh@93 -- # local resv 00:03:08.011 15:32:06 -- setup/hugepages.sh@94 -- # local anon 00:03:08.011 15:32:06 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:08.011 15:32:06 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:08.012 15:32:06 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:08.012 15:32:06 -- setup/common.sh@18 -- # local node= 00:03:08.012 15:32:06 -- setup/common.sh@19 -- # local var val 00:03:08.012 15:32:06 -- setup/common.sh@20 -- # local mem_f mem 00:03:08.012 15:32:06 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:08.012 15:32:06 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:08.012 15:32:06 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:08.012 15:32:06 -- setup/common.sh@28 -- # mapfile -t mem 00:03:08.012 15:32:06 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.012 15:32:06 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381160 kB' 'MemFree: 170397512 kB' 'MemAvailable: 173571032 kB' 'Buffers: 4144 kB' 'Cached: 14916628 kB' 'SwapCached: 0 kB' 'Active: 12012920 kB' 'Inactive: 3528164 kB' 'Active(anon): 11352172 kB' 'Inactive(anon): 0 kB' 'Active(file): 660748 kB' 'Inactive(file): 3528164 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 623524 kB' 'Mapped: 182968 kB' 'Shmem: 10731860 kB' 'KReclaimable: 257648 kB' 'Slab: 858404 kB' 'SReclaimable: 257648 kB' 'SUnreclaim: 600756 kB' 'KernelStack: 20640 kB' 'PageTables: 8796 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030608 kB' 'Committed_AS: 12807788 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316160 kB' 'VmallocChunk: 0 kB' 'Percpu: 70656 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3288020 kB' 'DirectMap2M: 40431616 kB' 'DirectMap1G: 158334976 kB' 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.012 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.012 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:08.013 15:32:06 -- setup/common.sh@33 -- # echo 0 00:03:08.013 15:32:06 -- setup/common.sh@33 -- # return 0 00:03:08.013 15:32:06 -- setup/hugepages.sh@97 -- # anon=0 00:03:08.013 15:32:06 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:08.013 15:32:06 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:08.013 15:32:06 -- setup/common.sh@18 -- # local node= 00:03:08.013 15:32:06 -- setup/common.sh@19 -- # local var val 00:03:08.013 15:32:06 -- setup/common.sh@20 -- # local mem_f mem 00:03:08.013 15:32:06 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:08.013 15:32:06 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:08.013 15:32:06 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:08.013 15:32:06 -- setup/common.sh@28 -- # mapfile -t mem 00:03:08.013 15:32:06 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.013 15:32:06 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381160 kB' 'MemFree: 170397072 kB' 'MemAvailable: 173570592 kB' 'Buffers: 4144 kB' 'Cached: 14916632 kB' 'SwapCached: 0 kB' 'Active: 12012608 kB' 'Inactive: 3528164 kB' 'Active(anon): 11351860 kB' 'Inactive(anon): 0 kB' 'Active(file): 660748 kB' 'Inactive(file): 3528164 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 623232 kB' 'Mapped: 182928 kB' 'Shmem: 10731864 kB' 'KReclaimable: 257648 kB' 'Slab: 858452 kB' 'SReclaimable: 257648 kB' 'SUnreclaim: 600804 kB' 'KernelStack: 20624 kB' 'PageTables: 8756 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030608 kB' 'Committed_AS: 12807932 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316144 kB' 'VmallocChunk: 0 kB' 'Percpu: 70656 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3288020 kB' 'DirectMap2M: 40431616 kB' 'DirectMap1G: 158334976 kB' 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.013 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.013 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.014 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.014 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.015 15:32:06 -- setup/common.sh@33 -- # echo 0 00:03:08.015 15:32:06 -- setup/common.sh@33 -- # return 0 00:03:08.015 15:32:06 -- setup/hugepages.sh@99 -- # surp=0 00:03:08.015 15:32:06 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:08.015 15:32:06 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:08.015 15:32:06 -- setup/common.sh@18 -- # local node= 00:03:08.015 15:32:06 -- setup/common.sh@19 -- # local var val 00:03:08.015 15:32:06 -- setup/common.sh@20 -- # local mem_f mem 00:03:08.015 15:32:06 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:08.015 15:32:06 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:08.015 15:32:06 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:08.015 15:32:06 -- setup/common.sh@28 -- # mapfile -t mem 00:03:08.015 15:32:06 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.015 15:32:06 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381160 kB' 'MemFree: 170396568 kB' 'MemAvailable: 173570088 kB' 'Buffers: 4144 kB' 'Cached: 14916652 kB' 'SwapCached: 0 kB' 'Active: 12012944 kB' 'Inactive: 3528164 kB' 'Active(anon): 11352196 kB' 'Inactive(anon): 0 kB' 'Active(file): 660748 kB' 'Inactive(file): 3528164 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 623556 kB' 'Mapped: 182928 kB' 'Shmem: 10731884 kB' 'KReclaimable: 257648 kB' 'Slab: 858452 kB' 'SReclaimable: 257648 kB' 'SUnreclaim: 600804 kB' 'KernelStack: 20672 kB' 'PageTables: 8984 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030608 kB' 'Committed_AS: 12820828 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316160 kB' 'VmallocChunk: 0 kB' 'Percpu: 70656 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3288020 kB' 'DirectMap2M: 40431616 kB' 'DirectMap1G: 158334976 kB' 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.015 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.015 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:08.016 15:32:06 -- setup/common.sh@33 -- # echo 0 00:03:08.016 15:32:06 -- setup/common.sh@33 -- # return 0 00:03:08.016 15:32:06 -- setup/hugepages.sh@100 -- # resv=0 00:03:08.016 15:32:06 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:08.016 nr_hugepages=1024 00:03:08.016 15:32:06 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:08.016 resv_hugepages=0 00:03:08.016 15:32:06 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:08.016 surplus_hugepages=0 00:03:08.016 15:32:06 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:08.016 anon_hugepages=0 00:03:08.016 15:32:06 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:08.016 15:32:06 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:08.016 15:32:06 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:08.016 15:32:06 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:08.016 15:32:06 -- setup/common.sh@18 -- # local node= 00:03:08.016 15:32:06 -- setup/common.sh@19 -- # local var val 00:03:08.016 15:32:06 -- setup/common.sh@20 -- # local mem_f mem 00:03:08.016 15:32:06 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:08.016 15:32:06 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:08.016 15:32:06 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:08.016 15:32:06 -- setup/common.sh@28 -- # mapfile -t mem 00:03:08.016 15:32:06 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.016 15:32:06 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 191381160 kB' 'MemFree: 170396064 kB' 'MemAvailable: 173569584 kB' 'Buffers: 4144 kB' 'Cached: 14916668 kB' 'SwapCached: 0 kB' 'Active: 12012776 kB' 'Inactive: 3528164 kB' 'Active(anon): 11352028 kB' 'Inactive(anon): 0 kB' 'Active(file): 660748 kB' 'Inactive(file): 3528164 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 623432 kB' 'Mapped: 182928 kB' 'Shmem: 10731900 kB' 'KReclaimable: 257648 kB' 'Slab: 858452 kB' 'SReclaimable: 257648 kB' 'SUnreclaim: 600804 kB' 'KernelStack: 20640 kB' 'PageTables: 8876 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 103030608 kB' 'Committed_AS: 12808332 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 316128 kB' 'VmallocChunk: 0 kB' 'Percpu: 70656 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 3288020 kB' 'DirectMap2M: 40431616 kB' 'DirectMap1G: 158334976 kB' 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.016 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.016 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.017 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.017 15:32:06 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.018 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.018 15:32:06 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:08.018 15:32:06 -- setup/common.sh@33 -- # echo 1024 00:03:08.018 15:32:06 -- setup/common.sh@33 -- # return 0 00:03:08.018 15:32:06 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:08.018 15:32:06 -- setup/hugepages.sh@112 -- # get_nodes 00:03:08.018 15:32:06 -- setup/hugepages.sh@27 -- # local node 00:03:08.018 15:32:06 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:08.018 15:32:06 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:08.018 15:32:06 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:08.278 15:32:06 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:08.278 15:32:06 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:08.278 15:32:06 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:08.278 15:32:06 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:08.278 15:32:06 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:08.278 15:32:06 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:08.278 15:32:06 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:08.278 15:32:06 -- setup/common.sh@18 -- # local node=0 00:03:08.278 15:32:06 -- setup/common.sh@19 -- # local var val 00:03:08.278 15:32:06 -- setup/common.sh@20 -- # local mem_f mem 00:03:08.278 15:32:06 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:08.278 15:32:06 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:08.278 15:32:06 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:08.278 15:32:06 -- setup/common.sh@28 -- # mapfile -t mem 00:03:08.278 15:32:06 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:08.278 15:32:06 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 97615628 kB' 'MemFree: 86322428 kB' 'MemUsed: 11293200 kB' 'SwapCached: 0 kB' 'Active: 7524060 kB' 'Inactive: 145888 kB' 'Active(anon): 7162740 kB' 'Inactive(anon): 0 kB' 'Active(file): 361320 kB' 'Inactive(file): 145888 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7206836 kB' 'Mapped: 118948 kB' 'AnonPages: 466224 kB' 'Shmem: 6699628 kB' 'KernelStack: 12840 kB' 'PageTables: 5892 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 131208 kB' 'Slab: 449912 kB' 'SReclaimable: 131208 kB' 'SUnreclaim: 318704 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.278 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.278 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.279 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.279 15:32:06 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.279 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.279 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.279 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.279 15:32:06 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.279 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.279 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.279 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.279 15:32:06 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.279 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.279 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.279 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.279 15:32:06 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.279 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.279 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.279 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.279 15:32:06 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.279 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.279 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.279 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.279 15:32:06 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.279 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.279 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.279 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.279 15:32:06 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.279 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.279 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.279 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.279 15:32:06 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.279 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.279 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.279 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.279 15:32:06 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.279 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.279 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.279 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.279 15:32:06 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.279 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.279 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.279 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.279 15:32:06 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.279 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.279 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.279 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.279 15:32:06 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.279 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.279 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.279 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.279 15:32:06 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.279 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.279 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.279 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.279 15:32:06 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.279 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.279 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.279 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.279 15:32:06 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.279 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.279 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.279 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.279 15:32:06 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.279 15:32:06 -- setup/common.sh@32 -- # continue 00:03:08.279 15:32:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:08.279 15:32:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:08.279 15:32:06 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:08.279 15:32:06 -- setup/common.sh@33 -- # echo 0 00:03:08.279 15:32:06 -- setup/common.sh@33 -- # return 0 00:03:08.279 15:32:06 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:08.279 15:32:06 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:08.279 15:32:06 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:08.279 15:32:06 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:08.279 15:32:06 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:08.279 node0=1024 expecting 1024 00:03:08.279 15:32:06 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:08.279 00:03:08.279 real 0m5.764s 00:03:08.279 user 0m2.264s 00:03:08.279 sys 0m3.608s 00:03:08.279 15:32:06 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:08.279 15:32:06 -- common/autotest_common.sh@10 -- # set +x 00:03:08.279 ************************************ 00:03:08.279 END TEST no_shrink_alloc 00:03:08.279 ************************************ 00:03:08.279 15:32:06 -- setup/hugepages.sh@217 -- # clear_hp 00:03:08.279 15:32:06 -- setup/hugepages.sh@37 -- # local node hp 00:03:08.279 15:32:06 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:08.279 15:32:06 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:08.279 15:32:06 -- setup/hugepages.sh@41 -- # echo 0 00:03:08.279 15:32:06 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:08.279 15:32:06 -- setup/hugepages.sh@41 -- # echo 0 00:03:08.279 15:32:06 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:08.279 15:32:06 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:08.279 15:32:06 -- setup/hugepages.sh@41 -- # echo 0 00:03:08.279 15:32:06 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:08.279 15:32:06 -- setup/hugepages.sh@41 -- # echo 0 00:03:08.279 15:32:06 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:08.279 15:32:06 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:08.279 00:03:08.279 real 0m23.153s 00:03:08.279 user 0m8.583s 00:03:08.279 sys 0m13.487s 00:03:08.279 15:32:06 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:08.279 15:32:06 -- common/autotest_common.sh@10 -- # set +x 00:03:08.279 ************************************ 00:03:08.279 END TEST hugepages 00:03:08.279 ************************************ 00:03:08.279 15:32:06 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/driver.sh 00:03:08.279 15:32:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:08.279 15:32:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:08.279 15:32:06 -- common/autotest_common.sh@10 -- # set +x 00:03:08.279 ************************************ 00:03:08.279 START TEST driver 00:03:08.279 ************************************ 00:03:08.279 15:32:06 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/driver.sh 00:03:08.539 * Looking for test storage... 00:03:08.539 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup 00:03:08.539 15:32:06 -- setup/driver.sh@68 -- # setup reset 00:03:08.539 15:32:06 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:08.539 15:32:06 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:03:12.731 15:32:10 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:03:12.731 15:32:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:12.731 15:32:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:12.731 15:32:10 -- common/autotest_common.sh@10 -- # set +x 00:03:12.731 ************************************ 00:03:12.731 START TEST guess_driver 00:03:12.731 ************************************ 00:03:12.731 15:32:10 -- common/autotest_common.sh@1111 -- # guess_driver 00:03:12.731 15:32:10 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:03:12.731 15:32:10 -- setup/driver.sh@47 -- # local fail=0 00:03:12.731 15:32:10 -- setup/driver.sh@49 -- # pick_driver 00:03:12.732 15:32:10 -- setup/driver.sh@36 -- # vfio 00:03:12.732 15:32:10 -- setup/driver.sh@21 -- # local iommu_grups 00:03:12.732 15:32:10 -- setup/driver.sh@22 -- # local unsafe_vfio 00:03:12.732 15:32:10 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:03:12.732 15:32:10 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:03:12.732 15:32:10 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:03:12.732 15:32:10 -- setup/driver.sh@29 -- # (( 174 > 0 )) 00:03:12.732 15:32:10 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:03:12.732 15:32:10 -- setup/driver.sh@14 -- # mod vfio_pci 00:03:12.732 15:32:10 -- setup/driver.sh@12 -- # dep vfio_pci 00:03:12.732 15:32:10 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:03:12.732 15:32:10 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:03:12.732 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:12.732 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:12.732 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:12.732 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:12.732 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:03:12.732 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:03:12.732 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:03:12.732 15:32:10 -- setup/driver.sh@30 -- # return 0 00:03:12.732 15:32:10 -- setup/driver.sh@37 -- # echo vfio-pci 00:03:12.732 15:32:10 -- setup/driver.sh@49 -- # driver=vfio-pci 00:03:12.732 15:32:10 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:03:12.732 15:32:10 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:03:12.732 Looking for driver=vfio-pci 00:03:12.732 15:32:10 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:12.732 15:32:10 -- setup/driver.sh@45 -- # setup output config 00:03:12.732 15:32:10 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:12.732 15:32:10 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:03:15.266 15:32:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:15.266 15:32:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:15.266 15:32:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:15.266 15:32:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:15.266 15:32:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:15.266 15:32:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:15.266 15:32:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:15.266 15:32:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:15.266 15:32:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:15.266 15:32:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:15.266 15:32:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:15.266 15:32:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:15.266 15:32:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:15.266 15:32:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:15.266 15:32:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:15.266 15:32:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:15.266 15:32:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:15.266 15:32:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:15.266 15:32:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:15.266 15:32:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:15.266 15:32:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:15.266 15:32:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:15.266 15:32:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:15.266 15:32:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:15.266 15:32:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:15.266 15:32:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:15.266 15:32:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:15.266 15:32:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:15.266 15:32:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:15.266 15:32:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:15.266 15:32:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:15.266 15:32:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:15.266 15:32:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:15.266 15:32:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:15.266 15:32:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:15.266 15:32:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:15.266 15:32:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:15.266 15:32:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:15.266 15:32:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:15.266 15:32:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:15.266 15:32:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:15.266 15:32:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:15.266 15:32:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:15.266 15:32:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:15.266 15:32:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:15.267 15:32:13 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:15.267 15:32:13 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:15.267 15:32:13 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:16.641 15:32:15 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:16.641 15:32:15 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:16.641 15:32:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:16.900 15:32:15 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:03:16.900 15:32:15 -- setup/driver.sh@65 -- # setup reset 00:03:16.900 15:32:15 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:16.900 15:32:15 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:03:21.093 00:03:21.093 real 0m8.337s 00:03:21.093 user 0m2.177s 00:03:21.093 sys 0m4.090s 00:03:21.093 15:32:19 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:21.093 15:32:19 -- common/autotest_common.sh@10 -- # set +x 00:03:21.093 ************************************ 00:03:21.093 END TEST guess_driver 00:03:21.093 ************************************ 00:03:21.093 00:03:21.093 real 0m12.495s 00:03:21.093 user 0m3.325s 00:03:21.093 sys 0m6.328s 00:03:21.093 15:32:19 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:21.093 15:32:19 -- common/autotest_common.sh@10 -- # set +x 00:03:21.093 ************************************ 00:03:21.093 END TEST driver 00:03:21.093 ************************************ 00:03:21.093 15:32:19 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/devices.sh 00:03:21.093 15:32:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:21.093 15:32:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:21.093 15:32:19 -- common/autotest_common.sh@10 -- # set +x 00:03:21.093 ************************************ 00:03:21.093 START TEST devices 00:03:21.093 ************************************ 00:03:21.093 15:32:19 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/devices.sh 00:03:21.093 * Looking for test storage... 00:03:21.093 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup 00:03:21.093 15:32:19 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:03:21.093 15:32:19 -- setup/devices.sh@192 -- # setup reset 00:03:21.093 15:32:19 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:21.093 15:32:19 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:03:24.377 15:32:22 -- setup/devices.sh@194 -- # get_zoned_devs 00:03:24.377 15:32:22 -- common/autotest_common.sh@1655 -- # zoned_devs=() 00:03:24.377 15:32:22 -- common/autotest_common.sh@1655 -- # local -gA zoned_devs 00:03:24.377 15:32:22 -- common/autotest_common.sh@1656 -- # local nvme bdf 00:03:24.377 15:32:22 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:03:24.377 15:32:22 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme0n1 00:03:24.377 15:32:22 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:03:24.377 15:32:22 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:24.377 15:32:22 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:03:24.377 15:32:22 -- setup/devices.sh@196 -- # blocks=() 00:03:24.377 15:32:22 -- setup/devices.sh@196 -- # declare -a blocks 00:03:24.377 15:32:22 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:03:24.377 15:32:22 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:03:24.377 15:32:22 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:03:24.377 15:32:22 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:03:24.377 15:32:22 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:03:24.377 15:32:22 -- setup/devices.sh@201 -- # ctrl=nvme0 00:03:24.377 15:32:22 -- setup/devices.sh@202 -- # pci=0000:5f:00.0 00:03:24.377 15:32:22 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\5\f\:\0\0\.\0* ]] 00:03:24.377 15:32:22 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:03:24.377 15:32:22 -- scripts/common.sh@378 -- # local block=nvme0n1 pt 00:03:24.377 15:32:22 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:03:24.377 No valid GPT data, bailing 00:03:24.377 15:32:22 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:24.377 15:32:22 -- scripts/common.sh@391 -- # pt= 00:03:24.377 15:32:22 -- scripts/common.sh@392 -- # return 1 00:03:24.377 15:32:22 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:03:24.377 15:32:22 -- setup/common.sh@76 -- # local dev=nvme0n1 00:03:24.377 15:32:22 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:03:24.377 15:32:22 -- setup/common.sh@80 -- # echo 1600321314816 00:03:24.377 15:32:22 -- setup/devices.sh@204 -- # (( 1600321314816 >= min_disk_size )) 00:03:24.377 15:32:22 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:03:24.377 15:32:22 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:5f:00.0 00:03:24.377 15:32:22 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:03:24.377 15:32:22 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:03:24.377 15:32:22 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:03:24.377 15:32:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:24.377 15:32:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:24.377 15:32:22 -- common/autotest_common.sh@10 -- # set +x 00:03:24.377 ************************************ 00:03:24.377 START TEST nvme_mount 00:03:24.377 ************************************ 00:03:24.377 15:32:22 -- common/autotest_common.sh@1111 -- # nvme_mount 00:03:24.377 15:32:22 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:03:24.377 15:32:22 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:03:24.377 15:32:22 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:24.377 15:32:22 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:24.377 15:32:22 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:03:24.377 15:32:22 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:24.377 15:32:22 -- setup/common.sh@40 -- # local part_no=1 00:03:24.377 15:32:22 -- setup/common.sh@41 -- # local size=1073741824 00:03:24.377 15:32:22 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:24.377 15:32:22 -- setup/common.sh@44 -- # parts=() 00:03:24.377 15:32:22 -- setup/common.sh@44 -- # local parts 00:03:24.377 15:32:22 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:24.377 15:32:22 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:24.377 15:32:22 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:24.377 15:32:22 -- setup/common.sh@46 -- # (( part++ )) 00:03:24.377 15:32:22 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:24.377 15:32:22 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:24.377 15:32:22 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:24.377 15:32:22 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:03:25.347 Creating new GPT entries in memory. 00:03:25.347 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:25.347 other utilities. 00:03:25.347 15:32:23 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:25.347 15:32:23 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:25.347 15:32:23 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:25.347 15:32:23 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:25.347 15:32:23 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:26.293 Creating new GPT entries in memory. 00:03:26.293 The operation has completed successfully. 00:03:26.293 15:32:24 -- setup/common.sh@57 -- # (( part++ )) 00:03:26.293 15:32:24 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:26.293 15:32:24 -- setup/common.sh@62 -- # wait 3137044 00:03:26.552 15:32:24 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:26.552 15:32:24 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount size= 00:03:26.552 15:32:24 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:26.552 15:32:24 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:03:26.552 15:32:24 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:03:26.552 15:32:24 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:26.552 15:32:24 -- setup/devices.sh@105 -- # verify 0000:5f:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:26.552 15:32:24 -- setup/devices.sh@48 -- # local dev=0000:5f:00.0 00:03:26.552 15:32:24 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:03:26.552 15:32:24 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:26.552 15:32:24 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:26.552 15:32:24 -- setup/devices.sh@53 -- # local found=0 00:03:26.552 15:32:24 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:26.552 15:32:24 -- setup/devices.sh@56 -- # : 00:03:26.552 15:32:24 -- setup/devices.sh@59 -- # local pci status 00:03:26.552 15:32:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:26.552 15:32:24 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5f:00.0 00:03:26.552 15:32:24 -- setup/devices.sh@47 -- # setup output config 00:03:26.552 15:32:24 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:26.552 15:32:24 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:03:29.165 15:32:27 -- setup/devices.sh@62 -- # [[ 0000:5f:00.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:29.165 15:32:27 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:03:29.165 15:32:27 -- setup/devices.sh@63 -- # found=1 00:03:29.165 15:32:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.165 15:32:27 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:29.165 15:32:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.165 15:32:27 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:29.165 15:32:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.165 15:32:27 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:29.165 15:32:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.165 15:32:27 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:29.165 15:32:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.165 15:32:27 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:29.165 15:32:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.165 15:32:27 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:29.165 15:32:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.165 15:32:27 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:29.165 15:32:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.165 15:32:27 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:29.165 15:32:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.165 15:32:27 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:29.165 15:32:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.165 15:32:27 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:29.165 15:32:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.165 15:32:27 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:29.165 15:32:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.165 15:32:27 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:29.165 15:32:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.165 15:32:27 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:29.165 15:32:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.165 15:32:27 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:29.165 15:32:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.165 15:32:27 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:29.165 15:32:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.165 15:32:27 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:29.165 15:32:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.165 15:32:27 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:29.165 15:32:27 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:29.165 15:32:27 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:29.165 15:32:27 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:29.165 15:32:27 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:29.165 15:32:27 -- setup/devices.sh@110 -- # cleanup_nvme 00:03:29.165 15:32:27 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:29.165 15:32:27 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:29.165 15:32:27 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:29.165 15:32:27 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:29.165 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:29.165 15:32:27 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:29.165 15:32:27 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:29.424 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:29.424 /dev/nvme0n1: 8 bytes were erased at offset 0x1749a955e00 (gpt): 45 46 49 20 50 41 52 54 00:03:29.424 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:29.424 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:29.425 15:32:27 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:03:29.425 15:32:27 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:03:29.425 15:32:27 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:29.425 15:32:27 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:03:29.425 15:32:27 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:03:29.425 15:32:27 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:29.425 15:32:27 -- setup/devices.sh@116 -- # verify 0000:5f:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:29.425 15:32:27 -- setup/devices.sh@48 -- # local dev=0000:5f:00.0 00:03:29.425 15:32:27 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:03:29.425 15:32:27 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:29.425 15:32:27 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:29.425 15:32:27 -- setup/devices.sh@53 -- # local found=0 00:03:29.425 15:32:27 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:29.425 15:32:27 -- setup/devices.sh@56 -- # : 00:03:29.425 15:32:27 -- setup/devices.sh@59 -- # local pci status 00:03:29.425 15:32:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:29.425 15:32:27 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5f:00.0 00:03:29.425 15:32:27 -- setup/devices.sh@47 -- # setup output config 00:03:29.425 15:32:27 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:29.425 15:32:27 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:03:31.957 15:32:30 -- setup/devices.sh@62 -- # [[ 0000:5f:00.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:31.957 15:32:30 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:03:31.957 15:32:30 -- setup/devices.sh@63 -- # found=1 00:03:31.957 15:32:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.957 15:32:30 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:31.957 15:32:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.957 15:32:30 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:31.957 15:32:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.957 15:32:30 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:31.957 15:32:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.957 15:32:30 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:31.957 15:32:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.957 15:32:30 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:31.957 15:32:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.958 15:32:30 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:31.958 15:32:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.958 15:32:30 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:31.958 15:32:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.958 15:32:30 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:31.958 15:32:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.958 15:32:30 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:31.958 15:32:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.958 15:32:30 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:31.958 15:32:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.958 15:32:30 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:31.958 15:32:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.958 15:32:30 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:31.958 15:32:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.958 15:32:30 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:31.958 15:32:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.958 15:32:30 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:31.958 15:32:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.958 15:32:30 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:31.958 15:32:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.958 15:32:30 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:31.958 15:32:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:32.216 15:32:30 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:32.216 15:32:30 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:32.216 15:32:30 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:32.216 15:32:30 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:32.216 15:32:30 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:32.216 15:32:30 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:32.216 15:32:30 -- setup/devices.sh@125 -- # verify 0000:5f:00.0 data@nvme0n1 '' '' 00:03:32.216 15:32:30 -- setup/devices.sh@48 -- # local dev=0000:5f:00.0 00:03:32.216 15:32:30 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:03:32.216 15:32:30 -- setup/devices.sh@50 -- # local mount_point= 00:03:32.216 15:32:30 -- setup/devices.sh@51 -- # local test_file= 00:03:32.216 15:32:30 -- setup/devices.sh@53 -- # local found=0 00:03:32.216 15:32:30 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:32.216 15:32:30 -- setup/devices.sh@59 -- # local pci status 00:03:32.216 15:32:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:32.216 15:32:30 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5f:00.0 00:03:32.216 15:32:30 -- setup/devices.sh@47 -- # setup output config 00:03:32.216 15:32:30 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:32.216 15:32:30 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:03:34.783 15:32:33 -- setup/devices.sh@62 -- # [[ 0000:5f:00.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:34.783 15:32:33 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:03:34.783 15:32:33 -- setup/devices.sh@63 -- # found=1 00:03:34.783 15:32:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.783 15:32:33 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:34.783 15:32:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.783 15:32:33 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:34.783 15:32:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.783 15:32:33 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:34.783 15:32:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.783 15:32:33 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:34.783 15:32:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.783 15:32:33 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:34.783 15:32:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.783 15:32:33 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:34.783 15:32:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.783 15:32:33 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:34.783 15:32:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.783 15:32:33 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:34.783 15:32:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.783 15:32:33 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:34.783 15:32:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.783 15:32:33 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:34.783 15:32:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.783 15:32:33 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:34.783 15:32:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.783 15:32:33 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:34.783 15:32:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.783 15:32:33 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:34.783 15:32:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.783 15:32:33 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:34.783 15:32:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.783 15:32:33 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:34.783 15:32:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.783 15:32:33 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:34.783 15:32:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.783 15:32:33 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:34.783 15:32:33 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:34.783 15:32:33 -- setup/devices.sh@68 -- # return 0 00:03:34.783 15:32:33 -- setup/devices.sh@128 -- # cleanup_nvme 00:03:34.783 15:32:33 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:35.041 15:32:33 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:35.041 15:32:33 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:35.041 15:32:33 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:35.041 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:35.041 00:03:35.041 real 0m10.557s 00:03:35.041 user 0m3.054s 00:03:35.041 sys 0m5.333s 00:03:35.041 15:32:33 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:35.041 15:32:33 -- common/autotest_common.sh@10 -- # set +x 00:03:35.041 ************************************ 00:03:35.041 END TEST nvme_mount 00:03:35.041 ************************************ 00:03:35.041 15:32:33 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:03:35.041 15:32:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:35.041 15:32:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:35.041 15:32:33 -- common/autotest_common.sh@10 -- # set +x 00:03:35.041 ************************************ 00:03:35.041 START TEST dm_mount 00:03:35.041 ************************************ 00:03:35.041 15:32:33 -- common/autotest_common.sh@1111 -- # dm_mount 00:03:35.041 15:32:33 -- setup/devices.sh@144 -- # pv=nvme0n1 00:03:35.041 15:32:33 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:03:35.041 15:32:33 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:03:35.041 15:32:33 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:03:35.041 15:32:33 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:35.041 15:32:33 -- setup/common.sh@40 -- # local part_no=2 00:03:35.041 15:32:33 -- setup/common.sh@41 -- # local size=1073741824 00:03:35.041 15:32:33 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:35.041 15:32:33 -- setup/common.sh@44 -- # parts=() 00:03:35.041 15:32:33 -- setup/common.sh@44 -- # local parts 00:03:35.041 15:32:33 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:35.041 15:32:33 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:35.041 15:32:33 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:35.041 15:32:33 -- setup/common.sh@46 -- # (( part++ )) 00:03:35.041 15:32:33 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:35.041 15:32:33 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:35.041 15:32:33 -- setup/common.sh@46 -- # (( part++ )) 00:03:35.041 15:32:33 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:35.041 15:32:33 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:35.041 15:32:33 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:35.041 15:32:33 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:03:36.415 Creating new GPT entries in memory. 00:03:36.415 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:36.415 other utilities. 00:03:36.415 15:32:34 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:36.415 15:32:34 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:36.415 15:32:34 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:36.415 15:32:34 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:36.415 15:32:34 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:37.352 Creating new GPT entries in memory. 00:03:37.352 The operation has completed successfully. 00:03:37.352 15:32:35 -- setup/common.sh@57 -- # (( part++ )) 00:03:37.352 15:32:35 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:37.352 15:32:35 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:37.352 15:32:35 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:37.352 15:32:35 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:03:38.288 The operation has completed successfully. 00:03:38.288 15:32:36 -- setup/common.sh@57 -- # (( part++ )) 00:03:38.288 15:32:36 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:38.288 15:32:36 -- setup/common.sh@62 -- # wait 3141221 00:03:38.288 15:32:36 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:03:38.288 15:32:36 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:03:38.288 15:32:36 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:38.288 15:32:36 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:03:38.288 15:32:36 -- setup/devices.sh@160 -- # for t in {1..5} 00:03:38.288 15:32:36 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:38.288 15:32:36 -- setup/devices.sh@161 -- # break 00:03:38.288 15:32:36 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:38.288 15:32:36 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:03:38.288 15:32:36 -- setup/devices.sh@165 -- # dm=/dev/dm-2 00:03:38.288 15:32:36 -- setup/devices.sh@166 -- # dm=dm-2 00:03:38.288 15:32:36 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-2 ]] 00:03:38.288 15:32:36 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-2 ]] 00:03:38.288 15:32:36 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:03:38.288 15:32:36 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount size= 00:03:38.288 15:32:36 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:03:38.288 15:32:36 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:38.288 15:32:36 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:03:38.288 15:32:36 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:03:38.288 15:32:36 -- setup/devices.sh@174 -- # verify 0000:5f:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:38.288 15:32:36 -- setup/devices.sh@48 -- # local dev=0000:5f:00.0 00:03:38.288 15:32:36 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:03:38.288 15:32:36 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:03:38.288 15:32:36 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:38.288 15:32:36 -- setup/devices.sh@53 -- # local found=0 00:03:38.288 15:32:36 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:38.288 15:32:36 -- setup/devices.sh@56 -- # : 00:03:38.288 15:32:36 -- setup/devices.sh@59 -- # local pci status 00:03:38.288 15:32:36 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5f:00.0 00:03:38.288 15:32:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.288 15:32:36 -- setup/devices.sh@47 -- # setup output config 00:03:38.288 15:32:36 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:38.288 15:32:36 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:03:40.821 15:32:39 -- setup/devices.sh@62 -- # [[ 0000:5f:00.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:40.821 15:32:39 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-2,holder@nvme0n1p2:dm-2,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:03:40.821 15:32:39 -- setup/devices.sh@63 -- # found=1 00:03:40.821 15:32:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.821 15:32:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:40.821 15:32:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.821 15:32:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:40.821 15:32:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.821 15:32:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:40.821 15:32:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.821 15:32:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:40.821 15:32:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.821 15:32:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:40.821 15:32:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.821 15:32:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:40.821 15:32:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.821 15:32:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:40.821 15:32:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.821 15:32:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:40.821 15:32:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.821 15:32:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:40.821 15:32:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.821 15:32:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:40.821 15:32:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.821 15:32:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:40.821 15:32:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.821 15:32:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:40.821 15:32:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.821 15:32:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:40.821 15:32:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.821 15:32:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:40.821 15:32:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.821 15:32:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:40.821 15:32:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.821 15:32:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:40.821 15:32:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:41.079 15:32:39 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:41.079 15:32:39 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount ]] 00:03:41.079 15:32:39 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:03:41.079 15:32:39 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:41.079 15:32:39 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:41.079 15:32:39 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:03:41.079 15:32:39 -- setup/devices.sh@184 -- # verify 0000:5f:00.0 holder@nvme0n1p1:dm-2,holder@nvme0n1p2:dm-2 '' '' 00:03:41.079 15:32:39 -- setup/devices.sh@48 -- # local dev=0000:5f:00.0 00:03:41.079 15:32:39 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-2,holder@nvme0n1p2:dm-2 00:03:41.079 15:32:39 -- setup/devices.sh@50 -- # local mount_point= 00:03:41.079 15:32:39 -- setup/devices.sh@51 -- # local test_file= 00:03:41.079 15:32:39 -- setup/devices.sh@53 -- # local found=0 00:03:41.079 15:32:39 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:41.079 15:32:39 -- setup/devices.sh@59 -- # local pci status 00:03:41.079 15:32:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:41.079 15:32:39 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5f:00.0 00:03:41.079 15:32:39 -- setup/devices.sh@47 -- # setup output config 00:03:41.079 15:32:39 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:41.079 15:32:39 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:03:43.611 15:32:42 -- setup/devices.sh@62 -- # [[ 0000:5f:00.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:43.611 15:32:42 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-2,holder@nvme0n1p2:dm-2, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\2\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\2* ]] 00:03:43.611 15:32:42 -- setup/devices.sh@63 -- # found=1 00:03:43.611 15:32:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.611 15:32:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:43.611 15:32:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.611 15:32:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:43.611 15:32:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.611 15:32:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:43.611 15:32:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.611 15:32:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:43.611 15:32:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.611 15:32:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:43.611 15:32:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.611 15:32:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:43.611 15:32:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.611 15:32:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:43.611 15:32:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.611 15:32:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:43.611 15:32:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.611 15:32:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:43.612 15:32:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.612 15:32:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:43.612 15:32:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.612 15:32:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:43.612 15:32:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.612 15:32:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:43.612 15:32:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.612 15:32:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:43.612 15:32:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.612 15:32:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:43.612 15:32:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.612 15:32:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:43.612 15:32:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.612 15:32:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:43.612 15:32:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.870 15:32:42 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:43.870 15:32:42 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:43.870 15:32:42 -- setup/devices.sh@68 -- # return 0 00:03:43.870 15:32:42 -- setup/devices.sh@187 -- # cleanup_dm 00:03:43.870 15:32:42 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:03:43.870 15:32:42 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:43.870 15:32:42 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:03:43.870 15:32:42 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:43.870 15:32:42 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:03:43.870 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:43.870 15:32:42 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:43.870 15:32:42 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:03:43.870 00:03:43.870 real 0m8.729s 00:03:43.870 user 0m2.124s 00:03:43.870 sys 0m3.636s 00:03:43.870 15:32:42 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:43.870 15:32:42 -- common/autotest_common.sh@10 -- # set +x 00:03:43.870 ************************************ 00:03:43.870 END TEST dm_mount 00:03:43.870 ************************************ 00:03:43.870 15:32:42 -- setup/devices.sh@1 -- # cleanup 00:03:43.870 15:32:42 -- setup/devices.sh@11 -- # cleanup_nvme 00:03:43.870 15:32:42 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:43.870 15:32:42 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:43.870 15:32:42 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:43.870 15:32:42 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:43.870 15:32:42 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:44.129 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:44.129 /dev/nvme0n1: 8 bytes were erased at offset 0x1749a955e00 (gpt): 45 46 49 20 50 41 52 54 00:03:44.129 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:44.129 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:44.129 15:32:42 -- setup/devices.sh@12 -- # cleanup_dm 00:03:44.129 15:32:42 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:03:44.129 15:32:42 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:44.129 15:32:42 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:44.129 15:32:42 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:44.129 15:32:42 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:03:44.129 15:32:42 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:03:44.129 00:03:44.129 real 0m23.126s 00:03:44.129 user 0m6.542s 00:03:44.129 sys 0m11.288s 00:03:44.129 15:32:42 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:44.129 15:32:42 -- common/autotest_common.sh@10 -- # set +x 00:03:44.129 ************************************ 00:03:44.129 END TEST devices 00:03:44.129 ************************************ 00:03:44.129 00:03:44.129 real 1m19.889s 00:03:44.129 user 0m25.418s 00:03:44.129 sys 0m43.310s 00:03:44.129 15:32:42 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:44.129 15:32:42 -- common/autotest_common.sh@10 -- # set +x 00:03:44.129 ************************************ 00:03:44.129 END TEST setup.sh 00:03:44.129 ************************************ 00:03:44.129 15:32:42 -- spdk/autotest.sh@128 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh status 00:03:47.415 Hugepages 00:03:47.415 node hugesize free / total 00:03:47.415 node0 1048576kB 0 / 0 00:03:47.415 node0 2048kB 2048 / 2048 00:03:47.415 node1 1048576kB 0 / 0 00:03:47.415 node1 2048kB 0 / 0 00:03:47.415 00:03:47.415 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:47.415 I/OAT 0000:00:04.0 8086 2021 0 ioatdma - - 00:03:47.415 I/OAT 0000:00:04.1 8086 2021 0 ioatdma - - 00:03:47.415 I/OAT 0000:00:04.2 8086 2021 0 ioatdma - - 00:03:47.415 I/OAT 0000:00:04.3 8086 2021 0 ioatdma - - 00:03:47.415 I/OAT 0000:00:04.4 8086 2021 0 ioatdma - - 00:03:47.415 I/OAT 0000:00:04.5 8086 2021 0 ioatdma - - 00:03:47.415 I/OAT 0000:00:04.6 8086 2021 0 ioatdma - - 00:03:47.415 I/OAT 0000:00:04.7 8086 2021 0 ioatdma - - 00:03:47.415 NVMe 0000:5f:00.0 8086 0a54 0 nvme nvme0 nvme0n1 00:03:47.415 I/OAT 0000:80:04.0 8086 2021 1 ioatdma - - 00:03:47.415 I/OAT 0000:80:04.1 8086 2021 1 ioatdma - - 00:03:47.415 I/OAT 0000:80:04.2 8086 2021 1 ioatdma - - 00:03:47.415 I/OAT 0000:80:04.3 8086 2021 1 ioatdma - - 00:03:47.415 I/OAT 0000:80:04.4 8086 2021 1 ioatdma - - 00:03:47.415 I/OAT 0000:80:04.5 8086 2021 1 ioatdma - - 00:03:47.415 I/OAT 0000:80:04.6 8086 2021 1 ioatdma - - 00:03:47.415 I/OAT 0000:80:04.7 8086 2021 1 ioatdma - - 00:03:47.415 15:32:45 -- spdk/autotest.sh@130 -- # uname -s 00:03:47.415 15:32:45 -- spdk/autotest.sh@130 -- # [[ Linux == Linux ]] 00:03:47.415 15:32:45 -- spdk/autotest.sh@132 -- # nvme_namespace_revert 00:03:47.415 15:32:45 -- common/autotest_common.sh@1517 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:03:49.951 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:03:49.951 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:03:49.951 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:03:49.951 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:03:49.951 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:03:49.951 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:03:49.951 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:03:49.951 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:03:49.951 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:03:49.951 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:03:49.951 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:03:49.951 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:03:49.951 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:03:49.951 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:03:49.951 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:03:49.951 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:03:51.329 0000:5f:00.0 (8086 0a54): nvme -> vfio-pci 00:03:51.329 15:32:49 -- common/autotest_common.sh@1518 -- # sleep 1 00:03:52.704 15:32:50 -- common/autotest_common.sh@1519 -- # bdfs=() 00:03:52.704 15:32:50 -- common/autotest_common.sh@1519 -- # local bdfs 00:03:52.704 15:32:50 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:03:52.704 15:32:50 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:03:52.704 15:32:50 -- common/autotest_common.sh@1499 -- # bdfs=() 00:03:52.704 15:32:50 -- common/autotest_common.sh@1499 -- # local bdfs 00:03:52.704 15:32:50 -- common/autotest_common.sh@1500 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:52.704 15:32:50 -- common/autotest_common.sh@1500 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:52.704 15:32:50 -- common/autotest_common.sh@1500 -- # jq -r '.config[].params.traddr' 00:03:52.704 15:32:50 -- common/autotest_common.sh@1501 -- # (( 1 == 0 )) 00:03:52.704 15:32:50 -- common/autotest_common.sh@1505 -- # printf '%s\n' 0000:5f:00.0 00:03:52.704 15:32:50 -- common/autotest_common.sh@1522 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:03:55.237 Waiting for block devices as requested 00:03:55.237 0000:5f:00.0 (8086 0a54): vfio-pci -> nvme 00:03:55.237 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:03:55.237 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:03:55.237 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:03:55.497 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:03:55.497 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:03:55.497 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:03:55.497 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:03:55.757 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:03:55.757 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:03:55.757 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:03:56.016 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:03:56.016 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:03:56.016 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:03:56.016 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:03:56.275 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:03:56.275 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:03:56.275 15:32:54 -- common/autotest_common.sh@1524 -- # for bdf in "${bdfs[@]}" 00:03:56.275 15:32:54 -- common/autotest_common.sh@1525 -- # get_nvme_ctrlr_from_bdf 0000:5f:00.0 00:03:56.275 15:32:54 -- common/autotest_common.sh@1488 -- # readlink -f /sys/class/nvme/nvme0 00:03:56.275 15:32:54 -- common/autotest_common.sh@1488 -- # grep 0000:5f:00.0/nvme/nvme 00:03:56.275 15:32:54 -- common/autotest_common.sh@1488 -- # bdf_sysfs_path=/sys/devices/pci0000:5d/0000:5d:03.0/0000:5f:00.0/nvme/nvme0 00:03:56.275 15:32:54 -- common/autotest_common.sh@1489 -- # [[ -z /sys/devices/pci0000:5d/0000:5d:03.0/0000:5f:00.0/nvme/nvme0 ]] 00:03:56.275 15:32:54 -- common/autotest_common.sh@1493 -- # basename /sys/devices/pci0000:5d/0000:5d:03.0/0000:5f:00.0/nvme/nvme0 00:03:56.275 15:32:54 -- common/autotest_common.sh@1493 -- # printf '%s\n' nvme0 00:03:56.275 15:32:54 -- common/autotest_common.sh@1525 -- # nvme_ctrlr=/dev/nvme0 00:03:56.275 15:32:54 -- common/autotest_common.sh@1526 -- # [[ -z /dev/nvme0 ]] 00:03:56.275 15:32:54 -- common/autotest_common.sh@1531 -- # nvme id-ctrl /dev/nvme0 00:03:56.275 15:32:54 -- common/autotest_common.sh@1531 -- # grep oacs 00:03:56.275 15:32:54 -- common/autotest_common.sh@1531 -- # cut -d: -f2 00:03:56.275 15:32:54 -- common/autotest_common.sh@1531 -- # oacs=' 0xe' 00:03:56.275 15:32:54 -- common/autotest_common.sh@1532 -- # oacs_ns_manage=8 00:03:56.275 15:32:54 -- common/autotest_common.sh@1534 -- # [[ 8 -ne 0 ]] 00:03:56.275 15:32:54 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:03:56.275 15:32:54 -- common/autotest_common.sh@1540 -- # grep unvmcap 00:03:56.275 15:32:54 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:03:56.535 15:32:54 -- common/autotest_common.sh@1540 -- # unvmcap=' 0' 00:03:56.535 15:32:54 -- common/autotest_common.sh@1541 -- # [[ 0 -eq 0 ]] 00:03:56.535 15:32:54 -- common/autotest_common.sh@1543 -- # continue 00:03:56.535 15:32:54 -- spdk/autotest.sh@135 -- # timing_exit pre_cleanup 00:03:56.535 15:32:54 -- common/autotest_common.sh@716 -- # xtrace_disable 00:03:56.535 15:32:54 -- common/autotest_common.sh@10 -- # set +x 00:03:56.535 15:32:54 -- spdk/autotest.sh@138 -- # timing_enter afterboot 00:03:56.535 15:32:54 -- common/autotest_common.sh@710 -- # xtrace_disable 00:03:56.535 15:32:54 -- common/autotest_common.sh@10 -- # set +x 00:03:56.535 15:32:54 -- spdk/autotest.sh@139 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:03:59.071 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:03:59.071 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:03:59.071 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:03:59.071 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:03:59.071 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:03:59.071 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:03:59.071 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:03:59.071 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:03:59.071 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:03:59.071 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:03:59.071 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:03:59.071 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:03:59.071 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:03:59.071 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:03:59.071 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:03:59.071 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:04:00.450 0000:5f:00.0 (8086 0a54): nvme -> vfio-pci 00:04:00.710 15:32:59 -- spdk/autotest.sh@140 -- # timing_exit afterboot 00:04:00.710 15:32:59 -- common/autotest_common.sh@716 -- # xtrace_disable 00:04:00.710 15:32:59 -- common/autotest_common.sh@10 -- # set +x 00:04:00.710 15:32:59 -- spdk/autotest.sh@144 -- # opal_revert_cleanup 00:04:00.710 15:32:59 -- common/autotest_common.sh@1577 -- # mapfile -t bdfs 00:04:00.710 15:32:59 -- common/autotest_common.sh@1577 -- # get_nvme_bdfs_by_id 0x0a54 00:04:00.710 15:32:59 -- common/autotest_common.sh@1563 -- # bdfs=() 00:04:00.710 15:32:59 -- common/autotest_common.sh@1563 -- # local bdfs 00:04:00.710 15:32:59 -- common/autotest_common.sh@1565 -- # get_nvme_bdfs 00:04:00.710 15:32:59 -- common/autotest_common.sh@1499 -- # bdfs=() 00:04:00.710 15:32:59 -- common/autotest_common.sh@1499 -- # local bdfs 00:04:00.710 15:32:59 -- common/autotest_common.sh@1500 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:04:00.710 15:32:59 -- common/autotest_common.sh@1500 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/gen_nvme.sh 00:04:00.710 15:32:59 -- common/autotest_common.sh@1500 -- # jq -r '.config[].params.traddr' 00:04:00.710 15:32:59 -- common/autotest_common.sh@1501 -- # (( 1 == 0 )) 00:04:00.710 15:32:59 -- common/autotest_common.sh@1505 -- # printf '%s\n' 0000:5f:00.0 00:04:00.710 15:32:59 -- common/autotest_common.sh@1565 -- # for bdf in $(get_nvme_bdfs) 00:04:00.710 15:32:59 -- common/autotest_common.sh@1566 -- # cat /sys/bus/pci/devices/0000:5f:00.0/device 00:04:00.710 15:32:59 -- common/autotest_common.sh@1566 -- # device=0x0a54 00:04:00.710 15:32:59 -- common/autotest_common.sh@1567 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:04:00.710 15:32:59 -- common/autotest_common.sh@1568 -- # bdfs+=($bdf) 00:04:00.710 15:32:59 -- common/autotest_common.sh@1572 -- # printf '%s\n' 0000:5f:00.0 00:04:00.710 15:32:59 -- common/autotest_common.sh@1578 -- # [[ -z 0000:5f:00.0 ]] 00:04:00.710 15:32:59 -- common/autotest_common.sh@1583 -- # spdk_tgt_pid=3150059 00:04:00.710 15:32:59 -- common/autotest_common.sh@1584 -- # waitforlisten 3150059 00:04:00.710 15:32:59 -- common/autotest_common.sh@1582 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:04:00.710 15:32:59 -- common/autotest_common.sh@817 -- # '[' -z 3150059 ']' 00:04:00.710 15:32:59 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:00.710 15:32:59 -- common/autotest_common.sh@822 -- # local max_retries=100 00:04:00.710 15:32:59 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:00.710 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:00.710 15:32:59 -- common/autotest_common.sh@826 -- # xtrace_disable 00:04:00.710 15:32:59 -- common/autotest_common.sh@10 -- # set +x 00:04:00.969 [2024-04-26 15:32:59.347611] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:04:00.969 [2024-04-26 15:32:59.347659] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3150059 ] 00:04:00.969 EAL: No free 2048 kB hugepages reported on node 1 00:04:00.969 [2024-04-26 15:32:59.400985] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:00.969 [2024-04-26 15:32:59.478409] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:01.543 15:33:00 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:04:01.544 15:33:00 -- common/autotest_common.sh@850 -- # return 0 00:04:01.544 15:33:00 -- common/autotest_common.sh@1586 -- # bdf_id=0 00:04:01.544 15:33:00 -- common/autotest_common.sh@1587 -- # for bdf in "${bdfs[@]}" 00:04:01.544 15:33:00 -- common/autotest_common.sh@1588 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:5f:00.0 00:04:04.843 nvme0n1 00:04:04.843 15:33:03 -- common/autotest_common.sh@1590 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:04:04.843 [2024-04-26 15:33:03.290168] vbdev_opal_rpc.c: 125:rpc_bdev_nvme_opal_revert: *ERROR*: nvme0 not support opal 00:04:04.843 request: 00:04:04.843 { 00:04:04.843 "nvme_ctrlr_name": "nvme0", 00:04:04.843 "password": "test", 00:04:04.843 "method": "bdev_nvme_opal_revert", 00:04:04.843 "req_id": 1 00:04:04.843 } 00:04:04.843 Got JSON-RPC error response 00:04:04.843 response: 00:04:04.843 { 00:04:04.843 "code": -32602, 00:04:04.843 "message": "Invalid parameters" 00:04:04.843 } 00:04:04.843 15:33:03 -- common/autotest_common.sh@1590 -- # true 00:04:04.843 15:33:03 -- common/autotest_common.sh@1591 -- # (( ++bdf_id )) 00:04:04.843 15:33:03 -- common/autotest_common.sh@1594 -- # killprocess 3150059 00:04:04.843 15:33:03 -- common/autotest_common.sh@936 -- # '[' -z 3150059 ']' 00:04:04.843 15:33:03 -- common/autotest_common.sh@940 -- # kill -0 3150059 00:04:04.843 15:33:03 -- common/autotest_common.sh@941 -- # uname 00:04:04.843 15:33:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:04.843 15:33:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3150059 00:04:04.843 15:33:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:04.843 15:33:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:04.843 15:33:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3150059' 00:04:04.843 killing process with pid 3150059 00:04:04.843 15:33:03 -- common/autotest_common.sh@955 -- # kill 3150059 00:04:04.843 15:33:03 -- common/autotest_common.sh@960 -- # wait 3150059 00:04:07.441 15:33:05 -- spdk/autotest.sh@150 -- # '[' 0 -eq 1 ']' 00:04:07.441 15:33:05 -- spdk/autotest.sh@154 -- # '[' 1 -eq 1 ']' 00:04:07.441 15:33:05 -- spdk/autotest.sh@155 -- # [[ 0 -eq 1 ]] 00:04:07.441 15:33:05 -- spdk/autotest.sh@155 -- # [[ 0 -eq 1 ]] 00:04:07.441 15:33:05 -- spdk/autotest.sh@162 -- # timing_enter lib 00:04:07.441 15:33:05 -- common/autotest_common.sh@710 -- # xtrace_disable 00:04:07.441 15:33:05 -- common/autotest_common.sh@10 -- # set +x 00:04:07.441 15:33:05 -- spdk/autotest.sh@164 -- # run_test env /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/env.sh 00:04:07.442 15:33:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:07.442 15:33:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:07.442 15:33:05 -- common/autotest_common.sh@10 -- # set +x 00:04:07.442 ************************************ 00:04:07.442 START TEST env 00:04:07.442 ************************************ 00:04:07.442 15:33:05 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/env.sh 00:04:07.442 * Looking for test storage... 00:04:07.442 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env 00:04:07.442 15:33:05 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/memory/memory_ut 00:04:07.442 15:33:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:07.442 15:33:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:07.442 15:33:05 -- common/autotest_common.sh@10 -- # set +x 00:04:07.442 ************************************ 00:04:07.442 START TEST env_memory 00:04:07.442 ************************************ 00:04:07.442 15:33:05 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/memory/memory_ut 00:04:07.442 00:04:07.442 00:04:07.442 CUnit - A unit testing framework for C - Version 2.1-3 00:04:07.442 http://cunit.sourceforge.net/ 00:04:07.442 00:04:07.442 00:04:07.442 Suite: memory 00:04:07.442 Test: alloc and free memory map ...[2024-04-26 15:33:05.976055] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:04:07.442 passed 00:04:07.442 Test: mem map translation ...[2024-04-26 15:33:05.995576] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:04:07.442 [2024-04-26 15:33:05.995591] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:04:07.442 [2024-04-26 15:33:05.995630] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:04:07.442 [2024-04-26 15:33:05.995637] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:04:07.442 passed 00:04:07.442 Test: mem map registration ...[2024-04-26 15:33:06.036119] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:04:07.442 [2024-04-26 15:33:06.036136] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:04:07.708 passed 00:04:07.708 Test: mem map adjacent registrations ...passed 00:04:07.708 00:04:07.708 Run Summary: Type Total Ran Passed Failed Inactive 00:04:07.708 suites 1 1 n/a 0 0 00:04:07.708 tests 4 4 4 0 0 00:04:07.708 asserts 152 152 152 0 n/a 00:04:07.708 00:04:07.708 Elapsed time = 0.149 seconds 00:04:07.708 00:04:07.708 real 0m0.161s 00:04:07.708 user 0m0.147s 00:04:07.708 sys 0m0.013s 00:04:07.708 15:33:06 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:07.708 15:33:06 -- common/autotest_common.sh@10 -- # set +x 00:04:07.708 ************************************ 00:04:07.708 END TEST env_memory 00:04:07.708 ************************************ 00:04:07.708 15:33:06 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:07.708 15:33:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:07.708 15:33:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:07.708 15:33:06 -- common/autotest_common.sh@10 -- # set +x 00:04:07.708 ************************************ 00:04:07.708 START TEST env_vtophys 00:04:07.708 ************************************ 00:04:07.708 15:33:06 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:07.708 EAL: lib.eal log level changed from notice to debug 00:04:07.708 EAL: Detected lcore 0 as core 0 on socket 0 00:04:07.708 EAL: Detected lcore 1 as core 1 on socket 0 00:04:07.708 EAL: Detected lcore 2 as core 2 on socket 0 00:04:07.708 EAL: Detected lcore 3 as core 3 on socket 0 00:04:07.708 EAL: Detected lcore 4 as core 4 on socket 0 00:04:07.708 EAL: Detected lcore 5 as core 5 on socket 0 00:04:07.708 EAL: Detected lcore 6 as core 6 on socket 0 00:04:07.708 EAL: Detected lcore 7 as core 9 on socket 0 00:04:07.708 EAL: Detected lcore 8 as core 10 on socket 0 00:04:07.708 EAL: Detected lcore 9 as core 11 on socket 0 00:04:07.708 EAL: Detected lcore 10 as core 12 on socket 0 00:04:07.708 EAL: Detected lcore 11 as core 13 on socket 0 00:04:07.708 EAL: Detected lcore 12 as core 16 on socket 0 00:04:07.708 EAL: Detected lcore 13 as core 17 on socket 0 00:04:07.708 EAL: Detected lcore 14 as core 18 on socket 0 00:04:07.709 EAL: Detected lcore 15 as core 19 on socket 0 00:04:07.709 EAL: Detected lcore 16 as core 20 on socket 0 00:04:07.709 EAL: Detected lcore 17 as core 21 on socket 0 00:04:07.709 EAL: Detected lcore 18 as core 24 on socket 0 00:04:07.709 EAL: Detected lcore 19 as core 25 on socket 0 00:04:07.709 EAL: Detected lcore 20 as core 26 on socket 0 00:04:07.709 EAL: Detected lcore 21 as core 27 on socket 0 00:04:07.709 EAL: Detected lcore 22 as core 28 on socket 0 00:04:07.709 EAL: Detected lcore 23 as core 29 on socket 0 00:04:07.709 EAL: Detected lcore 24 as core 0 on socket 1 00:04:07.709 EAL: Detected lcore 25 as core 1 on socket 1 00:04:07.709 EAL: Detected lcore 26 as core 2 on socket 1 00:04:07.709 EAL: Detected lcore 27 as core 3 on socket 1 00:04:07.709 EAL: Detected lcore 28 as core 4 on socket 1 00:04:07.709 EAL: Detected lcore 29 as core 5 on socket 1 00:04:07.709 EAL: Detected lcore 30 as core 6 on socket 1 00:04:07.709 EAL: Detected lcore 31 as core 8 on socket 1 00:04:07.709 EAL: Detected lcore 32 as core 9 on socket 1 00:04:07.709 EAL: Detected lcore 33 as core 10 on socket 1 00:04:07.709 EAL: Detected lcore 34 as core 11 on socket 1 00:04:07.709 EAL: Detected lcore 35 as core 12 on socket 1 00:04:07.709 EAL: Detected lcore 36 as core 13 on socket 1 00:04:07.709 EAL: Detected lcore 37 as core 16 on socket 1 00:04:07.709 EAL: Detected lcore 38 as core 17 on socket 1 00:04:07.709 EAL: Detected lcore 39 as core 18 on socket 1 00:04:07.709 EAL: Detected lcore 40 as core 19 on socket 1 00:04:07.709 EAL: Detected lcore 41 as core 20 on socket 1 00:04:07.709 EAL: Detected lcore 42 as core 21 on socket 1 00:04:07.709 EAL: Detected lcore 43 as core 25 on socket 1 00:04:07.709 EAL: Detected lcore 44 as core 26 on socket 1 00:04:07.709 EAL: Detected lcore 45 as core 27 on socket 1 00:04:07.709 EAL: Detected lcore 46 as core 28 on socket 1 00:04:07.709 EAL: Detected lcore 47 as core 29 on socket 1 00:04:07.709 EAL: Detected lcore 48 as core 0 on socket 0 00:04:07.709 EAL: Detected lcore 49 as core 1 on socket 0 00:04:07.709 EAL: Detected lcore 50 as core 2 on socket 0 00:04:07.709 EAL: Detected lcore 51 as core 3 on socket 0 00:04:07.709 EAL: Detected lcore 52 as core 4 on socket 0 00:04:07.709 EAL: Detected lcore 53 as core 5 on socket 0 00:04:07.709 EAL: Detected lcore 54 as core 6 on socket 0 00:04:07.709 EAL: Detected lcore 55 as core 9 on socket 0 00:04:07.709 EAL: Detected lcore 56 as core 10 on socket 0 00:04:07.709 EAL: Detected lcore 57 as core 11 on socket 0 00:04:07.709 EAL: Detected lcore 58 as core 12 on socket 0 00:04:07.709 EAL: Detected lcore 59 as core 13 on socket 0 00:04:07.709 EAL: Detected lcore 60 as core 16 on socket 0 00:04:07.709 EAL: Detected lcore 61 as core 17 on socket 0 00:04:07.709 EAL: Detected lcore 62 as core 18 on socket 0 00:04:07.709 EAL: Detected lcore 63 as core 19 on socket 0 00:04:07.709 EAL: Detected lcore 64 as core 20 on socket 0 00:04:07.709 EAL: Detected lcore 65 as core 21 on socket 0 00:04:07.709 EAL: Detected lcore 66 as core 24 on socket 0 00:04:07.709 EAL: Detected lcore 67 as core 25 on socket 0 00:04:07.709 EAL: Detected lcore 68 as core 26 on socket 0 00:04:07.709 EAL: Detected lcore 69 as core 27 on socket 0 00:04:07.709 EAL: Detected lcore 70 as core 28 on socket 0 00:04:07.709 EAL: Detected lcore 71 as core 29 on socket 0 00:04:07.709 EAL: Detected lcore 72 as core 0 on socket 1 00:04:07.709 EAL: Detected lcore 73 as core 1 on socket 1 00:04:07.709 EAL: Detected lcore 74 as core 2 on socket 1 00:04:07.709 EAL: Detected lcore 75 as core 3 on socket 1 00:04:07.709 EAL: Detected lcore 76 as core 4 on socket 1 00:04:07.709 EAL: Detected lcore 77 as core 5 on socket 1 00:04:07.709 EAL: Detected lcore 78 as core 6 on socket 1 00:04:07.709 EAL: Detected lcore 79 as core 8 on socket 1 00:04:07.709 EAL: Detected lcore 80 as core 9 on socket 1 00:04:07.709 EAL: Detected lcore 81 as core 10 on socket 1 00:04:07.709 EAL: Detected lcore 82 as core 11 on socket 1 00:04:07.709 EAL: Detected lcore 83 as core 12 on socket 1 00:04:07.709 EAL: Detected lcore 84 as core 13 on socket 1 00:04:07.709 EAL: Detected lcore 85 as core 16 on socket 1 00:04:07.709 EAL: Detected lcore 86 as core 17 on socket 1 00:04:07.709 EAL: Detected lcore 87 as core 18 on socket 1 00:04:07.709 EAL: Detected lcore 88 as core 19 on socket 1 00:04:07.709 EAL: Detected lcore 89 as core 20 on socket 1 00:04:07.709 EAL: Detected lcore 90 as core 21 on socket 1 00:04:07.709 EAL: Detected lcore 91 as core 25 on socket 1 00:04:07.709 EAL: Detected lcore 92 as core 26 on socket 1 00:04:07.709 EAL: Detected lcore 93 as core 27 on socket 1 00:04:07.709 EAL: Detected lcore 94 as core 28 on socket 1 00:04:07.709 EAL: Detected lcore 95 as core 29 on socket 1 00:04:07.709 EAL: Maximum logical cores by configuration: 128 00:04:07.709 EAL: Detected CPU lcores: 96 00:04:07.709 EAL: Detected NUMA nodes: 2 00:04:07.709 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:04:07.709 EAL: Detected shared linkage of DPDK 00:04:07.709 EAL: No shared files mode enabled, IPC will be disabled 00:04:07.968 EAL: Bus pci wants IOVA as 'DC' 00:04:07.968 EAL: Buses did not request a specific IOVA mode. 00:04:07.968 EAL: IOMMU is available, selecting IOVA as VA mode. 00:04:07.968 EAL: Selected IOVA mode 'VA' 00:04:07.968 EAL: No free 2048 kB hugepages reported on node 1 00:04:07.968 EAL: Probing VFIO support... 00:04:07.968 EAL: IOMMU type 1 (Type 1) is supported 00:04:07.968 EAL: IOMMU type 7 (sPAPR) is not supported 00:04:07.968 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:04:07.968 EAL: VFIO support initialized 00:04:07.968 EAL: Ask a virtual area of 0x2e000 bytes 00:04:07.968 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:04:07.968 EAL: Setting up physically contiguous memory... 00:04:07.968 EAL: Setting maximum number of open files to 524288 00:04:07.968 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:04:07.968 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:04:07.968 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:04:07.968 EAL: Ask a virtual area of 0x61000 bytes 00:04:07.968 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:04:07.968 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:07.968 EAL: Ask a virtual area of 0x400000000 bytes 00:04:07.968 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:04:07.968 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:04:07.968 EAL: Ask a virtual area of 0x61000 bytes 00:04:07.968 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:04:07.968 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:07.968 EAL: Ask a virtual area of 0x400000000 bytes 00:04:07.968 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:04:07.968 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:04:07.968 EAL: Ask a virtual area of 0x61000 bytes 00:04:07.968 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:04:07.968 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:07.968 EAL: Ask a virtual area of 0x400000000 bytes 00:04:07.968 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:04:07.968 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:04:07.968 EAL: Ask a virtual area of 0x61000 bytes 00:04:07.968 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:04:07.968 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:07.968 EAL: Ask a virtual area of 0x400000000 bytes 00:04:07.968 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:04:07.968 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:04:07.968 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:04:07.968 EAL: Ask a virtual area of 0x61000 bytes 00:04:07.968 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:04:07.968 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:07.968 EAL: Ask a virtual area of 0x400000000 bytes 00:04:07.968 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:04:07.968 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:04:07.968 EAL: Ask a virtual area of 0x61000 bytes 00:04:07.968 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:04:07.968 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:07.968 EAL: Ask a virtual area of 0x400000000 bytes 00:04:07.968 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:04:07.968 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:04:07.968 EAL: Ask a virtual area of 0x61000 bytes 00:04:07.968 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:04:07.968 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:07.968 EAL: Ask a virtual area of 0x400000000 bytes 00:04:07.968 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:04:07.968 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:04:07.968 EAL: Ask a virtual area of 0x61000 bytes 00:04:07.968 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:04:07.968 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:07.968 EAL: Ask a virtual area of 0x400000000 bytes 00:04:07.968 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:04:07.968 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:04:07.968 EAL: Hugepages will be freed exactly as allocated. 00:04:07.968 EAL: No shared files mode enabled, IPC is disabled 00:04:07.968 EAL: No shared files mode enabled, IPC is disabled 00:04:07.968 EAL: TSC frequency is ~2100000 KHz 00:04:07.968 EAL: Main lcore 0 is ready (tid=7f8cefcc7a00;cpuset=[0]) 00:04:07.968 EAL: Trying to obtain current memory policy. 00:04:07.968 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:07.968 EAL: Restoring previous memory policy: 0 00:04:07.968 EAL: request: mp_malloc_sync 00:04:07.968 EAL: No shared files mode enabled, IPC is disabled 00:04:07.968 EAL: Heap on socket 0 was expanded by 2MB 00:04:07.968 EAL: No shared files mode enabled, IPC is disabled 00:04:07.968 EAL: No PCI address specified using 'addr=' in: bus=pci 00:04:07.968 EAL: Mem event callback 'spdk:(nil)' registered 00:04:07.968 00:04:07.968 00:04:07.968 CUnit - A unit testing framework for C - Version 2.1-3 00:04:07.968 http://cunit.sourceforge.net/ 00:04:07.968 00:04:07.968 00:04:07.968 Suite: components_suite 00:04:07.968 Test: vtophys_malloc_test ...passed 00:04:07.968 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:04:07.968 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:07.968 EAL: Restoring previous memory policy: 4 00:04:07.968 EAL: Calling mem event callback 'spdk:(nil)' 00:04:07.968 EAL: request: mp_malloc_sync 00:04:07.968 EAL: No shared files mode enabled, IPC is disabled 00:04:07.968 EAL: Heap on socket 0 was expanded by 4MB 00:04:07.968 EAL: Calling mem event callback 'spdk:(nil)' 00:04:07.968 EAL: request: mp_malloc_sync 00:04:07.968 EAL: No shared files mode enabled, IPC is disabled 00:04:07.968 EAL: Heap on socket 0 was shrunk by 4MB 00:04:07.968 EAL: Trying to obtain current memory policy. 00:04:07.968 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:07.968 EAL: Restoring previous memory policy: 4 00:04:07.968 EAL: Calling mem event callback 'spdk:(nil)' 00:04:07.968 EAL: request: mp_malloc_sync 00:04:07.968 EAL: No shared files mode enabled, IPC is disabled 00:04:07.968 EAL: Heap on socket 0 was expanded by 6MB 00:04:07.968 EAL: Calling mem event callback 'spdk:(nil)' 00:04:07.968 EAL: request: mp_malloc_sync 00:04:07.968 EAL: No shared files mode enabled, IPC is disabled 00:04:07.968 EAL: Heap on socket 0 was shrunk by 6MB 00:04:07.968 EAL: Trying to obtain current memory policy. 00:04:07.968 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:07.968 EAL: Restoring previous memory policy: 4 00:04:07.968 EAL: Calling mem event callback 'spdk:(nil)' 00:04:07.968 EAL: request: mp_malloc_sync 00:04:07.968 EAL: No shared files mode enabled, IPC is disabled 00:04:07.968 EAL: Heap on socket 0 was expanded by 10MB 00:04:07.968 EAL: Calling mem event callback 'spdk:(nil)' 00:04:07.968 EAL: request: mp_malloc_sync 00:04:07.968 EAL: No shared files mode enabled, IPC is disabled 00:04:07.968 EAL: Heap on socket 0 was shrunk by 10MB 00:04:07.968 EAL: Trying to obtain current memory policy. 00:04:07.968 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:07.968 EAL: Restoring previous memory policy: 4 00:04:07.968 EAL: Calling mem event callback 'spdk:(nil)' 00:04:07.968 EAL: request: mp_malloc_sync 00:04:07.968 EAL: No shared files mode enabled, IPC is disabled 00:04:07.968 EAL: Heap on socket 0 was expanded by 18MB 00:04:07.968 EAL: Calling mem event callback 'spdk:(nil)' 00:04:07.968 EAL: request: mp_malloc_sync 00:04:07.968 EAL: No shared files mode enabled, IPC is disabled 00:04:07.968 EAL: Heap on socket 0 was shrunk by 18MB 00:04:07.968 EAL: Trying to obtain current memory policy. 00:04:07.968 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:07.968 EAL: Restoring previous memory policy: 4 00:04:07.968 EAL: Calling mem event callback 'spdk:(nil)' 00:04:07.968 EAL: request: mp_malloc_sync 00:04:07.968 EAL: No shared files mode enabled, IPC is disabled 00:04:07.968 EAL: Heap on socket 0 was expanded by 34MB 00:04:07.968 EAL: Calling mem event callback 'spdk:(nil)' 00:04:07.968 EAL: request: mp_malloc_sync 00:04:07.968 EAL: No shared files mode enabled, IPC is disabled 00:04:07.968 EAL: Heap on socket 0 was shrunk by 34MB 00:04:07.968 EAL: Trying to obtain current memory policy. 00:04:07.968 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:07.968 EAL: Restoring previous memory policy: 4 00:04:07.968 EAL: Calling mem event callback 'spdk:(nil)' 00:04:07.968 EAL: request: mp_malloc_sync 00:04:07.968 EAL: No shared files mode enabled, IPC is disabled 00:04:07.968 EAL: Heap on socket 0 was expanded by 66MB 00:04:07.968 EAL: Calling mem event callback 'spdk:(nil)' 00:04:07.968 EAL: request: mp_malloc_sync 00:04:07.968 EAL: No shared files mode enabled, IPC is disabled 00:04:07.968 EAL: Heap on socket 0 was shrunk by 66MB 00:04:07.968 EAL: Trying to obtain current memory policy. 00:04:07.968 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:07.968 EAL: Restoring previous memory policy: 4 00:04:07.968 EAL: Calling mem event callback 'spdk:(nil)' 00:04:07.968 EAL: request: mp_malloc_sync 00:04:07.969 EAL: No shared files mode enabled, IPC is disabled 00:04:07.969 EAL: Heap on socket 0 was expanded by 130MB 00:04:07.969 EAL: Calling mem event callback 'spdk:(nil)' 00:04:07.969 EAL: request: mp_malloc_sync 00:04:07.969 EAL: No shared files mode enabled, IPC is disabled 00:04:07.969 EAL: Heap on socket 0 was shrunk by 130MB 00:04:07.969 EAL: Trying to obtain current memory policy. 00:04:07.969 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:07.969 EAL: Restoring previous memory policy: 4 00:04:07.969 EAL: Calling mem event callback 'spdk:(nil)' 00:04:07.969 EAL: request: mp_malloc_sync 00:04:07.969 EAL: No shared files mode enabled, IPC is disabled 00:04:07.969 EAL: Heap on socket 0 was expanded by 258MB 00:04:07.969 EAL: Calling mem event callback 'spdk:(nil)' 00:04:08.227 EAL: request: mp_malloc_sync 00:04:08.227 EAL: No shared files mode enabled, IPC is disabled 00:04:08.227 EAL: Heap on socket 0 was shrunk by 258MB 00:04:08.227 EAL: Trying to obtain current memory policy. 00:04:08.227 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:08.227 EAL: Restoring previous memory policy: 4 00:04:08.227 EAL: Calling mem event callback 'spdk:(nil)' 00:04:08.227 EAL: request: mp_malloc_sync 00:04:08.227 EAL: No shared files mode enabled, IPC is disabled 00:04:08.227 EAL: Heap on socket 0 was expanded by 514MB 00:04:08.227 EAL: Calling mem event callback 'spdk:(nil)' 00:04:08.485 EAL: request: mp_malloc_sync 00:04:08.485 EAL: No shared files mode enabled, IPC is disabled 00:04:08.485 EAL: Heap on socket 0 was shrunk by 514MB 00:04:08.485 EAL: Trying to obtain current memory policy. 00:04:08.485 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:08.485 EAL: Restoring previous memory policy: 4 00:04:08.485 EAL: Calling mem event callback 'spdk:(nil)' 00:04:08.485 EAL: request: mp_malloc_sync 00:04:08.485 EAL: No shared files mode enabled, IPC is disabled 00:04:08.485 EAL: Heap on socket 0 was expanded by 1026MB 00:04:08.743 EAL: Calling mem event callback 'spdk:(nil)' 00:04:08.743 EAL: request: mp_malloc_sync 00:04:08.743 EAL: No shared files mode enabled, IPC is disabled 00:04:08.743 EAL: Heap on socket 0 was shrunk by 1026MB 00:04:08.743 passed 00:04:08.743 00:04:08.743 Run Summary: Type Total Ran Passed Failed Inactive 00:04:08.743 suites 1 1 n/a 0 0 00:04:08.743 tests 2 2 2 0 0 00:04:08.743 asserts 497 497 497 0 n/a 00:04:08.743 00:04:08.743 Elapsed time = 0.966 seconds 00:04:08.743 EAL: Calling mem event callback 'spdk:(nil)' 00:04:08.743 EAL: request: mp_malloc_sync 00:04:08.743 EAL: No shared files mode enabled, IPC is disabled 00:04:08.743 EAL: Heap on socket 0 was shrunk by 2MB 00:04:08.743 EAL: No shared files mode enabled, IPC is disabled 00:04:08.743 EAL: No shared files mode enabled, IPC is disabled 00:04:08.743 EAL: No shared files mode enabled, IPC is disabled 00:04:08.743 00:04:08.743 real 0m1.078s 00:04:08.743 user 0m0.638s 00:04:08.743 sys 0m0.415s 00:04:08.743 15:33:07 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:08.743 15:33:07 -- common/autotest_common.sh@10 -- # set +x 00:04:08.743 ************************************ 00:04:08.743 END TEST env_vtophys 00:04:08.743 ************************************ 00:04:09.002 15:33:07 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/pci/pci_ut 00:04:09.002 15:33:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:09.002 15:33:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:09.002 15:33:07 -- common/autotest_common.sh@10 -- # set +x 00:04:09.002 ************************************ 00:04:09.002 START TEST env_pci 00:04:09.002 ************************************ 00:04:09.002 15:33:07 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/pci/pci_ut 00:04:09.002 00:04:09.002 00:04:09.002 CUnit - A unit testing framework for C - Version 2.1-3 00:04:09.002 http://cunit.sourceforge.net/ 00:04:09.002 00:04:09.002 00:04:09.002 Suite: pci 00:04:09.002 Test: pci_hook ...[2024-04-26 15:33:07.518190] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 3152096 has claimed it 00:04:09.002 EAL: Cannot find device (10000:00:01.0) 00:04:09.002 EAL: Failed to attach device on primary process 00:04:09.002 passed 00:04:09.002 00:04:09.002 Run Summary: Type Total Ran Passed Failed Inactive 00:04:09.002 suites 1 1 n/a 0 0 00:04:09.002 tests 1 1 1 0 0 00:04:09.002 asserts 25 25 25 0 n/a 00:04:09.002 00:04:09.002 Elapsed time = 0.027 seconds 00:04:09.002 00:04:09.002 real 0m0.045s 00:04:09.002 user 0m0.016s 00:04:09.002 sys 0m0.029s 00:04:09.002 15:33:07 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:09.002 15:33:07 -- common/autotest_common.sh@10 -- # set +x 00:04:09.002 ************************************ 00:04:09.002 END TEST env_pci 00:04:09.002 ************************************ 00:04:09.002 15:33:07 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:04:09.002 15:33:07 -- env/env.sh@15 -- # uname 00:04:09.002 15:33:07 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:04:09.002 15:33:07 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:04:09.002 15:33:07 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:09.002 15:33:07 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:04:09.002 15:33:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:09.002 15:33:07 -- common/autotest_common.sh@10 -- # set +x 00:04:09.261 ************************************ 00:04:09.261 START TEST env_dpdk_post_init 00:04:09.261 ************************************ 00:04:09.261 15:33:07 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:09.261 EAL: Detected CPU lcores: 96 00:04:09.261 EAL: Detected NUMA nodes: 2 00:04:09.261 EAL: Detected shared linkage of DPDK 00:04:09.261 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:09.261 EAL: Selected IOVA mode 'VA' 00:04:09.261 EAL: No free 2048 kB hugepages reported on node 1 00:04:09.261 EAL: VFIO support initialized 00:04:09.262 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:09.262 EAL: Using IOMMU type 1 (Type 1) 00:04:09.262 EAL: Ignore mapping IO port bar(1) 00:04:09.262 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.0 (socket 0) 00:04:09.262 EAL: Ignore mapping IO port bar(1) 00:04:09.262 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.1 (socket 0) 00:04:09.262 EAL: Ignore mapping IO port bar(1) 00:04:09.262 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.2 (socket 0) 00:04:09.262 EAL: Ignore mapping IO port bar(1) 00:04:09.262 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.3 (socket 0) 00:04:09.521 EAL: Ignore mapping IO port bar(1) 00:04:09.521 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.4 (socket 0) 00:04:09.521 EAL: Ignore mapping IO port bar(1) 00:04:09.521 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.5 (socket 0) 00:04:09.521 EAL: Ignore mapping IO port bar(1) 00:04:09.521 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.6 (socket 0) 00:04:09.521 EAL: Ignore mapping IO port bar(1) 00:04:09.521 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.7 (socket 0) 00:04:10.090 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:5f:00.0 (socket 0) 00:04:10.090 EAL: Ignore mapping IO port bar(1) 00:04:10.090 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.0 (socket 1) 00:04:10.090 EAL: Ignore mapping IO port bar(1) 00:04:10.090 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.1 (socket 1) 00:04:10.090 EAL: Ignore mapping IO port bar(1) 00:04:10.090 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.2 (socket 1) 00:04:10.090 EAL: Ignore mapping IO port bar(1) 00:04:10.090 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.3 (socket 1) 00:04:10.349 EAL: Ignore mapping IO port bar(1) 00:04:10.349 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.4 (socket 1) 00:04:10.349 EAL: Ignore mapping IO port bar(1) 00:04:10.349 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.5 (socket 1) 00:04:10.349 EAL: Ignore mapping IO port bar(1) 00:04:10.349 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.6 (socket 1) 00:04:10.349 EAL: Ignore mapping IO port bar(1) 00:04:10.349 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.7 (socket 1) 00:04:14.540 EAL: Releasing PCI mapped resource for 0000:5f:00.0 00:04:14.540 EAL: Calling pci_unmap_resource for 0000:5f:00.0 at 0x202001020000 00:04:14.540 Starting DPDK initialization... 00:04:14.540 Starting SPDK post initialization... 00:04:14.540 SPDK NVMe probe 00:04:14.540 Attaching to 0000:5f:00.0 00:04:14.540 Attached to 0000:5f:00.0 00:04:14.540 Cleaning up... 00:04:14.540 00:04:14.540 real 0m4.902s 00:04:14.540 user 0m3.815s 00:04:14.540 sys 0m0.161s 00:04:14.540 15:33:12 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:14.540 15:33:12 -- common/autotest_common.sh@10 -- # set +x 00:04:14.540 ************************************ 00:04:14.540 END TEST env_dpdk_post_init 00:04:14.540 ************************************ 00:04:14.540 15:33:12 -- env/env.sh@26 -- # uname 00:04:14.540 15:33:12 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:04:14.540 15:33:12 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:14.540 15:33:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:14.540 15:33:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:14.540 15:33:12 -- common/autotest_common.sh@10 -- # set +x 00:04:14.540 ************************************ 00:04:14.540 START TEST env_mem_callbacks 00:04:14.540 ************************************ 00:04:14.540 15:33:12 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:14.540 EAL: Detected CPU lcores: 96 00:04:14.540 EAL: Detected NUMA nodes: 2 00:04:14.540 EAL: Detected shared linkage of DPDK 00:04:14.540 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:14.540 EAL: Selected IOVA mode 'VA' 00:04:14.540 EAL: No free 2048 kB hugepages reported on node 1 00:04:14.540 EAL: VFIO support initialized 00:04:14.540 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:14.540 00:04:14.540 00:04:14.540 CUnit - A unit testing framework for C - Version 2.1-3 00:04:14.540 http://cunit.sourceforge.net/ 00:04:14.540 00:04:14.540 00:04:14.540 Suite: memory 00:04:14.540 Test: test ... 00:04:14.540 register 0x200000200000 2097152 00:04:14.540 malloc 3145728 00:04:14.540 register 0x200000400000 4194304 00:04:14.540 buf 0x200000500000 len 3145728 PASSED 00:04:14.540 malloc 64 00:04:14.540 buf 0x2000004fff40 len 64 PASSED 00:04:14.540 malloc 4194304 00:04:14.540 register 0x200000800000 6291456 00:04:14.540 buf 0x200000a00000 len 4194304 PASSED 00:04:14.540 free 0x200000500000 3145728 00:04:14.540 free 0x2000004fff40 64 00:04:14.540 unregister 0x200000400000 4194304 PASSED 00:04:14.540 free 0x200000a00000 4194304 00:04:14.540 unregister 0x200000800000 6291456 PASSED 00:04:14.540 malloc 8388608 00:04:14.540 register 0x200000400000 10485760 00:04:14.540 buf 0x200000600000 len 8388608 PASSED 00:04:14.540 free 0x200000600000 8388608 00:04:14.540 unregister 0x200000400000 10485760 PASSED 00:04:14.540 passed 00:04:14.540 00:04:14.540 Run Summary: Type Total Ran Passed Failed Inactive 00:04:14.540 suites 1 1 n/a 0 0 00:04:14.540 tests 1 1 1 0 0 00:04:14.540 asserts 15 15 15 0 n/a 00:04:14.540 00:04:14.540 Elapsed time = 0.005 seconds 00:04:14.540 00:04:14.540 real 0m0.055s 00:04:14.540 user 0m0.019s 00:04:14.540 sys 0m0.036s 00:04:14.540 15:33:12 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:14.540 15:33:12 -- common/autotest_common.sh@10 -- # set +x 00:04:14.540 ************************************ 00:04:14.540 END TEST env_mem_callbacks 00:04:14.540 ************************************ 00:04:14.540 00:04:14.540 real 0m7.157s 00:04:14.540 user 0m4.991s 00:04:14.540 sys 0m1.169s 00:04:14.540 15:33:12 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:14.540 15:33:12 -- common/autotest_common.sh@10 -- # set +x 00:04:14.540 ************************************ 00:04:14.540 END TEST env 00:04:14.540 ************************************ 00:04:14.540 15:33:12 -- spdk/autotest.sh@165 -- # run_test rpc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/rpc.sh 00:04:14.540 15:33:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:14.540 15:33:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:14.540 15:33:12 -- common/autotest_common.sh@10 -- # set +x 00:04:14.540 ************************************ 00:04:14.540 START TEST rpc 00:04:14.540 ************************************ 00:04:14.540 15:33:13 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/rpc.sh 00:04:14.540 * Looking for test storage... 00:04:14.540 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc 00:04:14.540 15:33:13 -- rpc/rpc.sh@65 -- # spdk_pid=3153188 00:04:14.540 15:33:13 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:14.540 15:33:13 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:04:14.540 15:33:13 -- rpc/rpc.sh@67 -- # waitforlisten 3153188 00:04:14.540 15:33:13 -- common/autotest_common.sh@817 -- # '[' -z 3153188 ']' 00:04:14.540 15:33:13 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:14.540 15:33:13 -- common/autotest_common.sh@822 -- # local max_retries=100 00:04:14.540 15:33:13 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:14.540 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:14.540 15:33:13 -- common/autotest_common.sh@826 -- # xtrace_disable 00:04:14.540 15:33:13 -- common/autotest_common.sh@10 -- # set +x 00:04:14.806 [2024-04-26 15:33:13.160236] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:04:14.807 [2024-04-26 15:33:13.160285] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3153188 ] 00:04:14.807 EAL: No free 2048 kB hugepages reported on node 1 00:04:14.807 [2024-04-26 15:33:13.216612] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:14.807 [2024-04-26 15:33:13.288641] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:04:14.807 [2024-04-26 15:33:13.288680] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 3153188' to capture a snapshot of events at runtime. 00:04:14.807 [2024-04-26 15:33:13.288686] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:04:14.807 [2024-04-26 15:33:13.288692] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:04:14.807 [2024-04-26 15:33:13.288697] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid3153188 for offline analysis/debug. 00:04:14.807 [2024-04-26 15:33:13.288712] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:15.376 15:33:13 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:04:15.376 15:33:13 -- common/autotest_common.sh@850 -- # return 0 00:04:15.376 15:33:13 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc 00:04:15.376 15:33:13 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc 00:04:15.376 15:33:13 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:04:15.376 15:33:13 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:04:15.376 15:33:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:15.376 15:33:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:15.376 15:33:13 -- common/autotest_common.sh@10 -- # set +x 00:04:15.634 ************************************ 00:04:15.634 START TEST rpc_integrity 00:04:15.634 ************************************ 00:04:15.634 15:33:14 -- common/autotest_common.sh@1111 -- # rpc_integrity 00:04:15.634 15:33:14 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:15.634 15:33:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:15.634 15:33:14 -- common/autotest_common.sh@10 -- # set +x 00:04:15.634 15:33:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:15.634 15:33:14 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:15.634 15:33:14 -- rpc/rpc.sh@13 -- # jq length 00:04:15.634 15:33:14 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:15.634 15:33:14 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:15.634 15:33:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:15.634 15:33:14 -- common/autotest_common.sh@10 -- # set +x 00:04:15.634 15:33:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:15.634 15:33:14 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:04:15.634 15:33:14 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:15.634 15:33:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:15.634 15:33:14 -- common/autotest_common.sh@10 -- # set +x 00:04:15.634 15:33:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:15.634 15:33:14 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:15.634 { 00:04:15.634 "name": "Malloc0", 00:04:15.634 "aliases": [ 00:04:15.634 "6b0d8e26-1a10-41dd-bcb0-b924446d4d79" 00:04:15.634 ], 00:04:15.634 "product_name": "Malloc disk", 00:04:15.634 "block_size": 512, 00:04:15.634 "num_blocks": 16384, 00:04:15.634 "uuid": "6b0d8e26-1a10-41dd-bcb0-b924446d4d79", 00:04:15.634 "assigned_rate_limits": { 00:04:15.634 "rw_ios_per_sec": 0, 00:04:15.634 "rw_mbytes_per_sec": 0, 00:04:15.634 "r_mbytes_per_sec": 0, 00:04:15.634 "w_mbytes_per_sec": 0 00:04:15.634 }, 00:04:15.634 "claimed": false, 00:04:15.634 "zoned": false, 00:04:15.634 "supported_io_types": { 00:04:15.634 "read": true, 00:04:15.634 "write": true, 00:04:15.634 "unmap": true, 00:04:15.634 "write_zeroes": true, 00:04:15.634 "flush": true, 00:04:15.634 "reset": true, 00:04:15.634 "compare": false, 00:04:15.634 "compare_and_write": false, 00:04:15.634 "abort": true, 00:04:15.634 "nvme_admin": false, 00:04:15.634 "nvme_io": false 00:04:15.634 }, 00:04:15.634 "memory_domains": [ 00:04:15.634 { 00:04:15.634 "dma_device_id": "system", 00:04:15.634 "dma_device_type": 1 00:04:15.634 }, 00:04:15.634 { 00:04:15.634 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:15.634 "dma_device_type": 2 00:04:15.634 } 00:04:15.634 ], 00:04:15.634 "driver_specific": {} 00:04:15.634 } 00:04:15.634 ]' 00:04:15.634 15:33:14 -- rpc/rpc.sh@17 -- # jq length 00:04:15.634 15:33:14 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:15.634 15:33:14 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:04:15.634 15:33:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:15.634 15:33:14 -- common/autotest_common.sh@10 -- # set +x 00:04:15.634 [2024-04-26 15:33:14.182466] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:04:15.634 [2024-04-26 15:33:14.182498] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:15.634 [2024-04-26 15:33:14.182509] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x1429fa0 00:04:15.634 [2024-04-26 15:33:14.182516] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:15.634 [2024-04-26 15:33:14.183588] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:15.634 [2024-04-26 15:33:14.183610] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:15.634 Passthru0 00:04:15.634 15:33:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:15.634 15:33:14 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:15.634 15:33:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:15.634 15:33:14 -- common/autotest_common.sh@10 -- # set +x 00:04:15.634 15:33:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:15.634 15:33:14 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:15.635 { 00:04:15.635 "name": "Malloc0", 00:04:15.635 "aliases": [ 00:04:15.635 "6b0d8e26-1a10-41dd-bcb0-b924446d4d79" 00:04:15.635 ], 00:04:15.635 "product_name": "Malloc disk", 00:04:15.635 "block_size": 512, 00:04:15.635 "num_blocks": 16384, 00:04:15.635 "uuid": "6b0d8e26-1a10-41dd-bcb0-b924446d4d79", 00:04:15.635 "assigned_rate_limits": { 00:04:15.635 "rw_ios_per_sec": 0, 00:04:15.635 "rw_mbytes_per_sec": 0, 00:04:15.635 "r_mbytes_per_sec": 0, 00:04:15.635 "w_mbytes_per_sec": 0 00:04:15.635 }, 00:04:15.635 "claimed": true, 00:04:15.635 "claim_type": "exclusive_write", 00:04:15.635 "zoned": false, 00:04:15.635 "supported_io_types": { 00:04:15.635 "read": true, 00:04:15.635 "write": true, 00:04:15.635 "unmap": true, 00:04:15.635 "write_zeroes": true, 00:04:15.635 "flush": true, 00:04:15.635 "reset": true, 00:04:15.635 "compare": false, 00:04:15.635 "compare_and_write": false, 00:04:15.635 "abort": true, 00:04:15.635 "nvme_admin": false, 00:04:15.635 "nvme_io": false 00:04:15.635 }, 00:04:15.635 "memory_domains": [ 00:04:15.635 { 00:04:15.635 "dma_device_id": "system", 00:04:15.635 "dma_device_type": 1 00:04:15.635 }, 00:04:15.635 { 00:04:15.635 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:15.635 "dma_device_type": 2 00:04:15.635 } 00:04:15.635 ], 00:04:15.635 "driver_specific": {} 00:04:15.635 }, 00:04:15.635 { 00:04:15.635 "name": "Passthru0", 00:04:15.635 "aliases": [ 00:04:15.635 "6cad6e4f-68f1-5222-b70a-c01eca3da86b" 00:04:15.635 ], 00:04:15.635 "product_name": "passthru", 00:04:15.635 "block_size": 512, 00:04:15.635 "num_blocks": 16384, 00:04:15.635 "uuid": "6cad6e4f-68f1-5222-b70a-c01eca3da86b", 00:04:15.635 "assigned_rate_limits": { 00:04:15.635 "rw_ios_per_sec": 0, 00:04:15.635 "rw_mbytes_per_sec": 0, 00:04:15.635 "r_mbytes_per_sec": 0, 00:04:15.635 "w_mbytes_per_sec": 0 00:04:15.635 }, 00:04:15.635 "claimed": false, 00:04:15.635 "zoned": false, 00:04:15.635 "supported_io_types": { 00:04:15.635 "read": true, 00:04:15.635 "write": true, 00:04:15.635 "unmap": true, 00:04:15.635 "write_zeroes": true, 00:04:15.635 "flush": true, 00:04:15.635 "reset": true, 00:04:15.635 "compare": false, 00:04:15.635 "compare_and_write": false, 00:04:15.635 "abort": true, 00:04:15.635 "nvme_admin": false, 00:04:15.635 "nvme_io": false 00:04:15.635 }, 00:04:15.635 "memory_domains": [ 00:04:15.635 { 00:04:15.635 "dma_device_id": "system", 00:04:15.635 "dma_device_type": 1 00:04:15.635 }, 00:04:15.635 { 00:04:15.635 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:15.635 "dma_device_type": 2 00:04:15.635 } 00:04:15.635 ], 00:04:15.635 "driver_specific": { 00:04:15.635 "passthru": { 00:04:15.635 "name": "Passthru0", 00:04:15.635 "base_bdev_name": "Malloc0" 00:04:15.635 } 00:04:15.635 } 00:04:15.635 } 00:04:15.635 ]' 00:04:15.635 15:33:14 -- rpc/rpc.sh@21 -- # jq length 00:04:15.893 15:33:14 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:15.893 15:33:14 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:15.893 15:33:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:15.893 15:33:14 -- common/autotest_common.sh@10 -- # set +x 00:04:15.893 15:33:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:15.893 15:33:14 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:04:15.893 15:33:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:15.893 15:33:14 -- common/autotest_common.sh@10 -- # set +x 00:04:15.893 15:33:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:15.893 15:33:14 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:15.893 15:33:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:15.893 15:33:14 -- common/autotest_common.sh@10 -- # set +x 00:04:15.893 15:33:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:15.893 15:33:14 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:15.893 15:33:14 -- rpc/rpc.sh@26 -- # jq length 00:04:15.893 15:33:14 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:15.893 00:04:15.893 real 0m0.242s 00:04:15.893 user 0m0.158s 00:04:15.893 sys 0m0.025s 00:04:15.893 15:33:14 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:15.893 15:33:14 -- common/autotest_common.sh@10 -- # set +x 00:04:15.893 ************************************ 00:04:15.893 END TEST rpc_integrity 00:04:15.893 ************************************ 00:04:15.893 15:33:14 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:04:15.893 15:33:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:15.893 15:33:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:15.893 15:33:14 -- common/autotest_common.sh@10 -- # set +x 00:04:15.893 ************************************ 00:04:15.893 START TEST rpc_plugins 00:04:15.893 ************************************ 00:04:15.893 15:33:14 -- common/autotest_common.sh@1111 -- # rpc_plugins 00:04:15.893 15:33:14 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:04:15.893 15:33:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:15.893 15:33:14 -- common/autotest_common.sh@10 -- # set +x 00:04:15.893 15:33:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:15.893 15:33:14 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:04:15.893 15:33:14 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:04:15.893 15:33:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:15.893 15:33:14 -- common/autotest_common.sh@10 -- # set +x 00:04:15.893 15:33:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:15.893 15:33:14 -- rpc/rpc.sh@31 -- # bdevs='[ 00:04:15.893 { 00:04:15.893 "name": "Malloc1", 00:04:15.893 "aliases": [ 00:04:15.893 "f0f7b130-458d-4a83-8f82-ca92cde26b23" 00:04:15.893 ], 00:04:15.893 "product_name": "Malloc disk", 00:04:15.893 "block_size": 4096, 00:04:15.893 "num_blocks": 256, 00:04:15.893 "uuid": "f0f7b130-458d-4a83-8f82-ca92cde26b23", 00:04:15.893 "assigned_rate_limits": { 00:04:15.893 "rw_ios_per_sec": 0, 00:04:15.893 "rw_mbytes_per_sec": 0, 00:04:15.893 "r_mbytes_per_sec": 0, 00:04:15.893 "w_mbytes_per_sec": 0 00:04:15.893 }, 00:04:15.893 "claimed": false, 00:04:15.893 "zoned": false, 00:04:15.893 "supported_io_types": { 00:04:15.893 "read": true, 00:04:15.893 "write": true, 00:04:15.893 "unmap": true, 00:04:15.893 "write_zeroes": true, 00:04:15.893 "flush": true, 00:04:15.893 "reset": true, 00:04:15.893 "compare": false, 00:04:15.893 "compare_and_write": false, 00:04:15.893 "abort": true, 00:04:15.893 "nvme_admin": false, 00:04:15.893 "nvme_io": false 00:04:15.893 }, 00:04:15.893 "memory_domains": [ 00:04:15.893 { 00:04:15.893 "dma_device_id": "system", 00:04:15.893 "dma_device_type": 1 00:04:15.893 }, 00:04:15.893 { 00:04:15.893 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:15.893 "dma_device_type": 2 00:04:15.893 } 00:04:15.893 ], 00:04:15.893 "driver_specific": {} 00:04:15.893 } 00:04:15.893 ]' 00:04:15.893 15:33:14 -- rpc/rpc.sh@32 -- # jq length 00:04:16.152 15:33:14 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:04:16.152 15:33:14 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:04:16.152 15:33:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:16.152 15:33:14 -- common/autotest_common.sh@10 -- # set +x 00:04:16.152 15:33:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:16.152 15:33:14 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:04:16.152 15:33:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:16.152 15:33:14 -- common/autotest_common.sh@10 -- # set +x 00:04:16.152 15:33:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:16.152 15:33:14 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:04:16.152 15:33:14 -- rpc/rpc.sh@36 -- # jq length 00:04:16.152 15:33:14 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:04:16.152 00:04:16.152 real 0m0.128s 00:04:16.152 user 0m0.079s 00:04:16.152 sys 0m0.013s 00:04:16.152 15:33:14 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:16.152 15:33:14 -- common/autotest_common.sh@10 -- # set +x 00:04:16.152 ************************************ 00:04:16.152 END TEST rpc_plugins 00:04:16.152 ************************************ 00:04:16.152 15:33:14 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:04:16.152 15:33:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:16.152 15:33:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:16.152 15:33:14 -- common/autotest_common.sh@10 -- # set +x 00:04:16.152 ************************************ 00:04:16.152 START TEST rpc_trace_cmd_test 00:04:16.152 ************************************ 00:04:16.152 15:33:14 -- common/autotest_common.sh@1111 -- # rpc_trace_cmd_test 00:04:16.152 15:33:14 -- rpc/rpc.sh@40 -- # local info 00:04:16.152 15:33:14 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:04:16.152 15:33:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:16.152 15:33:14 -- common/autotest_common.sh@10 -- # set +x 00:04:16.411 15:33:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:16.411 15:33:14 -- rpc/rpc.sh@42 -- # info='{ 00:04:16.411 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid3153188", 00:04:16.411 "tpoint_group_mask": "0x8", 00:04:16.411 "iscsi_conn": { 00:04:16.411 "mask": "0x2", 00:04:16.411 "tpoint_mask": "0x0" 00:04:16.411 }, 00:04:16.411 "scsi": { 00:04:16.411 "mask": "0x4", 00:04:16.411 "tpoint_mask": "0x0" 00:04:16.411 }, 00:04:16.411 "bdev": { 00:04:16.411 "mask": "0x8", 00:04:16.411 "tpoint_mask": "0xffffffffffffffff" 00:04:16.411 }, 00:04:16.411 "nvmf_rdma": { 00:04:16.411 "mask": "0x10", 00:04:16.411 "tpoint_mask": "0x0" 00:04:16.411 }, 00:04:16.411 "nvmf_tcp": { 00:04:16.411 "mask": "0x20", 00:04:16.411 "tpoint_mask": "0x0" 00:04:16.411 }, 00:04:16.411 "ftl": { 00:04:16.411 "mask": "0x40", 00:04:16.411 "tpoint_mask": "0x0" 00:04:16.411 }, 00:04:16.411 "blobfs": { 00:04:16.411 "mask": "0x80", 00:04:16.411 "tpoint_mask": "0x0" 00:04:16.411 }, 00:04:16.411 "dsa": { 00:04:16.411 "mask": "0x200", 00:04:16.411 "tpoint_mask": "0x0" 00:04:16.411 }, 00:04:16.411 "thread": { 00:04:16.411 "mask": "0x400", 00:04:16.411 "tpoint_mask": "0x0" 00:04:16.411 }, 00:04:16.411 "nvme_pcie": { 00:04:16.411 "mask": "0x800", 00:04:16.411 "tpoint_mask": "0x0" 00:04:16.411 }, 00:04:16.411 "iaa": { 00:04:16.411 "mask": "0x1000", 00:04:16.411 "tpoint_mask": "0x0" 00:04:16.411 }, 00:04:16.411 "nvme_tcp": { 00:04:16.411 "mask": "0x2000", 00:04:16.411 "tpoint_mask": "0x0" 00:04:16.411 }, 00:04:16.411 "bdev_nvme": { 00:04:16.411 "mask": "0x4000", 00:04:16.411 "tpoint_mask": "0x0" 00:04:16.411 }, 00:04:16.411 "sock": { 00:04:16.411 "mask": "0x8000", 00:04:16.411 "tpoint_mask": "0x0" 00:04:16.411 } 00:04:16.411 }' 00:04:16.411 15:33:14 -- rpc/rpc.sh@43 -- # jq length 00:04:16.411 15:33:14 -- rpc/rpc.sh@43 -- # '[' 16 -gt 2 ']' 00:04:16.411 15:33:14 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:04:16.411 15:33:14 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:04:16.411 15:33:14 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:04:16.411 15:33:14 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:04:16.411 15:33:14 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:04:16.411 15:33:14 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:04:16.411 15:33:14 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:04:16.411 15:33:14 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:04:16.411 00:04:16.411 real 0m0.187s 00:04:16.411 user 0m0.154s 00:04:16.411 sys 0m0.025s 00:04:16.411 15:33:14 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:16.411 15:33:14 -- common/autotest_common.sh@10 -- # set +x 00:04:16.411 ************************************ 00:04:16.411 END TEST rpc_trace_cmd_test 00:04:16.411 ************************************ 00:04:16.411 15:33:14 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:04:16.411 15:33:14 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:04:16.411 15:33:14 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:04:16.411 15:33:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:16.411 15:33:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:16.411 15:33:14 -- common/autotest_common.sh@10 -- # set +x 00:04:16.669 ************************************ 00:04:16.669 START TEST rpc_daemon_integrity 00:04:16.670 ************************************ 00:04:16.670 15:33:15 -- common/autotest_common.sh@1111 -- # rpc_integrity 00:04:16.670 15:33:15 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:16.670 15:33:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:16.670 15:33:15 -- common/autotest_common.sh@10 -- # set +x 00:04:16.670 15:33:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:16.670 15:33:15 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:16.670 15:33:15 -- rpc/rpc.sh@13 -- # jq length 00:04:16.670 15:33:15 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:16.670 15:33:15 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:16.670 15:33:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:16.670 15:33:15 -- common/autotest_common.sh@10 -- # set +x 00:04:16.670 15:33:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:16.670 15:33:15 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:04:16.670 15:33:15 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:16.670 15:33:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:16.670 15:33:15 -- common/autotest_common.sh@10 -- # set +x 00:04:16.670 15:33:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:16.670 15:33:15 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:16.670 { 00:04:16.670 "name": "Malloc2", 00:04:16.670 "aliases": [ 00:04:16.670 "c4667254-dae5-44e9-b90b-b6484c596f7e" 00:04:16.670 ], 00:04:16.670 "product_name": "Malloc disk", 00:04:16.670 "block_size": 512, 00:04:16.670 "num_blocks": 16384, 00:04:16.670 "uuid": "c4667254-dae5-44e9-b90b-b6484c596f7e", 00:04:16.670 "assigned_rate_limits": { 00:04:16.670 "rw_ios_per_sec": 0, 00:04:16.670 "rw_mbytes_per_sec": 0, 00:04:16.670 "r_mbytes_per_sec": 0, 00:04:16.670 "w_mbytes_per_sec": 0 00:04:16.670 }, 00:04:16.670 "claimed": false, 00:04:16.670 "zoned": false, 00:04:16.670 "supported_io_types": { 00:04:16.670 "read": true, 00:04:16.670 "write": true, 00:04:16.670 "unmap": true, 00:04:16.670 "write_zeroes": true, 00:04:16.670 "flush": true, 00:04:16.670 "reset": true, 00:04:16.670 "compare": false, 00:04:16.670 "compare_and_write": false, 00:04:16.670 "abort": true, 00:04:16.670 "nvme_admin": false, 00:04:16.670 "nvme_io": false 00:04:16.670 }, 00:04:16.670 "memory_domains": [ 00:04:16.670 { 00:04:16.670 "dma_device_id": "system", 00:04:16.670 "dma_device_type": 1 00:04:16.670 }, 00:04:16.670 { 00:04:16.670 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:16.670 "dma_device_type": 2 00:04:16.670 } 00:04:16.670 ], 00:04:16.670 "driver_specific": {} 00:04:16.670 } 00:04:16.670 ]' 00:04:16.670 15:33:15 -- rpc/rpc.sh@17 -- # jq length 00:04:16.670 15:33:15 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:16.670 15:33:15 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:04:16.670 15:33:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:16.670 15:33:15 -- common/autotest_common.sh@10 -- # set +x 00:04:16.670 [2024-04-26 15:33:15.213272] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:04:16.670 [2024-04-26 15:33:15.213300] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:16.670 [2024-04-26 15:33:15.213311] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x142a470 00:04:16.670 [2024-04-26 15:33:15.213317] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:16.670 [2024-04-26 15:33:15.214266] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:16.670 [2024-04-26 15:33:15.214288] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:16.670 Passthru0 00:04:16.670 15:33:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:16.670 15:33:15 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:16.670 15:33:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:16.670 15:33:15 -- common/autotest_common.sh@10 -- # set +x 00:04:16.670 15:33:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:16.670 15:33:15 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:16.670 { 00:04:16.670 "name": "Malloc2", 00:04:16.670 "aliases": [ 00:04:16.670 "c4667254-dae5-44e9-b90b-b6484c596f7e" 00:04:16.670 ], 00:04:16.670 "product_name": "Malloc disk", 00:04:16.670 "block_size": 512, 00:04:16.670 "num_blocks": 16384, 00:04:16.670 "uuid": "c4667254-dae5-44e9-b90b-b6484c596f7e", 00:04:16.670 "assigned_rate_limits": { 00:04:16.670 "rw_ios_per_sec": 0, 00:04:16.670 "rw_mbytes_per_sec": 0, 00:04:16.670 "r_mbytes_per_sec": 0, 00:04:16.670 "w_mbytes_per_sec": 0 00:04:16.670 }, 00:04:16.670 "claimed": true, 00:04:16.670 "claim_type": "exclusive_write", 00:04:16.670 "zoned": false, 00:04:16.670 "supported_io_types": { 00:04:16.670 "read": true, 00:04:16.670 "write": true, 00:04:16.670 "unmap": true, 00:04:16.670 "write_zeroes": true, 00:04:16.670 "flush": true, 00:04:16.670 "reset": true, 00:04:16.670 "compare": false, 00:04:16.670 "compare_and_write": false, 00:04:16.670 "abort": true, 00:04:16.670 "nvme_admin": false, 00:04:16.670 "nvme_io": false 00:04:16.670 }, 00:04:16.670 "memory_domains": [ 00:04:16.670 { 00:04:16.670 "dma_device_id": "system", 00:04:16.670 "dma_device_type": 1 00:04:16.670 }, 00:04:16.670 { 00:04:16.670 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:16.670 "dma_device_type": 2 00:04:16.670 } 00:04:16.670 ], 00:04:16.670 "driver_specific": {} 00:04:16.670 }, 00:04:16.670 { 00:04:16.670 "name": "Passthru0", 00:04:16.670 "aliases": [ 00:04:16.670 "360deb3c-c0af-5ce6-a211-599d7e98254b" 00:04:16.670 ], 00:04:16.670 "product_name": "passthru", 00:04:16.670 "block_size": 512, 00:04:16.670 "num_blocks": 16384, 00:04:16.670 "uuid": "360deb3c-c0af-5ce6-a211-599d7e98254b", 00:04:16.670 "assigned_rate_limits": { 00:04:16.670 "rw_ios_per_sec": 0, 00:04:16.670 "rw_mbytes_per_sec": 0, 00:04:16.670 "r_mbytes_per_sec": 0, 00:04:16.670 "w_mbytes_per_sec": 0 00:04:16.670 }, 00:04:16.670 "claimed": false, 00:04:16.670 "zoned": false, 00:04:16.670 "supported_io_types": { 00:04:16.670 "read": true, 00:04:16.670 "write": true, 00:04:16.670 "unmap": true, 00:04:16.670 "write_zeroes": true, 00:04:16.670 "flush": true, 00:04:16.670 "reset": true, 00:04:16.670 "compare": false, 00:04:16.670 "compare_and_write": false, 00:04:16.670 "abort": true, 00:04:16.670 "nvme_admin": false, 00:04:16.670 "nvme_io": false 00:04:16.670 }, 00:04:16.670 "memory_domains": [ 00:04:16.670 { 00:04:16.670 "dma_device_id": "system", 00:04:16.670 "dma_device_type": 1 00:04:16.670 }, 00:04:16.670 { 00:04:16.670 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:16.670 "dma_device_type": 2 00:04:16.670 } 00:04:16.670 ], 00:04:16.670 "driver_specific": { 00:04:16.670 "passthru": { 00:04:16.670 "name": "Passthru0", 00:04:16.670 "base_bdev_name": "Malloc2" 00:04:16.670 } 00:04:16.670 } 00:04:16.670 } 00:04:16.670 ]' 00:04:16.670 15:33:15 -- rpc/rpc.sh@21 -- # jq length 00:04:16.929 15:33:15 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:16.929 15:33:15 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:16.930 15:33:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:16.930 15:33:15 -- common/autotest_common.sh@10 -- # set +x 00:04:16.930 15:33:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:16.930 15:33:15 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:04:16.930 15:33:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:16.930 15:33:15 -- common/autotest_common.sh@10 -- # set +x 00:04:16.930 15:33:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:16.930 15:33:15 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:16.930 15:33:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:16.930 15:33:15 -- common/autotest_common.sh@10 -- # set +x 00:04:16.930 15:33:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:16.930 15:33:15 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:16.930 15:33:15 -- rpc/rpc.sh@26 -- # jq length 00:04:16.930 15:33:15 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:16.930 00:04:16.930 real 0m0.253s 00:04:16.930 user 0m0.158s 00:04:16.930 sys 0m0.032s 00:04:16.930 15:33:15 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:16.930 15:33:15 -- common/autotest_common.sh@10 -- # set +x 00:04:16.930 ************************************ 00:04:16.930 END TEST rpc_daemon_integrity 00:04:16.930 ************************************ 00:04:16.930 15:33:15 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:04:16.930 15:33:15 -- rpc/rpc.sh@84 -- # killprocess 3153188 00:04:16.930 15:33:15 -- common/autotest_common.sh@936 -- # '[' -z 3153188 ']' 00:04:16.930 15:33:15 -- common/autotest_common.sh@940 -- # kill -0 3153188 00:04:16.930 15:33:15 -- common/autotest_common.sh@941 -- # uname 00:04:16.930 15:33:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:16.930 15:33:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3153188 00:04:16.930 15:33:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:16.930 15:33:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:16.930 15:33:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3153188' 00:04:16.930 killing process with pid 3153188 00:04:16.930 15:33:15 -- common/autotest_common.sh@955 -- # kill 3153188 00:04:16.930 15:33:15 -- common/autotest_common.sh@960 -- # wait 3153188 00:04:17.188 00:04:17.188 real 0m2.722s 00:04:17.188 user 0m3.494s 00:04:17.188 sys 0m0.804s 00:04:17.188 15:33:15 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:17.188 15:33:15 -- common/autotest_common.sh@10 -- # set +x 00:04:17.188 ************************************ 00:04:17.188 END TEST rpc 00:04:17.188 ************************************ 00:04:17.188 15:33:15 -- spdk/autotest.sh@166 -- # run_test skip_rpc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/skip_rpc.sh 00:04:17.189 15:33:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:17.189 15:33:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:17.189 15:33:15 -- common/autotest_common.sh@10 -- # set +x 00:04:17.447 ************************************ 00:04:17.447 START TEST skip_rpc 00:04:17.447 ************************************ 00:04:17.447 15:33:15 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/skip_rpc.sh 00:04:17.447 * Looking for test storage... 00:04:17.447 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc 00:04:17.447 15:33:15 -- rpc/skip_rpc.sh@11 -- # CONFIG_PATH=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/config.json 00:04:17.447 15:33:15 -- rpc/skip_rpc.sh@12 -- # LOG_PATH=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/log.txt 00:04:17.447 15:33:15 -- rpc/skip_rpc.sh@73 -- # run_test skip_rpc test_skip_rpc 00:04:17.447 15:33:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:17.447 15:33:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:17.447 15:33:15 -- common/autotest_common.sh@10 -- # set +x 00:04:17.730 ************************************ 00:04:17.731 START TEST skip_rpc 00:04:17.731 ************************************ 00:04:17.731 15:33:16 -- common/autotest_common.sh@1111 -- # test_skip_rpc 00:04:17.731 15:33:16 -- rpc/skip_rpc.sh@16 -- # local spdk_pid=3153871 00:04:17.731 15:33:16 -- rpc/skip_rpc.sh@18 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:17.731 15:33:16 -- rpc/skip_rpc.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 00:04:17.731 15:33:16 -- rpc/skip_rpc.sh@19 -- # sleep 5 00:04:17.731 [2024-04-26 15:33:16.138843] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:04:17.731 [2024-04-26 15:33:16.138875] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3153871 ] 00:04:17.731 EAL: No free 2048 kB hugepages reported on node 1 00:04:17.731 [2024-04-26 15:33:16.191403] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:17.731 [2024-04-26 15:33:16.260013] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:23.011 15:33:21 -- rpc/skip_rpc.sh@21 -- # NOT rpc_cmd spdk_get_version 00:04:23.012 15:33:21 -- common/autotest_common.sh@638 -- # local es=0 00:04:23.012 15:33:21 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd spdk_get_version 00:04:23.012 15:33:21 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:04:23.012 15:33:21 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:04:23.012 15:33:21 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:04:23.012 15:33:21 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:04:23.012 15:33:21 -- common/autotest_common.sh@641 -- # rpc_cmd spdk_get_version 00:04:23.012 15:33:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:23.012 15:33:21 -- common/autotest_common.sh@10 -- # set +x 00:04:23.012 15:33:21 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:04:23.012 15:33:21 -- common/autotest_common.sh@641 -- # es=1 00:04:23.012 15:33:21 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:04:23.012 15:33:21 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:04:23.012 15:33:21 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:04:23.012 15:33:21 -- rpc/skip_rpc.sh@22 -- # trap - SIGINT SIGTERM EXIT 00:04:23.012 15:33:21 -- rpc/skip_rpc.sh@23 -- # killprocess 3153871 00:04:23.012 15:33:21 -- common/autotest_common.sh@936 -- # '[' -z 3153871 ']' 00:04:23.012 15:33:21 -- common/autotest_common.sh@940 -- # kill -0 3153871 00:04:23.012 15:33:21 -- common/autotest_common.sh@941 -- # uname 00:04:23.012 15:33:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:23.012 15:33:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3153871 00:04:23.012 15:33:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:23.012 15:33:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:23.012 15:33:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3153871' 00:04:23.012 killing process with pid 3153871 00:04:23.012 15:33:21 -- common/autotest_common.sh@955 -- # kill 3153871 00:04:23.012 15:33:21 -- common/autotest_common.sh@960 -- # wait 3153871 00:04:23.012 00:04:23.012 real 0m5.390s 00:04:23.012 user 0m5.161s 00:04:23.012 sys 0m0.255s 00:04:23.012 15:33:21 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:23.012 15:33:21 -- common/autotest_common.sh@10 -- # set +x 00:04:23.012 ************************************ 00:04:23.012 END TEST skip_rpc 00:04:23.012 ************************************ 00:04:23.012 15:33:21 -- rpc/skip_rpc.sh@74 -- # run_test skip_rpc_with_json test_skip_rpc_with_json 00:04:23.012 15:33:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:23.012 15:33:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:23.012 15:33:21 -- common/autotest_common.sh@10 -- # set +x 00:04:23.275 ************************************ 00:04:23.275 START TEST skip_rpc_with_json 00:04:23.275 ************************************ 00:04:23.275 15:33:21 -- common/autotest_common.sh@1111 -- # test_skip_rpc_with_json 00:04:23.275 15:33:21 -- rpc/skip_rpc.sh@44 -- # gen_json_config 00:04:23.275 15:33:21 -- rpc/skip_rpc.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:23.275 15:33:21 -- rpc/skip_rpc.sh@28 -- # local spdk_pid=3154821 00:04:23.275 15:33:21 -- rpc/skip_rpc.sh@30 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:23.275 15:33:21 -- rpc/skip_rpc.sh@31 -- # waitforlisten 3154821 00:04:23.275 15:33:21 -- common/autotest_common.sh@817 -- # '[' -z 3154821 ']' 00:04:23.275 15:33:21 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:23.275 15:33:21 -- common/autotest_common.sh@822 -- # local max_retries=100 00:04:23.275 15:33:21 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:23.275 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:23.275 15:33:21 -- common/autotest_common.sh@826 -- # xtrace_disable 00:04:23.275 15:33:21 -- common/autotest_common.sh@10 -- # set +x 00:04:23.275 [2024-04-26 15:33:21.674701] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:04:23.275 [2024-04-26 15:33:21.674738] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3154821 ] 00:04:23.275 EAL: No free 2048 kB hugepages reported on node 1 00:04:23.275 [2024-04-26 15:33:21.728332] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:23.275 [2024-04-26 15:33:21.804741] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:24.212 15:33:22 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:04:24.212 15:33:22 -- common/autotest_common.sh@850 -- # return 0 00:04:24.212 15:33:22 -- rpc/skip_rpc.sh@34 -- # rpc_cmd nvmf_get_transports --trtype tcp 00:04:24.212 15:33:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:24.212 15:33:22 -- common/autotest_common.sh@10 -- # set +x 00:04:24.212 [2024-04-26 15:33:22.482632] nvmf_rpc.c:2513:rpc_nvmf_get_transports: *ERROR*: transport 'tcp' does not exist 00:04:24.212 request: 00:04:24.212 { 00:04:24.212 "trtype": "tcp", 00:04:24.212 "method": "nvmf_get_transports", 00:04:24.212 "req_id": 1 00:04:24.212 } 00:04:24.212 Got JSON-RPC error response 00:04:24.212 response: 00:04:24.212 { 00:04:24.212 "code": -19, 00:04:24.212 "message": "No such device" 00:04:24.212 } 00:04:24.212 15:33:22 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:04:24.212 15:33:22 -- rpc/skip_rpc.sh@34 -- # rpc_cmd nvmf_create_transport -t tcp 00:04:24.212 15:33:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:24.212 15:33:22 -- common/autotest_common.sh@10 -- # set +x 00:04:24.212 [2024-04-26 15:33:22.494730] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:24.212 15:33:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:24.212 15:33:22 -- rpc/skip_rpc.sh@36 -- # rpc_cmd save_config 00:04:24.212 15:33:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:24.212 15:33:22 -- common/autotest_common.sh@10 -- # set +x 00:04:24.212 15:33:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:24.212 15:33:22 -- rpc/skip_rpc.sh@37 -- # cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/config.json 00:04:24.212 { 00:04:24.212 "subsystems": [ 00:04:24.212 { 00:04:24.212 "subsystem": "keyring", 00:04:24.212 "config": [] 00:04:24.212 }, 00:04:24.212 { 00:04:24.212 "subsystem": "iobuf", 00:04:24.212 "config": [ 00:04:24.212 { 00:04:24.212 "method": "iobuf_set_options", 00:04:24.212 "params": { 00:04:24.212 "small_pool_count": 8192, 00:04:24.212 "large_pool_count": 1024, 00:04:24.212 "small_bufsize": 8192, 00:04:24.212 "large_bufsize": 135168 00:04:24.212 } 00:04:24.212 } 00:04:24.212 ] 00:04:24.212 }, 00:04:24.212 { 00:04:24.212 "subsystem": "sock", 00:04:24.212 "config": [ 00:04:24.212 { 00:04:24.212 "method": "sock_impl_set_options", 00:04:24.212 "params": { 00:04:24.212 "impl_name": "posix", 00:04:24.212 "recv_buf_size": 2097152, 00:04:24.212 "send_buf_size": 2097152, 00:04:24.212 "enable_recv_pipe": true, 00:04:24.212 "enable_quickack": false, 00:04:24.212 "enable_placement_id": 0, 00:04:24.212 "enable_zerocopy_send_server": true, 00:04:24.212 "enable_zerocopy_send_client": false, 00:04:24.212 "zerocopy_threshold": 0, 00:04:24.212 "tls_version": 0, 00:04:24.212 "enable_ktls": false 00:04:24.212 } 00:04:24.212 }, 00:04:24.212 { 00:04:24.212 "method": "sock_impl_set_options", 00:04:24.212 "params": { 00:04:24.212 "impl_name": "ssl", 00:04:24.212 "recv_buf_size": 4096, 00:04:24.212 "send_buf_size": 4096, 00:04:24.212 "enable_recv_pipe": true, 00:04:24.212 "enable_quickack": false, 00:04:24.212 "enable_placement_id": 0, 00:04:24.212 "enable_zerocopy_send_server": true, 00:04:24.212 "enable_zerocopy_send_client": false, 00:04:24.212 "zerocopy_threshold": 0, 00:04:24.212 "tls_version": 0, 00:04:24.212 "enable_ktls": false 00:04:24.212 } 00:04:24.212 } 00:04:24.212 ] 00:04:24.212 }, 00:04:24.212 { 00:04:24.212 "subsystem": "vmd", 00:04:24.212 "config": [] 00:04:24.212 }, 00:04:24.212 { 00:04:24.212 "subsystem": "accel", 00:04:24.212 "config": [ 00:04:24.212 { 00:04:24.212 "method": "accel_set_options", 00:04:24.212 "params": { 00:04:24.212 "small_cache_size": 128, 00:04:24.212 "large_cache_size": 16, 00:04:24.212 "task_count": 2048, 00:04:24.212 "sequence_count": 2048, 00:04:24.212 "buf_count": 2048 00:04:24.212 } 00:04:24.212 } 00:04:24.212 ] 00:04:24.212 }, 00:04:24.212 { 00:04:24.212 "subsystem": "bdev", 00:04:24.212 "config": [ 00:04:24.212 { 00:04:24.212 "method": "bdev_set_options", 00:04:24.212 "params": { 00:04:24.212 "bdev_io_pool_size": 65535, 00:04:24.212 "bdev_io_cache_size": 256, 00:04:24.212 "bdev_auto_examine": true, 00:04:24.212 "iobuf_small_cache_size": 128, 00:04:24.212 "iobuf_large_cache_size": 16 00:04:24.212 } 00:04:24.212 }, 00:04:24.212 { 00:04:24.212 "method": "bdev_raid_set_options", 00:04:24.212 "params": { 00:04:24.212 "process_window_size_kb": 1024 00:04:24.212 } 00:04:24.212 }, 00:04:24.212 { 00:04:24.212 "method": "bdev_iscsi_set_options", 00:04:24.212 "params": { 00:04:24.212 "timeout_sec": 30 00:04:24.212 } 00:04:24.212 }, 00:04:24.212 { 00:04:24.212 "method": "bdev_nvme_set_options", 00:04:24.212 "params": { 00:04:24.212 "action_on_timeout": "none", 00:04:24.212 "timeout_us": 0, 00:04:24.212 "timeout_admin_us": 0, 00:04:24.212 "keep_alive_timeout_ms": 10000, 00:04:24.212 "arbitration_burst": 0, 00:04:24.213 "low_priority_weight": 0, 00:04:24.213 "medium_priority_weight": 0, 00:04:24.213 "high_priority_weight": 0, 00:04:24.213 "nvme_adminq_poll_period_us": 10000, 00:04:24.213 "nvme_ioq_poll_period_us": 0, 00:04:24.213 "io_queue_requests": 0, 00:04:24.213 "delay_cmd_submit": true, 00:04:24.213 "transport_retry_count": 4, 00:04:24.213 "bdev_retry_count": 3, 00:04:24.213 "transport_ack_timeout": 0, 00:04:24.213 "ctrlr_loss_timeout_sec": 0, 00:04:24.213 "reconnect_delay_sec": 0, 00:04:24.213 "fast_io_fail_timeout_sec": 0, 00:04:24.213 "disable_auto_failback": false, 00:04:24.213 "generate_uuids": false, 00:04:24.213 "transport_tos": 0, 00:04:24.213 "nvme_error_stat": false, 00:04:24.213 "rdma_srq_size": 0, 00:04:24.213 "io_path_stat": false, 00:04:24.213 "allow_accel_sequence": false, 00:04:24.213 "rdma_max_cq_size": 0, 00:04:24.213 "rdma_cm_event_timeout_ms": 0, 00:04:24.213 "dhchap_digests": [ 00:04:24.213 "sha256", 00:04:24.213 "sha384", 00:04:24.213 "sha512" 00:04:24.213 ], 00:04:24.213 "dhchap_dhgroups": [ 00:04:24.213 "null", 00:04:24.213 "ffdhe2048", 00:04:24.213 "ffdhe3072", 00:04:24.213 "ffdhe4096", 00:04:24.213 "ffdhe6144", 00:04:24.213 "ffdhe8192" 00:04:24.213 ] 00:04:24.213 } 00:04:24.213 }, 00:04:24.213 { 00:04:24.213 "method": "bdev_nvme_set_hotplug", 00:04:24.213 "params": { 00:04:24.213 "period_us": 100000, 00:04:24.213 "enable": false 00:04:24.213 } 00:04:24.213 }, 00:04:24.213 { 00:04:24.213 "method": "bdev_wait_for_examine" 00:04:24.213 } 00:04:24.213 ] 00:04:24.213 }, 00:04:24.213 { 00:04:24.213 "subsystem": "scsi", 00:04:24.213 "config": null 00:04:24.213 }, 00:04:24.213 { 00:04:24.213 "subsystem": "scheduler", 00:04:24.213 "config": [ 00:04:24.213 { 00:04:24.213 "method": "framework_set_scheduler", 00:04:24.213 "params": { 00:04:24.213 "name": "static" 00:04:24.213 } 00:04:24.213 } 00:04:24.213 ] 00:04:24.213 }, 00:04:24.213 { 00:04:24.213 "subsystem": "vhost_scsi", 00:04:24.213 "config": [] 00:04:24.213 }, 00:04:24.213 { 00:04:24.213 "subsystem": "vhost_blk", 00:04:24.213 "config": [] 00:04:24.213 }, 00:04:24.213 { 00:04:24.213 "subsystem": "ublk", 00:04:24.213 "config": [] 00:04:24.213 }, 00:04:24.213 { 00:04:24.213 "subsystem": "nbd", 00:04:24.213 "config": [] 00:04:24.213 }, 00:04:24.213 { 00:04:24.213 "subsystem": "nvmf", 00:04:24.213 "config": [ 00:04:24.213 { 00:04:24.213 "method": "nvmf_set_config", 00:04:24.213 "params": { 00:04:24.213 "discovery_filter": "match_any", 00:04:24.213 "admin_cmd_passthru": { 00:04:24.213 "identify_ctrlr": false 00:04:24.213 } 00:04:24.213 } 00:04:24.213 }, 00:04:24.213 { 00:04:24.213 "method": "nvmf_set_max_subsystems", 00:04:24.213 "params": { 00:04:24.213 "max_subsystems": 1024 00:04:24.213 } 00:04:24.213 }, 00:04:24.213 { 00:04:24.213 "method": "nvmf_set_crdt", 00:04:24.213 "params": { 00:04:24.213 "crdt1": 0, 00:04:24.213 "crdt2": 0, 00:04:24.213 "crdt3": 0 00:04:24.213 } 00:04:24.213 }, 00:04:24.213 { 00:04:24.213 "method": "nvmf_create_transport", 00:04:24.213 "params": { 00:04:24.213 "trtype": "TCP", 00:04:24.213 "max_queue_depth": 128, 00:04:24.213 "max_io_qpairs_per_ctrlr": 127, 00:04:24.213 "in_capsule_data_size": 4096, 00:04:24.213 "max_io_size": 131072, 00:04:24.213 "io_unit_size": 131072, 00:04:24.213 "max_aq_depth": 128, 00:04:24.213 "num_shared_buffers": 511, 00:04:24.213 "buf_cache_size": 4294967295, 00:04:24.213 "dif_insert_or_strip": false, 00:04:24.213 "zcopy": false, 00:04:24.213 "c2h_success": true, 00:04:24.213 "sock_priority": 0, 00:04:24.213 "abort_timeout_sec": 1, 00:04:24.213 "ack_timeout": 0, 00:04:24.213 "data_wr_pool_size": 0 00:04:24.213 } 00:04:24.213 } 00:04:24.213 ] 00:04:24.213 }, 00:04:24.213 { 00:04:24.213 "subsystem": "iscsi", 00:04:24.213 "config": [ 00:04:24.213 { 00:04:24.213 "method": "iscsi_set_options", 00:04:24.213 "params": { 00:04:24.213 "node_base": "iqn.2016-06.io.spdk", 00:04:24.213 "max_sessions": 128, 00:04:24.213 "max_connections_per_session": 2, 00:04:24.213 "max_queue_depth": 64, 00:04:24.213 "default_time2wait": 2, 00:04:24.213 "default_time2retain": 20, 00:04:24.213 "first_burst_length": 8192, 00:04:24.213 "immediate_data": true, 00:04:24.213 "allow_duplicated_isid": false, 00:04:24.213 "error_recovery_level": 0, 00:04:24.213 "nop_timeout": 60, 00:04:24.213 "nop_in_interval": 30, 00:04:24.213 "disable_chap": false, 00:04:24.213 "require_chap": false, 00:04:24.213 "mutual_chap": false, 00:04:24.213 "chap_group": 0, 00:04:24.213 "max_large_datain_per_connection": 64, 00:04:24.213 "max_r2t_per_connection": 4, 00:04:24.213 "pdu_pool_size": 36864, 00:04:24.213 "immediate_data_pool_size": 16384, 00:04:24.213 "data_out_pool_size": 2048 00:04:24.213 } 00:04:24.213 } 00:04:24.213 ] 00:04:24.213 } 00:04:24.213 ] 00:04:24.213 } 00:04:24.213 15:33:22 -- rpc/skip_rpc.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:04:24.213 15:33:22 -- rpc/skip_rpc.sh@40 -- # killprocess 3154821 00:04:24.213 15:33:22 -- common/autotest_common.sh@936 -- # '[' -z 3154821 ']' 00:04:24.213 15:33:22 -- common/autotest_common.sh@940 -- # kill -0 3154821 00:04:24.213 15:33:22 -- common/autotest_common.sh@941 -- # uname 00:04:24.213 15:33:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:24.213 15:33:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3154821 00:04:24.213 15:33:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:24.213 15:33:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:24.213 15:33:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3154821' 00:04:24.213 killing process with pid 3154821 00:04:24.213 15:33:22 -- common/autotest_common.sh@955 -- # kill 3154821 00:04:24.213 15:33:22 -- common/autotest_common.sh@960 -- # wait 3154821 00:04:24.472 15:33:23 -- rpc/skip_rpc.sh@47 -- # local spdk_pid=3155059 00:04:24.472 15:33:23 -- rpc/skip_rpc.sh@48 -- # sleep 5 00:04:24.472 15:33:23 -- rpc/skip_rpc.sh@46 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --json /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/config.json 00:04:29.743 15:33:28 -- rpc/skip_rpc.sh@50 -- # killprocess 3155059 00:04:29.744 15:33:28 -- common/autotest_common.sh@936 -- # '[' -z 3155059 ']' 00:04:29.744 15:33:28 -- common/autotest_common.sh@940 -- # kill -0 3155059 00:04:29.744 15:33:28 -- common/autotest_common.sh@941 -- # uname 00:04:29.744 15:33:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:29.744 15:33:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3155059 00:04:29.744 15:33:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:29.744 15:33:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:29.744 15:33:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3155059' 00:04:29.744 killing process with pid 3155059 00:04:29.744 15:33:28 -- common/autotest_common.sh@955 -- # kill 3155059 00:04:29.744 15:33:28 -- common/autotest_common.sh@960 -- # wait 3155059 00:04:30.002 15:33:28 -- rpc/skip_rpc.sh@51 -- # grep -q 'TCP Transport Init' /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/log.txt 00:04:30.002 15:33:28 -- rpc/skip_rpc.sh@52 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/log.txt 00:04:30.002 00:04:30.002 real 0m6.776s 00:04:30.002 user 0m6.628s 00:04:30.002 sys 0m0.564s 00:04:30.002 15:33:28 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:30.002 15:33:28 -- common/autotest_common.sh@10 -- # set +x 00:04:30.002 ************************************ 00:04:30.002 END TEST skip_rpc_with_json 00:04:30.002 ************************************ 00:04:30.003 15:33:28 -- rpc/skip_rpc.sh@75 -- # run_test skip_rpc_with_delay test_skip_rpc_with_delay 00:04:30.003 15:33:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:30.003 15:33:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:30.003 15:33:28 -- common/autotest_common.sh@10 -- # set +x 00:04:30.003 ************************************ 00:04:30.003 START TEST skip_rpc_with_delay 00:04:30.003 ************************************ 00:04:30.003 15:33:28 -- common/autotest_common.sh@1111 -- # test_skip_rpc_with_delay 00:04:30.003 15:33:28 -- rpc/skip_rpc.sh@57 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:04:30.003 15:33:28 -- common/autotest_common.sh@638 -- # local es=0 00:04:30.003 15:33:28 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:04:30.003 15:33:28 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:04:30.003 15:33:28 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:04:30.003 15:33:28 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:04:30.003 15:33:28 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:04:30.003 15:33:28 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:04:30.003 15:33:28 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:04:30.003 15:33:28 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:04:30.003 15:33:28 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt ]] 00:04:30.003 15:33:28 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:04:30.003 [2024-04-26 15:33:28.597977] app.c: 751:spdk_app_start: *ERROR*: Cannot use '--wait-for-rpc' if no RPC server is going to be started. 00:04:30.003 [2024-04-26 15:33:28.598031] app.c: 630:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 0, errno: 2 00:04:30.003 15:33:28 -- common/autotest_common.sh@641 -- # es=1 00:04:30.262 15:33:28 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:04:30.262 15:33:28 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:04:30.262 15:33:28 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:04:30.262 00:04:30.262 real 0m0.061s 00:04:30.262 user 0m0.035s 00:04:30.262 sys 0m0.026s 00:04:30.262 15:33:28 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:30.262 15:33:28 -- common/autotest_common.sh@10 -- # set +x 00:04:30.262 ************************************ 00:04:30.262 END TEST skip_rpc_with_delay 00:04:30.262 ************************************ 00:04:30.262 15:33:28 -- rpc/skip_rpc.sh@77 -- # uname 00:04:30.262 15:33:28 -- rpc/skip_rpc.sh@77 -- # '[' Linux '!=' FreeBSD ']' 00:04:30.262 15:33:28 -- rpc/skip_rpc.sh@78 -- # run_test exit_on_failed_rpc_init test_exit_on_failed_rpc_init 00:04:30.262 15:33:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:30.262 15:33:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:30.262 15:33:28 -- common/autotest_common.sh@10 -- # set +x 00:04:30.262 ************************************ 00:04:30.262 START TEST exit_on_failed_rpc_init 00:04:30.262 ************************************ 00:04:30.262 15:33:28 -- common/autotest_common.sh@1111 -- # test_exit_on_failed_rpc_init 00:04:30.262 15:33:28 -- rpc/skip_rpc.sh@62 -- # local spdk_pid=3156050 00:04:30.262 15:33:28 -- rpc/skip_rpc.sh@63 -- # waitforlisten 3156050 00:04:30.262 15:33:28 -- rpc/skip_rpc.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:30.262 15:33:28 -- common/autotest_common.sh@817 -- # '[' -z 3156050 ']' 00:04:30.262 15:33:28 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:30.262 15:33:28 -- common/autotest_common.sh@822 -- # local max_retries=100 00:04:30.262 15:33:28 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:30.262 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:30.262 15:33:28 -- common/autotest_common.sh@826 -- # xtrace_disable 00:04:30.262 15:33:28 -- common/autotest_common.sh@10 -- # set +x 00:04:30.262 [2024-04-26 15:33:28.814839] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:04:30.262 [2024-04-26 15:33:28.814882] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3156050 ] 00:04:30.262 EAL: No free 2048 kB hugepages reported on node 1 00:04:30.522 [2024-04-26 15:33:28.869372] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:30.522 [2024-04-26 15:33:28.949059] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:31.090 15:33:29 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:04:31.090 15:33:29 -- common/autotest_common.sh@850 -- # return 0 00:04:31.090 15:33:29 -- rpc/skip_rpc.sh@65 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:31.090 15:33:29 -- rpc/skip_rpc.sh@67 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x2 00:04:31.090 15:33:29 -- common/autotest_common.sh@638 -- # local es=0 00:04:31.090 15:33:29 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x2 00:04:31.090 15:33:29 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:04:31.090 15:33:29 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:04:31.090 15:33:29 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:04:31.090 15:33:29 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:04:31.090 15:33:29 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:04:31.090 15:33:29 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:04:31.090 15:33:29 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:04:31.090 15:33:29 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt ]] 00:04:31.090 15:33:29 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x2 00:04:31.090 [2024-04-26 15:33:29.662389] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:04:31.090 [2024-04-26 15:33:29.662436] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3156277 ] 00:04:31.090 EAL: No free 2048 kB hugepages reported on node 1 00:04:31.349 [2024-04-26 15:33:29.717191] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:31.349 [2024-04-26 15:33:29.786721] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:31.350 [2024-04-26 15:33:29.786790] rpc.c: 180:_spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:04:31.350 [2024-04-26 15:33:29.786798] rpc.c: 166:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:04:31.350 [2024-04-26 15:33:29.786803] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:04:31.350 15:33:29 -- common/autotest_common.sh@641 -- # es=234 00:04:31.350 15:33:29 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:04:31.350 15:33:29 -- common/autotest_common.sh@650 -- # es=106 00:04:31.350 15:33:29 -- common/autotest_common.sh@651 -- # case "$es" in 00:04:31.350 15:33:29 -- common/autotest_common.sh@658 -- # es=1 00:04:31.350 15:33:29 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:04:31.350 15:33:29 -- rpc/skip_rpc.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:04:31.350 15:33:29 -- rpc/skip_rpc.sh@70 -- # killprocess 3156050 00:04:31.350 15:33:29 -- common/autotest_common.sh@936 -- # '[' -z 3156050 ']' 00:04:31.350 15:33:29 -- common/autotest_common.sh@940 -- # kill -0 3156050 00:04:31.350 15:33:29 -- common/autotest_common.sh@941 -- # uname 00:04:31.350 15:33:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:31.350 15:33:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3156050 00:04:31.350 15:33:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:31.350 15:33:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:31.350 15:33:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3156050' 00:04:31.350 killing process with pid 3156050 00:04:31.350 15:33:29 -- common/autotest_common.sh@955 -- # kill 3156050 00:04:31.350 15:33:29 -- common/autotest_common.sh@960 -- # wait 3156050 00:04:31.918 00:04:31.918 real 0m1.487s 00:04:31.918 user 0m1.725s 00:04:31.918 sys 0m0.390s 00:04:31.919 15:33:30 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:31.919 15:33:30 -- common/autotest_common.sh@10 -- # set +x 00:04:31.919 ************************************ 00:04:31.919 END TEST exit_on_failed_rpc_init 00:04:31.919 ************************************ 00:04:31.919 15:33:30 -- rpc/skip_rpc.sh@81 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/config.json 00:04:31.919 00:04:31.919 real 0m14.407s 00:04:31.919 user 0m13.846s 00:04:31.919 sys 0m1.606s 00:04:31.919 15:33:30 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:31.919 15:33:30 -- common/autotest_common.sh@10 -- # set +x 00:04:31.919 ************************************ 00:04:31.919 END TEST skip_rpc 00:04:31.919 ************************************ 00:04:31.919 15:33:30 -- spdk/autotest.sh@167 -- # run_test rpc_client /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:31.919 15:33:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:31.919 15:33:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:31.919 15:33:30 -- common/autotest_common.sh@10 -- # set +x 00:04:31.919 ************************************ 00:04:31.919 START TEST rpc_client 00:04:31.919 ************************************ 00:04:31.919 15:33:30 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:32.178 * Looking for test storage... 00:04:32.178 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_client 00:04:32.178 15:33:30 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:04:32.178 OK 00:04:32.178 15:33:30 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:04:32.178 00:04:32.178 real 0m0.117s 00:04:32.178 user 0m0.052s 00:04:32.178 sys 0m0.073s 00:04:32.178 15:33:30 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:32.178 15:33:30 -- common/autotest_common.sh@10 -- # set +x 00:04:32.178 ************************************ 00:04:32.178 END TEST rpc_client 00:04:32.178 ************************************ 00:04:32.178 15:33:30 -- spdk/autotest.sh@168 -- # run_test json_config /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_config.sh 00:04:32.178 15:33:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:32.178 15:33:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:32.178 15:33:30 -- common/autotest_common.sh@10 -- # set +x 00:04:32.178 ************************************ 00:04:32.178 START TEST json_config 00:04:32.178 ************************************ 00:04:32.178 15:33:30 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_config.sh 00:04:32.439 15:33:30 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:04:32.439 15:33:30 -- nvmf/common.sh@7 -- # uname -s 00:04:32.439 15:33:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:32.439 15:33:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:32.439 15:33:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:32.439 15:33:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:32.439 15:33:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:32.439 15:33:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:32.439 15:33:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:32.439 15:33:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:32.439 15:33:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:32.439 15:33:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:32.439 15:33:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:04:32.439 15:33:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:04:32.439 15:33:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:32.439 15:33:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:32.439 15:33:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:32.439 15:33:30 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:04:32.439 15:33:30 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:04:32.439 15:33:30 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:32.439 15:33:30 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:32.439 15:33:30 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:32.439 15:33:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:32.439 15:33:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:32.439 15:33:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:32.439 15:33:30 -- paths/export.sh@5 -- # export PATH 00:04:32.439 15:33:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:32.439 15:33:30 -- nvmf/common.sh@47 -- # : 0 00:04:32.439 15:33:30 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:04:32.439 15:33:30 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:04:32.439 15:33:30 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:04:32.439 15:33:30 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:32.439 15:33:30 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:32.439 15:33:30 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:04:32.439 15:33:30 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:04:32.439 15:33:30 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:04:32.439 15:33:30 -- json_config/json_config.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/common.sh 00:04:32.439 15:33:30 -- json_config/json_config.sh@11 -- # [[ 0 -eq 1 ]] 00:04:32.439 15:33:30 -- json_config/json_config.sh@15 -- # [[ 0 -ne 1 ]] 00:04:32.439 15:33:30 -- json_config/json_config.sh@15 -- # [[ 0 -eq 1 ]] 00:04:32.439 15:33:30 -- json_config/json_config.sh@26 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:04:32.439 15:33:30 -- json_config/json_config.sh@31 -- # app_pid=(['target']='' ['initiator']='') 00:04:32.439 15:33:30 -- json_config/json_config.sh@31 -- # declare -A app_pid 00:04:32.439 15:33:30 -- json_config/json_config.sh@32 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:04:32.439 15:33:30 -- json_config/json_config.sh@32 -- # declare -A app_socket 00:04:32.439 15:33:30 -- json_config/json_config.sh@33 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:04:32.439 15:33:30 -- json_config/json_config.sh@33 -- # declare -A app_params 00:04:32.439 15:33:30 -- json_config/json_config.sh@34 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_initiator_config.json') 00:04:32.439 15:33:30 -- json_config/json_config.sh@34 -- # declare -A configs_path 00:04:32.439 15:33:30 -- json_config/json_config.sh@40 -- # last_event_id=0 00:04:32.439 15:33:30 -- json_config/json_config.sh@355 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:32.439 15:33:30 -- json_config/json_config.sh@356 -- # echo 'INFO: JSON configuration test init' 00:04:32.439 INFO: JSON configuration test init 00:04:32.439 15:33:30 -- json_config/json_config.sh@357 -- # json_config_test_init 00:04:32.439 15:33:30 -- json_config/json_config.sh@262 -- # timing_enter json_config_test_init 00:04:32.439 15:33:30 -- common/autotest_common.sh@710 -- # xtrace_disable 00:04:32.439 15:33:30 -- common/autotest_common.sh@10 -- # set +x 00:04:32.439 15:33:30 -- json_config/json_config.sh@263 -- # timing_enter json_config_setup_target 00:04:32.439 15:33:30 -- common/autotest_common.sh@710 -- # xtrace_disable 00:04:32.439 15:33:30 -- common/autotest_common.sh@10 -- # set +x 00:04:32.439 15:33:30 -- json_config/json_config.sh@265 -- # json_config_test_start_app target --wait-for-rpc 00:04:32.439 15:33:30 -- json_config/common.sh@9 -- # local app=target 00:04:32.439 15:33:30 -- json_config/common.sh@10 -- # shift 00:04:32.439 15:33:30 -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:04:32.439 15:33:30 -- json_config/common.sh@13 -- # [[ -z '' ]] 00:04:32.439 15:33:30 -- json_config/common.sh@15 -- # local app_extra_params= 00:04:32.439 15:33:30 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:04:32.439 15:33:30 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:04:32.439 15:33:30 -- json_config/common.sh@22 -- # app_pid["$app"]=3156626 00:04:32.439 15:33:30 -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:04:32.439 Waiting for target to run... 00:04:32.439 15:33:30 -- json_config/common.sh@25 -- # waitforlisten 3156626 /var/tmp/spdk_tgt.sock 00:04:32.439 15:33:30 -- common/autotest_common.sh@817 -- # '[' -z 3156626 ']' 00:04:32.439 15:33:30 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:32.439 15:33:30 -- common/autotest_common.sh@822 -- # local max_retries=100 00:04:32.439 15:33:30 -- json_config/common.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:04:32.439 15:33:30 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:32.439 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:32.439 15:33:30 -- common/autotest_common.sh@826 -- # xtrace_disable 00:04:32.439 15:33:30 -- common/autotest_common.sh@10 -- # set +x 00:04:32.439 [2024-04-26 15:33:30.889476] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:04:32.439 [2024-04-26 15:33:30.889527] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3156626 ] 00:04:32.439 EAL: No free 2048 kB hugepages reported on node 1 00:04:32.699 [2024-04-26 15:33:31.151970] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:32.699 [2024-04-26 15:33:31.216800] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:33.266 15:33:31 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:04:33.266 15:33:31 -- common/autotest_common.sh@850 -- # return 0 00:04:33.266 15:33:31 -- json_config/common.sh@26 -- # echo '' 00:04:33.266 00:04:33.266 15:33:31 -- json_config/json_config.sh@269 -- # create_accel_config 00:04:33.266 15:33:31 -- json_config/json_config.sh@93 -- # timing_enter create_accel_config 00:04:33.266 15:33:31 -- common/autotest_common.sh@710 -- # xtrace_disable 00:04:33.266 15:33:31 -- common/autotest_common.sh@10 -- # set +x 00:04:33.266 15:33:31 -- json_config/json_config.sh@95 -- # [[ 0 -eq 1 ]] 00:04:33.266 15:33:31 -- json_config/json_config.sh@101 -- # timing_exit create_accel_config 00:04:33.266 15:33:31 -- common/autotest_common.sh@716 -- # xtrace_disable 00:04:33.266 15:33:31 -- common/autotest_common.sh@10 -- # set +x 00:04:33.266 15:33:31 -- json_config/json_config.sh@273 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:04:33.266 15:33:31 -- json_config/json_config.sh@274 -- # tgt_rpc load_config 00:04:33.266 15:33:31 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:04:36.553 15:33:34 -- json_config/json_config.sh@276 -- # tgt_check_notification_types 00:04:36.553 15:33:34 -- json_config/json_config.sh@43 -- # timing_enter tgt_check_notification_types 00:04:36.553 15:33:34 -- common/autotest_common.sh@710 -- # xtrace_disable 00:04:36.553 15:33:34 -- common/autotest_common.sh@10 -- # set +x 00:04:36.553 15:33:34 -- json_config/json_config.sh@45 -- # local ret=0 00:04:36.553 15:33:34 -- json_config/json_config.sh@46 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:04:36.553 15:33:34 -- json_config/json_config.sh@46 -- # local enabled_types 00:04:36.553 15:33:34 -- json_config/json_config.sh@48 -- # tgt_rpc notify_get_types 00:04:36.553 15:33:34 -- json_config/json_config.sh@48 -- # jq -r '.[]' 00:04:36.553 15:33:34 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:04:36.553 15:33:34 -- json_config/json_config.sh@48 -- # get_types=('bdev_register' 'bdev_unregister') 00:04:36.553 15:33:34 -- json_config/json_config.sh@48 -- # local get_types 00:04:36.553 15:33:34 -- json_config/json_config.sh@49 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:04:36.553 15:33:34 -- json_config/json_config.sh@54 -- # timing_exit tgt_check_notification_types 00:04:36.553 15:33:34 -- common/autotest_common.sh@716 -- # xtrace_disable 00:04:36.553 15:33:34 -- common/autotest_common.sh@10 -- # set +x 00:04:36.553 15:33:34 -- json_config/json_config.sh@55 -- # return 0 00:04:36.553 15:33:34 -- json_config/json_config.sh@278 -- # [[ 0 -eq 1 ]] 00:04:36.553 15:33:34 -- json_config/json_config.sh@282 -- # [[ 0 -eq 1 ]] 00:04:36.553 15:33:34 -- json_config/json_config.sh@286 -- # [[ 0 -eq 1 ]] 00:04:36.553 15:33:34 -- json_config/json_config.sh@290 -- # [[ 1 -eq 1 ]] 00:04:36.553 15:33:34 -- json_config/json_config.sh@291 -- # create_nvmf_subsystem_config 00:04:36.553 15:33:34 -- json_config/json_config.sh@230 -- # timing_enter create_nvmf_subsystem_config 00:04:36.553 15:33:34 -- common/autotest_common.sh@710 -- # xtrace_disable 00:04:36.553 15:33:34 -- common/autotest_common.sh@10 -- # set +x 00:04:36.553 15:33:34 -- json_config/json_config.sh@232 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:04:36.553 15:33:34 -- json_config/json_config.sh@233 -- # [[ rdma == \r\d\m\a ]] 00:04:36.553 15:33:34 -- json_config/json_config.sh@234 -- # TEST_TRANSPORT=rdma 00:04:36.553 15:33:34 -- json_config/json_config.sh@234 -- # nvmftestinit 00:04:36.553 15:33:34 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:04:36.553 15:33:34 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:04:36.553 15:33:34 -- nvmf/common.sh@437 -- # prepare_net_devs 00:04:36.553 15:33:34 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:04:36.553 15:33:34 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:04:36.553 15:33:34 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:04:36.553 15:33:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:04:36.553 15:33:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:04:36.553 15:33:35 -- nvmf/common.sh@403 -- # [[ phy-fallback != virt ]] 00:04:36.553 15:33:35 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:04:36.553 15:33:35 -- nvmf/common.sh@285 -- # xtrace_disable 00:04:36.553 15:33:35 -- common/autotest_common.sh@10 -- # set +x 00:04:41.820 15:33:40 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:04:41.820 15:33:40 -- nvmf/common.sh@291 -- # pci_devs=() 00:04:41.820 15:33:40 -- nvmf/common.sh@291 -- # local -a pci_devs 00:04:41.820 15:33:40 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:04:41.820 15:33:40 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:04:41.820 15:33:40 -- nvmf/common.sh@293 -- # pci_drivers=() 00:04:41.820 15:33:40 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:04:41.820 15:33:40 -- nvmf/common.sh@295 -- # net_devs=() 00:04:41.820 15:33:40 -- nvmf/common.sh@295 -- # local -ga net_devs 00:04:41.820 15:33:40 -- nvmf/common.sh@296 -- # e810=() 00:04:41.820 15:33:40 -- nvmf/common.sh@296 -- # local -ga e810 00:04:41.820 15:33:40 -- nvmf/common.sh@297 -- # x722=() 00:04:41.820 15:33:40 -- nvmf/common.sh@297 -- # local -ga x722 00:04:41.820 15:33:40 -- nvmf/common.sh@298 -- # mlx=() 00:04:41.820 15:33:40 -- nvmf/common.sh@298 -- # local -ga mlx 00:04:41.820 15:33:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:04:41.820 15:33:40 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:04:41.820 15:33:40 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:04:41.820 15:33:40 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:04:41.820 15:33:40 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:04:41.820 15:33:40 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:04:41.820 15:33:40 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:04:41.821 15:33:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:04:41.821 15:33:40 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:04:41.821 15:33:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:04:41.821 15:33:40 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:04:41.821 15:33:40 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:04:41.821 15:33:40 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:04:41.821 15:33:40 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:04:41.821 15:33:40 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:04:41.821 15:33:40 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:04:41.821 15:33:40 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:04:41.821 15:33:40 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:04:41.821 15:33:40 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:04:41.821 15:33:40 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:04:41.821 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:04:41.821 15:33:40 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:04:41.821 15:33:40 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:04:41.821 15:33:40 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:04:41.821 15:33:40 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:04:41.821 15:33:40 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:04:41.821 15:33:40 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:04:41.821 15:33:40 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:04:41.821 15:33:40 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:04:41.821 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:04:41.821 15:33:40 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:04:41.821 15:33:40 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:04:41.821 15:33:40 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:04:41.821 15:33:40 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:04:41.821 15:33:40 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:04:41.821 15:33:40 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:04:41.821 15:33:40 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:04:41.821 15:33:40 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:04:41.821 15:33:40 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:04:41.821 15:33:40 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:04:41.821 15:33:40 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:04:41.821 15:33:40 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:04:41.821 15:33:40 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:04:41.821 Found net devices under 0000:da:00.0: mlx_0_0 00:04:41.821 15:33:40 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:04:41.821 15:33:40 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:04:41.821 15:33:40 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:04:41.821 15:33:40 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:04:41.821 15:33:40 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:04:41.821 15:33:40 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:04:41.821 Found net devices under 0000:da:00.1: mlx_0_1 00:04:41.821 15:33:40 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:04:41.821 15:33:40 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:04:41.821 15:33:40 -- nvmf/common.sh@403 -- # is_hw=yes 00:04:41.821 15:33:40 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:04:41.821 15:33:40 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:04:41.821 15:33:40 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:04:41.821 15:33:40 -- nvmf/common.sh@409 -- # rdma_device_init 00:04:41.821 15:33:40 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:04:41.821 15:33:40 -- nvmf/common.sh@58 -- # uname 00:04:41.821 15:33:40 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:04:41.821 15:33:40 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:04:41.821 15:33:40 -- nvmf/common.sh@63 -- # modprobe ib_core 00:04:41.821 15:33:40 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:04:41.821 15:33:40 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:04:41.821 15:33:40 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:04:41.821 15:33:40 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:04:41.821 15:33:40 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:04:41.821 15:33:40 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:04:41.821 15:33:40 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:04:41.821 15:33:40 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:04:41.821 15:33:40 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:04:41.821 15:33:40 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:04:41.821 15:33:40 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:04:41.821 15:33:40 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:04:41.821 15:33:40 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:04:41.821 15:33:40 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:04:41.821 15:33:40 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:04:41.821 15:33:40 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:04:41.821 15:33:40 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:04:41.821 15:33:40 -- nvmf/common.sh@105 -- # continue 2 00:04:41.821 15:33:40 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:04:41.821 15:33:40 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:04:41.821 15:33:40 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:04:41.821 15:33:40 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:04:41.821 15:33:40 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:04:41.821 15:33:40 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:04:41.821 15:33:40 -- nvmf/common.sh@105 -- # continue 2 00:04:41.821 15:33:40 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:04:41.821 15:33:40 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:04:41.821 15:33:40 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:04:41.821 15:33:40 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:04:41.821 15:33:40 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:04:41.821 15:33:40 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:04:41.821 15:33:40 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:04:41.821 15:33:40 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:04:41.821 15:33:40 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:04:41.821 118: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:04:41.821 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:04:41.821 altname enp218s0f0np0 00:04:41.821 altname ens818f0np0 00:04:41.821 inet 192.168.100.8/24 scope global mlx_0_0 00:04:41.821 valid_lft forever preferred_lft forever 00:04:41.821 15:33:40 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:04:41.821 15:33:40 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:04:41.821 15:33:40 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:04:41.821 15:33:40 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:04:41.821 15:33:40 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:04:41.821 15:33:40 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:04:41.821 15:33:40 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:04:41.821 15:33:40 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:04:41.821 15:33:40 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:04:41.821 119: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:04:41.821 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:04:41.821 altname enp218s0f1np1 00:04:41.821 altname ens818f1np1 00:04:41.821 inet 192.168.100.9/24 scope global mlx_0_1 00:04:41.821 valid_lft forever preferred_lft forever 00:04:41.821 15:33:40 -- nvmf/common.sh@411 -- # return 0 00:04:41.821 15:33:40 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:04:41.821 15:33:40 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:04:41.821 15:33:40 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:04:41.821 15:33:40 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:04:41.821 15:33:40 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:04:41.821 15:33:40 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:04:41.821 15:33:40 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:04:42.081 15:33:40 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:04:42.081 15:33:40 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:04:42.081 15:33:40 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:04:42.081 15:33:40 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:04:42.081 15:33:40 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:04:42.081 15:33:40 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:04:42.081 15:33:40 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:04:42.081 15:33:40 -- nvmf/common.sh@105 -- # continue 2 00:04:42.081 15:33:40 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:04:42.081 15:33:40 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:04:42.081 15:33:40 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:04:42.081 15:33:40 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:04:42.081 15:33:40 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:04:42.081 15:33:40 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:04:42.081 15:33:40 -- nvmf/common.sh@105 -- # continue 2 00:04:42.081 15:33:40 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:04:42.081 15:33:40 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:04:42.081 15:33:40 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:04:42.081 15:33:40 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:04:42.081 15:33:40 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:04:42.081 15:33:40 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:04:42.081 15:33:40 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:04:42.081 15:33:40 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:04:42.081 15:33:40 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:04:42.081 15:33:40 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:04:42.081 15:33:40 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:04:42.081 15:33:40 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:04:42.081 15:33:40 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:04:42.081 192.168.100.9' 00:04:42.081 15:33:40 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:04:42.081 192.168.100.9' 00:04:42.081 15:33:40 -- nvmf/common.sh@446 -- # head -n 1 00:04:42.081 15:33:40 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:04:42.081 15:33:40 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:04:42.081 192.168.100.9' 00:04:42.081 15:33:40 -- nvmf/common.sh@447 -- # tail -n +2 00:04:42.081 15:33:40 -- nvmf/common.sh@447 -- # head -n 1 00:04:42.081 15:33:40 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:04:42.081 15:33:40 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:04:42.081 15:33:40 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:04:42.081 15:33:40 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:04:42.081 15:33:40 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:04:42.081 15:33:40 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:04:42.081 15:33:40 -- json_config/json_config.sh@237 -- # [[ -z 192.168.100.8 ]] 00:04:42.081 15:33:40 -- json_config/json_config.sh@242 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:42.081 15:33:40 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:42.081 MallocForNvmf0 00:04:42.081 15:33:40 -- json_config/json_config.sh@243 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:42.081 15:33:40 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:42.339 MallocForNvmf1 00:04:42.339 15:33:40 -- json_config/json_config.sh@245 -- # tgt_rpc nvmf_create_transport -t rdma -u 8192 -c 0 00:04:42.339 15:33:40 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t rdma -u 8192 -c 0 00:04:42.598 [2024-04-26 15:33:41.002867] rdma.c:2712:nvmf_rdma_create: *WARNING*: In capsule data size is set to 256, this is minimum size required to support msdbd=16 00:04:42.598 [2024-04-26 15:33:41.034806] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x2210db0/0x235df00) succeed. 00:04:42.598 [2024-04-26 15:33:41.046320] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x2212fa0/0x22bde00) succeed. 00:04:42.598 15:33:41 -- json_config/json_config.sh@246 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:42.598 15:33:41 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:42.856 15:33:41 -- json_config/json_config.sh@247 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:42.856 15:33:41 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:42.856 15:33:41 -- json_config/json_config.sh@248 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:42.856 15:33:41 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:43.114 15:33:41 -- json_config/json_config.sh@249 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:04:43.114 15:33:41 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:04:43.114 [2024-04-26 15:33:41.673938] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:04:43.114 15:33:41 -- json_config/json_config.sh@251 -- # timing_exit create_nvmf_subsystem_config 00:04:43.114 15:33:41 -- common/autotest_common.sh@716 -- # xtrace_disable 00:04:43.114 15:33:41 -- common/autotest_common.sh@10 -- # set +x 00:04:43.373 15:33:41 -- json_config/json_config.sh@293 -- # timing_exit json_config_setup_target 00:04:43.373 15:33:41 -- common/autotest_common.sh@716 -- # xtrace_disable 00:04:43.373 15:33:41 -- common/autotest_common.sh@10 -- # set +x 00:04:43.373 15:33:41 -- json_config/json_config.sh@295 -- # [[ 0 -eq 1 ]] 00:04:43.373 15:33:41 -- json_config/json_config.sh@300 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:43.373 15:33:41 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:43.373 MallocBdevForConfigChangeCheck 00:04:43.373 15:33:41 -- json_config/json_config.sh@302 -- # timing_exit json_config_test_init 00:04:43.373 15:33:41 -- common/autotest_common.sh@716 -- # xtrace_disable 00:04:43.373 15:33:41 -- common/autotest_common.sh@10 -- # set +x 00:04:43.373 15:33:41 -- json_config/json_config.sh@359 -- # tgt_rpc save_config 00:04:43.373 15:33:41 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:43.940 15:33:42 -- json_config/json_config.sh@361 -- # echo 'INFO: shutting down applications...' 00:04:43.940 INFO: shutting down applications... 00:04:43.940 15:33:42 -- json_config/json_config.sh@362 -- # [[ 0 -eq 1 ]] 00:04:43.940 15:33:42 -- json_config/json_config.sh@368 -- # json_config_clear target 00:04:43.940 15:33:42 -- json_config/json_config.sh@332 -- # [[ -n 22 ]] 00:04:43.940 15:33:42 -- json_config/json_config.sh@333 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:04:45.903 Calling clear_iscsi_subsystem 00:04:45.903 Calling clear_nvmf_subsystem 00:04:45.903 Calling clear_nbd_subsystem 00:04:45.903 Calling clear_ublk_subsystem 00:04:45.903 Calling clear_vhost_blk_subsystem 00:04:45.903 Calling clear_vhost_scsi_subsystem 00:04:45.903 Calling clear_bdev_subsystem 00:04:45.903 15:33:44 -- json_config/json_config.sh@337 -- # local config_filter=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py 00:04:45.903 15:33:44 -- json_config/json_config.sh@343 -- # count=100 00:04:45.903 15:33:44 -- json_config/json_config.sh@344 -- # '[' 100 -gt 0 ']' 00:04:45.903 15:33:44 -- json_config/json_config.sh@345 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:45.903 15:33:44 -- json_config/json_config.sh@345 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:04:45.903 15:33:44 -- json_config/json_config.sh@345 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:04:46.162 15:33:44 -- json_config/json_config.sh@345 -- # break 00:04:46.162 15:33:44 -- json_config/json_config.sh@350 -- # '[' 100 -eq 0 ']' 00:04:46.162 15:33:44 -- json_config/json_config.sh@369 -- # json_config_test_shutdown_app target 00:04:46.162 15:33:44 -- json_config/common.sh@31 -- # local app=target 00:04:46.162 15:33:44 -- json_config/common.sh@34 -- # [[ -n 22 ]] 00:04:46.162 15:33:44 -- json_config/common.sh@35 -- # [[ -n 3156626 ]] 00:04:46.162 15:33:44 -- json_config/common.sh@38 -- # kill -SIGINT 3156626 00:04:46.162 15:33:44 -- json_config/common.sh@40 -- # (( i = 0 )) 00:04:46.162 15:33:44 -- json_config/common.sh@40 -- # (( i < 30 )) 00:04:46.162 15:33:44 -- json_config/common.sh@41 -- # kill -0 3156626 00:04:46.162 15:33:44 -- json_config/common.sh@45 -- # sleep 0.5 00:04:46.421 [2024-04-26 15:33:44.838052] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:04:46.679 15:33:45 -- json_config/common.sh@40 -- # (( i++ )) 00:04:46.679 15:33:45 -- json_config/common.sh@40 -- # (( i < 30 )) 00:04:46.679 15:33:45 -- json_config/common.sh@41 -- # kill -0 3156626 00:04:46.679 15:33:45 -- json_config/common.sh@42 -- # app_pid["$app"]= 00:04:46.679 15:33:45 -- json_config/common.sh@43 -- # break 00:04:46.679 15:33:45 -- json_config/common.sh@48 -- # [[ -n '' ]] 00:04:46.679 15:33:45 -- json_config/common.sh@53 -- # echo 'SPDK target shutdown done' 00:04:46.679 SPDK target shutdown done 00:04:46.679 15:33:45 -- json_config/json_config.sh@371 -- # echo 'INFO: relaunching applications...' 00:04:46.679 INFO: relaunching applications... 00:04:46.679 15:33:45 -- json_config/json_config.sh@372 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:04:46.679 15:33:45 -- json_config/common.sh@9 -- # local app=target 00:04:46.679 15:33:45 -- json_config/common.sh@10 -- # shift 00:04:46.679 15:33:45 -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:04:46.679 15:33:45 -- json_config/common.sh@13 -- # [[ -z '' ]] 00:04:46.679 15:33:45 -- json_config/common.sh@15 -- # local app_extra_params= 00:04:46.680 15:33:45 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:04:46.680 15:33:45 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:04:46.680 15:33:45 -- json_config/common.sh@22 -- # app_pid["$app"]=3161152 00:04:46.680 15:33:45 -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:04:46.680 Waiting for target to run... 00:04:46.680 15:33:45 -- json_config/common.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:04:46.680 15:33:45 -- json_config/common.sh@25 -- # waitforlisten 3161152 /var/tmp/spdk_tgt.sock 00:04:46.680 15:33:45 -- common/autotest_common.sh@817 -- # '[' -z 3161152 ']' 00:04:46.680 15:33:45 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:46.680 15:33:45 -- common/autotest_common.sh@822 -- # local max_retries=100 00:04:46.680 15:33:45 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:46.680 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:46.680 15:33:45 -- common/autotest_common.sh@826 -- # xtrace_disable 00:04:46.680 15:33:45 -- common/autotest_common.sh@10 -- # set +x 00:04:46.680 [2024-04-26 15:33:45.279103] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:04:46.680 [2024-04-26 15:33:45.279155] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3161152 ] 00:04:46.939 EAL: No free 2048 kB hugepages reported on node 1 00:04:47.198 [2024-04-26 15:33:45.545619] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:47.198 [2024-04-26 15:33:45.610199] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:50.484 [2024-04-26 15:33:48.635642] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xf33c30/0xf60280) succeed. 00:04:50.484 [2024-04-26 15:33:48.646475] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xf35e20/0xfc0280) succeed. 00:04:50.484 [2024-04-26 15:33:48.700728] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:04:50.484 15:33:48 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:04:50.484 15:33:48 -- common/autotest_common.sh@850 -- # return 0 00:04:50.484 15:33:48 -- json_config/common.sh@26 -- # echo '' 00:04:50.484 00:04:50.484 15:33:48 -- json_config/json_config.sh@373 -- # [[ 0 -eq 1 ]] 00:04:50.484 15:33:48 -- json_config/json_config.sh@377 -- # echo 'INFO: Checking if target configuration is the same...' 00:04:50.484 INFO: Checking if target configuration is the same... 00:04:50.484 15:33:48 -- json_config/json_config.sh@378 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:04:50.484 15:33:48 -- json_config/json_config.sh@378 -- # tgt_rpc save_config 00:04:50.484 15:33:48 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:50.484 + '[' 2 -ne 2 ']' 00:04:50.484 +++ dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:50.484 ++ readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/../.. 00:04:50.484 + rootdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:04:50.484 +++ basename /dev/fd/62 00:04:50.484 ++ mktemp /tmp/62.XXX 00:04:50.484 + tmp_file_1=/tmp/62.Njp 00:04:50.484 +++ basename /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:04:50.484 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:50.484 + tmp_file_2=/tmp/spdk_tgt_config.json.KgD 00:04:50.484 + ret=0 00:04:50.484 + /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:50.484 + /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:50.484 + diff -u /tmp/62.Njp /tmp/spdk_tgt_config.json.KgD 00:04:50.484 + echo 'INFO: JSON config files are the same' 00:04:50.484 INFO: JSON config files are the same 00:04:50.484 + rm /tmp/62.Njp /tmp/spdk_tgt_config.json.KgD 00:04:50.484 + exit 0 00:04:50.484 15:33:49 -- json_config/json_config.sh@379 -- # [[ 0 -eq 1 ]] 00:04:50.484 15:33:49 -- json_config/json_config.sh@384 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:04:50.484 INFO: changing configuration and checking if this can be detected... 00:04:50.484 15:33:49 -- json_config/json_config.sh@386 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:50.484 15:33:49 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:50.743 15:33:49 -- json_config/json_config.sh@387 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:04:50.743 15:33:49 -- json_config/json_config.sh@387 -- # tgt_rpc save_config 00:04:50.743 15:33:49 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:50.743 + '[' 2 -ne 2 ']' 00:04:50.743 +++ dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:50.743 ++ readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/../.. 00:04:50.743 + rootdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:04:50.743 +++ basename /dev/fd/62 00:04:50.743 ++ mktemp /tmp/62.XXX 00:04:50.743 + tmp_file_1=/tmp/62.FmX 00:04:50.743 +++ basename /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:04:50.743 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:50.743 + tmp_file_2=/tmp/spdk_tgt_config.json.yy9 00:04:50.743 + ret=0 00:04:50.743 + /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:51.002 + /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:51.002 + diff -u /tmp/62.FmX /tmp/spdk_tgt_config.json.yy9 00:04:51.002 + ret=1 00:04:51.002 + echo '=== Start of file: /tmp/62.FmX ===' 00:04:51.002 + cat /tmp/62.FmX 00:04:51.002 + echo '=== End of file: /tmp/62.FmX ===' 00:04:51.002 + echo '' 00:04:51.002 + echo '=== Start of file: /tmp/spdk_tgt_config.json.yy9 ===' 00:04:51.002 + cat /tmp/spdk_tgt_config.json.yy9 00:04:51.002 + echo '=== End of file: /tmp/spdk_tgt_config.json.yy9 ===' 00:04:51.002 + echo '' 00:04:51.002 + rm /tmp/62.FmX /tmp/spdk_tgt_config.json.yy9 00:04:51.261 + exit 1 00:04:51.261 15:33:49 -- json_config/json_config.sh@391 -- # echo 'INFO: configuration change detected.' 00:04:51.261 INFO: configuration change detected. 00:04:51.261 15:33:49 -- json_config/json_config.sh@394 -- # json_config_test_fini 00:04:51.261 15:33:49 -- json_config/json_config.sh@306 -- # timing_enter json_config_test_fini 00:04:51.261 15:33:49 -- common/autotest_common.sh@710 -- # xtrace_disable 00:04:51.261 15:33:49 -- common/autotest_common.sh@10 -- # set +x 00:04:51.261 15:33:49 -- json_config/json_config.sh@307 -- # local ret=0 00:04:51.261 15:33:49 -- json_config/json_config.sh@309 -- # [[ -n '' ]] 00:04:51.261 15:33:49 -- json_config/json_config.sh@317 -- # [[ -n 3161152 ]] 00:04:51.261 15:33:49 -- json_config/json_config.sh@320 -- # cleanup_bdev_subsystem_config 00:04:51.261 15:33:49 -- json_config/json_config.sh@184 -- # timing_enter cleanup_bdev_subsystem_config 00:04:51.261 15:33:49 -- common/autotest_common.sh@710 -- # xtrace_disable 00:04:51.261 15:33:49 -- common/autotest_common.sh@10 -- # set +x 00:04:51.261 15:33:49 -- json_config/json_config.sh@186 -- # [[ 0 -eq 1 ]] 00:04:51.261 15:33:49 -- json_config/json_config.sh@193 -- # uname -s 00:04:51.261 15:33:49 -- json_config/json_config.sh@193 -- # [[ Linux = Linux ]] 00:04:51.261 15:33:49 -- json_config/json_config.sh@194 -- # rm -f /sample_aio 00:04:51.261 15:33:49 -- json_config/json_config.sh@197 -- # [[ 0 -eq 1 ]] 00:04:51.261 15:33:49 -- json_config/json_config.sh@201 -- # timing_exit cleanup_bdev_subsystem_config 00:04:51.261 15:33:49 -- common/autotest_common.sh@716 -- # xtrace_disable 00:04:51.261 15:33:49 -- common/autotest_common.sh@10 -- # set +x 00:04:51.261 15:33:49 -- json_config/json_config.sh@323 -- # killprocess 3161152 00:04:51.261 15:33:49 -- common/autotest_common.sh@936 -- # '[' -z 3161152 ']' 00:04:51.261 15:33:49 -- common/autotest_common.sh@940 -- # kill -0 3161152 00:04:51.261 15:33:49 -- common/autotest_common.sh@941 -- # uname 00:04:51.261 15:33:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:51.261 15:33:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3161152 00:04:51.261 15:33:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:51.261 15:33:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:51.261 15:33:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3161152' 00:04:51.261 killing process with pid 3161152 00:04:51.261 15:33:49 -- common/autotest_common.sh@955 -- # kill 3161152 00:04:51.261 15:33:49 -- common/autotest_common.sh@960 -- # wait 3161152 00:04:51.261 [2024-04-26 15:33:49.819480] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:04:53.794 15:33:51 -- json_config/json_config.sh@326 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:04:53.794 15:33:51 -- json_config/json_config.sh@327 -- # timing_exit json_config_test_fini 00:04:53.794 15:33:51 -- common/autotest_common.sh@716 -- # xtrace_disable 00:04:53.794 15:33:51 -- common/autotest_common.sh@10 -- # set +x 00:04:53.794 15:33:51 -- json_config/json_config.sh@328 -- # return 0 00:04:53.794 15:33:51 -- json_config/json_config.sh@396 -- # echo 'INFO: Success' 00:04:53.794 INFO: Success 00:04:53.794 15:33:51 -- json_config/json_config.sh@1 -- # nvmftestfini 00:04:53.794 15:33:51 -- nvmf/common.sh@477 -- # nvmfcleanup 00:04:53.794 15:33:51 -- nvmf/common.sh@117 -- # sync 00:04:53.795 15:33:51 -- nvmf/common.sh@119 -- # '[' '' == tcp ']' 00:04:53.795 15:33:51 -- nvmf/common.sh@119 -- # '[' '' == rdma ']' 00:04:53.795 15:33:51 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:04:53.795 15:33:51 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:04:53.795 15:33:51 -- nvmf/common.sh@484 -- # [[ '' == \t\c\p ]] 00:04:53.795 00:04:53.795 real 0m21.195s 00:04:53.795 user 0m23.353s 00:04:53.795 sys 0m5.833s 00:04:53.795 15:33:51 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:53.795 15:33:51 -- common/autotest_common.sh@10 -- # set +x 00:04:53.795 ************************************ 00:04:53.795 END TEST json_config 00:04:53.795 ************************************ 00:04:53.795 15:33:51 -- spdk/autotest.sh@169 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:53.795 15:33:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:53.795 15:33:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:53.795 15:33:51 -- common/autotest_common.sh@10 -- # set +x 00:04:53.795 ************************************ 00:04:53.795 START TEST json_config_extra_key 00:04:53.795 ************************************ 00:04:53.795 15:33:52 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:53.795 15:33:52 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:04:53.795 15:33:52 -- nvmf/common.sh@7 -- # uname -s 00:04:53.795 15:33:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:53.795 15:33:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:53.795 15:33:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:53.795 15:33:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:53.795 15:33:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:53.795 15:33:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:53.795 15:33:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:53.795 15:33:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:53.795 15:33:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:53.795 15:33:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:53.795 15:33:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:04:53.795 15:33:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:04:53.795 15:33:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:53.795 15:33:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:53.795 15:33:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:53.795 15:33:52 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:04:53.795 15:33:52 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:04:53.795 15:33:52 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:53.795 15:33:52 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:53.795 15:33:52 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:53.795 15:33:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:53.795 15:33:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:53.795 15:33:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:53.795 15:33:52 -- paths/export.sh@5 -- # export PATH 00:04:53.795 15:33:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:53.795 15:33:52 -- nvmf/common.sh@47 -- # : 0 00:04:53.795 15:33:52 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:04:53.795 15:33:52 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:04:53.795 15:33:52 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:04:53.795 15:33:52 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:53.795 15:33:52 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:53.795 15:33:52 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:04:53.795 15:33:52 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:04:53.795 15:33:52 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:04:53.795 15:33:52 -- json_config/json_config_extra_key.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/common.sh 00:04:53.795 15:33:52 -- json_config/json_config_extra_key.sh@17 -- # app_pid=(['target']='') 00:04:53.795 15:33:52 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_pid 00:04:53.795 15:33:52 -- json_config/json_config_extra_key.sh@18 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:04:53.795 15:33:52 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_socket 00:04:53.795 15:33:52 -- json_config/json_config_extra_key.sh@19 -- # app_params=(['target']='-m 0x1 -s 1024') 00:04:53.795 15:33:52 -- json_config/json_config_extra_key.sh@19 -- # declare -A app_params 00:04:53.795 15:33:52 -- json_config/json_config_extra_key.sh@20 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/extra_key.json') 00:04:53.795 15:33:52 -- json_config/json_config_extra_key.sh@20 -- # declare -A configs_path 00:04:53.795 15:33:52 -- json_config/json_config_extra_key.sh@22 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:53.795 15:33:52 -- json_config/json_config_extra_key.sh@24 -- # echo 'INFO: launching applications...' 00:04:53.795 INFO: launching applications... 00:04:53.795 15:33:52 -- json_config/json_config_extra_key.sh@25 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/extra_key.json 00:04:53.795 15:33:52 -- json_config/common.sh@9 -- # local app=target 00:04:53.795 15:33:52 -- json_config/common.sh@10 -- # shift 00:04:53.795 15:33:52 -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:04:53.795 15:33:52 -- json_config/common.sh@13 -- # [[ -z '' ]] 00:04:53.795 15:33:52 -- json_config/common.sh@15 -- # local app_extra_params= 00:04:53.795 15:33:52 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:04:53.795 15:33:52 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:04:53.795 15:33:52 -- json_config/common.sh@22 -- # app_pid["$app"]=3162424 00:04:53.795 15:33:52 -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:04:53.795 Waiting for target to run... 00:04:53.795 15:33:52 -- json_config/common.sh@25 -- # waitforlisten 3162424 /var/tmp/spdk_tgt.sock 00:04:53.795 15:33:52 -- common/autotest_common.sh@817 -- # '[' -z 3162424 ']' 00:04:53.795 15:33:52 -- json_config/common.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/extra_key.json 00:04:53.795 15:33:52 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:53.795 15:33:52 -- common/autotest_common.sh@822 -- # local max_retries=100 00:04:53.795 15:33:52 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:53.795 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:53.795 15:33:52 -- common/autotest_common.sh@826 -- # xtrace_disable 00:04:53.795 15:33:52 -- common/autotest_common.sh@10 -- # set +x 00:04:53.795 [2024-04-26 15:33:52.234569] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:04:53.795 [2024-04-26 15:33:52.234613] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3162424 ] 00:04:53.795 EAL: No free 2048 kB hugepages reported on node 1 00:04:54.054 [2024-04-26 15:33:52.501948] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:54.054 [2024-04-26 15:33:52.570866] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:54.622 15:33:53 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:04:54.622 15:33:53 -- common/autotest_common.sh@850 -- # return 0 00:04:54.622 15:33:53 -- json_config/common.sh@26 -- # echo '' 00:04:54.622 00:04:54.622 15:33:53 -- json_config/json_config_extra_key.sh@27 -- # echo 'INFO: shutting down applications...' 00:04:54.622 INFO: shutting down applications... 00:04:54.622 15:33:53 -- json_config/json_config_extra_key.sh@28 -- # json_config_test_shutdown_app target 00:04:54.622 15:33:53 -- json_config/common.sh@31 -- # local app=target 00:04:54.622 15:33:53 -- json_config/common.sh@34 -- # [[ -n 22 ]] 00:04:54.622 15:33:53 -- json_config/common.sh@35 -- # [[ -n 3162424 ]] 00:04:54.623 15:33:53 -- json_config/common.sh@38 -- # kill -SIGINT 3162424 00:04:54.623 15:33:53 -- json_config/common.sh@40 -- # (( i = 0 )) 00:04:54.623 15:33:53 -- json_config/common.sh@40 -- # (( i < 30 )) 00:04:54.623 15:33:53 -- json_config/common.sh@41 -- # kill -0 3162424 00:04:54.623 15:33:53 -- json_config/common.sh@45 -- # sleep 0.5 00:04:55.191 15:33:53 -- json_config/common.sh@40 -- # (( i++ )) 00:04:55.191 15:33:53 -- json_config/common.sh@40 -- # (( i < 30 )) 00:04:55.191 15:33:53 -- json_config/common.sh@41 -- # kill -0 3162424 00:04:55.191 15:33:53 -- json_config/common.sh@42 -- # app_pid["$app"]= 00:04:55.191 15:33:53 -- json_config/common.sh@43 -- # break 00:04:55.191 15:33:53 -- json_config/common.sh@48 -- # [[ -n '' ]] 00:04:55.191 15:33:53 -- json_config/common.sh@53 -- # echo 'SPDK target shutdown done' 00:04:55.191 SPDK target shutdown done 00:04:55.191 15:33:53 -- json_config/json_config_extra_key.sh@30 -- # echo Success 00:04:55.191 Success 00:04:55.191 00:04:55.191 real 0m1.411s 00:04:55.191 user 0m1.212s 00:04:55.191 sys 0m0.352s 00:04:55.191 15:33:53 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:55.191 15:33:53 -- common/autotest_common.sh@10 -- # set +x 00:04:55.191 ************************************ 00:04:55.191 END TEST json_config_extra_key 00:04:55.191 ************************************ 00:04:55.192 15:33:53 -- spdk/autotest.sh@170 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:55.192 15:33:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:55.192 15:33:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:55.192 15:33:53 -- common/autotest_common.sh@10 -- # set +x 00:04:55.192 ************************************ 00:04:55.192 START TEST alias_rpc 00:04:55.192 ************************************ 00:04:55.192 15:33:53 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:55.192 * Looking for test storage... 00:04:55.192 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/alias_rpc 00:04:55.192 15:33:53 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:04:55.192 15:33:53 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=3162780 00:04:55.192 15:33:53 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 3162780 00:04:55.192 15:33:53 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:04:55.192 15:33:53 -- common/autotest_common.sh@817 -- # '[' -z 3162780 ']' 00:04:55.192 15:33:53 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:55.192 15:33:53 -- common/autotest_common.sh@822 -- # local max_retries=100 00:04:55.192 15:33:53 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:55.192 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:55.192 15:33:53 -- common/autotest_common.sh@826 -- # xtrace_disable 00:04:55.192 15:33:53 -- common/autotest_common.sh@10 -- # set +x 00:04:55.450 [2024-04-26 15:33:53.812259] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:04:55.450 [2024-04-26 15:33:53.812309] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3162780 ] 00:04:55.450 EAL: No free 2048 kB hugepages reported on node 1 00:04:55.450 [2024-04-26 15:33:53.866828] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:55.450 [2024-04-26 15:33:53.944979] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:56.018 15:33:54 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:04:56.018 15:33:54 -- common/autotest_common.sh@850 -- # return 0 00:04:56.018 15:33:54 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py load_config -i 00:04:56.276 15:33:54 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 3162780 00:04:56.276 15:33:54 -- common/autotest_common.sh@936 -- # '[' -z 3162780 ']' 00:04:56.276 15:33:54 -- common/autotest_common.sh@940 -- # kill -0 3162780 00:04:56.276 15:33:54 -- common/autotest_common.sh@941 -- # uname 00:04:56.276 15:33:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:56.276 15:33:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3162780 00:04:56.276 15:33:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:56.276 15:33:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:56.276 15:33:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3162780' 00:04:56.276 killing process with pid 3162780 00:04:56.276 15:33:54 -- common/autotest_common.sh@955 -- # kill 3162780 00:04:56.276 15:33:54 -- common/autotest_common.sh@960 -- # wait 3162780 00:04:56.843 00:04:56.843 real 0m1.491s 00:04:56.843 user 0m1.628s 00:04:56.843 sys 0m0.382s 00:04:56.843 15:33:55 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:56.843 15:33:55 -- common/autotest_common.sh@10 -- # set +x 00:04:56.843 ************************************ 00:04:56.843 END TEST alias_rpc 00:04:56.843 ************************************ 00:04:56.843 15:33:55 -- spdk/autotest.sh@172 -- # [[ 0 -eq 0 ]] 00:04:56.843 15:33:55 -- spdk/autotest.sh@173 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:56.843 15:33:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:56.843 15:33:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:56.843 15:33:55 -- common/autotest_common.sh@10 -- # set +x 00:04:56.843 ************************************ 00:04:56.843 START TEST spdkcli_tcp 00:04:56.843 ************************************ 00:04:56.844 15:33:55 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:56.844 * Looking for test storage... 00:04:56.844 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli 00:04:56.844 15:33:55 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/common.sh 00:04:56.844 15:33:55 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:04:56.844 15:33:55 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/clear_config.py 00:04:56.844 15:33:55 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:04:56.844 15:33:55 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:04:56.844 15:33:55 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:04:56.844 15:33:55 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:04:56.844 15:33:55 -- common/autotest_common.sh@710 -- # xtrace_disable 00:04:56.844 15:33:55 -- common/autotest_common.sh@10 -- # set +x 00:04:56.844 15:33:55 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=3163224 00:04:56.844 15:33:55 -- spdkcli/tcp.sh@27 -- # waitforlisten 3163224 00:04:56.844 15:33:55 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:04:56.844 15:33:55 -- common/autotest_common.sh@817 -- # '[' -z 3163224 ']' 00:04:56.844 15:33:55 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:56.844 15:33:55 -- common/autotest_common.sh@822 -- # local max_retries=100 00:04:56.844 15:33:55 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:56.844 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:56.844 15:33:55 -- common/autotest_common.sh@826 -- # xtrace_disable 00:04:56.844 15:33:55 -- common/autotest_common.sh@10 -- # set +x 00:04:57.102 [2024-04-26 15:33:55.475622] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:04:57.102 [2024-04-26 15:33:55.475670] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3163224 ] 00:04:57.102 EAL: No free 2048 kB hugepages reported on node 1 00:04:57.102 [2024-04-26 15:33:55.530594] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:57.103 [2024-04-26 15:33:55.602098] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:57.103 [2024-04-26 15:33:55.602100] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:57.669 15:33:56 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:04:57.670 15:33:56 -- common/autotest_common.sh@850 -- # return 0 00:04:57.670 15:33:56 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:04:57.670 15:33:56 -- spdkcli/tcp.sh@31 -- # socat_pid=3163244 00:04:57.670 15:33:56 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:04:57.930 [ 00:04:57.930 "bdev_malloc_delete", 00:04:57.930 "bdev_malloc_create", 00:04:57.930 "bdev_null_resize", 00:04:57.930 "bdev_null_delete", 00:04:57.930 "bdev_null_create", 00:04:57.930 "bdev_nvme_cuse_unregister", 00:04:57.930 "bdev_nvme_cuse_register", 00:04:57.930 "bdev_opal_new_user", 00:04:57.930 "bdev_opal_set_lock_state", 00:04:57.930 "bdev_opal_delete", 00:04:57.930 "bdev_opal_get_info", 00:04:57.930 "bdev_opal_create", 00:04:57.930 "bdev_nvme_opal_revert", 00:04:57.930 "bdev_nvme_opal_init", 00:04:57.930 "bdev_nvme_send_cmd", 00:04:57.930 "bdev_nvme_get_path_iostat", 00:04:57.930 "bdev_nvme_get_mdns_discovery_info", 00:04:57.930 "bdev_nvme_stop_mdns_discovery", 00:04:57.930 "bdev_nvme_start_mdns_discovery", 00:04:57.930 "bdev_nvme_set_multipath_policy", 00:04:57.930 "bdev_nvme_set_preferred_path", 00:04:57.930 "bdev_nvme_get_io_paths", 00:04:57.930 "bdev_nvme_remove_error_injection", 00:04:57.930 "bdev_nvme_add_error_injection", 00:04:57.930 "bdev_nvme_get_discovery_info", 00:04:57.930 "bdev_nvme_stop_discovery", 00:04:57.930 "bdev_nvme_start_discovery", 00:04:57.930 "bdev_nvme_get_controller_health_info", 00:04:57.930 "bdev_nvme_disable_controller", 00:04:57.930 "bdev_nvme_enable_controller", 00:04:57.930 "bdev_nvme_reset_controller", 00:04:57.930 "bdev_nvme_get_transport_statistics", 00:04:57.930 "bdev_nvme_apply_firmware", 00:04:57.930 "bdev_nvme_detach_controller", 00:04:57.930 "bdev_nvme_get_controllers", 00:04:57.930 "bdev_nvme_attach_controller", 00:04:57.930 "bdev_nvme_set_hotplug", 00:04:57.930 "bdev_nvme_set_options", 00:04:57.930 "bdev_passthru_delete", 00:04:57.930 "bdev_passthru_create", 00:04:57.930 "bdev_lvol_grow_lvstore", 00:04:57.930 "bdev_lvol_get_lvols", 00:04:57.930 "bdev_lvol_get_lvstores", 00:04:57.930 "bdev_lvol_delete", 00:04:57.930 "bdev_lvol_set_read_only", 00:04:57.930 "bdev_lvol_resize", 00:04:57.930 "bdev_lvol_decouple_parent", 00:04:57.930 "bdev_lvol_inflate", 00:04:57.930 "bdev_lvol_rename", 00:04:57.930 "bdev_lvol_clone_bdev", 00:04:57.930 "bdev_lvol_clone", 00:04:57.930 "bdev_lvol_snapshot", 00:04:57.930 "bdev_lvol_create", 00:04:57.930 "bdev_lvol_delete_lvstore", 00:04:57.930 "bdev_lvol_rename_lvstore", 00:04:57.930 "bdev_lvol_create_lvstore", 00:04:57.930 "bdev_raid_set_options", 00:04:57.930 "bdev_raid_remove_base_bdev", 00:04:57.930 "bdev_raid_add_base_bdev", 00:04:57.930 "bdev_raid_delete", 00:04:57.930 "bdev_raid_create", 00:04:57.930 "bdev_raid_get_bdevs", 00:04:57.930 "bdev_error_inject_error", 00:04:57.930 "bdev_error_delete", 00:04:57.930 "bdev_error_create", 00:04:57.930 "bdev_split_delete", 00:04:57.930 "bdev_split_create", 00:04:57.930 "bdev_delay_delete", 00:04:57.930 "bdev_delay_create", 00:04:57.930 "bdev_delay_update_latency", 00:04:57.930 "bdev_zone_block_delete", 00:04:57.930 "bdev_zone_block_create", 00:04:57.930 "blobfs_create", 00:04:57.930 "blobfs_detect", 00:04:57.930 "blobfs_set_cache_size", 00:04:57.930 "bdev_aio_delete", 00:04:57.930 "bdev_aio_rescan", 00:04:57.930 "bdev_aio_create", 00:04:57.930 "bdev_ftl_set_property", 00:04:57.930 "bdev_ftl_get_properties", 00:04:57.930 "bdev_ftl_get_stats", 00:04:57.930 "bdev_ftl_unmap", 00:04:57.930 "bdev_ftl_unload", 00:04:57.930 "bdev_ftl_delete", 00:04:57.930 "bdev_ftl_load", 00:04:57.930 "bdev_ftl_create", 00:04:57.930 "bdev_virtio_attach_controller", 00:04:57.930 "bdev_virtio_scsi_get_devices", 00:04:57.930 "bdev_virtio_detach_controller", 00:04:57.930 "bdev_virtio_blk_set_hotplug", 00:04:57.930 "bdev_iscsi_delete", 00:04:57.930 "bdev_iscsi_create", 00:04:57.930 "bdev_iscsi_set_options", 00:04:57.930 "accel_error_inject_error", 00:04:57.930 "ioat_scan_accel_module", 00:04:57.930 "dsa_scan_accel_module", 00:04:57.930 "iaa_scan_accel_module", 00:04:57.930 "keyring_file_remove_key", 00:04:57.930 "keyring_file_add_key", 00:04:57.930 "iscsi_get_histogram", 00:04:57.930 "iscsi_enable_histogram", 00:04:57.930 "iscsi_set_options", 00:04:57.930 "iscsi_get_auth_groups", 00:04:57.930 "iscsi_auth_group_remove_secret", 00:04:57.930 "iscsi_auth_group_add_secret", 00:04:57.930 "iscsi_delete_auth_group", 00:04:57.930 "iscsi_create_auth_group", 00:04:57.930 "iscsi_set_discovery_auth", 00:04:57.930 "iscsi_get_options", 00:04:57.930 "iscsi_target_node_request_logout", 00:04:57.930 "iscsi_target_node_set_redirect", 00:04:57.930 "iscsi_target_node_set_auth", 00:04:57.930 "iscsi_target_node_add_lun", 00:04:57.930 "iscsi_get_stats", 00:04:57.930 "iscsi_get_connections", 00:04:57.930 "iscsi_portal_group_set_auth", 00:04:57.930 "iscsi_start_portal_group", 00:04:57.930 "iscsi_delete_portal_group", 00:04:57.930 "iscsi_create_portal_group", 00:04:57.930 "iscsi_get_portal_groups", 00:04:57.930 "iscsi_delete_target_node", 00:04:57.930 "iscsi_target_node_remove_pg_ig_maps", 00:04:57.930 "iscsi_target_node_add_pg_ig_maps", 00:04:57.930 "iscsi_create_target_node", 00:04:57.930 "iscsi_get_target_nodes", 00:04:57.930 "iscsi_delete_initiator_group", 00:04:57.930 "iscsi_initiator_group_remove_initiators", 00:04:57.930 "iscsi_initiator_group_add_initiators", 00:04:57.930 "iscsi_create_initiator_group", 00:04:57.930 "iscsi_get_initiator_groups", 00:04:57.930 "nvmf_set_crdt", 00:04:57.930 "nvmf_set_config", 00:04:57.930 "nvmf_set_max_subsystems", 00:04:57.930 "nvmf_subsystem_get_listeners", 00:04:57.930 "nvmf_subsystem_get_qpairs", 00:04:57.930 "nvmf_subsystem_get_controllers", 00:04:57.930 "nvmf_get_stats", 00:04:57.930 "nvmf_get_transports", 00:04:57.930 "nvmf_create_transport", 00:04:57.930 "nvmf_get_targets", 00:04:57.930 "nvmf_delete_target", 00:04:57.930 "nvmf_create_target", 00:04:57.930 "nvmf_subsystem_allow_any_host", 00:04:57.930 "nvmf_subsystem_remove_host", 00:04:57.930 "nvmf_subsystem_add_host", 00:04:57.930 "nvmf_ns_remove_host", 00:04:57.930 "nvmf_ns_add_host", 00:04:57.930 "nvmf_subsystem_remove_ns", 00:04:57.930 "nvmf_subsystem_add_ns", 00:04:57.930 "nvmf_subsystem_listener_set_ana_state", 00:04:57.930 "nvmf_discovery_get_referrals", 00:04:57.930 "nvmf_discovery_remove_referral", 00:04:57.930 "nvmf_discovery_add_referral", 00:04:57.930 "nvmf_subsystem_remove_listener", 00:04:57.930 "nvmf_subsystem_add_listener", 00:04:57.930 "nvmf_delete_subsystem", 00:04:57.930 "nvmf_create_subsystem", 00:04:57.930 "nvmf_get_subsystems", 00:04:57.930 "env_dpdk_get_mem_stats", 00:04:57.930 "nbd_get_disks", 00:04:57.930 "nbd_stop_disk", 00:04:57.930 "nbd_start_disk", 00:04:57.930 "ublk_recover_disk", 00:04:57.930 "ublk_get_disks", 00:04:57.930 "ublk_stop_disk", 00:04:57.930 "ublk_start_disk", 00:04:57.930 "ublk_destroy_target", 00:04:57.930 "ublk_create_target", 00:04:57.930 "virtio_blk_create_transport", 00:04:57.930 "virtio_blk_get_transports", 00:04:57.930 "vhost_controller_set_coalescing", 00:04:57.930 "vhost_get_controllers", 00:04:57.930 "vhost_delete_controller", 00:04:57.930 "vhost_create_blk_controller", 00:04:57.930 "vhost_scsi_controller_remove_target", 00:04:57.930 "vhost_scsi_controller_add_target", 00:04:57.930 "vhost_start_scsi_controller", 00:04:57.930 "vhost_create_scsi_controller", 00:04:57.930 "thread_set_cpumask", 00:04:57.930 "framework_get_scheduler", 00:04:57.930 "framework_set_scheduler", 00:04:57.930 "framework_get_reactors", 00:04:57.930 "thread_get_io_channels", 00:04:57.930 "thread_get_pollers", 00:04:57.930 "thread_get_stats", 00:04:57.930 "framework_monitor_context_switch", 00:04:57.930 "spdk_kill_instance", 00:04:57.930 "log_enable_timestamps", 00:04:57.930 "log_get_flags", 00:04:57.930 "log_clear_flag", 00:04:57.930 "log_set_flag", 00:04:57.930 "log_get_level", 00:04:57.930 "log_set_level", 00:04:57.930 "log_get_print_level", 00:04:57.930 "log_set_print_level", 00:04:57.930 "framework_enable_cpumask_locks", 00:04:57.930 "framework_disable_cpumask_locks", 00:04:57.930 "framework_wait_init", 00:04:57.930 "framework_start_init", 00:04:57.931 "scsi_get_devices", 00:04:57.931 "bdev_get_histogram", 00:04:57.931 "bdev_enable_histogram", 00:04:57.931 "bdev_set_qos_limit", 00:04:57.931 "bdev_set_qd_sampling_period", 00:04:57.931 "bdev_get_bdevs", 00:04:57.931 "bdev_reset_iostat", 00:04:57.931 "bdev_get_iostat", 00:04:57.931 "bdev_examine", 00:04:57.931 "bdev_wait_for_examine", 00:04:57.931 "bdev_set_options", 00:04:57.931 "notify_get_notifications", 00:04:57.931 "notify_get_types", 00:04:57.931 "accel_get_stats", 00:04:57.931 "accel_set_options", 00:04:57.931 "accel_set_driver", 00:04:57.931 "accel_crypto_key_destroy", 00:04:57.931 "accel_crypto_keys_get", 00:04:57.931 "accel_crypto_key_create", 00:04:57.931 "accel_assign_opc", 00:04:57.931 "accel_get_module_info", 00:04:57.931 "accel_get_opc_assignments", 00:04:57.931 "vmd_rescan", 00:04:57.931 "vmd_remove_device", 00:04:57.931 "vmd_enable", 00:04:57.931 "sock_get_default_impl", 00:04:57.931 "sock_set_default_impl", 00:04:57.931 "sock_impl_set_options", 00:04:57.931 "sock_impl_get_options", 00:04:57.931 "iobuf_get_stats", 00:04:57.931 "iobuf_set_options", 00:04:57.931 "framework_get_pci_devices", 00:04:57.931 "framework_get_config", 00:04:57.931 "framework_get_subsystems", 00:04:57.931 "trace_get_info", 00:04:57.931 "trace_get_tpoint_group_mask", 00:04:57.931 "trace_disable_tpoint_group", 00:04:57.931 "trace_enable_tpoint_group", 00:04:57.931 "trace_clear_tpoint_mask", 00:04:57.931 "trace_set_tpoint_mask", 00:04:57.931 "keyring_get_keys", 00:04:57.931 "spdk_get_version", 00:04:57.931 "rpc_get_methods" 00:04:57.931 ] 00:04:57.931 15:33:56 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:04:57.931 15:33:56 -- common/autotest_common.sh@716 -- # xtrace_disable 00:04:57.931 15:33:56 -- common/autotest_common.sh@10 -- # set +x 00:04:57.931 15:33:56 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:04:57.931 15:33:56 -- spdkcli/tcp.sh@38 -- # killprocess 3163224 00:04:57.931 15:33:56 -- common/autotest_common.sh@936 -- # '[' -z 3163224 ']' 00:04:57.931 15:33:56 -- common/autotest_common.sh@940 -- # kill -0 3163224 00:04:57.931 15:33:56 -- common/autotest_common.sh@941 -- # uname 00:04:57.931 15:33:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:57.931 15:33:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3163224 00:04:57.931 15:33:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:57.931 15:33:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:57.931 15:33:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3163224' 00:04:57.931 killing process with pid 3163224 00:04:57.931 15:33:56 -- common/autotest_common.sh@955 -- # kill 3163224 00:04:57.931 15:33:56 -- common/autotest_common.sh@960 -- # wait 3163224 00:04:58.499 00:04:58.499 real 0m1.523s 00:04:58.499 user 0m2.792s 00:04:58.499 sys 0m0.425s 00:04:58.499 15:33:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:58.499 15:33:56 -- common/autotest_common.sh@10 -- # set +x 00:04:58.499 ************************************ 00:04:58.499 END TEST spdkcli_tcp 00:04:58.499 ************************************ 00:04:58.499 15:33:56 -- spdk/autotest.sh@176 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:58.499 15:33:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:58.499 15:33:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:58.499 15:33:56 -- common/autotest_common.sh@10 -- # set +x 00:04:58.499 ************************************ 00:04:58.499 START TEST dpdk_mem_utility 00:04:58.499 ************************************ 00:04:58.499 15:33:57 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:58.757 * Looking for test storage... 00:04:58.757 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dpdk_memory_utility 00:04:58.757 15:33:57 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:58.757 15:33:57 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=3163537 00:04:58.757 15:33:57 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 3163537 00:04:58.757 15:33:57 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:04:58.757 15:33:57 -- common/autotest_common.sh@817 -- # '[' -z 3163537 ']' 00:04:58.757 15:33:57 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:58.757 15:33:57 -- common/autotest_common.sh@822 -- # local max_retries=100 00:04:58.757 15:33:57 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:58.757 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:58.757 15:33:57 -- common/autotest_common.sh@826 -- # xtrace_disable 00:04:58.757 15:33:57 -- common/autotest_common.sh@10 -- # set +x 00:04:58.757 [2024-04-26 15:33:57.149666] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:04:58.757 [2024-04-26 15:33:57.149710] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3163537 ] 00:04:58.757 EAL: No free 2048 kB hugepages reported on node 1 00:04:58.757 [2024-04-26 15:33:57.203954] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:58.757 [2024-04-26 15:33:57.283513] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:59.692 15:33:57 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:04:59.692 15:33:57 -- common/autotest_common.sh@850 -- # return 0 00:04:59.692 15:33:57 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:04:59.692 15:33:57 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:04:59.692 15:33:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:04:59.692 15:33:57 -- common/autotest_common.sh@10 -- # set +x 00:04:59.692 { 00:04:59.692 "filename": "/tmp/spdk_mem_dump.txt" 00:04:59.692 } 00:04:59.692 15:33:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:04:59.692 15:33:57 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:59.692 DPDK memory size 814.000000 MiB in 1 heap(s) 00:04:59.692 1 heaps totaling size 814.000000 MiB 00:04:59.692 size: 814.000000 MiB heap id: 0 00:04:59.692 end heaps---------- 00:04:59.692 8 mempools totaling size 598.116089 MiB 00:04:59.692 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:04:59.692 size: 158.602051 MiB name: PDU_data_out_Pool 00:04:59.692 size: 84.521057 MiB name: bdev_io_3163537 00:04:59.692 size: 51.011292 MiB name: evtpool_3163537 00:04:59.692 size: 50.003479 MiB name: msgpool_3163537 00:04:59.692 size: 21.763794 MiB name: PDU_Pool 00:04:59.692 size: 19.513306 MiB name: SCSI_TASK_Pool 00:04:59.692 size: 0.026123 MiB name: Session_Pool 00:04:59.692 end mempools------- 00:04:59.692 6 memzones totaling size 4.142822 MiB 00:04:59.692 size: 1.000366 MiB name: RG_ring_0_3163537 00:04:59.692 size: 1.000366 MiB name: RG_ring_1_3163537 00:04:59.692 size: 1.000366 MiB name: RG_ring_4_3163537 00:04:59.692 size: 1.000366 MiB name: RG_ring_5_3163537 00:04:59.692 size: 0.125366 MiB name: RG_ring_2_3163537 00:04:59.692 size: 0.015991 MiB name: RG_ring_3_3163537 00:04:59.692 end memzones------- 00:04:59.692 15:33:57 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:04:59.692 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:04:59.692 list of free elements. size: 12.519348 MiB 00:04:59.692 element at address: 0x200000400000 with size: 1.999512 MiB 00:04:59.692 element at address: 0x200018e00000 with size: 0.999878 MiB 00:04:59.692 element at address: 0x200019000000 with size: 0.999878 MiB 00:04:59.692 element at address: 0x200003e00000 with size: 0.996277 MiB 00:04:59.692 element at address: 0x200031c00000 with size: 0.994446 MiB 00:04:59.692 element at address: 0x200013800000 with size: 0.978699 MiB 00:04:59.692 element at address: 0x200007000000 with size: 0.959839 MiB 00:04:59.692 element at address: 0x200019200000 with size: 0.936584 MiB 00:04:59.692 element at address: 0x200000200000 with size: 0.841614 MiB 00:04:59.692 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:04:59.692 element at address: 0x20000b200000 with size: 0.490723 MiB 00:04:59.692 element at address: 0x200000800000 with size: 0.487793 MiB 00:04:59.692 element at address: 0x200019400000 with size: 0.485657 MiB 00:04:59.692 element at address: 0x200027e00000 with size: 0.410034 MiB 00:04:59.692 element at address: 0x200003a00000 with size: 0.355530 MiB 00:04:59.692 list of standard malloc elements. size: 199.218079 MiB 00:04:59.692 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:04:59.692 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:04:59.692 element at address: 0x200018efff80 with size: 1.000122 MiB 00:04:59.693 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:04:59.693 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:04:59.693 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:04:59.693 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:04:59.693 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:04:59.693 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:04:59.693 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:04:59.693 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:04:59.693 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:04:59.693 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:04:59.693 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:04:59.693 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:04:59.693 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:04:59.693 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:04:59.693 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:04:59.693 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:04:59.693 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:04:59.693 element at address: 0x200003adb300 with size: 0.000183 MiB 00:04:59.693 element at address: 0x200003adb500 with size: 0.000183 MiB 00:04:59.693 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:04:59.693 element at address: 0x200003affa80 with size: 0.000183 MiB 00:04:59.693 element at address: 0x200003affb40 with size: 0.000183 MiB 00:04:59.693 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:04:59.693 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:04:59.693 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:04:59.693 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:04:59.693 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:04:59.693 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:04:59.693 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:04:59.693 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:04:59.693 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:04:59.693 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:04:59.693 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:04:59.693 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:04:59.693 element at address: 0x200027e69040 with size: 0.000183 MiB 00:04:59.693 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:04:59.693 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:04:59.693 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:04:59.693 list of memzone associated elements. size: 602.262573 MiB 00:04:59.693 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:04:59.693 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:04:59.693 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:04:59.693 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:04:59.693 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:04:59.693 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_3163537_0 00:04:59.693 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:04:59.693 associated memzone info: size: 48.002930 MiB name: MP_evtpool_3163537_0 00:04:59.693 element at address: 0x200003fff380 with size: 48.003052 MiB 00:04:59.693 associated memzone info: size: 48.002930 MiB name: MP_msgpool_3163537_0 00:04:59.693 element at address: 0x2000195be940 with size: 20.255554 MiB 00:04:59.693 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:04:59.693 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:04:59.693 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:04:59.693 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:04:59.693 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_3163537 00:04:59.693 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:04:59.693 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_3163537 00:04:59.693 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:04:59.693 associated memzone info: size: 1.007996 MiB name: MP_evtpool_3163537 00:04:59.693 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:04:59.693 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:04:59.693 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:04:59.693 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:04:59.693 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:04:59.693 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:04:59.693 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:04:59.693 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:04:59.693 element at address: 0x200003eff180 with size: 1.000488 MiB 00:04:59.693 associated memzone info: size: 1.000366 MiB name: RG_ring_0_3163537 00:04:59.693 element at address: 0x200003affc00 with size: 1.000488 MiB 00:04:59.693 associated memzone info: size: 1.000366 MiB name: RG_ring_1_3163537 00:04:59.693 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:04:59.693 associated memzone info: size: 1.000366 MiB name: RG_ring_4_3163537 00:04:59.693 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:04:59.693 associated memzone info: size: 1.000366 MiB name: RG_ring_5_3163537 00:04:59.693 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:04:59.693 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_3163537 00:04:59.693 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:04:59.693 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:04:59.693 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:04:59.693 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:04:59.693 element at address: 0x20001947c540 with size: 0.250488 MiB 00:04:59.693 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:04:59.693 element at address: 0x200003adf880 with size: 0.125488 MiB 00:04:59.693 associated memzone info: size: 0.125366 MiB name: RG_ring_2_3163537 00:04:59.693 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:04:59.693 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:04:59.693 element at address: 0x200027e69100 with size: 0.023743 MiB 00:04:59.693 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:04:59.693 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:04:59.693 associated memzone info: size: 0.015991 MiB name: RG_ring_3_3163537 00:04:59.693 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:04:59.693 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:04:59.693 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:04:59.693 associated memzone info: size: 0.000183 MiB name: MP_msgpool_3163537 00:04:59.693 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:04:59.693 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_3163537 00:04:59.693 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:04:59.693 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:04:59.693 15:33:58 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:04:59.693 15:33:58 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 3163537 00:04:59.693 15:33:58 -- common/autotest_common.sh@936 -- # '[' -z 3163537 ']' 00:04:59.693 15:33:58 -- common/autotest_common.sh@940 -- # kill -0 3163537 00:04:59.693 15:33:58 -- common/autotest_common.sh@941 -- # uname 00:04:59.693 15:33:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:59.693 15:33:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3163537 00:04:59.693 15:33:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:59.693 15:33:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:59.693 15:33:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3163537' 00:04:59.693 killing process with pid 3163537 00:04:59.693 15:33:58 -- common/autotest_common.sh@955 -- # kill 3163537 00:04:59.693 15:33:58 -- common/autotest_common.sh@960 -- # wait 3163537 00:04:59.951 00:04:59.951 real 0m1.381s 00:04:59.951 user 0m1.449s 00:04:59.951 sys 0m0.362s 00:04:59.951 15:33:58 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:59.951 15:33:58 -- common/autotest_common.sh@10 -- # set +x 00:04:59.951 ************************************ 00:04:59.951 END TEST dpdk_mem_utility 00:04:59.951 ************************************ 00:04:59.951 15:33:58 -- spdk/autotest.sh@177 -- # run_test event /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/event.sh 00:04:59.951 15:33:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:59.951 15:33:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:59.951 15:33:58 -- common/autotest_common.sh@10 -- # set +x 00:05:00.209 ************************************ 00:05:00.209 START TEST event 00:05:00.209 ************************************ 00:05:00.209 15:33:58 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/event.sh 00:05:00.209 * Looking for test storage... 00:05:00.209 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event 00:05:00.209 15:33:58 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/bdev/nbd_common.sh 00:05:00.209 15:33:58 -- bdev/nbd_common.sh@6 -- # set -e 00:05:00.209 15:33:58 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:05:00.210 15:33:58 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:00.210 15:33:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:00.210 15:33:58 -- common/autotest_common.sh@10 -- # set +x 00:05:00.210 ************************************ 00:05:00.210 START TEST event_perf 00:05:00.210 ************************************ 00:05:00.210 15:33:58 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:05:00.210 Running I/O for 1 seconds...[2024-04-26 15:33:58.806862] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:05:00.210 [2024-04-26 15:33:58.806924] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3163847 ] 00:05:00.468 EAL: No free 2048 kB hugepages reported on node 1 00:05:00.468 [2024-04-26 15:33:58.864010] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:00.468 [2024-04-26 15:33:58.937373] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:00.468 [2024-04-26 15:33:58.937460] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:00.468 [2024-04-26 15:33:58.937544] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:00.468 [2024-04-26 15:33:58.937545] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:01.843 Running I/O for 1 seconds... 00:05:01.843 lcore 0: 210405 00:05:01.843 lcore 1: 210407 00:05:01.843 lcore 2: 210406 00:05:01.843 lcore 3: 210408 00:05:01.843 done. 00:05:01.843 00:05:01.843 real 0m1.241s 00:05:01.843 user 0m4.159s 00:05:01.843 sys 0m0.078s 00:05:01.843 15:34:00 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:01.843 15:34:00 -- common/autotest_common.sh@10 -- # set +x 00:05:01.843 ************************************ 00:05:01.843 END TEST event_perf 00:05:01.843 ************************************ 00:05:01.843 15:34:00 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:05:01.843 15:34:00 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:05:01.843 15:34:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:01.843 15:34:00 -- common/autotest_common.sh@10 -- # set +x 00:05:01.843 ************************************ 00:05:01.843 START TEST event_reactor 00:05:01.843 ************************************ 00:05:01.843 15:34:00 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:05:01.843 [2024-04-26 15:34:00.217028] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:05:01.843 [2024-04-26 15:34:00.217089] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3164105 ] 00:05:01.843 EAL: No free 2048 kB hugepages reported on node 1 00:05:01.843 [2024-04-26 15:34:00.278230] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:01.843 [2024-04-26 15:34:00.354875] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:03.221 test_start 00:05:03.221 oneshot 00:05:03.221 tick 100 00:05:03.221 tick 100 00:05:03.221 tick 250 00:05:03.221 tick 100 00:05:03.221 tick 100 00:05:03.221 tick 100 00:05:03.221 tick 250 00:05:03.221 tick 500 00:05:03.221 tick 100 00:05:03.221 tick 100 00:05:03.221 tick 250 00:05:03.221 tick 100 00:05:03.221 tick 100 00:05:03.221 test_end 00:05:03.221 00:05:03.221 real 0m1.245s 00:05:03.221 user 0m1.168s 00:05:03.221 sys 0m0.072s 00:05:03.221 15:34:01 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:03.221 15:34:01 -- common/autotest_common.sh@10 -- # set +x 00:05:03.221 ************************************ 00:05:03.221 END TEST event_reactor 00:05:03.221 ************************************ 00:05:03.221 15:34:01 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:05:03.221 15:34:01 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:05:03.221 15:34:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:03.221 15:34:01 -- common/autotest_common.sh@10 -- # set +x 00:05:03.221 ************************************ 00:05:03.221 START TEST event_reactor_perf 00:05:03.221 ************************************ 00:05:03.221 15:34:01 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:05:03.221 [2024-04-26 15:34:01.618754] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:05:03.221 [2024-04-26 15:34:01.618820] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3164361 ] 00:05:03.221 EAL: No free 2048 kB hugepages reported on node 1 00:05:03.221 [2024-04-26 15:34:01.679874] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:03.221 [2024-04-26 15:34:01.755106] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:04.596 test_start 00:05:04.596 test_end 00:05:04.596 Performance: 510169 events per second 00:05:04.596 00:05:04.596 real 0m1.250s 00:05:04.596 user 0m1.172s 00:05:04.596 sys 0m0.074s 00:05:04.596 15:34:02 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:04.596 15:34:02 -- common/autotest_common.sh@10 -- # set +x 00:05:04.596 ************************************ 00:05:04.596 END TEST event_reactor_perf 00:05:04.596 ************************************ 00:05:04.596 15:34:02 -- event/event.sh@49 -- # uname -s 00:05:04.596 15:34:02 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:05:04.596 15:34:02 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:05:04.596 15:34:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:04.596 15:34:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:04.596 15:34:02 -- common/autotest_common.sh@10 -- # set +x 00:05:04.596 ************************************ 00:05:04.596 START TEST event_scheduler 00:05:04.596 ************************************ 00:05:04.596 15:34:03 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:05:04.596 * Looking for test storage... 00:05:04.596 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/scheduler 00:05:04.596 15:34:03 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:05:04.596 15:34:03 -- scheduler/scheduler.sh@35 -- # scheduler_pid=3164647 00:05:04.596 15:34:03 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:05:04.596 15:34:03 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:05:04.596 15:34:03 -- scheduler/scheduler.sh@37 -- # waitforlisten 3164647 00:05:04.596 15:34:03 -- common/autotest_common.sh@817 -- # '[' -z 3164647 ']' 00:05:04.596 15:34:03 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:04.596 15:34:03 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:04.596 15:34:03 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:04.596 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:04.596 15:34:03 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:04.596 15:34:03 -- common/autotest_common.sh@10 -- # set +x 00:05:04.596 [2024-04-26 15:34:03.144184] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:05:04.596 [2024-04-26 15:34:03.144234] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3164647 ] 00:05:04.596 EAL: No free 2048 kB hugepages reported on node 1 00:05:04.855 [2024-04-26 15:34:03.201148] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:04.855 [2024-04-26 15:34:03.278437] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:04.855 [2024-04-26 15:34:03.278537] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:04.855 [2024-04-26 15:34:03.278627] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:04.855 [2024-04-26 15:34:03.278629] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:05.428 15:34:03 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:05.428 15:34:03 -- common/autotest_common.sh@850 -- # return 0 00:05:05.428 15:34:03 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:05:05.428 15:34:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:05.428 15:34:03 -- common/autotest_common.sh@10 -- # set +x 00:05:05.428 POWER: Env isn't set yet! 00:05:05.428 POWER: Attempting to initialise ACPI cpufreq power management... 00:05:05.428 POWER: Failed to write /sys/devices/system/cpu/cpu%u/cpufreq/scaling_governor 00:05:05.428 POWER: Cannot set governor of lcore 0 to userspace 00:05:05.428 POWER: Attempting to initialise PSTAT power management... 00:05:05.428 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:05:05.428 POWER: Initialized successfully for lcore 0 power management 00:05:05.428 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:05:05.428 POWER: Initialized successfully for lcore 1 power management 00:05:05.428 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:05:05.428 POWER: Initialized successfully for lcore 2 power management 00:05:05.428 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:05:05.428 POWER: Initialized successfully for lcore 3 power management 00:05:05.428 15:34:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:05.428 15:34:03 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:05:05.428 15:34:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:05.428 15:34:03 -- common/autotest_common.sh@10 -- # set +x 00:05:05.687 [2024-04-26 15:34:04.069438] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:05:05.687 15:34:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:05.687 15:34:04 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:05:05.687 15:34:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:05.687 15:34:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:05.687 15:34:04 -- common/autotest_common.sh@10 -- # set +x 00:05:05.687 ************************************ 00:05:05.687 START TEST scheduler_create_thread 00:05:05.687 ************************************ 00:05:05.687 15:34:04 -- common/autotest_common.sh@1111 -- # scheduler_create_thread 00:05:05.687 15:34:04 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:05:05.687 15:34:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:05.687 15:34:04 -- common/autotest_common.sh@10 -- # set +x 00:05:05.687 2 00:05:05.687 15:34:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:05.687 15:34:04 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:05:05.687 15:34:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:05.687 15:34:04 -- common/autotest_common.sh@10 -- # set +x 00:05:05.687 3 00:05:05.687 15:34:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:05.687 15:34:04 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:05:05.687 15:34:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:05.687 15:34:04 -- common/autotest_common.sh@10 -- # set +x 00:05:05.687 4 00:05:05.687 15:34:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:05.687 15:34:04 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:05:05.687 15:34:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:05.687 15:34:04 -- common/autotest_common.sh@10 -- # set +x 00:05:05.687 5 00:05:05.687 15:34:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:05.687 15:34:04 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:05:05.687 15:34:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:05.687 15:34:04 -- common/autotest_common.sh@10 -- # set +x 00:05:05.687 6 00:05:05.687 15:34:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:05.687 15:34:04 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:05:05.687 15:34:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:05.687 15:34:04 -- common/autotest_common.sh@10 -- # set +x 00:05:05.687 7 00:05:05.687 15:34:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:05.687 15:34:04 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:05:05.687 15:34:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:05.687 15:34:04 -- common/autotest_common.sh@10 -- # set +x 00:05:05.687 8 00:05:05.687 15:34:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:05.687 15:34:04 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:05:05.687 15:34:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:05.687 15:34:04 -- common/autotest_common.sh@10 -- # set +x 00:05:05.687 9 00:05:05.687 15:34:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:05.687 15:34:04 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:05:05.687 15:34:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:05.687 15:34:04 -- common/autotest_common.sh@10 -- # set +x 00:05:05.946 10 00:05:05.946 15:34:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:05.946 15:34:04 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:05:05.946 15:34:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:05.946 15:34:04 -- common/autotest_common.sh@10 -- # set +x 00:05:05.946 15:34:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:05.946 15:34:04 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:05:05.946 15:34:04 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:05:05.946 15:34:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:05.946 15:34:04 -- common/autotest_common.sh@10 -- # set +x 00:05:06.883 15:34:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:06.883 15:34:05 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:05:06.883 15:34:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:06.883 15:34:05 -- common/autotest_common.sh@10 -- # set +x 00:05:08.260 15:34:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:08.260 15:34:06 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:05:08.260 15:34:06 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:05:08.260 15:34:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:08.260 15:34:06 -- common/autotest_common.sh@10 -- # set +x 00:05:09.197 15:34:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:09.197 00:05:09.197 real 0m3.477s 00:05:09.197 user 0m0.020s 00:05:09.197 sys 0m0.008s 00:05:09.197 15:34:07 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:09.197 15:34:07 -- common/autotest_common.sh@10 -- # set +x 00:05:09.197 ************************************ 00:05:09.197 END TEST scheduler_create_thread 00:05:09.197 ************************************ 00:05:09.197 15:34:07 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:05:09.197 15:34:07 -- scheduler/scheduler.sh@46 -- # killprocess 3164647 00:05:09.197 15:34:07 -- common/autotest_common.sh@936 -- # '[' -z 3164647 ']' 00:05:09.197 15:34:07 -- common/autotest_common.sh@940 -- # kill -0 3164647 00:05:09.197 15:34:07 -- common/autotest_common.sh@941 -- # uname 00:05:09.197 15:34:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:09.197 15:34:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3164647 00:05:09.197 15:34:07 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:05:09.197 15:34:07 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:05:09.197 15:34:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3164647' 00:05:09.197 killing process with pid 3164647 00:05:09.197 15:34:07 -- common/autotest_common.sh@955 -- # kill 3164647 00:05:09.197 15:34:07 -- common/autotest_common.sh@960 -- # wait 3164647 00:05:09.764 [2024-04-26 15:34:08.166307] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:05:09.764 POWER: Power management governor of lcore 0 has been set to 'powersave' successfully 00:05:09.764 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:05:09.764 POWER: Power management governor of lcore 1 has been set to 'powersave' successfully 00:05:09.764 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:05:09.764 POWER: Power management governor of lcore 2 has been set to 'powersave' successfully 00:05:09.764 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:05:09.764 POWER: Power management governor of lcore 3 has been set to 'powersave' successfully 00:05:09.764 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:05:09.764 00:05:09.764 real 0m5.355s 00:05:09.764 user 0m8.803s 00:05:09.764 sys 0m0.416s 00:05:09.764 15:34:08 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:09.764 15:34:08 -- common/autotest_common.sh@10 -- # set +x 00:05:09.764 ************************************ 00:05:09.764 END TEST event_scheduler 00:05:09.764 ************************************ 00:05:10.024 15:34:08 -- event/event.sh@51 -- # modprobe -n nbd 00:05:10.024 15:34:08 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:05:10.024 15:34:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:10.024 15:34:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:10.024 15:34:08 -- common/autotest_common.sh@10 -- # set +x 00:05:10.024 ************************************ 00:05:10.024 START TEST app_repeat 00:05:10.024 ************************************ 00:05:10.024 15:34:08 -- common/autotest_common.sh@1111 -- # app_repeat_test 00:05:10.024 15:34:08 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:10.024 15:34:08 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:10.024 15:34:08 -- event/event.sh@13 -- # local nbd_list 00:05:10.024 15:34:08 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:10.024 15:34:08 -- event/event.sh@14 -- # local bdev_list 00:05:10.024 15:34:08 -- event/event.sh@15 -- # local repeat_times=4 00:05:10.024 15:34:08 -- event/event.sh@17 -- # modprobe nbd 00:05:10.024 15:34:08 -- event/event.sh@19 -- # repeat_pid=3165636 00:05:10.024 15:34:08 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:05:10.024 15:34:08 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:05:10.024 15:34:08 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 3165636' 00:05:10.024 Process app_repeat pid: 3165636 00:05:10.024 15:34:08 -- event/event.sh@23 -- # for i in {0..2} 00:05:10.024 15:34:08 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:05:10.024 spdk_app_start Round 0 00:05:10.024 15:34:08 -- event/event.sh@25 -- # waitforlisten 3165636 /var/tmp/spdk-nbd.sock 00:05:10.024 15:34:08 -- common/autotest_common.sh@817 -- # '[' -z 3165636 ']' 00:05:10.024 15:34:08 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:10.024 15:34:08 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:10.024 15:34:08 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:10.024 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:10.024 15:34:08 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:10.024 15:34:08 -- common/autotest_common.sh@10 -- # set +x 00:05:10.024 [2024-04-26 15:34:08.586404] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:05:10.024 [2024-04-26 15:34:08.586459] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3165636 ] 00:05:10.024 EAL: No free 2048 kB hugepages reported on node 1 00:05:10.283 [2024-04-26 15:34:08.644931] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:10.283 [2024-04-26 15:34:08.717099] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:10.283 [2024-04-26 15:34:08.717101] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:10.850 15:34:09 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:10.850 15:34:09 -- common/autotest_common.sh@850 -- # return 0 00:05:10.850 15:34:09 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:11.109 Malloc0 00:05:11.109 15:34:09 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:11.368 Malloc1 00:05:11.368 15:34:09 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:11.368 15:34:09 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:11.368 15:34:09 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:11.368 15:34:09 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:11.368 15:34:09 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:11.368 15:34:09 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:11.368 15:34:09 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:11.368 15:34:09 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:11.368 15:34:09 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:11.368 15:34:09 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:11.368 15:34:09 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:11.368 15:34:09 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:11.368 15:34:09 -- bdev/nbd_common.sh@12 -- # local i 00:05:11.368 15:34:09 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:11.369 15:34:09 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:11.369 15:34:09 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:11.369 /dev/nbd0 00:05:11.369 15:34:09 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:11.369 15:34:09 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:11.369 15:34:09 -- common/autotest_common.sh@854 -- # local nbd_name=nbd0 00:05:11.369 15:34:09 -- common/autotest_common.sh@855 -- # local i 00:05:11.369 15:34:09 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:05:11.369 15:34:09 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:05:11.369 15:34:09 -- common/autotest_common.sh@858 -- # grep -q -w nbd0 /proc/partitions 00:05:11.369 15:34:09 -- common/autotest_common.sh@859 -- # break 00:05:11.369 15:34:09 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:05:11.369 15:34:09 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:05:11.369 15:34:09 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:11.369 1+0 records in 00:05:11.369 1+0 records out 00:05:11.369 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000221383 s, 18.5 MB/s 00:05:11.369 15:34:09 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:05:11.369 15:34:09 -- common/autotest_common.sh@872 -- # size=4096 00:05:11.369 15:34:09 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:05:11.369 15:34:09 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:05:11.369 15:34:09 -- common/autotest_common.sh@875 -- # return 0 00:05:11.369 15:34:09 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:11.369 15:34:09 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:11.369 15:34:09 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:11.629 /dev/nbd1 00:05:11.629 15:34:10 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:11.629 15:34:10 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:11.629 15:34:10 -- common/autotest_common.sh@854 -- # local nbd_name=nbd1 00:05:11.629 15:34:10 -- common/autotest_common.sh@855 -- # local i 00:05:11.629 15:34:10 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:05:11.629 15:34:10 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:05:11.629 15:34:10 -- common/autotest_common.sh@858 -- # grep -q -w nbd1 /proc/partitions 00:05:11.629 15:34:10 -- common/autotest_common.sh@859 -- # break 00:05:11.629 15:34:10 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:05:11.629 15:34:10 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:05:11.629 15:34:10 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:11.629 1+0 records in 00:05:11.629 1+0 records out 00:05:11.630 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000186885 s, 21.9 MB/s 00:05:11.630 15:34:10 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:05:11.630 15:34:10 -- common/autotest_common.sh@872 -- # size=4096 00:05:11.630 15:34:10 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:05:11.630 15:34:10 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:05:11.630 15:34:10 -- common/autotest_common.sh@875 -- # return 0 00:05:11.630 15:34:10 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:11.630 15:34:10 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:11.630 15:34:10 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:11.630 15:34:10 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:11.630 15:34:10 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:11.940 15:34:10 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:11.940 { 00:05:11.940 "nbd_device": "/dev/nbd0", 00:05:11.940 "bdev_name": "Malloc0" 00:05:11.940 }, 00:05:11.940 { 00:05:11.940 "nbd_device": "/dev/nbd1", 00:05:11.940 "bdev_name": "Malloc1" 00:05:11.940 } 00:05:11.940 ]' 00:05:11.940 15:34:10 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:11.940 { 00:05:11.940 "nbd_device": "/dev/nbd0", 00:05:11.940 "bdev_name": "Malloc0" 00:05:11.940 }, 00:05:11.940 { 00:05:11.940 "nbd_device": "/dev/nbd1", 00:05:11.940 "bdev_name": "Malloc1" 00:05:11.940 } 00:05:11.940 ]' 00:05:11.940 15:34:10 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:11.940 15:34:10 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:11.940 /dev/nbd1' 00:05:11.940 15:34:10 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:11.940 /dev/nbd1' 00:05:11.940 15:34:10 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:11.940 15:34:10 -- bdev/nbd_common.sh@65 -- # count=2 00:05:11.940 15:34:10 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:11.940 15:34:10 -- bdev/nbd_common.sh@95 -- # count=2 00:05:11.940 15:34:10 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:11.940 15:34:10 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:11.940 15:34:10 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:11.940 15:34:10 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:11.940 15:34:10 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:11.940 15:34:10 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:05:11.940 15:34:10 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:11.940 15:34:10 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:11.940 256+0 records in 00:05:11.940 256+0 records out 00:05:11.940 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103157 s, 102 MB/s 00:05:11.940 15:34:10 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:11.940 15:34:10 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:11.940 256+0 records in 00:05:11.940 256+0 records out 00:05:11.940 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134564 s, 77.9 MB/s 00:05:11.940 15:34:10 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:11.941 15:34:10 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:11.941 256+0 records in 00:05:11.941 256+0 records out 00:05:11.941 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143419 s, 73.1 MB/s 00:05:11.941 15:34:10 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:11.941 15:34:10 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:11.941 15:34:10 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:11.941 15:34:10 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:11.941 15:34:10 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:05:11.941 15:34:10 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:11.941 15:34:10 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:11.941 15:34:10 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:11.941 15:34:10 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:11.941 15:34:10 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:11.941 15:34:10 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:11.941 15:34:10 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:05:11.941 15:34:10 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:11.941 15:34:10 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:11.941 15:34:10 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:11.941 15:34:10 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:11.941 15:34:10 -- bdev/nbd_common.sh@51 -- # local i 00:05:11.941 15:34:10 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:11.941 15:34:10 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:12.226 15:34:10 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:12.226 15:34:10 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:12.226 15:34:10 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:12.226 15:34:10 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:12.226 15:34:10 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:12.227 15:34:10 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:12.227 15:34:10 -- bdev/nbd_common.sh@41 -- # break 00:05:12.227 15:34:10 -- bdev/nbd_common.sh@45 -- # return 0 00:05:12.227 15:34:10 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:12.227 15:34:10 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:12.227 15:34:10 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:12.227 15:34:10 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:12.485 15:34:10 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:12.486 15:34:10 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:12.486 15:34:10 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:12.486 15:34:10 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:12.486 15:34:10 -- bdev/nbd_common.sh@41 -- # break 00:05:12.486 15:34:10 -- bdev/nbd_common.sh@45 -- # return 0 00:05:12.486 15:34:10 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:12.486 15:34:10 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:12.486 15:34:10 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:12.486 15:34:11 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:12.486 15:34:11 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:12.486 15:34:11 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:12.486 15:34:11 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:12.486 15:34:11 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:12.486 15:34:11 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:12.486 15:34:11 -- bdev/nbd_common.sh@65 -- # true 00:05:12.486 15:34:11 -- bdev/nbd_common.sh@65 -- # count=0 00:05:12.486 15:34:11 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:12.486 15:34:11 -- bdev/nbd_common.sh@104 -- # count=0 00:05:12.486 15:34:11 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:12.486 15:34:11 -- bdev/nbd_common.sh@109 -- # return 0 00:05:12.486 15:34:11 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:12.745 15:34:11 -- event/event.sh@35 -- # sleep 3 00:05:13.004 [2024-04-26 15:34:11.443930] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:13.004 [2024-04-26 15:34:11.508037] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:13.004 [2024-04-26 15:34:11.508038] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:13.004 [2024-04-26 15:34:11.549533] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:13.004 [2024-04-26 15:34:11.549575] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:16.291 15:34:14 -- event/event.sh@23 -- # for i in {0..2} 00:05:16.291 15:34:14 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:05:16.291 spdk_app_start Round 1 00:05:16.291 15:34:14 -- event/event.sh@25 -- # waitforlisten 3165636 /var/tmp/spdk-nbd.sock 00:05:16.291 15:34:14 -- common/autotest_common.sh@817 -- # '[' -z 3165636 ']' 00:05:16.291 15:34:14 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:16.291 15:34:14 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:16.291 15:34:14 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:16.291 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:16.291 15:34:14 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:16.291 15:34:14 -- common/autotest_common.sh@10 -- # set +x 00:05:16.291 15:34:14 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:16.291 15:34:14 -- common/autotest_common.sh@850 -- # return 0 00:05:16.291 15:34:14 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:16.291 Malloc0 00:05:16.291 15:34:14 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:16.291 Malloc1 00:05:16.291 15:34:14 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:16.291 15:34:14 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:16.291 15:34:14 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:16.291 15:34:14 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:16.291 15:34:14 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:16.291 15:34:14 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:16.291 15:34:14 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:16.291 15:34:14 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:16.291 15:34:14 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:16.291 15:34:14 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:16.291 15:34:14 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:16.291 15:34:14 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:16.291 15:34:14 -- bdev/nbd_common.sh@12 -- # local i 00:05:16.291 15:34:14 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:16.291 15:34:14 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:16.291 15:34:14 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:16.550 /dev/nbd0 00:05:16.550 15:34:14 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:16.550 15:34:14 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:16.550 15:34:14 -- common/autotest_common.sh@854 -- # local nbd_name=nbd0 00:05:16.550 15:34:14 -- common/autotest_common.sh@855 -- # local i 00:05:16.550 15:34:14 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:05:16.550 15:34:14 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:05:16.550 15:34:14 -- common/autotest_common.sh@858 -- # grep -q -w nbd0 /proc/partitions 00:05:16.550 15:34:14 -- common/autotest_common.sh@859 -- # break 00:05:16.550 15:34:14 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:05:16.550 15:34:14 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:05:16.550 15:34:14 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:16.550 1+0 records in 00:05:16.550 1+0 records out 00:05:16.550 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000181728 s, 22.5 MB/s 00:05:16.550 15:34:14 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:05:16.550 15:34:14 -- common/autotest_common.sh@872 -- # size=4096 00:05:16.550 15:34:14 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:05:16.550 15:34:15 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:05:16.550 15:34:15 -- common/autotest_common.sh@875 -- # return 0 00:05:16.550 15:34:15 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:16.550 15:34:15 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:16.550 15:34:15 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:16.809 /dev/nbd1 00:05:16.809 15:34:15 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:16.809 15:34:15 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:16.809 15:34:15 -- common/autotest_common.sh@854 -- # local nbd_name=nbd1 00:05:16.809 15:34:15 -- common/autotest_common.sh@855 -- # local i 00:05:16.809 15:34:15 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:05:16.809 15:34:15 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:05:16.809 15:34:15 -- common/autotest_common.sh@858 -- # grep -q -w nbd1 /proc/partitions 00:05:16.809 15:34:15 -- common/autotest_common.sh@859 -- # break 00:05:16.809 15:34:15 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:05:16.809 15:34:15 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:05:16.809 15:34:15 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:16.809 1+0 records in 00:05:16.809 1+0 records out 00:05:16.809 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000222173 s, 18.4 MB/s 00:05:16.809 15:34:15 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:05:16.809 15:34:15 -- common/autotest_common.sh@872 -- # size=4096 00:05:16.809 15:34:15 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:05:16.809 15:34:15 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:05:16.809 15:34:15 -- common/autotest_common.sh@875 -- # return 0 00:05:16.809 15:34:15 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:16.809 15:34:15 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:16.809 15:34:15 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:16.809 15:34:15 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:16.809 15:34:15 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:16.809 15:34:15 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:16.809 { 00:05:16.809 "nbd_device": "/dev/nbd0", 00:05:16.809 "bdev_name": "Malloc0" 00:05:16.809 }, 00:05:16.809 { 00:05:16.809 "nbd_device": "/dev/nbd1", 00:05:16.809 "bdev_name": "Malloc1" 00:05:16.809 } 00:05:16.809 ]' 00:05:16.809 15:34:15 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:16.809 { 00:05:16.809 "nbd_device": "/dev/nbd0", 00:05:16.809 "bdev_name": "Malloc0" 00:05:16.809 }, 00:05:16.809 { 00:05:16.809 "nbd_device": "/dev/nbd1", 00:05:16.809 "bdev_name": "Malloc1" 00:05:16.809 } 00:05:16.809 ]' 00:05:16.809 15:34:15 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:17.068 /dev/nbd1' 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:17.068 /dev/nbd1' 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@65 -- # count=2 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@95 -- # count=2 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:17.068 256+0 records in 00:05:17.068 256+0 records out 00:05:17.068 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103388 s, 101 MB/s 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:17.068 256+0 records in 00:05:17.068 256+0 records out 00:05:17.068 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133488 s, 78.6 MB/s 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:17.068 256+0 records in 00:05:17.068 256+0 records out 00:05:17.068 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148055 s, 70.8 MB/s 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@51 -- # local i 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:17.068 15:34:15 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:17.327 15:34:15 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:17.327 15:34:15 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:17.327 15:34:15 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:17.327 15:34:15 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:17.327 15:34:15 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:17.327 15:34:15 -- bdev/nbd_common.sh@41 -- # break 00:05:17.327 15:34:15 -- bdev/nbd_common.sh@45 -- # return 0 00:05:17.327 15:34:15 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:17.327 15:34:15 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:17.327 15:34:15 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:17.327 15:34:15 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:17.327 15:34:15 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:17.327 15:34:15 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:17.328 15:34:15 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:17.328 15:34:15 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:17.328 15:34:15 -- bdev/nbd_common.sh@41 -- # break 00:05:17.328 15:34:15 -- bdev/nbd_common.sh@45 -- # return 0 00:05:17.328 15:34:15 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:17.328 15:34:15 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:17.328 15:34:15 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:17.587 15:34:16 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:17.587 15:34:16 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:17.587 15:34:16 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:17.587 15:34:16 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:17.587 15:34:16 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:17.587 15:34:16 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:17.587 15:34:16 -- bdev/nbd_common.sh@65 -- # true 00:05:17.587 15:34:16 -- bdev/nbd_common.sh@65 -- # count=0 00:05:17.587 15:34:16 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:17.587 15:34:16 -- bdev/nbd_common.sh@104 -- # count=0 00:05:17.587 15:34:16 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:17.587 15:34:16 -- bdev/nbd_common.sh@109 -- # return 0 00:05:17.587 15:34:16 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:17.845 15:34:16 -- event/event.sh@35 -- # sleep 3 00:05:18.105 [2024-04-26 15:34:16.489349] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:18.105 [2024-04-26 15:34:16.552875] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:18.105 [2024-04-26 15:34:16.552876] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:18.105 [2024-04-26 15:34:16.595191] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:18.105 [2024-04-26 15:34:16.595233] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:21.392 15:34:19 -- event/event.sh@23 -- # for i in {0..2} 00:05:21.392 15:34:19 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:05:21.392 spdk_app_start Round 2 00:05:21.392 15:34:19 -- event/event.sh@25 -- # waitforlisten 3165636 /var/tmp/spdk-nbd.sock 00:05:21.392 15:34:19 -- common/autotest_common.sh@817 -- # '[' -z 3165636 ']' 00:05:21.392 15:34:19 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:21.392 15:34:19 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:21.392 15:34:19 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:21.392 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:21.392 15:34:19 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:21.392 15:34:19 -- common/autotest_common.sh@10 -- # set +x 00:05:21.392 15:34:19 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:21.392 15:34:19 -- common/autotest_common.sh@850 -- # return 0 00:05:21.392 15:34:19 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:21.392 Malloc0 00:05:21.392 15:34:19 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:21.392 Malloc1 00:05:21.392 15:34:19 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:21.392 15:34:19 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:21.392 15:34:19 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:21.392 15:34:19 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:21.392 15:34:19 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:21.392 15:34:19 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:21.392 15:34:19 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:21.392 15:34:19 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:21.392 15:34:19 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:21.392 15:34:19 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:21.392 15:34:19 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:21.392 15:34:19 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:21.392 15:34:19 -- bdev/nbd_common.sh@12 -- # local i 00:05:21.392 15:34:19 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:21.392 15:34:19 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:21.392 15:34:19 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:21.392 /dev/nbd0 00:05:21.392 15:34:19 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:21.392 15:34:19 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:21.392 15:34:19 -- common/autotest_common.sh@854 -- # local nbd_name=nbd0 00:05:21.392 15:34:19 -- common/autotest_common.sh@855 -- # local i 00:05:21.392 15:34:19 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:05:21.392 15:34:19 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:05:21.392 15:34:19 -- common/autotest_common.sh@858 -- # grep -q -w nbd0 /proc/partitions 00:05:21.392 15:34:19 -- common/autotest_common.sh@859 -- # break 00:05:21.392 15:34:19 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:05:21.392 15:34:19 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:05:21.392 15:34:19 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:21.392 1+0 records in 00:05:21.392 1+0 records out 00:05:21.392 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000197503 s, 20.7 MB/s 00:05:21.392 15:34:19 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:05:21.392 15:34:19 -- common/autotest_common.sh@872 -- # size=4096 00:05:21.392 15:34:19 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:05:21.651 15:34:19 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:05:21.651 15:34:19 -- common/autotest_common.sh@875 -- # return 0 00:05:21.651 15:34:19 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:21.651 15:34:19 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:21.651 15:34:19 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:21.651 /dev/nbd1 00:05:21.651 15:34:20 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:21.651 15:34:20 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:21.651 15:34:20 -- common/autotest_common.sh@854 -- # local nbd_name=nbd1 00:05:21.651 15:34:20 -- common/autotest_common.sh@855 -- # local i 00:05:21.651 15:34:20 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:05:21.651 15:34:20 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:05:21.651 15:34:20 -- common/autotest_common.sh@858 -- # grep -q -w nbd1 /proc/partitions 00:05:21.651 15:34:20 -- common/autotest_common.sh@859 -- # break 00:05:21.651 15:34:20 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:05:21.651 15:34:20 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:05:21.651 15:34:20 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:21.651 1+0 records in 00:05:21.651 1+0 records out 00:05:21.651 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00018524 s, 22.1 MB/s 00:05:21.651 15:34:20 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:05:21.651 15:34:20 -- common/autotest_common.sh@872 -- # size=4096 00:05:21.651 15:34:20 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:05:21.651 15:34:20 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:05:21.651 15:34:20 -- common/autotest_common.sh@875 -- # return 0 00:05:21.651 15:34:20 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:21.651 15:34:20 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:21.651 15:34:20 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:21.651 15:34:20 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:21.651 15:34:20 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:21.910 { 00:05:21.910 "nbd_device": "/dev/nbd0", 00:05:21.910 "bdev_name": "Malloc0" 00:05:21.910 }, 00:05:21.910 { 00:05:21.910 "nbd_device": "/dev/nbd1", 00:05:21.910 "bdev_name": "Malloc1" 00:05:21.910 } 00:05:21.910 ]' 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:21.910 { 00:05:21.910 "nbd_device": "/dev/nbd0", 00:05:21.910 "bdev_name": "Malloc0" 00:05:21.910 }, 00:05:21.910 { 00:05:21.910 "nbd_device": "/dev/nbd1", 00:05:21.910 "bdev_name": "Malloc1" 00:05:21.910 } 00:05:21.910 ]' 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:21.910 /dev/nbd1' 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:21.910 /dev/nbd1' 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@65 -- # count=2 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@95 -- # count=2 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:21.910 256+0 records in 00:05:21.910 256+0 records out 00:05:21.910 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00319479 s, 328 MB/s 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:21.910 256+0 records in 00:05:21.910 256+0 records out 00:05:21.910 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135328 s, 77.5 MB/s 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:21.910 256+0 records in 00:05:21.910 256+0 records out 00:05:21.910 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142683 s, 73.5 MB/s 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@51 -- # local i 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:21.910 15:34:20 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:22.169 15:34:20 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:22.169 15:34:20 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:22.169 15:34:20 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:22.169 15:34:20 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:22.169 15:34:20 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:22.169 15:34:20 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:22.169 15:34:20 -- bdev/nbd_common.sh@41 -- # break 00:05:22.169 15:34:20 -- bdev/nbd_common.sh@45 -- # return 0 00:05:22.169 15:34:20 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:22.169 15:34:20 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:22.428 15:34:20 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:22.428 15:34:20 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:22.428 15:34:20 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:22.428 15:34:20 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:22.428 15:34:20 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:22.428 15:34:20 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:22.428 15:34:20 -- bdev/nbd_common.sh@41 -- # break 00:05:22.428 15:34:20 -- bdev/nbd_common.sh@45 -- # return 0 00:05:22.428 15:34:20 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:22.428 15:34:20 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:22.428 15:34:20 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:22.687 15:34:21 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:22.687 15:34:21 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:22.687 15:34:21 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:22.687 15:34:21 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:22.687 15:34:21 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:22.687 15:34:21 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:22.687 15:34:21 -- bdev/nbd_common.sh@65 -- # true 00:05:22.687 15:34:21 -- bdev/nbd_common.sh@65 -- # count=0 00:05:22.687 15:34:21 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:22.687 15:34:21 -- bdev/nbd_common.sh@104 -- # count=0 00:05:22.687 15:34:21 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:22.687 15:34:21 -- bdev/nbd_common.sh@109 -- # return 0 00:05:22.687 15:34:21 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:22.687 15:34:21 -- event/event.sh@35 -- # sleep 3 00:05:22.946 [2024-04-26 15:34:21.496367] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:23.205 [2024-04-26 15:34:21.561991] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:23.205 [2024-04-26 15:34:21.561993] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:23.205 [2024-04-26 15:34:21.603665] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:23.205 [2024-04-26 15:34:21.603707] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:25.736 15:34:24 -- event/event.sh@38 -- # waitforlisten 3165636 /var/tmp/spdk-nbd.sock 00:05:25.736 15:34:24 -- common/autotest_common.sh@817 -- # '[' -z 3165636 ']' 00:05:25.736 15:34:24 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:25.736 15:34:24 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:25.736 15:34:24 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:25.736 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:25.736 15:34:24 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:25.736 15:34:24 -- common/autotest_common.sh@10 -- # set +x 00:05:25.995 15:34:24 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:25.995 15:34:24 -- common/autotest_common.sh@850 -- # return 0 00:05:25.995 15:34:24 -- event/event.sh@39 -- # killprocess 3165636 00:05:25.995 15:34:24 -- common/autotest_common.sh@936 -- # '[' -z 3165636 ']' 00:05:25.995 15:34:24 -- common/autotest_common.sh@940 -- # kill -0 3165636 00:05:25.995 15:34:24 -- common/autotest_common.sh@941 -- # uname 00:05:25.995 15:34:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:25.995 15:34:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3165636 00:05:25.995 15:34:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:25.995 15:34:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:25.995 15:34:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3165636' 00:05:25.995 killing process with pid 3165636 00:05:25.995 15:34:24 -- common/autotest_common.sh@955 -- # kill 3165636 00:05:25.995 15:34:24 -- common/autotest_common.sh@960 -- # wait 3165636 00:05:26.254 spdk_app_start is called in Round 0. 00:05:26.254 Shutdown signal received, stop current app iteration 00:05:26.254 Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 reinitialization... 00:05:26.254 spdk_app_start is called in Round 1. 00:05:26.254 Shutdown signal received, stop current app iteration 00:05:26.254 Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 reinitialization... 00:05:26.254 spdk_app_start is called in Round 2. 00:05:26.254 Shutdown signal received, stop current app iteration 00:05:26.254 Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 reinitialization... 00:05:26.254 spdk_app_start is called in Round 3. 00:05:26.254 Shutdown signal received, stop current app iteration 00:05:26.254 15:34:24 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:05:26.254 15:34:24 -- event/event.sh@42 -- # return 0 00:05:26.254 00:05:26.254 real 0m16.138s 00:05:26.254 user 0m34.764s 00:05:26.254 sys 0m2.312s 00:05:26.254 15:34:24 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:26.254 15:34:24 -- common/autotest_common.sh@10 -- # set +x 00:05:26.254 ************************************ 00:05:26.254 END TEST app_repeat 00:05:26.254 ************************************ 00:05:26.254 15:34:24 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:05:26.254 15:34:24 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:26.254 15:34:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:26.254 15:34:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:26.254 15:34:24 -- common/autotest_common.sh@10 -- # set +x 00:05:26.254 ************************************ 00:05:26.254 START TEST cpu_locks 00:05:26.254 ************************************ 00:05:26.254 15:34:24 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:26.513 * Looking for test storage... 00:05:26.513 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event 00:05:26.513 15:34:24 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:05:26.513 15:34:24 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:05:26.513 15:34:24 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:05:26.514 15:34:24 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:05:26.514 15:34:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:26.514 15:34:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:26.514 15:34:24 -- common/autotest_common.sh@10 -- # set +x 00:05:26.514 ************************************ 00:05:26.514 START TEST default_locks 00:05:26.514 ************************************ 00:05:26.514 15:34:25 -- common/autotest_common.sh@1111 -- # default_locks 00:05:26.514 15:34:25 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=3168637 00:05:26.514 15:34:25 -- event/cpu_locks.sh@47 -- # waitforlisten 3168637 00:05:26.514 15:34:25 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:26.514 15:34:25 -- common/autotest_common.sh@817 -- # '[' -z 3168637 ']' 00:05:26.514 15:34:25 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:26.514 15:34:25 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:26.514 15:34:25 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:26.514 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:26.514 15:34:25 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:26.514 15:34:25 -- common/autotest_common.sh@10 -- # set +x 00:05:26.514 [2024-04-26 15:34:25.086341] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:05:26.514 [2024-04-26 15:34:25.086378] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3168637 ] 00:05:26.514 EAL: No free 2048 kB hugepages reported on node 1 00:05:26.773 [2024-04-26 15:34:25.140760] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:26.773 [2024-04-26 15:34:25.211101] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:27.340 15:34:25 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:27.341 15:34:25 -- common/autotest_common.sh@850 -- # return 0 00:05:27.341 15:34:25 -- event/cpu_locks.sh@49 -- # locks_exist 3168637 00:05:27.341 15:34:25 -- event/cpu_locks.sh@22 -- # lslocks -p 3168637 00:05:27.341 15:34:25 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:27.598 lslocks: write error 00:05:27.598 15:34:26 -- event/cpu_locks.sh@50 -- # killprocess 3168637 00:05:27.857 15:34:26 -- common/autotest_common.sh@936 -- # '[' -z 3168637 ']' 00:05:27.857 15:34:26 -- common/autotest_common.sh@940 -- # kill -0 3168637 00:05:27.857 15:34:26 -- common/autotest_common.sh@941 -- # uname 00:05:27.857 15:34:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:27.857 15:34:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3168637 00:05:27.857 15:34:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:27.857 15:34:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:27.857 15:34:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3168637' 00:05:27.857 killing process with pid 3168637 00:05:27.857 15:34:26 -- common/autotest_common.sh@955 -- # kill 3168637 00:05:27.857 15:34:26 -- common/autotest_common.sh@960 -- # wait 3168637 00:05:28.116 15:34:26 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 3168637 00:05:28.116 15:34:26 -- common/autotest_common.sh@638 -- # local es=0 00:05:28.116 15:34:26 -- common/autotest_common.sh@640 -- # valid_exec_arg waitforlisten 3168637 00:05:28.116 15:34:26 -- common/autotest_common.sh@626 -- # local arg=waitforlisten 00:05:28.116 15:34:26 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:28.116 15:34:26 -- common/autotest_common.sh@630 -- # type -t waitforlisten 00:05:28.116 15:34:26 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:28.116 15:34:26 -- common/autotest_common.sh@641 -- # waitforlisten 3168637 00:05:28.116 15:34:26 -- common/autotest_common.sh@817 -- # '[' -z 3168637 ']' 00:05:28.116 15:34:26 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:28.116 15:34:26 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:28.116 15:34:26 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:28.116 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:28.116 15:34:26 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:28.116 15:34:26 -- common/autotest_common.sh@10 -- # set +x 00:05:28.116 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh: line 832: kill: (3168637) - No such process 00:05:28.116 ERROR: process (pid: 3168637) is no longer running 00:05:28.116 15:34:26 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:28.116 15:34:26 -- common/autotest_common.sh@850 -- # return 1 00:05:28.116 15:34:26 -- common/autotest_common.sh@641 -- # es=1 00:05:28.116 15:34:26 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:05:28.116 15:34:26 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:05:28.116 15:34:26 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:05:28.116 15:34:26 -- event/cpu_locks.sh@54 -- # no_locks 00:05:28.116 15:34:26 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:28.116 15:34:26 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:28.116 15:34:26 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:28.116 00:05:28.116 real 0m1.547s 00:05:28.116 user 0m1.614s 00:05:28.116 sys 0m0.506s 00:05:28.116 15:34:26 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:28.116 15:34:26 -- common/autotest_common.sh@10 -- # set +x 00:05:28.116 ************************************ 00:05:28.116 END TEST default_locks 00:05:28.116 ************************************ 00:05:28.116 15:34:26 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:05:28.116 15:34:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:28.116 15:34:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:28.116 15:34:26 -- common/autotest_common.sh@10 -- # set +x 00:05:28.375 ************************************ 00:05:28.375 START TEST default_locks_via_rpc 00:05:28.375 ************************************ 00:05:28.375 15:34:26 -- common/autotest_common.sh@1111 -- # default_locks_via_rpc 00:05:28.375 15:34:26 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:28.375 15:34:26 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=3168972 00:05:28.375 15:34:26 -- event/cpu_locks.sh@63 -- # waitforlisten 3168972 00:05:28.375 15:34:26 -- common/autotest_common.sh@817 -- # '[' -z 3168972 ']' 00:05:28.375 15:34:26 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:28.375 15:34:26 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:28.375 15:34:26 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:28.375 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:28.375 15:34:26 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:28.375 15:34:26 -- common/autotest_common.sh@10 -- # set +x 00:05:28.375 [2024-04-26 15:34:26.778159] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:05:28.375 [2024-04-26 15:34:26.778196] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3168972 ] 00:05:28.375 EAL: No free 2048 kB hugepages reported on node 1 00:05:28.375 [2024-04-26 15:34:26.833183] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:28.375 [2024-04-26 15:34:26.911944] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:29.311 15:34:27 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:29.311 15:34:27 -- common/autotest_common.sh@850 -- # return 0 00:05:29.311 15:34:27 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:05:29.311 15:34:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:29.311 15:34:27 -- common/autotest_common.sh@10 -- # set +x 00:05:29.311 15:34:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:29.311 15:34:27 -- event/cpu_locks.sh@67 -- # no_locks 00:05:29.311 15:34:27 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:29.311 15:34:27 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:29.311 15:34:27 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:29.311 15:34:27 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:05:29.311 15:34:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:29.311 15:34:27 -- common/autotest_common.sh@10 -- # set +x 00:05:29.311 15:34:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:29.311 15:34:27 -- event/cpu_locks.sh@71 -- # locks_exist 3168972 00:05:29.311 15:34:27 -- event/cpu_locks.sh@22 -- # lslocks -p 3168972 00:05:29.311 15:34:27 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:29.570 15:34:27 -- event/cpu_locks.sh@73 -- # killprocess 3168972 00:05:29.570 15:34:27 -- common/autotest_common.sh@936 -- # '[' -z 3168972 ']' 00:05:29.570 15:34:27 -- common/autotest_common.sh@940 -- # kill -0 3168972 00:05:29.570 15:34:27 -- common/autotest_common.sh@941 -- # uname 00:05:29.570 15:34:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:29.570 15:34:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3168972 00:05:29.570 15:34:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:29.570 15:34:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:29.570 15:34:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3168972' 00:05:29.570 killing process with pid 3168972 00:05:29.570 15:34:28 -- common/autotest_common.sh@955 -- # kill 3168972 00:05:29.570 15:34:28 -- common/autotest_common.sh@960 -- # wait 3168972 00:05:29.828 00:05:29.828 real 0m1.629s 00:05:29.828 user 0m1.698s 00:05:29.828 sys 0m0.523s 00:05:29.828 15:34:28 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:29.828 15:34:28 -- common/autotest_common.sh@10 -- # set +x 00:05:29.828 ************************************ 00:05:29.828 END TEST default_locks_via_rpc 00:05:29.828 ************************************ 00:05:29.828 15:34:28 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:05:29.828 15:34:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:29.828 15:34:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:29.828 15:34:28 -- common/autotest_common.sh@10 -- # set +x 00:05:30.086 ************************************ 00:05:30.086 START TEST non_locking_app_on_locked_coremask 00:05:30.086 ************************************ 00:05:30.086 15:34:28 -- common/autotest_common.sh@1111 -- # non_locking_app_on_locked_coremask 00:05:30.086 15:34:28 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=3169397 00:05:30.086 15:34:28 -- event/cpu_locks.sh@81 -- # waitforlisten 3169397 /var/tmp/spdk.sock 00:05:30.086 15:34:28 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:30.086 15:34:28 -- common/autotest_common.sh@817 -- # '[' -z 3169397 ']' 00:05:30.086 15:34:28 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:30.086 15:34:28 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:30.086 15:34:28 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:30.086 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:30.086 15:34:28 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:30.086 15:34:28 -- common/autotest_common.sh@10 -- # set +x 00:05:30.086 [2024-04-26 15:34:28.579980] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:05:30.086 [2024-04-26 15:34:28.580021] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3169397 ] 00:05:30.086 EAL: No free 2048 kB hugepages reported on node 1 00:05:30.086 [2024-04-26 15:34:28.634816] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:30.345 [2024-04-26 15:34:28.704755] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:30.912 15:34:29 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:30.912 15:34:29 -- common/autotest_common.sh@850 -- # return 0 00:05:30.912 15:34:29 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=3169418 00:05:30.912 15:34:29 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:05:30.912 15:34:29 -- event/cpu_locks.sh@85 -- # waitforlisten 3169418 /var/tmp/spdk2.sock 00:05:30.912 15:34:29 -- common/autotest_common.sh@817 -- # '[' -z 3169418 ']' 00:05:30.912 15:34:29 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:30.912 15:34:29 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:30.912 15:34:29 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:30.912 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:30.912 15:34:29 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:30.912 15:34:29 -- common/autotest_common.sh@10 -- # set +x 00:05:30.912 [2024-04-26 15:34:29.402710] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:05:30.912 [2024-04-26 15:34:29.402756] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3169418 ] 00:05:30.912 EAL: No free 2048 kB hugepages reported on node 1 00:05:30.912 [2024-04-26 15:34:29.472207] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:30.912 [2024-04-26 15:34:29.472229] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:31.171 [2024-04-26 15:34:29.615598] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:31.739 15:34:30 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:31.739 15:34:30 -- common/autotest_common.sh@850 -- # return 0 00:05:31.739 15:34:30 -- event/cpu_locks.sh@87 -- # locks_exist 3169397 00:05:31.739 15:34:30 -- event/cpu_locks.sh@22 -- # lslocks -p 3169397 00:05:31.739 15:34:30 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:31.998 lslocks: write error 00:05:31.998 15:34:30 -- event/cpu_locks.sh@89 -- # killprocess 3169397 00:05:31.998 15:34:30 -- common/autotest_common.sh@936 -- # '[' -z 3169397 ']' 00:05:31.998 15:34:30 -- common/autotest_common.sh@940 -- # kill -0 3169397 00:05:31.998 15:34:30 -- common/autotest_common.sh@941 -- # uname 00:05:31.998 15:34:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:31.998 15:34:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3169397 00:05:31.998 15:34:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:31.998 15:34:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:31.998 15:34:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3169397' 00:05:31.998 killing process with pid 3169397 00:05:31.998 15:34:30 -- common/autotest_common.sh@955 -- # kill 3169397 00:05:31.998 15:34:30 -- common/autotest_common.sh@960 -- # wait 3169397 00:05:32.934 15:34:31 -- event/cpu_locks.sh@90 -- # killprocess 3169418 00:05:32.934 15:34:31 -- common/autotest_common.sh@936 -- # '[' -z 3169418 ']' 00:05:32.934 15:34:31 -- common/autotest_common.sh@940 -- # kill -0 3169418 00:05:32.934 15:34:31 -- common/autotest_common.sh@941 -- # uname 00:05:32.934 15:34:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:32.934 15:34:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3169418 00:05:32.934 15:34:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:32.934 15:34:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:32.934 15:34:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3169418' 00:05:32.934 killing process with pid 3169418 00:05:32.934 15:34:31 -- common/autotest_common.sh@955 -- # kill 3169418 00:05:32.934 15:34:31 -- common/autotest_common.sh@960 -- # wait 3169418 00:05:33.193 00:05:33.193 real 0m3.035s 00:05:33.193 user 0m3.271s 00:05:33.193 sys 0m0.783s 00:05:33.194 15:34:31 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:33.194 15:34:31 -- common/autotest_common.sh@10 -- # set +x 00:05:33.194 ************************************ 00:05:33.194 END TEST non_locking_app_on_locked_coremask 00:05:33.194 ************************************ 00:05:33.194 15:34:31 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:05:33.194 15:34:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:33.194 15:34:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:33.194 15:34:31 -- common/autotest_common.sh@10 -- # set +x 00:05:33.194 ************************************ 00:05:33.194 START TEST locking_app_on_unlocked_coremask 00:05:33.194 ************************************ 00:05:33.194 15:34:31 -- common/autotest_common.sh@1111 -- # locking_app_on_unlocked_coremask 00:05:33.194 15:34:31 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=3169910 00:05:33.194 15:34:31 -- event/cpu_locks.sh@99 -- # waitforlisten 3169910 /var/tmp/spdk.sock 00:05:33.194 15:34:31 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:05:33.194 15:34:31 -- common/autotest_common.sh@817 -- # '[' -z 3169910 ']' 00:05:33.194 15:34:31 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:33.194 15:34:31 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:33.194 15:34:31 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:33.194 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:33.194 15:34:31 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:33.194 15:34:31 -- common/autotest_common.sh@10 -- # set +x 00:05:33.194 [2024-04-26 15:34:31.751234] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:05:33.194 [2024-04-26 15:34:31.751271] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3169910 ] 00:05:33.194 EAL: No free 2048 kB hugepages reported on node 1 00:05:33.453 [2024-04-26 15:34:31.804465] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:33.453 [2024-04-26 15:34:31.804487] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:33.453 [2024-04-26 15:34:31.881081] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:34.020 15:34:32 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:34.020 15:34:32 -- common/autotest_common.sh@850 -- # return 0 00:05:34.020 15:34:32 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=3170135 00:05:34.020 15:34:32 -- event/cpu_locks.sh@103 -- # waitforlisten 3170135 /var/tmp/spdk2.sock 00:05:34.020 15:34:32 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:34.020 15:34:32 -- common/autotest_common.sh@817 -- # '[' -z 3170135 ']' 00:05:34.020 15:34:32 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:34.020 15:34:32 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:34.020 15:34:32 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:34.020 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:34.020 15:34:32 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:34.020 15:34:32 -- common/autotest_common.sh@10 -- # set +x 00:05:34.020 [2024-04-26 15:34:32.590273] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:05:34.020 [2024-04-26 15:34:32.590320] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3170135 ] 00:05:34.020 EAL: No free 2048 kB hugepages reported on node 1 00:05:34.279 [2024-04-26 15:34:32.657672] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:34.279 [2024-04-26 15:34:32.802988] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:34.855 15:34:33 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:34.855 15:34:33 -- common/autotest_common.sh@850 -- # return 0 00:05:34.855 15:34:33 -- event/cpu_locks.sh@105 -- # locks_exist 3170135 00:05:34.855 15:34:33 -- event/cpu_locks.sh@22 -- # lslocks -p 3170135 00:05:34.855 15:34:33 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:35.114 lslocks: write error 00:05:35.114 15:34:33 -- event/cpu_locks.sh@107 -- # killprocess 3169910 00:05:35.114 15:34:33 -- common/autotest_common.sh@936 -- # '[' -z 3169910 ']' 00:05:35.114 15:34:33 -- common/autotest_common.sh@940 -- # kill -0 3169910 00:05:35.373 15:34:33 -- common/autotest_common.sh@941 -- # uname 00:05:35.373 15:34:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:35.373 15:34:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3169910 00:05:35.373 15:34:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:35.373 15:34:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:35.373 15:34:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3169910' 00:05:35.373 killing process with pid 3169910 00:05:35.373 15:34:33 -- common/autotest_common.sh@955 -- # kill 3169910 00:05:35.373 15:34:33 -- common/autotest_common.sh@960 -- # wait 3169910 00:05:35.939 15:34:34 -- event/cpu_locks.sh@108 -- # killprocess 3170135 00:05:35.939 15:34:34 -- common/autotest_common.sh@936 -- # '[' -z 3170135 ']' 00:05:35.939 15:34:34 -- common/autotest_common.sh@940 -- # kill -0 3170135 00:05:35.939 15:34:34 -- common/autotest_common.sh@941 -- # uname 00:05:35.939 15:34:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:35.939 15:34:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3170135 00:05:35.939 15:34:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:35.939 15:34:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:35.939 15:34:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3170135' 00:05:35.939 killing process with pid 3170135 00:05:35.939 15:34:34 -- common/autotest_common.sh@955 -- # kill 3170135 00:05:35.939 15:34:34 -- common/autotest_common.sh@960 -- # wait 3170135 00:05:36.506 00:05:36.506 real 0m3.102s 00:05:36.506 user 0m3.317s 00:05:36.506 sys 0m0.836s 00:05:36.506 15:34:34 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:36.506 15:34:34 -- common/autotest_common.sh@10 -- # set +x 00:05:36.506 ************************************ 00:05:36.506 END TEST locking_app_on_unlocked_coremask 00:05:36.506 ************************************ 00:05:36.506 15:34:34 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:05:36.506 15:34:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:36.506 15:34:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:36.506 15:34:34 -- common/autotest_common.sh@10 -- # set +x 00:05:36.506 ************************************ 00:05:36.506 START TEST locking_app_on_locked_coremask 00:05:36.506 ************************************ 00:05:36.506 15:34:34 -- common/autotest_common.sh@1111 -- # locking_app_on_locked_coremask 00:05:36.506 15:34:34 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=3170448 00:05:36.507 15:34:34 -- event/cpu_locks.sh@116 -- # waitforlisten 3170448 /var/tmp/spdk.sock 00:05:36.507 15:34:34 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:36.507 15:34:34 -- common/autotest_common.sh@817 -- # '[' -z 3170448 ']' 00:05:36.507 15:34:34 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:36.507 15:34:34 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:36.507 15:34:34 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:36.507 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:36.507 15:34:34 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:36.507 15:34:34 -- common/autotest_common.sh@10 -- # set +x 00:05:36.507 [2024-04-26 15:34:35.018781] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:05:36.507 [2024-04-26 15:34:35.018819] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3170448 ] 00:05:36.507 EAL: No free 2048 kB hugepages reported on node 1 00:05:36.507 [2024-04-26 15:34:35.071899] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:36.764 [2024-04-26 15:34:35.143127] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:37.330 15:34:35 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:37.330 15:34:35 -- common/autotest_common.sh@850 -- # return 0 00:05:37.330 15:34:35 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=3170648 00:05:37.330 15:34:35 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 3170648 /var/tmp/spdk2.sock 00:05:37.330 15:34:35 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:37.330 15:34:35 -- common/autotest_common.sh@638 -- # local es=0 00:05:37.330 15:34:35 -- common/autotest_common.sh@640 -- # valid_exec_arg waitforlisten 3170648 /var/tmp/spdk2.sock 00:05:37.330 15:34:35 -- common/autotest_common.sh@626 -- # local arg=waitforlisten 00:05:37.330 15:34:35 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:37.330 15:34:35 -- common/autotest_common.sh@630 -- # type -t waitforlisten 00:05:37.330 15:34:35 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:37.330 15:34:35 -- common/autotest_common.sh@641 -- # waitforlisten 3170648 /var/tmp/spdk2.sock 00:05:37.330 15:34:35 -- common/autotest_common.sh@817 -- # '[' -z 3170648 ']' 00:05:37.330 15:34:35 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:37.330 15:34:35 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:37.330 15:34:35 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:37.330 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:37.330 15:34:35 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:37.330 15:34:35 -- common/autotest_common.sh@10 -- # set +x 00:05:37.330 [2024-04-26 15:34:35.852548] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:05:37.330 [2024-04-26 15:34:35.852595] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3170648 ] 00:05:37.330 EAL: No free 2048 kB hugepages reported on node 1 00:05:37.330 [2024-04-26 15:34:35.926509] app.c: 690:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 3170448 has claimed it. 00:05:37.330 [2024-04-26 15:34:35.926548] app.c: 821:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:37.896 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh: line 832: kill: (3170648) - No such process 00:05:37.896 ERROR: process (pid: 3170648) is no longer running 00:05:37.896 15:34:36 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:37.896 15:34:36 -- common/autotest_common.sh@850 -- # return 1 00:05:37.896 15:34:36 -- common/autotest_common.sh@641 -- # es=1 00:05:37.896 15:34:36 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:05:37.896 15:34:36 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:05:37.896 15:34:36 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:05:37.896 15:34:36 -- event/cpu_locks.sh@122 -- # locks_exist 3170448 00:05:37.896 15:34:36 -- event/cpu_locks.sh@22 -- # lslocks -p 3170448 00:05:37.896 15:34:36 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:38.464 lslocks: write error 00:05:38.464 15:34:36 -- event/cpu_locks.sh@124 -- # killprocess 3170448 00:05:38.464 15:34:36 -- common/autotest_common.sh@936 -- # '[' -z 3170448 ']' 00:05:38.464 15:34:36 -- common/autotest_common.sh@940 -- # kill -0 3170448 00:05:38.464 15:34:36 -- common/autotest_common.sh@941 -- # uname 00:05:38.464 15:34:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:38.464 15:34:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3170448 00:05:38.464 15:34:37 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:38.464 15:34:37 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:38.464 15:34:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3170448' 00:05:38.464 killing process with pid 3170448 00:05:38.464 15:34:37 -- common/autotest_common.sh@955 -- # kill 3170448 00:05:38.464 15:34:37 -- common/autotest_common.sh@960 -- # wait 3170448 00:05:39.031 00:05:39.031 real 0m2.398s 00:05:39.031 user 0m2.621s 00:05:39.031 sys 0m0.638s 00:05:39.031 15:34:37 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:39.032 15:34:37 -- common/autotest_common.sh@10 -- # set +x 00:05:39.032 ************************************ 00:05:39.032 END TEST locking_app_on_locked_coremask 00:05:39.032 ************************************ 00:05:39.032 15:34:37 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:05:39.032 15:34:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:39.032 15:34:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:39.032 15:34:37 -- common/autotest_common.sh@10 -- # set +x 00:05:39.032 ************************************ 00:05:39.032 START TEST locking_overlapped_coremask 00:05:39.032 ************************************ 00:05:39.032 15:34:37 -- common/autotest_common.sh@1111 -- # locking_overlapped_coremask 00:05:39.032 15:34:37 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=3170920 00:05:39.032 15:34:37 -- event/cpu_locks.sh@133 -- # waitforlisten 3170920 /var/tmp/spdk.sock 00:05:39.032 15:34:37 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:05:39.032 15:34:37 -- common/autotest_common.sh@817 -- # '[' -z 3170920 ']' 00:05:39.032 15:34:37 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:39.032 15:34:37 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:39.032 15:34:37 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:39.032 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:39.032 15:34:37 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:39.032 15:34:37 -- common/autotest_common.sh@10 -- # set +x 00:05:39.032 [2024-04-26 15:34:37.580746] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:05:39.032 [2024-04-26 15:34:37.580792] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3170920 ] 00:05:39.032 EAL: No free 2048 kB hugepages reported on node 1 00:05:39.032 [2024-04-26 15:34:37.635001] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:39.289 [2024-04-26 15:34:37.714676] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:39.289 [2024-04-26 15:34:37.714694] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:39.289 [2024-04-26 15:34:37.714695] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:39.854 15:34:38 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:39.854 15:34:38 -- common/autotest_common.sh@850 -- # return 0 00:05:39.854 15:34:38 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=3171150 00:05:39.854 15:34:38 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 3171150 /var/tmp/spdk2.sock 00:05:39.855 15:34:38 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:05:39.855 15:34:38 -- common/autotest_common.sh@638 -- # local es=0 00:05:39.855 15:34:38 -- common/autotest_common.sh@640 -- # valid_exec_arg waitforlisten 3171150 /var/tmp/spdk2.sock 00:05:39.855 15:34:38 -- common/autotest_common.sh@626 -- # local arg=waitforlisten 00:05:39.855 15:34:38 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:39.855 15:34:38 -- common/autotest_common.sh@630 -- # type -t waitforlisten 00:05:39.855 15:34:38 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:39.855 15:34:38 -- common/autotest_common.sh@641 -- # waitforlisten 3171150 /var/tmp/spdk2.sock 00:05:39.855 15:34:38 -- common/autotest_common.sh@817 -- # '[' -z 3171150 ']' 00:05:39.855 15:34:38 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:39.855 15:34:38 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:39.855 15:34:38 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:39.855 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:39.855 15:34:38 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:39.855 15:34:38 -- common/autotest_common.sh@10 -- # set +x 00:05:39.855 [2024-04-26 15:34:38.419349] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:05:39.855 [2024-04-26 15:34:38.419392] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3171150 ] 00:05:39.855 EAL: No free 2048 kB hugepages reported on node 1 00:05:40.197 [2024-04-26 15:34:38.493570] app.c: 690:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 3170920 has claimed it. 00:05:40.197 [2024-04-26 15:34:38.493608] app.c: 821:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:40.462 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh: line 832: kill: (3171150) - No such process 00:05:40.462 ERROR: process (pid: 3171150) is no longer running 00:05:40.462 15:34:39 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:40.462 15:34:39 -- common/autotest_common.sh@850 -- # return 1 00:05:40.462 15:34:39 -- common/autotest_common.sh@641 -- # es=1 00:05:40.462 15:34:39 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:05:40.462 15:34:39 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:05:40.462 15:34:39 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:05:40.462 15:34:39 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:05:40.462 15:34:39 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:40.462 15:34:39 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:40.462 15:34:39 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:40.462 15:34:39 -- event/cpu_locks.sh@141 -- # killprocess 3170920 00:05:40.462 15:34:39 -- common/autotest_common.sh@936 -- # '[' -z 3170920 ']' 00:05:40.462 15:34:39 -- common/autotest_common.sh@940 -- # kill -0 3170920 00:05:40.462 15:34:39 -- common/autotest_common.sh@941 -- # uname 00:05:40.462 15:34:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:40.462 15:34:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3170920 00:05:40.720 15:34:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:40.720 15:34:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:40.720 15:34:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3170920' 00:05:40.720 killing process with pid 3170920 00:05:40.720 15:34:39 -- common/autotest_common.sh@955 -- # kill 3170920 00:05:40.720 15:34:39 -- common/autotest_common.sh@960 -- # wait 3170920 00:05:40.979 00:05:40.979 real 0m1.900s 00:05:40.979 user 0m5.293s 00:05:40.979 sys 0m0.390s 00:05:40.979 15:34:39 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:40.979 15:34:39 -- common/autotest_common.sh@10 -- # set +x 00:05:40.979 ************************************ 00:05:40.979 END TEST locking_overlapped_coremask 00:05:40.979 ************************************ 00:05:40.979 15:34:39 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:05:40.979 15:34:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:40.979 15:34:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:40.979 15:34:39 -- common/autotest_common.sh@10 -- # set +x 00:05:41.240 ************************************ 00:05:41.240 START TEST locking_overlapped_coremask_via_rpc 00:05:41.240 ************************************ 00:05:41.240 15:34:39 -- common/autotest_common.sh@1111 -- # locking_overlapped_coremask_via_rpc 00:05:41.240 15:34:39 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=3171417 00:05:41.240 15:34:39 -- event/cpu_locks.sh@149 -- # waitforlisten 3171417 /var/tmp/spdk.sock 00:05:41.240 15:34:39 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:05:41.240 15:34:39 -- common/autotest_common.sh@817 -- # '[' -z 3171417 ']' 00:05:41.240 15:34:39 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:41.240 15:34:39 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:41.240 15:34:39 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:41.240 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:41.240 15:34:39 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:41.240 15:34:39 -- common/autotest_common.sh@10 -- # set +x 00:05:41.240 [2024-04-26 15:34:39.642063] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:05:41.240 [2024-04-26 15:34:39.642102] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3171417 ] 00:05:41.240 EAL: No free 2048 kB hugepages reported on node 1 00:05:41.240 [2024-04-26 15:34:39.696728] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:41.240 [2024-04-26 15:34:39.696752] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:41.240 [2024-04-26 15:34:39.767745] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:41.240 [2024-04-26 15:34:39.767845] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:41.240 [2024-04-26 15:34:39.767845] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:42.175 15:34:40 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:42.175 15:34:40 -- common/autotest_common.sh@850 -- # return 0 00:05:42.175 15:34:40 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=3171452 00:05:42.175 15:34:40 -- event/cpu_locks.sh@153 -- # waitforlisten 3171452 /var/tmp/spdk2.sock 00:05:42.175 15:34:40 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:05:42.175 15:34:40 -- common/autotest_common.sh@817 -- # '[' -z 3171452 ']' 00:05:42.175 15:34:40 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:42.175 15:34:40 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:42.175 15:34:40 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:42.175 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:42.175 15:34:40 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:42.175 15:34:40 -- common/autotest_common.sh@10 -- # set +x 00:05:42.175 [2024-04-26 15:34:40.482157] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:05:42.175 [2024-04-26 15:34:40.482208] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3171452 ] 00:05:42.175 EAL: No free 2048 kB hugepages reported on node 1 00:05:42.175 [2024-04-26 15:34:40.558904] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:42.175 [2024-04-26 15:34:40.558931] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:42.175 [2024-04-26 15:34:40.703398] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:42.175 [2024-04-26 15:34:40.707185] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:42.175 [2024-04-26 15:34:40.707187] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:05:42.751 15:34:41 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:42.751 15:34:41 -- common/autotest_common.sh@850 -- # return 0 00:05:42.751 15:34:41 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:05:42.751 15:34:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:42.751 15:34:41 -- common/autotest_common.sh@10 -- # set +x 00:05:42.751 15:34:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:42.751 15:34:41 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:42.751 15:34:41 -- common/autotest_common.sh@638 -- # local es=0 00:05:42.751 15:34:41 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:42.751 15:34:41 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:05:42.751 15:34:41 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:42.751 15:34:41 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:05:42.751 15:34:41 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:42.751 15:34:41 -- common/autotest_common.sh@641 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:42.751 15:34:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:42.751 15:34:41 -- common/autotest_common.sh@10 -- # set +x 00:05:42.751 [2024-04-26 15:34:41.302210] app.c: 690:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 3171417 has claimed it. 00:05:42.751 request: 00:05:42.751 { 00:05:42.751 "method": "framework_enable_cpumask_locks", 00:05:42.751 "req_id": 1 00:05:42.751 } 00:05:42.751 Got JSON-RPC error response 00:05:42.751 response: 00:05:42.751 { 00:05:42.751 "code": -32603, 00:05:42.751 "message": "Failed to claim CPU core: 2" 00:05:42.751 } 00:05:42.751 15:34:41 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:05:42.751 15:34:41 -- common/autotest_common.sh@641 -- # es=1 00:05:42.751 15:34:41 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:05:42.751 15:34:41 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:05:42.751 15:34:41 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:05:42.751 15:34:41 -- event/cpu_locks.sh@158 -- # waitforlisten 3171417 /var/tmp/spdk.sock 00:05:42.751 15:34:41 -- common/autotest_common.sh@817 -- # '[' -z 3171417 ']' 00:05:42.751 15:34:41 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:42.751 15:34:41 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:42.751 15:34:41 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:42.751 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:42.751 15:34:41 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:42.751 15:34:41 -- common/autotest_common.sh@10 -- # set +x 00:05:43.010 15:34:41 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:43.010 15:34:41 -- common/autotest_common.sh@850 -- # return 0 00:05:43.010 15:34:41 -- event/cpu_locks.sh@159 -- # waitforlisten 3171452 /var/tmp/spdk2.sock 00:05:43.010 15:34:41 -- common/autotest_common.sh@817 -- # '[' -z 3171452 ']' 00:05:43.010 15:34:41 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:43.010 15:34:41 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:43.010 15:34:41 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:43.010 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:43.010 15:34:41 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:43.010 15:34:41 -- common/autotest_common.sh@10 -- # set +x 00:05:43.267 15:34:41 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:43.267 15:34:41 -- common/autotest_common.sh@850 -- # return 0 00:05:43.267 15:34:41 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:05:43.267 15:34:41 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:43.267 15:34:41 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:43.267 15:34:41 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:43.267 00:05:43.267 real 0m2.087s 00:05:43.267 user 0m0.867s 00:05:43.267 sys 0m0.160s 00:05:43.267 15:34:41 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:43.267 15:34:41 -- common/autotest_common.sh@10 -- # set +x 00:05:43.267 ************************************ 00:05:43.267 END TEST locking_overlapped_coremask_via_rpc 00:05:43.267 ************************************ 00:05:43.267 15:34:41 -- event/cpu_locks.sh@174 -- # cleanup 00:05:43.267 15:34:41 -- event/cpu_locks.sh@15 -- # [[ -z 3171417 ]] 00:05:43.267 15:34:41 -- event/cpu_locks.sh@15 -- # killprocess 3171417 00:05:43.267 15:34:41 -- common/autotest_common.sh@936 -- # '[' -z 3171417 ']' 00:05:43.267 15:34:41 -- common/autotest_common.sh@940 -- # kill -0 3171417 00:05:43.267 15:34:41 -- common/autotest_common.sh@941 -- # uname 00:05:43.267 15:34:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:43.267 15:34:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3171417 00:05:43.267 15:34:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:43.267 15:34:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:43.267 15:34:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3171417' 00:05:43.267 killing process with pid 3171417 00:05:43.267 15:34:41 -- common/autotest_common.sh@955 -- # kill 3171417 00:05:43.267 15:34:41 -- common/autotest_common.sh@960 -- # wait 3171417 00:05:43.524 15:34:42 -- event/cpu_locks.sh@16 -- # [[ -z 3171452 ]] 00:05:43.524 15:34:42 -- event/cpu_locks.sh@16 -- # killprocess 3171452 00:05:43.524 15:34:42 -- common/autotest_common.sh@936 -- # '[' -z 3171452 ']' 00:05:43.524 15:34:42 -- common/autotest_common.sh@940 -- # kill -0 3171452 00:05:43.524 15:34:42 -- common/autotest_common.sh@941 -- # uname 00:05:43.525 15:34:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:43.525 15:34:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3171452 00:05:43.783 15:34:42 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:05:43.783 15:34:42 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:05:43.783 15:34:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3171452' 00:05:43.783 killing process with pid 3171452 00:05:43.783 15:34:42 -- common/autotest_common.sh@955 -- # kill 3171452 00:05:43.783 15:34:42 -- common/autotest_common.sh@960 -- # wait 3171452 00:05:44.041 15:34:42 -- event/cpu_locks.sh@18 -- # rm -f 00:05:44.041 15:34:42 -- event/cpu_locks.sh@1 -- # cleanup 00:05:44.041 15:34:42 -- event/cpu_locks.sh@15 -- # [[ -z 3171417 ]] 00:05:44.042 15:34:42 -- event/cpu_locks.sh@15 -- # killprocess 3171417 00:05:44.042 15:34:42 -- common/autotest_common.sh@936 -- # '[' -z 3171417 ']' 00:05:44.042 15:34:42 -- common/autotest_common.sh@940 -- # kill -0 3171417 00:05:44.042 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3171417) - No such process 00:05:44.042 15:34:42 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3171417 is not found' 00:05:44.042 Process with pid 3171417 is not found 00:05:44.042 15:34:42 -- event/cpu_locks.sh@16 -- # [[ -z 3171452 ]] 00:05:44.042 15:34:42 -- event/cpu_locks.sh@16 -- # killprocess 3171452 00:05:44.042 15:34:42 -- common/autotest_common.sh@936 -- # '[' -z 3171452 ']' 00:05:44.042 15:34:42 -- common/autotest_common.sh@940 -- # kill -0 3171452 00:05:44.042 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3171452) - No such process 00:05:44.042 15:34:42 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3171452 is not found' 00:05:44.042 Process with pid 3171452 is not found 00:05:44.042 15:34:42 -- event/cpu_locks.sh@18 -- # rm -f 00:05:44.042 00:05:44.042 real 0m17.688s 00:05:44.042 user 0m29.607s 00:05:44.042 sys 0m5.016s 00:05:44.042 15:34:42 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:44.042 15:34:42 -- common/autotest_common.sh@10 -- # set +x 00:05:44.042 ************************************ 00:05:44.042 END TEST cpu_locks 00:05:44.042 ************************************ 00:05:44.042 00:05:44.042 real 0m43.975s 00:05:44.042 user 1m20.082s 00:05:44.042 sys 0m8.565s 00:05:44.042 15:34:42 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:44.042 15:34:42 -- common/autotest_common.sh@10 -- # set +x 00:05:44.042 ************************************ 00:05:44.042 END TEST event 00:05:44.042 ************************************ 00:05:44.042 15:34:42 -- spdk/autotest.sh@178 -- # run_test thread /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/thread.sh 00:05:44.042 15:34:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:44.042 15:34:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:44.042 15:34:42 -- common/autotest_common.sh@10 -- # set +x 00:05:44.301 ************************************ 00:05:44.301 START TEST thread 00:05:44.301 ************************************ 00:05:44.301 15:34:42 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/thread.sh 00:05:44.301 * Looking for test storage... 00:05:44.301 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread 00:05:44.301 15:34:42 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:44.301 15:34:42 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:44.301 15:34:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:44.301 15:34:42 -- common/autotest_common.sh@10 -- # set +x 00:05:44.560 ************************************ 00:05:44.560 START TEST thread_poller_perf 00:05:44.560 ************************************ 00:05:44.560 15:34:42 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:44.560 [2024-04-26 15:34:42.938911] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:05:44.560 [2024-04-26 15:34:42.938991] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3172007 ] 00:05:44.560 EAL: No free 2048 kB hugepages reported on node 1 00:05:44.560 [2024-04-26 15:34:42.997956] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:44.560 [2024-04-26 15:34:43.067943] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:44.560 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:05:45.935 ====================================== 00:05:45.935 busy:2104996680 (cyc) 00:05:45.935 total_run_count: 414000 00:05:45.935 tsc_hz: 2100000000 (cyc) 00:05:45.935 ====================================== 00:05:45.935 poller_cost: 5084 (cyc), 2420 (nsec) 00:05:45.935 00:05:45.935 real 0m1.249s 00:05:45.935 user 0m1.166s 00:05:45.935 sys 0m0.079s 00:05:45.935 15:34:44 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:45.935 15:34:44 -- common/autotest_common.sh@10 -- # set +x 00:05:45.935 ************************************ 00:05:45.935 END TEST thread_poller_perf 00:05:45.935 ************************************ 00:05:45.935 15:34:44 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:45.935 15:34:44 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:45.935 15:34:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:45.935 15:34:44 -- common/autotest_common.sh@10 -- # set +x 00:05:45.935 ************************************ 00:05:45.935 START TEST thread_poller_perf 00:05:45.935 ************************************ 00:05:45.935 15:34:44 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:45.935 [2024-04-26 15:34:44.357389] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:05:45.935 [2024-04-26 15:34:44.357464] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3172260 ] 00:05:45.935 EAL: No free 2048 kB hugepages reported on node 1 00:05:45.935 [2024-04-26 15:34:44.417600] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:45.935 [2024-04-26 15:34:44.494402] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:45.935 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:05:47.310 ====================================== 00:05:47.310 busy:2101450288 (cyc) 00:05:47.310 total_run_count: 5608000 00:05:47.310 tsc_hz: 2100000000 (cyc) 00:05:47.310 ====================================== 00:05:47.310 poller_cost: 374 (cyc), 178 (nsec) 00:05:47.310 00:05:47.310 real 0m1.246s 00:05:47.310 user 0m1.165s 00:05:47.310 sys 0m0.076s 00:05:47.310 15:34:45 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:47.310 15:34:45 -- common/autotest_common.sh@10 -- # set +x 00:05:47.310 ************************************ 00:05:47.311 END TEST thread_poller_perf 00:05:47.311 ************************************ 00:05:47.311 15:34:45 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:05:47.311 00:05:47.311 real 0m2.919s 00:05:47.311 user 0m2.502s 00:05:47.311 sys 0m0.393s 00:05:47.311 15:34:45 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:47.311 15:34:45 -- common/autotest_common.sh@10 -- # set +x 00:05:47.311 ************************************ 00:05:47.311 END TEST thread 00:05:47.311 ************************************ 00:05:47.311 15:34:45 -- spdk/autotest.sh@179 -- # run_test accel /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/accel.sh 00:05:47.311 15:34:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:47.311 15:34:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:47.311 15:34:45 -- common/autotest_common.sh@10 -- # set +x 00:05:47.311 ************************************ 00:05:47.311 START TEST accel 00:05:47.311 ************************************ 00:05:47.311 15:34:45 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/accel.sh 00:05:47.311 * Looking for test storage... 00:05:47.311 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel 00:05:47.311 15:34:45 -- accel/accel.sh@81 -- # declare -A expected_opcs 00:05:47.311 15:34:45 -- accel/accel.sh@82 -- # get_expected_opcs 00:05:47.311 15:34:45 -- accel/accel.sh@60 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:47.311 15:34:45 -- accel/accel.sh@62 -- # spdk_tgt_pid=3172560 00:05:47.311 15:34:45 -- accel/accel.sh@63 -- # waitforlisten 3172560 00:05:47.311 15:34:45 -- common/autotest_common.sh@817 -- # '[' -z 3172560 ']' 00:05:47.311 15:34:45 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:47.311 15:34:45 -- accel/accel.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:05:47.311 15:34:45 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:47.311 15:34:45 -- accel/accel.sh@61 -- # build_accel_config 00:05:47.311 15:34:45 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:47.311 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:47.311 15:34:45 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:47.311 15:34:45 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:47.311 15:34:45 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:47.311 15:34:45 -- common/autotest_common.sh@10 -- # set +x 00:05:47.311 15:34:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:47.311 15:34:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:47.311 15:34:45 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:47.311 15:34:45 -- accel/accel.sh@40 -- # local IFS=, 00:05:47.311 15:34:45 -- accel/accel.sh@41 -- # jq -r . 00:05:47.311 [2024-04-26 15:34:45.884543] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:05:47.311 [2024-04-26 15:34:45.884589] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3172560 ] 00:05:47.311 EAL: No free 2048 kB hugepages reported on node 1 00:05:47.569 [2024-04-26 15:34:45.939781] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:47.569 [2024-04-26 15:34:46.012244] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:48.135 15:34:46 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:48.135 15:34:46 -- common/autotest_common.sh@850 -- # return 0 00:05:48.135 15:34:46 -- accel/accel.sh@65 -- # [[ 0 -gt 0 ]] 00:05:48.135 15:34:46 -- accel/accel.sh@66 -- # [[ 0 -gt 0 ]] 00:05:48.135 15:34:46 -- accel/accel.sh@67 -- # [[ 0 -gt 0 ]] 00:05:48.135 15:34:46 -- accel/accel.sh@68 -- # [[ -n '' ]] 00:05:48.135 15:34:46 -- accel/accel.sh@70 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:05:48.135 15:34:46 -- accel/accel.sh@70 -- # rpc_cmd accel_get_opc_assignments 00:05:48.135 15:34:46 -- accel/accel.sh@70 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:05:48.135 15:34:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:48.135 15:34:46 -- common/autotest_common.sh@10 -- # set +x 00:05:48.135 15:34:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:48.135 15:34:46 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:48.135 15:34:46 -- accel/accel.sh@72 -- # IFS== 00:05:48.135 15:34:46 -- accel/accel.sh@72 -- # read -r opc module 00:05:48.135 15:34:46 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:48.135 15:34:46 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:48.135 15:34:46 -- accel/accel.sh@72 -- # IFS== 00:05:48.135 15:34:46 -- accel/accel.sh@72 -- # read -r opc module 00:05:48.135 15:34:46 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:48.135 15:34:46 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:48.135 15:34:46 -- accel/accel.sh@72 -- # IFS== 00:05:48.135 15:34:46 -- accel/accel.sh@72 -- # read -r opc module 00:05:48.135 15:34:46 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:48.135 15:34:46 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:48.135 15:34:46 -- accel/accel.sh@72 -- # IFS== 00:05:48.135 15:34:46 -- accel/accel.sh@72 -- # read -r opc module 00:05:48.135 15:34:46 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:48.135 15:34:46 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:48.135 15:34:46 -- accel/accel.sh@72 -- # IFS== 00:05:48.135 15:34:46 -- accel/accel.sh@72 -- # read -r opc module 00:05:48.135 15:34:46 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:48.135 15:34:46 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:48.135 15:34:46 -- accel/accel.sh@72 -- # IFS== 00:05:48.135 15:34:46 -- accel/accel.sh@72 -- # read -r opc module 00:05:48.135 15:34:46 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:48.135 15:34:46 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:48.135 15:34:46 -- accel/accel.sh@72 -- # IFS== 00:05:48.135 15:34:46 -- accel/accel.sh@72 -- # read -r opc module 00:05:48.135 15:34:46 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:48.135 15:34:46 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:48.135 15:34:46 -- accel/accel.sh@72 -- # IFS== 00:05:48.135 15:34:46 -- accel/accel.sh@72 -- # read -r opc module 00:05:48.135 15:34:46 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:48.135 15:34:46 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:48.135 15:34:46 -- accel/accel.sh@72 -- # IFS== 00:05:48.135 15:34:46 -- accel/accel.sh@72 -- # read -r opc module 00:05:48.135 15:34:46 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:48.135 15:34:46 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:48.135 15:34:46 -- accel/accel.sh@72 -- # IFS== 00:05:48.135 15:34:46 -- accel/accel.sh@72 -- # read -r opc module 00:05:48.135 15:34:46 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:48.135 15:34:46 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:48.135 15:34:46 -- accel/accel.sh@72 -- # IFS== 00:05:48.135 15:34:46 -- accel/accel.sh@72 -- # read -r opc module 00:05:48.135 15:34:46 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:48.135 15:34:46 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:48.135 15:34:46 -- accel/accel.sh@72 -- # IFS== 00:05:48.135 15:34:46 -- accel/accel.sh@72 -- # read -r opc module 00:05:48.136 15:34:46 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:48.136 15:34:46 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:48.136 15:34:46 -- accel/accel.sh@72 -- # IFS== 00:05:48.136 15:34:46 -- accel/accel.sh@72 -- # read -r opc module 00:05:48.136 15:34:46 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:48.136 15:34:46 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:05:48.136 15:34:46 -- accel/accel.sh@72 -- # IFS== 00:05:48.136 15:34:46 -- accel/accel.sh@72 -- # read -r opc module 00:05:48.136 15:34:46 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:05:48.136 15:34:46 -- accel/accel.sh@75 -- # killprocess 3172560 00:05:48.136 15:34:46 -- common/autotest_common.sh@936 -- # '[' -z 3172560 ']' 00:05:48.136 15:34:46 -- common/autotest_common.sh@940 -- # kill -0 3172560 00:05:48.136 15:34:46 -- common/autotest_common.sh@941 -- # uname 00:05:48.136 15:34:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:48.136 15:34:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3172560 00:05:48.393 15:34:46 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:48.393 15:34:46 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:48.393 15:34:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3172560' 00:05:48.393 killing process with pid 3172560 00:05:48.393 15:34:46 -- common/autotest_common.sh@955 -- # kill 3172560 00:05:48.393 15:34:46 -- common/autotest_common.sh@960 -- # wait 3172560 00:05:48.651 15:34:47 -- accel/accel.sh@76 -- # trap - ERR 00:05:48.651 15:34:47 -- accel/accel.sh@89 -- # run_test accel_help accel_perf -h 00:05:48.651 15:34:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:05:48.651 15:34:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:48.651 15:34:47 -- common/autotest_common.sh@10 -- # set +x 00:05:48.651 15:34:47 -- common/autotest_common.sh@1111 -- # accel_perf -h 00:05:48.652 15:34:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:05:48.652 15:34:47 -- accel/accel.sh@12 -- # build_accel_config 00:05:48.652 15:34:47 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:48.652 15:34:47 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:48.652 15:34:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:48.652 15:34:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:48.652 15:34:47 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:48.652 15:34:47 -- accel/accel.sh@40 -- # local IFS=, 00:05:48.652 15:34:47 -- accel/accel.sh@41 -- # jq -r . 00:05:48.652 15:34:47 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:48.652 15:34:47 -- common/autotest_common.sh@10 -- # set +x 00:05:48.910 15:34:47 -- accel/accel.sh@91 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:05:48.910 15:34:47 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:48.910 15:34:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:48.910 15:34:47 -- common/autotest_common.sh@10 -- # set +x 00:05:48.910 ************************************ 00:05:48.910 START TEST accel_missing_filename 00:05:48.910 ************************************ 00:05:48.910 15:34:47 -- common/autotest_common.sh@1111 -- # NOT accel_perf -t 1 -w compress 00:05:48.910 15:34:47 -- common/autotest_common.sh@638 -- # local es=0 00:05:48.910 15:34:47 -- common/autotest_common.sh@640 -- # valid_exec_arg accel_perf -t 1 -w compress 00:05:48.911 15:34:47 -- common/autotest_common.sh@626 -- # local arg=accel_perf 00:05:48.911 15:34:47 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:48.911 15:34:47 -- common/autotest_common.sh@630 -- # type -t accel_perf 00:05:48.911 15:34:47 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:48.911 15:34:47 -- common/autotest_common.sh@641 -- # accel_perf -t 1 -w compress 00:05:48.911 15:34:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:05:48.911 15:34:47 -- accel/accel.sh@12 -- # build_accel_config 00:05:48.911 15:34:47 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:48.911 15:34:47 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:48.911 15:34:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:48.911 15:34:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:48.911 15:34:47 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:48.911 15:34:47 -- accel/accel.sh@40 -- # local IFS=, 00:05:48.911 15:34:47 -- accel/accel.sh@41 -- # jq -r . 00:05:48.911 [2024-04-26 15:34:47.439122] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:05:48.911 [2024-04-26 15:34:47.439193] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3172895 ] 00:05:48.911 EAL: No free 2048 kB hugepages reported on node 1 00:05:48.911 [2024-04-26 15:34:47.496513] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:49.170 [2024-04-26 15:34:47.569474] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:49.170 [2024-04-26 15:34:47.610597] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:49.170 [2024-04-26 15:34:47.670398] accel_perf.c:1394:main: *ERROR*: ERROR starting application 00:05:49.170 A filename is required. 00:05:49.170 15:34:47 -- common/autotest_common.sh@641 -- # es=234 00:05:49.170 15:34:47 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:05:49.170 15:34:47 -- common/autotest_common.sh@650 -- # es=106 00:05:49.170 15:34:47 -- common/autotest_common.sh@651 -- # case "$es" in 00:05:49.170 15:34:47 -- common/autotest_common.sh@658 -- # es=1 00:05:49.170 15:34:47 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:05:49.170 00:05:49.170 real 0m0.355s 00:05:49.170 user 0m0.274s 00:05:49.170 sys 0m0.120s 00:05:49.170 15:34:47 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:49.170 15:34:47 -- common/autotest_common.sh@10 -- # set +x 00:05:49.170 ************************************ 00:05:49.170 END TEST accel_missing_filename 00:05:49.170 ************************************ 00:05:49.429 15:34:47 -- accel/accel.sh@93 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:05:49.429 15:34:47 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:49.429 15:34:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:49.429 15:34:47 -- common/autotest_common.sh@10 -- # set +x 00:05:49.429 ************************************ 00:05:49.429 START TEST accel_compress_verify 00:05:49.429 ************************************ 00:05:49.429 15:34:47 -- common/autotest_common.sh@1111 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:05:49.429 15:34:47 -- common/autotest_common.sh@638 -- # local es=0 00:05:49.429 15:34:47 -- common/autotest_common.sh@640 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:05:49.429 15:34:47 -- common/autotest_common.sh@626 -- # local arg=accel_perf 00:05:49.429 15:34:47 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:49.429 15:34:47 -- common/autotest_common.sh@630 -- # type -t accel_perf 00:05:49.429 15:34:47 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:49.429 15:34:47 -- common/autotest_common.sh@641 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:05:49.429 15:34:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:05:49.429 15:34:47 -- accel/accel.sh@12 -- # build_accel_config 00:05:49.429 15:34:47 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:49.429 15:34:47 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:49.429 15:34:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:49.429 15:34:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:49.429 15:34:47 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:49.429 15:34:47 -- accel/accel.sh@40 -- # local IFS=, 00:05:49.429 15:34:47 -- accel/accel.sh@41 -- # jq -r . 00:05:49.429 [2024-04-26 15:34:47.954230] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:05:49.429 [2024-04-26 15:34:47.954295] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3173091 ] 00:05:49.429 EAL: No free 2048 kB hugepages reported on node 1 00:05:49.429 [2024-04-26 15:34:48.011209] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:49.688 [2024-04-26 15:34:48.082067] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:49.688 [2024-04-26 15:34:48.122723] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:49.688 [2024-04-26 15:34:48.182255] accel_perf.c:1394:main: *ERROR*: ERROR starting application 00:05:49.688 00:05:49.688 Compression does not support the verify option, aborting. 00:05:49.688 15:34:48 -- common/autotest_common.sh@641 -- # es=161 00:05:49.688 15:34:48 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:05:49.688 15:34:48 -- common/autotest_common.sh@650 -- # es=33 00:05:49.688 15:34:48 -- common/autotest_common.sh@651 -- # case "$es" in 00:05:49.688 15:34:48 -- common/autotest_common.sh@658 -- # es=1 00:05:49.688 15:34:48 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:05:49.688 00:05:49.688 real 0m0.353s 00:05:49.688 user 0m0.277s 00:05:49.688 sys 0m0.117s 00:05:49.688 15:34:48 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:49.688 15:34:48 -- common/autotest_common.sh@10 -- # set +x 00:05:49.688 ************************************ 00:05:49.688 END TEST accel_compress_verify 00:05:49.688 ************************************ 00:05:49.946 15:34:48 -- accel/accel.sh@95 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:05:49.946 15:34:48 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:49.946 15:34:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:49.946 15:34:48 -- common/autotest_common.sh@10 -- # set +x 00:05:49.946 ************************************ 00:05:49.946 START TEST accel_wrong_workload 00:05:49.946 ************************************ 00:05:49.946 15:34:48 -- common/autotest_common.sh@1111 -- # NOT accel_perf -t 1 -w foobar 00:05:49.946 15:34:48 -- common/autotest_common.sh@638 -- # local es=0 00:05:49.946 15:34:48 -- common/autotest_common.sh@640 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:05:49.946 15:34:48 -- common/autotest_common.sh@626 -- # local arg=accel_perf 00:05:49.946 15:34:48 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:49.946 15:34:48 -- common/autotest_common.sh@630 -- # type -t accel_perf 00:05:49.946 15:34:48 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:49.946 15:34:48 -- common/autotest_common.sh@641 -- # accel_perf -t 1 -w foobar 00:05:49.946 15:34:48 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:05:49.946 15:34:48 -- accel/accel.sh@12 -- # build_accel_config 00:05:49.946 15:34:48 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:49.946 15:34:48 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:49.946 15:34:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:49.946 15:34:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:49.946 15:34:48 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:49.946 15:34:48 -- accel/accel.sh@40 -- # local IFS=, 00:05:49.946 15:34:48 -- accel/accel.sh@41 -- # jq -r . 00:05:49.946 Unsupported workload type: foobar 00:05:49.946 [2024-04-26 15:34:48.468200] app.c:1364:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:05:49.946 accel_perf options: 00:05:49.946 [-h help message] 00:05:49.946 [-q queue depth per core] 00:05:49.946 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:49.946 [-T number of threads per core 00:05:49.946 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:49.946 [-t time in seconds] 00:05:49.946 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:49.946 [ dif_verify, , dif_generate, dif_generate_copy 00:05:49.946 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:49.946 [-l for compress/decompress workloads, name of uncompressed input file 00:05:49.946 [-S for crc32c workload, use this seed value (default 0) 00:05:49.946 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:49.946 [-f for fill workload, use this BYTE value (default 255) 00:05:49.946 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:49.946 [-y verify result if this switch is on] 00:05:49.946 [-a tasks to allocate per core (default: same value as -q)] 00:05:49.946 Can be used to spread operations across a wider range of memory. 00:05:49.946 15:34:48 -- common/autotest_common.sh@641 -- # es=1 00:05:49.946 15:34:48 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:05:49.946 15:34:48 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:05:49.946 15:34:48 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:05:49.946 00:05:49.946 real 0m0.035s 00:05:49.946 user 0m0.018s 00:05:49.946 sys 0m0.017s 00:05:49.946 15:34:48 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:49.946 15:34:48 -- common/autotest_common.sh@10 -- # set +x 00:05:49.946 ************************************ 00:05:49.946 END TEST accel_wrong_workload 00:05:49.946 ************************************ 00:05:49.946 Error: writing output failed: Broken pipe 00:05:49.946 15:34:48 -- accel/accel.sh@97 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:05:49.946 15:34:48 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:49.947 15:34:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:49.947 15:34:48 -- common/autotest_common.sh@10 -- # set +x 00:05:50.207 ************************************ 00:05:50.207 START TEST accel_negative_buffers 00:05:50.207 ************************************ 00:05:50.207 15:34:48 -- common/autotest_common.sh@1111 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:05:50.207 15:34:48 -- common/autotest_common.sh@638 -- # local es=0 00:05:50.207 15:34:48 -- common/autotest_common.sh@640 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:05:50.207 15:34:48 -- common/autotest_common.sh@626 -- # local arg=accel_perf 00:05:50.207 15:34:48 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:50.207 15:34:48 -- common/autotest_common.sh@630 -- # type -t accel_perf 00:05:50.207 15:34:48 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:05:50.207 15:34:48 -- common/autotest_common.sh@641 -- # accel_perf -t 1 -w xor -y -x -1 00:05:50.207 15:34:48 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:05:50.207 15:34:48 -- accel/accel.sh@12 -- # build_accel_config 00:05:50.207 15:34:48 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:50.207 15:34:48 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:50.207 15:34:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:50.207 15:34:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:50.207 15:34:48 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:50.207 15:34:48 -- accel/accel.sh@40 -- # local IFS=, 00:05:50.207 15:34:48 -- accel/accel.sh@41 -- # jq -r . 00:05:50.207 -x option must be non-negative. 00:05:50.207 [2024-04-26 15:34:48.664528] app.c:1364:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:05:50.207 accel_perf options: 00:05:50.207 [-h help message] 00:05:50.207 [-q queue depth per core] 00:05:50.207 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:50.207 [-T number of threads per core 00:05:50.207 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:50.207 [-t time in seconds] 00:05:50.207 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:50.207 [ dif_verify, , dif_generate, dif_generate_copy 00:05:50.207 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:50.207 [-l for compress/decompress workloads, name of uncompressed input file 00:05:50.207 [-S for crc32c workload, use this seed value (default 0) 00:05:50.207 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:50.207 [-f for fill workload, use this BYTE value (default 255) 00:05:50.207 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:50.207 [-y verify result if this switch is on] 00:05:50.207 [-a tasks to allocate per core (default: same value as -q)] 00:05:50.207 Can be used to spread operations across a wider range of memory. 00:05:50.207 15:34:48 -- common/autotest_common.sh@641 -- # es=1 00:05:50.207 15:34:48 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:05:50.207 15:34:48 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:05:50.207 15:34:48 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:05:50.207 00:05:50.207 real 0m0.033s 00:05:50.207 user 0m0.021s 00:05:50.207 sys 0m0.012s 00:05:50.207 15:34:48 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:50.207 15:34:48 -- common/autotest_common.sh@10 -- # set +x 00:05:50.207 ************************************ 00:05:50.207 END TEST accel_negative_buffers 00:05:50.207 ************************************ 00:05:50.207 Error: writing output failed: Broken pipe 00:05:50.207 15:34:48 -- accel/accel.sh@101 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:05:50.207 15:34:48 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:50.207 15:34:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:50.207 15:34:48 -- common/autotest_common.sh@10 -- # set +x 00:05:50.466 ************************************ 00:05:50.466 START TEST accel_crc32c 00:05:50.466 ************************************ 00:05:50.466 15:34:48 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w crc32c -S 32 -y 00:05:50.466 15:34:48 -- accel/accel.sh@16 -- # local accel_opc 00:05:50.466 15:34:48 -- accel/accel.sh@17 -- # local accel_module 00:05:50.466 15:34:48 -- accel/accel.sh@19 -- # IFS=: 00:05:50.466 15:34:48 -- accel/accel.sh@19 -- # read -r var val 00:05:50.466 15:34:48 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:50.466 15:34:48 -- accel/accel.sh@12 -- # build_accel_config 00:05:50.466 15:34:48 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:50.466 15:34:48 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:50.466 15:34:48 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:50.466 15:34:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:50.466 15:34:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:50.466 15:34:48 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:50.466 15:34:48 -- accel/accel.sh@40 -- # local IFS=, 00:05:50.466 15:34:48 -- accel/accel.sh@41 -- # jq -r . 00:05:50.466 [2024-04-26 15:34:48.856552] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:05:50.466 [2024-04-26 15:34:48.856618] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3173247 ] 00:05:50.466 EAL: No free 2048 kB hugepages reported on node 1 00:05:50.466 [2024-04-26 15:34:48.913779] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:50.466 [2024-04-26 15:34:48.983371] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:50.466 15:34:49 -- accel/accel.sh@20 -- # val= 00:05:50.466 15:34:49 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.466 15:34:49 -- accel/accel.sh@19 -- # IFS=: 00:05:50.466 15:34:49 -- accel/accel.sh@19 -- # read -r var val 00:05:50.466 15:34:49 -- accel/accel.sh@20 -- # val= 00:05:50.466 15:34:49 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.466 15:34:49 -- accel/accel.sh@19 -- # IFS=: 00:05:50.466 15:34:49 -- accel/accel.sh@19 -- # read -r var val 00:05:50.466 15:34:49 -- accel/accel.sh@20 -- # val=0x1 00:05:50.466 15:34:49 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.466 15:34:49 -- accel/accel.sh@19 -- # IFS=: 00:05:50.466 15:34:49 -- accel/accel.sh@19 -- # read -r var val 00:05:50.466 15:34:49 -- accel/accel.sh@20 -- # val= 00:05:50.466 15:34:49 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.466 15:34:49 -- accel/accel.sh@19 -- # IFS=: 00:05:50.466 15:34:49 -- accel/accel.sh@19 -- # read -r var val 00:05:50.466 15:34:49 -- accel/accel.sh@20 -- # val= 00:05:50.466 15:34:49 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.466 15:34:49 -- accel/accel.sh@19 -- # IFS=: 00:05:50.466 15:34:49 -- accel/accel.sh@19 -- # read -r var val 00:05:50.466 15:34:49 -- accel/accel.sh@20 -- # val=crc32c 00:05:50.466 15:34:49 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.466 15:34:49 -- accel/accel.sh@23 -- # accel_opc=crc32c 00:05:50.466 15:34:49 -- accel/accel.sh@19 -- # IFS=: 00:05:50.466 15:34:49 -- accel/accel.sh@19 -- # read -r var val 00:05:50.466 15:34:49 -- accel/accel.sh@20 -- # val=32 00:05:50.466 15:34:49 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.466 15:34:49 -- accel/accel.sh@19 -- # IFS=: 00:05:50.466 15:34:49 -- accel/accel.sh@19 -- # read -r var val 00:05:50.466 15:34:49 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:50.466 15:34:49 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.467 15:34:49 -- accel/accel.sh@19 -- # IFS=: 00:05:50.467 15:34:49 -- accel/accel.sh@19 -- # read -r var val 00:05:50.467 15:34:49 -- accel/accel.sh@20 -- # val= 00:05:50.467 15:34:49 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.467 15:34:49 -- accel/accel.sh@19 -- # IFS=: 00:05:50.467 15:34:49 -- accel/accel.sh@19 -- # read -r var val 00:05:50.467 15:34:49 -- accel/accel.sh@20 -- # val=software 00:05:50.467 15:34:49 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.467 15:34:49 -- accel/accel.sh@22 -- # accel_module=software 00:05:50.467 15:34:49 -- accel/accel.sh@19 -- # IFS=: 00:05:50.467 15:34:49 -- accel/accel.sh@19 -- # read -r var val 00:05:50.467 15:34:49 -- accel/accel.sh@20 -- # val=32 00:05:50.467 15:34:49 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.467 15:34:49 -- accel/accel.sh@19 -- # IFS=: 00:05:50.467 15:34:49 -- accel/accel.sh@19 -- # read -r var val 00:05:50.467 15:34:49 -- accel/accel.sh@20 -- # val=32 00:05:50.467 15:34:49 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.467 15:34:49 -- accel/accel.sh@19 -- # IFS=: 00:05:50.467 15:34:49 -- accel/accel.sh@19 -- # read -r var val 00:05:50.467 15:34:49 -- accel/accel.sh@20 -- # val=1 00:05:50.467 15:34:49 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.467 15:34:49 -- accel/accel.sh@19 -- # IFS=: 00:05:50.467 15:34:49 -- accel/accel.sh@19 -- # read -r var val 00:05:50.467 15:34:49 -- accel/accel.sh@20 -- # val='1 seconds' 00:05:50.467 15:34:49 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.467 15:34:49 -- accel/accel.sh@19 -- # IFS=: 00:05:50.467 15:34:49 -- accel/accel.sh@19 -- # read -r var val 00:05:50.467 15:34:49 -- accel/accel.sh@20 -- # val=Yes 00:05:50.467 15:34:49 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.467 15:34:49 -- accel/accel.sh@19 -- # IFS=: 00:05:50.467 15:34:49 -- accel/accel.sh@19 -- # read -r var val 00:05:50.467 15:34:49 -- accel/accel.sh@20 -- # val= 00:05:50.467 15:34:49 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.467 15:34:49 -- accel/accel.sh@19 -- # IFS=: 00:05:50.467 15:34:49 -- accel/accel.sh@19 -- # read -r var val 00:05:50.467 15:34:49 -- accel/accel.sh@20 -- # val= 00:05:50.467 15:34:49 -- accel/accel.sh@21 -- # case "$var" in 00:05:50.467 15:34:49 -- accel/accel.sh@19 -- # IFS=: 00:05:50.467 15:34:49 -- accel/accel.sh@19 -- # read -r var val 00:05:51.840 15:34:50 -- accel/accel.sh@20 -- # val= 00:05:51.840 15:34:50 -- accel/accel.sh@21 -- # case "$var" in 00:05:51.840 15:34:50 -- accel/accel.sh@19 -- # IFS=: 00:05:51.840 15:34:50 -- accel/accel.sh@19 -- # read -r var val 00:05:51.840 15:34:50 -- accel/accel.sh@20 -- # val= 00:05:51.840 15:34:50 -- accel/accel.sh@21 -- # case "$var" in 00:05:51.840 15:34:50 -- accel/accel.sh@19 -- # IFS=: 00:05:51.840 15:34:50 -- accel/accel.sh@19 -- # read -r var val 00:05:51.840 15:34:50 -- accel/accel.sh@20 -- # val= 00:05:51.840 15:34:50 -- accel/accel.sh@21 -- # case "$var" in 00:05:51.840 15:34:50 -- accel/accel.sh@19 -- # IFS=: 00:05:51.840 15:34:50 -- accel/accel.sh@19 -- # read -r var val 00:05:51.840 15:34:50 -- accel/accel.sh@20 -- # val= 00:05:51.840 15:34:50 -- accel/accel.sh@21 -- # case "$var" in 00:05:51.840 15:34:50 -- accel/accel.sh@19 -- # IFS=: 00:05:51.840 15:34:50 -- accel/accel.sh@19 -- # read -r var val 00:05:51.840 15:34:50 -- accel/accel.sh@20 -- # val= 00:05:51.840 15:34:50 -- accel/accel.sh@21 -- # case "$var" in 00:05:51.840 15:34:50 -- accel/accel.sh@19 -- # IFS=: 00:05:51.840 15:34:50 -- accel/accel.sh@19 -- # read -r var val 00:05:51.840 15:34:50 -- accel/accel.sh@20 -- # val= 00:05:51.840 15:34:50 -- accel/accel.sh@21 -- # case "$var" in 00:05:51.840 15:34:50 -- accel/accel.sh@19 -- # IFS=: 00:05:51.840 15:34:50 -- accel/accel.sh@19 -- # read -r var val 00:05:51.840 15:34:50 -- accel/accel.sh@27 -- # [[ -n software ]] 00:05:51.840 15:34:50 -- accel/accel.sh@27 -- # [[ -n crc32c ]] 00:05:51.840 15:34:50 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:51.840 00:05:51.840 real 0m1.361s 00:05:51.840 user 0m1.257s 00:05:51.840 sys 0m0.118s 00:05:51.840 15:34:50 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:51.840 15:34:50 -- common/autotest_common.sh@10 -- # set +x 00:05:51.840 ************************************ 00:05:51.840 END TEST accel_crc32c 00:05:51.840 ************************************ 00:05:51.840 15:34:50 -- accel/accel.sh@102 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:05:51.840 15:34:50 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:51.840 15:34:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:51.840 15:34:50 -- common/autotest_common.sh@10 -- # set +x 00:05:51.840 ************************************ 00:05:51.840 START TEST accel_crc32c_C2 00:05:51.840 ************************************ 00:05:51.840 15:34:50 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w crc32c -y -C 2 00:05:51.840 15:34:50 -- accel/accel.sh@16 -- # local accel_opc 00:05:51.840 15:34:50 -- accel/accel.sh@17 -- # local accel_module 00:05:51.840 15:34:50 -- accel/accel.sh@19 -- # IFS=: 00:05:51.840 15:34:50 -- accel/accel.sh@19 -- # read -r var val 00:05:51.840 15:34:50 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:51.840 15:34:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:51.840 15:34:50 -- accel/accel.sh@12 -- # build_accel_config 00:05:51.840 15:34:50 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:51.840 15:34:50 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:51.840 15:34:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:51.840 15:34:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:51.840 15:34:50 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:51.840 15:34:50 -- accel/accel.sh@40 -- # local IFS=, 00:05:51.840 15:34:50 -- accel/accel.sh@41 -- # jq -r . 00:05:51.840 [2024-04-26 15:34:50.358929] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:05:51.840 [2024-04-26 15:34:50.358987] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3173582 ] 00:05:51.840 EAL: No free 2048 kB hugepages reported on node 1 00:05:51.840 [2024-04-26 15:34:50.417609] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:52.097 [2024-04-26 15:34:50.489236] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:52.097 15:34:50 -- accel/accel.sh@20 -- # val= 00:05:52.097 15:34:50 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.097 15:34:50 -- accel/accel.sh@19 -- # IFS=: 00:05:52.097 15:34:50 -- accel/accel.sh@19 -- # read -r var val 00:05:52.097 15:34:50 -- accel/accel.sh@20 -- # val= 00:05:52.097 15:34:50 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.097 15:34:50 -- accel/accel.sh@19 -- # IFS=: 00:05:52.097 15:34:50 -- accel/accel.sh@19 -- # read -r var val 00:05:52.097 15:34:50 -- accel/accel.sh@20 -- # val=0x1 00:05:52.097 15:34:50 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.097 15:34:50 -- accel/accel.sh@19 -- # IFS=: 00:05:52.097 15:34:50 -- accel/accel.sh@19 -- # read -r var val 00:05:52.097 15:34:50 -- accel/accel.sh@20 -- # val= 00:05:52.097 15:34:50 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.097 15:34:50 -- accel/accel.sh@19 -- # IFS=: 00:05:52.097 15:34:50 -- accel/accel.sh@19 -- # read -r var val 00:05:52.097 15:34:50 -- accel/accel.sh@20 -- # val= 00:05:52.097 15:34:50 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.097 15:34:50 -- accel/accel.sh@19 -- # IFS=: 00:05:52.097 15:34:50 -- accel/accel.sh@19 -- # read -r var val 00:05:52.097 15:34:50 -- accel/accel.sh@20 -- # val=crc32c 00:05:52.097 15:34:50 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.097 15:34:50 -- accel/accel.sh@23 -- # accel_opc=crc32c 00:05:52.097 15:34:50 -- accel/accel.sh@19 -- # IFS=: 00:05:52.097 15:34:50 -- accel/accel.sh@19 -- # read -r var val 00:05:52.097 15:34:50 -- accel/accel.sh@20 -- # val=0 00:05:52.097 15:34:50 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.097 15:34:50 -- accel/accel.sh@19 -- # IFS=: 00:05:52.097 15:34:50 -- accel/accel.sh@19 -- # read -r var val 00:05:52.097 15:34:50 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:52.097 15:34:50 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.097 15:34:50 -- accel/accel.sh@19 -- # IFS=: 00:05:52.097 15:34:50 -- accel/accel.sh@19 -- # read -r var val 00:05:52.097 15:34:50 -- accel/accel.sh@20 -- # val= 00:05:52.097 15:34:50 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.097 15:34:50 -- accel/accel.sh@19 -- # IFS=: 00:05:52.097 15:34:50 -- accel/accel.sh@19 -- # read -r var val 00:05:52.097 15:34:50 -- accel/accel.sh@20 -- # val=software 00:05:52.097 15:34:50 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.097 15:34:50 -- accel/accel.sh@22 -- # accel_module=software 00:05:52.097 15:34:50 -- accel/accel.sh@19 -- # IFS=: 00:05:52.097 15:34:50 -- accel/accel.sh@19 -- # read -r var val 00:05:52.097 15:34:50 -- accel/accel.sh@20 -- # val=32 00:05:52.097 15:34:50 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.097 15:34:50 -- accel/accel.sh@19 -- # IFS=: 00:05:52.097 15:34:50 -- accel/accel.sh@19 -- # read -r var val 00:05:52.097 15:34:50 -- accel/accel.sh@20 -- # val=32 00:05:52.097 15:34:50 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.097 15:34:50 -- accel/accel.sh@19 -- # IFS=: 00:05:52.097 15:34:50 -- accel/accel.sh@19 -- # read -r var val 00:05:52.097 15:34:50 -- accel/accel.sh@20 -- # val=1 00:05:52.097 15:34:50 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.097 15:34:50 -- accel/accel.sh@19 -- # IFS=: 00:05:52.097 15:34:50 -- accel/accel.sh@19 -- # read -r var val 00:05:52.097 15:34:50 -- accel/accel.sh@20 -- # val='1 seconds' 00:05:52.097 15:34:50 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.098 15:34:50 -- accel/accel.sh@19 -- # IFS=: 00:05:52.098 15:34:50 -- accel/accel.sh@19 -- # read -r var val 00:05:52.098 15:34:50 -- accel/accel.sh@20 -- # val=Yes 00:05:52.098 15:34:50 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.098 15:34:50 -- accel/accel.sh@19 -- # IFS=: 00:05:52.098 15:34:50 -- accel/accel.sh@19 -- # read -r var val 00:05:52.098 15:34:50 -- accel/accel.sh@20 -- # val= 00:05:52.098 15:34:50 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.098 15:34:50 -- accel/accel.sh@19 -- # IFS=: 00:05:52.098 15:34:50 -- accel/accel.sh@19 -- # read -r var val 00:05:52.098 15:34:50 -- accel/accel.sh@20 -- # val= 00:05:52.098 15:34:50 -- accel/accel.sh@21 -- # case "$var" in 00:05:52.098 15:34:50 -- accel/accel.sh@19 -- # IFS=: 00:05:52.098 15:34:50 -- accel/accel.sh@19 -- # read -r var val 00:05:53.472 15:34:51 -- accel/accel.sh@20 -- # val= 00:05:53.472 15:34:51 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.472 15:34:51 -- accel/accel.sh@19 -- # IFS=: 00:05:53.472 15:34:51 -- accel/accel.sh@19 -- # read -r var val 00:05:53.472 15:34:51 -- accel/accel.sh@20 -- # val= 00:05:53.472 15:34:51 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.472 15:34:51 -- accel/accel.sh@19 -- # IFS=: 00:05:53.472 15:34:51 -- accel/accel.sh@19 -- # read -r var val 00:05:53.472 15:34:51 -- accel/accel.sh@20 -- # val= 00:05:53.472 15:34:51 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.472 15:34:51 -- accel/accel.sh@19 -- # IFS=: 00:05:53.472 15:34:51 -- accel/accel.sh@19 -- # read -r var val 00:05:53.472 15:34:51 -- accel/accel.sh@20 -- # val= 00:05:53.472 15:34:51 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.472 15:34:51 -- accel/accel.sh@19 -- # IFS=: 00:05:53.472 15:34:51 -- accel/accel.sh@19 -- # read -r var val 00:05:53.472 15:34:51 -- accel/accel.sh@20 -- # val= 00:05:53.472 15:34:51 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.472 15:34:51 -- accel/accel.sh@19 -- # IFS=: 00:05:53.472 15:34:51 -- accel/accel.sh@19 -- # read -r var val 00:05:53.472 15:34:51 -- accel/accel.sh@20 -- # val= 00:05:53.472 15:34:51 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.472 15:34:51 -- accel/accel.sh@19 -- # IFS=: 00:05:53.472 15:34:51 -- accel/accel.sh@19 -- # read -r var val 00:05:53.472 15:34:51 -- accel/accel.sh@27 -- # [[ -n software ]] 00:05:53.472 15:34:51 -- accel/accel.sh@27 -- # [[ -n crc32c ]] 00:05:53.472 15:34:51 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:53.472 00:05:53.472 real 0m1.360s 00:05:53.472 user 0m1.249s 00:05:53.472 sys 0m0.125s 00:05:53.472 15:34:51 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:53.472 15:34:51 -- common/autotest_common.sh@10 -- # set +x 00:05:53.472 ************************************ 00:05:53.472 END TEST accel_crc32c_C2 00:05:53.472 ************************************ 00:05:53.472 15:34:51 -- accel/accel.sh@103 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:05:53.472 15:34:51 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:53.472 15:34:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:53.472 15:34:51 -- common/autotest_common.sh@10 -- # set +x 00:05:53.472 ************************************ 00:05:53.472 START TEST accel_copy 00:05:53.472 ************************************ 00:05:53.472 15:34:51 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w copy -y 00:05:53.472 15:34:51 -- accel/accel.sh@16 -- # local accel_opc 00:05:53.472 15:34:51 -- accel/accel.sh@17 -- # local accel_module 00:05:53.472 15:34:51 -- accel/accel.sh@19 -- # IFS=: 00:05:53.472 15:34:51 -- accel/accel.sh@19 -- # read -r var val 00:05:53.472 15:34:51 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:05:53.472 15:34:51 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:53.472 15:34:51 -- accel/accel.sh@12 -- # build_accel_config 00:05:53.472 15:34:51 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:53.472 15:34:51 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:53.472 15:34:51 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:53.472 15:34:51 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:53.472 15:34:51 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:53.472 15:34:51 -- accel/accel.sh@40 -- # local IFS=, 00:05:53.472 15:34:51 -- accel/accel.sh@41 -- # jq -r . 00:05:53.472 [2024-04-26 15:34:51.887564] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:05:53.472 [2024-04-26 15:34:51.887633] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3173910 ] 00:05:53.472 EAL: No free 2048 kB hugepages reported on node 1 00:05:53.472 [2024-04-26 15:34:51.946436] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:53.472 [2024-04-26 15:34:52.021666] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:53.472 15:34:52 -- accel/accel.sh@20 -- # val= 00:05:53.472 15:34:52 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.472 15:34:52 -- accel/accel.sh@19 -- # IFS=: 00:05:53.472 15:34:52 -- accel/accel.sh@19 -- # read -r var val 00:05:53.472 15:34:52 -- accel/accel.sh@20 -- # val= 00:05:53.472 15:34:52 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.472 15:34:52 -- accel/accel.sh@19 -- # IFS=: 00:05:53.472 15:34:52 -- accel/accel.sh@19 -- # read -r var val 00:05:53.472 15:34:52 -- accel/accel.sh@20 -- # val=0x1 00:05:53.472 15:34:52 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.472 15:34:52 -- accel/accel.sh@19 -- # IFS=: 00:05:53.472 15:34:52 -- accel/accel.sh@19 -- # read -r var val 00:05:53.472 15:34:52 -- accel/accel.sh@20 -- # val= 00:05:53.472 15:34:52 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.472 15:34:52 -- accel/accel.sh@19 -- # IFS=: 00:05:53.472 15:34:52 -- accel/accel.sh@19 -- # read -r var val 00:05:53.472 15:34:52 -- accel/accel.sh@20 -- # val= 00:05:53.472 15:34:52 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.472 15:34:52 -- accel/accel.sh@19 -- # IFS=: 00:05:53.472 15:34:52 -- accel/accel.sh@19 -- # read -r var val 00:05:53.472 15:34:52 -- accel/accel.sh@20 -- # val=copy 00:05:53.472 15:34:52 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.472 15:34:52 -- accel/accel.sh@23 -- # accel_opc=copy 00:05:53.472 15:34:52 -- accel/accel.sh@19 -- # IFS=: 00:05:53.472 15:34:52 -- accel/accel.sh@19 -- # read -r var val 00:05:53.472 15:34:52 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:53.472 15:34:52 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.472 15:34:52 -- accel/accel.sh@19 -- # IFS=: 00:05:53.472 15:34:52 -- accel/accel.sh@19 -- # read -r var val 00:05:53.472 15:34:52 -- accel/accel.sh@20 -- # val= 00:05:53.472 15:34:52 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.472 15:34:52 -- accel/accel.sh@19 -- # IFS=: 00:05:53.472 15:34:52 -- accel/accel.sh@19 -- # read -r var val 00:05:53.472 15:34:52 -- accel/accel.sh@20 -- # val=software 00:05:53.472 15:34:52 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.472 15:34:52 -- accel/accel.sh@22 -- # accel_module=software 00:05:53.472 15:34:52 -- accel/accel.sh@19 -- # IFS=: 00:05:53.472 15:34:52 -- accel/accel.sh@19 -- # read -r var val 00:05:53.472 15:34:52 -- accel/accel.sh@20 -- # val=32 00:05:53.472 15:34:52 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.472 15:34:52 -- accel/accel.sh@19 -- # IFS=: 00:05:53.472 15:34:52 -- accel/accel.sh@19 -- # read -r var val 00:05:53.472 15:34:52 -- accel/accel.sh@20 -- # val=32 00:05:53.472 15:34:52 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.473 15:34:52 -- accel/accel.sh@19 -- # IFS=: 00:05:53.473 15:34:52 -- accel/accel.sh@19 -- # read -r var val 00:05:53.473 15:34:52 -- accel/accel.sh@20 -- # val=1 00:05:53.473 15:34:52 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.473 15:34:52 -- accel/accel.sh@19 -- # IFS=: 00:05:53.473 15:34:52 -- accel/accel.sh@19 -- # read -r var val 00:05:53.473 15:34:52 -- accel/accel.sh@20 -- # val='1 seconds' 00:05:53.473 15:34:52 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.473 15:34:52 -- accel/accel.sh@19 -- # IFS=: 00:05:53.473 15:34:52 -- accel/accel.sh@19 -- # read -r var val 00:05:53.473 15:34:52 -- accel/accel.sh@20 -- # val=Yes 00:05:53.473 15:34:52 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.473 15:34:52 -- accel/accel.sh@19 -- # IFS=: 00:05:53.473 15:34:52 -- accel/accel.sh@19 -- # read -r var val 00:05:53.473 15:34:52 -- accel/accel.sh@20 -- # val= 00:05:53.473 15:34:52 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.473 15:34:52 -- accel/accel.sh@19 -- # IFS=: 00:05:53.731 15:34:52 -- accel/accel.sh@19 -- # read -r var val 00:05:53.731 15:34:52 -- accel/accel.sh@20 -- # val= 00:05:53.731 15:34:52 -- accel/accel.sh@21 -- # case "$var" in 00:05:53.731 15:34:52 -- accel/accel.sh@19 -- # IFS=: 00:05:53.731 15:34:52 -- accel/accel.sh@19 -- # read -r var val 00:05:54.669 15:34:53 -- accel/accel.sh@20 -- # val= 00:05:54.669 15:34:53 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.669 15:34:53 -- accel/accel.sh@19 -- # IFS=: 00:05:54.669 15:34:53 -- accel/accel.sh@19 -- # read -r var val 00:05:54.669 15:34:53 -- accel/accel.sh@20 -- # val= 00:05:54.669 15:34:53 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.669 15:34:53 -- accel/accel.sh@19 -- # IFS=: 00:05:54.669 15:34:53 -- accel/accel.sh@19 -- # read -r var val 00:05:54.669 15:34:53 -- accel/accel.sh@20 -- # val= 00:05:54.669 15:34:53 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.669 15:34:53 -- accel/accel.sh@19 -- # IFS=: 00:05:54.669 15:34:53 -- accel/accel.sh@19 -- # read -r var val 00:05:54.669 15:34:53 -- accel/accel.sh@20 -- # val= 00:05:54.669 15:34:53 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.669 15:34:53 -- accel/accel.sh@19 -- # IFS=: 00:05:54.669 15:34:53 -- accel/accel.sh@19 -- # read -r var val 00:05:54.669 15:34:53 -- accel/accel.sh@20 -- # val= 00:05:54.669 15:34:53 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.669 15:34:53 -- accel/accel.sh@19 -- # IFS=: 00:05:54.669 15:34:53 -- accel/accel.sh@19 -- # read -r var val 00:05:54.669 15:34:53 -- accel/accel.sh@20 -- # val= 00:05:54.669 15:34:53 -- accel/accel.sh@21 -- # case "$var" in 00:05:54.669 15:34:53 -- accel/accel.sh@19 -- # IFS=: 00:05:54.669 15:34:53 -- accel/accel.sh@19 -- # read -r var val 00:05:54.669 15:34:53 -- accel/accel.sh@27 -- # [[ -n software ]] 00:05:54.669 15:34:53 -- accel/accel.sh@27 -- # [[ -n copy ]] 00:05:54.669 15:34:53 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:54.669 00:05:54.669 real 0m1.365s 00:05:54.669 user 0m1.263s 00:05:54.669 sys 0m0.113s 00:05:54.669 15:34:53 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:54.669 15:34:53 -- common/autotest_common.sh@10 -- # set +x 00:05:54.669 ************************************ 00:05:54.669 END TEST accel_copy 00:05:54.669 ************************************ 00:05:54.669 15:34:53 -- accel/accel.sh@104 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:54.669 15:34:53 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:05:54.669 15:34:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:54.669 15:34:53 -- common/autotest_common.sh@10 -- # set +x 00:05:54.927 ************************************ 00:05:54.927 START TEST accel_fill 00:05:54.927 ************************************ 00:05:54.927 15:34:53 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:54.927 15:34:53 -- accel/accel.sh@16 -- # local accel_opc 00:05:54.927 15:34:53 -- accel/accel.sh@17 -- # local accel_module 00:05:54.927 15:34:53 -- accel/accel.sh@19 -- # IFS=: 00:05:54.927 15:34:53 -- accel/accel.sh@19 -- # read -r var val 00:05:54.927 15:34:53 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:54.927 15:34:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:54.927 15:34:53 -- accel/accel.sh@12 -- # build_accel_config 00:05:54.927 15:34:53 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:54.927 15:34:53 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:54.927 15:34:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:54.927 15:34:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:54.927 15:34:53 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:54.927 15:34:53 -- accel/accel.sh@40 -- # local IFS=, 00:05:54.927 15:34:53 -- accel/accel.sh@41 -- # jq -r . 00:05:54.927 [2024-04-26 15:34:53.416378] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:05:54.927 [2024-04-26 15:34:53.416448] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3174162 ] 00:05:54.927 EAL: No free 2048 kB hugepages reported on node 1 00:05:54.927 [2024-04-26 15:34:53.474521] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:55.186 [2024-04-26 15:34:53.551578] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:55.186 15:34:53 -- accel/accel.sh@20 -- # val= 00:05:55.186 15:34:53 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.186 15:34:53 -- accel/accel.sh@19 -- # IFS=: 00:05:55.186 15:34:53 -- accel/accel.sh@19 -- # read -r var val 00:05:55.186 15:34:53 -- accel/accel.sh@20 -- # val= 00:05:55.186 15:34:53 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.186 15:34:53 -- accel/accel.sh@19 -- # IFS=: 00:05:55.186 15:34:53 -- accel/accel.sh@19 -- # read -r var val 00:05:55.186 15:34:53 -- accel/accel.sh@20 -- # val=0x1 00:05:55.186 15:34:53 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.186 15:34:53 -- accel/accel.sh@19 -- # IFS=: 00:05:55.186 15:34:53 -- accel/accel.sh@19 -- # read -r var val 00:05:55.186 15:34:53 -- accel/accel.sh@20 -- # val= 00:05:55.186 15:34:53 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.186 15:34:53 -- accel/accel.sh@19 -- # IFS=: 00:05:55.186 15:34:53 -- accel/accel.sh@19 -- # read -r var val 00:05:55.186 15:34:53 -- accel/accel.sh@20 -- # val= 00:05:55.186 15:34:53 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.186 15:34:53 -- accel/accel.sh@19 -- # IFS=: 00:05:55.186 15:34:53 -- accel/accel.sh@19 -- # read -r var val 00:05:55.186 15:34:53 -- accel/accel.sh@20 -- # val=fill 00:05:55.186 15:34:53 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.186 15:34:53 -- accel/accel.sh@23 -- # accel_opc=fill 00:05:55.186 15:34:53 -- accel/accel.sh@19 -- # IFS=: 00:05:55.186 15:34:53 -- accel/accel.sh@19 -- # read -r var val 00:05:55.186 15:34:53 -- accel/accel.sh@20 -- # val=0x80 00:05:55.186 15:34:53 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.186 15:34:53 -- accel/accel.sh@19 -- # IFS=: 00:05:55.186 15:34:53 -- accel/accel.sh@19 -- # read -r var val 00:05:55.186 15:34:53 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:55.186 15:34:53 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.186 15:34:53 -- accel/accel.sh@19 -- # IFS=: 00:05:55.186 15:34:53 -- accel/accel.sh@19 -- # read -r var val 00:05:55.186 15:34:53 -- accel/accel.sh@20 -- # val= 00:05:55.186 15:34:53 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.186 15:34:53 -- accel/accel.sh@19 -- # IFS=: 00:05:55.186 15:34:53 -- accel/accel.sh@19 -- # read -r var val 00:05:55.186 15:34:53 -- accel/accel.sh@20 -- # val=software 00:05:55.186 15:34:53 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.186 15:34:53 -- accel/accel.sh@22 -- # accel_module=software 00:05:55.186 15:34:53 -- accel/accel.sh@19 -- # IFS=: 00:05:55.186 15:34:53 -- accel/accel.sh@19 -- # read -r var val 00:05:55.186 15:34:53 -- accel/accel.sh@20 -- # val=64 00:05:55.186 15:34:53 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.186 15:34:53 -- accel/accel.sh@19 -- # IFS=: 00:05:55.186 15:34:53 -- accel/accel.sh@19 -- # read -r var val 00:05:55.186 15:34:53 -- accel/accel.sh@20 -- # val=64 00:05:55.186 15:34:53 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.186 15:34:53 -- accel/accel.sh@19 -- # IFS=: 00:05:55.186 15:34:53 -- accel/accel.sh@19 -- # read -r var val 00:05:55.186 15:34:53 -- accel/accel.sh@20 -- # val=1 00:05:55.186 15:34:53 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.186 15:34:53 -- accel/accel.sh@19 -- # IFS=: 00:05:55.186 15:34:53 -- accel/accel.sh@19 -- # read -r var val 00:05:55.186 15:34:53 -- accel/accel.sh@20 -- # val='1 seconds' 00:05:55.186 15:34:53 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.186 15:34:53 -- accel/accel.sh@19 -- # IFS=: 00:05:55.186 15:34:53 -- accel/accel.sh@19 -- # read -r var val 00:05:55.186 15:34:53 -- accel/accel.sh@20 -- # val=Yes 00:05:55.186 15:34:53 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.186 15:34:53 -- accel/accel.sh@19 -- # IFS=: 00:05:55.186 15:34:53 -- accel/accel.sh@19 -- # read -r var val 00:05:55.186 15:34:53 -- accel/accel.sh@20 -- # val= 00:05:55.186 15:34:53 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.186 15:34:53 -- accel/accel.sh@19 -- # IFS=: 00:05:55.186 15:34:53 -- accel/accel.sh@19 -- # read -r var val 00:05:55.186 15:34:53 -- accel/accel.sh@20 -- # val= 00:05:55.186 15:34:53 -- accel/accel.sh@21 -- # case "$var" in 00:05:55.186 15:34:53 -- accel/accel.sh@19 -- # IFS=: 00:05:55.186 15:34:53 -- accel/accel.sh@19 -- # read -r var val 00:05:56.563 15:34:54 -- accel/accel.sh@20 -- # val= 00:05:56.563 15:34:54 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.563 15:34:54 -- accel/accel.sh@19 -- # IFS=: 00:05:56.563 15:34:54 -- accel/accel.sh@19 -- # read -r var val 00:05:56.563 15:34:54 -- accel/accel.sh@20 -- # val= 00:05:56.563 15:34:54 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.563 15:34:54 -- accel/accel.sh@19 -- # IFS=: 00:05:56.563 15:34:54 -- accel/accel.sh@19 -- # read -r var val 00:05:56.563 15:34:54 -- accel/accel.sh@20 -- # val= 00:05:56.563 15:34:54 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.563 15:34:54 -- accel/accel.sh@19 -- # IFS=: 00:05:56.563 15:34:54 -- accel/accel.sh@19 -- # read -r var val 00:05:56.563 15:34:54 -- accel/accel.sh@20 -- # val= 00:05:56.563 15:34:54 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.563 15:34:54 -- accel/accel.sh@19 -- # IFS=: 00:05:56.563 15:34:54 -- accel/accel.sh@19 -- # read -r var val 00:05:56.563 15:34:54 -- accel/accel.sh@20 -- # val= 00:05:56.563 15:34:54 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.563 15:34:54 -- accel/accel.sh@19 -- # IFS=: 00:05:56.563 15:34:54 -- accel/accel.sh@19 -- # read -r var val 00:05:56.563 15:34:54 -- accel/accel.sh@20 -- # val= 00:05:56.563 15:34:54 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.563 15:34:54 -- accel/accel.sh@19 -- # IFS=: 00:05:56.563 15:34:54 -- accel/accel.sh@19 -- # read -r var val 00:05:56.563 15:34:54 -- accel/accel.sh@27 -- # [[ -n software ]] 00:05:56.563 15:34:54 -- accel/accel.sh@27 -- # [[ -n fill ]] 00:05:56.563 15:34:54 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:56.563 00:05:56.563 real 0m1.367s 00:05:56.563 user 0m1.261s 00:05:56.563 sys 0m0.119s 00:05:56.563 15:34:54 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:56.563 15:34:54 -- common/autotest_common.sh@10 -- # set +x 00:05:56.563 ************************************ 00:05:56.563 END TEST accel_fill 00:05:56.563 ************************************ 00:05:56.563 15:34:54 -- accel/accel.sh@105 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:05:56.563 15:34:54 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:56.563 15:34:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:56.563 15:34:54 -- common/autotest_common.sh@10 -- # set +x 00:05:56.563 ************************************ 00:05:56.563 START TEST accel_copy_crc32c 00:05:56.563 ************************************ 00:05:56.563 15:34:54 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w copy_crc32c -y 00:05:56.563 15:34:54 -- accel/accel.sh@16 -- # local accel_opc 00:05:56.563 15:34:54 -- accel/accel.sh@17 -- # local accel_module 00:05:56.563 15:34:54 -- accel/accel.sh@19 -- # IFS=: 00:05:56.563 15:34:54 -- accel/accel.sh@19 -- # read -r var val 00:05:56.563 15:34:54 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:56.563 15:34:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:56.563 15:34:54 -- accel/accel.sh@12 -- # build_accel_config 00:05:56.563 15:34:54 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:56.563 15:34:54 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:56.563 15:34:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:56.563 15:34:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:56.563 15:34:54 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:56.563 15:34:54 -- accel/accel.sh@40 -- # local IFS=, 00:05:56.563 15:34:54 -- accel/accel.sh@41 -- # jq -r . 00:05:56.563 [2024-04-26 15:34:54.942607] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:05:56.563 [2024-04-26 15:34:54.942674] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3174424 ] 00:05:56.563 EAL: No free 2048 kB hugepages reported on node 1 00:05:56.563 [2024-04-26 15:34:55.000078] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:56.563 [2024-04-26 15:34:55.074574] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:56.563 15:34:55 -- accel/accel.sh@20 -- # val= 00:05:56.563 15:34:55 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.563 15:34:55 -- accel/accel.sh@19 -- # IFS=: 00:05:56.563 15:34:55 -- accel/accel.sh@19 -- # read -r var val 00:05:56.563 15:34:55 -- accel/accel.sh@20 -- # val= 00:05:56.563 15:34:55 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.563 15:34:55 -- accel/accel.sh@19 -- # IFS=: 00:05:56.563 15:34:55 -- accel/accel.sh@19 -- # read -r var val 00:05:56.563 15:34:55 -- accel/accel.sh@20 -- # val=0x1 00:05:56.563 15:34:55 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.563 15:34:55 -- accel/accel.sh@19 -- # IFS=: 00:05:56.563 15:34:55 -- accel/accel.sh@19 -- # read -r var val 00:05:56.563 15:34:55 -- accel/accel.sh@20 -- # val= 00:05:56.563 15:34:55 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.563 15:34:55 -- accel/accel.sh@19 -- # IFS=: 00:05:56.563 15:34:55 -- accel/accel.sh@19 -- # read -r var val 00:05:56.563 15:34:55 -- accel/accel.sh@20 -- # val= 00:05:56.563 15:34:55 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.563 15:34:55 -- accel/accel.sh@19 -- # IFS=: 00:05:56.563 15:34:55 -- accel/accel.sh@19 -- # read -r var val 00:05:56.563 15:34:55 -- accel/accel.sh@20 -- # val=copy_crc32c 00:05:56.563 15:34:55 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.563 15:34:55 -- accel/accel.sh@23 -- # accel_opc=copy_crc32c 00:05:56.563 15:34:55 -- accel/accel.sh@19 -- # IFS=: 00:05:56.563 15:34:55 -- accel/accel.sh@19 -- # read -r var val 00:05:56.563 15:34:55 -- accel/accel.sh@20 -- # val=0 00:05:56.563 15:34:55 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.563 15:34:55 -- accel/accel.sh@19 -- # IFS=: 00:05:56.563 15:34:55 -- accel/accel.sh@19 -- # read -r var val 00:05:56.563 15:34:55 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:56.563 15:34:55 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.563 15:34:55 -- accel/accel.sh@19 -- # IFS=: 00:05:56.563 15:34:55 -- accel/accel.sh@19 -- # read -r var val 00:05:56.563 15:34:55 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:56.563 15:34:55 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.563 15:34:55 -- accel/accel.sh@19 -- # IFS=: 00:05:56.563 15:34:55 -- accel/accel.sh@19 -- # read -r var val 00:05:56.563 15:34:55 -- accel/accel.sh@20 -- # val= 00:05:56.563 15:34:55 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.563 15:34:55 -- accel/accel.sh@19 -- # IFS=: 00:05:56.563 15:34:55 -- accel/accel.sh@19 -- # read -r var val 00:05:56.563 15:34:55 -- accel/accel.sh@20 -- # val=software 00:05:56.563 15:34:55 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.563 15:34:55 -- accel/accel.sh@22 -- # accel_module=software 00:05:56.563 15:34:55 -- accel/accel.sh@19 -- # IFS=: 00:05:56.563 15:34:55 -- accel/accel.sh@19 -- # read -r var val 00:05:56.563 15:34:55 -- accel/accel.sh@20 -- # val=32 00:05:56.563 15:34:55 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.563 15:34:55 -- accel/accel.sh@19 -- # IFS=: 00:05:56.563 15:34:55 -- accel/accel.sh@19 -- # read -r var val 00:05:56.563 15:34:55 -- accel/accel.sh@20 -- # val=32 00:05:56.563 15:34:55 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.563 15:34:55 -- accel/accel.sh@19 -- # IFS=: 00:05:56.563 15:34:55 -- accel/accel.sh@19 -- # read -r var val 00:05:56.563 15:34:55 -- accel/accel.sh@20 -- # val=1 00:05:56.563 15:34:55 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.563 15:34:55 -- accel/accel.sh@19 -- # IFS=: 00:05:56.563 15:34:55 -- accel/accel.sh@19 -- # read -r var val 00:05:56.563 15:34:55 -- accel/accel.sh@20 -- # val='1 seconds' 00:05:56.563 15:34:55 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.563 15:34:55 -- accel/accel.sh@19 -- # IFS=: 00:05:56.563 15:34:55 -- accel/accel.sh@19 -- # read -r var val 00:05:56.563 15:34:55 -- accel/accel.sh@20 -- # val=Yes 00:05:56.563 15:34:55 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.563 15:34:55 -- accel/accel.sh@19 -- # IFS=: 00:05:56.563 15:34:55 -- accel/accel.sh@19 -- # read -r var val 00:05:56.563 15:34:55 -- accel/accel.sh@20 -- # val= 00:05:56.564 15:34:55 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.564 15:34:55 -- accel/accel.sh@19 -- # IFS=: 00:05:56.564 15:34:55 -- accel/accel.sh@19 -- # read -r var val 00:05:56.564 15:34:55 -- accel/accel.sh@20 -- # val= 00:05:56.564 15:34:55 -- accel/accel.sh@21 -- # case "$var" in 00:05:56.564 15:34:55 -- accel/accel.sh@19 -- # IFS=: 00:05:56.564 15:34:55 -- accel/accel.sh@19 -- # read -r var val 00:05:57.940 15:34:56 -- accel/accel.sh@20 -- # val= 00:05:57.940 15:34:56 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.940 15:34:56 -- accel/accel.sh@19 -- # IFS=: 00:05:57.940 15:34:56 -- accel/accel.sh@19 -- # read -r var val 00:05:57.940 15:34:56 -- accel/accel.sh@20 -- # val= 00:05:57.940 15:34:56 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.940 15:34:56 -- accel/accel.sh@19 -- # IFS=: 00:05:57.940 15:34:56 -- accel/accel.sh@19 -- # read -r var val 00:05:57.940 15:34:56 -- accel/accel.sh@20 -- # val= 00:05:57.940 15:34:56 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.940 15:34:56 -- accel/accel.sh@19 -- # IFS=: 00:05:57.940 15:34:56 -- accel/accel.sh@19 -- # read -r var val 00:05:57.940 15:34:56 -- accel/accel.sh@20 -- # val= 00:05:57.940 15:34:56 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.940 15:34:56 -- accel/accel.sh@19 -- # IFS=: 00:05:57.940 15:34:56 -- accel/accel.sh@19 -- # read -r var val 00:05:57.940 15:34:56 -- accel/accel.sh@20 -- # val= 00:05:57.940 15:34:56 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.940 15:34:56 -- accel/accel.sh@19 -- # IFS=: 00:05:57.940 15:34:56 -- accel/accel.sh@19 -- # read -r var val 00:05:57.940 15:34:56 -- accel/accel.sh@20 -- # val= 00:05:57.940 15:34:56 -- accel/accel.sh@21 -- # case "$var" in 00:05:57.940 15:34:56 -- accel/accel.sh@19 -- # IFS=: 00:05:57.940 15:34:56 -- accel/accel.sh@19 -- # read -r var val 00:05:57.940 15:34:56 -- accel/accel.sh@27 -- # [[ -n software ]] 00:05:57.940 15:34:56 -- accel/accel.sh@27 -- # [[ -n copy_crc32c ]] 00:05:57.940 15:34:56 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:57.940 00:05:57.940 real 0m1.363s 00:05:57.940 user 0m1.255s 00:05:57.940 sys 0m0.120s 00:05:57.940 15:34:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:57.940 15:34:56 -- common/autotest_common.sh@10 -- # set +x 00:05:57.940 ************************************ 00:05:57.940 END TEST accel_copy_crc32c 00:05:57.940 ************************************ 00:05:57.940 15:34:56 -- accel/accel.sh@106 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:05:57.940 15:34:56 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:57.940 15:34:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:57.940 15:34:56 -- common/autotest_common.sh@10 -- # set +x 00:05:57.940 ************************************ 00:05:57.940 START TEST accel_copy_crc32c_C2 00:05:57.940 ************************************ 00:05:57.940 15:34:56 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:05:57.940 15:34:56 -- accel/accel.sh@16 -- # local accel_opc 00:05:57.940 15:34:56 -- accel/accel.sh@17 -- # local accel_module 00:05:57.940 15:34:56 -- accel/accel.sh@19 -- # IFS=: 00:05:57.940 15:34:56 -- accel/accel.sh@19 -- # read -r var val 00:05:57.940 15:34:56 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:57.940 15:34:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:57.940 15:34:56 -- accel/accel.sh@12 -- # build_accel_config 00:05:57.940 15:34:56 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:57.940 15:34:56 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:57.940 15:34:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:57.940 15:34:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:57.940 15:34:56 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:57.940 15:34:56 -- accel/accel.sh@40 -- # local IFS=, 00:05:57.940 15:34:56 -- accel/accel.sh@41 -- # jq -r . 00:05:57.940 [2024-04-26 15:34:56.460422] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:05:57.940 [2024-04-26 15:34:56.460490] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3174679 ] 00:05:57.940 EAL: No free 2048 kB hugepages reported on node 1 00:05:57.940 [2024-04-26 15:34:56.515564] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:58.199 [2024-04-26 15:34:56.585319] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:58.199 15:34:56 -- accel/accel.sh@20 -- # val= 00:05:58.199 15:34:56 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.199 15:34:56 -- accel/accel.sh@19 -- # IFS=: 00:05:58.199 15:34:56 -- accel/accel.sh@19 -- # read -r var val 00:05:58.199 15:34:56 -- accel/accel.sh@20 -- # val= 00:05:58.199 15:34:56 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.199 15:34:56 -- accel/accel.sh@19 -- # IFS=: 00:05:58.199 15:34:56 -- accel/accel.sh@19 -- # read -r var val 00:05:58.199 15:34:56 -- accel/accel.sh@20 -- # val=0x1 00:05:58.199 15:34:56 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.199 15:34:56 -- accel/accel.sh@19 -- # IFS=: 00:05:58.199 15:34:56 -- accel/accel.sh@19 -- # read -r var val 00:05:58.199 15:34:56 -- accel/accel.sh@20 -- # val= 00:05:58.199 15:34:56 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.199 15:34:56 -- accel/accel.sh@19 -- # IFS=: 00:05:58.199 15:34:56 -- accel/accel.sh@19 -- # read -r var val 00:05:58.199 15:34:56 -- accel/accel.sh@20 -- # val= 00:05:58.199 15:34:56 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.199 15:34:56 -- accel/accel.sh@19 -- # IFS=: 00:05:58.199 15:34:56 -- accel/accel.sh@19 -- # read -r var val 00:05:58.199 15:34:56 -- accel/accel.sh@20 -- # val=copy_crc32c 00:05:58.199 15:34:56 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.199 15:34:56 -- accel/accel.sh@23 -- # accel_opc=copy_crc32c 00:05:58.199 15:34:56 -- accel/accel.sh@19 -- # IFS=: 00:05:58.199 15:34:56 -- accel/accel.sh@19 -- # read -r var val 00:05:58.199 15:34:56 -- accel/accel.sh@20 -- # val=0 00:05:58.199 15:34:56 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.199 15:34:56 -- accel/accel.sh@19 -- # IFS=: 00:05:58.199 15:34:56 -- accel/accel.sh@19 -- # read -r var val 00:05:58.199 15:34:56 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:58.199 15:34:56 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.199 15:34:56 -- accel/accel.sh@19 -- # IFS=: 00:05:58.199 15:34:56 -- accel/accel.sh@19 -- # read -r var val 00:05:58.199 15:34:56 -- accel/accel.sh@20 -- # val='8192 bytes' 00:05:58.199 15:34:56 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.199 15:34:56 -- accel/accel.sh@19 -- # IFS=: 00:05:58.199 15:34:56 -- accel/accel.sh@19 -- # read -r var val 00:05:58.199 15:34:56 -- accel/accel.sh@20 -- # val= 00:05:58.199 15:34:56 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.199 15:34:56 -- accel/accel.sh@19 -- # IFS=: 00:05:58.199 15:34:56 -- accel/accel.sh@19 -- # read -r var val 00:05:58.199 15:34:56 -- accel/accel.sh@20 -- # val=software 00:05:58.199 15:34:56 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.199 15:34:56 -- accel/accel.sh@22 -- # accel_module=software 00:05:58.199 15:34:56 -- accel/accel.sh@19 -- # IFS=: 00:05:58.199 15:34:56 -- accel/accel.sh@19 -- # read -r var val 00:05:58.199 15:34:56 -- accel/accel.sh@20 -- # val=32 00:05:58.199 15:34:56 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.199 15:34:56 -- accel/accel.sh@19 -- # IFS=: 00:05:58.199 15:34:56 -- accel/accel.sh@19 -- # read -r var val 00:05:58.199 15:34:56 -- accel/accel.sh@20 -- # val=32 00:05:58.199 15:34:56 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.199 15:34:56 -- accel/accel.sh@19 -- # IFS=: 00:05:58.199 15:34:56 -- accel/accel.sh@19 -- # read -r var val 00:05:58.199 15:34:56 -- accel/accel.sh@20 -- # val=1 00:05:58.199 15:34:56 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.199 15:34:56 -- accel/accel.sh@19 -- # IFS=: 00:05:58.199 15:34:56 -- accel/accel.sh@19 -- # read -r var val 00:05:58.199 15:34:56 -- accel/accel.sh@20 -- # val='1 seconds' 00:05:58.199 15:34:56 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.199 15:34:56 -- accel/accel.sh@19 -- # IFS=: 00:05:58.199 15:34:56 -- accel/accel.sh@19 -- # read -r var val 00:05:58.199 15:34:56 -- accel/accel.sh@20 -- # val=Yes 00:05:58.199 15:34:56 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.199 15:34:56 -- accel/accel.sh@19 -- # IFS=: 00:05:58.199 15:34:56 -- accel/accel.sh@19 -- # read -r var val 00:05:58.199 15:34:56 -- accel/accel.sh@20 -- # val= 00:05:58.199 15:34:56 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.199 15:34:56 -- accel/accel.sh@19 -- # IFS=: 00:05:58.199 15:34:56 -- accel/accel.sh@19 -- # read -r var val 00:05:58.199 15:34:56 -- accel/accel.sh@20 -- # val= 00:05:58.199 15:34:56 -- accel/accel.sh@21 -- # case "$var" in 00:05:58.199 15:34:56 -- accel/accel.sh@19 -- # IFS=: 00:05:58.199 15:34:56 -- accel/accel.sh@19 -- # read -r var val 00:05:59.575 15:34:57 -- accel/accel.sh@20 -- # val= 00:05:59.575 15:34:57 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.575 15:34:57 -- accel/accel.sh@19 -- # IFS=: 00:05:59.575 15:34:57 -- accel/accel.sh@19 -- # read -r var val 00:05:59.575 15:34:57 -- accel/accel.sh@20 -- # val= 00:05:59.575 15:34:57 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.575 15:34:57 -- accel/accel.sh@19 -- # IFS=: 00:05:59.575 15:34:57 -- accel/accel.sh@19 -- # read -r var val 00:05:59.575 15:34:57 -- accel/accel.sh@20 -- # val= 00:05:59.575 15:34:57 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.575 15:34:57 -- accel/accel.sh@19 -- # IFS=: 00:05:59.575 15:34:57 -- accel/accel.sh@19 -- # read -r var val 00:05:59.575 15:34:57 -- accel/accel.sh@20 -- # val= 00:05:59.575 15:34:57 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.575 15:34:57 -- accel/accel.sh@19 -- # IFS=: 00:05:59.575 15:34:57 -- accel/accel.sh@19 -- # read -r var val 00:05:59.575 15:34:57 -- accel/accel.sh@20 -- # val= 00:05:59.575 15:34:57 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.575 15:34:57 -- accel/accel.sh@19 -- # IFS=: 00:05:59.575 15:34:57 -- accel/accel.sh@19 -- # read -r var val 00:05:59.575 15:34:57 -- accel/accel.sh@20 -- # val= 00:05:59.575 15:34:57 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.575 15:34:57 -- accel/accel.sh@19 -- # IFS=: 00:05:59.575 15:34:57 -- accel/accel.sh@19 -- # read -r var val 00:05:59.575 15:34:57 -- accel/accel.sh@27 -- # [[ -n software ]] 00:05:59.575 15:34:57 -- accel/accel.sh@27 -- # [[ -n copy_crc32c ]] 00:05:59.575 15:34:57 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:59.575 00:05:59.575 real 0m1.353s 00:05:59.575 user 0m1.256s 00:05:59.575 sys 0m0.112s 00:05:59.575 15:34:57 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:59.575 15:34:57 -- common/autotest_common.sh@10 -- # set +x 00:05:59.575 ************************************ 00:05:59.575 END TEST accel_copy_crc32c_C2 00:05:59.575 ************************************ 00:05:59.575 15:34:57 -- accel/accel.sh@107 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:05:59.575 15:34:57 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:59.575 15:34:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:59.575 15:34:57 -- common/autotest_common.sh@10 -- # set +x 00:05:59.575 ************************************ 00:05:59.575 START TEST accel_dualcast 00:05:59.575 ************************************ 00:05:59.575 15:34:57 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w dualcast -y 00:05:59.575 15:34:57 -- accel/accel.sh@16 -- # local accel_opc 00:05:59.575 15:34:57 -- accel/accel.sh@17 -- # local accel_module 00:05:59.575 15:34:57 -- accel/accel.sh@19 -- # IFS=: 00:05:59.575 15:34:57 -- accel/accel.sh@19 -- # read -r var val 00:05:59.575 15:34:57 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:05:59.575 15:34:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:59.575 15:34:57 -- accel/accel.sh@12 -- # build_accel_config 00:05:59.575 15:34:57 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:05:59.575 15:34:57 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:05:59.575 15:34:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:59.575 15:34:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:59.575 15:34:57 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:05:59.575 15:34:57 -- accel/accel.sh@40 -- # local IFS=, 00:05:59.575 15:34:57 -- accel/accel.sh@41 -- # jq -r . 00:05:59.575 [2024-04-26 15:34:57.970116] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:05:59.575 [2024-04-26 15:34:57.970173] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3174943 ] 00:05:59.575 EAL: No free 2048 kB hugepages reported on node 1 00:05:59.575 [2024-04-26 15:34:58.025424] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:59.575 [2024-04-26 15:34:58.094970] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:59.575 15:34:58 -- accel/accel.sh@20 -- # val= 00:05:59.575 15:34:58 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.575 15:34:58 -- accel/accel.sh@19 -- # IFS=: 00:05:59.575 15:34:58 -- accel/accel.sh@19 -- # read -r var val 00:05:59.576 15:34:58 -- accel/accel.sh@20 -- # val= 00:05:59.576 15:34:58 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.576 15:34:58 -- accel/accel.sh@19 -- # IFS=: 00:05:59.576 15:34:58 -- accel/accel.sh@19 -- # read -r var val 00:05:59.576 15:34:58 -- accel/accel.sh@20 -- # val=0x1 00:05:59.576 15:34:58 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.576 15:34:58 -- accel/accel.sh@19 -- # IFS=: 00:05:59.576 15:34:58 -- accel/accel.sh@19 -- # read -r var val 00:05:59.576 15:34:58 -- accel/accel.sh@20 -- # val= 00:05:59.576 15:34:58 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.576 15:34:58 -- accel/accel.sh@19 -- # IFS=: 00:05:59.576 15:34:58 -- accel/accel.sh@19 -- # read -r var val 00:05:59.576 15:34:58 -- accel/accel.sh@20 -- # val= 00:05:59.576 15:34:58 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.576 15:34:58 -- accel/accel.sh@19 -- # IFS=: 00:05:59.576 15:34:58 -- accel/accel.sh@19 -- # read -r var val 00:05:59.576 15:34:58 -- accel/accel.sh@20 -- # val=dualcast 00:05:59.576 15:34:58 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.576 15:34:58 -- accel/accel.sh@23 -- # accel_opc=dualcast 00:05:59.576 15:34:58 -- accel/accel.sh@19 -- # IFS=: 00:05:59.576 15:34:58 -- accel/accel.sh@19 -- # read -r var val 00:05:59.576 15:34:58 -- accel/accel.sh@20 -- # val='4096 bytes' 00:05:59.576 15:34:58 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.576 15:34:58 -- accel/accel.sh@19 -- # IFS=: 00:05:59.576 15:34:58 -- accel/accel.sh@19 -- # read -r var val 00:05:59.576 15:34:58 -- accel/accel.sh@20 -- # val= 00:05:59.576 15:34:58 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.576 15:34:58 -- accel/accel.sh@19 -- # IFS=: 00:05:59.576 15:34:58 -- accel/accel.sh@19 -- # read -r var val 00:05:59.576 15:34:58 -- accel/accel.sh@20 -- # val=software 00:05:59.576 15:34:58 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.576 15:34:58 -- accel/accel.sh@22 -- # accel_module=software 00:05:59.576 15:34:58 -- accel/accel.sh@19 -- # IFS=: 00:05:59.576 15:34:58 -- accel/accel.sh@19 -- # read -r var val 00:05:59.576 15:34:58 -- accel/accel.sh@20 -- # val=32 00:05:59.576 15:34:58 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.576 15:34:58 -- accel/accel.sh@19 -- # IFS=: 00:05:59.576 15:34:58 -- accel/accel.sh@19 -- # read -r var val 00:05:59.576 15:34:58 -- accel/accel.sh@20 -- # val=32 00:05:59.576 15:34:58 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.576 15:34:58 -- accel/accel.sh@19 -- # IFS=: 00:05:59.576 15:34:58 -- accel/accel.sh@19 -- # read -r var val 00:05:59.576 15:34:58 -- accel/accel.sh@20 -- # val=1 00:05:59.576 15:34:58 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.576 15:34:58 -- accel/accel.sh@19 -- # IFS=: 00:05:59.576 15:34:58 -- accel/accel.sh@19 -- # read -r var val 00:05:59.576 15:34:58 -- accel/accel.sh@20 -- # val='1 seconds' 00:05:59.576 15:34:58 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.576 15:34:58 -- accel/accel.sh@19 -- # IFS=: 00:05:59.576 15:34:58 -- accel/accel.sh@19 -- # read -r var val 00:05:59.576 15:34:58 -- accel/accel.sh@20 -- # val=Yes 00:05:59.576 15:34:58 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.576 15:34:58 -- accel/accel.sh@19 -- # IFS=: 00:05:59.576 15:34:58 -- accel/accel.sh@19 -- # read -r var val 00:05:59.576 15:34:58 -- accel/accel.sh@20 -- # val= 00:05:59.576 15:34:58 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.576 15:34:58 -- accel/accel.sh@19 -- # IFS=: 00:05:59.576 15:34:58 -- accel/accel.sh@19 -- # read -r var val 00:05:59.576 15:34:58 -- accel/accel.sh@20 -- # val= 00:05:59.576 15:34:58 -- accel/accel.sh@21 -- # case "$var" in 00:05:59.576 15:34:58 -- accel/accel.sh@19 -- # IFS=: 00:05:59.576 15:34:58 -- accel/accel.sh@19 -- # read -r var val 00:06:00.954 15:34:59 -- accel/accel.sh@20 -- # val= 00:06:00.954 15:34:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.954 15:34:59 -- accel/accel.sh@19 -- # IFS=: 00:06:00.954 15:34:59 -- accel/accel.sh@19 -- # read -r var val 00:06:00.954 15:34:59 -- accel/accel.sh@20 -- # val= 00:06:00.954 15:34:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.954 15:34:59 -- accel/accel.sh@19 -- # IFS=: 00:06:00.954 15:34:59 -- accel/accel.sh@19 -- # read -r var val 00:06:00.954 15:34:59 -- accel/accel.sh@20 -- # val= 00:06:00.954 15:34:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.954 15:34:59 -- accel/accel.sh@19 -- # IFS=: 00:06:00.954 15:34:59 -- accel/accel.sh@19 -- # read -r var val 00:06:00.954 15:34:59 -- accel/accel.sh@20 -- # val= 00:06:00.954 15:34:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.954 15:34:59 -- accel/accel.sh@19 -- # IFS=: 00:06:00.954 15:34:59 -- accel/accel.sh@19 -- # read -r var val 00:06:00.954 15:34:59 -- accel/accel.sh@20 -- # val= 00:06:00.954 15:34:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.954 15:34:59 -- accel/accel.sh@19 -- # IFS=: 00:06:00.954 15:34:59 -- accel/accel.sh@19 -- # read -r var val 00:06:00.954 15:34:59 -- accel/accel.sh@20 -- # val= 00:06:00.954 15:34:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:00.954 15:34:59 -- accel/accel.sh@19 -- # IFS=: 00:06:00.954 15:34:59 -- accel/accel.sh@19 -- # read -r var val 00:06:00.954 15:34:59 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:00.954 15:34:59 -- accel/accel.sh@27 -- # [[ -n dualcast ]] 00:06:00.954 15:34:59 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:00.954 00:06:00.954 real 0m1.353s 00:06:00.954 user 0m1.250s 00:06:00.954 sys 0m0.114s 00:06:00.954 15:34:59 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:00.954 15:34:59 -- common/autotest_common.sh@10 -- # set +x 00:06:00.954 ************************************ 00:06:00.954 END TEST accel_dualcast 00:06:00.954 ************************************ 00:06:00.954 15:34:59 -- accel/accel.sh@108 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:06:00.954 15:34:59 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:00.954 15:34:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:00.954 15:34:59 -- common/autotest_common.sh@10 -- # set +x 00:06:00.954 ************************************ 00:06:00.954 START TEST accel_compare 00:06:00.954 ************************************ 00:06:00.954 15:34:59 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w compare -y 00:06:00.954 15:34:59 -- accel/accel.sh@16 -- # local accel_opc 00:06:00.954 15:34:59 -- accel/accel.sh@17 -- # local accel_module 00:06:00.954 15:34:59 -- accel/accel.sh@19 -- # IFS=: 00:06:00.955 15:34:59 -- accel/accel.sh@19 -- # read -r var val 00:06:00.955 15:34:59 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:06:00.955 15:34:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:06:00.955 15:34:59 -- accel/accel.sh@12 -- # build_accel_config 00:06:00.955 15:34:59 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:00.955 15:34:59 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:00.955 15:34:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:00.955 15:34:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:00.955 15:34:59 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:00.955 15:34:59 -- accel/accel.sh@40 -- # local IFS=, 00:06:00.955 15:34:59 -- accel/accel.sh@41 -- # jq -r . 00:06:00.955 [2024-04-26 15:34:59.488569] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:06:00.955 [2024-04-26 15:34:59.488627] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3175195 ] 00:06:00.955 EAL: No free 2048 kB hugepages reported on node 1 00:06:00.955 [2024-04-26 15:34:59.546607] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:01.214 [2024-04-26 15:34:59.616949] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:01.214 15:34:59 -- accel/accel.sh@20 -- # val= 00:06:01.214 15:34:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.214 15:34:59 -- accel/accel.sh@19 -- # IFS=: 00:06:01.214 15:34:59 -- accel/accel.sh@19 -- # read -r var val 00:06:01.214 15:34:59 -- accel/accel.sh@20 -- # val= 00:06:01.214 15:34:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.214 15:34:59 -- accel/accel.sh@19 -- # IFS=: 00:06:01.214 15:34:59 -- accel/accel.sh@19 -- # read -r var val 00:06:01.214 15:34:59 -- accel/accel.sh@20 -- # val=0x1 00:06:01.214 15:34:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.214 15:34:59 -- accel/accel.sh@19 -- # IFS=: 00:06:01.214 15:34:59 -- accel/accel.sh@19 -- # read -r var val 00:06:01.214 15:34:59 -- accel/accel.sh@20 -- # val= 00:06:01.214 15:34:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.214 15:34:59 -- accel/accel.sh@19 -- # IFS=: 00:06:01.214 15:34:59 -- accel/accel.sh@19 -- # read -r var val 00:06:01.214 15:34:59 -- accel/accel.sh@20 -- # val= 00:06:01.214 15:34:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.214 15:34:59 -- accel/accel.sh@19 -- # IFS=: 00:06:01.214 15:34:59 -- accel/accel.sh@19 -- # read -r var val 00:06:01.214 15:34:59 -- accel/accel.sh@20 -- # val=compare 00:06:01.214 15:34:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.214 15:34:59 -- accel/accel.sh@23 -- # accel_opc=compare 00:06:01.214 15:34:59 -- accel/accel.sh@19 -- # IFS=: 00:06:01.214 15:34:59 -- accel/accel.sh@19 -- # read -r var val 00:06:01.214 15:34:59 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:01.214 15:34:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.214 15:34:59 -- accel/accel.sh@19 -- # IFS=: 00:06:01.214 15:34:59 -- accel/accel.sh@19 -- # read -r var val 00:06:01.214 15:34:59 -- accel/accel.sh@20 -- # val= 00:06:01.214 15:34:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.214 15:34:59 -- accel/accel.sh@19 -- # IFS=: 00:06:01.214 15:34:59 -- accel/accel.sh@19 -- # read -r var val 00:06:01.214 15:34:59 -- accel/accel.sh@20 -- # val=software 00:06:01.214 15:34:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.214 15:34:59 -- accel/accel.sh@22 -- # accel_module=software 00:06:01.214 15:34:59 -- accel/accel.sh@19 -- # IFS=: 00:06:01.214 15:34:59 -- accel/accel.sh@19 -- # read -r var val 00:06:01.214 15:34:59 -- accel/accel.sh@20 -- # val=32 00:06:01.214 15:34:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.214 15:34:59 -- accel/accel.sh@19 -- # IFS=: 00:06:01.214 15:34:59 -- accel/accel.sh@19 -- # read -r var val 00:06:01.214 15:34:59 -- accel/accel.sh@20 -- # val=32 00:06:01.214 15:34:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.214 15:34:59 -- accel/accel.sh@19 -- # IFS=: 00:06:01.214 15:34:59 -- accel/accel.sh@19 -- # read -r var val 00:06:01.214 15:34:59 -- accel/accel.sh@20 -- # val=1 00:06:01.214 15:34:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.214 15:34:59 -- accel/accel.sh@19 -- # IFS=: 00:06:01.214 15:34:59 -- accel/accel.sh@19 -- # read -r var val 00:06:01.214 15:34:59 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:01.214 15:34:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.214 15:34:59 -- accel/accel.sh@19 -- # IFS=: 00:06:01.214 15:34:59 -- accel/accel.sh@19 -- # read -r var val 00:06:01.214 15:34:59 -- accel/accel.sh@20 -- # val=Yes 00:06:01.214 15:34:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.214 15:34:59 -- accel/accel.sh@19 -- # IFS=: 00:06:01.214 15:34:59 -- accel/accel.sh@19 -- # read -r var val 00:06:01.214 15:34:59 -- accel/accel.sh@20 -- # val= 00:06:01.214 15:34:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.214 15:34:59 -- accel/accel.sh@19 -- # IFS=: 00:06:01.214 15:34:59 -- accel/accel.sh@19 -- # read -r var val 00:06:01.214 15:34:59 -- accel/accel.sh@20 -- # val= 00:06:01.214 15:34:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:01.214 15:34:59 -- accel/accel.sh@19 -- # IFS=: 00:06:01.214 15:34:59 -- accel/accel.sh@19 -- # read -r var val 00:06:02.591 15:35:00 -- accel/accel.sh@20 -- # val= 00:06:02.591 15:35:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.591 15:35:00 -- accel/accel.sh@19 -- # IFS=: 00:06:02.591 15:35:00 -- accel/accel.sh@19 -- # read -r var val 00:06:02.591 15:35:00 -- accel/accel.sh@20 -- # val= 00:06:02.591 15:35:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.591 15:35:00 -- accel/accel.sh@19 -- # IFS=: 00:06:02.591 15:35:00 -- accel/accel.sh@19 -- # read -r var val 00:06:02.591 15:35:00 -- accel/accel.sh@20 -- # val= 00:06:02.591 15:35:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.591 15:35:00 -- accel/accel.sh@19 -- # IFS=: 00:06:02.591 15:35:00 -- accel/accel.sh@19 -- # read -r var val 00:06:02.591 15:35:00 -- accel/accel.sh@20 -- # val= 00:06:02.591 15:35:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.591 15:35:00 -- accel/accel.sh@19 -- # IFS=: 00:06:02.591 15:35:00 -- accel/accel.sh@19 -- # read -r var val 00:06:02.591 15:35:00 -- accel/accel.sh@20 -- # val= 00:06:02.591 15:35:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.591 15:35:00 -- accel/accel.sh@19 -- # IFS=: 00:06:02.591 15:35:00 -- accel/accel.sh@19 -- # read -r var val 00:06:02.591 15:35:00 -- accel/accel.sh@20 -- # val= 00:06:02.591 15:35:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.591 15:35:00 -- accel/accel.sh@19 -- # IFS=: 00:06:02.591 15:35:00 -- accel/accel.sh@19 -- # read -r var val 00:06:02.591 15:35:00 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:02.591 15:35:00 -- accel/accel.sh@27 -- # [[ -n compare ]] 00:06:02.591 15:35:00 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:02.591 00:06:02.591 real 0m1.360s 00:06:02.591 user 0m1.254s 00:06:02.591 sys 0m0.118s 00:06:02.591 15:35:00 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:02.592 15:35:00 -- common/autotest_common.sh@10 -- # set +x 00:06:02.592 ************************************ 00:06:02.592 END TEST accel_compare 00:06:02.592 ************************************ 00:06:02.592 15:35:00 -- accel/accel.sh@109 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:06:02.592 15:35:00 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:02.592 15:35:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:02.592 15:35:00 -- common/autotest_common.sh@10 -- # set +x 00:06:02.592 ************************************ 00:06:02.592 START TEST accel_xor 00:06:02.592 ************************************ 00:06:02.592 15:35:00 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w xor -y 00:06:02.592 15:35:00 -- accel/accel.sh@16 -- # local accel_opc 00:06:02.592 15:35:00 -- accel/accel.sh@17 -- # local accel_module 00:06:02.592 15:35:00 -- accel/accel.sh@19 -- # IFS=: 00:06:02.592 15:35:00 -- accel/accel.sh@19 -- # read -r var val 00:06:02.592 15:35:00 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:06:02.592 15:35:00 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:06:02.592 15:35:00 -- accel/accel.sh@12 -- # build_accel_config 00:06:02.592 15:35:00 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:02.592 15:35:00 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:02.592 15:35:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:02.592 15:35:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:02.592 15:35:00 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:02.592 15:35:00 -- accel/accel.sh@40 -- # local IFS=, 00:06:02.592 15:35:00 -- accel/accel.sh@41 -- # jq -r . 00:06:02.592 [2024-04-26 15:35:01.008042] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:06:02.592 [2024-04-26 15:35:01.008105] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3175455 ] 00:06:02.592 EAL: No free 2048 kB hugepages reported on node 1 00:06:02.592 [2024-04-26 15:35:01.065670] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:02.592 [2024-04-26 15:35:01.143248] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:02.592 15:35:01 -- accel/accel.sh@20 -- # val= 00:06:02.592 15:35:01 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.592 15:35:01 -- accel/accel.sh@19 -- # IFS=: 00:06:02.592 15:35:01 -- accel/accel.sh@19 -- # read -r var val 00:06:02.592 15:35:01 -- accel/accel.sh@20 -- # val= 00:06:02.592 15:35:01 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.592 15:35:01 -- accel/accel.sh@19 -- # IFS=: 00:06:02.592 15:35:01 -- accel/accel.sh@19 -- # read -r var val 00:06:02.592 15:35:01 -- accel/accel.sh@20 -- # val=0x1 00:06:02.592 15:35:01 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.592 15:35:01 -- accel/accel.sh@19 -- # IFS=: 00:06:02.592 15:35:01 -- accel/accel.sh@19 -- # read -r var val 00:06:02.592 15:35:01 -- accel/accel.sh@20 -- # val= 00:06:02.592 15:35:01 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.592 15:35:01 -- accel/accel.sh@19 -- # IFS=: 00:06:02.592 15:35:01 -- accel/accel.sh@19 -- # read -r var val 00:06:02.592 15:35:01 -- accel/accel.sh@20 -- # val= 00:06:02.592 15:35:01 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.592 15:35:01 -- accel/accel.sh@19 -- # IFS=: 00:06:02.592 15:35:01 -- accel/accel.sh@19 -- # read -r var val 00:06:02.592 15:35:01 -- accel/accel.sh@20 -- # val=xor 00:06:02.592 15:35:01 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.592 15:35:01 -- accel/accel.sh@23 -- # accel_opc=xor 00:06:02.592 15:35:01 -- accel/accel.sh@19 -- # IFS=: 00:06:02.592 15:35:01 -- accel/accel.sh@19 -- # read -r var val 00:06:02.592 15:35:01 -- accel/accel.sh@20 -- # val=2 00:06:02.592 15:35:01 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.592 15:35:01 -- accel/accel.sh@19 -- # IFS=: 00:06:02.592 15:35:01 -- accel/accel.sh@19 -- # read -r var val 00:06:02.592 15:35:01 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:02.592 15:35:01 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.592 15:35:01 -- accel/accel.sh@19 -- # IFS=: 00:06:02.592 15:35:01 -- accel/accel.sh@19 -- # read -r var val 00:06:02.592 15:35:01 -- accel/accel.sh@20 -- # val= 00:06:02.592 15:35:01 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.592 15:35:01 -- accel/accel.sh@19 -- # IFS=: 00:06:02.592 15:35:01 -- accel/accel.sh@19 -- # read -r var val 00:06:02.592 15:35:01 -- accel/accel.sh@20 -- # val=software 00:06:02.592 15:35:01 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.592 15:35:01 -- accel/accel.sh@22 -- # accel_module=software 00:06:02.592 15:35:01 -- accel/accel.sh@19 -- # IFS=: 00:06:02.592 15:35:01 -- accel/accel.sh@19 -- # read -r var val 00:06:02.592 15:35:01 -- accel/accel.sh@20 -- # val=32 00:06:02.592 15:35:01 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.592 15:35:01 -- accel/accel.sh@19 -- # IFS=: 00:06:02.592 15:35:01 -- accel/accel.sh@19 -- # read -r var val 00:06:02.850 15:35:01 -- accel/accel.sh@20 -- # val=32 00:06:02.851 15:35:01 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.851 15:35:01 -- accel/accel.sh@19 -- # IFS=: 00:06:02.851 15:35:01 -- accel/accel.sh@19 -- # read -r var val 00:06:02.851 15:35:01 -- accel/accel.sh@20 -- # val=1 00:06:02.851 15:35:01 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.851 15:35:01 -- accel/accel.sh@19 -- # IFS=: 00:06:02.851 15:35:01 -- accel/accel.sh@19 -- # read -r var val 00:06:02.851 15:35:01 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:02.851 15:35:01 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.851 15:35:01 -- accel/accel.sh@19 -- # IFS=: 00:06:02.851 15:35:01 -- accel/accel.sh@19 -- # read -r var val 00:06:02.851 15:35:01 -- accel/accel.sh@20 -- # val=Yes 00:06:02.851 15:35:01 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.851 15:35:01 -- accel/accel.sh@19 -- # IFS=: 00:06:02.851 15:35:01 -- accel/accel.sh@19 -- # read -r var val 00:06:02.851 15:35:01 -- accel/accel.sh@20 -- # val= 00:06:02.851 15:35:01 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.851 15:35:01 -- accel/accel.sh@19 -- # IFS=: 00:06:02.851 15:35:01 -- accel/accel.sh@19 -- # read -r var val 00:06:02.851 15:35:01 -- accel/accel.sh@20 -- # val= 00:06:02.851 15:35:01 -- accel/accel.sh@21 -- # case "$var" in 00:06:02.851 15:35:01 -- accel/accel.sh@19 -- # IFS=: 00:06:02.851 15:35:01 -- accel/accel.sh@19 -- # read -r var val 00:06:03.786 15:35:02 -- accel/accel.sh@20 -- # val= 00:06:03.786 15:35:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:03.786 15:35:02 -- accel/accel.sh@19 -- # IFS=: 00:06:03.786 15:35:02 -- accel/accel.sh@19 -- # read -r var val 00:06:03.786 15:35:02 -- accel/accel.sh@20 -- # val= 00:06:03.786 15:35:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:03.786 15:35:02 -- accel/accel.sh@19 -- # IFS=: 00:06:03.786 15:35:02 -- accel/accel.sh@19 -- # read -r var val 00:06:03.786 15:35:02 -- accel/accel.sh@20 -- # val= 00:06:03.786 15:35:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:03.786 15:35:02 -- accel/accel.sh@19 -- # IFS=: 00:06:03.786 15:35:02 -- accel/accel.sh@19 -- # read -r var val 00:06:03.786 15:35:02 -- accel/accel.sh@20 -- # val= 00:06:03.786 15:35:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:03.786 15:35:02 -- accel/accel.sh@19 -- # IFS=: 00:06:03.786 15:35:02 -- accel/accel.sh@19 -- # read -r var val 00:06:03.786 15:35:02 -- accel/accel.sh@20 -- # val= 00:06:03.786 15:35:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:03.786 15:35:02 -- accel/accel.sh@19 -- # IFS=: 00:06:03.786 15:35:02 -- accel/accel.sh@19 -- # read -r var val 00:06:03.786 15:35:02 -- accel/accel.sh@20 -- # val= 00:06:03.786 15:35:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:03.786 15:35:02 -- accel/accel.sh@19 -- # IFS=: 00:06:03.786 15:35:02 -- accel/accel.sh@19 -- # read -r var val 00:06:03.786 15:35:02 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:03.787 15:35:02 -- accel/accel.sh@27 -- # [[ -n xor ]] 00:06:03.787 15:35:02 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:03.787 00:06:03.787 real 0m1.365s 00:06:03.787 user 0m1.259s 00:06:03.787 sys 0m0.119s 00:06:03.787 15:35:02 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:03.787 15:35:02 -- common/autotest_common.sh@10 -- # set +x 00:06:03.787 ************************************ 00:06:03.787 END TEST accel_xor 00:06:03.787 ************************************ 00:06:03.787 15:35:02 -- accel/accel.sh@110 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:06:03.787 15:35:02 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:03.787 15:35:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:03.787 15:35:02 -- common/autotest_common.sh@10 -- # set +x 00:06:04.046 ************************************ 00:06:04.046 START TEST accel_xor 00:06:04.046 ************************************ 00:06:04.046 15:35:02 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w xor -y -x 3 00:06:04.046 15:35:02 -- accel/accel.sh@16 -- # local accel_opc 00:06:04.046 15:35:02 -- accel/accel.sh@17 -- # local accel_module 00:06:04.046 15:35:02 -- accel/accel.sh@19 -- # IFS=: 00:06:04.046 15:35:02 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:06:04.046 15:35:02 -- accel/accel.sh@19 -- # read -r var val 00:06:04.046 15:35:02 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:06:04.046 15:35:02 -- accel/accel.sh@12 -- # build_accel_config 00:06:04.046 15:35:02 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:04.046 15:35:02 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:04.046 15:35:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:04.046 15:35:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:04.046 15:35:02 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:04.046 15:35:02 -- accel/accel.sh@40 -- # local IFS=, 00:06:04.046 15:35:02 -- accel/accel.sh@41 -- # jq -r . 00:06:04.046 [2024-04-26 15:35:02.531541] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:06:04.046 [2024-04-26 15:35:02.531586] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3175734 ] 00:06:04.046 EAL: No free 2048 kB hugepages reported on node 1 00:06:04.046 [2024-04-26 15:35:02.585654] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:04.305 [2024-04-26 15:35:02.656490] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:04.305 15:35:02 -- accel/accel.sh@20 -- # val= 00:06:04.305 15:35:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.305 15:35:02 -- accel/accel.sh@19 -- # IFS=: 00:06:04.305 15:35:02 -- accel/accel.sh@19 -- # read -r var val 00:06:04.305 15:35:02 -- accel/accel.sh@20 -- # val= 00:06:04.305 15:35:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.305 15:35:02 -- accel/accel.sh@19 -- # IFS=: 00:06:04.305 15:35:02 -- accel/accel.sh@19 -- # read -r var val 00:06:04.305 15:35:02 -- accel/accel.sh@20 -- # val=0x1 00:06:04.305 15:35:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.305 15:35:02 -- accel/accel.sh@19 -- # IFS=: 00:06:04.305 15:35:02 -- accel/accel.sh@19 -- # read -r var val 00:06:04.305 15:35:02 -- accel/accel.sh@20 -- # val= 00:06:04.305 15:35:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.305 15:35:02 -- accel/accel.sh@19 -- # IFS=: 00:06:04.305 15:35:02 -- accel/accel.sh@19 -- # read -r var val 00:06:04.305 15:35:02 -- accel/accel.sh@20 -- # val= 00:06:04.305 15:35:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.305 15:35:02 -- accel/accel.sh@19 -- # IFS=: 00:06:04.305 15:35:02 -- accel/accel.sh@19 -- # read -r var val 00:06:04.305 15:35:02 -- accel/accel.sh@20 -- # val=xor 00:06:04.305 15:35:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.305 15:35:02 -- accel/accel.sh@23 -- # accel_opc=xor 00:06:04.305 15:35:02 -- accel/accel.sh@19 -- # IFS=: 00:06:04.305 15:35:02 -- accel/accel.sh@19 -- # read -r var val 00:06:04.305 15:35:02 -- accel/accel.sh@20 -- # val=3 00:06:04.305 15:35:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.305 15:35:02 -- accel/accel.sh@19 -- # IFS=: 00:06:04.305 15:35:02 -- accel/accel.sh@19 -- # read -r var val 00:06:04.305 15:35:02 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:04.305 15:35:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.305 15:35:02 -- accel/accel.sh@19 -- # IFS=: 00:06:04.305 15:35:02 -- accel/accel.sh@19 -- # read -r var val 00:06:04.305 15:35:02 -- accel/accel.sh@20 -- # val= 00:06:04.305 15:35:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.305 15:35:02 -- accel/accel.sh@19 -- # IFS=: 00:06:04.305 15:35:02 -- accel/accel.sh@19 -- # read -r var val 00:06:04.305 15:35:02 -- accel/accel.sh@20 -- # val=software 00:06:04.305 15:35:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.305 15:35:02 -- accel/accel.sh@22 -- # accel_module=software 00:06:04.305 15:35:02 -- accel/accel.sh@19 -- # IFS=: 00:06:04.305 15:35:02 -- accel/accel.sh@19 -- # read -r var val 00:06:04.305 15:35:02 -- accel/accel.sh@20 -- # val=32 00:06:04.305 15:35:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.305 15:35:02 -- accel/accel.sh@19 -- # IFS=: 00:06:04.305 15:35:02 -- accel/accel.sh@19 -- # read -r var val 00:06:04.305 15:35:02 -- accel/accel.sh@20 -- # val=32 00:06:04.305 15:35:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.305 15:35:02 -- accel/accel.sh@19 -- # IFS=: 00:06:04.305 15:35:02 -- accel/accel.sh@19 -- # read -r var val 00:06:04.305 15:35:02 -- accel/accel.sh@20 -- # val=1 00:06:04.305 15:35:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.305 15:35:02 -- accel/accel.sh@19 -- # IFS=: 00:06:04.305 15:35:02 -- accel/accel.sh@19 -- # read -r var val 00:06:04.305 15:35:02 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:04.305 15:35:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.305 15:35:02 -- accel/accel.sh@19 -- # IFS=: 00:06:04.305 15:35:02 -- accel/accel.sh@19 -- # read -r var val 00:06:04.305 15:35:02 -- accel/accel.sh@20 -- # val=Yes 00:06:04.305 15:35:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.305 15:35:02 -- accel/accel.sh@19 -- # IFS=: 00:06:04.305 15:35:02 -- accel/accel.sh@19 -- # read -r var val 00:06:04.305 15:35:02 -- accel/accel.sh@20 -- # val= 00:06:04.305 15:35:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.305 15:35:02 -- accel/accel.sh@19 -- # IFS=: 00:06:04.305 15:35:02 -- accel/accel.sh@19 -- # read -r var val 00:06:04.305 15:35:02 -- accel/accel.sh@20 -- # val= 00:06:04.305 15:35:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:04.305 15:35:02 -- accel/accel.sh@19 -- # IFS=: 00:06:04.305 15:35:02 -- accel/accel.sh@19 -- # read -r var val 00:06:05.679 15:35:03 -- accel/accel.sh@20 -- # val= 00:06:05.679 15:35:03 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.679 15:35:03 -- accel/accel.sh@19 -- # IFS=: 00:06:05.679 15:35:03 -- accel/accel.sh@19 -- # read -r var val 00:06:05.679 15:35:03 -- accel/accel.sh@20 -- # val= 00:06:05.679 15:35:03 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.679 15:35:03 -- accel/accel.sh@19 -- # IFS=: 00:06:05.679 15:35:03 -- accel/accel.sh@19 -- # read -r var val 00:06:05.679 15:35:03 -- accel/accel.sh@20 -- # val= 00:06:05.679 15:35:03 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.679 15:35:03 -- accel/accel.sh@19 -- # IFS=: 00:06:05.679 15:35:03 -- accel/accel.sh@19 -- # read -r var val 00:06:05.679 15:35:03 -- accel/accel.sh@20 -- # val= 00:06:05.679 15:35:03 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.679 15:35:03 -- accel/accel.sh@19 -- # IFS=: 00:06:05.679 15:35:03 -- accel/accel.sh@19 -- # read -r var val 00:06:05.679 15:35:03 -- accel/accel.sh@20 -- # val= 00:06:05.679 15:35:03 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.679 15:35:03 -- accel/accel.sh@19 -- # IFS=: 00:06:05.679 15:35:03 -- accel/accel.sh@19 -- # read -r var val 00:06:05.679 15:35:03 -- accel/accel.sh@20 -- # val= 00:06:05.679 15:35:03 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.679 15:35:03 -- accel/accel.sh@19 -- # IFS=: 00:06:05.679 15:35:03 -- accel/accel.sh@19 -- # read -r var val 00:06:05.679 15:35:03 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:05.680 15:35:03 -- accel/accel.sh@27 -- # [[ -n xor ]] 00:06:05.680 15:35:03 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:05.680 00:06:05.680 real 0m1.352s 00:06:05.680 user 0m1.252s 00:06:05.680 sys 0m0.113s 00:06:05.680 15:35:03 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:05.680 15:35:03 -- common/autotest_common.sh@10 -- # set +x 00:06:05.680 ************************************ 00:06:05.680 END TEST accel_xor 00:06:05.680 ************************************ 00:06:05.680 15:35:03 -- accel/accel.sh@111 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:06:05.680 15:35:03 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:05.680 15:35:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:05.680 15:35:03 -- common/autotest_common.sh@10 -- # set +x 00:06:05.680 ************************************ 00:06:05.680 START TEST accel_dif_verify 00:06:05.680 ************************************ 00:06:05.680 15:35:04 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w dif_verify 00:06:05.680 15:35:04 -- accel/accel.sh@16 -- # local accel_opc 00:06:05.680 15:35:04 -- accel/accel.sh@17 -- # local accel_module 00:06:05.680 15:35:04 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # IFS=: 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # read -r var val 00:06:05.680 15:35:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:06:05.680 15:35:04 -- accel/accel.sh@12 -- # build_accel_config 00:06:05.680 15:35:04 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:05.680 15:35:04 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:05.680 15:35:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:05.680 15:35:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:05.680 15:35:04 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:05.680 15:35:04 -- accel/accel.sh@40 -- # local IFS=, 00:06:05.680 15:35:04 -- accel/accel.sh@41 -- # jq -r . 00:06:05.680 [2024-04-26 15:35:04.042370] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:06:05.680 [2024-04-26 15:35:04.042417] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3176085 ] 00:06:05.680 EAL: No free 2048 kB hugepages reported on node 1 00:06:05.680 [2024-04-26 15:35:04.095704] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:05.680 [2024-04-26 15:35:04.164890] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:05.680 15:35:04 -- accel/accel.sh@20 -- # val= 00:06:05.680 15:35:04 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # IFS=: 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # read -r var val 00:06:05.680 15:35:04 -- accel/accel.sh@20 -- # val= 00:06:05.680 15:35:04 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # IFS=: 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # read -r var val 00:06:05.680 15:35:04 -- accel/accel.sh@20 -- # val=0x1 00:06:05.680 15:35:04 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # IFS=: 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # read -r var val 00:06:05.680 15:35:04 -- accel/accel.sh@20 -- # val= 00:06:05.680 15:35:04 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # IFS=: 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # read -r var val 00:06:05.680 15:35:04 -- accel/accel.sh@20 -- # val= 00:06:05.680 15:35:04 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # IFS=: 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # read -r var val 00:06:05.680 15:35:04 -- accel/accel.sh@20 -- # val=dif_verify 00:06:05.680 15:35:04 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.680 15:35:04 -- accel/accel.sh@23 -- # accel_opc=dif_verify 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # IFS=: 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # read -r var val 00:06:05.680 15:35:04 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:05.680 15:35:04 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # IFS=: 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # read -r var val 00:06:05.680 15:35:04 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:05.680 15:35:04 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # IFS=: 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # read -r var val 00:06:05.680 15:35:04 -- accel/accel.sh@20 -- # val='512 bytes' 00:06:05.680 15:35:04 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # IFS=: 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # read -r var val 00:06:05.680 15:35:04 -- accel/accel.sh@20 -- # val='8 bytes' 00:06:05.680 15:35:04 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # IFS=: 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # read -r var val 00:06:05.680 15:35:04 -- accel/accel.sh@20 -- # val= 00:06:05.680 15:35:04 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # IFS=: 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # read -r var val 00:06:05.680 15:35:04 -- accel/accel.sh@20 -- # val=software 00:06:05.680 15:35:04 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.680 15:35:04 -- accel/accel.sh@22 -- # accel_module=software 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # IFS=: 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # read -r var val 00:06:05.680 15:35:04 -- accel/accel.sh@20 -- # val=32 00:06:05.680 15:35:04 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # IFS=: 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # read -r var val 00:06:05.680 15:35:04 -- accel/accel.sh@20 -- # val=32 00:06:05.680 15:35:04 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # IFS=: 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # read -r var val 00:06:05.680 15:35:04 -- accel/accel.sh@20 -- # val=1 00:06:05.680 15:35:04 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # IFS=: 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # read -r var val 00:06:05.680 15:35:04 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:05.680 15:35:04 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # IFS=: 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # read -r var val 00:06:05.680 15:35:04 -- accel/accel.sh@20 -- # val=No 00:06:05.680 15:35:04 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # IFS=: 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # read -r var val 00:06:05.680 15:35:04 -- accel/accel.sh@20 -- # val= 00:06:05.680 15:35:04 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # IFS=: 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # read -r var val 00:06:05.680 15:35:04 -- accel/accel.sh@20 -- # val= 00:06:05.680 15:35:04 -- accel/accel.sh@21 -- # case "$var" in 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # IFS=: 00:06:05.680 15:35:04 -- accel/accel.sh@19 -- # read -r var val 00:06:07.054 15:35:05 -- accel/accel.sh@20 -- # val= 00:06:07.054 15:35:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.054 15:35:05 -- accel/accel.sh@19 -- # IFS=: 00:06:07.054 15:35:05 -- accel/accel.sh@19 -- # read -r var val 00:06:07.054 15:35:05 -- accel/accel.sh@20 -- # val= 00:06:07.054 15:35:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.054 15:35:05 -- accel/accel.sh@19 -- # IFS=: 00:06:07.054 15:35:05 -- accel/accel.sh@19 -- # read -r var val 00:06:07.054 15:35:05 -- accel/accel.sh@20 -- # val= 00:06:07.054 15:35:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.054 15:35:05 -- accel/accel.sh@19 -- # IFS=: 00:06:07.054 15:35:05 -- accel/accel.sh@19 -- # read -r var val 00:06:07.054 15:35:05 -- accel/accel.sh@20 -- # val= 00:06:07.054 15:35:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.054 15:35:05 -- accel/accel.sh@19 -- # IFS=: 00:06:07.054 15:35:05 -- accel/accel.sh@19 -- # read -r var val 00:06:07.054 15:35:05 -- accel/accel.sh@20 -- # val= 00:06:07.054 15:35:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.054 15:35:05 -- accel/accel.sh@19 -- # IFS=: 00:06:07.054 15:35:05 -- accel/accel.sh@19 -- # read -r var val 00:06:07.054 15:35:05 -- accel/accel.sh@20 -- # val= 00:06:07.054 15:35:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.054 15:35:05 -- accel/accel.sh@19 -- # IFS=: 00:06:07.054 15:35:05 -- accel/accel.sh@19 -- # read -r var val 00:06:07.054 15:35:05 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:07.054 15:35:05 -- accel/accel.sh@27 -- # [[ -n dif_verify ]] 00:06:07.054 15:35:05 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:07.054 00:06:07.054 real 0m1.341s 00:06:07.054 user 0m1.255s 00:06:07.054 sys 0m0.100s 00:06:07.054 15:35:05 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:07.054 15:35:05 -- common/autotest_common.sh@10 -- # set +x 00:06:07.054 ************************************ 00:06:07.054 END TEST accel_dif_verify 00:06:07.054 ************************************ 00:06:07.054 15:35:05 -- accel/accel.sh@112 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:06:07.054 15:35:05 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:07.054 15:35:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:07.054 15:35:05 -- common/autotest_common.sh@10 -- # set +x 00:06:07.054 ************************************ 00:06:07.054 START TEST accel_dif_generate 00:06:07.054 ************************************ 00:06:07.054 15:35:05 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w dif_generate 00:06:07.055 15:35:05 -- accel/accel.sh@16 -- # local accel_opc 00:06:07.055 15:35:05 -- accel/accel.sh@17 -- # local accel_module 00:06:07.055 15:35:05 -- accel/accel.sh@19 -- # IFS=: 00:06:07.055 15:35:05 -- accel/accel.sh@19 -- # read -r var val 00:06:07.055 15:35:05 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:06:07.055 15:35:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:06:07.055 15:35:05 -- accel/accel.sh@12 -- # build_accel_config 00:06:07.055 15:35:05 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:07.055 15:35:05 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:07.055 15:35:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:07.055 15:35:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:07.055 15:35:05 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:07.055 15:35:05 -- accel/accel.sh@40 -- # local IFS=, 00:06:07.055 15:35:05 -- accel/accel.sh@41 -- # jq -r . 00:06:07.055 [2024-04-26 15:35:05.560772] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:06:07.055 [2024-04-26 15:35:05.560834] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3176423 ] 00:06:07.055 EAL: No free 2048 kB hugepages reported on node 1 00:06:07.055 [2024-04-26 15:35:05.618270] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:07.323 [2024-04-26 15:35:05.690266] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:07.323 15:35:05 -- accel/accel.sh@20 -- # val= 00:06:07.323 15:35:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.323 15:35:05 -- accel/accel.sh@19 -- # IFS=: 00:06:07.323 15:35:05 -- accel/accel.sh@19 -- # read -r var val 00:06:07.323 15:35:05 -- accel/accel.sh@20 -- # val= 00:06:07.323 15:35:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.323 15:35:05 -- accel/accel.sh@19 -- # IFS=: 00:06:07.323 15:35:05 -- accel/accel.sh@19 -- # read -r var val 00:06:07.323 15:35:05 -- accel/accel.sh@20 -- # val=0x1 00:06:07.323 15:35:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.323 15:35:05 -- accel/accel.sh@19 -- # IFS=: 00:06:07.323 15:35:05 -- accel/accel.sh@19 -- # read -r var val 00:06:07.323 15:35:05 -- accel/accel.sh@20 -- # val= 00:06:07.323 15:35:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.323 15:35:05 -- accel/accel.sh@19 -- # IFS=: 00:06:07.323 15:35:05 -- accel/accel.sh@19 -- # read -r var val 00:06:07.323 15:35:05 -- accel/accel.sh@20 -- # val= 00:06:07.323 15:35:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.323 15:35:05 -- accel/accel.sh@19 -- # IFS=: 00:06:07.323 15:35:05 -- accel/accel.sh@19 -- # read -r var val 00:06:07.323 15:35:05 -- accel/accel.sh@20 -- # val=dif_generate 00:06:07.323 15:35:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.323 15:35:05 -- accel/accel.sh@23 -- # accel_opc=dif_generate 00:06:07.323 15:35:05 -- accel/accel.sh@19 -- # IFS=: 00:06:07.323 15:35:05 -- accel/accel.sh@19 -- # read -r var val 00:06:07.323 15:35:05 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:07.323 15:35:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.323 15:35:05 -- accel/accel.sh@19 -- # IFS=: 00:06:07.323 15:35:05 -- accel/accel.sh@19 -- # read -r var val 00:06:07.323 15:35:05 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:07.323 15:35:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.323 15:35:05 -- accel/accel.sh@19 -- # IFS=: 00:06:07.323 15:35:05 -- accel/accel.sh@19 -- # read -r var val 00:06:07.323 15:35:05 -- accel/accel.sh@20 -- # val='512 bytes' 00:06:07.323 15:35:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.323 15:35:05 -- accel/accel.sh@19 -- # IFS=: 00:06:07.323 15:35:05 -- accel/accel.sh@19 -- # read -r var val 00:06:07.323 15:35:05 -- accel/accel.sh@20 -- # val='8 bytes' 00:06:07.323 15:35:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.323 15:35:05 -- accel/accel.sh@19 -- # IFS=: 00:06:07.323 15:35:05 -- accel/accel.sh@19 -- # read -r var val 00:06:07.323 15:35:05 -- accel/accel.sh@20 -- # val= 00:06:07.323 15:35:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.323 15:35:05 -- accel/accel.sh@19 -- # IFS=: 00:06:07.323 15:35:05 -- accel/accel.sh@19 -- # read -r var val 00:06:07.323 15:35:05 -- accel/accel.sh@20 -- # val=software 00:06:07.323 15:35:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.323 15:35:05 -- accel/accel.sh@22 -- # accel_module=software 00:06:07.323 15:35:05 -- accel/accel.sh@19 -- # IFS=: 00:06:07.323 15:35:05 -- accel/accel.sh@19 -- # read -r var val 00:06:07.323 15:35:05 -- accel/accel.sh@20 -- # val=32 00:06:07.323 15:35:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.323 15:35:05 -- accel/accel.sh@19 -- # IFS=: 00:06:07.323 15:35:05 -- accel/accel.sh@19 -- # read -r var val 00:06:07.323 15:35:05 -- accel/accel.sh@20 -- # val=32 00:06:07.323 15:35:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.323 15:35:05 -- accel/accel.sh@19 -- # IFS=: 00:06:07.323 15:35:05 -- accel/accel.sh@19 -- # read -r var val 00:06:07.323 15:35:05 -- accel/accel.sh@20 -- # val=1 00:06:07.323 15:35:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.323 15:35:05 -- accel/accel.sh@19 -- # IFS=: 00:06:07.323 15:35:05 -- accel/accel.sh@19 -- # read -r var val 00:06:07.323 15:35:05 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:07.323 15:35:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.323 15:35:05 -- accel/accel.sh@19 -- # IFS=: 00:06:07.323 15:35:05 -- accel/accel.sh@19 -- # read -r var val 00:06:07.323 15:35:05 -- accel/accel.sh@20 -- # val=No 00:06:07.323 15:35:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.323 15:35:05 -- accel/accel.sh@19 -- # IFS=: 00:06:07.323 15:35:05 -- accel/accel.sh@19 -- # read -r var val 00:06:07.323 15:35:05 -- accel/accel.sh@20 -- # val= 00:06:07.323 15:35:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.323 15:35:05 -- accel/accel.sh@19 -- # IFS=: 00:06:07.323 15:35:05 -- accel/accel.sh@19 -- # read -r var val 00:06:07.323 15:35:05 -- accel/accel.sh@20 -- # val= 00:06:07.324 15:35:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:07.324 15:35:05 -- accel/accel.sh@19 -- # IFS=: 00:06:07.324 15:35:05 -- accel/accel.sh@19 -- # read -r var val 00:06:08.705 15:35:06 -- accel/accel.sh@20 -- # val= 00:06:08.705 15:35:06 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.705 15:35:06 -- accel/accel.sh@19 -- # IFS=: 00:06:08.705 15:35:06 -- accel/accel.sh@19 -- # read -r var val 00:06:08.705 15:35:06 -- accel/accel.sh@20 -- # val= 00:06:08.705 15:35:06 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.705 15:35:06 -- accel/accel.sh@19 -- # IFS=: 00:06:08.705 15:35:06 -- accel/accel.sh@19 -- # read -r var val 00:06:08.705 15:35:06 -- accel/accel.sh@20 -- # val= 00:06:08.705 15:35:06 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.705 15:35:06 -- accel/accel.sh@19 -- # IFS=: 00:06:08.705 15:35:06 -- accel/accel.sh@19 -- # read -r var val 00:06:08.705 15:35:06 -- accel/accel.sh@20 -- # val= 00:06:08.705 15:35:06 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.705 15:35:06 -- accel/accel.sh@19 -- # IFS=: 00:06:08.705 15:35:06 -- accel/accel.sh@19 -- # read -r var val 00:06:08.705 15:35:06 -- accel/accel.sh@20 -- # val= 00:06:08.705 15:35:06 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.705 15:35:06 -- accel/accel.sh@19 -- # IFS=: 00:06:08.705 15:35:06 -- accel/accel.sh@19 -- # read -r var val 00:06:08.705 15:35:06 -- accel/accel.sh@20 -- # val= 00:06:08.705 15:35:06 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.705 15:35:06 -- accel/accel.sh@19 -- # IFS=: 00:06:08.705 15:35:06 -- accel/accel.sh@19 -- # read -r var val 00:06:08.705 15:35:06 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:08.705 15:35:06 -- accel/accel.sh@27 -- # [[ -n dif_generate ]] 00:06:08.705 15:35:06 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:08.705 00:06:08.705 real 0m1.361s 00:06:08.705 user 0m1.268s 00:06:08.705 sys 0m0.109s 00:06:08.705 15:35:06 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:08.705 15:35:06 -- common/autotest_common.sh@10 -- # set +x 00:06:08.705 ************************************ 00:06:08.705 END TEST accel_dif_generate 00:06:08.705 ************************************ 00:06:08.705 15:35:06 -- accel/accel.sh@113 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:06:08.705 15:35:06 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:08.705 15:35:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:08.705 15:35:06 -- common/autotest_common.sh@10 -- # set +x 00:06:08.705 ************************************ 00:06:08.705 START TEST accel_dif_generate_copy 00:06:08.706 ************************************ 00:06:08.706 15:35:07 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w dif_generate_copy 00:06:08.706 15:35:07 -- accel/accel.sh@16 -- # local accel_opc 00:06:08.706 15:35:07 -- accel/accel.sh@17 -- # local accel_module 00:06:08.706 15:35:07 -- accel/accel.sh@19 -- # IFS=: 00:06:08.706 15:35:07 -- accel/accel.sh@19 -- # read -r var val 00:06:08.706 15:35:07 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:06:08.706 15:35:07 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:08.706 15:35:07 -- accel/accel.sh@12 -- # build_accel_config 00:06:08.706 15:35:07 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:08.706 15:35:07 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:08.706 15:35:07 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:08.706 15:35:07 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:08.706 15:35:07 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:08.706 15:35:07 -- accel/accel.sh@40 -- # local IFS=, 00:06:08.706 15:35:07 -- accel/accel.sh@41 -- # jq -r . 00:06:08.706 [2024-04-26 15:35:07.076699] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:06:08.706 [2024-04-26 15:35:07.076749] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3176701 ] 00:06:08.706 EAL: No free 2048 kB hugepages reported on node 1 00:06:08.706 [2024-04-26 15:35:07.131309] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:08.706 [2024-04-26 15:35:07.201487] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:08.706 15:35:07 -- accel/accel.sh@20 -- # val= 00:06:08.706 15:35:07 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.706 15:35:07 -- accel/accel.sh@19 -- # IFS=: 00:06:08.706 15:35:07 -- accel/accel.sh@19 -- # read -r var val 00:06:08.706 15:35:07 -- accel/accel.sh@20 -- # val= 00:06:08.706 15:35:07 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.706 15:35:07 -- accel/accel.sh@19 -- # IFS=: 00:06:08.706 15:35:07 -- accel/accel.sh@19 -- # read -r var val 00:06:08.706 15:35:07 -- accel/accel.sh@20 -- # val=0x1 00:06:08.706 15:35:07 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.706 15:35:07 -- accel/accel.sh@19 -- # IFS=: 00:06:08.706 15:35:07 -- accel/accel.sh@19 -- # read -r var val 00:06:08.706 15:35:07 -- accel/accel.sh@20 -- # val= 00:06:08.706 15:35:07 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.706 15:35:07 -- accel/accel.sh@19 -- # IFS=: 00:06:08.706 15:35:07 -- accel/accel.sh@19 -- # read -r var val 00:06:08.706 15:35:07 -- accel/accel.sh@20 -- # val= 00:06:08.706 15:35:07 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.706 15:35:07 -- accel/accel.sh@19 -- # IFS=: 00:06:08.706 15:35:07 -- accel/accel.sh@19 -- # read -r var val 00:06:08.706 15:35:07 -- accel/accel.sh@20 -- # val=dif_generate_copy 00:06:08.706 15:35:07 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.706 15:35:07 -- accel/accel.sh@23 -- # accel_opc=dif_generate_copy 00:06:08.706 15:35:07 -- accel/accel.sh@19 -- # IFS=: 00:06:08.706 15:35:07 -- accel/accel.sh@19 -- # read -r var val 00:06:08.706 15:35:07 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:08.706 15:35:07 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.706 15:35:07 -- accel/accel.sh@19 -- # IFS=: 00:06:08.706 15:35:07 -- accel/accel.sh@19 -- # read -r var val 00:06:08.706 15:35:07 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:08.706 15:35:07 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.706 15:35:07 -- accel/accel.sh@19 -- # IFS=: 00:06:08.706 15:35:07 -- accel/accel.sh@19 -- # read -r var val 00:06:08.706 15:35:07 -- accel/accel.sh@20 -- # val= 00:06:08.706 15:35:07 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.706 15:35:07 -- accel/accel.sh@19 -- # IFS=: 00:06:08.706 15:35:07 -- accel/accel.sh@19 -- # read -r var val 00:06:08.706 15:35:07 -- accel/accel.sh@20 -- # val=software 00:06:08.706 15:35:07 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.706 15:35:07 -- accel/accel.sh@22 -- # accel_module=software 00:06:08.706 15:35:07 -- accel/accel.sh@19 -- # IFS=: 00:06:08.706 15:35:07 -- accel/accel.sh@19 -- # read -r var val 00:06:08.706 15:35:07 -- accel/accel.sh@20 -- # val=32 00:06:08.706 15:35:07 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.706 15:35:07 -- accel/accel.sh@19 -- # IFS=: 00:06:08.706 15:35:07 -- accel/accel.sh@19 -- # read -r var val 00:06:08.706 15:35:07 -- accel/accel.sh@20 -- # val=32 00:06:08.706 15:35:07 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.706 15:35:07 -- accel/accel.sh@19 -- # IFS=: 00:06:08.706 15:35:07 -- accel/accel.sh@19 -- # read -r var val 00:06:08.706 15:35:07 -- accel/accel.sh@20 -- # val=1 00:06:08.706 15:35:07 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.706 15:35:07 -- accel/accel.sh@19 -- # IFS=: 00:06:08.706 15:35:07 -- accel/accel.sh@19 -- # read -r var val 00:06:08.706 15:35:07 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:08.706 15:35:07 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.706 15:35:07 -- accel/accel.sh@19 -- # IFS=: 00:06:08.706 15:35:07 -- accel/accel.sh@19 -- # read -r var val 00:06:08.706 15:35:07 -- accel/accel.sh@20 -- # val=No 00:06:08.706 15:35:07 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.706 15:35:07 -- accel/accel.sh@19 -- # IFS=: 00:06:08.706 15:35:07 -- accel/accel.sh@19 -- # read -r var val 00:06:08.706 15:35:07 -- accel/accel.sh@20 -- # val= 00:06:08.706 15:35:07 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.706 15:35:07 -- accel/accel.sh@19 -- # IFS=: 00:06:08.706 15:35:07 -- accel/accel.sh@19 -- # read -r var val 00:06:08.706 15:35:07 -- accel/accel.sh@20 -- # val= 00:06:08.706 15:35:07 -- accel/accel.sh@21 -- # case "$var" in 00:06:08.706 15:35:07 -- accel/accel.sh@19 -- # IFS=: 00:06:08.706 15:35:07 -- accel/accel.sh@19 -- # read -r var val 00:06:10.084 15:35:08 -- accel/accel.sh@20 -- # val= 00:06:10.084 15:35:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.084 15:35:08 -- accel/accel.sh@19 -- # IFS=: 00:06:10.084 15:35:08 -- accel/accel.sh@19 -- # read -r var val 00:06:10.084 15:35:08 -- accel/accel.sh@20 -- # val= 00:06:10.084 15:35:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.084 15:35:08 -- accel/accel.sh@19 -- # IFS=: 00:06:10.084 15:35:08 -- accel/accel.sh@19 -- # read -r var val 00:06:10.084 15:35:08 -- accel/accel.sh@20 -- # val= 00:06:10.084 15:35:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.085 15:35:08 -- accel/accel.sh@19 -- # IFS=: 00:06:10.085 15:35:08 -- accel/accel.sh@19 -- # read -r var val 00:06:10.085 15:35:08 -- accel/accel.sh@20 -- # val= 00:06:10.085 15:35:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.085 15:35:08 -- accel/accel.sh@19 -- # IFS=: 00:06:10.085 15:35:08 -- accel/accel.sh@19 -- # read -r var val 00:06:10.085 15:35:08 -- accel/accel.sh@20 -- # val= 00:06:10.085 15:35:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.085 15:35:08 -- accel/accel.sh@19 -- # IFS=: 00:06:10.085 15:35:08 -- accel/accel.sh@19 -- # read -r var val 00:06:10.085 15:35:08 -- accel/accel.sh@20 -- # val= 00:06:10.085 15:35:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.085 15:35:08 -- accel/accel.sh@19 -- # IFS=: 00:06:10.085 15:35:08 -- accel/accel.sh@19 -- # read -r var val 00:06:10.085 15:35:08 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:10.085 15:35:08 -- accel/accel.sh@27 -- # [[ -n dif_generate_copy ]] 00:06:10.085 15:35:08 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:10.085 00:06:10.085 real 0m1.353s 00:06:10.085 user 0m1.257s 00:06:10.085 sys 0m0.110s 00:06:10.085 15:35:08 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:10.085 15:35:08 -- common/autotest_common.sh@10 -- # set +x 00:06:10.085 ************************************ 00:06:10.085 END TEST accel_dif_generate_copy 00:06:10.085 ************************************ 00:06:10.085 15:35:08 -- accel/accel.sh@115 -- # [[ y == y ]] 00:06:10.085 15:35:08 -- accel/accel.sh@116 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:06:10.085 15:35:08 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:10.085 15:35:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:10.085 15:35:08 -- common/autotest_common.sh@10 -- # set +x 00:06:10.085 ************************************ 00:06:10.085 START TEST accel_comp 00:06:10.085 ************************************ 00:06:10.085 15:35:08 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:06:10.085 15:35:08 -- accel/accel.sh@16 -- # local accel_opc 00:06:10.085 15:35:08 -- accel/accel.sh@17 -- # local accel_module 00:06:10.085 15:35:08 -- accel/accel.sh@19 -- # IFS=: 00:06:10.085 15:35:08 -- accel/accel.sh@19 -- # read -r var val 00:06:10.085 15:35:08 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:06:10.085 15:35:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:06:10.085 15:35:08 -- accel/accel.sh@12 -- # build_accel_config 00:06:10.085 15:35:08 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:10.085 15:35:08 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:10.085 15:35:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:10.085 15:35:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:10.085 15:35:08 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:10.085 15:35:08 -- accel/accel.sh@40 -- # local IFS=, 00:06:10.085 15:35:08 -- accel/accel.sh@41 -- # jq -r . 00:06:10.085 [2024-04-26 15:35:08.588972] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:06:10.085 [2024-04-26 15:35:08.589036] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3176955 ] 00:06:10.085 EAL: No free 2048 kB hugepages reported on node 1 00:06:10.085 [2024-04-26 15:35:08.646235] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:10.345 [2024-04-26 15:35:08.716283] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:10.345 15:35:08 -- accel/accel.sh@20 -- # val= 00:06:10.345 15:35:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.345 15:35:08 -- accel/accel.sh@19 -- # IFS=: 00:06:10.345 15:35:08 -- accel/accel.sh@19 -- # read -r var val 00:06:10.345 15:35:08 -- accel/accel.sh@20 -- # val= 00:06:10.345 15:35:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.345 15:35:08 -- accel/accel.sh@19 -- # IFS=: 00:06:10.345 15:35:08 -- accel/accel.sh@19 -- # read -r var val 00:06:10.345 15:35:08 -- accel/accel.sh@20 -- # val= 00:06:10.345 15:35:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.345 15:35:08 -- accel/accel.sh@19 -- # IFS=: 00:06:10.345 15:35:08 -- accel/accel.sh@19 -- # read -r var val 00:06:10.345 15:35:08 -- accel/accel.sh@20 -- # val=0x1 00:06:10.345 15:35:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.345 15:35:08 -- accel/accel.sh@19 -- # IFS=: 00:06:10.345 15:35:08 -- accel/accel.sh@19 -- # read -r var val 00:06:10.345 15:35:08 -- accel/accel.sh@20 -- # val= 00:06:10.345 15:35:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.345 15:35:08 -- accel/accel.sh@19 -- # IFS=: 00:06:10.345 15:35:08 -- accel/accel.sh@19 -- # read -r var val 00:06:10.345 15:35:08 -- accel/accel.sh@20 -- # val= 00:06:10.345 15:35:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.345 15:35:08 -- accel/accel.sh@19 -- # IFS=: 00:06:10.345 15:35:08 -- accel/accel.sh@19 -- # read -r var val 00:06:10.345 15:35:08 -- accel/accel.sh@20 -- # val=compress 00:06:10.345 15:35:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.345 15:35:08 -- accel/accel.sh@23 -- # accel_opc=compress 00:06:10.345 15:35:08 -- accel/accel.sh@19 -- # IFS=: 00:06:10.345 15:35:08 -- accel/accel.sh@19 -- # read -r var val 00:06:10.345 15:35:08 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:10.345 15:35:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.345 15:35:08 -- accel/accel.sh@19 -- # IFS=: 00:06:10.345 15:35:08 -- accel/accel.sh@19 -- # read -r var val 00:06:10.345 15:35:08 -- accel/accel.sh@20 -- # val= 00:06:10.345 15:35:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.345 15:35:08 -- accel/accel.sh@19 -- # IFS=: 00:06:10.345 15:35:08 -- accel/accel.sh@19 -- # read -r var val 00:06:10.345 15:35:08 -- accel/accel.sh@20 -- # val=software 00:06:10.345 15:35:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.345 15:35:08 -- accel/accel.sh@22 -- # accel_module=software 00:06:10.345 15:35:08 -- accel/accel.sh@19 -- # IFS=: 00:06:10.345 15:35:08 -- accel/accel.sh@19 -- # read -r var val 00:06:10.345 15:35:08 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:06:10.345 15:35:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.345 15:35:08 -- accel/accel.sh@19 -- # IFS=: 00:06:10.345 15:35:08 -- accel/accel.sh@19 -- # read -r var val 00:06:10.345 15:35:08 -- accel/accel.sh@20 -- # val=32 00:06:10.345 15:35:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.345 15:35:08 -- accel/accel.sh@19 -- # IFS=: 00:06:10.345 15:35:08 -- accel/accel.sh@19 -- # read -r var val 00:06:10.345 15:35:08 -- accel/accel.sh@20 -- # val=32 00:06:10.345 15:35:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.345 15:35:08 -- accel/accel.sh@19 -- # IFS=: 00:06:10.345 15:35:08 -- accel/accel.sh@19 -- # read -r var val 00:06:10.345 15:35:08 -- accel/accel.sh@20 -- # val=1 00:06:10.345 15:35:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.345 15:35:08 -- accel/accel.sh@19 -- # IFS=: 00:06:10.345 15:35:08 -- accel/accel.sh@19 -- # read -r var val 00:06:10.345 15:35:08 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:10.345 15:35:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.345 15:35:08 -- accel/accel.sh@19 -- # IFS=: 00:06:10.345 15:35:08 -- accel/accel.sh@19 -- # read -r var val 00:06:10.345 15:35:08 -- accel/accel.sh@20 -- # val=No 00:06:10.345 15:35:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.345 15:35:08 -- accel/accel.sh@19 -- # IFS=: 00:06:10.345 15:35:08 -- accel/accel.sh@19 -- # read -r var val 00:06:10.345 15:35:08 -- accel/accel.sh@20 -- # val= 00:06:10.345 15:35:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.345 15:35:08 -- accel/accel.sh@19 -- # IFS=: 00:06:10.345 15:35:08 -- accel/accel.sh@19 -- # read -r var val 00:06:10.345 15:35:08 -- accel/accel.sh@20 -- # val= 00:06:10.345 15:35:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:10.345 15:35:08 -- accel/accel.sh@19 -- # IFS=: 00:06:10.345 15:35:08 -- accel/accel.sh@19 -- # read -r var val 00:06:11.729 15:35:09 -- accel/accel.sh@20 -- # val= 00:06:11.729 15:35:09 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.729 15:35:09 -- accel/accel.sh@19 -- # IFS=: 00:06:11.729 15:35:09 -- accel/accel.sh@19 -- # read -r var val 00:06:11.729 15:35:09 -- accel/accel.sh@20 -- # val= 00:06:11.729 15:35:09 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.729 15:35:09 -- accel/accel.sh@19 -- # IFS=: 00:06:11.729 15:35:09 -- accel/accel.sh@19 -- # read -r var val 00:06:11.729 15:35:09 -- accel/accel.sh@20 -- # val= 00:06:11.729 15:35:09 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.730 15:35:09 -- accel/accel.sh@19 -- # IFS=: 00:06:11.730 15:35:09 -- accel/accel.sh@19 -- # read -r var val 00:06:11.730 15:35:09 -- accel/accel.sh@20 -- # val= 00:06:11.730 15:35:09 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.730 15:35:09 -- accel/accel.sh@19 -- # IFS=: 00:06:11.730 15:35:09 -- accel/accel.sh@19 -- # read -r var val 00:06:11.730 15:35:09 -- accel/accel.sh@20 -- # val= 00:06:11.730 15:35:09 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.730 15:35:09 -- accel/accel.sh@19 -- # IFS=: 00:06:11.730 15:35:09 -- accel/accel.sh@19 -- # read -r var val 00:06:11.730 15:35:09 -- accel/accel.sh@20 -- # val= 00:06:11.730 15:35:09 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.730 15:35:09 -- accel/accel.sh@19 -- # IFS=: 00:06:11.730 15:35:09 -- accel/accel.sh@19 -- # read -r var val 00:06:11.730 15:35:09 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:11.730 15:35:09 -- accel/accel.sh@27 -- # [[ -n compress ]] 00:06:11.730 15:35:09 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:11.730 00:06:11.730 real 0m1.360s 00:06:11.730 user 0m1.259s 00:06:11.730 sys 0m0.114s 00:06:11.730 15:35:09 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:11.730 15:35:09 -- common/autotest_common.sh@10 -- # set +x 00:06:11.730 ************************************ 00:06:11.730 END TEST accel_comp 00:06:11.730 ************************************ 00:06:11.730 15:35:09 -- accel/accel.sh@117 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:06:11.730 15:35:09 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:11.730 15:35:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:11.730 15:35:09 -- common/autotest_common.sh@10 -- # set +x 00:06:11.730 ************************************ 00:06:11.730 START TEST accel_decomp 00:06:11.730 ************************************ 00:06:11.730 15:35:10 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:06:11.730 15:35:10 -- accel/accel.sh@16 -- # local accel_opc 00:06:11.730 15:35:10 -- accel/accel.sh@17 -- # local accel_module 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # IFS=: 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # read -r var val 00:06:11.730 15:35:10 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:06:11.730 15:35:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:06:11.730 15:35:10 -- accel/accel.sh@12 -- # build_accel_config 00:06:11.730 15:35:10 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:11.730 15:35:10 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:11.730 15:35:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:11.730 15:35:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:11.730 15:35:10 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:11.730 15:35:10 -- accel/accel.sh@40 -- # local IFS=, 00:06:11.730 15:35:10 -- accel/accel.sh@41 -- # jq -r . 00:06:11.730 [2024-04-26 15:35:10.106949] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:06:11.730 [2024-04-26 15:35:10.107015] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3177215 ] 00:06:11.730 EAL: No free 2048 kB hugepages reported on node 1 00:06:11.730 [2024-04-26 15:35:10.165435] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:11.730 [2024-04-26 15:35:10.236200] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:11.730 15:35:10 -- accel/accel.sh@20 -- # val= 00:06:11.730 15:35:10 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # IFS=: 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # read -r var val 00:06:11.730 15:35:10 -- accel/accel.sh@20 -- # val= 00:06:11.730 15:35:10 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # IFS=: 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # read -r var val 00:06:11.730 15:35:10 -- accel/accel.sh@20 -- # val= 00:06:11.730 15:35:10 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # IFS=: 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # read -r var val 00:06:11.730 15:35:10 -- accel/accel.sh@20 -- # val=0x1 00:06:11.730 15:35:10 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # IFS=: 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # read -r var val 00:06:11.730 15:35:10 -- accel/accel.sh@20 -- # val= 00:06:11.730 15:35:10 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # IFS=: 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # read -r var val 00:06:11.730 15:35:10 -- accel/accel.sh@20 -- # val= 00:06:11.730 15:35:10 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # IFS=: 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # read -r var val 00:06:11.730 15:35:10 -- accel/accel.sh@20 -- # val=decompress 00:06:11.730 15:35:10 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.730 15:35:10 -- accel/accel.sh@23 -- # accel_opc=decompress 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # IFS=: 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # read -r var val 00:06:11.730 15:35:10 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:11.730 15:35:10 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # IFS=: 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # read -r var val 00:06:11.730 15:35:10 -- accel/accel.sh@20 -- # val= 00:06:11.730 15:35:10 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # IFS=: 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # read -r var val 00:06:11.730 15:35:10 -- accel/accel.sh@20 -- # val=software 00:06:11.730 15:35:10 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.730 15:35:10 -- accel/accel.sh@22 -- # accel_module=software 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # IFS=: 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # read -r var val 00:06:11.730 15:35:10 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:06:11.730 15:35:10 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # IFS=: 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # read -r var val 00:06:11.730 15:35:10 -- accel/accel.sh@20 -- # val=32 00:06:11.730 15:35:10 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # IFS=: 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # read -r var val 00:06:11.730 15:35:10 -- accel/accel.sh@20 -- # val=32 00:06:11.730 15:35:10 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # IFS=: 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # read -r var val 00:06:11.730 15:35:10 -- accel/accel.sh@20 -- # val=1 00:06:11.730 15:35:10 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # IFS=: 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # read -r var val 00:06:11.730 15:35:10 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:11.730 15:35:10 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # IFS=: 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # read -r var val 00:06:11.730 15:35:10 -- accel/accel.sh@20 -- # val=Yes 00:06:11.730 15:35:10 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # IFS=: 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # read -r var val 00:06:11.730 15:35:10 -- accel/accel.sh@20 -- # val= 00:06:11.730 15:35:10 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # IFS=: 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # read -r var val 00:06:11.730 15:35:10 -- accel/accel.sh@20 -- # val= 00:06:11.730 15:35:10 -- accel/accel.sh@21 -- # case "$var" in 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # IFS=: 00:06:11.730 15:35:10 -- accel/accel.sh@19 -- # read -r var val 00:06:13.104 15:35:11 -- accel/accel.sh@20 -- # val= 00:06:13.105 15:35:11 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.105 15:35:11 -- accel/accel.sh@19 -- # IFS=: 00:06:13.105 15:35:11 -- accel/accel.sh@19 -- # read -r var val 00:06:13.105 15:35:11 -- accel/accel.sh@20 -- # val= 00:06:13.105 15:35:11 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.105 15:35:11 -- accel/accel.sh@19 -- # IFS=: 00:06:13.105 15:35:11 -- accel/accel.sh@19 -- # read -r var val 00:06:13.105 15:35:11 -- accel/accel.sh@20 -- # val= 00:06:13.105 15:35:11 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.105 15:35:11 -- accel/accel.sh@19 -- # IFS=: 00:06:13.105 15:35:11 -- accel/accel.sh@19 -- # read -r var val 00:06:13.105 15:35:11 -- accel/accel.sh@20 -- # val= 00:06:13.105 15:35:11 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.105 15:35:11 -- accel/accel.sh@19 -- # IFS=: 00:06:13.105 15:35:11 -- accel/accel.sh@19 -- # read -r var val 00:06:13.105 15:35:11 -- accel/accel.sh@20 -- # val= 00:06:13.105 15:35:11 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.105 15:35:11 -- accel/accel.sh@19 -- # IFS=: 00:06:13.105 15:35:11 -- accel/accel.sh@19 -- # read -r var val 00:06:13.105 15:35:11 -- accel/accel.sh@20 -- # val= 00:06:13.105 15:35:11 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.105 15:35:11 -- accel/accel.sh@19 -- # IFS=: 00:06:13.105 15:35:11 -- accel/accel.sh@19 -- # read -r var val 00:06:13.105 15:35:11 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:13.105 15:35:11 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:06:13.105 15:35:11 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:13.105 00:06:13.105 real 0m1.362s 00:06:13.105 user 0m1.265s 00:06:13.105 sys 0m0.109s 00:06:13.105 15:35:11 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:13.105 15:35:11 -- common/autotest_common.sh@10 -- # set +x 00:06:13.105 ************************************ 00:06:13.105 END TEST accel_decomp 00:06:13.105 ************************************ 00:06:13.105 15:35:11 -- accel/accel.sh@118 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:13.105 15:35:11 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:13.105 15:35:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:13.105 15:35:11 -- common/autotest_common.sh@10 -- # set +x 00:06:13.105 ************************************ 00:06:13.105 START TEST accel_decmop_full 00:06:13.105 ************************************ 00:06:13.105 15:35:11 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:13.105 15:35:11 -- accel/accel.sh@16 -- # local accel_opc 00:06:13.105 15:35:11 -- accel/accel.sh@17 -- # local accel_module 00:06:13.105 15:35:11 -- accel/accel.sh@19 -- # IFS=: 00:06:13.105 15:35:11 -- accel/accel.sh@19 -- # read -r var val 00:06:13.105 15:35:11 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:13.105 15:35:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:13.105 15:35:11 -- accel/accel.sh@12 -- # build_accel_config 00:06:13.105 15:35:11 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:13.105 15:35:11 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:13.105 15:35:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:13.105 15:35:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:13.105 15:35:11 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:13.105 15:35:11 -- accel/accel.sh@40 -- # local IFS=, 00:06:13.105 15:35:11 -- accel/accel.sh@41 -- # jq -r . 00:06:13.105 [2024-04-26 15:35:11.625701] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:06:13.105 [2024-04-26 15:35:11.625767] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3177470 ] 00:06:13.105 EAL: No free 2048 kB hugepages reported on node 1 00:06:13.105 [2024-04-26 15:35:11.682917] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:13.364 [2024-04-26 15:35:11.753288] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:13.364 15:35:11 -- accel/accel.sh@20 -- # val= 00:06:13.364 15:35:11 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.364 15:35:11 -- accel/accel.sh@19 -- # IFS=: 00:06:13.364 15:35:11 -- accel/accel.sh@19 -- # read -r var val 00:06:13.364 15:35:11 -- accel/accel.sh@20 -- # val= 00:06:13.364 15:35:11 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.364 15:35:11 -- accel/accel.sh@19 -- # IFS=: 00:06:13.364 15:35:11 -- accel/accel.sh@19 -- # read -r var val 00:06:13.364 15:35:11 -- accel/accel.sh@20 -- # val= 00:06:13.364 15:35:11 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.364 15:35:11 -- accel/accel.sh@19 -- # IFS=: 00:06:13.364 15:35:11 -- accel/accel.sh@19 -- # read -r var val 00:06:13.364 15:35:11 -- accel/accel.sh@20 -- # val=0x1 00:06:13.364 15:35:11 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.364 15:35:11 -- accel/accel.sh@19 -- # IFS=: 00:06:13.364 15:35:11 -- accel/accel.sh@19 -- # read -r var val 00:06:13.364 15:35:11 -- accel/accel.sh@20 -- # val= 00:06:13.364 15:35:11 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.364 15:35:11 -- accel/accel.sh@19 -- # IFS=: 00:06:13.364 15:35:11 -- accel/accel.sh@19 -- # read -r var val 00:06:13.364 15:35:11 -- accel/accel.sh@20 -- # val= 00:06:13.364 15:35:11 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.364 15:35:11 -- accel/accel.sh@19 -- # IFS=: 00:06:13.364 15:35:11 -- accel/accel.sh@19 -- # read -r var val 00:06:13.364 15:35:11 -- accel/accel.sh@20 -- # val=decompress 00:06:13.364 15:35:11 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.364 15:35:11 -- accel/accel.sh@23 -- # accel_opc=decompress 00:06:13.364 15:35:11 -- accel/accel.sh@19 -- # IFS=: 00:06:13.364 15:35:11 -- accel/accel.sh@19 -- # read -r var val 00:06:13.364 15:35:11 -- accel/accel.sh@20 -- # val='111250 bytes' 00:06:13.364 15:35:11 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.364 15:35:11 -- accel/accel.sh@19 -- # IFS=: 00:06:13.364 15:35:11 -- accel/accel.sh@19 -- # read -r var val 00:06:13.364 15:35:11 -- accel/accel.sh@20 -- # val= 00:06:13.364 15:35:11 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.364 15:35:11 -- accel/accel.sh@19 -- # IFS=: 00:06:13.364 15:35:11 -- accel/accel.sh@19 -- # read -r var val 00:06:13.364 15:35:11 -- accel/accel.sh@20 -- # val=software 00:06:13.364 15:35:11 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.364 15:35:11 -- accel/accel.sh@22 -- # accel_module=software 00:06:13.364 15:35:11 -- accel/accel.sh@19 -- # IFS=: 00:06:13.364 15:35:11 -- accel/accel.sh@19 -- # read -r var val 00:06:13.364 15:35:11 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:06:13.364 15:35:11 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.364 15:35:11 -- accel/accel.sh@19 -- # IFS=: 00:06:13.364 15:35:11 -- accel/accel.sh@19 -- # read -r var val 00:06:13.364 15:35:11 -- accel/accel.sh@20 -- # val=32 00:06:13.364 15:35:11 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.364 15:35:11 -- accel/accel.sh@19 -- # IFS=: 00:06:13.364 15:35:11 -- accel/accel.sh@19 -- # read -r var val 00:06:13.364 15:35:11 -- accel/accel.sh@20 -- # val=32 00:06:13.364 15:35:11 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.364 15:35:11 -- accel/accel.sh@19 -- # IFS=: 00:06:13.364 15:35:11 -- accel/accel.sh@19 -- # read -r var val 00:06:13.364 15:35:11 -- accel/accel.sh@20 -- # val=1 00:06:13.364 15:35:11 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.364 15:35:11 -- accel/accel.sh@19 -- # IFS=: 00:06:13.364 15:35:11 -- accel/accel.sh@19 -- # read -r var val 00:06:13.364 15:35:11 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:13.364 15:35:11 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.364 15:35:11 -- accel/accel.sh@19 -- # IFS=: 00:06:13.364 15:35:11 -- accel/accel.sh@19 -- # read -r var val 00:06:13.364 15:35:11 -- accel/accel.sh@20 -- # val=Yes 00:06:13.364 15:35:11 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.364 15:35:11 -- accel/accel.sh@19 -- # IFS=: 00:06:13.364 15:35:11 -- accel/accel.sh@19 -- # read -r var val 00:06:13.364 15:35:11 -- accel/accel.sh@20 -- # val= 00:06:13.364 15:35:11 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.364 15:35:11 -- accel/accel.sh@19 -- # IFS=: 00:06:13.364 15:35:11 -- accel/accel.sh@19 -- # read -r var val 00:06:13.364 15:35:11 -- accel/accel.sh@20 -- # val= 00:06:13.364 15:35:11 -- accel/accel.sh@21 -- # case "$var" in 00:06:13.364 15:35:11 -- accel/accel.sh@19 -- # IFS=: 00:06:13.364 15:35:11 -- accel/accel.sh@19 -- # read -r var val 00:06:14.741 15:35:12 -- accel/accel.sh@20 -- # val= 00:06:14.741 15:35:12 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.741 15:35:12 -- accel/accel.sh@19 -- # IFS=: 00:06:14.741 15:35:12 -- accel/accel.sh@19 -- # read -r var val 00:06:14.741 15:35:12 -- accel/accel.sh@20 -- # val= 00:06:14.741 15:35:12 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.741 15:35:12 -- accel/accel.sh@19 -- # IFS=: 00:06:14.741 15:35:12 -- accel/accel.sh@19 -- # read -r var val 00:06:14.741 15:35:12 -- accel/accel.sh@20 -- # val= 00:06:14.741 15:35:12 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.741 15:35:12 -- accel/accel.sh@19 -- # IFS=: 00:06:14.741 15:35:12 -- accel/accel.sh@19 -- # read -r var val 00:06:14.741 15:35:12 -- accel/accel.sh@20 -- # val= 00:06:14.741 15:35:12 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.741 15:35:12 -- accel/accel.sh@19 -- # IFS=: 00:06:14.741 15:35:12 -- accel/accel.sh@19 -- # read -r var val 00:06:14.741 15:35:12 -- accel/accel.sh@20 -- # val= 00:06:14.741 15:35:12 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.741 15:35:12 -- accel/accel.sh@19 -- # IFS=: 00:06:14.741 15:35:12 -- accel/accel.sh@19 -- # read -r var val 00:06:14.741 15:35:12 -- accel/accel.sh@20 -- # val= 00:06:14.741 15:35:12 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.741 15:35:12 -- accel/accel.sh@19 -- # IFS=: 00:06:14.741 15:35:12 -- accel/accel.sh@19 -- # read -r var val 00:06:14.741 15:35:12 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:14.741 15:35:12 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:06:14.741 15:35:12 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:14.741 00:06:14.741 real 0m1.368s 00:06:14.741 user 0m1.269s 00:06:14.741 sys 0m0.113s 00:06:14.741 15:35:12 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:14.741 15:35:12 -- common/autotest_common.sh@10 -- # set +x 00:06:14.741 ************************************ 00:06:14.741 END TEST accel_decmop_full 00:06:14.741 ************************************ 00:06:14.741 15:35:12 -- accel/accel.sh@119 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:14.741 15:35:12 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:14.741 15:35:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:14.741 15:35:12 -- common/autotest_common.sh@10 -- # set +x 00:06:14.741 ************************************ 00:06:14.741 START TEST accel_decomp_mcore 00:06:14.741 ************************************ 00:06:14.741 15:35:13 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:14.741 15:35:13 -- accel/accel.sh@16 -- # local accel_opc 00:06:14.741 15:35:13 -- accel/accel.sh@17 -- # local accel_module 00:06:14.741 15:35:13 -- accel/accel.sh@19 -- # IFS=: 00:06:14.741 15:35:13 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:14.741 15:35:13 -- accel/accel.sh@19 -- # read -r var val 00:06:14.741 15:35:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:14.741 15:35:13 -- accel/accel.sh@12 -- # build_accel_config 00:06:14.741 15:35:13 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:14.741 15:35:13 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:14.741 15:35:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:14.741 15:35:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:14.741 15:35:13 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:14.741 15:35:13 -- accel/accel.sh@40 -- # local IFS=, 00:06:14.741 15:35:13 -- accel/accel.sh@41 -- # jq -r . 00:06:14.741 [2024-04-26 15:35:13.136736] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:06:14.741 [2024-04-26 15:35:13.136788] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3177733 ] 00:06:14.741 EAL: No free 2048 kB hugepages reported on node 1 00:06:14.741 [2024-04-26 15:35:13.192210] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:14.741 [2024-04-26 15:35:13.263648] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:14.741 [2024-04-26 15:35:13.263750] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:14.741 [2024-04-26 15:35:13.263839] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:14.741 [2024-04-26 15:35:13.263841] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:14.741 15:35:13 -- accel/accel.sh@20 -- # val= 00:06:14.741 15:35:13 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.741 15:35:13 -- accel/accel.sh@19 -- # IFS=: 00:06:14.741 15:35:13 -- accel/accel.sh@19 -- # read -r var val 00:06:14.741 15:35:13 -- accel/accel.sh@20 -- # val= 00:06:14.741 15:35:13 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.741 15:35:13 -- accel/accel.sh@19 -- # IFS=: 00:06:14.741 15:35:13 -- accel/accel.sh@19 -- # read -r var val 00:06:14.741 15:35:13 -- accel/accel.sh@20 -- # val= 00:06:14.741 15:35:13 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.741 15:35:13 -- accel/accel.sh@19 -- # IFS=: 00:06:14.741 15:35:13 -- accel/accel.sh@19 -- # read -r var val 00:06:14.741 15:35:13 -- accel/accel.sh@20 -- # val=0xf 00:06:14.741 15:35:13 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.741 15:35:13 -- accel/accel.sh@19 -- # IFS=: 00:06:14.741 15:35:13 -- accel/accel.sh@19 -- # read -r var val 00:06:14.741 15:35:13 -- accel/accel.sh@20 -- # val= 00:06:14.741 15:35:13 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.741 15:35:13 -- accel/accel.sh@19 -- # IFS=: 00:06:14.741 15:35:13 -- accel/accel.sh@19 -- # read -r var val 00:06:14.741 15:35:13 -- accel/accel.sh@20 -- # val= 00:06:14.741 15:35:13 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.741 15:35:13 -- accel/accel.sh@19 -- # IFS=: 00:06:14.741 15:35:13 -- accel/accel.sh@19 -- # read -r var val 00:06:14.741 15:35:13 -- accel/accel.sh@20 -- # val=decompress 00:06:14.741 15:35:13 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.741 15:35:13 -- accel/accel.sh@23 -- # accel_opc=decompress 00:06:14.741 15:35:13 -- accel/accel.sh@19 -- # IFS=: 00:06:14.741 15:35:13 -- accel/accel.sh@19 -- # read -r var val 00:06:14.741 15:35:13 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:14.741 15:35:13 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.741 15:35:13 -- accel/accel.sh@19 -- # IFS=: 00:06:14.741 15:35:13 -- accel/accel.sh@19 -- # read -r var val 00:06:14.741 15:35:13 -- accel/accel.sh@20 -- # val= 00:06:14.741 15:35:13 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.741 15:35:13 -- accel/accel.sh@19 -- # IFS=: 00:06:14.741 15:35:13 -- accel/accel.sh@19 -- # read -r var val 00:06:14.741 15:35:13 -- accel/accel.sh@20 -- # val=software 00:06:14.741 15:35:13 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.741 15:35:13 -- accel/accel.sh@22 -- # accel_module=software 00:06:14.741 15:35:13 -- accel/accel.sh@19 -- # IFS=: 00:06:14.741 15:35:13 -- accel/accel.sh@19 -- # read -r var val 00:06:14.741 15:35:13 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:06:14.741 15:35:13 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.741 15:35:13 -- accel/accel.sh@19 -- # IFS=: 00:06:14.741 15:35:13 -- accel/accel.sh@19 -- # read -r var val 00:06:14.741 15:35:13 -- accel/accel.sh@20 -- # val=32 00:06:14.741 15:35:13 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.741 15:35:13 -- accel/accel.sh@19 -- # IFS=: 00:06:14.741 15:35:13 -- accel/accel.sh@19 -- # read -r var val 00:06:14.741 15:35:13 -- accel/accel.sh@20 -- # val=32 00:06:14.741 15:35:13 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.741 15:35:13 -- accel/accel.sh@19 -- # IFS=: 00:06:14.741 15:35:13 -- accel/accel.sh@19 -- # read -r var val 00:06:14.741 15:35:13 -- accel/accel.sh@20 -- # val=1 00:06:14.741 15:35:13 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.741 15:35:13 -- accel/accel.sh@19 -- # IFS=: 00:06:14.741 15:35:13 -- accel/accel.sh@19 -- # read -r var val 00:06:14.741 15:35:13 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:14.741 15:35:13 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.741 15:35:13 -- accel/accel.sh@19 -- # IFS=: 00:06:14.741 15:35:13 -- accel/accel.sh@19 -- # read -r var val 00:06:14.741 15:35:13 -- accel/accel.sh@20 -- # val=Yes 00:06:14.741 15:35:13 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.741 15:35:13 -- accel/accel.sh@19 -- # IFS=: 00:06:14.741 15:35:13 -- accel/accel.sh@19 -- # read -r var val 00:06:14.741 15:35:13 -- accel/accel.sh@20 -- # val= 00:06:14.741 15:35:13 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.741 15:35:13 -- accel/accel.sh@19 -- # IFS=: 00:06:14.741 15:35:13 -- accel/accel.sh@19 -- # read -r var val 00:06:14.741 15:35:13 -- accel/accel.sh@20 -- # val= 00:06:14.741 15:35:13 -- accel/accel.sh@21 -- # case "$var" in 00:06:14.741 15:35:13 -- accel/accel.sh@19 -- # IFS=: 00:06:14.742 15:35:13 -- accel/accel.sh@19 -- # read -r var val 00:06:16.119 15:35:14 -- accel/accel.sh@20 -- # val= 00:06:16.119 15:35:14 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.119 15:35:14 -- accel/accel.sh@19 -- # IFS=: 00:06:16.119 15:35:14 -- accel/accel.sh@19 -- # read -r var val 00:06:16.119 15:35:14 -- accel/accel.sh@20 -- # val= 00:06:16.119 15:35:14 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.119 15:35:14 -- accel/accel.sh@19 -- # IFS=: 00:06:16.119 15:35:14 -- accel/accel.sh@19 -- # read -r var val 00:06:16.119 15:35:14 -- accel/accel.sh@20 -- # val= 00:06:16.119 15:35:14 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.119 15:35:14 -- accel/accel.sh@19 -- # IFS=: 00:06:16.119 15:35:14 -- accel/accel.sh@19 -- # read -r var val 00:06:16.119 15:35:14 -- accel/accel.sh@20 -- # val= 00:06:16.119 15:35:14 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.119 15:35:14 -- accel/accel.sh@19 -- # IFS=: 00:06:16.119 15:35:14 -- accel/accel.sh@19 -- # read -r var val 00:06:16.119 15:35:14 -- accel/accel.sh@20 -- # val= 00:06:16.119 15:35:14 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.119 15:35:14 -- accel/accel.sh@19 -- # IFS=: 00:06:16.119 15:35:14 -- accel/accel.sh@19 -- # read -r var val 00:06:16.119 15:35:14 -- accel/accel.sh@20 -- # val= 00:06:16.119 15:35:14 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.119 15:35:14 -- accel/accel.sh@19 -- # IFS=: 00:06:16.119 15:35:14 -- accel/accel.sh@19 -- # read -r var val 00:06:16.119 15:35:14 -- accel/accel.sh@20 -- # val= 00:06:16.119 15:35:14 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.119 15:35:14 -- accel/accel.sh@19 -- # IFS=: 00:06:16.119 15:35:14 -- accel/accel.sh@19 -- # read -r var val 00:06:16.119 15:35:14 -- accel/accel.sh@20 -- # val= 00:06:16.119 15:35:14 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.119 15:35:14 -- accel/accel.sh@19 -- # IFS=: 00:06:16.119 15:35:14 -- accel/accel.sh@19 -- # read -r var val 00:06:16.119 15:35:14 -- accel/accel.sh@20 -- # val= 00:06:16.119 15:35:14 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.119 15:35:14 -- accel/accel.sh@19 -- # IFS=: 00:06:16.119 15:35:14 -- accel/accel.sh@19 -- # read -r var val 00:06:16.119 15:35:14 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:16.119 15:35:14 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:06:16.119 15:35:14 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:16.119 00:06:16.119 real 0m1.359s 00:06:16.119 user 0m4.585s 00:06:16.119 sys 0m0.115s 00:06:16.119 15:35:14 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:16.119 15:35:14 -- common/autotest_common.sh@10 -- # set +x 00:06:16.119 ************************************ 00:06:16.119 END TEST accel_decomp_mcore 00:06:16.119 ************************************ 00:06:16.119 15:35:14 -- accel/accel.sh@120 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:16.119 15:35:14 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:16.119 15:35:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:16.119 15:35:14 -- common/autotest_common.sh@10 -- # set +x 00:06:16.119 ************************************ 00:06:16.119 START TEST accel_decomp_full_mcore 00:06:16.119 ************************************ 00:06:16.119 15:35:14 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:16.119 15:35:14 -- accel/accel.sh@16 -- # local accel_opc 00:06:16.119 15:35:14 -- accel/accel.sh@17 -- # local accel_module 00:06:16.119 15:35:14 -- accel/accel.sh@19 -- # IFS=: 00:06:16.119 15:35:14 -- accel/accel.sh@19 -- # read -r var val 00:06:16.119 15:35:14 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:16.119 15:35:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:16.120 15:35:14 -- accel/accel.sh@12 -- # build_accel_config 00:06:16.120 15:35:14 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:16.120 15:35:14 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:16.120 15:35:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:16.120 15:35:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:16.120 15:35:14 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:16.120 15:35:14 -- accel/accel.sh@40 -- # local IFS=, 00:06:16.120 15:35:14 -- accel/accel.sh@41 -- # jq -r . 00:06:16.120 [2024-04-26 15:35:14.657517] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:06:16.120 [2024-04-26 15:35:14.657565] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3177989 ] 00:06:16.120 EAL: No free 2048 kB hugepages reported on node 1 00:06:16.120 [2024-04-26 15:35:14.711859] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:16.379 [2024-04-26 15:35:14.784796] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:16.379 [2024-04-26 15:35:14.784893] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:16.379 [2024-04-26 15:35:14.784980] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:16.379 [2024-04-26 15:35:14.784982] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:16.379 15:35:14 -- accel/accel.sh@20 -- # val= 00:06:16.379 15:35:14 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.379 15:35:14 -- accel/accel.sh@19 -- # IFS=: 00:06:16.379 15:35:14 -- accel/accel.sh@19 -- # read -r var val 00:06:16.379 15:35:14 -- accel/accel.sh@20 -- # val= 00:06:16.379 15:35:14 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.379 15:35:14 -- accel/accel.sh@19 -- # IFS=: 00:06:16.379 15:35:14 -- accel/accel.sh@19 -- # read -r var val 00:06:16.379 15:35:14 -- accel/accel.sh@20 -- # val= 00:06:16.379 15:35:14 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.379 15:35:14 -- accel/accel.sh@19 -- # IFS=: 00:06:16.379 15:35:14 -- accel/accel.sh@19 -- # read -r var val 00:06:16.379 15:35:14 -- accel/accel.sh@20 -- # val=0xf 00:06:16.379 15:35:14 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.379 15:35:14 -- accel/accel.sh@19 -- # IFS=: 00:06:16.379 15:35:14 -- accel/accel.sh@19 -- # read -r var val 00:06:16.379 15:35:14 -- accel/accel.sh@20 -- # val= 00:06:16.379 15:35:14 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.379 15:35:14 -- accel/accel.sh@19 -- # IFS=: 00:06:16.379 15:35:14 -- accel/accel.sh@19 -- # read -r var val 00:06:16.379 15:35:14 -- accel/accel.sh@20 -- # val= 00:06:16.379 15:35:14 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.379 15:35:14 -- accel/accel.sh@19 -- # IFS=: 00:06:16.379 15:35:14 -- accel/accel.sh@19 -- # read -r var val 00:06:16.379 15:35:14 -- accel/accel.sh@20 -- # val=decompress 00:06:16.379 15:35:14 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.379 15:35:14 -- accel/accel.sh@23 -- # accel_opc=decompress 00:06:16.379 15:35:14 -- accel/accel.sh@19 -- # IFS=: 00:06:16.379 15:35:14 -- accel/accel.sh@19 -- # read -r var val 00:06:16.379 15:35:14 -- accel/accel.sh@20 -- # val='111250 bytes' 00:06:16.379 15:35:14 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.379 15:35:14 -- accel/accel.sh@19 -- # IFS=: 00:06:16.379 15:35:14 -- accel/accel.sh@19 -- # read -r var val 00:06:16.379 15:35:14 -- accel/accel.sh@20 -- # val= 00:06:16.379 15:35:14 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.379 15:35:14 -- accel/accel.sh@19 -- # IFS=: 00:06:16.379 15:35:14 -- accel/accel.sh@19 -- # read -r var val 00:06:16.379 15:35:14 -- accel/accel.sh@20 -- # val=software 00:06:16.379 15:35:14 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.379 15:35:14 -- accel/accel.sh@22 -- # accel_module=software 00:06:16.379 15:35:14 -- accel/accel.sh@19 -- # IFS=: 00:06:16.379 15:35:14 -- accel/accel.sh@19 -- # read -r var val 00:06:16.379 15:35:14 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:06:16.379 15:35:14 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.379 15:35:14 -- accel/accel.sh@19 -- # IFS=: 00:06:16.379 15:35:14 -- accel/accel.sh@19 -- # read -r var val 00:06:16.379 15:35:14 -- accel/accel.sh@20 -- # val=32 00:06:16.379 15:35:14 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.379 15:35:14 -- accel/accel.sh@19 -- # IFS=: 00:06:16.379 15:35:14 -- accel/accel.sh@19 -- # read -r var val 00:06:16.379 15:35:14 -- accel/accel.sh@20 -- # val=32 00:06:16.379 15:35:14 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.379 15:35:14 -- accel/accel.sh@19 -- # IFS=: 00:06:16.379 15:35:14 -- accel/accel.sh@19 -- # read -r var val 00:06:16.379 15:35:14 -- accel/accel.sh@20 -- # val=1 00:06:16.379 15:35:14 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.379 15:35:14 -- accel/accel.sh@19 -- # IFS=: 00:06:16.379 15:35:14 -- accel/accel.sh@19 -- # read -r var val 00:06:16.379 15:35:14 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:16.379 15:35:14 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.379 15:35:14 -- accel/accel.sh@19 -- # IFS=: 00:06:16.379 15:35:14 -- accel/accel.sh@19 -- # read -r var val 00:06:16.379 15:35:14 -- accel/accel.sh@20 -- # val=Yes 00:06:16.379 15:35:14 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.379 15:35:14 -- accel/accel.sh@19 -- # IFS=: 00:06:16.379 15:35:14 -- accel/accel.sh@19 -- # read -r var val 00:06:16.379 15:35:14 -- accel/accel.sh@20 -- # val= 00:06:16.379 15:35:14 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.379 15:35:14 -- accel/accel.sh@19 -- # IFS=: 00:06:16.379 15:35:14 -- accel/accel.sh@19 -- # read -r var val 00:06:16.379 15:35:14 -- accel/accel.sh@20 -- # val= 00:06:16.379 15:35:14 -- accel/accel.sh@21 -- # case "$var" in 00:06:16.379 15:35:14 -- accel/accel.sh@19 -- # IFS=: 00:06:16.379 15:35:14 -- accel/accel.sh@19 -- # read -r var val 00:06:17.758 15:35:15 -- accel/accel.sh@20 -- # val= 00:06:17.758 15:35:15 -- accel/accel.sh@21 -- # case "$var" in 00:06:17.758 15:35:15 -- accel/accel.sh@19 -- # IFS=: 00:06:17.758 15:35:15 -- accel/accel.sh@19 -- # read -r var val 00:06:17.758 15:35:15 -- accel/accel.sh@20 -- # val= 00:06:17.758 15:35:15 -- accel/accel.sh@21 -- # case "$var" in 00:06:17.758 15:35:15 -- accel/accel.sh@19 -- # IFS=: 00:06:17.758 15:35:16 -- accel/accel.sh@19 -- # read -r var val 00:06:17.758 15:35:16 -- accel/accel.sh@20 -- # val= 00:06:17.758 15:35:16 -- accel/accel.sh@21 -- # case "$var" in 00:06:17.758 15:35:16 -- accel/accel.sh@19 -- # IFS=: 00:06:17.758 15:35:16 -- accel/accel.sh@19 -- # read -r var val 00:06:17.758 15:35:16 -- accel/accel.sh@20 -- # val= 00:06:17.758 15:35:16 -- accel/accel.sh@21 -- # case "$var" in 00:06:17.758 15:35:16 -- accel/accel.sh@19 -- # IFS=: 00:06:17.758 15:35:16 -- accel/accel.sh@19 -- # read -r var val 00:06:17.758 15:35:16 -- accel/accel.sh@20 -- # val= 00:06:17.758 15:35:16 -- accel/accel.sh@21 -- # case "$var" in 00:06:17.758 15:35:16 -- accel/accel.sh@19 -- # IFS=: 00:06:17.758 15:35:16 -- accel/accel.sh@19 -- # read -r var val 00:06:17.758 15:35:16 -- accel/accel.sh@20 -- # val= 00:06:17.758 15:35:16 -- accel/accel.sh@21 -- # case "$var" in 00:06:17.758 15:35:16 -- accel/accel.sh@19 -- # IFS=: 00:06:17.758 15:35:16 -- accel/accel.sh@19 -- # read -r var val 00:06:17.758 15:35:16 -- accel/accel.sh@20 -- # val= 00:06:17.758 15:35:16 -- accel/accel.sh@21 -- # case "$var" in 00:06:17.758 15:35:16 -- accel/accel.sh@19 -- # IFS=: 00:06:17.758 15:35:16 -- accel/accel.sh@19 -- # read -r var val 00:06:17.758 15:35:16 -- accel/accel.sh@20 -- # val= 00:06:17.758 15:35:16 -- accel/accel.sh@21 -- # case "$var" in 00:06:17.758 15:35:16 -- accel/accel.sh@19 -- # IFS=: 00:06:17.758 15:35:16 -- accel/accel.sh@19 -- # read -r var val 00:06:17.758 15:35:16 -- accel/accel.sh@20 -- # val= 00:06:17.758 15:35:16 -- accel/accel.sh@21 -- # case "$var" in 00:06:17.758 15:35:16 -- accel/accel.sh@19 -- # IFS=: 00:06:17.758 15:35:16 -- accel/accel.sh@19 -- # read -r var val 00:06:17.758 15:35:16 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:17.758 15:35:16 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:06:17.758 15:35:16 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:17.758 00:06:17.758 real 0m1.376s 00:06:17.758 user 0m4.620s 00:06:17.758 sys 0m0.123s 00:06:17.758 15:35:16 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:17.758 15:35:16 -- common/autotest_common.sh@10 -- # set +x 00:06:17.758 ************************************ 00:06:17.758 END TEST accel_decomp_full_mcore 00:06:17.758 ************************************ 00:06:17.758 15:35:16 -- accel/accel.sh@121 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:17.758 15:35:16 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:17.758 15:35:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:17.758 15:35:16 -- common/autotest_common.sh@10 -- # set +x 00:06:17.758 ************************************ 00:06:17.758 START TEST accel_decomp_mthread 00:06:17.758 ************************************ 00:06:17.758 15:35:16 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:17.758 15:35:16 -- accel/accel.sh@16 -- # local accel_opc 00:06:17.758 15:35:16 -- accel/accel.sh@17 -- # local accel_module 00:06:17.758 15:35:16 -- accel/accel.sh@19 -- # IFS=: 00:06:17.758 15:35:16 -- accel/accel.sh@19 -- # read -r var val 00:06:17.758 15:35:16 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:17.758 15:35:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:17.758 15:35:16 -- accel/accel.sh@12 -- # build_accel_config 00:06:17.758 15:35:16 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:17.758 15:35:16 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:17.758 15:35:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:17.758 15:35:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:17.758 15:35:16 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:17.758 15:35:16 -- accel/accel.sh@40 -- # local IFS=, 00:06:17.758 15:35:16 -- accel/accel.sh@41 -- # jq -r . 00:06:17.758 [2024-04-26 15:35:16.200887] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:06:17.758 [2024-04-26 15:35:16.200964] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3178254 ] 00:06:17.758 EAL: No free 2048 kB hugepages reported on node 1 00:06:17.758 [2024-04-26 15:35:16.258308] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:17.758 [2024-04-26 15:35:16.328726] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:18.017 15:35:16 -- accel/accel.sh@20 -- # val= 00:06:18.017 15:35:16 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.017 15:35:16 -- accel/accel.sh@19 -- # IFS=: 00:06:18.017 15:35:16 -- accel/accel.sh@19 -- # read -r var val 00:06:18.017 15:35:16 -- accel/accel.sh@20 -- # val= 00:06:18.017 15:35:16 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.017 15:35:16 -- accel/accel.sh@19 -- # IFS=: 00:06:18.017 15:35:16 -- accel/accel.sh@19 -- # read -r var val 00:06:18.017 15:35:16 -- accel/accel.sh@20 -- # val= 00:06:18.017 15:35:16 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.017 15:35:16 -- accel/accel.sh@19 -- # IFS=: 00:06:18.017 15:35:16 -- accel/accel.sh@19 -- # read -r var val 00:06:18.017 15:35:16 -- accel/accel.sh@20 -- # val=0x1 00:06:18.017 15:35:16 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.017 15:35:16 -- accel/accel.sh@19 -- # IFS=: 00:06:18.017 15:35:16 -- accel/accel.sh@19 -- # read -r var val 00:06:18.017 15:35:16 -- accel/accel.sh@20 -- # val= 00:06:18.017 15:35:16 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.017 15:35:16 -- accel/accel.sh@19 -- # IFS=: 00:06:18.017 15:35:16 -- accel/accel.sh@19 -- # read -r var val 00:06:18.017 15:35:16 -- accel/accel.sh@20 -- # val= 00:06:18.017 15:35:16 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.017 15:35:16 -- accel/accel.sh@19 -- # IFS=: 00:06:18.017 15:35:16 -- accel/accel.sh@19 -- # read -r var val 00:06:18.017 15:35:16 -- accel/accel.sh@20 -- # val=decompress 00:06:18.017 15:35:16 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.017 15:35:16 -- accel/accel.sh@23 -- # accel_opc=decompress 00:06:18.017 15:35:16 -- accel/accel.sh@19 -- # IFS=: 00:06:18.017 15:35:16 -- accel/accel.sh@19 -- # read -r var val 00:06:18.017 15:35:16 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:18.017 15:35:16 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.017 15:35:16 -- accel/accel.sh@19 -- # IFS=: 00:06:18.017 15:35:16 -- accel/accel.sh@19 -- # read -r var val 00:06:18.017 15:35:16 -- accel/accel.sh@20 -- # val= 00:06:18.017 15:35:16 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.017 15:35:16 -- accel/accel.sh@19 -- # IFS=: 00:06:18.017 15:35:16 -- accel/accel.sh@19 -- # read -r var val 00:06:18.017 15:35:16 -- accel/accel.sh@20 -- # val=software 00:06:18.017 15:35:16 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.017 15:35:16 -- accel/accel.sh@22 -- # accel_module=software 00:06:18.017 15:35:16 -- accel/accel.sh@19 -- # IFS=: 00:06:18.017 15:35:16 -- accel/accel.sh@19 -- # read -r var val 00:06:18.017 15:35:16 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:06:18.017 15:35:16 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.018 15:35:16 -- accel/accel.sh@19 -- # IFS=: 00:06:18.018 15:35:16 -- accel/accel.sh@19 -- # read -r var val 00:06:18.018 15:35:16 -- accel/accel.sh@20 -- # val=32 00:06:18.018 15:35:16 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.018 15:35:16 -- accel/accel.sh@19 -- # IFS=: 00:06:18.018 15:35:16 -- accel/accel.sh@19 -- # read -r var val 00:06:18.018 15:35:16 -- accel/accel.sh@20 -- # val=32 00:06:18.018 15:35:16 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.018 15:35:16 -- accel/accel.sh@19 -- # IFS=: 00:06:18.018 15:35:16 -- accel/accel.sh@19 -- # read -r var val 00:06:18.018 15:35:16 -- accel/accel.sh@20 -- # val=2 00:06:18.018 15:35:16 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.018 15:35:16 -- accel/accel.sh@19 -- # IFS=: 00:06:18.018 15:35:16 -- accel/accel.sh@19 -- # read -r var val 00:06:18.018 15:35:16 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:18.018 15:35:16 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.018 15:35:16 -- accel/accel.sh@19 -- # IFS=: 00:06:18.018 15:35:16 -- accel/accel.sh@19 -- # read -r var val 00:06:18.018 15:35:16 -- accel/accel.sh@20 -- # val=Yes 00:06:18.018 15:35:16 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.018 15:35:16 -- accel/accel.sh@19 -- # IFS=: 00:06:18.018 15:35:16 -- accel/accel.sh@19 -- # read -r var val 00:06:18.018 15:35:16 -- accel/accel.sh@20 -- # val= 00:06:18.018 15:35:16 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.018 15:35:16 -- accel/accel.sh@19 -- # IFS=: 00:06:18.018 15:35:16 -- accel/accel.sh@19 -- # read -r var val 00:06:18.018 15:35:16 -- accel/accel.sh@20 -- # val= 00:06:18.018 15:35:16 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.018 15:35:16 -- accel/accel.sh@19 -- # IFS=: 00:06:18.018 15:35:16 -- accel/accel.sh@19 -- # read -r var val 00:06:18.953 15:35:17 -- accel/accel.sh@20 -- # val= 00:06:18.953 15:35:17 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.953 15:35:17 -- accel/accel.sh@19 -- # IFS=: 00:06:18.953 15:35:17 -- accel/accel.sh@19 -- # read -r var val 00:06:18.953 15:35:17 -- accel/accel.sh@20 -- # val= 00:06:18.953 15:35:17 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.953 15:35:17 -- accel/accel.sh@19 -- # IFS=: 00:06:18.953 15:35:17 -- accel/accel.sh@19 -- # read -r var val 00:06:18.953 15:35:17 -- accel/accel.sh@20 -- # val= 00:06:18.953 15:35:17 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.953 15:35:17 -- accel/accel.sh@19 -- # IFS=: 00:06:18.953 15:35:17 -- accel/accel.sh@19 -- # read -r var val 00:06:18.953 15:35:17 -- accel/accel.sh@20 -- # val= 00:06:18.953 15:35:17 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.953 15:35:17 -- accel/accel.sh@19 -- # IFS=: 00:06:18.953 15:35:17 -- accel/accel.sh@19 -- # read -r var val 00:06:18.953 15:35:17 -- accel/accel.sh@20 -- # val= 00:06:18.953 15:35:17 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.953 15:35:17 -- accel/accel.sh@19 -- # IFS=: 00:06:18.953 15:35:17 -- accel/accel.sh@19 -- # read -r var val 00:06:18.953 15:35:17 -- accel/accel.sh@20 -- # val= 00:06:18.953 15:35:17 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.953 15:35:17 -- accel/accel.sh@19 -- # IFS=: 00:06:18.953 15:35:17 -- accel/accel.sh@19 -- # read -r var val 00:06:18.953 15:35:17 -- accel/accel.sh@20 -- # val= 00:06:18.953 15:35:17 -- accel/accel.sh@21 -- # case "$var" in 00:06:18.953 15:35:17 -- accel/accel.sh@19 -- # IFS=: 00:06:18.953 15:35:17 -- accel/accel.sh@19 -- # read -r var val 00:06:18.953 15:35:17 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:18.953 15:35:17 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:06:18.953 15:35:17 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:18.953 00:06:18.953 real 0m1.363s 00:06:18.953 user 0m1.263s 00:06:18.953 sys 0m0.114s 00:06:18.953 15:35:17 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:18.953 15:35:17 -- common/autotest_common.sh@10 -- # set +x 00:06:18.953 ************************************ 00:06:18.953 END TEST accel_decomp_mthread 00:06:18.953 ************************************ 00:06:19.212 15:35:17 -- accel/accel.sh@122 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:19.212 15:35:17 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:19.212 15:35:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:19.212 15:35:17 -- common/autotest_common.sh@10 -- # set +x 00:06:19.212 ************************************ 00:06:19.212 START TEST accel_deomp_full_mthread 00:06:19.212 ************************************ 00:06:19.212 15:35:17 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:19.212 15:35:17 -- accel/accel.sh@16 -- # local accel_opc 00:06:19.212 15:35:17 -- accel/accel.sh@17 -- # local accel_module 00:06:19.212 15:35:17 -- accel/accel.sh@19 -- # IFS=: 00:06:19.212 15:35:17 -- accel/accel.sh@19 -- # read -r var val 00:06:19.212 15:35:17 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:19.212 15:35:17 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:19.212 15:35:17 -- accel/accel.sh@12 -- # build_accel_config 00:06:19.212 15:35:17 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:19.212 15:35:17 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:19.212 15:35:17 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:19.212 15:35:17 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:19.212 15:35:17 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:19.212 15:35:17 -- accel/accel.sh@40 -- # local IFS=, 00:06:19.212 15:35:17 -- accel/accel.sh@41 -- # jq -r . 00:06:19.212 [2024-04-26 15:35:17.728532] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:06:19.212 [2024-04-26 15:35:17.728596] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3178543 ] 00:06:19.213 EAL: No free 2048 kB hugepages reported on node 1 00:06:19.213 [2024-04-26 15:35:17.785831] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:19.471 [2024-04-26 15:35:17.856374] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:19.471 15:35:17 -- accel/accel.sh@20 -- # val= 00:06:19.471 15:35:17 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.471 15:35:17 -- accel/accel.sh@19 -- # IFS=: 00:06:19.471 15:35:17 -- accel/accel.sh@19 -- # read -r var val 00:06:19.471 15:35:17 -- accel/accel.sh@20 -- # val= 00:06:19.471 15:35:17 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.471 15:35:17 -- accel/accel.sh@19 -- # IFS=: 00:06:19.471 15:35:17 -- accel/accel.sh@19 -- # read -r var val 00:06:19.471 15:35:17 -- accel/accel.sh@20 -- # val= 00:06:19.471 15:35:17 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.471 15:35:17 -- accel/accel.sh@19 -- # IFS=: 00:06:19.471 15:35:17 -- accel/accel.sh@19 -- # read -r var val 00:06:19.471 15:35:17 -- accel/accel.sh@20 -- # val=0x1 00:06:19.472 15:35:17 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.472 15:35:17 -- accel/accel.sh@19 -- # IFS=: 00:06:19.472 15:35:17 -- accel/accel.sh@19 -- # read -r var val 00:06:19.472 15:35:17 -- accel/accel.sh@20 -- # val= 00:06:19.472 15:35:17 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.472 15:35:17 -- accel/accel.sh@19 -- # IFS=: 00:06:19.472 15:35:17 -- accel/accel.sh@19 -- # read -r var val 00:06:19.472 15:35:17 -- accel/accel.sh@20 -- # val= 00:06:19.472 15:35:17 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.472 15:35:17 -- accel/accel.sh@19 -- # IFS=: 00:06:19.472 15:35:17 -- accel/accel.sh@19 -- # read -r var val 00:06:19.472 15:35:17 -- accel/accel.sh@20 -- # val=decompress 00:06:19.472 15:35:17 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.472 15:35:17 -- accel/accel.sh@23 -- # accel_opc=decompress 00:06:19.472 15:35:17 -- accel/accel.sh@19 -- # IFS=: 00:06:19.472 15:35:17 -- accel/accel.sh@19 -- # read -r var val 00:06:19.472 15:35:17 -- accel/accel.sh@20 -- # val='111250 bytes' 00:06:19.472 15:35:17 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.472 15:35:17 -- accel/accel.sh@19 -- # IFS=: 00:06:19.472 15:35:17 -- accel/accel.sh@19 -- # read -r var val 00:06:19.472 15:35:17 -- accel/accel.sh@20 -- # val= 00:06:19.472 15:35:17 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.472 15:35:17 -- accel/accel.sh@19 -- # IFS=: 00:06:19.472 15:35:17 -- accel/accel.sh@19 -- # read -r var val 00:06:19.472 15:35:17 -- accel/accel.sh@20 -- # val=software 00:06:19.472 15:35:17 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.472 15:35:17 -- accel/accel.sh@22 -- # accel_module=software 00:06:19.472 15:35:17 -- accel/accel.sh@19 -- # IFS=: 00:06:19.472 15:35:17 -- accel/accel.sh@19 -- # read -r var val 00:06:19.472 15:35:17 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:06:19.472 15:35:17 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.472 15:35:17 -- accel/accel.sh@19 -- # IFS=: 00:06:19.472 15:35:17 -- accel/accel.sh@19 -- # read -r var val 00:06:19.472 15:35:17 -- accel/accel.sh@20 -- # val=32 00:06:19.472 15:35:17 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.472 15:35:17 -- accel/accel.sh@19 -- # IFS=: 00:06:19.472 15:35:17 -- accel/accel.sh@19 -- # read -r var val 00:06:19.472 15:35:17 -- accel/accel.sh@20 -- # val=32 00:06:19.472 15:35:17 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.472 15:35:17 -- accel/accel.sh@19 -- # IFS=: 00:06:19.472 15:35:17 -- accel/accel.sh@19 -- # read -r var val 00:06:19.472 15:35:17 -- accel/accel.sh@20 -- # val=2 00:06:19.472 15:35:17 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.472 15:35:17 -- accel/accel.sh@19 -- # IFS=: 00:06:19.472 15:35:17 -- accel/accel.sh@19 -- # read -r var val 00:06:19.472 15:35:17 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:19.472 15:35:17 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.472 15:35:17 -- accel/accel.sh@19 -- # IFS=: 00:06:19.472 15:35:17 -- accel/accel.sh@19 -- # read -r var val 00:06:19.472 15:35:17 -- accel/accel.sh@20 -- # val=Yes 00:06:19.472 15:35:17 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.472 15:35:17 -- accel/accel.sh@19 -- # IFS=: 00:06:19.472 15:35:17 -- accel/accel.sh@19 -- # read -r var val 00:06:19.472 15:35:17 -- accel/accel.sh@20 -- # val= 00:06:19.472 15:35:17 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.472 15:35:17 -- accel/accel.sh@19 -- # IFS=: 00:06:19.472 15:35:17 -- accel/accel.sh@19 -- # read -r var val 00:06:19.472 15:35:17 -- accel/accel.sh@20 -- # val= 00:06:19.472 15:35:17 -- accel/accel.sh@21 -- # case "$var" in 00:06:19.472 15:35:17 -- accel/accel.sh@19 -- # IFS=: 00:06:19.472 15:35:17 -- accel/accel.sh@19 -- # read -r var val 00:06:20.849 15:35:19 -- accel/accel.sh@20 -- # val= 00:06:20.849 15:35:19 -- accel/accel.sh@21 -- # case "$var" in 00:06:20.849 15:35:19 -- accel/accel.sh@19 -- # IFS=: 00:06:20.849 15:35:19 -- accel/accel.sh@19 -- # read -r var val 00:06:20.849 15:35:19 -- accel/accel.sh@20 -- # val= 00:06:20.849 15:35:19 -- accel/accel.sh@21 -- # case "$var" in 00:06:20.849 15:35:19 -- accel/accel.sh@19 -- # IFS=: 00:06:20.849 15:35:19 -- accel/accel.sh@19 -- # read -r var val 00:06:20.849 15:35:19 -- accel/accel.sh@20 -- # val= 00:06:20.849 15:35:19 -- accel/accel.sh@21 -- # case "$var" in 00:06:20.849 15:35:19 -- accel/accel.sh@19 -- # IFS=: 00:06:20.849 15:35:19 -- accel/accel.sh@19 -- # read -r var val 00:06:20.849 15:35:19 -- accel/accel.sh@20 -- # val= 00:06:20.849 15:35:19 -- accel/accel.sh@21 -- # case "$var" in 00:06:20.849 15:35:19 -- accel/accel.sh@19 -- # IFS=: 00:06:20.849 15:35:19 -- accel/accel.sh@19 -- # read -r var val 00:06:20.849 15:35:19 -- accel/accel.sh@20 -- # val= 00:06:20.849 15:35:19 -- accel/accel.sh@21 -- # case "$var" in 00:06:20.849 15:35:19 -- accel/accel.sh@19 -- # IFS=: 00:06:20.849 15:35:19 -- accel/accel.sh@19 -- # read -r var val 00:06:20.849 15:35:19 -- accel/accel.sh@20 -- # val= 00:06:20.849 15:35:19 -- accel/accel.sh@21 -- # case "$var" in 00:06:20.849 15:35:19 -- accel/accel.sh@19 -- # IFS=: 00:06:20.849 15:35:19 -- accel/accel.sh@19 -- # read -r var val 00:06:20.849 15:35:19 -- accel/accel.sh@20 -- # val= 00:06:20.849 15:35:19 -- accel/accel.sh@21 -- # case "$var" in 00:06:20.849 15:35:19 -- accel/accel.sh@19 -- # IFS=: 00:06:20.849 15:35:19 -- accel/accel.sh@19 -- # read -r var val 00:06:20.849 15:35:19 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:20.849 15:35:19 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:06:20.849 15:35:19 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:20.849 00:06:20.849 real 0m1.389s 00:06:20.849 user 0m1.288s 00:06:20.849 sys 0m0.113s 00:06:20.849 15:35:19 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:20.849 15:35:19 -- common/autotest_common.sh@10 -- # set +x 00:06:20.849 ************************************ 00:06:20.849 END TEST accel_deomp_full_mthread 00:06:20.849 ************************************ 00:06:20.849 15:35:19 -- accel/accel.sh@124 -- # [[ n == y ]] 00:06:20.849 15:35:19 -- accel/accel.sh@137 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:20.849 15:35:19 -- accel/accel.sh@137 -- # build_accel_config 00:06:20.849 15:35:19 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:20.849 15:35:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:20.849 15:35:19 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:20.849 15:35:19 -- common/autotest_common.sh@10 -- # set +x 00:06:20.849 15:35:19 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:20.849 15:35:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:20.849 15:35:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:20.849 15:35:19 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:20.849 15:35:19 -- accel/accel.sh@40 -- # local IFS=, 00:06:20.849 15:35:19 -- accel/accel.sh@41 -- # jq -r . 00:06:20.849 ************************************ 00:06:20.849 START TEST accel_dif_functional_tests 00:06:20.849 ************************************ 00:06:20.849 15:35:19 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:20.849 [2024-04-26 15:35:19.293100] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:06:20.849 [2024-04-26 15:35:19.293138] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3178920 ] 00:06:20.849 EAL: No free 2048 kB hugepages reported on node 1 00:06:20.849 [2024-04-26 15:35:19.347979] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:20.849 [2024-04-26 15:35:19.419328] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:20.849 [2024-04-26 15:35:19.419422] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:20.849 [2024-04-26 15:35:19.419424] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:21.108 00:06:21.108 00:06:21.108 CUnit - A unit testing framework for C - Version 2.1-3 00:06:21.108 http://cunit.sourceforge.net/ 00:06:21.108 00:06:21.108 00:06:21.108 Suite: accel_dif 00:06:21.108 Test: verify: DIF generated, GUARD check ...passed 00:06:21.108 Test: verify: DIF generated, APPTAG check ...passed 00:06:21.108 Test: verify: DIF generated, REFTAG check ...passed 00:06:21.108 Test: verify: DIF not generated, GUARD check ...[2024-04-26 15:35:19.487575] dif.c: 826:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:21.108 [2024-04-26 15:35:19.487614] dif.c: 826:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:21.108 passed 00:06:21.108 Test: verify: DIF not generated, APPTAG check ...[2024-04-26 15:35:19.487643] dif.c: 841:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:21.108 [2024-04-26 15:35:19.487657] dif.c: 841:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:21.108 passed 00:06:21.108 Test: verify: DIF not generated, REFTAG check ...[2024-04-26 15:35:19.487674] dif.c: 776:_dif_reftag_check: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:21.108 [2024-04-26 15:35:19.487689] dif.c: 776:_dif_reftag_check: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:21.108 passed 00:06:21.108 Test: verify: APPTAG correct, APPTAG check ...passed 00:06:21.108 Test: verify: APPTAG incorrect, APPTAG check ...[2024-04-26 15:35:19.487730] dif.c: 841:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:06:21.108 passed 00:06:21.108 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:06:21.108 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:06:21.108 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:06:21.108 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-04-26 15:35:19.487823] dif.c: 776:_dif_reftag_check: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:06:21.108 passed 00:06:21.108 Test: generate copy: DIF generated, GUARD check ...passed 00:06:21.108 Test: generate copy: DIF generated, APTTAG check ...passed 00:06:21.108 Test: generate copy: DIF generated, REFTAG check ...passed 00:06:21.108 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:06:21.108 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:06:21.108 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:06:21.108 Test: generate copy: iovecs-len validate ...[2024-04-26 15:35:19.487980] dif.c:1190:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:06:21.108 passed 00:06:21.108 Test: generate copy: buffer alignment validate ...passed 00:06:21.108 00:06:21.108 Run Summary: Type Total Ran Passed Failed Inactive 00:06:21.108 suites 1 1 n/a 0 0 00:06:21.108 tests 20 20 20 0 0 00:06:21.108 asserts 204 204 204 0 n/a 00:06:21.108 00:06:21.108 Elapsed time = 0.000 seconds 00:06:21.108 00:06:21.108 real 0m0.424s 00:06:21.108 user 0m0.595s 00:06:21.108 sys 0m0.143s 00:06:21.108 15:35:19 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:21.108 15:35:19 -- common/autotest_common.sh@10 -- # set +x 00:06:21.108 ************************************ 00:06:21.108 END TEST accel_dif_functional_tests 00:06:21.108 ************************************ 00:06:21.108 00:06:21.108 real 0m33.951s 00:06:21.108 user 0m36.267s 00:06:21.108 sys 0m5.311s 00:06:21.108 15:35:19 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:21.367 15:35:19 -- common/autotest_common.sh@10 -- # set +x 00:06:21.367 ************************************ 00:06:21.367 END TEST accel 00:06:21.367 ************************************ 00:06:21.367 15:35:19 -- spdk/autotest.sh@180 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:21.367 15:35:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:21.367 15:35:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:21.367 15:35:19 -- common/autotest_common.sh@10 -- # set +x 00:06:21.367 ************************************ 00:06:21.367 START TEST accel_rpc 00:06:21.367 ************************************ 00:06:21.367 15:35:19 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:21.367 * Looking for test storage... 00:06:21.367 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel 00:06:21.367 15:35:19 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:21.367 15:35:19 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=3179053 00:06:21.367 15:35:19 -- accel/accel_rpc.sh@15 -- # waitforlisten 3179053 00:06:21.367 15:35:19 -- common/autotest_common.sh@817 -- # '[' -z 3179053 ']' 00:06:21.367 15:35:19 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:21.367 15:35:19 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:21.367 15:35:19 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:21.367 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:21.367 15:35:19 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:21.367 15:35:19 -- common/autotest_common.sh@10 -- # set +x 00:06:21.367 15:35:19 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:06:21.627 [2024-04-26 15:35:20.020571] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:06:21.627 [2024-04-26 15:35:20.020619] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3179053 ] 00:06:21.627 EAL: No free 2048 kB hugepages reported on node 1 00:06:21.627 [2024-04-26 15:35:20.077675] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:21.627 [2024-04-26 15:35:20.155114] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:22.564 15:35:20 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:22.564 15:35:20 -- common/autotest_common.sh@850 -- # return 0 00:06:22.564 15:35:20 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:06:22.564 15:35:20 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:06:22.564 15:35:20 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:06:22.564 15:35:20 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:06:22.564 15:35:20 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:06:22.564 15:35:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:22.564 15:35:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:22.564 15:35:20 -- common/autotest_common.sh@10 -- # set +x 00:06:22.564 ************************************ 00:06:22.564 START TEST accel_assign_opcode 00:06:22.564 ************************************ 00:06:22.564 15:35:20 -- common/autotest_common.sh@1111 -- # accel_assign_opcode_test_suite 00:06:22.564 15:35:20 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:06:22.564 15:35:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:22.564 15:35:20 -- common/autotest_common.sh@10 -- # set +x 00:06:22.564 [2024-04-26 15:35:20.893273] accel_rpc.c: 167:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:06:22.564 15:35:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:22.564 15:35:20 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:06:22.564 15:35:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:22.564 15:35:20 -- common/autotest_common.sh@10 -- # set +x 00:06:22.564 [2024-04-26 15:35:20.901287] accel_rpc.c: 167:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:06:22.564 15:35:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:22.564 15:35:20 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:06:22.564 15:35:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:22.564 15:35:20 -- common/autotest_common.sh@10 -- # set +x 00:06:22.564 15:35:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:22.564 15:35:21 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:06:22.564 15:35:21 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:06:22.564 15:35:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:22.564 15:35:21 -- accel/accel_rpc.sh@42 -- # grep software 00:06:22.564 15:35:21 -- common/autotest_common.sh@10 -- # set +x 00:06:22.564 15:35:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:22.564 software 00:06:22.564 00:06:22.564 real 0m0.232s 00:06:22.564 user 0m0.041s 00:06:22.564 sys 0m0.009s 00:06:22.564 15:35:21 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:22.564 15:35:21 -- common/autotest_common.sh@10 -- # set +x 00:06:22.564 ************************************ 00:06:22.564 END TEST accel_assign_opcode 00:06:22.564 ************************************ 00:06:22.564 15:35:21 -- accel/accel_rpc.sh@55 -- # killprocess 3179053 00:06:22.564 15:35:21 -- common/autotest_common.sh@936 -- # '[' -z 3179053 ']' 00:06:22.564 15:35:21 -- common/autotest_common.sh@940 -- # kill -0 3179053 00:06:22.564 15:35:21 -- common/autotest_common.sh@941 -- # uname 00:06:22.564 15:35:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:22.564 15:35:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3179053 00:06:22.823 15:35:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:22.823 15:35:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:22.823 15:35:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3179053' 00:06:22.823 killing process with pid 3179053 00:06:22.823 15:35:21 -- common/autotest_common.sh@955 -- # kill 3179053 00:06:22.823 15:35:21 -- common/autotest_common.sh@960 -- # wait 3179053 00:06:23.082 00:06:23.082 real 0m1.655s 00:06:23.082 user 0m1.712s 00:06:23.082 sys 0m0.459s 00:06:23.082 15:35:21 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:23.082 15:35:21 -- common/autotest_common.sh@10 -- # set +x 00:06:23.082 ************************************ 00:06:23.082 END TEST accel_rpc 00:06:23.082 ************************************ 00:06:23.082 15:35:21 -- spdk/autotest.sh@181 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/cmdline.sh 00:06:23.082 15:35:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:23.082 15:35:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:23.082 15:35:21 -- common/autotest_common.sh@10 -- # set +x 00:06:23.341 ************************************ 00:06:23.341 START TEST app_cmdline 00:06:23.341 ************************************ 00:06:23.341 15:35:21 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/cmdline.sh 00:06:23.341 * Looking for test storage... 00:06:23.341 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app 00:06:23.341 15:35:21 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:06:23.341 15:35:21 -- app/cmdline.sh@17 -- # spdk_tgt_pid=3179402 00:06:23.341 15:35:21 -- app/cmdline.sh@18 -- # waitforlisten 3179402 00:06:23.341 15:35:21 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:06:23.341 15:35:21 -- common/autotest_common.sh@817 -- # '[' -z 3179402 ']' 00:06:23.341 15:35:21 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:23.341 15:35:21 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:23.341 15:35:21 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:23.341 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:23.341 15:35:21 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:23.341 15:35:21 -- common/autotest_common.sh@10 -- # set +x 00:06:23.341 [2024-04-26 15:35:21.829682] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:06:23.341 [2024-04-26 15:35:21.829726] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3179402 ] 00:06:23.341 EAL: No free 2048 kB hugepages reported on node 1 00:06:23.341 [2024-04-26 15:35:21.884405] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:23.600 [2024-04-26 15:35:21.962650] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:24.167 15:35:22 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:24.167 15:35:22 -- common/autotest_common.sh@850 -- # return 0 00:06:24.167 15:35:22 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:06:24.426 { 00:06:24.426 "version": "SPDK v24.05-pre git sha1 bca9154a0", 00:06:24.426 "fields": { 00:06:24.426 "major": 24, 00:06:24.426 "minor": 5, 00:06:24.426 "patch": 0, 00:06:24.426 "suffix": "-pre", 00:06:24.426 "commit": "bca9154a0" 00:06:24.426 } 00:06:24.426 } 00:06:24.426 15:35:22 -- app/cmdline.sh@22 -- # expected_methods=() 00:06:24.426 15:35:22 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:06:24.426 15:35:22 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:06:24.426 15:35:22 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:06:24.426 15:35:22 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:06:24.426 15:35:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:24.426 15:35:22 -- common/autotest_common.sh@10 -- # set +x 00:06:24.426 15:35:22 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:06:24.426 15:35:22 -- app/cmdline.sh@26 -- # sort 00:06:24.426 15:35:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:24.426 15:35:22 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:06:24.426 15:35:22 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:06:24.426 15:35:22 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:24.426 15:35:22 -- common/autotest_common.sh@638 -- # local es=0 00:06:24.426 15:35:22 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:24.426 15:35:22 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:06:24.426 15:35:22 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:24.426 15:35:22 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:06:24.426 15:35:22 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:24.426 15:35:22 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:06:24.426 15:35:22 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:24.426 15:35:22 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:06:24.426 15:35:22 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py ]] 00:06:24.426 15:35:22 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:24.426 request: 00:06:24.426 { 00:06:24.426 "method": "env_dpdk_get_mem_stats", 00:06:24.426 "req_id": 1 00:06:24.426 } 00:06:24.426 Got JSON-RPC error response 00:06:24.426 response: 00:06:24.426 { 00:06:24.426 "code": -32601, 00:06:24.426 "message": "Method not found" 00:06:24.426 } 00:06:24.426 15:35:23 -- common/autotest_common.sh@641 -- # es=1 00:06:24.426 15:35:23 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:06:24.426 15:35:23 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:06:24.426 15:35:23 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:06:24.426 15:35:23 -- app/cmdline.sh@1 -- # killprocess 3179402 00:06:24.426 15:35:23 -- common/autotest_common.sh@936 -- # '[' -z 3179402 ']' 00:06:24.426 15:35:23 -- common/autotest_common.sh@940 -- # kill -0 3179402 00:06:24.426 15:35:23 -- common/autotest_common.sh@941 -- # uname 00:06:24.426 15:35:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:24.426 15:35:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3179402 00:06:24.685 15:35:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:24.685 15:35:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:24.685 15:35:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3179402' 00:06:24.685 killing process with pid 3179402 00:06:24.685 15:35:23 -- common/autotest_common.sh@955 -- # kill 3179402 00:06:24.685 15:35:23 -- common/autotest_common.sh@960 -- # wait 3179402 00:06:24.943 00:06:24.944 real 0m1.683s 00:06:24.944 user 0m2.008s 00:06:24.944 sys 0m0.420s 00:06:24.944 15:35:23 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:24.944 15:35:23 -- common/autotest_common.sh@10 -- # set +x 00:06:24.944 ************************************ 00:06:24.944 END TEST app_cmdline 00:06:24.944 ************************************ 00:06:24.944 15:35:23 -- spdk/autotest.sh@182 -- # run_test version /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/version.sh 00:06:24.944 15:35:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:24.944 15:35:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:24.944 15:35:23 -- common/autotest_common.sh@10 -- # set +x 00:06:24.944 ************************************ 00:06:24.944 START TEST version 00:06:24.944 ************************************ 00:06:24.944 15:35:23 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/version.sh 00:06:25.203 * Looking for test storage... 00:06:25.203 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app 00:06:25.203 15:35:23 -- app/version.sh@17 -- # get_header_version major 00:06:25.203 15:35:23 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/version.h 00:06:25.203 15:35:23 -- app/version.sh@14 -- # cut -f2 00:06:25.203 15:35:23 -- app/version.sh@14 -- # tr -d '"' 00:06:25.203 15:35:23 -- app/version.sh@17 -- # major=24 00:06:25.203 15:35:23 -- app/version.sh@18 -- # get_header_version minor 00:06:25.203 15:35:23 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/version.h 00:06:25.203 15:35:23 -- app/version.sh@14 -- # cut -f2 00:06:25.203 15:35:23 -- app/version.sh@14 -- # tr -d '"' 00:06:25.203 15:35:23 -- app/version.sh@18 -- # minor=5 00:06:25.203 15:35:23 -- app/version.sh@19 -- # get_header_version patch 00:06:25.203 15:35:23 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/version.h 00:06:25.203 15:35:23 -- app/version.sh@14 -- # cut -f2 00:06:25.203 15:35:23 -- app/version.sh@14 -- # tr -d '"' 00:06:25.203 15:35:23 -- app/version.sh@19 -- # patch=0 00:06:25.203 15:35:23 -- app/version.sh@20 -- # get_header_version suffix 00:06:25.203 15:35:23 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/version.h 00:06:25.203 15:35:23 -- app/version.sh@14 -- # cut -f2 00:06:25.203 15:35:23 -- app/version.sh@14 -- # tr -d '"' 00:06:25.203 15:35:23 -- app/version.sh@20 -- # suffix=-pre 00:06:25.203 15:35:23 -- app/version.sh@22 -- # version=24.5 00:06:25.203 15:35:23 -- app/version.sh@25 -- # (( patch != 0 )) 00:06:25.203 15:35:23 -- app/version.sh@28 -- # version=24.5rc0 00:06:25.203 15:35:23 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python 00:06:25.203 15:35:23 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:06:25.203 15:35:23 -- app/version.sh@30 -- # py_version=24.5rc0 00:06:25.203 15:35:23 -- app/version.sh@31 -- # [[ 24.5rc0 == \2\4\.\5\r\c\0 ]] 00:06:25.203 00:06:25.203 real 0m0.151s 00:06:25.203 user 0m0.082s 00:06:25.203 sys 0m0.102s 00:06:25.203 15:35:23 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:25.203 15:35:23 -- common/autotest_common.sh@10 -- # set +x 00:06:25.203 ************************************ 00:06:25.203 END TEST version 00:06:25.203 ************************************ 00:06:25.203 15:35:23 -- spdk/autotest.sh@184 -- # '[' 0 -eq 1 ']' 00:06:25.203 15:35:23 -- spdk/autotest.sh@194 -- # uname -s 00:06:25.203 15:35:23 -- spdk/autotest.sh@194 -- # [[ Linux == Linux ]] 00:06:25.203 15:35:23 -- spdk/autotest.sh@195 -- # [[ 0 -eq 1 ]] 00:06:25.203 15:35:23 -- spdk/autotest.sh@195 -- # [[ 0 -eq 1 ]] 00:06:25.203 15:35:23 -- spdk/autotest.sh@207 -- # '[' 0 -eq 1 ']' 00:06:25.203 15:35:23 -- spdk/autotest.sh@254 -- # '[' 0 -eq 1 ']' 00:06:25.203 15:35:23 -- spdk/autotest.sh@258 -- # timing_exit lib 00:06:25.203 15:35:23 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:25.203 15:35:23 -- common/autotest_common.sh@10 -- # set +x 00:06:25.203 15:35:23 -- spdk/autotest.sh@260 -- # '[' 0 -eq 1 ']' 00:06:25.203 15:35:23 -- spdk/autotest.sh@268 -- # '[' 0 -eq 1 ']' 00:06:25.203 15:35:23 -- spdk/autotest.sh@277 -- # '[' 1 -eq 1 ']' 00:06:25.203 15:35:23 -- spdk/autotest.sh@278 -- # export NET_TYPE 00:06:25.203 15:35:23 -- spdk/autotest.sh@281 -- # '[' rdma = rdma ']' 00:06:25.203 15:35:23 -- spdk/autotest.sh@282 -- # run_test nvmf_rdma /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=rdma 00:06:25.203 15:35:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:25.203 15:35:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:25.203 15:35:23 -- common/autotest_common.sh@10 -- # set +x 00:06:25.463 ************************************ 00:06:25.463 START TEST nvmf_rdma 00:06:25.463 ************************************ 00:06:25.463 15:35:23 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=rdma 00:06:25.463 * Looking for test storage... 00:06:25.463 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf 00:06:25.463 15:35:23 -- nvmf/nvmf.sh@10 -- # uname -s 00:06:25.463 15:35:23 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:06:25.463 15:35:23 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:06:25.463 15:35:23 -- nvmf/common.sh@7 -- # uname -s 00:06:25.463 15:35:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:25.463 15:35:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:25.463 15:35:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:25.463 15:35:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:25.463 15:35:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:25.463 15:35:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:25.463 15:35:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:25.463 15:35:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:25.463 15:35:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:25.463 15:35:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:25.463 15:35:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:06:25.463 15:35:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:06:25.463 15:35:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:25.463 15:35:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:25.463 15:35:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:25.463 15:35:23 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:06:25.463 15:35:23 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:06:25.463 15:35:23 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:25.463 15:35:23 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:25.463 15:35:23 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:25.463 15:35:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:25.463 15:35:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:25.463 15:35:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:25.463 15:35:23 -- paths/export.sh@5 -- # export PATH 00:06:25.463 15:35:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:25.463 15:35:23 -- nvmf/common.sh@47 -- # : 0 00:06:25.463 15:35:23 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:06:25.463 15:35:23 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:06:25.463 15:35:23 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:06:25.463 15:35:23 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:25.463 15:35:23 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:25.463 15:35:23 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:06:25.463 15:35:23 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:06:25.463 15:35:23 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:06:25.463 15:35:23 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:06:25.463 15:35:23 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:06:25.463 15:35:23 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:06:25.463 15:35:23 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:25.463 15:35:23 -- common/autotest_common.sh@10 -- # set +x 00:06:25.463 15:35:23 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:06:25.463 15:35:23 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=rdma 00:06:25.463 15:35:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:25.463 15:35:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:25.463 15:35:23 -- common/autotest_common.sh@10 -- # set +x 00:06:25.723 ************************************ 00:06:25.723 START TEST nvmf_example 00:06:25.723 ************************************ 00:06:25.723 15:35:24 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=rdma 00:06:25.723 * Looking for test storage... 00:06:25.723 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:06:25.723 15:35:24 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:06:25.723 15:35:24 -- nvmf/common.sh@7 -- # uname -s 00:06:25.723 15:35:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:25.723 15:35:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:25.723 15:35:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:25.723 15:35:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:25.723 15:35:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:25.723 15:35:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:25.723 15:35:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:25.723 15:35:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:25.723 15:35:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:25.723 15:35:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:25.723 15:35:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:06:25.723 15:35:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:06:25.723 15:35:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:25.723 15:35:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:25.723 15:35:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:25.723 15:35:24 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:06:25.723 15:35:24 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:06:25.723 15:35:24 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:25.723 15:35:24 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:25.723 15:35:24 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:25.723 15:35:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:25.723 15:35:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:25.723 15:35:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:25.723 15:35:24 -- paths/export.sh@5 -- # export PATH 00:06:25.723 15:35:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:25.723 15:35:24 -- nvmf/common.sh@47 -- # : 0 00:06:25.723 15:35:24 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:06:25.723 15:35:24 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:06:25.723 15:35:24 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:06:25.723 15:35:24 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:25.723 15:35:24 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:25.723 15:35:24 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:06:25.723 15:35:24 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:06:25.723 15:35:24 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:06:25.723 15:35:24 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:06:25.723 15:35:24 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:06:25.723 15:35:24 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:06:25.723 15:35:24 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:06:25.723 15:35:24 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:06:25.723 15:35:24 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:06:25.723 15:35:24 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:06:25.723 15:35:24 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:06:25.723 15:35:24 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:25.723 15:35:24 -- common/autotest_common.sh@10 -- # set +x 00:06:25.723 15:35:24 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:06:25.723 15:35:24 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:06:25.723 15:35:24 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:25.723 15:35:24 -- nvmf/common.sh@437 -- # prepare_net_devs 00:06:25.723 15:35:24 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:06:25.723 15:35:24 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:06:25.723 15:35:24 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:25.723 15:35:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:25.723 15:35:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:25.723 15:35:24 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:06:25.723 15:35:24 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:06:25.723 15:35:24 -- nvmf/common.sh@285 -- # xtrace_disable 00:06:25.723 15:35:24 -- common/autotest_common.sh@10 -- # set +x 00:06:30.993 15:35:29 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:31.253 15:35:29 -- nvmf/common.sh@291 -- # pci_devs=() 00:06:31.253 15:35:29 -- nvmf/common.sh@291 -- # local -a pci_devs 00:06:31.253 15:35:29 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:06:31.253 15:35:29 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:06:31.253 15:35:29 -- nvmf/common.sh@293 -- # pci_drivers=() 00:06:31.253 15:35:29 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:06:31.253 15:35:29 -- nvmf/common.sh@295 -- # net_devs=() 00:06:31.253 15:35:29 -- nvmf/common.sh@295 -- # local -ga net_devs 00:06:31.253 15:35:29 -- nvmf/common.sh@296 -- # e810=() 00:06:31.253 15:35:29 -- nvmf/common.sh@296 -- # local -ga e810 00:06:31.253 15:35:29 -- nvmf/common.sh@297 -- # x722=() 00:06:31.253 15:35:29 -- nvmf/common.sh@297 -- # local -ga x722 00:06:31.253 15:35:29 -- nvmf/common.sh@298 -- # mlx=() 00:06:31.253 15:35:29 -- nvmf/common.sh@298 -- # local -ga mlx 00:06:31.253 15:35:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:31.253 15:35:29 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:31.253 15:35:29 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:31.253 15:35:29 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:31.253 15:35:29 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:31.253 15:35:29 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:31.253 15:35:29 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:31.253 15:35:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:31.253 15:35:29 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:31.253 15:35:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:31.253 15:35:29 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:31.253 15:35:29 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:06:31.253 15:35:29 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:06:31.253 15:35:29 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:06:31.253 15:35:29 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:06:31.253 15:35:29 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:06:31.253 15:35:29 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:06:31.253 15:35:29 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:06:31.253 15:35:29 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:06:31.253 15:35:29 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:06:31.253 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:06:31.253 15:35:29 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:06:31.253 15:35:29 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:06:31.253 15:35:29 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:06:31.253 15:35:29 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:06:31.253 15:35:29 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:06:31.253 15:35:29 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:06:31.253 15:35:29 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:06:31.253 15:35:29 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:06:31.253 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:06:31.253 15:35:29 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:06:31.253 15:35:29 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:06:31.253 15:35:29 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:06:31.253 15:35:29 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:06:31.253 15:35:29 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:06:31.253 15:35:29 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:06:31.253 15:35:29 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:06:31.253 15:35:29 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:06:31.253 15:35:29 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:06:31.253 15:35:29 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:31.253 15:35:29 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:06:31.253 15:35:29 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:31.253 15:35:29 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:06:31.253 Found net devices under 0000:da:00.0: mlx_0_0 00:06:31.253 15:35:29 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:06:31.253 15:35:29 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:06:31.253 15:35:29 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:31.253 15:35:29 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:06:31.253 15:35:29 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:31.253 15:35:29 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:06:31.253 Found net devices under 0000:da:00.1: mlx_0_1 00:06:31.253 15:35:29 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:06:31.253 15:35:29 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:06:31.253 15:35:29 -- nvmf/common.sh@403 -- # is_hw=yes 00:06:31.253 15:35:29 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:06:31.253 15:35:29 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:06:31.253 15:35:29 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:06:31.253 15:35:29 -- nvmf/common.sh@409 -- # rdma_device_init 00:06:31.253 15:35:29 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:06:31.253 15:35:29 -- nvmf/common.sh@58 -- # uname 00:06:31.253 15:35:29 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:06:31.253 15:35:29 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:06:31.253 15:35:29 -- nvmf/common.sh@63 -- # modprobe ib_core 00:06:31.253 15:35:29 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:06:31.253 15:35:29 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:06:31.253 15:35:29 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:06:31.253 15:35:29 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:06:31.253 15:35:29 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:06:31.253 15:35:29 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:06:31.253 15:35:29 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:06:31.253 15:35:29 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:06:31.253 15:35:29 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:06:31.253 15:35:29 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:06:31.253 15:35:29 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:06:31.253 15:35:29 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:06:31.253 15:35:29 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:06:31.254 15:35:29 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:31.254 15:35:29 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:31.254 15:35:29 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:06:31.254 15:35:29 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:06:31.254 15:35:29 -- nvmf/common.sh@105 -- # continue 2 00:06:31.254 15:35:29 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:31.254 15:35:29 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:31.254 15:35:29 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:06:31.254 15:35:29 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:31.254 15:35:29 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:06:31.254 15:35:29 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:06:31.254 15:35:29 -- nvmf/common.sh@105 -- # continue 2 00:06:31.254 15:35:29 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:06:31.254 15:35:29 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:06:31.254 15:35:29 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:06:31.254 15:35:29 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:06:31.254 15:35:29 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:31.254 15:35:29 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:31.254 15:35:29 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:06:31.254 15:35:29 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:06:31.254 15:35:29 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:06:31.254 118: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:06:31.254 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:06:31.254 altname enp218s0f0np0 00:06:31.254 altname ens818f0np0 00:06:31.254 inet 192.168.100.8/24 scope global mlx_0_0 00:06:31.254 valid_lft forever preferred_lft forever 00:06:31.254 15:35:29 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:06:31.254 15:35:29 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:06:31.254 15:35:29 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:06:31.254 15:35:29 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:06:31.254 15:35:29 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:31.254 15:35:29 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:31.254 15:35:29 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:06:31.254 15:35:29 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:06:31.254 15:35:29 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:06:31.254 119: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:06:31.254 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:06:31.254 altname enp218s0f1np1 00:06:31.254 altname ens818f1np1 00:06:31.254 inet 192.168.100.9/24 scope global mlx_0_1 00:06:31.254 valid_lft forever preferred_lft forever 00:06:31.254 15:35:29 -- nvmf/common.sh@411 -- # return 0 00:06:31.254 15:35:29 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:06:31.254 15:35:29 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:06:31.254 15:35:29 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:06:31.254 15:35:29 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:06:31.254 15:35:29 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:06:31.254 15:35:29 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:06:31.254 15:35:29 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:06:31.254 15:35:29 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:06:31.254 15:35:29 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:06:31.254 15:35:29 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:06:31.254 15:35:29 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:31.254 15:35:29 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:31.254 15:35:29 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:06:31.254 15:35:29 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:06:31.254 15:35:29 -- nvmf/common.sh@105 -- # continue 2 00:06:31.254 15:35:29 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:31.254 15:35:29 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:31.254 15:35:29 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:06:31.254 15:35:29 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:31.254 15:35:29 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:06:31.254 15:35:29 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:06:31.254 15:35:29 -- nvmf/common.sh@105 -- # continue 2 00:06:31.254 15:35:29 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:06:31.254 15:35:29 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:06:31.254 15:35:29 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:06:31.254 15:35:29 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:06:31.254 15:35:29 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:31.254 15:35:29 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:31.254 15:35:29 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:06:31.254 15:35:29 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:06:31.254 15:35:29 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:06:31.254 15:35:29 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:06:31.254 15:35:29 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:31.254 15:35:29 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:31.254 15:35:29 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:06:31.254 192.168.100.9' 00:06:31.254 15:35:29 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:06:31.254 192.168.100.9' 00:06:31.254 15:35:29 -- nvmf/common.sh@446 -- # head -n 1 00:06:31.254 15:35:29 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:06:31.254 15:35:29 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:06:31.254 192.168.100.9' 00:06:31.254 15:35:29 -- nvmf/common.sh@447 -- # tail -n +2 00:06:31.254 15:35:29 -- nvmf/common.sh@447 -- # head -n 1 00:06:31.254 15:35:29 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:06:31.254 15:35:29 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:06:31.254 15:35:29 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:06:31.254 15:35:29 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:06:31.254 15:35:29 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:06:31.254 15:35:29 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:06:31.254 15:35:29 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:06:31.254 15:35:29 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:06:31.254 15:35:29 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:31.254 15:35:29 -- common/autotest_common.sh@10 -- # set +x 00:06:31.254 15:35:29 -- target/nvmf_example.sh@29 -- # '[' rdma == tcp ']' 00:06:31.254 15:35:29 -- target/nvmf_example.sh@34 -- # nvmfpid=3183037 00:06:31.254 15:35:29 -- target/nvmf_example.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:06:31.254 15:35:29 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:06:31.254 15:35:29 -- target/nvmf_example.sh@36 -- # waitforlisten 3183037 00:06:31.254 15:35:29 -- common/autotest_common.sh@817 -- # '[' -z 3183037 ']' 00:06:31.254 15:35:29 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:31.254 15:35:29 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:31.254 15:35:29 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:31.254 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:31.254 15:35:29 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:31.254 15:35:29 -- common/autotest_common.sh@10 -- # set +x 00:06:31.512 EAL: No free 2048 kB hugepages reported on node 1 00:06:32.079 15:35:30 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:32.079 15:35:30 -- common/autotest_common.sh@850 -- # return 0 00:06:32.079 15:35:30 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:06:32.079 15:35:30 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:32.079 15:35:30 -- common/autotest_common.sh@10 -- # set +x 00:06:32.079 15:35:30 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:06:32.079 15:35:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:32.079 15:35:30 -- common/autotest_common.sh@10 -- # set +x 00:06:32.337 15:35:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:32.337 15:35:30 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:06:32.337 15:35:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:32.337 15:35:30 -- common/autotest_common.sh@10 -- # set +x 00:06:32.337 15:35:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:32.337 15:35:30 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:06:32.337 15:35:30 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:32.337 15:35:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:32.337 15:35:30 -- common/autotest_common.sh@10 -- # set +x 00:06:32.337 15:35:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:32.337 15:35:30 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:06:32.337 15:35:30 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:06:32.337 15:35:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:32.337 15:35:30 -- common/autotest_common.sh@10 -- # set +x 00:06:32.337 15:35:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:32.337 15:35:30 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:06:32.337 15:35:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:32.337 15:35:30 -- common/autotest_common.sh@10 -- # set +x 00:06:32.337 15:35:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:32.337 15:35:30 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:06:32.337 15:35:30 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:06:32.595 EAL: No free 2048 kB hugepages reported on node 1 00:06:44.854 Initializing NVMe Controllers 00:06:44.854 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:06:44.854 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:06:44.854 Initialization complete. Launching workers. 00:06:44.854 ======================================================== 00:06:44.854 Latency(us) 00:06:44.854 Device Information : IOPS MiB/s Average min max 00:06:44.854 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 26012.80 101.61 2460.03 631.31 15955.97 00:06:44.854 ======================================================== 00:06:44.854 Total : 26012.80 101.61 2460.03 631.31 15955.97 00:06:44.854 00:06:44.854 15:35:42 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:06:44.854 15:35:42 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:06:44.854 15:35:42 -- nvmf/common.sh@477 -- # nvmfcleanup 00:06:44.854 15:35:42 -- nvmf/common.sh@117 -- # sync 00:06:44.854 15:35:42 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:06:44.854 15:35:42 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:06:44.854 15:35:42 -- nvmf/common.sh@120 -- # set +e 00:06:44.854 15:35:42 -- nvmf/common.sh@121 -- # for i in {1..20} 00:06:44.854 15:35:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:06:44.854 rmmod nvme_rdma 00:06:44.854 rmmod nvme_fabrics 00:06:44.854 15:35:42 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:06:44.854 15:35:42 -- nvmf/common.sh@124 -- # set -e 00:06:44.854 15:35:42 -- nvmf/common.sh@125 -- # return 0 00:06:44.854 15:35:42 -- nvmf/common.sh@478 -- # '[' -n 3183037 ']' 00:06:44.854 15:35:42 -- nvmf/common.sh@479 -- # killprocess 3183037 00:06:44.854 15:35:42 -- common/autotest_common.sh@936 -- # '[' -z 3183037 ']' 00:06:44.854 15:35:42 -- common/autotest_common.sh@940 -- # kill -0 3183037 00:06:44.854 15:35:42 -- common/autotest_common.sh@941 -- # uname 00:06:44.854 15:35:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:44.854 15:35:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3183037 00:06:44.854 15:35:42 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:06:44.854 15:35:42 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:06:44.854 15:35:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3183037' 00:06:44.854 killing process with pid 3183037 00:06:44.854 15:35:42 -- common/autotest_common.sh@955 -- # kill 3183037 00:06:44.854 15:35:42 -- common/autotest_common.sh@960 -- # wait 3183037 00:06:44.854 [2024-04-26 15:35:42.337402] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:06:44.854 nvmf threads initialize successfully 00:06:44.854 bdev subsystem init successfully 00:06:44.854 created a nvmf target service 00:06:44.854 create targets's poll groups done 00:06:44.854 all subsystems of target started 00:06:44.854 nvmf target is running 00:06:44.854 all subsystems of target stopped 00:06:44.854 destroy targets's poll groups done 00:06:44.854 destroyed the nvmf target service 00:06:44.854 bdev subsystem finish successfully 00:06:44.854 nvmf threads destroy successfully 00:06:44.854 15:35:42 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:06:44.854 15:35:42 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:06:44.854 15:35:42 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:06:44.854 15:35:42 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:44.854 15:35:42 -- common/autotest_common.sh@10 -- # set +x 00:06:44.854 00:06:44.854 real 0m18.417s 00:06:44.854 user 0m51.777s 00:06:44.854 sys 0m4.593s 00:06:44.854 15:35:42 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:44.854 15:35:42 -- common/autotest_common.sh@10 -- # set +x 00:06:44.854 ************************************ 00:06:44.854 END TEST nvmf_example 00:06:44.854 ************************************ 00:06:44.854 15:35:42 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=rdma 00:06:44.854 15:35:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:44.854 15:35:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:44.854 15:35:42 -- common/autotest_common.sh@10 -- # set +x 00:06:44.854 ************************************ 00:06:44.854 START TEST nvmf_filesystem 00:06:44.854 ************************************ 00:06:44.854 15:35:42 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=rdma 00:06:44.854 * Looking for test storage... 00:06:44.854 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:06:44.854 15:35:42 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh 00:06:44.854 15:35:42 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:06:44.854 15:35:42 -- common/autotest_common.sh@34 -- # set -e 00:06:44.854 15:35:42 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:06:44.854 15:35:42 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:06:44.854 15:35:42 -- common/autotest_common.sh@38 -- # '[' -z /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output ']' 00:06:44.854 15:35:42 -- common/autotest_common.sh@43 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/build_config.sh ]] 00:06:44.854 15:35:42 -- common/autotest_common.sh@44 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/build_config.sh 00:06:44.854 15:35:42 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:06:44.854 15:35:42 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:06:44.854 15:35:42 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:06:44.854 15:35:42 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:06:44.854 15:35:42 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:06:44.854 15:35:42 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:06:44.854 15:35:42 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:06:44.854 15:35:42 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:06:44.854 15:35:42 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:06:44.854 15:35:42 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:06:44.854 15:35:42 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:06:44.854 15:35:42 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:06:44.854 15:35:42 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:06:44.854 15:35:42 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:06:44.854 15:35:42 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:06:44.854 15:35:42 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:06:44.854 15:35:42 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:06:44.854 15:35:42 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:06:44.854 15:35:42 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk 00:06:44.854 15:35:42 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:06:44.854 15:35:42 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:06:44.854 15:35:42 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:06:44.854 15:35:42 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:06:44.854 15:35:42 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:06:44.854 15:35:42 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:06:44.854 15:35:42 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:06:44.854 15:35:42 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:06:44.854 15:35:42 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:06:44.854 15:35:42 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:06:44.854 15:35:42 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:06:44.854 15:35:42 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:06:44.854 15:35:42 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:06:44.854 15:35:42 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:06:44.854 15:35:42 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:06:44.854 15:35:42 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:06:44.854 15:35:42 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:06:44.854 15:35:42 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:06:44.854 15:35:42 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:06:44.854 15:35:42 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:06:44.854 15:35:42 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:06:44.854 15:35:42 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:06:44.854 15:35:42 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:06:44.854 15:35:42 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:06:44.854 15:35:42 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:06:44.854 15:35:42 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:06:44.854 15:35:42 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:06:44.854 15:35:42 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:06:44.854 15:35:42 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:06:44.854 15:35:42 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:06:44.854 15:35:42 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:06:44.854 15:35:42 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:06:44.854 15:35:42 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:06:44.854 15:35:42 -- common/build_config.sh@53 -- # CONFIG_HAVE_EVP_MAC=y 00:06:44.854 15:35:42 -- common/build_config.sh@54 -- # CONFIG_URING_ZNS=n 00:06:44.854 15:35:42 -- common/build_config.sh@55 -- # CONFIG_WERROR=y 00:06:44.854 15:35:42 -- common/build_config.sh@56 -- # CONFIG_HAVE_LIBBSD=n 00:06:44.854 15:35:42 -- common/build_config.sh@57 -- # CONFIG_UBSAN=y 00:06:44.854 15:35:42 -- common/build_config.sh@58 -- # CONFIG_IPSEC_MB_DIR= 00:06:44.854 15:35:42 -- common/build_config.sh@59 -- # CONFIG_GOLANG=n 00:06:44.854 15:35:42 -- common/build_config.sh@60 -- # CONFIG_ISAL=y 00:06:44.854 15:35:42 -- common/build_config.sh@61 -- # CONFIG_IDXD_KERNEL=n 00:06:44.854 15:35:42 -- common/build_config.sh@62 -- # CONFIG_DPDK_LIB_DIR= 00:06:44.854 15:35:42 -- common/build_config.sh@63 -- # CONFIG_RDMA_PROV=verbs 00:06:44.854 15:35:42 -- common/build_config.sh@64 -- # CONFIG_APPS=y 00:06:44.854 15:35:42 -- common/build_config.sh@65 -- # CONFIG_SHARED=y 00:06:44.854 15:35:42 -- common/build_config.sh@66 -- # CONFIG_HAVE_KEYUTILS=n 00:06:44.854 15:35:42 -- common/build_config.sh@67 -- # CONFIG_FC_PATH= 00:06:44.855 15:35:42 -- common/build_config.sh@68 -- # CONFIG_DPDK_PKG_CONFIG=n 00:06:44.855 15:35:42 -- common/build_config.sh@69 -- # CONFIG_FC=n 00:06:44.855 15:35:42 -- common/build_config.sh@70 -- # CONFIG_AVAHI=n 00:06:44.855 15:35:42 -- common/build_config.sh@71 -- # CONFIG_FIO_PLUGIN=y 00:06:44.855 15:35:42 -- common/build_config.sh@72 -- # CONFIG_RAID5F=n 00:06:44.855 15:35:42 -- common/build_config.sh@73 -- # CONFIG_EXAMPLES=y 00:06:44.855 15:35:42 -- common/build_config.sh@74 -- # CONFIG_TESTS=y 00:06:44.855 15:35:42 -- common/build_config.sh@75 -- # CONFIG_CRYPTO_MLX5=n 00:06:44.855 15:35:42 -- common/build_config.sh@76 -- # CONFIG_MAX_LCORES= 00:06:44.855 15:35:42 -- common/build_config.sh@77 -- # CONFIG_IPSEC_MB=n 00:06:44.855 15:35:42 -- common/build_config.sh@78 -- # CONFIG_PGO_DIR= 00:06:44.855 15:35:42 -- common/build_config.sh@79 -- # CONFIG_DEBUG=y 00:06:44.855 15:35:42 -- common/build_config.sh@80 -- # CONFIG_DPDK_COMPRESSDEV=n 00:06:44.855 15:35:42 -- common/build_config.sh@81 -- # CONFIG_CROSS_PREFIX= 00:06:44.855 15:35:42 -- common/build_config.sh@82 -- # CONFIG_URING=n 00:06:44.855 15:35:42 -- common/autotest_common.sh@53 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/applications.sh 00:06:44.855 15:35:42 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/applications.sh 00:06:44.855 15:35:42 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common 00:06:44.855 15:35:42 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common 00:06:44.855 15:35:42 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:06:44.855 15:35:42 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:06:44.855 15:35:42 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app 00:06:44.855 15:35:42 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:06:44.855 15:35:42 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:06:44.855 15:35:42 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:06:44.855 15:35:42 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:06:44.855 15:35:42 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:06:44.855 15:35:42 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:06:44.855 15:35:42 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:06:44.855 15:35:42 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/config.h ]] 00:06:44.855 15:35:42 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:06:44.855 #define SPDK_CONFIG_H 00:06:44.855 #define SPDK_CONFIG_APPS 1 00:06:44.855 #define SPDK_CONFIG_ARCH native 00:06:44.855 #undef SPDK_CONFIG_ASAN 00:06:44.855 #undef SPDK_CONFIG_AVAHI 00:06:44.855 #undef SPDK_CONFIG_CET 00:06:44.855 #define SPDK_CONFIG_COVERAGE 1 00:06:44.855 #define SPDK_CONFIG_CROSS_PREFIX 00:06:44.855 #undef SPDK_CONFIG_CRYPTO 00:06:44.855 #undef SPDK_CONFIG_CRYPTO_MLX5 00:06:44.855 #undef SPDK_CONFIG_CUSTOMOCF 00:06:44.855 #undef SPDK_CONFIG_DAOS 00:06:44.855 #define SPDK_CONFIG_DAOS_DIR 00:06:44.855 #define SPDK_CONFIG_DEBUG 1 00:06:44.855 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:06:44.855 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:06:44.855 #define SPDK_CONFIG_DPDK_INC_DIR 00:06:44.855 #define SPDK_CONFIG_DPDK_LIB_DIR 00:06:44.855 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:06:44.855 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk 00:06:44.855 #define SPDK_CONFIG_EXAMPLES 1 00:06:44.855 #undef SPDK_CONFIG_FC 00:06:44.855 #define SPDK_CONFIG_FC_PATH 00:06:44.855 #define SPDK_CONFIG_FIO_PLUGIN 1 00:06:44.855 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:06:44.855 #undef SPDK_CONFIG_FUSE 00:06:44.855 #undef SPDK_CONFIG_FUZZER 00:06:44.855 #define SPDK_CONFIG_FUZZER_LIB 00:06:44.855 #undef SPDK_CONFIG_GOLANG 00:06:44.855 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:06:44.855 #define SPDK_CONFIG_HAVE_EVP_MAC 1 00:06:44.855 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:06:44.855 #undef SPDK_CONFIG_HAVE_KEYUTILS 00:06:44.855 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:06:44.855 #undef SPDK_CONFIG_HAVE_LIBBSD 00:06:44.855 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:06:44.855 #define SPDK_CONFIG_IDXD 1 00:06:44.855 #undef SPDK_CONFIG_IDXD_KERNEL 00:06:44.855 #undef SPDK_CONFIG_IPSEC_MB 00:06:44.855 #define SPDK_CONFIG_IPSEC_MB_DIR 00:06:44.855 #define SPDK_CONFIG_ISAL 1 00:06:44.855 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:06:44.855 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:06:44.855 #define SPDK_CONFIG_LIBDIR 00:06:44.855 #undef SPDK_CONFIG_LTO 00:06:44.855 #define SPDK_CONFIG_MAX_LCORES 00:06:44.855 #define SPDK_CONFIG_NVME_CUSE 1 00:06:44.855 #undef SPDK_CONFIG_OCF 00:06:44.855 #define SPDK_CONFIG_OCF_PATH 00:06:44.855 #define SPDK_CONFIG_OPENSSL_PATH 00:06:44.855 #undef SPDK_CONFIG_PGO_CAPTURE 00:06:44.855 #define SPDK_CONFIG_PGO_DIR 00:06:44.855 #undef SPDK_CONFIG_PGO_USE 00:06:44.855 #define SPDK_CONFIG_PREFIX /usr/local 00:06:44.855 #undef SPDK_CONFIG_RAID5F 00:06:44.855 #undef SPDK_CONFIG_RBD 00:06:44.855 #define SPDK_CONFIG_RDMA 1 00:06:44.855 #define SPDK_CONFIG_RDMA_PROV verbs 00:06:44.855 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:06:44.855 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:06:44.855 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:06:44.855 #define SPDK_CONFIG_SHARED 1 00:06:44.855 #undef SPDK_CONFIG_SMA 00:06:44.855 #define SPDK_CONFIG_TESTS 1 00:06:44.855 #undef SPDK_CONFIG_TSAN 00:06:44.855 #define SPDK_CONFIG_UBLK 1 00:06:44.855 #define SPDK_CONFIG_UBSAN 1 00:06:44.855 #undef SPDK_CONFIG_UNIT_TESTS 00:06:44.855 #undef SPDK_CONFIG_URING 00:06:44.855 #define SPDK_CONFIG_URING_PATH 00:06:44.855 #undef SPDK_CONFIG_URING_ZNS 00:06:44.855 #undef SPDK_CONFIG_USDT 00:06:44.855 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:06:44.855 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:06:44.855 #undef SPDK_CONFIG_VFIO_USER 00:06:44.855 #define SPDK_CONFIG_VFIO_USER_DIR 00:06:44.855 #define SPDK_CONFIG_VHOST 1 00:06:44.855 #define SPDK_CONFIG_VIRTIO 1 00:06:44.855 #undef SPDK_CONFIG_VTUNE 00:06:44.855 #define SPDK_CONFIG_VTUNE_DIR 00:06:44.855 #define SPDK_CONFIG_WERROR 1 00:06:44.855 #define SPDK_CONFIG_WPDK_DIR 00:06:44.855 #undef SPDK_CONFIG_XNVME 00:06:44.855 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:06:44.855 15:35:42 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:06:44.855 15:35:42 -- common/autotest_common.sh@54 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:06:44.855 15:35:42 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:44.855 15:35:42 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:44.855 15:35:42 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:44.855 15:35:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:44.855 15:35:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:44.855 15:35:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:44.855 15:35:42 -- paths/export.sh@5 -- # export PATH 00:06:44.855 15:35:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:44.855 15:35:42 -- common/autotest_common.sh@55 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/common 00:06:44.855 15:35:42 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/common 00:06:44.855 15:35:42 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm 00:06:44.855 15:35:42 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm 00:06:44.855 15:35:42 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/../../../ 00:06:44.855 15:35:42 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:06:44.855 15:35:42 -- pm/common@67 -- # TEST_TAG=N/A 00:06:44.855 15:35:42 -- pm/common@68 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/.run_test_name 00:06:44.855 15:35:42 -- pm/common@70 -- # PM_OUTPUTDIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power 00:06:44.855 15:35:42 -- pm/common@71 -- # uname -s 00:06:44.855 15:35:42 -- pm/common@71 -- # PM_OS=Linux 00:06:44.855 15:35:42 -- pm/common@73 -- # MONITOR_RESOURCES=(collect-cpu-load collect-vmstat) 00:06:44.855 15:35:42 -- pm/common@74 -- # [[ Linux == FreeBSD ]] 00:06:44.855 15:35:42 -- pm/common@76 -- # [[ Linux == Linux ]] 00:06:44.855 15:35:42 -- pm/common@76 -- # [[ ............................... != QEMU ]] 00:06:44.855 15:35:42 -- pm/common@76 -- # [[ ! -e /.dockerenv ]] 00:06:44.855 15:35:42 -- pm/common@79 -- # MONITOR_RESOURCES+=(collect-cpu-temp) 00:06:44.855 15:35:42 -- pm/common@80 -- # MONITOR_RESOURCES+=(collect-bmc-pm) 00:06:44.855 15:35:42 -- pm/common@83 -- # MONITOR_RESOURCES_PIDS=() 00:06:44.855 15:35:42 -- pm/common@83 -- # declare -A MONITOR_RESOURCES_PIDS 00:06:44.855 15:35:42 -- pm/common@85 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power 00:06:44.855 15:35:42 -- common/autotest_common.sh@57 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@58 -- # export RUN_NIGHTLY 00:06:44.855 15:35:42 -- common/autotest_common.sh@61 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@62 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:06:44.855 15:35:42 -- common/autotest_common.sh@63 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@64 -- # export SPDK_RUN_VALGRIND 00:06:44.855 15:35:42 -- common/autotest_common.sh@65 -- # : 1 00:06:44.855 15:35:42 -- common/autotest_common.sh@66 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:06:44.855 15:35:42 -- common/autotest_common.sh@67 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@68 -- # export SPDK_TEST_UNITTEST 00:06:44.855 15:35:42 -- common/autotest_common.sh@69 -- # : 00:06:44.855 15:35:42 -- common/autotest_common.sh@70 -- # export SPDK_TEST_AUTOBUILD 00:06:44.855 15:35:42 -- common/autotest_common.sh@71 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@72 -- # export SPDK_TEST_RELEASE_BUILD 00:06:44.855 15:35:42 -- common/autotest_common.sh@73 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@74 -- # export SPDK_TEST_ISAL 00:06:44.855 15:35:42 -- common/autotest_common.sh@75 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@76 -- # export SPDK_TEST_ISCSI 00:06:44.855 15:35:42 -- common/autotest_common.sh@77 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@78 -- # export SPDK_TEST_ISCSI_INITIATOR 00:06:44.855 15:35:42 -- common/autotest_common.sh@79 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@80 -- # export SPDK_TEST_NVME 00:06:44.855 15:35:42 -- common/autotest_common.sh@81 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@82 -- # export SPDK_TEST_NVME_PMR 00:06:44.855 15:35:42 -- common/autotest_common.sh@83 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@84 -- # export SPDK_TEST_NVME_BP 00:06:44.855 15:35:42 -- common/autotest_common.sh@85 -- # : 1 00:06:44.855 15:35:42 -- common/autotest_common.sh@86 -- # export SPDK_TEST_NVME_CLI 00:06:44.855 15:35:42 -- common/autotest_common.sh@87 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@88 -- # export SPDK_TEST_NVME_CUSE 00:06:44.855 15:35:42 -- common/autotest_common.sh@89 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@90 -- # export SPDK_TEST_NVME_FDP 00:06:44.855 15:35:42 -- common/autotest_common.sh@91 -- # : 1 00:06:44.855 15:35:42 -- common/autotest_common.sh@92 -- # export SPDK_TEST_NVMF 00:06:44.855 15:35:42 -- common/autotest_common.sh@93 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@94 -- # export SPDK_TEST_VFIOUSER 00:06:44.855 15:35:42 -- common/autotest_common.sh@95 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@96 -- # export SPDK_TEST_VFIOUSER_QEMU 00:06:44.855 15:35:42 -- common/autotest_common.sh@97 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@98 -- # export SPDK_TEST_FUZZER 00:06:44.855 15:35:42 -- common/autotest_common.sh@99 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@100 -- # export SPDK_TEST_FUZZER_SHORT 00:06:44.855 15:35:42 -- common/autotest_common.sh@101 -- # : rdma 00:06:44.855 15:35:42 -- common/autotest_common.sh@102 -- # export SPDK_TEST_NVMF_TRANSPORT 00:06:44.855 15:35:42 -- common/autotest_common.sh@103 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@104 -- # export SPDK_TEST_RBD 00:06:44.855 15:35:42 -- common/autotest_common.sh@105 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@106 -- # export SPDK_TEST_VHOST 00:06:44.855 15:35:42 -- common/autotest_common.sh@107 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@108 -- # export SPDK_TEST_BLOCKDEV 00:06:44.855 15:35:42 -- common/autotest_common.sh@109 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@110 -- # export SPDK_TEST_IOAT 00:06:44.855 15:35:42 -- common/autotest_common.sh@111 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@112 -- # export SPDK_TEST_BLOBFS 00:06:44.855 15:35:42 -- common/autotest_common.sh@113 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@114 -- # export SPDK_TEST_VHOST_INIT 00:06:44.855 15:35:42 -- common/autotest_common.sh@115 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@116 -- # export SPDK_TEST_LVOL 00:06:44.855 15:35:42 -- common/autotest_common.sh@117 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@118 -- # export SPDK_TEST_VBDEV_COMPRESS 00:06:44.855 15:35:42 -- common/autotest_common.sh@119 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@120 -- # export SPDK_RUN_ASAN 00:06:44.855 15:35:42 -- common/autotest_common.sh@121 -- # : 1 00:06:44.855 15:35:42 -- common/autotest_common.sh@122 -- # export SPDK_RUN_UBSAN 00:06:44.855 15:35:42 -- common/autotest_common.sh@123 -- # : 00:06:44.855 15:35:42 -- common/autotest_common.sh@124 -- # export SPDK_RUN_EXTERNAL_DPDK 00:06:44.855 15:35:42 -- common/autotest_common.sh@125 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@126 -- # export SPDK_RUN_NON_ROOT 00:06:44.855 15:35:42 -- common/autotest_common.sh@127 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@128 -- # export SPDK_TEST_CRYPTO 00:06:44.855 15:35:42 -- common/autotest_common.sh@129 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@130 -- # export SPDK_TEST_FTL 00:06:44.855 15:35:42 -- common/autotest_common.sh@131 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@132 -- # export SPDK_TEST_OCF 00:06:44.855 15:35:42 -- common/autotest_common.sh@133 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@134 -- # export SPDK_TEST_VMD 00:06:44.855 15:35:42 -- common/autotest_common.sh@135 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@136 -- # export SPDK_TEST_OPAL 00:06:44.855 15:35:42 -- common/autotest_common.sh@137 -- # : 00:06:44.855 15:35:42 -- common/autotest_common.sh@138 -- # export SPDK_TEST_NATIVE_DPDK 00:06:44.855 15:35:42 -- common/autotest_common.sh@139 -- # : true 00:06:44.855 15:35:42 -- common/autotest_common.sh@140 -- # export SPDK_AUTOTEST_X 00:06:44.855 15:35:42 -- common/autotest_common.sh@141 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@142 -- # export SPDK_TEST_RAID5 00:06:44.855 15:35:42 -- common/autotest_common.sh@143 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@144 -- # export SPDK_TEST_URING 00:06:44.855 15:35:42 -- common/autotest_common.sh@145 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@146 -- # export SPDK_TEST_USDT 00:06:44.855 15:35:42 -- common/autotest_common.sh@147 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@148 -- # export SPDK_TEST_USE_IGB_UIO 00:06:44.855 15:35:42 -- common/autotest_common.sh@149 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@150 -- # export SPDK_TEST_SCHEDULER 00:06:44.855 15:35:42 -- common/autotest_common.sh@151 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@152 -- # export SPDK_TEST_SCANBUILD 00:06:44.855 15:35:42 -- common/autotest_common.sh@153 -- # : mlx5 00:06:44.855 15:35:42 -- common/autotest_common.sh@154 -- # export SPDK_TEST_NVMF_NICS 00:06:44.855 15:35:42 -- common/autotest_common.sh@155 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@156 -- # export SPDK_TEST_SMA 00:06:44.855 15:35:42 -- common/autotest_common.sh@157 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@158 -- # export SPDK_TEST_DAOS 00:06:44.855 15:35:42 -- common/autotest_common.sh@159 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@160 -- # export SPDK_TEST_XNVME 00:06:44.855 15:35:42 -- common/autotest_common.sh@161 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@162 -- # export SPDK_TEST_ACCEL_DSA 00:06:44.855 15:35:42 -- common/autotest_common.sh@163 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@164 -- # export SPDK_TEST_ACCEL_IAA 00:06:44.855 15:35:42 -- common/autotest_common.sh@166 -- # : 00:06:44.855 15:35:42 -- common/autotest_common.sh@167 -- # export SPDK_TEST_FUZZER_TARGET 00:06:44.855 15:35:42 -- common/autotest_common.sh@168 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@169 -- # export SPDK_TEST_NVMF_MDNS 00:06:44.855 15:35:42 -- common/autotest_common.sh@170 -- # : 0 00:06:44.855 15:35:42 -- common/autotest_common.sh@171 -- # export SPDK_JSONRPC_GO_CLIENT 00:06:44.855 15:35:42 -- common/autotest_common.sh@174 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib 00:06:44.855 15:35:42 -- common/autotest_common.sh@174 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib 00:06:44.855 15:35:42 -- common/autotest_common.sh@175 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib 00:06:44.855 15:35:42 -- common/autotest_common.sh@175 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib 00:06:44.855 15:35:42 -- common/autotest_common.sh@176 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:44.855 15:35:42 -- common/autotest_common.sh@176 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:44.855 15:35:42 -- common/autotest_common.sh@177 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:44.855 15:35:42 -- common/autotest_common.sh@177 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:44.855 15:35:42 -- common/autotest_common.sh@180 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:06:44.855 15:35:42 -- common/autotest_common.sh@180 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:06:44.856 15:35:42 -- common/autotest_common.sh@184 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python 00:06:44.856 15:35:42 -- common/autotest_common.sh@184 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python 00:06:44.856 15:35:42 -- common/autotest_common.sh@188 -- # export PYTHONDONTWRITEBYTECODE=1 00:06:44.856 15:35:42 -- common/autotest_common.sh@188 -- # PYTHONDONTWRITEBYTECODE=1 00:06:44.856 15:35:42 -- common/autotest_common.sh@192 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:44.856 15:35:42 -- common/autotest_common.sh@192 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:44.856 15:35:42 -- common/autotest_common.sh@193 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:44.856 15:35:42 -- common/autotest_common.sh@193 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:44.856 15:35:42 -- common/autotest_common.sh@197 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:06:44.856 15:35:42 -- common/autotest_common.sh@198 -- # rm -rf /var/tmp/asan_suppression_file 00:06:44.856 15:35:42 -- common/autotest_common.sh@199 -- # cat 00:06:44.856 15:35:42 -- common/autotest_common.sh@225 -- # echo leak:libfuse3.so 00:06:44.856 15:35:42 -- common/autotest_common.sh@227 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:44.856 15:35:42 -- common/autotest_common.sh@227 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:44.856 15:35:42 -- common/autotest_common.sh@229 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:44.856 15:35:42 -- common/autotest_common.sh@229 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:44.856 15:35:42 -- common/autotest_common.sh@231 -- # '[' -z /var/spdk/dependencies ']' 00:06:44.856 15:35:42 -- common/autotest_common.sh@234 -- # export DEPENDENCY_DIR 00:06:44.856 15:35:42 -- common/autotest_common.sh@238 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:06:44.856 15:35:42 -- common/autotest_common.sh@238 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:06:44.856 15:35:42 -- common/autotest_common.sh@239 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:06:44.856 15:35:42 -- common/autotest_common.sh@239 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:06:44.856 15:35:42 -- common/autotest_common.sh@242 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:44.856 15:35:42 -- common/autotest_common.sh@242 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:44.856 15:35:42 -- common/autotest_common.sh@243 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:44.856 15:35:42 -- common/autotest_common.sh@243 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:44.856 15:35:42 -- common/autotest_common.sh@245 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:44.856 15:35:42 -- common/autotest_common.sh@245 -- # AR_TOOL=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:44.856 15:35:42 -- common/autotest_common.sh@248 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:44.856 15:35:42 -- common/autotest_common.sh@248 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:44.856 15:35:42 -- common/autotest_common.sh@251 -- # '[' 0 -eq 0 ']' 00:06:44.856 15:35:42 -- common/autotest_common.sh@252 -- # export valgrind= 00:06:44.856 15:35:42 -- common/autotest_common.sh@252 -- # valgrind= 00:06:44.856 15:35:42 -- common/autotest_common.sh@258 -- # uname -s 00:06:44.856 15:35:42 -- common/autotest_common.sh@258 -- # '[' Linux = Linux ']' 00:06:44.856 15:35:42 -- common/autotest_common.sh@259 -- # HUGEMEM=4096 00:06:44.856 15:35:42 -- common/autotest_common.sh@260 -- # export CLEAR_HUGE=yes 00:06:44.856 15:35:42 -- common/autotest_common.sh@260 -- # CLEAR_HUGE=yes 00:06:44.856 15:35:42 -- common/autotest_common.sh@261 -- # [[ 0 -eq 1 ]] 00:06:44.856 15:35:42 -- common/autotest_common.sh@261 -- # [[ 0 -eq 1 ]] 00:06:44.856 15:35:42 -- common/autotest_common.sh@268 -- # MAKE=make 00:06:44.856 15:35:42 -- common/autotest_common.sh@269 -- # MAKEFLAGS=-j96 00:06:44.856 15:35:42 -- common/autotest_common.sh@285 -- # export HUGEMEM=4096 00:06:44.856 15:35:42 -- common/autotest_common.sh@285 -- # HUGEMEM=4096 00:06:44.856 15:35:42 -- common/autotest_common.sh@287 -- # NO_HUGE=() 00:06:44.856 15:35:42 -- common/autotest_common.sh@288 -- # TEST_MODE= 00:06:44.856 15:35:42 -- common/autotest_common.sh@289 -- # for i in "$@" 00:06:44.856 15:35:42 -- common/autotest_common.sh@290 -- # case "$i" in 00:06:44.856 15:35:42 -- common/autotest_common.sh@295 -- # TEST_TRANSPORT=rdma 00:06:44.856 15:35:42 -- common/autotest_common.sh@307 -- # [[ -z 3185337 ]] 00:06:44.856 15:35:42 -- common/autotest_common.sh@307 -- # kill -0 3185337 00:06:44.856 15:35:42 -- common/autotest_common.sh@1666 -- # set_test_storage 2147483648 00:06:44.856 15:35:42 -- common/autotest_common.sh@317 -- # [[ -v testdir ]] 00:06:44.856 15:35:42 -- common/autotest_common.sh@319 -- # local requested_size=2147483648 00:06:44.856 15:35:42 -- common/autotest_common.sh@320 -- # local mount target_dir 00:06:44.856 15:35:42 -- common/autotest_common.sh@322 -- # local -A mounts fss sizes avails uses 00:06:44.856 15:35:42 -- common/autotest_common.sh@323 -- # local source fs size avail mount use 00:06:44.856 15:35:42 -- common/autotest_common.sh@325 -- # local storage_fallback storage_candidates 00:06:44.856 15:35:42 -- common/autotest_common.sh@327 -- # mktemp -udt spdk.XXXXXX 00:06:44.856 15:35:42 -- common/autotest_common.sh@327 -- # storage_fallback=/tmp/spdk.AFerYH 00:06:44.856 15:35:42 -- common/autotest_common.sh@332 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:06:44.856 15:35:42 -- common/autotest_common.sh@334 -- # [[ -n '' ]] 00:06:44.856 15:35:42 -- common/autotest_common.sh@339 -- # [[ -n '' ]] 00:06:44.856 15:35:42 -- common/autotest_common.sh@344 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target /tmp/spdk.AFerYH/tests/target /tmp/spdk.AFerYH 00:06:44.856 15:35:42 -- common/autotest_common.sh@347 -- # requested_size=2214592512 00:06:44.856 15:35:42 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:06:44.856 15:35:42 -- common/autotest_common.sh@316 -- # df -T 00:06:44.856 15:35:42 -- common/autotest_common.sh@316 -- # grep -v Filesystem 00:06:44.856 15:35:42 -- common/autotest_common.sh@350 -- # mounts["$mount"]=spdk_devtmpfs 00:06:44.856 15:35:42 -- common/autotest_common.sh@350 -- # fss["$mount"]=devtmpfs 00:06:44.856 15:35:42 -- common/autotest_common.sh@351 -- # avails["$mount"]=67108864 00:06:44.856 15:35:42 -- common/autotest_common.sh@351 -- # sizes["$mount"]=67108864 00:06:44.856 15:35:42 -- common/autotest_common.sh@352 -- # uses["$mount"]=0 00:06:44.856 15:35:42 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:06:44.856 15:35:42 -- common/autotest_common.sh@350 -- # mounts["$mount"]=/dev/pmem0 00:06:44.856 15:35:42 -- common/autotest_common.sh@350 -- # fss["$mount"]=ext2 00:06:44.856 15:35:42 -- common/autotest_common.sh@351 -- # avails["$mount"]=1052192768 00:06:44.856 15:35:42 -- common/autotest_common.sh@351 -- # sizes["$mount"]=5284429824 00:06:44.856 15:35:42 -- common/autotest_common.sh@352 -- # uses["$mount"]=4232237056 00:06:44.856 15:35:42 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:06:44.856 15:35:42 -- common/autotest_common.sh@350 -- # mounts["$mount"]=spdk_root 00:06:44.856 15:35:42 -- common/autotest_common.sh@350 -- # fss["$mount"]=overlay 00:06:44.856 15:35:42 -- common/autotest_common.sh@351 -- # avails["$mount"]=185088647168 00:06:44.856 15:35:42 -- common/autotest_common.sh@351 -- # sizes["$mount"]=195974307840 00:06:44.856 15:35:42 -- common/autotest_common.sh@352 -- # uses["$mount"]=10885660672 00:06:44.856 15:35:42 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:06:44.856 15:35:42 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:06:44.856 15:35:42 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:06:44.856 15:35:42 -- common/autotest_common.sh@351 -- # avails["$mount"]=97886588928 00:06:44.856 15:35:42 -- common/autotest_common.sh@351 -- # sizes["$mount"]=97987153920 00:06:44.856 15:35:42 -- common/autotest_common.sh@352 -- # uses["$mount"]=100564992 00:06:44.856 15:35:42 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:06:44.856 15:35:42 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:06:44.856 15:35:42 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:06:44.856 15:35:42 -- common/autotest_common.sh@351 -- # avails["$mount"]=39185473536 00:06:44.856 15:35:42 -- common/autotest_common.sh@351 -- # sizes["$mount"]=39194861568 00:06:44.856 15:35:42 -- common/autotest_common.sh@352 -- # uses["$mount"]=9388032 00:06:44.856 15:35:42 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:06:44.856 15:35:42 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:06:44.856 15:35:42 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:06:44.856 15:35:42 -- common/autotest_common.sh@351 -- # avails["$mount"]=97986490368 00:06:44.856 15:35:42 -- common/autotest_common.sh@351 -- # sizes["$mount"]=97987153920 00:06:44.856 15:35:42 -- common/autotest_common.sh@352 -- # uses["$mount"]=663552 00:06:44.856 15:35:42 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:06:44.856 15:35:42 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:06:44.856 15:35:42 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:06:44.856 15:35:42 -- common/autotest_common.sh@351 -- # avails["$mount"]=19597426688 00:06:44.856 15:35:42 -- common/autotest_common.sh@351 -- # sizes["$mount"]=19597430784 00:06:44.856 15:35:42 -- common/autotest_common.sh@352 -- # uses["$mount"]=4096 00:06:44.856 15:35:42 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:06:44.856 15:35:42 -- common/autotest_common.sh@355 -- # printf '* Looking for test storage...\n' 00:06:44.856 * Looking for test storage... 00:06:44.856 15:35:42 -- common/autotest_common.sh@357 -- # local target_space new_size 00:06:44.856 15:35:42 -- common/autotest_common.sh@358 -- # for target_dir in "${storage_candidates[@]}" 00:06:44.856 15:35:42 -- common/autotest_common.sh@361 -- # df /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:06:44.856 15:35:42 -- common/autotest_common.sh@361 -- # awk '$1 !~ /Filesystem/{print $6}' 00:06:44.856 15:35:42 -- common/autotest_common.sh@361 -- # mount=/ 00:06:44.856 15:35:42 -- common/autotest_common.sh@363 -- # target_space=185088647168 00:06:44.856 15:35:42 -- common/autotest_common.sh@364 -- # (( target_space == 0 || target_space < requested_size )) 00:06:44.856 15:35:42 -- common/autotest_common.sh@367 -- # (( target_space >= requested_size )) 00:06:44.856 15:35:42 -- common/autotest_common.sh@369 -- # [[ overlay == tmpfs ]] 00:06:44.856 15:35:42 -- common/autotest_common.sh@369 -- # [[ overlay == ramfs ]] 00:06:44.856 15:35:42 -- common/autotest_common.sh@369 -- # [[ / == / ]] 00:06:44.856 15:35:42 -- common/autotest_common.sh@370 -- # new_size=13100253184 00:06:44.856 15:35:42 -- common/autotest_common.sh@371 -- # (( new_size * 100 / sizes[/] > 95 )) 00:06:44.856 15:35:42 -- common/autotest_common.sh@376 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:06:44.856 15:35:42 -- common/autotest_common.sh@376 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:06:44.856 15:35:42 -- common/autotest_common.sh@377 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:06:44.856 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:06:44.856 15:35:42 -- common/autotest_common.sh@378 -- # return 0 00:06:44.856 15:35:42 -- common/autotest_common.sh@1668 -- # set -o errtrace 00:06:44.856 15:35:42 -- common/autotest_common.sh@1669 -- # shopt -s extdebug 00:06:44.856 15:35:42 -- common/autotest_common.sh@1670 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:06:44.856 15:35:42 -- common/autotest_common.sh@1672 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:06:44.856 15:35:42 -- common/autotest_common.sh@1673 -- # true 00:06:44.856 15:35:42 -- common/autotest_common.sh@1675 -- # xtrace_fd 00:06:44.856 15:35:42 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:06:44.856 15:35:42 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:06:44.856 15:35:42 -- common/autotest_common.sh@27 -- # exec 00:06:44.856 15:35:42 -- common/autotest_common.sh@29 -- # exec 00:06:44.856 15:35:42 -- common/autotest_common.sh@31 -- # xtrace_restore 00:06:44.856 15:35:42 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:06:44.856 15:35:42 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:06:44.856 15:35:42 -- common/autotest_common.sh@18 -- # set -x 00:06:44.856 15:35:42 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:06:44.856 15:35:42 -- nvmf/common.sh@7 -- # uname -s 00:06:44.856 15:35:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:44.856 15:35:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:44.856 15:35:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:44.856 15:35:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:44.856 15:35:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:44.856 15:35:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:44.856 15:35:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:44.856 15:35:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:44.856 15:35:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:44.856 15:35:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:44.856 15:35:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:06:44.856 15:35:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:06:44.856 15:35:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:44.856 15:35:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:44.856 15:35:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:44.856 15:35:42 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:06:44.856 15:35:42 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:06:44.856 15:35:42 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:44.856 15:35:42 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:44.856 15:35:42 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:44.856 15:35:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:44.856 15:35:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:44.856 15:35:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:44.856 15:35:42 -- paths/export.sh@5 -- # export PATH 00:06:44.856 15:35:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:44.856 15:35:42 -- nvmf/common.sh@47 -- # : 0 00:06:44.856 15:35:42 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:06:44.856 15:35:42 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:06:44.856 15:35:42 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:06:44.856 15:35:42 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:44.856 15:35:42 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:44.856 15:35:42 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:06:44.856 15:35:42 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:06:44.856 15:35:42 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:06:44.856 15:35:42 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:06:44.856 15:35:42 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:06:44.856 15:35:42 -- target/filesystem.sh@15 -- # nvmftestinit 00:06:44.856 15:35:42 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:06:44.856 15:35:42 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:44.856 15:35:42 -- nvmf/common.sh@437 -- # prepare_net_devs 00:06:44.856 15:35:42 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:06:44.856 15:35:42 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:06:44.856 15:35:42 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:44.856 15:35:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:44.856 15:35:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:44.856 15:35:42 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:06:44.856 15:35:42 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:06:44.856 15:35:42 -- nvmf/common.sh@285 -- # xtrace_disable 00:06:44.856 15:35:42 -- common/autotest_common.sh@10 -- # set +x 00:06:50.159 15:35:48 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:50.159 15:35:48 -- nvmf/common.sh@291 -- # pci_devs=() 00:06:50.159 15:35:48 -- nvmf/common.sh@291 -- # local -a pci_devs 00:06:50.159 15:35:48 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:06:50.159 15:35:48 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:06:50.159 15:35:48 -- nvmf/common.sh@293 -- # pci_drivers=() 00:06:50.159 15:35:48 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:06:50.159 15:35:48 -- nvmf/common.sh@295 -- # net_devs=() 00:06:50.159 15:35:48 -- nvmf/common.sh@295 -- # local -ga net_devs 00:06:50.159 15:35:48 -- nvmf/common.sh@296 -- # e810=() 00:06:50.159 15:35:48 -- nvmf/common.sh@296 -- # local -ga e810 00:06:50.160 15:35:48 -- nvmf/common.sh@297 -- # x722=() 00:06:50.160 15:35:48 -- nvmf/common.sh@297 -- # local -ga x722 00:06:50.160 15:35:48 -- nvmf/common.sh@298 -- # mlx=() 00:06:50.160 15:35:48 -- nvmf/common.sh@298 -- # local -ga mlx 00:06:50.160 15:35:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:50.160 15:35:48 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:50.160 15:35:48 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:50.160 15:35:48 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:50.160 15:35:48 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:50.160 15:35:48 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:50.160 15:35:48 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:50.160 15:35:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:50.160 15:35:48 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:50.160 15:35:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:50.160 15:35:48 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:50.160 15:35:48 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:06:50.160 15:35:48 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:06:50.160 15:35:48 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:06:50.160 15:35:48 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:06:50.160 15:35:48 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:06:50.160 15:35:48 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:06:50.160 15:35:48 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:06:50.160 15:35:48 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:06:50.160 15:35:48 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:06:50.160 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:06:50.160 15:35:48 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:06:50.160 15:35:48 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:06:50.160 15:35:48 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:06:50.160 15:35:48 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:06:50.160 15:35:48 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:06:50.160 15:35:48 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:06:50.160 15:35:48 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:06:50.160 15:35:48 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:06:50.160 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:06:50.160 15:35:48 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:06:50.160 15:35:48 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:06:50.160 15:35:48 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:06:50.160 15:35:48 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:06:50.160 15:35:48 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:06:50.160 15:35:48 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:06:50.160 15:35:48 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:06:50.160 15:35:48 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:06:50.160 15:35:48 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:06:50.160 15:35:48 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:50.160 15:35:48 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:06:50.160 15:35:48 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:50.160 15:35:48 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:06:50.160 Found net devices under 0000:da:00.0: mlx_0_0 00:06:50.160 15:35:48 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:06:50.160 15:35:48 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:06:50.160 15:35:48 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:50.160 15:35:48 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:06:50.160 15:35:48 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:50.160 15:35:48 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:06:50.160 Found net devices under 0000:da:00.1: mlx_0_1 00:06:50.160 15:35:48 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:06:50.160 15:35:48 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:06:50.160 15:35:48 -- nvmf/common.sh@403 -- # is_hw=yes 00:06:50.160 15:35:48 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:06:50.160 15:35:48 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:06:50.160 15:35:48 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:06:50.160 15:35:48 -- nvmf/common.sh@409 -- # rdma_device_init 00:06:50.160 15:35:48 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:06:50.160 15:35:48 -- nvmf/common.sh@58 -- # uname 00:06:50.160 15:35:48 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:06:50.160 15:35:48 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:06:50.160 15:35:48 -- nvmf/common.sh@63 -- # modprobe ib_core 00:06:50.160 15:35:48 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:06:50.160 15:35:48 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:06:50.160 15:35:48 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:06:50.160 15:35:48 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:06:50.160 15:35:48 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:06:50.160 15:35:48 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:06:50.160 15:35:48 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:06:50.160 15:35:48 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:06:50.160 15:35:48 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:06:50.160 15:35:48 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:06:50.160 15:35:48 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:06:50.160 15:35:48 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:06:50.160 15:35:48 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:06:50.160 15:35:48 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:50.160 15:35:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:50.160 15:35:48 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:06:50.160 15:35:48 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:06:50.160 15:35:48 -- nvmf/common.sh@105 -- # continue 2 00:06:50.160 15:35:48 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:50.160 15:35:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:50.160 15:35:48 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:06:50.160 15:35:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:50.160 15:35:48 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:06:50.160 15:35:48 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:06:50.160 15:35:48 -- nvmf/common.sh@105 -- # continue 2 00:06:50.160 15:35:48 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:06:50.160 15:35:48 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:06:50.160 15:35:48 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:06:50.160 15:35:48 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:06:50.160 15:35:48 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:50.160 15:35:48 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:50.160 15:35:48 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:06:50.160 15:35:48 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:06:50.160 15:35:48 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:06:50.160 118: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:06:50.160 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:06:50.160 altname enp218s0f0np0 00:06:50.160 altname ens818f0np0 00:06:50.160 inet 192.168.100.8/24 scope global mlx_0_0 00:06:50.160 valid_lft forever preferred_lft forever 00:06:50.160 15:35:48 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:06:50.160 15:35:48 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:06:50.160 15:35:48 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:06:50.160 15:35:48 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:06:50.160 15:35:48 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:50.160 15:35:48 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:50.160 15:35:48 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:06:50.160 15:35:48 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:06:50.160 15:35:48 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:06:50.160 119: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:06:50.160 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:06:50.160 altname enp218s0f1np1 00:06:50.160 altname ens818f1np1 00:06:50.160 inet 192.168.100.9/24 scope global mlx_0_1 00:06:50.160 valid_lft forever preferred_lft forever 00:06:50.160 15:35:48 -- nvmf/common.sh@411 -- # return 0 00:06:50.160 15:35:48 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:06:50.160 15:35:48 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:06:50.160 15:35:48 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:06:50.160 15:35:48 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:06:50.160 15:35:48 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:06:50.160 15:35:48 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:06:50.160 15:35:48 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:06:50.160 15:35:48 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:06:50.160 15:35:48 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:06:50.160 15:35:48 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:06:50.160 15:35:48 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:50.160 15:35:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:50.160 15:35:48 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:06:50.160 15:35:48 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:06:50.160 15:35:48 -- nvmf/common.sh@105 -- # continue 2 00:06:50.160 15:35:48 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:50.160 15:35:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:50.160 15:35:48 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:06:50.160 15:35:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:50.160 15:35:48 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:06:50.160 15:35:48 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:06:50.160 15:35:48 -- nvmf/common.sh@105 -- # continue 2 00:06:50.160 15:35:48 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:06:50.160 15:35:48 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:06:50.160 15:35:48 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:06:50.160 15:35:48 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:06:50.160 15:35:48 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:50.160 15:35:48 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:50.160 15:35:48 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:06:50.160 15:35:48 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:06:50.160 15:35:48 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:06:50.160 15:35:48 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:06:50.160 15:35:48 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:50.160 15:35:48 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:50.161 15:35:48 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:06:50.161 192.168.100.9' 00:06:50.161 15:35:48 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:06:50.161 192.168.100.9' 00:06:50.161 15:35:48 -- nvmf/common.sh@446 -- # head -n 1 00:06:50.161 15:35:48 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:06:50.161 15:35:48 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:06:50.161 192.168.100.9' 00:06:50.161 15:35:48 -- nvmf/common.sh@447 -- # tail -n +2 00:06:50.161 15:35:48 -- nvmf/common.sh@447 -- # head -n 1 00:06:50.161 15:35:48 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:06:50.161 15:35:48 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:06:50.161 15:35:48 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:06:50.161 15:35:48 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:06:50.161 15:35:48 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:06:50.161 15:35:48 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:06:50.161 15:35:48 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:06:50.161 15:35:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:50.161 15:35:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:50.161 15:35:48 -- common/autotest_common.sh@10 -- # set +x 00:06:50.161 ************************************ 00:06:50.161 START TEST nvmf_filesystem_no_in_capsule 00:06:50.161 ************************************ 00:06:50.161 15:35:48 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_part 0 00:06:50.161 15:35:48 -- target/filesystem.sh@47 -- # in_capsule=0 00:06:50.161 15:35:48 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:06:50.161 15:35:48 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:06:50.161 15:35:48 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:50.161 15:35:48 -- common/autotest_common.sh@10 -- # set +x 00:06:50.161 15:35:48 -- nvmf/common.sh@470 -- # nvmfpid=3188463 00:06:50.161 15:35:48 -- nvmf/common.sh@471 -- # waitforlisten 3188463 00:06:50.161 15:35:48 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:50.161 15:35:48 -- common/autotest_common.sh@817 -- # '[' -z 3188463 ']' 00:06:50.161 15:35:48 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:50.161 15:35:48 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:50.161 15:35:48 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:50.161 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:50.161 15:35:48 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:50.161 15:35:48 -- common/autotest_common.sh@10 -- # set +x 00:06:50.161 [2024-04-26 15:35:48.587463] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:06:50.161 [2024-04-26 15:35:48.587508] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:50.161 EAL: No free 2048 kB hugepages reported on node 1 00:06:50.161 [2024-04-26 15:35:48.645133] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:50.161 [2024-04-26 15:35:48.720230] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:50.161 [2024-04-26 15:35:48.720271] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:50.161 [2024-04-26 15:35:48.720277] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:06:50.161 [2024-04-26 15:35:48.720283] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:06:50.161 [2024-04-26 15:35:48.720288] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:50.161 [2024-04-26 15:35:48.720343] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:50.161 [2024-04-26 15:35:48.720443] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:50.161 [2024-04-26 15:35:48.720535] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:50.161 [2024-04-26 15:35:48.720536] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:51.098 15:35:49 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:51.098 15:35:49 -- common/autotest_common.sh@850 -- # return 0 00:06:51.098 15:35:49 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:06:51.098 15:35:49 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:51.098 15:35:49 -- common/autotest_common.sh@10 -- # set +x 00:06:51.098 15:35:49 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:51.098 15:35:49 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:06:51.098 15:35:49 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -c 0 00:06:51.098 15:35:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:51.098 15:35:49 -- common/autotest_common.sh@10 -- # set +x 00:06:51.098 [2024-04-26 15:35:49.433010] rdma.c:2712:nvmf_rdma_create: *WARNING*: In capsule data size is set to 256, this is minimum size required to support msdbd=16 00:06:51.098 [2024-04-26 15:35:49.454341] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x19ab100/0x19af5f0) succeed. 00:06:51.098 [2024-04-26 15:35:49.464477] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x19ac740/0x19f0c80) succeed. 00:06:51.098 15:35:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:51.098 15:35:49 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:06:51.098 15:35:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:51.098 15:35:49 -- common/autotest_common.sh@10 -- # set +x 00:06:51.098 Malloc1 00:06:51.098 15:35:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:51.098 15:35:49 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:06:51.098 15:35:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:51.098 15:35:49 -- common/autotest_common.sh@10 -- # set +x 00:06:51.098 15:35:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:51.098 15:35:49 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:06:51.098 15:35:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:51.098 15:35:49 -- common/autotest_common.sh@10 -- # set +x 00:06:51.357 15:35:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:51.357 15:35:49 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:06:51.357 15:35:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:51.357 15:35:49 -- common/autotest_common.sh@10 -- # set +x 00:06:51.357 [2024-04-26 15:35:49.713191] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:06:51.357 15:35:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:51.357 15:35:49 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:06:51.357 15:35:49 -- common/autotest_common.sh@1364 -- # local bdev_name=Malloc1 00:06:51.357 15:35:49 -- common/autotest_common.sh@1365 -- # local bdev_info 00:06:51.357 15:35:49 -- common/autotest_common.sh@1366 -- # local bs 00:06:51.357 15:35:49 -- common/autotest_common.sh@1367 -- # local nb 00:06:51.357 15:35:49 -- common/autotest_common.sh@1368 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:06:51.357 15:35:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:51.357 15:35:49 -- common/autotest_common.sh@10 -- # set +x 00:06:51.357 15:35:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:51.357 15:35:49 -- common/autotest_common.sh@1368 -- # bdev_info='[ 00:06:51.357 { 00:06:51.357 "name": "Malloc1", 00:06:51.358 "aliases": [ 00:06:51.358 "e9eba3d0-b663-4446-a21f-0ab78e64aad7" 00:06:51.358 ], 00:06:51.358 "product_name": "Malloc disk", 00:06:51.358 "block_size": 512, 00:06:51.358 "num_blocks": 1048576, 00:06:51.358 "uuid": "e9eba3d0-b663-4446-a21f-0ab78e64aad7", 00:06:51.358 "assigned_rate_limits": { 00:06:51.358 "rw_ios_per_sec": 0, 00:06:51.358 "rw_mbytes_per_sec": 0, 00:06:51.358 "r_mbytes_per_sec": 0, 00:06:51.358 "w_mbytes_per_sec": 0 00:06:51.358 }, 00:06:51.358 "claimed": true, 00:06:51.358 "claim_type": "exclusive_write", 00:06:51.358 "zoned": false, 00:06:51.358 "supported_io_types": { 00:06:51.358 "read": true, 00:06:51.358 "write": true, 00:06:51.358 "unmap": true, 00:06:51.358 "write_zeroes": true, 00:06:51.358 "flush": true, 00:06:51.358 "reset": true, 00:06:51.358 "compare": false, 00:06:51.358 "compare_and_write": false, 00:06:51.358 "abort": true, 00:06:51.358 "nvme_admin": false, 00:06:51.358 "nvme_io": false 00:06:51.358 }, 00:06:51.358 "memory_domains": [ 00:06:51.358 { 00:06:51.358 "dma_device_id": "system", 00:06:51.358 "dma_device_type": 1 00:06:51.358 }, 00:06:51.358 { 00:06:51.358 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:51.358 "dma_device_type": 2 00:06:51.358 } 00:06:51.358 ], 00:06:51.358 "driver_specific": {} 00:06:51.358 } 00:06:51.358 ]' 00:06:51.358 15:35:49 -- common/autotest_common.sh@1369 -- # jq '.[] .block_size' 00:06:51.358 15:35:49 -- common/autotest_common.sh@1369 -- # bs=512 00:06:51.358 15:35:49 -- common/autotest_common.sh@1370 -- # jq '.[] .num_blocks' 00:06:51.358 15:35:49 -- common/autotest_common.sh@1370 -- # nb=1048576 00:06:51.358 15:35:49 -- common/autotest_common.sh@1373 -- # bdev_size=512 00:06:51.358 15:35:49 -- common/autotest_common.sh@1374 -- # echo 512 00:06:51.358 15:35:49 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:06:51.358 15:35:49 -- target/filesystem.sh@60 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:06:52.300 15:35:50 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:06:52.300 15:35:50 -- common/autotest_common.sh@1184 -- # local i=0 00:06:52.300 15:35:50 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:06:52.300 15:35:50 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:06:52.300 15:35:50 -- common/autotest_common.sh@1191 -- # sleep 2 00:06:54.830 15:35:52 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:06:54.830 15:35:52 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:06:54.830 15:35:52 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:06:54.830 15:35:52 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:06:54.830 15:35:52 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:06:54.830 15:35:52 -- common/autotest_common.sh@1194 -- # return 0 00:06:54.830 15:35:52 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:06:54.830 15:35:52 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:06:54.830 15:35:52 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:06:54.830 15:35:52 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:06:54.830 15:35:52 -- setup/common.sh@76 -- # local dev=nvme0n1 00:06:54.830 15:35:52 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:06:54.830 15:35:52 -- setup/common.sh@80 -- # echo 536870912 00:06:54.830 15:35:52 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:06:54.830 15:35:52 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:06:54.830 15:35:52 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:06:54.830 15:35:52 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:06:54.830 15:35:52 -- target/filesystem.sh@69 -- # partprobe 00:06:54.830 15:35:52 -- target/filesystem.sh@70 -- # sleep 1 00:06:55.397 15:35:53 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:06:55.397 15:35:53 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:06:55.397 15:35:53 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:55.397 15:35:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:55.397 15:35:53 -- common/autotest_common.sh@10 -- # set +x 00:06:55.656 ************************************ 00:06:55.656 START TEST filesystem_ext4 00:06:55.656 ************************************ 00:06:55.656 15:35:54 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create ext4 nvme0n1 00:06:55.656 15:35:54 -- target/filesystem.sh@18 -- # fstype=ext4 00:06:55.656 15:35:54 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:55.656 15:35:54 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:06:55.656 15:35:54 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:06:55.656 15:35:54 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:55.656 15:35:54 -- common/autotest_common.sh@914 -- # local i=0 00:06:55.656 15:35:54 -- common/autotest_common.sh@915 -- # local force 00:06:55.656 15:35:54 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:06:55.656 15:35:54 -- common/autotest_common.sh@918 -- # force=-F 00:06:55.656 15:35:54 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:06:55.656 mke2fs 1.46.5 (30-Dec-2021) 00:06:55.656 Discarding device blocks: 0/522240 done 00:06:55.656 Creating filesystem with 522240 1k blocks and 130560 inodes 00:06:55.656 Filesystem UUID: a57b2437-5867-424f-b444-a7f62d68ea86 00:06:55.656 Superblock backups stored on blocks: 00:06:55.656 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:06:55.656 00:06:55.656 Allocating group tables: 0/64 done 00:06:55.656 Writing inode tables: 0/64 done 00:06:55.656 Creating journal (8192 blocks): done 00:06:55.656 Writing superblocks and filesystem accounting information: 0/64 done 00:06:55.656 00:06:55.656 15:35:54 -- common/autotest_common.sh@931 -- # return 0 00:06:55.656 15:35:54 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:55.656 15:35:54 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:55.656 15:35:54 -- target/filesystem.sh@25 -- # sync 00:06:55.656 15:35:54 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:55.656 15:35:54 -- target/filesystem.sh@27 -- # sync 00:06:55.656 15:35:54 -- target/filesystem.sh@29 -- # i=0 00:06:55.656 15:35:54 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:55.656 15:35:54 -- target/filesystem.sh@37 -- # kill -0 3188463 00:06:55.656 15:35:54 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:55.656 15:35:54 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:55.914 15:35:54 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:55.914 15:35:54 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:55.914 00:06:55.914 real 0m0.164s 00:06:55.914 user 0m0.025s 00:06:55.914 sys 0m0.062s 00:06:55.914 15:35:54 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:55.914 15:35:54 -- common/autotest_common.sh@10 -- # set +x 00:06:55.914 ************************************ 00:06:55.914 END TEST filesystem_ext4 00:06:55.914 ************************************ 00:06:55.914 15:35:54 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:06:55.914 15:35:54 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:55.914 15:35:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:55.914 15:35:54 -- common/autotest_common.sh@10 -- # set +x 00:06:55.914 ************************************ 00:06:55.914 START TEST filesystem_btrfs 00:06:55.914 ************************************ 00:06:55.914 15:35:54 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create btrfs nvme0n1 00:06:55.914 15:35:54 -- target/filesystem.sh@18 -- # fstype=btrfs 00:06:55.914 15:35:54 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:55.914 15:35:54 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:06:55.914 15:35:54 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:06:55.914 15:35:54 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:55.914 15:35:54 -- common/autotest_common.sh@914 -- # local i=0 00:06:55.914 15:35:54 -- common/autotest_common.sh@915 -- # local force 00:06:55.914 15:35:54 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:06:55.914 15:35:54 -- common/autotest_common.sh@920 -- # force=-f 00:06:55.914 15:35:54 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:06:56.173 btrfs-progs v6.6.2 00:06:56.173 See https://btrfs.readthedocs.io for more information. 00:06:56.173 00:06:56.173 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:06:56.173 NOTE: several default settings have changed in version 5.15, please make sure 00:06:56.173 this does not affect your deployments: 00:06:56.173 - DUP for metadata (-m dup) 00:06:56.173 - enabled no-holes (-O no-holes) 00:06:56.173 - enabled free-space-tree (-R free-space-tree) 00:06:56.173 00:06:56.173 Label: (null) 00:06:56.173 UUID: 0379165f-996b-47b4-b766-29fa01de58de 00:06:56.173 Node size: 16384 00:06:56.173 Sector size: 4096 00:06:56.173 Filesystem size: 510.00MiB 00:06:56.173 Block group profiles: 00:06:56.173 Data: single 8.00MiB 00:06:56.173 Metadata: DUP 32.00MiB 00:06:56.173 System: DUP 8.00MiB 00:06:56.173 SSD detected: yes 00:06:56.173 Zoned device: no 00:06:56.173 Incompat features: extref, skinny-metadata, no-holes, free-space-tree 00:06:56.173 Runtime features: free-space-tree 00:06:56.173 Checksum: crc32c 00:06:56.173 Number of devices: 1 00:06:56.173 Devices: 00:06:56.173 ID SIZE PATH 00:06:56.173 1 510.00MiB /dev/nvme0n1p1 00:06:56.173 00:06:56.173 15:35:54 -- common/autotest_common.sh@931 -- # return 0 00:06:56.173 15:35:54 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:56.173 15:35:54 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:56.173 15:35:54 -- target/filesystem.sh@25 -- # sync 00:06:56.173 15:35:54 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:56.173 15:35:54 -- target/filesystem.sh@27 -- # sync 00:06:56.173 15:35:54 -- target/filesystem.sh@29 -- # i=0 00:06:56.173 15:35:54 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:56.173 15:35:54 -- target/filesystem.sh@37 -- # kill -0 3188463 00:06:56.173 15:35:54 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:56.173 15:35:54 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:56.173 15:35:54 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:56.173 15:35:54 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:56.173 00:06:56.173 real 0m0.239s 00:06:56.173 user 0m0.028s 00:06:56.173 sys 0m0.117s 00:06:56.173 15:35:54 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:56.173 15:35:54 -- common/autotest_common.sh@10 -- # set +x 00:06:56.174 ************************************ 00:06:56.174 END TEST filesystem_btrfs 00:06:56.174 ************************************ 00:06:56.174 15:35:54 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:06:56.174 15:35:54 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:56.174 15:35:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:56.174 15:35:54 -- common/autotest_common.sh@10 -- # set +x 00:06:56.433 ************************************ 00:06:56.433 START TEST filesystem_xfs 00:06:56.433 ************************************ 00:06:56.433 15:35:54 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create xfs nvme0n1 00:06:56.433 15:35:54 -- target/filesystem.sh@18 -- # fstype=xfs 00:06:56.433 15:35:54 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:56.433 15:35:54 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:06:56.433 15:35:54 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:06:56.433 15:35:54 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:56.433 15:35:54 -- common/autotest_common.sh@914 -- # local i=0 00:06:56.433 15:35:54 -- common/autotest_common.sh@915 -- # local force 00:06:56.433 15:35:54 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:06:56.433 15:35:54 -- common/autotest_common.sh@920 -- # force=-f 00:06:56.433 15:35:54 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:06:56.433 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:06:56.433 = sectsz=512 attr=2, projid32bit=1 00:06:56.433 = crc=1 finobt=1, sparse=1, rmapbt=0 00:06:56.433 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:06:56.433 data = bsize=4096 blocks=130560, imaxpct=25 00:06:56.433 = sunit=0 swidth=0 blks 00:06:56.433 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:06:56.433 log =internal log bsize=4096 blocks=16384, version=2 00:06:56.433 = sectsz=512 sunit=0 blks, lazy-count=1 00:06:56.433 realtime =none extsz=4096 blocks=0, rtextents=0 00:06:56.433 Discarding blocks...Done. 00:06:56.433 15:35:54 -- common/autotest_common.sh@931 -- # return 0 00:06:56.433 15:35:54 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:56.433 15:35:54 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:56.433 15:35:55 -- target/filesystem.sh@25 -- # sync 00:06:56.433 15:35:55 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:56.433 15:35:55 -- target/filesystem.sh@27 -- # sync 00:06:56.433 15:35:55 -- target/filesystem.sh@29 -- # i=0 00:06:56.433 15:35:55 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:56.433 15:35:55 -- target/filesystem.sh@37 -- # kill -0 3188463 00:06:56.433 15:35:55 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:56.692 15:35:55 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:56.692 15:35:55 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:56.692 15:35:55 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:56.692 00:06:56.692 real 0m0.197s 00:06:56.692 user 0m0.021s 00:06:56.692 sys 0m0.072s 00:06:56.692 15:35:55 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:56.692 15:35:55 -- common/autotest_common.sh@10 -- # set +x 00:06:56.692 ************************************ 00:06:56.692 END TEST filesystem_xfs 00:06:56.692 ************************************ 00:06:56.692 15:35:55 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:06:56.692 15:35:55 -- target/filesystem.sh@93 -- # sync 00:06:56.692 15:35:55 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:06:57.629 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:06:57.629 15:35:56 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:06:57.629 15:35:56 -- common/autotest_common.sh@1205 -- # local i=0 00:06:57.629 15:35:56 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:06:57.629 15:35:56 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:06:57.629 15:35:56 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:06:57.629 15:35:56 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:06:57.629 15:35:56 -- common/autotest_common.sh@1217 -- # return 0 00:06:57.629 15:35:56 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:06:57.629 15:35:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:57.629 15:35:56 -- common/autotest_common.sh@10 -- # set +x 00:06:57.629 15:35:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:57.629 15:35:56 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:06:57.629 15:35:56 -- target/filesystem.sh@101 -- # killprocess 3188463 00:06:57.629 15:35:56 -- common/autotest_common.sh@936 -- # '[' -z 3188463 ']' 00:06:57.629 15:35:56 -- common/autotest_common.sh@940 -- # kill -0 3188463 00:06:57.629 15:35:56 -- common/autotest_common.sh@941 -- # uname 00:06:57.629 15:35:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:57.629 15:35:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3188463 00:06:57.629 15:35:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:57.629 15:35:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:57.629 15:35:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3188463' 00:06:57.629 killing process with pid 3188463 00:06:57.629 15:35:56 -- common/autotest_common.sh@955 -- # kill 3188463 00:06:57.629 15:35:56 -- common/autotest_common.sh@960 -- # wait 3188463 00:06:57.629 [2024-04-26 15:35:56.206511] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:06:58.199 15:35:56 -- target/filesystem.sh@102 -- # nvmfpid= 00:06:58.199 00:06:58.199 real 0m8.032s 00:06:58.199 user 0m31.391s 00:06:58.199 sys 0m1.175s 00:06:58.199 15:35:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:58.199 15:35:56 -- common/autotest_common.sh@10 -- # set +x 00:06:58.199 ************************************ 00:06:58.199 END TEST nvmf_filesystem_no_in_capsule 00:06:58.199 ************************************ 00:06:58.199 15:35:56 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:06:58.199 15:35:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:58.199 15:35:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:58.199 15:35:56 -- common/autotest_common.sh@10 -- # set +x 00:06:58.199 ************************************ 00:06:58.199 START TEST nvmf_filesystem_in_capsule 00:06:58.199 ************************************ 00:06:58.199 15:35:56 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_part 4096 00:06:58.199 15:35:56 -- target/filesystem.sh@47 -- # in_capsule=4096 00:06:58.199 15:35:56 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:06:58.199 15:35:56 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:06:58.199 15:35:56 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:58.199 15:35:56 -- common/autotest_common.sh@10 -- # set +x 00:06:58.199 15:35:56 -- nvmf/common.sh@470 -- # nvmfpid=3189987 00:06:58.199 15:35:56 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:58.199 15:35:56 -- nvmf/common.sh@471 -- # waitforlisten 3189987 00:06:58.199 15:35:56 -- common/autotest_common.sh@817 -- # '[' -z 3189987 ']' 00:06:58.199 15:35:56 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:58.199 15:35:56 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:58.199 15:35:56 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:58.199 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:58.199 15:35:56 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:58.199 15:35:56 -- common/autotest_common.sh@10 -- # set +x 00:06:58.199 [2024-04-26 15:35:56.770374] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:06:58.199 [2024-04-26 15:35:56.770410] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:58.199 EAL: No free 2048 kB hugepages reported on node 1 00:06:58.459 [2024-04-26 15:35:56.827072] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:58.459 [2024-04-26 15:35:56.905741] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:58.459 [2024-04-26 15:35:56.905774] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:58.459 [2024-04-26 15:35:56.905780] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:06:58.459 [2024-04-26 15:35:56.905786] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:06:58.459 [2024-04-26 15:35:56.905791] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:58.459 [2024-04-26 15:35:56.905834] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:58.459 [2024-04-26 15:35:56.905918] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:58.459 [2024-04-26 15:35:56.905984] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:58.459 [2024-04-26 15:35:56.905985] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:59.027 15:35:57 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:59.027 15:35:57 -- common/autotest_common.sh@850 -- # return 0 00:06:59.027 15:35:57 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:06:59.027 15:35:57 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:59.027 15:35:57 -- common/autotest_common.sh@10 -- # set +x 00:06:59.027 15:35:57 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:59.027 15:35:57 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:06:59.027 15:35:57 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -c 4096 00:06:59.027 15:35:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:59.027 15:35:57 -- common/autotest_common.sh@10 -- # set +x 00:06:59.285 [2024-04-26 15:35:57.644636] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x23e1100/0x23e55f0) succeed. 00:06:59.285 [2024-04-26 15:35:57.655259] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x23e2740/0x2426c80) succeed. 00:06:59.285 15:35:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:59.285 15:35:57 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:06:59.285 15:35:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:59.285 15:35:57 -- common/autotest_common.sh@10 -- # set +x 00:06:59.545 Malloc1 00:06:59.545 15:35:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:59.545 15:35:57 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:06:59.545 15:35:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:59.545 15:35:57 -- common/autotest_common.sh@10 -- # set +x 00:06:59.545 15:35:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:59.545 15:35:57 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:06:59.545 15:35:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:59.545 15:35:57 -- common/autotest_common.sh@10 -- # set +x 00:06:59.545 15:35:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:59.545 15:35:57 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:06:59.545 15:35:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:59.545 15:35:57 -- common/autotest_common.sh@10 -- # set +x 00:06:59.545 [2024-04-26 15:35:57.925550] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:06:59.545 15:35:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:59.545 15:35:57 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:06:59.545 15:35:57 -- common/autotest_common.sh@1364 -- # local bdev_name=Malloc1 00:06:59.545 15:35:57 -- common/autotest_common.sh@1365 -- # local bdev_info 00:06:59.545 15:35:57 -- common/autotest_common.sh@1366 -- # local bs 00:06:59.545 15:35:57 -- common/autotest_common.sh@1367 -- # local nb 00:06:59.545 15:35:57 -- common/autotest_common.sh@1368 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:06:59.545 15:35:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:59.545 15:35:57 -- common/autotest_common.sh@10 -- # set +x 00:06:59.545 15:35:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:59.545 15:35:57 -- common/autotest_common.sh@1368 -- # bdev_info='[ 00:06:59.545 { 00:06:59.545 "name": "Malloc1", 00:06:59.545 "aliases": [ 00:06:59.545 "903871de-6d7a-4f9c-801a-6ccc0076b3ef" 00:06:59.545 ], 00:06:59.545 "product_name": "Malloc disk", 00:06:59.545 "block_size": 512, 00:06:59.545 "num_blocks": 1048576, 00:06:59.545 "uuid": "903871de-6d7a-4f9c-801a-6ccc0076b3ef", 00:06:59.545 "assigned_rate_limits": { 00:06:59.545 "rw_ios_per_sec": 0, 00:06:59.545 "rw_mbytes_per_sec": 0, 00:06:59.545 "r_mbytes_per_sec": 0, 00:06:59.545 "w_mbytes_per_sec": 0 00:06:59.545 }, 00:06:59.545 "claimed": true, 00:06:59.545 "claim_type": "exclusive_write", 00:06:59.545 "zoned": false, 00:06:59.545 "supported_io_types": { 00:06:59.545 "read": true, 00:06:59.545 "write": true, 00:06:59.545 "unmap": true, 00:06:59.545 "write_zeroes": true, 00:06:59.545 "flush": true, 00:06:59.545 "reset": true, 00:06:59.545 "compare": false, 00:06:59.545 "compare_and_write": false, 00:06:59.545 "abort": true, 00:06:59.545 "nvme_admin": false, 00:06:59.545 "nvme_io": false 00:06:59.545 }, 00:06:59.545 "memory_domains": [ 00:06:59.545 { 00:06:59.545 "dma_device_id": "system", 00:06:59.545 "dma_device_type": 1 00:06:59.545 }, 00:06:59.545 { 00:06:59.545 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:59.545 "dma_device_type": 2 00:06:59.545 } 00:06:59.545 ], 00:06:59.545 "driver_specific": {} 00:06:59.545 } 00:06:59.545 ]' 00:06:59.545 15:35:57 -- common/autotest_common.sh@1369 -- # jq '.[] .block_size' 00:06:59.545 15:35:57 -- common/autotest_common.sh@1369 -- # bs=512 00:06:59.545 15:35:57 -- common/autotest_common.sh@1370 -- # jq '.[] .num_blocks' 00:06:59.545 15:35:58 -- common/autotest_common.sh@1370 -- # nb=1048576 00:06:59.545 15:35:58 -- common/autotest_common.sh@1373 -- # bdev_size=512 00:06:59.545 15:35:58 -- common/autotest_common.sh@1374 -- # echo 512 00:06:59.545 15:35:58 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:06:59.545 15:35:58 -- target/filesystem.sh@60 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:07:00.481 15:35:58 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:00.481 15:35:58 -- common/autotest_common.sh@1184 -- # local i=0 00:07:00.481 15:35:58 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:07:00.481 15:35:58 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:07:00.481 15:35:58 -- common/autotest_common.sh@1191 -- # sleep 2 00:07:02.386 15:36:00 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:07:02.386 15:36:00 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:07:02.386 15:36:00 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:07:02.646 15:36:01 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:07:02.646 15:36:01 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:07:02.646 15:36:01 -- common/autotest_common.sh@1194 -- # return 0 00:07:02.646 15:36:01 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:02.646 15:36:01 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:02.646 15:36:01 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:02.646 15:36:01 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:02.646 15:36:01 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:02.646 15:36:01 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:02.646 15:36:01 -- setup/common.sh@80 -- # echo 536870912 00:07:02.646 15:36:01 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:02.646 15:36:01 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:02.646 15:36:01 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:02.646 15:36:01 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:02.646 15:36:01 -- target/filesystem.sh@69 -- # partprobe 00:07:02.646 15:36:01 -- target/filesystem.sh@70 -- # sleep 1 00:07:03.581 15:36:02 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:07:03.581 15:36:02 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:03.581 15:36:02 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:03.581 15:36:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:03.581 15:36:02 -- common/autotest_common.sh@10 -- # set +x 00:07:03.840 ************************************ 00:07:03.840 START TEST filesystem_in_capsule_ext4 00:07:03.840 ************************************ 00:07:03.840 15:36:02 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:03.840 15:36:02 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:03.840 15:36:02 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:03.840 15:36:02 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:03.840 15:36:02 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:07:03.840 15:36:02 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:03.840 15:36:02 -- common/autotest_common.sh@914 -- # local i=0 00:07:03.840 15:36:02 -- common/autotest_common.sh@915 -- # local force 00:07:03.840 15:36:02 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:07:03.840 15:36:02 -- common/autotest_common.sh@918 -- # force=-F 00:07:03.840 15:36:02 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:03.840 mke2fs 1.46.5 (30-Dec-2021) 00:07:03.840 Discarding device blocks: 0/522240 done 00:07:03.840 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:03.840 Filesystem UUID: 1f766131-912f-416e-8695-e8b8d9e76a2d 00:07:03.840 Superblock backups stored on blocks: 00:07:03.840 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:03.840 00:07:03.840 Allocating group tables: 0/64 done 00:07:03.840 Writing inode tables: 0/64 done 00:07:03.840 Creating journal (8192 blocks): done 00:07:03.840 Writing superblocks and filesystem accounting information: 0/64 done 00:07:03.840 00:07:03.840 15:36:02 -- common/autotest_common.sh@931 -- # return 0 00:07:03.840 15:36:02 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:03.840 15:36:02 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:03.840 15:36:02 -- target/filesystem.sh@25 -- # sync 00:07:03.840 15:36:02 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:03.840 15:36:02 -- target/filesystem.sh@27 -- # sync 00:07:03.840 15:36:02 -- target/filesystem.sh@29 -- # i=0 00:07:03.840 15:36:02 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:04.099 15:36:02 -- target/filesystem.sh@37 -- # kill -0 3189987 00:07:04.099 15:36:02 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:04.100 15:36:02 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:04.100 15:36:02 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:04.100 15:36:02 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:04.100 00:07:04.100 real 0m0.175s 00:07:04.100 user 0m0.019s 00:07:04.100 sys 0m0.069s 00:07:04.100 15:36:02 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:04.100 15:36:02 -- common/autotest_common.sh@10 -- # set +x 00:07:04.100 ************************************ 00:07:04.100 END TEST filesystem_in_capsule_ext4 00:07:04.100 ************************************ 00:07:04.100 15:36:02 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:04.100 15:36:02 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:04.100 15:36:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:04.100 15:36:02 -- common/autotest_common.sh@10 -- # set +x 00:07:04.100 ************************************ 00:07:04.100 START TEST filesystem_in_capsule_btrfs 00:07:04.100 ************************************ 00:07:04.100 15:36:02 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:04.100 15:36:02 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:04.100 15:36:02 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:04.100 15:36:02 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:04.100 15:36:02 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:07:04.100 15:36:02 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:04.100 15:36:02 -- common/autotest_common.sh@914 -- # local i=0 00:07:04.100 15:36:02 -- common/autotest_common.sh@915 -- # local force 00:07:04.100 15:36:02 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:07:04.100 15:36:02 -- common/autotest_common.sh@920 -- # force=-f 00:07:04.100 15:36:02 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:04.359 btrfs-progs v6.6.2 00:07:04.359 See https://btrfs.readthedocs.io for more information. 00:07:04.359 00:07:04.359 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:04.359 NOTE: several default settings have changed in version 5.15, please make sure 00:07:04.359 this does not affect your deployments: 00:07:04.359 - DUP for metadata (-m dup) 00:07:04.359 - enabled no-holes (-O no-holes) 00:07:04.359 - enabled free-space-tree (-R free-space-tree) 00:07:04.359 00:07:04.359 Label: (null) 00:07:04.359 UUID: 1ddb0a12-4167-4cd4-88bb-4d71694d9d53 00:07:04.359 Node size: 16384 00:07:04.359 Sector size: 4096 00:07:04.359 Filesystem size: 510.00MiB 00:07:04.359 Block group profiles: 00:07:04.359 Data: single 8.00MiB 00:07:04.359 Metadata: DUP 32.00MiB 00:07:04.359 System: DUP 8.00MiB 00:07:04.359 SSD detected: yes 00:07:04.359 Zoned device: no 00:07:04.359 Incompat features: extref, skinny-metadata, no-holes, free-space-tree 00:07:04.359 Runtime features: free-space-tree 00:07:04.359 Checksum: crc32c 00:07:04.359 Number of devices: 1 00:07:04.359 Devices: 00:07:04.359 ID SIZE PATH 00:07:04.359 1 510.00MiB /dev/nvme0n1p1 00:07:04.359 00:07:04.359 15:36:02 -- common/autotest_common.sh@931 -- # return 0 00:07:04.359 15:36:02 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:04.359 15:36:02 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:04.359 15:36:02 -- target/filesystem.sh@25 -- # sync 00:07:04.359 15:36:02 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:04.359 15:36:02 -- target/filesystem.sh@27 -- # sync 00:07:04.359 15:36:02 -- target/filesystem.sh@29 -- # i=0 00:07:04.359 15:36:02 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:04.359 15:36:02 -- target/filesystem.sh@37 -- # kill -0 3189987 00:07:04.359 15:36:02 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:04.359 15:36:02 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:04.359 15:36:02 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:04.359 15:36:02 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:04.359 00:07:04.359 real 0m0.254s 00:07:04.359 user 0m0.025s 00:07:04.359 sys 0m0.125s 00:07:04.359 15:36:02 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:04.359 15:36:02 -- common/autotest_common.sh@10 -- # set +x 00:07:04.359 ************************************ 00:07:04.359 END TEST filesystem_in_capsule_btrfs 00:07:04.359 ************************************ 00:07:04.359 15:36:02 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:07:04.359 15:36:02 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:04.359 15:36:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:04.359 15:36:02 -- common/autotest_common.sh@10 -- # set +x 00:07:04.618 ************************************ 00:07:04.618 START TEST filesystem_in_capsule_xfs 00:07:04.618 ************************************ 00:07:04.618 15:36:03 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create xfs nvme0n1 00:07:04.618 15:36:03 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:04.618 15:36:03 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:04.618 15:36:03 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:04.618 15:36:03 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:07:04.618 15:36:03 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:04.618 15:36:03 -- common/autotest_common.sh@914 -- # local i=0 00:07:04.618 15:36:03 -- common/autotest_common.sh@915 -- # local force 00:07:04.618 15:36:03 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:07:04.618 15:36:03 -- common/autotest_common.sh@920 -- # force=-f 00:07:04.618 15:36:03 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:04.618 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:04.618 = sectsz=512 attr=2, projid32bit=1 00:07:04.618 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:04.618 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:04.618 data = bsize=4096 blocks=130560, imaxpct=25 00:07:04.618 = sunit=0 swidth=0 blks 00:07:04.618 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:04.618 log =internal log bsize=4096 blocks=16384, version=2 00:07:04.618 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:04.618 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:04.618 Discarding blocks...Done. 00:07:04.618 15:36:03 -- common/autotest_common.sh@931 -- # return 0 00:07:04.618 15:36:03 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:04.618 15:36:03 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:04.618 15:36:03 -- target/filesystem.sh@25 -- # sync 00:07:04.618 15:36:03 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:04.618 15:36:03 -- target/filesystem.sh@27 -- # sync 00:07:04.618 15:36:03 -- target/filesystem.sh@29 -- # i=0 00:07:04.618 15:36:03 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:04.876 15:36:03 -- target/filesystem.sh@37 -- # kill -0 3189987 00:07:04.876 15:36:03 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:04.876 15:36:03 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:04.876 15:36:03 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:04.876 15:36:03 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:04.876 00:07:04.876 real 0m0.188s 00:07:04.876 user 0m0.023s 00:07:04.876 sys 0m0.068s 00:07:04.876 15:36:03 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:04.876 15:36:03 -- common/autotest_common.sh@10 -- # set +x 00:07:04.876 ************************************ 00:07:04.876 END TEST filesystem_in_capsule_xfs 00:07:04.876 ************************************ 00:07:04.876 15:36:03 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:04.876 15:36:03 -- target/filesystem.sh@93 -- # sync 00:07:04.876 15:36:03 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:05.812 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:05.812 15:36:04 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:05.812 15:36:04 -- common/autotest_common.sh@1205 -- # local i=0 00:07:05.812 15:36:04 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:07:05.812 15:36:04 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:05.812 15:36:04 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:07:05.812 15:36:04 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:05.812 15:36:04 -- common/autotest_common.sh@1217 -- # return 0 00:07:05.812 15:36:04 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:05.812 15:36:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:05.812 15:36:04 -- common/autotest_common.sh@10 -- # set +x 00:07:05.812 15:36:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:05.812 15:36:04 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:05.812 15:36:04 -- target/filesystem.sh@101 -- # killprocess 3189987 00:07:05.812 15:36:04 -- common/autotest_common.sh@936 -- # '[' -z 3189987 ']' 00:07:05.812 15:36:04 -- common/autotest_common.sh@940 -- # kill -0 3189987 00:07:05.812 15:36:04 -- common/autotest_common.sh@941 -- # uname 00:07:05.812 15:36:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:05.812 15:36:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3189987 00:07:05.812 15:36:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:05.812 15:36:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:05.812 15:36:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3189987' 00:07:05.812 killing process with pid 3189987 00:07:05.812 15:36:04 -- common/autotest_common.sh@955 -- # kill 3189987 00:07:05.812 15:36:04 -- common/autotest_common.sh@960 -- # wait 3189987 00:07:06.071 [2024-04-26 15:36:04.419706] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:07:06.330 15:36:04 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:06.330 00:07:06.330 real 0m8.055s 00:07:06.330 user 0m31.425s 00:07:06.330 sys 0m1.204s 00:07:06.330 15:36:04 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:06.330 15:36:04 -- common/autotest_common.sh@10 -- # set +x 00:07:06.331 ************************************ 00:07:06.331 END TEST nvmf_filesystem_in_capsule 00:07:06.331 ************************************ 00:07:06.331 15:36:04 -- target/filesystem.sh@108 -- # nvmftestfini 00:07:06.331 15:36:04 -- nvmf/common.sh@477 -- # nvmfcleanup 00:07:06.331 15:36:04 -- nvmf/common.sh@117 -- # sync 00:07:06.331 15:36:04 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:07:06.331 15:36:04 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:07:06.331 15:36:04 -- nvmf/common.sh@120 -- # set +e 00:07:06.331 15:36:04 -- nvmf/common.sh@121 -- # for i in {1..20} 00:07:06.331 15:36:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:07:06.331 rmmod nvme_rdma 00:07:06.331 rmmod nvme_fabrics 00:07:06.331 15:36:04 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:07:06.331 15:36:04 -- nvmf/common.sh@124 -- # set -e 00:07:06.331 15:36:04 -- nvmf/common.sh@125 -- # return 0 00:07:06.331 15:36:04 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:07:06.331 15:36:04 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:07:06.331 15:36:04 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:07:06.331 00:07:06.331 real 0m22.140s 00:07:06.331 user 1m4.632s 00:07:06.331 sys 0m6.743s 00:07:06.331 15:36:04 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:06.331 15:36:04 -- common/autotest_common.sh@10 -- # set +x 00:07:06.331 ************************************ 00:07:06.331 END TEST nvmf_filesystem 00:07:06.331 ************************************ 00:07:06.331 15:36:04 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=rdma 00:07:06.331 15:36:04 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:06.331 15:36:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:06.331 15:36:04 -- common/autotest_common.sh@10 -- # set +x 00:07:06.590 ************************************ 00:07:06.590 START TEST nvmf_discovery 00:07:06.590 ************************************ 00:07:06.590 15:36:05 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=rdma 00:07:06.590 * Looking for test storage... 00:07:06.590 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:07:06.590 15:36:05 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:07:06.590 15:36:05 -- nvmf/common.sh@7 -- # uname -s 00:07:06.590 15:36:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:06.590 15:36:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:06.590 15:36:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:06.590 15:36:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:06.590 15:36:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:06.590 15:36:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:06.590 15:36:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:06.590 15:36:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:06.590 15:36:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:06.590 15:36:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:06.590 15:36:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:07:06.590 15:36:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:07:06.590 15:36:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:06.590 15:36:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:06.590 15:36:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:06.590 15:36:05 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:07:06.590 15:36:05 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:07:06.590 15:36:05 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:06.590 15:36:05 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:06.590 15:36:05 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:06.590 15:36:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:06.590 15:36:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:06.590 15:36:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:06.590 15:36:05 -- paths/export.sh@5 -- # export PATH 00:07:06.590 15:36:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:06.590 15:36:05 -- nvmf/common.sh@47 -- # : 0 00:07:06.590 15:36:05 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:07:06.590 15:36:05 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:07:06.590 15:36:05 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:07:06.590 15:36:05 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:06.590 15:36:05 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:06.590 15:36:05 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:07:06.590 15:36:05 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:07:06.590 15:36:05 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:07:06.590 15:36:05 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:07:06.590 15:36:05 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:07:06.590 15:36:05 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:07:06.590 15:36:05 -- target/discovery.sh@15 -- # hash nvme 00:07:06.590 15:36:05 -- target/discovery.sh@20 -- # nvmftestinit 00:07:06.590 15:36:05 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:07:06.590 15:36:05 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:06.590 15:36:05 -- nvmf/common.sh@437 -- # prepare_net_devs 00:07:06.590 15:36:05 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:07:06.590 15:36:05 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:07:06.590 15:36:05 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:06.590 15:36:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:06.590 15:36:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:06.590 15:36:05 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:07:06.590 15:36:05 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:07:06.590 15:36:05 -- nvmf/common.sh@285 -- # xtrace_disable 00:07:06.590 15:36:05 -- common/autotest_common.sh@10 -- # set +x 00:07:11.861 15:36:10 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:11.861 15:36:10 -- nvmf/common.sh@291 -- # pci_devs=() 00:07:11.861 15:36:10 -- nvmf/common.sh@291 -- # local -a pci_devs 00:07:11.861 15:36:10 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:07:11.861 15:36:10 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:07:11.861 15:36:10 -- nvmf/common.sh@293 -- # pci_drivers=() 00:07:11.861 15:36:10 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:07:11.861 15:36:10 -- nvmf/common.sh@295 -- # net_devs=() 00:07:11.861 15:36:10 -- nvmf/common.sh@295 -- # local -ga net_devs 00:07:11.861 15:36:10 -- nvmf/common.sh@296 -- # e810=() 00:07:11.861 15:36:10 -- nvmf/common.sh@296 -- # local -ga e810 00:07:11.861 15:36:10 -- nvmf/common.sh@297 -- # x722=() 00:07:11.861 15:36:10 -- nvmf/common.sh@297 -- # local -ga x722 00:07:11.861 15:36:10 -- nvmf/common.sh@298 -- # mlx=() 00:07:11.861 15:36:10 -- nvmf/common.sh@298 -- # local -ga mlx 00:07:11.861 15:36:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:11.861 15:36:10 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:11.861 15:36:10 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:11.861 15:36:10 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:11.861 15:36:10 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:11.861 15:36:10 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:11.861 15:36:10 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:11.861 15:36:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:11.861 15:36:10 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:11.861 15:36:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:11.861 15:36:10 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:11.861 15:36:10 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:07:11.861 15:36:10 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:07:11.861 15:36:10 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:07:11.861 15:36:10 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:07:11.861 15:36:10 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:07:11.861 15:36:10 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:07:11.861 15:36:10 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:07:11.861 15:36:10 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:11.861 15:36:10 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:07:11.861 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:07:11.861 15:36:10 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:07:11.861 15:36:10 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:07:11.861 15:36:10 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:07:11.861 15:36:10 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:07:11.861 15:36:10 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:07:11.861 15:36:10 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:07:11.861 15:36:10 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:11.862 15:36:10 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:07:11.862 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:07:11.862 15:36:10 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:07:11.862 15:36:10 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:07:11.862 15:36:10 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:07:11.862 15:36:10 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:07:11.862 15:36:10 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:07:11.862 15:36:10 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:07:11.862 15:36:10 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:07:11.862 15:36:10 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:07:11.862 15:36:10 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:11.862 15:36:10 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:11.862 15:36:10 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:11.862 15:36:10 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:11.862 15:36:10 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:07:11.862 Found net devices under 0000:da:00.0: mlx_0_0 00:07:11.862 15:36:10 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:11.862 15:36:10 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:11.862 15:36:10 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:11.862 15:36:10 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:11.862 15:36:10 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:11.862 15:36:10 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:07:11.862 Found net devices under 0000:da:00.1: mlx_0_1 00:07:11.862 15:36:10 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:11.862 15:36:10 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:07:11.862 15:36:10 -- nvmf/common.sh@403 -- # is_hw=yes 00:07:11.862 15:36:10 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:07:11.862 15:36:10 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:07:11.862 15:36:10 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:07:11.862 15:36:10 -- nvmf/common.sh@409 -- # rdma_device_init 00:07:11.862 15:36:10 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:07:11.862 15:36:10 -- nvmf/common.sh@58 -- # uname 00:07:11.862 15:36:10 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:07:11.862 15:36:10 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:07:11.862 15:36:10 -- nvmf/common.sh@63 -- # modprobe ib_core 00:07:11.862 15:36:10 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:07:11.862 15:36:10 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:07:11.862 15:36:10 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:07:11.862 15:36:10 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:07:11.862 15:36:10 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:07:11.862 15:36:10 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:07:11.862 15:36:10 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:07:11.862 15:36:10 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:07:11.862 15:36:10 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:07:11.862 15:36:10 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:07:11.862 15:36:10 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:07:11.862 15:36:10 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:07:11.862 15:36:10 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:07:11.862 15:36:10 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:11.862 15:36:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:11.862 15:36:10 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:07:11.862 15:36:10 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:07:11.862 15:36:10 -- nvmf/common.sh@105 -- # continue 2 00:07:11.862 15:36:10 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:11.862 15:36:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:11.862 15:36:10 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:07:11.862 15:36:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:11.862 15:36:10 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:07:11.862 15:36:10 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:07:11.862 15:36:10 -- nvmf/common.sh@105 -- # continue 2 00:07:11.862 15:36:10 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:07:11.862 15:36:10 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:07:11.862 15:36:10 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:07:11.862 15:36:10 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:07:11.862 15:36:10 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:11.862 15:36:10 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:11.862 15:36:10 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:07:11.862 15:36:10 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:07:11.862 15:36:10 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:07:11.862 118: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:07:11.862 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:07:11.862 altname enp218s0f0np0 00:07:11.862 altname ens818f0np0 00:07:11.862 inet 192.168.100.8/24 scope global mlx_0_0 00:07:11.862 valid_lft forever preferred_lft forever 00:07:11.862 15:36:10 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:07:11.862 15:36:10 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:07:11.862 15:36:10 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:07:11.862 15:36:10 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:07:11.862 15:36:10 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:11.862 15:36:10 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:11.862 15:36:10 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:07:11.862 15:36:10 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:07:11.862 15:36:10 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:07:11.862 119: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:07:11.862 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:07:11.862 altname enp218s0f1np1 00:07:11.862 altname ens818f1np1 00:07:11.862 inet 192.168.100.9/24 scope global mlx_0_1 00:07:11.862 valid_lft forever preferred_lft forever 00:07:11.862 15:36:10 -- nvmf/common.sh@411 -- # return 0 00:07:11.862 15:36:10 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:07:11.862 15:36:10 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:07:11.862 15:36:10 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:07:11.862 15:36:10 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:07:11.862 15:36:10 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:07:11.862 15:36:10 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:07:11.862 15:36:10 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:07:11.862 15:36:10 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:07:11.862 15:36:10 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:07:11.862 15:36:10 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:07:11.862 15:36:10 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:11.862 15:36:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:11.862 15:36:10 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:07:11.862 15:36:10 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:07:11.862 15:36:10 -- nvmf/common.sh@105 -- # continue 2 00:07:11.862 15:36:10 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:11.862 15:36:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:11.862 15:36:10 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:07:11.862 15:36:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:11.862 15:36:10 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:07:11.862 15:36:10 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:07:11.862 15:36:10 -- nvmf/common.sh@105 -- # continue 2 00:07:11.862 15:36:10 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:07:11.862 15:36:10 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:07:11.862 15:36:10 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:07:11.862 15:36:10 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:07:11.862 15:36:10 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:11.862 15:36:10 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:11.862 15:36:10 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:07:11.862 15:36:10 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:07:11.862 15:36:10 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:07:11.862 15:36:10 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:07:11.862 15:36:10 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:11.862 15:36:10 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:11.862 15:36:10 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:07:11.862 192.168.100.9' 00:07:11.862 15:36:10 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:07:11.862 192.168.100.9' 00:07:11.862 15:36:10 -- nvmf/common.sh@446 -- # head -n 1 00:07:11.862 15:36:10 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:07:11.862 15:36:10 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:07:11.862 192.168.100.9' 00:07:11.862 15:36:10 -- nvmf/common.sh@447 -- # tail -n +2 00:07:11.862 15:36:10 -- nvmf/common.sh@447 -- # head -n 1 00:07:11.862 15:36:10 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:07:11.862 15:36:10 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:07:11.862 15:36:10 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:07:11.862 15:36:10 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:07:11.862 15:36:10 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:07:11.862 15:36:10 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:07:12.181 15:36:10 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:07:12.181 15:36:10 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:07:12.181 15:36:10 -- common/autotest_common.sh@710 -- # xtrace_disable 00:07:12.181 15:36:10 -- common/autotest_common.sh@10 -- # set +x 00:07:12.181 15:36:10 -- nvmf/common.sh@470 -- # nvmfpid=3195110 00:07:12.181 15:36:10 -- nvmf/common.sh@471 -- # waitforlisten 3195110 00:07:12.181 15:36:10 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:12.181 15:36:10 -- common/autotest_common.sh@817 -- # '[' -z 3195110 ']' 00:07:12.181 15:36:10 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:12.181 15:36:10 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:12.181 15:36:10 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:12.181 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:12.181 15:36:10 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:12.181 15:36:10 -- common/autotest_common.sh@10 -- # set +x 00:07:12.181 [2024-04-26 15:36:10.528071] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:07:12.181 [2024-04-26 15:36:10.528121] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:12.181 EAL: No free 2048 kB hugepages reported on node 1 00:07:12.181 [2024-04-26 15:36:10.585508] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:12.181 [2024-04-26 15:36:10.663419] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:12.181 [2024-04-26 15:36:10.663461] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:12.181 [2024-04-26 15:36:10.663468] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:07:12.181 [2024-04-26 15:36:10.663474] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:07:12.181 [2024-04-26 15:36:10.663479] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:12.181 [2024-04-26 15:36:10.663529] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:12.181 [2024-04-26 15:36:10.663619] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:12.181 [2024-04-26 15:36:10.663704] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:12.181 [2024-04-26 15:36:10.663705] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:12.745 15:36:11 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:12.745 15:36:11 -- common/autotest_common.sh@850 -- # return 0 00:07:12.745 15:36:11 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:07:12.745 15:36:11 -- common/autotest_common.sh@716 -- # xtrace_disable 00:07:12.745 15:36:11 -- common/autotest_common.sh@10 -- # set +x 00:07:13.003 15:36:11 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:13.003 15:36:11 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:07:13.003 15:36:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:13.003 15:36:11 -- common/autotest_common.sh@10 -- # set +x 00:07:13.003 [2024-04-26 15:36:11.392621] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1b2b100/0x1b2f5f0) succeed. 00:07:13.003 [2024-04-26 15:36:11.402952] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1b2c740/0x1b70c80) succeed. 00:07:13.003 15:36:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:13.003 15:36:11 -- target/discovery.sh@26 -- # seq 1 4 00:07:13.003 15:36:11 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:13.003 15:36:11 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:07:13.003 15:36:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:13.003 15:36:11 -- common/autotest_common.sh@10 -- # set +x 00:07:13.003 Null1 00:07:13.003 15:36:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:13.003 15:36:11 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:13.003 15:36:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:13.003 15:36:11 -- common/autotest_common.sh@10 -- # set +x 00:07:13.003 15:36:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:13.003 15:36:11 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:07:13.003 15:36:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:13.003 15:36:11 -- common/autotest_common.sh@10 -- # set +x 00:07:13.003 15:36:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:13.003 15:36:11 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:07:13.003 15:36:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:13.003 15:36:11 -- common/autotest_common.sh@10 -- # set +x 00:07:13.003 [2024-04-26 15:36:11.567483] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:07:13.003 15:36:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:13.003 15:36:11 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:13.003 15:36:11 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:07:13.003 15:36:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:13.003 15:36:11 -- common/autotest_common.sh@10 -- # set +x 00:07:13.003 Null2 00:07:13.003 15:36:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:13.003 15:36:11 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:07:13.003 15:36:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:13.003 15:36:11 -- common/autotest_common.sh@10 -- # set +x 00:07:13.003 15:36:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:13.003 15:36:11 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:07:13.003 15:36:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:13.003 15:36:11 -- common/autotest_common.sh@10 -- # set +x 00:07:13.003 15:36:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:13.003 15:36:11 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t rdma -a 192.168.100.8 -s 4420 00:07:13.003 15:36:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:13.003 15:36:11 -- common/autotest_common.sh@10 -- # set +x 00:07:13.003 15:36:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:13.003 15:36:11 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:13.003 15:36:11 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:07:13.003 15:36:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:13.003 15:36:11 -- common/autotest_common.sh@10 -- # set +x 00:07:13.261 Null3 00:07:13.261 15:36:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:13.261 15:36:11 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:07:13.261 15:36:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:13.261 15:36:11 -- common/autotest_common.sh@10 -- # set +x 00:07:13.261 15:36:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:13.261 15:36:11 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:07:13.261 15:36:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:13.261 15:36:11 -- common/autotest_common.sh@10 -- # set +x 00:07:13.261 15:36:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:13.261 15:36:11 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t rdma -a 192.168.100.8 -s 4420 00:07:13.261 15:36:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:13.261 15:36:11 -- common/autotest_common.sh@10 -- # set +x 00:07:13.261 15:36:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:13.261 15:36:11 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:13.261 15:36:11 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:07:13.261 15:36:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:13.261 15:36:11 -- common/autotest_common.sh@10 -- # set +x 00:07:13.261 Null4 00:07:13.261 15:36:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:13.261 15:36:11 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:07:13.261 15:36:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:13.261 15:36:11 -- common/autotest_common.sh@10 -- # set +x 00:07:13.261 15:36:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:13.261 15:36:11 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:07:13.261 15:36:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:13.261 15:36:11 -- common/autotest_common.sh@10 -- # set +x 00:07:13.261 15:36:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:13.261 15:36:11 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t rdma -a 192.168.100.8 -s 4420 00:07:13.261 15:36:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:13.261 15:36:11 -- common/autotest_common.sh@10 -- # set +x 00:07:13.261 15:36:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:13.261 15:36:11 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:07:13.261 15:36:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:13.261 15:36:11 -- common/autotest_common.sh@10 -- # set +x 00:07:13.261 15:36:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:13.261 15:36:11 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 192.168.100.8 -s 4430 00:07:13.261 15:36:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:13.261 15:36:11 -- common/autotest_common.sh@10 -- # set +x 00:07:13.261 15:36:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:13.261 15:36:11 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 4420 00:07:13.261 00:07:13.261 Discovery Log Number of Records 6, Generation counter 6 00:07:13.261 =====Discovery Log Entry 0====== 00:07:13.261 trtype: rdma 00:07:13.261 adrfam: ipv4 00:07:13.261 subtype: current discovery subsystem 00:07:13.261 treq: not required 00:07:13.261 portid: 0 00:07:13.261 trsvcid: 4420 00:07:13.261 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:13.261 traddr: 192.168.100.8 00:07:13.261 eflags: explicit discovery connections, duplicate discovery information 00:07:13.261 rdma_prtype: not specified 00:07:13.261 rdma_qptype: connected 00:07:13.261 rdma_cms: rdma-cm 00:07:13.261 rdma_pkey: 0x0000 00:07:13.261 =====Discovery Log Entry 1====== 00:07:13.261 trtype: rdma 00:07:13.261 adrfam: ipv4 00:07:13.261 subtype: nvme subsystem 00:07:13.261 treq: not required 00:07:13.261 portid: 0 00:07:13.261 trsvcid: 4420 00:07:13.261 subnqn: nqn.2016-06.io.spdk:cnode1 00:07:13.261 traddr: 192.168.100.8 00:07:13.261 eflags: none 00:07:13.261 rdma_prtype: not specified 00:07:13.261 rdma_qptype: connected 00:07:13.261 rdma_cms: rdma-cm 00:07:13.261 rdma_pkey: 0x0000 00:07:13.261 =====Discovery Log Entry 2====== 00:07:13.261 trtype: rdma 00:07:13.261 adrfam: ipv4 00:07:13.261 subtype: nvme subsystem 00:07:13.261 treq: not required 00:07:13.261 portid: 0 00:07:13.261 trsvcid: 4420 00:07:13.261 subnqn: nqn.2016-06.io.spdk:cnode2 00:07:13.261 traddr: 192.168.100.8 00:07:13.261 eflags: none 00:07:13.261 rdma_prtype: not specified 00:07:13.261 rdma_qptype: connected 00:07:13.261 rdma_cms: rdma-cm 00:07:13.261 rdma_pkey: 0x0000 00:07:13.261 =====Discovery Log Entry 3====== 00:07:13.261 trtype: rdma 00:07:13.261 adrfam: ipv4 00:07:13.261 subtype: nvme subsystem 00:07:13.261 treq: not required 00:07:13.261 portid: 0 00:07:13.261 trsvcid: 4420 00:07:13.261 subnqn: nqn.2016-06.io.spdk:cnode3 00:07:13.261 traddr: 192.168.100.8 00:07:13.261 eflags: none 00:07:13.261 rdma_prtype: not specified 00:07:13.261 rdma_qptype: connected 00:07:13.261 rdma_cms: rdma-cm 00:07:13.261 rdma_pkey: 0x0000 00:07:13.261 =====Discovery Log Entry 4====== 00:07:13.261 trtype: rdma 00:07:13.261 adrfam: ipv4 00:07:13.261 subtype: nvme subsystem 00:07:13.261 treq: not required 00:07:13.261 portid: 0 00:07:13.261 trsvcid: 4420 00:07:13.261 subnqn: nqn.2016-06.io.spdk:cnode4 00:07:13.261 traddr: 192.168.100.8 00:07:13.261 eflags: none 00:07:13.261 rdma_prtype: not specified 00:07:13.261 rdma_qptype: connected 00:07:13.261 rdma_cms: rdma-cm 00:07:13.261 rdma_pkey: 0x0000 00:07:13.261 =====Discovery Log Entry 5====== 00:07:13.261 trtype: rdma 00:07:13.261 adrfam: ipv4 00:07:13.261 subtype: discovery subsystem referral 00:07:13.261 treq: not required 00:07:13.261 portid: 0 00:07:13.261 trsvcid: 4430 00:07:13.261 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:13.261 traddr: 192.168.100.8 00:07:13.261 eflags: none 00:07:13.261 rdma_prtype: unrecognized 00:07:13.261 rdma_qptype: unrecognized 00:07:13.261 rdma_cms: unrecognized 00:07:13.261 rdma_pkey: 0x0000 00:07:13.261 15:36:11 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:07:13.261 Perform nvmf subsystem discovery via RPC 00:07:13.261 15:36:11 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:07:13.261 15:36:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:13.261 15:36:11 -- common/autotest_common.sh@10 -- # set +x 00:07:13.261 [2024-04-26 15:36:11.763950] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:07:13.261 [ 00:07:13.261 { 00:07:13.261 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:07:13.261 "subtype": "Discovery", 00:07:13.261 "listen_addresses": [ 00:07:13.261 { 00:07:13.261 "transport": "RDMA", 00:07:13.261 "trtype": "RDMA", 00:07:13.261 "adrfam": "IPv4", 00:07:13.261 "traddr": "192.168.100.8", 00:07:13.261 "trsvcid": "4420" 00:07:13.261 } 00:07:13.261 ], 00:07:13.261 "allow_any_host": true, 00:07:13.261 "hosts": [] 00:07:13.261 }, 00:07:13.261 { 00:07:13.261 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:07:13.261 "subtype": "NVMe", 00:07:13.261 "listen_addresses": [ 00:07:13.262 { 00:07:13.262 "transport": "RDMA", 00:07:13.262 "trtype": "RDMA", 00:07:13.262 "adrfam": "IPv4", 00:07:13.262 "traddr": "192.168.100.8", 00:07:13.262 "trsvcid": "4420" 00:07:13.262 } 00:07:13.262 ], 00:07:13.262 "allow_any_host": true, 00:07:13.262 "hosts": [], 00:07:13.262 "serial_number": "SPDK00000000000001", 00:07:13.262 "model_number": "SPDK bdev Controller", 00:07:13.262 "max_namespaces": 32, 00:07:13.262 "min_cntlid": 1, 00:07:13.262 "max_cntlid": 65519, 00:07:13.262 "namespaces": [ 00:07:13.262 { 00:07:13.262 "nsid": 1, 00:07:13.262 "bdev_name": "Null1", 00:07:13.262 "name": "Null1", 00:07:13.262 "nguid": "F3B8A2D7454D4795B1B80C1DF95EC384", 00:07:13.262 "uuid": "f3b8a2d7-454d-4795-b1b8-0c1df95ec384" 00:07:13.262 } 00:07:13.262 ] 00:07:13.262 }, 00:07:13.262 { 00:07:13.262 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:07:13.262 "subtype": "NVMe", 00:07:13.262 "listen_addresses": [ 00:07:13.262 { 00:07:13.262 "transport": "RDMA", 00:07:13.262 "trtype": "RDMA", 00:07:13.262 "adrfam": "IPv4", 00:07:13.262 "traddr": "192.168.100.8", 00:07:13.262 "trsvcid": "4420" 00:07:13.262 } 00:07:13.262 ], 00:07:13.262 "allow_any_host": true, 00:07:13.262 "hosts": [], 00:07:13.262 "serial_number": "SPDK00000000000002", 00:07:13.262 "model_number": "SPDK bdev Controller", 00:07:13.262 "max_namespaces": 32, 00:07:13.262 "min_cntlid": 1, 00:07:13.262 "max_cntlid": 65519, 00:07:13.262 "namespaces": [ 00:07:13.262 { 00:07:13.262 "nsid": 1, 00:07:13.262 "bdev_name": "Null2", 00:07:13.262 "name": "Null2", 00:07:13.262 "nguid": "7B92C0EC02CC4C73B56AEF9C718E9C1E", 00:07:13.262 "uuid": "7b92c0ec-02cc-4c73-b56a-ef9c718e9c1e" 00:07:13.262 } 00:07:13.262 ] 00:07:13.262 }, 00:07:13.262 { 00:07:13.262 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:07:13.262 "subtype": "NVMe", 00:07:13.262 "listen_addresses": [ 00:07:13.262 { 00:07:13.262 "transport": "RDMA", 00:07:13.262 "trtype": "RDMA", 00:07:13.262 "adrfam": "IPv4", 00:07:13.262 "traddr": "192.168.100.8", 00:07:13.262 "trsvcid": "4420" 00:07:13.262 } 00:07:13.262 ], 00:07:13.262 "allow_any_host": true, 00:07:13.262 "hosts": [], 00:07:13.262 "serial_number": "SPDK00000000000003", 00:07:13.262 "model_number": "SPDK bdev Controller", 00:07:13.262 "max_namespaces": 32, 00:07:13.262 "min_cntlid": 1, 00:07:13.262 "max_cntlid": 65519, 00:07:13.262 "namespaces": [ 00:07:13.262 { 00:07:13.262 "nsid": 1, 00:07:13.262 "bdev_name": "Null3", 00:07:13.262 "name": "Null3", 00:07:13.262 "nguid": "120D375360F94600942EE296BE03FC6B", 00:07:13.262 "uuid": "120d3753-60f9-4600-942e-e296be03fc6b" 00:07:13.262 } 00:07:13.262 ] 00:07:13.262 }, 00:07:13.262 { 00:07:13.262 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:07:13.262 "subtype": "NVMe", 00:07:13.262 "listen_addresses": [ 00:07:13.262 { 00:07:13.262 "transport": "RDMA", 00:07:13.262 "trtype": "RDMA", 00:07:13.262 "adrfam": "IPv4", 00:07:13.262 "traddr": "192.168.100.8", 00:07:13.262 "trsvcid": "4420" 00:07:13.262 } 00:07:13.262 ], 00:07:13.262 "allow_any_host": true, 00:07:13.262 "hosts": [], 00:07:13.262 "serial_number": "SPDK00000000000004", 00:07:13.262 "model_number": "SPDK bdev Controller", 00:07:13.262 "max_namespaces": 32, 00:07:13.262 "min_cntlid": 1, 00:07:13.262 "max_cntlid": 65519, 00:07:13.262 "namespaces": [ 00:07:13.262 { 00:07:13.262 "nsid": 1, 00:07:13.262 "bdev_name": "Null4", 00:07:13.262 "name": "Null4", 00:07:13.262 "nguid": "D4B8782624454E469B95E7D8E178C306", 00:07:13.262 "uuid": "d4b87826-2445-4e46-9b95-e7d8e178c306" 00:07:13.262 } 00:07:13.262 ] 00:07:13.262 } 00:07:13.262 ] 00:07:13.262 15:36:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:13.262 15:36:11 -- target/discovery.sh@42 -- # seq 1 4 00:07:13.262 15:36:11 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:13.262 15:36:11 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:13.262 15:36:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:13.262 15:36:11 -- common/autotest_common.sh@10 -- # set +x 00:07:13.262 15:36:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:13.262 15:36:11 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:07:13.262 15:36:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:13.262 15:36:11 -- common/autotest_common.sh@10 -- # set +x 00:07:13.262 15:36:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:13.262 15:36:11 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:13.262 15:36:11 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:07:13.262 15:36:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:13.262 15:36:11 -- common/autotest_common.sh@10 -- # set +x 00:07:13.262 15:36:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:13.262 15:36:11 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:07:13.262 15:36:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:13.262 15:36:11 -- common/autotest_common.sh@10 -- # set +x 00:07:13.262 15:36:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:13.262 15:36:11 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:13.262 15:36:11 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:07:13.262 15:36:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:13.262 15:36:11 -- common/autotest_common.sh@10 -- # set +x 00:07:13.262 15:36:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:13.262 15:36:11 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:07:13.262 15:36:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:13.262 15:36:11 -- common/autotest_common.sh@10 -- # set +x 00:07:13.262 15:36:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:13.262 15:36:11 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:13.262 15:36:11 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:07:13.262 15:36:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:13.262 15:36:11 -- common/autotest_common.sh@10 -- # set +x 00:07:13.262 15:36:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:13.262 15:36:11 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:07:13.262 15:36:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:13.262 15:36:11 -- common/autotest_common.sh@10 -- # set +x 00:07:13.262 15:36:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:13.262 15:36:11 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 192.168.100.8 -s 4430 00:07:13.262 15:36:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:13.262 15:36:11 -- common/autotest_common.sh@10 -- # set +x 00:07:13.262 15:36:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:13.520 15:36:11 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:07:13.520 15:36:11 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:07:13.520 15:36:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:13.520 15:36:11 -- common/autotest_common.sh@10 -- # set +x 00:07:13.520 15:36:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:13.520 15:36:11 -- target/discovery.sh@49 -- # check_bdevs= 00:07:13.520 15:36:11 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:07:13.520 15:36:11 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:07:13.520 15:36:11 -- target/discovery.sh@57 -- # nvmftestfini 00:07:13.520 15:36:11 -- nvmf/common.sh@477 -- # nvmfcleanup 00:07:13.520 15:36:11 -- nvmf/common.sh@117 -- # sync 00:07:13.520 15:36:11 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:07:13.520 15:36:11 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:07:13.520 15:36:11 -- nvmf/common.sh@120 -- # set +e 00:07:13.520 15:36:11 -- nvmf/common.sh@121 -- # for i in {1..20} 00:07:13.520 15:36:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:07:13.520 rmmod nvme_rdma 00:07:13.520 rmmod nvme_fabrics 00:07:13.520 15:36:11 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:07:13.520 15:36:11 -- nvmf/common.sh@124 -- # set -e 00:07:13.520 15:36:11 -- nvmf/common.sh@125 -- # return 0 00:07:13.520 15:36:11 -- nvmf/common.sh@478 -- # '[' -n 3195110 ']' 00:07:13.520 15:36:11 -- nvmf/common.sh@479 -- # killprocess 3195110 00:07:13.520 15:36:11 -- common/autotest_common.sh@936 -- # '[' -z 3195110 ']' 00:07:13.520 15:36:11 -- common/autotest_common.sh@940 -- # kill -0 3195110 00:07:13.520 15:36:11 -- common/autotest_common.sh@941 -- # uname 00:07:13.520 15:36:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:13.520 15:36:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3195110 00:07:13.520 15:36:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:13.520 15:36:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:13.520 15:36:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3195110' 00:07:13.520 killing process with pid 3195110 00:07:13.520 15:36:12 -- common/autotest_common.sh@955 -- # kill 3195110 00:07:13.520 [2024-04-26 15:36:12.007263] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:07:13.520 15:36:12 -- common/autotest_common.sh@960 -- # wait 3195110 00:07:13.520 [2024-04-26 15:36:12.089251] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:07:13.778 15:36:12 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:07:13.778 15:36:12 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:07:13.778 00:07:13.778 real 0m7.278s 00:07:13.778 user 0m8.048s 00:07:13.778 sys 0m4.409s 00:07:13.778 15:36:12 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:13.778 15:36:12 -- common/autotest_common.sh@10 -- # set +x 00:07:13.778 ************************************ 00:07:13.778 END TEST nvmf_discovery 00:07:13.778 ************************************ 00:07:13.778 15:36:12 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=rdma 00:07:13.778 15:36:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:13.778 15:36:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:13.778 15:36:12 -- common/autotest_common.sh@10 -- # set +x 00:07:14.037 ************************************ 00:07:14.037 START TEST nvmf_referrals 00:07:14.037 ************************************ 00:07:14.037 15:36:12 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=rdma 00:07:14.037 * Looking for test storage... 00:07:14.037 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:07:14.037 15:36:12 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:07:14.037 15:36:12 -- nvmf/common.sh@7 -- # uname -s 00:07:14.037 15:36:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:14.037 15:36:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:14.037 15:36:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:14.037 15:36:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:14.037 15:36:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:14.037 15:36:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:14.037 15:36:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:14.037 15:36:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:14.037 15:36:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:14.037 15:36:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:14.037 15:36:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:07:14.037 15:36:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:07:14.037 15:36:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:14.037 15:36:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:14.037 15:36:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:14.037 15:36:12 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:07:14.037 15:36:12 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:07:14.037 15:36:12 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:14.037 15:36:12 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:14.037 15:36:12 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:14.037 15:36:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:14.037 15:36:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:14.037 15:36:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:14.037 15:36:12 -- paths/export.sh@5 -- # export PATH 00:07:14.037 15:36:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:14.037 15:36:12 -- nvmf/common.sh@47 -- # : 0 00:07:14.037 15:36:12 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:07:14.037 15:36:12 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:07:14.037 15:36:12 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:07:14.037 15:36:12 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:14.037 15:36:12 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:14.037 15:36:12 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:07:14.037 15:36:12 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:07:14.037 15:36:12 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:07:14.037 15:36:12 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:07:14.037 15:36:12 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:07:14.037 15:36:12 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:07:14.037 15:36:12 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:07:14.037 15:36:12 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:07:14.037 15:36:12 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:07:14.037 15:36:12 -- target/referrals.sh@37 -- # nvmftestinit 00:07:14.037 15:36:12 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:07:14.037 15:36:12 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:14.037 15:36:12 -- nvmf/common.sh@437 -- # prepare_net_devs 00:07:14.037 15:36:12 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:07:14.037 15:36:12 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:07:14.037 15:36:12 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:14.037 15:36:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:14.037 15:36:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:14.037 15:36:12 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:07:14.037 15:36:12 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:07:14.037 15:36:12 -- nvmf/common.sh@285 -- # xtrace_disable 00:07:14.037 15:36:12 -- common/autotest_common.sh@10 -- # set +x 00:07:19.323 15:36:17 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:19.323 15:36:17 -- nvmf/common.sh@291 -- # pci_devs=() 00:07:19.323 15:36:17 -- nvmf/common.sh@291 -- # local -a pci_devs 00:07:19.323 15:36:17 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:07:19.323 15:36:17 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:07:19.323 15:36:17 -- nvmf/common.sh@293 -- # pci_drivers=() 00:07:19.323 15:36:17 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:07:19.323 15:36:17 -- nvmf/common.sh@295 -- # net_devs=() 00:07:19.323 15:36:17 -- nvmf/common.sh@295 -- # local -ga net_devs 00:07:19.323 15:36:17 -- nvmf/common.sh@296 -- # e810=() 00:07:19.323 15:36:17 -- nvmf/common.sh@296 -- # local -ga e810 00:07:19.323 15:36:17 -- nvmf/common.sh@297 -- # x722=() 00:07:19.323 15:36:17 -- nvmf/common.sh@297 -- # local -ga x722 00:07:19.323 15:36:17 -- nvmf/common.sh@298 -- # mlx=() 00:07:19.323 15:36:17 -- nvmf/common.sh@298 -- # local -ga mlx 00:07:19.323 15:36:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:19.323 15:36:17 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:19.323 15:36:17 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:19.323 15:36:17 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:19.323 15:36:17 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:19.323 15:36:17 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:19.323 15:36:17 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:19.323 15:36:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:19.323 15:36:17 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:19.323 15:36:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:19.323 15:36:17 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:19.323 15:36:17 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:07:19.323 15:36:17 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:07:19.323 15:36:17 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:07:19.323 15:36:17 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:07:19.323 15:36:17 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:07:19.323 15:36:17 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:07:19.323 15:36:17 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:07:19.323 15:36:17 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:19.323 15:36:17 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:07:19.323 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:07:19.323 15:36:17 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:07:19.323 15:36:17 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:07:19.323 15:36:17 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:07:19.323 15:36:17 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:07:19.323 15:36:17 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:07:19.323 15:36:17 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:07:19.323 15:36:17 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:19.323 15:36:17 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:07:19.323 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:07:19.323 15:36:17 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:07:19.323 15:36:17 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:07:19.323 15:36:17 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:07:19.323 15:36:17 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:07:19.323 15:36:17 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:07:19.323 15:36:17 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:07:19.324 15:36:17 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:07:19.324 15:36:17 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:07:19.324 15:36:17 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:19.324 15:36:17 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:19.324 15:36:17 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:19.324 15:36:17 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:19.324 15:36:17 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:07:19.324 Found net devices under 0000:da:00.0: mlx_0_0 00:07:19.324 15:36:17 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:19.324 15:36:17 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:19.324 15:36:17 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:19.324 15:36:17 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:19.324 15:36:17 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:19.324 15:36:17 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:07:19.324 Found net devices under 0000:da:00.1: mlx_0_1 00:07:19.324 15:36:17 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:19.324 15:36:17 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:07:19.324 15:36:17 -- nvmf/common.sh@403 -- # is_hw=yes 00:07:19.324 15:36:17 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:07:19.324 15:36:17 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:07:19.324 15:36:17 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:07:19.324 15:36:17 -- nvmf/common.sh@409 -- # rdma_device_init 00:07:19.324 15:36:17 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:07:19.324 15:36:17 -- nvmf/common.sh@58 -- # uname 00:07:19.324 15:36:17 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:07:19.324 15:36:17 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:07:19.324 15:36:17 -- nvmf/common.sh@63 -- # modprobe ib_core 00:07:19.324 15:36:17 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:07:19.324 15:36:17 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:07:19.324 15:36:17 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:07:19.324 15:36:17 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:07:19.324 15:36:17 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:07:19.324 15:36:17 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:07:19.324 15:36:17 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:07:19.324 15:36:17 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:07:19.324 15:36:17 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:07:19.324 15:36:17 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:07:19.324 15:36:17 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:07:19.324 15:36:17 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:07:19.324 15:36:17 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:07:19.324 15:36:17 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:19.324 15:36:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:19.324 15:36:17 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:07:19.324 15:36:17 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:07:19.324 15:36:17 -- nvmf/common.sh@105 -- # continue 2 00:07:19.324 15:36:17 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:19.324 15:36:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:19.324 15:36:17 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:07:19.324 15:36:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:19.324 15:36:17 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:07:19.324 15:36:17 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:07:19.324 15:36:17 -- nvmf/common.sh@105 -- # continue 2 00:07:19.324 15:36:17 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:07:19.324 15:36:17 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:07:19.324 15:36:17 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:07:19.324 15:36:17 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:07:19.324 15:36:17 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:19.324 15:36:17 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:19.324 15:36:17 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:07:19.324 15:36:17 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:07:19.324 15:36:17 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:07:19.324 118: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:07:19.324 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:07:19.324 altname enp218s0f0np0 00:07:19.324 altname ens818f0np0 00:07:19.324 inet 192.168.100.8/24 scope global mlx_0_0 00:07:19.324 valid_lft forever preferred_lft forever 00:07:19.324 15:36:17 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:07:19.324 15:36:17 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:07:19.324 15:36:17 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:07:19.324 15:36:17 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:07:19.324 15:36:17 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:19.324 15:36:17 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:19.324 15:36:17 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:07:19.324 15:36:17 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:07:19.324 15:36:17 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:07:19.324 119: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:07:19.324 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:07:19.324 altname enp218s0f1np1 00:07:19.324 altname ens818f1np1 00:07:19.324 inet 192.168.100.9/24 scope global mlx_0_1 00:07:19.324 valid_lft forever preferred_lft forever 00:07:19.324 15:36:17 -- nvmf/common.sh@411 -- # return 0 00:07:19.324 15:36:17 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:07:19.324 15:36:17 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:07:19.324 15:36:17 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:07:19.324 15:36:17 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:07:19.324 15:36:17 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:07:19.324 15:36:17 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:07:19.324 15:36:17 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:07:19.324 15:36:17 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:07:19.324 15:36:17 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:07:19.324 15:36:17 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:07:19.324 15:36:17 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:19.324 15:36:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:19.324 15:36:17 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:07:19.324 15:36:17 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:07:19.324 15:36:17 -- nvmf/common.sh@105 -- # continue 2 00:07:19.324 15:36:17 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:19.324 15:36:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:19.324 15:36:17 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:07:19.324 15:36:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:19.324 15:36:17 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:07:19.324 15:36:17 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:07:19.324 15:36:17 -- nvmf/common.sh@105 -- # continue 2 00:07:19.324 15:36:17 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:07:19.324 15:36:17 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:07:19.324 15:36:17 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:07:19.324 15:36:17 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:07:19.324 15:36:17 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:19.324 15:36:17 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:19.324 15:36:17 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:07:19.324 15:36:17 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:07:19.324 15:36:17 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:07:19.324 15:36:17 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:07:19.324 15:36:17 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:19.324 15:36:17 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:19.324 15:36:17 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:07:19.324 192.168.100.9' 00:07:19.324 15:36:17 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:07:19.324 192.168.100.9' 00:07:19.324 15:36:17 -- nvmf/common.sh@446 -- # head -n 1 00:07:19.324 15:36:17 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:07:19.324 15:36:17 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:07:19.324 192.168.100.9' 00:07:19.324 15:36:17 -- nvmf/common.sh@447 -- # tail -n +2 00:07:19.324 15:36:17 -- nvmf/common.sh@447 -- # head -n 1 00:07:19.324 15:36:17 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:07:19.324 15:36:17 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:07:19.324 15:36:17 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:07:19.324 15:36:17 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:07:19.324 15:36:17 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:07:19.324 15:36:17 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:07:19.324 15:36:17 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:07:19.324 15:36:17 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:07:19.324 15:36:17 -- common/autotest_common.sh@710 -- # xtrace_disable 00:07:19.324 15:36:17 -- common/autotest_common.sh@10 -- # set +x 00:07:19.324 15:36:17 -- nvmf/common.sh@470 -- # nvmfpid=3198602 00:07:19.324 15:36:17 -- nvmf/common.sh@471 -- # waitforlisten 3198602 00:07:19.324 15:36:17 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:19.324 15:36:17 -- common/autotest_common.sh@817 -- # '[' -z 3198602 ']' 00:07:19.324 15:36:17 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:19.324 15:36:17 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:19.324 15:36:17 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:19.324 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:19.324 15:36:17 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:19.324 15:36:17 -- common/autotest_common.sh@10 -- # set +x 00:07:19.324 [2024-04-26 15:36:17.857416] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:07:19.324 [2024-04-26 15:36:17.857461] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:19.324 EAL: No free 2048 kB hugepages reported on node 1 00:07:19.324 [2024-04-26 15:36:17.910631] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:19.597 [2024-04-26 15:36:17.987686] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:19.597 [2024-04-26 15:36:17.987736] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:19.597 [2024-04-26 15:36:17.987742] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:07:19.597 [2024-04-26 15:36:17.987748] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:07:19.597 [2024-04-26 15:36:17.987752] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:19.597 [2024-04-26 15:36:17.987797] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:19.597 [2024-04-26 15:36:17.987885] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:19.597 [2024-04-26 15:36:17.987972] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:19.597 [2024-04-26 15:36:17.987974] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:20.163 15:36:18 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:20.163 15:36:18 -- common/autotest_common.sh@850 -- # return 0 00:07:20.163 15:36:18 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:07:20.163 15:36:18 -- common/autotest_common.sh@716 -- # xtrace_disable 00:07:20.163 15:36:18 -- common/autotest_common.sh@10 -- # set +x 00:07:20.163 15:36:18 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:20.163 15:36:18 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:07:20.164 15:36:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:20.164 15:36:18 -- common/autotest_common.sh@10 -- # set +x 00:07:20.164 [2024-04-26 15:36:18.714281] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xa50100/0xa545f0) succeed. 00:07:20.164 [2024-04-26 15:36:18.724572] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xa51740/0xa95c80) succeed. 00:07:20.422 15:36:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:20.422 15:36:18 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t rdma -a 192.168.100.8 -s 8009 discovery 00:07:20.422 15:36:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:20.422 15:36:18 -- common/autotest_common.sh@10 -- # set +x 00:07:20.422 [2024-04-26 15:36:18.848226] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 8009 *** 00:07:20.422 15:36:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:20.422 15:36:18 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.2 -s 4430 00:07:20.422 15:36:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:20.422 15:36:18 -- common/autotest_common.sh@10 -- # set +x 00:07:20.422 15:36:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:20.422 15:36:18 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.3 -s 4430 00:07:20.422 15:36:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:20.422 15:36:18 -- common/autotest_common.sh@10 -- # set +x 00:07:20.422 15:36:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:20.422 15:36:18 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.4 -s 4430 00:07:20.422 15:36:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:20.422 15:36:18 -- common/autotest_common.sh@10 -- # set +x 00:07:20.422 15:36:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:20.422 15:36:18 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:20.422 15:36:18 -- target/referrals.sh@48 -- # jq length 00:07:20.422 15:36:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:20.422 15:36:18 -- common/autotest_common.sh@10 -- # set +x 00:07:20.422 15:36:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:20.422 15:36:18 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:07:20.422 15:36:18 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:07:20.422 15:36:18 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:20.422 15:36:18 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:20.422 15:36:18 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:20.422 15:36:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:20.422 15:36:18 -- target/referrals.sh@21 -- # sort 00:07:20.422 15:36:18 -- common/autotest_common.sh@10 -- # set +x 00:07:20.422 15:36:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:20.422 15:36:18 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:20.422 15:36:18 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:20.422 15:36:18 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:07:20.422 15:36:18 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:20.422 15:36:18 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:20.422 15:36:18 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:07:20.422 15:36:18 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:20.422 15:36:18 -- target/referrals.sh@26 -- # sort 00:07:20.681 15:36:19 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:20.681 15:36:19 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:20.681 15:36:19 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.2 -s 4430 00:07:20.681 15:36:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:20.681 15:36:19 -- common/autotest_common.sh@10 -- # set +x 00:07:20.681 15:36:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:20.681 15:36:19 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.3 -s 4430 00:07:20.681 15:36:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:20.681 15:36:19 -- common/autotest_common.sh@10 -- # set +x 00:07:20.681 15:36:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:20.681 15:36:19 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.4 -s 4430 00:07:20.681 15:36:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:20.681 15:36:19 -- common/autotest_common.sh@10 -- # set +x 00:07:20.681 15:36:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:20.681 15:36:19 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:20.681 15:36:19 -- target/referrals.sh@56 -- # jq length 00:07:20.681 15:36:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:20.681 15:36:19 -- common/autotest_common.sh@10 -- # set +x 00:07:20.681 15:36:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:20.681 15:36:19 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:07:20.681 15:36:19 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:07:20.681 15:36:19 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:20.681 15:36:19 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:20.681 15:36:19 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:07:20.681 15:36:19 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:20.681 15:36:19 -- target/referrals.sh@26 -- # sort 00:07:20.681 15:36:19 -- target/referrals.sh@26 -- # echo 00:07:20.681 15:36:19 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:07:20.681 15:36:19 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.2 -s 4430 -n discovery 00:07:20.681 15:36:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:20.681 15:36:19 -- common/autotest_common.sh@10 -- # set +x 00:07:20.681 15:36:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:20.681 15:36:19 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:20.681 15:36:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:20.681 15:36:19 -- common/autotest_common.sh@10 -- # set +x 00:07:20.681 15:36:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:20.681 15:36:19 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:07:20.681 15:36:19 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:20.681 15:36:19 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:20.681 15:36:19 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:20.681 15:36:19 -- target/referrals.sh@21 -- # sort 00:07:20.681 15:36:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:20.681 15:36:19 -- common/autotest_common.sh@10 -- # set +x 00:07:20.681 15:36:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:20.940 15:36:19 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:07:20.940 15:36:19 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:20.940 15:36:19 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:07:20.940 15:36:19 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:20.940 15:36:19 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:20.940 15:36:19 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:20.940 15:36:19 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:07:20.940 15:36:19 -- target/referrals.sh@26 -- # sort 00:07:20.940 15:36:19 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:07:20.940 15:36:19 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:20.940 15:36:19 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:07:20.940 15:36:19 -- target/referrals.sh@67 -- # jq -r .subnqn 00:07:20.940 15:36:19 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:20.940 15:36:19 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:07:20.940 15:36:19 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:20.940 15:36:19 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:07:20.940 15:36:19 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:07:20.940 15:36:19 -- target/referrals.sh@68 -- # jq -r .subnqn 00:07:20.940 15:36:19 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:20.940 15:36:19 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:07:20.940 15:36:19 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:21.198 15:36:19 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:21.198 15:36:19 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:21.198 15:36:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:21.198 15:36:19 -- common/autotest_common.sh@10 -- # set +x 00:07:21.198 15:36:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:21.198 15:36:19 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:07:21.198 15:36:19 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:21.198 15:36:19 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:21.198 15:36:19 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:21.198 15:36:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:21.198 15:36:19 -- target/referrals.sh@21 -- # sort 00:07:21.198 15:36:19 -- common/autotest_common.sh@10 -- # set +x 00:07:21.198 15:36:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:21.198 15:36:19 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:07:21.198 15:36:19 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:21.198 15:36:19 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:07:21.198 15:36:19 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:21.198 15:36:19 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:21.198 15:36:19 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:07:21.198 15:36:19 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:21.198 15:36:19 -- target/referrals.sh@26 -- # sort 00:07:21.198 15:36:19 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:07:21.198 15:36:19 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:21.198 15:36:19 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:07:21.198 15:36:19 -- target/referrals.sh@75 -- # jq -r .subnqn 00:07:21.198 15:36:19 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:21.198 15:36:19 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:07:21.198 15:36:19 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:21.456 15:36:19 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:07:21.456 15:36:19 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:07:21.456 15:36:19 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:21.456 15:36:19 -- target/referrals.sh@76 -- # jq -r .subnqn 00:07:21.457 15:36:19 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:07:21.457 15:36:19 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:21.457 15:36:19 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:21.457 15:36:19 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:07:21.457 15:36:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:21.457 15:36:19 -- common/autotest_common.sh@10 -- # set +x 00:07:21.457 15:36:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:21.457 15:36:19 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:21.457 15:36:19 -- target/referrals.sh@82 -- # jq length 00:07:21.457 15:36:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:21.457 15:36:19 -- common/autotest_common.sh@10 -- # set +x 00:07:21.457 15:36:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:21.457 15:36:19 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:07:21.457 15:36:19 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:07:21.457 15:36:19 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:21.457 15:36:19 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:21.457 15:36:19 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:07:21.457 15:36:19 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:21.457 15:36:19 -- target/referrals.sh@26 -- # sort 00:07:21.715 15:36:20 -- target/referrals.sh@26 -- # echo 00:07:21.715 15:36:20 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:07:21.715 15:36:20 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:07:21.715 15:36:20 -- target/referrals.sh@86 -- # nvmftestfini 00:07:21.715 15:36:20 -- nvmf/common.sh@477 -- # nvmfcleanup 00:07:21.715 15:36:20 -- nvmf/common.sh@117 -- # sync 00:07:21.716 15:36:20 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:07:21.716 15:36:20 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:07:21.716 15:36:20 -- nvmf/common.sh@120 -- # set +e 00:07:21.716 15:36:20 -- nvmf/common.sh@121 -- # for i in {1..20} 00:07:21.716 15:36:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:07:21.716 rmmod nvme_rdma 00:07:21.716 rmmod nvme_fabrics 00:07:21.716 15:36:20 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:07:21.716 15:36:20 -- nvmf/common.sh@124 -- # set -e 00:07:21.716 15:36:20 -- nvmf/common.sh@125 -- # return 0 00:07:21.716 15:36:20 -- nvmf/common.sh@478 -- # '[' -n 3198602 ']' 00:07:21.716 15:36:20 -- nvmf/common.sh@479 -- # killprocess 3198602 00:07:21.716 15:36:20 -- common/autotest_common.sh@936 -- # '[' -z 3198602 ']' 00:07:21.716 15:36:20 -- common/autotest_common.sh@940 -- # kill -0 3198602 00:07:21.716 15:36:20 -- common/autotest_common.sh@941 -- # uname 00:07:21.716 15:36:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:21.716 15:36:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3198602 00:07:21.716 15:36:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:21.716 15:36:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:21.716 15:36:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3198602' 00:07:21.716 killing process with pid 3198602 00:07:21.716 15:36:20 -- common/autotest_common.sh@955 -- # kill 3198602 00:07:21.716 15:36:20 -- common/autotest_common.sh@960 -- # wait 3198602 00:07:21.716 [2024-04-26 15:36:20.258244] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:07:21.975 15:36:20 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:07:21.975 15:36:20 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:07:21.975 00:07:21.975 real 0m8.018s 00:07:21.975 user 0m12.035s 00:07:21.975 sys 0m4.615s 00:07:21.975 15:36:20 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:21.975 15:36:20 -- common/autotest_common.sh@10 -- # set +x 00:07:21.975 ************************************ 00:07:21.975 END TEST nvmf_referrals 00:07:21.975 ************************************ 00:07:21.975 15:36:20 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=rdma 00:07:21.975 15:36:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:21.975 15:36:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:21.975 15:36:20 -- common/autotest_common.sh@10 -- # set +x 00:07:22.234 ************************************ 00:07:22.234 START TEST nvmf_connect_disconnect 00:07:22.234 ************************************ 00:07:22.234 15:36:20 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=rdma 00:07:22.234 * Looking for test storage... 00:07:22.234 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:07:22.234 15:36:20 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:07:22.234 15:36:20 -- nvmf/common.sh@7 -- # uname -s 00:07:22.234 15:36:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:22.234 15:36:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:22.234 15:36:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:22.234 15:36:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:22.234 15:36:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:22.234 15:36:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:22.234 15:36:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:22.234 15:36:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:22.234 15:36:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:22.234 15:36:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:22.234 15:36:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:07:22.234 15:36:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:07:22.234 15:36:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:22.234 15:36:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:22.234 15:36:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:22.234 15:36:20 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:07:22.234 15:36:20 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:07:22.234 15:36:20 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:22.234 15:36:20 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:22.234 15:36:20 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:22.234 15:36:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:22.234 15:36:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:22.234 15:36:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:22.234 15:36:20 -- paths/export.sh@5 -- # export PATH 00:07:22.235 15:36:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:22.235 15:36:20 -- nvmf/common.sh@47 -- # : 0 00:07:22.235 15:36:20 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:07:22.235 15:36:20 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:07:22.235 15:36:20 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:07:22.235 15:36:20 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:22.235 15:36:20 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:22.235 15:36:20 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:07:22.235 15:36:20 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:07:22.235 15:36:20 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:07:22.235 15:36:20 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:07:22.235 15:36:20 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:07:22.235 15:36:20 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:07:22.235 15:36:20 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:07:22.235 15:36:20 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:22.235 15:36:20 -- nvmf/common.sh@437 -- # prepare_net_devs 00:07:22.235 15:36:20 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:07:22.235 15:36:20 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:07:22.235 15:36:20 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:22.235 15:36:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:22.235 15:36:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:22.235 15:36:20 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:07:22.235 15:36:20 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:07:22.235 15:36:20 -- nvmf/common.sh@285 -- # xtrace_disable 00:07:22.235 15:36:20 -- common/autotest_common.sh@10 -- # set +x 00:07:28.803 15:36:26 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:28.803 15:36:26 -- nvmf/common.sh@291 -- # pci_devs=() 00:07:28.803 15:36:26 -- nvmf/common.sh@291 -- # local -a pci_devs 00:07:28.803 15:36:26 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:07:28.803 15:36:26 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:07:28.803 15:36:26 -- nvmf/common.sh@293 -- # pci_drivers=() 00:07:28.803 15:36:26 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:07:28.803 15:36:26 -- nvmf/common.sh@295 -- # net_devs=() 00:07:28.803 15:36:26 -- nvmf/common.sh@295 -- # local -ga net_devs 00:07:28.803 15:36:26 -- nvmf/common.sh@296 -- # e810=() 00:07:28.803 15:36:26 -- nvmf/common.sh@296 -- # local -ga e810 00:07:28.803 15:36:26 -- nvmf/common.sh@297 -- # x722=() 00:07:28.803 15:36:26 -- nvmf/common.sh@297 -- # local -ga x722 00:07:28.803 15:36:26 -- nvmf/common.sh@298 -- # mlx=() 00:07:28.803 15:36:26 -- nvmf/common.sh@298 -- # local -ga mlx 00:07:28.803 15:36:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:28.803 15:36:26 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:28.803 15:36:26 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:28.803 15:36:26 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:28.803 15:36:26 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:28.803 15:36:26 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:28.803 15:36:26 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:28.803 15:36:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:28.803 15:36:26 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:28.803 15:36:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:28.803 15:36:26 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:28.803 15:36:26 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:07:28.803 15:36:26 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:07:28.803 15:36:26 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:07:28.803 15:36:26 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:07:28.803 15:36:26 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:07:28.803 15:36:26 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:07:28.803 15:36:26 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:07:28.803 15:36:26 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:28.803 15:36:26 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:07:28.803 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:07:28.803 15:36:26 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:07:28.803 15:36:26 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:07:28.803 15:36:26 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:07:28.803 15:36:26 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:07:28.803 15:36:26 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:07:28.803 15:36:26 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:07:28.803 15:36:26 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:28.803 15:36:26 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:07:28.803 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:07:28.803 15:36:26 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:07:28.803 15:36:26 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:07:28.803 15:36:26 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:07:28.803 15:36:26 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:07:28.803 15:36:26 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:07:28.803 15:36:26 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:07:28.803 15:36:26 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:07:28.803 15:36:26 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:07:28.803 15:36:26 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:28.803 15:36:26 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:28.803 15:36:26 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:28.803 15:36:26 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:28.803 15:36:26 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:07:28.803 Found net devices under 0000:da:00.0: mlx_0_0 00:07:28.803 15:36:26 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:28.803 15:36:26 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:28.803 15:36:26 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:28.803 15:36:26 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:28.803 15:36:26 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:28.803 15:36:26 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:07:28.803 Found net devices under 0000:da:00.1: mlx_0_1 00:07:28.803 15:36:26 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:28.803 15:36:26 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:07:28.803 15:36:26 -- nvmf/common.sh@403 -- # is_hw=yes 00:07:28.803 15:36:26 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:07:28.803 15:36:26 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:07:28.803 15:36:26 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:07:28.803 15:36:26 -- nvmf/common.sh@409 -- # rdma_device_init 00:07:28.803 15:36:26 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:07:28.803 15:36:26 -- nvmf/common.sh@58 -- # uname 00:07:28.803 15:36:26 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:07:28.803 15:36:26 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:07:28.803 15:36:26 -- nvmf/common.sh@63 -- # modprobe ib_core 00:07:28.803 15:36:26 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:07:28.803 15:36:26 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:07:28.803 15:36:26 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:07:28.803 15:36:26 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:07:28.803 15:36:26 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:07:28.803 15:36:26 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:07:28.803 15:36:26 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:07:28.803 15:36:26 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:07:28.803 15:36:26 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:07:28.803 15:36:26 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:07:28.803 15:36:26 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:07:28.803 15:36:26 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:07:28.803 15:36:26 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:07:28.803 15:36:26 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:28.803 15:36:26 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:28.803 15:36:26 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:07:28.803 15:36:26 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:07:28.803 15:36:26 -- nvmf/common.sh@105 -- # continue 2 00:07:28.803 15:36:26 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:28.803 15:36:26 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:28.803 15:36:26 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:07:28.803 15:36:26 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:28.803 15:36:26 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:07:28.803 15:36:26 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:07:28.803 15:36:26 -- nvmf/common.sh@105 -- # continue 2 00:07:28.803 15:36:26 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:07:28.803 15:36:26 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:07:28.803 15:36:26 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:07:28.803 15:36:26 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:07:28.803 15:36:26 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:28.803 15:36:26 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:28.803 15:36:26 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:07:28.803 15:36:26 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:07:28.803 15:36:26 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:07:28.803 118: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:07:28.803 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:07:28.803 altname enp218s0f0np0 00:07:28.803 altname ens818f0np0 00:07:28.803 inet 192.168.100.8/24 scope global mlx_0_0 00:07:28.804 valid_lft forever preferred_lft forever 00:07:28.804 15:36:26 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:07:28.804 15:36:26 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:07:28.804 15:36:26 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:07:28.804 15:36:26 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:28.804 15:36:26 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:07:28.804 15:36:26 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:28.804 15:36:26 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:07:28.804 15:36:26 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:07:28.804 15:36:26 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:07:28.804 119: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:07:28.804 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:07:28.804 altname enp218s0f1np1 00:07:28.804 altname ens818f1np1 00:07:28.804 inet 192.168.100.9/24 scope global mlx_0_1 00:07:28.804 valid_lft forever preferred_lft forever 00:07:28.804 15:36:26 -- nvmf/common.sh@411 -- # return 0 00:07:28.804 15:36:26 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:07:28.804 15:36:26 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:07:28.804 15:36:26 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:07:28.804 15:36:26 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:07:28.804 15:36:26 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:07:28.804 15:36:26 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:07:28.804 15:36:26 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:07:28.804 15:36:26 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:07:28.804 15:36:26 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:07:28.804 15:36:26 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:07:28.804 15:36:26 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:28.804 15:36:26 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:28.804 15:36:26 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:07:28.804 15:36:26 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:07:28.804 15:36:26 -- nvmf/common.sh@105 -- # continue 2 00:07:28.804 15:36:26 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:28.804 15:36:26 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:28.804 15:36:26 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:07:28.804 15:36:26 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:28.804 15:36:26 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:07:28.804 15:36:26 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:07:28.804 15:36:26 -- nvmf/common.sh@105 -- # continue 2 00:07:28.804 15:36:26 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:07:28.804 15:36:26 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:07:28.804 15:36:26 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:07:28.804 15:36:26 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:07:28.804 15:36:26 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:28.804 15:36:26 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:28.804 15:36:26 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:07:28.804 15:36:26 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:07:28.804 15:36:26 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:07:28.804 15:36:26 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:07:28.804 15:36:26 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:28.804 15:36:26 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:28.804 15:36:26 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:07:28.804 192.168.100.9' 00:07:28.804 15:36:26 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:07:28.804 192.168.100.9' 00:07:28.804 15:36:26 -- nvmf/common.sh@446 -- # head -n 1 00:07:28.804 15:36:26 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:07:28.804 15:36:26 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:07:28.804 192.168.100.9' 00:07:28.804 15:36:26 -- nvmf/common.sh@447 -- # tail -n +2 00:07:28.804 15:36:26 -- nvmf/common.sh@447 -- # head -n 1 00:07:28.804 15:36:26 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:07:28.804 15:36:26 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:07:28.804 15:36:26 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:07:28.804 15:36:26 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:07:28.804 15:36:26 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:07:28.804 15:36:26 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:07:28.804 15:36:26 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:07:28.804 15:36:26 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:07:28.804 15:36:26 -- common/autotest_common.sh@710 -- # xtrace_disable 00:07:28.804 15:36:26 -- common/autotest_common.sh@10 -- # set +x 00:07:28.804 15:36:26 -- nvmf/common.sh@470 -- # nvmfpid=3202235 00:07:28.804 15:36:26 -- nvmf/common.sh@471 -- # waitforlisten 3202235 00:07:28.804 15:36:26 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:28.804 15:36:26 -- common/autotest_common.sh@817 -- # '[' -z 3202235 ']' 00:07:28.804 15:36:26 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:28.804 15:36:26 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:28.804 15:36:26 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:28.804 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:28.804 15:36:26 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:28.804 15:36:26 -- common/autotest_common.sh@10 -- # set +x 00:07:28.804 [2024-04-26 15:36:26.478100] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:07:28.804 [2024-04-26 15:36:26.478154] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:28.804 EAL: No free 2048 kB hugepages reported on node 1 00:07:28.804 [2024-04-26 15:36:26.532305] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:28.804 [2024-04-26 15:36:26.601969] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:28.804 [2024-04-26 15:36:26.602011] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:28.804 [2024-04-26 15:36:26.602017] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:07:28.804 [2024-04-26 15:36:26.602023] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:07:28.804 [2024-04-26 15:36:26.602027] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:28.804 [2024-04-26 15:36:26.602081] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:28.804 [2024-04-26 15:36:26.602181] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:28.804 [2024-04-26 15:36:26.602235] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:28.804 [2024-04-26 15:36:26.602236] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:28.804 15:36:27 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:28.804 15:36:27 -- common/autotest_common.sh@850 -- # return 0 00:07:28.804 15:36:27 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:07:28.804 15:36:27 -- common/autotest_common.sh@716 -- # xtrace_disable 00:07:28.804 15:36:27 -- common/autotest_common.sh@10 -- # set +x 00:07:28.804 15:36:27 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:28.804 15:36:27 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -c 0 00:07:28.804 15:36:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:28.804 15:36:27 -- common/autotest_common.sh@10 -- # set +x 00:07:28.804 [2024-04-26 15:36:27.337188] rdma.c:2712:nvmf_rdma_create: *WARNING*: In capsule data size is set to 256, this is minimum size required to support msdbd=16 00:07:28.804 [2024-04-26 15:36:27.358419] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xb8c100/0xb905f0) succeed. 00:07:28.804 [2024-04-26 15:36:27.368837] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xb8d740/0xbd1c80) succeed. 00:07:29.063 15:36:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:29.063 15:36:27 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:07:29.063 15:36:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:29.063 15:36:27 -- common/autotest_common.sh@10 -- # set +x 00:07:29.063 15:36:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:29.063 15:36:27 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:07:29.063 15:36:27 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:29.063 15:36:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:29.063 15:36:27 -- common/autotest_common.sh@10 -- # set +x 00:07:29.063 15:36:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:29.063 15:36:27 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:29.063 15:36:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:29.063 15:36:27 -- common/autotest_common.sh@10 -- # set +x 00:07:29.063 15:36:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:29.063 15:36:27 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:07:29.063 15:36:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:29.063 15:36:27 -- common/autotest_common.sh@10 -- # set +x 00:07:29.063 [2024-04-26 15:36:27.508760] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:07:29.063 15:36:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:29.063 15:36:27 -- target/connect_disconnect.sh@26 -- # '[' 0 -eq 1 ']' 00:07:29.063 15:36:27 -- target/connect_disconnect.sh@31 -- # num_iterations=5 00:07:29.063 15:36:27 -- target/connect_disconnect.sh@34 -- # set +x 00:07:33.246 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:37.455 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:41.639 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:44.920 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:49.104 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:49.104 15:36:47 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:07:49.104 15:36:47 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:07:49.104 15:36:47 -- nvmf/common.sh@477 -- # nvmfcleanup 00:07:49.104 15:36:47 -- nvmf/common.sh@117 -- # sync 00:07:49.104 15:36:47 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:07:49.104 15:36:47 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:07:49.104 15:36:47 -- nvmf/common.sh@120 -- # set +e 00:07:49.104 15:36:47 -- nvmf/common.sh@121 -- # for i in {1..20} 00:07:49.104 15:36:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:07:49.104 rmmod nvme_rdma 00:07:49.104 rmmod nvme_fabrics 00:07:49.104 15:36:47 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:07:49.104 15:36:47 -- nvmf/common.sh@124 -- # set -e 00:07:49.104 15:36:47 -- nvmf/common.sh@125 -- # return 0 00:07:49.104 15:36:47 -- nvmf/common.sh@478 -- # '[' -n 3202235 ']' 00:07:49.104 15:36:47 -- nvmf/common.sh@479 -- # killprocess 3202235 00:07:49.104 15:36:47 -- common/autotest_common.sh@936 -- # '[' -z 3202235 ']' 00:07:49.104 15:36:47 -- common/autotest_common.sh@940 -- # kill -0 3202235 00:07:49.104 15:36:47 -- common/autotest_common.sh@941 -- # uname 00:07:49.104 15:36:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:49.104 15:36:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3202235 00:07:49.104 15:36:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:49.104 15:36:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:49.104 15:36:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3202235' 00:07:49.104 killing process with pid 3202235 00:07:49.104 15:36:47 -- common/autotest_common.sh@955 -- # kill 3202235 00:07:49.104 15:36:47 -- common/autotest_common.sh@960 -- # wait 3202235 00:07:49.104 [2024-04-26 15:36:47.468319] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:07:49.104 15:36:47 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:07:49.104 15:36:47 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:07:49.104 00:07:49.104 real 0m27.075s 00:07:49.104 user 1m25.404s 00:07:49.104 sys 0m5.186s 00:07:49.104 15:36:47 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:49.104 15:36:47 -- common/autotest_common.sh@10 -- # set +x 00:07:49.104 ************************************ 00:07:49.104 END TEST nvmf_connect_disconnect 00:07:49.104 ************************************ 00:07:49.363 15:36:47 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=rdma 00:07:49.363 15:36:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:49.363 15:36:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:49.363 15:36:47 -- common/autotest_common.sh@10 -- # set +x 00:07:49.363 ************************************ 00:07:49.363 START TEST nvmf_multitarget 00:07:49.363 ************************************ 00:07:49.363 15:36:47 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=rdma 00:07:49.363 * Looking for test storage... 00:07:49.363 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:07:49.363 15:36:47 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:07:49.363 15:36:47 -- nvmf/common.sh@7 -- # uname -s 00:07:49.363 15:36:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:49.363 15:36:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:49.363 15:36:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:49.363 15:36:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:49.363 15:36:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:49.363 15:36:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:49.363 15:36:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:49.363 15:36:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:49.363 15:36:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:49.622 15:36:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:49.622 15:36:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:07:49.622 15:36:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:07:49.622 15:36:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:49.622 15:36:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:49.622 15:36:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:49.622 15:36:47 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:07:49.622 15:36:47 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:07:49.622 15:36:47 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:49.622 15:36:47 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:49.622 15:36:47 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:49.622 15:36:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:49.622 15:36:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:49.622 15:36:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:49.622 15:36:47 -- paths/export.sh@5 -- # export PATH 00:07:49.622 15:36:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:49.622 15:36:47 -- nvmf/common.sh@47 -- # : 0 00:07:49.622 15:36:47 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:07:49.622 15:36:47 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:07:49.622 15:36:47 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:07:49.622 15:36:47 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:49.622 15:36:47 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:49.622 15:36:47 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:07:49.622 15:36:47 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:07:49.622 15:36:47 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:07:49.622 15:36:47 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:07:49.622 15:36:47 -- target/multitarget.sh@15 -- # nvmftestinit 00:07:49.622 15:36:47 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:07:49.622 15:36:47 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:49.622 15:36:47 -- nvmf/common.sh@437 -- # prepare_net_devs 00:07:49.622 15:36:47 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:07:49.622 15:36:47 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:07:49.622 15:36:47 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:49.622 15:36:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:49.622 15:36:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:49.622 15:36:47 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:07:49.622 15:36:47 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:07:49.622 15:36:47 -- nvmf/common.sh@285 -- # xtrace_disable 00:07:49.622 15:36:47 -- common/autotest_common.sh@10 -- # set +x 00:07:54.891 15:36:53 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:54.891 15:36:53 -- nvmf/common.sh@291 -- # pci_devs=() 00:07:54.891 15:36:53 -- nvmf/common.sh@291 -- # local -a pci_devs 00:07:54.891 15:36:53 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:07:54.891 15:36:53 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:07:54.891 15:36:53 -- nvmf/common.sh@293 -- # pci_drivers=() 00:07:54.891 15:36:53 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:07:54.891 15:36:53 -- nvmf/common.sh@295 -- # net_devs=() 00:07:54.891 15:36:53 -- nvmf/common.sh@295 -- # local -ga net_devs 00:07:54.891 15:36:53 -- nvmf/common.sh@296 -- # e810=() 00:07:54.891 15:36:53 -- nvmf/common.sh@296 -- # local -ga e810 00:07:54.891 15:36:53 -- nvmf/common.sh@297 -- # x722=() 00:07:54.891 15:36:53 -- nvmf/common.sh@297 -- # local -ga x722 00:07:54.891 15:36:53 -- nvmf/common.sh@298 -- # mlx=() 00:07:54.891 15:36:53 -- nvmf/common.sh@298 -- # local -ga mlx 00:07:54.891 15:36:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:54.891 15:36:53 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:54.891 15:36:53 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:54.891 15:36:53 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:54.891 15:36:53 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:54.891 15:36:53 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:54.891 15:36:53 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:54.891 15:36:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:54.891 15:36:53 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:54.891 15:36:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:54.891 15:36:53 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:54.891 15:36:53 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:07:54.891 15:36:53 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:07:54.891 15:36:53 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:07:54.891 15:36:53 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:07:54.891 15:36:53 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:07:54.891 15:36:53 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:07:54.891 15:36:53 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:07:54.891 15:36:53 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:54.891 15:36:53 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:07:54.891 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:07:54.891 15:36:53 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:07:54.891 15:36:53 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:07:54.891 15:36:53 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:07:54.891 15:36:53 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:07:54.891 15:36:53 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:07:54.891 15:36:53 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:07:54.891 15:36:53 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:54.891 15:36:53 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:07:54.891 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:07:54.891 15:36:53 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:07:54.891 15:36:53 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:07:54.891 15:36:53 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:07:54.891 15:36:53 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:07:54.891 15:36:53 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:07:54.891 15:36:53 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:07:54.891 15:36:53 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:07:54.891 15:36:53 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:07:54.891 15:36:53 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:54.891 15:36:53 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:54.891 15:36:53 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:54.891 15:36:53 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:54.891 15:36:53 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:07:54.891 Found net devices under 0000:da:00.0: mlx_0_0 00:07:54.891 15:36:53 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:54.891 15:36:53 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:54.891 15:36:53 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:54.891 15:36:53 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:54.891 15:36:53 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:54.891 15:36:53 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:07:54.891 Found net devices under 0000:da:00.1: mlx_0_1 00:07:54.891 15:36:53 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:54.891 15:36:53 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:07:54.891 15:36:53 -- nvmf/common.sh@403 -- # is_hw=yes 00:07:54.891 15:36:53 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:07:54.891 15:36:53 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:07:54.891 15:36:53 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:07:54.891 15:36:53 -- nvmf/common.sh@409 -- # rdma_device_init 00:07:54.891 15:36:53 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:07:54.891 15:36:53 -- nvmf/common.sh@58 -- # uname 00:07:54.892 15:36:53 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:07:54.892 15:36:53 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:07:54.892 15:36:53 -- nvmf/common.sh@63 -- # modprobe ib_core 00:07:54.892 15:36:53 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:07:54.892 15:36:53 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:07:54.892 15:36:53 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:07:54.892 15:36:53 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:07:54.892 15:36:53 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:07:54.892 15:36:53 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:07:54.892 15:36:53 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:07:54.892 15:36:53 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:07:54.892 15:36:53 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:07:54.892 15:36:53 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:07:54.892 15:36:53 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:07:54.892 15:36:53 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:07:54.892 15:36:53 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:07:54.892 15:36:53 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:54.892 15:36:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:54.892 15:36:53 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:07:54.892 15:36:53 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:07:54.892 15:36:53 -- nvmf/common.sh@105 -- # continue 2 00:07:54.892 15:36:53 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:54.892 15:36:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:54.892 15:36:53 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:07:54.892 15:36:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:54.892 15:36:53 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:07:54.892 15:36:53 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:07:54.892 15:36:53 -- nvmf/common.sh@105 -- # continue 2 00:07:54.892 15:36:53 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:07:54.892 15:36:53 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:07:54.892 15:36:53 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:07:54.892 15:36:53 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:07:54.892 15:36:53 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:54.892 15:36:53 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:54.892 15:36:53 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:07:54.892 15:36:53 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:07:54.892 15:36:53 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:07:54.892 118: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:07:54.892 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:07:54.892 altname enp218s0f0np0 00:07:54.892 altname ens818f0np0 00:07:54.892 inet 192.168.100.8/24 scope global mlx_0_0 00:07:54.892 valid_lft forever preferred_lft forever 00:07:54.892 15:36:53 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:07:54.892 15:36:53 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:07:54.892 15:36:53 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:07:54.892 15:36:53 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:07:54.892 15:36:53 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:54.892 15:36:53 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:54.892 15:36:53 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:07:54.892 15:36:53 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:07:54.892 15:36:53 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:07:54.892 119: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:07:54.892 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:07:54.892 altname enp218s0f1np1 00:07:54.892 altname ens818f1np1 00:07:54.892 inet 192.168.100.9/24 scope global mlx_0_1 00:07:54.892 valid_lft forever preferred_lft forever 00:07:54.892 15:36:53 -- nvmf/common.sh@411 -- # return 0 00:07:54.892 15:36:53 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:07:54.892 15:36:53 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:07:54.892 15:36:53 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:07:54.892 15:36:53 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:07:54.892 15:36:53 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:07:54.892 15:36:53 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:07:54.892 15:36:53 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:07:54.892 15:36:53 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:07:54.892 15:36:53 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:07:54.892 15:36:53 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:07:54.892 15:36:53 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:54.892 15:36:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:54.892 15:36:53 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:07:54.892 15:36:53 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:07:54.892 15:36:53 -- nvmf/common.sh@105 -- # continue 2 00:07:54.892 15:36:53 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:54.892 15:36:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:54.892 15:36:53 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:07:54.892 15:36:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:54.892 15:36:53 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:07:54.892 15:36:53 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:07:54.892 15:36:53 -- nvmf/common.sh@105 -- # continue 2 00:07:54.892 15:36:53 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:07:54.892 15:36:53 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:07:54.892 15:36:53 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:07:54.892 15:36:53 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:07:54.892 15:36:53 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:54.892 15:36:53 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:54.892 15:36:53 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:07:54.892 15:36:53 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:07:54.892 15:36:53 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:07:54.892 15:36:53 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:07:54.892 15:36:53 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:54.892 15:36:53 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:54.892 15:36:53 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:07:54.892 192.168.100.9' 00:07:54.892 15:36:53 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:07:54.892 192.168.100.9' 00:07:54.892 15:36:53 -- nvmf/common.sh@446 -- # head -n 1 00:07:54.892 15:36:53 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:07:54.892 15:36:53 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:07:54.892 192.168.100.9' 00:07:54.892 15:36:53 -- nvmf/common.sh@447 -- # tail -n +2 00:07:54.892 15:36:53 -- nvmf/common.sh@447 -- # head -n 1 00:07:54.892 15:36:53 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:07:54.892 15:36:53 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:07:54.892 15:36:53 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:07:54.892 15:36:53 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:07:54.892 15:36:53 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:07:54.892 15:36:53 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:07:54.892 15:36:53 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:07:54.892 15:36:53 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:07:54.892 15:36:53 -- common/autotest_common.sh@710 -- # xtrace_disable 00:07:54.892 15:36:53 -- common/autotest_common.sh@10 -- # set +x 00:07:54.892 15:36:53 -- nvmf/common.sh@470 -- # nvmfpid=3208874 00:07:54.892 15:36:53 -- nvmf/common.sh@471 -- # waitforlisten 3208874 00:07:54.892 15:36:53 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:54.892 15:36:53 -- common/autotest_common.sh@817 -- # '[' -z 3208874 ']' 00:07:54.892 15:36:53 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:54.892 15:36:53 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:54.892 15:36:53 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:54.892 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:54.892 15:36:53 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:54.892 15:36:53 -- common/autotest_common.sh@10 -- # set +x 00:07:54.892 [2024-04-26 15:36:53.438730] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:07:54.892 [2024-04-26 15:36:53.438780] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:54.892 EAL: No free 2048 kB hugepages reported on node 1 00:07:55.149 [2024-04-26 15:36:53.496314] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:55.149 [2024-04-26 15:36:53.571213] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:55.150 [2024-04-26 15:36:53.571256] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:55.150 [2024-04-26 15:36:53.571263] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:07:55.150 [2024-04-26 15:36:53.571269] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:07:55.150 [2024-04-26 15:36:53.571274] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:55.150 [2024-04-26 15:36:53.571319] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:55.150 [2024-04-26 15:36:53.571398] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:55.150 [2024-04-26 15:36:53.571483] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:55.150 [2024-04-26 15:36:53.571484] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:55.713 15:36:54 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:55.713 15:36:54 -- common/autotest_common.sh@850 -- # return 0 00:07:55.713 15:36:54 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:07:55.713 15:36:54 -- common/autotest_common.sh@716 -- # xtrace_disable 00:07:55.713 15:36:54 -- common/autotest_common.sh@10 -- # set +x 00:07:55.713 15:36:54 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:55.713 15:36:54 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:07:55.713 15:36:54 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:07:55.713 15:36:54 -- target/multitarget.sh@21 -- # jq length 00:07:55.971 15:36:54 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:07:55.971 15:36:54 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:07:55.971 "nvmf_tgt_1" 00:07:55.971 15:36:54 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:07:55.971 "nvmf_tgt_2" 00:07:56.229 15:36:54 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:07:56.229 15:36:54 -- target/multitarget.sh@28 -- # jq length 00:07:56.229 15:36:54 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:07:56.229 15:36:54 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:07:56.229 true 00:07:56.229 15:36:54 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:07:56.486 true 00:07:56.486 15:36:54 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:07:56.486 15:36:54 -- target/multitarget.sh@35 -- # jq length 00:07:56.486 15:36:54 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:07:56.486 15:36:54 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:07:56.486 15:36:54 -- target/multitarget.sh@41 -- # nvmftestfini 00:07:56.486 15:36:54 -- nvmf/common.sh@477 -- # nvmfcleanup 00:07:56.486 15:36:54 -- nvmf/common.sh@117 -- # sync 00:07:56.486 15:36:55 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:07:56.486 15:36:55 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:07:56.486 15:36:55 -- nvmf/common.sh@120 -- # set +e 00:07:56.486 15:36:55 -- nvmf/common.sh@121 -- # for i in {1..20} 00:07:56.486 15:36:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:07:56.486 rmmod nvme_rdma 00:07:56.486 rmmod nvme_fabrics 00:07:56.486 15:36:55 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:07:56.486 15:36:55 -- nvmf/common.sh@124 -- # set -e 00:07:56.486 15:36:55 -- nvmf/common.sh@125 -- # return 0 00:07:56.486 15:36:55 -- nvmf/common.sh@478 -- # '[' -n 3208874 ']' 00:07:56.486 15:36:55 -- nvmf/common.sh@479 -- # killprocess 3208874 00:07:56.486 15:36:55 -- common/autotest_common.sh@936 -- # '[' -z 3208874 ']' 00:07:56.486 15:36:55 -- common/autotest_common.sh@940 -- # kill -0 3208874 00:07:56.486 15:36:55 -- common/autotest_common.sh@941 -- # uname 00:07:56.486 15:36:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:56.486 15:36:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3208874 00:07:56.745 15:36:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:56.745 15:36:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:56.745 15:36:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3208874' 00:07:56.745 killing process with pid 3208874 00:07:56.745 15:36:55 -- common/autotest_common.sh@955 -- # kill 3208874 00:07:56.745 15:36:55 -- common/autotest_common.sh@960 -- # wait 3208874 00:07:56.745 15:36:55 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:07:56.745 15:36:55 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:07:56.745 00:07:56.745 real 0m7.438s 00:07:56.745 user 0m9.126s 00:07:56.745 sys 0m4.530s 00:07:56.745 15:36:55 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:56.745 15:36:55 -- common/autotest_common.sh@10 -- # set +x 00:07:56.745 ************************************ 00:07:56.745 END TEST nvmf_multitarget 00:07:56.745 ************************************ 00:07:56.745 15:36:55 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=rdma 00:07:56.745 15:36:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:56.745 15:36:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:56.745 15:36:55 -- common/autotest_common.sh@10 -- # set +x 00:07:57.004 ************************************ 00:07:57.004 START TEST nvmf_rpc 00:07:57.004 ************************************ 00:07:57.004 15:36:55 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=rdma 00:07:57.004 * Looking for test storage... 00:07:57.004 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:07:57.004 15:36:55 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:07:57.004 15:36:55 -- nvmf/common.sh@7 -- # uname -s 00:07:57.004 15:36:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:57.004 15:36:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:57.004 15:36:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:57.004 15:36:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:57.004 15:36:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:57.004 15:36:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:57.004 15:36:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:57.004 15:36:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:57.004 15:36:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:57.004 15:36:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:57.004 15:36:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:07:57.004 15:36:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:07:57.004 15:36:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:57.004 15:36:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:57.004 15:36:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:57.004 15:36:55 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:07:57.004 15:36:55 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:07:57.004 15:36:55 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:57.004 15:36:55 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:57.004 15:36:55 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:57.004 15:36:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:57.004 15:36:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:57.004 15:36:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:57.004 15:36:55 -- paths/export.sh@5 -- # export PATH 00:07:57.004 15:36:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:57.004 15:36:55 -- nvmf/common.sh@47 -- # : 0 00:07:57.004 15:36:55 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:07:57.004 15:36:55 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:07:57.004 15:36:55 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:07:57.004 15:36:55 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:57.004 15:36:55 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:57.004 15:36:55 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:07:57.004 15:36:55 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:07:57.004 15:36:55 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:07:57.004 15:36:55 -- target/rpc.sh@11 -- # loops=5 00:07:57.004 15:36:55 -- target/rpc.sh@23 -- # nvmftestinit 00:07:57.004 15:36:55 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:07:57.004 15:36:55 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:57.004 15:36:55 -- nvmf/common.sh@437 -- # prepare_net_devs 00:07:57.004 15:36:55 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:07:57.004 15:36:55 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:07:57.004 15:36:55 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:57.004 15:36:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:57.004 15:36:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:57.004 15:36:55 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:07:57.004 15:36:55 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:07:57.004 15:36:55 -- nvmf/common.sh@285 -- # xtrace_disable 00:07:57.004 15:36:55 -- common/autotest_common.sh@10 -- # set +x 00:08:02.275 15:37:00 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:02.275 15:37:00 -- nvmf/common.sh@291 -- # pci_devs=() 00:08:02.275 15:37:00 -- nvmf/common.sh@291 -- # local -a pci_devs 00:08:02.275 15:37:00 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:08:02.275 15:37:00 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:08:02.275 15:37:00 -- nvmf/common.sh@293 -- # pci_drivers=() 00:08:02.276 15:37:00 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:08:02.276 15:37:00 -- nvmf/common.sh@295 -- # net_devs=() 00:08:02.276 15:37:00 -- nvmf/common.sh@295 -- # local -ga net_devs 00:08:02.276 15:37:00 -- nvmf/common.sh@296 -- # e810=() 00:08:02.276 15:37:00 -- nvmf/common.sh@296 -- # local -ga e810 00:08:02.276 15:37:00 -- nvmf/common.sh@297 -- # x722=() 00:08:02.276 15:37:00 -- nvmf/common.sh@297 -- # local -ga x722 00:08:02.276 15:37:00 -- nvmf/common.sh@298 -- # mlx=() 00:08:02.276 15:37:00 -- nvmf/common.sh@298 -- # local -ga mlx 00:08:02.276 15:37:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:02.276 15:37:00 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:02.276 15:37:00 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:02.276 15:37:00 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:02.276 15:37:00 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:02.276 15:37:00 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:02.276 15:37:00 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:02.276 15:37:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:02.276 15:37:00 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:02.276 15:37:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:02.276 15:37:00 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:02.276 15:37:00 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:08:02.276 15:37:00 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:08:02.276 15:37:00 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:08:02.276 15:37:00 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:08:02.276 15:37:00 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:08:02.276 15:37:00 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:08:02.276 15:37:00 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:08:02.276 15:37:00 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:02.276 15:37:00 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:08:02.276 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:08:02.276 15:37:00 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:02.276 15:37:00 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:02.276 15:37:00 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:02.276 15:37:00 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:02.276 15:37:00 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:02.276 15:37:00 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:02.276 15:37:00 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:02.276 15:37:00 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:08:02.276 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:08:02.276 15:37:00 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:02.276 15:37:00 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:02.276 15:37:00 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:02.276 15:37:00 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:02.276 15:37:00 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:02.276 15:37:00 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:02.276 15:37:00 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:08:02.276 15:37:00 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:08:02.276 15:37:00 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:02.276 15:37:00 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:02.276 15:37:00 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:02.276 15:37:00 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:02.276 15:37:00 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:08:02.276 Found net devices under 0000:da:00.0: mlx_0_0 00:08:02.276 15:37:00 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:02.276 15:37:00 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:02.276 15:37:00 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:02.276 15:37:00 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:02.276 15:37:00 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:02.276 15:37:00 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:08:02.276 Found net devices under 0000:da:00.1: mlx_0_1 00:08:02.276 15:37:00 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:02.276 15:37:00 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:08:02.276 15:37:00 -- nvmf/common.sh@403 -- # is_hw=yes 00:08:02.276 15:37:00 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:08:02.276 15:37:00 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:08:02.276 15:37:00 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:08:02.276 15:37:00 -- nvmf/common.sh@409 -- # rdma_device_init 00:08:02.276 15:37:00 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:08:02.276 15:37:00 -- nvmf/common.sh@58 -- # uname 00:08:02.276 15:37:00 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:08:02.276 15:37:00 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:08:02.276 15:37:00 -- nvmf/common.sh@63 -- # modprobe ib_core 00:08:02.276 15:37:00 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:08:02.276 15:37:00 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:08:02.276 15:37:00 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:08:02.276 15:37:00 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:08:02.276 15:37:00 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:08:02.276 15:37:00 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:08:02.276 15:37:00 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:08:02.276 15:37:00 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:08:02.276 15:37:00 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:02.276 15:37:00 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:02.276 15:37:00 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:02.276 15:37:00 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:02.276 15:37:00 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:02.276 15:37:00 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:02.276 15:37:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:02.276 15:37:00 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:02.276 15:37:00 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:02.276 15:37:00 -- nvmf/common.sh@105 -- # continue 2 00:08:02.276 15:37:00 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:02.276 15:37:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:02.276 15:37:00 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:02.276 15:37:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:02.276 15:37:00 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:02.276 15:37:00 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:02.276 15:37:00 -- nvmf/common.sh@105 -- # continue 2 00:08:02.276 15:37:00 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:02.276 15:37:00 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:08:02.276 15:37:00 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:02.276 15:37:00 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:02.276 15:37:00 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:02.276 15:37:00 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:02.276 15:37:00 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:08:02.276 15:37:00 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:08:02.276 15:37:00 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:08:02.548 118: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:02.548 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:08:02.548 altname enp218s0f0np0 00:08:02.548 altname ens818f0np0 00:08:02.548 inet 192.168.100.8/24 scope global mlx_0_0 00:08:02.548 valid_lft forever preferred_lft forever 00:08:02.548 15:37:00 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:02.548 15:37:00 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:08:02.548 15:37:00 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:02.548 15:37:00 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:02.548 15:37:00 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:02.548 15:37:00 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:02.548 15:37:00 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:08:02.548 15:37:00 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:08:02.548 15:37:00 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:08:02.548 119: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:02.548 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:08:02.548 altname enp218s0f1np1 00:08:02.548 altname ens818f1np1 00:08:02.548 inet 192.168.100.9/24 scope global mlx_0_1 00:08:02.548 valid_lft forever preferred_lft forever 00:08:02.548 15:37:00 -- nvmf/common.sh@411 -- # return 0 00:08:02.548 15:37:00 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:08:02.548 15:37:00 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:08:02.548 15:37:00 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:08:02.548 15:37:00 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:08:02.548 15:37:00 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:08:02.548 15:37:00 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:02.548 15:37:00 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:02.548 15:37:00 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:02.548 15:37:00 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:02.548 15:37:00 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:02.548 15:37:00 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:02.548 15:37:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:02.548 15:37:00 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:02.548 15:37:00 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:02.548 15:37:00 -- nvmf/common.sh@105 -- # continue 2 00:08:02.548 15:37:00 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:02.548 15:37:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:02.548 15:37:00 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:02.548 15:37:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:02.548 15:37:00 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:02.548 15:37:00 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:02.548 15:37:00 -- nvmf/common.sh@105 -- # continue 2 00:08:02.548 15:37:00 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:02.548 15:37:00 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:08:02.548 15:37:00 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:02.548 15:37:00 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:02.548 15:37:00 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:02.548 15:37:00 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:02.548 15:37:00 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:02.548 15:37:00 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:08:02.548 15:37:00 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:02.548 15:37:00 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:02.548 15:37:00 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:02.548 15:37:00 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:02.548 15:37:00 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:08:02.548 192.168.100.9' 00:08:02.548 15:37:00 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:08:02.548 192.168.100.9' 00:08:02.548 15:37:00 -- nvmf/common.sh@446 -- # head -n 1 00:08:02.548 15:37:00 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:08:02.548 15:37:00 -- nvmf/common.sh@447 -- # tail -n +2 00:08:02.548 15:37:00 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:08:02.548 192.168.100.9' 00:08:02.548 15:37:00 -- nvmf/common.sh@447 -- # head -n 1 00:08:02.548 15:37:00 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:08:02.548 15:37:00 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:08:02.548 15:37:00 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:08:02.548 15:37:00 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:08:02.548 15:37:00 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:08:02.548 15:37:00 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:08:02.548 15:37:00 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:08:02.548 15:37:00 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:08:02.548 15:37:00 -- common/autotest_common.sh@710 -- # xtrace_disable 00:08:02.548 15:37:00 -- common/autotest_common.sh@10 -- # set +x 00:08:02.548 15:37:00 -- nvmf/common.sh@470 -- # nvmfpid=3212424 00:08:02.548 15:37:00 -- nvmf/common.sh@471 -- # waitforlisten 3212424 00:08:02.548 15:37:00 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:02.548 15:37:00 -- common/autotest_common.sh@817 -- # '[' -z 3212424 ']' 00:08:02.548 15:37:00 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:02.548 15:37:00 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:02.548 15:37:00 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:02.548 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:02.548 15:37:00 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:02.548 15:37:00 -- common/autotest_common.sh@10 -- # set +x 00:08:02.548 [2024-04-26 15:37:01.038473] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:08:02.548 [2024-04-26 15:37:01.038517] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:02.548 EAL: No free 2048 kB hugepages reported on node 1 00:08:02.548 [2024-04-26 15:37:01.095077] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:02.819 [2024-04-26 15:37:01.174086] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:02.819 [2024-04-26 15:37:01.174123] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:02.819 [2024-04-26 15:37:01.174130] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:02.819 [2024-04-26 15:37:01.174136] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:02.819 [2024-04-26 15:37:01.174146] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:02.819 [2024-04-26 15:37:01.174198] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:02.819 [2024-04-26 15:37:01.174297] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:02.819 [2024-04-26 15:37:01.174382] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:02.819 [2024-04-26 15:37:01.174383] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:03.386 15:37:01 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:03.386 15:37:01 -- common/autotest_common.sh@850 -- # return 0 00:08:03.386 15:37:01 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:08:03.386 15:37:01 -- common/autotest_common.sh@716 -- # xtrace_disable 00:08:03.386 15:37:01 -- common/autotest_common.sh@10 -- # set +x 00:08:03.386 15:37:01 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:03.386 15:37:01 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:08:03.386 15:37:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:03.386 15:37:01 -- common/autotest_common.sh@10 -- # set +x 00:08:03.386 15:37:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:03.386 15:37:01 -- target/rpc.sh@26 -- # stats='{ 00:08:03.386 "tick_rate": 2100000000, 00:08:03.386 "poll_groups": [ 00:08:03.386 { 00:08:03.386 "name": "nvmf_tgt_poll_group_0", 00:08:03.386 "admin_qpairs": 0, 00:08:03.386 "io_qpairs": 0, 00:08:03.386 "current_admin_qpairs": 0, 00:08:03.386 "current_io_qpairs": 0, 00:08:03.386 "pending_bdev_io": 0, 00:08:03.386 "completed_nvme_io": 0, 00:08:03.386 "transports": [] 00:08:03.386 }, 00:08:03.386 { 00:08:03.386 "name": "nvmf_tgt_poll_group_1", 00:08:03.386 "admin_qpairs": 0, 00:08:03.386 "io_qpairs": 0, 00:08:03.386 "current_admin_qpairs": 0, 00:08:03.386 "current_io_qpairs": 0, 00:08:03.386 "pending_bdev_io": 0, 00:08:03.386 "completed_nvme_io": 0, 00:08:03.386 "transports": [] 00:08:03.386 }, 00:08:03.386 { 00:08:03.386 "name": "nvmf_tgt_poll_group_2", 00:08:03.386 "admin_qpairs": 0, 00:08:03.386 "io_qpairs": 0, 00:08:03.386 "current_admin_qpairs": 0, 00:08:03.386 "current_io_qpairs": 0, 00:08:03.386 "pending_bdev_io": 0, 00:08:03.386 "completed_nvme_io": 0, 00:08:03.386 "transports": [] 00:08:03.386 }, 00:08:03.386 { 00:08:03.386 "name": "nvmf_tgt_poll_group_3", 00:08:03.386 "admin_qpairs": 0, 00:08:03.386 "io_qpairs": 0, 00:08:03.386 "current_admin_qpairs": 0, 00:08:03.386 "current_io_qpairs": 0, 00:08:03.386 "pending_bdev_io": 0, 00:08:03.386 "completed_nvme_io": 0, 00:08:03.386 "transports": [] 00:08:03.386 } 00:08:03.386 ] 00:08:03.386 }' 00:08:03.386 15:37:01 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:08:03.386 15:37:01 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:08:03.386 15:37:01 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:08:03.386 15:37:01 -- target/rpc.sh@15 -- # wc -l 00:08:03.386 15:37:01 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:08:03.386 15:37:01 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:08:03.386 15:37:01 -- target/rpc.sh@29 -- # [[ null == null ]] 00:08:03.386 15:37:01 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:08:03.386 15:37:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:03.386 15:37:01 -- common/autotest_common.sh@10 -- # set +x 00:08:03.646 [2024-04-26 15:37:01.992882] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x203b160/0x203f650) succeed. 00:08:03.646 [2024-04-26 15:37:02.003128] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x203c7a0/0x2080ce0) succeed. 00:08:03.646 15:37:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:03.646 15:37:02 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:08:03.646 15:37:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:03.646 15:37:02 -- common/autotest_common.sh@10 -- # set +x 00:08:03.646 15:37:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:03.646 15:37:02 -- target/rpc.sh@33 -- # stats='{ 00:08:03.646 "tick_rate": 2100000000, 00:08:03.646 "poll_groups": [ 00:08:03.646 { 00:08:03.646 "name": "nvmf_tgt_poll_group_0", 00:08:03.646 "admin_qpairs": 0, 00:08:03.646 "io_qpairs": 0, 00:08:03.646 "current_admin_qpairs": 0, 00:08:03.646 "current_io_qpairs": 0, 00:08:03.646 "pending_bdev_io": 0, 00:08:03.646 "completed_nvme_io": 0, 00:08:03.646 "transports": [ 00:08:03.646 { 00:08:03.646 "trtype": "RDMA", 00:08:03.646 "pending_data_buffer": 0, 00:08:03.646 "devices": [ 00:08:03.646 { 00:08:03.646 "name": "mlx5_0", 00:08:03.646 "polls": 14852, 00:08:03.646 "idle_polls": 14852, 00:08:03.646 "completions": 0, 00:08:03.646 "requests": 0, 00:08:03.646 "request_latency": 0, 00:08:03.646 "pending_free_request": 0, 00:08:03.646 "pending_rdma_read": 0, 00:08:03.646 "pending_rdma_write": 0, 00:08:03.646 "pending_rdma_send": 0, 00:08:03.646 "total_send_wrs": 0, 00:08:03.646 "send_doorbell_updates": 0, 00:08:03.646 "total_recv_wrs": 4096, 00:08:03.646 "recv_doorbell_updates": 1 00:08:03.646 }, 00:08:03.646 { 00:08:03.646 "name": "mlx5_1", 00:08:03.646 "polls": 14852, 00:08:03.646 "idle_polls": 14852, 00:08:03.646 "completions": 0, 00:08:03.646 "requests": 0, 00:08:03.646 "request_latency": 0, 00:08:03.646 "pending_free_request": 0, 00:08:03.646 "pending_rdma_read": 0, 00:08:03.646 "pending_rdma_write": 0, 00:08:03.646 "pending_rdma_send": 0, 00:08:03.646 "total_send_wrs": 0, 00:08:03.646 "send_doorbell_updates": 0, 00:08:03.646 "total_recv_wrs": 4096, 00:08:03.646 "recv_doorbell_updates": 1 00:08:03.646 } 00:08:03.646 ] 00:08:03.646 } 00:08:03.647 ] 00:08:03.647 }, 00:08:03.647 { 00:08:03.647 "name": "nvmf_tgt_poll_group_1", 00:08:03.647 "admin_qpairs": 0, 00:08:03.647 "io_qpairs": 0, 00:08:03.647 "current_admin_qpairs": 0, 00:08:03.647 "current_io_qpairs": 0, 00:08:03.647 "pending_bdev_io": 0, 00:08:03.647 "completed_nvme_io": 0, 00:08:03.647 "transports": [ 00:08:03.647 { 00:08:03.647 "trtype": "RDMA", 00:08:03.647 "pending_data_buffer": 0, 00:08:03.647 "devices": [ 00:08:03.647 { 00:08:03.647 "name": "mlx5_0", 00:08:03.647 "polls": 9644, 00:08:03.647 "idle_polls": 9644, 00:08:03.647 "completions": 0, 00:08:03.647 "requests": 0, 00:08:03.647 "request_latency": 0, 00:08:03.647 "pending_free_request": 0, 00:08:03.647 "pending_rdma_read": 0, 00:08:03.647 "pending_rdma_write": 0, 00:08:03.647 "pending_rdma_send": 0, 00:08:03.647 "total_send_wrs": 0, 00:08:03.647 "send_doorbell_updates": 0, 00:08:03.647 "total_recv_wrs": 4096, 00:08:03.647 "recv_doorbell_updates": 1 00:08:03.647 }, 00:08:03.647 { 00:08:03.647 "name": "mlx5_1", 00:08:03.647 "polls": 9644, 00:08:03.647 "idle_polls": 9644, 00:08:03.647 "completions": 0, 00:08:03.647 "requests": 0, 00:08:03.647 "request_latency": 0, 00:08:03.647 "pending_free_request": 0, 00:08:03.647 "pending_rdma_read": 0, 00:08:03.647 "pending_rdma_write": 0, 00:08:03.647 "pending_rdma_send": 0, 00:08:03.647 "total_send_wrs": 0, 00:08:03.647 "send_doorbell_updates": 0, 00:08:03.647 "total_recv_wrs": 4096, 00:08:03.647 "recv_doorbell_updates": 1 00:08:03.647 } 00:08:03.647 ] 00:08:03.647 } 00:08:03.647 ] 00:08:03.647 }, 00:08:03.647 { 00:08:03.647 "name": "nvmf_tgt_poll_group_2", 00:08:03.647 "admin_qpairs": 0, 00:08:03.647 "io_qpairs": 0, 00:08:03.647 "current_admin_qpairs": 0, 00:08:03.647 "current_io_qpairs": 0, 00:08:03.647 "pending_bdev_io": 0, 00:08:03.647 "completed_nvme_io": 0, 00:08:03.647 "transports": [ 00:08:03.647 { 00:08:03.647 "trtype": "RDMA", 00:08:03.647 "pending_data_buffer": 0, 00:08:03.647 "devices": [ 00:08:03.647 { 00:08:03.647 "name": "mlx5_0", 00:08:03.647 "polls": 5110, 00:08:03.647 "idle_polls": 5110, 00:08:03.647 "completions": 0, 00:08:03.647 "requests": 0, 00:08:03.647 "request_latency": 0, 00:08:03.647 "pending_free_request": 0, 00:08:03.647 "pending_rdma_read": 0, 00:08:03.647 "pending_rdma_write": 0, 00:08:03.647 "pending_rdma_send": 0, 00:08:03.647 "total_send_wrs": 0, 00:08:03.647 "send_doorbell_updates": 0, 00:08:03.647 "total_recv_wrs": 4096, 00:08:03.647 "recv_doorbell_updates": 1 00:08:03.647 }, 00:08:03.647 { 00:08:03.647 "name": "mlx5_1", 00:08:03.647 "polls": 5110, 00:08:03.647 "idle_polls": 5110, 00:08:03.647 "completions": 0, 00:08:03.647 "requests": 0, 00:08:03.647 "request_latency": 0, 00:08:03.647 "pending_free_request": 0, 00:08:03.647 "pending_rdma_read": 0, 00:08:03.647 "pending_rdma_write": 0, 00:08:03.647 "pending_rdma_send": 0, 00:08:03.647 "total_send_wrs": 0, 00:08:03.647 "send_doorbell_updates": 0, 00:08:03.647 "total_recv_wrs": 4096, 00:08:03.647 "recv_doorbell_updates": 1 00:08:03.647 } 00:08:03.647 ] 00:08:03.647 } 00:08:03.647 ] 00:08:03.647 }, 00:08:03.647 { 00:08:03.647 "name": "nvmf_tgt_poll_group_3", 00:08:03.647 "admin_qpairs": 0, 00:08:03.647 "io_qpairs": 0, 00:08:03.647 "current_admin_qpairs": 0, 00:08:03.647 "current_io_qpairs": 0, 00:08:03.647 "pending_bdev_io": 0, 00:08:03.647 "completed_nvme_io": 0, 00:08:03.647 "transports": [ 00:08:03.647 { 00:08:03.647 "trtype": "RDMA", 00:08:03.647 "pending_data_buffer": 0, 00:08:03.647 "devices": [ 00:08:03.647 { 00:08:03.647 "name": "mlx5_0", 00:08:03.647 "polls": 875, 00:08:03.647 "idle_polls": 875, 00:08:03.647 "completions": 0, 00:08:03.647 "requests": 0, 00:08:03.647 "request_latency": 0, 00:08:03.647 "pending_free_request": 0, 00:08:03.647 "pending_rdma_read": 0, 00:08:03.647 "pending_rdma_write": 0, 00:08:03.647 "pending_rdma_send": 0, 00:08:03.647 "total_send_wrs": 0, 00:08:03.647 "send_doorbell_updates": 0, 00:08:03.647 "total_recv_wrs": 4096, 00:08:03.647 "recv_doorbell_updates": 1 00:08:03.647 }, 00:08:03.647 { 00:08:03.647 "name": "mlx5_1", 00:08:03.647 "polls": 875, 00:08:03.647 "idle_polls": 875, 00:08:03.647 "completions": 0, 00:08:03.647 "requests": 0, 00:08:03.647 "request_latency": 0, 00:08:03.647 "pending_free_request": 0, 00:08:03.647 "pending_rdma_read": 0, 00:08:03.647 "pending_rdma_write": 0, 00:08:03.647 "pending_rdma_send": 0, 00:08:03.647 "total_send_wrs": 0, 00:08:03.647 "send_doorbell_updates": 0, 00:08:03.647 "total_recv_wrs": 4096, 00:08:03.647 "recv_doorbell_updates": 1 00:08:03.647 } 00:08:03.647 ] 00:08:03.647 } 00:08:03.647 ] 00:08:03.647 } 00:08:03.647 ] 00:08:03.647 }' 00:08:03.647 15:37:02 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:08:03.647 15:37:02 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:08:03.647 15:37:02 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:08:03.647 15:37:02 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:08:03.647 15:37:02 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:08:03.647 15:37:02 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:08:03.647 15:37:02 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:08:03.647 15:37:02 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:08:03.647 15:37:02 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:08:03.647 15:37:02 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:08:03.647 15:37:02 -- target/rpc.sh@38 -- # '[' rdma == rdma ']' 00:08:03.647 15:37:02 -- target/rpc.sh@40 -- # jcount '.poll_groups[0].transports[].trtype' 00:08:03.647 15:37:02 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[0].transports[].trtype' 00:08:03.647 15:37:02 -- target/rpc.sh@15 -- # jq '.poll_groups[0].transports[].trtype' 00:08:03.647 15:37:02 -- target/rpc.sh@15 -- # wc -l 00:08:03.906 15:37:02 -- target/rpc.sh@40 -- # (( 1 == 1 )) 00:08:03.906 15:37:02 -- target/rpc.sh@41 -- # jq -r '.poll_groups[0].transports[0].trtype' 00:08:03.906 15:37:02 -- target/rpc.sh@41 -- # transport_type=RDMA 00:08:03.906 15:37:02 -- target/rpc.sh@42 -- # [[ rdma == \r\d\m\a ]] 00:08:03.906 15:37:02 -- target/rpc.sh@43 -- # jcount '.poll_groups[0].transports[0].devices[].name' 00:08:03.906 15:37:02 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[0].transports[0].devices[].name' 00:08:03.906 15:37:02 -- target/rpc.sh@15 -- # jq '.poll_groups[0].transports[0].devices[].name' 00:08:03.906 15:37:02 -- target/rpc.sh@15 -- # wc -l 00:08:03.906 15:37:02 -- target/rpc.sh@43 -- # (( 2 > 0 )) 00:08:03.906 15:37:02 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:08:03.906 15:37:02 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:08:03.906 15:37:02 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:08:03.906 15:37:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:03.906 15:37:02 -- common/autotest_common.sh@10 -- # set +x 00:08:03.906 Malloc1 00:08:03.906 15:37:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:03.906 15:37:02 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:03.906 15:37:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:03.906 15:37:02 -- common/autotest_common.sh@10 -- # set +x 00:08:03.906 15:37:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:03.906 15:37:02 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:03.906 15:37:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:03.906 15:37:02 -- common/autotest_common.sh@10 -- # set +x 00:08:03.906 15:37:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:03.906 15:37:02 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:08:03.906 15:37:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:03.906 15:37:02 -- common/autotest_common.sh@10 -- # set +x 00:08:03.906 15:37:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:03.906 15:37:02 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:08:03.906 15:37:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:03.906 15:37:02 -- common/autotest_common.sh@10 -- # set +x 00:08:03.906 [2024-04-26 15:37:02.405972] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:08:03.906 15:37:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:03.906 15:37:02 -- target/rpc.sh@58 -- # NOT nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 -a 192.168.100.8 -s 4420 00:08:03.906 15:37:02 -- common/autotest_common.sh@638 -- # local es=0 00:08:03.906 15:37:02 -- common/autotest_common.sh@640 -- # valid_exec_arg nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 -a 192.168.100.8 -s 4420 00:08:03.906 15:37:02 -- common/autotest_common.sh@626 -- # local arg=nvme 00:08:03.906 15:37:02 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:08:03.906 15:37:02 -- common/autotest_common.sh@630 -- # type -t nvme 00:08:03.906 15:37:02 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:08:03.906 15:37:02 -- common/autotest_common.sh@632 -- # type -P nvme 00:08:03.906 15:37:02 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:08:03.906 15:37:02 -- common/autotest_common.sh@632 -- # arg=/usr/sbin/nvme 00:08:03.906 15:37:02 -- common/autotest_common.sh@632 -- # [[ -x /usr/sbin/nvme ]] 00:08:03.906 15:37:02 -- common/autotest_common.sh@641 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 -a 192.168.100.8 -s 4420 00:08:03.906 [2024-04-26 15:37:02.451910] ctrlr.c: 766:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562' 00:08:03.906 Failed to write to /dev/nvme-fabrics: Input/output error 00:08:03.906 could not add new controller: failed to write to nvme-fabrics device 00:08:03.906 15:37:02 -- common/autotest_common.sh@641 -- # es=1 00:08:03.906 15:37:02 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:08:03.906 15:37:02 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:08:03.906 15:37:02 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:08:03.906 15:37:02 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:08:03.906 15:37:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:03.906 15:37:02 -- common/autotest_common.sh@10 -- # set +x 00:08:03.906 15:37:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:03.906 15:37:02 -- target/rpc.sh@62 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:08:05.279 15:37:03 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:08:05.279 15:37:03 -- common/autotest_common.sh@1184 -- # local i=0 00:08:05.279 15:37:03 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:08:05.279 15:37:03 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:08:05.279 15:37:03 -- common/autotest_common.sh@1191 -- # sleep 2 00:08:07.179 15:37:05 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:08:07.179 15:37:05 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:08:07.179 15:37:05 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:08:07.179 15:37:05 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:08:07.179 15:37:05 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:08:07.179 15:37:05 -- common/autotest_common.sh@1194 -- # return 0 00:08:07.179 15:37:05 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:08.112 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:08.112 15:37:06 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:08.112 15:37:06 -- common/autotest_common.sh@1205 -- # local i=0 00:08:08.112 15:37:06 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:08:08.112 15:37:06 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:08.112 15:37:06 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:08:08.112 15:37:06 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:08.112 15:37:06 -- common/autotest_common.sh@1217 -- # return 0 00:08:08.112 15:37:06 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:08:08.112 15:37:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:08.112 15:37:06 -- common/autotest_common.sh@10 -- # set +x 00:08:08.112 15:37:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:08.112 15:37:06 -- target/rpc.sh@69 -- # NOT nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:08:08.112 15:37:06 -- common/autotest_common.sh@638 -- # local es=0 00:08:08.112 15:37:06 -- common/autotest_common.sh@640 -- # valid_exec_arg nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:08:08.112 15:37:06 -- common/autotest_common.sh@626 -- # local arg=nvme 00:08:08.112 15:37:06 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:08:08.112 15:37:06 -- common/autotest_common.sh@630 -- # type -t nvme 00:08:08.112 15:37:06 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:08:08.112 15:37:06 -- common/autotest_common.sh@632 -- # type -P nvme 00:08:08.112 15:37:06 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:08:08.112 15:37:06 -- common/autotest_common.sh@632 -- # arg=/usr/sbin/nvme 00:08:08.112 15:37:06 -- common/autotest_common.sh@632 -- # [[ -x /usr/sbin/nvme ]] 00:08:08.112 15:37:06 -- common/autotest_common.sh@641 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:08:08.112 [2024-04-26 15:37:06.493378] ctrlr.c: 766:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562' 00:08:08.112 Failed to write to /dev/nvme-fabrics: Input/output error 00:08:08.112 could not add new controller: failed to write to nvme-fabrics device 00:08:08.112 15:37:06 -- common/autotest_common.sh@641 -- # es=1 00:08:08.112 15:37:06 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:08:08.112 15:37:06 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:08:08.112 15:37:06 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:08:08.112 15:37:06 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:08:08.112 15:37:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:08.112 15:37:06 -- common/autotest_common.sh@10 -- # set +x 00:08:08.112 15:37:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:08.112 15:37:06 -- target/rpc.sh@73 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:08:09.046 15:37:07 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:08:09.046 15:37:07 -- common/autotest_common.sh@1184 -- # local i=0 00:08:09.046 15:37:07 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:08:09.046 15:37:07 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:08:09.046 15:37:07 -- common/autotest_common.sh@1191 -- # sleep 2 00:08:10.943 15:37:09 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:08:10.943 15:37:09 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:08:10.943 15:37:09 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:08:10.943 15:37:09 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:08:10.943 15:37:09 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:08:10.943 15:37:09 -- common/autotest_common.sh@1194 -- # return 0 00:08:10.943 15:37:09 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:11.876 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:11.876 15:37:10 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:11.876 15:37:10 -- common/autotest_common.sh@1205 -- # local i=0 00:08:11.876 15:37:10 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:08:11.876 15:37:10 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:11.876 15:37:10 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:11.876 15:37:10 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:08:12.133 15:37:10 -- common/autotest_common.sh@1217 -- # return 0 00:08:12.133 15:37:10 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:12.133 15:37:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:12.133 15:37:10 -- common/autotest_common.sh@10 -- # set +x 00:08:12.133 15:37:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:12.133 15:37:10 -- target/rpc.sh@81 -- # seq 1 5 00:08:12.133 15:37:10 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:08:12.133 15:37:10 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:08:12.133 15:37:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:12.133 15:37:10 -- common/autotest_common.sh@10 -- # set +x 00:08:12.133 15:37:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:12.133 15:37:10 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:08:12.133 15:37:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:12.133 15:37:10 -- common/autotest_common.sh@10 -- # set +x 00:08:12.133 [2024-04-26 15:37:10.515820] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:08:12.133 15:37:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:12.133 15:37:10 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:08:12.133 15:37:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:12.133 15:37:10 -- common/autotest_common.sh@10 -- # set +x 00:08:12.133 15:37:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:12.133 15:37:10 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:08:12.133 15:37:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:12.133 15:37:10 -- common/autotest_common.sh@10 -- # set +x 00:08:12.133 15:37:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:12.133 15:37:10 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:08:13.066 15:37:11 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:08:13.066 15:37:11 -- common/autotest_common.sh@1184 -- # local i=0 00:08:13.066 15:37:11 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:08:13.066 15:37:11 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:08:13.066 15:37:11 -- common/autotest_common.sh@1191 -- # sleep 2 00:08:14.968 15:37:13 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:08:14.968 15:37:13 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:08:14.968 15:37:13 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:08:14.968 15:37:13 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:08:14.968 15:37:13 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:08:14.968 15:37:13 -- common/autotest_common.sh@1194 -- # return 0 00:08:14.968 15:37:13 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:15.902 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:15.902 15:37:14 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:15.902 15:37:14 -- common/autotest_common.sh@1205 -- # local i=0 00:08:15.902 15:37:14 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:08:15.902 15:37:14 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:15.902 15:37:14 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:08:15.902 15:37:14 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:15.902 15:37:14 -- common/autotest_common.sh@1217 -- # return 0 00:08:15.902 15:37:14 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:08:15.902 15:37:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:15.902 15:37:14 -- common/autotest_common.sh@10 -- # set +x 00:08:15.902 15:37:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:15.902 15:37:14 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:15.902 15:37:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:15.902 15:37:14 -- common/autotest_common.sh@10 -- # set +x 00:08:15.902 15:37:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:15.902 15:37:14 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:08:15.902 15:37:14 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:08:15.902 15:37:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:15.902 15:37:14 -- common/autotest_common.sh@10 -- # set +x 00:08:15.902 15:37:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:15.902 15:37:14 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:08:15.902 15:37:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:15.902 15:37:14 -- common/autotest_common.sh@10 -- # set +x 00:08:15.902 [2024-04-26 15:37:14.504393] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:08:16.161 15:37:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:16.161 15:37:14 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:08:16.161 15:37:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:16.161 15:37:14 -- common/autotest_common.sh@10 -- # set +x 00:08:16.161 15:37:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:16.161 15:37:14 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:08:16.161 15:37:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:16.161 15:37:14 -- common/autotest_common.sh@10 -- # set +x 00:08:16.161 15:37:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:16.161 15:37:14 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:08:17.097 15:37:15 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:08:17.097 15:37:15 -- common/autotest_common.sh@1184 -- # local i=0 00:08:17.097 15:37:15 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:08:17.097 15:37:15 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:08:17.097 15:37:15 -- common/autotest_common.sh@1191 -- # sleep 2 00:08:18.999 15:37:17 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:08:18.999 15:37:17 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:08:18.999 15:37:17 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:08:18.999 15:37:17 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:08:18.999 15:37:17 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:08:18.999 15:37:17 -- common/autotest_common.sh@1194 -- # return 0 00:08:18.999 15:37:17 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:19.933 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:19.933 15:37:18 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:19.933 15:37:18 -- common/autotest_common.sh@1205 -- # local i=0 00:08:19.933 15:37:18 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:08:19.933 15:37:18 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:19.933 15:37:18 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:08:19.933 15:37:18 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:19.933 15:37:18 -- common/autotest_common.sh@1217 -- # return 0 00:08:19.933 15:37:18 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:08:19.933 15:37:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:19.933 15:37:18 -- common/autotest_common.sh@10 -- # set +x 00:08:19.933 15:37:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:19.933 15:37:18 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:19.933 15:37:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:19.933 15:37:18 -- common/autotest_common.sh@10 -- # set +x 00:08:19.933 15:37:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:19.933 15:37:18 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:08:19.933 15:37:18 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:08:19.933 15:37:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:19.933 15:37:18 -- common/autotest_common.sh@10 -- # set +x 00:08:19.933 15:37:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:19.933 15:37:18 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:08:19.933 15:37:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:19.933 15:37:18 -- common/autotest_common.sh@10 -- # set +x 00:08:19.933 [2024-04-26 15:37:18.489235] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:08:19.933 15:37:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:19.933 15:37:18 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:08:19.933 15:37:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:19.933 15:37:18 -- common/autotest_common.sh@10 -- # set +x 00:08:19.933 15:37:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:19.933 15:37:18 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:08:19.933 15:37:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:19.933 15:37:18 -- common/autotest_common.sh@10 -- # set +x 00:08:19.933 15:37:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:19.933 15:37:18 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:08:21.310 15:37:19 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:08:21.310 15:37:19 -- common/autotest_common.sh@1184 -- # local i=0 00:08:21.310 15:37:19 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:08:21.310 15:37:19 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:08:21.310 15:37:19 -- common/autotest_common.sh@1191 -- # sleep 2 00:08:23.212 15:37:21 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:08:23.212 15:37:21 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:08:23.212 15:37:21 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:08:23.212 15:37:21 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:08:23.212 15:37:21 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:08:23.212 15:37:21 -- common/autotest_common.sh@1194 -- # return 0 00:08:23.212 15:37:21 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:24.147 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:24.147 15:37:22 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:24.147 15:37:22 -- common/autotest_common.sh@1205 -- # local i=0 00:08:24.147 15:37:22 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:08:24.147 15:37:22 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:24.147 15:37:22 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:08:24.147 15:37:22 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:24.147 15:37:22 -- common/autotest_common.sh@1217 -- # return 0 00:08:24.147 15:37:22 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:08:24.147 15:37:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:24.147 15:37:22 -- common/autotest_common.sh@10 -- # set +x 00:08:24.147 15:37:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:24.147 15:37:22 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:24.147 15:37:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:24.147 15:37:22 -- common/autotest_common.sh@10 -- # set +x 00:08:24.147 15:37:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:24.147 15:37:22 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:08:24.147 15:37:22 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:08:24.147 15:37:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:24.147 15:37:22 -- common/autotest_common.sh@10 -- # set +x 00:08:24.147 15:37:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:24.147 15:37:22 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:08:24.147 15:37:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:24.147 15:37:22 -- common/autotest_common.sh@10 -- # set +x 00:08:24.147 [2024-04-26 15:37:22.534199] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:08:24.147 15:37:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:24.147 15:37:22 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:08:24.147 15:37:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:24.147 15:37:22 -- common/autotest_common.sh@10 -- # set +x 00:08:24.147 15:37:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:24.147 15:37:22 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:08:24.147 15:37:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:24.147 15:37:22 -- common/autotest_common.sh@10 -- # set +x 00:08:24.147 15:37:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:24.147 15:37:22 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:08:25.083 15:37:23 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:08:25.083 15:37:23 -- common/autotest_common.sh@1184 -- # local i=0 00:08:25.083 15:37:23 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:08:25.083 15:37:23 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:08:25.083 15:37:23 -- common/autotest_common.sh@1191 -- # sleep 2 00:08:26.984 15:37:25 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:08:26.984 15:37:25 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:08:26.984 15:37:25 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:08:26.984 15:37:25 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:08:26.984 15:37:25 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:08:26.984 15:37:25 -- common/autotest_common.sh@1194 -- # return 0 00:08:26.984 15:37:25 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:27.921 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:27.921 15:37:26 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:27.921 15:37:26 -- common/autotest_common.sh@1205 -- # local i=0 00:08:27.921 15:37:26 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:08:27.921 15:37:26 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:27.921 15:37:26 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:08:27.921 15:37:26 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:27.921 15:37:26 -- common/autotest_common.sh@1217 -- # return 0 00:08:27.921 15:37:26 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:08:27.921 15:37:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:27.921 15:37:26 -- common/autotest_common.sh@10 -- # set +x 00:08:27.921 15:37:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:27.921 15:37:26 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:27.921 15:37:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:27.921 15:37:26 -- common/autotest_common.sh@10 -- # set +x 00:08:27.921 15:37:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:27.921 15:37:26 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:08:27.921 15:37:26 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:08:27.921 15:37:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:27.921 15:37:26 -- common/autotest_common.sh@10 -- # set +x 00:08:28.179 15:37:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:28.179 15:37:26 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:08:28.180 15:37:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:28.180 15:37:26 -- common/autotest_common.sh@10 -- # set +x 00:08:28.180 [2024-04-26 15:37:26.530920] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:08:28.180 15:37:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:28.180 15:37:26 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:08:28.180 15:37:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:28.180 15:37:26 -- common/autotest_common.sh@10 -- # set +x 00:08:28.180 15:37:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:28.180 15:37:26 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:08:28.180 15:37:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:28.180 15:37:26 -- common/autotest_common.sh@10 -- # set +x 00:08:28.180 15:37:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:28.180 15:37:26 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:08:29.115 15:37:27 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:08:29.115 15:37:27 -- common/autotest_common.sh@1184 -- # local i=0 00:08:29.115 15:37:27 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:08:29.115 15:37:27 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:08:29.115 15:37:27 -- common/autotest_common.sh@1191 -- # sleep 2 00:08:31.017 15:37:29 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:08:31.017 15:37:29 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:08:31.018 15:37:29 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:08:31.018 15:37:29 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:08:31.018 15:37:29 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:08:31.018 15:37:29 -- common/autotest_common.sh@1194 -- # return 0 00:08:31.018 15:37:29 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:31.953 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:31.953 15:37:30 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:31.953 15:37:30 -- common/autotest_common.sh@1205 -- # local i=0 00:08:31.953 15:37:30 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:08:31.953 15:37:30 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:31.953 15:37:30 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:08:31.953 15:37:30 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:31.953 15:37:30 -- common/autotest_common.sh@1217 -- # return 0 00:08:31.953 15:37:30 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:08:31.953 15:37:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:31.953 15:37:30 -- common/autotest_common.sh@10 -- # set +x 00:08:31.953 15:37:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:31.953 15:37:30 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:31.953 15:37:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:31.953 15:37:30 -- common/autotest_common.sh@10 -- # set +x 00:08:31.953 15:37:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:31.953 15:37:30 -- target/rpc.sh@99 -- # seq 1 5 00:08:31.953 15:37:30 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:08:31.953 15:37:30 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:08:31.953 15:37:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:31.953 15:37:30 -- common/autotest_common.sh@10 -- # set +x 00:08:32.293 15:37:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:32.293 15:37:30 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:08:32.293 15:37:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:32.293 15:37:30 -- common/autotest_common.sh@10 -- # set +x 00:08:32.293 [2024-04-26 15:37:30.566995] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:08:32.293 15:37:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:32.293 15:37:30 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:32.293 15:37:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:32.293 15:37:30 -- common/autotest_common.sh@10 -- # set +x 00:08:32.293 15:37:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:32.293 15:37:30 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:08:32.293 15:37:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:32.293 15:37:30 -- common/autotest_common.sh@10 -- # set +x 00:08:32.293 15:37:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:32.293 15:37:30 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:32.293 15:37:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:32.293 15:37:30 -- common/autotest_common.sh@10 -- # set +x 00:08:32.293 15:37:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:32.293 15:37:30 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:32.293 15:37:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:32.293 15:37:30 -- common/autotest_common.sh@10 -- # set +x 00:08:32.293 15:37:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:32.293 15:37:30 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:08:32.293 15:37:30 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:08:32.293 15:37:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:32.293 15:37:30 -- common/autotest_common.sh@10 -- # set +x 00:08:32.293 15:37:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:32.293 15:37:30 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:08:32.293 15:37:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:32.293 15:37:30 -- common/autotest_common.sh@10 -- # set +x 00:08:32.293 [2024-04-26 15:37:30.615168] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:08:32.293 15:37:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:32.293 15:37:30 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:32.293 15:37:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:32.293 15:37:30 -- common/autotest_common.sh@10 -- # set +x 00:08:32.293 15:37:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:32.293 15:37:30 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:08:32.293 15:37:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:32.293 15:37:30 -- common/autotest_common.sh@10 -- # set +x 00:08:32.293 15:37:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:32.293 15:37:30 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:32.293 15:37:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:32.293 15:37:30 -- common/autotest_common.sh@10 -- # set +x 00:08:32.293 15:37:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:32.293 15:37:30 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:32.293 15:37:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:32.293 15:37:30 -- common/autotest_common.sh@10 -- # set +x 00:08:32.293 15:37:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:32.293 15:37:30 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:08:32.293 15:37:30 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:08:32.293 15:37:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:32.293 15:37:30 -- common/autotest_common.sh@10 -- # set +x 00:08:32.293 15:37:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:32.293 15:37:30 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:08:32.293 15:37:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:32.293 15:37:30 -- common/autotest_common.sh@10 -- # set +x 00:08:32.293 [2024-04-26 15:37:30.663341] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:08:32.293 15:37:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:32.293 15:37:30 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:32.293 15:37:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:32.293 15:37:30 -- common/autotest_common.sh@10 -- # set +x 00:08:32.293 15:37:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:32.293 15:37:30 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:08:32.293 15:37:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:32.293 15:37:30 -- common/autotest_common.sh@10 -- # set +x 00:08:32.293 15:37:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:32.293 15:37:30 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:32.293 15:37:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:32.293 15:37:30 -- common/autotest_common.sh@10 -- # set +x 00:08:32.293 15:37:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:32.293 15:37:30 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:32.293 15:37:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:32.293 15:37:30 -- common/autotest_common.sh@10 -- # set +x 00:08:32.293 15:37:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:32.293 15:37:30 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:08:32.293 15:37:30 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:08:32.293 15:37:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:32.293 15:37:30 -- common/autotest_common.sh@10 -- # set +x 00:08:32.293 15:37:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:32.293 15:37:30 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:08:32.293 15:37:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:32.293 15:37:30 -- common/autotest_common.sh@10 -- # set +x 00:08:32.293 [2024-04-26 15:37:30.715528] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:08:32.293 15:37:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:32.293 15:37:30 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:32.293 15:37:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:32.293 15:37:30 -- common/autotest_common.sh@10 -- # set +x 00:08:32.293 15:37:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:32.294 15:37:30 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:08:32.294 15:37:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:32.294 15:37:30 -- common/autotest_common.sh@10 -- # set +x 00:08:32.294 15:37:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:32.294 15:37:30 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:32.294 15:37:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:32.294 15:37:30 -- common/autotest_common.sh@10 -- # set +x 00:08:32.294 15:37:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:32.294 15:37:30 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:32.294 15:37:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:32.294 15:37:30 -- common/autotest_common.sh@10 -- # set +x 00:08:32.294 15:37:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:32.294 15:37:30 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:08:32.294 15:37:30 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:08:32.294 15:37:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:32.294 15:37:30 -- common/autotest_common.sh@10 -- # set +x 00:08:32.294 15:37:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:32.294 15:37:30 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:08:32.294 15:37:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:32.294 15:37:30 -- common/autotest_common.sh@10 -- # set +x 00:08:32.294 [2024-04-26 15:37:30.763693] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:08:32.294 15:37:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:32.294 15:37:30 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:32.294 15:37:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:32.294 15:37:30 -- common/autotest_common.sh@10 -- # set +x 00:08:32.294 15:37:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:32.294 15:37:30 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:08:32.294 15:37:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:32.294 15:37:30 -- common/autotest_common.sh@10 -- # set +x 00:08:32.294 15:37:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:32.294 15:37:30 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:32.294 15:37:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:32.294 15:37:30 -- common/autotest_common.sh@10 -- # set +x 00:08:32.294 15:37:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:32.294 15:37:30 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:32.294 15:37:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:32.294 15:37:30 -- common/autotest_common.sh@10 -- # set +x 00:08:32.294 15:37:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:32.294 15:37:30 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:08:32.294 15:37:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:32.294 15:37:30 -- common/autotest_common.sh@10 -- # set +x 00:08:32.294 15:37:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:32.294 15:37:30 -- target/rpc.sh@110 -- # stats='{ 00:08:32.294 "tick_rate": 2100000000, 00:08:32.294 "poll_groups": [ 00:08:32.294 { 00:08:32.294 "name": "nvmf_tgt_poll_group_0", 00:08:32.294 "admin_qpairs": 2, 00:08:32.294 "io_qpairs": 27, 00:08:32.294 "current_admin_qpairs": 0, 00:08:32.294 "current_io_qpairs": 0, 00:08:32.294 "pending_bdev_io": 0, 00:08:32.294 "completed_nvme_io": 114, 00:08:32.294 "transports": [ 00:08:32.294 { 00:08:32.294 "trtype": "RDMA", 00:08:32.294 "pending_data_buffer": 0, 00:08:32.294 "devices": [ 00:08:32.294 { 00:08:32.294 "name": "mlx5_0", 00:08:32.294 "polls": 3430713, 00:08:32.294 "idle_polls": 3430414, 00:08:32.294 "completions": 339, 00:08:32.294 "requests": 169, 00:08:32.294 "request_latency": 28428254, 00:08:32.294 "pending_free_request": 0, 00:08:32.294 "pending_rdma_read": 0, 00:08:32.294 "pending_rdma_write": 0, 00:08:32.294 "pending_rdma_send": 0, 00:08:32.294 "total_send_wrs": 282, 00:08:32.294 "send_doorbell_updates": 148, 00:08:32.294 "total_recv_wrs": 4265, 00:08:32.294 "recv_doorbell_updates": 148 00:08:32.294 }, 00:08:32.294 { 00:08:32.294 "name": "mlx5_1", 00:08:32.294 "polls": 3430713, 00:08:32.294 "idle_polls": 3430713, 00:08:32.294 "completions": 0, 00:08:32.294 "requests": 0, 00:08:32.294 "request_latency": 0, 00:08:32.294 "pending_free_request": 0, 00:08:32.294 "pending_rdma_read": 0, 00:08:32.294 "pending_rdma_write": 0, 00:08:32.294 "pending_rdma_send": 0, 00:08:32.294 "total_send_wrs": 0, 00:08:32.294 "send_doorbell_updates": 0, 00:08:32.294 "total_recv_wrs": 4096, 00:08:32.294 "recv_doorbell_updates": 1 00:08:32.294 } 00:08:32.294 ] 00:08:32.294 } 00:08:32.294 ] 00:08:32.294 }, 00:08:32.294 { 00:08:32.294 "name": "nvmf_tgt_poll_group_1", 00:08:32.294 "admin_qpairs": 2, 00:08:32.294 "io_qpairs": 26, 00:08:32.294 "current_admin_qpairs": 0, 00:08:32.294 "current_io_qpairs": 0, 00:08:32.294 "pending_bdev_io": 0, 00:08:32.294 "completed_nvme_io": 125, 00:08:32.294 "transports": [ 00:08:32.294 { 00:08:32.294 "trtype": "RDMA", 00:08:32.294 "pending_data_buffer": 0, 00:08:32.294 "devices": [ 00:08:32.294 { 00:08:32.294 "name": "mlx5_0", 00:08:32.294 "polls": 3526324, 00:08:32.294 "idle_polls": 3526008, 00:08:32.294 "completions": 358, 00:08:32.294 "requests": 179, 00:08:32.294 "request_latency": 30351646, 00:08:32.294 "pending_free_request": 0, 00:08:32.294 "pending_rdma_read": 0, 00:08:32.294 "pending_rdma_write": 0, 00:08:32.294 "pending_rdma_send": 0, 00:08:32.294 "total_send_wrs": 303, 00:08:32.294 "send_doorbell_updates": 154, 00:08:32.294 "total_recv_wrs": 4275, 00:08:32.294 "recv_doorbell_updates": 155 00:08:32.294 }, 00:08:32.294 { 00:08:32.294 "name": "mlx5_1", 00:08:32.294 "polls": 3526324, 00:08:32.294 "idle_polls": 3526324, 00:08:32.294 "completions": 0, 00:08:32.294 "requests": 0, 00:08:32.294 "request_latency": 0, 00:08:32.294 "pending_free_request": 0, 00:08:32.294 "pending_rdma_read": 0, 00:08:32.294 "pending_rdma_write": 0, 00:08:32.294 "pending_rdma_send": 0, 00:08:32.294 "total_send_wrs": 0, 00:08:32.294 "send_doorbell_updates": 0, 00:08:32.294 "total_recv_wrs": 4096, 00:08:32.294 "recv_doorbell_updates": 1 00:08:32.294 } 00:08:32.294 ] 00:08:32.294 } 00:08:32.294 ] 00:08:32.294 }, 00:08:32.294 { 00:08:32.294 "name": "nvmf_tgt_poll_group_2", 00:08:32.294 "admin_qpairs": 1, 00:08:32.294 "io_qpairs": 26, 00:08:32.294 "current_admin_qpairs": 0, 00:08:32.294 "current_io_qpairs": 0, 00:08:32.294 "pending_bdev_io": 0, 00:08:32.294 "completed_nvme_io": 28, 00:08:32.294 "transports": [ 00:08:32.294 { 00:08:32.294 "trtype": "RDMA", 00:08:32.294 "pending_data_buffer": 0, 00:08:32.294 "devices": [ 00:08:32.294 { 00:08:32.294 "name": "mlx5_0", 00:08:32.294 "polls": 3478781, 00:08:32.294 "idle_polls": 3478666, 00:08:32.294 "completions": 115, 00:08:32.294 "requests": 57, 00:08:32.294 "request_latency": 5370928, 00:08:32.294 "pending_free_request": 0, 00:08:32.294 "pending_rdma_read": 0, 00:08:32.294 "pending_rdma_write": 0, 00:08:32.294 "pending_rdma_send": 0, 00:08:32.294 "total_send_wrs": 73, 00:08:32.294 "send_doorbell_updates": 58, 00:08:32.294 "total_recv_wrs": 4153, 00:08:32.294 "recv_doorbell_updates": 58 00:08:32.294 }, 00:08:32.294 { 00:08:32.294 "name": "mlx5_1", 00:08:32.294 "polls": 3478781, 00:08:32.294 "idle_polls": 3478781, 00:08:32.294 "completions": 0, 00:08:32.294 "requests": 0, 00:08:32.294 "request_latency": 0, 00:08:32.294 "pending_free_request": 0, 00:08:32.294 "pending_rdma_read": 0, 00:08:32.294 "pending_rdma_write": 0, 00:08:32.294 "pending_rdma_send": 0, 00:08:32.294 "total_send_wrs": 0, 00:08:32.294 "send_doorbell_updates": 0, 00:08:32.294 "total_recv_wrs": 4096, 00:08:32.294 "recv_doorbell_updates": 1 00:08:32.294 } 00:08:32.294 ] 00:08:32.294 } 00:08:32.294 ] 00:08:32.294 }, 00:08:32.294 { 00:08:32.294 "name": "nvmf_tgt_poll_group_3", 00:08:32.294 "admin_qpairs": 2, 00:08:32.294 "io_qpairs": 26, 00:08:32.294 "current_admin_qpairs": 0, 00:08:32.294 "current_io_qpairs": 0, 00:08:32.294 "pending_bdev_io": 0, 00:08:32.294 "completed_nvme_io": 188, 00:08:32.294 "transports": [ 00:08:32.294 { 00:08:32.294 "trtype": "RDMA", 00:08:32.294 "pending_data_buffer": 0, 00:08:32.294 "devices": [ 00:08:32.294 { 00:08:32.294 "name": "mlx5_0", 00:08:32.294 "polls": 2736992, 00:08:32.294 "idle_polls": 2736571, 00:08:32.294 "completions": 486, 00:08:32.294 "requests": 243, 00:08:32.294 "request_latency": 44658940, 00:08:32.294 "pending_free_request": 0, 00:08:32.294 "pending_rdma_read": 0, 00:08:32.294 "pending_rdma_write": 0, 00:08:32.294 "pending_rdma_send": 0, 00:08:32.294 "total_send_wrs": 431, 00:08:32.294 "send_doorbell_updates": 206, 00:08:32.294 "total_recv_wrs": 4339, 00:08:32.294 "recv_doorbell_updates": 207 00:08:32.294 }, 00:08:32.294 { 00:08:32.294 "name": "mlx5_1", 00:08:32.294 "polls": 2736992, 00:08:32.294 "idle_polls": 2736992, 00:08:32.294 "completions": 0, 00:08:32.294 "requests": 0, 00:08:32.294 "request_latency": 0, 00:08:32.294 "pending_free_request": 0, 00:08:32.294 "pending_rdma_read": 0, 00:08:32.294 "pending_rdma_write": 0, 00:08:32.294 "pending_rdma_send": 0, 00:08:32.294 "total_send_wrs": 0, 00:08:32.294 "send_doorbell_updates": 0, 00:08:32.294 "total_recv_wrs": 4096, 00:08:32.294 "recv_doorbell_updates": 1 00:08:32.294 } 00:08:32.294 ] 00:08:32.294 } 00:08:32.294 ] 00:08:32.294 } 00:08:32.294 ] 00:08:32.294 }' 00:08:32.570 15:37:30 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:08:32.570 15:37:30 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:08:32.570 15:37:30 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:08:32.570 15:37:30 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:08:32.570 15:37:30 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:08:32.570 15:37:30 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:08:32.570 15:37:30 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:08:32.570 15:37:30 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:08:32.570 15:37:30 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:08:32.570 15:37:30 -- target/rpc.sh@113 -- # (( 105 > 0 )) 00:08:32.570 15:37:30 -- target/rpc.sh@115 -- # '[' rdma == rdma ']' 00:08:32.570 15:37:30 -- target/rpc.sh@117 -- # jsum '.poll_groups[].transports[].devices[].completions' 00:08:32.570 15:37:30 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].transports[].devices[].completions' 00:08:32.570 15:37:30 -- target/rpc.sh@20 -- # jq '.poll_groups[].transports[].devices[].completions' 00:08:32.570 15:37:30 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:08:32.570 15:37:30 -- target/rpc.sh@117 -- # (( 1298 > 0 )) 00:08:32.570 15:37:30 -- target/rpc.sh@118 -- # jsum '.poll_groups[].transports[].devices[].request_latency' 00:08:32.570 15:37:30 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].transports[].devices[].request_latency' 00:08:32.570 15:37:30 -- target/rpc.sh@20 -- # jq '.poll_groups[].transports[].devices[].request_latency' 00:08:32.570 15:37:30 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:08:32.570 15:37:31 -- target/rpc.sh@118 -- # (( 108809768 > 0 )) 00:08:32.570 15:37:31 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:08:32.570 15:37:31 -- target/rpc.sh@123 -- # nvmftestfini 00:08:32.570 15:37:31 -- nvmf/common.sh@477 -- # nvmfcleanup 00:08:32.570 15:37:31 -- nvmf/common.sh@117 -- # sync 00:08:32.570 15:37:31 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:08:32.570 15:37:31 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:08:32.570 15:37:31 -- nvmf/common.sh@120 -- # set +e 00:08:32.570 15:37:31 -- nvmf/common.sh@121 -- # for i in {1..20} 00:08:32.570 15:37:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:08:32.570 rmmod nvme_rdma 00:08:32.570 rmmod nvme_fabrics 00:08:32.570 15:37:31 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:08:32.570 15:37:31 -- nvmf/common.sh@124 -- # set -e 00:08:32.570 15:37:31 -- nvmf/common.sh@125 -- # return 0 00:08:32.570 15:37:31 -- nvmf/common.sh@478 -- # '[' -n 3212424 ']' 00:08:32.570 15:37:31 -- nvmf/common.sh@479 -- # killprocess 3212424 00:08:32.570 15:37:31 -- common/autotest_common.sh@936 -- # '[' -z 3212424 ']' 00:08:32.570 15:37:31 -- common/autotest_common.sh@940 -- # kill -0 3212424 00:08:32.570 15:37:31 -- common/autotest_common.sh@941 -- # uname 00:08:32.570 15:37:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:32.570 15:37:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3212424 00:08:32.570 15:37:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:32.570 15:37:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:32.570 15:37:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3212424' 00:08:32.570 killing process with pid 3212424 00:08:32.570 15:37:31 -- common/autotest_common.sh@955 -- # kill 3212424 00:08:32.570 15:37:31 -- common/autotest_common.sh@960 -- # wait 3212424 00:08:32.834 [2024-04-26 15:37:31.180253] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:08:32.834 15:37:31 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:08:32.834 15:37:31 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:08:32.834 00:08:32.834 real 0m35.951s 00:08:32.834 user 2m2.251s 00:08:32.834 sys 0m5.461s 00:08:32.834 15:37:31 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:32.835 15:37:31 -- common/autotest_common.sh@10 -- # set +x 00:08:32.835 ************************************ 00:08:32.835 END TEST nvmf_rpc 00:08:32.835 ************************************ 00:08:33.103 15:37:31 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=rdma 00:08:33.103 15:37:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:33.103 15:37:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:33.103 15:37:31 -- common/autotest_common.sh@10 -- # set +x 00:08:33.103 ************************************ 00:08:33.103 START TEST nvmf_invalid 00:08:33.103 ************************************ 00:08:33.103 15:37:31 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=rdma 00:08:33.103 * Looking for test storage... 00:08:33.103 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:08:33.103 15:37:31 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:08:33.103 15:37:31 -- nvmf/common.sh@7 -- # uname -s 00:08:33.103 15:37:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:33.103 15:37:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:33.103 15:37:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:33.103 15:37:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:33.103 15:37:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:33.103 15:37:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:33.103 15:37:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:33.103 15:37:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:33.103 15:37:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:33.103 15:37:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:33.103 15:37:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:08:33.103 15:37:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:08:33.103 15:37:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:33.103 15:37:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:33.103 15:37:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:33.104 15:37:31 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:33.104 15:37:31 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:08:33.104 15:37:31 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:33.104 15:37:31 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:33.104 15:37:31 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:33.104 15:37:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:33.104 15:37:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:33.104 15:37:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:33.104 15:37:31 -- paths/export.sh@5 -- # export PATH 00:08:33.104 15:37:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:33.104 15:37:31 -- nvmf/common.sh@47 -- # : 0 00:08:33.104 15:37:31 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:08:33.104 15:37:31 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:08:33.104 15:37:31 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:33.104 15:37:31 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:33.104 15:37:31 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:33.104 15:37:31 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:08:33.104 15:37:31 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:08:33.104 15:37:31 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:08:33.104 15:37:31 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:08:33.104 15:37:31 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:08:33.104 15:37:31 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:08:33.104 15:37:31 -- target/invalid.sh@14 -- # target=foobar 00:08:33.104 15:37:31 -- target/invalid.sh@16 -- # RANDOM=0 00:08:33.104 15:37:31 -- target/invalid.sh@34 -- # nvmftestinit 00:08:33.104 15:37:31 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:08:33.104 15:37:31 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:33.104 15:37:31 -- nvmf/common.sh@437 -- # prepare_net_devs 00:08:33.104 15:37:31 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:08:33.104 15:37:31 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:08:33.104 15:37:31 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:33.104 15:37:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:33.104 15:37:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:33.104 15:37:31 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:08:33.104 15:37:31 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:08:33.104 15:37:31 -- nvmf/common.sh@285 -- # xtrace_disable 00:08:33.104 15:37:31 -- common/autotest_common.sh@10 -- # set +x 00:08:38.371 15:37:36 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:38.371 15:37:36 -- nvmf/common.sh@291 -- # pci_devs=() 00:08:38.371 15:37:36 -- nvmf/common.sh@291 -- # local -a pci_devs 00:08:38.371 15:37:36 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:08:38.371 15:37:36 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:08:38.371 15:37:36 -- nvmf/common.sh@293 -- # pci_drivers=() 00:08:38.371 15:37:36 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:08:38.371 15:37:36 -- nvmf/common.sh@295 -- # net_devs=() 00:08:38.371 15:37:36 -- nvmf/common.sh@295 -- # local -ga net_devs 00:08:38.371 15:37:36 -- nvmf/common.sh@296 -- # e810=() 00:08:38.371 15:37:36 -- nvmf/common.sh@296 -- # local -ga e810 00:08:38.371 15:37:36 -- nvmf/common.sh@297 -- # x722=() 00:08:38.371 15:37:36 -- nvmf/common.sh@297 -- # local -ga x722 00:08:38.371 15:37:36 -- nvmf/common.sh@298 -- # mlx=() 00:08:38.371 15:37:36 -- nvmf/common.sh@298 -- # local -ga mlx 00:08:38.371 15:37:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:38.371 15:37:36 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:38.371 15:37:36 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:38.371 15:37:36 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:38.371 15:37:36 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:38.371 15:37:36 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:38.371 15:37:36 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:38.371 15:37:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:38.371 15:37:36 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:38.371 15:37:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:38.371 15:37:36 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:38.371 15:37:36 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:08:38.371 15:37:36 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:08:38.371 15:37:36 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:08:38.371 15:37:36 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:08:38.371 15:37:36 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:08:38.371 15:37:36 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:08:38.371 15:37:36 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:08:38.371 15:37:36 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:38.371 15:37:36 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:08:38.371 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:08:38.371 15:37:36 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:38.371 15:37:36 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:38.371 15:37:36 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:38.371 15:37:36 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:38.371 15:37:36 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:38.371 15:37:36 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:38.371 15:37:36 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:38.371 15:37:36 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:08:38.371 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:08:38.371 15:37:36 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:38.371 15:37:36 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:38.371 15:37:36 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:38.371 15:37:36 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:38.371 15:37:36 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:38.371 15:37:36 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:38.371 15:37:36 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:08:38.371 15:37:36 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:08:38.371 15:37:36 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:38.371 15:37:36 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:38.371 15:37:36 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:38.371 15:37:36 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:38.371 15:37:36 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:08:38.371 Found net devices under 0000:da:00.0: mlx_0_0 00:08:38.371 15:37:36 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:38.371 15:37:36 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:38.371 15:37:36 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:38.371 15:37:36 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:38.371 15:37:36 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:38.371 15:37:36 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:08:38.371 Found net devices under 0000:da:00.1: mlx_0_1 00:08:38.371 15:37:36 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:38.371 15:37:36 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:08:38.371 15:37:36 -- nvmf/common.sh@403 -- # is_hw=yes 00:08:38.371 15:37:36 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:08:38.371 15:37:36 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:08:38.371 15:37:36 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:08:38.371 15:37:36 -- nvmf/common.sh@409 -- # rdma_device_init 00:08:38.371 15:37:36 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:08:38.371 15:37:36 -- nvmf/common.sh@58 -- # uname 00:08:38.372 15:37:36 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:08:38.372 15:37:36 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:08:38.372 15:37:36 -- nvmf/common.sh@63 -- # modprobe ib_core 00:08:38.372 15:37:36 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:08:38.372 15:37:36 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:08:38.372 15:37:36 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:08:38.372 15:37:36 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:08:38.372 15:37:36 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:08:38.372 15:37:36 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:08:38.372 15:37:36 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:08:38.372 15:37:36 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:08:38.372 15:37:36 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:38.372 15:37:36 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:38.372 15:37:36 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:38.372 15:37:36 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:38.372 15:37:36 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:38.372 15:37:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:38.372 15:37:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:38.372 15:37:36 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:38.372 15:37:36 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:38.372 15:37:36 -- nvmf/common.sh@105 -- # continue 2 00:08:38.372 15:37:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:38.372 15:37:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:38.372 15:37:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:38.372 15:37:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:38.372 15:37:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:38.372 15:37:36 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:38.372 15:37:36 -- nvmf/common.sh@105 -- # continue 2 00:08:38.372 15:37:36 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:38.372 15:37:36 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:08:38.372 15:37:36 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:38.372 15:37:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:38.372 15:37:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:38.372 15:37:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:38.372 15:37:36 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:08:38.372 15:37:36 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:08:38.372 15:37:36 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:08:38.372 118: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:38.372 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:08:38.372 altname enp218s0f0np0 00:08:38.372 altname ens818f0np0 00:08:38.372 inet 192.168.100.8/24 scope global mlx_0_0 00:08:38.372 valid_lft forever preferred_lft forever 00:08:38.372 15:37:36 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:38.372 15:37:36 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:08:38.372 15:37:36 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:38.372 15:37:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:38.372 15:37:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:38.372 15:37:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:38.372 15:37:36 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:08:38.372 15:37:36 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:08:38.372 15:37:36 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:08:38.372 119: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:38.372 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:08:38.372 altname enp218s0f1np1 00:08:38.372 altname ens818f1np1 00:08:38.372 inet 192.168.100.9/24 scope global mlx_0_1 00:08:38.372 valid_lft forever preferred_lft forever 00:08:38.372 15:37:36 -- nvmf/common.sh@411 -- # return 0 00:08:38.372 15:37:36 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:08:38.372 15:37:36 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:08:38.372 15:37:36 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:08:38.372 15:37:36 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:08:38.372 15:37:36 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:08:38.372 15:37:36 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:38.372 15:37:36 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:38.372 15:37:36 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:38.372 15:37:36 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:38.372 15:37:36 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:38.372 15:37:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:38.372 15:37:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:38.372 15:37:36 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:38.372 15:37:36 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:38.372 15:37:36 -- nvmf/common.sh@105 -- # continue 2 00:08:38.372 15:37:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:38.372 15:37:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:38.372 15:37:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:38.372 15:37:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:38.372 15:37:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:38.372 15:37:36 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:38.372 15:37:36 -- nvmf/common.sh@105 -- # continue 2 00:08:38.372 15:37:36 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:38.372 15:37:36 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:08:38.372 15:37:36 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:38.372 15:37:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:38.372 15:37:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:38.372 15:37:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:38.372 15:37:36 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:38.372 15:37:36 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:08:38.372 15:37:36 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:38.372 15:37:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:38.372 15:37:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:38.372 15:37:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:38.372 15:37:36 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:08:38.372 192.168.100.9' 00:08:38.372 15:37:36 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:08:38.372 192.168.100.9' 00:08:38.372 15:37:36 -- nvmf/common.sh@446 -- # head -n 1 00:08:38.372 15:37:36 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:08:38.372 15:37:36 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:08:38.372 192.168.100.9' 00:08:38.372 15:37:36 -- nvmf/common.sh@447 -- # tail -n +2 00:08:38.372 15:37:36 -- nvmf/common.sh@447 -- # head -n 1 00:08:38.372 15:37:36 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:08:38.372 15:37:36 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:08:38.372 15:37:36 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:08:38.372 15:37:36 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:08:38.372 15:37:36 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:08:38.372 15:37:36 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:08:38.372 15:37:36 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:08:38.372 15:37:36 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:08:38.372 15:37:36 -- common/autotest_common.sh@710 -- # xtrace_disable 00:08:38.372 15:37:36 -- common/autotest_common.sh@10 -- # set +x 00:08:38.372 15:37:36 -- nvmf/common.sh@470 -- # nvmfpid=3220527 00:08:38.372 15:37:36 -- nvmf/common.sh@471 -- # waitforlisten 3220527 00:08:38.372 15:37:36 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:38.372 15:37:36 -- common/autotest_common.sh@817 -- # '[' -z 3220527 ']' 00:08:38.372 15:37:36 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:38.372 15:37:36 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:38.372 15:37:36 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:38.372 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:38.372 15:37:36 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:38.372 15:37:36 -- common/autotest_common.sh@10 -- # set +x 00:08:38.372 [2024-04-26 15:37:36.672464] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:08:38.372 [2024-04-26 15:37:36.672519] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:38.372 EAL: No free 2048 kB hugepages reported on node 1 00:08:38.372 [2024-04-26 15:37:36.726703] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:38.372 [2024-04-26 15:37:36.803130] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:38.372 [2024-04-26 15:37:36.803168] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:38.372 [2024-04-26 15:37:36.803176] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:38.372 [2024-04-26 15:37:36.803182] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:38.372 [2024-04-26 15:37:36.803187] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:38.372 [2024-04-26 15:37:36.803228] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:38.372 [2024-04-26 15:37:36.803257] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:38.372 [2024-04-26 15:37:36.803359] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:38.372 [2024-04-26 15:37:36.803360] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:38.938 15:37:37 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:38.938 15:37:37 -- common/autotest_common.sh@850 -- # return 0 00:08:38.938 15:37:37 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:08:38.938 15:37:37 -- common/autotest_common.sh@716 -- # xtrace_disable 00:08:38.938 15:37:37 -- common/autotest_common.sh@10 -- # set +x 00:08:38.938 15:37:37 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:38.938 15:37:37 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:08:38.938 15:37:37 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode19806 00:08:39.197 [2024-04-26 15:37:37.656460] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:08:39.197 15:37:37 -- target/invalid.sh@40 -- # out='request: 00:08:39.197 { 00:08:39.197 "nqn": "nqn.2016-06.io.spdk:cnode19806", 00:08:39.197 "tgt_name": "foobar", 00:08:39.197 "method": "nvmf_create_subsystem", 00:08:39.197 "req_id": 1 00:08:39.197 } 00:08:39.197 Got JSON-RPC error response 00:08:39.197 response: 00:08:39.197 { 00:08:39.197 "code": -32603, 00:08:39.197 "message": "Unable to find target foobar" 00:08:39.197 }' 00:08:39.197 15:37:37 -- target/invalid.sh@41 -- # [[ request: 00:08:39.197 { 00:08:39.197 "nqn": "nqn.2016-06.io.spdk:cnode19806", 00:08:39.197 "tgt_name": "foobar", 00:08:39.197 "method": "nvmf_create_subsystem", 00:08:39.197 "req_id": 1 00:08:39.197 } 00:08:39.197 Got JSON-RPC error response 00:08:39.197 response: 00:08:39.197 { 00:08:39.197 "code": -32603, 00:08:39.197 "message": "Unable to find target foobar" 00:08:39.197 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:08:39.197 15:37:37 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:08:39.197 15:37:37 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode2640 00:08:39.455 [2024-04-26 15:37:37.837088] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2640: invalid serial number 'SPDKISFASTANDAWESOME' 00:08:39.455 15:37:37 -- target/invalid.sh@45 -- # out='request: 00:08:39.455 { 00:08:39.455 "nqn": "nqn.2016-06.io.spdk:cnode2640", 00:08:39.455 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:08:39.455 "method": "nvmf_create_subsystem", 00:08:39.455 "req_id": 1 00:08:39.455 } 00:08:39.455 Got JSON-RPC error response 00:08:39.455 response: 00:08:39.455 { 00:08:39.455 "code": -32602, 00:08:39.455 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:08:39.455 }' 00:08:39.455 15:37:37 -- target/invalid.sh@46 -- # [[ request: 00:08:39.455 { 00:08:39.455 "nqn": "nqn.2016-06.io.spdk:cnode2640", 00:08:39.455 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:08:39.455 "method": "nvmf_create_subsystem", 00:08:39.455 "req_id": 1 00:08:39.455 } 00:08:39.455 Got JSON-RPC error response 00:08:39.455 response: 00:08:39.455 { 00:08:39.455 "code": -32602, 00:08:39.455 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:08:39.455 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:08:39.455 15:37:37 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:08:39.455 15:37:37 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode5942 00:08:39.455 [2024-04-26 15:37:38.021656] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode5942: invalid model number 'SPDK_Controller' 00:08:39.455 15:37:38 -- target/invalid.sh@50 -- # out='request: 00:08:39.455 { 00:08:39.455 "nqn": "nqn.2016-06.io.spdk:cnode5942", 00:08:39.455 "model_number": "SPDK_Controller\u001f", 00:08:39.455 "method": "nvmf_create_subsystem", 00:08:39.455 "req_id": 1 00:08:39.455 } 00:08:39.456 Got JSON-RPC error response 00:08:39.456 response: 00:08:39.456 { 00:08:39.456 "code": -32602, 00:08:39.456 "message": "Invalid MN SPDK_Controller\u001f" 00:08:39.456 }' 00:08:39.456 15:37:38 -- target/invalid.sh@51 -- # [[ request: 00:08:39.456 { 00:08:39.456 "nqn": "nqn.2016-06.io.spdk:cnode5942", 00:08:39.456 "model_number": "SPDK_Controller\u001f", 00:08:39.456 "method": "nvmf_create_subsystem", 00:08:39.456 "req_id": 1 00:08:39.456 } 00:08:39.456 Got JSON-RPC error response 00:08:39.456 response: 00:08:39.456 { 00:08:39.456 "code": -32602, 00:08:39.456 "message": "Invalid MN SPDK_Controller\u001f" 00:08:39.456 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:08:39.456 15:37:38 -- target/invalid.sh@54 -- # gen_random_s 21 00:08:39.456 15:37:38 -- target/invalid.sh@19 -- # local length=21 ll 00:08:39.456 15:37:38 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:08:39.456 15:37:38 -- target/invalid.sh@21 -- # local chars 00:08:39.456 15:37:38 -- target/invalid.sh@22 -- # local string 00:08:39.456 15:37:38 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:08:39.456 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.714 15:37:38 -- target/invalid.sh@25 -- # printf %x 121 00:08:39.714 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x79' 00:08:39.714 15:37:38 -- target/invalid.sh@25 -- # string+=y 00:08:39.714 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.714 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.714 15:37:38 -- target/invalid.sh@25 -- # printf %x 96 00:08:39.714 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x60' 00:08:39.714 15:37:38 -- target/invalid.sh@25 -- # string+='`' 00:08:39.714 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.714 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.714 15:37:38 -- target/invalid.sh@25 -- # printf %x 84 00:08:39.714 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x54' 00:08:39.714 15:37:38 -- target/invalid.sh@25 -- # string+=T 00:08:39.714 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.714 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.714 15:37:38 -- target/invalid.sh@25 -- # printf %x 43 00:08:39.714 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x2b' 00:08:39.714 15:37:38 -- target/invalid.sh@25 -- # string+=+ 00:08:39.714 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.714 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.714 15:37:38 -- target/invalid.sh@25 -- # printf %x 117 00:08:39.714 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x75' 00:08:39.714 15:37:38 -- target/invalid.sh@25 -- # string+=u 00:08:39.714 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.714 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.714 15:37:38 -- target/invalid.sh@25 -- # printf %x 65 00:08:39.714 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x41' 00:08:39.714 15:37:38 -- target/invalid.sh@25 -- # string+=A 00:08:39.714 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.714 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.714 15:37:38 -- target/invalid.sh@25 -- # printf %x 75 00:08:39.714 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:08:39.714 15:37:38 -- target/invalid.sh@25 -- # string+=K 00:08:39.714 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.714 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.714 15:37:38 -- target/invalid.sh@25 -- # printf %x 61 00:08:39.714 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x3d' 00:08:39.714 15:37:38 -- target/invalid.sh@25 -- # string+== 00:08:39.714 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.715 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # printf %x 81 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x51' 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # string+=Q 00:08:39.715 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.715 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # printf %x 113 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x71' 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # string+=q 00:08:39.715 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.715 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # printf %x 79 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # string+=O 00:08:39.715 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.715 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # printf %x 87 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x57' 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # string+=W 00:08:39.715 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.715 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # printf %x 87 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x57' 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # string+=W 00:08:39.715 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.715 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # printf %x 63 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x3f' 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # string+='?' 00:08:39.715 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.715 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # printf %x 69 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x45' 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # string+=E 00:08:39.715 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.715 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # printf %x 54 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x36' 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # string+=6 00:08:39.715 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.715 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # printf %x 87 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x57' 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # string+=W 00:08:39.715 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.715 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # printf %x 40 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x28' 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # string+='(' 00:08:39.715 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.715 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # printf %x 120 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x78' 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # string+=x 00:08:39.715 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.715 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # printf %x 124 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # string+='|' 00:08:39.715 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.715 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # printf %x 59 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x3b' 00:08:39.715 15:37:38 -- target/invalid.sh@25 -- # string+=';' 00:08:39.715 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.715 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.715 15:37:38 -- target/invalid.sh@28 -- # [[ y == \- ]] 00:08:39.715 15:37:38 -- target/invalid.sh@31 -- # echo 'y`T+uAK=QqOWW?E6W(x|;' 00:08:39.715 15:37:38 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s 'y`T+uAK=QqOWW?E6W(x|;' nqn.2016-06.io.spdk:cnode24673 00:08:39.974 [2024-04-26 15:37:38.354758] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode24673: invalid serial number 'y`T+uAK=QqOWW?E6W(x|;' 00:08:39.974 15:37:38 -- target/invalid.sh@54 -- # out='request: 00:08:39.974 { 00:08:39.974 "nqn": "nqn.2016-06.io.spdk:cnode24673", 00:08:39.974 "serial_number": "y`T+uAK=QqOWW?E6W(x|;", 00:08:39.974 "method": "nvmf_create_subsystem", 00:08:39.974 "req_id": 1 00:08:39.974 } 00:08:39.974 Got JSON-RPC error response 00:08:39.974 response: 00:08:39.974 { 00:08:39.974 "code": -32602, 00:08:39.974 "message": "Invalid SN y`T+uAK=QqOWW?E6W(x|;" 00:08:39.974 }' 00:08:39.974 15:37:38 -- target/invalid.sh@55 -- # [[ request: 00:08:39.974 { 00:08:39.974 "nqn": "nqn.2016-06.io.spdk:cnode24673", 00:08:39.974 "serial_number": "y`T+uAK=QqOWW?E6W(x|;", 00:08:39.974 "method": "nvmf_create_subsystem", 00:08:39.974 "req_id": 1 00:08:39.974 } 00:08:39.974 Got JSON-RPC error response 00:08:39.974 response: 00:08:39.974 { 00:08:39.974 "code": -32602, 00:08:39.974 "message": "Invalid SN y`T+uAK=QqOWW?E6W(x|;" 00:08:39.974 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:08:39.974 15:37:38 -- target/invalid.sh@58 -- # gen_random_s 41 00:08:39.974 15:37:38 -- target/invalid.sh@19 -- # local length=41 ll 00:08:39.974 15:37:38 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:08:39.974 15:37:38 -- target/invalid.sh@21 -- # local chars 00:08:39.974 15:37:38 -- target/invalid.sh@22 -- # local string 00:08:39.974 15:37:38 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:08:39.974 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # printf %x 65 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x41' 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # string+=A 00:08:39.974 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.974 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # printf %x 95 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x5f' 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # string+=_ 00:08:39.974 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.974 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # printf %x 88 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x58' 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # string+=X 00:08:39.974 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.974 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # printf %x 50 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x32' 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # string+=2 00:08:39.974 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.974 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # printf %x 69 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x45' 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # string+=E 00:08:39.974 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.974 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # printf %x 110 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # string+=n 00:08:39.974 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.974 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # printf %x 66 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x42' 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # string+=B 00:08:39.974 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.974 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # printf %x 78 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x4e' 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # string+=N 00:08:39.974 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.974 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # printf %x 67 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x43' 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # string+=C 00:08:39.974 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.974 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # printf %x 72 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x48' 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # string+=H 00:08:39.974 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.974 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # printf %x 86 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x56' 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # string+=V 00:08:39.974 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.974 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # printf %x 56 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x38' 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # string+=8 00:08:39.974 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.974 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # printf %x 48 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x30' 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # string+=0 00:08:39.974 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.974 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.974 15:37:38 -- target/invalid.sh@25 -- # printf %x 75 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # string+=K 00:08:39.975 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.975 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # printf %x 87 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x57' 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # string+=W 00:08:39.975 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.975 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # printf %x 92 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # string+='\' 00:08:39.975 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.975 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # printf %x 53 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x35' 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # string+=5 00:08:39.975 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.975 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # printf %x 50 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x32' 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # string+=2 00:08:39.975 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.975 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # printf %x 110 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # string+=n 00:08:39.975 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.975 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # printf %x 66 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x42' 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # string+=B 00:08:39.975 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.975 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # printf %x 93 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x5d' 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # string+=']' 00:08:39.975 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.975 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # printf %x 101 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x65' 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # string+=e 00:08:39.975 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.975 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # printf %x 39 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x27' 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # string+=\' 00:08:39.975 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.975 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # printf %x 122 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # string+=z 00:08:39.975 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.975 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # printf %x 40 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x28' 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # string+='(' 00:08:39.975 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.975 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # printf %x 120 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x78' 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # string+=x 00:08:39.975 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.975 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # printf %x 59 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x3b' 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # string+=';' 00:08:39.975 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.975 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # printf %x 118 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x76' 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # string+=v 00:08:39.975 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.975 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # printf %x 108 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # string+=l 00:08:39.975 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:39.975 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:39.975 15:37:38 -- target/invalid.sh@25 -- # printf %x 87 00:08:40.234 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x57' 00:08:40.234 15:37:38 -- target/invalid.sh@25 -- # string+=W 00:08:40.234 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:40.234 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:40.234 15:37:38 -- target/invalid.sh@25 -- # printf %x 52 00:08:40.234 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x34' 00:08:40.234 15:37:38 -- target/invalid.sh@25 -- # string+=4 00:08:40.234 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:40.234 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:40.234 15:37:38 -- target/invalid.sh@25 -- # printf %x 64 00:08:40.234 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x40' 00:08:40.234 15:37:38 -- target/invalid.sh@25 -- # string+=@ 00:08:40.234 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:40.234 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:40.234 15:37:38 -- target/invalid.sh@25 -- # printf %x 36 00:08:40.234 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x24' 00:08:40.234 15:37:38 -- target/invalid.sh@25 -- # string+='$' 00:08:40.234 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:40.234 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:40.234 15:37:38 -- target/invalid.sh@25 -- # printf %x 93 00:08:40.234 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x5d' 00:08:40.234 15:37:38 -- target/invalid.sh@25 -- # string+=']' 00:08:40.234 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:40.234 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:40.234 15:37:38 -- target/invalid.sh@25 -- # printf %x 44 00:08:40.234 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x2c' 00:08:40.234 15:37:38 -- target/invalid.sh@25 -- # string+=, 00:08:40.234 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:40.234 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:40.234 15:37:38 -- target/invalid.sh@25 -- # printf %x 41 00:08:40.234 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x29' 00:08:40.234 15:37:38 -- target/invalid.sh@25 -- # string+=')' 00:08:40.234 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:40.234 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:40.234 15:37:38 -- target/invalid.sh@25 -- # printf %x 114 00:08:40.234 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x72' 00:08:40.234 15:37:38 -- target/invalid.sh@25 -- # string+=r 00:08:40.234 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:40.234 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:40.234 15:37:38 -- target/invalid.sh@25 -- # printf %x 55 00:08:40.234 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x37' 00:08:40.234 15:37:38 -- target/invalid.sh@25 -- # string+=7 00:08:40.234 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:40.234 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:40.234 15:37:38 -- target/invalid.sh@25 -- # printf %x 95 00:08:40.234 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x5f' 00:08:40.234 15:37:38 -- target/invalid.sh@25 -- # string+=_ 00:08:40.234 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:40.234 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:40.234 15:37:38 -- target/invalid.sh@25 -- # printf %x 67 00:08:40.234 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x43' 00:08:40.234 15:37:38 -- target/invalid.sh@25 -- # string+=C 00:08:40.234 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:40.234 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:40.234 15:37:38 -- target/invalid.sh@25 -- # printf %x 124 00:08:40.234 15:37:38 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:08:40.234 15:37:38 -- target/invalid.sh@25 -- # string+='|' 00:08:40.234 15:37:38 -- target/invalid.sh@24 -- # (( ll++ )) 00:08:40.234 15:37:38 -- target/invalid.sh@24 -- # (( ll < length )) 00:08:40.234 15:37:38 -- target/invalid.sh@28 -- # [[ A == \- ]] 00:08:40.234 15:37:38 -- target/invalid.sh@31 -- # echo 'A_X2EnBNCHV80KW\52nB]e'\''z(x;vlW4@$],)r7_C|' 00:08:40.234 15:37:38 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d 'A_X2EnBNCHV80KW\52nB]e'\''z(x;vlW4@$],)r7_C|' nqn.2016-06.io.spdk:cnode13223 00:08:40.234 [2024-04-26 15:37:38.800242] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode13223: invalid model number 'A_X2EnBNCHV80KW\52nB]e'z(x;vlW4@$],)r7_C|' 00:08:40.234 15:37:38 -- target/invalid.sh@58 -- # out='request: 00:08:40.234 { 00:08:40.234 "nqn": "nqn.2016-06.io.spdk:cnode13223", 00:08:40.234 "model_number": "A_X2EnBNCHV80KW\\52nB]e'\''z(x;vlW4@$],)r7_C|", 00:08:40.234 "method": "nvmf_create_subsystem", 00:08:40.234 "req_id": 1 00:08:40.234 } 00:08:40.234 Got JSON-RPC error response 00:08:40.234 response: 00:08:40.234 { 00:08:40.234 "code": -32602, 00:08:40.234 "message": "Invalid MN A_X2EnBNCHV80KW\\52nB]e'\''z(x;vlW4@$],)r7_C|" 00:08:40.234 }' 00:08:40.234 15:37:38 -- target/invalid.sh@59 -- # [[ request: 00:08:40.234 { 00:08:40.234 "nqn": "nqn.2016-06.io.spdk:cnode13223", 00:08:40.234 "model_number": "A_X2EnBNCHV80KW\\52nB]e'z(x;vlW4@$],)r7_C|", 00:08:40.234 "method": "nvmf_create_subsystem", 00:08:40.234 "req_id": 1 00:08:40.234 } 00:08:40.234 Got JSON-RPC error response 00:08:40.234 response: 00:08:40.234 { 00:08:40.234 "code": -32602, 00:08:40.234 "message": "Invalid MN A_X2EnBNCHV80KW\\52nB]e'z(x;vlW4@$],)r7_C|" 00:08:40.234 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:08:40.234 15:37:38 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype rdma 00:08:40.492 [2024-04-26 15:37:39.004053] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1e807c0/0x1e84cb0) succeed. 00:08:40.492 [2024-04-26 15:37:39.015743] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1e81e00/0x1ec6340) succeed. 00:08:40.750 15:37:39 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:08:40.750 15:37:39 -- target/invalid.sh@64 -- # [[ rdma == \T\C\P ]] 00:08:40.750 15:37:39 -- target/invalid.sh@67 -- # echo '192.168.100.8 00:08:40.750 192.168.100.9' 00:08:40.750 15:37:39 -- target/invalid.sh@67 -- # head -n 1 00:08:40.750 15:37:39 -- target/invalid.sh@67 -- # IP=192.168.100.8 00:08:40.750 15:37:39 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t rdma -a 192.168.100.8 -s 4421 00:08:41.008 [2024-04-26 15:37:39.494294] nvmf_rpc.c: 792:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:08:41.008 15:37:39 -- target/invalid.sh@69 -- # out='request: 00:08:41.008 { 00:08:41.008 "nqn": "nqn.2016-06.io.spdk:cnode", 00:08:41.008 "listen_address": { 00:08:41.008 "trtype": "rdma", 00:08:41.008 "traddr": "192.168.100.8", 00:08:41.008 "trsvcid": "4421" 00:08:41.008 }, 00:08:41.008 "method": "nvmf_subsystem_remove_listener", 00:08:41.008 "req_id": 1 00:08:41.008 } 00:08:41.008 Got JSON-RPC error response 00:08:41.008 response: 00:08:41.008 { 00:08:41.008 "code": -32602, 00:08:41.008 "message": "Invalid parameters" 00:08:41.008 }' 00:08:41.008 15:37:39 -- target/invalid.sh@70 -- # [[ request: 00:08:41.008 { 00:08:41.008 "nqn": "nqn.2016-06.io.spdk:cnode", 00:08:41.008 "listen_address": { 00:08:41.008 "trtype": "rdma", 00:08:41.008 "traddr": "192.168.100.8", 00:08:41.008 "trsvcid": "4421" 00:08:41.008 }, 00:08:41.008 "method": "nvmf_subsystem_remove_listener", 00:08:41.008 "req_id": 1 00:08:41.008 } 00:08:41.008 Got JSON-RPC error response 00:08:41.008 response: 00:08:41.008 { 00:08:41.008 "code": -32602, 00:08:41.008 "message": "Invalid parameters" 00:08:41.008 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:08:41.008 15:37:39 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2190 -i 0 00:08:41.267 [2024-04-26 15:37:39.686949] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2190: invalid cntlid range [0-65519] 00:08:41.267 15:37:39 -- target/invalid.sh@73 -- # out='request: 00:08:41.267 { 00:08:41.267 "nqn": "nqn.2016-06.io.spdk:cnode2190", 00:08:41.267 "min_cntlid": 0, 00:08:41.267 "method": "nvmf_create_subsystem", 00:08:41.267 "req_id": 1 00:08:41.267 } 00:08:41.267 Got JSON-RPC error response 00:08:41.267 response: 00:08:41.267 { 00:08:41.267 "code": -32602, 00:08:41.267 "message": "Invalid cntlid range [0-65519]" 00:08:41.267 }' 00:08:41.267 15:37:39 -- target/invalid.sh@74 -- # [[ request: 00:08:41.267 { 00:08:41.267 "nqn": "nqn.2016-06.io.spdk:cnode2190", 00:08:41.267 "min_cntlid": 0, 00:08:41.267 "method": "nvmf_create_subsystem", 00:08:41.267 "req_id": 1 00:08:41.267 } 00:08:41.267 Got JSON-RPC error response 00:08:41.267 response: 00:08:41.267 { 00:08:41.267 "code": -32602, 00:08:41.267 "message": "Invalid cntlid range [0-65519]" 00:08:41.267 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:08:41.267 15:37:39 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode17904 -i 65520 00:08:41.525 [2024-04-26 15:37:39.883649] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode17904: invalid cntlid range [65520-65519] 00:08:41.525 15:37:39 -- target/invalid.sh@75 -- # out='request: 00:08:41.525 { 00:08:41.525 "nqn": "nqn.2016-06.io.spdk:cnode17904", 00:08:41.525 "min_cntlid": 65520, 00:08:41.525 "method": "nvmf_create_subsystem", 00:08:41.525 "req_id": 1 00:08:41.525 } 00:08:41.525 Got JSON-RPC error response 00:08:41.525 response: 00:08:41.525 { 00:08:41.525 "code": -32602, 00:08:41.525 "message": "Invalid cntlid range [65520-65519]" 00:08:41.525 }' 00:08:41.525 15:37:39 -- target/invalid.sh@76 -- # [[ request: 00:08:41.525 { 00:08:41.525 "nqn": "nqn.2016-06.io.spdk:cnode17904", 00:08:41.525 "min_cntlid": 65520, 00:08:41.525 "method": "nvmf_create_subsystem", 00:08:41.525 "req_id": 1 00:08:41.525 } 00:08:41.525 Got JSON-RPC error response 00:08:41.525 response: 00:08:41.525 { 00:08:41.525 "code": -32602, 00:08:41.525 "message": "Invalid cntlid range [65520-65519]" 00:08:41.525 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:08:41.525 15:37:39 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode32544 -I 0 00:08:41.525 [2024-04-26 15:37:40.060340] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode32544: invalid cntlid range [1-0] 00:08:41.525 15:37:40 -- target/invalid.sh@77 -- # out='request: 00:08:41.525 { 00:08:41.525 "nqn": "nqn.2016-06.io.spdk:cnode32544", 00:08:41.525 "max_cntlid": 0, 00:08:41.525 "method": "nvmf_create_subsystem", 00:08:41.525 "req_id": 1 00:08:41.525 } 00:08:41.525 Got JSON-RPC error response 00:08:41.525 response: 00:08:41.525 { 00:08:41.525 "code": -32602, 00:08:41.525 "message": "Invalid cntlid range [1-0]" 00:08:41.525 }' 00:08:41.525 15:37:40 -- target/invalid.sh@78 -- # [[ request: 00:08:41.525 { 00:08:41.525 "nqn": "nqn.2016-06.io.spdk:cnode32544", 00:08:41.525 "max_cntlid": 0, 00:08:41.525 "method": "nvmf_create_subsystem", 00:08:41.525 "req_id": 1 00:08:41.525 } 00:08:41.525 Got JSON-RPC error response 00:08:41.525 response: 00:08:41.525 { 00:08:41.525 "code": -32602, 00:08:41.525 "message": "Invalid cntlid range [1-0]" 00:08:41.525 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:08:41.525 15:37:40 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode25962 -I 65520 00:08:41.784 [2024-04-26 15:37:40.253032] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode25962: invalid cntlid range [1-65520] 00:08:41.784 15:37:40 -- target/invalid.sh@79 -- # out='request: 00:08:41.784 { 00:08:41.784 "nqn": "nqn.2016-06.io.spdk:cnode25962", 00:08:41.784 "max_cntlid": 65520, 00:08:41.784 "method": "nvmf_create_subsystem", 00:08:41.784 "req_id": 1 00:08:41.784 } 00:08:41.784 Got JSON-RPC error response 00:08:41.784 response: 00:08:41.784 { 00:08:41.784 "code": -32602, 00:08:41.784 "message": "Invalid cntlid range [1-65520]" 00:08:41.784 }' 00:08:41.784 15:37:40 -- target/invalid.sh@80 -- # [[ request: 00:08:41.784 { 00:08:41.784 "nqn": "nqn.2016-06.io.spdk:cnode25962", 00:08:41.784 "max_cntlid": 65520, 00:08:41.784 "method": "nvmf_create_subsystem", 00:08:41.784 "req_id": 1 00:08:41.784 } 00:08:41.784 Got JSON-RPC error response 00:08:41.784 response: 00:08:41.784 { 00:08:41.784 "code": -32602, 00:08:41.784 "message": "Invalid cntlid range [1-65520]" 00:08:41.784 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:08:41.784 15:37:40 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode27310 -i 6 -I 5 00:08:42.043 [2024-04-26 15:37:40.417612] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode27310: invalid cntlid range [6-5] 00:08:42.043 15:37:40 -- target/invalid.sh@83 -- # out='request: 00:08:42.043 { 00:08:42.043 "nqn": "nqn.2016-06.io.spdk:cnode27310", 00:08:42.043 "min_cntlid": 6, 00:08:42.043 "max_cntlid": 5, 00:08:42.043 "method": "nvmf_create_subsystem", 00:08:42.043 "req_id": 1 00:08:42.043 } 00:08:42.043 Got JSON-RPC error response 00:08:42.043 response: 00:08:42.043 { 00:08:42.043 "code": -32602, 00:08:42.043 "message": "Invalid cntlid range [6-5]" 00:08:42.043 }' 00:08:42.043 15:37:40 -- target/invalid.sh@84 -- # [[ request: 00:08:42.043 { 00:08:42.043 "nqn": "nqn.2016-06.io.spdk:cnode27310", 00:08:42.043 "min_cntlid": 6, 00:08:42.043 "max_cntlid": 5, 00:08:42.043 "method": "nvmf_create_subsystem", 00:08:42.043 "req_id": 1 00:08:42.043 } 00:08:42.043 Got JSON-RPC error response 00:08:42.043 response: 00:08:42.043 { 00:08:42.043 "code": -32602, 00:08:42.043 "message": "Invalid cntlid range [6-5]" 00:08:42.043 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:08:42.043 15:37:40 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:08:42.043 15:37:40 -- target/invalid.sh@87 -- # out='request: 00:08:42.043 { 00:08:42.043 "name": "foobar", 00:08:42.043 "method": "nvmf_delete_target", 00:08:42.043 "req_id": 1 00:08:42.043 } 00:08:42.043 Got JSON-RPC error response 00:08:42.043 response: 00:08:42.043 { 00:08:42.043 "code": -32602, 00:08:42.043 "message": "The specified target doesn'\''t exist, cannot delete it." 00:08:42.043 }' 00:08:42.043 15:37:40 -- target/invalid.sh@88 -- # [[ request: 00:08:42.043 { 00:08:42.043 "name": "foobar", 00:08:42.043 "method": "nvmf_delete_target", 00:08:42.043 "req_id": 1 00:08:42.043 } 00:08:42.043 Got JSON-RPC error response 00:08:42.043 response: 00:08:42.043 { 00:08:42.043 "code": -32602, 00:08:42.043 "message": "The specified target doesn't exist, cannot delete it." 00:08:42.043 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:08:42.043 15:37:40 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:08:42.043 15:37:40 -- target/invalid.sh@91 -- # nvmftestfini 00:08:42.043 15:37:40 -- nvmf/common.sh@477 -- # nvmfcleanup 00:08:42.043 15:37:40 -- nvmf/common.sh@117 -- # sync 00:08:42.043 15:37:40 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:08:42.043 15:37:40 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:08:42.043 15:37:40 -- nvmf/common.sh@120 -- # set +e 00:08:42.043 15:37:40 -- nvmf/common.sh@121 -- # for i in {1..20} 00:08:42.043 15:37:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:08:42.043 rmmod nvme_rdma 00:08:42.043 rmmod nvme_fabrics 00:08:42.043 15:37:40 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:08:42.043 15:37:40 -- nvmf/common.sh@124 -- # set -e 00:08:42.043 15:37:40 -- nvmf/common.sh@125 -- # return 0 00:08:42.043 15:37:40 -- nvmf/common.sh@478 -- # '[' -n 3220527 ']' 00:08:42.043 15:37:40 -- nvmf/common.sh@479 -- # killprocess 3220527 00:08:42.043 15:37:40 -- common/autotest_common.sh@936 -- # '[' -z 3220527 ']' 00:08:42.043 15:37:40 -- common/autotest_common.sh@940 -- # kill -0 3220527 00:08:42.043 15:37:40 -- common/autotest_common.sh@941 -- # uname 00:08:42.043 15:37:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:42.043 15:37:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3220527 00:08:42.043 15:37:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:42.043 15:37:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:42.043 15:37:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3220527' 00:08:42.043 killing process with pid 3220527 00:08:42.043 15:37:40 -- common/autotest_common.sh@955 -- # kill 3220527 00:08:42.043 15:37:40 -- common/autotest_common.sh@960 -- # wait 3220527 00:08:42.302 [2024-04-26 15:37:40.714832] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:08:42.560 15:37:40 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:08:42.560 15:37:40 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:08:42.560 00:08:42.560 real 0m9.348s 00:08:42.560 user 0m19.765s 00:08:42.560 sys 0m4.762s 00:08:42.560 15:37:40 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:42.560 15:37:40 -- common/autotest_common.sh@10 -- # set +x 00:08:42.560 ************************************ 00:08:42.560 END TEST nvmf_invalid 00:08:42.560 ************************************ 00:08:42.560 15:37:40 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=rdma 00:08:42.560 15:37:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:42.560 15:37:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:42.560 15:37:40 -- common/autotest_common.sh@10 -- # set +x 00:08:42.560 ************************************ 00:08:42.560 START TEST nvmf_abort 00:08:42.560 ************************************ 00:08:42.560 15:37:41 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=rdma 00:08:42.560 * Looking for test storage... 00:08:42.819 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:08:42.819 15:37:41 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:08:42.819 15:37:41 -- nvmf/common.sh@7 -- # uname -s 00:08:42.819 15:37:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:42.819 15:37:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:42.819 15:37:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:42.819 15:37:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:42.819 15:37:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:42.819 15:37:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:42.819 15:37:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:42.819 15:37:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:42.819 15:37:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:42.819 15:37:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:42.819 15:37:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:08:42.819 15:37:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:08:42.819 15:37:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:42.819 15:37:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:42.819 15:37:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:42.819 15:37:41 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:42.819 15:37:41 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:08:42.819 15:37:41 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:42.819 15:37:41 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:42.819 15:37:41 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:42.819 15:37:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:42.819 15:37:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:42.819 15:37:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:42.819 15:37:41 -- paths/export.sh@5 -- # export PATH 00:08:42.819 15:37:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:42.819 15:37:41 -- nvmf/common.sh@47 -- # : 0 00:08:42.819 15:37:41 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:08:42.819 15:37:41 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:08:42.819 15:37:41 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:42.819 15:37:41 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:42.819 15:37:41 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:42.819 15:37:41 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:08:42.819 15:37:41 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:08:42.819 15:37:41 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:08:42.819 15:37:41 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:08:42.819 15:37:41 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:08:42.819 15:37:41 -- target/abort.sh@14 -- # nvmftestinit 00:08:42.819 15:37:41 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:08:42.819 15:37:41 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:42.819 15:37:41 -- nvmf/common.sh@437 -- # prepare_net_devs 00:08:42.819 15:37:41 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:08:42.819 15:37:41 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:08:42.819 15:37:41 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:42.819 15:37:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:42.819 15:37:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:42.819 15:37:41 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:08:42.819 15:37:41 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:08:42.819 15:37:41 -- nvmf/common.sh@285 -- # xtrace_disable 00:08:42.819 15:37:41 -- common/autotest_common.sh@10 -- # set +x 00:08:48.092 15:37:46 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:48.092 15:37:46 -- nvmf/common.sh@291 -- # pci_devs=() 00:08:48.092 15:37:46 -- nvmf/common.sh@291 -- # local -a pci_devs 00:08:48.092 15:37:46 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:08:48.092 15:37:46 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:08:48.092 15:37:46 -- nvmf/common.sh@293 -- # pci_drivers=() 00:08:48.092 15:37:46 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:08:48.092 15:37:46 -- nvmf/common.sh@295 -- # net_devs=() 00:08:48.092 15:37:46 -- nvmf/common.sh@295 -- # local -ga net_devs 00:08:48.092 15:37:46 -- nvmf/common.sh@296 -- # e810=() 00:08:48.092 15:37:46 -- nvmf/common.sh@296 -- # local -ga e810 00:08:48.092 15:37:46 -- nvmf/common.sh@297 -- # x722=() 00:08:48.092 15:37:46 -- nvmf/common.sh@297 -- # local -ga x722 00:08:48.092 15:37:46 -- nvmf/common.sh@298 -- # mlx=() 00:08:48.092 15:37:46 -- nvmf/common.sh@298 -- # local -ga mlx 00:08:48.092 15:37:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:48.092 15:37:46 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:48.092 15:37:46 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:48.092 15:37:46 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:48.092 15:37:46 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:48.092 15:37:46 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:48.092 15:37:46 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:48.092 15:37:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:48.092 15:37:46 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:48.092 15:37:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:48.092 15:37:46 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:48.092 15:37:46 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:08:48.092 15:37:46 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:08:48.092 15:37:46 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:08:48.092 15:37:46 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:08:48.092 15:37:46 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:08:48.092 15:37:46 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:08:48.092 15:37:46 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:08:48.092 15:37:46 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:48.092 15:37:46 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:08:48.092 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:08:48.092 15:37:46 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:48.092 15:37:46 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:48.092 15:37:46 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:48.092 15:37:46 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:48.092 15:37:46 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:48.092 15:37:46 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:48.092 15:37:46 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:48.092 15:37:46 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:08:48.092 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:08:48.092 15:37:46 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:48.092 15:37:46 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:48.092 15:37:46 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:48.092 15:37:46 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:48.092 15:37:46 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:48.092 15:37:46 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:48.092 15:37:46 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:08:48.092 15:37:46 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:08:48.092 15:37:46 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:48.092 15:37:46 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:48.092 15:37:46 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:48.092 15:37:46 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:48.092 15:37:46 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:08:48.092 Found net devices under 0000:da:00.0: mlx_0_0 00:08:48.092 15:37:46 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:48.092 15:37:46 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:48.092 15:37:46 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:48.092 15:37:46 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:48.092 15:37:46 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:48.092 15:37:46 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:08:48.092 Found net devices under 0000:da:00.1: mlx_0_1 00:08:48.092 15:37:46 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:48.092 15:37:46 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:08:48.092 15:37:46 -- nvmf/common.sh@403 -- # is_hw=yes 00:08:48.092 15:37:46 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:08:48.092 15:37:46 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:08:48.092 15:37:46 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:08:48.092 15:37:46 -- nvmf/common.sh@409 -- # rdma_device_init 00:08:48.092 15:37:46 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:08:48.092 15:37:46 -- nvmf/common.sh@58 -- # uname 00:08:48.092 15:37:46 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:08:48.092 15:37:46 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:08:48.092 15:37:46 -- nvmf/common.sh@63 -- # modprobe ib_core 00:08:48.092 15:37:46 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:08:48.092 15:37:46 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:08:48.092 15:37:46 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:08:48.092 15:37:46 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:08:48.092 15:37:46 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:08:48.092 15:37:46 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:08:48.092 15:37:46 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:08:48.092 15:37:46 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:08:48.092 15:37:46 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:48.092 15:37:46 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:48.092 15:37:46 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:48.092 15:37:46 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:48.092 15:37:46 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:48.092 15:37:46 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:48.092 15:37:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:48.092 15:37:46 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:48.092 15:37:46 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:48.092 15:37:46 -- nvmf/common.sh@105 -- # continue 2 00:08:48.092 15:37:46 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:48.092 15:37:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:48.093 15:37:46 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:48.093 15:37:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:48.093 15:37:46 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:48.093 15:37:46 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:48.093 15:37:46 -- nvmf/common.sh@105 -- # continue 2 00:08:48.093 15:37:46 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:48.093 15:37:46 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:08:48.093 15:37:46 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:48.093 15:37:46 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:48.093 15:37:46 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:48.093 15:37:46 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:48.093 15:37:46 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:08:48.093 15:37:46 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:08:48.093 15:37:46 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:08:48.093 118: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:48.093 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:08:48.093 altname enp218s0f0np0 00:08:48.093 altname ens818f0np0 00:08:48.093 inet 192.168.100.8/24 scope global mlx_0_0 00:08:48.093 valid_lft forever preferred_lft forever 00:08:48.093 15:37:46 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:48.093 15:37:46 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:08:48.093 15:37:46 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:48.093 15:37:46 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:48.093 15:37:46 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:48.093 15:37:46 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:48.093 15:37:46 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:08:48.093 15:37:46 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:08:48.093 15:37:46 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:08:48.093 119: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:48.093 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:08:48.093 altname enp218s0f1np1 00:08:48.093 altname ens818f1np1 00:08:48.093 inet 192.168.100.9/24 scope global mlx_0_1 00:08:48.093 valid_lft forever preferred_lft forever 00:08:48.093 15:37:46 -- nvmf/common.sh@411 -- # return 0 00:08:48.093 15:37:46 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:08:48.093 15:37:46 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:08:48.093 15:37:46 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:08:48.093 15:37:46 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:08:48.093 15:37:46 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:08:48.093 15:37:46 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:48.093 15:37:46 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:48.093 15:37:46 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:48.093 15:37:46 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:48.093 15:37:46 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:48.093 15:37:46 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:48.093 15:37:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:48.093 15:37:46 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:48.093 15:37:46 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:48.093 15:37:46 -- nvmf/common.sh@105 -- # continue 2 00:08:48.093 15:37:46 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:48.093 15:37:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:48.093 15:37:46 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:48.093 15:37:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:48.093 15:37:46 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:48.093 15:37:46 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:48.093 15:37:46 -- nvmf/common.sh@105 -- # continue 2 00:08:48.093 15:37:46 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:48.093 15:37:46 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:08:48.093 15:37:46 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:48.093 15:37:46 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:48.093 15:37:46 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:48.093 15:37:46 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:48.093 15:37:46 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:48.093 15:37:46 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:08:48.093 15:37:46 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:48.093 15:37:46 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:48.093 15:37:46 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:48.093 15:37:46 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:48.093 15:37:46 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:08:48.093 192.168.100.9' 00:08:48.093 15:37:46 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:08:48.093 192.168.100.9' 00:08:48.093 15:37:46 -- nvmf/common.sh@446 -- # head -n 1 00:08:48.093 15:37:46 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:08:48.093 15:37:46 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:08:48.093 192.168.100.9' 00:08:48.093 15:37:46 -- nvmf/common.sh@447 -- # tail -n +2 00:08:48.093 15:37:46 -- nvmf/common.sh@447 -- # head -n 1 00:08:48.093 15:37:46 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:08:48.093 15:37:46 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:08:48.093 15:37:46 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:08:48.093 15:37:46 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:08:48.093 15:37:46 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:08:48.093 15:37:46 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:08:48.093 15:37:46 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:08:48.093 15:37:46 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:08:48.093 15:37:46 -- common/autotest_common.sh@710 -- # xtrace_disable 00:08:48.093 15:37:46 -- common/autotest_common.sh@10 -- # set +x 00:08:48.093 15:37:46 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:08:48.093 15:37:46 -- nvmf/common.sh@470 -- # nvmfpid=3224505 00:08:48.093 15:37:46 -- nvmf/common.sh@471 -- # waitforlisten 3224505 00:08:48.093 15:37:46 -- common/autotest_common.sh@817 -- # '[' -z 3224505 ']' 00:08:48.093 15:37:46 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:48.093 15:37:46 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:48.093 15:37:46 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:48.093 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:48.093 15:37:46 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:48.093 15:37:46 -- common/autotest_common.sh@10 -- # set +x 00:08:48.093 [2024-04-26 15:37:46.554505] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:08:48.093 [2024-04-26 15:37:46.554553] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:48.093 EAL: No free 2048 kB hugepages reported on node 1 00:08:48.093 [2024-04-26 15:37:46.604693] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:08:48.093 [2024-04-26 15:37:46.680966] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:48.093 [2024-04-26 15:37:46.681005] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:48.093 [2024-04-26 15:37:46.681011] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:48.093 [2024-04-26 15:37:46.681017] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:48.093 [2024-04-26 15:37:46.681021] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:48.093 [2024-04-26 15:37:46.681097] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:48.093 [2024-04-26 15:37:46.681183] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:48.093 [2024-04-26 15:37:46.681184] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:49.031 15:37:47 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:49.031 15:37:47 -- common/autotest_common.sh@850 -- # return 0 00:08:49.031 15:37:47 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:08:49.031 15:37:47 -- common/autotest_common.sh@716 -- # xtrace_disable 00:08:49.031 15:37:47 -- common/autotest_common.sh@10 -- # set +x 00:08:49.031 15:37:47 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:49.031 15:37:47 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -a 256 00:08:49.031 15:37:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:49.031 15:37:47 -- common/autotest_common.sh@10 -- # set +x 00:08:49.031 [2024-04-26 15:37:47.434185] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1d2a920/0x1d2ee10) succeed. 00:08:49.031 [2024-04-26 15:37:47.444012] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1d2bec0/0x1d704a0) succeed. 00:08:49.031 15:37:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:49.032 15:37:47 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:08:49.032 15:37:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:49.032 15:37:47 -- common/autotest_common.sh@10 -- # set +x 00:08:49.032 Malloc0 00:08:49.032 15:37:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:49.032 15:37:47 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:08:49.032 15:37:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:49.032 15:37:47 -- common/autotest_common.sh@10 -- # set +x 00:08:49.032 Delay0 00:08:49.032 15:37:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:49.032 15:37:47 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:08:49.032 15:37:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:49.032 15:37:47 -- common/autotest_common.sh@10 -- # set +x 00:08:49.032 15:37:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:49.032 15:37:47 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:08:49.032 15:37:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:49.032 15:37:47 -- common/autotest_common.sh@10 -- # set +x 00:08:49.032 15:37:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:49.032 15:37:47 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:08:49.032 15:37:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:49.032 15:37:47 -- common/autotest_common.sh@10 -- # set +x 00:08:49.032 [2024-04-26 15:37:47.595039] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:08:49.032 15:37:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:49.032 15:37:47 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:08:49.032 15:37:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:49.032 15:37:47 -- common/autotest_common.sh@10 -- # set +x 00:08:49.032 15:37:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:49.032 15:37:47 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/abort -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:08:49.291 EAL: No free 2048 kB hugepages reported on node 1 00:08:49.291 [2024-04-26 15:37:47.688994] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:08:51.195 Initializing NVMe Controllers 00:08:51.195 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode0 00:08:51.195 controller IO queue size 128 less than required 00:08:51.195 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:08:51.195 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:08:51.195 Initialization complete. Launching workers. 00:08:51.195 NS: RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 49886 00:08:51.195 CTRLR: RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 49947, failed to submit 62 00:08:51.195 success 49887, unsuccess 60, failed 0 00:08:51.195 15:37:49 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:08:51.195 15:37:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:51.195 15:37:49 -- common/autotest_common.sh@10 -- # set +x 00:08:51.455 15:37:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:51.455 15:37:49 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:08:51.455 15:37:49 -- target/abort.sh@38 -- # nvmftestfini 00:08:51.455 15:37:49 -- nvmf/common.sh@477 -- # nvmfcleanup 00:08:51.455 15:37:49 -- nvmf/common.sh@117 -- # sync 00:08:51.455 15:37:49 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:08:51.455 15:37:49 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:08:51.455 15:37:49 -- nvmf/common.sh@120 -- # set +e 00:08:51.455 15:37:49 -- nvmf/common.sh@121 -- # for i in {1..20} 00:08:51.455 15:37:49 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:08:51.455 rmmod nvme_rdma 00:08:51.455 rmmod nvme_fabrics 00:08:51.455 15:37:49 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:08:51.455 15:37:49 -- nvmf/common.sh@124 -- # set -e 00:08:51.455 15:37:49 -- nvmf/common.sh@125 -- # return 0 00:08:51.455 15:37:49 -- nvmf/common.sh@478 -- # '[' -n 3224505 ']' 00:08:51.455 15:37:49 -- nvmf/common.sh@479 -- # killprocess 3224505 00:08:51.455 15:37:49 -- common/autotest_common.sh@936 -- # '[' -z 3224505 ']' 00:08:51.455 15:37:49 -- common/autotest_common.sh@940 -- # kill -0 3224505 00:08:51.455 15:37:49 -- common/autotest_common.sh@941 -- # uname 00:08:51.455 15:37:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:51.455 15:37:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3224505 00:08:51.455 15:37:49 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:08:51.455 15:37:49 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:08:51.455 15:37:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3224505' 00:08:51.455 killing process with pid 3224505 00:08:51.455 15:37:49 -- common/autotest_common.sh@955 -- # kill 3224505 00:08:51.455 15:37:49 -- common/autotest_common.sh@960 -- # wait 3224505 00:08:51.455 [2024-04-26 15:37:49.945749] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:08:51.714 15:37:50 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:08:51.714 15:37:50 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:08:51.714 00:08:51.714 real 0m9.083s 00:08:51.714 user 0m14.091s 00:08:51.714 sys 0m4.372s 00:08:51.714 15:37:50 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:51.714 15:37:50 -- common/autotest_common.sh@10 -- # set +x 00:08:51.714 ************************************ 00:08:51.714 END TEST nvmf_abort 00:08:51.714 ************************************ 00:08:51.714 15:37:50 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=rdma 00:08:51.714 15:37:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:51.714 15:37:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:51.714 15:37:50 -- common/autotest_common.sh@10 -- # set +x 00:08:51.973 ************************************ 00:08:51.973 START TEST nvmf_ns_hotplug_stress 00:08:51.973 ************************************ 00:08:51.973 15:37:50 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=rdma 00:08:51.973 * Looking for test storage... 00:08:51.973 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:08:51.973 15:37:50 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:08:51.973 15:37:50 -- nvmf/common.sh@7 -- # uname -s 00:08:51.973 15:37:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:51.973 15:37:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:51.973 15:37:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:51.973 15:37:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:51.973 15:37:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:51.973 15:37:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:51.973 15:37:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:51.973 15:37:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:51.973 15:37:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:51.973 15:37:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:51.973 15:37:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:08:51.973 15:37:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:08:51.973 15:37:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:51.973 15:37:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:51.973 15:37:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:51.973 15:37:50 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:51.973 15:37:50 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:08:51.973 15:37:50 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:51.973 15:37:50 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:51.973 15:37:50 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:51.974 15:37:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:51.974 15:37:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:51.974 15:37:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:51.974 15:37:50 -- paths/export.sh@5 -- # export PATH 00:08:51.974 15:37:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:51.974 15:37:50 -- nvmf/common.sh@47 -- # : 0 00:08:51.974 15:37:50 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:08:51.974 15:37:50 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:08:51.974 15:37:50 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:51.974 15:37:50 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:51.974 15:37:50 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:51.974 15:37:50 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:08:51.974 15:37:50 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:08:51.974 15:37:50 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:08:51.974 15:37:50 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:08:51.974 15:37:50 -- target/ns_hotplug_stress.sh@13 -- # nvmftestinit 00:08:51.974 15:37:50 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:08:51.974 15:37:50 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:51.974 15:37:50 -- nvmf/common.sh@437 -- # prepare_net_devs 00:08:51.974 15:37:50 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:08:51.974 15:37:50 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:08:51.974 15:37:50 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:51.974 15:37:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:51.974 15:37:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:51.974 15:37:50 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:08:51.974 15:37:50 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:08:51.974 15:37:50 -- nvmf/common.sh@285 -- # xtrace_disable 00:08:51.974 15:37:50 -- common/autotest_common.sh@10 -- # set +x 00:08:57.245 15:37:55 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:57.245 15:37:55 -- nvmf/common.sh@291 -- # pci_devs=() 00:08:57.245 15:37:55 -- nvmf/common.sh@291 -- # local -a pci_devs 00:08:57.245 15:37:55 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:08:57.245 15:37:55 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:08:57.245 15:37:55 -- nvmf/common.sh@293 -- # pci_drivers=() 00:08:57.245 15:37:55 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:08:57.245 15:37:55 -- nvmf/common.sh@295 -- # net_devs=() 00:08:57.245 15:37:55 -- nvmf/common.sh@295 -- # local -ga net_devs 00:08:57.245 15:37:55 -- nvmf/common.sh@296 -- # e810=() 00:08:57.245 15:37:55 -- nvmf/common.sh@296 -- # local -ga e810 00:08:57.245 15:37:55 -- nvmf/common.sh@297 -- # x722=() 00:08:57.245 15:37:55 -- nvmf/common.sh@297 -- # local -ga x722 00:08:57.245 15:37:55 -- nvmf/common.sh@298 -- # mlx=() 00:08:57.245 15:37:55 -- nvmf/common.sh@298 -- # local -ga mlx 00:08:57.245 15:37:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:57.245 15:37:55 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:57.245 15:37:55 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:57.245 15:37:55 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:57.245 15:37:55 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:57.245 15:37:55 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:57.245 15:37:55 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:57.245 15:37:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:57.245 15:37:55 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:57.245 15:37:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:57.245 15:37:55 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:57.245 15:37:55 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:08:57.245 15:37:55 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:08:57.245 15:37:55 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:08:57.245 15:37:55 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:08:57.245 15:37:55 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:08:57.245 15:37:55 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:08:57.245 15:37:55 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:08:57.245 15:37:55 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:57.245 15:37:55 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:08:57.245 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:08:57.245 15:37:55 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:57.245 15:37:55 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:57.245 15:37:55 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:57.245 15:37:55 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:57.245 15:37:55 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:57.245 15:37:55 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:57.245 15:37:55 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:57.245 15:37:55 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:08:57.245 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:08:57.245 15:37:55 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:57.245 15:37:55 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:57.245 15:37:55 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:57.245 15:37:55 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:57.245 15:37:55 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:57.245 15:37:55 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:57.245 15:37:55 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:08:57.245 15:37:55 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:08:57.245 15:37:55 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:57.245 15:37:55 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:57.245 15:37:55 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:57.245 15:37:55 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:57.245 15:37:55 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:08:57.245 Found net devices under 0000:da:00.0: mlx_0_0 00:08:57.245 15:37:55 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:57.245 15:37:55 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:57.245 15:37:55 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:57.245 15:37:55 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:57.245 15:37:55 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:57.245 15:37:55 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:08:57.245 Found net devices under 0000:da:00.1: mlx_0_1 00:08:57.245 15:37:55 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:57.245 15:37:55 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:08:57.245 15:37:55 -- nvmf/common.sh@403 -- # is_hw=yes 00:08:57.245 15:37:55 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:08:57.245 15:37:55 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:08:57.245 15:37:55 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:08:57.245 15:37:55 -- nvmf/common.sh@409 -- # rdma_device_init 00:08:57.245 15:37:55 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:08:57.245 15:37:55 -- nvmf/common.sh@58 -- # uname 00:08:57.246 15:37:55 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:08:57.246 15:37:55 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:08:57.246 15:37:55 -- nvmf/common.sh@63 -- # modprobe ib_core 00:08:57.246 15:37:55 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:08:57.246 15:37:55 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:08:57.246 15:37:55 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:08:57.246 15:37:55 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:08:57.246 15:37:55 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:08:57.246 15:37:55 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:08:57.246 15:37:55 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:08:57.246 15:37:55 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:08:57.246 15:37:55 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:57.246 15:37:55 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:57.246 15:37:55 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:57.246 15:37:55 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:57.246 15:37:55 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:57.246 15:37:55 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:57.246 15:37:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:57.246 15:37:55 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:57.246 15:37:55 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:57.246 15:37:55 -- nvmf/common.sh@105 -- # continue 2 00:08:57.246 15:37:55 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:57.246 15:37:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:57.246 15:37:55 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:57.246 15:37:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:57.246 15:37:55 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:57.246 15:37:55 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:57.246 15:37:55 -- nvmf/common.sh@105 -- # continue 2 00:08:57.246 15:37:55 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:57.246 15:37:55 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:08:57.246 15:37:55 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:57.246 15:37:55 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:57.246 15:37:55 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:57.246 15:37:55 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:57.246 15:37:55 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:08:57.246 15:37:55 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:08:57.246 15:37:55 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:08:57.246 118: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:57.246 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:08:57.246 altname enp218s0f0np0 00:08:57.246 altname ens818f0np0 00:08:57.246 inet 192.168.100.8/24 scope global mlx_0_0 00:08:57.246 valid_lft forever preferred_lft forever 00:08:57.246 15:37:55 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:57.246 15:37:55 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:08:57.246 15:37:55 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:57.246 15:37:55 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:57.246 15:37:55 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:57.246 15:37:55 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:57.246 15:37:55 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:08:57.246 15:37:55 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:08:57.246 15:37:55 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:08:57.246 119: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:57.246 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:08:57.246 altname enp218s0f1np1 00:08:57.246 altname ens818f1np1 00:08:57.246 inet 192.168.100.9/24 scope global mlx_0_1 00:08:57.246 valid_lft forever preferred_lft forever 00:08:57.246 15:37:55 -- nvmf/common.sh@411 -- # return 0 00:08:57.246 15:37:55 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:08:57.246 15:37:55 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:08:57.246 15:37:55 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:08:57.246 15:37:55 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:08:57.246 15:37:55 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:08:57.246 15:37:55 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:57.246 15:37:55 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:57.246 15:37:55 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:57.246 15:37:55 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:57.246 15:37:55 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:57.246 15:37:55 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:57.246 15:37:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:57.246 15:37:55 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:57.246 15:37:55 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:57.246 15:37:55 -- nvmf/common.sh@105 -- # continue 2 00:08:57.246 15:37:55 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:57.246 15:37:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:57.246 15:37:55 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:57.246 15:37:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:57.246 15:37:55 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:57.246 15:37:55 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:57.246 15:37:55 -- nvmf/common.sh@105 -- # continue 2 00:08:57.246 15:37:55 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:57.246 15:37:55 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:08:57.246 15:37:55 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:57.246 15:37:55 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:57.246 15:37:55 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:57.246 15:37:55 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:57.246 15:37:55 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:57.246 15:37:55 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:08:57.246 15:37:55 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:57.246 15:37:55 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:57.246 15:37:55 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:57.246 15:37:55 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:57.246 15:37:55 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:08:57.246 192.168.100.9' 00:08:57.246 15:37:55 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:08:57.246 192.168.100.9' 00:08:57.246 15:37:55 -- nvmf/common.sh@446 -- # head -n 1 00:08:57.246 15:37:55 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:08:57.246 15:37:55 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:08:57.246 192.168.100.9' 00:08:57.246 15:37:55 -- nvmf/common.sh@447 -- # tail -n +2 00:08:57.246 15:37:55 -- nvmf/common.sh@447 -- # head -n 1 00:08:57.246 15:37:55 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:08:57.246 15:37:55 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:08:57.246 15:37:55 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:08:57.246 15:37:55 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:08:57.246 15:37:55 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:08:57.246 15:37:55 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:08:57.246 15:37:55 -- target/ns_hotplug_stress.sh@14 -- # nvmfappstart -m 0xE 00:08:57.246 15:37:55 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:08:57.246 15:37:55 -- common/autotest_common.sh@710 -- # xtrace_disable 00:08:57.246 15:37:55 -- common/autotest_common.sh@10 -- # set +x 00:08:57.246 15:37:55 -- nvmf/common.sh@470 -- # nvmfpid=3228231 00:08:57.246 15:37:55 -- nvmf/common.sh@471 -- # waitforlisten 3228231 00:08:57.246 15:37:55 -- common/autotest_common.sh@817 -- # '[' -z 3228231 ']' 00:08:57.246 15:37:55 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:57.246 15:37:55 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:57.246 15:37:55 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:57.246 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:57.246 15:37:55 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:08:57.246 15:37:55 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:57.246 15:37:55 -- common/autotest_common.sh@10 -- # set +x 00:08:57.246 [2024-04-26 15:37:55.578360] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:08:57.246 [2024-04-26 15:37:55.578401] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:57.246 EAL: No free 2048 kB hugepages reported on node 1 00:08:57.246 [2024-04-26 15:37:55.633951] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:08:57.246 [2024-04-26 15:37:55.709691] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:57.246 [2024-04-26 15:37:55.709725] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:57.246 [2024-04-26 15:37:55.709732] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:57.246 [2024-04-26 15:37:55.709737] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:57.246 [2024-04-26 15:37:55.709742] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:57.246 [2024-04-26 15:37:55.709815] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:57.246 [2024-04-26 15:37:55.709900] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:57.246 [2024-04-26 15:37:55.709901] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:57.813 15:37:56 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:57.813 15:37:56 -- common/autotest_common.sh@850 -- # return 0 00:08:57.813 15:37:56 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:08:57.813 15:37:56 -- common/autotest_common.sh@716 -- # xtrace_disable 00:08:57.813 15:37:56 -- common/autotest_common.sh@10 -- # set +x 00:08:57.813 15:37:56 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:57.813 15:37:56 -- target/ns_hotplug_stress.sh@16 -- # null_size=1000 00:08:57.813 15:37:56 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:08:58.071 [2024-04-26 15:37:56.587186] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1ad8920/0x1adce10) succeed. 00:08:58.071 [2024-04-26 15:37:56.597055] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1ad9ec0/0x1b1e4a0) succeed. 00:08:58.330 15:37:56 -- target/ns_hotplug_stress.sh@20 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:08:58.330 15:37:56 -- target/ns_hotplug_stress.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:08:58.594 [2024-04-26 15:37:57.032886] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:08:58.594 15:37:57 -- target/ns_hotplug_stress.sh@22 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:08:58.852 15:37:57 -- target/ns_hotplug_stress.sh@23 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:08:58.852 Malloc0 00:08:58.852 15:37:57 -- target/ns_hotplug_stress.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:08:59.110 Delay0 00:08:59.110 15:37:57 -- target/ns_hotplug_stress.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:08:59.368 15:37:57 -- target/ns_hotplug_stress.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:08:59.368 NULL1 00:08:59.627 15:37:57 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:08:59.627 15:37:58 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:08:59.627 15:37:58 -- target/ns_hotplug_stress.sh@33 -- # PERF_PID=3228721 00:08:59.627 15:37:58 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3228721 00:08:59.627 15:37:58 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:08:59.627 EAL: No free 2048 kB hugepages reported on node 1 00:09:01.003 Read completed with error (sct=0, sc=11) 00:09:01.003 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:01.003 15:37:59 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:01.003 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:01.003 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:01.003 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:01.003 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:01.003 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:01.003 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:01.003 15:37:59 -- target/ns_hotplug_stress.sh@40 -- # null_size=1001 00:09:01.003 15:37:59 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:09:01.262 true 00:09:01.262 15:37:59 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3228721 00:09:01.262 15:37:59 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:02.197 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:02.197 15:38:00 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:02.197 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:02.197 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:02.197 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:02.197 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:02.197 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:02.197 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:02.197 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:02.197 15:38:00 -- target/ns_hotplug_stress.sh@40 -- # null_size=1002 00:09:02.197 15:38:00 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:09:02.464 true 00:09:02.464 15:38:00 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3228721 00:09:02.464 15:38:00 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:03.408 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:03.408 15:38:01 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:03.408 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:03.408 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:03.408 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:03.408 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:03.408 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:03.408 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:03.408 15:38:01 -- target/ns_hotplug_stress.sh@40 -- # null_size=1003 00:09:03.408 15:38:01 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:09:03.667 true 00:09:03.667 15:38:02 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3228721 00:09:03.667 15:38:02 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:04.600 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:04.600 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:04.600 15:38:02 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:04.600 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:04.600 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:04.600 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:04.600 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:04.600 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:04.600 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:04.600 15:38:03 -- target/ns_hotplug_stress.sh@40 -- # null_size=1004 00:09:04.600 15:38:03 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:09:04.858 true 00:09:04.858 15:38:03 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3228721 00:09:04.858 15:38:03 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:05.795 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:05.795 15:38:04 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:05.795 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:05.795 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:05.795 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:05.795 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:05.795 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:05.795 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:05.795 15:38:04 -- target/ns_hotplug_stress.sh@40 -- # null_size=1005 00:09:05.795 15:38:04 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:09:06.074 true 00:09:06.074 15:38:04 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3228721 00:09:06.074 15:38:04 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:07.023 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:07.023 15:38:05 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:07.023 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:07.023 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:07.023 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:07.023 15:38:05 -- target/ns_hotplug_stress.sh@40 -- # null_size=1006 00:09:07.023 15:38:05 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:09:07.023 true 00:09:07.023 15:38:05 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3228721 00:09:07.023 15:38:05 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:07.960 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:07.960 15:38:06 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:07.960 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:07.960 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:08.220 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:08.220 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:08.220 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:08.220 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:08.220 15:38:06 -- target/ns_hotplug_stress.sh@40 -- # null_size=1007 00:09:08.220 15:38:06 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:09:08.479 true 00:09:08.479 15:38:06 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3228721 00:09:08.479 15:38:06 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:09.416 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:09.416 15:38:07 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:09.416 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:09.416 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:09.416 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:09.416 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:09.416 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:09.416 15:38:07 -- target/ns_hotplug_stress.sh@40 -- # null_size=1008 00:09:09.416 15:38:07 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:09:09.416 true 00:09:09.675 15:38:08 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3228721 00:09:09.675 15:38:08 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:10.243 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:10.631 15:38:08 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:10.631 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:10.631 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:10.631 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:10.631 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:10.631 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:10.631 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:10.631 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:10.631 15:38:09 -- target/ns_hotplug_stress.sh@40 -- # null_size=1009 00:09:10.631 15:38:09 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:09:10.631 true 00:09:10.631 15:38:09 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3228721 00:09:10.631 15:38:09 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:11.568 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:11.568 15:38:10 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:11.568 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:11.568 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:11.568 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:11.568 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:11.826 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:11.826 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:11.826 15:38:10 -- target/ns_hotplug_stress.sh@40 -- # null_size=1010 00:09:11.826 15:38:10 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:09:11.826 true 00:09:11.826 15:38:10 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3228721 00:09:11.827 15:38:10 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:12.763 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:12.763 15:38:11 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:12.763 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:12.763 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:12.763 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:12.763 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:12.763 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:13.022 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:13.022 15:38:11 -- target/ns_hotplug_stress.sh@40 -- # null_size=1011 00:09:13.022 15:38:11 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:09:13.022 true 00:09:13.022 15:38:11 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3228721 00:09:13.022 15:38:11 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:13.960 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:13.960 15:38:12 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:13.960 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:14.219 15:38:12 -- target/ns_hotplug_stress.sh@40 -- # null_size=1012 00:09:14.219 15:38:12 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:09:14.219 true 00:09:14.219 15:38:12 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3228721 00:09:14.219 15:38:12 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:14.478 15:38:12 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:14.736 15:38:13 -- target/ns_hotplug_stress.sh@40 -- # null_size=1013 00:09:14.736 15:38:13 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:09:14.736 true 00:09:14.736 15:38:13 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3228721 00:09:14.736 15:38:13 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:16.111 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:16.111 15:38:14 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:16.111 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:16.111 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:16.111 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:16.111 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:16.111 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:16.111 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:16.111 15:38:14 -- target/ns_hotplug_stress.sh@40 -- # null_size=1014 00:09:16.111 15:38:14 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:09:16.370 true 00:09:16.370 15:38:14 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3228721 00:09:16.370 15:38:14 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:17.306 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:17.306 15:38:15 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:17.306 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:17.306 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:17.306 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:17.306 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:17.306 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:17.306 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:17.306 15:38:15 -- target/ns_hotplug_stress.sh@40 -- # null_size=1015 00:09:17.306 15:38:15 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:09:17.565 true 00:09:17.565 15:38:16 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3228721 00:09:17.565 15:38:16 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:18.501 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:18.501 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:18.501 15:38:16 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:18.501 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:18.501 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:18.501 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:18.501 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:18.501 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:18.501 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:18.501 15:38:17 -- target/ns_hotplug_stress.sh@40 -- # null_size=1016 00:09:18.501 15:38:17 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:09:18.759 true 00:09:18.759 15:38:17 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3228721 00:09:18.759 15:38:17 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:19.695 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:19.695 15:38:18 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:19.695 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:19.695 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:19.695 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:19.695 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:19.695 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:19.695 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:19.695 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:19.695 15:38:18 -- target/ns_hotplug_stress.sh@40 -- # null_size=1017 00:09:19.695 15:38:18 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:09:19.953 true 00:09:19.953 15:38:18 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3228721 00:09:19.953 15:38:18 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:20.892 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:20.892 15:38:19 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:20.892 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:20.892 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:20.892 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:20.892 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:20.892 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:20.892 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:20.892 15:38:19 -- target/ns_hotplug_stress.sh@40 -- # null_size=1018 00:09:20.892 15:38:19 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:09:21.151 true 00:09:21.151 15:38:19 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3228721 00:09:21.151 15:38:19 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:22.088 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:22.088 15:38:20 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:22.088 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:22.088 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:22.088 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:22.088 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:22.088 15:38:20 -- target/ns_hotplug_stress.sh@40 -- # null_size=1019 00:09:22.088 15:38:20 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:09:22.347 true 00:09:22.347 15:38:20 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3228721 00:09:22.347 15:38:20 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:23.283 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:23.283 15:38:21 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:23.283 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:23.283 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:23.283 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:23.283 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:23.283 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:23.283 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:23.283 15:38:21 -- target/ns_hotplug_stress.sh@40 -- # null_size=1020 00:09:23.283 15:38:21 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:09:23.541 true 00:09:23.541 15:38:22 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3228721 00:09:23.541 15:38:22 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:24.477 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:24.477 15:38:22 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:24.477 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:24.477 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:24.477 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:24.477 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:24.477 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:24.477 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:24.477 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:24.477 15:38:23 -- target/ns_hotplug_stress.sh@40 -- # null_size=1021 00:09:24.477 15:38:23 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:09:24.735 true 00:09:24.735 15:38:23 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3228721 00:09:24.735 15:38:23 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:25.670 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:25.670 15:38:24 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:25.670 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:25.670 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:25.670 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:25.670 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:25.670 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:25.670 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:25.670 15:38:24 -- target/ns_hotplug_stress.sh@40 -- # null_size=1022 00:09:25.670 15:38:24 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:09:25.928 true 00:09:25.928 15:38:24 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3228721 00:09:25.928 15:38:24 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:26.862 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:26.862 15:38:25 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:26.862 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:26.862 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:26.862 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:26.862 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:26.862 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:26.862 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:26.862 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:26.862 15:38:25 -- target/ns_hotplug_stress.sh@40 -- # null_size=1023 00:09:26.862 15:38:25 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:09:27.119 true 00:09:27.119 15:38:25 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3228721 00:09:27.119 15:38:25 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:28.056 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:28.056 15:38:26 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:28.056 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:28.056 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:28.056 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:28.056 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:28.056 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:28.056 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:28.314 15:38:26 -- target/ns_hotplug_stress.sh@40 -- # null_size=1024 00:09:28.314 15:38:26 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:09:28.314 true 00:09:28.314 15:38:26 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3228721 00:09:28.314 15:38:26 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:29.249 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:29.249 15:38:27 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:29.249 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:29.249 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:29.249 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:29.507 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:29.507 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:29.507 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:29.507 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:09:29.507 15:38:27 -- target/ns_hotplug_stress.sh@40 -- # null_size=1025 00:09:29.507 15:38:27 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:09:29.765 true 00:09:29.765 15:38:28 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3228721 00:09:29.765 15:38:28 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:30.702 15:38:28 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:30.702 15:38:29 -- target/ns_hotplug_stress.sh@40 -- # null_size=1026 00:09:30.702 15:38:29 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:09:30.958 true 00:09:30.958 15:38:29 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3228721 00:09:30.958 15:38:29 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:30.958 15:38:29 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:31.217 15:38:29 -- target/ns_hotplug_stress.sh@40 -- # null_size=1027 00:09:31.217 15:38:29 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:09:31.475 true 00:09:31.475 15:38:29 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3228721 00:09:31.475 15:38:29 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:31.475 15:38:30 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:31.734 15:38:30 -- target/ns_hotplug_stress.sh@40 -- # null_size=1028 00:09:31.734 15:38:30 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:09:31.994 true 00:09:31.994 15:38:30 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3228721 00:09:31.994 15:38:30 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:31.994 15:38:30 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:32.252 15:38:30 -- target/ns_hotplug_stress.sh@40 -- # null_size=1029 00:09:32.252 15:38:30 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:09:32.521 true 00:09:32.521 15:38:30 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3228721 00:09:32.521 15:38:30 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:32.521 Initializing NVMe Controllers 00:09:32.521 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:09:32.521 Controller IO queue size 128, less than required. 00:09:32.521 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:09:32.521 Controller IO queue size 128, less than required. 00:09:32.521 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:09:32.521 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:09:32.521 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:09:32.521 Initialization complete. Launching workers. 00:09:32.521 ======================================================== 00:09:32.521 Latency(us) 00:09:32.521 Device Information : IOPS MiB/s Average min max 00:09:32.521 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 5603.07 2.74 20369.30 824.40 1138229.83 00:09:32.521 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 34175.80 16.69 3745.23 1569.68 295898.48 00:09:32.521 ======================================================== 00:09:32.521 Total : 39778.87 19.42 6086.82 824.40 1138229.83 00:09:32.521 00:09:32.822 15:38:31 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:09:32.822 15:38:31 -- target/ns_hotplug_stress.sh@40 -- # null_size=1030 00:09:32.823 15:38:31 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1030 00:09:33.096 true 00:09:33.096 15:38:31 -- target/ns_hotplug_stress.sh@35 -- # kill -0 3228721 00:09:33.096 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 35: kill: (3228721) - No such process 00:09:33.096 15:38:31 -- target/ns_hotplug_stress.sh@44 -- # wait 3228721 00:09:33.096 15:38:31 -- target/ns_hotplug_stress.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:09:33.096 15:38:31 -- target/ns_hotplug_stress.sh@48 -- # nvmftestfini 00:09:33.096 15:38:31 -- nvmf/common.sh@477 -- # nvmfcleanup 00:09:33.096 15:38:31 -- nvmf/common.sh@117 -- # sync 00:09:33.096 15:38:31 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:09:33.096 15:38:31 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:09:33.096 15:38:31 -- nvmf/common.sh@120 -- # set +e 00:09:33.096 15:38:31 -- nvmf/common.sh@121 -- # for i in {1..20} 00:09:33.096 15:38:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:09:33.096 rmmod nvme_rdma 00:09:33.096 rmmod nvme_fabrics 00:09:33.096 15:38:31 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:09:33.096 15:38:31 -- nvmf/common.sh@124 -- # set -e 00:09:33.096 15:38:31 -- nvmf/common.sh@125 -- # return 0 00:09:33.096 15:38:31 -- nvmf/common.sh@478 -- # '[' -n 3228231 ']' 00:09:33.096 15:38:31 -- nvmf/common.sh@479 -- # killprocess 3228231 00:09:33.096 15:38:31 -- common/autotest_common.sh@936 -- # '[' -z 3228231 ']' 00:09:33.096 15:38:31 -- common/autotest_common.sh@940 -- # kill -0 3228231 00:09:33.096 15:38:31 -- common/autotest_common.sh@941 -- # uname 00:09:33.096 15:38:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:09:33.096 15:38:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3228231 00:09:33.096 15:38:31 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:09:33.096 15:38:31 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:09:33.096 15:38:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3228231' 00:09:33.096 killing process with pid 3228231 00:09:33.096 15:38:31 -- common/autotest_common.sh@955 -- # kill 3228231 00:09:33.096 15:38:31 -- common/autotest_common.sh@960 -- # wait 3228231 00:09:33.096 [2024-04-26 15:38:31.658969] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:09:33.355 15:38:31 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:09:33.355 15:38:31 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:09:33.355 00:09:33.355 real 0m41.536s 00:09:33.355 user 2m37.046s 00:09:33.355 sys 0m6.897s 00:09:33.355 15:38:31 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:09:33.355 15:38:31 -- common/autotest_common.sh@10 -- # set +x 00:09:33.355 ************************************ 00:09:33.355 END TEST nvmf_ns_hotplug_stress 00:09:33.355 ************************************ 00:09:33.355 15:38:31 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=rdma 00:09:33.355 15:38:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:09:33.355 15:38:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:33.355 15:38:31 -- common/autotest_common.sh@10 -- # set +x 00:09:33.613 ************************************ 00:09:33.613 START TEST nvmf_connect_stress 00:09:33.613 ************************************ 00:09:33.613 15:38:32 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=rdma 00:09:33.613 * Looking for test storage... 00:09:33.613 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:09:33.613 15:38:32 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:09:33.613 15:38:32 -- nvmf/common.sh@7 -- # uname -s 00:09:33.613 15:38:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:33.613 15:38:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:33.613 15:38:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:33.613 15:38:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:33.613 15:38:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:33.613 15:38:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:33.613 15:38:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:33.613 15:38:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:33.613 15:38:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:33.613 15:38:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:33.613 15:38:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:09:33.613 15:38:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:09:33.613 15:38:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:33.613 15:38:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:33.613 15:38:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:33.613 15:38:32 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:09:33.613 15:38:32 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:09:33.613 15:38:32 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:33.613 15:38:32 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:33.613 15:38:32 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:33.613 15:38:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:33.613 15:38:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:33.613 15:38:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:33.613 15:38:32 -- paths/export.sh@5 -- # export PATH 00:09:33.613 15:38:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:33.614 15:38:32 -- nvmf/common.sh@47 -- # : 0 00:09:33.614 15:38:32 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:09:33.614 15:38:32 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:09:33.614 15:38:32 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:09:33.614 15:38:32 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:33.614 15:38:32 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:33.614 15:38:32 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:09:33.614 15:38:32 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:09:33.614 15:38:32 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:09:33.614 15:38:32 -- target/connect_stress.sh@12 -- # nvmftestinit 00:09:33.614 15:38:32 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:09:33.614 15:38:32 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:33.614 15:38:32 -- nvmf/common.sh@437 -- # prepare_net_devs 00:09:33.614 15:38:32 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:09:33.614 15:38:32 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:09:33.614 15:38:32 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:33.614 15:38:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:33.614 15:38:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:33.614 15:38:32 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:09:33.614 15:38:32 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:09:33.614 15:38:32 -- nvmf/common.sh@285 -- # xtrace_disable 00:09:33.614 15:38:32 -- common/autotest_common.sh@10 -- # set +x 00:09:38.885 15:38:36 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:38.885 15:38:36 -- nvmf/common.sh@291 -- # pci_devs=() 00:09:38.885 15:38:36 -- nvmf/common.sh@291 -- # local -a pci_devs 00:09:38.885 15:38:36 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:09:38.885 15:38:36 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:09:38.885 15:38:36 -- nvmf/common.sh@293 -- # pci_drivers=() 00:09:38.885 15:38:36 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:09:38.885 15:38:36 -- nvmf/common.sh@295 -- # net_devs=() 00:09:38.885 15:38:36 -- nvmf/common.sh@295 -- # local -ga net_devs 00:09:38.885 15:38:36 -- nvmf/common.sh@296 -- # e810=() 00:09:38.885 15:38:36 -- nvmf/common.sh@296 -- # local -ga e810 00:09:38.885 15:38:36 -- nvmf/common.sh@297 -- # x722=() 00:09:38.885 15:38:36 -- nvmf/common.sh@297 -- # local -ga x722 00:09:38.885 15:38:36 -- nvmf/common.sh@298 -- # mlx=() 00:09:38.885 15:38:36 -- nvmf/common.sh@298 -- # local -ga mlx 00:09:38.885 15:38:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:38.885 15:38:36 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:38.885 15:38:36 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:38.885 15:38:36 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:38.885 15:38:36 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:38.885 15:38:36 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:38.885 15:38:36 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:38.885 15:38:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:38.885 15:38:36 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:38.885 15:38:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:38.885 15:38:36 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:38.885 15:38:36 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:09:38.885 15:38:36 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:09:38.885 15:38:36 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:09:38.885 15:38:36 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:09:38.885 15:38:36 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:09:38.885 15:38:36 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:09:38.885 15:38:36 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:09:38.885 15:38:36 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:38.885 15:38:36 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:09:38.885 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:09:38.885 15:38:36 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:09:38.885 15:38:36 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:09:38.885 15:38:36 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:09:38.885 15:38:36 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:09:38.885 15:38:36 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:09:38.885 15:38:36 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:09:38.885 15:38:36 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:38.885 15:38:36 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:09:38.885 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:09:38.885 15:38:36 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:09:38.885 15:38:36 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:09:38.885 15:38:36 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:09:38.885 15:38:36 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:09:38.885 15:38:36 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:09:38.885 15:38:36 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:09:38.885 15:38:36 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:09:38.886 15:38:36 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:09:38.886 15:38:36 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:38.886 15:38:36 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:38.886 15:38:36 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:38.886 15:38:36 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:38.886 15:38:36 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:09:38.886 Found net devices under 0000:da:00.0: mlx_0_0 00:09:38.886 15:38:36 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:38.886 15:38:36 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:38.886 15:38:36 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:38.886 15:38:36 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:38.886 15:38:36 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:38.886 15:38:36 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:09:38.886 Found net devices under 0000:da:00.1: mlx_0_1 00:09:38.886 15:38:36 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:38.886 15:38:36 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:09:38.886 15:38:36 -- nvmf/common.sh@403 -- # is_hw=yes 00:09:38.886 15:38:36 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:09:38.886 15:38:36 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:09:38.886 15:38:36 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:09:38.886 15:38:36 -- nvmf/common.sh@409 -- # rdma_device_init 00:09:38.886 15:38:36 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:09:38.886 15:38:36 -- nvmf/common.sh@58 -- # uname 00:09:38.886 15:38:36 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:09:38.886 15:38:36 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:09:38.886 15:38:36 -- nvmf/common.sh@63 -- # modprobe ib_core 00:09:38.886 15:38:36 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:09:38.886 15:38:36 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:09:38.886 15:38:36 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:09:38.886 15:38:36 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:09:38.886 15:38:36 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:09:38.886 15:38:37 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:09:38.886 15:38:37 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:09:38.886 15:38:37 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:09:38.886 15:38:37 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:09:38.886 15:38:37 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:09:38.886 15:38:37 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:09:38.886 15:38:37 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:09:38.886 15:38:37 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:09:38.886 15:38:37 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:38.886 15:38:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:38.886 15:38:37 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:09:38.886 15:38:37 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:09:38.886 15:38:37 -- nvmf/common.sh@105 -- # continue 2 00:09:38.886 15:38:37 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:38.886 15:38:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:38.886 15:38:37 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:09:38.886 15:38:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:38.886 15:38:37 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:09:38.886 15:38:37 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:09:38.886 15:38:37 -- nvmf/common.sh@105 -- # continue 2 00:09:38.886 15:38:37 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:09:38.886 15:38:37 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:09:38.886 15:38:37 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:09:38.886 15:38:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:09:38.886 15:38:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:38.886 15:38:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:38.886 15:38:37 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:09:38.886 15:38:37 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:09:38.886 15:38:37 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:09:38.886 118: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:09:38.886 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:09:38.886 altname enp218s0f0np0 00:09:38.886 altname ens818f0np0 00:09:38.886 inet 192.168.100.8/24 scope global mlx_0_0 00:09:38.886 valid_lft forever preferred_lft forever 00:09:38.886 15:38:37 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:09:38.886 15:38:37 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:09:38.886 15:38:37 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:09:38.886 15:38:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:09:38.886 15:38:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:38.886 15:38:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:38.886 15:38:37 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:09:38.886 15:38:37 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:09:38.886 15:38:37 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:09:38.886 119: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:09:38.886 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:09:38.886 altname enp218s0f1np1 00:09:38.886 altname ens818f1np1 00:09:38.886 inet 192.168.100.9/24 scope global mlx_0_1 00:09:38.886 valid_lft forever preferred_lft forever 00:09:38.886 15:38:37 -- nvmf/common.sh@411 -- # return 0 00:09:38.886 15:38:37 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:09:38.886 15:38:37 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:09:38.886 15:38:37 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:09:38.886 15:38:37 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:09:38.886 15:38:37 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:09:38.886 15:38:37 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:09:38.886 15:38:37 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:09:38.886 15:38:37 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:09:38.886 15:38:37 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:09:38.886 15:38:37 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:09:38.886 15:38:37 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:38.886 15:38:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:38.886 15:38:37 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:09:38.886 15:38:37 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:09:38.886 15:38:37 -- nvmf/common.sh@105 -- # continue 2 00:09:38.886 15:38:37 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:38.886 15:38:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:38.886 15:38:37 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:09:38.886 15:38:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:38.886 15:38:37 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:09:38.886 15:38:37 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:09:38.886 15:38:37 -- nvmf/common.sh@105 -- # continue 2 00:09:38.886 15:38:37 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:09:38.886 15:38:37 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:09:38.886 15:38:37 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:09:38.886 15:38:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:09:38.886 15:38:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:38.886 15:38:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:38.886 15:38:37 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:09:38.886 15:38:37 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:09:38.886 15:38:37 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:09:38.886 15:38:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:09:38.886 15:38:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:38.886 15:38:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:38.886 15:38:37 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:09:38.886 192.168.100.9' 00:09:38.886 15:38:37 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:09:38.886 192.168.100.9' 00:09:38.886 15:38:37 -- nvmf/common.sh@446 -- # head -n 1 00:09:38.886 15:38:37 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:09:38.886 15:38:37 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:09:38.886 192.168.100.9' 00:09:38.886 15:38:37 -- nvmf/common.sh@447 -- # tail -n +2 00:09:38.886 15:38:37 -- nvmf/common.sh@447 -- # head -n 1 00:09:38.886 15:38:37 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:09:38.886 15:38:37 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:09:38.886 15:38:37 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:09:38.886 15:38:37 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:09:38.886 15:38:37 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:09:38.886 15:38:37 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:09:38.886 15:38:37 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:09:38.886 15:38:37 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:09:38.886 15:38:37 -- common/autotest_common.sh@710 -- # xtrace_disable 00:09:38.886 15:38:37 -- common/autotest_common.sh@10 -- # set +x 00:09:38.886 15:38:37 -- nvmf/common.sh@470 -- # nvmfpid=3237379 00:09:38.886 15:38:37 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:09:38.886 15:38:37 -- nvmf/common.sh@471 -- # waitforlisten 3237379 00:09:38.886 15:38:37 -- common/autotest_common.sh@817 -- # '[' -z 3237379 ']' 00:09:38.886 15:38:37 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:38.886 15:38:37 -- common/autotest_common.sh@822 -- # local max_retries=100 00:09:38.886 15:38:37 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:38.886 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:38.886 15:38:37 -- common/autotest_common.sh@826 -- # xtrace_disable 00:09:38.886 15:38:37 -- common/autotest_common.sh@10 -- # set +x 00:09:38.886 [2024-04-26 15:38:37.195908] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:09:38.886 [2024-04-26 15:38:37.195951] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:38.886 EAL: No free 2048 kB hugepages reported on node 1 00:09:38.886 [2024-04-26 15:38:37.249472] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:09:38.886 [2024-04-26 15:38:37.317483] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:38.886 [2024-04-26 15:38:37.317525] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:38.886 [2024-04-26 15:38:37.317531] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:09:38.886 [2024-04-26 15:38:37.317537] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:09:38.886 [2024-04-26 15:38:37.317541] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:38.887 [2024-04-26 15:38:37.317616] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:38.887 [2024-04-26 15:38:37.317702] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:38.887 [2024-04-26 15:38:37.317703] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:39.454 15:38:37 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:09:39.454 15:38:37 -- common/autotest_common.sh@850 -- # return 0 00:09:39.454 15:38:37 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:09:39.454 15:38:37 -- common/autotest_common.sh@716 -- # xtrace_disable 00:09:39.454 15:38:37 -- common/autotest_common.sh@10 -- # set +x 00:09:39.454 15:38:38 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:39.454 15:38:38 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:09:39.455 15:38:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:39.455 15:38:38 -- common/autotest_common.sh@10 -- # set +x 00:09:39.455 [2024-04-26 15:38:38.059069] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1d54920/0x1d58e10) succeed. 00:09:39.729 [2024-04-26 15:38:38.069053] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1d55ec0/0x1d9a4a0) succeed. 00:09:39.729 15:38:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:39.729 15:38:38 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:09:39.729 15:38:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:39.729 15:38:38 -- common/autotest_common.sh@10 -- # set +x 00:09:39.729 15:38:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:39.729 15:38:38 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:09:39.729 15:38:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:39.729 15:38:38 -- common/autotest_common.sh@10 -- # set +x 00:09:39.729 [2024-04-26 15:38:38.187617] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:09:39.729 15:38:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:39.729 15:38:38 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:09:39.729 15:38:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:39.729 15:38:38 -- common/autotest_common.sh@10 -- # set +x 00:09:39.729 NULL1 00:09:39.729 15:38:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:39.729 15:38:38 -- target/connect_stress.sh@21 -- # PERF_PID=3237628 00:09:39.729 15:38:38 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:09:39.729 15:38:38 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:09:39.729 15:38:38 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:09:39.729 15:38:38 -- target/connect_stress.sh@27 -- # seq 1 20 00:09:39.729 15:38:38 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:39.729 15:38:38 -- target/connect_stress.sh@28 -- # cat 00:09:39.729 15:38:38 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:39.729 15:38:38 -- target/connect_stress.sh@28 -- # cat 00:09:39.729 15:38:38 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:39.729 15:38:38 -- target/connect_stress.sh@28 -- # cat 00:09:39.729 15:38:38 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:39.729 15:38:38 -- target/connect_stress.sh@28 -- # cat 00:09:39.729 15:38:38 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:39.730 15:38:38 -- target/connect_stress.sh@28 -- # cat 00:09:39.730 15:38:38 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:39.730 15:38:38 -- target/connect_stress.sh@28 -- # cat 00:09:39.730 EAL: No free 2048 kB hugepages reported on node 1 00:09:39.730 15:38:38 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:39.730 15:38:38 -- target/connect_stress.sh@28 -- # cat 00:09:39.730 15:38:38 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:39.730 15:38:38 -- target/connect_stress.sh@28 -- # cat 00:09:39.730 15:38:38 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:39.730 15:38:38 -- target/connect_stress.sh@28 -- # cat 00:09:39.730 15:38:38 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:39.730 15:38:38 -- target/connect_stress.sh@28 -- # cat 00:09:39.730 15:38:38 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:39.730 15:38:38 -- target/connect_stress.sh@28 -- # cat 00:09:39.730 15:38:38 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:39.730 15:38:38 -- target/connect_stress.sh@28 -- # cat 00:09:39.730 15:38:38 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:39.730 15:38:38 -- target/connect_stress.sh@28 -- # cat 00:09:39.730 15:38:38 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:39.730 15:38:38 -- target/connect_stress.sh@28 -- # cat 00:09:39.730 15:38:38 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:39.730 15:38:38 -- target/connect_stress.sh@28 -- # cat 00:09:39.730 15:38:38 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:39.730 15:38:38 -- target/connect_stress.sh@28 -- # cat 00:09:39.730 15:38:38 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:39.730 15:38:38 -- target/connect_stress.sh@28 -- # cat 00:09:39.730 15:38:38 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:39.730 15:38:38 -- target/connect_stress.sh@28 -- # cat 00:09:39.730 15:38:38 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:39.730 15:38:38 -- target/connect_stress.sh@28 -- # cat 00:09:39.730 15:38:38 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:09:39.730 15:38:38 -- target/connect_stress.sh@28 -- # cat 00:09:39.730 15:38:38 -- target/connect_stress.sh@34 -- # kill -0 3237628 00:09:39.730 15:38:38 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:39.730 15:38:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:39.730 15:38:38 -- common/autotest_common.sh@10 -- # set +x 00:09:40.295 15:38:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:40.295 15:38:38 -- target/connect_stress.sh@34 -- # kill -0 3237628 00:09:40.295 15:38:38 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:40.295 15:38:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:40.295 15:38:38 -- common/autotest_common.sh@10 -- # set +x 00:09:40.553 15:38:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:40.553 15:38:38 -- target/connect_stress.sh@34 -- # kill -0 3237628 00:09:40.553 15:38:38 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:40.553 15:38:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:40.553 15:38:38 -- common/autotest_common.sh@10 -- # set +x 00:09:40.811 15:38:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:40.811 15:38:39 -- target/connect_stress.sh@34 -- # kill -0 3237628 00:09:40.811 15:38:39 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:40.811 15:38:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:40.811 15:38:39 -- common/autotest_common.sh@10 -- # set +x 00:09:41.086 15:38:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:41.086 15:38:39 -- target/connect_stress.sh@34 -- # kill -0 3237628 00:09:41.086 15:38:39 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:41.086 15:38:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:41.086 15:38:39 -- common/autotest_common.sh@10 -- # set +x 00:09:41.343 15:38:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:41.343 15:38:39 -- target/connect_stress.sh@34 -- # kill -0 3237628 00:09:41.343 15:38:39 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:41.343 15:38:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:41.343 15:38:39 -- common/autotest_common.sh@10 -- # set +x 00:09:41.906 15:38:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:41.906 15:38:40 -- target/connect_stress.sh@34 -- # kill -0 3237628 00:09:41.906 15:38:40 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:41.906 15:38:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:41.906 15:38:40 -- common/autotest_common.sh@10 -- # set +x 00:09:42.163 15:38:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:42.163 15:38:40 -- target/connect_stress.sh@34 -- # kill -0 3237628 00:09:42.163 15:38:40 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:42.163 15:38:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:42.163 15:38:40 -- common/autotest_common.sh@10 -- # set +x 00:09:42.421 15:38:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:42.421 15:38:40 -- target/connect_stress.sh@34 -- # kill -0 3237628 00:09:42.421 15:38:40 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:42.421 15:38:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:42.421 15:38:40 -- common/autotest_common.sh@10 -- # set +x 00:09:42.679 15:38:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:42.679 15:38:41 -- target/connect_stress.sh@34 -- # kill -0 3237628 00:09:42.679 15:38:41 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:42.679 15:38:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:42.679 15:38:41 -- common/autotest_common.sh@10 -- # set +x 00:09:43.245 15:38:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:43.245 15:38:41 -- target/connect_stress.sh@34 -- # kill -0 3237628 00:09:43.245 15:38:41 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:43.245 15:38:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:43.245 15:38:41 -- common/autotest_common.sh@10 -- # set +x 00:09:43.504 15:38:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:43.504 15:38:41 -- target/connect_stress.sh@34 -- # kill -0 3237628 00:09:43.504 15:38:41 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:43.504 15:38:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:43.504 15:38:41 -- common/autotest_common.sh@10 -- # set +x 00:09:43.763 15:38:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:43.763 15:38:42 -- target/connect_stress.sh@34 -- # kill -0 3237628 00:09:43.763 15:38:42 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:43.763 15:38:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:43.763 15:38:42 -- common/autotest_common.sh@10 -- # set +x 00:09:44.021 15:38:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:44.022 15:38:42 -- target/connect_stress.sh@34 -- # kill -0 3237628 00:09:44.022 15:38:42 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:44.022 15:38:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:44.022 15:38:42 -- common/autotest_common.sh@10 -- # set +x 00:09:44.281 15:38:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:44.281 15:38:42 -- target/connect_stress.sh@34 -- # kill -0 3237628 00:09:44.281 15:38:42 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:44.281 15:38:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:44.281 15:38:42 -- common/autotest_common.sh@10 -- # set +x 00:09:44.847 15:38:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:44.847 15:38:43 -- target/connect_stress.sh@34 -- # kill -0 3237628 00:09:44.847 15:38:43 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:44.847 15:38:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:44.847 15:38:43 -- common/autotest_common.sh@10 -- # set +x 00:09:45.105 15:38:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:45.105 15:38:43 -- target/connect_stress.sh@34 -- # kill -0 3237628 00:09:45.105 15:38:43 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:45.105 15:38:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:45.105 15:38:43 -- common/autotest_common.sh@10 -- # set +x 00:09:45.364 15:38:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:45.364 15:38:43 -- target/connect_stress.sh@34 -- # kill -0 3237628 00:09:45.364 15:38:43 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:45.364 15:38:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:45.364 15:38:43 -- common/autotest_common.sh@10 -- # set +x 00:09:45.622 15:38:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:45.622 15:38:44 -- target/connect_stress.sh@34 -- # kill -0 3237628 00:09:45.622 15:38:44 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:45.622 15:38:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:45.622 15:38:44 -- common/autotest_common.sh@10 -- # set +x 00:09:45.881 15:38:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:45.881 15:38:44 -- target/connect_stress.sh@34 -- # kill -0 3237628 00:09:45.881 15:38:44 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:45.881 15:38:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:45.881 15:38:44 -- common/autotest_common.sh@10 -- # set +x 00:09:46.448 15:38:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:46.448 15:38:44 -- target/connect_stress.sh@34 -- # kill -0 3237628 00:09:46.448 15:38:44 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:46.448 15:38:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:46.448 15:38:44 -- common/autotest_common.sh@10 -- # set +x 00:09:46.707 15:38:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:46.707 15:38:45 -- target/connect_stress.sh@34 -- # kill -0 3237628 00:09:46.707 15:38:45 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:46.707 15:38:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:46.707 15:38:45 -- common/autotest_common.sh@10 -- # set +x 00:09:46.966 15:38:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:46.966 15:38:45 -- target/connect_stress.sh@34 -- # kill -0 3237628 00:09:46.966 15:38:45 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:46.966 15:38:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:46.966 15:38:45 -- common/autotest_common.sh@10 -- # set +x 00:09:47.225 15:38:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:47.225 15:38:45 -- target/connect_stress.sh@34 -- # kill -0 3237628 00:09:47.225 15:38:45 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:47.225 15:38:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:47.225 15:38:45 -- common/autotest_common.sh@10 -- # set +x 00:09:47.792 15:38:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:47.792 15:38:46 -- target/connect_stress.sh@34 -- # kill -0 3237628 00:09:47.792 15:38:46 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:47.792 15:38:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:47.792 15:38:46 -- common/autotest_common.sh@10 -- # set +x 00:09:48.050 15:38:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:48.050 15:38:46 -- target/connect_stress.sh@34 -- # kill -0 3237628 00:09:48.050 15:38:46 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:48.050 15:38:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:48.050 15:38:46 -- common/autotest_common.sh@10 -- # set +x 00:09:48.309 15:38:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:48.309 15:38:46 -- target/connect_stress.sh@34 -- # kill -0 3237628 00:09:48.309 15:38:46 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:48.309 15:38:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:48.309 15:38:46 -- common/autotest_common.sh@10 -- # set +x 00:09:48.568 15:38:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:48.568 15:38:47 -- target/connect_stress.sh@34 -- # kill -0 3237628 00:09:48.568 15:38:47 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:48.568 15:38:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:48.568 15:38:47 -- common/autotest_common.sh@10 -- # set +x 00:09:48.827 15:38:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:48.827 15:38:47 -- target/connect_stress.sh@34 -- # kill -0 3237628 00:09:48.827 15:38:47 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:48.827 15:38:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:48.827 15:38:47 -- common/autotest_common.sh@10 -- # set +x 00:09:49.394 15:38:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:49.394 15:38:47 -- target/connect_stress.sh@34 -- # kill -0 3237628 00:09:49.394 15:38:47 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:49.394 15:38:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:49.394 15:38:47 -- common/autotest_common.sh@10 -- # set +x 00:09:49.652 15:38:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:49.652 15:38:48 -- target/connect_stress.sh@34 -- # kill -0 3237628 00:09:49.652 15:38:48 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:49.652 15:38:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:49.652 15:38:48 -- common/autotest_common.sh@10 -- # set +x 00:09:49.910 15:38:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:49.910 15:38:48 -- target/connect_stress.sh@34 -- # kill -0 3237628 00:09:49.910 15:38:48 -- target/connect_stress.sh@35 -- # rpc_cmd 00:09:49.910 15:38:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:49.910 15:38:48 -- common/autotest_common.sh@10 -- # set +x 00:09:49.910 Testing NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:09:50.169 15:38:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:50.169 15:38:48 -- target/connect_stress.sh@34 -- # kill -0 3237628 00:09:50.169 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (3237628) - No such process 00:09:50.169 15:38:48 -- target/connect_stress.sh@38 -- # wait 3237628 00:09:50.169 15:38:48 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:09:50.169 15:38:48 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:09:50.169 15:38:48 -- target/connect_stress.sh@43 -- # nvmftestfini 00:09:50.169 15:38:48 -- nvmf/common.sh@477 -- # nvmfcleanup 00:09:50.169 15:38:48 -- nvmf/common.sh@117 -- # sync 00:09:50.169 15:38:48 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:09:50.169 15:38:48 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:09:50.169 15:38:48 -- nvmf/common.sh@120 -- # set +e 00:09:50.169 15:38:48 -- nvmf/common.sh@121 -- # for i in {1..20} 00:09:50.169 15:38:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:09:50.169 rmmod nvme_rdma 00:09:50.169 rmmod nvme_fabrics 00:09:50.169 15:38:48 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:09:50.169 15:38:48 -- nvmf/common.sh@124 -- # set -e 00:09:50.169 15:38:48 -- nvmf/common.sh@125 -- # return 0 00:09:50.169 15:38:48 -- nvmf/common.sh@478 -- # '[' -n 3237379 ']' 00:09:50.169 15:38:48 -- nvmf/common.sh@479 -- # killprocess 3237379 00:09:50.169 15:38:48 -- common/autotest_common.sh@936 -- # '[' -z 3237379 ']' 00:09:50.169 15:38:48 -- common/autotest_common.sh@940 -- # kill -0 3237379 00:09:50.169 15:38:48 -- common/autotest_common.sh@941 -- # uname 00:09:50.169 15:38:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:09:50.169 15:38:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3237379 00:09:50.428 15:38:48 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:09:50.428 15:38:48 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:09:50.428 15:38:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3237379' 00:09:50.428 killing process with pid 3237379 00:09:50.428 15:38:48 -- common/autotest_common.sh@955 -- # kill 3237379 00:09:50.428 15:38:48 -- common/autotest_common.sh@960 -- # wait 3237379 00:09:50.428 [2024-04-26 15:38:48.879483] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:09:50.688 15:38:49 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:09:50.688 15:38:49 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:09:50.688 00:09:50.688 real 0m17.054s 00:09:50.688 user 0m42.749s 00:09:50.688 sys 0m5.569s 00:09:50.688 15:38:49 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:09:50.688 15:38:49 -- common/autotest_common.sh@10 -- # set +x 00:09:50.688 ************************************ 00:09:50.688 END TEST nvmf_connect_stress 00:09:50.688 ************************************ 00:09:50.688 15:38:49 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=rdma 00:09:50.688 15:38:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:09:50.688 15:38:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:50.688 15:38:49 -- common/autotest_common.sh@10 -- # set +x 00:09:50.688 ************************************ 00:09:50.688 START TEST nvmf_fused_ordering 00:09:50.688 ************************************ 00:09:50.688 15:38:49 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=rdma 00:09:50.947 * Looking for test storage... 00:09:50.947 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:09:50.947 15:38:49 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:09:50.947 15:38:49 -- nvmf/common.sh@7 -- # uname -s 00:09:50.947 15:38:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:50.947 15:38:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:50.947 15:38:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:50.947 15:38:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:50.947 15:38:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:50.947 15:38:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:50.947 15:38:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:50.947 15:38:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:50.947 15:38:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:50.947 15:38:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:50.947 15:38:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:09:50.947 15:38:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:09:50.947 15:38:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:50.947 15:38:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:50.947 15:38:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:50.947 15:38:49 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:09:50.947 15:38:49 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:09:50.947 15:38:49 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:50.947 15:38:49 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:50.947 15:38:49 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:50.947 15:38:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:50.947 15:38:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:50.947 15:38:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:50.947 15:38:49 -- paths/export.sh@5 -- # export PATH 00:09:50.947 15:38:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:50.947 15:38:49 -- nvmf/common.sh@47 -- # : 0 00:09:50.947 15:38:49 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:09:50.947 15:38:49 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:09:50.947 15:38:49 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:09:50.947 15:38:49 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:50.947 15:38:49 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:50.947 15:38:49 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:09:50.947 15:38:49 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:09:50.947 15:38:49 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:09:50.947 15:38:49 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:09:50.947 15:38:49 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:09:50.947 15:38:49 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:50.947 15:38:49 -- nvmf/common.sh@437 -- # prepare_net_devs 00:09:50.947 15:38:49 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:09:50.947 15:38:49 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:09:50.947 15:38:49 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:50.947 15:38:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:50.947 15:38:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:50.947 15:38:49 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:09:50.947 15:38:49 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:09:50.947 15:38:49 -- nvmf/common.sh@285 -- # xtrace_disable 00:09:50.947 15:38:49 -- common/autotest_common.sh@10 -- # set +x 00:09:56.217 15:38:54 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:56.217 15:38:54 -- nvmf/common.sh@291 -- # pci_devs=() 00:09:56.217 15:38:54 -- nvmf/common.sh@291 -- # local -a pci_devs 00:09:56.217 15:38:54 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:09:56.217 15:38:54 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:09:56.217 15:38:54 -- nvmf/common.sh@293 -- # pci_drivers=() 00:09:56.217 15:38:54 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:09:56.217 15:38:54 -- nvmf/common.sh@295 -- # net_devs=() 00:09:56.217 15:38:54 -- nvmf/common.sh@295 -- # local -ga net_devs 00:09:56.217 15:38:54 -- nvmf/common.sh@296 -- # e810=() 00:09:56.217 15:38:54 -- nvmf/common.sh@296 -- # local -ga e810 00:09:56.217 15:38:54 -- nvmf/common.sh@297 -- # x722=() 00:09:56.218 15:38:54 -- nvmf/common.sh@297 -- # local -ga x722 00:09:56.218 15:38:54 -- nvmf/common.sh@298 -- # mlx=() 00:09:56.218 15:38:54 -- nvmf/common.sh@298 -- # local -ga mlx 00:09:56.218 15:38:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:56.218 15:38:54 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:56.218 15:38:54 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:56.218 15:38:54 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:56.218 15:38:54 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:56.218 15:38:54 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:56.218 15:38:54 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:56.218 15:38:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:56.218 15:38:54 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:56.218 15:38:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:56.218 15:38:54 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:56.218 15:38:54 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:09:56.218 15:38:54 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:09:56.218 15:38:54 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:09:56.218 15:38:54 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:09:56.218 15:38:54 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:09:56.218 15:38:54 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:09:56.218 15:38:54 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:09:56.218 15:38:54 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:56.218 15:38:54 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:09:56.218 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:09:56.218 15:38:54 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:09:56.218 15:38:54 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:09:56.218 15:38:54 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:09:56.218 15:38:54 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:09:56.218 15:38:54 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:09:56.218 15:38:54 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:09:56.218 15:38:54 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:56.218 15:38:54 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:09:56.218 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:09:56.218 15:38:54 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:09:56.218 15:38:54 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:09:56.218 15:38:54 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:09:56.218 15:38:54 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:09:56.218 15:38:54 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:09:56.218 15:38:54 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:09:56.218 15:38:54 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:09:56.218 15:38:54 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:09:56.218 15:38:54 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:56.218 15:38:54 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:56.218 15:38:54 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:56.218 15:38:54 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:56.218 15:38:54 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:09:56.218 Found net devices under 0000:da:00.0: mlx_0_0 00:09:56.218 15:38:54 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:56.218 15:38:54 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:56.218 15:38:54 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:56.218 15:38:54 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:56.218 15:38:54 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:56.218 15:38:54 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:09:56.218 Found net devices under 0000:da:00.1: mlx_0_1 00:09:56.218 15:38:54 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:56.218 15:38:54 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:09:56.218 15:38:54 -- nvmf/common.sh@403 -- # is_hw=yes 00:09:56.218 15:38:54 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:09:56.218 15:38:54 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:09:56.218 15:38:54 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:09:56.218 15:38:54 -- nvmf/common.sh@409 -- # rdma_device_init 00:09:56.218 15:38:54 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:09:56.218 15:38:54 -- nvmf/common.sh@58 -- # uname 00:09:56.218 15:38:54 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:09:56.218 15:38:54 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:09:56.218 15:38:54 -- nvmf/common.sh@63 -- # modprobe ib_core 00:09:56.218 15:38:54 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:09:56.218 15:38:54 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:09:56.218 15:38:54 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:09:56.218 15:38:54 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:09:56.218 15:38:54 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:09:56.218 15:38:54 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:09:56.218 15:38:54 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:09:56.218 15:38:54 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:09:56.218 15:38:54 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:09:56.218 15:38:54 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:09:56.218 15:38:54 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:09:56.218 15:38:54 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:09:56.218 15:38:54 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:09:56.218 15:38:54 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:56.218 15:38:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:56.218 15:38:54 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:09:56.218 15:38:54 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:09:56.218 15:38:54 -- nvmf/common.sh@105 -- # continue 2 00:09:56.218 15:38:54 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:56.218 15:38:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:56.218 15:38:54 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:09:56.218 15:38:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:56.218 15:38:54 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:09:56.218 15:38:54 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:09:56.218 15:38:54 -- nvmf/common.sh@105 -- # continue 2 00:09:56.218 15:38:54 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:09:56.218 15:38:54 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:09:56.218 15:38:54 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:09:56.218 15:38:54 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:09:56.218 15:38:54 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:56.218 15:38:54 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:56.218 15:38:54 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:09:56.218 15:38:54 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:09:56.218 15:38:54 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:09:56.218 118: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:09:56.218 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:09:56.218 altname enp218s0f0np0 00:09:56.218 altname ens818f0np0 00:09:56.218 inet 192.168.100.8/24 scope global mlx_0_0 00:09:56.218 valid_lft forever preferred_lft forever 00:09:56.218 15:38:54 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:09:56.218 15:38:54 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:09:56.218 15:38:54 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:09:56.218 15:38:54 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:09:56.218 15:38:54 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:56.218 15:38:54 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:56.218 15:38:54 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:09:56.218 15:38:54 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:09:56.218 15:38:54 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:09:56.218 119: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:09:56.218 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:09:56.218 altname enp218s0f1np1 00:09:56.218 altname ens818f1np1 00:09:56.218 inet 192.168.100.9/24 scope global mlx_0_1 00:09:56.218 valid_lft forever preferred_lft forever 00:09:56.218 15:38:54 -- nvmf/common.sh@411 -- # return 0 00:09:56.218 15:38:54 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:09:56.218 15:38:54 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:09:56.218 15:38:54 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:09:56.218 15:38:54 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:09:56.218 15:38:54 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:09:56.218 15:38:54 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:09:56.218 15:38:54 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:09:56.218 15:38:54 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:09:56.218 15:38:54 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:09:56.218 15:38:54 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:09:56.218 15:38:54 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:56.218 15:38:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:56.218 15:38:54 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:09:56.218 15:38:54 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:09:56.218 15:38:54 -- nvmf/common.sh@105 -- # continue 2 00:09:56.218 15:38:54 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:56.218 15:38:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:56.218 15:38:54 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:09:56.218 15:38:54 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:56.218 15:38:54 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:09:56.218 15:38:54 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:09:56.218 15:38:54 -- nvmf/common.sh@105 -- # continue 2 00:09:56.218 15:38:54 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:09:56.218 15:38:54 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:09:56.218 15:38:54 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:09:56.218 15:38:54 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:56.218 15:38:54 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:56.218 15:38:54 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:09:56.218 15:38:54 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:09:56.218 15:38:54 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:09:56.218 15:38:54 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:09:56.218 15:38:54 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:56.218 15:38:54 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:09:56.218 15:38:54 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:56.218 15:38:54 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:09:56.218 192.168.100.9' 00:09:56.218 15:38:54 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:09:56.218 192.168.100.9' 00:09:56.219 15:38:54 -- nvmf/common.sh@446 -- # head -n 1 00:09:56.219 15:38:54 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:09:56.219 15:38:54 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:09:56.219 192.168.100.9' 00:09:56.219 15:38:54 -- nvmf/common.sh@447 -- # tail -n +2 00:09:56.219 15:38:54 -- nvmf/common.sh@447 -- # head -n 1 00:09:56.219 15:38:54 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:09:56.219 15:38:54 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:09:56.219 15:38:54 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:09:56.219 15:38:54 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:09:56.219 15:38:54 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:09:56.219 15:38:54 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:09:56.219 15:38:54 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:09:56.219 15:38:54 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:09:56.219 15:38:54 -- common/autotest_common.sh@710 -- # xtrace_disable 00:09:56.219 15:38:54 -- common/autotest_common.sh@10 -- # set +x 00:09:56.219 15:38:54 -- nvmf/common.sh@470 -- # nvmfpid=3242545 00:09:56.219 15:38:54 -- nvmf/common.sh@471 -- # waitforlisten 3242545 00:09:56.219 15:38:54 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:09:56.219 15:38:54 -- common/autotest_common.sh@817 -- # '[' -z 3242545 ']' 00:09:56.219 15:38:54 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:56.219 15:38:54 -- common/autotest_common.sh@822 -- # local max_retries=100 00:09:56.219 15:38:54 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:56.219 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:56.219 15:38:54 -- common/autotest_common.sh@826 -- # xtrace_disable 00:09:56.219 15:38:54 -- common/autotest_common.sh@10 -- # set +x 00:09:56.219 [2024-04-26 15:38:54.633628] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:09:56.219 [2024-04-26 15:38:54.633671] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:56.219 EAL: No free 2048 kB hugepages reported on node 1 00:09:56.219 [2024-04-26 15:38:54.688892] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:09:56.219 [2024-04-26 15:38:54.764643] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:56.219 [2024-04-26 15:38:54.764675] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:56.219 [2024-04-26 15:38:54.764682] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:09:56.219 [2024-04-26 15:38:54.764687] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:09:56.219 [2024-04-26 15:38:54.764692] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:56.219 [2024-04-26 15:38:54.764708] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:57.155 15:38:55 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:09:57.155 15:38:55 -- common/autotest_common.sh@850 -- # return 0 00:09:57.155 15:38:55 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:09:57.155 15:38:55 -- common/autotest_common.sh@716 -- # xtrace_disable 00:09:57.155 15:38:55 -- common/autotest_common.sh@10 -- # set +x 00:09:57.155 15:38:55 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:57.155 15:38:55 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:09:57.155 15:38:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:57.155 15:38:55 -- common/autotest_common.sh@10 -- # set +x 00:09:57.155 [2024-04-26 15:38:55.492797] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x973270/0x977760) succeed. 00:09:57.155 [2024-04-26 15:38:55.502124] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x974770/0x9b8df0) succeed. 00:09:57.155 15:38:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:57.155 15:38:55 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:09:57.155 15:38:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:57.155 15:38:55 -- common/autotest_common.sh@10 -- # set +x 00:09:57.155 15:38:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:57.155 15:38:55 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:09:57.155 15:38:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:57.155 15:38:55 -- common/autotest_common.sh@10 -- # set +x 00:09:57.155 [2024-04-26 15:38:55.559791] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:09:57.155 15:38:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:57.155 15:38:55 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:09:57.155 15:38:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:57.155 15:38:55 -- common/autotest_common.sh@10 -- # set +x 00:09:57.155 NULL1 00:09:57.155 15:38:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:57.155 15:38:55 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:09:57.155 15:38:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:57.155 15:38:55 -- common/autotest_common.sh@10 -- # set +x 00:09:57.155 15:38:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:57.155 15:38:55 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:09:57.155 15:38:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:57.155 15:38:55 -- common/autotest_common.sh@10 -- # set +x 00:09:57.155 15:38:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:57.155 15:38:55 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:09:57.155 [2024-04-26 15:38:55.614570] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:09:57.155 [2024-04-26 15:38:55.614614] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3242585 ] 00:09:57.155 EAL: No free 2048 kB hugepages reported on node 1 00:09:57.414 Attached to nqn.2016-06.io.spdk:cnode1 00:09:57.414 Namespace ID: 1 size: 1GB 00:09:57.414 fused_ordering(0) 00:09:57.414 fused_ordering(1) 00:09:57.414 fused_ordering(2) 00:09:57.414 fused_ordering(3) 00:09:57.414 fused_ordering(4) 00:09:57.414 fused_ordering(5) 00:09:57.414 fused_ordering(6) 00:09:57.414 fused_ordering(7) 00:09:57.414 fused_ordering(8) 00:09:57.414 fused_ordering(9) 00:09:57.414 fused_ordering(10) 00:09:57.414 fused_ordering(11) 00:09:57.414 fused_ordering(12) 00:09:57.414 fused_ordering(13) 00:09:57.414 fused_ordering(14) 00:09:57.414 fused_ordering(15) 00:09:57.414 fused_ordering(16) 00:09:57.414 fused_ordering(17) 00:09:57.414 fused_ordering(18) 00:09:57.414 fused_ordering(19) 00:09:57.414 fused_ordering(20) 00:09:57.414 fused_ordering(21) 00:09:57.414 fused_ordering(22) 00:09:57.414 fused_ordering(23) 00:09:57.414 fused_ordering(24) 00:09:57.414 fused_ordering(25) 00:09:57.414 fused_ordering(26) 00:09:57.414 fused_ordering(27) 00:09:57.414 fused_ordering(28) 00:09:57.414 fused_ordering(29) 00:09:57.414 fused_ordering(30) 00:09:57.414 fused_ordering(31) 00:09:57.414 fused_ordering(32) 00:09:57.414 fused_ordering(33) 00:09:57.415 fused_ordering(34) 00:09:57.415 fused_ordering(35) 00:09:57.415 fused_ordering(36) 00:09:57.415 fused_ordering(37) 00:09:57.415 fused_ordering(38) 00:09:57.415 fused_ordering(39) 00:09:57.415 fused_ordering(40) 00:09:57.415 fused_ordering(41) 00:09:57.415 fused_ordering(42) 00:09:57.415 fused_ordering(43) 00:09:57.415 fused_ordering(44) 00:09:57.415 fused_ordering(45) 00:09:57.415 fused_ordering(46) 00:09:57.415 fused_ordering(47) 00:09:57.415 fused_ordering(48) 00:09:57.415 fused_ordering(49) 00:09:57.415 fused_ordering(50) 00:09:57.415 fused_ordering(51) 00:09:57.415 fused_ordering(52) 00:09:57.415 fused_ordering(53) 00:09:57.415 fused_ordering(54) 00:09:57.415 fused_ordering(55) 00:09:57.415 fused_ordering(56) 00:09:57.415 fused_ordering(57) 00:09:57.415 fused_ordering(58) 00:09:57.415 fused_ordering(59) 00:09:57.415 fused_ordering(60) 00:09:57.415 fused_ordering(61) 00:09:57.415 fused_ordering(62) 00:09:57.415 fused_ordering(63) 00:09:57.415 fused_ordering(64) 00:09:57.415 fused_ordering(65) 00:09:57.415 fused_ordering(66) 00:09:57.415 fused_ordering(67) 00:09:57.415 fused_ordering(68) 00:09:57.415 fused_ordering(69) 00:09:57.415 fused_ordering(70) 00:09:57.415 fused_ordering(71) 00:09:57.415 fused_ordering(72) 00:09:57.415 fused_ordering(73) 00:09:57.415 fused_ordering(74) 00:09:57.415 fused_ordering(75) 00:09:57.415 fused_ordering(76) 00:09:57.415 fused_ordering(77) 00:09:57.415 fused_ordering(78) 00:09:57.415 fused_ordering(79) 00:09:57.415 fused_ordering(80) 00:09:57.415 fused_ordering(81) 00:09:57.415 fused_ordering(82) 00:09:57.415 fused_ordering(83) 00:09:57.415 fused_ordering(84) 00:09:57.415 fused_ordering(85) 00:09:57.415 fused_ordering(86) 00:09:57.415 fused_ordering(87) 00:09:57.415 fused_ordering(88) 00:09:57.415 fused_ordering(89) 00:09:57.415 fused_ordering(90) 00:09:57.415 fused_ordering(91) 00:09:57.415 fused_ordering(92) 00:09:57.415 fused_ordering(93) 00:09:57.415 fused_ordering(94) 00:09:57.415 fused_ordering(95) 00:09:57.415 fused_ordering(96) 00:09:57.415 fused_ordering(97) 00:09:57.415 fused_ordering(98) 00:09:57.415 fused_ordering(99) 00:09:57.415 fused_ordering(100) 00:09:57.415 fused_ordering(101) 00:09:57.415 fused_ordering(102) 00:09:57.415 fused_ordering(103) 00:09:57.415 fused_ordering(104) 00:09:57.415 fused_ordering(105) 00:09:57.415 fused_ordering(106) 00:09:57.415 fused_ordering(107) 00:09:57.415 fused_ordering(108) 00:09:57.415 fused_ordering(109) 00:09:57.415 fused_ordering(110) 00:09:57.415 fused_ordering(111) 00:09:57.415 fused_ordering(112) 00:09:57.415 fused_ordering(113) 00:09:57.415 fused_ordering(114) 00:09:57.415 fused_ordering(115) 00:09:57.415 fused_ordering(116) 00:09:57.415 fused_ordering(117) 00:09:57.415 fused_ordering(118) 00:09:57.415 fused_ordering(119) 00:09:57.415 fused_ordering(120) 00:09:57.415 fused_ordering(121) 00:09:57.415 fused_ordering(122) 00:09:57.415 fused_ordering(123) 00:09:57.415 fused_ordering(124) 00:09:57.415 fused_ordering(125) 00:09:57.415 fused_ordering(126) 00:09:57.415 fused_ordering(127) 00:09:57.415 fused_ordering(128) 00:09:57.415 fused_ordering(129) 00:09:57.415 fused_ordering(130) 00:09:57.415 fused_ordering(131) 00:09:57.415 fused_ordering(132) 00:09:57.415 fused_ordering(133) 00:09:57.415 fused_ordering(134) 00:09:57.415 fused_ordering(135) 00:09:57.415 fused_ordering(136) 00:09:57.415 fused_ordering(137) 00:09:57.415 fused_ordering(138) 00:09:57.415 fused_ordering(139) 00:09:57.415 fused_ordering(140) 00:09:57.415 fused_ordering(141) 00:09:57.415 fused_ordering(142) 00:09:57.415 fused_ordering(143) 00:09:57.415 fused_ordering(144) 00:09:57.415 fused_ordering(145) 00:09:57.415 fused_ordering(146) 00:09:57.415 fused_ordering(147) 00:09:57.415 fused_ordering(148) 00:09:57.415 fused_ordering(149) 00:09:57.415 fused_ordering(150) 00:09:57.415 fused_ordering(151) 00:09:57.415 fused_ordering(152) 00:09:57.415 fused_ordering(153) 00:09:57.415 fused_ordering(154) 00:09:57.415 fused_ordering(155) 00:09:57.415 fused_ordering(156) 00:09:57.415 fused_ordering(157) 00:09:57.415 fused_ordering(158) 00:09:57.415 fused_ordering(159) 00:09:57.415 fused_ordering(160) 00:09:57.415 fused_ordering(161) 00:09:57.415 fused_ordering(162) 00:09:57.415 fused_ordering(163) 00:09:57.415 fused_ordering(164) 00:09:57.415 fused_ordering(165) 00:09:57.415 fused_ordering(166) 00:09:57.415 fused_ordering(167) 00:09:57.415 fused_ordering(168) 00:09:57.415 fused_ordering(169) 00:09:57.415 fused_ordering(170) 00:09:57.415 fused_ordering(171) 00:09:57.415 fused_ordering(172) 00:09:57.415 fused_ordering(173) 00:09:57.415 fused_ordering(174) 00:09:57.415 fused_ordering(175) 00:09:57.415 fused_ordering(176) 00:09:57.415 fused_ordering(177) 00:09:57.415 fused_ordering(178) 00:09:57.415 fused_ordering(179) 00:09:57.415 fused_ordering(180) 00:09:57.415 fused_ordering(181) 00:09:57.415 fused_ordering(182) 00:09:57.415 fused_ordering(183) 00:09:57.415 fused_ordering(184) 00:09:57.415 fused_ordering(185) 00:09:57.415 fused_ordering(186) 00:09:57.415 fused_ordering(187) 00:09:57.415 fused_ordering(188) 00:09:57.415 fused_ordering(189) 00:09:57.415 fused_ordering(190) 00:09:57.415 fused_ordering(191) 00:09:57.415 fused_ordering(192) 00:09:57.415 fused_ordering(193) 00:09:57.415 fused_ordering(194) 00:09:57.415 fused_ordering(195) 00:09:57.415 fused_ordering(196) 00:09:57.415 fused_ordering(197) 00:09:57.415 fused_ordering(198) 00:09:57.415 fused_ordering(199) 00:09:57.415 fused_ordering(200) 00:09:57.415 fused_ordering(201) 00:09:57.415 fused_ordering(202) 00:09:57.415 fused_ordering(203) 00:09:57.415 fused_ordering(204) 00:09:57.415 fused_ordering(205) 00:09:57.415 fused_ordering(206) 00:09:57.415 fused_ordering(207) 00:09:57.415 fused_ordering(208) 00:09:57.415 fused_ordering(209) 00:09:57.415 fused_ordering(210) 00:09:57.415 fused_ordering(211) 00:09:57.415 fused_ordering(212) 00:09:57.415 fused_ordering(213) 00:09:57.415 fused_ordering(214) 00:09:57.415 fused_ordering(215) 00:09:57.415 fused_ordering(216) 00:09:57.415 fused_ordering(217) 00:09:57.415 fused_ordering(218) 00:09:57.415 fused_ordering(219) 00:09:57.415 fused_ordering(220) 00:09:57.415 fused_ordering(221) 00:09:57.415 fused_ordering(222) 00:09:57.415 fused_ordering(223) 00:09:57.415 fused_ordering(224) 00:09:57.415 fused_ordering(225) 00:09:57.415 fused_ordering(226) 00:09:57.415 fused_ordering(227) 00:09:57.415 fused_ordering(228) 00:09:57.415 fused_ordering(229) 00:09:57.415 fused_ordering(230) 00:09:57.415 fused_ordering(231) 00:09:57.415 fused_ordering(232) 00:09:57.415 fused_ordering(233) 00:09:57.415 fused_ordering(234) 00:09:57.415 fused_ordering(235) 00:09:57.415 fused_ordering(236) 00:09:57.415 fused_ordering(237) 00:09:57.415 fused_ordering(238) 00:09:57.415 fused_ordering(239) 00:09:57.415 fused_ordering(240) 00:09:57.415 fused_ordering(241) 00:09:57.415 fused_ordering(242) 00:09:57.415 fused_ordering(243) 00:09:57.415 fused_ordering(244) 00:09:57.415 fused_ordering(245) 00:09:57.415 fused_ordering(246) 00:09:57.415 fused_ordering(247) 00:09:57.415 fused_ordering(248) 00:09:57.415 fused_ordering(249) 00:09:57.415 fused_ordering(250) 00:09:57.415 fused_ordering(251) 00:09:57.415 fused_ordering(252) 00:09:57.415 fused_ordering(253) 00:09:57.415 fused_ordering(254) 00:09:57.415 fused_ordering(255) 00:09:57.415 fused_ordering(256) 00:09:57.415 fused_ordering(257) 00:09:57.415 fused_ordering(258) 00:09:57.415 fused_ordering(259) 00:09:57.415 fused_ordering(260) 00:09:57.415 fused_ordering(261) 00:09:57.415 fused_ordering(262) 00:09:57.415 fused_ordering(263) 00:09:57.415 fused_ordering(264) 00:09:57.415 fused_ordering(265) 00:09:57.415 fused_ordering(266) 00:09:57.415 fused_ordering(267) 00:09:57.415 fused_ordering(268) 00:09:57.415 fused_ordering(269) 00:09:57.415 fused_ordering(270) 00:09:57.415 fused_ordering(271) 00:09:57.415 fused_ordering(272) 00:09:57.415 fused_ordering(273) 00:09:57.415 fused_ordering(274) 00:09:57.415 fused_ordering(275) 00:09:57.415 fused_ordering(276) 00:09:57.415 fused_ordering(277) 00:09:57.415 fused_ordering(278) 00:09:57.415 fused_ordering(279) 00:09:57.415 fused_ordering(280) 00:09:57.415 fused_ordering(281) 00:09:57.415 fused_ordering(282) 00:09:57.415 fused_ordering(283) 00:09:57.415 fused_ordering(284) 00:09:57.415 fused_ordering(285) 00:09:57.415 fused_ordering(286) 00:09:57.415 fused_ordering(287) 00:09:57.415 fused_ordering(288) 00:09:57.415 fused_ordering(289) 00:09:57.415 fused_ordering(290) 00:09:57.415 fused_ordering(291) 00:09:57.415 fused_ordering(292) 00:09:57.415 fused_ordering(293) 00:09:57.415 fused_ordering(294) 00:09:57.415 fused_ordering(295) 00:09:57.415 fused_ordering(296) 00:09:57.415 fused_ordering(297) 00:09:57.415 fused_ordering(298) 00:09:57.415 fused_ordering(299) 00:09:57.415 fused_ordering(300) 00:09:57.415 fused_ordering(301) 00:09:57.415 fused_ordering(302) 00:09:57.415 fused_ordering(303) 00:09:57.415 fused_ordering(304) 00:09:57.415 fused_ordering(305) 00:09:57.415 fused_ordering(306) 00:09:57.415 fused_ordering(307) 00:09:57.415 fused_ordering(308) 00:09:57.415 fused_ordering(309) 00:09:57.415 fused_ordering(310) 00:09:57.415 fused_ordering(311) 00:09:57.415 fused_ordering(312) 00:09:57.415 fused_ordering(313) 00:09:57.415 fused_ordering(314) 00:09:57.415 fused_ordering(315) 00:09:57.415 fused_ordering(316) 00:09:57.416 fused_ordering(317) 00:09:57.416 fused_ordering(318) 00:09:57.416 fused_ordering(319) 00:09:57.416 fused_ordering(320) 00:09:57.416 fused_ordering(321) 00:09:57.416 fused_ordering(322) 00:09:57.416 fused_ordering(323) 00:09:57.416 fused_ordering(324) 00:09:57.416 fused_ordering(325) 00:09:57.416 fused_ordering(326) 00:09:57.416 fused_ordering(327) 00:09:57.416 fused_ordering(328) 00:09:57.416 fused_ordering(329) 00:09:57.416 fused_ordering(330) 00:09:57.416 fused_ordering(331) 00:09:57.416 fused_ordering(332) 00:09:57.416 fused_ordering(333) 00:09:57.416 fused_ordering(334) 00:09:57.416 fused_ordering(335) 00:09:57.416 fused_ordering(336) 00:09:57.416 fused_ordering(337) 00:09:57.416 fused_ordering(338) 00:09:57.416 fused_ordering(339) 00:09:57.416 fused_ordering(340) 00:09:57.416 fused_ordering(341) 00:09:57.416 fused_ordering(342) 00:09:57.416 fused_ordering(343) 00:09:57.416 fused_ordering(344) 00:09:57.416 fused_ordering(345) 00:09:57.416 fused_ordering(346) 00:09:57.416 fused_ordering(347) 00:09:57.416 fused_ordering(348) 00:09:57.416 fused_ordering(349) 00:09:57.416 fused_ordering(350) 00:09:57.416 fused_ordering(351) 00:09:57.416 fused_ordering(352) 00:09:57.416 fused_ordering(353) 00:09:57.416 fused_ordering(354) 00:09:57.416 fused_ordering(355) 00:09:57.416 fused_ordering(356) 00:09:57.416 fused_ordering(357) 00:09:57.416 fused_ordering(358) 00:09:57.416 fused_ordering(359) 00:09:57.416 fused_ordering(360) 00:09:57.416 fused_ordering(361) 00:09:57.416 fused_ordering(362) 00:09:57.416 fused_ordering(363) 00:09:57.416 fused_ordering(364) 00:09:57.416 fused_ordering(365) 00:09:57.416 fused_ordering(366) 00:09:57.416 fused_ordering(367) 00:09:57.416 fused_ordering(368) 00:09:57.416 fused_ordering(369) 00:09:57.416 fused_ordering(370) 00:09:57.416 fused_ordering(371) 00:09:57.416 fused_ordering(372) 00:09:57.416 fused_ordering(373) 00:09:57.416 fused_ordering(374) 00:09:57.416 fused_ordering(375) 00:09:57.416 fused_ordering(376) 00:09:57.416 fused_ordering(377) 00:09:57.416 fused_ordering(378) 00:09:57.416 fused_ordering(379) 00:09:57.416 fused_ordering(380) 00:09:57.416 fused_ordering(381) 00:09:57.416 fused_ordering(382) 00:09:57.416 fused_ordering(383) 00:09:57.416 fused_ordering(384) 00:09:57.416 fused_ordering(385) 00:09:57.416 fused_ordering(386) 00:09:57.416 fused_ordering(387) 00:09:57.416 fused_ordering(388) 00:09:57.416 fused_ordering(389) 00:09:57.416 fused_ordering(390) 00:09:57.416 fused_ordering(391) 00:09:57.416 fused_ordering(392) 00:09:57.416 fused_ordering(393) 00:09:57.416 fused_ordering(394) 00:09:57.416 fused_ordering(395) 00:09:57.416 fused_ordering(396) 00:09:57.416 fused_ordering(397) 00:09:57.416 fused_ordering(398) 00:09:57.416 fused_ordering(399) 00:09:57.416 fused_ordering(400) 00:09:57.416 fused_ordering(401) 00:09:57.416 fused_ordering(402) 00:09:57.416 fused_ordering(403) 00:09:57.416 fused_ordering(404) 00:09:57.416 fused_ordering(405) 00:09:57.416 fused_ordering(406) 00:09:57.416 fused_ordering(407) 00:09:57.416 fused_ordering(408) 00:09:57.416 fused_ordering(409) 00:09:57.416 fused_ordering(410) 00:09:57.416 fused_ordering(411) 00:09:57.416 fused_ordering(412) 00:09:57.416 fused_ordering(413) 00:09:57.416 fused_ordering(414) 00:09:57.416 fused_ordering(415) 00:09:57.416 fused_ordering(416) 00:09:57.416 fused_ordering(417) 00:09:57.416 fused_ordering(418) 00:09:57.416 fused_ordering(419) 00:09:57.416 fused_ordering(420) 00:09:57.416 fused_ordering(421) 00:09:57.416 fused_ordering(422) 00:09:57.416 fused_ordering(423) 00:09:57.416 fused_ordering(424) 00:09:57.416 fused_ordering(425) 00:09:57.416 fused_ordering(426) 00:09:57.416 fused_ordering(427) 00:09:57.416 fused_ordering(428) 00:09:57.416 fused_ordering(429) 00:09:57.416 fused_ordering(430) 00:09:57.416 fused_ordering(431) 00:09:57.416 fused_ordering(432) 00:09:57.416 fused_ordering(433) 00:09:57.416 fused_ordering(434) 00:09:57.416 fused_ordering(435) 00:09:57.416 fused_ordering(436) 00:09:57.416 fused_ordering(437) 00:09:57.416 fused_ordering(438) 00:09:57.416 fused_ordering(439) 00:09:57.416 fused_ordering(440) 00:09:57.416 fused_ordering(441) 00:09:57.416 fused_ordering(442) 00:09:57.416 fused_ordering(443) 00:09:57.416 fused_ordering(444) 00:09:57.416 fused_ordering(445) 00:09:57.416 fused_ordering(446) 00:09:57.416 fused_ordering(447) 00:09:57.416 fused_ordering(448) 00:09:57.416 fused_ordering(449) 00:09:57.416 fused_ordering(450) 00:09:57.416 fused_ordering(451) 00:09:57.416 fused_ordering(452) 00:09:57.416 fused_ordering(453) 00:09:57.416 fused_ordering(454) 00:09:57.416 fused_ordering(455) 00:09:57.416 fused_ordering(456) 00:09:57.416 fused_ordering(457) 00:09:57.416 fused_ordering(458) 00:09:57.416 fused_ordering(459) 00:09:57.416 fused_ordering(460) 00:09:57.416 fused_ordering(461) 00:09:57.416 fused_ordering(462) 00:09:57.416 fused_ordering(463) 00:09:57.416 fused_ordering(464) 00:09:57.416 fused_ordering(465) 00:09:57.416 fused_ordering(466) 00:09:57.416 fused_ordering(467) 00:09:57.416 fused_ordering(468) 00:09:57.416 fused_ordering(469) 00:09:57.416 fused_ordering(470) 00:09:57.416 fused_ordering(471) 00:09:57.416 fused_ordering(472) 00:09:57.416 fused_ordering(473) 00:09:57.416 fused_ordering(474) 00:09:57.416 fused_ordering(475) 00:09:57.416 fused_ordering(476) 00:09:57.416 fused_ordering(477) 00:09:57.416 fused_ordering(478) 00:09:57.416 fused_ordering(479) 00:09:57.416 fused_ordering(480) 00:09:57.416 fused_ordering(481) 00:09:57.416 fused_ordering(482) 00:09:57.416 fused_ordering(483) 00:09:57.416 fused_ordering(484) 00:09:57.416 fused_ordering(485) 00:09:57.416 fused_ordering(486) 00:09:57.416 fused_ordering(487) 00:09:57.416 fused_ordering(488) 00:09:57.416 fused_ordering(489) 00:09:57.416 fused_ordering(490) 00:09:57.416 fused_ordering(491) 00:09:57.416 fused_ordering(492) 00:09:57.416 fused_ordering(493) 00:09:57.416 fused_ordering(494) 00:09:57.416 fused_ordering(495) 00:09:57.416 fused_ordering(496) 00:09:57.416 fused_ordering(497) 00:09:57.416 fused_ordering(498) 00:09:57.416 fused_ordering(499) 00:09:57.416 fused_ordering(500) 00:09:57.416 fused_ordering(501) 00:09:57.416 fused_ordering(502) 00:09:57.416 fused_ordering(503) 00:09:57.416 fused_ordering(504) 00:09:57.416 fused_ordering(505) 00:09:57.416 fused_ordering(506) 00:09:57.416 fused_ordering(507) 00:09:57.416 fused_ordering(508) 00:09:57.416 fused_ordering(509) 00:09:57.416 fused_ordering(510) 00:09:57.416 fused_ordering(511) 00:09:57.416 fused_ordering(512) 00:09:57.416 fused_ordering(513) 00:09:57.416 fused_ordering(514) 00:09:57.416 fused_ordering(515) 00:09:57.416 fused_ordering(516) 00:09:57.416 fused_ordering(517) 00:09:57.416 fused_ordering(518) 00:09:57.416 fused_ordering(519) 00:09:57.416 fused_ordering(520) 00:09:57.416 fused_ordering(521) 00:09:57.416 fused_ordering(522) 00:09:57.416 fused_ordering(523) 00:09:57.416 fused_ordering(524) 00:09:57.416 fused_ordering(525) 00:09:57.416 fused_ordering(526) 00:09:57.416 fused_ordering(527) 00:09:57.416 fused_ordering(528) 00:09:57.416 fused_ordering(529) 00:09:57.416 fused_ordering(530) 00:09:57.416 fused_ordering(531) 00:09:57.416 fused_ordering(532) 00:09:57.416 fused_ordering(533) 00:09:57.416 fused_ordering(534) 00:09:57.416 fused_ordering(535) 00:09:57.416 fused_ordering(536) 00:09:57.416 fused_ordering(537) 00:09:57.416 fused_ordering(538) 00:09:57.416 fused_ordering(539) 00:09:57.416 fused_ordering(540) 00:09:57.416 fused_ordering(541) 00:09:57.416 fused_ordering(542) 00:09:57.416 fused_ordering(543) 00:09:57.416 fused_ordering(544) 00:09:57.416 fused_ordering(545) 00:09:57.416 fused_ordering(546) 00:09:57.416 fused_ordering(547) 00:09:57.416 fused_ordering(548) 00:09:57.416 fused_ordering(549) 00:09:57.416 fused_ordering(550) 00:09:57.416 fused_ordering(551) 00:09:57.416 fused_ordering(552) 00:09:57.416 fused_ordering(553) 00:09:57.416 fused_ordering(554) 00:09:57.416 fused_ordering(555) 00:09:57.416 fused_ordering(556) 00:09:57.416 fused_ordering(557) 00:09:57.416 fused_ordering(558) 00:09:57.416 fused_ordering(559) 00:09:57.416 fused_ordering(560) 00:09:57.416 fused_ordering(561) 00:09:57.416 fused_ordering(562) 00:09:57.416 fused_ordering(563) 00:09:57.416 fused_ordering(564) 00:09:57.416 fused_ordering(565) 00:09:57.416 fused_ordering(566) 00:09:57.416 fused_ordering(567) 00:09:57.416 fused_ordering(568) 00:09:57.416 fused_ordering(569) 00:09:57.416 fused_ordering(570) 00:09:57.416 fused_ordering(571) 00:09:57.416 fused_ordering(572) 00:09:57.416 fused_ordering(573) 00:09:57.416 fused_ordering(574) 00:09:57.416 fused_ordering(575) 00:09:57.416 fused_ordering(576) 00:09:57.416 fused_ordering(577) 00:09:57.416 fused_ordering(578) 00:09:57.416 fused_ordering(579) 00:09:57.416 fused_ordering(580) 00:09:57.416 fused_ordering(581) 00:09:57.416 fused_ordering(582) 00:09:57.416 fused_ordering(583) 00:09:57.416 fused_ordering(584) 00:09:57.416 fused_ordering(585) 00:09:57.416 fused_ordering(586) 00:09:57.416 fused_ordering(587) 00:09:57.416 fused_ordering(588) 00:09:57.416 fused_ordering(589) 00:09:57.416 fused_ordering(590) 00:09:57.417 fused_ordering(591) 00:09:57.417 fused_ordering(592) 00:09:57.417 fused_ordering(593) 00:09:57.417 fused_ordering(594) 00:09:57.417 fused_ordering(595) 00:09:57.417 fused_ordering(596) 00:09:57.417 fused_ordering(597) 00:09:57.417 fused_ordering(598) 00:09:57.417 fused_ordering(599) 00:09:57.417 fused_ordering(600) 00:09:57.417 fused_ordering(601) 00:09:57.417 fused_ordering(602) 00:09:57.417 fused_ordering(603) 00:09:57.417 fused_ordering(604) 00:09:57.417 fused_ordering(605) 00:09:57.417 fused_ordering(606) 00:09:57.417 fused_ordering(607) 00:09:57.417 fused_ordering(608) 00:09:57.417 fused_ordering(609) 00:09:57.417 fused_ordering(610) 00:09:57.417 fused_ordering(611) 00:09:57.417 fused_ordering(612) 00:09:57.417 fused_ordering(613) 00:09:57.417 fused_ordering(614) 00:09:57.417 fused_ordering(615) 00:09:57.676 fused_ordering(616) 00:09:57.676 fused_ordering(617) 00:09:57.676 fused_ordering(618) 00:09:57.676 fused_ordering(619) 00:09:57.676 fused_ordering(620) 00:09:57.676 fused_ordering(621) 00:09:57.676 fused_ordering(622) 00:09:57.676 fused_ordering(623) 00:09:57.676 fused_ordering(624) 00:09:57.676 fused_ordering(625) 00:09:57.676 fused_ordering(626) 00:09:57.676 fused_ordering(627) 00:09:57.676 fused_ordering(628) 00:09:57.676 fused_ordering(629) 00:09:57.676 fused_ordering(630) 00:09:57.676 fused_ordering(631) 00:09:57.676 fused_ordering(632) 00:09:57.676 fused_ordering(633) 00:09:57.676 fused_ordering(634) 00:09:57.676 fused_ordering(635) 00:09:57.676 fused_ordering(636) 00:09:57.676 fused_ordering(637) 00:09:57.676 fused_ordering(638) 00:09:57.676 fused_ordering(639) 00:09:57.676 fused_ordering(640) 00:09:57.676 fused_ordering(641) 00:09:57.676 fused_ordering(642) 00:09:57.676 fused_ordering(643) 00:09:57.676 fused_ordering(644) 00:09:57.676 fused_ordering(645) 00:09:57.676 fused_ordering(646) 00:09:57.676 fused_ordering(647) 00:09:57.676 fused_ordering(648) 00:09:57.676 fused_ordering(649) 00:09:57.676 fused_ordering(650) 00:09:57.676 fused_ordering(651) 00:09:57.676 fused_ordering(652) 00:09:57.676 fused_ordering(653) 00:09:57.676 fused_ordering(654) 00:09:57.676 fused_ordering(655) 00:09:57.676 fused_ordering(656) 00:09:57.676 fused_ordering(657) 00:09:57.676 fused_ordering(658) 00:09:57.676 fused_ordering(659) 00:09:57.676 fused_ordering(660) 00:09:57.676 fused_ordering(661) 00:09:57.676 fused_ordering(662) 00:09:57.676 fused_ordering(663) 00:09:57.676 fused_ordering(664) 00:09:57.676 fused_ordering(665) 00:09:57.676 fused_ordering(666) 00:09:57.676 fused_ordering(667) 00:09:57.676 fused_ordering(668) 00:09:57.676 fused_ordering(669) 00:09:57.676 fused_ordering(670) 00:09:57.676 fused_ordering(671) 00:09:57.676 fused_ordering(672) 00:09:57.676 fused_ordering(673) 00:09:57.676 fused_ordering(674) 00:09:57.676 fused_ordering(675) 00:09:57.676 fused_ordering(676) 00:09:57.676 fused_ordering(677) 00:09:57.676 fused_ordering(678) 00:09:57.676 fused_ordering(679) 00:09:57.676 fused_ordering(680) 00:09:57.676 fused_ordering(681) 00:09:57.676 fused_ordering(682) 00:09:57.676 fused_ordering(683) 00:09:57.676 fused_ordering(684) 00:09:57.676 fused_ordering(685) 00:09:57.676 fused_ordering(686) 00:09:57.676 fused_ordering(687) 00:09:57.676 fused_ordering(688) 00:09:57.676 fused_ordering(689) 00:09:57.676 fused_ordering(690) 00:09:57.676 fused_ordering(691) 00:09:57.676 fused_ordering(692) 00:09:57.676 fused_ordering(693) 00:09:57.676 fused_ordering(694) 00:09:57.676 fused_ordering(695) 00:09:57.676 fused_ordering(696) 00:09:57.676 fused_ordering(697) 00:09:57.676 fused_ordering(698) 00:09:57.676 fused_ordering(699) 00:09:57.676 fused_ordering(700) 00:09:57.676 fused_ordering(701) 00:09:57.676 fused_ordering(702) 00:09:57.676 fused_ordering(703) 00:09:57.676 fused_ordering(704) 00:09:57.676 fused_ordering(705) 00:09:57.676 fused_ordering(706) 00:09:57.676 fused_ordering(707) 00:09:57.676 fused_ordering(708) 00:09:57.676 fused_ordering(709) 00:09:57.676 fused_ordering(710) 00:09:57.676 fused_ordering(711) 00:09:57.676 fused_ordering(712) 00:09:57.676 fused_ordering(713) 00:09:57.676 fused_ordering(714) 00:09:57.676 fused_ordering(715) 00:09:57.676 fused_ordering(716) 00:09:57.676 fused_ordering(717) 00:09:57.676 fused_ordering(718) 00:09:57.676 fused_ordering(719) 00:09:57.676 fused_ordering(720) 00:09:57.676 fused_ordering(721) 00:09:57.676 fused_ordering(722) 00:09:57.676 fused_ordering(723) 00:09:57.676 fused_ordering(724) 00:09:57.676 fused_ordering(725) 00:09:57.676 fused_ordering(726) 00:09:57.676 fused_ordering(727) 00:09:57.676 fused_ordering(728) 00:09:57.676 fused_ordering(729) 00:09:57.676 fused_ordering(730) 00:09:57.676 fused_ordering(731) 00:09:57.676 fused_ordering(732) 00:09:57.676 fused_ordering(733) 00:09:57.676 fused_ordering(734) 00:09:57.676 fused_ordering(735) 00:09:57.676 fused_ordering(736) 00:09:57.676 fused_ordering(737) 00:09:57.676 fused_ordering(738) 00:09:57.676 fused_ordering(739) 00:09:57.676 fused_ordering(740) 00:09:57.676 fused_ordering(741) 00:09:57.676 fused_ordering(742) 00:09:57.676 fused_ordering(743) 00:09:57.676 fused_ordering(744) 00:09:57.676 fused_ordering(745) 00:09:57.676 fused_ordering(746) 00:09:57.676 fused_ordering(747) 00:09:57.676 fused_ordering(748) 00:09:57.676 fused_ordering(749) 00:09:57.676 fused_ordering(750) 00:09:57.676 fused_ordering(751) 00:09:57.676 fused_ordering(752) 00:09:57.676 fused_ordering(753) 00:09:57.676 fused_ordering(754) 00:09:57.676 fused_ordering(755) 00:09:57.676 fused_ordering(756) 00:09:57.676 fused_ordering(757) 00:09:57.676 fused_ordering(758) 00:09:57.676 fused_ordering(759) 00:09:57.676 fused_ordering(760) 00:09:57.676 fused_ordering(761) 00:09:57.676 fused_ordering(762) 00:09:57.676 fused_ordering(763) 00:09:57.676 fused_ordering(764) 00:09:57.676 fused_ordering(765) 00:09:57.676 fused_ordering(766) 00:09:57.676 fused_ordering(767) 00:09:57.676 fused_ordering(768) 00:09:57.676 fused_ordering(769) 00:09:57.676 fused_ordering(770) 00:09:57.676 fused_ordering(771) 00:09:57.676 fused_ordering(772) 00:09:57.676 fused_ordering(773) 00:09:57.676 fused_ordering(774) 00:09:57.676 fused_ordering(775) 00:09:57.676 fused_ordering(776) 00:09:57.676 fused_ordering(777) 00:09:57.676 fused_ordering(778) 00:09:57.676 fused_ordering(779) 00:09:57.676 fused_ordering(780) 00:09:57.676 fused_ordering(781) 00:09:57.676 fused_ordering(782) 00:09:57.676 fused_ordering(783) 00:09:57.676 fused_ordering(784) 00:09:57.676 fused_ordering(785) 00:09:57.676 fused_ordering(786) 00:09:57.676 fused_ordering(787) 00:09:57.676 fused_ordering(788) 00:09:57.676 fused_ordering(789) 00:09:57.676 fused_ordering(790) 00:09:57.676 fused_ordering(791) 00:09:57.676 fused_ordering(792) 00:09:57.676 fused_ordering(793) 00:09:57.676 fused_ordering(794) 00:09:57.676 fused_ordering(795) 00:09:57.676 fused_ordering(796) 00:09:57.676 fused_ordering(797) 00:09:57.676 fused_ordering(798) 00:09:57.676 fused_ordering(799) 00:09:57.676 fused_ordering(800) 00:09:57.676 fused_ordering(801) 00:09:57.676 fused_ordering(802) 00:09:57.676 fused_ordering(803) 00:09:57.676 fused_ordering(804) 00:09:57.676 fused_ordering(805) 00:09:57.676 fused_ordering(806) 00:09:57.676 fused_ordering(807) 00:09:57.676 fused_ordering(808) 00:09:57.676 fused_ordering(809) 00:09:57.676 fused_ordering(810) 00:09:57.676 fused_ordering(811) 00:09:57.676 fused_ordering(812) 00:09:57.676 fused_ordering(813) 00:09:57.676 fused_ordering(814) 00:09:57.676 fused_ordering(815) 00:09:57.676 fused_ordering(816) 00:09:57.676 fused_ordering(817) 00:09:57.676 fused_ordering(818) 00:09:57.676 fused_ordering(819) 00:09:57.676 fused_ordering(820) 00:09:57.676 fused_ordering(821) 00:09:57.676 fused_ordering(822) 00:09:57.676 fused_ordering(823) 00:09:57.676 fused_ordering(824) 00:09:57.676 fused_ordering(825) 00:09:57.676 fused_ordering(826) 00:09:57.676 fused_ordering(827) 00:09:57.676 fused_ordering(828) 00:09:57.676 fused_ordering(829) 00:09:57.676 fused_ordering(830) 00:09:57.676 fused_ordering(831) 00:09:57.676 fused_ordering(832) 00:09:57.676 fused_ordering(833) 00:09:57.676 fused_ordering(834) 00:09:57.676 fused_ordering(835) 00:09:57.676 fused_ordering(836) 00:09:57.676 fused_ordering(837) 00:09:57.676 fused_ordering(838) 00:09:57.676 fused_ordering(839) 00:09:57.676 fused_ordering(840) 00:09:57.676 fused_ordering(841) 00:09:57.676 fused_ordering(842) 00:09:57.676 fused_ordering(843) 00:09:57.676 fused_ordering(844) 00:09:57.676 fused_ordering(845) 00:09:57.676 fused_ordering(846) 00:09:57.676 fused_ordering(847) 00:09:57.676 fused_ordering(848) 00:09:57.676 fused_ordering(849) 00:09:57.676 fused_ordering(850) 00:09:57.676 fused_ordering(851) 00:09:57.676 fused_ordering(852) 00:09:57.676 fused_ordering(853) 00:09:57.676 fused_ordering(854) 00:09:57.676 fused_ordering(855) 00:09:57.676 fused_ordering(856) 00:09:57.676 fused_ordering(857) 00:09:57.676 fused_ordering(858) 00:09:57.676 fused_ordering(859) 00:09:57.676 fused_ordering(860) 00:09:57.676 fused_ordering(861) 00:09:57.676 fused_ordering(862) 00:09:57.676 fused_ordering(863) 00:09:57.676 fused_ordering(864) 00:09:57.676 fused_ordering(865) 00:09:57.676 fused_ordering(866) 00:09:57.676 fused_ordering(867) 00:09:57.676 fused_ordering(868) 00:09:57.676 fused_ordering(869) 00:09:57.676 fused_ordering(870) 00:09:57.676 fused_ordering(871) 00:09:57.676 fused_ordering(872) 00:09:57.676 fused_ordering(873) 00:09:57.676 fused_ordering(874) 00:09:57.676 fused_ordering(875) 00:09:57.676 fused_ordering(876) 00:09:57.676 fused_ordering(877) 00:09:57.676 fused_ordering(878) 00:09:57.676 fused_ordering(879) 00:09:57.676 fused_ordering(880) 00:09:57.676 fused_ordering(881) 00:09:57.676 fused_ordering(882) 00:09:57.676 fused_ordering(883) 00:09:57.676 fused_ordering(884) 00:09:57.676 fused_ordering(885) 00:09:57.676 fused_ordering(886) 00:09:57.676 fused_ordering(887) 00:09:57.676 fused_ordering(888) 00:09:57.676 fused_ordering(889) 00:09:57.676 fused_ordering(890) 00:09:57.676 fused_ordering(891) 00:09:57.676 fused_ordering(892) 00:09:57.676 fused_ordering(893) 00:09:57.676 fused_ordering(894) 00:09:57.676 fused_ordering(895) 00:09:57.676 fused_ordering(896) 00:09:57.676 fused_ordering(897) 00:09:57.676 fused_ordering(898) 00:09:57.676 fused_ordering(899) 00:09:57.676 fused_ordering(900) 00:09:57.676 fused_ordering(901) 00:09:57.676 fused_ordering(902) 00:09:57.676 fused_ordering(903) 00:09:57.676 fused_ordering(904) 00:09:57.676 fused_ordering(905) 00:09:57.676 fused_ordering(906) 00:09:57.676 fused_ordering(907) 00:09:57.676 fused_ordering(908) 00:09:57.676 fused_ordering(909) 00:09:57.676 fused_ordering(910) 00:09:57.676 fused_ordering(911) 00:09:57.676 fused_ordering(912) 00:09:57.676 fused_ordering(913) 00:09:57.676 fused_ordering(914) 00:09:57.676 fused_ordering(915) 00:09:57.676 fused_ordering(916) 00:09:57.676 fused_ordering(917) 00:09:57.676 fused_ordering(918) 00:09:57.676 fused_ordering(919) 00:09:57.676 fused_ordering(920) 00:09:57.676 fused_ordering(921) 00:09:57.676 fused_ordering(922) 00:09:57.676 fused_ordering(923) 00:09:57.676 fused_ordering(924) 00:09:57.676 fused_ordering(925) 00:09:57.676 fused_ordering(926) 00:09:57.676 fused_ordering(927) 00:09:57.676 fused_ordering(928) 00:09:57.677 fused_ordering(929) 00:09:57.677 fused_ordering(930) 00:09:57.677 fused_ordering(931) 00:09:57.677 fused_ordering(932) 00:09:57.677 fused_ordering(933) 00:09:57.677 fused_ordering(934) 00:09:57.677 fused_ordering(935) 00:09:57.677 fused_ordering(936) 00:09:57.677 fused_ordering(937) 00:09:57.677 fused_ordering(938) 00:09:57.677 fused_ordering(939) 00:09:57.677 fused_ordering(940) 00:09:57.677 fused_ordering(941) 00:09:57.677 fused_ordering(942) 00:09:57.677 fused_ordering(943) 00:09:57.677 fused_ordering(944) 00:09:57.677 fused_ordering(945) 00:09:57.677 fused_ordering(946) 00:09:57.677 fused_ordering(947) 00:09:57.677 fused_ordering(948) 00:09:57.677 fused_ordering(949) 00:09:57.677 fused_ordering(950) 00:09:57.677 fused_ordering(951) 00:09:57.677 fused_ordering(952) 00:09:57.677 fused_ordering(953) 00:09:57.677 fused_ordering(954) 00:09:57.677 fused_ordering(955) 00:09:57.677 fused_ordering(956) 00:09:57.677 fused_ordering(957) 00:09:57.677 fused_ordering(958) 00:09:57.677 fused_ordering(959) 00:09:57.677 fused_ordering(960) 00:09:57.677 fused_ordering(961) 00:09:57.677 fused_ordering(962) 00:09:57.677 fused_ordering(963) 00:09:57.677 fused_ordering(964) 00:09:57.677 fused_ordering(965) 00:09:57.677 fused_ordering(966) 00:09:57.677 fused_ordering(967) 00:09:57.677 fused_ordering(968) 00:09:57.677 fused_ordering(969) 00:09:57.677 fused_ordering(970) 00:09:57.677 fused_ordering(971) 00:09:57.677 fused_ordering(972) 00:09:57.677 fused_ordering(973) 00:09:57.677 fused_ordering(974) 00:09:57.677 fused_ordering(975) 00:09:57.677 fused_ordering(976) 00:09:57.677 fused_ordering(977) 00:09:57.677 fused_ordering(978) 00:09:57.677 fused_ordering(979) 00:09:57.677 fused_ordering(980) 00:09:57.677 fused_ordering(981) 00:09:57.677 fused_ordering(982) 00:09:57.677 fused_ordering(983) 00:09:57.677 fused_ordering(984) 00:09:57.677 fused_ordering(985) 00:09:57.677 fused_ordering(986) 00:09:57.677 fused_ordering(987) 00:09:57.677 fused_ordering(988) 00:09:57.677 fused_ordering(989) 00:09:57.677 fused_ordering(990) 00:09:57.677 fused_ordering(991) 00:09:57.677 fused_ordering(992) 00:09:57.677 fused_ordering(993) 00:09:57.677 fused_ordering(994) 00:09:57.677 fused_ordering(995) 00:09:57.677 fused_ordering(996) 00:09:57.677 fused_ordering(997) 00:09:57.677 fused_ordering(998) 00:09:57.677 fused_ordering(999) 00:09:57.677 fused_ordering(1000) 00:09:57.677 fused_ordering(1001) 00:09:57.677 fused_ordering(1002) 00:09:57.677 fused_ordering(1003) 00:09:57.677 fused_ordering(1004) 00:09:57.677 fused_ordering(1005) 00:09:57.677 fused_ordering(1006) 00:09:57.677 fused_ordering(1007) 00:09:57.677 fused_ordering(1008) 00:09:57.677 fused_ordering(1009) 00:09:57.677 fused_ordering(1010) 00:09:57.677 fused_ordering(1011) 00:09:57.677 fused_ordering(1012) 00:09:57.677 fused_ordering(1013) 00:09:57.677 fused_ordering(1014) 00:09:57.677 fused_ordering(1015) 00:09:57.677 fused_ordering(1016) 00:09:57.677 fused_ordering(1017) 00:09:57.677 fused_ordering(1018) 00:09:57.677 fused_ordering(1019) 00:09:57.677 fused_ordering(1020) 00:09:57.677 fused_ordering(1021) 00:09:57.677 fused_ordering(1022) 00:09:57.677 fused_ordering(1023) 00:09:57.677 15:38:56 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:09:57.677 15:38:56 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:09:57.677 15:38:56 -- nvmf/common.sh@477 -- # nvmfcleanup 00:09:57.677 15:38:56 -- nvmf/common.sh@117 -- # sync 00:09:57.677 15:38:56 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:09:57.677 15:38:56 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:09:57.677 15:38:56 -- nvmf/common.sh@120 -- # set +e 00:09:57.677 15:38:56 -- nvmf/common.sh@121 -- # for i in {1..20} 00:09:57.677 15:38:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:09:57.935 rmmod nvme_rdma 00:09:57.936 rmmod nvme_fabrics 00:09:57.936 15:38:56 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:09:57.936 15:38:56 -- nvmf/common.sh@124 -- # set -e 00:09:57.936 15:38:56 -- nvmf/common.sh@125 -- # return 0 00:09:57.936 15:38:56 -- nvmf/common.sh@478 -- # '[' -n 3242545 ']' 00:09:57.936 15:38:56 -- nvmf/common.sh@479 -- # killprocess 3242545 00:09:57.936 15:38:56 -- common/autotest_common.sh@936 -- # '[' -z 3242545 ']' 00:09:57.936 15:38:56 -- common/autotest_common.sh@940 -- # kill -0 3242545 00:09:57.936 15:38:56 -- common/autotest_common.sh@941 -- # uname 00:09:57.936 15:38:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:09:57.936 15:38:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3242545 00:09:57.936 15:38:56 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:09:57.936 15:38:56 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:09:57.936 15:38:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3242545' 00:09:57.936 killing process with pid 3242545 00:09:57.936 15:38:56 -- common/autotest_common.sh@955 -- # kill 3242545 00:09:57.936 15:38:56 -- common/autotest_common.sh@960 -- # wait 3242545 00:09:57.936 [2024-04-26 15:38:56.399968] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:09:58.195 15:38:56 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:09:58.195 15:38:56 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:09:58.195 00:09:58.195 real 0m7.343s 00:09:58.195 user 0m4.190s 00:09:58.195 sys 0m4.326s 00:09:58.195 15:38:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:09:58.195 15:38:56 -- common/autotest_common.sh@10 -- # set +x 00:09:58.195 ************************************ 00:09:58.195 END TEST nvmf_fused_ordering 00:09:58.195 ************************************ 00:09:58.195 15:38:56 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=rdma 00:09:58.195 15:38:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:09:58.195 15:38:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:58.195 15:38:56 -- common/autotest_common.sh@10 -- # set +x 00:09:58.195 ************************************ 00:09:58.195 START TEST nvmf_delete_subsystem 00:09:58.195 ************************************ 00:09:58.195 15:38:56 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=rdma 00:09:58.453 * Looking for test storage... 00:09:58.453 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:09:58.453 15:38:56 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:09:58.453 15:38:56 -- nvmf/common.sh@7 -- # uname -s 00:09:58.453 15:38:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:58.453 15:38:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:58.453 15:38:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:58.453 15:38:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:58.453 15:38:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:58.453 15:38:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:58.453 15:38:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:58.453 15:38:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:58.453 15:38:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:58.453 15:38:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:58.453 15:38:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:09:58.453 15:38:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:09:58.453 15:38:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:58.453 15:38:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:58.453 15:38:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:58.453 15:38:56 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:09:58.453 15:38:56 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:09:58.453 15:38:56 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:58.453 15:38:56 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:58.453 15:38:56 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:58.453 15:38:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:58.454 15:38:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:58.454 15:38:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:58.454 15:38:56 -- paths/export.sh@5 -- # export PATH 00:09:58.454 15:38:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:58.454 15:38:56 -- nvmf/common.sh@47 -- # : 0 00:09:58.454 15:38:56 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:09:58.454 15:38:56 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:09:58.454 15:38:56 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:09:58.454 15:38:56 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:58.454 15:38:56 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:58.454 15:38:56 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:09:58.454 15:38:56 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:09:58.454 15:38:56 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:09:58.454 15:38:56 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:09:58.454 15:38:56 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:09:58.454 15:38:56 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:58.454 15:38:56 -- nvmf/common.sh@437 -- # prepare_net_devs 00:09:58.454 15:38:56 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:09:58.454 15:38:56 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:09:58.454 15:38:56 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:58.454 15:38:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:58.454 15:38:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:58.454 15:38:56 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:09:58.454 15:38:56 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:09:58.454 15:38:56 -- nvmf/common.sh@285 -- # xtrace_disable 00:09:58.454 15:38:56 -- common/autotest_common.sh@10 -- # set +x 00:10:03.722 15:39:01 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:10:03.722 15:39:01 -- nvmf/common.sh@291 -- # pci_devs=() 00:10:03.722 15:39:01 -- nvmf/common.sh@291 -- # local -a pci_devs 00:10:03.722 15:39:01 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:10:03.722 15:39:01 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:10:03.722 15:39:01 -- nvmf/common.sh@293 -- # pci_drivers=() 00:10:03.722 15:39:01 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:10:03.722 15:39:01 -- nvmf/common.sh@295 -- # net_devs=() 00:10:03.722 15:39:01 -- nvmf/common.sh@295 -- # local -ga net_devs 00:10:03.722 15:39:01 -- nvmf/common.sh@296 -- # e810=() 00:10:03.722 15:39:01 -- nvmf/common.sh@296 -- # local -ga e810 00:10:03.722 15:39:01 -- nvmf/common.sh@297 -- # x722=() 00:10:03.722 15:39:01 -- nvmf/common.sh@297 -- # local -ga x722 00:10:03.722 15:39:01 -- nvmf/common.sh@298 -- # mlx=() 00:10:03.722 15:39:01 -- nvmf/common.sh@298 -- # local -ga mlx 00:10:03.722 15:39:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:10:03.722 15:39:01 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:10:03.722 15:39:01 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:10:03.722 15:39:01 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:10:03.722 15:39:01 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:10:03.722 15:39:01 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:10:03.722 15:39:01 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:10:03.722 15:39:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:10:03.722 15:39:01 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:10:03.722 15:39:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:10:03.722 15:39:01 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:10:03.722 15:39:01 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:10:03.722 15:39:01 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:10:03.722 15:39:01 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:10:03.722 15:39:01 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:10:03.722 15:39:01 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:10:03.722 15:39:01 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:10:03.722 15:39:01 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:10:03.722 15:39:01 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:10:03.722 15:39:01 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:10:03.722 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:10:03.722 15:39:01 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:10:03.722 15:39:01 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:10:03.722 15:39:01 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:10:03.722 15:39:01 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:10:03.722 15:39:01 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:10:03.722 15:39:01 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:10:03.722 15:39:01 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:10:03.722 15:39:01 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:10:03.722 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:10:03.722 15:39:01 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:10:03.722 15:39:01 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:10:03.722 15:39:01 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:10:03.722 15:39:01 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:10:03.722 15:39:01 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:10:03.722 15:39:01 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:10:03.722 15:39:01 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:10:03.722 15:39:01 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:10:03.722 15:39:01 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:10:03.722 15:39:01 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:03.722 15:39:01 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:10:03.722 15:39:01 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:03.722 15:39:01 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:10:03.722 Found net devices under 0000:da:00.0: mlx_0_0 00:10:03.722 15:39:01 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:10:03.722 15:39:01 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:10:03.722 15:39:01 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:03.722 15:39:01 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:10:03.722 15:39:01 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:03.722 15:39:01 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:10:03.722 Found net devices under 0000:da:00.1: mlx_0_1 00:10:03.722 15:39:01 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:10:03.722 15:39:01 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:10:03.722 15:39:01 -- nvmf/common.sh@403 -- # is_hw=yes 00:10:03.722 15:39:01 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:10:03.723 15:39:01 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:10:03.723 15:39:01 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:10:03.723 15:39:01 -- nvmf/common.sh@409 -- # rdma_device_init 00:10:03.723 15:39:01 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:10:03.723 15:39:01 -- nvmf/common.sh@58 -- # uname 00:10:03.723 15:39:01 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:10:03.723 15:39:01 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:10:03.723 15:39:01 -- nvmf/common.sh@63 -- # modprobe ib_core 00:10:03.723 15:39:01 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:10:03.723 15:39:01 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:10:03.723 15:39:01 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:10:03.723 15:39:01 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:10:03.723 15:39:01 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:10:03.723 15:39:01 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:10:03.723 15:39:01 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:10:03.723 15:39:01 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:10:03.723 15:39:01 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:10:03.723 15:39:01 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:10:03.723 15:39:01 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:10:03.723 15:39:01 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:10:03.723 15:39:01 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:10:03.723 15:39:01 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:03.723 15:39:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:03.723 15:39:01 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:10:03.723 15:39:01 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:10:03.723 15:39:01 -- nvmf/common.sh@105 -- # continue 2 00:10:03.723 15:39:01 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:03.723 15:39:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:03.723 15:39:01 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:10:03.723 15:39:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:03.723 15:39:01 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:10:03.723 15:39:01 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:10:03.723 15:39:01 -- nvmf/common.sh@105 -- # continue 2 00:10:03.723 15:39:01 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:10:03.723 15:39:01 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:10:03.723 15:39:01 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:10:03.723 15:39:01 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:10:03.723 15:39:01 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:03.723 15:39:01 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:03.723 15:39:01 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:10:03.723 15:39:01 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:10:03.723 15:39:01 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:10:03.723 118: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:10:03.723 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:10:03.723 altname enp218s0f0np0 00:10:03.723 altname ens818f0np0 00:10:03.723 inet 192.168.100.8/24 scope global mlx_0_0 00:10:03.723 valid_lft forever preferred_lft forever 00:10:03.723 15:39:01 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:10:03.723 15:39:01 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:10:03.723 15:39:01 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:10:03.723 15:39:01 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:10:03.723 15:39:01 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:03.723 15:39:01 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:03.723 15:39:01 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:10:03.723 15:39:01 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:10:03.723 15:39:01 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:10:03.723 119: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:10:03.723 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:10:03.723 altname enp218s0f1np1 00:10:03.723 altname ens818f1np1 00:10:03.723 inet 192.168.100.9/24 scope global mlx_0_1 00:10:03.723 valid_lft forever preferred_lft forever 00:10:03.723 15:39:01 -- nvmf/common.sh@411 -- # return 0 00:10:03.723 15:39:01 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:10:03.723 15:39:01 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:10:03.723 15:39:01 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:10:03.723 15:39:01 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:10:03.723 15:39:01 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:10:03.723 15:39:01 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:10:03.723 15:39:01 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:10:03.723 15:39:01 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:10:03.723 15:39:01 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:10:03.723 15:39:01 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:10:03.723 15:39:01 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:03.723 15:39:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:03.723 15:39:01 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:10:03.723 15:39:01 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:10:03.723 15:39:01 -- nvmf/common.sh@105 -- # continue 2 00:10:03.723 15:39:01 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:03.723 15:39:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:03.723 15:39:01 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:10:03.723 15:39:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:03.723 15:39:01 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:10:03.723 15:39:01 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:10:03.723 15:39:01 -- nvmf/common.sh@105 -- # continue 2 00:10:03.723 15:39:01 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:10:03.723 15:39:01 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:10:03.723 15:39:01 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:10:03.723 15:39:01 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:10:03.723 15:39:01 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:03.723 15:39:01 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:03.723 15:39:01 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:10:03.723 15:39:01 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:10:03.723 15:39:01 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:10:03.723 15:39:01 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:10:03.723 15:39:01 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:03.723 15:39:01 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:03.723 15:39:01 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:10:03.723 192.168.100.9' 00:10:03.723 15:39:01 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:10:03.723 192.168.100.9' 00:10:03.723 15:39:01 -- nvmf/common.sh@446 -- # head -n 1 00:10:03.723 15:39:01 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:10:03.723 15:39:01 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:10:03.723 192.168.100.9' 00:10:03.723 15:39:01 -- nvmf/common.sh@447 -- # tail -n +2 00:10:03.723 15:39:01 -- nvmf/common.sh@447 -- # head -n 1 00:10:03.723 15:39:01 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:10:03.723 15:39:01 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:10:03.723 15:39:01 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:10:03.723 15:39:01 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:10:03.723 15:39:01 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:10:03.723 15:39:01 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:10:03.723 15:39:01 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:10:03.723 15:39:01 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:10:03.723 15:39:01 -- common/autotest_common.sh@710 -- # xtrace_disable 00:10:03.723 15:39:01 -- common/autotest_common.sh@10 -- # set +x 00:10:03.723 15:39:01 -- nvmf/common.sh@470 -- # nvmfpid=3245995 00:10:03.723 15:39:01 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:10:03.723 15:39:01 -- nvmf/common.sh@471 -- # waitforlisten 3245995 00:10:03.723 15:39:01 -- common/autotest_common.sh@817 -- # '[' -z 3245995 ']' 00:10:03.723 15:39:01 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:10:03.723 15:39:01 -- common/autotest_common.sh@822 -- # local max_retries=100 00:10:03.723 15:39:01 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:10:03.723 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:10:03.723 15:39:01 -- common/autotest_common.sh@826 -- # xtrace_disable 00:10:03.723 15:39:01 -- common/autotest_common.sh@10 -- # set +x 00:10:03.723 [2024-04-26 15:39:02.014686] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:10:03.723 [2024-04-26 15:39:02.014733] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:10:03.723 EAL: No free 2048 kB hugepages reported on node 1 00:10:03.723 [2024-04-26 15:39:02.064891] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:10:03.723 [2024-04-26 15:39:02.141416] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:10:03.723 [2024-04-26 15:39:02.141456] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:10:03.723 [2024-04-26 15:39:02.141463] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:10:03.723 [2024-04-26 15:39:02.141469] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:10:03.723 [2024-04-26 15:39:02.141474] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:10:03.723 [2024-04-26 15:39:02.141518] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:10:03.723 [2024-04-26 15:39:02.141520] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:10:04.291 15:39:02 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:10:04.291 15:39:02 -- common/autotest_common.sh@850 -- # return 0 00:10:04.291 15:39:02 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:10:04.291 15:39:02 -- common/autotest_common.sh@716 -- # xtrace_disable 00:10:04.291 15:39:02 -- common/autotest_common.sh@10 -- # set +x 00:10:04.291 15:39:02 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:10:04.291 15:39:02 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:10:04.291 15:39:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:04.291 15:39:02 -- common/autotest_common.sh@10 -- # set +x 00:10:04.550 [2024-04-26 15:39:02.897802] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xaf7a60/0xafbf50) succeed. 00:10:04.550 [2024-04-26 15:39:02.906624] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xaf8f60/0xb3d5e0) succeed. 00:10:04.550 15:39:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:04.550 15:39:02 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:10:04.550 15:39:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:04.550 15:39:02 -- common/autotest_common.sh@10 -- # set +x 00:10:04.550 15:39:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:04.550 15:39:02 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:10:04.550 15:39:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:04.550 15:39:02 -- common/autotest_common.sh@10 -- # set +x 00:10:04.550 [2024-04-26 15:39:02.992118] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:10:04.550 15:39:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:04.550 15:39:02 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:10:04.550 15:39:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:04.550 15:39:02 -- common/autotest_common.sh@10 -- # set +x 00:10:04.550 NULL1 00:10:04.550 15:39:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:04.550 15:39:03 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:10:04.550 15:39:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:04.550 15:39:03 -- common/autotest_common.sh@10 -- # set +x 00:10:04.550 Delay0 00:10:04.550 15:39:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:04.550 15:39:03 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:04.550 15:39:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:04.550 15:39:03 -- common/autotest_common.sh@10 -- # set +x 00:10:04.550 15:39:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:04.550 15:39:03 -- target/delete_subsystem.sh@28 -- # perf_pid=3246241 00:10:04.550 15:39:03 -- target/delete_subsystem.sh@30 -- # sleep 2 00:10:04.550 15:39:03 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:10:04.550 EAL: No free 2048 kB hugepages reported on node 1 00:10:04.550 [2024-04-26 15:39:03.089003] subsystem.c:1435:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on RDMA/192.168.100.8/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:10:06.573 15:39:05 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:10:06.573 15:39:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:06.573 15:39:05 -- common/autotest_common.sh@10 -- # set +x 00:10:07.950 NVMe io qpair process completion error 00:10:07.950 NVMe io qpair process completion error 00:10:07.950 NVMe io qpair process completion error 00:10:07.950 NVMe io qpair process completion error 00:10:07.950 NVMe io qpair process completion error 00:10:07.950 NVMe io qpair process completion error 00:10:07.950 15:39:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:07.950 15:39:06 -- target/delete_subsystem.sh@34 -- # delay=0 00:10:07.950 15:39:06 -- target/delete_subsystem.sh@35 -- # kill -0 3246241 00:10:07.950 15:39:06 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:10:08.210 15:39:06 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:10:08.210 15:39:06 -- target/delete_subsystem.sh@35 -- # kill -0 3246241 00:10:08.210 15:39:06 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:10:08.778 Read completed with error (sct=0, sc=8) 00:10:08.778 starting I/O failed: -6 00:10:08.778 Read completed with error (sct=0, sc=8) 00:10:08.778 starting I/O failed: -6 00:10:08.778 Read completed with error (sct=0, sc=8) 00:10:08.778 starting I/O failed: -6 00:10:08.778 Write completed with error (sct=0, sc=8) 00:10:08.778 starting I/O failed: -6 00:10:08.778 Read completed with error (sct=0, sc=8) 00:10:08.778 starting I/O failed: -6 00:10:08.778 Read completed with error (sct=0, sc=8) 00:10:08.778 starting I/O failed: -6 00:10:08.778 Read completed with error (sct=0, sc=8) 00:10:08.778 starting I/O failed: -6 00:10:08.778 Write completed with error (sct=0, sc=8) 00:10:08.778 starting I/O failed: -6 00:10:08.778 Read completed with error (sct=0, sc=8) 00:10:08.778 starting I/O failed: -6 00:10:08.778 Read completed with error (sct=0, sc=8) 00:10:08.778 starting I/O failed: -6 00:10:08.778 Read completed with error (sct=0, sc=8) 00:10:08.778 starting I/O failed: -6 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Write completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Write completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Write completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Write completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Write completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Write completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Write completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Write completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Write completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Write completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 Write completed with error (sct=0, sc=8) 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 Write completed with error (sct=0, sc=8) 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 Write completed with error (sct=0, sc=8) 00:10:08.779 Write completed with error (sct=0, sc=8) 00:10:08.779 Write completed with error (sct=0, sc=8) 00:10:08.779 Write completed with error (sct=0, sc=8) 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 Write completed with error (sct=0, sc=8) 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 Write completed with error (sct=0, sc=8) 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 Write completed with error (sct=0, sc=8) 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 Write completed with error (sct=0, sc=8) 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 Write completed with error (sct=0, sc=8) 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 Write completed with error (sct=0, sc=8) 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 Write completed with error (sct=0, sc=8) 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Write completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Write completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Write completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.779 Read completed with error (sct=0, sc=8) 00:10:08.779 starting I/O failed: -6 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Write completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Write completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Write completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Write completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Write completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Write completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Write completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Write completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Write completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 starting I/O failed: -6 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 Write completed with error (sct=0, sc=8) 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 Write completed with error (sct=0, sc=8) 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 Write completed with error (sct=0, sc=8) 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 Write completed with error (sct=0, sc=8) 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 Write completed with error (sct=0, sc=8) 00:10:08.780 Write completed with error (sct=0, sc=8) 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 Write completed with error (sct=0, sc=8) 00:10:08.780 Write completed with error (sct=0, sc=8) 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 Write completed with error (sct=0, sc=8) 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 Write completed with error (sct=0, sc=8) 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 Write completed with error (sct=0, sc=8) 00:10:08.780 Write completed with error (sct=0, sc=8) 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.780 Read completed with error (sct=0, sc=8) 00:10:08.781 Write completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Write completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Write completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Write completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Write completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Write completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Write completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Write completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Write completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Write completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Write completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Write completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Write completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Write completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Write completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Write completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Read completed with error (sct=0, sc=8) 00:10:08.781 Write completed with error (sct=0, sc=8) 00:10:08.781 15:39:07 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:10:08.781 15:39:07 -- target/delete_subsystem.sh@35 -- # kill -0 3246241 00:10:08.781 15:39:07 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:10:08.781 [2024-04-26 15:39:07.187032] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:10:08.781 [2024-04-26 15:39:07.187068] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:10:08.781 /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:10:08.781 Initializing NVMe Controllers 00:10:08.781 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:10:08.781 Controller IO queue size 128, less than required. 00:10:08.781 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:10:08.781 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:10:08.781 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:10:08.781 Initialization complete. Launching workers. 00:10:08.781 ======================================================== 00:10:08.781 Latency(us) 00:10:08.781 Device Information : IOPS MiB/s Average min max 00:10:08.781 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 80.37 0.04 1595509.16 1000155.98 2981450.32 00:10:08.781 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 80.37 0.04 1596936.01 1001063.25 2982974.36 00:10:08.781 ======================================================== 00:10:08.781 Total : 160.75 0.08 1596222.59 1000155.98 2982974.36 00:10:08.781 00:10:09.349 15:39:07 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:10:09.349 15:39:07 -- target/delete_subsystem.sh@35 -- # kill -0 3246241 00:10:09.349 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (3246241) - No such process 00:10:09.349 15:39:07 -- target/delete_subsystem.sh@45 -- # NOT wait 3246241 00:10:09.349 15:39:07 -- common/autotest_common.sh@638 -- # local es=0 00:10:09.349 15:39:07 -- common/autotest_common.sh@640 -- # valid_exec_arg wait 3246241 00:10:09.349 15:39:07 -- common/autotest_common.sh@626 -- # local arg=wait 00:10:09.349 15:39:07 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:10:09.349 15:39:07 -- common/autotest_common.sh@630 -- # type -t wait 00:10:09.349 15:39:07 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:10:09.349 15:39:07 -- common/autotest_common.sh@641 -- # wait 3246241 00:10:09.349 15:39:07 -- common/autotest_common.sh@641 -- # es=1 00:10:09.349 15:39:07 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:10:09.349 15:39:07 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:10:09.349 15:39:07 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:10:09.349 15:39:07 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:10:09.349 15:39:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:09.349 15:39:07 -- common/autotest_common.sh@10 -- # set +x 00:10:09.349 15:39:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:09.349 15:39:07 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:10:09.349 15:39:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:09.349 15:39:07 -- common/autotest_common.sh@10 -- # set +x 00:10:09.349 [2024-04-26 15:39:07.698801] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:10:09.349 15:39:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:09.349 15:39:07 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:09.349 15:39:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:09.349 15:39:07 -- common/autotest_common.sh@10 -- # set +x 00:10:09.349 15:39:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:09.349 15:39:07 -- target/delete_subsystem.sh@54 -- # perf_pid=3247327 00:10:09.349 15:39:07 -- target/delete_subsystem.sh@56 -- # delay=0 00:10:09.349 15:39:07 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:10:09.349 15:39:07 -- target/delete_subsystem.sh@57 -- # kill -0 3247327 00:10:09.349 15:39:07 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:10:09.349 EAL: No free 2048 kB hugepages reported on node 1 00:10:09.349 [2024-04-26 15:39:07.783772] subsystem.c:1435:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on RDMA/192.168.100.8/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:10:09.918 15:39:08 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:10:09.918 15:39:08 -- target/delete_subsystem.sh@57 -- # kill -0 3247327 00:10:09.918 15:39:08 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:10:10.176 15:39:08 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:10:10.176 15:39:08 -- target/delete_subsystem.sh@57 -- # kill -0 3247327 00:10:10.176 15:39:08 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:10:10.745 15:39:09 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:10:10.745 15:39:09 -- target/delete_subsystem.sh@57 -- # kill -0 3247327 00:10:10.745 15:39:09 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:10:11.312 15:39:09 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:10:11.312 15:39:09 -- target/delete_subsystem.sh@57 -- # kill -0 3247327 00:10:11.312 15:39:09 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:10:11.879 15:39:10 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:10:11.879 15:39:10 -- target/delete_subsystem.sh@57 -- # kill -0 3247327 00:10:11.879 15:39:10 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:10:12.138 15:39:10 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:10:12.138 15:39:10 -- target/delete_subsystem.sh@57 -- # kill -0 3247327 00:10:12.138 15:39:10 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:10:12.706 15:39:11 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:10:12.706 15:39:11 -- target/delete_subsystem.sh@57 -- # kill -0 3247327 00:10:12.706 15:39:11 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:10:13.274 15:39:11 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:10:13.274 15:39:11 -- target/delete_subsystem.sh@57 -- # kill -0 3247327 00:10:13.274 15:39:11 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:10:13.872 15:39:12 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:10:13.872 15:39:12 -- target/delete_subsystem.sh@57 -- # kill -0 3247327 00:10:13.872 15:39:12 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:10:14.438 15:39:12 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:10:14.438 15:39:12 -- target/delete_subsystem.sh@57 -- # kill -0 3247327 00:10:14.438 15:39:12 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:10:14.696 15:39:13 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:10:14.696 15:39:13 -- target/delete_subsystem.sh@57 -- # kill -0 3247327 00:10:14.696 15:39:13 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:10:15.262 15:39:13 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:10:15.262 15:39:13 -- target/delete_subsystem.sh@57 -- # kill -0 3247327 00:10:15.262 15:39:13 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:10:15.830 15:39:14 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:10:15.830 15:39:14 -- target/delete_subsystem.sh@57 -- # kill -0 3247327 00:10:15.830 15:39:14 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:10:16.396 15:39:14 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:10:16.396 15:39:14 -- target/delete_subsystem.sh@57 -- # kill -0 3247327 00:10:16.396 15:39:14 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:10:16.396 Initializing NVMe Controllers 00:10:16.396 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:10:16.396 Controller IO queue size 128, less than required. 00:10:16.396 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:10:16.396 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:10:16.396 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:10:16.396 Initialization complete. Launching workers. 00:10:16.396 ======================================================== 00:10:16.396 Latency(us) 00:10:16.396 Device Information : IOPS MiB/s Average min max 00:10:16.396 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1001774.99 1000063.13 1005205.51 00:10:16.396 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1002256.63 1000060.17 1006682.36 00:10:16.396 ======================================================== 00:10:16.396 Total : 256.00 0.12 1002015.81 1000060.17 1006682.36 00:10:16.396 00:10:16.963 15:39:15 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:10:16.963 15:39:15 -- target/delete_subsystem.sh@57 -- # kill -0 3247327 00:10:16.963 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (3247327) - No such process 00:10:16.963 15:39:15 -- target/delete_subsystem.sh@67 -- # wait 3247327 00:10:16.963 15:39:15 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:10:16.963 15:39:15 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:10:16.963 15:39:15 -- nvmf/common.sh@477 -- # nvmfcleanup 00:10:16.963 15:39:15 -- nvmf/common.sh@117 -- # sync 00:10:16.963 15:39:15 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:10:16.963 15:39:15 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:10:16.963 15:39:15 -- nvmf/common.sh@120 -- # set +e 00:10:16.963 15:39:15 -- nvmf/common.sh@121 -- # for i in {1..20} 00:10:16.963 15:39:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:10:16.963 rmmod nvme_rdma 00:10:16.963 rmmod nvme_fabrics 00:10:16.963 15:39:15 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:10:16.963 15:39:15 -- nvmf/common.sh@124 -- # set -e 00:10:16.963 15:39:15 -- nvmf/common.sh@125 -- # return 0 00:10:16.963 15:39:15 -- nvmf/common.sh@478 -- # '[' -n 3245995 ']' 00:10:16.963 15:39:15 -- nvmf/common.sh@479 -- # killprocess 3245995 00:10:16.963 15:39:15 -- common/autotest_common.sh@936 -- # '[' -z 3245995 ']' 00:10:16.963 15:39:15 -- common/autotest_common.sh@940 -- # kill -0 3245995 00:10:16.963 15:39:15 -- common/autotest_common.sh@941 -- # uname 00:10:16.963 15:39:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:10:16.963 15:39:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3245995 00:10:16.963 15:39:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:10:16.963 15:39:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:10:16.963 15:39:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3245995' 00:10:16.963 killing process with pid 3245995 00:10:16.963 15:39:15 -- common/autotest_common.sh@955 -- # kill 3245995 00:10:16.963 15:39:15 -- common/autotest_common.sh@960 -- # wait 3245995 00:10:16.963 [2024-04-26 15:39:15.427929] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:10:17.221 15:39:15 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:10:17.221 15:39:15 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:10:17.221 00:10:17.221 real 0m18.871s 00:10:17.221 user 0m49.757s 00:10:17.221 sys 0m4.902s 00:10:17.221 15:39:15 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:10:17.221 15:39:15 -- common/autotest_common.sh@10 -- # set +x 00:10:17.221 ************************************ 00:10:17.221 END TEST nvmf_delete_subsystem 00:10:17.221 ************************************ 00:10:17.221 15:39:15 -- nvmf/nvmf.sh@36 -- # run_test nvmf_ns_masking test/nvmf/target/ns_masking.sh --transport=rdma 00:10:17.222 15:39:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:10:17.222 15:39:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:10:17.222 15:39:15 -- common/autotest_common.sh@10 -- # set +x 00:10:17.222 ************************************ 00:10:17.222 START TEST nvmf_ns_masking 00:10:17.222 ************************************ 00:10:17.222 15:39:15 -- common/autotest_common.sh@1111 -- # test/nvmf/target/ns_masking.sh --transport=rdma 00:10:17.481 * Looking for test storage... 00:10:17.481 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:10:17.481 15:39:15 -- target/ns_masking.sh@8 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:10:17.481 15:39:15 -- nvmf/common.sh@7 -- # uname -s 00:10:17.481 15:39:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:10:17.481 15:39:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:10:17.481 15:39:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:10:17.481 15:39:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:10:17.481 15:39:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:10:17.481 15:39:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:10:17.481 15:39:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:10:17.481 15:39:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:10:17.481 15:39:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:10:17.481 15:39:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:10:17.481 15:39:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:10:17.481 15:39:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:10:17.481 15:39:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:10:17.481 15:39:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:10:17.481 15:39:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:10:17.481 15:39:15 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:10:17.481 15:39:15 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:10:17.481 15:39:15 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:10:17.481 15:39:15 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:10:17.481 15:39:15 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:10:17.481 15:39:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:17.481 15:39:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:17.481 15:39:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:17.481 15:39:15 -- paths/export.sh@5 -- # export PATH 00:10:17.481 15:39:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:17.481 15:39:15 -- nvmf/common.sh@47 -- # : 0 00:10:17.481 15:39:15 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:10:17.481 15:39:15 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:10:17.481 15:39:15 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:10:17.481 15:39:15 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:10:17.481 15:39:15 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:10:17.481 15:39:15 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:10:17.481 15:39:15 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:10:17.481 15:39:15 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:10:17.481 15:39:15 -- target/ns_masking.sh@10 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:10:17.481 15:39:15 -- target/ns_masking.sh@11 -- # loops=5 00:10:17.481 15:39:15 -- target/ns_masking.sh@13 -- # SUBSYSNQN=nqn.2016-06.io.spdk:cnode1 00:10:17.481 15:39:15 -- target/ns_masking.sh@14 -- # HOSTNQN=nqn.2016-06.io.spdk:host1 00:10:17.481 15:39:15 -- target/ns_masking.sh@15 -- # uuidgen 00:10:17.481 15:39:15 -- target/ns_masking.sh@15 -- # HOSTID=10da3fef-a6b5-4c4f-a736-faa65e35ba72 00:10:17.481 15:39:15 -- target/ns_masking.sh@44 -- # nvmftestinit 00:10:17.481 15:39:15 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:10:17.481 15:39:15 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:10:17.481 15:39:15 -- nvmf/common.sh@437 -- # prepare_net_devs 00:10:17.481 15:39:15 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:10:17.481 15:39:15 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:10:17.481 15:39:15 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:17.481 15:39:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:10:17.481 15:39:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:17.481 15:39:15 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:10:17.481 15:39:15 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:10:17.481 15:39:15 -- nvmf/common.sh@285 -- # xtrace_disable 00:10:17.481 15:39:15 -- common/autotest_common.sh@10 -- # set +x 00:10:22.750 15:39:20 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:10:22.750 15:39:20 -- nvmf/common.sh@291 -- # pci_devs=() 00:10:22.750 15:39:20 -- nvmf/common.sh@291 -- # local -a pci_devs 00:10:22.750 15:39:20 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:10:22.750 15:39:20 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:10:22.750 15:39:20 -- nvmf/common.sh@293 -- # pci_drivers=() 00:10:22.750 15:39:20 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:10:22.750 15:39:20 -- nvmf/common.sh@295 -- # net_devs=() 00:10:22.750 15:39:20 -- nvmf/common.sh@295 -- # local -ga net_devs 00:10:22.750 15:39:20 -- nvmf/common.sh@296 -- # e810=() 00:10:22.750 15:39:20 -- nvmf/common.sh@296 -- # local -ga e810 00:10:22.750 15:39:20 -- nvmf/common.sh@297 -- # x722=() 00:10:22.750 15:39:20 -- nvmf/common.sh@297 -- # local -ga x722 00:10:22.750 15:39:20 -- nvmf/common.sh@298 -- # mlx=() 00:10:22.750 15:39:20 -- nvmf/common.sh@298 -- # local -ga mlx 00:10:22.750 15:39:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:10:22.750 15:39:20 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:10:22.750 15:39:20 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:10:22.750 15:39:20 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:10:22.750 15:39:20 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:10:22.750 15:39:20 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:10:22.750 15:39:20 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:10:22.750 15:39:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:10:22.750 15:39:20 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:10:22.750 15:39:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:10:22.750 15:39:20 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:10:22.750 15:39:20 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:10:22.750 15:39:20 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:10:22.750 15:39:20 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:10:22.750 15:39:20 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:10:22.751 15:39:20 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:10:22.751 15:39:20 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:10:22.751 15:39:20 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:10:22.751 15:39:20 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:10:22.751 15:39:20 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:10:22.751 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:10:22.751 15:39:20 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:10:22.751 15:39:20 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:10:22.751 15:39:20 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:10:22.751 15:39:20 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:10:22.751 15:39:20 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:10:22.751 15:39:20 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:10:22.751 15:39:20 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:10:22.751 15:39:20 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:10:22.751 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:10:22.751 15:39:20 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:10:22.751 15:39:20 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:10:22.751 15:39:20 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:10:22.751 15:39:20 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:10:22.751 15:39:20 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:10:22.751 15:39:20 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:10:22.751 15:39:20 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:10:22.751 15:39:20 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:10:22.751 15:39:20 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:10:22.751 15:39:20 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:22.751 15:39:20 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:10:22.751 15:39:20 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:22.751 15:39:20 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:10:22.751 Found net devices under 0000:da:00.0: mlx_0_0 00:10:22.751 15:39:20 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:10:22.751 15:39:20 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:10:22.751 15:39:20 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:22.751 15:39:20 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:10:22.751 15:39:20 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:22.751 15:39:20 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:10:22.751 Found net devices under 0000:da:00.1: mlx_0_1 00:10:22.751 15:39:20 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:10:22.751 15:39:20 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:10:22.751 15:39:20 -- nvmf/common.sh@403 -- # is_hw=yes 00:10:22.751 15:39:20 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:10:22.751 15:39:20 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:10:22.751 15:39:20 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:10:22.751 15:39:20 -- nvmf/common.sh@409 -- # rdma_device_init 00:10:22.751 15:39:20 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:10:22.751 15:39:20 -- nvmf/common.sh@58 -- # uname 00:10:22.751 15:39:20 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:10:22.751 15:39:20 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:10:22.751 15:39:20 -- nvmf/common.sh@63 -- # modprobe ib_core 00:10:22.751 15:39:20 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:10:22.751 15:39:20 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:10:22.751 15:39:20 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:10:22.751 15:39:20 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:10:22.751 15:39:20 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:10:22.751 15:39:20 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:10:22.751 15:39:20 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:10:22.751 15:39:20 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:10:22.751 15:39:20 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:10:22.751 15:39:20 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:10:22.751 15:39:20 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:10:22.751 15:39:20 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:10:22.751 15:39:20 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:10:22.751 15:39:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:22.751 15:39:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:22.751 15:39:20 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:10:22.751 15:39:20 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:10:22.751 15:39:20 -- nvmf/common.sh@105 -- # continue 2 00:10:22.751 15:39:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:22.751 15:39:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:22.751 15:39:20 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:10:22.751 15:39:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:22.751 15:39:20 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:10:22.751 15:39:20 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:10:22.751 15:39:20 -- nvmf/common.sh@105 -- # continue 2 00:10:22.751 15:39:20 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:10:22.751 15:39:20 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:10:22.751 15:39:20 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:10:22.751 15:39:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:10:22.751 15:39:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:22.751 15:39:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:22.751 15:39:20 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:10:22.751 15:39:20 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:10:22.751 15:39:20 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:10:22.751 118: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:10:22.751 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:10:22.751 altname enp218s0f0np0 00:10:22.751 altname ens818f0np0 00:10:22.751 inet 192.168.100.8/24 scope global mlx_0_0 00:10:22.751 valid_lft forever preferred_lft forever 00:10:22.751 15:39:20 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:10:22.751 15:39:20 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:10:22.751 15:39:20 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:10:22.751 15:39:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:22.751 15:39:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:10:22.751 15:39:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:22.751 15:39:20 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:10:22.751 15:39:20 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:10:22.751 15:39:20 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:10:22.751 119: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:10:22.751 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:10:22.751 altname enp218s0f1np1 00:10:22.751 altname ens818f1np1 00:10:22.751 inet 192.168.100.9/24 scope global mlx_0_1 00:10:22.751 valid_lft forever preferred_lft forever 00:10:22.751 15:39:20 -- nvmf/common.sh@411 -- # return 0 00:10:22.751 15:39:20 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:10:22.751 15:39:20 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:10:22.751 15:39:20 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:10:22.751 15:39:20 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:10:22.751 15:39:20 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:10:22.751 15:39:20 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:10:22.751 15:39:20 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:10:22.751 15:39:20 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:10:22.751 15:39:20 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:10:22.751 15:39:20 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:10:22.751 15:39:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:22.751 15:39:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:22.751 15:39:20 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:10:22.751 15:39:20 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:10:22.751 15:39:20 -- nvmf/common.sh@105 -- # continue 2 00:10:22.751 15:39:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:22.751 15:39:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:22.751 15:39:20 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:10:22.751 15:39:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:22.751 15:39:20 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:10:22.751 15:39:20 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:10:22.752 15:39:20 -- nvmf/common.sh@105 -- # continue 2 00:10:22.752 15:39:20 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:10:22.752 15:39:20 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:10:22.752 15:39:20 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:10:22.752 15:39:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:10:22.752 15:39:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:22.752 15:39:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:22.752 15:39:20 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:10:22.752 15:39:20 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:10:22.752 15:39:20 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:10:22.752 15:39:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:10:22.752 15:39:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:22.752 15:39:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:22.752 15:39:20 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:10:22.752 192.168.100.9' 00:10:22.752 15:39:20 -- nvmf/common.sh@446 -- # head -n 1 00:10:22.752 15:39:20 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:10:22.752 192.168.100.9' 00:10:22.752 15:39:20 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:10:22.752 15:39:20 -- nvmf/common.sh@447 -- # head -n 1 00:10:22.752 15:39:20 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:10:22.752 192.168.100.9' 00:10:22.752 15:39:20 -- nvmf/common.sh@447 -- # tail -n +2 00:10:22.752 15:39:20 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:10:22.752 15:39:20 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:10:22.752 15:39:20 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:10:22.752 15:39:20 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:10:22.752 15:39:20 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:10:22.752 15:39:20 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:10:22.752 15:39:20 -- target/ns_masking.sh@45 -- # nvmfappstart -m 0xF 00:10:22.752 15:39:20 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:10:22.752 15:39:20 -- common/autotest_common.sh@710 -- # xtrace_disable 00:10:22.752 15:39:20 -- common/autotest_common.sh@10 -- # set +x 00:10:22.752 15:39:20 -- nvmf/common.sh@470 -- # nvmfpid=3251746 00:10:22.752 15:39:20 -- nvmf/common.sh@471 -- # waitforlisten 3251746 00:10:22.752 15:39:20 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:10:22.752 15:39:20 -- common/autotest_common.sh@817 -- # '[' -z 3251746 ']' 00:10:22.752 15:39:20 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:10:22.752 15:39:20 -- common/autotest_common.sh@822 -- # local max_retries=100 00:10:22.752 15:39:20 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:10:22.752 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:10:22.752 15:39:20 -- common/autotest_common.sh@826 -- # xtrace_disable 00:10:22.752 15:39:20 -- common/autotest_common.sh@10 -- # set +x 00:10:22.752 [2024-04-26 15:39:21.023979] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:10:22.752 [2024-04-26 15:39:21.024020] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:10:22.752 EAL: No free 2048 kB hugepages reported on node 1 00:10:22.752 [2024-04-26 15:39:21.079019] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:10:22.752 [2024-04-26 15:39:21.158731] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:10:22.752 [2024-04-26 15:39:21.158766] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:10:22.752 [2024-04-26 15:39:21.158773] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:10:22.752 [2024-04-26 15:39:21.158779] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:10:22.752 [2024-04-26 15:39:21.158784] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:10:22.752 [2024-04-26 15:39:21.158848] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:10:22.752 [2024-04-26 15:39:21.158862] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:10:22.752 [2024-04-26 15:39:21.158957] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:10:22.752 [2024-04-26 15:39:21.158958] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:10:23.320 15:39:21 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:10:23.320 15:39:21 -- common/autotest_common.sh@850 -- # return 0 00:10:23.320 15:39:21 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:10:23.320 15:39:21 -- common/autotest_common.sh@716 -- # xtrace_disable 00:10:23.320 15:39:21 -- common/autotest_common.sh@10 -- # set +x 00:10:23.320 15:39:21 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:10:23.320 15:39:21 -- target/ns_masking.sh@47 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:10:23.579 [2024-04-26 15:39:22.038494] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x13aa100/0x13ae5f0) succeed. 00:10:23.579 [2024-04-26 15:39:22.048853] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x13ab740/0x13efc80) succeed. 00:10:23.837 15:39:22 -- target/ns_masking.sh@49 -- # MALLOC_BDEV_SIZE=64 00:10:23.837 15:39:22 -- target/ns_masking.sh@50 -- # MALLOC_BLOCK_SIZE=512 00:10:23.837 15:39:22 -- target/ns_masking.sh@52 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:10:23.837 Malloc1 00:10:23.837 15:39:22 -- target/ns_masking.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:10:24.094 Malloc2 00:10:24.094 15:39:22 -- target/ns_masking.sh@56 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:10:24.352 15:39:22 -- target/ns_masking.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 1 00:10:24.352 15:39:22 -- target/ns_masking.sh@58 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:10:24.610 [2024-04-26 15:39:23.087792] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:10:24.610 15:39:23 -- target/ns_masking.sh@61 -- # connect 00:10:24.610 15:39:23 -- target/ns_masking.sh@18 -- # nvme connect -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I 10da3fef-a6b5-4c4f-a736-faa65e35ba72 -a 192.168.100.8 -s 4420 -i 4 00:10:24.869 15:39:23 -- target/ns_masking.sh@20 -- # waitforserial SPDKISFASTANDAWESOME 00:10:24.869 15:39:23 -- common/autotest_common.sh@1184 -- # local i=0 00:10:24.869 15:39:23 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:10:24.869 15:39:23 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:10:24.869 15:39:23 -- common/autotest_common.sh@1191 -- # sleep 2 00:10:27.394 15:39:25 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:10:27.394 15:39:25 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:10:27.394 15:39:25 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:10:27.394 15:39:25 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:10:27.394 15:39:25 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:10:27.394 15:39:25 -- common/autotest_common.sh@1194 -- # return 0 00:10:27.394 15:39:25 -- target/ns_masking.sh@22 -- # nvme list-subsys -o json 00:10:27.394 15:39:25 -- target/ns_masking.sh@22 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:10:27.394 15:39:25 -- target/ns_masking.sh@22 -- # ctrl_id=nvme0 00:10:27.394 15:39:25 -- target/ns_masking.sh@23 -- # [[ -z nvme0 ]] 00:10:27.394 15:39:25 -- target/ns_masking.sh@62 -- # ns_is_visible 0x1 00:10:27.394 15:39:25 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:10:27.394 15:39:25 -- target/ns_masking.sh@39 -- # grep 0x1 00:10:27.394 [ 0]:0x1 00:10:27.394 15:39:25 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:10:27.394 15:39:25 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:10:27.394 15:39:25 -- target/ns_masking.sh@40 -- # nguid=ee9d1ba7c67a4acd91e48a4cca25ad77 00:10:27.394 15:39:25 -- target/ns_masking.sh@41 -- # [[ ee9d1ba7c67a4acd91e48a4cca25ad77 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:10:27.394 15:39:25 -- target/ns_masking.sh@65 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc2 -n 2 00:10:27.394 15:39:25 -- target/ns_masking.sh@66 -- # ns_is_visible 0x1 00:10:27.394 15:39:25 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:10:27.394 15:39:25 -- target/ns_masking.sh@39 -- # grep 0x1 00:10:27.394 [ 0]:0x1 00:10:27.394 15:39:25 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:10:27.394 15:39:25 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:10:27.394 15:39:25 -- target/ns_masking.sh@40 -- # nguid=ee9d1ba7c67a4acd91e48a4cca25ad77 00:10:27.394 15:39:25 -- target/ns_masking.sh@41 -- # [[ ee9d1ba7c67a4acd91e48a4cca25ad77 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:10:27.394 15:39:25 -- target/ns_masking.sh@67 -- # ns_is_visible 0x2 00:10:27.394 15:39:25 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:10:27.394 15:39:25 -- target/ns_masking.sh@39 -- # grep 0x2 00:10:27.394 [ 1]:0x2 00:10:27.394 15:39:25 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:10:27.394 15:39:25 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:10:27.394 15:39:25 -- target/ns_masking.sh@40 -- # nguid=5bee9ad98f934c6086f9bd873e8ff198 00:10:27.394 15:39:25 -- target/ns_masking.sh@41 -- # [[ 5bee9ad98f934c6086f9bd873e8ff198 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:10:27.394 15:39:25 -- target/ns_masking.sh@69 -- # disconnect 00:10:27.394 15:39:25 -- target/ns_masking.sh@34 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:10:27.669 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:27.669 15:39:26 -- target/ns_masking.sh@73 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:27.925 15:39:26 -- target/ns_masking.sh@74 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 1 --no-auto-visible 00:10:27.925 15:39:26 -- target/ns_masking.sh@77 -- # connect 1 00:10:27.925 15:39:26 -- target/ns_masking.sh@18 -- # nvme connect -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I 10da3fef-a6b5-4c4f-a736-faa65e35ba72 -a 192.168.100.8 -s 4420 -i 4 00:10:28.490 15:39:26 -- target/ns_masking.sh@20 -- # waitforserial SPDKISFASTANDAWESOME 1 00:10:28.490 15:39:26 -- common/autotest_common.sh@1184 -- # local i=0 00:10:28.490 15:39:26 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:10:28.490 15:39:26 -- common/autotest_common.sh@1186 -- # [[ -n 1 ]] 00:10:28.490 15:39:26 -- common/autotest_common.sh@1187 -- # nvme_device_counter=1 00:10:28.490 15:39:26 -- common/autotest_common.sh@1191 -- # sleep 2 00:10:30.386 15:39:28 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:10:30.386 15:39:28 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:10:30.386 15:39:28 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:10:30.386 15:39:28 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:10:30.386 15:39:28 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:10:30.386 15:39:28 -- common/autotest_common.sh@1194 -- # return 0 00:10:30.386 15:39:28 -- target/ns_masking.sh@22 -- # nvme list-subsys -o json 00:10:30.386 15:39:28 -- target/ns_masking.sh@22 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:10:30.386 15:39:28 -- target/ns_masking.sh@22 -- # ctrl_id=nvme0 00:10:30.386 15:39:28 -- target/ns_masking.sh@23 -- # [[ -z nvme0 ]] 00:10:30.386 15:39:28 -- target/ns_masking.sh@78 -- # NOT ns_is_visible 0x1 00:10:30.386 15:39:28 -- common/autotest_common.sh@638 -- # local es=0 00:10:30.386 15:39:28 -- common/autotest_common.sh@640 -- # valid_exec_arg ns_is_visible 0x1 00:10:30.386 15:39:28 -- common/autotest_common.sh@626 -- # local arg=ns_is_visible 00:10:30.386 15:39:28 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:10:30.386 15:39:28 -- common/autotest_common.sh@630 -- # type -t ns_is_visible 00:10:30.386 15:39:28 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:10:30.386 15:39:28 -- common/autotest_common.sh@641 -- # ns_is_visible 0x1 00:10:30.386 15:39:28 -- target/ns_masking.sh@39 -- # grep 0x1 00:10:30.386 15:39:28 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:10:30.386 15:39:28 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:10:30.386 15:39:28 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:10:30.386 15:39:28 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:10:30.386 15:39:28 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:10:30.386 15:39:28 -- common/autotest_common.sh@641 -- # es=1 00:10:30.386 15:39:28 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:10:30.386 15:39:28 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:10:30.386 15:39:28 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:10:30.386 15:39:28 -- target/ns_masking.sh@79 -- # ns_is_visible 0x2 00:10:30.386 15:39:28 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:10:30.386 15:39:28 -- target/ns_masking.sh@39 -- # grep 0x2 00:10:30.386 [ 0]:0x2 00:10:30.386 15:39:28 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:10:30.386 15:39:28 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:10:30.386 15:39:28 -- target/ns_masking.sh@40 -- # nguid=5bee9ad98f934c6086f9bd873e8ff198 00:10:30.386 15:39:28 -- target/ns_masking.sh@41 -- # [[ 5bee9ad98f934c6086f9bd873e8ff198 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:10:30.386 15:39:28 -- target/ns_masking.sh@82 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_add_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:10:30.644 15:39:29 -- target/ns_masking.sh@83 -- # ns_is_visible 0x1 00:10:30.644 15:39:29 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:10:30.644 15:39:29 -- target/ns_masking.sh@39 -- # grep 0x1 00:10:30.644 [ 0]:0x1 00:10:30.645 15:39:29 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:10:30.645 15:39:29 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:10:30.645 15:39:29 -- target/ns_masking.sh@40 -- # nguid=ee9d1ba7c67a4acd91e48a4cca25ad77 00:10:30.645 15:39:29 -- target/ns_masking.sh@41 -- # [[ ee9d1ba7c67a4acd91e48a4cca25ad77 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:10:30.645 15:39:29 -- target/ns_masking.sh@84 -- # ns_is_visible 0x2 00:10:30.645 15:39:29 -- target/ns_masking.sh@39 -- # grep 0x2 00:10:30.645 15:39:29 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:10:30.645 [ 1]:0x2 00:10:30.645 15:39:29 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:10:30.645 15:39:29 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:10:30.903 15:39:29 -- target/ns_masking.sh@40 -- # nguid=5bee9ad98f934c6086f9bd873e8ff198 00:10:30.903 15:39:29 -- target/ns_masking.sh@41 -- # [[ 5bee9ad98f934c6086f9bd873e8ff198 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:10:30.903 15:39:29 -- target/ns_masking.sh@87 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:10:30.903 15:39:29 -- target/ns_masking.sh@88 -- # NOT ns_is_visible 0x1 00:10:30.903 15:39:29 -- common/autotest_common.sh@638 -- # local es=0 00:10:30.903 15:39:29 -- common/autotest_common.sh@640 -- # valid_exec_arg ns_is_visible 0x1 00:10:30.903 15:39:29 -- common/autotest_common.sh@626 -- # local arg=ns_is_visible 00:10:30.903 15:39:29 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:10:30.903 15:39:29 -- common/autotest_common.sh@630 -- # type -t ns_is_visible 00:10:30.903 15:39:29 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:10:30.903 15:39:29 -- common/autotest_common.sh@641 -- # ns_is_visible 0x1 00:10:30.903 15:39:29 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:10:30.903 15:39:29 -- target/ns_masking.sh@39 -- # grep 0x1 00:10:30.903 15:39:29 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:10:30.903 15:39:29 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:10:30.903 15:39:29 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:10:30.903 15:39:29 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:10:30.903 15:39:29 -- common/autotest_common.sh@641 -- # es=1 00:10:30.903 15:39:29 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:10:30.903 15:39:29 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:10:30.903 15:39:29 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:10:30.903 15:39:29 -- target/ns_masking.sh@89 -- # ns_is_visible 0x2 00:10:30.903 15:39:29 -- target/ns_masking.sh@39 -- # grep 0x2 00:10:30.903 15:39:29 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:10:30.903 [ 0]:0x2 00:10:31.160 15:39:29 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:10:31.160 15:39:29 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:10:31.160 15:39:29 -- target/ns_masking.sh@40 -- # nguid=5bee9ad98f934c6086f9bd873e8ff198 00:10:31.160 15:39:29 -- target/ns_masking.sh@41 -- # [[ 5bee9ad98f934c6086f9bd873e8ff198 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:10:31.160 15:39:29 -- target/ns_masking.sh@91 -- # disconnect 00:10:31.160 15:39:29 -- target/ns_masking.sh@34 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:10:31.418 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:31.419 15:39:29 -- target/ns_masking.sh@94 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_add_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:10:31.677 15:39:30 -- target/ns_masking.sh@95 -- # connect 2 00:10:31.677 15:39:30 -- target/ns_masking.sh@18 -- # nvme connect -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I 10da3fef-a6b5-4c4f-a736-faa65e35ba72 -a 192.168.100.8 -s 4420 -i 4 00:10:31.936 15:39:30 -- target/ns_masking.sh@20 -- # waitforserial SPDKISFASTANDAWESOME 2 00:10:31.936 15:39:30 -- common/autotest_common.sh@1184 -- # local i=0 00:10:31.936 15:39:30 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:10:31.936 15:39:30 -- common/autotest_common.sh@1186 -- # [[ -n 2 ]] 00:10:31.936 15:39:30 -- common/autotest_common.sh@1187 -- # nvme_device_counter=2 00:10:31.936 15:39:30 -- common/autotest_common.sh@1191 -- # sleep 2 00:10:33.840 15:39:32 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:10:33.840 15:39:32 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:10:33.840 15:39:32 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:10:33.840 15:39:32 -- common/autotest_common.sh@1193 -- # nvme_devices=2 00:10:33.840 15:39:32 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:10:33.840 15:39:32 -- common/autotest_common.sh@1194 -- # return 0 00:10:33.840 15:39:32 -- target/ns_masking.sh@22 -- # nvme list-subsys -o json 00:10:33.840 15:39:32 -- target/ns_masking.sh@22 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:10:33.840 15:39:32 -- target/ns_masking.sh@22 -- # ctrl_id=nvme0 00:10:33.840 15:39:32 -- target/ns_masking.sh@23 -- # [[ -z nvme0 ]] 00:10:33.840 15:39:32 -- target/ns_masking.sh@96 -- # ns_is_visible 0x1 00:10:33.840 15:39:32 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:10:33.840 15:39:32 -- target/ns_masking.sh@39 -- # grep 0x1 00:10:33.840 [ 0]:0x1 00:10:33.840 15:39:32 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:10:33.840 15:39:32 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:10:34.099 15:39:32 -- target/ns_masking.sh@40 -- # nguid=ee9d1ba7c67a4acd91e48a4cca25ad77 00:10:34.099 15:39:32 -- target/ns_masking.sh@41 -- # [[ ee9d1ba7c67a4acd91e48a4cca25ad77 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:10:34.099 15:39:32 -- target/ns_masking.sh@97 -- # ns_is_visible 0x2 00:10:34.099 15:39:32 -- target/ns_masking.sh@39 -- # grep 0x2 00:10:34.099 15:39:32 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:10:34.099 [ 1]:0x2 00:10:34.099 15:39:32 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:10:34.099 15:39:32 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:10:34.100 15:39:32 -- target/ns_masking.sh@40 -- # nguid=5bee9ad98f934c6086f9bd873e8ff198 00:10:34.100 15:39:32 -- target/ns_masking.sh@41 -- # [[ 5bee9ad98f934c6086f9bd873e8ff198 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:10:34.100 15:39:32 -- target/ns_masking.sh@100 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:10:34.100 15:39:32 -- target/ns_masking.sh@101 -- # NOT ns_is_visible 0x1 00:10:34.100 15:39:32 -- common/autotest_common.sh@638 -- # local es=0 00:10:34.100 15:39:32 -- common/autotest_common.sh@640 -- # valid_exec_arg ns_is_visible 0x1 00:10:34.100 15:39:32 -- common/autotest_common.sh@626 -- # local arg=ns_is_visible 00:10:34.100 15:39:32 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:10:34.100 15:39:32 -- common/autotest_common.sh@630 -- # type -t ns_is_visible 00:10:34.100 15:39:32 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:10:34.100 15:39:32 -- common/autotest_common.sh@641 -- # ns_is_visible 0x1 00:10:34.100 15:39:32 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:10:34.100 15:39:32 -- target/ns_masking.sh@39 -- # grep 0x1 00:10:34.100 15:39:32 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:10:34.100 15:39:32 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:10:34.359 15:39:32 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:10:34.359 15:39:32 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:10:34.359 15:39:32 -- common/autotest_common.sh@641 -- # es=1 00:10:34.359 15:39:32 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:10:34.359 15:39:32 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:10:34.359 15:39:32 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:10:34.359 15:39:32 -- target/ns_masking.sh@102 -- # ns_is_visible 0x2 00:10:34.359 15:39:32 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:10:34.359 15:39:32 -- target/ns_masking.sh@39 -- # grep 0x2 00:10:34.359 [ 0]:0x2 00:10:34.359 15:39:32 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:10:34.359 15:39:32 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:10:34.359 15:39:32 -- target/ns_masking.sh@40 -- # nguid=5bee9ad98f934c6086f9bd873e8ff198 00:10:34.359 15:39:32 -- target/ns_masking.sh@41 -- # [[ 5bee9ad98f934c6086f9bd873e8ff198 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:10:34.359 15:39:32 -- target/ns_masking.sh@105 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:10:34.359 15:39:32 -- common/autotest_common.sh@638 -- # local es=0 00:10:34.359 15:39:32 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:10:34.359 15:39:32 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:10:34.359 15:39:32 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:10:34.359 15:39:32 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:10:34.359 15:39:32 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:10:34.359 15:39:32 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:10:34.359 15:39:32 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:10:34.359 15:39:32 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:10:34.359 15:39:32 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py ]] 00:10:34.359 15:39:32 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:10:34.359 [2024-04-26 15:39:32.951081] nvmf_rpc.c:1779:nvmf_rpc_ns_visible_paused: *ERROR*: Unable to add/remove nqn.2016-06.io.spdk:host1 to namespace ID 2 00:10:34.359 request: 00:10:34.359 { 00:10:34.359 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:10:34.359 "nsid": 2, 00:10:34.359 "host": "nqn.2016-06.io.spdk:host1", 00:10:34.359 "method": "nvmf_ns_remove_host", 00:10:34.359 "req_id": 1 00:10:34.359 } 00:10:34.359 Got JSON-RPC error response 00:10:34.359 response: 00:10:34.359 { 00:10:34.359 "code": -32602, 00:10:34.359 "message": "Invalid parameters" 00:10:34.359 } 00:10:34.618 15:39:32 -- common/autotest_common.sh@641 -- # es=1 00:10:34.618 15:39:32 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:10:34.618 15:39:32 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:10:34.618 15:39:32 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:10:34.618 15:39:32 -- target/ns_masking.sh@106 -- # NOT ns_is_visible 0x1 00:10:34.618 15:39:32 -- common/autotest_common.sh@638 -- # local es=0 00:10:34.618 15:39:32 -- common/autotest_common.sh@640 -- # valid_exec_arg ns_is_visible 0x1 00:10:34.618 15:39:32 -- common/autotest_common.sh@626 -- # local arg=ns_is_visible 00:10:34.618 15:39:32 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:10:34.618 15:39:32 -- common/autotest_common.sh@630 -- # type -t ns_is_visible 00:10:34.618 15:39:32 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:10:34.618 15:39:32 -- common/autotest_common.sh@641 -- # ns_is_visible 0x1 00:10:34.618 15:39:32 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:10:34.618 15:39:32 -- target/ns_masking.sh@39 -- # grep 0x1 00:10:34.618 15:39:32 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:10:34.618 15:39:32 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:10:34.618 15:39:33 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:10:34.618 15:39:33 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:10:34.618 15:39:33 -- common/autotest_common.sh@641 -- # es=1 00:10:34.618 15:39:33 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:10:34.618 15:39:33 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:10:34.618 15:39:33 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:10:34.618 15:39:33 -- target/ns_masking.sh@107 -- # ns_is_visible 0x2 00:10:34.618 15:39:33 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:10:34.618 15:39:33 -- target/ns_masking.sh@39 -- # grep 0x2 00:10:34.618 [ 0]:0x2 00:10:34.618 15:39:33 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:10:34.618 15:39:33 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:10:34.618 15:39:33 -- target/ns_masking.sh@40 -- # nguid=5bee9ad98f934c6086f9bd873e8ff198 00:10:34.618 15:39:33 -- target/ns_masking.sh@41 -- # [[ 5bee9ad98f934c6086f9bd873e8ff198 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:10:34.618 15:39:33 -- target/ns_masking.sh@108 -- # disconnect 00:10:34.618 15:39:33 -- target/ns_masking.sh@34 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:10:34.876 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:34.876 15:39:33 -- target/ns_masking.sh@110 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:10:35.179 15:39:33 -- target/ns_masking.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:10:35.179 15:39:33 -- target/ns_masking.sh@114 -- # nvmftestfini 00:10:35.179 15:39:33 -- nvmf/common.sh@477 -- # nvmfcleanup 00:10:35.179 15:39:33 -- nvmf/common.sh@117 -- # sync 00:10:35.179 15:39:33 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:10:35.179 15:39:33 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:10:35.179 15:39:33 -- nvmf/common.sh@120 -- # set +e 00:10:35.179 15:39:33 -- nvmf/common.sh@121 -- # for i in {1..20} 00:10:35.179 15:39:33 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:10:35.179 rmmod nvme_rdma 00:10:35.179 rmmod nvme_fabrics 00:10:35.179 15:39:33 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:10:35.179 15:39:33 -- nvmf/common.sh@124 -- # set -e 00:10:35.179 15:39:33 -- nvmf/common.sh@125 -- # return 0 00:10:35.179 15:39:33 -- nvmf/common.sh@478 -- # '[' -n 3251746 ']' 00:10:35.179 15:39:33 -- nvmf/common.sh@479 -- # killprocess 3251746 00:10:35.179 15:39:33 -- common/autotest_common.sh@936 -- # '[' -z 3251746 ']' 00:10:35.179 15:39:33 -- common/autotest_common.sh@940 -- # kill -0 3251746 00:10:35.179 15:39:33 -- common/autotest_common.sh@941 -- # uname 00:10:35.179 15:39:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:10:35.179 15:39:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3251746 00:10:35.179 15:39:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:10:35.179 15:39:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:10:35.179 15:39:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3251746' 00:10:35.179 killing process with pid 3251746 00:10:35.179 15:39:33 -- common/autotest_common.sh@955 -- # kill 3251746 00:10:35.179 15:39:33 -- common/autotest_common.sh@960 -- # wait 3251746 00:10:35.179 [2024-04-26 15:39:33.742198] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:10:35.456 15:39:33 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:10:35.456 15:39:33 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:10:35.456 00:10:35.456 real 0m18.191s 00:10:35.456 user 0m55.450s 00:10:35.456 sys 0m5.023s 00:10:35.456 15:39:33 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:10:35.456 15:39:33 -- common/autotest_common.sh@10 -- # set +x 00:10:35.456 ************************************ 00:10:35.456 END TEST nvmf_ns_masking 00:10:35.456 ************************************ 00:10:35.456 15:39:34 -- nvmf/nvmf.sh@37 -- # [[ 1 -eq 1 ]] 00:10:35.456 15:39:34 -- nvmf/nvmf.sh@38 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=rdma 00:10:35.456 15:39:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:10:35.456 15:39:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:10:35.456 15:39:34 -- common/autotest_common.sh@10 -- # set +x 00:10:35.716 ************************************ 00:10:35.716 START TEST nvmf_nvme_cli 00:10:35.716 ************************************ 00:10:35.716 15:39:34 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=rdma 00:10:35.716 * Looking for test storage... 00:10:35.716 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:10:35.716 15:39:34 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:10:35.716 15:39:34 -- nvmf/common.sh@7 -- # uname -s 00:10:35.716 15:39:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:10:35.716 15:39:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:10:35.716 15:39:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:10:35.716 15:39:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:10:35.716 15:39:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:10:35.716 15:39:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:10:35.716 15:39:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:10:35.716 15:39:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:10:35.716 15:39:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:10:35.716 15:39:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:10:35.716 15:39:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:10:35.716 15:39:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:10:35.716 15:39:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:10:35.716 15:39:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:10:35.716 15:39:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:10:35.716 15:39:34 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:10:35.716 15:39:34 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:10:35.716 15:39:34 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:10:35.716 15:39:34 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:10:35.716 15:39:34 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:10:35.716 15:39:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:35.716 15:39:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:35.716 15:39:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:35.716 15:39:34 -- paths/export.sh@5 -- # export PATH 00:10:35.716 15:39:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:35.716 15:39:34 -- nvmf/common.sh@47 -- # : 0 00:10:35.716 15:39:34 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:10:35.716 15:39:34 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:10:35.716 15:39:34 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:10:35.716 15:39:34 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:10:35.716 15:39:34 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:10:35.716 15:39:34 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:10:35.716 15:39:34 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:10:35.716 15:39:34 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:10:35.716 15:39:34 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:10:35.716 15:39:34 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:10:35.716 15:39:34 -- target/nvme_cli.sh@14 -- # devs=() 00:10:35.716 15:39:34 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:10:35.716 15:39:34 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:10:35.716 15:39:34 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:10:35.716 15:39:34 -- nvmf/common.sh@437 -- # prepare_net_devs 00:10:35.716 15:39:34 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:10:35.716 15:39:34 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:10:35.716 15:39:34 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:35.716 15:39:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:10:35.716 15:39:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:35.716 15:39:34 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:10:35.716 15:39:34 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:10:35.716 15:39:34 -- nvmf/common.sh@285 -- # xtrace_disable 00:10:35.716 15:39:34 -- common/autotest_common.sh@10 -- # set +x 00:10:40.992 15:39:39 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:10:40.992 15:39:39 -- nvmf/common.sh@291 -- # pci_devs=() 00:10:40.992 15:39:39 -- nvmf/common.sh@291 -- # local -a pci_devs 00:10:40.992 15:39:39 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:10:40.992 15:39:39 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:10:40.992 15:39:39 -- nvmf/common.sh@293 -- # pci_drivers=() 00:10:40.992 15:39:39 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:10:40.992 15:39:39 -- nvmf/common.sh@295 -- # net_devs=() 00:10:40.992 15:39:39 -- nvmf/common.sh@295 -- # local -ga net_devs 00:10:40.992 15:39:39 -- nvmf/common.sh@296 -- # e810=() 00:10:40.992 15:39:39 -- nvmf/common.sh@296 -- # local -ga e810 00:10:40.992 15:39:39 -- nvmf/common.sh@297 -- # x722=() 00:10:40.992 15:39:39 -- nvmf/common.sh@297 -- # local -ga x722 00:10:40.992 15:39:39 -- nvmf/common.sh@298 -- # mlx=() 00:10:40.992 15:39:39 -- nvmf/common.sh@298 -- # local -ga mlx 00:10:40.992 15:39:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:10:40.992 15:39:39 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:10:40.992 15:39:39 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:10:40.992 15:39:39 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:10:40.992 15:39:39 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:10:40.992 15:39:39 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:10:40.992 15:39:39 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:10:40.992 15:39:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:10:40.992 15:39:39 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:10:40.992 15:39:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:10:40.992 15:39:39 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:10:40.992 15:39:39 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:10:40.992 15:39:39 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:10:40.992 15:39:39 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:10:40.992 15:39:39 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:10:40.992 15:39:39 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:10:40.992 15:39:39 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:10:40.992 15:39:39 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:10:40.992 15:39:39 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:10:40.992 15:39:39 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:10:40.992 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:10:40.992 15:39:39 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:10:40.992 15:39:39 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:10:40.992 15:39:39 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:10:40.992 15:39:39 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:10:40.992 15:39:39 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:10:40.992 15:39:39 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:10:40.992 15:39:39 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:10:40.992 15:39:39 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:10:40.992 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:10:40.992 15:39:39 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:10:40.992 15:39:39 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:10:40.992 15:39:39 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:10:40.992 15:39:39 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:10:40.992 15:39:39 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:10:40.992 15:39:39 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:10:40.992 15:39:39 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:10:40.992 15:39:39 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:10:40.992 15:39:39 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:10:40.992 15:39:39 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:40.992 15:39:39 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:10:40.992 15:39:39 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:40.992 15:39:39 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:10:40.992 Found net devices under 0000:da:00.0: mlx_0_0 00:10:40.992 15:39:39 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:10:40.992 15:39:39 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:10:40.992 15:39:39 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:40.992 15:39:39 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:10:40.992 15:39:39 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:40.992 15:39:39 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:10:40.992 Found net devices under 0000:da:00.1: mlx_0_1 00:10:40.992 15:39:39 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:10:40.992 15:39:39 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:10:40.992 15:39:39 -- nvmf/common.sh@403 -- # is_hw=yes 00:10:40.992 15:39:39 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:10:40.992 15:39:39 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:10:40.992 15:39:39 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:10:40.992 15:39:39 -- nvmf/common.sh@409 -- # rdma_device_init 00:10:40.992 15:39:39 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:10:40.992 15:39:39 -- nvmf/common.sh@58 -- # uname 00:10:40.993 15:39:39 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:10:40.993 15:39:39 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:10:40.993 15:39:39 -- nvmf/common.sh@63 -- # modprobe ib_core 00:10:40.993 15:39:39 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:10:40.993 15:39:39 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:10:40.993 15:39:39 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:10:40.993 15:39:39 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:10:40.993 15:39:39 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:10:40.993 15:39:39 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:10:40.993 15:39:39 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:10:40.993 15:39:39 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:10:40.993 15:39:39 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:10:40.993 15:39:39 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:10:40.993 15:39:39 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:10:40.993 15:39:39 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:10:40.993 15:39:39 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:10:40.993 15:39:39 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:40.993 15:39:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:40.993 15:39:39 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:10:40.993 15:39:39 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:10:40.993 15:39:39 -- nvmf/common.sh@105 -- # continue 2 00:10:40.993 15:39:39 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:40.993 15:39:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:40.993 15:39:39 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:10:40.993 15:39:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:40.993 15:39:39 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:10:40.993 15:39:39 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:10:40.993 15:39:39 -- nvmf/common.sh@105 -- # continue 2 00:10:40.993 15:39:39 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:10:40.993 15:39:39 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:10:40.993 15:39:39 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:10:40.993 15:39:39 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:10:40.993 15:39:39 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:40.993 15:39:39 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:40.993 15:39:39 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:10:40.993 15:39:39 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:10:40.993 15:39:39 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:10:40.993 118: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:10:40.993 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:10:40.993 altname enp218s0f0np0 00:10:40.993 altname ens818f0np0 00:10:40.993 inet 192.168.100.8/24 scope global mlx_0_0 00:10:40.993 valid_lft forever preferred_lft forever 00:10:40.993 15:39:39 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:10:40.993 15:39:39 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:10:40.993 15:39:39 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:10:40.993 15:39:39 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:10:40.993 15:39:39 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:40.993 15:39:39 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:40.993 15:39:39 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:10:40.993 15:39:39 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:10:40.993 15:39:39 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:10:40.993 119: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:10:40.993 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:10:40.993 altname enp218s0f1np1 00:10:40.993 altname ens818f1np1 00:10:40.993 inet 192.168.100.9/24 scope global mlx_0_1 00:10:40.993 valid_lft forever preferred_lft forever 00:10:40.993 15:39:39 -- nvmf/common.sh@411 -- # return 0 00:10:40.993 15:39:39 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:10:40.993 15:39:39 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:10:40.993 15:39:39 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:10:40.993 15:39:39 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:10:40.993 15:39:39 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:10:40.993 15:39:39 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:10:40.993 15:39:39 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:10:40.993 15:39:39 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:10:40.993 15:39:39 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:10:40.993 15:39:39 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:10:40.993 15:39:39 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:40.993 15:39:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:40.993 15:39:39 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:10:40.993 15:39:39 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:10:40.993 15:39:39 -- nvmf/common.sh@105 -- # continue 2 00:10:40.993 15:39:39 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:40.993 15:39:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:40.993 15:39:39 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:10:40.993 15:39:39 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:40.993 15:39:39 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:10:40.993 15:39:39 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:10:40.993 15:39:39 -- nvmf/common.sh@105 -- # continue 2 00:10:40.993 15:39:39 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:10:40.993 15:39:39 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:10:40.993 15:39:39 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:10:40.993 15:39:39 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:10:40.993 15:39:39 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:40.993 15:39:39 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:40.993 15:39:39 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:10:40.993 15:39:39 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:10:40.993 15:39:39 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:10:40.993 15:39:39 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:10:40.993 15:39:39 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:40.993 15:39:39 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:40.993 15:39:39 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:10:40.993 192.168.100.9' 00:10:40.993 15:39:39 -- nvmf/common.sh@446 -- # head -n 1 00:10:40.993 15:39:39 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:10:40.993 192.168.100.9' 00:10:40.993 15:39:39 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:10:40.993 15:39:39 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:10:40.993 192.168.100.9' 00:10:40.993 15:39:39 -- nvmf/common.sh@447 -- # tail -n +2 00:10:40.993 15:39:39 -- nvmf/common.sh@447 -- # head -n 1 00:10:40.993 15:39:39 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:10:40.993 15:39:39 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:10:40.993 15:39:39 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:10:40.993 15:39:39 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:10:40.993 15:39:39 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:10:40.993 15:39:39 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:10:40.993 15:39:39 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:10:40.993 15:39:39 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:10:40.993 15:39:39 -- common/autotest_common.sh@710 -- # xtrace_disable 00:10:40.993 15:39:39 -- common/autotest_common.sh@10 -- # set +x 00:10:40.993 15:39:39 -- nvmf/common.sh@470 -- # nvmfpid=3257094 00:10:40.993 15:39:39 -- nvmf/common.sh@471 -- # waitforlisten 3257094 00:10:40.993 15:39:39 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:10:40.993 15:39:39 -- common/autotest_common.sh@817 -- # '[' -z 3257094 ']' 00:10:40.993 15:39:39 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:10:40.993 15:39:39 -- common/autotest_common.sh@822 -- # local max_retries=100 00:10:40.993 15:39:39 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:10:40.993 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:10:40.993 15:39:39 -- common/autotest_common.sh@826 -- # xtrace_disable 00:10:40.993 15:39:39 -- common/autotest_common.sh@10 -- # set +x 00:10:40.993 [2024-04-26 15:39:39.466535] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:10:40.993 [2024-04-26 15:39:39.466580] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:10:40.993 EAL: No free 2048 kB hugepages reported on node 1 00:10:40.993 [2024-04-26 15:39:39.522239] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:10:41.255 [2024-04-26 15:39:39.600323] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:10:41.255 [2024-04-26 15:39:39.600355] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:10:41.255 [2024-04-26 15:39:39.600363] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:10:41.255 [2024-04-26 15:39:39.600369] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:10:41.255 [2024-04-26 15:39:39.600373] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:10:41.255 [2024-04-26 15:39:39.600410] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:10:41.255 [2024-04-26 15:39:39.600436] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:10:41.255 [2024-04-26 15:39:39.600522] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:10:41.255 [2024-04-26 15:39:39.600523] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:10:41.823 15:39:40 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:10:41.823 15:39:40 -- common/autotest_common.sh@850 -- # return 0 00:10:41.823 15:39:40 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:10:41.823 15:39:40 -- common/autotest_common.sh@716 -- # xtrace_disable 00:10:41.823 15:39:40 -- common/autotest_common.sh@10 -- # set +x 00:10:41.823 15:39:40 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:10:41.823 15:39:40 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:10:41.823 15:39:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:41.823 15:39:40 -- common/autotest_common.sh@10 -- # set +x 00:10:41.823 [2024-04-26 15:39:40.341093] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x22af100/0x22b35f0) succeed. 00:10:41.823 [2024-04-26 15:39:40.351534] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x22b0740/0x22f4c80) succeed. 00:10:42.081 15:39:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:42.081 15:39:40 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:10:42.081 15:39:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:42.081 15:39:40 -- common/autotest_common.sh@10 -- # set +x 00:10:42.081 Malloc0 00:10:42.081 15:39:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:42.081 15:39:40 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:10:42.081 15:39:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:42.081 15:39:40 -- common/autotest_common.sh@10 -- # set +x 00:10:42.081 Malloc1 00:10:42.081 15:39:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:42.081 15:39:40 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:10:42.081 15:39:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:42.081 15:39:40 -- common/autotest_common.sh@10 -- # set +x 00:10:42.081 15:39:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:42.081 15:39:40 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:10:42.081 15:39:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:42.081 15:39:40 -- common/autotest_common.sh@10 -- # set +x 00:10:42.081 15:39:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:42.081 15:39:40 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:10:42.081 15:39:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:42.081 15:39:40 -- common/autotest_common.sh@10 -- # set +x 00:10:42.081 15:39:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:42.081 15:39:40 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:10:42.081 15:39:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:42.081 15:39:40 -- common/autotest_common.sh@10 -- # set +x 00:10:42.081 [2024-04-26 15:39:40.547686] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:10:42.081 15:39:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:42.081 15:39:40 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:10:42.081 15:39:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:42.081 15:39:40 -- common/autotest_common.sh@10 -- # set +x 00:10:42.081 15:39:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:42.081 15:39:40 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 4420 00:10:42.081 00:10:42.081 Discovery Log Number of Records 2, Generation counter 2 00:10:42.081 =====Discovery Log Entry 0====== 00:10:42.081 trtype: rdma 00:10:42.081 adrfam: ipv4 00:10:42.081 subtype: current discovery subsystem 00:10:42.081 treq: not required 00:10:42.081 portid: 0 00:10:42.081 trsvcid: 4420 00:10:42.081 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:10:42.081 traddr: 192.168.100.8 00:10:42.081 eflags: explicit discovery connections, duplicate discovery information 00:10:42.081 rdma_prtype: not specified 00:10:42.081 rdma_qptype: connected 00:10:42.081 rdma_cms: rdma-cm 00:10:42.081 rdma_pkey: 0x0000 00:10:42.081 =====Discovery Log Entry 1====== 00:10:42.081 trtype: rdma 00:10:42.081 adrfam: ipv4 00:10:42.081 subtype: nvme subsystem 00:10:42.081 treq: not required 00:10:42.081 portid: 0 00:10:42.081 trsvcid: 4420 00:10:42.081 subnqn: nqn.2016-06.io.spdk:cnode1 00:10:42.081 traddr: 192.168.100.8 00:10:42.081 eflags: none 00:10:42.081 rdma_prtype: not specified 00:10:42.081 rdma_qptype: connected 00:10:42.081 rdma_cms: rdma-cm 00:10:42.081 rdma_pkey: 0x0000 00:10:42.081 15:39:40 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:10:42.081 15:39:40 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:10:42.081 15:39:40 -- nvmf/common.sh@511 -- # local dev _ 00:10:42.081 15:39:40 -- nvmf/common.sh@513 -- # read -r dev _ 00:10:42.081 15:39:40 -- nvmf/common.sh@510 -- # nvme list 00:10:42.081 15:39:40 -- nvmf/common.sh@514 -- # [[ Node == /dev/nvme* ]] 00:10:42.081 15:39:40 -- nvmf/common.sh@513 -- # read -r dev _ 00:10:42.081 15:39:40 -- nvmf/common.sh@514 -- # [[ --------------------- == /dev/nvme* ]] 00:10:42.081 15:39:40 -- nvmf/common.sh@513 -- # read -r dev _ 00:10:42.081 15:39:40 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:10:42.081 15:39:40 -- target/nvme_cli.sh@32 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:10:43.456 15:39:41 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:10:43.456 15:39:41 -- common/autotest_common.sh@1184 -- # local i=0 00:10:43.456 15:39:41 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:10:43.456 15:39:41 -- common/autotest_common.sh@1186 -- # [[ -n 2 ]] 00:10:43.456 15:39:41 -- common/autotest_common.sh@1187 -- # nvme_device_counter=2 00:10:43.456 15:39:41 -- common/autotest_common.sh@1191 -- # sleep 2 00:10:45.371 15:39:43 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:10:45.371 15:39:43 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:10:45.371 15:39:43 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:10:45.371 15:39:43 -- common/autotest_common.sh@1193 -- # nvme_devices=2 00:10:45.371 15:39:43 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:10:45.371 15:39:43 -- common/autotest_common.sh@1194 -- # return 0 00:10:45.371 15:39:43 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:10:45.371 15:39:43 -- nvmf/common.sh@511 -- # local dev _ 00:10:45.371 15:39:43 -- nvmf/common.sh@513 -- # read -r dev _ 00:10:45.371 15:39:43 -- nvmf/common.sh@510 -- # nvme list 00:10:45.371 15:39:43 -- nvmf/common.sh@514 -- # [[ Node == /dev/nvme* ]] 00:10:45.371 15:39:43 -- nvmf/common.sh@513 -- # read -r dev _ 00:10:45.371 15:39:43 -- nvmf/common.sh@514 -- # [[ --------------------- == /dev/nvme* ]] 00:10:45.371 15:39:43 -- nvmf/common.sh@513 -- # read -r dev _ 00:10:45.371 15:39:43 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:10:45.371 15:39:43 -- nvmf/common.sh@515 -- # echo /dev/nvme0n2 00:10:45.371 15:39:43 -- nvmf/common.sh@513 -- # read -r dev _ 00:10:45.371 15:39:43 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:10:45.371 15:39:43 -- nvmf/common.sh@515 -- # echo /dev/nvme0n1 00:10:45.371 15:39:43 -- nvmf/common.sh@513 -- # read -r dev _ 00:10:45.371 15:39:43 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n2 00:10:45.371 /dev/nvme0n1 ]] 00:10:45.371 15:39:43 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:10:45.371 15:39:43 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:10:45.371 15:39:43 -- nvmf/common.sh@511 -- # local dev _ 00:10:45.371 15:39:43 -- nvmf/common.sh@513 -- # read -r dev _ 00:10:45.371 15:39:43 -- nvmf/common.sh@510 -- # nvme list 00:10:45.371 15:39:43 -- nvmf/common.sh@514 -- # [[ Node == /dev/nvme* ]] 00:10:45.371 15:39:43 -- nvmf/common.sh@513 -- # read -r dev _ 00:10:45.371 15:39:43 -- nvmf/common.sh@514 -- # [[ --------------------- == /dev/nvme* ]] 00:10:45.371 15:39:43 -- nvmf/common.sh@513 -- # read -r dev _ 00:10:45.371 15:39:43 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:10:45.371 15:39:43 -- nvmf/common.sh@515 -- # echo /dev/nvme0n2 00:10:45.371 15:39:43 -- nvmf/common.sh@513 -- # read -r dev _ 00:10:45.371 15:39:43 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:10:45.371 15:39:43 -- nvmf/common.sh@515 -- # echo /dev/nvme0n1 00:10:45.371 15:39:43 -- nvmf/common.sh@513 -- # read -r dev _ 00:10:45.371 15:39:43 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:10:45.371 15:39:43 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:10:46.306 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:46.306 15:39:44 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:10:46.306 15:39:44 -- common/autotest_common.sh@1205 -- # local i=0 00:10:46.306 15:39:44 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:10:46.306 15:39:44 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:10:46.306 15:39:44 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:10:46.306 15:39:44 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:10:46.306 15:39:44 -- common/autotest_common.sh@1217 -- # return 0 00:10:46.306 15:39:44 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:10:46.306 15:39:44 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:10:46.306 15:39:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:46.306 15:39:44 -- common/autotest_common.sh@10 -- # set +x 00:10:46.306 15:39:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:46.306 15:39:44 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:10:46.306 15:39:44 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:10:46.306 15:39:44 -- nvmf/common.sh@477 -- # nvmfcleanup 00:10:46.306 15:39:44 -- nvmf/common.sh@117 -- # sync 00:10:46.306 15:39:44 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:10:46.306 15:39:44 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:10:46.306 15:39:44 -- nvmf/common.sh@120 -- # set +e 00:10:46.306 15:39:44 -- nvmf/common.sh@121 -- # for i in {1..20} 00:10:46.306 15:39:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:10:46.306 rmmod nvme_rdma 00:10:46.306 rmmod nvme_fabrics 00:10:46.307 15:39:44 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:10:46.307 15:39:44 -- nvmf/common.sh@124 -- # set -e 00:10:46.307 15:39:44 -- nvmf/common.sh@125 -- # return 0 00:10:46.307 15:39:44 -- nvmf/common.sh@478 -- # '[' -n 3257094 ']' 00:10:46.307 15:39:44 -- nvmf/common.sh@479 -- # killprocess 3257094 00:10:46.307 15:39:44 -- common/autotest_common.sh@936 -- # '[' -z 3257094 ']' 00:10:46.307 15:39:44 -- common/autotest_common.sh@940 -- # kill -0 3257094 00:10:46.307 15:39:44 -- common/autotest_common.sh@941 -- # uname 00:10:46.307 15:39:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:10:46.307 15:39:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3257094 00:10:46.307 15:39:44 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:10:46.307 15:39:44 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:10:46.307 15:39:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3257094' 00:10:46.307 killing process with pid 3257094 00:10:46.307 15:39:44 -- common/autotest_common.sh@955 -- # kill 3257094 00:10:46.307 15:39:44 -- common/autotest_common.sh@960 -- # wait 3257094 00:10:46.307 [2024-04-26 15:39:44.902389] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:10:46.565 15:39:45 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:10:46.565 15:39:45 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:10:46.565 00:10:46.565 real 0m11.002s 00:10:46.565 user 0m23.431s 00:10:46.565 sys 0m4.450s 00:10:46.565 15:39:45 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:10:46.565 15:39:45 -- common/autotest_common.sh@10 -- # set +x 00:10:46.565 ************************************ 00:10:46.565 END TEST nvmf_nvme_cli 00:10:46.565 ************************************ 00:10:46.824 15:39:45 -- nvmf/nvmf.sh@40 -- # [[ 0 -eq 1 ]] 00:10:46.824 15:39:45 -- nvmf/nvmf.sh@47 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=rdma 00:10:46.824 15:39:45 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:10:46.824 15:39:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:10:46.824 15:39:45 -- common/autotest_common.sh@10 -- # set +x 00:10:46.824 ************************************ 00:10:46.824 START TEST nvmf_host_management 00:10:46.824 ************************************ 00:10:46.824 15:39:45 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=rdma 00:10:46.824 * Looking for test storage... 00:10:46.824 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:10:46.824 15:39:45 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:10:46.824 15:39:45 -- nvmf/common.sh@7 -- # uname -s 00:10:46.824 15:39:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:10:46.824 15:39:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:10:46.824 15:39:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:10:46.824 15:39:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:10:46.824 15:39:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:10:46.824 15:39:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:10:46.824 15:39:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:10:46.824 15:39:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:10:46.824 15:39:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:10:46.824 15:39:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:10:46.824 15:39:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:10:46.824 15:39:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:10:46.824 15:39:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:10:46.824 15:39:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:10:46.824 15:39:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:10:46.824 15:39:45 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:10:46.824 15:39:45 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:10:46.824 15:39:45 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:10:46.824 15:39:45 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:10:46.824 15:39:45 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:10:46.824 15:39:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:46.824 15:39:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:46.824 15:39:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:46.824 15:39:45 -- paths/export.sh@5 -- # export PATH 00:10:46.824 15:39:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:46.824 15:39:45 -- nvmf/common.sh@47 -- # : 0 00:10:46.824 15:39:45 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:10:46.824 15:39:45 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:10:46.824 15:39:45 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:10:46.824 15:39:45 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:10:46.824 15:39:45 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:10:46.824 15:39:45 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:10:46.824 15:39:45 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:10:46.824 15:39:45 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:10:46.824 15:39:45 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:10:46.824 15:39:45 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:10:46.824 15:39:45 -- target/host_management.sh@105 -- # nvmftestinit 00:10:46.824 15:39:45 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:10:46.824 15:39:45 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:10:46.824 15:39:45 -- nvmf/common.sh@437 -- # prepare_net_devs 00:10:46.824 15:39:45 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:10:46.824 15:39:45 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:10:46.824 15:39:45 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:46.824 15:39:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:10:46.824 15:39:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:47.083 15:39:45 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:10:47.083 15:39:45 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:10:47.083 15:39:45 -- nvmf/common.sh@285 -- # xtrace_disable 00:10:47.083 15:39:45 -- common/autotest_common.sh@10 -- # set +x 00:10:52.354 15:39:50 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:10:52.354 15:39:50 -- nvmf/common.sh@291 -- # pci_devs=() 00:10:52.354 15:39:50 -- nvmf/common.sh@291 -- # local -a pci_devs 00:10:52.354 15:39:50 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:10:52.354 15:39:50 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:10:52.354 15:39:50 -- nvmf/common.sh@293 -- # pci_drivers=() 00:10:52.354 15:39:50 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:10:52.354 15:39:50 -- nvmf/common.sh@295 -- # net_devs=() 00:10:52.354 15:39:50 -- nvmf/common.sh@295 -- # local -ga net_devs 00:10:52.354 15:39:50 -- nvmf/common.sh@296 -- # e810=() 00:10:52.354 15:39:50 -- nvmf/common.sh@296 -- # local -ga e810 00:10:52.354 15:39:50 -- nvmf/common.sh@297 -- # x722=() 00:10:52.354 15:39:50 -- nvmf/common.sh@297 -- # local -ga x722 00:10:52.354 15:39:50 -- nvmf/common.sh@298 -- # mlx=() 00:10:52.354 15:39:50 -- nvmf/common.sh@298 -- # local -ga mlx 00:10:52.354 15:39:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:10:52.354 15:39:50 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:10:52.354 15:39:50 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:10:52.354 15:39:50 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:10:52.354 15:39:50 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:10:52.354 15:39:50 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:10:52.354 15:39:50 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:10:52.354 15:39:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:10:52.354 15:39:50 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:10:52.354 15:39:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:10:52.354 15:39:50 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:10:52.354 15:39:50 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:10:52.354 15:39:50 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:10:52.354 15:39:50 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:10:52.354 15:39:50 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:10:52.354 15:39:50 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:10:52.354 15:39:50 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:10:52.354 15:39:50 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:10:52.354 15:39:50 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:10:52.354 15:39:50 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:10:52.354 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:10:52.354 15:39:50 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:10:52.354 15:39:50 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:10:52.354 15:39:50 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:10:52.354 15:39:50 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:10:52.354 15:39:50 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:10:52.354 15:39:50 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:10:52.354 15:39:50 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:10:52.354 15:39:50 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:10:52.354 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:10:52.354 15:39:50 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:10:52.354 15:39:50 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:10:52.354 15:39:50 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:10:52.354 15:39:50 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:10:52.354 15:39:50 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:10:52.354 15:39:50 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:10:52.354 15:39:50 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:10:52.354 15:39:50 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:10:52.354 15:39:50 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:10:52.354 15:39:50 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:52.354 15:39:50 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:10:52.354 15:39:50 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:52.354 15:39:50 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:10:52.354 Found net devices under 0000:da:00.0: mlx_0_0 00:10:52.354 15:39:50 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:10:52.354 15:39:50 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:10:52.354 15:39:50 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:52.354 15:39:50 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:10:52.354 15:39:50 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:52.354 15:39:50 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:10:52.354 Found net devices under 0000:da:00.1: mlx_0_1 00:10:52.354 15:39:50 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:10:52.354 15:39:50 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:10:52.354 15:39:50 -- nvmf/common.sh@403 -- # is_hw=yes 00:10:52.354 15:39:50 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:10:52.354 15:39:50 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:10:52.354 15:39:50 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:10:52.354 15:39:50 -- nvmf/common.sh@409 -- # rdma_device_init 00:10:52.354 15:39:50 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:10:52.354 15:39:50 -- nvmf/common.sh@58 -- # uname 00:10:52.354 15:39:50 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:10:52.354 15:39:50 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:10:52.354 15:39:50 -- nvmf/common.sh@63 -- # modprobe ib_core 00:10:52.354 15:39:50 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:10:52.354 15:39:50 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:10:52.354 15:39:50 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:10:52.354 15:39:50 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:10:52.354 15:39:50 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:10:52.354 15:39:50 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:10:52.354 15:39:50 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:10:52.354 15:39:50 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:10:52.354 15:39:50 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:10:52.354 15:39:50 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:10:52.354 15:39:50 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:10:52.354 15:39:50 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:10:52.354 15:39:50 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:10:52.354 15:39:50 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:52.354 15:39:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:52.354 15:39:50 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:10:52.354 15:39:50 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:10:52.354 15:39:50 -- nvmf/common.sh@105 -- # continue 2 00:10:52.354 15:39:50 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:52.354 15:39:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:52.354 15:39:50 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:10:52.354 15:39:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:52.354 15:39:50 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:10:52.354 15:39:50 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:10:52.354 15:39:50 -- nvmf/common.sh@105 -- # continue 2 00:10:52.354 15:39:50 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:10:52.354 15:39:50 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:10:52.354 15:39:50 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:10:52.354 15:39:50 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:10:52.354 15:39:50 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:52.354 15:39:50 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:52.354 15:39:50 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:10:52.354 15:39:50 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:10:52.354 15:39:50 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:10:52.354 118: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:10:52.354 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:10:52.354 altname enp218s0f0np0 00:10:52.354 altname ens818f0np0 00:10:52.354 inet 192.168.100.8/24 scope global mlx_0_0 00:10:52.354 valid_lft forever preferred_lft forever 00:10:52.354 15:39:50 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:10:52.354 15:39:50 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:10:52.354 15:39:50 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:10:52.354 15:39:50 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:10:52.354 15:39:50 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:52.354 15:39:50 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:52.354 15:39:50 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:10:52.354 15:39:50 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:10:52.354 15:39:50 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:10:52.354 119: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:10:52.354 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:10:52.354 altname enp218s0f1np1 00:10:52.354 altname ens818f1np1 00:10:52.354 inet 192.168.100.9/24 scope global mlx_0_1 00:10:52.354 valid_lft forever preferred_lft forever 00:10:52.354 15:39:50 -- nvmf/common.sh@411 -- # return 0 00:10:52.354 15:39:50 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:10:52.354 15:39:50 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:10:52.354 15:39:50 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:10:52.354 15:39:50 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:10:52.354 15:39:50 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:10:52.354 15:39:50 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:10:52.354 15:39:50 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:10:52.354 15:39:50 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:10:52.354 15:39:50 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:10:52.354 15:39:50 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:10:52.354 15:39:50 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:52.354 15:39:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:52.354 15:39:50 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:10:52.354 15:39:50 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:10:52.354 15:39:50 -- nvmf/common.sh@105 -- # continue 2 00:10:52.354 15:39:50 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:52.354 15:39:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:52.354 15:39:50 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:10:52.354 15:39:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:52.354 15:39:50 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:10:52.354 15:39:50 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:10:52.354 15:39:50 -- nvmf/common.sh@105 -- # continue 2 00:10:52.354 15:39:50 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:10:52.354 15:39:50 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:10:52.354 15:39:50 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:10:52.354 15:39:50 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:10:52.354 15:39:50 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:52.354 15:39:50 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:52.354 15:39:50 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:10:52.354 15:39:50 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:10:52.354 15:39:50 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:10:52.354 15:39:50 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:10:52.354 15:39:50 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:52.354 15:39:50 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:52.354 15:39:50 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:10:52.354 192.168.100.9' 00:10:52.354 15:39:50 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:10:52.354 192.168.100.9' 00:10:52.354 15:39:50 -- nvmf/common.sh@446 -- # head -n 1 00:10:52.354 15:39:50 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:10:52.354 15:39:50 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:10:52.354 192.168.100.9' 00:10:52.354 15:39:50 -- nvmf/common.sh@447 -- # tail -n +2 00:10:52.354 15:39:50 -- nvmf/common.sh@447 -- # head -n 1 00:10:52.354 15:39:50 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:10:52.354 15:39:50 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:10:52.354 15:39:50 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:10:52.354 15:39:50 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:10:52.354 15:39:50 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:10:52.354 15:39:50 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:10:52.354 15:39:50 -- target/host_management.sh@107 -- # run_test nvmf_host_management nvmf_host_management 00:10:52.354 15:39:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:10:52.354 15:39:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:10:52.354 15:39:50 -- common/autotest_common.sh@10 -- # set +x 00:10:52.354 ************************************ 00:10:52.354 START TEST nvmf_host_management 00:10:52.354 ************************************ 00:10:52.354 15:39:50 -- common/autotest_common.sh@1111 -- # nvmf_host_management 00:10:52.354 15:39:50 -- target/host_management.sh@69 -- # starttarget 00:10:52.354 15:39:50 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:10:52.354 15:39:50 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:10:52.354 15:39:50 -- common/autotest_common.sh@710 -- # xtrace_disable 00:10:52.354 15:39:50 -- common/autotest_common.sh@10 -- # set +x 00:10:52.354 15:39:50 -- nvmf/common.sh@470 -- # nvmfpid=3261132 00:10:52.354 15:39:50 -- nvmf/common.sh@471 -- # waitforlisten 3261132 00:10:52.354 15:39:50 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:10:52.354 15:39:50 -- common/autotest_common.sh@817 -- # '[' -z 3261132 ']' 00:10:52.354 15:39:50 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:10:52.354 15:39:50 -- common/autotest_common.sh@822 -- # local max_retries=100 00:10:52.354 15:39:50 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:10:52.354 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:10:52.354 15:39:50 -- common/autotest_common.sh@826 -- # xtrace_disable 00:10:52.354 15:39:50 -- common/autotest_common.sh@10 -- # set +x 00:10:52.354 [2024-04-26 15:39:50.440475] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:10:52.354 [2024-04-26 15:39:50.440514] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:10:52.354 EAL: No free 2048 kB hugepages reported on node 1 00:10:52.354 [2024-04-26 15:39:50.496267] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:10:52.354 [2024-04-26 15:39:50.567799] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:10:52.354 [2024-04-26 15:39:50.567840] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:10:52.354 [2024-04-26 15:39:50.567847] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:10:52.354 [2024-04-26 15:39:50.567852] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:10:52.354 [2024-04-26 15:39:50.567857] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:10:52.354 [2024-04-26 15:39:50.567955] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:10:52.354 [2024-04-26 15:39:50.568022] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:10:52.354 [2024-04-26 15:39:50.568066] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:10:52.354 [2024-04-26 15:39:50.568067] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:10:52.922 15:39:51 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:10:52.922 15:39:51 -- common/autotest_common.sh@850 -- # return 0 00:10:52.922 15:39:51 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:10:52.922 15:39:51 -- common/autotest_common.sh@716 -- # xtrace_disable 00:10:52.922 15:39:51 -- common/autotest_common.sh@10 -- # set +x 00:10:52.922 15:39:51 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:10:52.922 15:39:51 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:10:52.922 15:39:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:52.922 15:39:51 -- common/autotest_common.sh@10 -- # set +x 00:10:52.922 [2024-04-26 15:39:51.311790] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x147b3f0/0x147f8e0) succeed. 00:10:52.922 [2024-04-26 15:39:51.323528] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x147ca30/0x14c0f70) succeed. 00:10:52.922 15:39:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:52.922 15:39:51 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:10:52.922 15:39:51 -- common/autotest_common.sh@710 -- # xtrace_disable 00:10:52.922 15:39:51 -- common/autotest_common.sh@10 -- # set +x 00:10:52.922 15:39:51 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:10:52.922 15:39:51 -- target/host_management.sh@23 -- # cat 00:10:52.922 15:39:51 -- target/host_management.sh@30 -- # rpc_cmd 00:10:52.922 15:39:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:52.922 15:39:51 -- common/autotest_common.sh@10 -- # set +x 00:10:52.922 Malloc0 00:10:52.922 [2024-04-26 15:39:51.498052] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:10:52.922 15:39:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:52.922 15:39:51 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:10:52.922 15:39:51 -- common/autotest_common.sh@716 -- # xtrace_disable 00:10:52.922 15:39:51 -- common/autotest_common.sh@10 -- # set +x 00:10:53.180 15:39:51 -- target/host_management.sh@73 -- # perfpid=3261256 00:10:53.180 15:39:51 -- target/host_management.sh@74 -- # waitforlisten 3261256 /var/tmp/bdevperf.sock 00:10:53.180 15:39:51 -- common/autotest_common.sh@817 -- # '[' -z 3261256 ']' 00:10:53.180 15:39:51 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:10:53.180 15:39:51 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:10:53.180 15:39:51 -- common/autotest_common.sh@822 -- # local max_retries=100 00:10:53.180 15:39:51 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:10:53.180 15:39:51 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:10:53.181 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:10:53.181 15:39:51 -- nvmf/common.sh@521 -- # config=() 00:10:53.181 15:39:51 -- common/autotest_common.sh@826 -- # xtrace_disable 00:10:53.181 15:39:51 -- nvmf/common.sh@521 -- # local subsystem config 00:10:53.181 15:39:51 -- common/autotest_common.sh@10 -- # set +x 00:10:53.181 15:39:51 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:10:53.181 15:39:51 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:10:53.181 { 00:10:53.181 "params": { 00:10:53.181 "name": "Nvme$subsystem", 00:10:53.181 "trtype": "$TEST_TRANSPORT", 00:10:53.181 "traddr": "$NVMF_FIRST_TARGET_IP", 00:10:53.181 "adrfam": "ipv4", 00:10:53.181 "trsvcid": "$NVMF_PORT", 00:10:53.181 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:10:53.181 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:10:53.181 "hdgst": ${hdgst:-false}, 00:10:53.181 "ddgst": ${ddgst:-false} 00:10:53.181 }, 00:10:53.181 "method": "bdev_nvme_attach_controller" 00:10:53.181 } 00:10:53.181 EOF 00:10:53.181 )") 00:10:53.181 15:39:51 -- nvmf/common.sh@543 -- # cat 00:10:53.181 15:39:51 -- nvmf/common.sh@545 -- # jq . 00:10:53.181 15:39:51 -- nvmf/common.sh@546 -- # IFS=, 00:10:53.181 15:39:51 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:10:53.181 "params": { 00:10:53.181 "name": "Nvme0", 00:10:53.181 "trtype": "rdma", 00:10:53.181 "traddr": "192.168.100.8", 00:10:53.181 "adrfam": "ipv4", 00:10:53.181 "trsvcid": "4420", 00:10:53.181 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:10:53.181 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:10:53.181 "hdgst": false, 00:10:53.181 "ddgst": false 00:10:53.181 }, 00:10:53.181 "method": "bdev_nvme_attach_controller" 00:10:53.181 }' 00:10:53.181 [2024-04-26 15:39:51.588803] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:10:53.181 [2024-04-26 15:39:51.588851] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3261256 ] 00:10:53.181 EAL: No free 2048 kB hugepages reported on node 1 00:10:53.181 [2024-04-26 15:39:51.646053] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:10:53.181 [2024-04-26 15:39:51.717838] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:10:53.438 Running I/O for 10 seconds... 00:10:54.006 15:39:52 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:10:54.006 15:39:52 -- common/autotest_common.sh@850 -- # return 0 00:10:54.006 15:39:52 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:10:54.006 15:39:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:54.006 15:39:52 -- common/autotest_common.sh@10 -- # set +x 00:10:54.006 15:39:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:54.006 15:39:52 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:10:54.006 15:39:52 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:10:54.006 15:39:52 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:10:54.006 15:39:52 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:10:54.006 15:39:52 -- target/host_management.sh@52 -- # local ret=1 00:10:54.006 15:39:52 -- target/host_management.sh@53 -- # local i 00:10:54.006 15:39:52 -- target/host_management.sh@54 -- # (( i = 10 )) 00:10:54.006 15:39:52 -- target/host_management.sh@54 -- # (( i != 0 )) 00:10:54.006 15:39:52 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:10:54.006 15:39:52 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:10:54.006 15:39:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:54.006 15:39:52 -- common/autotest_common.sh@10 -- # set +x 00:10:54.006 15:39:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:54.006 15:39:52 -- target/host_management.sh@55 -- # read_io_count=1580 00:10:54.006 15:39:52 -- target/host_management.sh@58 -- # '[' 1580 -ge 100 ']' 00:10:54.006 15:39:52 -- target/host_management.sh@59 -- # ret=0 00:10:54.006 15:39:52 -- target/host_management.sh@60 -- # break 00:10:54.006 15:39:52 -- target/host_management.sh@64 -- # return 0 00:10:54.006 15:39:52 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:10:54.006 15:39:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:54.006 15:39:52 -- common/autotest_common.sh@10 -- # set +x 00:10:54.006 15:39:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:54.006 15:39:52 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:10:54.006 15:39:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:10:54.006 15:39:52 -- common/autotest_common.sh@10 -- # set +x 00:10:54.006 15:39:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:10:54.006 15:39:52 -- target/host_management.sh@87 -- # sleep 1 00:10:54.940 [2024-04-26 15:39:53.488176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:90112 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000138da900 len:0x10000 key:0x182500 00:10:54.940 [2024-04-26 15:39:53.488211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.940 [2024-04-26 15:39:53.488227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:90240 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000138ca880 len:0x10000 key:0x182500 00:10:54.940 [2024-04-26 15:39:53.488235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.940 [2024-04-26 15:39:53.488244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:90368 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000138ba800 len:0x10000 key:0x182500 00:10:54.940 [2024-04-26 15:39:53.488251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.940 [2024-04-26 15:39:53.488259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:90496 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000138aa780 len:0x10000 key:0x182500 00:10:54.940 [2024-04-26 15:39:53.488269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.940 [2024-04-26 15:39:53.488277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:90624 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001389a700 len:0x10000 key:0x182500 00:10:54.940 [2024-04-26 15:39:53.488284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.940 [2024-04-26 15:39:53.488292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:90752 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001388a680 len:0x10000 key:0x182500 00:10:54.940 [2024-04-26 15:39:53.488298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.940 [2024-04-26 15:39:53.488306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:90880 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001387a600 len:0x10000 key:0x182500 00:10:54.940 [2024-04-26 15:39:53.488312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.940 [2024-04-26 15:39:53.488320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:91008 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001386a580 len:0x10000 key:0x182500 00:10:54.940 [2024-04-26 15:39:53.488327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.940 [2024-04-26 15:39:53.488335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:91136 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001385a500 len:0x10000 key:0x182500 00:10:54.940 [2024-04-26 15:39:53.488341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.940 [2024-04-26 15:39:53.488350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:91264 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001384a480 len:0x10000 key:0x182500 00:10:54.940 [2024-04-26 15:39:53.488357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.940 [2024-04-26 15:39:53.488365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:91392 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001383a400 len:0x10000 key:0x182500 00:10:54.940 [2024-04-26 15:39:53.488371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.940 [2024-04-26 15:39:53.488379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:91520 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001382a380 len:0x10000 key:0x182500 00:10:54.940 [2024-04-26 15:39:53.488385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.940 [2024-04-26 15:39:53.488393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:91648 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001381a300 len:0x10000 key:0x182500 00:10:54.940 [2024-04-26 15:39:53.488399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.940 [2024-04-26 15:39:53.488407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:91776 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001380a280 len:0x10000 key:0x182500 00:10:54.940 [2024-04-26 15:39:53.488413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.940 [2024-04-26 15:39:53.488421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:91904 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000192d1e80 len:0x10000 key:0x182800 00:10:54.940 [2024-04-26 15:39:53.488428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.940 [2024-04-26 15:39:53.488436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:92032 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000192c1e00 len:0x10000 key:0x182800 00:10:54.940 [2024-04-26 15:39:53.488443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.940 [2024-04-26 15:39:53.488450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:92160 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000192b1d80 len:0x10000 key:0x182800 00:10:54.940 [2024-04-26 15:39:53.488457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.940 [2024-04-26 15:39:53.488465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:92288 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000192a1d00 len:0x10000 key:0x182800 00:10:54.940 [2024-04-26 15:39:53.488471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.940 [2024-04-26 15:39:53.488479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:92416 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019291c80 len:0x10000 key:0x182800 00:10:54.940 [2024-04-26 15:39:53.488485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.940 [2024-04-26 15:39:53.488493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:92544 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019281c00 len:0x10000 key:0x182800 00:10:54.940 [2024-04-26 15:39:53.488500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.940 [2024-04-26 15:39:53.488507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:92672 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019271b80 len:0x10000 key:0x182800 00:10:54.940 [2024-04-26 15:39:53.488514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.940 [2024-04-26 15:39:53.488521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:92800 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019261b00 len:0x10000 key:0x182800 00:10:54.940 [2024-04-26 15:39:53.488528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.940 [2024-04-26 15:39:53.488536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:92928 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019251a80 len:0x10000 key:0x182800 00:10:54.940 [2024-04-26 15:39:53.488542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.940 [2024-04-26 15:39:53.488550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:93056 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019241a00 len:0x10000 key:0x182800 00:10:54.940 [2024-04-26 15:39:53.488556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.940 [2024-04-26 15:39:53.488564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:93184 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019231980 len:0x10000 key:0x182800 00:10:54.940 [2024-04-26 15:39:53.488570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.940 [2024-04-26 15:39:53.488578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:93312 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019221900 len:0x10000 key:0x182800 00:10:54.940 [2024-04-26 15:39:53.488586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.940 [2024-04-26 15:39:53.488594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:93440 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019211880 len:0x10000 key:0x182800 00:10:54.940 [2024-04-26 15:39:53.488600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.940 [2024-04-26 15:39:53.488608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:93568 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019201800 len:0x10000 key:0x182800 00:10:54.940 [2024-04-26 15:39:53.488614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.940 [2024-04-26 15:39:53.488622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:93696 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000190eff80 len:0x10000 key:0x182700 00:10:54.940 [2024-04-26 15:39:53.488629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.940 [2024-04-26 15:39:53.488637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:93824 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000190dff00 len:0x10000 key:0x182700 00:10:54.940 [2024-04-26 15:39:53.488643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.940 [2024-04-26 15:39:53.488651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:93952 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000190cfe80 len:0x10000 key:0x182700 00:10:54.940 [2024-04-26 15:39:53.488657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.940 [2024-04-26 15:39:53.488665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:94080 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000190bfe00 len:0x10000 key:0x182700 00:10:54.941 [2024-04-26 15:39:53.488671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.941 [2024-04-26 15:39:53.488679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:94208 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000190afd80 len:0x10000 key:0x182700 00:10:54.941 [2024-04-26 15:39:53.488686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.941 [2024-04-26 15:39:53.488693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:94336 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001909fd00 len:0x10000 key:0x182700 00:10:54.941 [2024-04-26 15:39:53.488700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.941 [2024-04-26 15:39:53.488708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:94464 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001908fc80 len:0x10000 key:0x182700 00:10:54.941 [2024-04-26 15:39:53.488714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.941 [2024-04-26 15:39:53.488721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:94592 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001907fc00 len:0x10000 key:0x182700 00:10:54.941 [2024-04-26 15:39:53.488728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.941 [2024-04-26 15:39:53.488736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:94720 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001906fb80 len:0x10000 key:0x182700 00:10:54.941 [2024-04-26 15:39:53.488744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.941 [2024-04-26 15:39:53.488751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:94848 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001905fb00 len:0x10000 key:0x182700 00:10:54.941 [2024-04-26 15:39:53.488757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.941 [2024-04-26 15:39:53.488765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:94976 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001904fa80 len:0x10000 key:0x182700 00:10:54.941 [2024-04-26 15:39:53.488772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.941 [2024-04-26 15:39:53.488779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:95104 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001903fa00 len:0x10000 key:0x182700 00:10:54.941 [2024-04-26 15:39:53.488786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.941 [2024-04-26 15:39:53.488793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:95232 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001902f980 len:0x10000 key:0x182700 00:10:54.941 [2024-04-26 15:39:53.488800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.941 [2024-04-26 15:39:53.488808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:87168 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d710000 len:0x10000 key:0x182400 00:10:54.941 [2024-04-26 15:39:53.488815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.941 [2024-04-26 15:39:53.488823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:87296 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d731000 len:0x10000 key:0x182400 00:10:54.941 [2024-04-26 15:39:53.488829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.941 [2024-04-26 15:39:53.488837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:87424 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d0e0000 len:0x10000 key:0x182400 00:10:54.941 [2024-04-26 15:39:53.488843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.941 [2024-04-26 15:39:53.488851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:87552 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d101000 len:0x10000 key:0x182400 00:10:54.941 [2024-04-26 15:39:53.488858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.941 [2024-04-26 15:39:53.488866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:87680 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000cab0000 len:0x10000 key:0x182400 00:10:54.941 [2024-04-26 15:39:53.488872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.941 [2024-04-26 15:39:53.488880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:87808 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000cad1000 len:0x10000 key:0x182400 00:10:54.941 [2024-04-26 15:39:53.488886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.941 [2024-04-26 15:39:53.488896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:87936 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000c480000 len:0x10000 key:0x182400 00:10:54.941 [2024-04-26 15:39:53.488903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.941 [2024-04-26 15:39:53.488912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:88064 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000c4a1000 len:0x10000 key:0x182400 00:10:54.941 [2024-04-26 15:39:53.488919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.941 [2024-04-26 15:39:53.488927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:88192 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000be50000 len:0x10000 key:0x182400 00:10:54.941 [2024-04-26 15:39:53.488933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.941 [2024-04-26 15:39:53.488941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:88320 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000deed000 len:0x10000 key:0x182400 00:10:54.941 [2024-04-26 15:39:53.488947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.941 [2024-04-26 15:39:53.488955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:88448 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000decc000 len:0x10000 key:0x182400 00:10:54.941 [2024-04-26 15:39:53.488962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.941 [2024-04-26 15:39:53.488970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:88576 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000deab000 len:0x10000 key:0x182400 00:10:54.941 [2024-04-26 15:39:53.488976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.941 [2024-04-26 15:39:53.488984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:88704 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000de8a000 len:0x10000 key:0x182400 00:10:54.941 [2024-04-26 15:39:53.488990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.941 [2024-04-26 15:39:53.488998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:88832 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000de69000 len:0x10000 key:0x182400 00:10:54.941 [2024-04-26 15:39:53.489004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.941 [2024-04-26 15:39:53.489012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:88960 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000de48000 len:0x10000 key:0x182400 00:10:54.941 [2024-04-26 15:39:53.489019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.941 [2024-04-26 15:39:53.489027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:89088 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000de27000 len:0x10000 key:0x182400 00:10:54.941 [2024-04-26 15:39:53.489033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.941 [2024-04-26 15:39:53.489042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:89216 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000de06000 len:0x10000 key:0x182400 00:10:54.941 [2024-04-26 15:39:53.489048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.941 [2024-04-26 15:39:53.489056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:89344 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000dde5000 len:0x10000 key:0x182400 00:10:54.941 [2024-04-26 15:39:53.489062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.941 [2024-04-26 15:39:53.489071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:89472 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000ddc4000 len:0x10000 key:0x182400 00:10:54.941 [2024-04-26 15:39:53.489078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.941 [2024-04-26 15:39:53.489085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:89600 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000dda3000 len:0x10000 key:0x182400 00:10:54.941 [2024-04-26 15:39:53.489092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.941 [2024-04-26 15:39:53.489100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:89728 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000dd82000 len:0x10000 key:0x182400 00:10:54.941 [2024-04-26 15:39:53.489106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.941 [2024-04-26 15:39:53.489114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:89856 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000dd61000 len:0x10000 key:0x182400 00:10:54.941 [2024-04-26 15:39:53.489120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.941 [2024-04-26 15:39:53.489129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:89984 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000dd40000 len:0x10000 key:0x182400 00:10:54.941 [2024-04-26 15:39:53.489136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:2c40 p:0 m:0 dnr:0 00:10:54.941 [2024-04-26 15:39:53.491067] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192015c0 was disconnected and freed. reset controller. 00:10:54.941 [2024-04-26 15:39:53.491958] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:10:54.941 task offset: 90112 on job bdev=Nvme0n1 fails 00:10:54.941 00:10:54.941 Latency(us) 00:10:54.941 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:10:54.941 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:10:54.941 Job: Nvme0n1 ended in about 1.59 seconds with error 00:10:54.941 Verification LBA range: start 0x0 length 0x400 00:10:54.941 Nvme0n1 : 1.59 1073.20 67.07 40.28 0.00 56961.85 2106.51 1014622.11 00:10:54.941 =================================================================================================================== 00:10:54.941 Total : 1073.20 67.07 40.28 0.00 56961.85 2106.51 1014622.11 00:10:54.942 [2024-04-26 15:39:53.493552] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:10:54.942 15:39:53 -- target/host_management.sh@91 -- # kill -9 3261256 00:10:54.942 15:39:53 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:10:54.942 15:39:53 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:10:54.942 15:39:53 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:10:54.942 15:39:53 -- nvmf/common.sh@521 -- # config=() 00:10:54.942 15:39:53 -- nvmf/common.sh@521 -- # local subsystem config 00:10:54.942 15:39:53 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:10:54.942 15:39:53 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:10:54.942 { 00:10:54.942 "params": { 00:10:54.942 "name": "Nvme$subsystem", 00:10:54.942 "trtype": "$TEST_TRANSPORT", 00:10:54.942 "traddr": "$NVMF_FIRST_TARGET_IP", 00:10:54.942 "adrfam": "ipv4", 00:10:54.942 "trsvcid": "$NVMF_PORT", 00:10:54.942 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:10:54.942 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:10:54.942 "hdgst": ${hdgst:-false}, 00:10:54.942 "ddgst": ${ddgst:-false} 00:10:54.942 }, 00:10:54.942 "method": "bdev_nvme_attach_controller" 00:10:54.942 } 00:10:54.942 EOF 00:10:54.942 )") 00:10:54.942 15:39:53 -- nvmf/common.sh@543 -- # cat 00:10:54.942 15:39:53 -- nvmf/common.sh@545 -- # jq . 00:10:54.942 15:39:53 -- nvmf/common.sh@546 -- # IFS=, 00:10:54.942 15:39:53 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:10:54.942 "params": { 00:10:54.942 "name": "Nvme0", 00:10:54.942 "trtype": "rdma", 00:10:54.942 "traddr": "192.168.100.8", 00:10:54.942 "adrfam": "ipv4", 00:10:54.942 "trsvcid": "4420", 00:10:54.942 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:10:54.942 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:10:54.942 "hdgst": false, 00:10:54.942 "ddgst": false 00:10:54.942 }, 00:10:54.942 "method": "bdev_nvme_attach_controller" 00:10:54.942 }' 00:10:55.200 [2024-04-26 15:39:53.543880] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:10:55.200 [2024-04-26 15:39:53.543927] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3261659 ] 00:10:55.200 EAL: No free 2048 kB hugepages reported on node 1 00:10:55.200 [2024-04-26 15:39:53.597657] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:10:55.200 [2024-04-26 15:39:53.668359] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:10:55.458 Running I/O for 1 seconds... 00:10:56.390 00:10:56.390 Latency(us) 00:10:56.390 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:10:56.390 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:10:56.390 Verification LBA range: start 0x0 length 0x400 00:10:56.390 Nvme0n1 : 1.01 3013.30 188.33 0.00 0.00 20813.01 760.69 42941.68 00:10:56.390 =================================================================================================================== 00:10:56.390 Total : 3013.30 188.33 0.00 0.00 20813.01 760.69 42941.68 00:10:56.647 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 68: 3261256 Killed $rootdir/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "0") -q 64 -o 65536 -w verify -t 10 "${NO_HUGE[@]}" 00:10:56.647 15:39:55 -- target/host_management.sh@102 -- # stoptarget 00:10:56.647 15:39:55 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:10:56.647 15:39:55 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:10:56.647 15:39:55 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:10:56.647 15:39:55 -- target/host_management.sh@40 -- # nvmftestfini 00:10:56.647 15:39:55 -- nvmf/common.sh@477 -- # nvmfcleanup 00:10:56.647 15:39:55 -- nvmf/common.sh@117 -- # sync 00:10:56.647 15:39:55 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:10:56.647 15:39:55 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:10:56.647 15:39:55 -- nvmf/common.sh@120 -- # set +e 00:10:56.647 15:39:55 -- nvmf/common.sh@121 -- # for i in {1..20} 00:10:56.647 15:39:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:10:56.647 rmmod nvme_rdma 00:10:56.647 rmmod nvme_fabrics 00:10:56.647 15:39:55 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:10:56.647 15:39:55 -- nvmf/common.sh@124 -- # set -e 00:10:56.647 15:39:55 -- nvmf/common.sh@125 -- # return 0 00:10:56.647 15:39:55 -- nvmf/common.sh@478 -- # '[' -n 3261132 ']' 00:10:56.647 15:39:55 -- nvmf/common.sh@479 -- # killprocess 3261132 00:10:56.647 15:39:55 -- common/autotest_common.sh@936 -- # '[' -z 3261132 ']' 00:10:56.647 15:39:55 -- common/autotest_common.sh@940 -- # kill -0 3261132 00:10:56.647 15:39:55 -- common/autotest_common.sh@941 -- # uname 00:10:56.647 15:39:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:10:56.647 15:39:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3261132 00:10:56.647 15:39:55 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:10:56.647 15:39:55 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:10:56.647 15:39:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3261132' 00:10:56.647 killing process with pid 3261132 00:10:56.647 15:39:55 -- common/autotest_common.sh@955 -- # kill 3261132 00:10:56.647 15:39:55 -- common/autotest_common.sh@960 -- # wait 3261132 00:10:56.906 [2024-04-26 15:39:55.258730] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:10:56.906 [2024-04-26 15:39:55.461920] app.c: 630:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:10:56.906 15:39:55 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:10:56.906 15:39:55 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:10:56.906 00:10:56.906 real 0m5.089s 00:10:56.906 user 0m22.935s 00:10:56.906 sys 0m0.818s 00:10:56.906 15:39:55 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:10:56.906 15:39:55 -- common/autotest_common.sh@10 -- # set +x 00:10:56.906 ************************************ 00:10:56.906 END TEST nvmf_host_management 00:10:56.906 ************************************ 00:10:57.165 15:39:55 -- target/host_management.sh@109 -- # trap - SIGINT SIGTERM EXIT 00:10:57.165 00:10:57.165 real 0m10.200s 00:10:57.165 user 0m24.212s 00:10:57.165 sys 0m4.681s 00:10:57.165 15:39:55 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:10:57.166 15:39:55 -- common/autotest_common.sh@10 -- # set +x 00:10:57.166 ************************************ 00:10:57.166 END TEST nvmf_host_management 00:10:57.166 ************************************ 00:10:57.166 15:39:55 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=rdma 00:10:57.166 15:39:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:10:57.166 15:39:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:10:57.166 15:39:55 -- common/autotest_common.sh@10 -- # set +x 00:10:57.166 ************************************ 00:10:57.166 START TEST nvmf_lvol 00:10:57.166 ************************************ 00:10:57.166 15:39:55 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=rdma 00:10:57.425 * Looking for test storage... 00:10:57.425 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:10:57.425 15:39:55 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:10:57.425 15:39:55 -- nvmf/common.sh@7 -- # uname -s 00:10:57.425 15:39:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:10:57.425 15:39:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:10:57.425 15:39:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:10:57.425 15:39:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:10:57.425 15:39:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:10:57.425 15:39:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:10:57.425 15:39:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:10:57.425 15:39:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:10:57.425 15:39:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:10:57.425 15:39:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:10:57.425 15:39:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:10:57.425 15:39:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:10:57.425 15:39:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:10:57.425 15:39:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:10:57.425 15:39:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:10:57.425 15:39:55 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:10:57.425 15:39:55 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:10:57.425 15:39:55 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:10:57.425 15:39:55 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:10:57.425 15:39:55 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:10:57.425 15:39:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:57.425 15:39:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:57.425 15:39:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:57.425 15:39:55 -- paths/export.sh@5 -- # export PATH 00:10:57.425 15:39:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:57.425 15:39:55 -- nvmf/common.sh@47 -- # : 0 00:10:57.425 15:39:55 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:10:57.425 15:39:55 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:10:57.425 15:39:55 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:10:57.425 15:39:55 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:10:57.425 15:39:55 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:10:57.425 15:39:55 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:10:57.425 15:39:55 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:10:57.425 15:39:55 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:10:57.425 15:39:55 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:10:57.425 15:39:55 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:10:57.425 15:39:55 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:10:57.425 15:39:55 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:10:57.425 15:39:55 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:10:57.425 15:39:55 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:10:57.425 15:39:55 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:10:57.425 15:39:55 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:10:57.425 15:39:55 -- nvmf/common.sh@437 -- # prepare_net_devs 00:10:57.425 15:39:55 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:10:57.425 15:39:55 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:10:57.425 15:39:55 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:57.425 15:39:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:10:57.425 15:39:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:57.425 15:39:55 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:10:57.425 15:39:55 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:10:57.425 15:39:55 -- nvmf/common.sh@285 -- # xtrace_disable 00:10:57.425 15:39:55 -- common/autotest_common.sh@10 -- # set +x 00:11:02.694 15:40:00 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:02.694 15:40:00 -- nvmf/common.sh@291 -- # pci_devs=() 00:11:02.694 15:40:00 -- nvmf/common.sh@291 -- # local -a pci_devs 00:11:02.694 15:40:00 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:11:02.694 15:40:00 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:11:02.694 15:40:00 -- nvmf/common.sh@293 -- # pci_drivers=() 00:11:02.694 15:40:00 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:11:02.694 15:40:00 -- nvmf/common.sh@295 -- # net_devs=() 00:11:02.694 15:40:00 -- nvmf/common.sh@295 -- # local -ga net_devs 00:11:02.694 15:40:00 -- nvmf/common.sh@296 -- # e810=() 00:11:02.694 15:40:00 -- nvmf/common.sh@296 -- # local -ga e810 00:11:02.694 15:40:00 -- nvmf/common.sh@297 -- # x722=() 00:11:02.694 15:40:00 -- nvmf/common.sh@297 -- # local -ga x722 00:11:02.694 15:40:00 -- nvmf/common.sh@298 -- # mlx=() 00:11:02.694 15:40:00 -- nvmf/common.sh@298 -- # local -ga mlx 00:11:02.694 15:40:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:02.694 15:40:00 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:02.694 15:40:00 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:02.694 15:40:00 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:02.694 15:40:00 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:02.694 15:40:00 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:02.694 15:40:00 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:02.694 15:40:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:02.694 15:40:00 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:02.694 15:40:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:02.694 15:40:00 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:02.694 15:40:00 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:11:02.694 15:40:00 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:11:02.694 15:40:00 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:11:02.694 15:40:00 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:11:02.694 15:40:00 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:11:02.694 15:40:00 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:11:02.694 15:40:00 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:11:02.694 15:40:00 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:11:02.694 15:40:00 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:11:02.694 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:11:02.694 15:40:00 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:11:02.694 15:40:00 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:11:02.694 15:40:00 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:11:02.694 15:40:00 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:11:02.694 15:40:00 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:11:02.694 15:40:00 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:11:02.694 15:40:00 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:11:02.694 15:40:00 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:11:02.694 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:11:02.694 15:40:00 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:11:02.694 15:40:00 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:11:02.694 15:40:00 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:11:02.694 15:40:00 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:11:02.694 15:40:00 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:11:02.694 15:40:00 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:11:02.694 15:40:00 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:11:02.694 15:40:00 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:11:02.694 15:40:00 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:11:02.694 15:40:00 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:02.694 15:40:00 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:11:02.694 15:40:00 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:02.694 15:40:00 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:11:02.694 Found net devices under 0000:da:00.0: mlx_0_0 00:11:02.694 15:40:00 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:11:02.694 15:40:00 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:11:02.694 15:40:00 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:02.694 15:40:00 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:11:02.695 15:40:00 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:02.695 15:40:00 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:11:02.695 Found net devices under 0000:da:00.1: mlx_0_1 00:11:02.695 15:40:00 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:11:02.695 15:40:00 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:11:02.695 15:40:00 -- nvmf/common.sh@403 -- # is_hw=yes 00:11:02.695 15:40:00 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:11:02.695 15:40:00 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:11:02.695 15:40:00 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:11:02.695 15:40:00 -- nvmf/common.sh@409 -- # rdma_device_init 00:11:02.695 15:40:00 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:11:02.695 15:40:00 -- nvmf/common.sh@58 -- # uname 00:11:02.695 15:40:00 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:11:02.695 15:40:00 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:11:02.695 15:40:00 -- nvmf/common.sh@63 -- # modprobe ib_core 00:11:02.695 15:40:00 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:11:02.695 15:40:00 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:11:02.695 15:40:00 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:11:02.695 15:40:00 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:11:02.695 15:40:00 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:11:02.695 15:40:00 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:11:02.695 15:40:00 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:11:02.695 15:40:00 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:11:02.695 15:40:00 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:11:02.695 15:40:00 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:11:02.695 15:40:00 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:11:02.695 15:40:00 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:11:02.695 15:40:00 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:11:02.695 15:40:00 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:02.695 15:40:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:02.695 15:40:00 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:11:02.695 15:40:00 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:11:02.695 15:40:00 -- nvmf/common.sh@105 -- # continue 2 00:11:02.695 15:40:00 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:02.695 15:40:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:02.695 15:40:00 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:11:02.695 15:40:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:02.695 15:40:00 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:11:02.695 15:40:00 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:11:02.695 15:40:00 -- nvmf/common.sh@105 -- # continue 2 00:11:02.695 15:40:00 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:11:02.695 15:40:00 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:11:02.695 15:40:00 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:11:02.695 15:40:00 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:11:02.695 15:40:00 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:02.695 15:40:00 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:02.695 15:40:00 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:11:02.695 15:40:00 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:11:02.695 15:40:00 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:11:02.695 118: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:11:02.695 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:11:02.695 altname enp218s0f0np0 00:11:02.695 altname ens818f0np0 00:11:02.695 inet 192.168.100.8/24 scope global mlx_0_0 00:11:02.695 valid_lft forever preferred_lft forever 00:11:02.695 15:40:00 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:11:02.695 15:40:00 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:11:02.695 15:40:00 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:11:02.695 15:40:00 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:11:02.695 15:40:00 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:02.695 15:40:00 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:02.695 15:40:00 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:11:02.695 15:40:00 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:11:02.695 15:40:00 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:11:02.695 119: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:11:02.695 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:11:02.695 altname enp218s0f1np1 00:11:02.695 altname ens818f1np1 00:11:02.695 inet 192.168.100.9/24 scope global mlx_0_1 00:11:02.695 valid_lft forever preferred_lft forever 00:11:02.695 15:40:00 -- nvmf/common.sh@411 -- # return 0 00:11:02.695 15:40:00 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:11:02.695 15:40:00 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:11:02.695 15:40:00 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:11:02.695 15:40:00 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:11:02.695 15:40:00 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:11:02.695 15:40:00 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:11:02.695 15:40:00 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:11:02.695 15:40:00 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:11:02.695 15:40:00 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:11:02.695 15:40:00 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:11:02.695 15:40:00 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:02.695 15:40:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:02.695 15:40:00 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:11:02.695 15:40:00 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:11:02.695 15:40:00 -- nvmf/common.sh@105 -- # continue 2 00:11:02.695 15:40:00 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:02.695 15:40:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:02.695 15:40:00 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:11:02.695 15:40:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:02.695 15:40:00 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:11:02.695 15:40:00 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:11:02.695 15:40:00 -- nvmf/common.sh@105 -- # continue 2 00:11:02.695 15:40:00 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:11:02.695 15:40:00 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:11:02.695 15:40:00 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:11:02.695 15:40:00 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:11:02.695 15:40:00 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:02.695 15:40:00 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:02.695 15:40:00 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:11:02.695 15:40:00 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:11:02.695 15:40:00 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:11:02.695 15:40:00 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:11:02.695 15:40:00 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:02.695 15:40:00 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:02.695 15:40:00 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:11:02.695 192.168.100.9' 00:11:02.695 15:40:00 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:11:02.695 192.168.100.9' 00:11:02.695 15:40:00 -- nvmf/common.sh@446 -- # head -n 1 00:11:02.695 15:40:00 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:11:02.695 15:40:00 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:11:02.695 192.168.100.9' 00:11:02.695 15:40:00 -- nvmf/common.sh@447 -- # head -n 1 00:11:02.695 15:40:00 -- nvmf/common.sh@447 -- # tail -n +2 00:11:02.695 15:40:00 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:11:02.695 15:40:00 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:11:02.695 15:40:00 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:11:02.695 15:40:00 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:11:02.695 15:40:00 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:11:02.695 15:40:00 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:11:02.695 15:40:00 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:11:02.695 15:40:00 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:11:02.695 15:40:00 -- common/autotest_common.sh@710 -- # xtrace_disable 00:11:02.695 15:40:00 -- common/autotest_common.sh@10 -- # set +x 00:11:02.695 15:40:00 -- nvmf/common.sh@470 -- # nvmfpid=3264982 00:11:02.695 15:40:00 -- nvmf/common.sh@471 -- # waitforlisten 3264982 00:11:02.695 15:40:00 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:11:02.695 15:40:00 -- common/autotest_common.sh@817 -- # '[' -z 3264982 ']' 00:11:02.695 15:40:00 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:02.695 15:40:00 -- common/autotest_common.sh@822 -- # local max_retries=100 00:11:02.695 15:40:00 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:02.695 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:02.695 15:40:00 -- common/autotest_common.sh@826 -- # xtrace_disable 00:11:02.695 15:40:00 -- common/autotest_common.sh@10 -- # set +x 00:11:02.695 [2024-04-26 15:40:00.946578] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:11:02.695 [2024-04-26 15:40:00.946625] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:02.695 EAL: No free 2048 kB hugepages reported on node 1 00:11:02.695 [2024-04-26 15:40:01.002999] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:11:02.695 [2024-04-26 15:40:01.079547] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:02.695 [2024-04-26 15:40:01.079587] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:02.695 [2024-04-26 15:40:01.079594] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:11:02.695 [2024-04-26 15:40:01.079600] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:11:02.695 [2024-04-26 15:40:01.079605] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:02.695 [2024-04-26 15:40:01.079660] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:02.695 [2024-04-26 15:40:01.079683] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:02.695 [2024-04-26 15:40:01.079684] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:03.261 15:40:01 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:11:03.261 15:40:01 -- common/autotest_common.sh@850 -- # return 0 00:11:03.261 15:40:01 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:11:03.261 15:40:01 -- common/autotest_common.sh@716 -- # xtrace_disable 00:11:03.261 15:40:01 -- common/autotest_common.sh@10 -- # set +x 00:11:03.261 15:40:01 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:03.261 15:40:01 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:11:03.520 [2024-04-26 15:40:01.957334] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x5f8620/0x5fcb10) succeed. 00:11:03.520 [2024-04-26 15:40:01.967284] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x5f9bc0/0x63e1a0) succeed. 00:11:03.520 15:40:02 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:11:03.779 15:40:02 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:11:03.779 15:40:02 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:11:04.037 15:40:02 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:11:04.037 15:40:02 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:11:04.037 15:40:02 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:11:04.295 15:40:02 -- target/nvmf_lvol.sh@29 -- # lvs=6a8e4459-a05a-4346-9db4-7ef4c6ebc81c 00:11:04.296 15:40:02 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 6a8e4459-a05a-4346-9db4-7ef4c6ebc81c lvol 20 00:11:04.554 15:40:03 -- target/nvmf_lvol.sh@32 -- # lvol=4a4020b2-c708-422e-92b1-7f4666ec56e3 00:11:04.554 15:40:03 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:11:04.813 15:40:03 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 4a4020b2-c708-422e-92b1-7f4666ec56e3 00:11:04.813 15:40:03 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:11:05.072 [2024-04-26 15:40:03.509876] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:11:05.072 15:40:03 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:11:05.330 15:40:03 -- target/nvmf_lvol.sh@42 -- # perf_pid=3265471 00:11:05.330 15:40:03 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:11:05.331 15:40:03 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:11:05.331 EAL: No free 2048 kB hugepages reported on node 1 00:11:06.263 15:40:04 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 4a4020b2-c708-422e-92b1-7f4666ec56e3 MY_SNAPSHOT 00:11:06.521 15:40:04 -- target/nvmf_lvol.sh@47 -- # snapshot=b9865efb-34d8-4013-9552-c5111cd86771 00:11:06.521 15:40:04 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 4a4020b2-c708-422e-92b1-7f4666ec56e3 30 00:11:06.521 15:40:05 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone b9865efb-34d8-4013-9552-c5111cd86771 MY_CLONE 00:11:06.779 15:40:05 -- target/nvmf_lvol.sh@49 -- # clone=1461abff-b579-432d-8ec5-d6c8211c7ac5 00:11:06.779 15:40:05 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 1461abff-b579-432d-8ec5-d6c8211c7ac5 00:11:07.036 15:40:05 -- target/nvmf_lvol.sh@53 -- # wait 3265471 00:11:17.025 Initializing NVMe Controllers 00:11:17.025 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode0 00:11:17.025 Controller IO queue size 128, less than required. 00:11:17.025 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:11:17.025 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:11:17.025 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:11:17.025 Initialization complete. Launching workers. 00:11:17.025 ======================================================== 00:11:17.025 Latency(us) 00:11:17.025 Device Information : IOPS MiB/s Average min max 00:11:17.025 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 16765.10 65.49 7637.33 2093.01 45238.70 00:11:17.025 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 16713.20 65.29 7660.42 2284.33 48250.80 00:11:17.025 ======================================================== 00:11:17.025 Total : 33478.29 130.77 7648.86 2093.01 48250.80 00:11:17.025 00:11:17.025 15:40:15 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:11:17.025 15:40:15 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 4a4020b2-c708-422e-92b1-7f4666ec56e3 00:11:17.025 15:40:15 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 6a8e4459-a05a-4346-9db4-7ef4c6ebc81c 00:11:17.284 15:40:15 -- target/nvmf_lvol.sh@60 -- # rm -f 00:11:17.284 15:40:15 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:11:17.284 15:40:15 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:11:17.284 15:40:15 -- nvmf/common.sh@477 -- # nvmfcleanup 00:11:17.284 15:40:15 -- nvmf/common.sh@117 -- # sync 00:11:17.284 15:40:15 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:11:17.284 15:40:15 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:11:17.284 15:40:15 -- nvmf/common.sh@120 -- # set +e 00:11:17.284 15:40:15 -- nvmf/common.sh@121 -- # for i in {1..20} 00:11:17.284 15:40:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:11:17.284 rmmod nvme_rdma 00:11:17.284 rmmod nvme_fabrics 00:11:17.284 15:40:15 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:11:17.284 15:40:15 -- nvmf/common.sh@124 -- # set -e 00:11:17.284 15:40:15 -- nvmf/common.sh@125 -- # return 0 00:11:17.284 15:40:15 -- nvmf/common.sh@478 -- # '[' -n 3264982 ']' 00:11:17.284 15:40:15 -- nvmf/common.sh@479 -- # killprocess 3264982 00:11:17.284 15:40:15 -- common/autotest_common.sh@936 -- # '[' -z 3264982 ']' 00:11:17.284 15:40:15 -- common/autotest_common.sh@940 -- # kill -0 3264982 00:11:17.284 15:40:15 -- common/autotest_common.sh@941 -- # uname 00:11:17.284 15:40:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:17.284 15:40:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3264982 00:11:17.284 15:40:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:17.284 15:40:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:17.284 15:40:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3264982' 00:11:17.284 killing process with pid 3264982 00:11:17.284 15:40:15 -- common/autotest_common.sh@955 -- # kill 3264982 00:11:17.284 15:40:15 -- common/autotest_common.sh@960 -- # wait 3264982 00:11:17.284 [2024-04-26 15:40:15.837018] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:11:17.543 15:40:16 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:11:17.543 15:40:16 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:11:17.543 00:11:17.543 real 0m20.394s 00:11:17.543 user 1m10.829s 00:11:17.543 sys 0m4.974s 00:11:17.543 15:40:16 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:11:17.543 15:40:16 -- common/autotest_common.sh@10 -- # set +x 00:11:17.543 ************************************ 00:11:17.543 END TEST nvmf_lvol 00:11:17.543 ************************************ 00:11:17.543 15:40:16 -- nvmf/nvmf.sh@49 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=rdma 00:11:17.543 15:40:16 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:17.543 15:40:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:17.543 15:40:16 -- common/autotest_common.sh@10 -- # set +x 00:11:17.803 ************************************ 00:11:17.803 START TEST nvmf_lvs_grow 00:11:17.803 ************************************ 00:11:17.803 15:40:16 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=rdma 00:11:17.803 * Looking for test storage... 00:11:17.803 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:11:17.803 15:40:16 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:11:17.803 15:40:16 -- nvmf/common.sh@7 -- # uname -s 00:11:17.803 15:40:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:17.803 15:40:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:17.803 15:40:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:17.803 15:40:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:17.803 15:40:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:17.803 15:40:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:17.803 15:40:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:17.803 15:40:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:17.803 15:40:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:17.803 15:40:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:17.803 15:40:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:11:17.803 15:40:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:11:17.803 15:40:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:17.803 15:40:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:17.803 15:40:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:17.803 15:40:16 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:11:17.803 15:40:16 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:11:17.803 15:40:16 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:17.803 15:40:16 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:17.803 15:40:16 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:17.803 15:40:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:17.803 15:40:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:17.804 15:40:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:17.804 15:40:16 -- paths/export.sh@5 -- # export PATH 00:11:17.804 15:40:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:17.804 15:40:16 -- nvmf/common.sh@47 -- # : 0 00:11:17.804 15:40:16 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:11:17.804 15:40:16 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:11:17.804 15:40:16 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:11:17.804 15:40:16 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:17.804 15:40:16 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:17.804 15:40:16 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:11:17.804 15:40:16 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:11:17.804 15:40:16 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:11:17.804 15:40:16 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:11:17.804 15:40:16 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:11:17.804 15:40:16 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:11:17.804 15:40:16 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:11:17.804 15:40:16 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:17.804 15:40:16 -- nvmf/common.sh@437 -- # prepare_net_devs 00:11:17.804 15:40:16 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:11:17.804 15:40:16 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:11:17.804 15:40:16 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:17.804 15:40:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:17.804 15:40:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:17.804 15:40:16 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:11:17.804 15:40:16 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:11:17.804 15:40:16 -- nvmf/common.sh@285 -- # xtrace_disable 00:11:17.804 15:40:16 -- common/autotest_common.sh@10 -- # set +x 00:11:24.374 15:40:21 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:24.374 15:40:21 -- nvmf/common.sh@291 -- # pci_devs=() 00:11:24.374 15:40:21 -- nvmf/common.sh@291 -- # local -a pci_devs 00:11:24.374 15:40:21 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:11:24.374 15:40:21 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:11:24.374 15:40:21 -- nvmf/common.sh@293 -- # pci_drivers=() 00:11:24.374 15:40:21 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:11:24.374 15:40:21 -- nvmf/common.sh@295 -- # net_devs=() 00:11:24.374 15:40:21 -- nvmf/common.sh@295 -- # local -ga net_devs 00:11:24.374 15:40:21 -- nvmf/common.sh@296 -- # e810=() 00:11:24.374 15:40:21 -- nvmf/common.sh@296 -- # local -ga e810 00:11:24.374 15:40:21 -- nvmf/common.sh@297 -- # x722=() 00:11:24.374 15:40:21 -- nvmf/common.sh@297 -- # local -ga x722 00:11:24.374 15:40:21 -- nvmf/common.sh@298 -- # mlx=() 00:11:24.374 15:40:21 -- nvmf/common.sh@298 -- # local -ga mlx 00:11:24.374 15:40:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:24.374 15:40:21 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:24.374 15:40:21 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:24.374 15:40:21 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:24.374 15:40:21 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:24.374 15:40:21 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:24.374 15:40:21 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:24.374 15:40:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:24.374 15:40:21 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:24.374 15:40:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:24.374 15:40:21 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:24.374 15:40:21 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:11:24.374 15:40:21 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:11:24.374 15:40:21 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:11:24.374 15:40:21 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:11:24.374 15:40:21 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:11:24.374 15:40:21 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:11:24.374 15:40:21 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:11:24.374 15:40:21 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:11:24.374 15:40:21 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:11:24.374 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:11:24.374 15:40:21 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:11:24.374 15:40:21 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:11:24.374 15:40:21 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:11:24.374 15:40:21 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:11:24.374 15:40:21 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:11:24.374 15:40:21 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:11:24.374 15:40:21 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:11:24.374 15:40:21 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:11:24.374 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:11:24.374 15:40:21 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:11:24.374 15:40:21 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:11:24.374 15:40:21 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:11:24.374 15:40:21 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:11:24.374 15:40:21 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:11:24.374 15:40:21 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:11:24.374 15:40:21 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:11:24.374 15:40:21 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:11:24.374 15:40:21 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:11:24.374 15:40:21 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:24.374 15:40:21 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:11:24.374 15:40:21 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:24.374 15:40:21 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:11:24.374 Found net devices under 0000:da:00.0: mlx_0_0 00:11:24.374 15:40:21 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:11:24.374 15:40:21 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:11:24.374 15:40:21 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:24.374 15:40:21 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:11:24.374 15:40:21 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:24.374 15:40:21 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:11:24.374 Found net devices under 0000:da:00.1: mlx_0_1 00:11:24.374 15:40:21 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:11:24.374 15:40:21 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:11:24.374 15:40:21 -- nvmf/common.sh@403 -- # is_hw=yes 00:11:24.374 15:40:21 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:11:24.374 15:40:21 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:11:24.374 15:40:21 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:11:24.374 15:40:21 -- nvmf/common.sh@409 -- # rdma_device_init 00:11:24.374 15:40:21 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:11:24.374 15:40:21 -- nvmf/common.sh@58 -- # uname 00:11:24.374 15:40:21 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:11:24.374 15:40:21 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:11:24.374 15:40:21 -- nvmf/common.sh@63 -- # modprobe ib_core 00:11:24.374 15:40:21 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:11:24.374 15:40:21 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:11:24.374 15:40:21 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:11:24.374 15:40:21 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:11:24.374 15:40:21 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:11:24.374 15:40:21 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:11:24.374 15:40:21 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:11:24.374 15:40:21 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:11:24.374 15:40:21 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:11:24.374 15:40:21 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:11:24.374 15:40:21 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:11:24.374 15:40:21 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:11:24.374 15:40:21 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:11:24.375 15:40:21 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:24.375 15:40:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:24.375 15:40:21 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:11:24.375 15:40:21 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:11:24.375 15:40:21 -- nvmf/common.sh@105 -- # continue 2 00:11:24.375 15:40:21 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:24.375 15:40:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:24.375 15:40:21 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:11:24.375 15:40:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:24.375 15:40:21 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:11:24.375 15:40:21 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:11:24.375 15:40:21 -- nvmf/common.sh@105 -- # continue 2 00:11:24.375 15:40:21 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:11:24.375 15:40:21 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:11:24.375 15:40:21 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:11:24.375 15:40:21 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:11:24.375 15:40:21 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:24.375 15:40:21 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:24.375 15:40:21 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:11:24.375 15:40:21 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:11:24.375 15:40:21 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:11:24.375 118: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:11:24.375 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:11:24.375 altname enp218s0f0np0 00:11:24.375 altname ens818f0np0 00:11:24.375 inet 192.168.100.8/24 scope global mlx_0_0 00:11:24.375 valid_lft forever preferred_lft forever 00:11:24.375 15:40:21 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:11:24.375 15:40:21 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:11:24.375 15:40:21 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:11:24.375 15:40:21 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:11:24.375 15:40:21 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:24.375 15:40:21 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:24.375 15:40:21 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:11:24.375 15:40:21 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:11:24.375 15:40:21 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:11:24.375 119: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:11:24.375 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:11:24.375 altname enp218s0f1np1 00:11:24.375 altname ens818f1np1 00:11:24.375 inet 192.168.100.9/24 scope global mlx_0_1 00:11:24.375 valid_lft forever preferred_lft forever 00:11:24.375 15:40:21 -- nvmf/common.sh@411 -- # return 0 00:11:24.375 15:40:21 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:11:24.375 15:40:21 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:11:24.375 15:40:21 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:11:24.375 15:40:21 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:11:24.375 15:40:21 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:11:24.375 15:40:21 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:11:24.375 15:40:21 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:11:24.375 15:40:21 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:11:24.375 15:40:21 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:11:24.375 15:40:21 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:11:24.375 15:40:21 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:24.375 15:40:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:24.375 15:40:21 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:11:24.375 15:40:21 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:11:24.375 15:40:21 -- nvmf/common.sh@105 -- # continue 2 00:11:24.375 15:40:21 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:24.375 15:40:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:24.375 15:40:21 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:11:24.375 15:40:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:24.375 15:40:21 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:11:24.375 15:40:21 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:11:24.375 15:40:21 -- nvmf/common.sh@105 -- # continue 2 00:11:24.375 15:40:21 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:11:24.375 15:40:21 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:11:24.375 15:40:21 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:11:24.375 15:40:21 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:11:24.375 15:40:21 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:24.375 15:40:21 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:24.375 15:40:21 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:11:24.375 15:40:21 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:11:24.375 15:40:21 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:11:24.375 15:40:21 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:11:24.375 15:40:21 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:24.375 15:40:21 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:24.375 15:40:21 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:11:24.375 192.168.100.9' 00:11:24.375 15:40:21 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:11:24.375 192.168.100.9' 00:11:24.375 15:40:21 -- nvmf/common.sh@446 -- # head -n 1 00:11:24.375 15:40:21 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:11:24.375 15:40:21 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:11:24.375 192.168.100.9' 00:11:24.375 15:40:21 -- nvmf/common.sh@447 -- # tail -n +2 00:11:24.375 15:40:21 -- nvmf/common.sh@447 -- # head -n 1 00:11:24.375 15:40:21 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:11:24.375 15:40:21 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:11:24.375 15:40:21 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:11:24.375 15:40:21 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:11:24.375 15:40:21 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:11:24.375 15:40:21 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:11:24.375 15:40:21 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:11:24.375 15:40:21 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:11:24.375 15:40:21 -- common/autotest_common.sh@710 -- # xtrace_disable 00:11:24.375 15:40:21 -- common/autotest_common.sh@10 -- # set +x 00:11:24.375 15:40:21 -- nvmf/common.sh@470 -- # nvmfpid=3270613 00:11:24.375 15:40:21 -- nvmf/common.sh@471 -- # waitforlisten 3270613 00:11:24.375 15:40:21 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:11:24.375 15:40:21 -- common/autotest_common.sh@817 -- # '[' -z 3270613 ']' 00:11:24.375 15:40:21 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:24.375 15:40:21 -- common/autotest_common.sh@822 -- # local max_retries=100 00:11:24.375 15:40:21 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:24.375 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:24.375 15:40:21 -- common/autotest_common.sh@826 -- # xtrace_disable 00:11:24.375 15:40:21 -- common/autotest_common.sh@10 -- # set +x 00:11:24.375 [2024-04-26 15:40:21.925102] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:11:24.375 [2024-04-26 15:40:21.925158] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:24.375 EAL: No free 2048 kB hugepages reported on node 1 00:11:24.375 [2024-04-26 15:40:21.980178] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:11:24.375 [2024-04-26 15:40:22.049580] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:24.375 [2024-04-26 15:40:22.049620] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:24.375 [2024-04-26 15:40:22.049626] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:11:24.375 [2024-04-26 15:40:22.049632] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:11:24.375 [2024-04-26 15:40:22.049636] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:24.375 [2024-04-26 15:40:22.049652] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:24.375 15:40:22 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:11:24.375 15:40:22 -- common/autotest_common.sh@850 -- # return 0 00:11:24.375 15:40:22 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:11:24.375 15:40:22 -- common/autotest_common.sh@716 -- # xtrace_disable 00:11:24.375 15:40:22 -- common/autotest_common.sh@10 -- # set +x 00:11:24.375 15:40:22 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:24.375 15:40:22 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:11:24.375 [2024-04-26 15:40:22.921901] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1ce1f60/0x1ce6450) succeed. 00:11:24.375 [2024-04-26 15:40:22.930295] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1ce3460/0x1d27ae0) succeed. 00:11:24.634 15:40:22 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:11:24.634 15:40:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:11:24.634 15:40:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:24.634 15:40:22 -- common/autotest_common.sh@10 -- # set +x 00:11:24.634 ************************************ 00:11:24.634 START TEST lvs_grow_clean 00:11:24.634 ************************************ 00:11:24.634 15:40:23 -- common/autotest_common.sh@1111 -- # lvs_grow 00:11:24.634 15:40:23 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:11:24.634 15:40:23 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:11:24.634 15:40:23 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:11:24.634 15:40:23 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:11:24.634 15:40:23 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:11:24.634 15:40:23 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:11:24.634 15:40:23 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:11:24.634 15:40:23 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:11:24.634 15:40:23 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:11:24.892 15:40:23 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:11:24.892 15:40:23 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:11:25.150 15:40:23 -- target/nvmf_lvs_grow.sh@28 -- # lvs=4b568280-12de-4197-b16b-67af49bbf4da 00:11:25.150 15:40:23 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 4b568280-12de-4197-b16b-67af49bbf4da 00:11:25.150 15:40:23 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:11:25.150 15:40:23 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:11:25.150 15:40:23 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:11:25.150 15:40:23 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 4b568280-12de-4197-b16b-67af49bbf4da lvol 150 00:11:25.408 15:40:23 -- target/nvmf_lvs_grow.sh@33 -- # lvol=200519e5-515e-4acd-a53d-efeabd5c54e3 00:11:25.408 15:40:23 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:11:25.408 15:40:23 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:11:25.408 [2024-04-26 15:40:23.992846] bdev_aio.c:1030:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:11:25.408 [2024-04-26 15:40:23.992899] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:11:25.408 true 00:11:25.408 15:40:24 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 4b568280-12de-4197-b16b-67af49bbf4da 00:11:25.408 15:40:24 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:11:25.667 15:40:24 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:11:25.667 15:40:24 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:11:25.925 15:40:24 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 200519e5-515e-4acd-a53d-efeabd5c54e3 00:11:25.925 15:40:24 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:11:26.183 [2024-04-26 15:40:24.655021] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:11:26.183 15:40:24 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:11:26.442 15:40:24 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=3271126 00:11:26.442 15:40:24 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:11:26.442 15:40:24 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:11:26.442 15:40:24 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 3271126 /var/tmp/bdevperf.sock 00:11:26.442 15:40:24 -- common/autotest_common.sh@817 -- # '[' -z 3271126 ']' 00:11:26.442 15:40:24 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:11:26.442 15:40:24 -- common/autotest_common.sh@822 -- # local max_retries=100 00:11:26.442 15:40:24 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:11:26.442 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:11:26.442 15:40:24 -- common/autotest_common.sh@826 -- # xtrace_disable 00:11:26.442 15:40:24 -- common/autotest_common.sh@10 -- # set +x 00:11:26.442 [2024-04-26 15:40:24.840051] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:11:26.442 [2024-04-26 15:40:24.840093] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3271126 ] 00:11:26.442 EAL: No free 2048 kB hugepages reported on node 1 00:11:26.442 [2024-04-26 15:40:24.892984] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:11:26.442 [2024-04-26 15:40:24.962949] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:26.700 15:40:25 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:11:26.700 15:40:25 -- common/autotest_common.sh@850 -- # return 0 00:11:26.700 15:40:25 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:11:26.700 Nvme0n1 00:11:26.956 15:40:25 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:11:26.956 [ 00:11:26.956 { 00:11:26.956 "name": "Nvme0n1", 00:11:26.956 "aliases": [ 00:11:26.956 "200519e5-515e-4acd-a53d-efeabd5c54e3" 00:11:26.956 ], 00:11:26.956 "product_name": "NVMe disk", 00:11:26.956 "block_size": 4096, 00:11:26.956 "num_blocks": 38912, 00:11:26.956 "uuid": "200519e5-515e-4acd-a53d-efeabd5c54e3", 00:11:26.956 "assigned_rate_limits": { 00:11:26.956 "rw_ios_per_sec": 0, 00:11:26.956 "rw_mbytes_per_sec": 0, 00:11:26.956 "r_mbytes_per_sec": 0, 00:11:26.956 "w_mbytes_per_sec": 0 00:11:26.956 }, 00:11:26.956 "claimed": false, 00:11:26.956 "zoned": false, 00:11:26.956 "supported_io_types": { 00:11:26.956 "read": true, 00:11:26.956 "write": true, 00:11:26.956 "unmap": true, 00:11:26.956 "write_zeroes": true, 00:11:26.956 "flush": true, 00:11:26.956 "reset": true, 00:11:26.956 "compare": true, 00:11:26.956 "compare_and_write": true, 00:11:26.956 "abort": true, 00:11:26.956 "nvme_admin": true, 00:11:26.956 "nvme_io": true 00:11:26.956 }, 00:11:26.956 "memory_domains": [ 00:11:26.956 { 00:11:26.956 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:11:26.956 "dma_device_type": 0 00:11:26.956 } 00:11:26.956 ], 00:11:26.956 "driver_specific": { 00:11:26.956 "nvme": [ 00:11:26.956 { 00:11:26.956 "trid": { 00:11:26.956 "trtype": "RDMA", 00:11:26.956 "adrfam": "IPv4", 00:11:26.956 "traddr": "192.168.100.8", 00:11:26.956 "trsvcid": "4420", 00:11:26.956 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:11:26.957 }, 00:11:26.957 "ctrlr_data": { 00:11:26.957 "cntlid": 1, 00:11:26.957 "vendor_id": "0x8086", 00:11:26.957 "model_number": "SPDK bdev Controller", 00:11:26.957 "serial_number": "SPDK0", 00:11:26.957 "firmware_revision": "24.05", 00:11:26.957 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:11:26.957 "oacs": { 00:11:26.957 "security": 0, 00:11:26.957 "format": 0, 00:11:26.957 "firmware": 0, 00:11:26.957 "ns_manage": 0 00:11:26.957 }, 00:11:26.957 "multi_ctrlr": true, 00:11:26.957 "ana_reporting": false 00:11:26.957 }, 00:11:26.957 "vs": { 00:11:26.957 "nvme_version": "1.3" 00:11:26.957 }, 00:11:26.957 "ns_data": { 00:11:26.957 "id": 1, 00:11:26.957 "can_share": true 00:11:26.957 } 00:11:26.957 } 00:11:26.957 ], 00:11:26.957 "mp_policy": "active_passive" 00:11:26.957 } 00:11:26.957 } 00:11:26.957 ] 00:11:26.957 15:40:25 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=3271356 00:11:26.957 15:40:25 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:11:26.957 15:40:25 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:11:27.214 Running I/O for 10 seconds... 00:11:28.146 Latency(us) 00:11:28.146 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:11:28.146 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:11:28.146 Nvme0n1 : 1.00 34402.00 134.38 0.00 0.00 0.00 0.00 0.00 00:11:28.146 =================================================================================================================== 00:11:28.146 Total : 34402.00 134.38 0.00 0.00 0.00 0.00 0.00 00:11:28.146 00:11:29.080 15:40:27 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 4b568280-12de-4197-b16b-67af49bbf4da 00:11:29.080 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:11:29.081 Nvme0n1 : 2.00 34768.50 135.81 0.00 0.00 0.00 0.00 0.00 00:11:29.081 =================================================================================================================== 00:11:29.081 Total : 34768.50 135.81 0.00 0.00 0.00 0.00 0.00 00:11:29.081 00:11:29.081 true 00:11:29.081 15:40:27 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 4b568280-12de-4197-b16b-67af49bbf4da 00:11:29.081 15:40:27 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:11:29.339 15:40:27 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:11:29.339 15:40:27 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:11:29.339 15:40:27 -- target/nvmf_lvs_grow.sh@65 -- # wait 3271356 00:11:30.272 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:11:30.272 Nvme0n1 : 3.00 34836.67 136.08 0.00 0.00 0.00 0.00 0.00 00:11:30.272 =================================================================================================================== 00:11:30.272 Total : 34836.67 136.08 0.00 0.00 0.00 0.00 0.00 00:11:30.272 00:11:31.205 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:11:31.205 Nvme0n1 : 4.00 34951.25 136.53 0.00 0.00 0.00 0.00 0.00 00:11:31.205 =================================================================================================================== 00:11:31.205 Total : 34951.25 136.53 0.00 0.00 0.00 0.00 0.00 00:11:31.205 00:11:32.140 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:11:32.140 Nvme0n1 : 5.00 34892.00 136.30 0.00 0.00 0.00 0.00 0.00 00:11:32.140 =================================================================================================================== 00:11:32.140 Total : 34892.00 136.30 0.00 0.00 0.00 0.00 0.00 00:11:32.140 00:11:33.073 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:11:33.073 Nvme0n1 : 6.00 34970.17 136.60 0.00 0.00 0.00 0.00 0.00 00:11:33.073 =================================================================================================================== 00:11:33.073 Total : 34970.17 136.60 0.00 0.00 0.00 0.00 0.00 00:11:33.073 00:11:34.006 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:11:34.006 Nvme0n1 : 7.00 35034.86 136.85 0.00 0.00 0.00 0.00 0.00 00:11:34.006 =================================================================================================================== 00:11:34.006 Total : 35034.86 136.85 0.00 0.00 0.00 0.00 0.00 00:11:34.006 00:11:35.378 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:11:35.378 Nvme0n1 : 8.00 35075.12 137.01 0.00 0.00 0.00 0.00 0.00 00:11:35.378 =================================================================================================================== 00:11:35.378 Total : 35075.12 137.01 0.00 0.00 0.00 0.00 0.00 00:11:35.378 00:11:36.312 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:11:36.312 Nvme0n1 : 9.00 35113.89 137.16 0.00 0.00 0.00 0.00 0.00 00:11:36.312 =================================================================================================================== 00:11:36.312 Total : 35113.89 137.16 0.00 0.00 0.00 0.00 0.00 00:11:36.312 00:11:37.246 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:11:37.246 Nvme0n1 : 10.00 35142.90 137.28 0.00 0.00 0.00 0.00 0.00 00:11:37.246 =================================================================================================================== 00:11:37.246 Total : 35142.90 137.28 0.00 0.00 0.00 0.00 0.00 00:11:37.246 00:11:37.246 00:11:37.246 Latency(us) 00:11:37.246 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:11:37.246 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:11:37.246 Nvme0n1 : 10.00 35142.73 137.28 0.00 0.00 3639.46 2168.93 14230.67 00:11:37.246 =================================================================================================================== 00:11:37.246 Total : 35142.73 137.28 0.00 0.00 3639.46 2168.93 14230.67 00:11:37.246 0 00:11:37.246 15:40:35 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 3271126 00:11:37.246 15:40:35 -- common/autotest_common.sh@936 -- # '[' -z 3271126 ']' 00:11:37.246 15:40:35 -- common/autotest_common.sh@940 -- # kill -0 3271126 00:11:37.246 15:40:35 -- common/autotest_common.sh@941 -- # uname 00:11:37.246 15:40:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:37.246 15:40:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3271126 00:11:37.246 15:40:35 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:11:37.246 15:40:35 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:11:37.246 15:40:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3271126' 00:11:37.246 killing process with pid 3271126 00:11:37.246 15:40:35 -- common/autotest_common.sh@955 -- # kill 3271126 00:11:37.246 Received shutdown signal, test time was about 10.000000 seconds 00:11:37.246 00:11:37.246 Latency(us) 00:11:37.246 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:11:37.246 =================================================================================================================== 00:11:37.246 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:11:37.246 15:40:35 -- common/autotest_common.sh@960 -- # wait 3271126 00:11:37.504 15:40:35 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:11:37.505 15:40:36 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 4b568280-12de-4197-b16b-67af49bbf4da 00:11:37.505 15:40:36 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:11:37.763 15:40:36 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:11:37.763 15:40:36 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:11:37.763 15:40:36 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:11:38.020 [2024-04-26 15:40:36.424576] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:11:38.020 15:40:36 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 4b568280-12de-4197-b16b-67af49bbf4da 00:11:38.020 15:40:36 -- common/autotest_common.sh@638 -- # local es=0 00:11:38.020 15:40:36 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 4b568280-12de-4197-b16b-67af49bbf4da 00:11:38.020 15:40:36 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:11:38.020 15:40:36 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:11:38.020 15:40:36 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:11:38.020 15:40:36 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:11:38.020 15:40:36 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:11:38.020 15:40:36 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:11:38.020 15:40:36 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:11:38.020 15:40:36 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py ]] 00:11:38.020 15:40:36 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 4b568280-12de-4197-b16b-67af49bbf4da 00:11:38.020 request: 00:11:38.020 { 00:11:38.020 "uuid": "4b568280-12de-4197-b16b-67af49bbf4da", 00:11:38.020 "method": "bdev_lvol_get_lvstores", 00:11:38.020 "req_id": 1 00:11:38.020 } 00:11:38.020 Got JSON-RPC error response 00:11:38.020 response: 00:11:38.020 { 00:11:38.020 "code": -19, 00:11:38.020 "message": "No such device" 00:11:38.020 } 00:11:38.020 15:40:36 -- common/autotest_common.sh@641 -- # es=1 00:11:38.020 15:40:36 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:11:38.020 15:40:36 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:11:38.020 15:40:36 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:11:38.020 15:40:36 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:11:38.279 aio_bdev 00:11:38.279 15:40:36 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 200519e5-515e-4acd-a53d-efeabd5c54e3 00:11:38.279 15:40:36 -- common/autotest_common.sh@885 -- # local bdev_name=200519e5-515e-4acd-a53d-efeabd5c54e3 00:11:38.279 15:40:36 -- common/autotest_common.sh@886 -- # local bdev_timeout= 00:11:38.279 15:40:36 -- common/autotest_common.sh@887 -- # local i 00:11:38.279 15:40:36 -- common/autotest_common.sh@888 -- # [[ -z '' ]] 00:11:38.279 15:40:36 -- common/autotest_common.sh@888 -- # bdev_timeout=2000 00:11:38.279 15:40:36 -- common/autotest_common.sh@890 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:11:38.538 15:40:36 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 200519e5-515e-4acd-a53d-efeabd5c54e3 -t 2000 00:11:38.538 [ 00:11:38.538 { 00:11:38.538 "name": "200519e5-515e-4acd-a53d-efeabd5c54e3", 00:11:38.538 "aliases": [ 00:11:38.538 "lvs/lvol" 00:11:38.538 ], 00:11:38.538 "product_name": "Logical Volume", 00:11:38.538 "block_size": 4096, 00:11:38.538 "num_blocks": 38912, 00:11:38.538 "uuid": "200519e5-515e-4acd-a53d-efeabd5c54e3", 00:11:38.538 "assigned_rate_limits": { 00:11:38.538 "rw_ios_per_sec": 0, 00:11:38.538 "rw_mbytes_per_sec": 0, 00:11:38.538 "r_mbytes_per_sec": 0, 00:11:38.538 "w_mbytes_per_sec": 0 00:11:38.538 }, 00:11:38.538 "claimed": false, 00:11:38.538 "zoned": false, 00:11:38.538 "supported_io_types": { 00:11:38.538 "read": true, 00:11:38.538 "write": true, 00:11:38.538 "unmap": true, 00:11:38.538 "write_zeroes": true, 00:11:38.538 "flush": false, 00:11:38.538 "reset": true, 00:11:38.538 "compare": false, 00:11:38.538 "compare_and_write": false, 00:11:38.538 "abort": false, 00:11:38.538 "nvme_admin": false, 00:11:38.538 "nvme_io": false 00:11:38.538 }, 00:11:38.538 "driver_specific": { 00:11:38.538 "lvol": { 00:11:38.538 "lvol_store_uuid": "4b568280-12de-4197-b16b-67af49bbf4da", 00:11:38.538 "base_bdev": "aio_bdev", 00:11:38.538 "thin_provision": false, 00:11:38.538 "snapshot": false, 00:11:38.538 "clone": false, 00:11:38.538 "esnap_clone": false 00:11:38.538 } 00:11:38.538 } 00:11:38.538 } 00:11:38.538 ] 00:11:38.538 15:40:37 -- common/autotest_common.sh@893 -- # return 0 00:11:38.538 15:40:37 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 4b568280-12de-4197-b16b-67af49bbf4da 00:11:38.538 15:40:37 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:11:38.795 15:40:37 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:11:38.795 15:40:37 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 4b568280-12de-4197-b16b-67af49bbf4da 00:11:38.795 15:40:37 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:11:39.053 15:40:37 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:11:39.053 15:40:37 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 200519e5-515e-4acd-a53d-efeabd5c54e3 00:11:39.053 15:40:37 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 4b568280-12de-4197-b16b-67af49bbf4da 00:11:39.310 15:40:37 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:11:39.679 15:40:37 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:11:39.679 00:11:39.679 real 0m14.881s 00:11:39.679 user 0m14.873s 00:11:39.679 sys 0m0.959s 00:11:39.679 15:40:38 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:11:39.679 15:40:38 -- common/autotest_common.sh@10 -- # set +x 00:11:39.679 ************************************ 00:11:39.679 END TEST lvs_grow_clean 00:11:39.679 ************************************ 00:11:39.679 15:40:38 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:11:39.679 15:40:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:39.679 15:40:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:39.679 15:40:38 -- common/autotest_common.sh@10 -- # set +x 00:11:39.679 ************************************ 00:11:39.679 START TEST lvs_grow_dirty 00:11:39.679 ************************************ 00:11:39.679 15:40:38 -- common/autotest_common.sh@1111 -- # lvs_grow dirty 00:11:39.679 15:40:38 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:11:39.679 15:40:38 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:11:39.679 15:40:38 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:11:39.679 15:40:38 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:11:39.679 15:40:38 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:11:39.679 15:40:38 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:11:39.679 15:40:38 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:11:39.679 15:40:38 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:11:39.679 15:40:38 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:11:39.961 15:40:38 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:11:39.961 15:40:38 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:11:39.961 15:40:38 -- target/nvmf_lvs_grow.sh@28 -- # lvs=ad1c2fe6-1cdf-4eb0-be1c-8fd508f64f35 00:11:40.217 15:40:38 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ad1c2fe6-1cdf-4eb0-be1c-8fd508f64f35 00:11:40.217 15:40:38 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:11:40.217 15:40:38 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:11:40.217 15:40:38 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:11:40.217 15:40:38 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u ad1c2fe6-1cdf-4eb0-be1c-8fd508f64f35 lvol 150 00:11:40.474 15:40:38 -- target/nvmf_lvs_grow.sh@33 -- # lvol=c23a212a-8146-4bce-8836-0cee8223191f 00:11:40.474 15:40:38 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:11:40.474 15:40:38 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:11:40.474 [2024-04-26 15:40:39.060847] bdev_aio.c:1030:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:11:40.474 [2024-04-26 15:40:39.060898] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:11:40.474 true 00:11:40.474 15:40:39 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ad1c2fe6-1cdf-4eb0-be1c-8fd508f64f35 00:11:40.474 15:40:39 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:11:40.732 15:40:39 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:11:40.732 15:40:39 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:11:40.991 15:40:39 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 c23a212a-8146-4bce-8836-0cee8223191f 00:11:40.991 15:40:39 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:11:41.249 15:40:39 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:11:41.506 15:40:39 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=3273726 00:11:41.506 15:40:39 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:11:41.506 15:40:39 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:11:41.506 15:40:39 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 3273726 /var/tmp/bdevperf.sock 00:11:41.506 15:40:39 -- common/autotest_common.sh@817 -- # '[' -z 3273726 ']' 00:11:41.506 15:40:39 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:11:41.506 15:40:39 -- common/autotest_common.sh@822 -- # local max_retries=100 00:11:41.506 15:40:39 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:11:41.507 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:11:41.507 15:40:39 -- common/autotest_common.sh@826 -- # xtrace_disable 00:11:41.507 15:40:39 -- common/autotest_common.sh@10 -- # set +x 00:11:41.507 [2024-04-26 15:40:39.911784] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:11:41.507 [2024-04-26 15:40:39.911831] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3273726 ] 00:11:41.507 EAL: No free 2048 kB hugepages reported on node 1 00:11:41.507 [2024-04-26 15:40:39.963967] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:11:41.507 [2024-04-26 15:40:40.041833] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:42.439 15:40:40 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:11:42.439 15:40:40 -- common/autotest_common.sh@850 -- # return 0 00:11:42.439 15:40:40 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:11:42.439 Nvme0n1 00:11:42.439 15:40:40 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:11:42.696 [ 00:11:42.696 { 00:11:42.696 "name": "Nvme0n1", 00:11:42.696 "aliases": [ 00:11:42.696 "c23a212a-8146-4bce-8836-0cee8223191f" 00:11:42.696 ], 00:11:42.696 "product_name": "NVMe disk", 00:11:42.696 "block_size": 4096, 00:11:42.696 "num_blocks": 38912, 00:11:42.696 "uuid": "c23a212a-8146-4bce-8836-0cee8223191f", 00:11:42.696 "assigned_rate_limits": { 00:11:42.696 "rw_ios_per_sec": 0, 00:11:42.696 "rw_mbytes_per_sec": 0, 00:11:42.696 "r_mbytes_per_sec": 0, 00:11:42.696 "w_mbytes_per_sec": 0 00:11:42.696 }, 00:11:42.696 "claimed": false, 00:11:42.696 "zoned": false, 00:11:42.696 "supported_io_types": { 00:11:42.697 "read": true, 00:11:42.697 "write": true, 00:11:42.697 "unmap": true, 00:11:42.697 "write_zeroes": true, 00:11:42.697 "flush": true, 00:11:42.697 "reset": true, 00:11:42.697 "compare": true, 00:11:42.697 "compare_and_write": true, 00:11:42.697 "abort": true, 00:11:42.697 "nvme_admin": true, 00:11:42.697 "nvme_io": true 00:11:42.697 }, 00:11:42.697 "memory_domains": [ 00:11:42.697 { 00:11:42.697 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:11:42.697 "dma_device_type": 0 00:11:42.697 } 00:11:42.697 ], 00:11:42.697 "driver_specific": { 00:11:42.697 "nvme": [ 00:11:42.697 { 00:11:42.697 "trid": { 00:11:42.697 "trtype": "RDMA", 00:11:42.697 "adrfam": "IPv4", 00:11:42.697 "traddr": "192.168.100.8", 00:11:42.697 "trsvcid": "4420", 00:11:42.697 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:11:42.697 }, 00:11:42.697 "ctrlr_data": { 00:11:42.697 "cntlid": 1, 00:11:42.697 "vendor_id": "0x8086", 00:11:42.697 "model_number": "SPDK bdev Controller", 00:11:42.697 "serial_number": "SPDK0", 00:11:42.697 "firmware_revision": "24.05", 00:11:42.697 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:11:42.697 "oacs": { 00:11:42.697 "security": 0, 00:11:42.697 "format": 0, 00:11:42.697 "firmware": 0, 00:11:42.697 "ns_manage": 0 00:11:42.697 }, 00:11:42.697 "multi_ctrlr": true, 00:11:42.697 "ana_reporting": false 00:11:42.697 }, 00:11:42.697 "vs": { 00:11:42.697 "nvme_version": "1.3" 00:11:42.697 }, 00:11:42.697 "ns_data": { 00:11:42.697 "id": 1, 00:11:42.697 "can_share": true 00:11:42.697 } 00:11:42.697 } 00:11:42.697 ], 00:11:42.697 "mp_policy": "active_passive" 00:11:42.697 } 00:11:42.697 } 00:11:42.697 ] 00:11:42.697 15:40:41 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=3273959 00:11:42.697 15:40:41 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:11:42.697 15:40:41 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:11:42.697 Running I/O for 10 seconds... 00:11:43.630 Latency(us) 00:11:43.630 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:11:43.630 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:11:43.630 Nvme0n1 : 1.00 34274.00 133.88 0.00 0.00 0.00 0.00 0.00 00:11:43.630 =================================================================================================================== 00:11:43.630 Total : 34274.00 133.88 0.00 0.00 0.00 0.00 0.00 00:11:43.630 00:11:44.563 15:40:43 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u ad1c2fe6-1cdf-4eb0-be1c-8fd508f64f35 00:11:44.821 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:11:44.821 Nvme0n1 : 2.00 34641.00 135.32 0.00 0.00 0.00 0.00 0.00 00:11:44.821 =================================================================================================================== 00:11:44.821 Total : 34641.00 135.32 0.00 0.00 0.00 0.00 0.00 00:11:44.821 00:11:44.822 true 00:11:44.822 15:40:43 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:11:44.822 15:40:43 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ad1c2fe6-1cdf-4eb0-be1c-8fd508f64f35 00:11:45.079 15:40:43 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:11:45.079 15:40:43 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:11:45.079 15:40:43 -- target/nvmf_lvs_grow.sh@65 -- # wait 3273959 00:11:45.642 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:11:45.642 Nvme0n1 : 3.00 34743.33 135.72 0.00 0.00 0.00 0.00 0.00 00:11:45.642 =================================================================================================================== 00:11:45.642 Total : 34743.33 135.72 0.00 0.00 0.00 0.00 0.00 00:11:45.642 00:11:47.016 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:11:47.016 Nvme0n1 : 4.00 34865.00 136.19 0.00 0.00 0.00 0.00 0.00 00:11:47.016 =================================================================================================================== 00:11:47.016 Total : 34865.00 136.19 0.00 0.00 0.00 0.00 0.00 00:11:47.016 00:11:47.950 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:11:47.950 Nvme0n1 : 5.00 34951.60 136.53 0.00 0.00 0.00 0.00 0.00 00:11:47.950 =================================================================================================================== 00:11:47.950 Total : 34951.60 136.53 0.00 0.00 0.00 0.00 0.00 00:11:47.950 00:11:48.886 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:11:48.886 Nvme0n1 : 6.00 35014.33 136.77 0.00 0.00 0.00 0.00 0.00 00:11:48.886 =================================================================================================================== 00:11:48.886 Total : 35014.33 136.77 0.00 0.00 0.00 0.00 0.00 00:11:48.886 00:11:49.820 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:11:49.820 Nvme0n1 : 7.00 35062.29 136.96 0.00 0.00 0.00 0.00 0.00 00:11:49.820 =================================================================================================================== 00:11:49.820 Total : 35062.29 136.96 0.00 0.00 0.00 0.00 0.00 00:11:49.820 00:11:50.755 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:11:50.755 Nvme0n1 : 8.00 35096.62 137.10 0.00 0.00 0.00 0.00 0.00 00:11:50.755 =================================================================================================================== 00:11:50.755 Total : 35096.62 137.10 0.00 0.00 0.00 0.00 0.00 00:11:50.755 00:11:51.689 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:11:51.689 Nvme0n1 : 9.00 35090.22 137.07 0.00 0.00 0.00 0.00 0.00 00:11:51.690 =================================================================================================================== 00:11:51.690 Total : 35090.22 137.07 0.00 0.00 0.00 0.00 0.00 00:11:51.690 00:11:53.061 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:11:53.061 Nvme0n1 : 10.00 35093.80 137.09 0.00 0.00 0.00 0.00 0.00 00:11:53.061 =================================================================================================================== 00:11:53.061 Total : 35093.80 137.09 0.00 0.00 0.00 0.00 0.00 00:11:53.061 00:11:53.061 00:11:53.061 Latency(us) 00:11:53.061 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:11:53.061 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:11:53.061 Nvme0n1 : 10.00 35094.03 137.09 0.00 0.00 3644.38 2246.95 16352.79 00:11:53.061 =================================================================================================================== 00:11:53.061 Total : 35094.03 137.09 0.00 0.00 3644.38 2246.95 16352.79 00:11:53.061 0 00:11:53.061 15:40:51 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 3273726 00:11:53.061 15:40:51 -- common/autotest_common.sh@936 -- # '[' -z 3273726 ']' 00:11:53.061 15:40:51 -- common/autotest_common.sh@940 -- # kill -0 3273726 00:11:53.061 15:40:51 -- common/autotest_common.sh@941 -- # uname 00:11:53.061 15:40:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:53.061 15:40:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3273726 00:11:53.061 15:40:51 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:11:53.061 15:40:51 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:11:53.061 15:40:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3273726' 00:11:53.061 killing process with pid 3273726 00:11:53.061 15:40:51 -- common/autotest_common.sh@955 -- # kill 3273726 00:11:53.061 Received shutdown signal, test time was about 10.000000 seconds 00:11:53.061 00:11:53.061 Latency(us) 00:11:53.061 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:11:53.061 =================================================================================================================== 00:11:53.061 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:11:53.061 15:40:51 -- common/autotest_common.sh@960 -- # wait 3273726 00:11:53.061 15:40:51 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:11:53.320 15:40:51 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ad1c2fe6-1cdf-4eb0-be1c-8fd508f64f35 00:11:53.320 15:40:51 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:11:53.320 15:40:51 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:11:53.320 15:40:51 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:11:53.320 15:40:51 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 3270613 00:11:53.320 15:40:51 -- target/nvmf_lvs_grow.sh@74 -- # wait 3270613 00:11:53.320 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 3270613 Killed "${NVMF_APP[@]}" "$@" 00:11:53.320 15:40:51 -- target/nvmf_lvs_grow.sh@74 -- # true 00:11:53.320 15:40:51 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:11:53.320 15:40:51 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:11:53.320 15:40:51 -- common/autotest_common.sh@710 -- # xtrace_disable 00:11:53.320 15:40:51 -- common/autotest_common.sh@10 -- # set +x 00:11:53.579 15:40:51 -- nvmf/common.sh@470 -- # nvmfpid=3275800 00:11:53.579 15:40:51 -- nvmf/common.sh@471 -- # waitforlisten 3275800 00:11:53.579 15:40:51 -- common/autotest_common.sh@817 -- # '[' -z 3275800 ']' 00:11:53.579 15:40:51 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:53.579 15:40:51 -- common/autotest_common.sh@822 -- # local max_retries=100 00:11:53.579 15:40:51 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:53.579 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:53.579 15:40:51 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:11:53.579 15:40:51 -- common/autotest_common.sh@826 -- # xtrace_disable 00:11:53.579 15:40:51 -- common/autotest_common.sh@10 -- # set +x 00:11:53.579 [2024-04-26 15:40:51.970297] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:11:53.579 [2024-04-26 15:40:51.970341] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:53.579 EAL: No free 2048 kB hugepages reported on node 1 00:11:53.579 [2024-04-26 15:40:52.026804] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:11:53.579 [2024-04-26 15:40:52.103685] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:53.579 [2024-04-26 15:40:52.103719] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:53.579 [2024-04-26 15:40:52.103726] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:11:53.579 [2024-04-26 15:40:52.103732] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:11:53.579 [2024-04-26 15:40:52.103737] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:53.579 [2024-04-26 15:40:52.103751] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:54.514 15:40:52 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:11:54.514 15:40:52 -- common/autotest_common.sh@850 -- # return 0 00:11:54.514 15:40:52 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:11:54.514 15:40:52 -- common/autotest_common.sh@716 -- # xtrace_disable 00:11:54.514 15:40:52 -- common/autotest_common.sh@10 -- # set +x 00:11:54.514 15:40:52 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:54.514 15:40:52 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:11:54.514 [2024-04-26 15:40:52.953021] blobstore.c:4779:bs_recover: *NOTICE*: Performing recovery on blobstore 00:11:54.514 [2024-04-26 15:40:52.953103] blobstore.c:4726:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:11:54.514 [2024-04-26 15:40:52.953132] blobstore.c:4726:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:11:54.514 15:40:52 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:11:54.514 15:40:52 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev c23a212a-8146-4bce-8836-0cee8223191f 00:11:54.514 15:40:52 -- common/autotest_common.sh@885 -- # local bdev_name=c23a212a-8146-4bce-8836-0cee8223191f 00:11:54.514 15:40:52 -- common/autotest_common.sh@886 -- # local bdev_timeout= 00:11:54.514 15:40:52 -- common/autotest_common.sh@887 -- # local i 00:11:54.514 15:40:52 -- common/autotest_common.sh@888 -- # [[ -z '' ]] 00:11:54.514 15:40:52 -- common/autotest_common.sh@888 -- # bdev_timeout=2000 00:11:54.514 15:40:52 -- common/autotest_common.sh@890 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:11:54.772 15:40:53 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b c23a212a-8146-4bce-8836-0cee8223191f -t 2000 00:11:54.772 [ 00:11:54.772 { 00:11:54.772 "name": "c23a212a-8146-4bce-8836-0cee8223191f", 00:11:54.772 "aliases": [ 00:11:54.772 "lvs/lvol" 00:11:54.772 ], 00:11:54.772 "product_name": "Logical Volume", 00:11:54.772 "block_size": 4096, 00:11:54.772 "num_blocks": 38912, 00:11:54.772 "uuid": "c23a212a-8146-4bce-8836-0cee8223191f", 00:11:54.772 "assigned_rate_limits": { 00:11:54.772 "rw_ios_per_sec": 0, 00:11:54.772 "rw_mbytes_per_sec": 0, 00:11:54.772 "r_mbytes_per_sec": 0, 00:11:54.772 "w_mbytes_per_sec": 0 00:11:54.772 }, 00:11:54.772 "claimed": false, 00:11:54.772 "zoned": false, 00:11:54.772 "supported_io_types": { 00:11:54.772 "read": true, 00:11:54.772 "write": true, 00:11:54.772 "unmap": true, 00:11:54.772 "write_zeroes": true, 00:11:54.772 "flush": false, 00:11:54.772 "reset": true, 00:11:54.772 "compare": false, 00:11:54.772 "compare_and_write": false, 00:11:54.772 "abort": false, 00:11:54.772 "nvme_admin": false, 00:11:54.772 "nvme_io": false 00:11:54.772 }, 00:11:54.772 "driver_specific": { 00:11:54.772 "lvol": { 00:11:54.772 "lvol_store_uuid": "ad1c2fe6-1cdf-4eb0-be1c-8fd508f64f35", 00:11:54.772 "base_bdev": "aio_bdev", 00:11:54.772 "thin_provision": false, 00:11:54.772 "snapshot": false, 00:11:54.772 "clone": false, 00:11:54.772 "esnap_clone": false 00:11:54.772 } 00:11:54.772 } 00:11:54.772 } 00:11:54.772 ] 00:11:54.772 15:40:53 -- common/autotest_common.sh@893 -- # return 0 00:11:54.772 15:40:53 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ad1c2fe6-1cdf-4eb0-be1c-8fd508f64f35 00:11:54.772 15:40:53 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:11:55.030 15:40:53 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:11:55.030 15:40:53 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ad1c2fe6-1cdf-4eb0-be1c-8fd508f64f35 00:11:55.030 15:40:53 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:11:55.030 15:40:53 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:11:55.030 15:40:53 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:11:55.287 [2024-04-26 15:40:53.777410] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:11:55.287 15:40:53 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ad1c2fe6-1cdf-4eb0-be1c-8fd508f64f35 00:11:55.287 15:40:53 -- common/autotest_common.sh@638 -- # local es=0 00:11:55.287 15:40:53 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ad1c2fe6-1cdf-4eb0-be1c-8fd508f64f35 00:11:55.287 15:40:53 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:11:55.287 15:40:53 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:11:55.287 15:40:53 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:11:55.287 15:40:53 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:11:55.287 15:40:53 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:11:55.287 15:40:53 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:11:55.287 15:40:53 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:11:55.287 15:40:53 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py ]] 00:11:55.287 15:40:53 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ad1c2fe6-1cdf-4eb0-be1c-8fd508f64f35 00:11:55.545 request: 00:11:55.545 { 00:11:55.545 "uuid": "ad1c2fe6-1cdf-4eb0-be1c-8fd508f64f35", 00:11:55.545 "method": "bdev_lvol_get_lvstores", 00:11:55.545 "req_id": 1 00:11:55.545 } 00:11:55.545 Got JSON-RPC error response 00:11:55.545 response: 00:11:55.545 { 00:11:55.545 "code": -19, 00:11:55.545 "message": "No such device" 00:11:55.545 } 00:11:55.545 15:40:53 -- common/autotest_common.sh@641 -- # es=1 00:11:55.545 15:40:53 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:11:55.545 15:40:53 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:11:55.545 15:40:53 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:11:55.545 15:40:53 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:11:55.545 aio_bdev 00:11:55.545 15:40:54 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev c23a212a-8146-4bce-8836-0cee8223191f 00:11:55.545 15:40:54 -- common/autotest_common.sh@885 -- # local bdev_name=c23a212a-8146-4bce-8836-0cee8223191f 00:11:55.546 15:40:54 -- common/autotest_common.sh@886 -- # local bdev_timeout= 00:11:55.546 15:40:54 -- common/autotest_common.sh@887 -- # local i 00:11:55.546 15:40:54 -- common/autotest_common.sh@888 -- # [[ -z '' ]] 00:11:55.546 15:40:54 -- common/autotest_common.sh@888 -- # bdev_timeout=2000 00:11:55.546 15:40:54 -- common/autotest_common.sh@890 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:11:55.804 15:40:54 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b c23a212a-8146-4bce-8836-0cee8223191f -t 2000 00:11:56.063 [ 00:11:56.063 { 00:11:56.063 "name": "c23a212a-8146-4bce-8836-0cee8223191f", 00:11:56.063 "aliases": [ 00:11:56.063 "lvs/lvol" 00:11:56.063 ], 00:11:56.063 "product_name": "Logical Volume", 00:11:56.063 "block_size": 4096, 00:11:56.063 "num_blocks": 38912, 00:11:56.063 "uuid": "c23a212a-8146-4bce-8836-0cee8223191f", 00:11:56.063 "assigned_rate_limits": { 00:11:56.063 "rw_ios_per_sec": 0, 00:11:56.063 "rw_mbytes_per_sec": 0, 00:11:56.063 "r_mbytes_per_sec": 0, 00:11:56.063 "w_mbytes_per_sec": 0 00:11:56.063 }, 00:11:56.063 "claimed": false, 00:11:56.063 "zoned": false, 00:11:56.063 "supported_io_types": { 00:11:56.063 "read": true, 00:11:56.063 "write": true, 00:11:56.063 "unmap": true, 00:11:56.063 "write_zeroes": true, 00:11:56.063 "flush": false, 00:11:56.063 "reset": true, 00:11:56.063 "compare": false, 00:11:56.063 "compare_and_write": false, 00:11:56.063 "abort": false, 00:11:56.063 "nvme_admin": false, 00:11:56.063 "nvme_io": false 00:11:56.063 }, 00:11:56.063 "driver_specific": { 00:11:56.063 "lvol": { 00:11:56.063 "lvol_store_uuid": "ad1c2fe6-1cdf-4eb0-be1c-8fd508f64f35", 00:11:56.063 "base_bdev": "aio_bdev", 00:11:56.063 "thin_provision": false, 00:11:56.063 "snapshot": false, 00:11:56.063 "clone": false, 00:11:56.063 "esnap_clone": false 00:11:56.063 } 00:11:56.063 } 00:11:56.063 } 00:11:56.063 ] 00:11:56.063 15:40:54 -- common/autotest_common.sh@893 -- # return 0 00:11:56.063 15:40:54 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ad1c2fe6-1cdf-4eb0-be1c-8fd508f64f35 00:11:56.063 15:40:54 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:11:56.063 15:40:54 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:11:56.063 15:40:54 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ad1c2fe6-1cdf-4eb0-be1c-8fd508f64f35 00:11:56.063 15:40:54 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:11:56.322 15:40:54 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:11:56.322 15:40:54 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete c23a212a-8146-4bce-8836-0cee8223191f 00:11:56.581 15:40:54 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u ad1c2fe6-1cdf-4eb0-be1c-8fd508f64f35 00:11:56.581 15:40:55 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:11:56.839 15:40:55 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:11:56.839 00:11:56.839 real 0m17.100s 00:11:56.839 user 0m44.641s 00:11:56.839 sys 0m2.789s 00:11:56.839 15:40:55 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:11:56.839 15:40:55 -- common/autotest_common.sh@10 -- # set +x 00:11:56.839 ************************************ 00:11:56.839 END TEST lvs_grow_dirty 00:11:56.839 ************************************ 00:11:56.839 15:40:55 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:11:56.839 15:40:55 -- common/autotest_common.sh@794 -- # type=--id 00:11:56.839 15:40:55 -- common/autotest_common.sh@795 -- # id=0 00:11:56.839 15:40:55 -- common/autotest_common.sh@796 -- # '[' --id = --pid ']' 00:11:56.839 15:40:55 -- common/autotest_common.sh@800 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:11:56.839 15:40:55 -- common/autotest_common.sh@800 -- # shm_files=nvmf_trace.0 00:11:56.839 15:40:55 -- common/autotest_common.sh@802 -- # [[ -z nvmf_trace.0 ]] 00:11:56.839 15:40:55 -- common/autotest_common.sh@806 -- # for n in $shm_files 00:11:56.840 15:40:55 -- common/autotest_common.sh@807 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:11:56.840 nvmf_trace.0 00:11:56.840 15:40:55 -- common/autotest_common.sh@809 -- # return 0 00:11:56.840 15:40:55 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:11:56.840 15:40:55 -- nvmf/common.sh@477 -- # nvmfcleanup 00:11:56.840 15:40:55 -- nvmf/common.sh@117 -- # sync 00:11:56.840 15:40:55 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:11:56.840 15:40:55 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:11:56.840 15:40:55 -- nvmf/common.sh@120 -- # set +e 00:11:56.840 15:40:55 -- nvmf/common.sh@121 -- # for i in {1..20} 00:11:56.840 15:40:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:11:56.840 rmmod nvme_rdma 00:11:56.840 rmmod nvme_fabrics 00:11:56.840 15:40:55 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:11:56.840 15:40:55 -- nvmf/common.sh@124 -- # set -e 00:11:56.840 15:40:55 -- nvmf/common.sh@125 -- # return 0 00:11:56.840 15:40:55 -- nvmf/common.sh@478 -- # '[' -n 3275800 ']' 00:11:56.840 15:40:55 -- nvmf/common.sh@479 -- # killprocess 3275800 00:11:56.840 15:40:55 -- common/autotest_common.sh@936 -- # '[' -z 3275800 ']' 00:11:56.840 15:40:55 -- common/autotest_common.sh@940 -- # kill -0 3275800 00:11:56.840 15:40:55 -- common/autotest_common.sh@941 -- # uname 00:11:56.840 15:40:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:56.840 15:40:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3275800 00:11:57.098 15:40:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:57.098 15:40:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:57.098 15:40:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3275800' 00:11:57.098 killing process with pid 3275800 00:11:57.098 15:40:55 -- common/autotest_common.sh@955 -- # kill 3275800 00:11:57.098 15:40:55 -- common/autotest_common.sh@960 -- # wait 3275800 00:11:57.098 15:40:55 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:11:57.098 15:40:55 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:11:57.098 00:11:57.098 real 0m39.430s 00:11:57.098 user 1m5.261s 00:11:57.098 sys 0m8.444s 00:11:57.098 15:40:55 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:11:57.098 15:40:55 -- common/autotest_common.sh@10 -- # set +x 00:11:57.098 ************************************ 00:11:57.098 END TEST nvmf_lvs_grow 00:11:57.098 ************************************ 00:11:57.098 15:40:55 -- nvmf/nvmf.sh@50 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=rdma 00:11:57.098 15:40:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:57.098 15:40:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:57.098 15:40:55 -- common/autotest_common.sh@10 -- # set +x 00:11:57.356 ************************************ 00:11:57.356 START TEST nvmf_bdev_io_wait 00:11:57.356 ************************************ 00:11:57.356 15:40:55 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=rdma 00:11:57.356 * Looking for test storage... 00:11:57.356 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:11:57.356 15:40:55 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:11:57.356 15:40:55 -- nvmf/common.sh@7 -- # uname -s 00:11:57.356 15:40:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:57.356 15:40:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:57.356 15:40:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:57.356 15:40:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:57.356 15:40:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:57.356 15:40:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:57.356 15:40:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:57.356 15:40:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:57.356 15:40:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:57.356 15:40:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:57.356 15:40:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:11:57.356 15:40:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:11:57.356 15:40:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:57.356 15:40:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:57.356 15:40:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:57.356 15:40:55 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:11:57.356 15:40:55 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:11:57.356 15:40:55 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:57.356 15:40:55 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:57.356 15:40:55 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:57.356 15:40:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:57.356 15:40:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:57.356 15:40:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:57.356 15:40:55 -- paths/export.sh@5 -- # export PATH 00:11:57.356 15:40:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:57.356 15:40:55 -- nvmf/common.sh@47 -- # : 0 00:11:57.356 15:40:55 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:11:57.356 15:40:55 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:11:57.356 15:40:55 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:11:57.356 15:40:55 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:57.356 15:40:55 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:57.356 15:40:55 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:11:57.356 15:40:55 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:11:57.356 15:40:55 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:11:57.356 15:40:55 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:11:57.356 15:40:55 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:11:57.356 15:40:55 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:11:57.356 15:40:55 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:11:57.356 15:40:55 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:57.356 15:40:55 -- nvmf/common.sh@437 -- # prepare_net_devs 00:11:57.356 15:40:55 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:11:57.356 15:40:55 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:11:57.356 15:40:55 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:57.356 15:40:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:57.356 15:40:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:57.356 15:40:55 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:11:57.356 15:40:55 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:11:57.356 15:40:55 -- nvmf/common.sh@285 -- # xtrace_disable 00:11:57.356 15:40:55 -- common/autotest_common.sh@10 -- # set +x 00:12:02.618 15:41:00 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:02.618 15:41:00 -- nvmf/common.sh@291 -- # pci_devs=() 00:12:02.618 15:41:00 -- nvmf/common.sh@291 -- # local -a pci_devs 00:12:02.618 15:41:00 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:12:02.619 15:41:00 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:12:02.619 15:41:00 -- nvmf/common.sh@293 -- # pci_drivers=() 00:12:02.619 15:41:00 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:12:02.619 15:41:00 -- nvmf/common.sh@295 -- # net_devs=() 00:12:02.619 15:41:00 -- nvmf/common.sh@295 -- # local -ga net_devs 00:12:02.619 15:41:00 -- nvmf/common.sh@296 -- # e810=() 00:12:02.619 15:41:00 -- nvmf/common.sh@296 -- # local -ga e810 00:12:02.619 15:41:00 -- nvmf/common.sh@297 -- # x722=() 00:12:02.619 15:41:00 -- nvmf/common.sh@297 -- # local -ga x722 00:12:02.619 15:41:00 -- nvmf/common.sh@298 -- # mlx=() 00:12:02.619 15:41:00 -- nvmf/common.sh@298 -- # local -ga mlx 00:12:02.619 15:41:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:02.619 15:41:00 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:02.619 15:41:00 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:02.619 15:41:00 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:02.619 15:41:00 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:02.619 15:41:00 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:02.619 15:41:00 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:02.619 15:41:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:02.619 15:41:00 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:02.619 15:41:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:02.619 15:41:00 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:02.619 15:41:00 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:12:02.619 15:41:00 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:12:02.619 15:41:00 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:12:02.619 15:41:00 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:12:02.619 15:41:00 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:12:02.619 15:41:00 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:12:02.619 15:41:00 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:12:02.619 15:41:00 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:02.619 15:41:00 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:12:02.619 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:12:02.619 15:41:00 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:02.619 15:41:00 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:02.619 15:41:00 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:12:02.619 15:41:00 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:12:02.619 15:41:00 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:02.619 15:41:00 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:02.619 15:41:00 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:02.619 15:41:00 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:12:02.619 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:12:02.619 15:41:00 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:02.619 15:41:00 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:02.619 15:41:00 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:12:02.619 15:41:00 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:12:02.619 15:41:00 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:02.619 15:41:00 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:02.619 15:41:00 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:12:02.619 15:41:00 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:12:02.619 15:41:00 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:02.619 15:41:00 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:02.619 15:41:00 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:02.619 15:41:00 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:02.619 15:41:00 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:12:02.619 Found net devices under 0000:da:00.0: mlx_0_0 00:12:02.619 15:41:00 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:02.619 15:41:00 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:02.619 15:41:00 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:02.619 15:41:00 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:02.619 15:41:00 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:02.619 15:41:00 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:12:02.619 Found net devices under 0000:da:00.1: mlx_0_1 00:12:02.619 15:41:00 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:02.619 15:41:00 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:12:02.619 15:41:00 -- nvmf/common.sh@403 -- # is_hw=yes 00:12:02.619 15:41:00 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:12:02.619 15:41:00 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:12:02.619 15:41:00 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:12:02.619 15:41:00 -- nvmf/common.sh@409 -- # rdma_device_init 00:12:02.619 15:41:00 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:12:02.619 15:41:00 -- nvmf/common.sh@58 -- # uname 00:12:02.619 15:41:00 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:12:02.619 15:41:00 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:12:02.619 15:41:00 -- nvmf/common.sh@63 -- # modprobe ib_core 00:12:02.619 15:41:00 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:12:02.619 15:41:00 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:12:02.619 15:41:01 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:12:02.619 15:41:01 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:12:02.619 15:41:01 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:12:02.619 15:41:01 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:12:02.619 15:41:01 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:12:02.619 15:41:01 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:12:02.619 15:41:01 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:02.619 15:41:01 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:02.619 15:41:01 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:02.619 15:41:01 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:02.619 15:41:01 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:02.619 15:41:01 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:02.619 15:41:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:02.619 15:41:01 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:02.619 15:41:01 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:02.619 15:41:01 -- nvmf/common.sh@105 -- # continue 2 00:12:02.619 15:41:01 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:02.619 15:41:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:02.619 15:41:01 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:02.619 15:41:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:02.619 15:41:01 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:02.619 15:41:01 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:02.619 15:41:01 -- nvmf/common.sh@105 -- # continue 2 00:12:02.619 15:41:01 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:02.620 15:41:01 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:12:02.620 15:41:01 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:02.620 15:41:01 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:02.620 15:41:01 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:02.620 15:41:01 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:02.620 15:41:01 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:12:02.620 15:41:01 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:12:02.620 15:41:01 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:12:02.620 118: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:02.620 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:12:02.620 altname enp218s0f0np0 00:12:02.620 altname ens818f0np0 00:12:02.620 inet 192.168.100.8/24 scope global mlx_0_0 00:12:02.620 valid_lft forever preferred_lft forever 00:12:02.620 15:41:01 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:02.620 15:41:01 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:12:02.620 15:41:01 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:02.620 15:41:01 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:02.620 15:41:01 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:02.620 15:41:01 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:02.620 15:41:01 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:12:02.620 15:41:01 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:12:02.620 15:41:01 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:12:02.620 119: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:02.620 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:12:02.620 altname enp218s0f1np1 00:12:02.620 altname ens818f1np1 00:12:02.620 inet 192.168.100.9/24 scope global mlx_0_1 00:12:02.620 valid_lft forever preferred_lft forever 00:12:02.620 15:41:01 -- nvmf/common.sh@411 -- # return 0 00:12:02.620 15:41:01 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:12:02.620 15:41:01 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:12:02.620 15:41:01 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:12:02.620 15:41:01 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:12:02.620 15:41:01 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:12:02.620 15:41:01 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:02.620 15:41:01 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:02.620 15:41:01 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:02.620 15:41:01 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:02.620 15:41:01 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:02.620 15:41:01 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:02.620 15:41:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:02.620 15:41:01 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:02.620 15:41:01 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:02.620 15:41:01 -- nvmf/common.sh@105 -- # continue 2 00:12:02.620 15:41:01 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:02.620 15:41:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:02.620 15:41:01 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:02.620 15:41:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:02.620 15:41:01 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:02.620 15:41:01 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:02.620 15:41:01 -- nvmf/common.sh@105 -- # continue 2 00:12:02.620 15:41:01 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:02.620 15:41:01 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:12:02.620 15:41:01 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:02.620 15:41:01 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:02.620 15:41:01 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:02.620 15:41:01 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:02.620 15:41:01 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:02.620 15:41:01 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:12:02.620 15:41:01 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:02.620 15:41:01 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:02.620 15:41:01 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:02.620 15:41:01 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:02.620 15:41:01 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:12:02.620 192.168.100.9' 00:12:02.620 15:41:01 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:12:02.620 192.168.100.9' 00:12:02.620 15:41:01 -- nvmf/common.sh@446 -- # head -n 1 00:12:02.620 15:41:01 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:12:02.620 15:41:01 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:12:02.620 192.168.100.9' 00:12:02.620 15:41:01 -- nvmf/common.sh@447 -- # tail -n +2 00:12:02.620 15:41:01 -- nvmf/common.sh@447 -- # head -n 1 00:12:02.620 15:41:01 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:12:02.620 15:41:01 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:12:02.620 15:41:01 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:12:02.620 15:41:01 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:12:02.620 15:41:01 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:12:02.620 15:41:01 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:12:02.620 15:41:01 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:12:02.620 15:41:01 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:12:02.620 15:41:01 -- common/autotest_common.sh@710 -- # xtrace_disable 00:12:02.620 15:41:01 -- common/autotest_common.sh@10 -- # set +x 00:12:02.620 15:41:01 -- nvmf/common.sh@470 -- # nvmfpid=3279413 00:12:02.620 15:41:01 -- nvmf/common.sh@471 -- # waitforlisten 3279413 00:12:02.620 15:41:01 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:12:02.620 15:41:01 -- common/autotest_common.sh@817 -- # '[' -z 3279413 ']' 00:12:02.620 15:41:01 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:02.620 15:41:01 -- common/autotest_common.sh@822 -- # local max_retries=100 00:12:02.620 15:41:01 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:02.620 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:02.620 15:41:01 -- common/autotest_common.sh@826 -- # xtrace_disable 00:12:02.620 15:41:01 -- common/autotest_common.sh@10 -- # set +x 00:12:02.620 [2024-04-26 15:41:01.209627] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:12:02.620 [2024-04-26 15:41:01.209670] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:02.880 EAL: No free 2048 kB hugepages reported on node 1 00:12:02.880 [2024-04-26 15:41:01.265416] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:02.880 [2024-04-26 15:41:01.344199] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:02.880 [2024-04-26 15:41:01.344236] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:02.880 [2024-04-26 15:41:01.344243] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:02.880 [2024-04-26 15:41:01.344248] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:02.880 [2024-04-26 15:41:01.344253] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:02.880 [2024-04-26 15:41:01.344324] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:02.880 [2024-04-26 15:41:01.344345] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:02.880 [2024-04-26 15:41:01.344432] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:02.880 [2024-04-26 15:41:01.344433] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:03.445 15:41:02 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:12:03.445 15:41:02 -- common/autotest_common.sh@850 -- # return 0 00:12:03.445 15:41:02 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:12:03.445 15:41:02 -- common/autotest_common.sh@716 -- # xtrace_disable 00:12:03.445 15:41:02 -- common/autotest_common.sh@10 -- # set +x 00:12:03.445 15:41:02 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:03.445 15:41:02 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:12:03.445 15:41:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:03.445 15:41:02 -- common/autotest_common.sh@10 -- # set +x 00:12:03.703 15:41:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:03.703 15:41:02 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:12:03.703 15:41:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:03.703 15:41:02 -- common/autotest_common.sh@10 -- # set +x 00:12:03.703 15:41:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:03.703 15:41:02 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:12:03.703 15:41:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:03.703 15:41:02 -- common/autotest_common.sh@10 -- # set +x 00:12:03.703 [2024-04-26 15:41:02.144015] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xf23180/0xf27670) succeed. 00:12:03.703 [2024-04-26 15:41:02.153917] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xf247c0/0xf68d00) succeed. 00:12:03.703 15:41:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:03.703 15:41:02 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:12:03.703 15:41:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:03.703 15:41:02 -- common/autotest_common.sh@10 -- # set +x 00:12:03.703 Malloc0 00:12:03.703 15:41:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:03.703 15:41:02 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:12:03.703 15:41:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:03.703 15:41:02 -- common/autotest_common.sh@10 -- # set +x 00:12:03.961 15:41:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:03.961 15:41:02 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:12:03.961 15:41:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:03.961 15:41:02 -- common/autotest_common.sh@10 -- # set +x 00:12:03.961 15:41:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:03.961 15:41:02 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:12:03.961 15:41:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:03.961 15:41:02 -- common/autotest_common.sh@10 -- # set +x 00:12:03.961 [2024-04-26 15:41:02.328363] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:12:03.961 15:41:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:03.961 15:41:02 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=3279654 00:12:03.961 15:41:02 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:12:03.961 15:41:02 -- target/bdev_io_wait.sh@30 -- # READ_PID=3279656 00:12:03.961 15:41:02 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:12:03.961 15:41:02 -- nvmf/common.sh@521 -- # config=() 00:12:03.961 15:41:02 -- nvmf/common.sh@521 -- # local subsystem config 00:12:03.961 15:41:02 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:12:03.961 15:41:02 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:12:03.961 { 00:12:03.961 "params": { 00:12:03.961 "name": "Nvme$subsystem", 00:12:03.961 "trtype": "$TEST_TRANSPORT", 00:12:03.961 "traddr": "$NVMF_FIRST_TARGET_IP", 00:12:03.961 "adrfam": "ipv4", 00:12:03.961 "trsvcid": "$NVMF_PORT", 00:12:03.961 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:12:03.961 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:12:03.961 "hdgst": ${hdgst:-false}, 00:12:03.961 "ddgst": ${ddgst:-false} 00:12:03.961 }, 00:12:03.961 "method": "bdev_nvme_attach_controller" 00:12:03.961 } 00:12:03.961 EOF 00:12:03.961 )") 00:12:03.961 15:41:02 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:12:03.961 15:41:02 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=3279658 00:12:03.961 15:41:02 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:12:03.961 15:41:02 -- nvmf/common.sh@521 -- # config=() 00:12:03.961 15:41:02 -- nvmf/common.sh@521 -- # local subsystem config 00:12:03.961 15:41:02 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:12:03.961 15:41:02 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:12:03.961 { 00:12:03.961 "params": { 00:12:03.961 "name": "Nvme$subsystem", 00:12:03.961 "trtype": "$TEST_TRANSPORT", 00:12:03.961 "traddr": "$NVMF_FIRST_TARGET_IP", 00:12:03.961 "adrfam": "ipv4", 00:12:03.961 "trsvcid": "$NVMF_PORT", 00:12:03.961 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:12:03.961 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:12:03.961 "hdgst": ${hdgst:-false}, 00:12:03.961 "ddgst": ${ddgst:-false} 00:12:03.961 }, 00:12:03.961 "method": "bdev_nvme_attach_controller" 00:12:03.961 } 00:12:03.961 EOF 00:12:03.961 )") 00:12:03.962 15:41:02 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:12:03.962 15:41:02 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=3279661 00:12:03.962 15:41:02 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:12:03.962 15:41:02 -- target/bdev_io_wait.sh@35 -- # sync 00:12:03.962 15:41:02 -- nvmf/common.sh@543 -- # cat 00:12:03.962 15:41:02 -- nvmf/common.sh@521 -- # config=() 00:12:03.962 15:41:02 -- nvmf/common.sh@521 -- # local subsystem config 00:12:03.962 15:41:02 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:12:03.962 15:41:02 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:12:03.962 { 00:12:03.962 "params": { 00:12:03.962 "name": "Nvme$subsystem", 00:12:03.962 "trtype": "$TEST_TRANSPORT", 00:12:03.962 "traddr": "$NVMF_FIRST_TARGET_IP", 00:12:03.962 "adrfam": "ipv4", 00:12:03.962 "trsvcid": "$NVMF_PORT", 00:12:03.962 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:12:03.962 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:12:03.962 "hdgst": ${hdgst:-false}, 00:12:03.962 "ddgst": ${ddgst:-false} 00:12:03.962 }, 00:12:03.962 "method": "bdev_nvme_attach_controller" 00:12:03.962 } 00:12:03.962 EOF 00:12:03.962 )") 00:12:03.962 15:41:02 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:12:03.962 15:41:02 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:12:03.962 15:41:02 -- nvmf/common.sh@521 -- # config=() 00:12:03.962 15:41:02 -- nvmf/common.sh@543 -- # cat 00:12:03.962 15:41:02 -- nvmf/common.sh@521 -- # local subsystem config 00:12:03.962 15:41:02 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:12:03.962 15:41:02 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:12:03.962 { 00:12:03.962 "params": { 00:12:03.962 "name": "Nvme$subsystem", 00:12:03.962 "trtype": "$TEST_TRANSPORT", 00:12:03.962 "traddr": "$NVMF_FIRST_TARGET_IP", 00:12:03.962 "adrfam": "ipv4", 00:12:03.962 "trsvcid": "$NVMF_PORT", 00:12:03.962 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:12:03.962 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:12:03.962 "hdgst": ${hdgst:-false}, 00:12:03.962 "ddgst": ${ddgst:-false} 00:12:03.962 }, 00:12:03.962 "method": "bdev_nvme_attach_controller" 00:12:03.962 } 00:12:03.962 EOF 00:12:03.962 )") 00:12:03.962 15:41:02 -- nvmf/common.sh@543 -- # cat 00:12:03.962 15:41:02 -- target/bdev_io_wait.sh@37 -- # wait 3279654 00:12:03.962 15:41:02 -- nvmf/common.sh@543 -- # cat 00:12:03.962 15:41:02 -- nvmf/common.sh@545 -- # jq . 00:12:03.962 15:41:02 -- nvmf/common.sh@545 -- # jq . 00:12:03.962 15:41:02 -- nvmf/common.sh@545 -- # jq . 00:12:03.962 15:41:02 -- nvmf/common.sh@546 -- # IFS=, 00:12:03.962 15:41:02 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:12:03.962 "params": { 00:12:03.962 "name": "Nvme1", 00:12:03.962 "trtype": "rdma", 00:12:03.962 "traddr": "192.168.100.8", 00:12:03.962 "adrfam": "ipv4", 00:12:03.962 "trsvcid": "4420", 00:12:03.962 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:12:03.962 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:12:03.962 "hdgst": false, 00:12:03.962 "ddgst": false 00:12:03.962 }, 00:12:03.962 "method": "bdev_nvme_attach_controller" 00:12:03.962 }' 00:12:03.962 15:41:02 -- nvmf/common.sh@545 -- # jq . 00:12:03.962 15:41:02 -- nvmf/common.sh@546 -- # IFS=, 00:12:03.962 15:41:02 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:12:03.962 "params": { 00:12:03.962 "name": "Nvme1", 00:12:03.962 "trtype": "rdma", 00:12:03.962 "traddr": "192.168.100.8", 00:12:03.962 "adrfam": "ipv4", 00:12:03.962 "trsvcid": "4420", 00:12:03.962 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:12:03.962 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:12:03.962 "hdgst": false, 00:12:03.962 "ddgst": false 00:12:03.962 }, 00:12:03.962 "method": "bdev_nvme_attach_controller" 00:12:03.962 }' 00:12:03.962 15:41:02 -- nvmf/common.sh@546 -- # IFS=, 00:12:03.962 15:41:02 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:12:03.962 "params": { 00:12:03.962 "name": "Nvme1", 00:12:03.962 "trtype": "rdma", 00:12:03.962 "traddr": "192.168.100.8", 00:12:03.962 "adrfam": "ipv4", 00:12:03.962 "trsvcid": "4420", 00:12:03.962 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:12:03.962 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:12:03.962 "hdgst": false, 00:12:03.962 "ddgst": false 00:12:03.962 }, 00:12:03.962 "method": "bdev_nvme_attach_controller" 00:12:03.962 }' 00:12:03.962 15:41:02 -- nvmf/common.sh@546 -- # IFS=, 00:12:03.962 15:41:02 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:12:03.962 "params": { 00:12:03.962 "name": "Nvme1", 00:12:03.962 "trtype": "rdma", 00:12:03.962 "traddr": "192.168.100.8", 00:12:03.962 "adrfam": "ipv4", 00:12:03.962 "trsvcid": "4420", 00:12:03.962 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:12:03.962 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:12:03.962 "hdgst": false, 00:12:03.962 "ddgst": false 00:12:03.962 }, 00:12:03.962 "method": "bdev_nvme_attach_controller" 00:12:03.962 }' 00:12:03.962 [2024-04-26 15:41:02.375728] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:12:03.962 [2024-04-26 15:41:02.375778] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:12:03.962 [2024-04-26 15:41:02.375844] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:12:03.962 [2024-04-26 15:41:02.375884] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:12:03.962 [2024-04-26 15:41:02.379679] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:12:03.962 [2024-04-26 15:41:02.379723] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:12:03.962 [2024-04-26 15:41:02.379721] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:12:03.962 [2024-04-26 15:41:02.379759] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:12:03.962 EAL: No free 2048 kB hugepages reported on node 1 00:12:03.962 EAL: No free 2048 kB hugepages reported on node 1 00:12:03.962 [2024-04-26 15:41:02.561774] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:04.219 EAL: No free 2048 kB hugepages reported on node 1 00:12:04.219 [2024-04-26 15:41:02.637209] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:12:04.219 [2024-04-26 15:41:02.662348] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:04.219 EAL: No free 2048 kB hugepages reported on node 1 00:12:04.219 [2024-04-26 15:41:02.718713] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:04.219 [2024-04-26 15:41:02.741454] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:12:04.219 [2024-04-26 15:41:02.774809] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:04.219 [2024-04-26 15:41:02.793691] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:12:04.478 [2024-04-26 15:41:02.849472] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:12:04.478 Running I/O for 1 seconds... 00:12:04.478 Running I/O for 1 seconds... 00:12:04.478 Running I/O for 1 seconds... 00:12:04.478 Running I/O for 1 seconds... 00:12:05.409 00:12:05.409 Latency(us) 00:12:05.409 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:12:05.409 Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:12:05.409 Nvme1n1 : 1.00 261648.16 1022.06 0.00 0.00 487.39 189.20 1880.26 00:12:05.409 =================================================================================================================== 00:12:05.409 Total : 261648.16 1022.06 0.00 0.00 487.39 189.20 1880.26 00:12:05.409 00:12:05.409 Latency(us) 00:12:05.409 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:12:05.409 Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:12:05.409 Nvme1n1 : 1.01 17740.95 69.30 0.00 0.00 7192.43 4337.86 13481.69 00:12:05.409 =================================================================================================================== 00:12:05.409 Total : 17740.95 69.30 0.00 0.00 7192.43 4337.86 13481.69 00:12:05.409 00:12:05.409 Latency(us) 00:12:05.409 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:12:05.409 Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:12:05.409 Nvme1n1 : 1.01 15260.45 59.61 0.00 0.00 8361.92 5149.26 18225.25 00:12:05.409 =================================================================================================================== 00:12:05.409 Total : 15260.45 59.61 0.00 0.00 8361.92 5149.26 18225.25 00:12:05.409 00:12:05.409 Latency(us) 00:12:05.409 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:12:05.409 Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:12:05.409 Nvme1n1 : 1.00 18593.14 72.63 0.00 0.00 6869.22 3386.03 17975.59 00:12:05.409 =================================================================================================================== 00:12:05.409 Total : 18593.14 72.63 0.00 0.00 6869.22 3386.03 17975.59 00:12:05.975 15:41:04 -- target/bdev_io_wait.sh@38 -- # wait 3279656 00:12:05.975 15:41:04 -- target/bdev_io_wait.sh@39 -- # wait 3279658 00:12:05.975 15:41:04 -- target/bdev_io_wait.sh@40 -- # wait 3279661 00:12:05.975 15:41:04 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:05.975 15:41:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:05.975 15:41:04 -- common/autotest_common.sh@10 -- # set +x 00:12:05.975 15:41:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:05.975 15:41:04 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:12:05.975 15:41:04 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:12:05.975 15:41:04 -- nvmf/common.sh@477 -- # nvmfcleanup 00:12:05.975 15:41:04 -- nvmf/common.sh@117 -- # sync 00:12:05.975 15:41:04 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:12:05.975 15:41:04 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:12:05.975 15:41:04 -- nvmf/common.sh@120 -- # set +e 00:12:05.975 15:41:04 -- nvmf/common.sh@121 -- # for i in {1..20} 00:12:05.975 15:41:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:12:05.975 rmmod nvme_rdma 00:12:05.975 rmmod nvme_fabrics 00:12:05.975 15:41:04 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:12:05.975 15:41:04 -- nvmf/common.sh@124 -- # set -e 00:12:05.975 15:41:04 -- nvmf/common.sh@125 -- # return 0 00:12:05.975 15:41:04 -- nvmf/common.sh@478 -- # '[' -n 3279413 ']' 00:12:05.975 15:41:04 -- nvmf/common.sh@479 -- # killprocess 3279413 00:12:05.975 15:41:04 -- common/autotest_common.sh@936 -- # '[' -z 3279413 ']' 00:12:05.975 15:41:04 -- common/autotest_common.sh@940 -- # kill -0 3279413 00:12:05.975 15:41:04 -- common/autotest_common.sh@941 -- # uname 00:12:05.975 15:41:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:05.975 15:41:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3279413 00:12:05.975 15:41:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:05.975 15:41:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:05.975 15:41:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3279413' 00:12:05.975 killing process with pid 3279413 00:12:05.975 15:41:04 -- common/autotest_common.sh@955 -- # kill 3279413 00:12:05.975 15:41:04 -- common/autotest_common.sh@960 -- # wait 3279413 00:12:05.975 [2024-04-26 15:41:04.472804] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:12:06.234 15:41:04 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:12:06.234 15:41:04 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:12:06.234 00:12:06.234 real 0m8.854s 00:12:06.234 user 0m20.387s 00:12:06.234 sys 0m5.162s 00:12:06.234 15:41:04 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:12:06.234 15:41:04 -- common/autotest_common.sh@10 -- # set +x 00:12:06.234 ************************************ 00:12:06.234 END TEST nvmf_bdev_io_wait 00:12:06.235 ************************************ 00:12:06.235 15:41:04 -- nvmf/nvmf.sh@51 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=rdma 00:12:06.235 15:41:04 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:06.235 15:41:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:06.235 15:41:04 -- common/autotest_common.sh@10 -- # set +x 00:12:06.494 ************************************ 00:12:06.494 START TEST nvmf_queue_depth 00:12:06.494 ************************************ 00:12:06.494 15:41:04 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=rdma 00:12:06.494 * Looking for test storage... 00:12:06.494 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:12:06.494 15:41:04 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:12:06.494 15:41:04 -- nvmf/common.sh@7 -- # uname -s 00:12:06.494 15:41:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:06.494 15:41:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:06.494 15:41:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:06.494 15:41:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:06.494 15:41:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:06.494 15:41:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:06.494 15:41:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:06.494 15:41:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:06.494 15:41:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:06.494 15:41:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:06.494 15:41:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:12:06.494 15:41:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:12:06.494 15:41:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:06.494 15:41:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:06.494 15:41:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:06.494 15:41:04 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:12:06.494 15:41:04 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:12:06.494 15:41:04 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:06.494 15:41:04 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:06.494 15:41:04 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:06.494 15:41:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:06.494 15:41:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:06.494 15:41:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:06.494 15:41:04 -- paths/export.sh@5 -- # export PATH 00:12:06.494 15:41:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:06.494 15:41:04 -- nvmf/common.sh@47 -- # : 0 00:12:06.494 15:41:04 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:12:06.494 15:41:04 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:12:06.494 15:41:04 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:12:06.494 15:41:04 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:06.494 15:41:04 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:06.494 15:41:04 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:12:06.494 15:41:04 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:12:06.494 15:41:04 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:12:06.494 15:41:04 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:12:06.494 15:41:04 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:12:06.494 15:41:04 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:12:06.494 15:41:04 -- target/queue_depth.sh@19 -- # nvmftestinit 00:12:06.494 15:41:04 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:12:06.494 15:41:04 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:06.494 15:41:04 -- nvmf/common.sh@437 -- # prepare_net_devs 00:12:06.494 15:41:04 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:12:06.494 15:41:04 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:12:06.494 15:41:04 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:06.494 15:41:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:06.494 15:41:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:06.494 15:41:04 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:12:06.494 15:41:04 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:12:06.494 15:41:04 -- nvmf/common.sh@285 -- # xtrace_disable 00:12:06.494 15:41:04 -- common/autotest_common.sh@10 -- # set +x 00:12:11.767 15:41:10 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:11.767 15:41:10 -- nvmf/common.sh@291 -- # pci_devs=() 00:12:11.767 15:41:10 -- nvmf/common.sh@291 -- # local -a pci_devs 00:12:11.767 15:41:10 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:12:11.767 15:41:10 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:12:11.767 15:41:10 -- nvmf/common.sh@293 -- # pci_drivers=() 00:12:11.767 15:41:10 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:12:11.767 15:41:10 -- nvmf/common.sh@295 -- # net_devs=() 00:12:11.767 15:41:10 -- nvmf/common.sh@295 -- # local -ga net_devs 00:12:11.767 15:41:10 -- nvmf/common.sh@296 -- # e810=() 00:12:11.767 15:41:10 -- nvmf/common.sh@296 -- # local -ga e810 00:12:11.767 15:41:10 -- nvmf/common.sh@297 -- # x722=() 00:12:11.767 15:41:10 -- nvmf/common.sh@297 -- # local -ga x722 00:12:11.767 15:41:10 -- nvmf/common.sh@298 -- # mlx=() 00:12:11.767 15:41:10 -- nvmf/common.sh@298 -- # local -ga mlx 00:12:11.767 15:41:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:11.767 15:41:10 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:11.767 15:41:10 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:11.767 15:41:10 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:11.767 15:41:10 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:11.767 15:41:10 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:11.767 15:41:10 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:11.767 15:41:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:11.767 15:41:10 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:11.767 15:41:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:11.767 15:41:10 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:11.767 15:41:10 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:12:11.767 15:41:10 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:12:11.767 15:41:10 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:12:11.767 15:41:10 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:12:11.767 15:41:10 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:12:11.767 15:41:10 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:12:11.767 15:41:10 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:12:11.767 15:41:10 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:11.767 15:41:10 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:12:11.767 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:12:11.767 15:41:10 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:11.767 15:41:10 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:11.767 15:41:10 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:12:11.767 15:41:10 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:12:11.767 15:41:10 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:11.767 15:41:10 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:11.767 15:41:10 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:11.767 15:41:10 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:12:11.767 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:12:11.767 15:41:10 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:11.767 15:41:10 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:11.767 15:41:10 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:12:11.767 15:41:10 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:12:11.767 15:41:10 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:11.767 15:41:10 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:11.767 15:41:10 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:12:11.767 15:41:10 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:12:11.767 15:41:10 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:11.767 15:41:10 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:11.767 15:41:10 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:11.767 15:41:10 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:11.767 15:41:10 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:12:11.767 Found net devices under 0000:da:00.0: mlx_0_0 00:12:11.767 15:41:10 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:11.767 15:41:10 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:11.767 15:41:10 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:11.767 15:41:10 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:11.767 15:41:10 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:11.767 15:41:10 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:12:11.767 Found net devices under 0000:da:00.1: mlx_0_1 00:12:11.767 15:41:10 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:11.767 15:41:10 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:12:11.767 15:41:10 -- nvmf/common.sh@403 -- # is_hw=yes 00:12:11.767 15:41:10 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:12:11.767 15:41:10 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:12:11.767 15:41:10 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:12:11.767 15:41:10 -- nvmf/common.sh@409 -- # rdma_device_init 00:12:11.767 15:41:10 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:12:11.767 15:41:10 -- nvmf/common.sh@58 -- # uname 00:12:11.767 15:41:10 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:12:11.767 15:41:10 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:12:11.767 15:41:10 -- nvmf/common.sh@63 -- # modprobe ib_core 00:12:11.767 15:41:10 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:12:11.767 15:41:10 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:12:11.767 15:41:10 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:12:11.767 15:41:10 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:12:11.767 15:41:10 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:12:11.767 15:41:10 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:12:11.767 15:41:10 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:12:11.767 15:41:10 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:12:11.767 15:41:10 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:11.767 15:41:10 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:11.767 15:41:10 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:11.767 15:41:10 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:11.767 15:41:10 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:11.767 15:41:10 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:11.767 15:41:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:11.767 15:41:10 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:11.767 15:41:10 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:11.767 15:41:10 -- nvmf/common.sh@105 -- # continue 2 00:12:11.767 15:41:10 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:11.767 15:41:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:11.767 15:41:10 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:11.767 15:41:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:11.767 15:41:10 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:11.767 15:41:10 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:11.767 15:41:10 -- nvmf/common.sh@105 -- # continue 2 00:12:11.767 15:41:10 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:11.767 15:41:10 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:12:11.767 15:41:10 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:11.767 15:41:10 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:11.767 15:41:10 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:11.767 15:41:10 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:11.767 15:41:10 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:12:11.767 15:41:10 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:12:11.767 15:41:10 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:12:11.767 118: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:11.767 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:12:11.767 altname enp218s0f0np0 00:12:11.767 altname ens818f0np0 00:12:11.767 inet 192.168.100.8/24 scope global mlx_0_0 00:12:11.767 valid_lft forever preferred_lft forever 00:12:11.767 15:41:10 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:11.767 15:41:10 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:12:11.767 15:41:10 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:11.767 15:41:10 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:11.767 15:41:10 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:11.767 15:41:10 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:11.767 15:41:10 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:12:11.767 15:41:10 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:12:11.767 15:41:10 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:12:11.767 119: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:11.767 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:12:11.768 altname enp218s0f1np1 00:12:11.768 altname ens818f1np1 00:12:11.768 inet 192.168.100.9/24 scope global mlx_0_1 00:12:11.768 valid_lft forever preferred_lft forever 00:12:11.768 15:41:10 -- nvmf/common.sh@411 -- # return 0 00:12:11.768 15:41:10 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:12:11.768 15:41:10 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:12:11.768 15:41:10 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:12:11.768 15:41:10 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:12:11.768 15:41:10 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:12:11.768 15:41:10 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:11.768 15:41:10 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:11.768 15:41:10 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:11.768 15:41:10 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:11.768 15:41:10 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:11.768 15:41:10 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:11.768 15:41:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:11.768 15:41:10 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:11.768 15:41:10 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:11.768 15:41:10 -- nvmf/common.sh@105 -- # continue 2 00:12:11.768 15:41:10 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:11.768 15:41:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:11.768 15:41:10 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:11.768 15:41:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:11.768 15:41:10 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:11.768 15:41:10 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:11.768 15:41:10 -- nvmf/common.sh@105 -- # continue 2 00:12:11.768 15:41:10 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:11.768 15:41:10 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:12:11.768 15:41:10 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:11.768 15:41:10 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:11.768 15:41:10 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:11.768 15:41:10 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:11.768 15:41:10 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:11.768 15:41:10 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:12:11.768 15:41:10 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:11.768 15:41:10 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:11.768 15:41:10 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:11.768 15:41:10 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:11.768 15:41:10 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:12:11.768 192.168.100.9' 00:12:11.768 15:41:10 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:12:11.768 192.168.100.9' 00:12:11.768 15:41:10 -- nvmf/common.sh@446 -- # head -n 1 00:12:11.768 15:41:10 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:12:11.768 15:41:10 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:12:11.768 192.168.100.9' 00:12:11.768 15:41:10 -- nvmf/common.sh@447 -- # tail -n +2 00:12:11.768 15:41:10 -- nvmf/common.sh@447 -- # head -n 1 00:12:11.768 15:41:10 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:12:11.768 15:41:10 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:12:11.768 15:41:10 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:12:11.768 15:41:10 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:12:11.768 15:41:10 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:12:11.768 15:41:10 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:12:11.768 15:41:10 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:12:11.768 15:41:10 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:12:11.768 15:41:10 -- common/autotest_common.sh@710 -- # xtrace_disable 00:12:11.768 15:41:10 -- common/autotest_common.sh@10 -- # set +x 00:12:11.768 15:41:10 -- nvmf/common.sh@470 -- # nvmfpid=3283199 00:12:11.768 15:41:10 -- nvmf/common.sh@471 -- # waitforlisten 3283199 00:12:11.768 15:41:10 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:12:11.768 15:41:10 -- common/autotest_common.sh@817 -- # '[' -z 3283199 ']' 00:12:11.768 15:41:10 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:11.768 15:41:10 -- common/autotest_common.sh@822 -- # local max_retries=100 00:12:11.768 15:41:10 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:11.768 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:11.768 15:41:10 -- common/autotest_common.sh@826 -- # xtrace_disable 00:12:11.768 15:41:10 -- common/autotest_common.sh@10 -- # set +x 00:12:11.768 [2024-04-26 15:41:10.361974] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:12:11.768 [2024-04-26 15:41:10.362016] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:12.026 EAL: No free 2048 kB hugepages reported on node 1 00:12:12.026 [2024-04-26 15:41:10.416152] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:12.026 [2024-04-26 15:41:10.490212] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:12.026 [2024-04-26 15:41:10.490249] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:12.026 [2024-04-26 15:41:10.490260] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:12.026 [2024-04-26 15:41:10.490266] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:12.026 [2024-04-26 15:41:10.490271] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:12.026 [2024-04-26 15:41:10.490292] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:12.593 15:41:11 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:12:12.593 15:41:11 -- common/autotest_common.sh@850 -- # return 0 00:12:12.593 15:41:11 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:12:12.593 15:41:11 -- common/autotest_common.sh@716 -- # xtrace_disable 00:12:12.593 15:41:11 -- common/autotest_common.sh@10 -- # set +x 00:12:12.593 15:41:11 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:12.593 15:41:11 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:12:12.593 15:41:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:12.593 15:41:11 -- common/autotest_common.sh@10 -- # set +x 00:12:12.851 [2024-04-26 15:41:11.213147] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x12b1270/0x12b5760) succeed. 00:12:12.851 [2024-04-26 15:41:11.222386] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x12b2770/0x12f6df0) succeed. 00:12:12.851 15:41:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:12.851 15:41:11 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:12:12.851 15:41:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:12.851 15:41:11 -- common/autotest_common.sh@10 -- # set +x 00:12:12.851 Malloc0 00:12:12.851 15:41:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:12.851 15:41:11 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:12:12.851 15:41:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:12.851 15:41:11 -- common/autotest_common.sh@10 -- # set +x 00:12:12.851 15:41:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:12.851 15:41:11 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:12:12.851 15:41:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:12.851 15:41:11 -- common/autotest_common.sh@10 -- # set +x 00:12:12.851 15:41:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:12.851 15:41:11 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:12:12.851 15:41:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:12.851 15:41:11 -- common/autotest_common.sh@10 -- # set +x 00:12:12.851 [2024-04-26 15:41:11.316091] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:12:12.851 15:41:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:12.851 15:41:11 -- target/queue_depth.sh@30 -- # bdevperf_pid=3283394 00:12:12.851 15:41:11 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:12:12.851 15:41:11 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:12:12.851 15:41:11 -- target/queue_depth.sh@33 -- # waitforlisten 3283394 /var/tmp/bdevperf.sock 00:12:12.851 15:41:11 -- common/autotest_common.sh@817 -- # '[' -z 3283394 ']' 00:12:12.851 15:41:11 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:12:12.851 15:41:11 -- common/autotest_common.sh@822 -- # local max_retries=100 00:12:12.851 15:41:11 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:12:12.852 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:12:12.852 15:41:11 -- common/autotest_common.sh@826 -- # xtrace_disable 00:12:12.852 15:41:11 -- common/autotest_common.sh@10 -- # set +x 00:12:12.852 [2024-04-26 15:41:11.351883] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:12:12.852 [2024-04-26 15:41:11.351920] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3283394 ] 00:12:12.852 EAL: No free 2048 kB hugepages reported on node 1 00:12:12.852 [2024-04-26 15:41:11.405974] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:13.109 [2024-04-26 15:41:11.483380] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:13.673 15:41:12 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:12:13.673 15:41:12 -- common/autotest_common.sh@850 -- # return 0 00:12:13.673 15:41:12 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:12:13.673 15:41:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:13.673 15:41:12 -- common/autotest_common.sh@10 -- # set +x 00:12:13.673 NVMe0n1 00:12:13.673 15:41:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:13.673 15:41:12 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:12:13.931 Running I/O for 10 seconds... 00:12:23.908 00:12:23.908 Latency(us) 00:12:23.908 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:12:23.908 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:12:23.908 Verification LBA range: start 0x0 length 0x4000 00:12:23.908 NVMe0n1 : 10.03 17756.63 69.36 0.00 0.00 57528.69 21845.33 38947.11 00:12:23.908 =================================================================================================================== 00:12:23.908 Total : 17756.63 69.36 0.00 0.00 57528.69 21845.33 38947.11 00:12:23.908 0 00:12:23.908 15:41:22 -- target/queue_depth.sh@39 -- # killprocess 3283394 00:12:23.908 15:41:22 -- common/autotest_common.sh@936 -- # '[' -z 3283394 ']' 00:12:23.908 15:41:22 -- common/autotest_common.sh@940 -- # kill -0 3283394 00:12:23.908 15:41:22 -- common/autotest_common.sh@941 -- # uname 00:12:23.908 15:41:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:23.908 15:41:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3283394 00:12:23.908 15:41:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:23.908 15:41:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:23.908 15:41:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3283394' 00:12:23.908 killing process with pid 3283394 00:12:23.908 15:41:22 -- common/autotest_common.sh@955 -- # kill 3283394 00:12:23.908 Received shutdown signal, test time was about 10.000000 seconds 00:12:23.908 00:12:23.908 Latency(us) 00:12:23.908 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:12:23.908 =================================================================================================================== 00:12:23.908 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:12:23.908 15:41:22 -- common/autotest_common.sh@960 -- # wait 3283394 00:12:24.167 15:41:22 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:12:24.167 15:41:22 -- target/queue_depth.sh@43 -- # nvmftestfini 00:12:24.167 15:41:22 -- nvmf/common.sh@477 -- # nvmfcleanup 00:12:24.167 15:41:22 -- nvmf/common.sh@117 -- # sync 00:12:24.167 15:41:22 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:12:24.167 15:41:22 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:12:24.167 15:41:22 -- nvmf/common.sh@120 -- # set +e 00:12:24.167 15:41:22 -- nvmf/common.sh@121 -- # for i in {1..20} 00:12:24.167 15:41:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:12:24.167 rmmod nvme_rdma 00:12:24.167 rmmod nvme_fabrics 00:12:24.167 15:41:22 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:12:24.167 15:41:22 -- nvmf/common.sh@124 -- # set -e 00:12:24.167 15:41:22 -- nvmf/common.sh@125 -- # return 0 00:12:24.167 15:41:22 -- nvmf/common.sh@478 -- # '[' -n 3283199 ']' 00:12:24.167 15:41:22 -- nvmf/common.sh@479 -- # killprocess 3283199 00:12:24.167 15:41:22 -- common/autotest_common.sh@936 -- # '[' -z 3283199 ']' 00:12:24.167 15:41:22 -- common/autotest_common.sh@940 -- # kill -0 3283199 00:12:24.167 15:41:22 -- common/autotest_common.sh@941 -- # uname 00:12:24.167 15:41:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:24.167 15:41:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3283199 00:12:24.167 15:41:22 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:12:24.167 15:41:22 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:12:24.167 15:41:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3283199' 00:12:24.167 killing process with pid 3283199 00:12:24.167 15:41:22 -- common/autotest_common.sh@955 -- # kill 3283199 00:12:24.167 15:41:22 -- common/autotest_common.sh@960 -- # wait 3283199 00:12:24.425 [2024-04-26 15:41:22.806238] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:12:24.425 15:41:23 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:12:24.425 15:41:23 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:12:24.425 00:12:24.425 real 0m18.177s 00:12:24.425 user 0m25.695s 00:12:24.425 sys 0m4.704s 00:12:24.425 15:41:23 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:12:24.425 15:41:23 -- common/autotest_common.sh@10 -- # set +x 00:12:24.425 ************************************ 00:12:24.425 END TEST nvmf_queue_depth 00:12:24.425 ************************************ 00:12:24.684 15:41:23 -- nvmf/nvmf.sh@52 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=rdma 00:12:24.684 15:41:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:24.684 15:41:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:24.684 15:41:23 -- common/autotest_common.sh@10 -- # set +x 00:12:24.684 ************************************ 00:12:24.684 START TEST nvmf_multipath 00:12:24.684 ************************************ 00:12:24.684 15:41:23 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=rdma 00:12:24.684 * Looking for test storage... 00:12:24.684 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:12:24.684 15:41:23 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:12:24.684 15:41:23 -- nvmf/common.sh@7 -- # uname -s 00:12:24.684 15:41:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:24.684 15:41:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:24.684 15:41:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:24.684 15:41:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:24.684 15:41:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:24.684 15:41:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:24.684 15:41:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:24.684 15:41:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:24.684 15:41:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:24.684 15:41:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:24.684 15:41:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:12:24.684 15:41:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:12:24.684 15:41:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:24.684 15:41:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:24.684 15:41:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:24.684 15:41:23 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:12:24.684 15:41:23 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:12:24.684 15:41:23 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:24.684 15:41:23 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:24.684 15:41:23 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:24.684 15:41:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:24.941 15:41:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:24.941 15:41:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:24.941 15:41:23 -- paths/export.sh@5 -- # export PATH 00:12:24.941 15:41:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:24.941 15:41:23 -- nvmf/common.sh@47 -- # : 0 00:12:24.941 15:41:23 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:12:24.941 15:41:23 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:12:24.941 15:41:23 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:12:24.941 15:41:23 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:24.941 15:41:23 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:24.941 15:41:23 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:12:24.941 15:41:23 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:12:24.941 15:41:23 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:12:24.941 15:41:23 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:12:24.941 15:41:23 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:12:24.941 15:41:23 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:12:24.941 15:41:23 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:12:24.941 15:41:23 -- target/multipath.sh@43 -- # nvmftestinit 00:12:24.941 15:41:23 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:12:24.941 15:41:23 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:24.941 15:41:23 -- nvmf/common.sh@437 -- # prepare_net_devs 00:12:24.941 15:41:23 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:12:24.941 15:41:23 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:12:24.941 15:41:23 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:24.941 15:41:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:24.941 15:41:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:24.941 15:41:23 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:12:24.941 15:41:23 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:12:24.941 15:41:23 -- nvmf/common.sh@285 -- # xtrace_disable 00:12:24.941 15:41:23 -- common/autotest_common.sh@10 -- # set +x 00:12:30.309 15:41:28 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:30.309 15:41:28 -- nvmf/common.sh@291 -- # pci_devs=() 00:12:30.309 15:41:28 -- nvmf/common.sh@291 -- # local -a pci_devs 00:12:30.309 15:41:28 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:12:30.309 15:41:28 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:12:30.309 15:41:28 -- nvmf/common.sh@293 -- # pci_drivers=() 00:12:30.309 15:41:28 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:12:30.309 15:41:28 -- nvmf/common.sh@295 -- # net_devs=() 00:12:30.309 15:41:28 -- nvmf/common.sh@295 -- # local -ga net_devs 00:12:30.309 15:41:28 -- nvmf/common.sh@296 -- # e810=() 00:12:30.309 15:41:28 -- nvmf/common.sh@296 -- # local -ga e810 00:12:30.309 15:41:28 -- nvmf/common.sh@297 -- # x722=() 00:12:30.309 15:41:28 -- nvmf/common.sh@297 -- # local -ga x722 00:12:30.309 15:41:28 -- nvmf/common.sh@298 -- # mlx=() 00:12:30.309 15:41:28 -- nvmf/common.sh@298 -- # local -ga mlx 00:12:30.309 15:41:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:30.309 15:41:28 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:30.309 15:41:28 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:30.309 15:41:28 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:30.309 15:41:28 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:30.309 15:41:28 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:30.309 15:41:28 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:30.309 15:41:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:30.309 15:41:28 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:30.309 15:41:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:30.309 15:41:28 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:30.309 15:41:28 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:12:30.309 15:41:28 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:12:30.309 15:41:28 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:12:30.309 15:41:28 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:12:30.309 15:41:28 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:12:30.309 15:41:28 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:12:30.309 15:41:28 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:12:30.309 15:41:28 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:30.309 15:41:28 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:12:30.309 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:12:30.309 15:41:28 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:30.309 15:41:28 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:30.309 15:41:28 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:12:30.309 15:41:28 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:12:30.309 15:41:28 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:30.309 15:41:28 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:30.310 15:41:28 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:30.310 15:41:28 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:12:30.310 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:12:30.310 15:41:28 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:30.310 15:41:28 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:30.310 15:41:28 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:12:30.310 15:41:28 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:12:30.310 15:41:28 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:30.310 15:41:28 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:30.310 15:41:28 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:12:30.310 15:41:28 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:12:30.310 15:41:28 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:30.310 15:41:28 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:30.310 15:41:28 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:30.310 15:41:28 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:30.310 15:41:28 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:12:30.310 Found net devices under 0000:da:00.0: mlx_0_0 00:12:30.310 15:41:28 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:30.310 15:41:28 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:30.310 15:41:28 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:30.310 15:41:28 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:30.310 15:41:28 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:30.310 15:41:28 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:12:30.310 Found net devices under 0000:da:00.1: mlx_0_1 00:12:30.310 15:41:28 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:30.310 15:41:28 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:12:30.310 15:41:28 -- nvmf/common.sh@403 -- # is_hw=yes 00:12:30.310 15:41:28 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:12:30.310 15:41:28 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:12:30.310 15:41:28 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:12:30.310 15:41:28 -- nvmf/common.sh@409 -- # rdma_device_init 00:12:30.310 15:41:28 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:12:30.310 15:41:28 -- nvmf/common.sh@58 -- # uname 00:12:30.310 15:41:28 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:12:30.310 15:41:28 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:12:30.310 15:41:28 -- nvmf/common.sh@63 -- # modprobe ib_core 00:12:30.310 15:41:28 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:12:30.310 15:41:28 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:12:30.310 15:41:28 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:12:30.310 15:41:28 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:12:30.310 15:41:28 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:12:30.310 15:41:28 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:12:30.310 15:41:28 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:12:30.310 15:41:28 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:12:30.310 15:41:28 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:30.310 15:41:28 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:30.310 15:41:28 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:30.310 15:41:28 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:30.310 15:41:28 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:30.310 15:41:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:30.310 15:41:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:30.310 15:41:28 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:30.310 15:41:28 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:30.310 15:41:28 -- nvmf/common.sh@105 -- # continue 2 00:12:30.310 15:41:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:30.310 15:41:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:30.310 15:41:28 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:30.310 15:41:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:30.310 15:41:28 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:30.310 15:41:28 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:30.310 15:41:28 -- nvmf/common.sh@105 -- # continue 2 00:12:30.310 15:41:28 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:30.310 15:41:28 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:12:30.310 15:41:28 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:30.310 15:41:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:30.310 15:41:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:30.310 15:41:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:30.310 15:41:28 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:12:30.310 15:41:28 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:12:30.310 15:41:28 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:12:30.310 118: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:30.310 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:12:30.310 altname enp218s0f0np0 00:12:30.310 altname ens818f0np0 00:12:30.310 inet 192.168.100.8/24 scope global mlx_0_0 00:12:30.310 valid_lft forever preferred_lft forever 00:12:30.310 15:41:28 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:30.310 15:41:28 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:12:30.310 15:41:28 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:30.310 15:41:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:30.310 15:41:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:30.310 15:41:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:30.310 15:41:28 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:12:30.310 15:41:28 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:12:30.310 15:41:28 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:12:30.310 119: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:30.310 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:12:30.310 altname enp218s0f1np1 00:12:30.310 altname ens818f1np1 00:12:30.310 inet 192.168.100.9/24 scope global mlx_0_1 00:12:30.310 valid_lft forever preferred_lft forever 00:12:30.310 15:41:28 -- nvmf/common.sh@411 -- # return 0 00:12:30.310 15:41:28 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:12:30.310 15:41:28 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:12:30.310 15:41:28 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:12:30.310 15:41:28 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:12:30.310 15:41:28 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:12:30.310 15:41:28 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:30.310 15:41:28 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:30.310 15:41:28 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:30.310 15:41:28 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:30.310 15:41:28 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:30.310 15:41:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:30.310 15:41:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:30.310 15:41:28 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:30.310 15:41:28 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:30.310 15:41:28 -- nvmf/common.sh@105 -- # continue 2 00:12:30.310 15:41:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:30.310 15:41:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:30.310 15:41:28 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:30.310 15:41:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:30.310 15:41:28 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:30.310 15:41:28 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:30.310 15:41:28 -- nvmf/common.sh@105 -- # continue 2 00:12:30.310 15:41:28 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:30.310 15:41:28 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:12:30.310 15:41:28 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:30.310 15:41:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:30.310 15:41:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:30.310 15:41:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:30.310 15:41:28 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:30.310 15:41:28 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:12:30.310 15:41:28 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:30.310 15:41:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:30.310 15:41:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:30.310 15:41:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:30.310 15:41:28 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:12:30.310 192.168.100.9' 00:12:30.310 15:41:28 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:12:30.310 192.168.100.9' 00:12:30.310 15:41:28 -- nvmf/common.sh@446 -- # head -n 1 00:12:30.310 15:41:28 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:12:30.310 15:41:28 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:12:30.310 192.168.100.9' 00:12:30.310 15:41:28 -- nvmf/common.sh@447 -- # head -n 1 00:12:30.310 15:41:28 -- nvmf/common.sh@447 -- # tail -n +2 00:12:30.310 15:41:28 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:12:30.310 15:41:28 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:12:30.310 15:41:28 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:12:30.310 15:41:28 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:12:30.310 15:41:28 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:12:30.310 15:41:28 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:12:30.310 15:41:28 -- target/multipath.sh@45 -- # '[' -z 192.168.100.9 ']' 00:12:30.310 15:41:28 -- target/multipath.sh@51 -- # '[' rdma '!=' tcp ']' 00:12:30.310 15:41:28 -- target/multipath.sh@52 -- # echo 'run this test only with TCP transport for now' 00:12:30.310 run this test only with TCP transport for now 00:12:30.310 15:41:28 -- target/multipath.sh@53 -- # nvmftestfini 00:12:30.310 15:41:28 -- nvmf/common.sh@477 -- # nvmfcleanup 00:12:30.310 15:41:28 -- nvmf/common.sh@117 -- # sync 00:12:30.310 15:41:28 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:12:30.310 15:41:28 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:12:30.310 15:41:28 -- nvmf/common.sh@120 -- # set +e 00:12:30.310 15:41:28 -- nvmf/common.sh@121 -- # for i in {1..20} 00:12:30.310 15:41:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:12:30.310 rmmod nvme_rdma 00:12:30.310 rmmod nvme_fabrics 00:12:30.310 15:41:28 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:12:30.310 15:41:28 -- nvmf/common.sh@124 -- # set -e 00:12:30.310 15:41:28 -- nvmf/common.sh@125 -- # return 0 00:12:30.310 15:41:28 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:12:30.310 15:41:28 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:12:30.310 15:41:28 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:12:30.310 15:41:28 -- target/multipath.sh@54 -- # exit 0 00:12:30.311 15:41:28 -- target/multipath.sh@1 -- # nvmftestfini 00:12:30.311 15:41:28 -- nvmf/common.sh@477 -- # nvmfcleanup 00:12:30.311 15:41:28 -- nvmf/common.sh@117 -- # sync 00:12:30.311 15:41:28 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:12:30.311 15:41:28 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:12:30.311 15:41:28 -- nvmf/common.sh@120 -- # set +e 00:12:30.311 15:41:28 -- nvmf/common.sh@121 -- # for i in {1..20} 00:12:30.311 15:41:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:12:30.311 15:41:28 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:12:30.311 15:41:28 -- nvmf/common.sh@124 -- # set -e 00:12:30.311 15:41:28 -- nvmf/common.sh@125 -- # return 0 00:12:30.311 15:41:28 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:12:30.311 15:41:28 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:12:30.311 15:41:28 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:12:30.311 00:12:30.311 real 0m5.479s 00:12:30.311 user 0m1.560s 00:12:30.311 sys 0m4.051s 00:12:30.311 15:41:28 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:12:30.311 15:41:28 -- common/autotest_common.sh@10 -- # set +x 00:12:30.311 ************************************ 00:12:30.311 END TEST nvmf_multipath 00:12:30.311 ************************************ 00:12:30.311 15:41:28 -- nvmf/nvmf.sh@53 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=rdma 00:12:30.311 15:41:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:30.311 15:41:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:30.311 15:41:28 -- common/autotest_common.sh@10 -- # set +x 00:12:30.311 ************************************ 00:12:30.311 START TEST nvmf_zcopy 00:12:30.311 ************************************ 00:12:30.311 15:41:28 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=rdma 00:12:30.570 * Looking for test storage... 00:12:30.570 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:12:30.570 15:41:28 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:12:30.570 15:41:28 -- nvmf/common.sh@7 -- # uname -s 00:12:30.570 15:41:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:30.570 15:41:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:30.570 15:41:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:30.570 15:41:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:30.570 15:41:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:30.570 15:41:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:30.570 15:41:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:30.570 15:41:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:30.570 15:41:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:30.570 15:41:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:30.570 15:41:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:12:30.570 15:41:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:12:30.570 15:41:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:30.570 15:41:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:30.570 15:41:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:30.570 15:41:28 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:12:30.571 15:41:28 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:12:30.571 15:41:28 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:30.571 15:41:28 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:30.571 15:41:28 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:30.571 15:41:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:30.571 15:41:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:30.571 15:41:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:30.571 15:41:28 -- paths/export.sh@5 -- # export PATH 00:12:30.571 15:41:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:30.571 15:41:28 -- nvmf/common.sh@47 -- # : 0 00:12:30.571 15:41:28 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:12:30.571 15:41:28 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:12:30.571 15:41:28 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:12:30.571 15:41:28 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:30.571 15:41:28 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:30.571 15:41:28 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:12:30.571 15:41:28 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:12:30.571 15:41:28 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:12:30.571 15:41:28 -- target/zcopy.sh@12 -- # nvmftestinit 00:12:30.571 15:41:28 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:12:30.571 15:41:28 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:30.571 15:41:28 -- nvmf/common.sh@437 -- # prepare_net_devs 00:12:30.571 15:41:28 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:12:30.571 15:41:28 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:12:30.571 15:41:28 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:30.571 15:41:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:30.571 15:41:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:30.571 15:41:28 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:12:30.571 15:41:28 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:12:30.571 15:41:28 -- nvmf/common.sh@285 -- # xtrace_disable 00:12:30.571 15:41:28 -- common/autotest_common.sh@10 -- # set +x 00:12:35.843 15:41:33 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:35.843 15:41:33 -- nvmf/common.sh@291 -- # pci_devs=() 00:12:35.843 15:41:33 -- nvmf/common.sh@291 -- # local -a pci_devs 00:12:35.843 15:41:33 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:12:35.843 15:41:33 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:12:35.843 15:41:33 -- nvmf/common.sh@293 -- # pci_drivers=() 00:12:35.843 15:41:33 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:12:35.843 15:41:33 -- nvmf/common.sh@295 -- # net_devs=() 00:12:35.843 15:41:33 -- nvmf/common.sh@295 -- # local -ga net_devs 00:12:35.843 15:41:33 -- nvmf/common.sh@296 -- # e810=() 00:12:35.843 15:41:33 -- nvmf/common.sh@296 -- # local -ga e810 00:12:35.843 15:41:33 -- nvmf/common.sh@297 -- # x722=() 00:12:35.843 15:41:33 -- nvmf/common.sh@297 -- # local -ga x722 00:12:35.843 15:41:33 -- nvmf/common.sh@298 -- # mlx=() 00:12:35.843 15:41:33 -- nvmf/common.sh@298 -- # local -ga mlx 00:12:35.843 15:41:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:35.843 15:41:34 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:35.843 15:41:34 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:35.843 15:41:34 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:35.843 15:41:34 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:35.843 15:41:34 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:35.843 15:41:34 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:35.843 15:41:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:35.843 15:41:34 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:35.843 15:41:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:35.843 15:41:34 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:35.843 15:41:34 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:12:35.843 15:41:34 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:12:35.843 15:41:34 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:12:35.843 15:41:34 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:12:35.843 15:41:34 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:12:35.843 15:41:34 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:12:35.843 15:41:34 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:12:35.843 15:41:34 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:35.843 15:41:34 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:12:35.843 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:12:35.843 15:41:34 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:35.843 15:41:34 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:35.843 15:41:34 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:12:35.843 15:41:34 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:12:35.843 15:41:34 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:35.843 15:41:34 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:35.843 15:41:34 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:35.843 15:41:34 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:12:35.843 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:12:35.843 15:41:34 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:35.843 15:41:34 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:35.843 15:41:34 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:12:35.843 15:41:34 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:12:35.843 15:41:34 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:35.843 15:41:34 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:35.843 15:41:34 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:12:35.843 15:41:34 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:12:35.843 15:41:34 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:35.843 15:41:34 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:35.843 15:41:34 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:35.843 15:41:34 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:35.843 15:41:34 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:12:35.843 Found net devices under 0000:da:00.0: mlx_0_0 00:12:35.843 15:41:34 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:35.843 15:41:34 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:35.843 15:41:34 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:35.843 15:41:34 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:35.843 15:41:34 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:35.843 15:41:34 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:12:35.843 Found net devices under 0000:da:00.1: mlx_0_1 00:12:35.843 15:41:34 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:35.843 15:41:34 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:12:35.843 15:41:34 -- nvmf/common.sh@403 -- # is_hw=yes 00:12:35.843 15:41:34 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:12:35.843 15:41:34 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:12:35.843 15:41:34 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:12:35.843 15:41:34 -- nvmf/common.sh@409 -- # rdma_device_init 00:12:35.843 15:41:34 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:12:35.843 15:41:34 -- nvmf/common.sh@58 -- # uname 00:12:35.843 15:41:34 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:12:35.843 15:41:34 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:12:35.843 15:41:34 -- nvmf/common.sh@63 -- # modprobe ib_core 00:12:35.843 15:41:34 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:12:35.843 15:41:34 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:12:35.843 15:41:34 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:12:35.843 15:41:34 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:12:35.843 15:41:34 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:12:35.843 15:41:34 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:12:35.843 15:41:34 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:12:35.843 15:41:34 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:12:35.843 15:41:34 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:35.843 15:41:34 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:35.843 15:41:34 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:35.843 15:41:34 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:35.843 15:41:34 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:35.843 15:41:34 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:35.843 15:41:34 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:35.843 15:41:34 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:35.843 15:41:34 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:35.843 15:41:34 -- nvmf/common.sh@105 -- # continue 2 00:12:35.843 15:41:34 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:35.843 15:41:34 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:35.843 15:41:34 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:35.843 15:41:34 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:35.843 15:41:34 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:35.843 15:41:34 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:35.843 15:41:34 -- nvmf/common.sh@105 -- # continue 2 00:12:35.843 15:41:34 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:35.843 15:41:34 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:12:35.843 15:41:34 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:35.843 15:41:34 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:35.843 15:41:34 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:35.843 15:41:34 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:35.843 15:41:34 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:12:35.843 15:41:34 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:12:35.843 15:41:34 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:12:35.843 118: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:35.843 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:12:35.843 altname enp218s0f0np0 00:12:35.843 altname ens818f0np0 00:12:35.843 inet 192.168.100.8/24 scope global mlx_0_0 00:12:35.843 valid_lft forever preferred_lft forever 00:12:35.843 15:41:34 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:35.843 15:41:34 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:12:35.843 15:41:34 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:35.843 15:41:34 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:35.843 15:41:34 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:35.843 15:41:34 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:35.843 15:41:34 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:12:35.843 15:41:34 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:12:35.843 15:41:34 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:12:35.843 119: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:35.843 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:12:35.843 altname enp218s0f1np1 00:12:35.843 altname ens818f1np1 00:12:35.843 inet 192.168.100.9/24 scope global mlx_0_1 00:12:35.843 valid_lft forever preferred_lft forever 00:12:35.843 15:41:34 -- nvmf/common.sh@411 -- # return 0 00:12:35.844 15:41:34 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:12:35.844 15:41:34 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:12:35.844 15:41:34 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:12:35.844 15:41:34 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:12:35.844 15:41:34 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:12:35.844 15:41:34 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:35.844 15:41:34 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:35.844 15:41:34 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:35.844 15:41:34 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:35.844 15:41:34 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:35.844 15:41:34 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:35.844 15:41:34 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:35.844 15:41:34 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:35.844 15:41:34 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:35.844 15:41:34 -- nvmf/common.sh@105 -- # continue 2 00:12:35.844 15:41:34 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:35.844 15:41:34 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:35.844 15:41:34 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:35.844 15:41:34 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:35.844 15:41:34 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:35.844 15:41:34 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:35.844 15:41:34 -- nvmf/common.sh@105 -- # continue 2 00:12:35.844 15:41:34 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:35.844 15:41:34 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:12:35.844 15:41:34 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:35.844 15:41:34 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:35.844 15:41:34 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:35.844 15:41:34 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:35.844 15:41:34 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:35.844 15:41:34 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:12:35.844 15:41:34 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:35.844 15:41:34 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:35.844 15:41:34 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:35.844 15:41:34 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:35.844 15:41:34 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:12:35.844 192.168.100.9' 00:12:35.844 15:41:34 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:12:35.844 192.168.100.9' 00:12:35.844 15:41:34 -- nvmf/common.sh@446 -- # head -n 1 00:12:35.844 15:41:34 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:12:35.844 15:41:34 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:12:35.844 192.168.100.9' 00:12:35.844 15:41:34 -- nvmf/common.sh@447 -- # tail -n +2 00:12:35.844 15:41:34 -- nvmf/common.sh@447 -- # head -n 1 00:12:35.844 15:41:34 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:12:35.844 15:41:34 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:12:35.844 15:41:34 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:12:35.844 15:41:34 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:12:35.844 15:41:34 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:12:35.844 15:41:34 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:12:35.844 15:41:34 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:12:35.844 15:41:34 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:12:35.844 15:41:34 -- common/autotest_common.sh@710 -- # xtrace_disable 00:12:35.844 15:41:34 -- common/autotest_common.sh@10 -- # set +x 00:12:35.844 15:41:34 -- nvmf/common.sh@470 -- # nvmfpid=3291412 00:12:35.844 15:41:34 -- nvmf/common.sh@471 -- # waitforlisten 3291412 00:12:35.844 15:41:34 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:12:35.844 15:41:34 -- common/autotest_common.sh@817 -- # '[' -z 3291412 ']' 00:12:35.844 15:41:34 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:35.844 15:41:34 -- common/autotest_common.sh@822 -- # local max_retries=100 00:12:35.844 15:41:34 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:35.844 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:35.844 15:41:34 -- common/autotest_common.sh@826 -- # xtrace_disable 00:12:35.844 15:41:34 -- common/autotest_common.sh@10 -- # set +x 00:12:35.844 [2024-04-26 15:41:34.259923] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:12:35.844 [2024-04-26 15:41:34.259966] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:35.844 EAL: No free 2048 kB hugepages reported on node 1 00:12:35.844 [2024-04-26 15:41:34.312908] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:35.844 [2024-04-26 15:41:34.386543] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:35.844 [2024-04-26 15:41:34.386578] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:35.844 [2024-04-26 15:41:34.386584] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:35.844 [2024-04-26 15:41:34.386590] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:35.844 [2024-04-26 15:41:34.386595] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:35.844 [2024-04-26 15:41:34.386616] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:36.779 15:41:35 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:12:36.779 15:41:35 -- common/autotest_common.sh@850 -- # return 0 00:12:36.779 15:41:35 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:12:36.779 15:41:35 -- common/autotest_common.sh@716 -- # xtrace_disable 00:12:36.779 15:41:35 -- common/autotest_common.sh@10 -- # set +x 00:12:36.779 15:41:35 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:36.779 15:41:35 -- target/zcopy.sh@15 -- # '[' rdma '!=' tcp ']' 00:12:36.779 15:41:35 -- target/zcopy.sh@16 -- # echo 'Unsupported transport: rdma' 00:12:36.779 Unsupported transport: rdma 00:12:36.779 15:41:35 -- target/zcopy.sh@17 -- # exit 0 00:12:36.779 15:41:35 -- target/zcopy.sh@1 -- # process_shm --id 0 00:12:36.779 15:41:35 -- common/autotest_common.sh@794 -- # type=--id 00:12:36.779 15:41:35 -- common/autotest_common.sh@795 -- # id=0 00:12:36.779 15:41:35 -- common/autotest_common.sh@796 -- # '[' --id = --pid ']' 00:12:36.779 15:41:35 -- common/autotest_common.sh@800 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:12:36.779 15:41:35 -- common/autotest_common.sh@800 -- # shm_files=nvmf_trace.0 00:12:36.779 15:41:35 -- common/autotest_common.sh@802 -- # [[ -z nvmf_trace.0 ]] 00:12:36.779 15:41:35 -- common/autotest_common.sh@806 -- # for n in $shm_files 00:12:36.779 15:41:35 -- common/autotest_common.sh@807 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:12:36.779 nvmf_trace.0 00:12:36.779 15:41:35 -- common/autotest_common.sh@809 -- # return 0 00:12:36.779 15:41:35 -- target/zcopy.sh@1 -- # nvmftestfini 00:12:36.779 15:41:35 -- nvmf/common.sh@477 -- # nvmfcleanup 00:12:36.779 15:41:35 -- nvmf/common.sh@117 -- # sync 00:12:36.779 15:41:35 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:12:36.779 15:41:35 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:12:36.779 15:41:35 -- nvmf/common.sh@120 -- # set +e 00:12:36.779 15:41:35 -- nvmf/common.sh@121 -- # for i in {1..20} 00:12:36.779 15:41:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:12:36.779 rmmod nvme_rdma 00:12:36.779 rmmod nvme_fabrics 00:12:36.779 15:41:35 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:12:36.779 15:41:35 -- nvmf/common.sh@124 -- # set -e 00:12:36.779 15:41:35 -- nvmf/common.sh@125 -- # return 0 00:12:36.779 15:41:35 -- nvmf/common.sh@478 -- # '[' -n 3291412 ']' 00:12:36.779 15:41:35 -- nvmf/common.sh@479 -- # killprocess 3291412 00:12:36.779 15:41:35 -- common/autotest_common.sh@936 -- # '[' -z 3291412 ']' 00:12:36.779 15:41:35 -- common/autotest_common.sh@940 -- # kill -0 3291412 00:12:36.779 15:41:35 -- common/autotest_common.sh@941 -- # uname 00:12:36.779 15:41:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:36.779 15:41:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3291412 00:12:36.779 15:41:35 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:12:36.779 15:41:35 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:12:36.779 15:41:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3291412' 00:12:36.779 killing process with pid 3291412 00:12:36.779 15:41:35 -- common/autotest_common.sh@955 -- # kill 3291412 00:12:36.779 15:41:35 -- common/autotest_common.sh@960 -- # wait 3291412 00:12:37.037 15:41:35 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:12:37.037 15:41:35 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:12:37.037 00:12:37.037 real 0m6.580s 00:12:37.037 user 0m2.882s 00:12:37.037 sys 0m4.263s 00:12:37.037 15:41:35 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:12:37.037 15:41:35 -- common/autotest_common.sh@10 -- # set +x 00:12:37.037 ************************************ 00:12:37.037 END TEST nvmf_zcopy 00:12:37.037 ************************************ 00:12:37.037 15:41:35 -- nvmf/nvmf.sh@54 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=rdma 00:12:37.037 15:41:35 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:37.037 15:41:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:37.037 15:41:35 -- common/autotest_common.sh@10 -- # set +x 00:12:37.037 ************************************ 00:12:37.037 START TEST nvmf_nmic 00:12:37.037 ************************************ 00:12:37.037 15:41:35 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=rdma 00:12:37.295 * Looking for test storage... 00:12:37.295 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:12:37.295 15:41:35 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:12:37.295 15:41:35 -- nvmf/common.sh@7 -- # uname -s 00:12:37.295 15:41:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:37.295 15:41:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:37.295 15:41:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:37.295 15:41:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:37.295 15:41:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:37.295 15:41:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:37.295 15:41:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:37.295 15:41:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:37.295 15:41:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:37.295 15:41:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:37.295 15:41:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:12:37.295 15:41:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:12:37.295 15:41:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:37.295 15:41:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:37.295 15:41:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:37.295 15:41:35 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:12:37.295 15:41:35 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:12:37.295 15:41:35 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:37.295 15:41:35 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:37.295 15:41:35 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:37.295 15:41:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:37.295 15:41:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:37.296 15:41:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:37.296 15:41:35 -- paths/export.sh@5 -- # export PATH 00:12:37.296 15:41:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:37.296 15:41:35 -- nvmf/common.sh@47 -- # : 0 00:12:37.296 15:41:35 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:12:37.296 15:41:35 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:12:37.296 15:41:35 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:12:37.296 15:41:35 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:37.296 15:41:35 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:37.296 15:41:35 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:12:37.296 15:41:35 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:12:37.296 15:41:35 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:12:37.296 15:41:35 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:12:37.296 15:41:35 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:12:37.296 15:41:35 -- target/nmic.sh@14 -- # nvmftestinit 00:12:37.296 15:41:35 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:12:37.296 15:41:35 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:37.296 15:41:35 -- nvmf/common.sh@437 -- # prepare_net_devs 00:12:37.296 15:41:35 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:12:37.296 15:41:35 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:12:37.296 15:41:35 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:37.296 15:41:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:37.296 15:41:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:37.296 15:41:35 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:12:37.296 15:41:35 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:12:37.296 15:41:35 -- nvmf/common.sh@285 -- # xtrace_disable 00:12:37.296 15:41:35 -- common/autotest_common.sh@10 -- # set +x 00:12:42.563 15:41:40 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:42.563 15:41:40 -- nvmf/common.sh@291 -- # pci_devs=() 00:12:42.563 15:41:40 -- nvmf/common.sh@291 -- # local -a pci_devs 00:12:42.563 15:41:40 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:12:42.563 15:41:40 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:12:42.563 15:41:40 -- nvmf/common.sh@293 -- # pci_drivers=() 00:12:42.563 15:41:40 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:12:42.563 15:41:40 -- nvmf/common.sh@295 -- # net_devs=() 00:12:42.563 15:41:40 -- nvmf/common.sh@295 -- # local -ga net_devs 00:12:42.563 15:41:40 -- nvmf/common.sh@296 -- # e810=() 00:12:42.563 15:41:40 -- nvmf/common.sh@296 -- # local -ga e810 00:12:42.563 15:41:40 -- nvmf/common.sh@297 -- # x722=() 00:12:42.563 15:41:40 -- nvmf/common.sh@297 -- # local -ga x722 00:12:42.563 15:41:40 -- nvmf/common.sh@298 -- # mlx=() 00:12:42.563 15:41:40 -- nvmf/common.sh@298 -- # local -ga mlx 00:12:42.563 15:41:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:42.563 15:41:40 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:42.563 15:41:40 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:42.563 15:41:40 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:42.563 15:41:40 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:42.563 15:41:40 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:42.563 15:41:40 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:42.563 15:41:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:42.563 15:41:40 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:42.563 15:41:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:42.563 15:41:40 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:42.563 15:41:40 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:12:42.563 15:41:40 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:12:42.563 15:41:40 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:12:42.563 15:41:40 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:12:42.563 15:41:40 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:12:42.563 15:41:40 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:12:42.563 15:41:40 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:12:42.563 15:41:40 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:42.563 15:41:40 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:12:42.563 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:12:42.563 15:41:40 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:42.563 15:41:40 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:42.563 15:41:40 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:12:42.563 15:41:40 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:12:42.563 15:41:40 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:42.563 15:41:40 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:42.563 15:41:40 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:42.563 15:41:40 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:12:42.563 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:12:42.563 15:41:40 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:42.563 15:41:40 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:42.563 15:41:40 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:12:42.563 15:41:40 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:12:42.563 15:41:40 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:42.563 15:41:40 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:42.563 15:41:40 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:12:42.563 15:41:40 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:12:42.563 15:41:40 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:42.563 15:41:40 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:42.563 15:41:40 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:42.563 15:41:40 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:42.563 15:41:40 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:12:42.563 Found net devices under 0000:da:00.0: mlx_0_0 00:12:42.563 15:41:40 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:42.563 15:41:40 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:42.563 15:41:40 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:42.563 15:41:40 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:42.564 15:41:40 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:42.564 15:41:40 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:12:42.564 Found net devices under 0000:da:00.1: mlx_0_1 00:12:42.564 15:41:40 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:42.564 15:41:40 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:12:42.564 15:41:40 -- nvmf/common.sh@403 -- # is_hw=yes 00:12:42.564 15:41:40 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:12:42.564 15:41:40 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:12:42.564 15:41:40 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:12:42.564 15:41:40 -- nvmf/common.sh@409 -- # rdma_device_init 00:12:42.564 15:41:40 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:12:42.564 15:41:40 -- nvmf/common.sh@58 -- # uname 00:12:42.564 15:41:40 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:12:42.564 15:41:40 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:12:42.564 15:41:40 -- nvmf/common.sh@63 -- # modprobe ib_core 00:12:42.564 15:41:40 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:12:42.564 15:41:40 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:12:42.564 15:41:40 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:12:42.564 15:41:40 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:12:42.564 15:41:40 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:12:42.564 15:41:40 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:12:42.564 15:41:40 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:12:42.564 15:41:40 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:12:42.564 15:41:40 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:42.564 15:41:40 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:42.564 15:41:40 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:42.564 15:41:40 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:42.564 15:41:41 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:42.564 15:41:41 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:42.564 15:41:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:42.564 15:41:41 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:42.564 15:41:41 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:42.564 15:41:41 -- nvmf/common.sh@105 -- # continue 2 00:12:42.564 15:41:41 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:42.564 15:41:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:42.564 15:41:41 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:42.564 15:41:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:42.564 15:41:41 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:42.564 15:41:41 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:42.564 15:41:41 -- nvmf/common.sh@105 -- # continue 2 00:12:42.564 15:41:41 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:42.564 15:41:41 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:12:42.564 15:41:41 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:42.564 15:41:41 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:42.564 15:41:41 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:42.564 15:41:41 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:42.564 15:41:41 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:12:42.564 15:41:41 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:12:42.564 15:41:41 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:12:42.564 118: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:42.564 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:12:42.564 altname enp218s0f0np0 00:12:42.564 altname ens818f0np0 00:12:42.564 inet 192.168.100.8/24 scope global mlx_0_0 00:12:42.564 valid_lft forever preferred_lft forever 00:12:42.564 15:41:41 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:42.564 15:41:41 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:12:42.564 15:41:41 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:42.564 15:41:41 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:42.564 15:41:41 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:42.564 15:41:41 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:42.564 15:41:41 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:12:42.564 15:41:41 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:12:42.564 15:41:41 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:12:42.564 119: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:42.564 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:12:42.564 altname enp218s0f1np1 00:12:42.564 altname ens818f1np1 00:12:42.564 inet 192.168.100.9/24 scope global mlx_0_1 00:12:42.564 valid_lft forever preferred_lft forever 00:12:42.564 15:41:41 -- nvmf/common.sh@411 -- # return 0 00:12:42.564 15:41:41 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:12:42.564 15:41:41 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:12:42.564 15:41:41 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:12:42.564 15:41:41 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:12:42.564 15:41:41 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:12:42.564 15:41:41 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:42.564 15:41:41 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:42.564 15:41:41 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:42.564 15:41:41 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:42.564 15:41:41 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:42.564 15:41:41 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:42.564 15:41:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:42.564 15:41:41 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:42.564 15:41:41 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:42.564 15:41:41 -- nvmf/common.sh@105 -- # continue 2 00:12:42.564 15:41:41 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:42.564 15:41:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:42.564 15:41:41 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:42.564 15:41:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:42.564 15:41:41 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:42.564 15:41:41 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:42.564 15:41:41 -- nvmf/common.sh@105 -- # continue 2 00:12:42.564 15:41:41 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:42.564 15:41:41 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:12:42.564 15:41:41 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:42.564 15:41:41 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:42.564 15:41:41 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:42.564 15:41:41 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:42.564 15:41:41 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:42.564 15:41:41 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:12:42.564 15:41:41 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:42.564 15:41:41 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:42.564 15:41:41 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:42.564 15:41:41 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:42.564 15:41:41 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:12:42.564 192.168.100.9' 00:12:42.564 15:41:41 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:12:42.564 192.168.100.9' 00:12:42.564 15:41:41 -- nvmf/common.sh@446 -- # head -n 1 00:12:42.564 15:41:41 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:12:42.564 15:41:41 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:12:42.564 192.168.100.9' 00:12:42.564 15:41:41 -- nvmf/common.sh@447 -- # tail -n +2 00:12:42.564 15:41:41 -- nvmf/common.sh@447 -- # head -n 1 00:12:42.564 15:41:41 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:12:42.564 15:41:41 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:12:42.564 15:41:41 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:12:42.564 15:41:41 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:12:42.564 15:41:41 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:12:42.564 15:41:41 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:12:42.564 15:41:41 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:12:42.564 15:41:41 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:12:42.564 15:41:41 -- common/autotest_common.sh@710 -- # xtrace_disable 00:12:42.564 15:41:41 -- common/autotest_common.sh@10 -- # set +x 00:12:42.564 15:41:41 -- nvmf/common.sh@470 -- # nvmfpid=3294727 00:12:42.564 15:41:41 -- nvmf/common.sh@471 -- # waitforlisten 3294727 00:12:42.564 15:41:41 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:42.564 15:41:41 -- common/autotest_common.sh@817 -- # '[' -z 3294727 ']' 00:12:42.564 15:41:41 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:42.564 15:41:41 -- common/autotest_common.sh@822 -- # local max_retries=100 00:12:42.565 15:41:41 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:42.565 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:42.565 15:41:41 -- common/autotest_common.sh@826 -- # xtrace_disable 00:12:42.565 15:41:41 -- common/autotest_common.sh@10 -- # set +x 00:12:42.822 [2024-04-26 15:41:41.183026] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:12:42.823 [2024-04-26 15:41:41.183070] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:42.823 EAL: No free 2048 kB hugepages reported on node 1 00:12:42.823 [2024-04-26 15:41:41.238206] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:42.823 [2024-04-26 15:41:41.309228] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:42.823 [2024-04-26 15:41:41.309270] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:42.823 [2024-04-26 15:41:41.309277] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:42.823 [2024-04-26 15:41:41.309283] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:42.823 [2024-04-26 15:41:41.309287] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:42.823 [2024-04-26 15:41:41.309352] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:42.823 [2024-04-26 15:41:41.309373] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:42.823 [2024-04-26 15:41:41.309461] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:42.823 [2024-04-26 15:41:41.309462] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:43.755 15:41:41 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:12:43.755 15:41:41 -- common/autotest_common.sh@850 -- # return 0 00:12:43.755 15:41:41 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:12:43.755 15:41:41 -- common/autotest_common.sh@716 -- # xtrace_disable 00:12:43.755 15:41:41 -- common/autotest_common.sh@10 -- # set +x 00:12:43.755 15:41:42 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:43.755 15:41:42 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:12:43.755 15:41:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:43.755 15:41:42 -- common/autotest_common.sh@10 -- # set +x 00:12:43.755 [2024-04-26 15:41:42.054852] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x541100/0x5455f0) succeed. 00:12:43.755 [2024-04-26 15:41:42.064940] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x542740/0x586c80) succeed. 00:12:43.755 15:41:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:43.755 15:41:42 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:12:43.755 15:41:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:43.755 15:41:42 -- common/autotest_common.sh@10 -- # set +x 00:12:43.755 Malloc0 00:12:43.755 15:41:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:43.755 15:41:42 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:12:43.755 15:41:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:43.755 15:41:42 -- common/autotest_common.sh@10 -- # set +x 00:12:43.755 15:41:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:43.755 15:41:42 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:12:43.755 15:41:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:43.755 15:41:42 -- common/autotest_common.sh@10 -- # set +x 00:12:43.755 15:41:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:43.755 15:41:42 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:12:43.755 15:41:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:43.755 15:41:42 -- common/autotest_common.sh@10 -- # set +x 00:12:43.755 [2024-04-26 15:41:42.230046] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:12:43.755 15:41:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:43.755 15:41:42 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:12:43.755 test case1: single bdev can't be used in multiple subsystems 00:12:43.755 15:41:42 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:12:43.755 15:41:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:43.755 15:41:42 -- common/autotest_common.sh@10 -- # set +x 00:12:43.755 15:41:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:43.755 15:41:42 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t rdma -a 192.168.100.8 -s 4420 00:12:43.755 15:41:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:43.755 15:41:42 -- common/autotest_common.sh@10 -- # set +x 00:12:43.755 15:41:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:43.755 15:41:42 -- target/nmic.sh@28 -- # nmic_status=0 00:12:43.755 15:41:42 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:12:43.755 15:41:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:43.755 15:41:42 -- common/autotest_common.sh@10 -- # set +x 00:12:43.755 [2024-04-26 15:41:42.253812] bdev.c:8005:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:12:43.755 [2024-04-26 15:41:42.253830] subsystem.c:1940:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:12:43.755 [2024-04-26 15:41:42.253838] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:12:43.755 request: 00:12:43.755 { 00:12:43.755 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:12:43.755 "namespace": { 00:12:43.755 "bdev_name": "Malloc0", 00:12:43.755 "no_auto_visible": false 00:12:43.755 }, 00:12:43.755 "method": "nvmf_subsystem_add_ns", 00:12:43.755 "req_id": 1 00:12:43.755 } 00:12:43.756 Got JSON-RPC error response 00:12:43.756 response: 00:12:43.756 { 00:12:43.756 "code": -32602, 00:12:43.756 "message": "Invalid parameters" 00:12:43.756 } 00:12:43.756 15:41:42 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:12:43.756 15:41:42 -- target/nmic.sh@29 -- # nmic_status=1 00:12:43.756 15:41:42 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:12:43.756 15:41:42 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:12:43.756 Adding namespace failed - expected result. 00:12:43.756 15:41:42 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:12:43.756 test case2: host connect to nvmf target in multiple paths 00:12:43.756 15:41:42 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4421 00:12:43.756 15:41:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:12:43.756 15:41:42 -- common/autotest_common.sh@10 -- # set +x 00:12:43.756 [2024-04-26 15:41:42.265875] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4421 *** 00:12:43.756 15:41:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:12:43.756 15:41:42 -- target/nmic.sh@41 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:12:44.688 15:41:43 -- target/nmic.sh@42 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4421 00:12:45.618 15:41:44 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:12:45.618 15:41:44 -- common/autotest_common.sh@1184 -- # local i=0 00:12:45.618 15:41:44 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:12:45.618 15:41:44 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:12:45.618 15:41:44 -- common/autotest_common.sh@1191 -- # sleep 2 00:12:48.143 15:41:46 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:12:48.143 15:41:46 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:12:48.143 15:41:46 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:12:48.143 15:41:46 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:12:48.143 15:41:46 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:12:48.143 15:41:46 -- common/autotest_common.sh@1194 -- # return 0 00:12:48.143 15:41:46 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:12:48.143 [global] 00:12:48.143 thread=1 00:12:48.143 invalidate=1 00:12:48.143 rw=write 00:12:48.143 time_based=1 00:12:48.143 runtime=1 00:12:48.143 ioengine=libaio 00:12:48.143 direct=1 00:12:48.143 bs=4096 00:12:48.143 iodepth=1 00:12:48.143 norandommap=0 00:12:48.143 numjobs=1 00:12:48.143 00:12:48.143 verify_dump=1 00:12:48.143 verify_backlog=512 00:12:48.143 verify_state_save=0 00:12:48.143 do_verify=1 00:12:48.143 verify=crc32c-intel 00:12:48.143 [job0] 00:12:48.143 filename=/dev/nvme0n1 00:12:48.143 Could not set queue depth (nvme0n1) 00:12:48.143 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:12:48.143 fio-3.35 00:12:48.143 Starting 1 thread 00:12:49.076 00:12:49.076 job0: (groupid=0, jobs=1): err= 0: pid=3295806: Fri Apr 26 15:41:47 2024 00:12:49.076 read: IOPS=7451, BW=29.1MiB/s (30.5MB/s)(29.1MiB/1001msec) 00:12:49.076 slat (nsec): min=6143, max=26159, avg=6976.56, stdev=752.24 00:12:49.076 clat (nsec): min=40911, max=81956, avg=57448.77, stdev=3724.40 00:12:49.076 lat (nsec): min=52518, max=88899, avg=64425.33, stdev=3775.56 00:12:49.076 clat percentiles (nsec): 00:12:49.076 | 1.00th=[49920], 5.00th=[51456], 10.00th=[52480], 20.00th=[54016], 00:12:49.076 | 30.00th=[55552], 40.00th=[56576], 50.00th=[57600], 60.00th=[58624], 00:12:49.076 | 70.00th=[59648], 80.00th=[60672], 90.00th=[62208], 95.00th=[63744], 00:12:49.076 | 99.00th=[66048], 99.50th=[67072], 99.90th=[71168], 99.95th=[73216], 00:12:49.076 | 99.99th=[82432] 00:12:49.076 write: IOPS=7672, BW=30.0MiB/s (31.4MB/s)(30.0MiB/1001msec); 0 zone resets 00:12:49.076 slat (nsec): min=7899, max=39336, avg=8796.77, stdev=985.93 00:12:49.076 clat (nsec): min=41922, max=84752, avg=55225.18, stdev=3910.83 00:12:49.076 lat (usec): min=52, max=124, avg=64.02, stdev= 4.06 00:12:49.076 clat percentiles (nsec): 00:12:49.076 | 1.00th=[47360], 5.00th=[49408], 10.00th=[50432], 20.00th=[51456], 00:12:49.076 | 30.00th=[52992], 40.00th=[54016], 50.00th=[55040], 60.00th=[56064], 00:12:49.076 | 70.00th=[57600], 80.00th=[58624], 90.00th=[60160], 95.00th=[61696], 00:12:49.076 | 99.00th=[64256], 99.50th=[66048], 99.90th=[71168], 99.95th=[74240], 00:12:49.076 | 99.99th=[84480] 00:12:49.076 bw ( KiB/s): min=32224, max=32224, per=100.00%, avg=32224.00, stdev= 0.00, samples=1 00:12:49.076 iops : min= 8056, max= 8056, avg=8056.00, stdev= 0.00, samples=1 00:12:49.076 lat (usec) : 50=4.93%, 100=95.07% 00:12:49.076 cpu : usr=9.00%, sys=15.00%, ctx=15139, majf=0, minf=2 00:12:49.076 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:12:49.076 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:12:49.076 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:12:49.076 issued rwts: total=7459,7680,0,0 short=0,0,0,0 dropped=0,0,0,0 00:12:49.076 latency : target=0, window=0, percentile=100.00%, depth=1 00:12:49.076 00:12:49.076 Run status group 0 (all jobs): 00:12:49.076 READ: bw=29.1MiB/s (30.5MB/s), 29.1MiB/s-29.1MiB/s (30.5MB/s-30.5MB/s), io=29.1MiB (30.6MB), run=1001-1001msec 00:12:49.076 WRITE: bw=30.0MiB/s (31.4MB/s), 30.0MiB/s-30.0MiB/s (31.4MB/s-31.4MB/s), io=30.0MiB (31.5MB), run=1001-1001msec 00:12:49.076 00:12:49.076 Disk stats (read/write): 00:12:49.076 nvme0n1: ios=6706/6951, merge=0/0, ticks=351/337, in_queue=688, util=90.58% 00:12:49.076 15:41:47 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:50.972 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:12:50.972 15:41:49 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:50.972 15:41:49 -- common/autotest_common.sh@1205 -- # local i=0 00:12:50.972 15:41:49 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:12:50.972 15:41:49 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:50.972 15:41:49 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:12:50.972 15:41:49 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:50.972 15:41:49 -- common/autotest_common.sh@1217 -- # return 0 00:12:51.229 15:41:49 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:12:51.229 15:41:49 -- target/nmic.sh@53 -- # nvmftestfini 00:12:51.229 15:41:49 -- nvmf/common.sh@477 -- # nvmfcleanup 00:12:51.229 15:41:49 -- nvmf/common.sh@117 -- # sync 00:12:51.229 15:41:49 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:12:51.229 15:41:49 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:12:51.229 15:41:49 -- nvmf/common.sh@120 -- # set +e 00:12:51.229 15:41:49 -- nvmf/common.sh@121 -- # for i in {1..20} 00:12:51.229 15:41:49 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:12:51.229 rmmod nvme_rdma 00:12:51.229 rmmod nvme_fabrics 00:12:51.229 15:41:49 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:12:51.229 15:41:49 -- nvmf/common.sh@124 -- # set -e 00:12:51.229 15:41:49 -- nvmf/common.sh@125 -- # return 0 00:12:51.229 15:41:49 -- nvmf/common.sh@478 -- # '[' -n 3294727 ']' 00:12:51.229 15:41:49 -- nvmf/common.sh@479 -- # killprocess 3294727 00:12:51.229 15:41:49 -- common/autotest_common.sh@936 -- # '[' -z 3294727 ']' 00:12:51.229 15:41:49 -- common/autotest_common.sh@940 -- # kill -0 3294727 00:12:51.229 15:41:49 -- common/autotest_common.sh@941 -- # uname 00:12:51.229 15:41:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:51.229 15:41:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3294727 00:12:51.229 15:41:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:51.229 15:41:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:51.229 15:41:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3294727' 00:12:51.229 killing process with pid 3294727 00:12:51.229 15:41:49 -- common/autotest_common.sh@955 -- # kill 3294727 00:12:51.229 15:41:49 -- common/autotest_common.sh@960 -- # wait 3294727 00:12:51.229 [2024-04-26 15:41:49.752301] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:12:51.487 15:41:49 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:12:51.487 15:41:49 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:12:51.487 00:12:51.487 real 0m14.379s 00:12:51.487 user 0m41.605s 00:12:51.487 sys 0m4.895s 00:12:51.487 15:41:49 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:12:51.487 15:41:49 -- common/autotest_common.sh@10 -- # set +x 00:12:51.487 ************************************ 00:12:51.487 END TEST nvmf_nmic 00:12:51.487 ************************************ 00:12:51.487 15:41:50 -- nvmf/nvmf.sh@55 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=rdma 00:12:51.487 15:41:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:51.487 15:41:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:51.487 15:41:50 -- common/autotest_common.sh@10 -- # set +x 00:12:51.745 ************************************ 00:12:51.745 START TEST nvmf_fio_target 00:12:51.745 ************************************ 00:12:51.745 15:41:50 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=rdma 00:12:51.745 * Looking for test storage... 00:12:51.745 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:12:51.745 15:41:50 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:12:51.745 15:41:50 -- nvmf/common.sh@7 -- # uname -s 00:12:51.745 15:41:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:51.745 15:41:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:51.745 15:41:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:51.745 15:41:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:51.745 15:41:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:51.745 15:41:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:51.745 15:41:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:51.745 15:41:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:51.745 15:41:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:51.745 15:41:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:51.745 15:41:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:12:51.745 15:41:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:12:51.745 15:41:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:51.745 15:41:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:51.745 15:41:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:51.745 15:41:50 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:12:51.745 15:41:50 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:12:51.745 15:41:50 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:51.745 15:41:50 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:51.745 15:41:50 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:51.745 15:41:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:51.745 15:41:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:51.745 15:41:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:51.745 15:41:50 -- paths/export.sh@5 -- # export PATH 00:12:51.745 15:41:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:51.745 15:41:50 -- nvmf/common.sh@47 -- # : 0 00:12:51.745 15:41:50 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:12:51.745 15:41:50 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:12:51.745 15:41:50 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:12:51.745 15:41:50 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:51.745 15:41:50 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:51.745 15:41:50 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:12:51.745 15:41:50 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:12:51.745 15:41:50 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:12:51.745 15:41:50 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:12:51.745 15:41:50 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:12:51.745 15:41:50 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:12:51.745 15:41:50 -- target/fio.sh@16 -- # nvmftestinit 00:12:51.745 15:41:50 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:12:51.745 15:41:50 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:51.745 15:41:50 -- nvmf/common.sh@437 -- # prepare_net_devs 00:12:51.745 15:41:50 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:12:51.745 15:41:50 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:12:51.745 15:41:50 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:51.745 15:41:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:51.745 15:41:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:51.745 15:41:50 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:12:51.745 15:41:50 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:12:51.745 15:41:50 -- nvmf/common.sh@285 -- # xtrace_disable 00:12:51.745 15:41:50 -- common/autotest_common.sh@10 -- # set +x 00:12:57.009 15:41:55 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:57.009 15:41:55 -- nvmf/common.sh@291 -- # pci_devs=() 00:12:57.009 15:41:55 -- nvmf/common.sh@291 -- # local -a pci_devs 00:12:57.009 15:41:55 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:12:57.009 15:41:55 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:12:57.009 15:41:55 -- nvmf/common.sh@293 -- # pci_drivers=() 00:12:57.009 15:41:55 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:12:57.009 15:41:55 -- nvmf/common.sh@295 -- # net_devs=() 00:12:57.009 15:41:55 -- nvmf/common.sh@295 -- # local -ga net_devs 00:12:57.009 15:41:55 -- nvmf/common.sh@296 -- # e810=() 00:12:57.009 15:41:55 -- nvmf/common.sh@296 -- # local -ga e810 00:12:57.009 15:41:55 -- nvmf/common.sh@297 -- # x722=() 00:12:57.009 15:41:55 -- nvmf/common.sh@297 -- # local -ga x722 00:12:57.009 15:41:55 -- nvmf/common.sh@298 -- # mlx=() 00:12:57.009 15:41:55 -- nvmf/common.sh@298 -- # local -ga mlx 00:12:57.009 15:41:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:57.009 15:41:55 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:57.009 15:41:55 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:57.009 15:41:55 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:57.009 15:41:55 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:57.009 15:41:55 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:57.009 15:41:55 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:57.009 15:41:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:57.009 15:41:55 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:57.009 15:41:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:57.009 15:41:55 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:57.009 15:41:55 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:12:57.009 15:41:55 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:12:57.009 15:41:55 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:12:57.009 15:41:55 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:12:57.009 15:41:55 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:12:57.009 15:41:55 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:12:57.009 15:41:55 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:12:57.009 15:41:55 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:57.009 15:41:55 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:12:57.010 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:12:57.010 15:41:55 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:57.010 15:41:55 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:57.010 15:41:55 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:12:57.010 15:41:55 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:12:57.010 15:41:55 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:57.010 15:41:55 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:57.010 15:41:55 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:57.010 15:41:55 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:12:57.010 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:12:57.010 15:41:55 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:57.010 15:41:55 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:57.010 15:41:55 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:12:57.010 15:41:55 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:12:57.010 15:41:55 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:57.010 15:41:55 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:57.010 15:41:55 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:12:57.010 15:41:55 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:12:57.010 15:41:55 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:57.010 15:41:55 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:57.010 15:41:55 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:57.010 15:41:55 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:57.010 15:41:55 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:12:57.010 Found net devices under 0000:da:00.0: mlx_0_0 00:12:57.010 15:41:55 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:57.010 15:41:55 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:57.010 15:41:55 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:57.010 15:41:55 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:57.010 15:41:55 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:57.010 15:41:55 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:12:57.010 Found net devices under 0000:da:00.1: mlx_0_1 00:12:57.010 15:41:55 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:57.010 15:41:55 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:12:57.010 15:41:55 -- nvmf/common.sh@403 -- # is_hw=yes 00:12:57.010 15:41:55 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:12:57.010 15:41:55 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:12:57.010 15:41:55 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:12:57.010 15:41:55 -- nvmf/common.sh@409 -- # rdma_device_init 00:12:57.010 15:41:55 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:12:57.010 15:41:55 -- nvmf/common.sh@58 -- # uname 00:12:57.010 15:41:55 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:12:57.010 15:41:55 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:12:57.010 15:41:55 -- nvmf/common.sh@63 -- # modprobe ib_core 00:12:57.010 15:41:55 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:12:57.010 15:41:55 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:12:57.010 15:41:55 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:12:57.010 15:41:55 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:12:57.010 15:41:55 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:12:57.010 15:41:55 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:12:57.010 15:41:55 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:12:57.010 15:41:55 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:12:57.010 15:41:55 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:57.010 15:41:55 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:57.010 15:41:55 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:57.010 15:41:55 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:57.010 15:41:55 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:57.010 15:41:55 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:57.010 15:41:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:57.010 15:41:55 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:57.010 15:41:55 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:57.010 15:41:55 -- nvmf/common.sh@105 -- # continue 2 00:12:57.010 15:41:55 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:57.010 15:41:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:57.010 15:41:55 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:57.010 15:41:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:57.010 15:41:55 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:57.010 15:41:55 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:57.010 15:41:55 -- nvmf/common.sh@105 -- # continue 2 00:12:57.010 15:41:55 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:57.010 15:41:55 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:12:57.010 15:41:55 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:57.010 15:41:55 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:57.010 15:41:55 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:57.010 15:41:55 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:57.010 15:41:55 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:12:57.010 15:41:55 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:12:57.010 15:41:55 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:12:57.010 118: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:57.010 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:12:57.010 altname enp218s0f0np0 00:12:57.010 altname ens818f0np0 00:12:57.010 inet 192.168.100.8/24 scope global mlx_0_0 00:12:57.010 valid_lft forever preferred_lft forever 00:12:57.010 15:41:55 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:57.010 15:41:55 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:12:57.010 15:41:55 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:57.010 15:41:55 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:57.010 15:41:55 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:57.010 15:41:55 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:57.010 15:41:55 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:12:57.010 15:41:55 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:12:57.010 15:41:55 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:12:57.010 119: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:57.010 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:12:57.010 altname enp218s0f1np1 00:12:57.010 altname ens818f1np1 00:12:57.010 inet 192.168.100.9/24 scope global mlx_0_1 00:12:57.010 valid_lft forever preferred_lft forever 00:12:57.010 15:41:55 -- nvmf/common.sh@411 -- # return 0 00:12:57.010 15:41:55 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:12:57.010 15:41:55 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:12:57.010 15:41:55 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:12:57.010 15:41:55 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:12:57.010 15:41:55 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:12:57.010 15:41:55 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:57.010 15:41:55 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:57.010 15:41:55 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:57.010 15:41:55 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:57.010 15:41:55 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:57.010 15:41:55 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:57.010 15:41:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:57.010 15:41:55 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:57.010 15:41:55 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:57.010 15:41:55 -- nvmf/common.sh@105 -- # continue 2 00:12:57.010 15:41:55 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:57.010 15:41:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:57.010 15:41:55 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:57.010 15:41:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:57.010 15:41:55 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:57.010 15:41:55 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:57.010 15:41:55 -- nvmf/common.sh@105 -- # continue 2 00:12:57.010 15:41:55 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:57.010 15:41:55 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:12:57.010 15:41:55 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:57.010 15:41:55 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:57.010 15:41:55 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:57.010 15:41:55 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:57.010 15:41:55 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:57.010 15:41:55 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:12:57.010 15:41:55 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:57.010 15:41:55 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:57.010 15:41:55 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:57.010 15:41:55 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:57.010 15:41:55 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:12:57.010 192.168.100.9' 00:12:57.010 15:41:55 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:12:57.010 192.168.100.9' 00:12:57.010 15:41:55 -- nvmf/common.sh@446 -- # head -n 1 00:12:57.010 15:41:55 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:12:57.010 15:41:55 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:12:57.010 192.168.100.9' 00:12:57.010 15:41:55 -- nvmf/common.sh@447 -- # tail -n +2 00:12:57.010 15:41:55 -- nvmf/common.sh@447 -- # head -n 1 00:12:57.010 15:41:55 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:12:57.010 15:41:55 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:12:57.010 15:41:55 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:12:57.010 15:41:55 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:12:57.010 15:41:55 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:12:57.010 15:41:55 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:12:57.010 15:41:55 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:12:57.010 15:41:55 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:12:57.010 15:41:55 -- common/autotest_common.sh@710 -- # xtrace_disable 00:12:57.010 15:41:55 -- common/autotest_common.sh@10 -- # set +x 00:12:57.010 15:41:55 -- nvmf/common.sh@470 -- # nvmfpid=3299341 00:12:57.010 15:41:55 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:57.010 15:41:55 -- nvmf/common.sh@471 -- # waitforlisten 3299341 00:12:57.010 15:41:55 -- common/autotest_common.sh@817 -- # '[' -z 3299341 ']' 00:12:57.011 15:41:55 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:57.011 15:41:55 -- common/autotest_common.sh@822 -- # local max_retries=100 00:12:57.011 15:41:55 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:57.011 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:57.011 15:41:55 -- common/autotest_common.sh@826 -- # xtrace_disable 00:12:57.011 15:41:55 -- common/autotest_common.sh@10 -- # set +x 00:12:57.011 [2024-04-26 15:41:55.453912] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:12:57.011 [2024-04-26 15:41:55.453958] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:57.011 EAL: No free 2048 kB hugepages reported on node 1 00:12:57.011 [2024-04-26 15:41:55.508438] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:57.011 [2024-04-26 15:41:55.580070] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:57.011 [2024-04-26 15:41:55.580113] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:57.011 [2024-04-26 15:41:55.580119] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:57.011 [2024-04-26 15:41:55.580125] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:57.011 [2024-04-26 15:41:55.580130] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:57.011 [2024-04-26 15:41:55.580205] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:57.011 [2024-04-26 15:41:55.580227] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:57.011 [2024-04-26 15:41:55.580313] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:57.011 [2024-04-26 15:41:55.580314] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:57.944 15:41:56 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:12:57.944 15:41:56 -- common/autotest_common.sh@850 -- # return 0 00:12:57.944 15:41:56 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:12:57.944 15:41:56 -- common/autotest_common.sh@716 -- # xtrace_disable 00:12:57.944 15:41:56 -- common/autotest_common.sh@10 -- # set +x 00:12:57.944 15:41:56 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:57.944 15:41:56 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:12:57.944 [2024-04-26 15:41:56.460173] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1467100/0x146b5f0) succeed. 00:12:57.944 [2024-04-26 15:41:56.470387] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1468740/0x14acc80) succeed. 00:12:58.202 15:41:56 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:12:58.459 15:41:56 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:12:58.459 15:41:56 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:12:58.459 15:41:56 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:12:58.459 15:41:56 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:12:58.717 15:41:57 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:12:58.717 15:41:57 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:12:58.974 15:41:57 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:12:58.974 15:41:57 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:12:58.974 15:41:57 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:12:59.232 15:41:57 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:12:59.232 15:41:57 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:12:59.498 15:41:57 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:12:59.499 15:41:57 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:12:59.758 15:41:58 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:12:59.758 15:41:58 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:12:59.758 15:41:58 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:13:00.016 15:41:58 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:13:00.016 15:41:58 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:13:00.273 15:41:58 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:13:00.274 15:41:58 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:00.274 15:41:58 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:13:00.532 [2024-04-26 15:41:59.025405] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:13:00.532 15:41:59 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:13:00.790 15:41:59 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:13:01.048 15:41:59 -- target/fio.sh@46 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:13:01.982 15:42:00 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:13:01.982 15:42:00 -- common/autotest_common.sh@1184 -- # local i=0 00:13:01.982 15:42:00 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:13:01.982 15:42:00 -- common/autotest_common.sh@1186 -- # [[ -n 4 ]] 00:13:01.982 15:42:00 -- common/autotest_common.sh@1187 -- # nvme_device_counter=4 00:13:01.982 15:42:00 -- common/autotest_common.sh@1191 -- # sleep 2 00:13:03.895 15:42:02 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:13:03.895 15:42:02 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:13:03.895 15:42:02 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:13:03.895 15:42:02 -- common/autotest_common.sh@1193 -- # nvme_devices=4 00:13:03.895 15:42:02 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:13:03.895 15:42:02 -- common/autotest_common.sh@1194 -- # return 0 00:13:03.895 15:42:02 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:13:03.895 [global] 00:13:03.895 thread=1 00:13:03.895 invalidate=1 00:13:03.895 rw=write 00:13:03.895 time_based=1 00:13:03.895 runtime=1 00:13:03.895 ioengine=libaio 00:13:03.895 direct=1 00:13:03.895 bs=4096 00:13:03.895 iodepth=1 00:13:03.895 norandommap=0 00:13:03.895 numjobs=1 00:13:03.895 00:13:03.895 verify_dump=1 00:13:03.895 verify_backlog=512 00:13:03.895 verify_state_save=0 00:13:03.895 do_verify=1 00:13:03.895 verify=crc32c-intel 00:13:03.895 [job0] 00:13:03.895 filename=/dev/nvme0n1 00:13:03.895 [job1] 00:13:03.895 filename=/dev/nvme0n2 00:13:03.895 [job2] 00:13:03.895 filename=/dev/nvme0n3 00:13:03.895 [job3] 00:13:03.895 filename=/dev/nvme0n4 00:13:03.895 Could not set queue depth (nvme0n1) 00:13:03.895 Could not set queue depth (nvme0n2) 00:13:03.895 Could not set queue depth (nvme0n3) 00:13:03.895 Could not set queue depth (nvme0n4) 00:13:04.155 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:13:04.155 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:13:04.155 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:13:04.155 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:13:04.155 fio-3.35 00:13:04.155 Starting 4 threads 00:13:05.528 00:13:05.528 job0: (groupid=0, jobs=1): err= 0: pid=3300840: Fri Apr 26 15:42:03 2024 00:13:05.528 read: IOPS=5109, BW=20.0MiB/s (20.9MB/s)(20.0MiB/1002msec) 00:13:05.528 slat (nsec): min=5694, max=19779, avg=6797.85, stdev=712.37 00:13:05.528 clat (usec): min=65, max=124, avg=82.32, stdev= 6.58 00:13:05.528 lat (usec): min=71, max=131, avg=89.11, stdev= 6.66 00:13:05.528 clat percentiles (usec): 00:13:05.528 | 1.00th=[ 70], 5.00th=[ 73], 10.00th=[ 75], 20.00th=[ 78], 00:13:05.528 | 30.00th=[ 79], 40.00th=[ 81], 50.00th=[ 82], 60.00th=[ 84], 00:13:05.528 | 70.00th=[ 86], 80.00th=[ 88], 90.00th=[ 91], 95.00th=[ 94], 00:13:05.528 | 99.00th=[ 100], 99.50th=[ 104], 99.90th=[ 110], 99.95th=[ 115], 00:13:05.528 | 99.99th=[ 126] 00:13:05.528 write: IOPS=5587, BW=21.8MiB/s (22.9MB/s)(21.9MiB/1002msec); 0 zone resets 00:13:05.528 slat (nsec): min=7772, max=70793, avg=8914.58, stdev=1274.65 00:13:05.528 clat (usec): min=61, max=242, avg=84.68, stdev=20.01 00:13:05.528 lat (usec): min=70, max=251, avg=93.59, stdev=20.25 00:13:05.528 clat percentiles (usec): 00:13:05.528 | 1.00th=[ 67], 5.00th=[ 70], 10.00th=[ 72], 20.00th=[ 75], 00:13:05.528 | 30.00th=[ 77], 40.00th=[ 78], 50.00th=[ 80], 60.00th=[ 82], 00:13:05.528 | 70.00th=[ 84], 80.00th=[ 87], 90.00th=[ 96], 95.00th=[ 145], 00:13:05.528 | 99.00th=[ 159], 99.50th=[ 163], 99.90th=[ 190], 99.95th=[ 198], 00:13:05.528 | 99.99th=[ 243] 00:13:05.528 bw ( KiB/s): min=20312, max=24480, per=30.15%, avg=22396.00, stdev=2947.22, samples=2 00:13:05.528 iops : min= 5078, max= 6120, avg=5599.00, stdev=736.81, samples=2 00:13:05.528 lat (usec) : 100=94.89%, 250=5.11% 00:13:05.528 cpu : usr=6.99%, sys=10.19%, ctx=10721, majf=0, minf=2 00:13:05.528 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:13:05.528 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:05.528 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:05.528 issued rwts: total=5120,5599,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:05.528 latency : target=0, window=0, percentile=100.00%, depth=1 00:13:05.528 job1: (groupid=0, jobs=1): err= 0: pid=3300846: Fri Apr 26 15:42:03 2024 00:13:05.528 read: IOPS=3580, BW=14.0MiB/s (14.7MB/s)(14.0MiB/1001msec) 00:13:05.528 slat (nsec): min=6232, max=17438, avg=7083.20, stdev=686.06 00:13:05.528 clat (usec): min=67, max=205, avg=130.41, stdev=17.33 00:13:05.528 lat (usec): min=73, max=212, avg=137.50, stdev=17.32 00:13:05.528 clat percentiles (usec): 00:13:05.528 | 1.00th=[ 85], 5.00th=[ 100], 10.00th=[ 114], 20.00th=[ 121], 00:13:05.528 | 30.00th=[ 125], 40.00th=[ 128], 50.00th=[ 130], 60.00th=[ 133], 00:13:05.528 | 70.00th=[ 137], 80.00th=[ 141], 90.00th=[ 151], 95.00th=[ 165], 00:13:05.528 | 99.00th=[ 182], 99.50th=[ 186], 99.90th=[ 200], 99.95th=[ 202], 00:13:05.528 | 99.99th=[ 206] 00:13:05.528 write: IOPS=3764, BW=14.7MiB/s (15.4MB/s)(14.7MiB/1001msec); 0 zone resets 00:13:05.528 slat (nsec): min=8216, max=40111, avg=9302.47, stdev=985.46 00:13:05.528 clat (usec): min=63, max=206, avg=121.41, stdev=18.97 00:13:05.528 lat (usec): min=72, max=215, avg=130.71, stdev=19.01 00:13:05.528 clat percentiles (usec): 00:13:05.528 | 1.00th=[ 76], 5.00th=[ 84], 10.00th=[ 101], 20.00th=[ 112], 00:13:05.528 | 30.00th=[ 116], 40.00th=[ 119], 50.00th=[ 121], 60.00th=[ 124], 00:13:05.528 | 70.00th=[ 127], 80.00th=[ 133], 90.00th=[ 145], 95.00th=[ 159], 00:13:05.528 | 99.00th=[ 172], 99.50th=[ 176], 99.90th=[ 186], 99.95th=[ 192], 00:13:05.528 | 99.99th=[ 206] 00:13:05.528 bw ( KiB/s): min=16384, max=16384, per=22.06%, avg=16384.00, stdev= 0.00, samples=1 00:13:05.528 iops : min= 4096, max= 4096, avg=4096.00, stdev= 0.00, samples=1 00:13:05.528 lat (usec) : 100=7.36%, 250=92.64% 00:13:05.528 cpu : usr=3.20%, sys=6.60%, ctx=7352, majf=0, minf=1 00:13:05.528 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:13:05.528 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:05.528 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:05.528 issued rwts: total=3584,3768,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:05.528 latency : target=0, window=0, percentile=100.00%, depth=1 00:13:05.528 job2: (groupid=0, jobs=1): err= 0: pid=3300864: Fri Apr 26 15:42:03 2024 00:13:05.528 read: IOPS=5114, BW=20.0MiB/s (20.9MB/s)(20.0MiB/1001msec) 00:13:05.528 slat (nsec): min=6265, max=25683, avg=7135.47, stdev=687.81 00:13:05.528 clat (usec): min=68, max=299, avg=86.22, stdev= 6.80 00:13:05.528 lat (usec): min=75, max=306, avg=93.35, stdev= 6.84 00:13:05.528 clat percentiles (usec): 00:13:05.528 | 1.00th=[ 76], 5.00th=[ 78], 10.00th=[ 80], 20.00th=[ 82], 00:13:05.528 | 30.00th=[ 83], 40.00th=[ 85], 50.00th=[ 86], 60.00th=[ 87], 00:13:05.528 | 70.00th=[ 89], 80.00th=[ 91], 90.00th=[ 94], 95.00th=[ 98], 00:13:05.528 | 99.00th=[ 105], 99.50th=[ 109], 99.90th=[ 116], 99.95th=[ 118], 00:13:05.528 | 99.99th=[ 302] 00:13:05.528 write: IOPS=5462, BW=21.3MiB/s (22.4MB/s)(21.4MiB/1001msec); 0 zone resets 00:13:05.528 slat (nsec): min=8130, max=35521, avg=9119.84, stdev=899.26 00:13:05.528 clat (usec): min=68, max=136, avg=82.72, stdev= 6.01 00:13:05.528 lat (usec): min=76, max=145, avg=91.84, stdev= 6.11 00:13:05.528 clat percentiles (usec): 00:13:05.528 | 1.00th=[ 73], 5.00th=[ 75], 10.00th=[ 77], 20.00th=[ 78], 00:13:05.528 | 30.00th=[ 80], 40.00th=[ 81], 50.00th=[ 83], 60.00th=[ 84], 00:13:05.529 | 70.00th=[ 86], 80.00th=[ 88], 90.00th=[ 91], 95.00th=[ 94], 00:13:05.529 | 99.00th=[ 100], 99.50th=[ 104], 99.90th=[ 113], 99.95th=[ 117], 00:13:05.529 | 99.99th=[ 137] 00:13:05.529 bw ( KiB/s): min=21552, max=21552, per=29.02%, avg=21552.00, stdev= 0.00, samples=1 00:13:05.529 iops : min= 5388, max= 5388, avg=5388.00, stdev= 0.00, samples=1 00:13:05.529 lat (usec) : 100=98.05%, 250=1.94%, 500=0.01% 00:13:05.529 cpu : usr=7.10%, sys=10.30%, ctx=10588, majf=0, minf=1 00:13:05.529 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:13:05.529 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:05.529 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:05.529 issued rwts: total=5120,5468,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:05.529 latency : target=0, window=0, percentile=100.00%, depth=1 00:13:05.529 job3: (groupid=0, jobs=1): err= 0: pid=3300870: Fri Apr 26 15:42:03 2024 00:13:05.529 read: IOPS=3584, BW=14.0MiB/s (14.7MB/s)(14.0MiB/1000msec) 00:13:05.529 slat (nsec): min=6203, max=23701, avg=7321.09, stdev=818.02 00:13:05.529 clat (usec): min=75, max=195, avg=129.92, stdev=15.52 00:13:05.529 lat (usec): min=82, max=202, avg=137.24, stdev=15.52 00:13:05.529 clat percentiles (usec): 00:13:05.529 | 1.00th=[ 92], 5.00th=[ 103], 10.00th=[ 114], 20.00th=[ 121], 00:13:05.529 | 30.00th=[ 125], 40.00th=[ 127], 50.00th=[ 129], 60.00th=[ 133], 00:13:05.529 | 70.00th=[ 135], 80.00th=[ 139], 90.00th=[ 149], 95.00th=[ 159], 00:13:05.529 | 99.00th=[ 176], 99.50th=[ 182], 99.90th=[ 192], 99.95th=[ 194], 00:13:05.529 | 99.99th=[ 196] 00:13:05.529 write: IOPS=3770, BW=14.7MiB/s (15.4MB/s)(14.7MiB/1000msec); 0 zone resets 00:13:05.529 slat (nsec): min=8122, max=39913, avg=9390.05, stdev=987.35 00:13:05.529 clat (usec): min=69, max=188, avg=121.11, stdev=15.78 00:13:05.529 lat (usec): min=78, max=197, avg=130.50, stdev=15.84 00:13:05.529 clat percentiles (usec): 00:13:05.529 | 1.00th=[ 82], 5.00th=[ 91], 10.00th=[ 104], 20.00th=[ 113], 00:13:05.529 | 30.00th=[ 116], 40.00th=[ 119], 50.00th=[ 121], 60.00th=[ 124], 00:13:05.529 | 70.00th=[ 127], 80.00th=[ 131], 90.00th=[ 141], 95.00th=[ 151], 00:13:05.529 | 99.00th=[ 163], 99.50th=[ 167], 99.90th=[ 182], 99.95th=[ 186], 00:13:05.529 | 99.99th=[ 190] 00:13:05.529 bw ( KiB/s): min=16384, max=16384, per=22.06%, avg=16384.00, stdev= 0.00, samples=1 00:13:05.529 iops : min= 4096, max= 4096, avg=4096.00, stdev= 0.00, samples=1 00:13:05.529 lat (usec) : 100=6.21%, 250=93.79% 00:13:05.529 cpu : usr=4.50%, sys=8.10%, ctx=7355, majf=0, minf=1 00:13:05.529 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:13:05.529 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:05.529 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:05.529 issued rwts: total=3584,3770,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:05.529 latency : target=0, window=0, percentile=100.00%, depth=1 00:13:05.529 00:13:05.529 Run status group 0 (all jobs): 00:13:05.529 READ: bw=67.9MiB/s (71.2MB/s), 14.0MiB/s-20.0MiB/s (14.7MB/s-20.9MB/s), io=68.0MiB (71.3MB), run=1000-1002msec 00:13:05.529 WRITE: bw=72.5MiB/s (76.1MB/s), 14.7MiB/s-21.8MiB/s (15.4MB/s-22.9MB/s), io=72.7MiB (76.2MB), run=1000-1002msec 00:13:05.529 00:13:05.529 Disk stats (read/write): 00:13:05.529 nvme0n1: ios=4657/4888, merge=0/0, ticks=358/358, in_queue=716, util=86.77% 00:13:05.529 nvme0n2: ios=3072/3292, merge=0/0, ticks=387/394, in_queue=781, util=87.02% 00:13:05.529 nvme0n3: ios=4436/4608, merge=0/0, ticks=339/344, in_queue=683, util=89.10% 00:13:05.529 nvme0n4: ios=3072/3293, merge=0/0, ticks=377/373, in_queue=750, util=89.75% 00:13:05.529 15:42:03 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:13:05.529 [global] 00:13:05.529 thread=1 00:13:05.529 invalidate=1 00:13:05.529 rw=randwrite 00:13:05.529 time_based=1 00:13:05.529 runtime=1 00:13:05.529 ioengine=libaio 00:13:05.529 direct=1 00:13:05.529 bs=4096 00:13:05.529 iodepth=1 00:13:05.529 norandommap=0 00:13:05.529 numjobs=1 00:13:05.529 00:13:05.529 verify_dump=1 00:13:05.529 verify_backlog=512 00:13:05.529 verify_state_save=0 00:13:05.529 do_verify=1 00:13:05.529 verify=crc32c-intel 00:13:05.529 [job0] 00:13:05.529 filename=/dev/nvme0n1 00:13:05.529 [job1] 00:13:05.529 filename=/dev/nvme0n2 00:13:05.529 [job2] 00:13:05.529 filename=/dev/nvme0n3 00:13:05.529 [job3] 00:13:05.529 filename=/dev/nvme0n4 00:13:05.529 Could not set queue depth (nvme0n1) 00:13:05.529 Could not set queue depth (nvme0n2) 00:13:05.529 Could not set queue depth (nvme0n3) 00:13:05.529 Could not set queue depth (nvme0n4) 00:13:05.787 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:13:05.787 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:13:05.787 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:13:05.787 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:13:05.787 fio-3.35 00:13:05.787 Starting 4 threads 00:13:07.173 00:13:07.173 job0: (groupid=0, jobs=1): err= 0: pid=3301288: Fri Apr 26 15:42:05 2024 00:13:07.173 read: IOPS=3580, BW=14.0MiB/s (14.7MB/s)(14.0MiB/1001msec) 00:13:07.173 slat (nsec): min=5632, max=38873, avg=7997.93, stdev=2215.23 00:13:07.173 clat (usec): min=64, max=223, avg=127.11, stdev=32.50 00:13:07.173 lat (usec): min=70, max=231, avg=135.11, stdev=33.18 00:13:07.173 clat percentiles (usec): 00:13:07.173 | 1.00th=[ 71], 5.00th=[ 75], 10.00th=[ 78], 20.00th=[ 83], 00:13:07.173 | 30.00th=[ 119], 40.00th=[ 135], 50.00th=[ 139], 60.00th=[ 143], 00:13:07.173 | 70.00th=[ 147], 80.00th=[ 151], 90.00th=[ 159], 95.00th=[ 167], 00:13:07.173 | 99.00th=[ 194], 99.50th=[ 198], 99.90th=[ 210], 99.95th=[ 217], 00:13:07.173 | 99.99th=[ 225] 00:13:07.173 write: IOPS=3596, BW=14.0MiB/s (14.7MB/s)(14.1MiB/1001msec); 0 zone resets 00:13:07.174 slat (nsec): min=7644, max=39377, avg=10020.23, stdev=2655.00 00:13:07.174 clat (usec): min=62, max=228, avg=128.54, stdev=32.40 00:13:07.174 lat (usec): min=70, max=237, avg=138.56, stdev=33.28 00:13:07.174 clat percentiles (usec): 00:13:07.174 | 1.00th=[ 68], 5.00th=[ 72], 10.00th=[ 75], 20.00th=[ 82], 00:13:07.174 | 30.00th=[ 125], 40.00th=[ 135], 50.00th=[ 141], 60.00th=[ 145], 00:13:07.174 | 70.00th=[ 149], 80.00th=[ 153], 90.00th=[ 159], 95.00th=[ 165], 00:13:07.174 | 99.00th=[ 190], 99.50th=[ 198], 99.90th=[ 210], 99.95th=[ 215], 00:13:07.174 | 99.99th=[ 229] 00:13:07.174 bw ( KiB/s): min=16384, max=16384, per=25.28%, avg=16384.00, stdev= 0.00, samples=1 00:13:07.174 iops : min= 4096, max= 4096, avg=4096.00, stdev= 0.00, samples=1 00:13:07.174 lat (usec) : 100=26.32%, 250=73.68% 00:13:07.174 cpu : usr=3.90%, sys=8.50%, ctx=7184, majf=0, minf=1 00:13:07.174 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:13:07.174 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:07.174 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:07.174 issued rwts: total=3584,3600,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:07.174 latency : target=0, window=0, percentile=100.00%, depth=1 00:13:07.174 job1: (groupid=0, jobs=1): err= 0: pid=3301304: Fri Apr 26 15:42:05 2024 00:13:07.174 read: IOPS=3069, BW=12.0MiB/s (12.6MB/s)(12.0MiB/1001msec) 00:13:07.174 slat (nsec): min=6350, max=25519, avg=7235.27, stdev=802.70 00:13:07.174 clat (usec): min=69, max=217, avg=144.24, stdev=17.65 00:13:07.174 lat (usec): min=76, max=224, avg=151.48, stdev=17.66 00:13:07.174 clat percentiles (usec): 00:13:07.174 | 1.00th=[ 89], 5.00th=[ 112], 10.00th=[ 125], 20.00th=[ 135], 00:13:07.174 | 30.00th=[ 141], 40.00th=[ 143], 50.00th=[ 147], 60.00th=[ 149], 00:13:07.174 | 70.00th=[ 153], 80.00th=[ 155], 90.00th=[ 161], 95.00th=[ 165], 00:13:07.174 | 99.00th=[ 196], 99.50th=[ 204], 99.90th=[ 212], 99.95th=[ 212], 00:13:07.174 | 99.99th=[ 217] 00:13:07.174 write: IOPS=3580, BW=14.0MiB/s (14.7MB/s)(14.0MiB/1001msec); 0 zone resets 00:13:07.174 slat (nsec): min=7831, max=35845, avg=8984.89, stdev=1030.70 00:13:07.174 clat (usec): min=61, max=218, avg=136.00, stdev=21.27 00:13:07.174 lat (usec): min=69, max=226, avg=144.99, stdev=21.32 00:13:07.174 clat percentiles (usec): 00:13:07.174 | 1.00th=[ 77], 5.00th=[ 93], 10.00th=[ 110], 20.00th=[ 120], 00:13:07.174 | 30.00th=[ 131], 40.00th=[ 137], 50.00th=[ 141], 60.00th=[ 143], 00:13:07.174 | 70.00th=[ 147], 80.00th=[ 151], 90.00th=[ 157], 95.00th=[ 165], 00:13:07.174 | 99.00th=[ 188], 99.50th=[ 194], 99.90th=[ 206], 99.95th=[ 210], 00:13:07.174 | 99.99th=[ 219] 00:13:07.174 bw ( KiB/s): min=15200, max=15200, per=23.45%, avg=15200.00, stdev= 0.00, samples=1 00:13:07.174 iops : min= 3800, max= 3800, avg=3800.00, stdev= 0.00, samples=1 00:13:07.174 lat (usec) : 100=5.26%, 250=94.74% 00:13:07.174 cpu : usr=3.80%, sys=7.50%, ctx=6657, majf=0, minf=1 00:13:07.174 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:13:07.174 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:07.174 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:07.174 issued rwts: total=3073,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:07.174 latency : target=0, window=0, percentile=100.00%, depth=1 00:13:07.174 job2: (groupid=0, jobs=1): err= 0: pid=3301321: Fri Apr 26 15:42:05 2024 00:13:07.174 read: IOPS=5114, BW=20.0MiB/s (20.9MB/s)(20.0MiB/1001msec) 00:13:07.174 slat (nsec): min=6104, max=25954, avg=7159.16, stdev=1151.28 00:13:07.174 clat (usec): min=68, max=157, avg=84.30, stdev= 6.51 00:13:07.174 lat (usec): min=74, max=164, avg=91.46, stdev= 6.74 00:13:07.174 clat percentiles (usec): 00:13:07.174 | 1.00th=[ 74], 5.00th=[ 77], 10.00th=[ 78], 20.00th=[ 80], 00:13:07.174 | 30.00th=[ 82], 40.00th=[ 83], 50.00th=[ 84], 60.00th=[ 85], 00:13:07.174 | 70.00th=[ 87], 80.00th=[ 89], 90.00th=[ 91], 95.00th=[ 94], 00:13:07.174 | 99.00th=[ 112], 99.50th=[ 118], 99.90th=[ 126], 99.95th=[ 128], 00:13:07.174 | 99.99th=[ 157] 00:13:07.174 write: IOPS=5449, BW=21.3MiB/s (22.3MB/s)(21.3MiB/1001msec); 0 zone resets 00:13:07.174 slat (nsec): min=7727, max=43433, avg=8863.58, stdev=1428.09 00:13:07.174 clat (usec): min=65, max=196, avg=84.89, stdev=15.41 00:13:07.174 lat (usec): min=74, max=205, avg=93.76, stdev=15.63 00:13:07.174 clat percentiles (usec): 00:13:07.174 | 1.00th=[ 71], 5.00th=[ 74], 10.00th=[ 75], 20.00th=[ 77], 00:13:07.174 | 30.00th=[ 79], 40.00th=[ 80], 50.00th=[ 81], 60.00th=[ 83], 00:13:07.174 | 70.00th=[ 84], 80.00th=[ 87], 90.00th=[ 94], 95.00th=[ 130], 00:13:07.174 | 99.00th=[ 143], 99.50th=[ 149], 99.90th=[ 176], 99.95th=[ 188], 00:13:07.174 | 99.99th=[ 198] 00:13:07.174 bw ( KiB/s): min=21864, max=21864, per=33.74%, avg=21864.00, stdev= 0.00, samples=1 00:13:07.174 iops : min= 5466, max= 5466, avg=5466.00, stdev= 0.00, samples=1 00:13:07.174 lat (usec) : 100=94.40%, 250=5.60% 00:13:07.174 cpu : usr=5.30%, sys=11.80%, ctx=10575, majf=0, minf=2 00:13:07.174 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:13:07.174 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:07.174 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:07.174 issued rwts: total=5120,5455,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:07.174 latency : target=0, window=0, percentile=100.00%, depth=1 00:13:07.174 job3: (groupid=0, jobs=1): err= 0: pid=3301322: Fri Apr 26 15:42:05 2024 00:13:07.174 read: IOPS=3068, BW=12.0MiB/s (12.6MB/s)(12.0MiB/1001msec) 00:13:07.174 slat (nsec): min=6466, max=19868, avg=7413.76, stdev=753.63 00:13:07.174 clat (usec): min=79, max=212, avg=144.21, stdev=17.13 00:13:07.174 lat (usec): min=86, max=219, avg=151.62, stdev=17.14 00:13:07.174 clat percentiles (usec): 00:13:07.174 | 1.00th=[ 90], 5.00th=[ 115], 10.00th=[ 125], 20.00th=[ 135], 00:13:07.174 | 30.00th=[ 141], 40.00th=[ 143], 50.00th=[ 147], 60.00th=[ 149], 00:13:07.174 | 70.00th=[ 153], 80.00th=[ 155], 90.00th=[ 161], 95.00th=[ 169], 00:13:07.174 | 99.00th=[ 190], 99.50th=[ 196], 99.90th=[ 208], 99.95th=[ 210], 00:13:07.174 | 99.99th=[ 212] 00:13:07.174 write: IOPS=3575, BW=14.0MiB/s (14.6MB/s)(14.0MiB/1001msec); 0 zone resets 00:13:07.174 slat (nsec): min=8029, max=36184, avg=9133.48, stdev=986.16 00:13:07.174 clat (usec): min=69, max=223, avg=135.99, stdev=19.42 00:13:07.174 lat (usec): min=78, max=232, avg=145.12, stdev=19.46 00:13:07.174 clat percentiles (usec): 00:13:07.174 | 1.00th=[ 83], 5.00th=[ 99], 10.00th=[ 112], 20.00th=[ 120], 00:13:07.174 | 30.00th=[ 130], 40.00th=[ 137], 50.00th=[ 141], 60.00th=[ 143], 00:13:07.174 | 70.00th=[ 147], 80.00th=[ 149], 90.00th=[ 155], 95.00th=[ 163], 00:13:07.174 | 99.00th=[ 188], 99.50th=[ 192], 99.90th=[ 200], 99.95th=[ 202], 00:13:07.174 | 99.99th=[ 223] 00:13:07.174 bw ( KiB/s): min=15192, max=15192, per=23.44%, avg=15192.00, stdev= 0.00, samples=1 00:13:07.174 iops : min= 3798, max= 3798, avg=3798.00, stdev= 0.00, samples=1 00:13:07.174 lat (usec) : 100=4.33%, 250=95.67% 00:13:07.174 cpu : usr=4.10%, sys=7.40%, ctx=6651, majf=0, minf=1 00:13:07.174 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:13:07.174 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:07.174 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:07.174 issued rwts: total=3072,3579,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:07.174 latency : target=0, window=0, percentile=100.00%, depth=1 00:13:07.174 00:13:07.174 Run status group 0 (all jobs): 00:13:07.174 READ: bw=57.9MiB/s (60.8MB/s), 12.0MiB/s-20.0MiB/s (12.6MB/s-20.9MB/s), io=58.0MiB (60.8MB), run=1001-1001msec 00:13:07.174 WRITE: bw=63.3MiB/s (66.4MB/s), 14.0MiB/s-21.3MiB/s (14.6MB/s-22.3MB/s), io=63.4MiB (66.4MB), run=1001-1001msec 00:13:07.174 00:13:07.174 Disk stats (read/write): 00:13:07.174 nvme0n1: ios=3121/3190, merge=0/0, ticks=366/384, in_queue=750, util=86.67% 00:13:07.174 nvme0n2: ios=2651/3072, merge=0/0, ticks=360/388, in_queue=748, util=86.93% 00:13:07.174 nvme0n3: ios=4574/4608, merge=0/0, ticks=367/346, in_queue=713, util=89.00% 00:13:07.174 nvme0n4: ios=2646/3072, merge=0/0, ticks=361/394, in_queue=755, util=89.75% 00:13:07.174 15:42:05 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:13:07.174 [global] 00:13:07.174 thread=1 00:13:07.174 invalidate=1 00:13:07.174 rw=write 00:13:07.174 time_based=1 00:13:07.174 runtime=1 00:13:07.174 ioengine=libaio 00:13:07.174 direct=1 00:13:07.174 bs=4096 00:13:07.174 iodepth=128 00:13:07.174 norandommap=0 00:13:07.174 numjobs=1 00:13:07.174 00:13:07.174 verify_dump=1 00:13:07.174 verify_backlog=512 00:13:07.174 verify_state_save=0 00:13:07.174 do_verify=1 00:13:07.174 verify=crc32c-intel 00:13:07.174 [job0] 00:13:07.174 filename=/dev/nvme0n1 00:13:07.174 [job1] 00:13:07.174 filename=/dev/nvme0n2 00:13:07.174 [job2] 00:13:07.174 filename=/dev/nvme0n3 00:13:07.174 [job3] 00:13:07.174 filename=/dev/nvme0n4 00:13:07.174 Could not set queue depth (nvme0n1) 00:13:07.174 Could not set queue depth (nvme0n2) 00:13:07.174 Could not set queue depth (nvme0n3) 00:13:07.174 Could not set queue depth (nvme0n4) 00:13:07.431 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:13:07.431 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:13:07.431 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:13:07.431 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:13:07.431 fio-3.35 00:13:07.431 Starting 4 threads 00:13:08.802 00:13:08.802 job0: (groupid=0, jobs=1): err= 0: pid=3302023: Fri Apr 26 15:42:06 2024 00:13:08.802 read: IOPS=6851, BW=26.8MiB/s (28.1MB/s)(26.9MiB/1004msec) 00:13:08.802 slat (nsec): min=1337, max=2723.1k, avg=71102.96, stdev=300126.58 00:13:08.802 clat (usec): min=2536, max=13342, avg=9173.10, stdev=932.67 00:13:08.802 lat (usec): min=4236, max=13352, avg=9244.20, stdev=970.84 00:13:08.802 clat percentiles (usec): 00:13:08.802 | 1.00th=[ 8029], 5.00th=[ 8455], 10.00th=[ 8586], 20.00th=[ 8586], 00:13:08.802 | 30.00th=[ 8717], 40.00th=[ 8717], 50.00th=[ 8848], 60.00th=[ 8979], 00:13:08.802 | 70.00th=[ 9110], 80.00th=[ 9503], 90.00th=[10683], 95.00th=[11076], 00:13:08.802 | 99.00th=[11600], 99.50th=[12125], 99.90th=[13042], 99.95th=[13173], 00:13:08.802 | 99.99th=[13304] 00:13:08.802 write: IOPS=7139, BW=27.9MiB/s (29.2MB/s)(28.0MiB/1004msec); 0 zone resets 00:13:08.802 slat (nsec): min=1872, max=2967.0k, avg=69225.66, stdev=292123.66 00:13:08.802 clat (usec): min=6522, max=13203, avg=8936.37, stdev=870.02 00:13:08.802 lat (usec): min=6529, max=13214, avg=9005.59, stdev=908.92 00:13:08.802 clat percentiles (usec): 00:13:08.802 | 1.00th=[ 7963], 5.00th=[ 8160], 10.00th=[ 8291], 20.00th=[ 8356], 00:13:08.802 | 30.00th=[ 8455], 40.00th=[ 8455], 50.00th=[ 8586], 60.00th=[ 8586], 00:13:08.802 | 70.00th=[ 8848], 80.00th=[ 9503], 90.00th=[10421], 95.00th=[10683], 00:13:08.802 | 99.00th=[11338], 99.50th=[11994], 99.90th=[12649], 99.95th=[12911], 00:13:08.802 | 99.99th=[13173] 00:13:08.802 bw ( KiB/s): min=28672, max=28672, per=30.98%, avg=28672.00, stdev= 0.00, samples=2 00:13:08.802 iops : min= 7168, max= 7168, avg=7168.00, stdev= 0.00, samples=2 00:13:08.802 lat (msec) : 4=0.01%, 10=81.65%, 20=18.34% 00:13:08.802 cpu : usr=2.89%, sys=3.29%, ctx=1032, majf=0, minf=1 00:13:08.802 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:13:08.802 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:08.802 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:13:08.802 issued rwts: total=6879,7168,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:08.802 latency : target=0, window=0, percentile=100.00%, depth=128 00:13:08.802 job1: (groupid=0, jobs=1): err= 0: pid=3302035: Fri Apr 26 15:42:06 2024 00:13:08.802 read: IOPS=4589, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1004msec) 00:13:08.802 slat (nsec): min=1421, max=3613.8k, avg=105446.66, stdev=449588.88 00:13:08.802 clat (usec): min=12174, max=18854, avg=13541.69, stdev=1117.52 00:13:08.802 lat (usec): min=12177, max=18866, avg=13647.14, stdev=1187.45 00:13:08.802 clat percentiles (usec): 00:13:08.802 | 1.00th=[12387], 5.00th=[12518], 10.00th=[12649], 20.00th=[12780], 00:13:08.802 | 30.00th=[13042], 40.00th=[13042], 50.00th=[13173], 60.00th=[13304], 00:13:08.802 | 70.00th=[13435], 80.00th=[13698], 90.00th=[15795], 95.00th=[16188], 00:13:08.802 | 99.00th=[16712], 99.50th=[17433], 99.90th=[18482], 99.95th=[18744], 00:13:08.802 | 99.99th=[18744] 00:13:08.802 write: IOPS=4778, BW=18.7MiB/s (19.6MB/s)(18.7MiB/1004msec); 0 zone resets 00:13:08.802 slat (nsec): min=1974, max=3717.2k, avg=104505.86, stdev=439822.36 00:13:08.802 clat (usec): min=3223, max=19632, avg=13446.73, stdev=1555.80 00:13:08.802 lat (usec): min=3689, max=19648, avg=13551.24, stdev=1604.86 00:13:08.802 clat percentiles (usec): 00:13:08.802 | 1.00th=[ 7898], 5.00th=[12125], 10.00th=[12387], 20.00th=[12518], 00:13:08.802 | 30.00th=[12780], 40.00th=[12911], 50.00th=[13042], 60.00th=[13173], 00:13:08.802 | 70.00th=[13304], 80.00th=[15270], 90.00th=[15795], 95.00th=[16188], 00:13:08.802 | 99.00th=[16909], 99.50th=[17695], 99.90th=[19268], 99.95th=[19530], 00:13:08.802 | 99.99th=[19530] 00:13:08.802 bw ( KiB/s): min=18368, max=19000, per=20.19%, avg=18684.00, stdev=446.89, samples=2 00:13:08.802 iops : min= 4592, max= 4750, avg=4671.00, stdev=111.72, samples=2 00:13:08.802 lat (msec) : 4=0.16%, 10=0.45%, 20=99.39% 00:13:08.802 cpu : usr=1.69%, sys=3.39%, ctx=810, majf=0, minf=1 00:13:08.802 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:13:08.802 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:08.802 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:13:08.802 issued rwts: total=4608,4798,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:08.802 latency : target=0, window=0, percentile=100.00%, depth=128 00:13:08.802 job2: (groupid=0, jobs=1): err= 0: pid=3302061: Fri Apr 26 15:42:06 2024 00:13:08.802 read: IOPS=4782, BW=18.7MiB/s (19.6MB/s)(18.7MiB/1003msec) 00:13:08.802 slat (nsec): min=1441, max=3413.8k, avg=101282.76, stdev=381891.05 00:13:08.802 clat (usec): min=2620, max=19108, avg=12910.96, stdev=3284.94 00:13:08.802 lat (usec): min=5098, max=19113, avg=13012.25, stdev=3306.67 00:13:08.802 clat percentiles (usec): 00:13:08.802 | 1.00th=[ 7046], 5.00th=[ 7308], 10.00th=[ 7504], 20.00th=[ 8848], 00:13:08.802 | 30.00th=[ 9634], 40.00th=[14484], 50.00th=[14746], 60.00th=[15008], 00:13:08.802 | 70.00th=[15139], 80.00th=[15401], 90.00th=[15795], 95.00th=[15926], 00:13:08.802 | 99.00th=[16581], 99.50th=[17695], 99.90th=[19006], 99.95th=[19006], 00:13:08.802 | 99.99th=[19006] 00:13:08.802 write: IOPS=5104, BW=19.9MiB/s (20.9MB/s)(20.0MiB/1003msec); 0 zone resets 00:13:08.802 slat (nsec): min=1980, max=3376.4k, avg=98110.18, stdev=376751.82 00:13:08.802 clat (usec): min=6786, max=18274, avg=12701.04, stdev=3205.99 00:13:08.802 lat (usec): min=6789, max=18441, avg=12799.15, stdev=3225.19 00:13:08.802 clat percentiles (usec): 00:13:08.802 | 1.00th=[ 6849], 5.00th=[ 6980], 10.00th=[ 7242], 20.00th=[ 8455], 00:13:08.802 | 30.00th=[ 9372], 40.00th=[14222], 50.00th=[14484], 60.00th=[14615], 00:13:08.802 | 70.00th=[14877], 80.00th=[15008], 90.00th=[15401], 95.00th=[15533], 00:13:08.802 | 99.00th=[15795], 99.50th=[16581], 99.90th=[17433], 99.95th=[17695], 00:13:08.802 | 99.99th=[18220] 00:13:08.802 bw ( KiB/s): min=17040, max=23920, per=22.13%, avg=20480.00, stdev=4864.89, samples=2 00:13:08.802 iops : min= 4260, max= 5980, avg=5120.00, stdev=1216.22, samples=2 00:13:08.802 lat (msec) : 4=0.01%, 10=30.53%, 20=69.46% 00:13:08.802 cpu : usr=1.50%, sys=3.39%, ctx=907, majf=0, minf=1 00:13:08.802 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:13:08.802 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:08.802 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:13:08.802 issued rwts: total=4797,5120,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:08.802 latency : target=0, window=0, percentile=100.00%, depth=128 00:13:08.802 job3: (groupid=0, jobs=1): err= 0: pid=3302069: Fri Apr 26 15:42:06 2024 00:13:08.802 read: IOPS=5949, BW=23.2MiB/s (24.4MB/s)(23.3MiB/1003msec) 00:13:08.802 slat (nsec): min=1410, max=2696.8k, avg=83684.83, stdev=317135.93 00:13:08.802 clat (usec): min=2596, max=14943, avg=10621.52, stdev=1659.87 00:13:08.802 lat (usec): min=3172, max=14949, avg=10705.20, stdev=1678.82 00:13:08.802 clat percentiles (usec): 00:13:08.802 | 1.00th=[ 6980], 5.00th=[ 7832], 10.00th=[ 8225], 20.00th=[ 8356], 00:13:08.802 | 30.00th=[10683], 40.00th=[11207], 50.00th=[11338], 60.00th=[11469], 00:13:08.802 | 70.00th=[11600], 80.00th=[11731], 90.00th=[11863], 95.00th=[12387], 00:13:08.802 | 99.00th=[13304], 99.50th=[13566], 99.90th=[14091], 99.95th=[14877], 00:13:08.802 | 99.99th=[15008] 00:13:08.802 write: IOPS=6125, BW=23.9MiB/s (25.1MB/s)(24.0MiB/1003msec); 0 zone resets 00:13:08.802 slat (nsec): min=1980, max=2606.2k, avg=79171.41, stdev=295498.69 00:13:08.802 clat (usec): min=6196, max=13900, avg=10354.34, stdev=1551.15 00:13:08.802 lat (usec): min=6209, max=13922, avg=10433.51, stdev=1572.31 00:13:08.802 clat percentiles (usec): 00:13:08.802 | 1.00th=[ 6915], 5.00th=[ 7701], 10.00th=[ 7832], 20.00th=[ 8029], 00:13:08.802 | 30.00th=[10421], 40.00th=[10945], 50.00th=[11076], 60.00th=[11207], 00:13:08.802 | 70.00th=[11207], 80.00th=[11338], 90.00th=[11600], 95.00th=[11994], 00:13:08.802 | 99.00th=[12911], 99.50th=[13042], 99.90th=[13435], 99.95th=[13698], 00:13:08.802 | 99.99th=[13960] 00:13:08.802 bw ( KiB/s): min=22360, max=26792, per=26.55%, avg=24576.00, stdev=3133.90, samples=2 00:13:08.802 iops : min= 5590, max= 6698, avg=6144.00, stdev=783.47, samples=2 00:13:08.802 lat (msec) : 4=0.13%, 10=26.45%, 20=73.42% 00:13:08.802 cpu : usr=2.10%, sys=3.69%, ctx=946, majf=0, minf=1 00:13:08.802 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:13:08.802 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:08.803 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:13:08.803 issued rwts: total=5967,6144,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:08.803 latency : target=0, window=0, percentile=100.00%, depth=128 00:13:08.803 00:13:08.803 Run status group 0 (all jobs): 00:13:08.803 READ: bw=86.6MiB/s (90.8MB/s), 17.9MiB/s-26.8MiB/s (18.8MB/s-28.1MB/s), io=86.9MiB (91.1MB), run=1003-1004msec 00:13:08.803 WRITE: bw=90.4MiB/s (94.8MB/s), 18.7MiB/s-27.9MiB/s (19.6MB/s-29.2MB/s), io=90.7MiB (95.1MB), run=1003-1004msec 00:13:08.803 00:13:08.803 Disk stats (read/write): 00:13:08.803 nvme0n1: ios=5839/6144, merge=0/0, ticks=26296/27039, in_queue=53335, util=87.07% 00:13:08.803 nvme0n2: ios=3907/4096, merge=0/0, ticks=17395/18212, in_queue=35607, util=87.22% 00:13:08.803 nvme0n3: ios=4106/4608, merge=0/0, ticks=12823/14178, in_queue=27001, util=89.33% 00:13:08.803 nvme0n4: ios=5120/5406, merge=0/0, ticks=17602/17955, in_queue=35557, util=89.78% 00:13:08.803 15:42:07 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:13:08.803 [global] 00:13:08.803 thread=1 00:13:08.803 invalidate=1 00:13:08.803 rw=randwrite 00:13:08.803 time_based=1 00:13:08.803 runtime=1 00:13:08.803 ioengine=libaio 00:13:08.803 direct=1 00:13:08.803 bs=4096 00:13:08.803 iodepth=128 00:13:08.803 norandommap=0 00:13:08.803 numjobs=1 00:13:08.803 00:13:08.803 verify_dump=1 00:13:08.803 verify_backlog=512 00:13:08.803 verify_state_save=0 00:13:08.803 do_verify=1 00:13:08.803 verify=crc32c-intel 00:13:08.803 [job0] 00:13:08.803 filename=/dev/nvme0n1 00:13:08.803 [job1] 00:13:08.803 filename=/dev/nvme0n2 00:13:08.803 [job2] 00:13:08.803 filename=/dev/nvme0n3 00:13:08.803 [job3] 00:13:08.803 filename=/dev/nvme0n4 00:13:08.803 Could not set queue depth (nvme0n1) 00:13:08.803 Could not set queue depth (nvme0n2) 00:13:08.803 Could not set queue depth (nvme0n3) 00:13:08.803 Could not set queue depth (nvme0n4) 00:13:08.803 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:13:08.803 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:13:08.803 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:13:08.803 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:13:08.803 fio-3.35 00:13:08.803 Starting 4 threads 00:13:10.173 00:13:10.173 job0: (groupid=0, jobs=1): err= 0: pid=3302546: Fri Apr 26 15:42:08 2024 00:13:10.173 read: IOPS=9708, BW=37.9MiB/s (39.8MB/s)(38.0MiB/1002msec) 00:13:10.173 slat (nsec): min=1392, max=1316.9k, avg=51553.79, stdev=186892.90 00:13:10.173 clat (usec): min=4994, max=7804, avg=6677.59, stdev=435.47 00:13:10.173 lat (usec): min=4999, max=7807, avg=6729.14, stdev=435.51 00:13:10.173 clat percentiles (usec): 00:13:10.173 | 1.00th=[ 5407], 5.00th=[ 6063], 10.00th=[ 6194], 20.00th=[ 6325], 00:13:10.173 | 30.00th=[ 6456], 40.00th=[ 6587], 50.00th=[ 6652], 60.00th=[ 6783], 00:13:10.173 | 70.00th=[ 6849], 80.00th=[ 6980], 90.00th=[ 7308], 95.00th=[ 7504], 00:13:10.173 | 99.00th=[ 7635], 99.50th=[ 7635], 99.90th=[ 7767], 99.95th=[ 7767], 00:13:10.173 | 99.99th=[ 7832] 00:13:10.173 write: IOPS=9889, BW=38.6MiB/s (40.5MB/s)(38.7MiB/1002msec); 0 zone resets 00:13:10.173 slat (nsec): min=1862, max=912226, avg=48254.04, stdev=173364.11 00:13:10.173 clat (usec): min=474, max=7571, avg=6247.90, stdev=553.22 00:13:10.173 lat (usec): min=1180, max=7578, avg=6296.16, stdev=554.28 00:13:10.173 clat percentiles (usec): 00:13:10.173 | 1.00th=[ 4686], 5.00th=[ 5342], 10.00th=[ 5866], 20.00th=[ 5997], 00:13:10.173 | 30.00th=[ 6063], 40.00th=[ 6128], 50.00th=[ 6194], 60.00th=[ 6325], 00:13:10.173 | 70.00th=[ 6456], 80.00th=[ 6652], 90.00th=[ 6849], 95.00th=[ 6980], 00:13:10.173 | 99.00th=[ 7177], 99.50th=[ 7308], 99.90th=[ 7504], 99.95th=[ 7570], 00:13:10.173 | 99.99th=[ 7570] 00:13:10.173 bw ( KiB/s): min=37288, max=40960, per=35.34%, avg=39124.00, stdev=2596.50, samples=2 00:13:10.173 iops : min= 9322, max=10240, avg=9781.00, stdev=649.12, samples=2 00:13:10.173 lat (usec) : 500=0.01% 00:13:10.173 lat (msec) : 2=0.11%, 4=0.22%, 10=99.67% 00:13:10.173 cpu : usr=3.60%, sys=4.60%, ctx=1500, majf=0, minf=1 00:13:10.173 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.7% 00:13:10.173 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:10.173 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:13:10.173 issued rwts: total=9728,9909,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:10.173 latency : target=0, window=0, percentile=100.00%, depth=128 00:13:10.173 job1: (groupid=0, jobs=1): err= 0: pid=3302547: Fri Apr 26 15:42:08 2024 00:13:10.173 read: IOPS=9197, BW=35.9MiB/s (37.7MB/s)(36.0MiB/1002msec) 00:13:10.173 slat (nsec): min=1409, max=959853, avg=52291.69, stdev=191571.58 00:13:10.173 clat (usec): min=5353, max=7867, avg=6745.56, stdev=309.76 00:13:10.173 lat (usec): min=5702, max=7870, avg=6797.85, stdev=277.85 00:13:10.173 clat percentiles (usec): 00:13:10.173 | 1.00th=[ 5800], 5.00th=[ 6128], 10.00th=[ 6390], 20.00th=[ 6521], 00:13:10.173 | 30.00th=[ 6652], 40.00th=[ 6718], 50.00th=[ 6783], 60.00th=[ 6849], 00:13:10.173 | 70.00th=[ 6915], 80.00th=[ 6980], 90.00th=[ 7046], 95.00th=[ 7177], 00:13:10.173 | 99.00th=[ 7635], 99.50th=[ 7701], 99.90th=[ 7767], 99.95th=[ 7832], 00:13:10.173 | 99.99th=[ 7898] 00:13:10.173 write: IOPS=9635, BW=37.6MiB/s (39.5MB/s)(37.7MiB/1002msec); 0 zone resets 00:13:10.173 slat (nsec): min=1877, max=1670.4k, avg=51672.22, stdev=187420.05 00:13:10.173 clat (usec): min=580, max=17976, avg=6659.67, stdev=1456.96 00:13:10.174 lat (usec): min=1360, max=18635, avg=6711.35, stdev=1460.17 00:13:10.174 clat percentiles (usec): 00:13:10.174 | 1.00th=[ 5080], 5.00th=[ 5932], 10.00th=[ 6128], 20.00th=[ 6194], 00:13:10.174 | 30.00th=[ 6325], 40.00th=[ 6390], 50.00th=[ 6521], 60.00th=[ 6587], 00:13:10.174 | 70.00th=[ 6718], 80.00th=[ 6783], 90.00th=[ 6915], 95.00th=[ 7111], 00:13:10.174 | 99.00th=[16581], 99.50th=[17695], 99.90th=[17957], 99.95th=[17957], 00:13:10.174 | 99.99th=[17957] 00:13:10.174 bw ( KiB/s): min=36864, max=39360, per=34.43%, avg=38112.00, stdev=1764.94, samples=2 00:13:10.174 iops : min= 9216, max= 9840, avg=9528.00, stdev=441.23, samples=2 00:13:10.174 lat (usec) : 750=0.01% 00:13:10.174 lat (msec) : 2=0.09%, 4=0.25%, 10=98.59%, 20=1.07% 00:13:10.174 cpu : usr=2.30%, sys=5.49%, ctx=1369, majf=0, minf=1 00:13:10.174 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.7% 00:13:10.174 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:10.174 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:13:10.174 issued rwts: total=9216,9655,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:10.174 latency : target=0, window=0, percentile=100.00%, depth=128 00:13:10.174 job2: (groupid=0, jobs=1): err= 0: pid=3302548: Fri Apr 26 15:42:08 2024 00:13:10.174 read: IOPS=3996, BW=15.6MiB/s (16.4MB/s)(15.7MiB/1003msec) 00:13:10.174 slat (nsec): min=1507, max=1442.1k, avg=124518.32, stdev=331261.91 00:13:10.174 clat (usec): min=1821, max=17967, avg=15795.44, stdev=1395.48 00:13:10.174 lat (usec): min=2654, max=17969, avg=15919.96, stdev=1358.75 00:13:10.174 clat percentiles (usec): 00:13:10.174 | 1.00th=[ 6652], 5.00th=[14877], 10.00th=[15270], 20.00th=[15664], 00:13:10.174 | 30.00th=[15926], 40.00th=[16057], 50.00th=[16057], 60.00th=[16188], 00:13:10.174 | 70.00th=[16188], 80.00th=[16319], 90.00th=[16450], 95.00th=[16581], 00:13:10.174 | 99.00th=[16712], 99.50th=[16909], 99.90th=[17957], 99.95th=[17957], 00:13:10.174 | 99.99th=[17957] 00:13:10.174 write: IOPS=4083, BW=16.0MiB/s (16.7MB/s)(16.0MiB/1003msec); 0 zone resets 00:13:10.174 slat (nsec): min=1986, max=1387.0k, avg=119750.81, stdev=313503.24 00:13:10.174 clat (usec): min=13396, max=19242, avg=15446.64, stdev=762.75 00:13:10.174 lat (usec): min=13659, max=19249, avg=15566.39, stdev=702.29 00:13:10.174 clat percentiles (usec): 00:13:10.174 | 1.00th=[13960], 5.00th=[14353], 10.00th=[14746], 20.00th=[15008], 00:13:10.174 | 30.00th=[15139], 40.00th=[15270], 50.00th=[15401], 60.00th=[15401], 00:13:10.174 | 70.00th=[15664], 80.00th=[15795], 90.00th=[16057], 95.00th=[17171], 00:13:10.174 | 99.00th=[18482], 99.50th=[18744], 99.90th=[19268], 99.95th=[19268], 00:13:10.174 | 99.99th=[19268] 00:13:10.174 bw ( KiB/s): min=16384, max=16384, per=14.80%, avg=16384.00, stdev= 0.00, samples=2 00:13:10.174 iops : min= 4096, max= 4096, avg=4096.00, stdev= 0.00, samples=2 00:13:10.174 lat (msec) : 2=0.01%, 4=0.22%, 10=0.57%, 20=99.20% 00:13:10.174 cpu : usr=1.60%, sys=3.09%, ctx=1250, majf=0, minf=1 00:13:10.174 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:13:10.174 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:10.174 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:13:10.174 issued rwts: total=4008,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:10.174 latency : target=0, window=0, percentile=100.00%, depth=128 00:13:10.174 job3: (groupid=0, jobs=1): err= 0: pid=3302549: Fri Apr 26 15:42:08 2024 00:13:10.174 read: IOPS=3990, BW=15.6MiB/s (16.3MB/s)(15.6MiB/1003msec) 00:13:10.174 slat (nsec): min=1596, max=1467.5k, avg=124728.61, stdev=331947.21 00:13:10.174 clat (usec): min=1823, max=17968, avg=15781.17, stdev=1397.49 00:13:10.174 lat (usec): min=2639, max=17971, avg=15905.90, stdev=1360.88 00:13:10.174 clat percentiles (usec): 00:13:10.174 | 1.00th=[ 6652], 5.00th=[14877], 10.00th=[15139], 20.00th=[15664], 00:13:10.174 | 30.00th=[15795], 40.00th=[15926], 50.00th=[16057], 60.00th=[16188], 00:13:10.174 | 70.00th=[16188], 80.00th=[16319], 90.00th=[16450], 95.00th=[16581], 00:13:10.174 | 99.00th=[16712], 99.50th=[16909], 99.90th=[17957], 99.95th=[17957], 00:13:10.174 | 99.99th=[17957] 00:13:10.174 write: IOPS=4083, BW=16.0MiB/s (16.7MB/s)(16.0MiB/1003msec); 0 zone resets 00:13:10.174 slat (usec): min=2, max=2641, avg=119.81, stdev=316.99 00:13:10.174 clat (usec): min=13392, max=19205, avg=15462.29, stdev=774.02 00:13:10.174 lat (usec): min=13618, max=19212, avg=15582.10, stdev=711.18 00:13:10.174 clat percentiles (usec): 00:13:10.174 | 1.00th=[13960], 5.00th=[14353], 10.00th=[14746], 20.00th=[15008], 00:13:10.174 | 30.00th=[15139], 40.00th=[15270], 50.00th=[15401], 60.00th=[15401], 00:13:10.174 | 70.00th=[15664], 80.00th=[15795], 90.00th=[16057], 95.00th=[17171], 00:13:10.174 | 99.00th=[18482], 99.50th=[18744], 99.90th=[19268], 99.95th=[19268], 00:13:10.174 | 99.99th=[19268] 00:13:10.174 bw ( KiB/s): min=16384, max=16384, per=14.80%, avg=16384.00, stdev= 0.00, samples=2 00:13:10.174 iops : min= 4096, max= 4096, avg=4096.00, stdev= 0.00, samples=2 00:13:10.174 lat (msec) : 2=0.01%, 4=0.21%, 10=0.58%, 20=99.20% 00:13:10.174 cpu : usr=1.30%, sys=3.19%, ctx=1234, majf=0, minf=1 00:13:10.174 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:13:10.174 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:10.174 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:13:10.174 issued rwts: total=4002,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:10.174 latency : target=0, window=0, percentile=100.00%, depth=128 00:13:10.174 00:13:10.174 Run status group 0 (all jobs): 00:13:10.174 READ: bw=105MiB/s (110MB/s), 15.6MiB/s-37.9MiB/s (16.3MB/s-39.8MB/s), io=105MiB (110MB), run=1002-1003msec 00:13:10.174 WRITE: bw=108MiB/s (113MB/s), 16.0MiB/s-38.6MiB/s (16.7MB/s-40.5MB/s), io=108MiB (114MB), run=1002-1003msec 00:13:10.174 00:13:10.174 Disk stats (read/write): 00:13:10.174 nvme0n1: ios=8246/8704, merge=0/0, ticks=13663/13415, in_queue=27078, util=87.27% 00:13:10.174 nvme0n2: ios=7982/8192, merge=0/0, ticks=13345/13747, in_queue=27092, util=87.23% 00:13:10.174 nvme0n3: ios=3349/3584, merge=0/0, ticks=13469/13829, in_queue=27298, util=89.13% 00:13:10.174 nvme0n4: ios=3344/3584, merge=0/0, ticks=13438/13834, in_queue=27272, util=89.69% 00:13:10.174 15:42:08 -- target/fio.sh@55 -- # sync 00:13:10.174 15:42:08 -- target/fio.sh@59 -- # fio_pid=3302726 00:13:10.174 15:42:08 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:13:10.174 15:42:08 -- target/fio.sh@61 -- # sleep 3 00:13:10.174 [global] 00:13:10.174 thread=1 00:13:10.174 invalidate=1 00:13:10.174 rw=read 00:13:10.174 time_based=1 00:13:10.174 runtime=10 00:13:10.174 ioengine=libaio 00:13:10.174 direct=1 00:13:10.174 bs=4096 00:13:10.174 iodepth=1 00:13:10.174 norandommap=1 00:13:10.174 numjobs=1 00:13:10.174 00:13:10.174 [job0] 00:13:10.174 filename=/dev/nvme0n1 00:13:10.174 [job1] 00:13:10.174 filename=/dev/nvme0n2 00:13:10.174 [job2] 00:13:10.174 filename=/dev/nvme0n3 00:13:10.174 [job3] 00:13:10.174 filename=/dev/nvme0n4 00:13:10.174 Could not set queue depth (nvme0n1) 00:13:10.174 Could not set queue depth (nvme0n2) 00:13:10.174 Could not set queue depth (nvme0n3) 00:13:10.174 Could not set queue depth (nvme0n4) 00:13:10.431 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:13:10.431 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:13:10.431 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:13:10.431 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:13:10.431 fio-3.35 00:13:10.431 Starting 4 threads 00:13:12.954 15:42:11 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:13:13.211 fio: io_u error on file /dev/nvme0n4: Remote I/O error: read offset=77832192, buflen=4096 00:13:13.211 fio: pid=3302929, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:13:13.211 15:42:11 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:13:13.469 fio: io_u error on file /dev/nvme0n3: Remote I/O error: read offset=83632128, buflen=4096 00:13:13.469 fio: pid=3302928, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:13:13.469 15:42:11 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:13:13.469 15:42:11 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:13:13.726 fio: io_u error on file /dev/nvme0n1: Remote I/O error: read offset=52912128, buflen=4096 00:13:13.726 fio: pid=3302926, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:13:13.726 15:42:12 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:13:13.726 15:42:12 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:13:13.726 fio: io_u error on file /dev/nvme0n2: Remote I/O error: read offset=64724992, buflen=4096 00:13:13.726 fio: pid=3302927, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:13:13.983 15:42:12 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:13:13.983 15:42:12 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:13:13.983 00:13:13.983 job0: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=3302926: Fri Apr 26 15:42:12 2024 00:13:13.983 read: IOPS=9642, BW=37.7MiB/s (39.5MB/s)(114MiB/3039msec) 00:13:13.983 slat (usec): min=5, max=15018, avg= 8.43, stdev=140.76 00:13:13.983 clat (usec): min=48, max=20824, avg=93.51, stdev=123.00 00:13:13.983 lat (usec): min=54, max=20830, avg=101.94, stdev=186.91 00:13:13.983 clat percentiles (usec): 00:13:13.983 | 1.00th=[ 58], 5.00th=[ 71], 10.00th=[ 73], 20.00th=[ 76], 00:13:13.984 | 30.00th=[ 78], 40.00th=[ 80], 50.00th=[ 83], 60.00th=[ 93], 00:13:13.984 | 70.00th=[ 111], 80.00th=[ 116], 90.00th=[ 121], 95.00th=[ 126], 00:13:13.984 | 99.00th=[ 151], 99.50th=[ 157], 99.90th=[ 169], 99.95th=[ 176], 00:13:13.984 | 99.99th=[ 281] 00:13:13.984 bw ( KiB/s): min=32240, max=46696, per=30.98%, avg=38505.60, stdev=7453.57, samples=5 00:13:13.984 iops : min= 8060, max=11674, avg=9626.40, stdev=1863.39, samples=5 00:13:13.984 lat (usec) : 50=0.01%, 100=61.93%, 250=38.05%, 500=0.01% 00:13:13.984 lat (msec) : 50=0.01% 00:13:13.984 cpu : usr=3.03%, sys=10.50%, ctx=29307, majf=0, minf=1 00:13:13.984 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:13:13.984 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:13.984 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:13.984 issued rwts: total=29303,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:13.984 latency : target=0, window=0, percentile=100.00%, depth=1 00:13:13.984 job1: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=3302927: Fri Apr 26 15:42:12 2024 00:13:13.984 read: IOPS=9912, BW=38.7MiB/s (40.6MB/s)(126MiB/3247msec) 00:13:13.984 slat (usec): min=3, max=16754, avg= 9.39, stdev=194.88 00:13:13.984 clat (usec): min=40, max=20976, avg=89.79, stdev=118.64 00:13:13.984 lat (usec): min=49, max=20982, avg=99.18, stdev=228.00 00:13:13.984 clat percentiles (usec): 00:13:13.984 | 1.00th=[ 53], 5.00th=[ 58], 10.00th=[ 66], 20.00th=[ 73], 00:13:13.984 | 30.00th=[ 76], 40.00th=[ 78], 50.00th=[ 81], 60.00th=[ 85], 00:13:13.984 | 70.00th=[ 106], 80.00th=[ 115], 90.00th=[ 120], 95.00th=[ 126], 00:13:13.984 | 99.00th=[ 151], 99.50th=[ 155], 99.90th=[ 165], 99.95th=[ 172], 00:13:13.984 | 99.99th=[ 258] 00:13:13.984 bw ( KiB/s): min=32248, max=46872, per=31.32%, avg=38937.33, stdev=6792.34, samples=6 00:13:13.984 iops : min= 8062, max=11718, avg=9734.33, stdev=1698.08, samples=6 00:13:13.984 lat (usec) : 50=0.18%, 100=66.39%, 250=33.41%, 500=0.01% 00:13:13.984 lat (msec) : 50=0.01% 00:13:13.984 cpu : usr=2.65%, sys=11.09%, ctx=32193, majf=0, minf=1 00:13:13.984 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:13:13.984 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:13.984 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:13.984 issued rwts: total=32187,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:13.984 latency : target=0, window=0, percentile=100.00%, depth=1 00:13:13.984 job2: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=3302928: Fri Apr 26 15:42:12 2024 00:13:13.984 read: IOPS=7154, BW=27.9MiB/s (29.3MB/s)(79.8MiB/2854msec) 00:13:13.984 slat (usec): min=5, max=15693, avg= 9.26, stdev=137.80 00:13:13.984 clat (usec): min=65, max=21474, avg=128.14, stdev=151.47 00:13:13.984 lat (usec): min=74, max=21489, avg=137.40, stdev=204.64 00:13:13.984 clat percentiles (usec): 00:13:13.984 | 1.00th=[ 78], 5.00th=[ 84], 10.00th=[ 88], 20.00th=[ 99], 00:13:13.984 | 30.00th=[ 124], 40.00th=[ 128], 50.00th=[ 131], 60.00th=[ 135], 00:13:13.984 | 70.00th=[ 137], 80.00th=[ 143], 90.00th=[ 155], 95.00th=[ 174], 00:13:13.984 | 99.00th=[ 188], 99.50th=[ 192], 99.90th=[ 202], 99.95th=[ 204], 00:13:13.984 | 99.99th=[ 239] 00:13:13.984 bw ( KiB/s): min=27328, max=32880, per=23.27%, avg=28929.60, stdev=2275.41, samples=5 00:13:13.984 iops : min= 6832, max= 8220, avg=7232.40, stdev=568.85, samples=5 00:13:13.984 lat (usec) : 100=20.28%, 250=79.71%, 500=0.01% 00:13:13.984 lat (msec) : 50=0.01% 00:13:13.984 cpu : usr=2.98%, sys=7.92%, ctx=20422, majf=0, minf=1 00:13:13.984 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:13:13.984 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:13.984 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:13.984 issued rwts: total=20419,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:13.984 latency : target=0, window=0, percentile=100.00%, depth=1 00:13:13.984 job3: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=3302929: Fri Apr 26 15:42:12 2024 00:13:13.984 read: IOPS=7130, BW=27.9MiB/s (29.2MB/s)(74.2MiB/2665msec) 00:13:13.984 slat (nsec): min=5823, max=36755, avg=7804.20, stdev=2149.78 00:13:13.984 clat (usec): min=74, max=326, avg=129.78, stdev=23.20 00:13:13.984 lat (usec): min=80, max=333, avg=137.59, stdev=23.42 00:13:13.984 clat percentiles (usec): 00:13:13.984 | 1.00th=[ 83], 5.00th=[ 88], 10.00th=[ 92], 20.00th=[ 117], 00:13:13.984 | 30.00th=[ 126], 40.00th=[ 129], 50.00th=[ 133], 60.00th=[ 135], 00:13:13.984 | 70.00th=[ 139], 80.00th=[ 143], 90.00th=[ 159], 95.00th=[ 174], 00:13:13.984 | 99.00th=[ 188], 99.50th=[ 192], 99.90th=[ 202], 99.95th=[ 210], 00:13:13.984 | 99.99th=[ 260] 00:13:13.984 bw ( KiB/s): min=27312, max=32576, per=23.22%, avg=28867.20, stdev=2144.38, samples=5 00:13:13.984 iops : min= 6828, max= 8144, avg=7216.80, stdev=536.09, samples=5 00:13:13.984 lat (usec) : 100=15.82%, 250=84.16%, 500=0.01% 00:13:13.984 cpu : usr=2.78%, sys=7.55%, ctx=19004, majf=0, minf=2 00:13:13.984 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:13:13.984 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:13.984 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:13:13.984 issued rwts: total=19003,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:13:13.984 latency : target=0, window=0, percentile=100.00%, depth=1 00:13:13.984 00:13:13.984 Run status group 0 (all jobs): 00:13:13.984 READ: bw=121MiB/s (127MB/s), 27.9MiB/s-38.7MiB/s (29.2MB/s-40.6MB/s), io=394MiB (413MB), run=2665-3247msec 00:13:13.984 00:13:13.984 Disk stats (read/write): 00:13:13.984 nvme0n1: ios=27579/0, merge=0/0, ticks=2415/0, in_queue=2415, util=94.02% 00:13:13.984 nvme0n2: ios=30016/0, merge=0/0, ticks=2581/0, in_queue=2581, util=93.12% 00:13:13.984 nvme0n3: ios=20418/0, merge=0/0, ticks=2467/0, in_queue=2467, util=95.48% 00:13:13.984 nvme0n4: ios=18591/0, merge=0/0, ticks=2262/0, in_queue=2262, util=96.46% 00:13:13.984 15:42:12 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:13:13.984 15:42:12 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:13:14.240 15:42:12 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:13:14.240 15:42:12 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:13:14.496 15:42:12 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:13:14.496 15:42:12 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:13:14.753 15:42:13 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:13:14.753 15:42:13 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:13:14.753 15:42:13 -- target/fio.sh@69 -- # fio_status=0 00:13:14.753 15:42:13 -- target/fio.sh@70 -- # wait 3302726 00:13:14.753 15:42:13 -- target/fio.sh@70 -- # fio_status=4 00:13:14.753 15:42:13 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:15.684 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:15.684 15:42:14 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:15.684 15:42:14 -- common/autotest_common.sh@1205 -- # local i=0 00:13:15.684 15:42:14 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:13:15.684 15:42:14 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:15.684 15:42:14 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:13:15.684 15:42:14 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:15.684 15:42:14 -- common/autotest_common.sh@1217 -- # return 0 00:13:15.684 15:42:14 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:13:15.684 15:42:14 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:13:15.684 nvmf hotplug test: fio failed as expected 00:13:15.684 15:42:14 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:15.941 15:42:14 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:13:15.941 15:42:14 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:13:15.941 15:42:14 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:13:15.941 15:42:14 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:13:15.941 15:42:14 -- target/fio.sh@91 -- # nvmftestfini 00:13:15.941 15:42:14 -- nvmf/common.sh@477 -- # nvmfcleanup 00:13:15.941 15:42:14 -- nvmf/common.sh@117 -- # sync 00:13:15.941 15:42:14 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:13:15.941 15:42:14 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:13:15.941 15:42:14 -- nvmf/common.sh@120 -- # set +e 00:13:15.941 15:42:14 -- nvmf/common.sh@121 -- # for i in {1..20} 00:13:15.941 15:42:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:13:15.941 rmmod nvme_rdma 00:13:15.941 rmmod nvme_fabrics 00:13:15.941 15:42:14 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:13:15.941 15:42:14 -- nvmf/common.sh@124 -- # set -e 00:13:15.941 15:42:14 -- nvmf/common.sh@125 -- # return 0 00:13:15.941 15:42:14 -- nvmf/common.sh@478 -- # '[' -n 3299341 ']' 00:13:15.941 15:42:14 -- nvmf/common.sh@479 -- # killprocess 3299341 00:13:15.941 15:42:14 -- common/autotest_common.sh@936 -- # '[' -z 3299341 ']' 00:13:15.941 15:42:14 -- common/autotest_common.sh@940 -- # kill -0 3299341 00:13:15.941 15:42:14 -- common/autotest_common.sh@941 -- # uname 00:13:15.941 15:42:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:15.941 15:42:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3299341 00:13:16.198 15:42:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:16.198 15:42:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:16.198 15:42:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3299341' 00:13:16.198 killing process with pid 3299341 00:13:16.198 15:42:14 -- common/autotest_common.sh@955 -- # kill 3299341 00:13:16.198 15:42:14 -- common/autotest_common.sh@960 -- # wait 3299341 00:13:16.198 [2024-04-26 15:42:14.645510] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:13:16.455 15:42:14 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:13:16.455 15:42:14 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:13:16.455 00:13:16.455 real 0m24.715s 00:13:16.455 user 1m50.987s 00:13:16.455 sys 0m7.951s 00:13:16.455 15:42:14 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:13:16.455 15:42:14 -- common/autotest_common.sh@10 -- # set +x 00:13:16.455 ************************************ 00:13:16.455 END TEST nvmf_fio_target 00:13:16.455 ************************************ 00:13:16.455 15:42:14 -- nvmf/nvmf.sh@56 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=rdma 00:13:16.455 15:42:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:16.455 15:42:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:16.455 15:42:14 -- common/autotest_common.sh@10 -- # set +x 00:13:16.455 ************************************ 00:13:16.455 START TEST nvmf_bdevio 00:13:16.455 ************************************ 00:13:16.455 15:42:15 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=rdma 00:13:16.713 * Looking for test storage... 00:13:16.713 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:13:16.713 15:42:15 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:13:16.713 15:42:15 -- nvmf/common.sh@7 -- # uname -s 00:13:16.713 15:42:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:16.713 15:42:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:16.713 15:42:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:16.713 15:42:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:16.713 15:42:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:16.713 15:42:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:16.713 15:42:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:16.713 15:42:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:16.713 15:42:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:16.713 15:42:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:16.713 15:42:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:13:16.713 15:42:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:13:16.713 15:42:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:16.713 15:42:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:16.713 15:42:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:16.713 15:42:15 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:16.713 15:42:15 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:13:16.713 15:42:15 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:16.713 15:42:15 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:16.713 15:42:15 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:16.713 15:42:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:16.713 15:42:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:16.713 15:42:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:16.713 15:42:15 -- paths/export.sh@5 -- # export PATH 00:13:16.713 15:42:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:16.713 15:42:15 -- nvmf/common.sh@47 -- # : 0 00:13:16.713 15:42:15 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:13:16.713 15:42:15 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:13:16.713 15:42:15 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:16.713 15:42:15 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:16.713 15:42:15 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:16.713 15:42:15 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:13:16.713 15:42:15 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:13:16.714 15:42:15 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:13:16.714 15:42:15 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:16.714 15:42:15 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:16.714 15:42:15 -- target/bdevio.sh@14 -- # nvmftestinit 00:13:16.714 15:42:15 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:13:16.714 15:42:15 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:16.714 15:42:15 -- nvmf/common.sh@437 -- # prepare_net_devs 00:13:16.714 15:42:15 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:13:16.714 15:42:15 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:13:16.714 15:42:15 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:16.714 15:42:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:16.714 15:42:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:16.714 15:42:15 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:13:16.714 15:42:15 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:13:16.714 15:42:15 -- nvmf/common.sh@285 -- # xtrace_disable 00:13:16.714 15:42:15 -- common/autotest_common.sh@10 -- # set +x 00:13:21.976 15:42:20 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:21.976 15:42:20 -- nvmf/common.sh@291 -- # pci_devs=() 00:13:21.976 15:42:20 -- nvmf/common.sh@291 -- # local -a pci_devs 00:13:21.976 15:42:20 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:13:21.976 15:42:20 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:13:21.976 15:42:20 -- nvmf/common.sh@293 -- # pci_drivers=() 00:13:21.976 15:42:20 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:13:21.976 15:42:20 -- nvmf/common.sh@295 -- # net_devs=() 00:13:21.976 15:42:20 -- nvmf/common.sh@295 -- # local -ga net_devs 00:13:21.976 15:42:20 -- nvmf/common.sh@296 -- # e810=() 00:13:21.976 15:42:20 -- nvmf/common.sh@296 -- # local -ga e810 00:13:21.976 15:42:20 -- nvmf/common.sh@297 -- # x722=() 00:13:21.976 15:42:20 -- nvmf/common.sh@297 -- # local -ga x722 00:13:21.976 15:42:20 -- nvmf/common.sh@298 -- # mlx=() 00:13:21.976 15:42:20 -- nvmf/common.sh@298 -- # local -ga mlx 00:13:21.976 15:42:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:21.976 15:42:20 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:21.976 15:42:20 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:21.976 15:42:20 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:21.976 15:42:20 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:21.976 15:42:20 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:21.976 15:42:20 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:21.976 15:42:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:21.976 15:42:20 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:21.976 15:42:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:21.976 15:42:20 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:21.976 15:42:20 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:13:21.976 15:42:20 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:13:21.976 15:42:20 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:13:21.976 15:42:20 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:13:21.976 15:42:20 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:13:21.976 15:42:20 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:13:21.976 15:42:20 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:13:21.976 15:42:20 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:21.976 15:42:20 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:13:21.976 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:13:21.976 15:42:20 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:13:21.976 15:42:20 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:13:21.976 15:42:20 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:13:21.976 15:42:20 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:13:21.976 15:42:20 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:13:21.976 15:42:20 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:21.976 15:42:20 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:21.976 15:42:20 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:13:21.976 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:13:21.977 15:42:20 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:13:21.977 15:42:20 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:13:21.977 15:42:20 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:13:21.977 15:42:20 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:13:21.977 15:42:20 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:13:21.977 15:42:20 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:21.977 15:42:20 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:13:21.977 15:42:20 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:13:21.977 15:42:20 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:21.977 15:42:20 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:21.977 15:42:20 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:21.977 15:42:20 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:21.977 15:42:20 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:13:21.977 Found net devices under 0000:da:00.0: mlx_0_0 00:13:21.977 15:42:20 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:21.977 15:42:20 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:21.977 15:42:20 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:21.977 15:42:20 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:21.977 15:42:20 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:21.977 15:42:20 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:13:21.977 Found net devices under 0000:da:00.1: mlx_0_1 00:13:21.977 15:42:20 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:21.977 15:42:20 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:13:21.977 15:42:20 -- nvmf/common.sh@403 -- # is_hw=yes 00:13:21.977 15:42:20 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:13:21.977 15:42:20 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:13:21.977 15:42:20 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:13:21.977 15:42:20 -- nvmf/common.sh@409 -- # rdma_device_init 00:13:21.977 15:42:20 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:13:21.977 15:42:20 -- nvmf/common.sh@58 -- # uname 00:13:21.977 15:42:20 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:13:21.977 15:42:20 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:13:21.977 15:42:20 -- nvmf/common.sh@63 -- # modprobe ib_core 00:13:21.977 15:42:20 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:13:21.977 15:42:20 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:13:21.977 15:42:20 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:13:21.977 15:42:20 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:13:21.977 15:42:20 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:13:21.977 15:42:20 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:13:21.977 15:42:20 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:13:21.977 15:42:20 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:13:21.977 15:42:20 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:21.977 15:42:20 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:21.977 15:42:20 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:21.977 15:42:20 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:21.977 15:42:20 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:21.977 15:42:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:21.977 15:42:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:21.977 15:42:20 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:13:21.977 15:42:20 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:13:21.977 15:42:20 -- nvmf/common.sh@105 -- # continue 2 00:13:21.977 15:42:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:21.977 15:42:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:21.977 15:42:20 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:13:21.977 15:42:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:21.977 15:42:20 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:13:21.977 15:42:20 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:13:21.977 15:42:20 -- nvmf/common.sh@105 -- # continue 2 00:13:21.977 15:42:20 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:21.977 15:42:20 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:13:21.977 15:42:20 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:21.977 15:42:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:21.977 15:42:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:21.977 15:42:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:21.977 15:42:20 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:13:21.977 15:42:20 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:13:21.977 15:42:20 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:13:21.977 118: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:13:21.977 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:13:21.977 altname enp218s0f0np0 00:13:21.977 altname ens818f0np0 00:13:21.977 inet 192.168.100.8/24 scope global mlx_0_0 00:13:21.977 valid_lft forever preferred_lft forever 00:13:21.977 15:42:20 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:21.977 15:42:20 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:13:21.977 15:42:20 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:21.977 15:42:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:21.977 15:42:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:21.977 15:42:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:21.977 15:42:20 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:13:21.977 15:42:20 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:13:21.977 15:42:20 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:13:21.977 119: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:13:21.977 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:13:21.977 altname enp218s0f1np1 00:13:21.977 altname ens818f1np1 00:13:21.977 inet 192.168.100.9/24 scope global mlx_0_1 00:13:21.977 valid_lft forever preferred_lft forever 00:13:21.977 15:42:20 -- nvmf/common.sh@411 -- # return 0 00:13:21.977 15:42:20 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:13:21.977 15:42:20 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:13:21.977 15:42:20 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:13:21.977 15:42:20 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:13:21.977 15:42:20 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:13:21.977 15:42:20 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:21.977 15:42:20 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:21.977 15:42:20 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:21.977 15:42:20 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:21.977 15:42:20 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:21.977 15:42:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:21.977 15:42:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:21.977 15:42:20 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:13:21.977 15:42:20 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:13:21.977 15:42:20 -- nvmf/common.sh@105 -- # continue 2 00:13:21.977 15:42:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:21.977 15:42:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:21.977 15:42:20 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:13:21.977 15:42:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:21.977 15:42:20 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:13:21.977 15:42:20 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:13:21.977 15:42:20 -- nvmf/common.sh@105 -- # continue 2 00:13:21.977 15:42:20 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:21.977 15:42:20 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:13:21.977 15:42:20 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:21.977 15:42:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:21.977 15:42:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:21.977 15:42:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:21.977 15:42:20 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:21.977 15:42:20 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:13:21.977 15:42:20 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:21.977 15:42:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:21.977 15:42:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:21.977 15:42:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:21.977 15:42:20 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:13:21.977 192.168.100.9' 00:13:21.977 15:42:20 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:13:21.977 192.168.100.9' 00:13:21.977 15:42:20 -- nvmf/common.sh@446 -- # head -n 1 00:13:21.977 15:42:20 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:13:21.977 15:42:20 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:13:21.977 192.168.100.9' 00:13:21.977 15:42:20 -- nvmf/common.sh@447 -- # tail -n +2 00:13:21.977 15:42:20 -- nvmf/common.sh@447 -- # head -n 1 00:13:21.977 15:42:20 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:13:21.977 15:42:20 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:13:21.977 15:42:20 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:13:21.977 15:42:20 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:13:21.977 15:42:20 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:13:21.977 15:42:20 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:13:21.977 15:42:20 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:13:21.977 15:42:20 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:13:21.977 15:42:20 -- common/autotest_common.sh@710 -- # xtrace_disable 00:13:21.977 15:42:20 -- common/autotest_common.sh@10 -- # set +x 00:13:21.977 15:42:20 -- nvmf/common.sh@470 -- # nvmfpid=3306943 00:13:21.977 15:42:20 -- nvmf/common.sh@471 -- # waitforlisten 3306943 00:13:21.977 15:42:20 -- common/autotest_common.sh@817 -- # '[' -z 3306943 ']' 00:13:21.977 15:42:20 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:21.977 15:42:20 -- common/autotest_common.sh@822 -- # local max_retries=100 00:13:21.977 15:42:20 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:13:21.977 15:42:20 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:21.977 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:21.977 15:42:20 -- common/autotest_common.sh@826 -- # xtrace_disable 00:13:21.977 15:42:20 -- common/autotest_common.sh@10 -- # set +x 00:13:21.977 [2024-04-26 15:42:20.524013] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:13:21.978 [2024-04-26 15:42:20.524065] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:21.978 EAL: No free 2048 kB hugepages reported on node 1 00:13:22.236 [2024-04-26 15:42:20.580844] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:22.236 [2024-04-26 15:42:20.658200] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:22.236 [2024-04-26 15:42:20.658235] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:22.236 [2024-04-26 15:42:20.658242] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:13:22.236 [2024-04-26 15:42:20.658248] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:13:22.236 [2024-04-26 15:42:20.658253] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:22.236 [2024-04-26 15:42:20.658318] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:13:22.236 [2024-04-26 15:42:20.658409] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:13:22.236 [2024-04-26 15:42:20.658514] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:22.236 [2024-04-26 15:42:20.658515] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:13:22.800 15:42:21 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:13:22.800 15:42:21 -- common/autotest_common.sh@850 -- # return 0 00:13:22.800 15:42:21 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:13:22.800 15:42:21 -- common/autotest_common.sh@716 -- # xtrace_disable 00:13:22.800 15:42:21 -- common/autotest_common.sh@10 -- # set +x 00:13:22.800 15:42:21 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:22.800 15:42:21 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:13:22.800 15:42:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:22.800 15:42:21 -- common/autotest_common.sh@10 -- # set +x 00:13:22.800 [2024-04-26 15:42:21.393445] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x14609e0/0x1464ed0) succeed. 00:13:22.800 [2024-04-26 15:42:21.403699] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1462020/0x14a6560) succeed. 00:13:23.057 15:42:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:23.057 15:42:21 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:13:23.057 15:42:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:23.057 15:42:21 -- common/autotest_common.sh@10 -- # set +x 00:13:23.057 Malloc0 00:13:23.057 15:42:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:23.057 15:42:21 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:13:23.057 15:42:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:23.057 15:42:21 -- common/autotest_common.sh@10 -- # set +x 00:13:23.057 15:42:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:23.057 15:42:21 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:13:23.057 15:42:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:23.057 15:42:21 -- common/autotest_common.sh@10 -- # set +x 00:13:23.057 15:42:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:23.057 15:42:21 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:13:23.057 15:42:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:23.057 15:42:21 -- common/autotest_common.sh@10 -- # set +x 00:13:23.057 [2024-04-26 15:42:21.562480] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:13:23.057 15:42:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:23.057 15:42:21 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:13:23.057 15:42:21 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:13:23.057 15:42:21 -- nvmf/common.sh@521 -- # config=() 00:13:23.057 15:42:21 -- nvmf/common.sh@521 -- # local subsystem config 00:13:23.057 15:42:21 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:13:23.057 15:42:21 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:13:23.057 { 00:13:23.057 "params": { 00:13:23.057 "name": "Nvme$subsystem", 00:13:23.057 "trtype": "$TEST_TRANSPORT", 00:13:23.057 "traddr": "$NVMF_FIRST_TARGET_IP", 00:13:23.057 "adrfam": "ipv4", 00:13:23.057 "trsvcid": "$NVMF_PORT", 00:13:23.057 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:13:23.057 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:13:23.057 "hdgst": ${hdgst:-false}, 00:13:23.057 "ddgst": ${ddgst:-false} 00:13:23.057 }, 00:13:23.057 "method": "bdev_nvme_attach_controller" 00:13:23.057 } 00:13:23.057 EOF 00:13:23.057 )") 00:13:23.057 15:42:21 -- nvmf/common.sh@543 -- # cat 00:13:23.057 15:42:21 -- nvmf/common.sh@545 -- # jq . 00:13:23.057 15:42:21 -- nvmf/common.sh@546 -- # IFS=, 00:13:23.057 15:42:21 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:13:23.057 "params": { 00:13:23.057 "name": "Nvme1", 00:13:23.057 "trtype": "rdma", 00:13:23.057 "traddr": "192.168.100.8", 00:13:23.057 "adrfam": "ipv4", 00:13:23.058 "trsvcid": "4420", 00:13:23.058 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:13:23.058 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:13:23.058 "hdgst": false, 00:13:23.058 "ddgst": false 00:13:23.058 }, 00:13:23.058 "method": "bdev_nvme_attach_controller" 00:13:23.058 }' 00:13:23.058 [2024-04-26 15:42:21.608272] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:13:23.058 [2024-04-26 15:42:21.608319] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3307193 ] 00:13:23.058 EAL: No free 2048 kB hugepages reported on node 1 00:13:23.314 [2024-04-26 15:42:21.663506] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:23.314 [2024-04-26 15:42:21.737473] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:23.314 [2024-04-26 15:42:21.737569] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:23.314 [2024-04-26 15:42:21.737570] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:23.314 I/O targets: 00:13:23.314 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:13:23.314 00:13:23.314 00:13:23.314 CUnit - A unit testing framework for C - Version 2.1-3 00:13:23.314 http://cunit.sourceforge.net/ 00:13:23.314 00:13:23.314 00:13:23.314 Suite: bdevio tests on: Nvme1n1 00:13:23.572 Test: blockdev write read block ...passed 00:13:23.572 Test: blockdev write zeroes read block ...passed 00:13:23.572 Test: blockdev write zeroes read no split ...passed 00:13:23.572 Test: blockdev write zeroes read split ...passed 00:13:23.572 Test: blockdev write zeroes read split partial ...passed 00:13:23.572 Test: blockdev reset ...[2024-04-26 15:42:21.941793] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:13:23.572 [2024-04-26 15:42:21.964369] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:13:23.572 [2024-04-26 15:42:21.991174] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:13:23.572 passed 00:13:23.572 Test: blockdev write read 8 blocks ...passed 00:13:23.572 Test: blockdev write read size > 128k ...passed 00:13:23.572 Test: blockdev write read invalid size ...passed 00:13:23.572 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:13:23.572 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:13:23.572 Test: blockdev write read max offset ...passed 00:13:23.572 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:13:23.572 Test: blockdev writev readv 8 blocks ...passed 00:13:23.572 Test: blockdev writev readv 30 x 1block ...passed 00:13:23.572 Test: blockdev writev readv block ...passed 00:13:23.572 Test: blockdev writev readv size > 128k ...passed 00:13:23.572 Test: blockdev writev readv size > 128k in two iovs ...passed 00:13:23.572 Test: blockdev comparev and writev ...[2024-04-26 15:42:21.994121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:13:23.572 [2024-04-26 15:42:21.994151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:13:23.572 [2024-04-26 15:42:21.994161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:13:23.572 [2024-04-26 15:42:21.994169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:13:23.572 [2024-04-26 15:42:21.994329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:13:23.572 [2024-04-26 15:42:21.994341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:13:23.572 [2024-04-26 15:42:21.994348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:13:23.572 [2024-04-26 15:42:21.994355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:13:23.572 [2024-04-26 15:42:21.994524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:13:23.572 [2024-04-26 15:42:21.994532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:13:23.572 [2024-04-26 15:42:21.994540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:13:23.572 [2024-04-26 15:42:21.994546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:13:23.572 [2024-04-26 15:42:21.994710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:13:23.572 [2024-04-26 15:42:21.994719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:13:23.572 [2024-04-26 15:42:21.994726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:13:23.572 [2024-04-26 15:42:21.994732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:13:23.572 passed 00:13:23.572 Test: blockdev nvme passthru rw ...passed 00:13:23.572 Test: blockdev nvme passthru vendor specific ...[2024-04-26 15:42:21.994995] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:13:23.572 [2024-04-26 15:42:21.995005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:13:23.572 [2024-04-26 15:42:21.995046] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:13:23.572 [2024-04-26 15:42:21.995054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:13:23.572 [2024-04-26 15:42:21.995090] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:13:23.572 [2024-04-26 15:42:21.995098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:13:23.572 [2024-04-26 15:42:21.995145] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:13:23.572 [2024-04-26 15:42:21.995153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:13:23.572 passed 00:13:23.572 Test: blockdev nvme admin passthru ...passed 00:13:23.572 Test: blockdev copy ...passed 00:13:23.572 00:13:23.572 Run Summary: Type Total Ran Passed Failed Inactive 00:13:23.572 suites 1 1 n/a 0 0 00:13:23.572 tests 23 23 23 0 0 00:13:23.572 asserts 152 152 152 0 n/a 00:13:23.572 00:13:23.572 Elapsed time = 0.172 seconds 00:13:23.830 15:42:22 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:23.830 15:42:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:23.830 15:42:22 -- common/autotest_common.sh@10 -- # set +x 00:13:23.830 15:42:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:23.830 15:42:22 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:13:23.830 15:42:22 -- target/bdevio.sh@30 -- # nvmftestfini 00:13:23.830 15:42:22 -- nvmf/common.sh@477 -- # nvmfcleanup 00:13:23.830 15:42:22 -- nvmf/common.sh@117 -- # sync 00:13:23.830 15:42:22 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:13:23.830 15:42:22 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:13:23.830 15:42:22 -- nvmf/common.sh@120 -- # set +e 00:13:23.830 15:42:22 -- nvmf/common.sh@121 -- # for i in {1..20} 00:13:23.830 15:42:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:13:23.830 rmmod nvme_rdma 00:13:23.830 rmmod nvme_fabrics 00:13:23.830 15:42:22 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:13:23.830 15:42:22 -- nvmf/common.sh@124 -- # set -e 00:13:23.830 15:42:22 -- nvmf/common.sh@125 -- # return 0 00:13:23.830 15:42:22 -- nvmf/common.sh@478 -- # '[' -n 3306943 ']' 00:13:23.830 15:42:22 -- nvmf/common.sh@479 -- # killprocess 3306943 00:13:23.830 15:42:22 -- common/autotest_common.sh@936 -- # '[' -z 3306943 ']' 00:13:23.830 15:42:22 -- common/autotest_common.sh@940 -- # kill -0 3306943 00:13:23.830 15:42:22 -- common/autotest_common.sh@941 -- # uname 00:13:23.830 15:42:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:23.830 15:42:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3306943 00:13:23.830 15:42:22 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:13:23.830 15:42:22 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:13:23.830 15:42:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3306943' 00:13:23.830 killing process with pid 3306943 00:13:23.830 15:42:22 -- common/autotest_common.sh@955 -- # kill 3306943 00:13:23.830 15:42:22 -- common/autotest_common.sh@960 -- # wait 3306943 00:13:23.830 [2024-04-26 15:42:22.387224] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:13:24.088 15:42:22 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:13:24.088 15:42:22 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:13:24.088 00:13:24.088 real 0m7.592s 00:13:24.088 user 0m10.279s 00:13:24.088 sys 0m4.563s 00:13:24.088 15:42:22 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:13:24.088 15:42:22 -- common/autotest_common.sh@10 -- # set +x 00:13:24.088 ************************************ 00:13:24.088 END TEST nvmf_bdevio 00:13:24.088 ************************************ 00:13:24.088 15:42:22 -- nvmf/nvmf.sh@58 -- # '[' rdma = tcp ']' 00:13:24.088 15:42:22 -- nvmf/nvmf.sh@64 -- # '[' 0 -eq 1 ']' 00:13:24.088 15:42:22 -- nvmf/nvmf.sh@70 -- # [[ phy == phy ]] 00:13:24.088 15:42:22 -- nvmf/nvmf.sh@71 -- # '[' rdma = tcp ']' 00:13:24.088 15:42:22 -- nvmf/nvmf.sh@77 -- # [[ rdma == \r\d\m\a ]] 00:13:24.088 15:42:22 -- nvmf/nvmf.sh@78 -- # run_test nvmf_device_removal test/nvmf/target/device_removal.sh --transport=rdma 00:13:24.088 15:42:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:24.088 15:42:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:24.088 15:42:22 -- common/autotest_common.sh@10 -- # set +x 00:13:24.347 ************************************ 00:13:24.347 START TEST nvmf_device_removal 00:13:24.347 ************************************ 00:13:24.347 15:42:22 -- common/autotest_common.sh@1111 -- # test/nvmf/target/device_removal.sh --transport=rdma 00:13:24.347 * Looking for test storage... 00:13:24.347 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:13:24.347 15:42:22 -- target/device_removal.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh 00:13:24.347 15:42:22 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:13:24.347 15:42:22 -- common/autotest_common.sh@34 -- # set -e 00:13:24.347 15:42:22 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:13:24.347 15:42:22 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:13:24.347 15:42:22 -- common/autotest_common.sh@38 -- # '[' -z /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output ']' 00:13:24.347 15:42:22 -- common/autotest_common.sh@43 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/build_config.sh ]] 00:13:24.347 15:42:22 -- common/autotest_common.sh@44 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/build_config.sh 00:13:24.347 15:42:22 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:13:24.347 15:42:22 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:13:24.347 15:42:22 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:13:24.347 15:42:22 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:13:24.347 15:42:22 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:13:24.347 15:42:22 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:13:24.347 15:42:22 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:13:24.347 15:42:22 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:13:24.347 15:42:22 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:13:24.347 15:42:22 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:13:24.347 15:42:22 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:13:24.347 15:42:22 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:13:24.347 15:42:22 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:13:24.347 15:42:22 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:13:24.347 15:42:22 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:13:24.347 15:42:22 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:13:24.347 15:42:22 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:13:24.347 15:42:22 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:13:24.347 15:42:22 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk 00:13:24.347 15:42:22 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:13:24.347 15:42:22 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:13:24.347 15:42:22 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:13:24.347 15:42:22 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:13:24.347 15:42:22 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:13:24.347 15:42:22 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:13:24.347 15:42:22 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:13:24.347 15:42:22 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:13:24.347 15:42:22 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:13:24.347 15:42:22 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:13:24.347 15:42:22 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:13:24.347 15:42:22 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:13:24.347 15:42:22 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:13:24.347 15:42:22 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:13:24.347 15:42:22 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:13:24.347 15:42:22 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:13:24.347 15:42:22 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:13:24.347 15:42:22 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:13:24.347 15:42:22 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:13:24.347 15:42:22 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:13:24.347 15:42:22 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:13:24.347 15:42:22 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:13:24.347 15:42:22 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:13:24.347 15:42:22 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:13:24.347 15:42:22 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:13:24.347 15:42:22 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:13:24.347 15:42:22 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:13:24.347 15:42:22 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:13:24.347 15:42:22 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:13:24.347 15:42:22 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:13:24.347 15:42:22 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:13:24.347 15:42:22 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:13:24.347 15:42:22 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:13:24.347 15:42:22 -- common/build_config.sh@53 -- # CONFIG_HAVE_EVP_MAC=y 00:13:24.347 15:42:22 -- common/build_config.sh@54 -- # CONFIG_URING_ZNS=n 00:13:24.347 15:42:22 -- common/build_config.sh@55 -- # CONFIG_WERROR=y 00:13:24.347 15:42:22 -- common/build_config.sh@56 -- # CONFIG_HAVE_LIBBSD=n 00:13:24.347 15:42:22 -- common/build_config.sh@57 -- # CONFIG_UBSAN=y 00:13:24.347 15:42:22 -- common/build_config.sh@58 -- # CONFIG_IPSEC_MB_DIR= 00:13:24.347 15:42:22 -- common/build_config.sh@59 -- # CONFIG_GOLANG=n 00:13:24.347 15:42:22 -- common/build_config.sh@60 -- # CONFIG_ISAL=y 00:13:24.347 15:42:22 -- common/build_config.sh@61 -- # CONFIG_IDXD_KERNEL=n 00:13:24.347 15:42:22 -- common/build_config.sh@62 -- # CONFIG_DPDK_LIB_DIR= 00:13:24.347 15:42:22 -- common/build_config.sh@63 -- # CONFIG_RDMA_PROV=verbs 00:13:24.347 15:42:22 -- common/build_config.sh@64 -- # CONFIG_APPS=y 00:13:24.347 15:42:22 -- common/build_config.sh@65 -- # CONFIG_SHARED=y 00:13:24.347 15:42:22 -- common/build_config.sh@66 -- # CONFIG_HAVE_KEYUTILS=n 00:13:24.347 15:42:22 -- common/build_config.sh@67 -- # CONFIG_FC_PATH= 00:13:24.347 15:42:22 -- common/build_config.sh@68 -- # CONFIG_DPDK_PKG_CONFIG=n 00:13:24.347 15:42:22 -- common/build_config.sh@69 -- # CONFIG_FC=n 00:13:24.347 15:42:22 -- common/build_config.sh@70 -- # CONFIG_AVAHI=n 00:13:24.347 15:42:22 -- common/build_config.sh@71 -- # CONFIG_FIO_PLUGIN=y 00:13:24.347 15:42:22 -- common/build_config.sh@72 -- # CONFIG_RAID5F=n 00:13:24.347 15:42:22 -- common/build_config.sh@73 -- # CONFIG_EXAMPLES=y 00:13:24.347 15:42:22 -- common/build_config.sh@74 -- # CONFIG_TESTS=y 00:13:24.347 15:42:22 -- common/build_config.sh@75 -- # CONFIG_CRYPTO_MLX5=n 00:13:24.347 15:42:22 -- common/build_config.sh@76 -- # CONFIG_MAX_LCORES= 00:13:24.347 15:42:22 -- common/build_config.sh@77 -- # CONFIG_IPSEC_MB=n 00:13:24.347 15:42:22 -- common/build_config.sh@78 -- # CONFIG_PGO_DIR= 00:13:24.347 15:42:22 -- common/build_config.sh@79 -- # CONFIG_DEBUG=y 00:13:24.347 15:42:22 -- common/build_config.sh@80 -- # CONFIG_DPDK_COMPRESSDEV=n 00:13:24.347 15:42:22 -- common/build_config.sh@81 -- # CONFIG_CROSS_PREFIX= 00:13:24.347 15:42:22 -- common/build_config.sh@82 -- # CONFIG_URING=n 00:13:24.347 15:42:22 -- common/autotest_common.sh@53 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/applications.sh 00:13:24.347 15:42:22 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/applications.sh 00:13:24.347 15:42:22 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common 00:13:24.347 15:42:22 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common 00:13:24.347 15:42:22 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:13:24.347 15:42:22 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:13:24.347 15:42:22 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app 00:13:24.347 15:42:22 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:13:24.347 15:42:22 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:13:24.347 15:42:22 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:13:24.347 15:42:22 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:13:24.347 15:42:22 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:13:24.347 15:42:22 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:13:24.347 15:42:22 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:13:24.347 15:42:22 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/config.h ]] 00:13:24.347 15:42:22 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:13:24.347 #define SPDK_CONFIG_H 00:13:24.347 #define SPDK_CONFIG_APPS 1 00:13:24.348 #define SPDK_CONFIG_ARCH native 00:13:24.348 #undef SPDK_CONFIG_ASAN 00:13:24.348 #undef SPDK_CONFIG_AVAHI 00:13:24.348 #undef SPDK_CONFIG_CET 00:13:24.348 #define SPDK_CONFIG_COVERAGE 1 00:13:24.348 #define SPDK_CONFIG_CROSS_PREFIX 00:13:24.348 #undef SPDK_CONFIG_CRYPTO 00:13:24.348 #undef SPDK_CONFIG_CRYPTO_MLX5 00:13:24.348 #undef SPDK_CONFIG_CUSTOMOCF 00:13:24.348 #undef SPDK_CONFIG_DAOS 00:13:24.348 #define SPDK_CONFIG_DAOS_DIR 00:13:24.348 #define SPDK_CONFIG_DEBUG 1 00:13:24.348 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:13:24.348 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:13:24.348 #define SPDK_CONFIG_DPDK_INC_DIR 00:13:24.348 #define SPDK_CONFIG_DPDK_LIB_DIR 00:13:24.348 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:13:24.348 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk 00:13:24.348 #define SPDK_CONFIG_EXAMPLES 1 00:13:24.348 #undef SPDK_CONFIG_FC 00:13:24.348 #define SPDK_CONFIG_FC_PATH 00:13:24.348 #define SPDK_CONFIG_FIO_PLUGIN 1 00:13:24.348 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:13:24.348 #undef SPDK_CONFIG_FUSE 00:13:24.348 #undef SPDK_CONFIG_FUZZER 00:13:24.348 #define SPDK_CONFIG_FUZZER_LIB 00:13:24.348 #undef SPDK_CONFIG_GOLANG 00:13:24.348 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:13:24.348 #define SPDK_CONFIG_HAVE_EVP_MAC 1 00:13:24.348 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:13:24.348 #undef SPDK_CONFIG_HAVE_KEYUTILS 00:13:24.348 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:13:24.348 #undef SPDK_CONFIG_HAVE_LIBBSD 00:13:24.348 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:13:24.348 #define SPDK_CONFIG_IDXD 1 00:13:24.348 #undef SPDK_CONFIG_IDXD_KERNEL 00:13:24.348 #undef SPDK_CONFIG_IPSEC_MB 00:13:24.348 #define SPDK_CONFIG_IPSEC_MB_DIR 00:13:24.348 #define SPDK_CONFIG_ISAL 1 00:13:24.348 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:13:24.348 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:13:24.348 #define SPDK_CONFIG_LIBDIR 00:13:24.348 #undef SPDK_CONFIG_LTO 00:13:24.348 #define SPDK_CONFIG_MAX_LCORES 00:13:24.348 #define SPDK_CONFIG_NVME_CUSE 1 00:13:24.348 #undef SPDK_CONFIG_OCF 00:13:24.348 #define SPDK_CONFIG_OCF_PATH 00:13:24.348 #define SPDK_CONFIG_OPENSSL_PATH 00:13:24.348 #undef SPDK_CONFIG_PGO_CAPTURE 00:13:24.348 #define SPDK_CONFIG_PGO_DIR 00:13:24.348 #undef SPDK_CONFIG_PGO_USE 00:13:24.348 #define SPDK_CONFIG_PREFIX /usr/local 00:13:24.348 #undef SPDK_CONFIG_RAID5F 00:13:24.348 #undef SPDK_CONFIG_RBD 00:13:24.348 #define SPDK_CONFIG_RDMA 1 00:13:24.348 #define SPDK_CONFIG_RDMA_PROV verbs 00:13:24.348 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:13:24.348 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:13:24.348 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:13:24.348 #define SPDK_CONFIG_SHARED 1 00:13:24.348 #undef SPDK_CONFIG_SMA 00:13:24.348 #define SPDK_CONFIG_TESTS 1 00:13:24.348 #undef SPDK_CONFIG_TSAN 00:13:24.348 #define SPDK_CONFIG_UBLK 1 00:13:24.348 #define SPDK_CONFIG_UBSAN 1 00:13:24.348 #undef SPDK_CONFIG_UNIT_TESTS 00:13:24.348 #undef SPDK_CONFIG_URING 00:13:24.348 #define SPDK_CONFIG_URING_PATH 00:13:24.348 #undef SPDK_CONFIG_URING_ZNS 00:13:24.348 #undef SPDK_CONFIG_USDT 00:13:24.348 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:13:24.348 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:13:24.348 #undef SPDK_CONFIG_VFIO_USER 00:13:24.348 #define SPDK_CONFIG_VFIO_USER_DIR 00:13:24.348 #define SPDK_CONFIG_VHOST 1 00:13:24.348 #define SPDK_CONFIG_VIRTIO 1 00:13:24.348 #undef SPDK_CONFIG_VTUNE 00:13:24.348 #define SPDK_CONFIG_VTUNE_DIR 00:13:24.348 #define SPDK_CONFIG_WERROR 1 00:13:24.348 #define SPDK_CONFIG_WPDK_DIR 00:13:24.348 #undef SPDK_CONFIG_XNVME 00:13:24.348 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:13:24.348 15:42:22 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:13:24.348 15:42:22 -- common/autotest_common.sh@54 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:13:24.348 15:42:22 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:24.348 15:42:22 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:24.348 15:42:22 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:24.348 15:42:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:24.348 15:42:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:24.348 15:42:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:24.348 15:42:22 -- paths/export.sh@5 -- # export PATH 00:13:24.348 15:42:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:24.348 15:42:22 -- common/autotest_common.sh@55 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/common 00:13:24.348 15:42:22 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/common 00:13:24.348 15:42:22 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm 00:13:24.348 15:42:22 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm 00:13:24.348 15:42:22 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/../../../ 00:13:24.348 15:42:22 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:13:24.348 15:42:22 -- pm/common@67 -- # TEST_TAG=N/A 00:13:24.348 15:42:22 -- pm/common@68 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/.run_test_name 00:13:24.348 15:42:22 -- pm/common@70 -- # PM_OUTPUTDIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power 00:13:24.348 15:42:22 -- pm/common@71 -- # uname -s 00:13:24.348 15:42:22 -- pm/common@71 -- # PM_OS=Linux 00:13:24.348 15:42:22 -- pm/common@73 -- # MONITOR_RESOURCES=(collect-cpu-load collect-vmstat) 00:13:24.348 15:42:22 -- pm/common@74 -- # [[ Linux == FreeBSD ]] 00:13:24.348 15:42:22 -- pm/common@76 -- # [[ Linux == Linux ]] 00:13:24.348 15:42:22 -- pm/common@76 -- # [[ ............................... != QEMU ]] 00:13:24.348 15:42:22 -- pm/common@76 -- # [[ ! -e /.dockerenv ]] 00:13:24.348 15:42:22 -- pm/common@79 -- # MONITOR_RESOURCES+=(collect-cpu-temp) 00:13:24.348 15:42:22 -- pm/common@80 -- # MONITOR_RESOURCES+=(collect-bmc-pm) 00:13:24.348 15:42:22 -- pm/common@83 -- # MONITOR_RESOURCES_PIDS=() 00:13:24.348 15:42:22 -- pm/common@83 -- # declare -A MONITOR_RESOURCES_PIDS 00:13:24.348 15:42:22 -- pm/common@85 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power 00:13:24.348 15:42:22 -- common/autotest_common.sh@57 -- # : 0 00:13:24.348 15:42:22 -- common/autotest_common.sh@58 -- # export RUN_NIGHTLY 00:13:24.348 15:42:22 -- common/autotest_common.sh@61 -- # : 0 00:13:24.348 15:42:22 -- common/autotest_common.sh@62 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:13:24.348 15:42:22 -- common/autotest_common.sh@63 -- # : 0 00:13:24.348 15:42:22 -- common/autotest_common.sh@64 -- # export SPDK_RUN_VALGRIND 00:13:24.348 15:42:22 -- common/autotest_common.sh@65 -- # : 1 00:13:24.348 15:42:22 -- common/autotest_common.sh@66 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:13:24.348 15:42:22 -- common/autotest_common.sh@67 -- # : 0 00:13:24.348 15:42:22 -- common/autotest_common.sh@68 -- # export SPDK_TEST_UNITTEST 00:13:24.348 15:42:22 -- common/autotest_common.sh@69 -- # : 00:13:24.348 15:42:22 -- common/autotest_common.sh@70 -- # export SPDK_TEST_AUTOBUILD 00:13:24.348 15:42:22 -- common/autotest_common.sh@71 -- # : 0 00:13:24.348 15:42:22 -- common/autotest_common.sh@72 -- # export SPDK_TEST_RELEASE_BUILD 00:13:24.348 15:42:22 -- common/autotest_common.sh@73 -- # : 0 00:13:24.348 15:42:22 -- common/autotest_common.sh@74 -- # export SPDK_TEST_ISAL 00:13:24.348 15:42:22 -- common/autotest_common.sh@75 -- # : 0 00:13:24.348 15:42:22 -- common/autotest_common.sh@76 -- # export SPDK_TEST_ISCSI 00:13:24.348 15:42:22 -- common/autotest_common.sh@77 -- # : 0 00:13:24.348 15:42:22 -- common/autotest_common.sh@78 -- # export SPDK_TEST_ISCSI_INITIATOR 00:13:24.348 15:42:22 -- common/autotest_common.sh@79 -- # : 0 00:13:24.348 15:42:22 -- common/autotest_common.sh@80 -- # export SPDK_TEST_NVME 00:13:24.348 15:42:22 -- common/autotest_common.sh@81 -- # : 0 00:13:24.348 15:42:22 -- common/autotest_common.sh@82 -- # export SPDK_TEST_NVME_PMR 00:13:24.348 15:42:22 -- common/autotest_common.sh@83 -- # : 0 00:13:24.348 15:42:22 -- common/autotest_common.sh@84 -- # export SPDK_TEST_NVME_BP 00:13:24.348 15:42:22 -- common/autotest_common.sh@85 -- # : 1 00:13:24.348 15:42:22 -- common/autotest_common.sh@86 -- # export SPDK_TEST_NVME_CLI 00:13:24.348 15:42:22 -- common/autotest_common.sh@87 -- # : 0 00:13:24.348 15:42:22 -- common/autotest_common.sh@88 -- # export SPDK_TEST_NVME_CUSE 00:13:24.348 15:42:22 -- common/autotest_common.sh@89 -- # : 0 00:13:24.348 15:42:22 -- common/autotest_common.sh@90 -- # export SPDK_TEST_NVME_FDP 00:13:24.348 15:42:22 -- common/autotest_common.sh@91 -- # : 1 00:13:24.348 15:42:22 -- common/autotest_common.sh@92 -- # export SPDK_TEST_NVMF 00:13:24.348 15:42:22 -- common/autotest_common.sh@93 -- # : 0 00:13:24.348 15:42:22 -- common/autotest_common.sh@94 -- # export SPDK_TEST_VFIOUSER 00:13:24.607 15:42:22 -- common/autotest_common.sh@95 -- # : 0 00:13:24.607 15:42:22 -- common/autotest_common.sh@96 -- # export SPDK_TEST_VFIOUSER_QEMU 00:13:24.607 15:42:22 -- common/autotest_common.sh@97 -- # : 0 00:13:24.607 15:42:22 -- common/autotest_common.sh@98 -- # export SPDK_TEST_FUZZER 00:13:24.607 15:42:22 -- common/autotest_common.sh@99 -- # : 0 00:13:24.607 15:42:22 -- common/autotest_common.sh@100 -- # export SPDK_TEST_FUZZER_SHORT 00:13:24.607 15:42:22 -- common/autotest_common.sh@101 -- # : rdma 00:13:24.607 15:42:22 -- common/autotest_common.sh@102 -- # export SPDK_TEST_NVMF_TRANSPORT 00:13:24.607 15:42:22 -- common/autotest_common.sh@103 -- # : 0 00:13:24.607 15:42:22 -- common/autotest_common.sh@104 -- # export SPDK_TEST_RBD 00:13:24.607 15:42:22 -- common/autotest_common.sh@105 -- # : 0 00:13:24.607 15:42:22 -- common/autotest_common.sh@106 -- # export SPDK_TEST_VHOST 00:13:24.607 15:42:22 -- common/autotest_common.sh@107 -- # : 0 00:13:24.607 15:42:22 -- common/autotest_common.sh@108 -- # export SPDK_TEST_BLOCKDEV 00:13:24.607 15:42:22 -- common/autotest_common.sh@109 -- # : 0 00:13:24.607 15:42:22 -- common/autotest_common.sh@110 -- # export SPDK_TEST_IOAT 00:13:24.607 15:42:22 -- common/autotest_common.sh@111 -- # : 0 00:13:24.607 15:42:22 -- common/autotest_common.sh@112 -- # export SPDK_TEST_BLOBFS 00:13:24.607 15:42:22 -- common/autotest_common.sh@113 -- # : 0 00:13:24.607 15:42:22 -- common/autotest_common.sh@114 -- # export SPDK_TEST_VHOST_INIT 00:13:24.607 15:42:22 -- common/autotest_common.sh@115 -- # : 0 00:13:24.607 15:42:22 -- common/autotest_common.sh@116 -- # export SPDK_TEST_LVOL 00:13:24.607 15:42:22 -- common/autotest_common.sh@117 -- # : 0 00:13:24.607 15:42:22 -- common/autotest_common.sh@118 -- # export SPDK_TEST_VBDEV_COMPRESS 00:13:24.607 15:42:22 -- common/autotest_common.sh@119 -- # : 0 00:13:24.607 15:42:22 -- common/autotest_common.sh@120 -- # export SPDK_RUN_ASAN 00:13:24.607 15:42:22 -- common/autotest_common.sh@121 -- # : 1 00:13:24.607 15:42:22 -- common/autotest_common.sh@122 -- # export SPDK_RUN_UBSAN 00:13:24.607 15:42:22 -- common/autotest_common.sh@123 -- # : 00:13:24.607 15:42:22 -- common/autotest_common.sh@124 -- # export SPDK_RUN_EXTERNAL_DPDK 00:13:24.607 15:42:22 -- common/autotest_common.sh@125 -- # : 0 00:13:24.607 15:42:22 -- common/autotest_common.sh@126 -- # export SPDK_RUN_NON_ROOT 00:13:24.607 15:42:22 -- common/autotest_common.sh@127 -- # : 0 00:13:24.607 15:42:22 -- common/autotest_common.sh@128 -- # export SPDK_TEST_CRYPTO 00:13:24.607 15:42:22 -- common/autotest_common.sh@129 -- # : 0 00:13:24.607 15:42:22 -- common/autotest_common.sh@130 -- # export SPDK_TEST_FTL 00:13:24.607 15:42:22 -- common/autotest_common.sh@131 -- # : 0 00:13:24.607 15:42:22 -- common/autotest_common.sh@132 -- # export SPDK_TEST_OCF 00:13:24.607 15:42:22 -- common/autotest_common.sh@133 -- # : 0 00:13:24.607 15:42:22 -- common/autotest_common.sh@134 -- # export SPDK_TEST_VMD 00:13:24.607 15:42:22 -- common/autotest_common.sh@135 -- # : 0 00:13:24.607 15:42:22 -- common/autotest_common.sh@136 -- # export SPDK_TEST_OPAL 00:13:24.607 15:42:22 -- common/autotest_common.sh@137 -- # : 00:13:24.607 15:42:22 -- common/autotest_common.sh@138 -- # export SPDK_TEST_NATIVE_DPDK 00:13:24.608 15:42:22 -- common/autotest_common.sh@139 -- # : true 00:13:24.608 15:42:22 -- common/autotest_common.sh@140 -- # export SPDK_AUTOTEST_X 00:13:24.608 15:42:22 -- common/autotest_common.sh@141 -- # : 0 00:13:24.608 15:42:22 -- common/autotest_common.sh@142 -- # export SPDK_TEST_RAID5 00:13:24.608 15:42:22 -- common/autotest_common.sh@143 -- # : 0 00:13:24.608 15:42:22 -- common/autotest_common.sh@144 -- # export SPDK_TEST_URING 00:13:24.608 15:42:22 -- common/autotest_common.sh@145 -- # : 0 00:13:24.608 15:42:22 -- common/autotest_common.sh@146 -- # export SPDK_TEST_USDT 00:13:24.608 15:42:22 -- common/autotest_common.sh@147 -- # : 0 00:13:24.608 15:42:22 -- common/autotest_common.sh@148 -- # export SPDK_TEST_USE_IGB_UIO 00:13:24.608 15:42:22 -- common/autotest_common.sh@149 -- # : 0 00:13:24.608 15:42:22 -- common/autotest_common.sh@150 -- # export SPDK_TEST_SCHEDULER 00:13:24.608 15:42:22 -- common/autotest_common.sh@151 -- # : 0 00:13:24.608 15:42:22 -- common/autotest_common.sh@152 -- # export SPDK_TEST_SCANBUILD 00:13:24.608 15:42:22 -- common/autotest_common.sh@153 -- # : mlx5 00:13:24.608 15:42:22 -- common/autotest_common.sh@154 -- # export SPDK_TEST_NVMF_NICS 00:13:24.608 15:42:22 -- common/autotest_common.sh@155 -- # : 0 00:13:24.608 15:42:22 -- common/autotest_common.sh@156 -- # export SPDK_TEST_SMA 00:13:24.608 15:42:22 -- common/autotest_common.sh@157 -- # : 0 00:13:24.608 15:42:22 -- common/autotest_common.sh@158 -- # export SPDK_TEST_DAOS 00:13:24.608 15:42:22 -- common/autotest_common.sh@159 -- # : 0 00:13:24.608 15:42:22 -- common/autotest_common.sh@160 -- # export SPDK_TEST_XNVME 00:13:24.608 15:42:22 -- common/autotest_common.sh@161 -- # : 0 00:13:24.608 15:42:22 -- common/autotest_common.sh@162 -- # export SPDK_TEST_ACCEL_DSA 00:13:24.608 15:42:22 -- common/autotest_common.sh@163 -- # : 0 00:13:24.608 15:42:22 -- common/autotest_common.sh@164 -- # export SPDK_TEST_ACCEL_IAA 00:13:24.608 15:42:22 -- common/autotest_common.sh@166 -- # : 00:13:24.608 15:42:22 -- common/autotest_common.sh@167 -- # export SPDK_TEST_FUZZER_TARGET 00:13:24.608 15:42:22 -- common/autotest_common.sh@168 -- # : 0 00:13:24.608 15:42:22 -- common/autotest_common.sh@169 -- # export SPDK_TEST_NVMF_MDNS 00:13:24.608 15:42:22 -- common/autotest_common.sh@170 -- # : 0 00:13:24.608 15:42:22 -- common/autotest_common.sh@171 -- # export SPDK_JSONRPC_GO_CLIENT 00:13:24.608 15:42:22 -- common/autotest_common.sh@174 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib 00:13:24.608 15:42:22 -- common/autotest_common.sh@174 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib 00:13:24.608 15:42:22 -- common/autotest_common.sh@175 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib 00:13:24.608 15:42:22 -- common/autotest_common.sh@175 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib 00:13:24.608 15:42:22 -- common/autotest_common.sh@176 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:13:24.608 15:42:22 -- common/autotest_common.sh@176 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:13:24.608 15:42:22 -- common/autotest_common.sh@177 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:13:24.608 15:42:22 -- common/autotest_common.sh@177 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:13:24.608 15:42:22 -- common/autotest_common.sh@180 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:13:24.608 15:42:22 -- common/autotest_common.sh@180 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:13:24.608 15:42:22 -- common/autotest_common.sh@184 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python 00:13:24.608 15:42:22 -- common/autotest_common.sh@184 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python 00:13:24.608 15:42:22 -- common/autotest_common.sh@188 -- # export PYTHONDONTWRITEBYTECODE=1 00:13:24.608 15:42:22 -- common/autotest_common.sh@188 -- # PYTHONDONTWRITEBYTECODE=1 00:13:24.608 15:42:22 -- common/autotest_common.sh@192 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:13:24.608 15:42:22 -- common/autotest_common.sh@192 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:13:24.608 15:42:22 -- common/autotest_common.sh@193 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:13:24.608 15:42:22 -- common/autotest_common.sh@193 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:13:24.608 15:42:22 -- common/autotest_common.sh@197 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:13:24.608 15:42:22 -- common/autotest_common.sh@198 -- # rm -rf /var/tmp/asan_suppression_file 00:13:24.608 15:42:22 -- common/autotest_common.sh@199 -- # cat 00:13:24.608 15:42:22 -- common/autotest_common.sh@225 -- # echo leak:libfuse3.so 00:13:24.608 15:42:22 -- common/autotest_common.sh@227 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:13:24.608 15:42:22 -- common/autotest_common.sh@227 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:13:24.608 15:42:22 -- common/autotest_common.sh@229 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:13:24.608 15:42:22 -- common/autotest_common.sh@229 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:13:24.608 15:42:22 -- common/autotest_common.sh@231 -- # '[' -z /var/spdk/dependencies ']' 00:13:24.608 15:42:22 -- common/autotest_common.sh@234 -- # export DEPENDENCY_DIR 00:13:24.608 15:42:22 -- common/autotest_common.sh@238 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:13:24.608 15:42:22 -- common/autotest_common.sh@238 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:13:24.608 15:42:22 -- common/autotest_common.sh@239 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:13:24.608 15:42:22 -- common/autotest_common.sh@239 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:13:24.608 15:42:22 -- common/autotest_common.sh@242 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:13:24.608 15:42:22 -- common/autotest_common.sh@242 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:13:24.608 15:42:22 -- common/autotest_common.sh@243 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:13:24.608 15:42:22 -- common/autotest_common.sh@243 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:13:24.608 15:42:22 -- common/autotest_common.sh@245 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:13:24.608 15:42:22 -- common/autotest_common.sh@245 -- # AR_TOOL=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:13:24.608 15:42:22 -- common/autotest_common.sh@248 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:13:24.608 15:42:22 -- common/autotest_common.sh@248 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:13:24.608 15:42:22 -- common/autotest_common.sh@251 -- # '[' 0 -eq 0 ']' 00:13:24.608 15:42:22 -- common/autotest_common.sh@252 -- # export valgrind= 00:13:24.608 15:42:22 -- common/autotest_common.sh@252 -- # valgrind= 00:13:24.608 15:42:22 -- common/autotest_common.sh@258 -- # uname -s 00:13:24.608 15:42:22 -- common/autotest_common.sh@258 -- # '[' Linux = Linux ']' 00:13:24.608 15:42:22 -- common/autotest_common.sh@259 -- # HUGEMEM=4096 00:13:24.608 15:42:22 -- common/autotest_common.sh@260 -- # export CLEAR_HUGE=yes 00:13:24.608 15:42:22 -- common/autotest_common.sh@260 -- # CLEAR_HUGE=yes 00:13:24.608 15:42:22 -- common/autotest_common.sh@261 -- # [[ 0 -eq 1 ]] 00:13:24.608 15:42:22 -- common/autotest_common.sh@261 -- # [[ 0 -eq 1 ]] 00:13:24.608 15:42:22 -- common/autotest_common.sh@268 -- # MAKE=make 00:13:24.608 15:42:22 -- common/autotest_common.sh@269 -- # MAKEFLAGS=-j96 00:13:24.608 15:42:22 -- common/autotest_common.sh@285 -- # export HUGEMEM=4096 00:13:24.608 15:42:22 -- common/autotest_common.sh@285 -- # HUGEMEM=4096 00:13:24.608 15:42:22 -- common/autotest_common.sh@287 -- # NO_HUGE=() 00:13:24.608 15:42:22 -- common/autotest_common.sh@288 -- # TEST_MODE= 00:13:24.608 15:42:22 -- common/autotest_common.sh@289 -- # for i in "$@" 00:13:24.608 15:42:22 -- common/autotest_common.sh@290 -- # case "$i" in 00:13:24.608 15:42:22 -- common/autotest_common.sh@295 -- # TEST_TRANSPORT=rdma 00:13:24.608 15:42:22 -- common/autotest_common.sh@307 -- # [[ -z 3307477 ]] 00:13:24.608 15:42:22 -- common/autotest_common.sh@307 -- # kill -0 3307477 00:13:24.608 15:42:22 -- common/autotest_common.sh@1666 -- # set_test_storage 2147483648 00:13:24.608 15:42:22 -- common/autotest_common.sh@317 -- # [[ -v testdir ]] 00:13:24.608 15:42:22 -- common/autotest_common.sh@319 -- # local requested_size=2147483648 00:13:24.608 15:42:22 -- common/autotest_common.sh@320 -- # local mount target_dir 00:13:24.608 15:42:22 -- common/autotest_common.sh@322 -- # local -A mounts fss sizes avails uses 00:13:24.608 15:42:22 -- common/autotest_common.sh@323 -- # local source fs size avail mount use 00:13:24.608 15:42:22 -- common/autotest_common.sh@325 -- # local storage_fallback storage_candidates 00:13:24.608 15:42:22 -- common/autotest_common.sh@327 -- # mktemp -udt spdk.XXXXXX 00:13:24.608 15:42:22 -- common/autotest_common.sh@327 -- # storage_fallback=/tmp/spdk.omG7Hu 00:13:24.608 15:42:22 -- common/autotest_common.sh@332 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:13:24.608 15:42:22 -- common/autotest_common.sh@334 -- # [[ -n '' ]] 00:13:24.608 15:42:22 -- common/autotest_common.sh@339 -- # [[ -n '' ]] 00:13:24.608 15:42:22 -- common/autotest_common.sh@344 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target /tmp/spdk.omG7Hu/tests/target /tmp/spdk.omG7Hu 00:13:24.608 15:42:22 -- common/autotest_common.sh@347 -- # requested_size=2214592512 00:13:24.608 15:42:22 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:13:24.608 15:42:22 -- common/autotest_common.sh@316 -- # df -T 00:13:24.608 15:42:22 -- common/autotest_common.sh@316 -- # grep -v Filesystem 00:13:24.608 15:42:22 -- common/autotest_common.sh@350 -- # mounts["$mount"]=spdk_devtmpfs 00:13:24.608 15:42:22 -- common/autotest_common.sh@350 -- # fss["$mount"]=devtmpfs 00:13:24.609 15:42:22 -- common/autotest_common.sh@351 -- # avails["$mount"]=67108864 00:13:24.609 15:42:22 -- common/autotest_common.sh@351 -- # sizes["$mount"]=67108864 00:13:24.609 15:42:22 -- common/autotest_common.sh@352 -- # uses["$mount"]=0 00:13:24.609 15:42:22 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:13:24.609 15:42:22 -- common/autotest_common.sh@350 -- # mounts["$mount"]=/dev/pmem0 00:13:24.609 15:42:22 -- common/autotest_common.sh@350 -- # fss["$mount"]=ext2 00:13:24.609 15:42:22 -- common/autotest_common.sh@351 -- # avails["$mount"]=1052192768 00:13:24.609 15:42:22 -- common/autotest_common.sh@351 -- # sizes["$mount"]=5284429824 00:13:24.609 15:42:22 -- common/autotest_common.sh@352 -- # uses["$mount"]=4232237056 00:13:24.609 15:42:23 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:13:24.609 15:42:23 -- common/autotest_common.sh@350 -- # mounts["$mount"]=spdk_root 00:13:24.609 15:42:23 -- common/autotest_common.sh@350 -- # fss["$mount"]=overlay 00:13:24.609 15:42:23 -- common/autotest_common.sh@351 -- # avails["$mount"]=185075150848 00:13:24.609 15:42:23 -- common/autotest_common.sh@351 -- # sizes["$mount"]=195974307840 00:13:24.609 15:42:23 -- common/autotest_common.sh@352 -- # uses["$mount"]=10899156992 00:13:24.609 15:42:23 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:13:24.609 15:42:23 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:13:24.609 15:42:23 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:13:24.609 15:42:23 -- common/autotest_common.sh@351 -- # avails["$mount"]=97880862720 00:13:24.609 15:42:23 -- common/autotest_common.sh@351 -- # sizes["$mount"]=97987153920 00:13:24.609 15:42:23 -- common/autotest_common.sh@352 -- # uses["$mount"]=106291200 00:13:24.609 15:42:23 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:13:24.609 15:42:23 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:13:24.609 15:42:23 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:13:24.609 15:42:23 -- common/autotest_common.sh@351 -- # avails["$mount"]=39171825664 00:13:24.609 15:42:23 -- common/autotest_common.sh@351 -- # sizes["$mount"]=39194861568 00:13:24.609 15:42:23 -- common/autotest_common.sh@352 -- # uses["$mount"]=23035904 00:13:24.609 15:42:23 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:13:24.609 15:42:23 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:13:24.609 15:42:23 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:13:24.609 15:42:23 -- common/autotest_common.sh@351 -- # avails["$mount"]=97986490368 00:13:24.609 15:42:23 -- common/autotest_common.sh@351 -- # sizes["$mount"]=97987153920 00:13:24.609 15:42:23 -- common/autotest_common.sh@352 -- # uses["$mount"]=663552 00:13:24.609 15:42:23 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:13:24.609 15:42:23 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:13:24.609 15:42:23 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:13:24.609 15:42:23 -- common/autotest_common.sh@351 -- # avails["$mount"]=19597426688 00:13:24.609 15:42:23 -- common/autotest_common.sh@351 -- # sizes["$mount"]=19597430784 00:13:24.609 15:42:23 -- common/autotest_common.sh@352 -- # uses["$mount"]=4096 00:13:24.609 15:42:23 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:13:24.609 15:42:23 -- common/autotest_common.sh@355 -- # printf '* Looking for test storage...\n' 00:13:24.609 * Looking for test storage... 00:13:24.609 15:42:23 -- common/autotest_common.sh@357 -- # local target_space new_size 00:13:24.609 15:42:23 -- common/autotest_common.sh@358 -- # for target_dir in "${storage_candidates[@]}" 00:13:24.609 15:42:23 -- common/autotest_common.sh@361 -- # df /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:13:24.609 15:42:23 -- common/autotest_common.sh@361 -- # awk '$1 !~ /Filesystem/{print $6}' 00:13:24.609 15:42:23 -- common/autotest_common.sh@361 -- # mount=/ 00:13:24.609 15:42:23 -- common/autotest_common.sh@363 -- # target_space=185075150848 00:13:24.609 15:42:23 -- common/autotest_common.sh@364 -- # (( target_space == 0 || target_space < requested_size )) 00:13:24.609 15:42:23 -- common/autotest_common.sh@367 -- # (( target_space >= requested_size )) 00:13:24.609 15:42:23 -- common/autotest_common.sh@369 -- # [[ overlay == tmpfs ]] 00:13:24.609 15:42:23 -- common/autotest_common.sh@369 -- # [[ overlay == ramfs ]] 00:13:24.609 15:42:23 -- common/autotest_common.sh@369 -- # [[ / == / ]] 00:13:24.609 15:42:23 -- common/autotest_common.sh@370 -- # new_size=13113749504 00:13:24.609 15:42:23 -- common/autotest_common.sh@371 -- # (( new_size * 100 / sizes[/] > 95 )) 00:13:24.609 15:42:23 -- common/autotest_common.sh@376 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:13:24.609 15:42:23 -- common/autotest_common.sh@376 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:13:24.609 15:42:23 -- common/autotest_common.sh@377 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:13:24.609 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:13:24.609 15:42:23 -- common/autotest_common.sh@378 -- # return 0 00:13:24.609 15:42:23 -- common/autotest_common.sh@1668 -- # set -o errtrace 00:13:24.609 15:42:23 -- common/autotest_common.sh@1669 -- # shopt -s extdebug 00:13:24.609 15:42:23 -- common/autotest_common.sh@1670 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:13:24.609 15:42:23 -- common/autotest_common.sh@1672 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:13:24.609 15:42:23 -- common/autotest_common.sh@1673 -- # true 00:13:24.609 15:42:23 -- common/autotest_common.sh@1675 -- # xtrace_fd 00:13:24.609 15:42:23 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:13:24.609 15:42:23 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:13:24.609 15:42:23 -- common/autotest_common.sh@27 -- # exec 00:13:24.609 15:42:23 -- common/autotest_common.sh@29 -- # exec 00:13:24.609 15:42:23 -- common/autotest_common.sh@31 -- # xtrace_restore 00:13:24.609 15:42:23 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:13:24.609 15:42:23 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:13:24.609 15:42:23 -- common/autotest_common.sh@18 -- # set -x 00:13:24.609 15:42:23 -- target/device_removal.sh@11 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:13:24.609 15:42:23 -- nvmf/common.sh@7 -- # uname -s 00:13:24.609 15:42:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:24.609 15:42:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:24.609 15:42:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:24.609 15:42:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:24.609 15:42:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:24.609 15:42:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:24.609 15:42:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:24.609 15:42:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:24.609 15:42:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:24.609 15:42:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:24.609 15:42:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:13:24.609 15:42:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:13:24.609 15:42:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:24.609 15:42:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:24.609 15:42:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:24.609 15:42:23 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:24.609 15:42:23 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:13:24.609 15:42:23 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:24.609 15:42:23 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:24.609 15:42:23 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:24.609 15:42:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:24.609 15:42:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:24.609 15:42:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:24.609 15:42:23 -- paths/export.sh@5 -- # export PATH 00:13:24.609 15:42:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:24.609 15:42:23 -- nvmf/common.sh@47 -- # : 0 00:13:24.609 15:42:23 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:13:24.609 15:42:23 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:13:24.609 15:42:23 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:24.609 15:42:23 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:24.609 15:42:23 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:24.609 15:42:23 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:13:24.609 15:42:23 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:13:24.609 15:42:23 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:13:24.609 15:42:23 -- target/device_removal.sh@13 -- # tgt_core_mask=0x3 00:13:24.609 15:42:23 -- target/device_removal.sh@14 -- # bdevperf_core_mask=0x4 00:13:24.609 15:42:23 -- target/device_removal.sh@15 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:13:24.609 15:42:23 -- target/device_removal.sh@16 -- # bdevperf_rpc_pid=-1 00:13:24.609 15:42:23 -- target/device_removal.sh@18 -- # nvmftestinit 00:13:24.609 15:42:23 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:13:24.609 15:42:23 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:24.609 15:42:23 -- nvmf/common.sh@437 -- # prepare_net_devs 00:13:24.609 15:42:23 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:13:24.609 15:42:23 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:13:24.609 15:42:23 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:24.609 15:42:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:24.610 15:42:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:24.610 15:42:23 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:13:24.610 15:42:23 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:13:24.610 15:42:23 -- nvmf/common.sh@285 -- # xtrace_disable 00:13:24.610 15:42:23 -- common/autotest_common.sh@10 -- # set +x 00:13:29.868 15:42:28 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:29.868 15:42:28 -- nvmf/common.sh@291 -- # pci_devs=() 00:13:29.868 15:42:28 -- nvmf/common.sh@291 -- # local -a pci_devs 00:13:29.868 15:42:28 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:13:29.868 15:42:28 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:13:29.868 15:42:28 -- nvmf/common.sh@293 -- # pci_drivers=() 00:13:29.868 15:42:28 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:13:29.868 15:42:28 -- nvmf/common.sh@295 -- # net_devs=() 00:13:29.868 15:42:28 -- nvmf/common.sh@295 -- # local -ga net_devs 00:13:29.868 15:42:28 -- nvmf/common.sh@296 -- # e810=() 00:13:29.868 15:42:28 -- nvmf/common.sh@296 -- # local -ga e810 00:13:29.868 15:42:28 -- nvmf/common.sh@297 -- # x722=() 00:13:29.868 15:42:28 -- nvmf/common.sh@297 -- # local -ga x722 00:13:29.868 15:42:28 -- nvmf/common.sh@298 -- # mlx=() 00:13:29.868 15:42:28 -- nvmf/common.sh@298 -- # local -ga mlx 00:13:29.868 15:42:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:29.868 15:42:28 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:29.868 15:42:28 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:29.868 15:42:28 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:29.868 15:42:28 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:29.868 15:42:28 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:29.868 15:42:28 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:29.868 15:42:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:29.868 15:42:28 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:29.868 15:42:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:29.868 15:42:28 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:29.868 15:42:28 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:13:29.868 15:42:28 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:13:29.868 15:42:28 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:13:29.868 15:42:28 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:13:29.868 15:42:28 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:13:29.868 15:42:28 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:13:29.868 15:42:28 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:13:29.868 15:42:28 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:29.868 15:42:28 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:13:29.868 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:13:29.868 15:42:28 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:13:29.868 15:42:28 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:13:29.868 15:42:28 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:13:29.868 15:42:28 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:13:29.868 15:42:28 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:13:29.868 15:42:28 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:29.868 15:42:28 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:29.868 15:42:28 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:13:29.868 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:13:29.868 15:42:28 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:13:29.868 15:42:28 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:13:29.868 15:42:28 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:13:29.868 15:42:28 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:13:29.868 15:42:28 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:13:29.868 15:42:28 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:29.868 15:42:28 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:13:29.868 15:42:28 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:13:29.868 15:42:28 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:29.868 15:42:28 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:29.868 15:42:28 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:29.868 15:42:28 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:29.868 15:42:28 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:13:29.868 Found net devices under 0000:da:00.0: mlx_0_0 00:13:29.868 15:42:28 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:29.868 15:42:28 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:29.868 15:42:28 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:29.868 15:42:28 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:29.868 15:42:28 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:29.868 15:42:28 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:13:29.868 Found net devices under 0000:da:00.1: mlx_0_1 00:13:29.868 15:42:28 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:29.868 15:42:28 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:13:29.868 15:42:28 -- nvmf/common.sh@403 -- # is_hw=yes 00:13:29.868 15:42:28 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:13:29.868 15:42:28 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:13:29.868 15:42:28 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:13:29.868 15:42:28 -- nvmf/common.sh@409 -- # rdma_device_init 00:13:29.868 15:42:28 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:13:29.868 15:42:28 -- nvmf/common.sh@58 -- # uname 00:13:29.868 15:42:28 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:13:29.868 15:42:28 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:13:29.868 15:42:28 -- nvmf/common.sh@63 -- # modprobe ib_core 00:13:29.868 15:42:28 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:13:29.868 15:42:28 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:13:29.868 15:42:28 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:13:29.868 15:42:28 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:13:29.868 15:42:28 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:13:29.868 15:42:28 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:13:29.868 15:42:28 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:13:29.868 15:42:28 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:13:29.868 15:42:28 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:29.868 15:42:28 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:29.868 15:42:28 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:29.868 15:42:28 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:29.868 15:42:28 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:29.868 15:42:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:29.868 15:42:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:29.868 15:42:28 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:13:29.868 15:42:28 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:13:29.868 15:42:28 -- nvmf/common.sh@105 -- # continue 2 00:13:29.868 15:42:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:29.868 15:42:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:29.868 15:42:28 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:13:29.868 15:42:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:29.868 15:42:28 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:13:29.868 15:42:28 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:13:29.868 15:42:28 -- nvmf/common.sh@105 -- # continue 2 00:13:29.868 15:42:28 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:29.868 15:42:28 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:13:29.868 15:42:28 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:29.868 15:42:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:29.868 15:42:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:29.868 15:42:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:29.868 15:42:28 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:13:29.868 15:42:28 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:13:29.868 15:42:28 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:13:29.868 118: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:13:29.868 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:13:29.868 altname enp218s0f0np0 00:13:29.868 altname ens818f0np0 00:13:29.868 inet 192.168.100.8/24 scope global mlx_0_0 00:13:29.868 valid_lft forever preferred_lft forever 00:13:29.868 15:42:28 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:29.868 15:42:28 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:13:29.868 15:42:28 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:29.868 15:42:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:29.868 15:42:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:29.868 15:42:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:29.868 15:42:28 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:13:29.868 15:42:28 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:13:29.868 15:42:28 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:13:29.868 119: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:13:29.868 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:13:29.868 altname enp218s0f1np1 00:13:29.868 altname ens818f1np1 00:13:29.868 inet 192.168.100.9/24 scope global mlx_0_1 00:13:29.868 valid_lft forever preferred_lft forever 00:13:29.868 15:42:28 -- nvmf/common.sh@411 -- # return 0 00:13:29.869 15:42:28 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:13:29.869 15:42:28 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:13:29.869 15:42:28 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:13:29.869 15:42:28 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:13:29.869 15:42:28 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:13:29.869 15:42:28 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:29.869 15:42:28 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:29.869 15:42:28 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:29.869 15:42:28 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:29.869 15:42:28 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:29.869 15:42:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:29.869 15:42:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:29.869 15:42:28 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:13:29.869 15:42:28 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:13:29.869 15:42:28 -- nvmf/common.sh@105 -- # continue 2 00:13:29.869 15:42:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:29.869 15:42:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:29.869 15:42:28 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:13:29.869 15:42:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:29.869 15:42:28 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:13:29.869 15:42:28 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:13:29.869 15:42:28 -- nvmf/common.sh@105 -- # continue 2 00:13:29.869 15:42:28 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:29.869 15:42:28 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:13:29.869 15:42:28 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:29.869 15:42:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:29.869 15:42:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:29.869 15:42:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:29.869 15:42:28 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:29.869 15:42:28 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:13:29.869 15:42:28 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:29.869 15:42:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:29.869 15:42:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:29.869 15:42:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:29.869 15:42:28 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:13:29.869 192.168.100.9' 00:13:29.869 15:42:28 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:13:29.869 192.168.100.9' 00:13:29.869 15:42:28 -- nvmf/common.sh@446 -- # head -n 1 00:13:29.869 15:42:28 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:13:29.869 15:42:28 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:13:29.869 192.168.100.9' 00:13:29.869 15:42:28 -- nvmf/common.sh@447 -- # tail -n +2 00:13:29.869 15:42:28 -- nvmf/common.sh@447 -- # head -n 1 00:13:29.869 15:42:28 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:13:29.869 15:42:28 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:13:29.869 15:42:28 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:13:29.869 15:42:28 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:13:29.869 15:42:28 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:13:29.869 15:42:28 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:13:29.869 15:42:28 -- target/device_removal.sh@235 -- # BOND_NAME=bond_nvmf 00:13:29.869 15:42:28 -- target/device_removal.sh@236 -- # BOND_IP=10.11.11.26 00:13:29.869 15:42:28 -- target/device_removal.sh@237 -- # BOND_MASK=24 00:13:29.869 15:42:28 -- target/device_removal.sh@311 -- # run_test nvmf_device_removal_pci_remove_no_srq test_remove_and_rescan --no-srq 00:13:29.869 15:42:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:29.869 15:42:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:29.869 15:42:28 -- common/autotest_common.sh@10 -- # set +x 00:13:30.127 ************************************ 00:13:30.127 START TEST nvmf_device_removal_pci_remove_no_srq 00:13:30.127 ************************************ 00:13:30.127 15:42:28 -- common/autotest_common.sh@1111 -- # test_remove_and_rescan --no-srq 00:13:30.127 15:42:28 -- target/device_removal.sh@128 -- # nvmfappstart -m 0x3 00:13:30.127 15:42:28 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:13:30.127 15:42:28 -- common/autotest_common.sh@710 -- # xtrace_disable 00:13:30.127 15:42:28 -- common/autotest_common.sh@10 -- # set +x 00:13:30.127 15:42:28 -- nvmf/common.sh@470 -- # nvmfpid=3310525 00:13:30.127 15:42:28 -- nvmf/common.sh@471 -- # waitforlisten 3310525 00:13:30.127 15:42:28 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:13:30.127 15:42:28 -- common/autotest_common.sh@817 -- # '[' -z 3310525 ']' 00:13:30.127 15:42:28 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:30.127 15:42:28 -- common/autotest_common.sh@822 -- # local max_retries=100 00:13:30.127 15:42:28 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:30.127 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:30.127 15:42:28 -- common/autotest_common.sh@826 -- # xtrace_disable 00:13:30.128 15:42:28 -- common/autotest_common.sh@10 -- # set +x 00:13:30.128 [2024-04-26 15:42:28.617486] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:13:30.128 [2024-04-26 15:42:28.617534] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:30.128 EAL: No free 2048 kB hugepages reported on node 1 00:13:30.128 [2024-04-26 15:42:28.669808] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:13:30.385 [2024-04-26 15:42:28.749103] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:30.385 [2024-04-26 15:42:28.749139] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:30.385 [2024-04-26 15:42:28.749153] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:13:30.385 [2024-04-26 15:42:28.749159] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:13:30.385 [2024-04-26 15:42:28.749164] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:30.385 [2024-04-26 15:42:28.749226] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:30.385 [2024-04-26 15:42:28.749229] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:30.950 15:42:29 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:13:30.950 15:42:29 -- common/autotest_common.sh@850 -- # return 0 00:13:30.950 15:42:29 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:13:30.950 15:42:29 -- common/autotest_common.sh@716 -- # xtrace_disable 00:13:30.950 15:42:29 -- common/autotest_common.sh@10 -- # set +x 00:13:30.950 15:42:29 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:30.950 15:42:29 -- target/device_removal.sh@130 -- # create_subsystem_and_connect --no-srq 00:13:30.950 15:42:29 -- target/device_removal.sh@45 -- # local -gA netdev_nvme_dict 00:13:30.950 15:42:29 -- target/device_removal.sh@46 -- # netdev_nvme_dict=() 00:13:30.950 15:42:29 -- target/device_removal.sh@48 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 --no-srq 00:13:30.950 15:42:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:30.950 15:42:29 -- common/autotest_common.sh@10 -- # set +x 00:13:30.950 [2024-04-26 15:42:29.480225] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1ae1a60/0x1ae5f50) succeed. 00:13:30.950 [2024-04-26 15:42:29.488906] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1ae2f60/0x1b275e0) succeed. 00:13:30.950 15:42:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:30.950 15:42:29 -- target/device_removal.sh@49 -- # get_rdma_if_list 00:13:30.950 15:42:29 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:30.950 15:42:29 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:30.950 15:42:29 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:30.950 15:42:29 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:30.950 15:42:29 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:30.950 15:42:29 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:30.950 15:42:29 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:30.950 15:42:29 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:13:30.950 15:42:29 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:13:30.950 15:42:29 -- nvmf/common.sh@105 -- # continue 2 00:13:30.950 15:42:29 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:30.950 15:42:29 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:30.950 15:42:29 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:13:30.950 15:42:29 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:30.950 15:42:29 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:13:30.950 15:42:29 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:13:30.950 15:42:29 -- nvmf/common.sh@105 -- # continue 2 00:13:30.950 15:42:29 -- target/device_removal.sh@49 -- # for net_dev in $(get_rdma_if_list) 00:13:30.950 15:42:29 -- target/device_removal.sh@50 -- # create_subsystem_and_connect_on_netdev mlx_0_0 00:13:30.950 15:42:29 -- target/device_removal.sh@25 -- # local -a dev_name 00:13:30.950 15:42:29 -- target/device_removal.sh@27 -- # dev_name=mlx_0_0 00:13:30.950 15:42:29 -- target/device_removal.sh@28 -- # malloc_name=mlx_0_0 00:13:30.950 15:42:29 -- target/device_removal.sh@29 -- # get_subsystem_nqn mlx_0_0 00:13:30.950 15:42:29 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_0 00:13:30.950 15:42:29 -- target/device_removal.sh@29 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_0 00:13:30.950 15:42:29 -- target/device_removal.sh@30 -- # get_ip_address mlx_0_0 00:13:30.950 15:42:29 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:30.950 15:42:29 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:30.950 15:42:29 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:30.950 15:42:29 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:30.950 15:42:29 -- target/device_removal.sh@30 -- # ip=192.168.100.8 00:13:30.950 15:42:29 -- target/device_removal.sh@31 -- # serial=SPDK000mlx_0_0 00:13:30.950 15:42:29 -- target/device_removal.sh@33 -- # MALLOC_BDEV_SIZE=128 00:13:30.950 15:42:29 -- target/device_removal.sh@34 -- # MALLOC_BLOCK_SIZE=512 00:13:30.950 15:42:29 -- target/device_removal.sh@36 -- # rpc_cmd bdev_malloc_create 128 512 -b mlx_0_0 00:13:30.950 15:42:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:30.950 15:42:29 -- common/autotest_common.sh@10 -- # set +x 00:13:31.208 15:42:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:31.208 15:42:29 -- target/device_removal.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:system_mlx_0_0 -a -s SPDK000mlx_0_0 00:13:31.208 15:42:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:31.208 15:42:29 -- common/autotest_common.sh@10 -- # set +x 00:13:31.208 15:42:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:31.208 15:42:29 -- target/device_removal.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:system_mlx_0_0 mlx_0_0 00:13:31.208 15:42:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:31.208 15:42:29 -- common/autotest_common.sh@10 -- # set +x 00:13:31.208 15:42:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:31.208 15:42:29 -- target/device_removal.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:system_mlx_0_0 -t rdma -a 192.168.100.8 -s 4420 00:13:31.208 15:42:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:31.208 15:42:29 -- common/autotest_common.sh@10 -- # set +x 00:13:31.208 [2024-04-26 15:42:29.614246] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:13:31.208 15:42:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:31.208 15:42:29 -- target/device_removal.sh@41 -- # return 0 00:13:31.208 15:42:29 -- target/device_removal.sh@50 -- # netdev_nvme_dict[$net_dev]=mlx_0_0 00:13:31.208 15:42:29 -- target/device_removal.sh@49 -- # for net_dev in $(get_rdma_if_list) 00:13:31.208 15:42:29 -- target/device_removal.sh@50 -- # create_subsystem_and_connect_on_netdev mlx_0_1 00:13:31.208 15:42:29 -- target/device_removal.sh@25 -- # local -a dev_name 00:13:31.208 15:42:29 -- target/device_removal.sh@27 -- # dev_name=mlx_0_1 00:13:31.208 15:42:29 -- target/device_removal.sh@28 -- # malloc_name=mlx_0_1 00:13:31.208 15:42:29 -- target/device_removal.sh@29 -- # get_subsystem_nqn mlx_0_1 00:13:31.208 15:42:29 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_1 00:13:31.208 15:42:29 -- target/device_removal.sh@29 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_1 00:13:31.208 15:42:29 -- target/device_removal.sh@30 -- # get_ip_address mlx_0_1 00:13:31.208 15:42:29 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:31.208 15:42:29 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:31.208 15:42:29 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:31.208 15:42:29 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:31.208 15:42:29 -- target/device_removal.sh@30 -- # ip=192.168.100.9 00:13:31.208 15:42:29 -- target/device_removal.sh@31 -- # serial=SPDK000mlx_0_1 00:13:31.208 15:42:29 -- target/device_removal.sh@33 -- # MALLOC_BDEV_SIZE=128 00:13:31.208 15:42:29 -- target/device_removal.sh@34 -- # MALLOC_BLOCK_SIZE=512 00:13:31.208 15:42:29 -- target/device_removal.sh@36 -- # rpc_cmd bdev_malloc_create 128 512 -b mlx_0_1 00:13:31.208 15:42:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:31.208 15:42:29 -- common/autotest_common.sh@10 -- # set +x 00:13:31.208 15:42:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:31.208 15:42:29 -- target/device_removal.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:system_mlx_0_1 -a -s SPDK000mlx_0_1 00:13:31.208 15:42:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:31.208 15:42:29 -- common/autotest_common.sh@10 -- # set +x 00:13:31.208 15:42:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:31.208 15:42:29 -- target/device_removal.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:system_mlx_0_1 mlx_0_1 00:13:31.208 15:42:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:31.208 15:42:29 -- common/autotest_common.sh@10 -- # set +x 00:13:31.208 15:42:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:31.208 15:42:29 -- target/device_removal.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:system_mlx_0_1 -t rdma -a 192.168.100.9 -s 4420 00:13:31.208 15:42:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:31.208 15:42:29 -- common/autotest_common.sh@10 -- # set +x 00:13:31.208 [2024-04-26 15:42:29.693503] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:13:31.208 15:42:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:31.208 15:42:29 -- target/device_removal.sh@41 -- # return 0 00:13:31.208 15:42:29 -- target/device_removal.sh@50 -- # netdev_nvme_dict[$net_dev]=mlx_0_1 00:13:31.208 15:42:29 -- target/device_removal.sh@53 -- # return 0 00:13:31.208 15:42:29 -- target/device_removal.sh@132 -- # generate_io_traffic_with_bdevperf mlx_0_0 mlx_0_1 00:13:31.208 15:42:29 -- target/device_removal.sh@87 -- # dev_names=('mlx_0_0' 'mlx_0_1') 00:13:31.208 15:42:29 -- target/device_removal.sh@87 -- # local dev_names 00:13:31.208 15:42:29 -- target/device_removal.sh@89 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:13:31.208 15:42:29 -- target/device_removal.sh@91 -- # bdevperf_pid=3310791 00:13:31.208 15:42:29 -- target/device_removal.sh@93 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; kill -9 $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:13:31.208 15:42:29 -- target/device_removal.sh@90 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 90 00:13:31.208 15:42:29 -- target/device_removal.sh@94 -- # waitforlisten 3310791 /var/tmp/bdevperf.sock 00:13:31.208 15:42:29 -- common/autotest_common.sh@817 -- # '[' -z 3310791 ']' 00:13:31.208 15:42:29 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:13:31.208 15:42:29 -- common/autotest_common.sh@822 -- # local max_retries=100 00:13:31.208 15:42:29 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:13:31.208 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:13:31.208 15:42:29 -- common/autotest_common.sh@826 -- # xtrace_disable 00:13:31.208 15:42:29 -- common/autotest_common.sh@10 -- # set +x 00:13:32.140 15:42:30 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:13:32.141 15:42:30 -- common/autotest_common.sh@850 -- # return 0 00:13:32.141 15:42:30 -- target/device_removal.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_set_options -r -1 00:13:32.141 15:42:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:32.141 15:42:30 -- common/autotest_common.sh@10 -- # set +x 00:13:32.141 15:42:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:32.141 15:42:30 -- target/device_removal.sh@100 -- # for dev_name in "${dev_names[@]}" 00:13:32.141 15:42:30 -- target/device_removal.sh@101 -- # get_subsystem_nqn mlx_0_0 00:13:32.141 15:42:30 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_0 00:13:32.141 15:42:30 -- target/device_removal.sh@101 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_0 00:13:32.141 15:42:30 -- target/device_removal.sh@102 -- # get_ip_address mlx_0_0 00:13:32.141 15:42:30 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:32.141 15:42:30 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:32.141 15:42:30 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:32.141 15:42:30 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:32.141 15:42:30 -- target/device_removal.sh@102 -- # tgt_ip=192.168.100.8 00:13:32.141 15:42:30 -- target/device_removal.sh@106 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme_mlx_0_0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:system_mlx_0_0 -l -1 -o 1 00:13:32.141 15:42:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:32.141 15:42:30 -- common/autotest_common.sh@10 -- # set +x 00:13:32.141 Nvme_mlx_0_0n1 00:13:32.141 15:42:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:32.141 15:42:30 -- target/device_removal.sh@100 -- # for dev_name in "${dev_names[@]}" 00:13:32.141 15:42:30 -- target/device_removal.sh@101 -- # get_subsystem_nqn mlx_0_1 00:13:32.141 15:42:30 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_1 00:13:32.141 15:42:30 -- target/device_removal.sh@101 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_1 00:13:32.141 15:42:30 -- target/device_removal.sh@102 -- # get_ip_address mlx_0_1 00:13:32.141 15:42:30 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:32.141 15:42:30 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:32.141 15:42:30 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:32.141 15:42:30 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:32.141 15:42:30 -- target/device_removal.sh@102 -- # tgt_ip=192.168.100.9 00:13:32.141 15:42:30 -- target/device_removal.sh@106 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme_mlx_0_1 -t rdma -a 192.168.100.9 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:system_mlx_0_1 -l -1 -o 1 00:13:32.141 15:42:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:32.141 15:42:30 -- common/autotest_common.sh@10 -- # set +x 00:13:32.399 Nvme_mlx_0_1n1 00:13:32.399 15:42:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:32.399 15:42:30 -- target/device_removal.sh@110 -- # bdevperf_rpc_pid=3310863 00:13:32.399 15:42:30 -- target/device_removal.sh@112 -- # sleep 5 00:13:32.399 15:42:30 -- target/device_removal.sh@109 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 120 -s /var/tmp/bdevperf.sock perform_tests 00:13:37.654 15:42:35 -- target/device_removal.sh@134 -- # for net_dev in "${!netdev_nvme_dict[@]}" 00:13:37.654 15:42:35 -- target/device_removal.sh@135 -- # nvme_dev=mlx_0_0 00:13:37.654 15:42:35 -- target/device_removal.sh@136 -- # get_rdma_device_name mlx_0_0 00:13:37.654 15:42:35 -- target/device_removal.sh@71 -- # dev_name=mlx_0_0 00:13:37.654 15:42:35 -- target/device_removal.sh@72 -- # get_pci_dir mlx_0_0 00:13:37.654 15:42:35 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:13:37.654 15:42:35 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:da:00.0/net/mlx_0_0/device 00:13:37.654 15:42:35 -- target/device_removal.sh@72 -- # ls /sys/devices/pci0000:d7/0000:d7:02.0/0000:da:00.0/infiniband 00:13:37.654 15:42:35 -- target/device_removal.sh@136 -- # rdma_dev_name=mlx5_0 00:13:37.654 15:42:35 -- target/device_removal.sh@137 -- # get_ip_address mlx_0_0 00:13:37.654 15:42:35 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:37.654 15:42:35 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:37.654 15:42:35 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:37.654 15:42:35 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:37.654 15:42:35 -- target/device_removal.sh@137 -- # origin_ip=192.168.100.8 00:13:37.654 15:42:35 -- target/device_removal.sh@138 -- # get_pci_dir mlx_0_0 00:13:37.654 15:42:35 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:13:37.654 15:42:35 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:da:00.0/net/mlx_0_0/device 00:13:37.654 15:42:35 -- target/device_removal.sh@138 -- # pci_dir=/sys/devices/pci0000:d7/0000:d7:02.0/0000:da:00.0 00:13:37.654 15:42:35 -- target/device_removal.sh@140 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_0 00:13:37.654 15:42:35 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_0 00:13:37.654 15:42:35 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:13:37.654 15:42:35 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:13:37.654 15:42:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:37.654 15:42:35 -- target/device_removal.sh@77 -- # grep mlx5_0 00:13:37.655 15:42:35 -- common/autotest_common.sh@10 -- # set +x 00:13:37.655 15:42:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:37.655 mlx5_0 00:13:37.655 15:42:35 -- target/device_removal.sh@78 -- # return 0 00:13:37.655 15:42:35 -- target/device_removal.sh@145 -- # remove_one_nic mlx_0_0 00:13:37.655 15:42:35 -- target/device_removal.sh@66 -- # dev_name=mlx_0_0 00:13:37.655 15:42:35 -- target/device_removal.sh@67 -- # echo 1 00:13:37.655 15:42:35 -- target/device_removal.sh@67 -- # get_pci_dir mlx_0_0 00:13:37.655 15:42:35 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:13:37.655 15:42:35 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:da:00.0/net/mlx_0_0/device 00:13:37.655 [2024-04-26 15:42:35.900436] rdma.c:3563:nvmf_rdma_handle_device_removal: *NOTICE*: Port 192.168.100.8:4420 on device mlx5_0 is being removed. 00:13:37.655 [2024-04-26 15:42:35.900853] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:13:37.655 [2024-04-26 15:42:35.904733] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:13:37.655 [2024-04-26 15:42:35.904753] rdma.c: 845:nvmf_rdma_qpair_destroy: *WARNING*: Destroying qpair when queue depth is 96 00:13:37.655 [2024-04-26 15:42:35.904760] rdma.c: 632:nvmf_rdma_dump_qpair_contents: *ERROR*: Dumping contents of queue pair (QID 1) 00:13:37.655 [2024-04-26 15:42:35.904766] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.904772] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.904777] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.904783] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.904787] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.904792] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.904796] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.904802] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.904807] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.904812] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.904817] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.904822] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.904827] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.904831] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.904836] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.904841] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.904845] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.904850] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.904855] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.904859] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.904864] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.904870] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.904875] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.904880] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.904884] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.904889] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.904897] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.904902] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.904906] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.904911] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.904916] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.904921] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.904927] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.904932] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.904936] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.904941] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.904946] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.904951] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.904955] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.904961] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.904965] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.904970] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.904975] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.904979] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.904984] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.904989] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.904993] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.904998] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.905003] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.905008] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.905013] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.905018] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.905023] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.905031] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.905036] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.905041] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.905049] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.905058] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.905063] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.905069] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.905074] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.905079] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.905084] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.905088] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.905094] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.905098] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.905103] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.905113] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.905117] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.905122] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.905127] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.905132] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.905137] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.905149] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.905154] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.905159] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.905164] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.905168] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.905173] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.905177] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.905183] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.905187] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.905192] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.905196] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.905201] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.905206] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.905212] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.905217] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.905222] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.905227] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.905231] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.905236] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.905240] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.905245] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.905250] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.905254] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.905260] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.905265] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.905270] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.905274] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.905279] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.905284] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.905289] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.655 [2024-04-26 15:42:35.905294] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.655 [2024-04-26 15:42:35.905298] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905303] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905308] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905313] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905317] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905323] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905328] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905333] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905338] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905342] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905347] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905351] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905356] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905361] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905366] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905370] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905375] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905379] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905384] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905389] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905394] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905398] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905403] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905407] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905413] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905417] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905422] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905427] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905431] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905436] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905441] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905445] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905449] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905454] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905458] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905463] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905468] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905473] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905478] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905483] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905488] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905492] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905497] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905502] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905506] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905511] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905516] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905523] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905527] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905532] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905536] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905541] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905546] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905551] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905555] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905560] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905565] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905570] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905575] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905579] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905584] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905589] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905593] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905598] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905603] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905607] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905612] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905617] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905622] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905627] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905631] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905636] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905640] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905645] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905649] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905655] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905660] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905664] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905669] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905673] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905678] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905682] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905687] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905692] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905702] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905707] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:37.656 [2024-04-26 15:42:35.905712] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:13:37.656 [2024-04-26 15:42:35.905716] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:13:42.911 15:42:41 -- target/device_removal.sh@147 -- # seq 1 10 00:13:42.911 15:42:41 -- target/device_removal.sh@147 -- # for i in $(seq 1 10) 00:13:42.911 15:42:41 -- target/device_removal.sh@148 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_0 00:13:42.911 15:42:41 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_0 00:13:42.911 15:42:41 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:13:42.911 15:42:41 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:13:42.911 15:42:41 -- target/device_removal.sh@77 -- # grep mlx5_0 00:13:42.911 15:42:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:42.911 15:42:41 -- common/autotest_common.sh@10 -- # set +x 00:13:42.911 15:42:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:42.911 15:42:41 -- target/device_removal.sh@78 -- # return 1 00:13:42.911 15:42:41 -- target/device_removal.sh@149 -- # break 00:13:42.911 15:42:41 -- target/device_removal.sh@158 -- # get_rdma_dev_count_in_nvmf_tgt 00:13:42.911 15:42:41 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:13:42.911 15:42:41 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:13:42.911 15:42:41 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:13:42.911 15:42:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:42.911 15:42:41 -- common/autotest_common.sh@10 -- # set +x 00:13:42.911 15:42:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:42.911 15:42:41 -- target/device_removal.sh@158 -- # ib_count_after_remove=1 00:13:42.911 15:42:41 -- target/device_removal.sh@160 -- # rescan_pci 00:13:42.911 15:42:41 -- target/device_removal.sh@57 -- # echo 1 00:13:43.848 15:42:42 -- target/device_removal.sh@162 -- # seq 1 10 00:13:43.848 15:42:42 -- target/device_removal.sh@162 -- # for i in $(seq 1 10) 00:13:43.848 15:42:42 -- target/device_removal.sh@163 -- # ls /sys/devices/pci0000:d7/0000:d7:02.0/0000:da:00.0/net 00:13:43.848 15:42:42 -- target/device_removal.sh@163 -- # new_net_dev=mlx_0_0 00:13:43.848 15:42:42 -- target/device_removal.sh@164 -- # [[ -z mlx_0_0 ]] 00:13:43.848 15:42:42 -- target/device_removal.sh@166 -- # [[ mlx_0_0 != \m\l\x\_\0\_\0 ]] 00:13:43.848 15:42:42 -- target/device_removal.sh@171 -- # break 00:13:43.848 15:42:42 -- target/device_removal.sh@175 -- # [[ -z mlx_0_0 ]] 00:13:43.848 15:42:42 -- target/device_removal.sh@179 -- # ip link set mlx_0_0 up 00:13:44.157 [2024-04-26 15:42:42.710264] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1e60dd0/0x1ae5f50) succeed. 00:13:44.157 [2024-04-26 15:42:42.710347] rdma.c:3305:nvmf_rdma_retry_listen_port: *ERROR*: Found new IB device but port 192.168.100.8:4420 is still failed(-1) to listen. 00:13:47.479 15:42:45 -- target/device_removal.sh@180 -- # get_ip_address mlx_0_0 00:13:47.479 15:42:45 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:47.479 15:42:45 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:47.479 15:42:45 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:47.479 15:42:45 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:47.479 15:42:45 -- target/device_removal.sh@180 -- # [[ -z '' ]] 00:13:47.479 15:42:45 -- target/device_removal.sh@181 -- # ip addr add 192.168.100.8/24 dev mlx_0_0 00:13:47.479 15:42:45 -- target/device_removal.sh@186 -- # seq 1 10 00:13:47.479 15:42:45 -- target/device_removal.sh@186 -- # for i in $(seq 1 10) 00:13:47.479 15:42:45 -- target/device_removal.sh@187 -- # get_rdma_dev_count_in_nvmf_tgt 00:13:47.479 15:42:45 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:13:47.479 15:42:45 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:13:47.479 15:42:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:47.479 15:42:45 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:13:47.479 15:42:45 -- common/autotest_common.sh@10 -- # set +x 00:13:47.479 [2024-04-26 15:42:45.765069] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:13:47.479 [2024-04-26 15:42:45.765104] rdma.c:3311:nvmf_rdma_retry_listen_port: *NOTICE*: Port 192.168.100.8:4420 come back 00:13:47.479 [2024-04-26 15:42:45.765120] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:13:47.479 [2024-04-26 15:42:45.765134] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:13:47.479 15:42:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:47.479 15:42:45 -- target/device_removal.sh@187 -- # ib_count=2 00:13:47.479 15:42:45 -- target/device_removal.sh@188 -- # (( ib_count > ib_count_after_remove )) 00:13:47.479 15:42:45 -- target/device_removal.sh@189 -- # break 00:13:47.479 15:42:45 -- target/device_removal.sh@134 -- # for net_dev in "${!netdev_nvme_dict[@]}" 00:13:47.479 15:42:45 -- target/device_removal.sh@135 -- # nvme_dev=mlx_0_1 00:13:47.479 15:42:45 -- target/device_removal.sh@136 -- # get_rdma_device_name mlx_0_1 00:13:47.479 15:42:45 -- target/device_removal.sh@71 -- # dev_name=mlx_0_1 00:13:47.479 15:42:45 -- target/device_removal.sh@72 -- # get_pci_dir mlx_0_1 00:13:47.479 15:42:45 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:13:47.479 15:42:45 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:da:00.1/net/mlx_0_1/device 00:13:47.479 15:42:45 -- target/device_removal.sh@72 -- # ls /sys/devices/pci0000:d7/0000:d7:02.0/0000:da:00.1/infiniband 00:13:47.479 15:42:45 -- target/device_removal.sh@136 -- # rdma_dev_name=mlx5_1 00:13:47.479 15:42:45 -- target/device_removal.sh@137 -- # get_ip_address mlx_0_1 00:13:47.479 15:42:45 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:47.479 15:42:45 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:47.479 15:42:45 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:47.479 15:42:45 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:47.479 15:42:45 -- target/device_removal.sh@137 -- # origin_ip=192.168.100.9 00:13:47.479 15:42:45 -- target/device_removal.sh@138 -- # get_pci_dir mlx_0_1 00:13:47.479 15:42:45 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:13:47.479 15:42:45 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:da:00.1/net/mlx_0_1/device 00:13:47.479 15:42:45 -- target/device_removal.sh@138 -- # pci_dir=/sys/devices/pci0000:d7/0000:d7:02.0/0000:da:00.1 00:13:47.479 15:42:45 -- target/device_removal.sh@140 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_1 00:13:47.479 15:42:45 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_1 00:13:47.479 15:42:45 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:13:47.479 15:42:45 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:13:47.479 15:42:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:47.479 15:42:45 -- common/autotest_common.sh@10 -- # set +x 00:13:47.479 15:42:45 -- target/device_removal.sh@77 -- # grep mlx5_1 00:13:47.479 15:42:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:47.479 mlx5_1 00:13:47.479 15:42:45 -- target/device_removal.sh@78 -- # return 0 00:13:47.479 15:42:45 -- target/device_removal.sh@145 -- # remove_one_nic mlx_0_1 00:13:47.479 15:42:45 -- target/device_removal.sh@66 -- # dev_name=mlx_0_1 00:13:47.479 15:42:45 -- target/device_removal.sh@67 -- # echo 1 00:13:47.479 15:42:45 -- target/device_removal.sh@67 -- # get_pci_dir mlx_0_1 00:13:47.479 15:42:45 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:13:47.479 15:42:45 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:da:00.1/net/mlx_0_1/device 00:13:47.479 [2024-04-26 15:42:45.929814] rdma.c:3563:nvmf_rdma_handle_device_removal: *NOTICE*: Port 192.168.100.9:4420 on device mlx5_1 is being removed. 00:13:47.479 [2024-04-26 15:42:45.929880] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:13:47.479 [2024-04-26 15:42:45.937935] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:13:54.027 15:42:51 -- target/device_removal.sh@147 -- # seq 1 10 00:13:54.027 15:42:51 -- target/device_removal.sh@147 -- # for i in $(seq 1 10) 00:13:54.027 15:42:51 -- target/device_removal.sh@148 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_1 00:13:54.027 15:42:51 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_1 00:13:54.027 15:42:51 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:13:54.027 15:42:51 -- target/device_removal.sh@77 -- # grep mlx5_1 00:13:54.027 15:42:51 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:13:54.027 15:42:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:54.027 15:42:51 -- common/autotest_common.sh@10 -- # set +x 00:13:54.027 15:42:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:54.027 15:42:51 -- target/device_removal.sh@78 -- # return 1 00:13:54.027 15:42:51 -- target/device_removal.sh@149 -- # break 00:13:54.027 15:42:51 -- target/device_removal.sh@158 -- # get_rdma_dev_count_in_nvmf_tgt 00:13:54.027 15:42:51 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:13:54.027 15:42:51 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:13:54.027 15:42:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:54.027 15:42:51 -- common/autotest_common.sh@10 -- # set +x 00:13:54.027 15:42:51 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:13:54.027 15:42:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:54.027 15:42:51 -- target/device_removal.sh@158 -- # ib_count_after_remove=1 00:13:54.027 15:42:51 -- target/device_removal.sh@160 -- # rescan_pci 00:13:54.027 15:42:51 -- target/device_removal.sh@57 -- # echo 1 00:13:54.027 [2024-04-26 15:42:52.540232] rdma.c:3252:nvmf_rdma_rescan_devices: *WARNING*: Failed to init ibv device 0x1cec7a0, err 11. Skip rescan. 00:13:54.027 15:42:52 -- target/device_removal.sh@162 -- # seq 1 10 00:13:54.027 15:42:52 -- target/device_removal.sh@162 -- # for i in $(seq 1 10) 00:13:54.027 15:42:52 -- target/device_removal.sh@163 -- # ls /sys/devices/pci0000:d7/0000:d7:02.0/0000:da:00.1/net 00:13:54.027 15:42:52 -- target/device_removal.sh@163 -- # new_net_dev=mlx_0_1 00:13:54.027 15:42:52 -- target/device_removal.sh@164 -- # [[ -z mlx_0_1 ]] 00:13:54.027 15:42:52 -- target/device_removal.sh@166 -- # [[ mlx_0_1 != \m\l\x\_\0\_\1 ]] 00:13:54.027 15:42:52 -- target/device_removal.sh@171 -- # break 00:13:54.027 15:42:52 -- target/device_removal.sh@175 -- # [[ -z mlx_0_1 ]] 00:13:54.027 15:42:52 -- target/device_removal.sh@179 -- # ip link set mlx_0_1 up 00:13:54.591 [2024-04-26 15:42:52.890157] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1cecaa0/0x1b275e0) succeed. 00:13:54.592 [2024-04-26 15:42:52.890232] rdma.c:3305:nvmf_rdma_retry_listen_port: *ERROR*: Found new IB device but port 192.168.100.9:4420 is still failed(-1) to listen. 00:13:57.867 15:42:55 -- target/device_removal.sh@180 -- # get_ip_address mlx_0_1 00:13:57.867 15:42:55 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:57.867 15:42:55 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:57.867 15:42:55 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:57.867 15:42:55 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:57.867 15:42:55 -- target/device_removal.sh@180 -- # [[ -z '' ]] 00:13:57.867 15:42:55 -- target/device_removal.sh@181 -- # ip addr add 192.168.100.9/24 dev mlx_0_1 00:13:57.867 15:42:55 -- target/device_removal.sh@186 -- # seq 1 10 00:13:57.867 15:42:55 -- target/device_removal.sh@186 -- # for i in $(seq 1 10) 00:13:57.867 15:42:55 -- target/device_removal.sh@187 -- # get_rdma_dev_count_in_nvmf_tgt 00:13:57.867 15:42:55 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:13:57.867 15:42:55 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:13:57.867 15:42:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:13:57.867 15:42:55 -- common/autotest_common.sh@10 -- # set +x 00:13:57.867 15:42:55 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:13:57.867 [2024-04-26 15:42:56.000746] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:13:57.867 [2024-04-26 15:42:56.000780] rdma.c:3311:nvmf_rdma_retry_listen_port: *NOTICE*: Port 192.168.100.9:4420 come back 00:13:57.867 [2024-04-26 15:42:56.000795] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:13:57.867 [2024-04-26 15:42:56.000809] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:13:57.867 15:42:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:13:57.867 15:42:56 -- target/device_removal.sh@187 -- # ib_count=2 00:13:57.867 15:42:56 -- target/device_removal.sh@188 -- # (( ib_count > ib_count_after_remove )) 00:13:57.867 15:42:56 -- target/device_removal.sh@189 -- # break 00:13:57.867 15:42:56 -- target/device_removal.sh@200 -- # stop_bdevperf 00:13:57.867 15:42:56 -- target/device_removal.sh@116 -- # wait 3310863 00:15:05.524 0 00:15:05.524 15:44:01 -- target/device_removal.sh@118 -- # killprocess 3310791 00:15:05.524 15:44:01 -- common/autotest_common.sh@936 -- # '[' -z 3310791 ']' 00:15:05.524 15:44:01 -- common/autotest_common.sh@940 -- # kill -0 3310791 00:15:05.524 15:44:01 -- common/autotest_common.sh@941 -- # uname 00:15:05.524 15:44:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:05.524 15:44:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3310791 00:15:05.524 15:44:01 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:15:05.524 15:44:01 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:15:05.524 15:44:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3310791' 00:15:05.524 killing process with pid 3310791 00:15:05.524 15:44:01 -- common/autotest_common.sh@955 -- # kill 3310791 00:15:05.524 15:44:01 -- common/autotest_common.sh@960 -- # wait 3310791 00:15:05.524 15:44:01 -- target/device_removal.sh@119 -- # bdevperf_pid= 00:15:05.524 15:44:01 -- target/device_removal.sh@121 -- # cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/try.txt 00:15:05.524 [2024-04-26 15:42:29.742584] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:15:05.524 [2024-04-26 15:42:29.742632] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3310791 ] 00:15:05.524 EAL: No free 2048 kB hugepages reported on node 1 00:15:05.524 [2024-04-26 15:42:29.791632] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:05.524 [2024-04-26 15:42:29.861378] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:05.524 Running I/O for 90 seconds... 00:15:05.524 [2024-04-26 15:42:35.898388] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno No such device or address (6) 00:15:05.524 [2024-04-26 15:42:35.898429] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:15:05.524 [2024-04-26 15:42:35.898439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32676 cdw0:6 sqhd:93b9 p:0 m:0 dnr:0 00:15:05.524 [2024-04-26 15:42:35.898447] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:15:05.524 [2024-04-26 15:42:35.898454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32676 cdw0:6 sqhd:93b9 p:0 m:0 dnr:0 00:15:05.524 [2024-04-26 15:42:35.898461] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:15:05.524 [2024-04-26 15:42:35.898467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32676 cdw0:6 sqhd:93b9 p:0 m:0 dnr:0 00:15:05.524 [2024-04-26 15:42:35.898474] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:15:05.524 [2024-04-26 15:42:35.898481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32676 cdw0:6 sqhd:93b9 p:0 m:0 dnr:0 00:15:05.524 [2024-04-26 15:42:35.900805] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:15:05.524 [2024-04-26 15:42:35.900819] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:15:05.524 [2024-04-26 15:42:35.900841] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:15:05.524 [2024-04-26 15:42:35.907873] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:35.917894] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:35.927921] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:35.937963] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:35.947988] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:35.958280] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:35.968308] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:35.978336] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:35.988663] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:35.998688] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:36.008715] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:36.018869] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:36.028896] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:36.039043] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:36.049333] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:36.059831] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:36.069899] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:36.079927] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:36.089953] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:36.099978] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:36.110005] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:36.120391] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:36.130845] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:36.141298] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:36.151679] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:36.161886] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:36.172410] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:36.182434] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:36.192591] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:36.203470] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:36.213604] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:36.223735] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:36.233822] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:36.244620] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:36.254763] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:36.264864] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:36.275066] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:36.285490] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:36.296703] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.524 [2024-04-26 15:42:36.308310] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.318335] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.328812] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.339631] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.349888] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.359914] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.370176] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.380203] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.390229] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.400458] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.410485] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.420511] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.430549] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.440577] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.450650] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.460677] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.470798] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.481244] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.491270] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.501297] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.511335] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.521466] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.531526] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.541738] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.551946] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.561972] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.572491] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.582518] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.592547] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.602669] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.612866] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.623310] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.633429] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.643628] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.653803] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.664021] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.674107] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.684253] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.694351] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.704457] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.715284] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.725441] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.735466] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.745499] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.755577] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.766237] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.776346] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.786370] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.796398] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.806717] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.816750] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.826934] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.836959] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.846985] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.857012] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.867387] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.877574] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.887600] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.897629] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.525 [2024-04-26 15:42:36.903306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:206304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.525 [2024-04-26 15:42:36.903326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.525 [2024-04-26 15:42:36.903340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:206312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.525 [2024-04-26 15:42:36.903350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.525 [2024-04-26 15:42:36.903360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:206320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.525 [2024-04-26 15:42:36.903366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.525 [2024-04-26 15:42:36.903376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:206328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.525 [2024-04-26 15:42:36.903382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.525 [2024-04-26 15:42:36.903391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:206336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.525 [2024-04-26 15:42:36.903398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.525 [2024-04-26 15:42:36.903407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:206344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.525 [2024-04-26 15:42:36.903413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.525 [2024-04-26 15:42:36.903423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:206352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.525 [2024-04-26 15:42:36.903428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.525 [2024-04-26 15:42:36.903438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:206360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.525 [2024-04-26 15:42:36.903444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.525 [2024-04-26 15:42:36.903453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:206368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.525 [2024-04-26 15:42:36.903459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.525 [2024-04-26 15:42:36.903468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:206376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.525 [2024-04-26 15:42:36.903474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.525 [2024-04-26 15:42:36.903484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:206384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.525 [2024-04-26 15:42:36.903490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.525 [2024-04-26 15:42:36.903500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:206392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.525 [2024-04-26 15:42:36.903506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.525 [2024-04-26 15:42:36.903515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:206400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.525 [2024-04-26 15:42:36.903521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.525 [2024-04-26 15:42:36.903531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:206408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.525 [2024-04-26 15:42:36.903539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.525 [2024-04-26 15:42:36.903549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:206416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.525 [2024-04-26 15:42:36.903555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.525 [2024-04-26 15:42:36.903564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:206424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.525 [2024-04-26 15:42:36.903570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.525 [2024-04-26 15:42:36.903580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:206432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.525 [2024-04-26 15:42:36.903586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.525 [2024-04-26 15:42:36.903596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:206440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.525 [2024-04-26 15:42:36.903602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.525 [2024-04-26 15:42:36.903612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:206448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.525 [2024-04-26 15:42:36.903619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.525 [2024-04-26 15:42:36.903629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:206456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.525 [2024-04-26 15:42:36.903635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.525 [2024-04-26 15:42:36.903644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:206464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.525 [2024-04-26 15:42:36.903651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.525 [2024-04-26 15:42:36.903660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:206472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.525 [2024-04-26 15:42:36.903667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.525 [2024-04-26 15:42:36.903676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:206480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.903682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.903691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:206488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.903697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.903706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:206496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.903713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.903722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:206504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.903730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.903740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:206512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.903746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.903756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:206520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.903761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.903771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:206528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.903777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.903787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:206536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.903793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.903802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:206544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.903809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.903818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:206552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.903824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.903833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:206560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.903839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.903849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:206568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.903855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.903864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:206576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.903870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.903880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:206584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.903886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.903895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:206592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.903901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.903910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:206600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.903917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.903927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:206608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.903934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.903943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:206616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.903949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.903958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:206624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.903964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.903973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:206632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.903980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.903989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:206640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.903995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.904004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:206648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.904010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.904019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:206656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.904026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.904035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:206664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.904041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.904050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:206672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.904056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.904065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:206680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.904071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.904080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:206688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.904086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.904096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:206696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.904102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.904113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:206704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.904119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.904128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:206712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.904134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.904146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:206720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.904153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.904162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:206728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.904168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.904178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:206736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.904184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.904193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:206744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.904200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.904209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:206752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.904216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.904225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:206760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.904231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.904240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:206768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.904246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.904256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:206776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.904262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.904271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:206784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.904278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.904287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:206792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.904293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.904302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:206800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.904310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.904320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:206808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.904326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.904335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:206816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.904341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.904351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:206824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.904357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.904366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:206832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.904373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.904382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:206840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.526 [2024-04-26 15:42:36.904387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.904397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:205824 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077fe000 len:0x1000 key:0x181700 00:15:05.526 [2024-04-26 15:42:36.904403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.904413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:205832 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077fc000 len:0x1000 key:0x181700 00:15:05.526 [2024-04-26 15:42:36.904419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.526 [2024-04-26 15:42:36.904430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:205840 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077fa000 len:0x1000 key:0x181700 00:15:05.527 [2024-04-26 15:42:36.904437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.527 [2024-04-26 15:42:36.904446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:205848 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077f8000 len:0x1000 key:0x181700 00:15:05.527 [2024-04-26 15:42:36.904452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.527 [2024-04-26 15:42:36.904461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:205856 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077f6000 len:0x1000 key:0x181700 00:15:05.527 [2024-04-26 15:42:36.904468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.527 [2024-04-26 15:42:36.904477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:205864 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077f4000 len:0x1000 key:0x181700 00:15:05.527 [2024-04-26 15:42:36.904483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.527 [2024-04-26 15:42:36.904494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:205872 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077f2000 len:0x1000 key:0x181700 00:15:05.527 [2024-04-26 15:42:36.904500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.527 [2024-04-26 15:42:36.904509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:205880 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077f0000 len:0x1000 key:0x181700 00:15:05.527 [2024-04-26 15:42:36.904515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.527 [2024-04-26 15:42:36.904523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:205888 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ee000 len:0x1000 key:0x181700 00:15:05.527 [2024-04-26 15:42:36.904530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.527 [2024-04-26 15:42:36.904538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:205896 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ec000 len:0x1000 key:0x181700 00:15:05.527 [2024-04-26 15:42:36.904544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.527 [2024-04-26 15:42:36.904552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:205904 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ea000 len:0x1000 key:0x181700 00:15:05.527 [2024-04-26 15:42:36.904558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.527 [2024-04-26 15:42:36.904566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:205912 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e8000 len:0x1000 key:0x181700 00:15:05.527 [2024-04-26 15:42:36.904573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.527 [2024-04-26 15:42:36.904581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:205920 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e6000 len:0x1000 key:0x181700 00:15:05.527 [2024-04-26 15:42:36.904587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.527 [2024-04-26 15:42:36.904596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:205928 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e4000 len:0x1000 key:0x181700 00:15:05.527 [2024-04-26 15:42:36.904602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.527 [2024-04-26 15:42:36.904610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:205936 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e2000 len:0x1000 key:0x181700 00:15:05.527 [2024-04-26 15:42:36.904616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.527 [2024-04-26 15:42:36.904624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:205944 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e0000 len:0x1000 key:0x181700 00:15:05.527 [2024-04-26 15:42:36.904631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.527 [2024-04-26 15:42:36.904639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:205952 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077de000 len:0x1000 key:0x181700 00:15:05.527 [2024-04-26 15:42:36.904645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.527 [2024-04-26 15:42:36.904654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:205960 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077dc000 len:0x1000 key:0x181700 00:15:05.527 [2024-04-26 15:42:36.904660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.527 [2024-04-26 15:42:36.904668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:205968 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077da000 len:0x1000 key:0x181700 00:15:05.527 [2024-04-26 15:42:36.904675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.527 [2024-04-26 15:42:36.904683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:205976 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d8000 len:0x1000 key:0x181700 00:15:05.527 [2024-04-26 15:42:36.904689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.527 [2024-04-26 15:42:36.904697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:205984 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d6000 len:0x1000 key:0x181700 00:15:05.527 [2024-04-26 15:42:36.904703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.527 [2024-04-26 15:42:36.904710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:205992 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d4000 len:0x1000 key:0x181700 00:15:05.527 [2024-04-26 15:42:36.904716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.527 [2024-04-26 15:42:36.904724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:206000 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d2000 len:0x1000 key:0x181700 00:15:05.527 [2024-04-26 15:42:36.904731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.527 [2024-04-26 15:42:36.904739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:206008 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d0000 len:0x1000 key:0x181700 00:15:05.527 [2024-04-26 15:42:36.904745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.527 [2024-04-26 15:42:36.904753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:206016 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ce000 len:0x1000 key:0x181700 00:15:05.527 [2024-04-26 15:42:36.904759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.527 [2024-04-26 15:42:36.904767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:206024 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077cc000 len:0x1000 key:0x181700 00:15:05.527 [2024-04-26 15:42:36.904773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.527 [2024-04-26 15:42:36.904785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:206032 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ca000 len:0x1000 key:0x181700 00:15:05.527 [2024-04-26 15:42:36.904793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.527 [2024-04-26 15:42:36.917495] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:15:05.527 [2024-04-26 15:42:36.917507] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:15:05.527 [2024-04-26 15:42:36.917514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:206040 len:8 PRP1 0x0 PRP2 0x0 00:15:05.527 [2024-04-26 15:42:36.917521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:05.527 [2024-04-26 15:42:36.919297] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:15:05.527 [2024-04-26 15:42:36.919582] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:15:05.527 [2024-04-26 15:42:36.919595] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:15:05.527 [2024-04-26 15:42:36.919600] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:15:05.527 [2024-04-26 15:42:36.919614] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:15:05.527 [2024-04-26 15:42:36.919622] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:15:05.527 [2024-04-26 15:42:36.919632] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:15:05.527 [2024-04-26 15:42:36.919638] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:15:05.527 [2024-04-26 15:42:36.919645] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:15:05.527 [2024-04-26 15:42:36.919662] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:15:05.527 [2024-04-26 15:42:36.919668] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:15:05.527 [2024-04-26 15:42:37.922207] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:15:05.527 [2024-04-26 15:42:37.922241] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:15:05.527 [2024-04-26 15:42:37.922247] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:15:05.527 [2024-04-26 15:42:37.922265] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:15:05.527 [2024-04-26 15:42:37.922274] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:15:05.527 [2024-04-26 15:42:37.922285] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:15:05.527 [2024-04-26 15:42:37.922292] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:15:05.527 [2024-04-26 15:42:37.922299] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:15:05.527 [2024-04-26 15:42:37.922317] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:15:05.527 [2024-04-26 15:42:37.922324] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:15:05.527 [2024-04-26 15:42:38.924844] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:15:05.527 [2024-04-26 15:42:38.924885] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:15:05.527 [2024-04-26 15:42:38.924892] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:15:05.527 [2024-04-26 15:42:38.924909] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:15:05.527 [2024-04-26 15:42:38.924919] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:15:05.527 [2024-04-26 15:42:38.924929] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:15:05.527 [2024-04-26 15:42:38.924935] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:15:05.527 [2024-04-26 15:42:38.924947] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:15:05.527 [2024-04-26 15:42:38.924966] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:15:05.527 [2024-04-26 15:42:38.924974] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:15:05.527 [2024-04-26 15:42:40.930117] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:15:05.527 [2024-04-26 15:42:40.930167] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:15:05.527 [2024-04-26 15:42:40.930193] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:15:05.527 [2024-04-26 15:42:40.930202] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:15:05.527 [2024-04-26 15:42:40.930373] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:15:05.527 [2024-04-26 15:42:40.930380] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:15:05.527 [2024-04-26 15:42:40.930389] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:15:05.527 [2024-04-26 15:42:40.930545] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:15:05.528 [2024-04-26 15:42:40.930554] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:15:05.528 [2024-04-26 15:42:42.935597] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:15:05.528 [2024-04-26 15:42:42.935625] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:15:05.528 [2024-04-26 15:42:42.935653] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:15:05.528 [2024-04-26 15:42:42.935666] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:15:05.528 [2024-04-26 15:42:42.935681] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:15:05.528 [2024-04-26 15:42:42.935691] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:15:05.528 [2024-04-26 15:42:42.935702] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:15:05.528 [2024-04-26 15:42:42.935729] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:15:05.528 [2024-04-26 15:42:42.935740] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:15:05.528 [2024-04-26 15:42:44.940815] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:15:05.528 [2024-04-26 15:42:44.940842] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:15:05.528 [2024-04-26 15:42:44.940864] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:15:05.528 [2024-04-26 15:42:44.940876] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:15:05.528 [2024-04-26 15:42:44.940890] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:15:05.528 [2024-04-26 15:42:44.940900] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:15:05.528 [2024-04-26 15:42:44.940910] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:15:05.528 [2024-04-26 15:42:44.940933] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:15:05.528 [2024-04-26 15:42:44.940944] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:15:05.528 [2024-04-26 15:42:45.921933] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:15:05.528 [2024-04-26 15:42:45.921966] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:15:05.528 [2024-04-26 15:42:45.921979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32676 cdw0:16 sqhd:93b9 p:0 m:0 dnr:0 00:15:05.528 [2024-04-26 15:42:45.921990] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:15:05.528 [2024-04-26 15:42:45.922000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32676 cdw0:16 sqhd:93b9 p:0 m:0 dnr:0 00:15:05.528 [2024-04-26 15:42:45.922011] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:15:05.528 [2024-04-26 15:42:45.922021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32676 cdw0:16 sqhd:93b9 p:0 m:0 dnr:0 00:15:05.528 [2024-04-26 15:42:45.922030] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:15:05.528 [2024-04-26 15:42:45.922040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32676 cdw0:16 sqhd:93b9 p:0 m:0 dnr:0 00:15:05.528 [2024-04-26 15:42:45.937632] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:15:05.528 [2024-04-26 15:42:45.937692] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:15:05.528 [2024-04-26 15:42:45.937779] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:15:05.528 [2024-04-26 15:42:45.937953] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:45.948583] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:45.958603] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:45.978962] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:45.988973] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:45.992686] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:15:05.528 [2024-04-26 15:42:45.998999] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.009024] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.019051] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.029076] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.039103] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.049132] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.059157] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.069185] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.079211] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.089240] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.099265] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.109293] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.119319] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.129345] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.139370] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.149396] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.159421] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.169448] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.179475] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.189501] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.199529] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.209555] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.219583] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.229607] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.239632] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.249658] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.259683] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.269709] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.279736] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.289763] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.299787] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.309814] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.319842] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.329868] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.339896] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.349924] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.359948] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.369973] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.379998] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.390023] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.400049] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.410075] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.420103] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.430131] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.440156] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.450183] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.460207] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.470234] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.480259] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.490286] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.500313] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.510339] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.520367] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.530392] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.540419] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.550446] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.560472] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.570498] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.580523] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.590549] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.600575] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.610602] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.620629] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.528 [2024-04-26 15:42:46.630654] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.529 [2024-04-26 15:42:46.640681] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.529 [2024-04-26 15:42:46.650708] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.529 [2024-04-26 15:42:46.660732] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.529 [2024-04-26 15:42:46.670759] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.529 [2024-04-26 15:42:46.680784] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.529 [2024-04-26 15:42:46.690811] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.529 [2024-04-26 15:42:46.700836] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.529 [2024-04-26 15:42:46.710863] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.529 [2024-04-26 15:42:46.720889] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.529 [2024-04-26 15:42:46.730916] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.529 [2024-04-26 15:42:46.740944] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.529 [2024-04-26 15:42:46.750971] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.529 [2024-04-26 15:42:46.760997] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.529 [2024-04-26 15:42:46.771024] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.529 [2024-04-26 15:42:46.781050] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.529 [2024-04-26 15:42:46.791075] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.529 [2024-04-26 15:42:46.801101] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.529 [2024-04-26 15:42:46.811126] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.529 [2024-04-26 15:42:46.821153] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.529 [2024-04-26 15:42:46.831179] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.529 [2024-04-26 15:42:46.841205] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.529 [2024-04-26 15:42:46.851232] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.529 [2024-04-26 15:42:46.861259] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.529 [2024-04-26 15:42:46.871284] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.529 [2024-04-26 15:42:46.881310] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.529 [2024-04-26 15:42:46.891337] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.529 [2024-04-26 15:42:46.901365] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.529 [2024-04-26 15:42:46.911390] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.529 [2024-04-26 15:42:46.921415] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.529 [2024-04-26 15:42:46.931442] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:15:05.529 [2024-04-26 15:42:46.940274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:16920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.529 [2024-04-26 15:42:46.940287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.529 [2024-04-26 15:42:46.940307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:16928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.529 [2024-04-26 15:42:46.940318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.529 [2024-04-26 15:42:46.940332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:16936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.529 [2024-04-26 15:42:46.940347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.529 [2024-04-26 15:42:46.940362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:16944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.529 [2024-04-26 15:42:46.940372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.529 [2024-04-26 15:42:46.940387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:16952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.529 [2024-04-26 15:42:46.940398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.529 [2024-04-26 15:42:46.940422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:16960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.529 [2024-04-26 15:42:46.940433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.529 [2024-04-26 15:42:46.940447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:16968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.529 [2024-04-26 15:42:46.940457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.529 [2024-04-26 15:42:46.940471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:16976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.529 [2024-04-26 15:42:46.940480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.529 [2024-04-26 15:42:46.940495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:16984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.529 [2024-04-26 15:42:46.940504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.529 [2024-04-26 15:42:46.940518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:16992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.529 [2024-04-26 15:42:46.940527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.529 [2024-04-26 15:42:46.940541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:17000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.529 [2024-04-26 15:42:46.940551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.529 [2024-04-26 15:42:46.940565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:17008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.529 [2024-04-26 15:42:46.940575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.529 [2024-04-26 15:42:46.940588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:17016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.529 [2024-04-26 15:42:46.940598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.529 [2024-04-26 15:42:46.940612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:17024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.529 [2024-04-26 15:42:46.940622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.529 [2024-04-26 15:42:46.940636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:17032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.529 [2024-04-26 15:42:46.940648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.529 [2024-04-26 15:42:46.940663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:17040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.529 [2024-04-26 15:42:46.940672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.529 [2024-04-26 15:42:46.940686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:17048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.529 [2024-04-26 15:42:46.940695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.529 [2024-04-26 15:42:46.940709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:17056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.529 [2024-04-26 15:42:46.940719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.529 [2024-04-26 15:42:46.940732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:17064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.529 [2024-04-26 15:42:46.940742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.529 [2024-04-26 15:42:46.940756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:17072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.529 [2024-04-26 15:42:46.940766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.529 [2024-04-26 15:42:46.940779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:17080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.529 [2024-04-26 15:42:46.940789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.529 [2024-04-26 15:42:46.940803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:17088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.529 [2024-04-26 15:42:46.940812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.529 [2024-04-26 15:42:46.940826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:17096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.529 [2024-04-26 15:42:46.940836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.529 [2024-04-26 15:42:46.940850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:17104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.529 [2024-04-26 15:42:46.940859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.529 [2024-04-26 15:42:46.940873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.529 [2024-04-26 15:42:46.940882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.529 [2024-04-26 15:42:46.940896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:17120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.529 [2024-04-26 15:42:46.940905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.529 [2024-04-26 15:42:46.940919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:17128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.529 [2024-04-26 15:42:46.940928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.529 [2024-04-26 15:42:46.940944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:17136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.529 [2024-04-26 15:42:46.940954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.529 [2024-04-26 15:42:46.940967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:17144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.529 [2024-04-26 15:42:46.940977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.529 [2024-04-26 15:42:46.940991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:17152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.529 [2024-04-26 15:42:46.941003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.529 [2024-04-26 15:42:46.941016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:17160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.529 [2024-04-26 15:42:46.941026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.529 [2024-04-26 15:42:46.941040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:17168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.529 [2024-04-26 15:42:46.941051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.529 [2024-04-26 15:42:46.941064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:17176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.529 [2024-04-26 15:42:46.941074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.529 [2024-04-26 15:42:46.941088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:17184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.529 [2024-04-26 15:42:46.941098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.529 [2024-04-26 15:42:46.941112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:17192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.529 [2024-04-26 15:42:46.941122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.529 [2024-04-26 15:42:46.941136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:17200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.530 [2024-04-26 15:42:46.941151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.530 [2024-04-26 15:42:46.941165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:17208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.530 [2024-04-26 15:42:46.941175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.530 [2024-04-26 15:42:46.941188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:17216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.530 [2024-04-26 15:42:46.941198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.530 [2024-04-26 15:42:46.941211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:17224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.530 [2024-04-26 15:42:46.941221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.530 [2024-04-26 15:42:46.941237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:17232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.530 [2024-04-26 15:42:46.941247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.530 [2024-04-26 15:42:46.941260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:17240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.530 [2024-04-26 15:42:46.941270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.530 [2024-04-26 15:42:46.941283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:17248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.530 [2024-04-26 15:42:46.941293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.530 [2024-04-26 15:42:46.941307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:17256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.530 [2024-04-26 15:42:46.941317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.530 [2024-04-26 15:42:46.941330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:17264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.530 [2024-04-26 15:42:46.941339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.530 [2024-04-26 15:42:46.941352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:17272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.530 [2024-04-26 15:42:46.941361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.530 [2024-04-26 15:42:46.941374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:17280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.530 [2024-04-26 15:42:46.941384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.530 [2024-04-26 15:42:46.941397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:17288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.530 [2024-04-26 15:42:46.941407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.530 [2024-04-26 15:42:46.941419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:17296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.530 [2024-04-26 15:42:46.941430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.530 [2024-04-26 15:42:46.941442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:17304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.530 [2024-04-26 15:42:46.941452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.530 [2024-04-26 15:42:46.941464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:17312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.530 [2024-04-26 15:42:46.941474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.530 [2024-04-26 15:42:46.941487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:17320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.530 [2024-04-26 15:42:46.941496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.530 [2024-04-26 15:42:46.941511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:17328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.530 [2024-04-26 15:42:46.941521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.530 [2024-04-26 15:42:46.941533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:17336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.530 [2024-04-26 15:42:46.941543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.530 [2024-04-26 15:42:46.941554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:17344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.530 [2024-04-26 15:42:46.941564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.530 [2024-04-26 15:42:46.941575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:17352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.530 [2024-04-26 15:42:46.941585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.530 [2024-04-26 15:42:46.941597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:17360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.530 [2024-04-26 15:42:46.941607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.530 [2024-04-26 15:42:46.941619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:17368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.530 [2024-04-26 15:42:46.941628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.530 [2024-04-26 15:42:46.941640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:17376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.530 [2024-04-26 15:42:46.941649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.530 [2024-04-26 15:42:46.941661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:17384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.530 [2024-04-26 15:42:46.941671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.530 [2024-04-26 15:42:46.941682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:17392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.530 [2024-04-26 15:42:46.941692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.530 [2024-04-26 15:42:46.941703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:17400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:15:05.530 [2024-04-26 15:42:46.941713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.530 [2024-04-26 15:42:46.941724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:16384 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007900000 len:0x1000 key:0x1bfd00 00:15:05.530 [2024-04-26 15:42:46.941734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.530 [2024-04-26 15:42:46.941747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:16392 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007902000 len:0x1000 key:0x1bfd00 00:15:05.530 [2024-04-26 15:42:46.941757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.530 [2024-04-26 15:42:46.941768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:16400 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007904000 len:0x1000 key:0x1bfd00 00:15:05.530 [2024-04-26 15:42:46.941780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.530 [2024-04-26 15:42:46.941791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:16408 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007906000 len:0x1000 key:0x1bfd00 00:15:05.530 [2024-04-26 15:42:46.941801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32676 cdw0:68daafa0 sqhd:6530 p:0 m:0 dnr:0 00:15:05.530 [2024-04-26 15:42:46.954524] rdma_verbs.c: 83:spdk_rdma_qp_destroy: *WARNING*: Destroying qpair with queued Work Requests 00:15:05.530 [2024-04-26 15:42:46.954582] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:15:05.530 [2024-04-26 15:42:46.954595] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:15:05.530 [2024-04-26 15:42:46.954606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16416 len:8 PRP1 0x0 PRP2 0x0 00:15:05.530 [2024-04-26 15:42:46.954616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:05.530 [2024-04-26 15:42:46.954665] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:15:05.530 [2024-04-26 15:42:46.955515] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:15:05.530 [2024-04-26 15:42:46.955531] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:15:05.530 [2024-04-26 15:42:46.955539] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:15:05.530 [2024-04-26 15:42:46.955557] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:15:05.530 [2024-04-26 15:42:46.955568] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:15:05.530 [2024-04-26 15:42:46.955613] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:15:05.530 [2024-04-26 15:42:46.955624] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:15:05.530 [2024-04-26 15:42:46.955634] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:15:05.530 [2024-04-26 15:42:46.955654] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:15:05.530 [2024-04-26 15:42:46.955664] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:15:05.530 [2024-04-26 15:42:47.958378] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:15:05.530 [2024-04-26 15:42:47.958420] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:15:05.530 [2024-04-26 15:42:47.958430] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:15:05.530 [2024-04-26 15:42:47.958451] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:15:05.530 [2024-04-26 15:42:47.958462] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:15:05.530 [2024-04-26 15:42:47.958475] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:15:05.530 [2024-04-26 15:42:47.958482] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:15:05.530 [2024-04-26 15:42:47.958492] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:15:05.530 [2024-04-26 15:42:47.958522] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:15:05.530 [2024-04-26 15:42:47.958532] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:15:05.531 [2024-04-26 15:42:48.962780] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:15:05.531 [2024-04-26 15:42:48.962815] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:15:05.531 [2024-04-26 15:42:48.962825] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:15:05.531 [2024-04-26 15:42:48.962847] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:15:05.531 [2024-04-26 15:42:48.962858] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:15:05.531 [2024-04-26 15:42:48.962872] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:15:05.531 [2024-04-26 15:42:48.962881] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:15:05.531 [2024-04-26 15:42:48.962891] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:15:05.531 [2024-04-26 15:42:48.962915] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:15:05.531 [2024-04-26 15:42:48.962926] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:15:05.531 [2024-04-26 15:42:50.967898] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:15:05.531 [2024-04-26 15:42:50.967934] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:15:05.531 [2024-04-26 15:42:50.967963] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:15:05.531 [2024-04-26 15:42:50.967974] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:15:05.531 [2024-04-26 15:42:50.968006] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:15:05.531 [2024-04-26 15:42:50.968017] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:15:05.531 [2024-04-26 15:42:50.968028] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:15:05.531 [2024-04-26 15:42:50.968054] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:15:05.531 [2024-04-26 15:42:50.968064] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:15:05.531 [2024-04-26 15:42:52.973214] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:15:05.531 [2024-04-26 15:42:52.973244] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:15:05.531 [2024-04-26 15:42:52.973269] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:15:05.531 [2024-04-26 15:42:52.973279] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:15:05.531 [2024-04-26 15:42:52.973290] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:15:05.531 [2024-04-26 15:42:52.973296] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:15:05.531 [2024-04-26 15:42:52.973304] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:15:05.531 [2024-04-26 15:42:52.973324] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:15:05.531 [2024-04-26 15:42:52.973331] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:15:05.531 [2024-04-26 15:42:54.978997] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:15:05.531 [2024-04-26 15:42:54.979038] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:15:05.531 [2024-04-26 15:42:54.979063] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:15:05.531 [2024-04-26 15:42:54.979073] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:15:05.531 [2024-04-26 15:42:54.980746] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:15:05.531 [2024-04-26 15:42:54.980763] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:15:05.531 [2024-04-26 15:42:54.980771] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:15:05.531 [2024-04-26 15:42:54.980820] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:15:05.531 [2024-04-26 15:42:54.980828] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:15:05.531 [2024-04-26 15:42:56.044248] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:15:05.531 00:15:05.531 Latency(us) 00:15:05.531 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:05.531 Job: Nvme_mlx_0_0n1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:15:05.531 Verification LBA range: start 0x0 length 0x8000 00:15:05.531 Nvme_mlx_0_0n1 : 90.01 11305.60 44.16 0.00 0.00 11300.44 2059.70 11056984.26 00:15:05.531 Job: Nvme_mlx_0_1n1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:15:05.531 Verification LBA range: start 0x0 length 0x8000 00:15:05.531 Nvme_mlx_0_1n1 : 90.01 9742.00 38.05 0.00 0.00 13116.93 2371.78 11056984.26 00:15:05.531 =================================================================================================================== 00:15:05.531 Total : 21047.60 82.22 0.00 0.00 12141.23 2059.70 11056984.26 00:15:05.531 Received shutdown signal, test time was about 90.000000 seconds 00:15:05.531 00:15:05.531 Latency(us) 00:15:05.531 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:05.531 =================================================================================================================== 00:15:05.531 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:05.531 15:44:01 -- target/device_removal.sh@123 -- # trap - SIGINT SIGTERM EXIT 00:15:05.531 15:44:01 -- target/device_removal.sh@124 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/try.txt 00:15:05.531 15:44:01 -- target/device_removal.sh@202 -- # killprocess 3310525 00:15:05.531 15:44:01 -- common/autotest_common.sh@936 -- # '[' -z 3310525 ']' 00:15:05.531 15:44:01 -- common/autotest_common.sh@940 -- # kill -0 3310525 00:15:05.531 15:44:01 -- common/autotest_common.sh@941 -- # uname 00:15:05.531 15:44:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:05.531 15:44:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3310525 00:15:05.531 15:44:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:05.531 15:44:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:05.531 15:44:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3310525' 00:15:05.531 killing process with pid 3310525 00:15:05.531 15:44:01 -- common/autotest_common.sh@955 -- # kill 3310525 00:15:05.531 15:44:01 -- common/autotest_common.sh@960 -- # wait 3310525 00:15:05.531 [2024-04-26 15:44:01.462904] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:15:05.531 15:44:01 -- target/device_removal.sh@203 -- # nvmfpid= 00:15:05.531 15:44:01 -- target/device_removal.sh@205 -- # return 0 00:15:05.531 00:15:05.531 real 1m33.186s 00:15:05.531 user 4m25.646s 00:15:05.531 sys 0m4.104s 00:15:05.531 15:44:01 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:15:05.531 15:44:01 -- common/autotest_common.sh@10 -- # set +x 00:15:05.531 ************************************ 00:15:05.531 END TEST nvmf_device_removal_pci_remove_no_srq 00:15:05.531 ************************************ 00:15:05.531 15:44:01 -- target/device_removal.sh@312 -- # run_test nvmf_device_removal_pci_remove test_remove_and_rescan 00:15:05.531 15:44:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:15:05.531 15:44:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:05.531 15:44:01 -- common/autotest_common.sh@10 -- # set +x 00:15:05.531 ************************************ 00:15:05.531 START TEST nvmf_device_removal_pci_remove 00:15:05.531 ************************************ 00:15:05.531 15:44:01 -- common/autotest_common.sh@1111 -- # test_remove_and_rescan 00:15:05.531 15:44:01 -- target/device_removal.sh@128 -- # nvmfappstart -m 0x3 00:15:05.531 15:44:01 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:15:05.531 15:44:01 -- common/autotest_common.sh@710 -- # xtrace_disable 00:15:05.531 15:44:01 -- common/autotest_common.sh@10 -- # set +x 00:15:05.531 15:44:01 -- nvmf/common.sh@470 -- # nvmfpid=3326126 00:15:05.531 15:44:01 -- nvmf/common.sh@471 -- # waitforlisten 3326126 00:15:05.531 15:44:01 -- common/autotest_common.sh@817 -- # '[' -z 3326126 ']' 00:15:05.531 15:44:01 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:05.531 15:44:01 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:05.531 15:44:01 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:05.531 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:05.531 15:44:01 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:15:05.531 15:44:01 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:05.531 15:44:01 -- common/autotest_common.sh@10 -- # set +x 00:15:05.531 [2024-04-26 15:44:01.954356] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:15:05.531 [2024-04-26 15:44:01.954393] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:05.531 EAL: No free 2048 kB hugepages reported on node 1 00:15:05.531 [2024-04-26 15:44:02.007925] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:15:05.531 [2024-04-26 15:44:02.084486] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:05.531 [2024-04-26 15:44:02.084520] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:05.531 [2024-04-26 15:44:02.084526] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:05.531 [2024-04-26 15:44:02.084532] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:05.531 [2024-04-26 15:44:02.084538] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:05.531 [2024-04-26 15:44:02.084579] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:05.531 [2024-04-26 15:44:02.084581] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:05.531 15:44:02 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:05.531 15:44:02 -- common/autotest_common.sh@850 -- # return 0 00:15:05.531 15:44:02 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:15:05.531 15:44:02 -- common/autotest_common.sh@716 -- # xtrace_disable 00:15:05.531 15:44:02 -- common/autotest_common.sh@10 -- # set +x 00:15:05.532 15:44:02 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:05.532 15:44:02 -- target/device_removal.sh@130 -- # create_subsystem_and_connect 00:15:05.532 15:44:02 -- target/device_removal.sh@45 -- # local -gA netdev_nvme_dict 00:15:05.532 15:44:02 -- target/device_removal.sh@46 -- # netdev_nvme_dict=() 00:15:05.532 15:44:02 -- target/device_removal.sh@48 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:15:05.532 15:44:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:05.532 15:44:02 -- common/autotest_common.sh@10 -- # set +x 00:15:05.532 [2024-04-26 15:44:02.806713] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1e3fa60/0x1e43f50) succeed. 00:15:05.532 [2024-04-26 15:44:02.815495] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1e40f60/0x1e855e0) succeed. 00:15:05.532 15:44:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:05.532 15:44:02 -- target/device_removal.sh@49 -- # get_rdma_if_list 00:15:05.532 15:44:02 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:05.532 15:44:02 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:05.532 15:44:02 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:05.532 15:44:02 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:05.532 15:44:02 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:05.532 15:44:02 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:05.532 15:44:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:05.532 15:44:02 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:15:05.532 15:44:02 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:15:05.532 15:44:02 -- nvmf/common.sh@105 -- # continue 2 00:15:05.532 15:44:02 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:05.532 15:44:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:05.532 15:44:02 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:15:05.532 15:44:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:05.532 15:44:02 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:15:05.532 15:44:02 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:15:05.532 15:44:02 -- nvmf/common.sh@105 -- # continue 2 00:15:05.532 15:44:02 -- target/device_removal.sh@49 -- # for net_dev in $(get_rdma_if_list) 00:15:05.532 15:44:02 -- target/device_removal.sh@50 -- # create_subsystem_and_connect_on_netdev mlx_0_0 00:15:05.532 15:44:02 -- target/device_removal.sh@25 -- # local -a dev_name 00:15:05.532 15:44:02 -- target/device_removal.sh@27 -- # dev_name=mlx_0_0 00:15:05.532 15:44:02 -- target/device_removal.sh@28 -- # malloc_name=mlx_0_0 00:15:05.532 15:44:02 -- target/device_removal.sh@29 -- # get_subsystem_nqn mlx_0_0 00:15:05.532 15:44:02 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_0 00:15:05.532 15:44:02 -- target/device_removal.sh@29 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_0 00:15:05.532 15:44:02 -- target/device_removal.sh@30 -- # get_ip_address mlx_0_0 00:15:05.532 15:44:02 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:15:05.532 15:44:02 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:15:05.532 15:44:02 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:05.532 15:44:02 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:05.532 15:44:02 -- target/device_removal.sh@30 -- # ip=192.168.100.8 00:15:05.532 15:44:02 -- target/device_removal.sh@31 -- # serial=SPDK000mlx_0_0 00:15:05.532 15:44:02 -- target/device_removal.sh@33 -- # MALLOC_BDEV_SIZE=128 00:15:05.532 15:44:02 -- target/device_removal.sh@34 -- # MALLOC_BLOCK_SIZE=512 00:15:05.532 15:44:02 -- target/device_removal.sh@36 -- # rpc_cmd bdev_malloc_create 128 512 -b mlx_0_0 00:15:05.532 15:44:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:05.532 15:44:02 -- common/autotest_common.sh@10 -- # set +x 00:15:05.532 15:44:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:05.532 15:44:02 -- target/device_removal.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:system_mlx_0_0 -a -s SPDK000mlx_0_0 00:15:05.532 15:44:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:05.532 15:44:02 -- common/autotest_common.sh@10 -- # set +x 00:15:05.532 15:44:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:05.532 15:44:02 -- target/device_removal.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:system_mlx_0_0 mlx_0_0 00:15:05.532 15:44:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:05.532 15:44:02 -- common/autotest_common.sh@10 -- # set +x 00:15:05.532 15:44:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:05.532 15:44:02 -- target/device_removal.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:system_mlx_0_0 -t rdma -a 192.168.100.8 -s 4420 00:15:05.532 15:44:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:05.532 15:44:02 -- common/autotest_common.sh@10 -- # set +x 00:15:05.532 [2024-04-26 15:44:02.993993] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:15:05.532 15:44:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:05.532 15:44:02 -- target/device_removal.sh@41 -- # return 0 00:15:05.532 15:44:02 -- target/device_removal.sh@50 -- # netdev_nvme_dict[$net_dev]=mlx_0_0 00:15:05.532 15:44:02 -- target/device_removal.sh@49 -- # for net_dev in $(get_rdma_if_list) 00:15:05.532 15:44:02 -- target/device_removal.sh@50 -- # create_subsystem_and_connect_on_netdev mlx_0_1 00:15:05.532 15:44:03 -- target/device_removal.sh@25 -- # local -a dev_name 00:15:05.532 15:44:03 -- target/device_removal.sh@27 -- # dev_name=mlx_0_1 00:15:05.532 15:44:03 -- target/device_removal.sh@28 -- # malloc_name=mlx_0_1 00:15:05.532 15:44:03 -- target/device_removal.sh@29 -- # get_subsystem_nqn mlx_0_1 00:15:05.532 15:44:03 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_1 00:15:05.532 15:44:03 -- target/device_removal.sh@29 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_1 00:15:05.532 15:44:03 -- target/device_removal.sh@30 -- # get_ip_address mlx_0_1 00:15:05.532 15:44:03 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:15:05.532 15:44:03 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:15:05.532 15:44:03 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:05.532 15:44:03 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:05.532 15:44:03 -- target/device_removal.sh@30 -- # ip=192.168.100.9 00:15:05.532 15:44:03 -- target/device_removal.sh@31 -- # serial=SPDK000mlx_0_1 00:15:05.532 15:44:03 -- target/device_removal.sh@33 -- # MALLOC_BDEV_SIZE=128 00:15:05.532 15:44:03 -- target/device_removal.sh@34 -- # MALLOC_BLOCK_SIZE=512 00:15:05.532 15:44:03 -- target/device_removal.sh@36 -- # rpc_cmd bdev_malloc_create 128 512 -b mlx_0_1 00:15:05.532 15:44:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:05.532 15:44:03 -- common/autotest_common.sh@10 -- # set +x 00:15:05.532 15:44:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:05.532 15:44:03 -- target/device_removal.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:system_mlx_0_1 -a -s SPDK000mlx_0_1 00:15:05.532 15:44:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:05.532 15:44:03 -- common/autotest_common.sh@10 -- # set +x 00:15:05.532 15:44:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:05.532 15:44:03 -- target/device_removal.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:system_mlx_0_1 mlx_0_1 00:15:05.532 15:44:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:05.532 15:44:03 -- common/autotest_common.sh@10 -- # set +x 00:15:05.532 15:44:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:05.532 15:44:03 -- target/device_removal.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:system_mlx_0_1 -t rdma -a 192.168.100.9 -s 4420 00:15:05.532 15:44:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:05.532 15:44:03 -- common/autotest_common.sh@10 -- # set +x 00:15:05.532 [2024-04-26 15:44:03.072684] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:15:05.532 15:44:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:05.532 15:44:03 -- target/device_removal.sh@41 -- # return 0 00:15:05.532 15:44:03 -- target/device_removal.sh@50 -- # netdev_nvme_dict[$net_dev]=mlx_0_1 00:15:05.532 15:44:03 -- target/device_removal.sh@53 -- # return 0 00:15:05.532 15:44:03 -- target/device_removal.sh@132 -- # generate_io_traffic_with_bdevperf mlx_0_0 mlx_0_1 00:15:05.532 15:44:03 -- target/device_removal.sh@87 -- # dev_names=('mlx_0_0' 'mlx_0_1') 00:15:05.532 15:44:03 -- target/device_removal.sh@87 -- # local dev_names 00:15:05.532 15:44:03 -- target/device_removal.sh@89 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:15:05.532 15:44:03 -- target/device_removal.sh@91 -- # bdevperf_pid=3326259 00:15:05.532 15:44:03 -- target/device_removal.sh@93 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; kill -9 $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:05.532 15:44:03 -- target/device_removal.sh@94 -- # waitforlisten 3326259 /var/tmp/bdevperf.sock 00:15:05.532 15:44:03 -- common/autotest_common.sh@817 -- # '[' -z 3326259 ']' 00:15:05.532 15:44:03 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:05.532 15:44:03 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:05.532 15:44:03 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:05.532 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:05.532 15:44:03 -- target/device_removal.sh@90 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 90 00:15:05.532 15:44:03 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:05.532 15:44:03 -- common/autotest_common.sh@10 -- # set +x 00:15:05.532 15:44:03 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:05.532 15:44:03 -- common/autotest_common.sh@850 -- # return 0 00:15:05.532 15:44:03 -- target/device_removal.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_set_options -r -1 00:15:05.532 15:44:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:05.532 15:44:03 -- common/autotest_common.sh@10 -- # set +x 00:15:05.532 15:44:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:05.532 15:44:03 -- target/device_removal.sh@100 -- # for dev_name in "${dev_names[@]}" 00:15:05.532 15:44:03 -- target/device_removal.sh@101 -- # get_subsystem_nqn mlx_0_0 00:15:05.532 15:44:03 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_0 00:15:05.532 15:44:03 -- target/device_removal.sh@101 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_0 00:15:05.532 15:44:03 -- target/device_removal.sh@102 -- # get_ip_address mlx_0_0 00:15:05.532 15:44:03 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:15:05.532 15:44:03 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:15:05.532 15:44:03 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:05.532 15:44:03 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:05.532 15:44:03 -- target/device_removal.sh@102 -- # tgt_ip=192.168.100.8 00:15:05.532 15:44:03 -- target/device_removal.sh@106 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme_mlx_0_0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:system_mlx_0_0 -l -1 -o 1 00:15:05.532 15:44:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:05.532 15:44:03 -- common/autotest_common.sh@10 -- # set +x 00:15:05.532 Nvme_mlx_0_0n1 00:15:05.532 15:44:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:05.532 15:44:03 -- target/device_removal.sh@100 -- # for dev_name in "${dev_names[@]}" 00:15:05.532 15:44:03 -- target/device_removal.sh@101 -- # get_subsystem_nqn mlx_0_1 00:15:05.532 15:44:03 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_1 00:15:05.532 15:44:03 -- target/device_removal.sh@101 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_1 00:15:05.532 15:44:03 -- target/device_removal.sh@102 -- # get_ip_address mlx_0_1 00:15:05.532 15:44:03 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:15:05.532 15:44:03 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:15:05.532 15:44:03 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:05.532 15:44:03 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:05.532 15:44:03 -- target/device_removal.sh@102 -- # tgt_ip=192.168.100.9 00:15:05.532 15:44:03 -- target/device_removal.sh@106 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme_mlx_0_1 -t rdma -a 192.168.100.9 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:system_mlx_0_1 -l -1 -o 1 00:15:05.532 15:44:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:05.532 15:44:03 -- common/autotest_common.sh@10 -- # set +x 00:15:05.532 Nvme_mlx_0_1n1 00:15:05.532 15:44:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:05.532 15:44:03 -- target/device_removal.sh@110 -- # bdevperf_rpc_pid=3326466 00:15:05.532 15:44:03 -- target/device_removal.sh@112 -- # sleep 5 00:15:05.532 15:44:03 -- target/device_removal.sh@109 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 120 -s /var/tmp/bdevperf.sock perform_tests 00:15:10.789 15:44:08 -- target/device_removal.sh@134 -- # for net_dev in "${!netdev_nvme_dict[@]}" 00:15:10.789 15:44:08 -- target/device_removal.sh@135 -- # nvme_dev=mlx_0_0 00:15:10.789 15:44:08 -- target/device_removal.sh@136 -- # get_rdma_device_name mlx_0_0 00:15:10.789 15:44:08 -- target/device_removal.sh@71 -- # dev_name=mlx_0_0 00:15:10.789 15:44:08 -- target/device_removal.sh@72 -- # get_pci_dir mlx_0_0 00:15:10.789 15:44:08 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:15:10.789 15:44:08 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:da:00.0/net/mlx_0_0/device 00:15:10.789 15:44:08 -- target/device_removal.sh@72 -- # ls /sys/devices/pci0000:d7/0000:d7:02.0/0000:da:00.0/infiniband 00:15:10.789 15:44:08 -- target/device_removal.sh@136 -- # rdma_dev_name=mlx5_0 00:15:10.789 15:44:08 -- target/device_removal.sh@137 -- # get_ip_address mlx_0_0 00:15:10.789 15:44:08 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:15:10.789 15:44:08 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:15:10.789 15:44:08 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:10.789 15:44:08 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:10.789 15:44:08 -- target/device_removal.sh@137 -- # origin_ip=192.168.100.8 00:15:10.789 15:44:08 -- target/device_removal.sh@138 -- # get_pci_dir mlx_0_0 00:15:10.789 15:44:08 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:15:10.789 15:44:08 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:da:00.0/net/mlx_0_0/device 00:15:10.789 15:44:08 -- target/device_removal.sh@138 -- # pci_dir=/sys/devices/pci0000:d7/0000:d7:02.0/0000:da:00.0 00:15:10.789 15:44:08 -- target/device_removal.sh@140 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_0 00:15:10.789 15:44:08 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_0 00:15:10.789 15:44:08 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:15:10.789 15:44:08 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:15:10.789 15:44:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:10.789 15:44:08 -- common/autotest_common.sh@10 -- # set +x 00:15:10.789 15:44:08 -- target/device_removal.sh@77 -- # grep mlx5_0 00:15:10.789 15:44:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:10.789 mlx5_0 00:15:10.789 15:44:08 -- target/device_removal.sh@78 -- # return 0 00:15:10.789 15:44:08 -- target/device_removal.sh@145 -- # remove_one_nic mlx_0_0 00:15:10.789 15:44:08 -- target/device_removal.sh@66 -- # dev_name=mlx_0_0 00:15:10.789 15:44:08 -- target/device_removal.sh@67 -- # echo 1 00:15:10.789 15:44:08 -- target/device_removal.sh@67 -- # get_pci_dir mlx_0_0 00:15:10.789 15:44:08 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:15:10.789 15:44:08 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:da:00.0/net/mlx_0_0/device 00:15:10.789 [2024-04-26 15:44:08.678108] rdma.c:3563:nvmf_rdma_handle_device_removal: *NOTICE*: Port 192.168.100.8:4420 on device mlx5_0 is being removed. 00:15:10.789 [2024-04-26 15:44:08.678183] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:15:10.789 [2024-04-26 15:44:08.678235] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:15:10.789 [2024-04-26 15:44:08.678246] rdma.c: 845:nvmf_rdma_qpair_destroy: *WARNING*: Destroying qpair when queue depth is 63 00:15:16.041 15:44:14 -- target/device_removal.sh@147 -- # seq 1 10 00:15:16.041 15:44:14 -- target/device_removal.sh@147 -- # for i in $(seq 1 10) 00:15:16.041 15:44:14 -- target/device_removal.sh@148 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_0 00:15:16.041 15:44:14 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_0 00:15:16.041 15:44:14 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:15:16.041 15:44:14 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:15:16.041 15:44:14 -- target/device_removal.sh@77 -- # grep mlx5_0 00:15:16.041 15:44:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:16.041 15:44:14 -- common/autotest_common.sh@10 -- # set +x 00:15:16.041 15:44:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:16.041 15:44:14 -- target/device_removal.sh@78 -- # return 1 00:15:16.041 15:44:14 -- target/device_removal.sh@149 -- # break 00:15:16.041 15:44:14 -- target/device_removal.sh@158 -- # get_rdma_dev_count_in_nvmf_tgt 00:15:16.041 15:44:14 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:15:16.041 15:44:14 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:15:16.041 15:44:14 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:15:16.041 15:44:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:16.041 15:44:14 -- common/autotest_common.sh@10 -- # set +x 00:15:16.041 15:44:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:16.041 15:44:14 -- target/device_removal.sh@158 -- # ib_count_after_remove=1 00:15:16.041 15:44:14 -- target/device_removal.sh@160 -- # rescan_pci 00:15:16.041 15:44:14 -- target/device_removal.sh@57 -- # echo 1 00:15:16.605 [2024-04-26 15:44:15.204520] rdma.c:3252:nvmf_rdma_rescan_devices: *WARNING*: Failed to init ibv device 0x1f1d9b0, err 11. Skip rescan. 00:15:16.862 15:44:15 -- target/device_removal.sh@162 -- # seq 1 10 00:15:16.862 15:44:15 -- target/device_removal.sh@162 -- # for i in $(seq 1 10) 00:15:16.862 15:44:15 -- target/device_removal.sh@163 -- # ls /sys/devices/pci0000:d7/0000:d7:02.0/0000:da:00.0/net 00:15:16.862 15:44:15 -- target/device_removal.sh@163 -- # new_net_dev=mlx_0_0 00:15:16.862 15:44:15 -- target/device_removal.sh@164 -- # [[ -z mlx_0_0 ]] 00:15:16.862 15:44:15 -- target/device_removal.sh@166 -- # [[ mlx_0_0 != \m\l\x\_\0\_\0 ]] 00:15:16.862 15:44:15 -- target/device_removal.sh@171 -- # break 00:15:16.862 15:44:15 -- target/device_removal.sh@175 -- # [[ -z mlx_0_0 ]] 00:15:16.862 15:44:15 -- target/device_removal.sh@179 -- # ip link set mlx_0_0 up 00:15:17.119 [2024-04-26 15:44:15.571286] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1e426f0/0x1e43f50) succeed. 00:15:17.119 [2024-04-26 15:44:15.571344] rdma.c:3305:nvmf_rdma_retry_listen_port: *ERROR*: Found new IB device but port 192.168.100.8:4420 is still failed(-1) to listen. 00:15:20.397 15:44:18 -- target/device_removal.sh@180 -- # get_ip_address mlx_0_0 00:15:20.397 15:44:18 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:15:20.397 15:44:18 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:15:20.397 15:44:18 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:20.397 15:44:18 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:20.397 15:44:18 -- target/device_removal.sh@180 -- # [[ -z '' ]] 00:15:20.397 15:44:18 -- target/device_removal.sh@181 -- # ip addr add 192.168.100.8/24 dev mlx_0_0 00:15:20.397 15:44:18 -- target/device_removal.sh@186 -- # seq 1 10 00:15:20.397 15:44:18 -- target/device_removal.sh@186 -- # for i in $(seq 1 10) 00:15:20.397 15:44:18 -- target/device_removal.sh@187 -- # get_rdma_dev_count_in_nvmf_tgt 00:15:20.397 15:44:18 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:15:20.397 15:44:18 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:15:20.397 15:44:18 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:15:20.397 15:44:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:20.397 15:44:18 -- common/autotest_common.sh@10 -- # set +x 00:15:20.397 [2024-04-26 15:44:18.611733] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:15:20.397 [2024-04-26 15:44:18.611766] rdma.c:3311:nvmf_rdma_retry_listen_port: *NOTICE*: Port 192.168.100.8:4420 come back 00:15:20.397 [2024-04-26 15:44:18.611782] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:15:20.397 [2024-04-26 15:44:18.611794] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:15:20.397 15:44:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:20.397 15:44:18 -- target/device_removal.sh@187 -- # ib_count=2 00:15:20.397 15:44:18 -- target/device_removal.sh@188 -- # (( ib_count > ib_count_after_remove )) 00:15:20.397 15:44:18 -- target/device_removal.sh@189 -- # break 00:15:20.397 15:44:18 -- target/device_removal.sh@134 -- # for net_dev in "${!netdev_nvme_dict[@]}" 00:15:20.397 15:44:18 -- target/device_removal.sh@135 -- # nvme_dev=mlx_0_1 00:15:20.397 15:44:18 -- target/device_removal.sh@136 -- # get_rdma_device_name mlx_0_1 00:15:20.397 15:44:18 -- target/device_removal.sh@71 -- # dev_name=mlx_0_1 00:15:20.397 15:44:18 -- target/device_removal.sh@72 -- # get_pci_dir mlx_0_1 00:15:20.397 15:44:18 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:15:20.397 15:44:18 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:da:00.1/net/mlx_0_1/device 00:15:20.397 15:44:18 -- target/device_removal.sh@72 -- # ls /sys/devices/pci0000:d7/0000:d7:02.0/0000:da:00.1/infiniband 00:15:20.397 15:44:18 -- target/device_removal.sh@136 -- # rdma_dev_name=mlx5_1 00:15:20.397 15:44:18 -- target/device_removal.sh@137 -- # get_ip_address mlx_0_1 00:15:20.397 15:44:18 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:15:20.397 15:44:18 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:15:20.397 15:44:18 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:20.397 15:44:18 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:20.397 15:44:18 -- target/device_removal.sh@137 -- # origin_ip=192.168.100.9 00:15:20.397 15:44:18 -- target/device_removal.sh@138 -- # get_pci_dir mlx_0_1 00:15:20.397 15:44:18 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:15:20.397 15:44:18 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:da:00.1/net/mlx_0_1/device 00:15:20.397 15:44:18 -- target/device_removal.sh@138 -- # pci_dir=/sys/devices/pci0000:d7/0000:d7:02.0/0000:da:00.1 00:15:20.397 15:44:18 -- target/device_removal.sh@140 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_1 00:15:20.397 15:44:18 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_1 00:15:20.397 15:44:18 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:15:20.397 15:44:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:20.397 15:44:18 -- common/autotest_common.sh@10 -- # set +x 00:15:20.397 15:44:18 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:15:20.397 15:44:18 -- target/device_removal.sh@77 -- # grep mlx5_1 00:15:20.397 15:44:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:20.397 mlx5_1 00:15:20.397 15:44:18 -- target/device_removal.sh@78 -- # return 0 00:15:20.397 15:44:18 -- target/device_removal.sh@145 -- # remove_one_nic mlx_0_1 00:15:20.397 15:44:18 -- target/device_removal.sh@66 -- # dev_name=mlx_0_1 00:15:20.397 15:44:18 -- target/device_removal.sh@67 -- # echo 1 00:15:20.398 15:44:18 -- target/device_removal.sh@67 -- # get_pci_dir mlx_0_1 00:15:20.398 15:44:18 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:15:20.398 15:44:18 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:da:00.1/net/mlx_0_1/device 00:15:20.398 [2024-04-26 15:44:18.777032] rdma.c:3563:nvmf_rdma_handle_device_removal: *NOTICE*: Port 192.168.100.9:4420 on device mlx5_1 is being removed. 00:15:20.398 [2024-04-26 15:44:18.777092] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:15:20.398 [2024-04-26 15:44:18.781866] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:15:26.950 15:44:24 -- target/device_removal.sh@147 -- # seq 1 10 00:15:26.950 15:44:24 -- target/device_removal.sh@147 -- # for i in $(seq 1 10) 00:15:26.950 15:44:24 -- target/device_removal.sh@148 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_1 00:15:26.950 15:44:24 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_1 00:15:26.950 15:44:24 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:15:26.950 15:44:24 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:15:26.950 15:44:24 -- target/device_removal.sh@77 -- # grep mlx5_1 00:15:26.950 15:44:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:26.950 15:44:24 -- common/autotest_common.sh@10 -- # set +x 00:15:26.950 15:44:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:26.950 15:44:24 -- target/device_removal.sh@78 -- # return 1 00:15:26.950 15:44:24 -- target/device_removal.sh@149 -- # break 00:15:26.950 15:44:24 -- target/device_removal.sh@158 -- # get_rdma_dev_count_in_nvmf_tgt 00:15:26.950 15:44:24 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:15:26.950 15:44:24 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:15:26.950 15:44:24 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:15:26.950 15:44:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:26.950 15:44:24 -- common/autotest_common.sh@10 -- # set +x 00:15:26.950 15:44:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:26.950 15:44:24 -- target/device_removal.sh@158 -- # ib_count_after_remove=1 00:15:26.950 15:44:24 -- target/device_removal.sh@160 -- # rescan_pci 00:15:26.950 15:44:24 -- target/device_removal.sh@57 -- # echo 1 00:15:26.950 [2024-04-26 15:44:25.366481] rdma.c:3252:nvmf_rdma_rescan_devices: *WARNING*: Failed to init ibv device 0x1e2c0b0, err 11. Skip rescan. 00:15:26.950 15:44:25 -- target/device_removal.sh@162 -- # seq 1 10 00:15:26.950 15:44:25 -- target/device_removal.sh@162 -- # for i in $(seq 1 10) 00:15:26.950 15:44:25 -- target/device_removal.sh@163 -- # ls /sys/devices/pci0000:d7/0000:d7:02.0/0000:da:00.1/net 00:15:26.950 15:44:25 -- target/device_removal.sh@163 -- # new_net_dev=mlx_0_1 00:15:26.950 15:44:25 -- target/device_removal.sh@164 -- # [[ -z mlx_0_1 ]] 00:15:26.950 15:44:25 -- target/device_removal.sh@166 -- # [[ mlx_0_1 != \m\l\x\_\0\_\1 ]] 00:15:26.950 15:44:25 -- target/device_removal.sh@171 -- # break 00:15:26.950 15:44:25 -- target/device_removal.sh@175 -- # [[ -z mlx_0_1 ]] 00:15:26.950 15:44:25 -- target/device_removal.sh@179 -- # ip link set mlx_0_1 up 00:15:27.206 [2024-04-26 15:44:25.740232] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1e42d70/0x1e855e0) succeed. 00:15:27.206 [2024-04-26 15:44:25.740302] rdma.c:3305:nvmf_rdma_retry_listen_port: *ERROR*: Found new IB device but port 192.168.100.9:4420 is still failed(-1) to listen. 00:15:30.587 15:44:28 -- target/device_removal.sh@180 -- # get_ip_address mlx_0_1 00:15:30.587 15:44:28 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:15:30.587 15:44:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:15:30.587 15:44:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:30.587 15:44:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:30.587 15:44:28 -- target/device_removal.sh@180 -- # [[ -z '' ]] 00:15:30.587 15:44:28 -- target/device_removal.sh@181 -- # ip addr add 192.168.100.9/24 dev mlx_0_1 00:15:30.587 15:44:28 -- target/device_removal.sh@186 -- # seq 1 10 00:15:30.587 15:44:28 -- target/device_removal.sh@186 -- # for i in $(seq 1 10) 00:15:30.587 15:44:28 -- target/device_removal.sh@187 -- # get_rdma_dev_count_in_nvmf_tgt 00:15:30.587 15:44:28 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:15:30.587 15:44:28 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:15:30.587 15:44:28 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:15:30.587 15:44:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:30.587 15:44:28 -- common/autotest_common.sh@10 -- # set +x 00:15:30.587 [2024-04-26 15:44:28.821893] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:15:30.587 [2024-04-26 15:44:28.821926] rdma.c:3311:nvmf_rdma_retry_listen_port: *NOTICE*: Port 192.168.100.9:4420 come back 00:15:30.587 [2024-04-26 15:44:28.821941] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:15:30.587 [2024-04-26 15:44:28.821954] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:15:30.587 15:44:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:30.587 15:44:28 -- target/device_removal.sh@187 -- # ib_count=2 00:15:30.587 15:44:28 -- target/device_removal.sh@188 -- # (( ib_count > ib_count_after_remove )) 00:15:30.587 15:44:28 -- target/device_removal.sh@189 -- # break 00:15:30.587 15:44:28 -- target/device_removal.sh@200 -- # stop_bdevperf 00:15:30.587 15:44:28 -- target/device_removal.sh@116 -- # wait 3326466 00:16:38.277 0 00:16:38.277 15:45:33 -- target/device_removal.sh@118 -- # killprocess 3326259 00:16:38.277 15:45:33 -- common/autotest_common.sh@936 -- # '[' -z 3326259 ']' 00:16:38.277 15:45:33 -- common/autotest_common.sh@940 -- # kill -0 3326259 00:16:38.277 15:45:33 -- common/autotest_common.sh@941 -- # uname 00:16:38.277 15:45:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:38.277 15:45:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3326259 00:16:38.277 15:45:33 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:16:38.277 15:45:33 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:16:38.277 15:45:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3326259' 00:16:38.277 killing process with pid 3326259 00:16:38.277 15:45:33 -- common/autotest_common.sh@955 -- # kill 3326259 00:16:38.277 15:45:33 -- common/autotest_common.sh@960 -- # wait 3326259 00:16:38.277 15:45:34 -- target/device_removal.sh@119 -- # bdevperf_pid= 00:16:38.277 15:45:34 -- target/device_removal.sh@121 -- # cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/try.txt 00:16:38.277 [2024-04-26 15:44:03.123822] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:16:38.277 [2024-04-26 15:44:03.123864] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3326259 ] 00:16:38.277 EAL: No free 2048 kB hugepages reported on node 1 00:16:38.277 [2024-04-26 15:44:03.172287] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:38.277 [2024-04-26 15:44:03.242987] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:38.277 Running I/O for 90 seconds... 00:16:38.277 [2024-04-26 15:44:08.670302] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:16:38.277 [2024-04-26 15:44:08.670343] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:16:38.277 [2024-04-26 15:44:08.670353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32627 cdw0:16 sqhd:13b9 p:0 m:0 dnr:0 00:16:38.277 [2024-04-26 15:44:08.670360] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:16:38.277 [2024-04-26 15:44:08.670367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32627 cdw0:16 sqhd:13b9 p:0 m:0 dnr:0 00:16:38.277 [2024-04-26 15:44:08.670374] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:16:38.277 [2024-04-26 15:44:08.670380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32627 cdw0:16 sqhd:13b9 p:0 m:0 dnr:0 00:16:38.277 [2024-04-26 15:44:08.670387] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:16:38.277 [2024-04-26 15:44:08.670393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32627 cdw0:16 sqhd:13b9 p:0 m:0 dnr:0 00:16:38.277 [2024-04-26 15:44:08.672287] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:38.277 [2024-04-26 15:44:08.672300] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:16:38.277 [2024-04-26 15:44:08.672320] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:16:38.277 [2024-04-26 15:44:08.680310] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.277 [2024-04-26 15:44:08.690336] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.277 [2024-04-26 15:44:08.700361] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.277 [2024-04-26 15:44:08.710390] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.277 [2024-04-26 15:44:08.720418] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.277 [2024-04-26 15:44:08.730465] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.277 [2024-04-26 15:44:08.740538] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.277 [2024-04-26 15:44:08.750879] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.277 [2024-04-26 15:44:08.761109] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.277 [2024-04-26 15:44:08.771357] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.277 [2024-04-26 15:44:08.781656] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.277 [2024-04-26 15:44:08.791763] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.277 [2024-04-26 15:44:08.801807] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.277 [2024-04-26 15:44:08.811890] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.277 [2024-04-26 15:44:08.821971] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.277 [2024-04-26 15:44:08.832072] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.277 [2024-04-26 15:44:08.842177] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.277 [2024-04-26 15:44:08.852487] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.277 [2024-04-26 15:44:08.862770] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.277 [2024-04-26 15:44:08.873043] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.277 [2024-04-26 15:44:08.883382] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:08.893550] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:08.903635] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:08.914073] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:08.924423] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:08.935083] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:08.945107] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:08.955418] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:08.965590] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:08.975756] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:08.986061] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:08.996217] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.006444] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.016702] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.026870] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.036977] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.047050] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.057152] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.067211] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.077236] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.087293] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.097665] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.107758] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.117950] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.128231] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.138573] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.148839] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.159074] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.169276] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.179544] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.189721] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.199998] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.210269] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.220398] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.230572] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.240767] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.250984] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.261120] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.271415] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.281674] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.291888] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.302059] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.312251] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.322567] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.332601] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.342904] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.353193] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.363220] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.373424] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.383613] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.393880] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.403978] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.414239] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.424476] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.434668] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.444793] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.455011] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.465184] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.475410] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.485571] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.495847] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.506035] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.516365] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.526509] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.536580] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.546609] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.556637] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.566665] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.576775] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.586961] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.597333] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.607862] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.617887] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.627914] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.637941] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.648057] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.658083] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.668249] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.278 [2024-04-26 15:44:09.674784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:202768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.278 [2024-04-26 15:44:09.674801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.278 [2024-04-26 15:44:09.674816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:202776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.278 [2024-04-26 15:44:09.674827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.278 [2024-04-26 15:44:09.674835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:202784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.278 [2024-04-26 15:44:09.674841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.278 [2024-04-26 15:44:09.674850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:202792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.278 [2024-04-26 15:44:09.674856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.278 [2024-04-26 15:44:09.674863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:202800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.278 [2024-04-26 15:44:09.674870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.278 [2024-04-26 15:44:09.674877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:202808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.278 [2024-04-26 15:44:09.674884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.674892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:202816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.674898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.674906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:202824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.674912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.674920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:202832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.674926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.674933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:202840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.674940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.674947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:202848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.674953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.674961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:202856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.674967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.674975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:202864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.674981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.674989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:202872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.674997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.675004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:202880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.675010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.675018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:202888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.675024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.675031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:202896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.675038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.675047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:202904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.675055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.675063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:202912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.675069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.675077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:202920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.675084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.675092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:202928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.675098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.675106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:202936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.675113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.675121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:202944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.675127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.675135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:202952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.675145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.675153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:202960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.675159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.675167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:202968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.675174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.675182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:202976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.675189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.675196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:202984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.675203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.675211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:202992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.675218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.675226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:203000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.675233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.675241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:203008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.675247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.675255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:203016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.675261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.675269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:203024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.675275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.675287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:203032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.675293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.675301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:203040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.675307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.675315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:203048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.675321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.675329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:203056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.675335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.675343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:203064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.675349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.675359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:203072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.675365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.675373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:203080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.675379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.675387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:203088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.675393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.675400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:203096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.675407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.675416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:203104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.675422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.279 [2024-04-26 15:44:09.675430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:203112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.279 [2024-04-26 15:44:09.675437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:203120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:203128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:203136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:203144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:203152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:203160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:203168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:203176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:203184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:203192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:203200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:203208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:203216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:203224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:203232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:203240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:203248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:203256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:203264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:203272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:203280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:203288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:203296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:203304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:203312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:203320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:203328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:203336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:203344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:203352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:203360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:203368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:203376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:203384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:203392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:203400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:203408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:203416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.280 [2024-04-26 15:44:09.675980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:203424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.280 [2024-04-26 15:44:09.675987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.281 [2024-04-26 15:44:09.675995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:203432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.281 [2024-04-26 15:44:09.676001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.281 [2024-04-26 15:44:09.676009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:203440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.281 [2024-04-26 15:44:09.676015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.281 [2024-04-26 15:44:09.676023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:203448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.281 [2024-04-26 15:44:09.676029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.281 [2024-04-26 15:44:09.676036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:203456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.281 [2024-04-26 15:44:09.676044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.281 [2024-04-26 15:44:09.676052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:203464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.281 [2024-04-26 15:44:09.676058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.281 [2024-04-26 15:44:09.676066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:203472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.281 [2024-04-26 15:44:09.676072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.281 [2024-04-26 15:44:09.676079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:203480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.281 [2024-04-26 15:44:09.676086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.281 [2024-04-26 15:44:09.676095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:203488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.281 [2024-04-26 15:44:09.676101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.281 [2024-04-26 15:44:09.676109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:203496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.281 [2024-04-26 15:44:09.676115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.281 [2024-04-26 15:44:09.676123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:203504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.281 [2024-04-26 15:44:09.676129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.281 [2024-04-26 15:44:09.676137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:203512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.281 [2024-04-26 15:44:09.676147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.281 [2024-04-26 15:44:09.676155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:203520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.281 [2024-04-26 15:44:09.676161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.281 [2024-04-26 15:44:09.676169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:203528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.281 [2024-04-26 15:44:09.676175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.281 [2024-04-26 15:44:09.676183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:203536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.281 [2024-04-26 15:44:09.676189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.281 [2024-04-26 15:44:09.676197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:203544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.281 [2024-04-26 15:44:09.676204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.281 [2024-04-26 15:44:09.676211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:203552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.281 [2024-04-26 15:44:09.676218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.281 [2024-04-26 15:44:09.676227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:203560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.281 [2024-04-26 15:44:09.676233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.281 [2024-04-26 15:44:09.676241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:203568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.281 [2024-04-26 15:44:09.676247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.281 [2024-04-26 15:44:09.676255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:203576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.281 [2024-04-26 15:44:09.676261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.281 [2024-04-26 15:44:09.676269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:203584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.281 [2024-04-26 15:44:09.676275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.281 [2024-04-26 15:44:09.676282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:203592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.281 [2024-04-26 15:44:09.676288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.281 [2024-04-26 15:44:09.676296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:203600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.281 [2024-04-26 15:44:09.676303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.281 [2024-04-26 15:44:09.676310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:203608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.281 [2024-04-26 15:44:09.676317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.281 [2024-04-26 15:44:09.676325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:203616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.281 [2024-04-26 15:44:09.676331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.281 [2024-04-26 15:44:09.676339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:203624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.281 [2024-04-26 15:44:09.676345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.281 [2024-04-26 15:44:09.676352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:203632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.281 [2024-04-26 15:44:09.676359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.281 [2024-04-26 15:44:09.676366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:203640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.281 [2024-04-26 15:44:09.676372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.281 [2024-04-26 15:44:09.676380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:203648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.281 [2024-04-26 15:44:09.676386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.281 [2024-04-26 15:44:09.676395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:203656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.281 [2024-04-26 15:44:09.676401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.281 [2024-04-26 15:44:09.676409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:203664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.281 [2024-04-26 15:44:09.676416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.281 [2024-04-26 15:44:09.676426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:203672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.281 [2024-04-26 15:44:09.676432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.281 [2024-04-26 15:44:09.676440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:203680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.281 [2024-04-26 15:44:09.676446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.281 [2024-04-26 15:44:09.676454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:203688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.283 [2024-04-26 15:44:09.676461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.283 [2024-04-26 15:44:09.676469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:203696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.283 [2024-04-26 15:44:09.676475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.283 [2024-04-26 15:44:09.676482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:203704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.283 [2024-04-26 15:44:09.676488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.283 [2024-04-26 15:44:09.676496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:203712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.283 [2024-04-26 15:44:09.676503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.283 [2024-04-26 15:44:09.676510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:203720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.283 [2024-04-26 15:44:09.676517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.283 [2024-04-26 15:44:09.676525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:203728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.283 [2024-04-26 15:44:09.676531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.283 [2024-04-26 15:44:09.676538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:203736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.283 [2024-04-26 15:44:09.676544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.283 [2024-04-26 15:44:09.676552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:203744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.283 [2024-04-26 15:44:09.676558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.283 [2024-04-26 15:44:09.676567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:203752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.283 [2024-04-26 15:44:09.676574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.283 [2024-04-26 15:44:09.676581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:203760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.283 [2024-04-26 15:44:09.676589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.283 [2024-04-26 15:44:09.676596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:203768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.283 [2024-04-26 15:44:09.676602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.283 [2024-04-26 15:44:09.676611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:202752 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007700000 len:0x1000 key:0x1810ef 00:16:38.283 [2024-04-26 15:44:09.676618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.283 [2024-04-26 15:44:09.689321] rdma_verbs.c: 83:spdk_rdma_qp_destroy: *WARNING*: Destroying qpair with queued Work Requests 00:16:38.283 [2024-04-26 15:44:09.689382] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:16:38.283 [2024-04-26 15:44:09.689391] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:16:38.283 [2024-04-26 15:44:09.689397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:202760 len:8 PRP1 0x0 PRP2 0x0 00:16:38.283 [2024-04-26 15:44:09.689404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:38.283 [2024-04-26 15:44:09.691702] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:16:38.283 [2024-04-26 15:44:09.691973] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:16:38.283 [2024-04-26 15:44:09.691985] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:38.283 [2024-04-26 15:44:09.691991] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:16:38.283 [2024-04-26 15:44:09.692005] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:38.283 [2024-04-26 15:44:09.692013] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:16:38.283 [2024-04-26 15:44:09.692041] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:16:38.283 [2024-04-26 15:44:09.692047] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:16:38.283 [2024-04-26 15:44:09.692055] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:16:38.283 [2024-04-26 15:44:09.692072] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:38.283 [2024-04-26 15:44:09.692078] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:16:38.283 [2024-04-26 15:44:10.694740] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:16:38.283 [2024-04-26 15:44:10.694777] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:38.283 [2024-04-26 15:44:10.694785] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:16:38.283 [2024-04-26 15:44:10.694804] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:38.283 [2024-04-26 15:44:10.694817] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:16:38.283 [2024-04-26 15:44:10.694827] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:16:38.283 [2024-04-26 15:44:10.694833] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:16:38.283 [2024-04-26 15:44:10.694841] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:16:38.283 [2024-04-26 15:44:10.694860] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:38.283 [2024-04-26 15:44:10.694867] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:16:38.283 [2024-04-26 15:44:11.697689] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:16:38.283 [2024-04-26 15:44:11.697724] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:38.283 [2024-04-26 15:44:11.697731] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:16:38.283 [2024-04-26 15:44:11.697748] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:38.283 [2024-04-26 15:44:11.697756] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:16:38.283 [2024-04-26 15:44:11.697767] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:16:38.283 [2024-04-26 15:44:11.697773] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:16:38.283 [2024-04-26 15:44:11.697780] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:16:38.283 [2024-04-26 15:44:11.697799] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:38.283 [2024-04-26 15:44:11.697806] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:16:38.283 [2024-04-26 15:44:13.703285] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:38.283 [2024-04-26 15:44:13.703319] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:16:38.283 [2024-04-26 15:44:13.703343] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:38.283 [2024-04-26 15:44:13.703352] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:16:38.283 [2024-04-26 15:44:13.704331] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:16:38.283 [2024-04-26 15:44:13.704344] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:16:38.284 [2024-04-26 15:44:13.704351] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:16:38.284 [2024-04-26 15:44:13.704367] bdev_nvme.c:2872:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Reset is already in progress. Defer failover until reset completes. 00:16:38.284 [2024-04-26 15:44:13.704397] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:38.284 [2024-04-26 15:44:13.704425] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:16:38.284 [2024-04-26 15:44:14.707044] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:38.284 [2024-04-26 15:44:14.707072] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:16:38.284 [2024-04-26 15:44:14.707093] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:38.284 [2024-04-26 15:44:14.707106] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:16:38.284 [2024-04-26 15:44:14.707447] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:16:38.284 [2024-04-26 15:44:14.707456] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:16:38.284 [2024-04-26 15:44:14.707463] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:16:38.284 [2024-04-26 15:44:14.707489] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:38.284 [2024-04-26 15:44:14.707497] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:16:38.284 [2024-04-26 15:44:16.712450] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:38.284 [2024-04-26 15:44:16.712479] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:16:38.284 [2024-04-26 15:44:16.712502] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:38.284 [2024-04-26 15:44:16.712511] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:16:38.284 [2024-04-26 15:44:16.712522] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:16:38.284 [2024-04-26 15:44:16.712528] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:16:38.284 [2024-04-26 15:44:16.712535] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:16:38.284 [2024-04-26 15:44:16.712554] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:38.284 [2024-04-26 15:44:16.712561] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:16:38.284 [2024-04-26 15:44:18.718924] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:38.284 [2024-04-26 15:44:18.718950] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:16:38.284 [2024-04-26 15:44:18.718976] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:38.284 [2024-04-26 15:44:18.718984] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:16:38.284 [2024-04-26 15:44:18.719003] bdev_nvme.c:2872:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Reset is already in progress. Defer failover until reset completes. 00:16:38.284 [2024-04-26 15:44:18.720507] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:16:38.284 [2024-04-26 15:44:18.720521] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:16:38.284 [2024-04-26 15:44:18.720529] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:16:38.284 [2024-04-26 15:44:18.720568] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:38.284 [2024-04-26 15:44:18.720596] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:16:38.284 [2024-04-26 15:44:18.770869] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:16:38.284 [2024-04-26 15:44:18.770894] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:16:38.284 [2024-04-26 15:44:18.770904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32627 cdw0:16 sqhd:13b9 p:0 m:0 dnr:0 00:16:38.284 [2024-04-26 15:44:18.770913] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:16:38.284 [2024-04-26 15:44:18.770919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32627 cdw0:16 sqhd:13b9 p:0 m:0 dnr:0 00:16:38.284 [2024-04-26 15:44:18.770930] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:16:38.284 [2024-04-26 15:44:18.770937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32627 cdw0:16 sqhd:13b9 p:0 m:0 dnr:0 00:16:38.284 [2024-04-26 15:44:18.770944] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:16:38.284 [2024-04-26 15:44:18.770950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32627 cdw0:16 sqhd:13b9 p:0 m:0 dnr:0 00:16:38.284 [2024-04-26 15:44:18.776036] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:38.284 [2024-04-26 15:44:18.776048] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:16:38.284 [2024-04-26 15:44:18.776089] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:16:38.284 [2024-04-26 15:44:18.780868] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:18.790892] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:18.800920] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:18.809936] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:16:38.284 [2024-04-26 15:44:18.810945] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:18.820972] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:18.830999] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:18.841025] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:18.851051] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:18.861079] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:18.871106] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:18.881131] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:18.891156] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:18.901181] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:18.911207] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:18.921233] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:18.931261] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:18.941289] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:18.951315] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:18.961341] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:18.971367] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:18.981394] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:18.991419] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:19.001448] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:19.011476] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:19.021499] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:19.031524] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:19.041549] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:19.051577] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:19.061604] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:19.071630] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:19.081658] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:19.091685] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:19.101713] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:19.111739] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:19.121764] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:19.131791] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:19.141816] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:19.151841] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:19.161868] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:19.171894] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:19.181921] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:19.191946] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:19.201973] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:19.212000] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:19.222027] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.284 [2024-04-26 15:44:19.232055] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.242081] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.252109] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.262138] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.272162] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.282189] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.292215] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.302241] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.312269] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.322295] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.332320] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.342346] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.352373] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.362399] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.372427] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.382454] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.392479] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.402506] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.412533] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.422560] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.432586] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.442612] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.452638] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.462665] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.472689] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.482714] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.492742] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.502768] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.512796] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.522820] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.532846] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.542872] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.552899] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.562925] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.572952] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.582977] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.593002] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.603026] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.613052] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.623080] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.633108] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.643135] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.653162] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.663187] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.673212] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.683240] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.693267] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.703292] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.713320] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.723348] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.733804] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.744223] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.754249] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.764988] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.775013] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:38.285 [2024-04-26 15:44:19.778732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:15656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079b4000 len:0x1000 key:0x1bf0ef 00:16:38.285 [2024-04-26 15:44:19.778749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.285 [2024-04-26 15:44:19.778762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079b2000 len:0x1000 key:0x1bf0ef 00:16:38.285 [2024-04-26 15:44:19.778768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.285 [2024-04-26 15:44:19.778777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:15672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079b0000 len:0x1000 key:0x1bf0ef 00:16:38.285 [2024-04-26 15:44:19.778784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.285 [2024-04-26 15:44:19.778792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:15680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ae000 len:0x1000 key:0x1bf0ef 00:16:38.285 [2024-04-26 15:44:19.778802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.285 [2024-04-26 15:44:19.778810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:15688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ac000 len:0x1000 key:0x1bf0ef 00:16:38.285 [2024-04-26 15:44:19.778817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.285 [2024-04-26 15:44:19.778825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:15696 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079aa000 len:0x1000 key:0x1bf0ef 00:16:38.285 [2024-04-26 15:44:19.778833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.285 [2024-04-26 15:44:19.778842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:15704 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079a8000 len:0x1000 key:0x1bf0ef 00:16:38.285 [2024-04-26 15:44:19.778848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.285 [2024-04-26 15:44:19.778856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:15712 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079a6000 len:0x1000 key:0x1bf0ef 00:16:38.285 [2024-04-26 15:44:19.778862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.285 [2024-04-26 15:44:19.778871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:15720 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079a4000 len:0x1000 key:0x1bf0ef 00:16:38.285 [2024-04-26 15:44:19.778877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.285 [2024-04-26 15:44:19.778886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:15728 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079a2000 len:0x1000 key:0x1bf0ef 00:16:38.285 [2024-04-26 15:44:19.778892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.285 [2024-04-26 15:44:19.778900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:15736 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079a0000 len:0x1000 key:0x1bf0ef 00:16:38.285 [2024-04-26 15:44:19.778907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.285 [2024-04-26 15:44:19.778915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:15744 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000799e000 len:0x1000 key:0x1bf0ef 00:16:38.285 [2024-04-26 15:44:19.778921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.285 [2024-04-26 15:44:19.778929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:15752 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000799c000 len:0x1000 key:0x1bf0ef 00:16:38.285 [2024-04-26 15:44:19.778935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.285 [2024-04-26 15:44:19.778943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:15760 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000799a000 len:0x1000 key:0x1bf0ef 00:16:38.285 [2024-04-26 15:44:19.778950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.285 [2024-04-26 15:44:19.778958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:15768 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007998000 len:0x1000 key:0x1bf0ef 00:16:38.285 [2024-04-26 15:44:19.778964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.286 [2024-04-26 15:44:19.778974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:15776 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007996000 len:0x1000 key:0x1bf0ef 00:16:38.286 [2024-04-26 15:44:19.778980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.286 [2024-04-26 15:44:19.778989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:15784 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007994000 len:0x1000 key:0x1bf0ef 00:16:38.286 [2024-04-26 15:44:19.778994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.286 [2024-04-26 15:44:19.779003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:15792 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007992000 len:0x1000 key:0x1bf0ef 00:16:38.286 [2024-04-26 15:44:19.779010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.286 [2024-04-26 15:44:19.779019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:15800 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007990000 len:0x1000 key:0x1bf0ef 00:16:38.286 [2024-04-26 15:44:19.779025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.286 [2024-04-26 15:44:19.779034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:15808 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000798e000 len:0x1000 key:0x1bf0ef 00:16:38.286 [2024-04-26 15:44:19.779040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.286 [2024-04-26 15:44:19.779048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:15816 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000798c000 len:0x1000 key:0x1bf0ef 00:16:38.286 [2024-04-26 15:44:19.779055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.286 [2024-04-26 15:44:19.779063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:15824 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000798a000 len:0x1000 key:0x1bf0ef 00:16:38.286 [2024-04-26 15:44:19.779069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.286 [2024-04-26 15:44:19.779077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:15832 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007988000 len:0x1000 key:0x1bf0ef 00:16:38.286 [2024-04-26 15:44:19.779084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.286 [2024-04-26 15:44:19.779092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:15840 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007986000 len:0x1000 key:0x1bf0ef 00:16:38.286 [2024-04-26 15:44:19.779100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.286 [2024-04-26 15:44:19.779108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:15848 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007984000 len:0x1000 key:0x1bf0ef 00:16:38.286 [2024-04-26 15:44:19.779114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.286 [2024-04-26 15:44:19.779122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:15856 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007982000 len:0x1000 key:0x1bf0ef 00:16:38.286 [2024-04-26 15:44:19.779128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.286 [2024-04-26 15:44:19.779138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:15864 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007980000 len:0x1000 key:0x1bf0ef 00:16:38.286 [2024-04-26 15:44:19.779149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.286 [2024-04-26 15:44:19.779158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:15872 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000797e000 len:0x1000 key:0x1bf0ef 00:16:38.286 [2024-04-26 15:44:19.779164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.286 [2024-04-26 15:44:19.779172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:15880 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000797c000 len:0x1000 key:0x1bf0ef 00:16:38.286 [2024-04-26 15:44:19.779179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.286 [2024-04-26 15:44:19.779186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:15888 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000797a000 len:0x1000 key:0x1bf0ef 00:16:38.286 [2024-04-26 15:44:19.779193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.286 [2024-04-26 15:44:19.779201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:15896 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007978000 len:0x1000 key:0x1bf0ef 00:16:38.286 [2024-04-26 15:44:19.779207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.286 [2024-04-26 15:44:19.779215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:15904 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007976000 len:0x1000 key:0x1bf0ef 00:16:38.286 [2024-04-26 15:44:19.779222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.286 [2024-04-26 15:44:19.779230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:15912 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007974000 len:0x1000 key:0x1bf0ef 00:16:38.286 [2024-04-26 15:44:19.779236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.286 [2024-04-26 15:44:19.779244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:15920 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007972000 len:0x1000 key:0x1bf0ef 00:16:38.286 [2024-04-26 15:44:19.779250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.286 [2024-04-26 15:44:19.779259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:15928 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007970000 len:0x1000 key:0x1bf0ef 00:16:38.286 [2024-04-26 15:44:19.779265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.286 [2024-04-26 15:44:19.779273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:15936 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000796e000 len:0x1000 key:0x1bf0ef 00:16:38.286 [2024-04-26 15:44:19.779279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.286 [2024-04-26 15:44:19.779288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:15944 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000796c000 len:0x1000 key:0x1bf0ef 00:16:38.286 [2024-04-26 15:44:19.779294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.286 [2024-04-26 15:44:19.779302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:15952 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000796a000 len:0x1000 key:0x1bf0ef 00:16:38.286 [2024-04-26 15:44:19.779311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.286 [2024-04-26 15:44:19.779319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:15960 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007968000 len:0x1000 key:0x1bf0ef 00:16:38.286 [2024-04-26 15:44:19.779325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.286 [2024-04-26 15:44:19.779333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:15968 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007966000 len:0x1000 key:0x1bf0ef 00:16:38.286 [2024-04-26 15:44:19.779339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.286 [2024-04-26 15:44:19.779347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:15976 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007964000 len:0x1000 key:0x1bf0ef 00:16:38.286 [2024-04-26 15:44:19.779354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.286 [2024-04-26 15:44:19.779362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:15984 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007962000 len:0x1000 key:0x1bf0ef 00:16:38.286 [2024-04-26 15:44:19.779368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.286 [2024-04-26 15:44:19.779376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:15992 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007960000 len:0x1000 key:0x1bf0ef 00:16:38.286 [2024-04-26 15:44:19.779382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.286 [2024-04-26 15:44:19.779391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:16000 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000795e000 len:0x1000 key:0x1bf0ef 00:16:38.286 [2024-04-26 15:44:19.779397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.286 [2024-04-26 15:44:19.779404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:16008 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000795c000 len:0x1000 key:0x1bf0ef 00:16:38.286 [2024-04-26 15:44:19.779411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.286 [2024-04-26 15:44:19.779419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:16016 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000795a000 len:0x1000 key:0x1bf0ef 00:16:38.286 [2024-04-26 15:44:19.779426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.286 [2024-04-26 15:44:19.779434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:16024 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007958000 len:0x1000 key:0x1bf0ef 00:16:38.286 [2024-04-26 15:44:19.779440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.286 [2024-04-26 15:44:19.779448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:16032 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007956000 len:0x1000 key:0x1bf0ef 00:16:38.286 [2024-04-26 15:44:19.779454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.286 [2024-04-26 15:44:19.779463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:16040 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007954000 len:0x1000 key:0x1bf0ef 00:16:38.286 [2024-04-26 15:44:19.779470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.286 [2024-04-26 15:44:19.779479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:16048 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007952000 len:0x1000 key:0x1bf0ef 00:16:38.286 [2024-04-26 15:44:19.779485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.286 [2024-04-26 15:44:19.779493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:16056 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007950000 len:0x1000 key:0x1bf0ef 00:16:38.286 [2024-04-26 15:44:19.779499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.287 [2024-04-26 15:44:19.779507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:16064 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000794e000 len:0x1000 key:0x1bf0ef 00:16:38.287 [2024-04-26 15:44:19.779513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.287 [2024-04-26 15:44:19.779521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:16072 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000794c000 len:0x1000 key:0x1bf0ef 00:16:38.287 [2024-04-26 15:44:19.779528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.287 [2024-04-26 15:44:19.779536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:16080 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000794a000 len:0x1000 key:0x1bf0ef 00:16:38.287 [2024-04-26 15:44:19.779542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.287 [2024-04-26 15:44:19.779550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:16088 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007948000 len:0x1000 key:0x1bf0ef 00:16:38.287 [2024-04-26 15:44:19.779556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.287 [2024-04-26 15:44:19.779564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16096 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007946000 len:0x1000 key:0x1bf0ef 00:16:38.287 [2024-04-26 15:44:19.779570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.287 [2024-04-26 15:44:19.779578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:16104 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007944000 len:0x1000 key:0x1bf0ef 00:16:38.287 [2024-04-26 15:44:19.779585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.287 [2024-04-26 15:44:19.779594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:16112 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007942000 len:0x1000 key:0x1bf0ef 00:16:38.287 [2024-04-26 15:44:19.779600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.287 [2024-04-26 15:44:19.779608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:16120 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007940000 len:0x1000 key:0x1bf0ef 00:16:38.287 [2024-04-26 15:44:19.779614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.287 [2024-04-26 15:44:19.779622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:16128 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000793e000 len:0x1000 key:0x1bf0ef 00:16:38.287 [2024-04-26 15:44:19.779630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.287 [2024-04-26 15:44:19.779638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:16136 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000793c000 len:0x1000 key:0x1bf0ef 00:16:38.287 [2024-04-26 15:44:19.779645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.287 [2024-04-26 15:44:19.779653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:16144 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000793a000 len:0x1000 key:0x1bf0ef 00:16:38.287 [2024-04-26 15:44:19.779660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.287 [2024-04-26 15:44:19.779668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:16152 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007938000 len:0x1000 key:0x1bf0ef 00:16:38.287 [2024-04-26 15:44:19.779674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.287 [2024-04-26 15:44:19.779682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:16160 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007936000 len:0x1000 key:0x1bf0ef 00:16:38.287 [2024-04-26 15:44:19.779689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.287 [2024-04-26 15:44:19.779696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:16168 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007934000 len:0x1000 key:0x1bf0ef 00:16:38.287 [2024-04-26 15:44:19.779702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.287 [2024-04-26 15:44:19.779710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:16176 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007932000 len:0x1000 key:0x1bf0ef 00:16:38.287 [2024-04-26 15:44:19.779716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.287 [2024-04-26 15:44:19.779724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:16184 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007930000 len:0x1000 key:0x1bf0ef 00:16:38.287 [2024-04-26 15:44:19.779730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.287 [2024-04-26 15:44:19.779739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:16192 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000792e000 len:0x1000 key:0x1bf0ef 00:16:38.287 [2024-04-26 15:44:19.779745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.287 [2024-04-26 15:44:19.779755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:16200 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000792c000 len:0x1000 key:0x1bf0ef 00:16:38.287 [2024-04-26 15:44:19.779761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.287 [2024-04-26 15:44:19.779769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:16208 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000792a000 len:0x1000 key:0x1bf0ef 00:16:38.287 [2024-04-26 15:44:19.779776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.287 [2024-04-26 15:44:19.779784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:16216 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007928000 len:0x1000 key:0x1bf0ef 00:16:38.287 [2024-04-26 15:44:19.779791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.287 [2024-04-26 15:44:19.779800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16224 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007926000 len:0x1000 key:0x1bf0ef 00:16:38.287 [2024-04-26 15:44:19.779807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.287 [2024-04-26 15:44:19.779815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:16232 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007924000 len:0x1000 key:0x1bf0ef 00:16:38.287 [2024-04-26 15:44:19.779821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.287 [2024-04-26 15:44:19.779829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:16240 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007922000 len:0x1000 key:0x1bf0ef 00:16:38.287 [2024-04-26 15:44:19.779835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.287 [2024-04-26 15:44:19.779843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:16248 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007920000 len:0x1000 key:0x1bf0ef 00:16:38.287 [2024-04-26 15:44:19.779849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.287 [2024-04-26 15:44:19.779857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:16256 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000791e000 len:0x1000 key:0x1bf0ef 00:16:38.287 [2024-04-26 15:44:19.779863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.287 [2024-04-26 15:44:19.779871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:16264 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000791c000 len:0x1000 key:0x1bf0ef 00:16:38.287 [2024-04-26 15:44:19.779877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.287 [2024-04-26 15:44:19.779885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:16272 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000791a000 len:0x1000 key:0x1bf0ef 00:16:38.287 [2024-04-26 15:44:19.779892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.287 [2024-04-26 15:44:19.779899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:16280 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007918000 len:0x1000 key:0x1bf0ef 00:16:38.287 [2024-04-26 15:44:19.779905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.287 [2024-04-26 15:44:19.779913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:16288 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007916000 len:0x1000 key:0x1bf0ef 00:16:38.287 [2024-04-26 15:44:19.779919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.287 [2024-04-26 15:44:19.779927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:16296 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007914000 len:0x1000 key:0x1bf0ef 00:16:38.287 [2024-04-26 15:44:19.779933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.287 [2024-04-26 15:44:19.779941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:16304 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007912000 len:0x1000 key:0x1bf0ef 00:16:38.288 [2024-04-26 15:44:19.779948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.288 [2024-04-26 15:44:19.779959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:16312 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007910000 len:0x1000 key:0x1bf0ef 00:16:38.288 [2024-04-26 15:44:19.779965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.288 [2024-04-26 15:44:19.779973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:16320 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000790e000 len:0x1000 key:0x1bf0ef 00:16:38.288 [2024-04-26 15:44:19.779979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.288 [2024-04-26 15:44:19.779987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:16328 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000790c000 len:0x1000 key:0x1bf0ef 00:16:38.288 [2024-04-26 15:44:19.779993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.288 [2024-04-26 15:44:19.780001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:16336 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000790a000 len:0x1000 key:0x1bf0ef 00:16:38.288 [2024-04-26 15:44:19.780008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.288 [2024-04-26 15:44:19.780015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:16344 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007908000 len:0x1000 key:0x1bf0ef 00:16:38.288 [2024-04-26 15:44:19.780021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.288 [2024-04-26 15:44:19.780029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:16352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007906000 len:0x1000 key:0x1bf0ef 00:16:38.288 [2024-04-26 15:44:19.780035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.288 [2024-04-26 15:44:19.780043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:16360 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007904000 len:0x1000 key:0x1bf0ef 00:16:38.288 [2024-04-26 15:44:19.780050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.288 [2024-04-26 15:44:19.780057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:16368 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007902000 len:0x1000 key:0x1bf0ef 00:16:38.288 [2024-04-26 15:44:19.780064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.288 [2024-04-26 15:44:19.780071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:16376 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007900000 len:0x1000 key:0x1bf0ef 00:16:38.288 [2024-04-26 15:44:19.780077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.288 [2024-04-26 15:44:19.780085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:16384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.288 [2024-04-26 15:44:19.780091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.288 [2024-04-26 15:44:19.780099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:16392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.288 [2024-04-26 15:44:19.780105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.288 [2024-04-26 15:44:19.780113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:16400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.288 [2024-04-26 15:44:19.780121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.288 [2024-04-26 15:44:19.780129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:16408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.288 [2024-04-26 15:44:19.780135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.288 [2024-04-26 15:44:19.780147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:16416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.288 [2024-04-26 15:44:19.780153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.288 [2024-04-26 15:44:19.780161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:16424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.288 [2024-04-26 15:44:19.780168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.288 [2024-04-26 15:44:19.780175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:16432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.288 [2024-04-26 15:44:19.780181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.288 [2024-04-26 15:44:19.780189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:16440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.288 [2024-04-26 15:44:19.780195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.288 [2024-04-26 15:44:19.780203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:16448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.288 [2024-04-26 15:44:19.780209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.288 [2024-04-26 15:44:19.780217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:16456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.288 [2024-04-26 15:44:19.780223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.288 [2024-04-26 15:44:19.780231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:16464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.288 [2024-04-26 15:44:19.780237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.288 [2024-04-26 15:44:19.780245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:16472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.288 [2024-04-26 15:44:19.780251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.288 [2024-04-26 15:44:19.780258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:16480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.288 [2024-04-26 15:44:19.780265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.288 [2024-04-26 15:44:19.780272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:16488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.288 [2024-04-26 15:44:19.780280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.288 [2024-04-26 15:44:19.780288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:16496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.288 [2024-04-26 15:44:19.780294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.288 [2024-04-26 15:44:19.780303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:16504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.288 [2024-04-26 15:44:19.780310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.288 [2024-04-26 15:44:19.780318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:16512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.288 [2024-04-26 15:44:19.780325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.288 [2024-04-26 15:44:19.780332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:16520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.288 [2024-04-26 15:44:19.780339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.288 [2024-04-26 15:44:19.780346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:16528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.288 [2024-04-26 15:44:19.780353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.288 [2024-04-26 15:44:19.780360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:16536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:38.288 [2024-04-26 15:44:19.780366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32627 cdw0:da5ec310 sqhd:e530 p:0 m:0 dnr:0 00:16:38.288 [2024-04-26 15:44:19.793046] rdma_verbs.c: 83:spdk_rdma_qp_destroy: *WARNING*: Destroying qpair with queued Work Requests 00:16:38.288 [2024-04-26 15:44:19.793104] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:16:38.288 [2024-04-26 15:44:19.793113] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:16:38.288 [2024-04-26 15:44:19.793119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16544 len:8 PRP1 0x0 PRP2 0x0 00:16:38.288 [2024-04-26 15:44:19.793126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:38.288 [2024-04-26 15:44:19.793328] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:16:38.288 [2024-04-26 15:44:19.795473] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:16:38.288 [2024-04-26 15:44:19.795489] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:38.288 [2024-04-26 15:44:19.795495] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:16:38.288 [2024-04-26 15:44:19.795509] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:38.288 [2024-04-26 15:44:19.795516] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:16:38.288 [2024-04-26 15:44:19.795547] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:16:38.288 [2024-04-26 15:44:19.795553] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:16:38.288 [2024-04-26 15:44:19.795560] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:16:38.288 [2024-04-26 15:44:19.795576] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:38.288 [2024-04-26 15:44:19.795583] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:16:38.288 [2024-04-26 15:44:20.798346] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:16:38.288 [2024-04-26 15:44:20.798390] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:38.288 [2024-04-26 15:44:20.798398] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:16:38.288 [2024-04-26 15:44:20.798415] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:38.288 [2024-04-26 15:44:20.798424] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:16:38.289 [2024-04-26 15:44:20.798447] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:16:38.289 [2024-04-26 15:44:20.798454] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:16:38.289 [2024-04-26 15:44:20.798462] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:16:38.289 [2024-04-26 15:44:20.798482] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:38.289 [2024-04-26 15:44:20.798490] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:16:38.289 [2024-04-26 15:44:21.802385] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:16:38.289 [2024-04-26 15:44:21.802421] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:38.289 [2024-04-26 15:44:21.802428] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:16:38.289 [2024-04-26 15:44:21.802463] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:38.289 [2024-04-26 15:44:21.802471] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:16:38.289 [2024-04-26 15:44:21.802489] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:16:38.289 [2024-04-26 15:44:21.802496] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:16:38.289 [2024-04-26 15:44:21.802504] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:16:38.289 [2024-04-26 15:44:21.802524] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:38.289 [2024-04-26 15:44:21.802531] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:16:38.289 [2024-04-26 15:44:23.807504] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:38.289 [2024-04-26 15:44:23.807540] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:16:38.289 [2024-04-26 15:44:23.807579] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:38.289 [2024-04-26 15:44:23.807587] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:16:38.289 [2024-04-26 15:44:23.807599] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:16:38.289 [2024-04-26 15:44:23.807605] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:16:38.289 [2024-04-26 15:44:23.807613] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:16:38.289 [2024-04-26 15:44:23.807632] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:38.289 [2024-04-26 15:44:23.807639] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:16:38.289 [2024-04-26 15:44:25.813756] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:38.289 [2024-04-26 15:44:25.813795] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:16:38.289 [2024-04-26 15:44:25.813820] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:38.289 [2024-04-26 15:44:25.813829] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:16:38.289 [2024-04-26 15:44:25.813853] bdev_nvme.c:2872:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Reset is already in progress. Defer failover until reset completes. 00:16:38.289 [2024-04-26 15:44:25.813890] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:16:38.289 [2024-04-26 15:44:25.813898] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:16:38.289 [2024-04-26 15:44:25.813906] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:16:38.289 [2024-04-26 15:44:25.813937] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:38.289 [2024-04-26 15:44:25.813969] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:16:38.289 [2024-04-26 15:44:26.816604] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:38.289 [2024-04-26 15:44:26.816642] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:16:38.289 [2024-04-26 15:44:26.816665] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:38.289 [2024-04-26 15:44:26.816673] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:16:38.289 [2024-04-26 15:44:26.816686] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:16:38.289 [2024-04-26 15:44:26.816693] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:16:38.289 [2024-04-26 15:44:26.816701] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:16:38.289 [2024-04-26 15:44:26.816727] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:38.289 [2024-04-26 15:44:26.816735] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:16:38.289 [2024-04-26 15:44:28.821871] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:38.289 [2024-04-26 15:44:28.821899] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:16:38.289 [2024-04-26 15:44:28.821923] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:38.289 [2024-04-26 15:44:28.821933] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:16:38.289 [2024-04-26 15:44:28.822312] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:16:38.289 [2024-04-26 15:44:28.822321] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:16:38.289 [2024-04-26 15:44:28.822329] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:16:38.289 [2024-04-26 15:44:28.822368] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:38.289 [2024-04-26 15:44:28.822377] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:16:38.289 [2024-04-26 15:44:29.877582] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:16:38.289 00:16:38.289 Latency(us) 00:16:38.289 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:38.289 Job: Nvme_mlx_0_0n1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:16:38.289 Verification LBA range: start 0x0 length 0x8000 00:16:38.289 Nvme_mlx_0_0n1 : 90.01 11172.15 43.64 0.00 0.00 11436.44 2059.70 11056984.26 00:16:38.289 Job: Nvme_mlx_0_1n1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:16:38.289 Verification LBA range: start 0x0 length 0x8000 00:16:38.289 Nvme_mlx_0_1n1 : 90.01 9588.08 37.45 0.00 0.00 13331.28 819.20 12079595.52 00:16:38.289 =================================================================================================================== 00:16:38.289 Total : 20760.22 81.09 0.00 0.00 12311.57 819.20 12079595.52 00:16:38.289 Received shutdown signal, test time was about 90.000000 seconds 00:16:38.289 00:16:38.289 Latency(us) 00:16:38.289 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:38.289 =================================================================================================================== 00:16:38.289 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:38.289 15:45:34 -- target/device_removal.sh@123 -- # trap - SIGINT SIGTERM EXIT 00:16:38.289 15:45:34 -- target/device_removal.sh@124 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/try.txt 00:16:38.289 15:45:34 -- target/device_removal.sh@202 -- # killprocess 3326126 00:16:38.289 15:45:34 -- common/autotest_common.sh@936 -- # '[' -z 3326126 ']' 00:16:38.289 15:45:34 -- common/autotest_common.sh@940 -- # kill -0 3326126 00:16:38.289 15:45:34 -- common/autotest_common.sh@941 -- # uname 00:16:38.289 15:45:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:38.289 15:45:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3326126 00:16:38.289 15:45:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:38.289 15:45:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:38.289 15:45:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3326126' 00:16:38.289 killing process with pid 3326126 00:16:38.289 15:45:34 -- common/autotest_common.sh@955 -- # kill 3326126 00:16:38.289 15:45:34 -- common/autotest_common.sh@960 -- # wait 3326126 00:16:38.289 [2024-04-26 15:45:34.255520] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:16:38.289 15:45:34 -- target/device_removal.sh@203 -- # nvmfpid= 00:16:38.289 15:45:34 -- target/device_removal.sh@205 -- # return 0 00:16:38.289 00:16:38.289 real 1m32.633s 00:16:38.289 user 4m23.733s 00:16:38.289 sys 0m4.158s 00:16:38.289 15:45:34 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:16:38.289 15:45:34 -- common/autotest_common.sh@10 -- # set +x 00:16:38.289 ************************************ 00:16:38.289 END TEST nvmf_device_removal_pci_remove 00:16:38.289 ************************************ 00:16:38.289 15:45:34 -- target/device_removal.sh@317 -- # nvmftestfini 00:16:38.289 15:45:34 -- nvmf/common.sh@477 -- # nvmfcleanup 00:16:38.289 15:45:34 -- nvmf/common.sh@117 -- # sync 00:16:38.289 15:45:34 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:16:38.289 15:45:34 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:16:38.289 15:45:34 -- nvmf/common.sh@120 -- # set +e 00:16:38.289 15:45:34 -- nvmf/common.sh@121 -- # for i in {1..20} 00:16:38.289 15:45:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:16:38.289 rmmod nvme_rdma 00:16:38.289 rmmod nvme_fabrics 00:16:38.289 15:45:34 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:16:38.289 15:45:34 -- nvmf/common.sh@124 -- # set -e 00:16:38.289 15:45:34 -- nvmf/common.sh@125 -- # return 0 00:16:38.289 15:45:34 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:16:38.289 15:45:34 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:16:38.289 15:45:34 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:16:38.289 15:45:34 -- target/device_removal.sh@318 -- # clean_bond_device 00:16:38.289 15:45:34 -- target/device_removal.sh@240 -- # ip link 00:16:38.289 15:45:34 -- target/device_removal.sh@240 -- # grep bond_nvmf 00:16:38.289 00:16:38.289 real 3m11.847s 00:16:38.289 user 8m51.232s 00:16:38.289 sys 0m12.550s 00:16:38.289 15:45:34 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:16:38.289 15:45:34 -- common/autotest_common.sh@10 -- # set +x 00:16:38.289 ************************************ 00:16:38.289 END TEST nvmf_device_removal 00:16:38.290 ************************************ 00:16:38.290 15:45:34 -- nvmf/nvmf.sh@79 -- # run_test nvmf_srq_overwhelm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/srq_overwhelm.sh --transport=rdma 00:16:38.290 15:45:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:38.290 15:45:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:38.290 15:45:34 -- common/autotest_common.sh@10 -- # set +x 00:16:38.290 ************************************ 00:16:38.290 START TEST nvmf_srq_overwhelm 00:16:38.290 ************************************ 00:16:38.290 15:45:34 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/srq_overwhelm.sh --transport=rdma 00:16:38.290 * Looking for test storage... 00:16:38.290 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:16:38.290 15:45:34 -- target/srq_overwhelm.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:16:38.290 15:45:34 -- nvmf/common.sh@7 -- # uname -s 00:16:38.290 15:45:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:38.290 15:45:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:38.290 15:45:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:38.290 15:45:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:38.290 15:45:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:38.290 15:45:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:38.290 15:45:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:38.290 15:45:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:38.290 15:45:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:38.290 15:45:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:38.290 15:45:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:16:38.290 15:45:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:16:38.290 15:45:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:38.290 15:45:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:38.290 15:45:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:38.290 15:45:34 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:16:38.290 15:45:34 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:16:38.290 15:45:34 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:38.290 15:45:34 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:38.290 15:45:34 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:38.290 15:45:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:38.290 15:45:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:38.290 15:45:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:38.290 15:45:34 -- paths/export.sh@5 -- # export PATH 00:16:38.290 15:45:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:38.290 15:45:34 -- nvmf/common.sh@47 -- # : 0 00:16:38.290 15:45:34 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:16:38.290 15:45:34 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:16:38.290 15:45:34 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:16:38.290 15:45:34 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:38.290 15:45:34 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:38.290 15:45:34 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:16:38.290 15:45:34 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:16:38.290 15:45:34 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:16:38.290 15:45:34 -- target/srq_overwhelm.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:38.290 15:45:34 -- target/srq_overwhelm.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:38.290 15:45:34 -- target/srq_overwhelm.sh@13 -- # NVME_CONNECT='nvme connect -i 16' 00:16:38.290 15:45:34 -- target/srq_overwhelm.sh@15 -- # nvmftestinit 00:16:38.290 15:45:34 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:16:38.290 15:45:34 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:38.290 15:45:34 -- nvmf/common.sh@437 -- # prepare_net_devs 00:16:38.290 15:45:34 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:16:38.290 15:45:34 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:16:38.290 15:45:34 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:38.290 15:45:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:38.290 15:45:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:38.290 15:45:34 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:16:38.290 15:45:34 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:16:38.290 15:45:34 -- nvmf/common.sh@285 -- # xtrace_disable 00:16:38.290 15:45:34 -- common/autotest_common.sh@10 -- # set +x 00:16:41.573 15:45:40 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:41.573 15:45:40 -- nvmf/common.sh@291 -- # pci_devs=() 00:16:41.573 15:45:40 -- nvmf/common.sh@291 -- # local -a pci_devs 00:16:41.573 15:45:40 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:16:41.573 15:45:40 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:16:41.573 15:45:40 -- nvmf/common.sh@293 -- # pci_drivers=() 00:16:41.573 15:45:40 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:16:41.573 15:45:40 -- nvmf/common.sh@295 -- # net_devs=() 00:16:41.573 15:45:40 -- nvmf/common.sh@295 -- # local -ga net_devs 00:16:41.573 15:45:40 -- nvmf/common.sh@296 -- # e810=() 00:16:41.573 15:45:40 -- nvmf/common.sh@296 -- # local -ga e810 00:16:41.573 15:45:40 -- nvmf/common.sh@297 -- # x722=() 00:16:41.573 15:45:40 -- nvmf/common.sh@297 -- # local -ga x722 00:16:41.573 15:45:40 -- nvmf/common.sh@298 -- # mlx=() 00:16:41.573 15:45:40 -- nvmf/common.sh@298 -- # local -ga mlx 00:16:41.573 15:45:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:41.573 15:45:40 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:41.573 15:45:40 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:41.573 15:45:40 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:41.573 15:45:40 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:41.573 15:45:40 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:41.573 15:45:40 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:41.573 15:45:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:41.573 15:45:40 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:41.573 15:45:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:41.573 15:45:40 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:41.573 15:45:40 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:16:41.573 15:45:40 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:16:41.573 15:45:40 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:16:41.573 15:45:40 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:16:41.573 15:45:40 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:16:41.573 15:45:40 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:16:41.573 15:45:40 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:16:41.573 15:45:40 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:41.573 15:45:40 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:16:41.573 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:16:41.573 15:45:40 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:16:41.573 15:45:40 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:16:41.573 15:45:40 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:16:41.573 15:45:40 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:16:41.574 15:45:40 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:41.574 15:45:40 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:41.574 15:45:40 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:41.574 15:45:40 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:16:41.574 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:16:41.574 15:45:40 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:16:41.574 15:45:40 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:16:41.574 15:45:40 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:16:41.574 15:45:40 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:16:41.574 15:45:40 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:41.574 15:45:40 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:41.574 15:45:40 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:16:41.574 15:45:40 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:16:41.574 15:45:40 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:41.574 15:45:40 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:41.574 15:45:40 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:41.574 15:45:40 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:41.574 15:45:40 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:16:41.574 Found net devices under 0000:da:00.0: mlx_0_0 00:16:41.574 15:45:40 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:41.574 15:45:40 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:41.574 15:45:40 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:41.574 15:45:40 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:41.574 15:45:40 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:41.574 15:45:40 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:16:41.574 Found net devices under 0000:da:00.1: mlx_0_1 00:16:41.574 15:45:40 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:41.574 15:45:40 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:16:41.574 15:45:40 -- nvmf/common.sh@403 -- # is_hw=yes 00:16:41.574 15:45:40 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:16:41.574 15:45:40 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:16:41.574 15:45:40 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:16:41.574 15:45:40 -- nvmf/common.sh@409 -- # rdma_device_init 00:16:41.574 15:45:40 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:16:41.574 15:45:40 -- nvmf/common.sh@58 -- # uname 00:16:41.574 15:45:40 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:16:41.574 15:45:40 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:16:41.574 15:45:40 -- nvmf/common.sh@63 -- # modprobe ib_core 00:16:41.574 15:45:40 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:16:41.574 15:45:40 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:16:41.574 15:45:40 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:16:41.574 15:45:40 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:16:41.574 15:45:40 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:16:41.574 15:45:40 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:16:41.574 15:45:40 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:16:41.574 15:45:40 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:16:41.574 15:45:40 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:41.574 15:45:40 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:41.574 15:45:40 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:41.574 15:45:40 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:41.574 15:45:40 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:41.574 15:45:40 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:41.574 15:45:40 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:41.574 15:45:40 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:16:41.574 15:45:40 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:16:41.574 15:45:40 -- nvmf/common.sh@105 -- # continue 2 00:16:41.574 15:45:40 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:41.574 15:45:40 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:41.574 15:45:40 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:16:41.574 15:45:40 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:41.574 15:45:40 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:16:41.574 15:45:40 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:16:41.574 15:45:40 -- nvmf/common.sh@105 -- # continue 2 00:16:41.574 15:45:40 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:41.574 15:45:40 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:16:41.574 15:45:40 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:41.574 15:45:40 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:41.574 15:45:40 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:41.574 15:45:40 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:41.574 15:45:40 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:16:41.574 15:45:40 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:16:41.574 15:45:40 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:16:41.574 122: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:16:41.574 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:16:41.574 altname enp218s0f0np0 00:16:41.574 altname ens818f0np0 00:16:41.574 inet 192.168.100.8/24 scope global mlx_0_0 00:16:41.574 valid_lft forever preferred_lft forever 00:16:41.574 15:45:40 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:41.574 15:45:40 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:16:41.574 15:45:40 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:41.574 15:45:40 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:41.574 15:45:40 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:41.574 15:45:40 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:41.574 15:45:40 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:16:41.574 15:45:40 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:16:41.574 15:45:40 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:16:41.574 123: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:16:41.574 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:16:41.574 altname enp218s0f1np1 00:16:41.574 altname ens818f1np1 00:16:41.574 inet 192.168.100.9/24 scope global mlx_0_1 00:16:41.574 valid_lft forever preferred_lft forever 00:16:41.574 15:45:40 -- nvmf/common.sh@411 -- # return 0 00:16:41.574 15:45:40 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:16:41.574 15:45:40 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:16:41.574 15:45:40 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:16:41.574 15:45:40 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:16:41.574 15:45:40 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:16:41.574 15:45:40 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:41.574 15:45:40 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:41.574 15:45:40 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:41.574 15:45:40 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:41.574 15:45:40 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:41.574 15:45:40 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:41.574 15:45:40 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:41.574 15:45:40 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:16:41.574 15:45:40 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:16:41.574 15:45:40 -- nvmf/common.sh@105 -- # continue 2 00:16:41.574 15:45:40 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:41.574 15:45:40 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:41.574 15:45:40 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:16:41.574 15:45:40 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:41.574 15:45:40 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:16:41.574 15:45:40 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:16:41.574 15:45:40 -- nvmf/common.sh@105 -- # continue 2 00:16:41.574 15:45:40 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:41.574 15:45:40 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:16:41.574 15:45:40 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:41.574 15:45:40 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:41.574 15:45:40 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:41.574 15:45:40 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:41.574 15:45:40 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:41.574 15:45:40 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:16:41.574 15:45:40 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:41.574 15:45:40 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:41.832 15:45:40 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:41.832 15:45:40 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:41.832 15:45:40 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:16:41.832 192.168.100.9' 00:16:41.832 15:45:40 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:16:41.832 192.168.100.9' 00:16:41.832 15:45:40 -- nvmf/common.sh@446 -- # head -n 1 00:16:41.832 15:45:40 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:16:41.832 15:45:40 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:16:41.832 192.168.100.9' 00:16:41.832 15:45:40 -- nvmf/common.sh@447 -- # tail -n +2 00:16:41.832 15:45:40 -- nvmf/common.sh@447 -- # head -n 1 00:16:41.832 15:45:40 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:16:41.832 15:45:40 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:16:41.832 15:45:40 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:16:41.832 15:45:40 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:16:41.832 15:45:40 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:16:41.832 15:45:40 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:16:41.832 15:45:40 -- target/srq_overwhelm.sh@17 -- # nvmfappstart -m 0xF 00:16:41.832 15:45:40 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:16:41.832 15:45:40 -- common/autotest_common.sh@710 -- # xtrace_disable 00:16:41.832 15:45:40 -- common/autotest_common.sh@10 -- # set +x 00:16:41.832 15:45:40 -- nvmf/common.sh@470 -- # nvmfpid=3345050 00:16:41.832 15:45:40 -- nvmf/common.sh@471 -- # waitforlisten 3345050 00:16:41.832 15:45:40 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:41.832 15:45:40 -- common/autotest_common.sh@817 -- # '[' -z 3345050 ']' 00:16:41.832 15:45:40 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:41.832 15:45:40 -- common/autotest_common.sh@822 -- # local max_retries=100 00:16:41.832 15:45:40 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:41.832 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:41.832 15:45:40 -- common/autotest_common.sh@826 -- # xtrace_disable 00:16:41.832 15:45:40 -- common/autotest_common.sh@10 -- # set +x 00:16:41.832 [2024-04-26 15:45:40.276484] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:16:41.832 [2024-04-26 15:45:40.276541] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:41.832 EAL: No free 2048 kB hugepages reported on node 1 00:16:41.832 [2024-04-26 15:45:40.335976] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:41.832 [2024-04-26 15:45:40.416649] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:41.832 [2024-04-26 15:45:40.416686] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:41.832 [2024-04-26 15:45:40.416694] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:41.832 [2024-04-26 15:45:40.416700] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:41.832 [2024-04-26 15:45:40.416705] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:41.832 [2024-04-26 15:45:40.416749] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:41.832 [2024-04-26 15:45:40.416847] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:41.832 [2024-04-26 15:45:40.416955] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:41.832 [2024-04-26 15:45:40.416956] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:42.765 15:45:41 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:16:42.765 15:45:41 -- common/autotest_common.sh@850 -- # return 0 00:16:42.765 15:45:41 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:16:42.765 15:45:41 -- common/autotest_common.sh@716 -- # xtrace_disable 00:16:42.765 15:45:41 -- common/autotest_common.sh@10 -- # set +x 00:16:42.765 15:45:41 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:42.765 15:45:41 -- target/srq_overwhelm.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -s 1024 00:16:42.765 15:45:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:42.765 15:45:41 -- common/autotest_common.sh@10 -- # set +x 00:16:42.765 [2024-04-26 15:45:41.160745] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xdda100/0xdde5f0) succeed. 00:16:42.765 [2024-04-26 15:45:41.171021] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xddb740/0xe1fc80) succeed. 00:16:42.765 15:45:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:42.765 15:45:41 -- target/srq_overwhelm.sh@22 -- # seq 0 5 00:16:42.765 15:45:41 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:16:42.765 15:45:41 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK00000000000000 00:16:42.765 15:45:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:42.765 15:45:41 -- common/autotest_common.sh@10 -- # set +x 00:16:42.765 15:45:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:42.765 15:45:41 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:42.765 15:45:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:42.765 15:45:41 -- common/autotest_common.sh@10 -- # set +x 00:16:42.765 Malloc0 00:16:42.765 15:45:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:42.765 15:45:41 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Malloc0 00:16:42.765 15:45:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:42.765 15:45:41 -- common/autotest_common.sh@10 -- # set +x 00:16:42.765 15:45:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:42.765 15:45:41 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:16:42.765 15:45:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:42.765 15:45:41 -- common/autotest_common.sh@10 -- # set +x 00:16:42.765 [2024-04-26 15:45:41.270782] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:16:42.765 15:45:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:42.765 15:45:41 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode0 -a 192.168.100.8 -s 4420 00:16:43.695 15:45:42 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme0n1 00:16:43.695 15:45:42 -- common/autotest_common.sh@1221 -- # local i=0 00:16:43.695 15:45:42 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:16:43.695 15:45:42 -- common/autotest_common.sh@1222 -- # grep -q -w nvme0n1 00:16:43.695 15:45:42 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:16:43.695 15:45:42 -- common/autotest_common.sh@1228 -- # grep -q -w nvme0n1 00:16:43.695 15:45:42 -- common/autotest_common.sh@1232 -- # return 0 00:16:43.695 15:45:42 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:16:43.696 15:45:42 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:16:43.696 15:45:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:43.696 15:45:42 -- common/autotest_common.sh@10 -- # set +x 00:16:43.696 15:45:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:43.696 15:45:42 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:16:43.696 15:45:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:43.953 15:45:42 -- common/autotest_common.sh@10 -- # set +x 00:16:43.953 Malloc1 00:16:43.953 15:45:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:43.953 15:45:42 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:16:43.953 15:45:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:43.953 15:45:42 -- common/autotest_common.sh@10 -- # set +x 00:16:43.953 15:45:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:43.953 15:45:42 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:16:43.953 15:45:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:43.953 15:45:42 -- common/autotest_common.sh@10 -- # set +x 00:16:43.953 15:45:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:43.953 15:45:42 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:16:44.884 15:45:43 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme1n1 00:16:44.884 15:45:43 -- common/autotest_common.sh@1221 -- # local i=0 00:16:44.884 15:45:43 -- common/autotest_common.sh@1222 -- # grep -q -w nvme1n1 00:16:44.884 15:45:43 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:16:44.884 15:45:43 -- common/autotest_common.sh@1228 -- # grep -q -w nvme1n1 00:16:44.884 15:45:43 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:16:44.884 15:45:43 -- common/autotest_common.sh@1232 -- # return 0 00:16:44.884 15:45:43 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:16:44.884 15:45:43 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:16:44.884 15:45:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:44.884 15:45:43 -- common/autotest_common.sh@10 -- # set +x 00:16:44.884 15:45:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:44.884 15:45:43 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:16:44.884 15:45:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:44.884 15:45:43 -- common/autotest_common.sh@10 -- # set +x 00:16:44.884 Malloc2 00:16:44.884 15:45:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:44.884 15:45:43 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:16:44.884 15:45:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:44.884 15:45:43 -- common/autotest_common.sh@10 -- # set +x 00:16:44.884 15:45:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:44.884 15:45:43 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t rdma -a 192.168.100.8 -s 4420 00:16:44.884 15:45:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:44.884 15:45:43 -- common/autotest_common.sh@10 -- # set +x 00:16:44.884 15:45:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:44.884 15:45:43 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode2 -a 192.168.100.8 -s 4420 00:16:45.815 15:45:44 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme2n1 00:16:45.815 15:45:44 -- common/autotest_common.sh@1221 -- # local i=0 00:16:45.815 15:45:44 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:16:45.815 15:45:44 -- common/autotest_common.sh@1222 -- # grep -q -w nvme2n1 00:16:45.815 15:45:44 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:16:45.815 15:45:44 -- common/autotest_common.sh@1228 -- # grep -q -w nvme2n1 00:16:45.815 15:45:44 -- common/autotest_common.sh@1232 -- # return 0 00:16:45.815 15:45:44 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:16:45.815 15:45:44 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:16:45.815 15:45:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:45.815 15:45:44 -- common/autotest_common.sh@10 -- # set +x 00:16:45.815 15:45:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:45.815 15:45:44 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:16:45.815 15:45:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:45.815 15:45:44 -- common/autotest_common.sh@10 -- # set +x 00:16:45.815 Malloc3 00:16:45.815 15:45:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:45.815 15:45:44 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:16:45.815 15:45:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:45.815 15:45:44 -- common/autotest_common.sh@10 -- # set +x 00:16:45.815 15:45:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:45.815 15:45:44 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t rdma -a 192.168.100.8 -s 4420 00:16:45.815 15:45:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:45.815 15:45:44 -- common/autotest_common.sh@10 -- # set +x 00:16:45.815 15:45:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:45.815 15:45:44 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode3 -a 192.168.100.8 -s 4420 00:16:47.183 15:45:45 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme3n1 00:16:47.183 15:45:45 -- common/autotest_common.sh@1221 -- # local i=0 00:16:47.183 15:45:45 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:16:47.183 15:45:45 -- common/autotest_common.sh@1222 -- # grep -q -w nvme3n1 00:16:47.183 15:45:45 -- common/autotest_common.sh@1228 -- # grep -q -w nvme3n1 00:16:47.183 15:45:45 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:16:47.183 15:45:45 -- common/autotest_common.sh@1232 -- # return 0 00:16:47.183 15:45:45 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:16:47.183 15:45:45 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:16:47.183 15:45:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:47.183 15:45:45 -- common/autotest_common.sh@10 -- # set +x 00:16:47.183 15:45:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:47.183 15:45:45 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:16:47.183 15:45:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:47.183 15:45:45 -- common/autotest_common.sh@10 -- # set +x 00:16:47.183 Malloc4 00:16:47.183 15:45:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:47.183 15:45:45 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:16:47.183 15:45:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:47.183 15:45:45 -- common/autotest_common.sh@10 -- # set +x 00:16:47.183 15:45:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:47.183 15:45:45 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t rdma -a 192.168.100.8 -s 4420 00:16:47.183 15:45:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:47.183 15:45:45 -- common/autotest_common.sh@10 -- # set +x 00:16:47.183 15:45:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:47.183 15:45:45 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode4 -a 192.168.100.8 -s 4420 00:16:48.114 15:45:46 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme4n1 00:16:48.114 15:45:46 -- common/autotest_common.sh@1221 -- # local i=0 00:16:48.114 15:45:46 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:16:48.114 15:45:46 -- common/autotest_common.sh@1222 -- # grep -q -w nvme4n1 00:16:48.114 15:45:46 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:16:48.114 15:45:46 -- common/autotest_common.sh@1228 -- # grep -q -w nvme4n1 00:16:48.114 15:45:46 -- common/autotest_common.sh@1232 -- # return 0 00:16:48.114 15:45:46 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:16:48.114 15:45:46 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK00000000000005 00:16:48.114 15:45:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:48.114 15:45:46 -- common/autotest_common.sh@10 -- # set +x 00:16:48.114 15:45:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:48.114 15:45:46 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:16:48.114 15:45:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:48.114 15:45:46 -- common/autotest_common.sh@10 -- # set +x 00:16:48.114 Malloc5 00:16:48.114 15:45:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:48.114 15:45:46 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:16:48.114 15:45:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:48.114 15:45:46 -- common/autotest_common.sh@10 -- # set +x 00:16:48.114 15:45:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:48.114 15:45:46 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t rdma -a 192.168.100.8 -s 4420 00:16:48.114 15:45:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:48.114 15:45:46 -- common/autotest_common.sh@10 -- # set +x 00:16:48.114 15:45:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:48.114 15:45:46 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode5 -a 192.168.100.8 -s 4420 00:16:49.045 15:45:47 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme5n1 00:16:49.045 15:45:47 -- common/autotest_common.sh@1221 -- # local i=0 00:16:49.045 15:45:47 -- common/autotest_common.sh@1222 -- # grep -q -w nvme5n1 00:16:49.045 15:45:47 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:16:49.045 15:45:47 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:16:49.045 15:45:47 -- common/autotest_common.sh@1228 -- # grep -q -w nvme5n1 00:16:49.045 15:45:47 -- common/autotest_common.sh@1232 -- # return 0 00:16:49.045 15:45:47 -- target/srq_overwhelm.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 1048576 -d 128 -t read -r 10 -n 13 00:16:49.045 [global] 00:16:49.045 thread=1 00:16:49.045 invalidate=1 00:16:49.045 rw=read 00:16:49.045 time_based=1 00:16:49.045 runtime=10 00:16:49.045 ioengine=libaio 00:16:49.045 direct=1 00:16:49.045 bs=1048576 00:16:49.045 iodepth=128 00:16:49.045 norandommap=1 00:16:49.045 numjobs=13 00:16:49.045 00:16:49.045 [job0] 00:16:49.045 filename=/dev/nvme0n1 00:16:49.045 [job1] 00:16:49.045 filename=/dev/nvme1n1 00:16:49.045 [job2] 00:16:49.045 filename=/dev/nvme2n1 00:16:49.045 [job3] 00:16:49.045 filename=/dev/nvme3n1 00:16:49.045 [job4] 00:16:49.045 filename=/dev/nvme4n1 00:16:49.045 [job5] 00:16:49.045 filename=/dev/nvme5n1 00:16:49.045 Could not set queue depth (nvme0n1) 00:16:49.045 Could not set queue depth (nvme1n1) 00:16:49.045 Could not set queue depth (nvme2n1) 00:16:49.045 Could not set queue depth (nvme3n1) 00:16:49.045 Could not set queue depth (nvme4n1) 00:16:49.045 Could not set queue depth (nvme5n1) 00:16:49.302 job0: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:16:49.302 ... 00:16:49.302 job1: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:16:49.302 ... 00:16:49.302 job2: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:16:49.302 ... 00:16:49.302 job3: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:16:49.302 ... 00:16:49.302 job4: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:16:49.302 ... 00:16:49.302 job5: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:16:49.302 ... 00:16:49.302 fio-3.35 00:16:49.302 Starting 78 threads 00:17:04.167 00:17:04.167 job0: (groupid=0, jobs=1): err= 0: pid=3346588: Fri Apr 26 15:46:00 2024 00:17:04.167 read: IOPS=3, BW=3637KiB/s (3724kB/s)(43.0MiB/12108msec) 00:17:04.167 slat (usec): min=640, max=2121.4k, avg=232675.33, stdev=623816.36 00:17:04.167 clat (msec): min=2102, max=12106, avg=9139.41, stdev=3707.21 00:17:04.167 lat (msec): min=2125, max=12107, avg=9372.08, stdev=3566.31 00:17:04.167 clat percentiles (msec): 00:17:04.167 | 1.00th=[ 2106], 5.00th=[ 4111], 10.00th=[ 4111], 20.00th=[ 4144], 00:17:04.167 | 30.00th=[ 6409], 40.00th=[10671], 50.00th=[11879], 60.00th=[11879], 00:17:04.167 | 70.00th=[12013], 80.00th=[12147], 90.00th=[12147], 95.00th=[12147], 00:17:04.167 | 99.00th=[12147], 99.50th=[12147], 99.90th=[12147], 99.95th=[12147], 00:17:04.167 | 99.99th=[12147] 00:17:04.167 lat (msec) : >=2000=100.00% 00:17:04.167 cpu : usr=0.00%, sys=0.22%, ctx=107, majf=0, minf=11009 00:17:04.167 IO depths : 1=2.3%, 2=4.7%, 4=9.3%, 8=18.6%, 16=37.2%, 32=27.9%, >=64=0.0% 00:17:04.167 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.167 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:17:04.167 issued rwts: total=43,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.167 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.167 job0: (groupid=0, jobs=1): err= 0: pid=3346589: Fri Apr 26 15:46:00 2024 00:17:04.167 read: IOPS=20, BW=20.2MiB/s (21.2MB/s)(246MiB/12169msec) 00:17:04.167 slat (usec): min=73, max=2133.0k, avg=40968.73, stdev=240182.43 00:17:04.167 clat (msec): min=982, max=12001, avg=4766.85, stdev=2478.31 00:17:04.167 lat (msec): min=996, max=12002, avg=4807.82, stdev=2462.87 00:17:04.167 clat percentiles (msec): 00:17:04.167 | 1.00th=[ 986], 5.00th=[ 1045], 10.00th=[ 1234], 20.00th=[ 1586], 00:17:04.167 | 30.00th=[ 3037], 40.00th=[ 5000], 50.00th=[ 5201], 60.00th=[ 6544], 00:17:04.167 | 70.00th=[ 6678], 80.00th=[ 6812], 90.00th=[ 6946], 95.00th=[ 7080], 00:17:04.167 | 99.00th=[12013], 99.50th=[12013], 99.90th=[12013], 99.95th=[12013], 00:17:04.167 | 99.99th=[12013] 00:17:04.167 bw ( KiB/s): min= 1954, max=137216, per=1.45%, avg=48723.60, stdev=63031.29, samples=5 00:17:04.167 iops : min= 1, max= 134, avg=47.40, stdev=61.72, samples=5 00:17:04.167 lat (msec) : 1000=2.85%, 2000=26.42%, >=2000=70.73% 00:17:04.167 cpu : usr=0.02%, sys=0.98%, ctx=388, majf=0, minf=32769 00:17:04.167 IO depths : 1=0.4%, 2=0.8%, 4=1.6%, 8=3.3%, 16=6.5%, 32=13.0%, >=64=74.4% 00:17:04.167 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.167 complete : 0=0.0%, 4=99.2%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.8% 00:17:04.167 issued rwts: total=246,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.167 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.167 job0: (groupid=0, jobs=1): err= 0: pid=3346590: Fri Apr 26 15:46:00 2024 00:17:04.167 read: IOPS=19, BW=19.8MiB/s (20.7MB/s)(241MiB/12188msec) 00:17:04.167 slat (usec): min=66, max=2135.7k, avg=41844.85, stdev=271736.58 00:17:04.167 clat (msec): min=514, max=11644, avg=6267.55, stdev=5276.88 00:17:04.167 lat (msec): min=514, max=11649, avg=6309.40, stdev=5278.99 00:17:04.167 clat percentiles (msec): 00:17:04.167 | 1.00th=[ 514], 5.00th=[ 523], 10.00th=[ 535], 20.00th=[ 558], 00:17:04.167 | 30.00th=[ 600], 40.00th=[ 634], 50.00th=[ 9597], 60.00th=[11208], 00:17:04.167 | 70.00th=[11342], 80.00th=[11476], 90.00th=[11476], 95.00th=[11610], 00:17:04.167 | 99.00th=[11610], 99.50th=[11610], 99.90th=[11610], 99.95th=[11610], 00:17:04.167 | 99.99th=[11610] 00:17:04.167 bw ( KiB/s): min= 1924, max=200704, per=0.99%, avg=33335.43, stdev=73980.17, samples=7 00:17:04.167 iops : min= 1, max= 196, avg=32.43, stdev=72.31, samples=7 00:17:04.167 lat (msec) : 750=43.98%, 1000=0.41%, >=2000=55.60% 00:17:04.167 cpu : usr=0.04%, sys=1.01%, ctx=252, majf=0, minf=32769 00:17:04.167 IO depths : 1=0.4%, 2=0.8%, 4=1.7%, 8=3.3%, 16=6.6%, 32=13.3%, >=64=73.9% 00:17:04.167 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.167 complete : 0=0.0%, 4=99.1%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.9% 00:17:04.167 issued rwts: total=241,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.167 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.167 job0: (groupid=0, jobs=1): err= 0: pid=3346591: Fri Apr 26 15:46:00 2024 00:17:04.167 read: IOPS=19, BW=19.2MiB/s (20.1MB/s)(232MiB/12082msec) 00:17:04.167 slat (usec): min=71, max=2095.1k, avg=43118.83, stdev=270597.19 00:17:04.167 clat (msec): min=872, max=11277, avg=6346.26, stdev=4350.94 00:17:04.167 lat (msec): min=887, max=11307, avg=6389.38, stdev=4351.11 00:17:04.167 clat percentiles (msec): 00:17:04.167 | 1.00th=[ 885], 5.00th=[ 885], 10.00th=[ 894], 20.00th=[ 894], 00:17:04.167 | 30.00th=[ 2089], 40.00th=[ 4279], 50.00th=[ 6477], 60.00th=[ 9194], 00:17:04.167 | 70.00th=[10805], 80.00th=[10939], 90.00th=[11073], 95.00th=[11208], 00:17:04.167 | 99.00th=[11208], 99.50th=[11342], 99.90th=[11342], 99.95th=[11342], 00:17:04.167 | 99.99th=[11342] 00:17:04.167 bw ( KiB/s): min=14336, max=120832, per=1.07%, avg=35840.00, stdev=41725.96, samples=6 00:17:04.167 iops : min= 14, max= 118, avg=35.00, stdev=40.75, samples=6 00:17:04.167 lat (msec) : 1000=29.31%, >=2000=70.69% 00:17:04.167 cpu : usr=0.01%, sys=0.79%, ctx=228, majf=0, minf=32769 00:17:04.167 IO depths : 1=0.4%, 2=0.9%, 4=1.7%, 8=3.4%, 16=6.9%, 32=13.8%, >=64=72.8% 00:17:04.167 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.167 complete : 0=0.0%, 4=99.1%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.9% 00:17:04.167 issued rwts: total=232,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.167 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.167 job0: (groupid=0, jobs=1): err= 0: pid=3346592: Fri Apr 26 15:46:00 2024 00:17:04.167 read: IOPS=9, BW=9827KiB/s (10.1MB/s)(116MiB/12087msec) 00:17:04.167 slat (usec): min=356, max=2114.6k, avg=86218.47, stdev=389406.61 00:17:04.167 clat (msec): min=2085, max=12085, avg=8948.31, stdev=3656.77 00:17:04.167 lat (msec): min=2087, max=12086, avg=9034.53, stdev=3611.17 00:17:04.167 clat percentiles (msec): 00:17:04.167 | 1.00th=[ 2089], 5.00th=[ 2089], 10.00th=[ 4212], 20.00th=[ 4279], 00:17:04.167 | 30.00th=[ 6275], 40.00th=[ 8557], 50.00th=[11745], 60.00th=[11745], 00:17:04.167 | 70.00th=[11879], 80.00th=[11879], 90.00th=[12013], 95.00th=[12013], 00:17:04.167 | 99.00th=[12147], 99.50th=[12147], 99.90th=[12147], 99.95th=[12147], 00:17:04.167 | 99.99th=[12147] 00:17:04.167 lat (msec) : >=2000=100.00% 00:17:04.167 cpu : usr=0.00%, sys=0.59%, ctx=125, majf=0, minf=29697 00:17:04.167 IO depths : 1=0.9%, 2=1.7%, 4=3.4%, 8=6.9%, 16=13.8%, 32=27.6%, >=64=45.7% 00:17:04.168 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.168 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:17:04.168 issued rwts: total=116,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.168 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.168 job0: (groupid=0, jobs=1): err= 0: pid=3346593: Fri Apr 26 15:46:00 2024 00:17:04.168 read: IOPS=31, BW=31.6MiB/s (33.2MB/s)(381MiB/12042msec) 00:17:04.168 slat (usec): min=58, max=2135.8k, avg=26366.50, stdev=198383.44 00:17:04.168 clat (msec): min=500, max=8426, avg=1449.82, stdev=1394.45 00:17:04.168 lat (msec): min=506, max=8504, avg=1476.19, stdev=1454.18 00:17:04.168 clat percentiles (msec): 00:17:04.168 | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 510], 20.00th=[ 514], 00:17:04.168 | 30.00th=[ 518], 40.00th=[ 542], 50.00th=[ 567], 60.00th=[ 902], 00:17:04.168 | 70.00th=[ 2534], 80.00th=[ 2735], 90.00th=[ 2903], 95.00th=[ 2970], 00:17:04.168 | 99.00th=[ 8423], 99.50th=[ 8423], 99.90th=[ 8423], 99.95th=[ 8423], 00:17:04.168 | 99.99th=[ 8423] 00:17:04.168 bw ( KiB/s): min= 4096, max=247313, per=3.81%, avg=127658.25, stdev=129516.91, samples=4 00:17:04.168 iops : min= 4, max= 241, avg=124.50, stdev=126.36, samples=4 00:17:04.168 lat (msec) : 750=59.58%, 1000=3.94%, 2000=0.52%, >=2000=35.96% 00:17:04.168 cpu : usr=0.01%, sys=0.96%, ctx=396, majf=0, minf=32769 00:17:04.168 IO depths : 1=0.3%, 2=0.5%, 4=1.0%, 8=2.1%, 16=4.2%, 32=8.4%, >=64=83.5% 00:17:04.168 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.168 complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.4% 00:17:04.168 issued rwts: total=381,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.168 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.168 job0: (groupid=0, jobs=1): err= 0: pid=3346594: Fri Apr 26 15:46:00 2024 00:17:04.168 read: IOPS=63, BW=63.9MiB/s (67.0MB/s)(642MiB/10041msec) 00:17:04.168 slat (usec): min=42, max=2101.7k, avg=15587.53, stdev=141753.33 00:17:04.168 clat (msec): min=29, max=7464, avg=1913.93, stdev=2565.67 00:17:04.168 lat (msec): min=69, max=7466, avg=1929.52, stdev=2574.10 00:17:04.168 clat percentiles (msec): 00:17:04.168 | 1.00th=[ 89], 5.00th=[ 230], 10.00th=[ 393], 20.00th=[ 527], 00:17:04.168 | 30.00th=[ 625], 40.00th=[ 625], 50.00th=[ 634], 60.00th=[ 634], 00:17:04.168 | 70.00th=[ 634], 80.00th=[ 4279], 90.00th=[ 7349], 95.00th=[ 7416], 00:17:04.168 | 99.00th=[ 7416], 99.50th=[ 7483], 99.90th=[ 7483], 99.95th=[ 7483], 00:17:04.168 | 99.99th=[ 7483] 00:17:04.168 bw ( KiB/s): min= 8192, max=212992, per=3.14%, avg=105317.10, stdev=84648.59, samples=10 00:17:04.168 iops : min= 8, max= 208, avg=102.70, stdev=82.72, samples=10 00:17:04.168 lat (msec) : 50=0.16%, 100=2.34%, 250=3.89%, 500=8.10%, 750=59.19% 00:17:04.168 lat (msec) : 2000=3.12%, >=2000=23.21% 00:17:04.168 cpu : usr=0.02%, sys=1.46%, ctx=581, majf=0, minf=32769 00:17:04.168 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.2%, 16=2.5%, 32=5.0%, >=64=90.2% 00:17:04.168 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.168 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:17:04.168 issued rwts: total=642,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.168 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.168 job0: (groupid=0, jobs=1): err= 0: pid=3346595: Fri Apr 26 15:46:00 2024 00:17:04.168 read: IOPS=1, BW=1692KiB/s (1733kB/s)(20.0MiB/12102msec) 00:17:04.168 slat (usec): min=725, max=2125.3k, avg=500434.69, stdev=872126.39 00:17:04.168 clat (msec): min=2092, max=12092, avg=8905.50, stdev=3789.91 00:17:04.168 lat (msec): min=2102, max=12101, avg=9405.94, stdev=3492.08 00:17:04.168 clat percentiles (msec): 00:17:04.168 | 1.00th=[ 2089], 5.00th=[ 2089], 10.00th=[ 2106], 20.00th=[ 4245], 00:17:04.168 | 30.00th=[ 6409], 40.00th=[ 8557], 50.00th=[10671], 60.00th=[12013], 00:17:04.168 | 70.00th=[12147], 80.00th=[12147], 90.00th=[12147], 95.00th=[12147], 00:17:04.168 | 99.00th=[12147], 99.50th=[12147], 99.90th=[12147], 99.95th=[12147], 00:17:04.168 | 99.99th=[12147] 00:17:04.168 lat (msec) : >=2000=100.00% 00:17:04.168 cpu : usr=0.01%, sys=0.10%, ctx=66, majf=0, minf=5121 00:17:04.168 IO depths : 1=5.0%, 2=10.0%, 4=20.0%, 8=40.0%, 16=25.0%, 32=0.0%, >=64=0.0% 00:17:04.168 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.168 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0% 00:17:04.168 issued rwts: total=20,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.168 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.168 job0: (groupid=0, jobs=1): err= 0: pid=3346596: Fri Apr 26 15:46:00 2024 00:17:04.168 read: IOPS=141, BW=141MiB/s (148MB/s)(1420MiB/10049msec) 00:17:04.168 slat (usec): min=40, max=1975.1k, avg=7042.65, stdev=62474.07 00:17:04.168 clat (msec): min=38, max=4189, avg=633.95, stdev=508.79 00:17:04.168 lat (msec): min=62, max=4190, avg=640.99, stdev=518.23 00:17:04.168 clat percentiles (msec): 00:17:04.168 | 1.00th=[ 106], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 384], 00:17:04.168 | 30.00th=[ 393], 40.00th=[ 447], 50.00th=[ 592], 60.00th=[ 642], 00:17:04.168 | 70.00th=[ 659], 80.00th=[ 776], 90.00th=[ 818], 95.00th=[ 885], 00:17:04.168 | 99.00th=[ 4144], 99.50th=[ 4144], 99.90th=[ 4178], 99.95th=[ 4178], 00:17:04.168 | 99.99th=[ 4178] 00:17:04.168 bw ( KiB/s): min=98304, max=337920, per=6.58%, avg=220561.50, stdev=76743.26, samples=12 00:17:04.168 iops : min= 96, max= 330, avg=215.25, stdev=74.99, samples=12 00:17:04.168 lat (msec) : 50=0.07%, 100=0.63%, 250=2.11%, 500=41.41%, 750=33.17% 00:17:04.168 lat (msec) : 1000=19.79%, >=2000=2.82% 00:17:04.168 cpu : usr=0.10%, sys=2.18%, ctx=1309, majf=0, minf=32769 00:17:04.168 IO depths : 1=0.1%, 2=0.1%, 4=0.3%, 8=0.6%, 16=1.1%, 32=2.3%, >=64=95.6% 00:17:04.168 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.168 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:04.168 issued rwts: total=1420,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.168 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.168 job0: (groupid=0, jobs=1): err= 0: pid=3346597: Fri Apr 26 15:46:00 2024 00:17:04.168 read: IOPS=3, BW=3535KiB/s (3620kB/s)(42.0MiB/12165msec) 00:17:04.168 slat (usec): min=477, max=2132.5k, avg=239053.54, stdev=644804.77 00:17:04.168 clat (msec): min=2123, max=12162, avg=10700.77, stdev=2832.23 00:17:04.168 lat (msec): min=4213, max=12163, avg=10939.82, stdev=2494.17 00:17:04.168 clat percentiles (msec): 00:17:04.168 | 1.00th=[ 2123], 5.00th=[ 4245], 10.00th=[ 4279], 20.00th=[10671], 00:17:04.168 | 30.00th=[11879], 40.00th=[12013], 50.00th=[12147], 60.00th=[12147], 00:17:04.168 | 70.00th=[12147], 80.00th=[12147], 90.00th=[12147], 95.00th=[12147], 00:17:04.168 | 99.00th=[12147], 99.50th=[12147], 99.90th=[12147], 99.95th=[12147], 00:17:04.168 | 99.99th=[12147] 00:17:04.168 lat (msec) : >=2000=100.00% 00:17:04.168 cpu : usr=0.00%, sys=0.35%, ctx=96, majf=0, minf=10753 00:17:04.168 IO depths : 1=2.4%, 2=4.8%, 4=9.5%, 8=19.0%, 16=38.1%, 32=26.2%, >=64=0.0% 00:17:04.168 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.168 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:17:04.168 issued rwts: total=42,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.168 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.168 job0: (groupid=0, jobs=1): err= 0: pid=3346598: Fri Apr 26 15:46:00 2024 00:17:04.168 read: IOPS=1, BW=1938KiB/s (1985kB/s)(23.0MiB/12151msec) 00:17:04.168 slat (usec): min=1812, max=3447.7k, avg=436913.18, stdev=962932.65 00:17:04.168 clat (msec): min=2101, max=12147, avg=8111.55, stdev=3771.22 00:17:04.168 lat (msec): min=4137, max=12150, avg=8548.46, stdev=3622.50 00:17:04.168 clat percentiles (msec): 00:17:04.168 | 1.00th=[ 2106], 5.00th=[ 4144], 10.00th=[ 4144], 20.00th=[ 4212], 00:17:04.168 | 30.00th=[ 4279], 40.00th=[ 6342], 50.00th=[ 6409], 60.00th=[12013], 00:17:04.168 | 70.00th=[12147], 80.00th=[12147], 90.00th=[12147], 95.00th=[12147], 00:17:04.168 | 99.00th=[12147], 99.50th=[12147], 99.90th=[12147], 99.95th=[12147], 00:17:04.168 | 99.99th=[12147] 00:17:04.168 lat (msec) : >=2000=100.00% 00:17:04.168 cpu : usr=0.00%, sys=0.15%, ctx=86, majf=0, minf=5889 00:17:04.168 IO depths : 1=4.3%, 2=8.7%, 4=17.4%, 8=34.8%, 16=34.8%, 32=0.0%, >=64=0.0% 00:17:04.168 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.168 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0% 00:17:04.168 issued rwts: total=23,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.168 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.168 job0: (groupid=0, jobs=1): err= 0: pid=3346599: Fri Apr 26 15:46:00 2024 00:17:04.168 read: IOPS=3, BW=3784KiB/s (3874kB/s)(45.0MiB/12179msec) 00:17:04.168 slat (usec): min=592, max=2260.1k, avg=225849.63, stdev=635522.58 00:17:04.168 clat (msec): min=2014, max=12176, avg=11140.73, stdev=2369.33 00:17:04.168 lat (msec): min=4274, max=12178, avg=11366.58, stdev=1921.76 00:17:04.168 clat percentiles (msec): 00:17:04.168 | 1.00th=[ 2022], 5.00th=[ 6342], 10.00th=[ 6409], 20.00th=[11879], 00:17:04.168 | 30.00th=[12013], 40.00th=[12147], 50.00th=[12147], 60.00th=[12147], 00:17:04.168 | 70.00th=[12147], 80.00th=[12147], 90.00th=[12147], 95.00th=[12147], 00:17:04.168 | 99.00th=[12147], 99.50th=[12147], 99.90th=[12147], 99.95th=[12147], 00:17:04.168 | 99.99th=[12147] 00:17:04.168 lat (msec) : >=2000=100.00% 00:17:04.168 cpu : usr=0.00%, sys=0.39%, ctx=88, majf=0, minf=11521 00:17:04.168 IO depths : 1=2.2%, 2=4.4%, 4=8.9%, 8=17.8%, 16=35.6%, 32=31.1%, >=64=0.0% 00:17:04.168 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.168 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:17:04.168 issued rwts: total=45,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.168 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.168 job0: (groupid=0, jobs=1): err= 0: pid=3346600: Fri Apr 26 15:46:00 2024 00:17:04.168 read: IOPS=16, BW=16.9MiB/s (17.7MB/s)(206MiB/12221msec) 00:17:04.168 slat (usec): min=510, max=2137.7k, avg=49053.13, stdev=267191.81 00:17:04.168 clat (msec): min=1314, max=11989, avg=6174.30, stdev=2109.56 00:17:04.168 lat (msec): min=1329, max=12051, avg=6223.36, stdev=2090.14 00:17:04.168 clat percentiles (msec): 00:17:04.168 | 1.00th=[ 1318], 5.00th=[ 1401], 10.00th=[ 3373], 20.00th=[ 4530], 00:17:04.168 | 30.00th=[ 4665], 40.00th=[ 6409], 50.00th=[ 7215], 60.00th=[ 7483], 00:17:04.168 | 70.00th=[ 7617], 80.00th=[ 7886], 90.00th=[ 8087], 95.00th=[ 8221], 00:17:04.168 | 99.00th=[ 8288], 99.50th=[10671], 99.90th=[12013], 99.95th=[12013], 00:17:04.168 | 99.99th=[12013] 00:17:04.168 bw ( KiB/s): min= 1815, max=96063, per=0.80%, avg=26894.33, stdev=36581.20, samples=6 00:17:04.168 iops : min= 1, max= 93, avg=26.00, stdev=35.52, samples=6 00:17:04.168 lat (msec) : 2000=7.28%, >=2000=92.72% 00:17:04.168 cpu : usr=0.00%, sys=0.97%, ctx=313, majf=0, minf=32769 00:17:04.168 IO depths : 1=0.5%, 2=1.0%, 4=1.9%, 8=3.9%, 16=7.8%, 32=15.5%, >=64=69.4% 00:17:04.168 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.169 complete : 0=0.0%, 4=98.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=1.2% 00:17:04.169 issued rwts: total=206,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.169 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.169 job1: (groupid=0, jobs=1): err= 0: pid=3346601: Fri Apr 26 15:46:00 2024 00:17:04.169 read: IOPS=41, BW=41.8MiB/s (43.8MB/s)(425MiB/10175msec) 00:17:04.169 slat (usec): min=58, max=2100.6k, avg=23674.69, stdev=200726.61 00:17:04.169 clat (msec): min=110, max=9046, avg=2947.44, stdev=3620.56 00:17:04.169 lat (msec): min=384, max=9048, avg=2971.12, stdev=3628.34 00:17:04.169 clat percentiles (msec): 00:17:04.169 | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 393], 20.00th=[ 397], 00:17:04.169 | 30.00th=[ 405], 40.00th=[ 426], 50.00th=[ 468], 60.00th=[ 600], 00:17:04.169 | 70.00th=[ 4463], 80.00th=[ 8792], 90.00th=[ 8926], 95.00th=[ 8926], 00:17:04.169 | 99.00th=[ 9060], 99.50th=[ 9060], 99.90th=[ 9060], 99.95th=[ 9060], 00:17:04.169 | 99.99th=[ 9060] 00:17:04.169 bw ( KiB/s): min= 4096, max=288768, per=3.02%, avg=101376.00, stdev=135222.29, samples=6 00:17:04.169 iops : min= 4, max= 282, avg=99.00, stdev=132.05, samples=6 00:17:04.169 lat (msec) : 250=0.24%, 500=54.59%, 750=9.18%, >=2000=36.00% 00:17:04.169 cpu : usr=0.01%, sys=1.27%, ctx=387, majf=0, minf=32769 00:17:04.169 IO depths : 1=0.2%, 2=0.5%, 4=0.9%, 8=1.9%, 16=3.8%, 32=7.5%, >=64=85.2% 00:17:04.169 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.169 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:17:04.169 issued rwts: total=425,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.169 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.169 job1: (groupid=0, jobs=1): err= 0: pid=3346602: Fri Apr 26 15:46:00 2024 00:17:04.169 read: IOPS=2, BW=2696KiB/s (2760kB/s)(32.0MiB/12156msec) 00:17:04.169 slat (usec): min=714, max=3386.5k, avg=313408.23, stdev=829859.56 00:17:04.169 clat (msec): min=2126, max=12153, avg=8912.28, stdev=3453.95 00:17:04.169 lat (msec): min=4209, max=12155, avg=9225.69, stdev=3268.38 00:17:04.169 clat percentiles (msec): 00:17:04.169 | 1.00th=[ 2123], 5.00th=[ 4212], 10.00th=[ 4245], 20.00th=[ 6342], 00:17:04.169 | 30.00th=[ 6409], 40.00th=[ 6409], 50.00th=[ 8557], 60.00th=[12147], 00:17:04.169 | 70.00th=[12147], 80.00th=[12147], 90.00th=[12147], 95.00th=[12147], 00:17:04.169 | 99.00th=[12147], 99.50th=[12147], 99.90th=[12147], 99.95th=[12147], 00:17:04.169 | 99.99th=[12147] 00:17:04.169 lat (msec) : >=2000=100.00% 00:17:04.169 cpu : usr=0.01%, sys=0.23%, ctx=77, majf=0, minf=8193 00:17:04.169 IO depths : 1=3.1%, 2=6.2%, 4=12.5%, 8=25.0%, 16=50.0%, 32=3.1%, >=64=0.0% 00:17:04.169 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.169 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0% 00:17:04.169 issued rwts: total=32,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.169 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.169 job1: (groupid=0, jobs=1): err= 0: pid=3346603: Fri Apr 26 15:46:00 2024 00:17:04.169 read: IOPS=2, BW=2866KiB/s (2934kB/s)(34.0MiB/12150msec) 00:17:04.169 slat (usec): min=911, max=2123.0k, avg=294904.01, stdev=706889.22 00:17:04.169 clat (msec): min=2122, max=12147, avg=10390.83, stdev=2928.85 00:17:04.169 lat (msec): min=4211, max=12149, avg=10685.73, stdev=2551.60 00:17:04.169 clat percentiles (msec): 00:17:04.169 | 1.00th=[ 2123], 5.00th=[ 4212], 10.00th=[ 6342], 20.00th=[ 6409], 00:17:04.169 | 30.00th=[12013], 40.00th=[12013], 50.00th=[12013], 60.00th=[12013], 00:17:04.169 | 70.00th=[12147], 80.00th=[12147], 90.00th=[12147], 95.00th=[12147], 00:17:04.169 | 99.00th=[12147], 99.50th=[12147], 99.90th=[12147], 99.95th=[12147], 00:17:04.169 | 99.99th=[12147] 00:17:04.169 lat (msec) : >=2000=100.00% 00:17:04.169 cpu : usr=0.00%, sys=0.25%, ctx=75, majf=0, minf=8705 00:17:04.169 IO depths : 1=2.9%, 2=5.9%, 4=11.8%, 8=23.5%, 16=47.1%, 32=8.8%, >=64=0.0% 00:17:04.169 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.169 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:17:04.169 issued rwts: total=34,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.169 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.169 job1: (groupid=0, jobs=1): err= 0: pid=3346604: Fri Apr 26 15:46:00 2024 00:17:04.169 read: IOPS=2, BW=2637KiB/s (2700kB/s)(26.0MiB/10098msec) 00:17:04.169 slat (msec): min=4, max=2100, avg=384.79, stdev=770.37 00:17:04.169 clat (msec): min=92, max=10077, avg=5224.10, stdev=3713.05 00:17:04.169 lat (msec): min=98, max=10096, avg=5608.89, stdev=3678.20 00:17:04.169 clat percentiles (msec): 00:17:04.169 | 1.00th=[ 93], 5.00th=[ 99], 10.00th=[ 110], 20.00th=[ 142], 00:17:04.169 | 30.00th=[ 2265], 40.00th=[ 4396], 50.00th=[ 4463], 60.00th=[ 6611], 00:17:04.169 | 70.00th=[ 8658], 80.00th=[ 8658], 90.00th=[10000], 95.00th=[10134], 00:17:04.169 | 99.00th=[10134], 99.50th=[10134], 99.90th=[10134], 99.95th=[10134], 00:17:04.169 | 99.99th=[10134] 00:17:04.169 lat (msec) : 100=7.69%, 250=15.38%, >=2000=76.92% 00:17:04.169 cpu : usr=0.00%, sys=0.15%, ctx=88, majf=0, minf=6657 00:17:04.169 IO depths : 1=3.8%, 2=7.7%, 4=15.4%, 8=30.8%, 16=42.3%, 32=0.0%, >=64=0.0% 00:17:04.169 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.169 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0% 00:17:04.169 issued rwts: total=26,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.169 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.169 job1: (groupid=0, jobs=1): err= 0: pid=3346605: Fri Apr 26 15:46:00 2024 00:17:04.169 read: IOPS=121, BW=121MiB/s (127MB/s)(1227MiB/10107msec) 00:17:04.169 slat (usec): min=38, max=2082.5k, avg=8165.88, stdev=90936.68 00:17:04.169 clat (msec): min=81, max=6040, avg=490.46, stdev=453.00 00:17:04.169 lat (msec): min=163, max=6042, avg=498.62, stdev=487.83 00:17:04.169 clat percentiles (msec): 00:17:04.169 | 1.00th=[ 192], 5.00th=[ 347], 10.00th=[ 380], 20.00th=[ 384], 00:17:04.169 | 30.00th=[ 388], 40.00th=[ 393], 50.00th=[ 418], 60.00th=[ 468], 00:17:04.169 | 70.00th=[ 514], 80.00th=[ 518], 90.00th=[ 550], 95.00th=[ 558], 00:17:04.169 | 99.00th=[ 2702], 99.50th=[ 4665], 99.90th=[ 4665], 99.95th=[ 6074], 00:17:04.169 | 99.99th=[ 6074] 00:17:04.169 bw ( KiB/s): min=247808, max=339968, per=8.38%, avg=280996.75, stdev=36721.52, samples=8 00:17:04.169 iops : min= 242, max= 332, avg=274.38, stdev=35.86, samples=8 00:17:04.169 lat (msec) : 100=0.08%, 250=2.36%, 500=63.08%, 750=33.09%, >=2000=1.39% 00:17:04.169 cpu : usr=0.04%, sys=1.50%, ctx=1142, majf=0, minf=32769 00:17:04.169 IO depths : 1=0.1%, 2=0.2%, 4=0.3%, 8=0.7%, 16=1.3%, 32=2.6%, >=64=94.9% 00:17:04.169 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.169 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:04.169 issued rwts: total=1227,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.169 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.169 job1: (groupid=0, jobs=1): err= 0: pid=3346606: Fri Apr 26 15:46:00 2024 00:17:04.169 read: IOPS=1, BW=1781KiB/s (1824kB/s)(21.0MiB/12072msec) 00:17:04.169 slat (usec): min=759, max=2113.0k, avg=572816.52, stdev=899498.43 00:17:04.169 clat (msec): min=42, max=11955, avg=6240.53, stdev=3897.14 00:17:04.169 lat (msec): min=2074, max=12071, avg=6813.35, stdev=3823.96 00:17:04.169 clat percentiles (msec): 00:17:04.169 | 1.00th=[ 43], 5.00th=[ 2072], 10.00th=[ 2089], 20.00th=[ 2089], 00:17:04.169 | 30.00th=[ 2123], 40.00th=[ 4245], 50.00th=[ 6409], 60.00th=[ 6477], 00:17:04.169 | 70.00th=[10537], 80.00th=[10671], 90.00th=[10671], 95.00th=[10671], 00:17:04.169 | 99.00th=[12013], 99.50th=[12013], 99.90th=[12013], 99.95th=[12013], 00:17:04.169 | 99.99th=[12013] 00:17:04.169 lat (msec) : 50=4.76%, >=2000=95.24% 00:17:04.169 cpu : usr=0.00%, sys=0.10%, ctx=84, majf=0, minf=5377 00:17:04.169 IO depths : 1=4.8%, 2=9.5%, 4=19.0%, 8=38.1%, 16=28.6%, 32=0.0%, >=64=0.0% 00:17:04.169 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.169 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0% 00:17:04.169 issued rwts: total=21,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.169 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.169 job1: (groupid=0, jobs=1): err= 0: pid=3346607: Fri Apr 26 15:46:00 2024 00:17:04.169 read: IOPS=52, BW=52.1MiB/s (54.6MB/s)(525MiB/10079msec) 00:17:04.169 slat (usec): min=40, max=2082.5k, avg=19057.26, stdev=164837.19 00:17:04.169 clat (msec): min=70, max=8353, avg=1553.24, stdev=2589.10 00:17:04.169 lat (msec): min=80, max=8356, avg=1572.30, stdev=2605.37 00:17:04.169 clat percentiles (msec): 00:17:04.169 | 1.00th=[ 89], 5.00th=[ 167], 10.00th=[ 284], 20.00th=[ 518], 00:17:04.169 | 30.00th=[ 527], 40.00th=[ 535], 50.00th=[ 558], 60.00th=[ 584], 00:17:04.169 | 70.00th=[ 592], 80.00th=[ 625], 90.00th=[ 8221], 95.00th=[ 8288], 00:17:04.169 | 99.00th=[ 8356], 99.50th=[ 8356], 99.90th=[ 8356], 99.95th=[ 8356], 00:17:04.169 | 99.99th=[ 8356] 00:17:04.169 bw ( KiB/s): min=106496, max=245760, per=6.08%, avg=203776.00, stdev=65738.35, samples=4 00:17:04.169 iops : min= 104, max= 240, avg=199.00, stdev=64.20, samples=4 00:17:04.169 lat (msec) : 100=1.90%, 250=6.67%, 500=9.52%, 750=67.05%, >=2000=14.86% 00:17:04.169 cpu : usr=0.04%, sys=1.44%, ctx=521, majf=0, minf=32769 00:17:04.169 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.5%, 16=3.0%, 32=6.1%, >=64=88.0% 00:17:04.169 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.169 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:17:04.169 issued rwts: total=525,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.169 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.169 job1: (groupid=0, jobs=1): err= 0: pid=3346608: Fri Apr 26 15:46:00 2024 00:17:04.169 read: IOPS=6, BW=6388KiB/s (6541kB/s)(63.0MiB/10099msec) 00:17:04.169 slat (usec): min=554, max=2086.0k, avg=158834.83, stdev=528389.76 00:17:04.169 clat (msec): min=91, max=10097, avg=5391.60, stdev=3480.44 00:17:04.169 lat (msec): min=99, max=10098, avg=5550.43, stdev=3462.96 00:17:04.169 clat percentiles (msec): 00:17:04.169 | 1.00th=[ 92], 5.00th=[ 111], 10.00th=[ 130], 20.00th=[ 2265], 00:17:04.169 | 30.00th=[ 2299], 40.00th=[ 4396], 50.00th=[ 4463], 60.00th=[ 6544], 00:17:04.169 | 70.00th=[ 8658], 80.00th=[10134], 90.00th=[10134], 95.00th=[10134], 00:17:04.169 | 99.00th=[10134], 99.50th=[10134], 99.90th=[10134], 99.95th=[10134], 00:17:04.169 | 99.99th=[10134] 00:17:04.169 lat (msec) : 100=3.17%, 250=7.94%, >=2000=88.89% 00:17:04.169 cpu : usr=0.00%, sys=0.37%, ctx=83, majf=0, minf=16129 00:17:04.169 IO depths : 1=1.6%, 2=3.2%, 4=6.3%, 8=12.7%, 16=25.4%, 32=50.8%, >=64=0.0% 00:17:04.169 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.169 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:17:04.169 issued rwts: total=63,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.170 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.170 job1: (groupid=0, jobs=1): err= 0: pid=3346609: Fri Apr 26 15:46:00 2024 00:17:04.170 read: IOPS=10, BW=10.6MiB/s (11.1MB/s)(128MiB/12087msec) 00:17:04.170 slat (usec): min=372, max=2113.4k, avg=78130.23, stdev=362363.28 00:17:04.170 clat (msec): min=2085, max=12081, avg=9671.62, stdev=3044.41 00:17:04.170 lat (msec): min=2094, max=12083, avg=9749.75, stdev=2975.72 00:17:04.170 clat percentiles (msec): 00:17:04.170 | 1.00th=[ 2089], 5.00th=[ 2140], 10.00th=[ 4245], 20.00th=[ 6409], 00:17:04.170 | 30.00th=[10805], 40.00th=[10939], 50.00th=[11073], 60.00th=[11342], 00:17:04.170 | 70.00th=[11476], 80.00th=[11745], 90.00th=[12013], 95.00th=[12013], 00:17:04.170 | 99.00th=[12147], 99.50th=[12147], 99.90th=[12147], 99.95th=[12147], 00:17:04.170 | 99.99th=[12147] 00:17:04.170 bw ( KiB/s): min= 2048, max= 2048, per=0.06%, avg=2048.00, stdev= 0.00, samples=1 00:17:04.170 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 00:17:04.170 lat (msec) : >=2000=100.00% 00:17:04.170 cpu : usr=0.00%, sys=0.65%, ctx=209, majf=0, minf=32769 00:17:04.170 IO depths : 1=0.8%, 2=1.6%, 4=3.1%, 8=6.2%, 16=12.5%, 32=25.0%, >=64=50.8% 00:17:04.170 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.170 complete : 0=0.0%, 4=50.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=50.0% 00:17:04.170 issued rwts: total=128,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.170 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.170 job1: (groupid=0, jobs=1): err= 0: pid=3346610: Fri Apr 26 15:46:00 2024 00:17:04.170 read: IOPS=12, BW=12.3MiB/s (12.9MB/s)(124MiB/10095msec) 00:17:04.170 slat (usec): min=345, max=2188.6k, avg=80655.03, stdev=375781.33 00:17:04.170 clat (msec): min=93, max=10070, avg=8617.34, stdev=2343.47 00:17:04.170 lat (msec): min=94, max=10094, avg=8697.99, stdev=2216.37 00:17:04.170 clat percentiles (msec): 00:17:04.170 | 1.00th=[ 95], 5.00th=[ 2265], 10.00th=[ 6544], 20.00th=[ 8792], 00:17:04.170 | 30.00th=[ 9060], 40.00th=[ 9060], 50.00th=[ 9329], 60.00th=[ 9597], 00:17:04.170 | 70.00th=[ 9597], 80.00th=[ 9731], 90.00th=[10000], 95.00th=[10000], 00:17:04.170 | 99.00th=[10134], 99.50th=[10134], 99.90th=[10134], 99.95th=[10134], 00:17:04.170 | 99.99th=[10134] 00:17:04.170 lat (msec) : 100=1.61%, 250=3.23%, >=2000=95.16% 00:17:04.170 cpu : usr=0.01%, sys=0.66%, ctx=216, majf=0, minf=31745 00:17:04.170 IO depths : 1=0.8%, 2=1.6%, 4=3.2%, 8=6.5%, 16=12.9%, 32=25.8%, >=64=49.2% 00:17:04.170 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.170 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:17:04.170 issued rwts: total=124,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.170 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.170 job1: (groupid=0, jobs=1): err= 0: pid=3346611: Fri Apr 26 15:46:00 2024 00:17:04.170 read: IOPS=2, BW=2371KiB/s (2428kB/s)(28.0MiB/12093msec) 00:17:04.170 slat (usec): min=647, max=2114.9k, avg=357444.98, stdev=758446.30 00:17:04.170 clat (msec): min=2083, max=12088, avg=7224.22, stdev=4197.46 00:17:04.170 lat (msec): min=2092, max=12092, avg=7581.66, stdev=4169.56 00:17:04.170 clat percentiles (msec): 00:17:04.170 | 1.00th=[ 2089], 5.00th=[ 2089], 10.00th=[ 2106], 20.00th=[ 2123], 00:17:04.170 | 30.00th=[ 4212], 40.00th=[ 6409], 50.00th=[ 6409], 60.00th=[ 8557], 00:17:04.170 | 70.00th=[11879], 80.00th=[12147], 90.00th=[12147], 95.00th=[12147], 00:17:04.170 | 99.00th=[12147], 99.50th=[12147], 99.90th=[12147], 99.95th=[12147], 00:17:04.170 | 99.99th=[12147] 00:17:04.170 lat (msec) : >=2000=100.00% 00:17:04.170 cpu : usr=0.00%, sys=0.14%, ctx=65, majf=0, minf=7169 00:17:04.170 IO depths : 1=3.6%, 2=7.1%, 4=14.3%, 8=28.6%, 16=46.4%, 32=0.0%, >=64=0.0% 00:17:04.170 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.170 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0% 00:17:04.170 issued rwts: total=28,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.170 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.170 job1: (groupid=0, jobs=1): err= 0: pid=3346612: Fri Apr 26 15:46:00 2024 00:17:04.170 read: IOPS=76, BW=76.2MiB/s (79.9MB/s)(770MiB/10111msec) 00:17:04.170 slat (usec): min=36, max=2119.4k, avg=12987.98, stdev=116131.12 00:17:04.170 clat (msec): min=105, max=5100, avg=1424.25, stdev=1489.58 00:17:04.170 lat (msec): min=122, max=5102, avg=1437.24, stdev=1492.57 00:17:04.170 clat percentiles (msec): 00:17:04.170 | 1.00th=[ 550], 5.00th=[ 584], 10.00th=[ 625], 20.00th=[ 667], 00:17:04.170 | 30.00th=[ 693], 40.00th=[ 709], 50.00th=[ 768], 60.00th=[ 802], 00:17:04.170 | 70.00th=[ 852], 80.00th=[ 936], 90.00th=[ 4665], 95.00th=[ 4933], 00:17:04.170 | 99.00th=[ 5067], 99.50th=[ 5067], 99.90th=[ 5134], 99.95th=[ 5134], 00:17:04.170 | 99.99th=[ 5134] 00:17:04.170 bw ( KiB/s): min= 2048, max=235520, per=3.93%, avg=131657.30, stdev=79823.01, samples=10 00:17:04.170 iops : min= 2, max= 230, avg=128.50, stdev=77.94, samples=10 00:17:04.170 lat (msec) : 250=0.26%, 750=45.32%, 1000=35.45%, 2000=0.39%, >=2000=18.57% 00:17:04.170 cpu : usr=0.03%, sys=1.29%, ctx=715, majf=0, minf=32769 00:17:04.170 IO depths : 1=0.1%, 2=0.3%, 4=0.5%, 8=1.0%, 16=2.1%, 32=4.2%, >=64=91.8% 00:17:04.170 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.170 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:17:04.170 issued rwts: total=770,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.170 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.170 job1: (groupid=0, jobs=1): err= 0: pid=3346613: Fri Apr 26 15:46:00 2024 00:17:04.170 read: IOPS=1, BW=1522KiB/s (1559kB/s)(15.0MiB/10091msec) 00:17:04.170 slat (usec): min=807, max=2183.3k, avg=666693.84, stdev=969722.77 00:17:04.170 clat (msec): min=89, max=8735, avg=3838.66, stdev=3590.74 00:17:04.170 lat (msec): min=92, max=10090, avg=4505.36, stdev=3768.95 00:17:04.170 clat percentiles (msec): 00:17:04.170 | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 93], 20.00th=[ 94], 00:17:04.170 | 30.00th=[ 113], 40.00th=[ 123], 50.00th=[ 4396], 60.00th=[ 4396], 00:17:04.170 | 70.00th=[ 6611], 80.00th=[ 6611], 90.00th=[ 8658], 95.00th=[ 8792], 00:17:04.170 | 99.00th=[ 8792], 99.50th=[ 8792], 99.90th=[ 8792], 99.95th=[ 8792], 00:17:04.170 | 99.99th=[ 8792] 00:17:04.170 lat (msec) : 100=20.00%, 250=20.00%, >=2000=60.00% 00:17:04.170 cpu : usr=0.00%, sys=0.13%, ctx=70, majf=0, minf=3841 00:17:04.170 IO depths : 1=6.7%, 2=13.3%, 4=26.7%, 8=53.3%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:04.170 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.170 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=100.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.170 issued rwts: total=15,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.170 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.170 job2: (groupid=0, jobs=1): err= 0: pid=3346614: Fri Apr 26 15:46:00 2024 00:17:04.170 read: IOPS=7, BW=7511KiB/s (7692kB/s)(74.0MiB/10088msec) 00:17:04.170 slat (usec): min=524, max=2090.8k, avg=135782.71, stdev=477034.42 00:17:04.170 clat (msec): min=39, max=10086, avg=6456.38, stdev=3784.99 00:17:04.170 lat (msec): min=98, max=10087, avg=6592.17, stdev=3731.51 00:17:04.170 clat percentiles (msec): 00:17:04.170 | 1.00th=[ 40], 5.00th=[ 102], 10.00th=[ 121], 20.00th=[ 150], 00:17:04.170 | 30.00th=[ 4396], 40.00th=[ 6611], 50.00th=[ 8658], 60.00th=[ 8658], 00:17:04.170 | 70.00th=[ 8792], 80.00th=[ 9866], 90.00th=[ 9866], 95.00th=[10000], 00:17:04.170 | 99.00th=[10134], 99.50th=[10134], 99.90th=[10134], 99.95th=[10134], 00:17:04.170 | 99.99th=[10134] 00:17:04.170 lat (msec) : 50=1.35%, 100=1.35%, 250=17.57%, >=2000=79.73% 00:17:04.170 cpu : usr=0.00%, sys=0.46%, ctx=137, majf=0, minf=18945 00:17:04.170 IO depths : 1=1.4%, 2=2.7%, 4=5.4%, 8=10.8%, 16=21.6%, 32=43.2%, >=64=14.9% 00:17:04.170 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.170 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:17:04.170 issued rwts: total=74,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.170 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.170 job2: (groupid=0, jobs=1): err= 0: pid=3346615: Fri Apr 26 15:46:00 2024 00:17:04.170 read: IOPS=111, BW=111MiB/s (117MB/s)(1129MiB/10129msec) 00:17:04.170 slat (usec): min=64, max=2048.0k, avg=8854.34, stdev=93193.13 00:17:04.170 clat (msec): min=127, max=7323, avg=812.66, stdev=981.15 00:17:04.170 lat (msec): min=133, max=8610, avg=821.51, stdev=993.63 00:17:04.170 clat percentiles (msec): 00:17:04.170 | 1.00th=[ 174], 5.00th=[ 296], 10.00th=[ 305], 20.00th=[ 313], 00:17:04.170 | 30.00th=[ 317], 40.00th=[ 326], 50.00th=[ 330], 60.00th=[ 351], 00:17:04.170 | 70.00th=[ 701], 80.00th=[ 885], 90.00th=[ 2769], 95.00th=[ 3071], 00:17:04.170 | 99.00th=[ 3977], 99.50th=[ 3977], 99.90th=[ 7349], 99.95th=[ 7349], 00:17:04.170 | 99.99th=[ 7349] 00:17:04.170 bw ( KiB/s): min=16384, max=409600, per=6.12%, avg=205209.60, stdev=151794.12, samples=10 00:17:04.170 iops : min= 16, max= 400, avg=200.40, stdev=148.24, samples=10 00:17:04.170 lat (msec) : 250=2.66%, 500=62.36%, 750=7.71%, 1000=11.87%, 2000=1.24% 00:17:04.170 lat (msec) : >=2000=14.17% 00:17:04.170 cpu : usr=0.04%, sys=1.58%, ctx=1497, majf=0, minf=32769 00:17:04.170 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.7%, 16=1.4%, 32=2.8%, >=64=94.4% 00:17:04.170 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.170 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:04.170 issued rwts: total=1129,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.170 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.170 job2: (groupid=0, jobs=1): err= 0: pid=3346616: Fri Apr 26 15:46:00 2024 00:17:04.170 read: IOPS=126, BW=126MiB/s (133MB/s)(1275MiB/10082msec) 00:17:04.170 slat (usec): min=42, max=2077.1k, avg=7838.96, stdev=58494.75 00:17:04.170 clat (msec): min=78, max=3672, avg=945.93, stdev=948.31 00:17:04.170 lat (msec): min=84, max=3683, avg=953.77, stdev=953.40 00:17:04.170 clat percentiles (msec): 00:17:04.170 | 1.00th=[ 228], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 393], 00:17:04.170 | 30.00th=[ 397], 40.00th=[ 405], 50.00th=[ 567], 60.00th=[ 651], 00:17:04.170 | 70.00th=[ 902], 80.00th=[ 1267], 90.00th=[ 1485], 95.00th=[ 3641], 00:17:04.170 | 99.00th=[ 3675], 99.50th=[ 3675], 99.90th=[ 3675], 99.95th=[ 3675], 00:17:04.170 | 99.99th=[ 3675] 00:17:04.170 bw ( KiB/s): min= 6144, max=335872, per=4.67%, avg=156714.87, stdev=110068.96, samples=15 00:17:04.170 iops : min= 6, max= 328, avg=152.93, stdev=107.55, samples=15 00:17:04.171 lat (msec) : 100=0.16%, 250=1.18%, 500=44.24%, 750=19.45%, 1000=7.22% 00:17:04.171 lat (msec) : 2000=17.80%, >=2000=9.96% 00:17:04.171 cpu : usr=0.10%, sys=2.21%, ctx=2393, majf=0, minf=32769 00:17:04.171 IO depths : 1=0.1%, 2=0.2%, 4=0.3%, 8=0.6%, 16=1.3%, 32=2.5%, >=64=95.1% 00:17:04.171 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.171 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:04.171 issued rwts: total=1275,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.171 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.171 job2: (groupid=0, jobs=1): err= 0: pid=3346617: Fri Apr 26 15:46:00 2024 00:17:04.171 read: IOPS=28, BW=28.8MiB/s (30.2MB/s)(293MiB/10187msec) 00:17:04.171 slat (usec): min=64, max=2086.5k, avg=34366.56, stdev=215136.43 00:17:04.171 clat (msec): min=115, max=9415, avg=4283.54, stdev=3687.03 00:17:04.171 lat (msec): min=505, max=9417, avg=4317.90, stdev=3689.06 00:17:04.171 clat percentiles (msec): 00:17:04.171 | 1.00th=[ 510], 5.00th=[ 527], 10.00th=[ 575], 20.00th=[ 634], 00:17:04.171 | 30.00th=[ 676], 40.00th=[ 818], 50.00th=[ 3910], 60.00th=[ 5336], 00:17:04.171 | 70.00th=[ 8658], 80.00th=[ 8926], 90.00th=[ 9329], 95.00th=[ 9329], 00:17:04.171 | 99.00th=[ 9463], 99.50th=[ 9463], 99.90th=[ 9463], 99.95th=[ 9463], 00:17:04.171 | 99.99th=[ 9463] 00:17:04.171 bw ( KiB/s): min= 6144, max=159744, per=1.26%, avg=42240.00, stdev=56021.99, samples=8 00:17:04.171 iops : min= 6, max= 156, avg=41.25, stdev=54.71, samples=8 00:17:04.171 lat (msec) : 250=0.34%, 750=34.47%, 1000=9.90%, >=2000=55.29% 00:17:04.171 cpu : usr=0.04%, sys=1.14%, ctx=563, majf=0, minf=32769 00:17:04.171 IO depths : 1=0.3%, 2=0.7%, 4=1.4%, 8=2.7%, 16=5.5%, 32=10.9%, >=64=78.5% 00:17:04.171 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.171 complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.6% 00:17:04.171 issued rwts: total=293,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.171 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.171 job2: (groupid=0, jobs=1): err= 0: pid=3346618: Fri Apr 26 15:46:00 2024 00:17:04.171 read: IOPS=16, BW=16.3MiB/s (17.1MB/s)(164MiB/10083msec) 00:17:04.171 slat (usec): min=382, max=2080.5k, avg=61090.16, stdev=290297.87 00:17:04.171 clat (msec): min=62, max=9712, avg=7166.87, stdev=2777.76 00:17:04.171 lat (msec): min=1770, max=9717, avg=7227.96, stdev=2728.61 00:17:04.171 clat percentiles (msec): 00:17:04.171 | 1.00th=[ 1770], 5.00th=[ 1905], 10.00th=[ 1989], 20.00th=[ 3608], 00:17:04.171 | 30.00th=[ 7953], 40.00th=[ 7953], 50.00th=[ 8288], 60.00th=[ 8792], 00:17:04.171 | 70.00th=[ 8926], 80.00th=[ 9194], 90.00th=[ 9463], 95.00th=[ 9597], 00:17:04.171 | 99.00th=[ 9731], 99.50th=[ 9731], 99.90th=[ 9731], 99.95th=[ 9731], 00:17:04.171 | 99.99th=[ 9731] 00:17:04.171 bw ( KiB/s): min= 4087, max=36864, per=0.44%, avg=14743.80, stdev=13997.21, samples=5 00:17:04.171 iops : min= 3, max= 36, avg=14.20, stdev=13.86, samples=5 00:17:04.171 lat (msec) : 100=0.61%, 2000=9.76%, >=2000=89.63% 00:17:04.171 cpu : usr=0.00%, sys=0.95%, ctx=406, majf=0, minf=32769 00:17:04.171 IO depths : 1=0.6%, 2=1.2%, 4=2.4%, 8=4.9%, 16=9.8%, 32=19.5%, >=64=61.6% 00:17:04.171 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.171 complete : 0=0.0%, 4=97.4%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=2.6% 00:17:04.171 issued rwts: total=164,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.171 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.171 job2: (groupid=0, jobs=1): err= 0: pid=3346619: Fri Apr 26 15:46:00 2024 00:17:04.171 read: IOPS=3, BW=3385KiB/s (3466kB/s)(40.0MiB/12101msec) 00:17:04.171 slat (usec): min=599, max=2100.2k, avg=250092.78, stdev=650594.77 00:17:04.171 clat (msec): min=2096, max=12072, avg=6800.65, stdev=2806.42 00:17:04.171 lat (msec): min=2114, max=12099, avg=7050.74, stdev=2822.13 00:17:04.171 clat percentiles (msec): 00:17:04.171 | 1.00th=[ 2089], 5.00th=[ 2123], 10.00th=[ 4212], 20.00th=[ 4245], 00:17:04.171 | 30.00th=[ 4245], 40.00th=[ 6342], 50.00th=[ 6409], 60.00th=[ 6409], 00:17:04.171 | 70.00th=[ 8490], 80.00th=[ 8557], 90.00th=[10671], 95.00th=[12013], 00:17:04.171 | 99.00th=[12013], 99.50th=[12013], 99.90th=[12013], 99.95th=[12013], 00:17:04.171 | 99.99th=[12013] 00:17:04.171 lat (msec) : >=2000=100.00% 00:17:04.171 cpu : usr=0.00%, sys=0.25%, ctx=61, majf=0, minf=10241 00:17:04.171 IO depths : 1=2.5%, 2=5.0%, 4=10.0%, 8=20.0%, 16=40.0%, 32=22.5%, >=64=0.0% 00:17:04.171 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.171 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:17:04.171 issued rwts: total=40,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.171 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.171 job2: (groupid=0, jobs=1): err= 0: pid=3346620: Fri Apr 26 15:46:00 2024 00:17:04.171 read: IOPS=18, BW=18.3MiB/s (19.2MB/s)(185MiB/10121msec) 00:17:04.171 slat (usec): min=74, max=2081.4k, avg=54074.95, stdev=267043.98 00:17:04.171 clat (msec): min=115, max=7972, avg=5149.90, stdev=1360.20 00:17:04.171 lat (msec): min=2196, max=8003, avg=5203.98, stdev=1324.34 00:17:04.171 clat percentiles (msec): 00:17:04.171 | 1.00th=[ 2198], 5.00th=[ 4010], 10.00th=[ 4010], 20.00th=[ 4144], 00:17:04.171 | 30.00th=[ 4212], 40.00th=[ 4245], 50.00th=[ 4396], 60.00th=[ 5873], 00:17:04.171 | 70.00th=[ 5873], 80.00th=[ 6477], 90.00th=[ 7483], 95.00th=[ 7752], 00:17:04.171 | 99.00th=[ 7953], 99.50th=[ 7953], 99.90th=[ 7953], 99.95th=[ 7953], 00:17:04.171 | 99.99th=[ 7953] 00:17:04.171 bw ( KiB/s): min= 2048, max=63488, per=0.89%, avg=29696.00, stdev=30353.73, samples=4 00:17:04.171 iops : min= 2, max= 62, avg=29.00, stdev=29.64, samples=4 00:17:04.171 lat (msec) : 250=0.54%, >=2000=99.46% 00:17:04.171 cpu : usr=0.02%, sys=0.93%, ctx=348, majf=0, minf=32769 00:17:04.171 IO depths : 1=0.5%, 2=1.1%, 4=2.2%, 8=4.3%, 16=8.6%, 32=17.3%, >=64=65.9% 00:17:04.171 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.171 complete : 0=0.0%, 4=98.3%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=1.7% 00:17:04.171 issued rwts: total=185,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.171 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.171 job2: (groupid=0, jobs=1): err= 0: pid=3346621: Fri Apr 26 15:46:00 2024 00:17:04.171 read: IOPS=44, BW=44.2MiB/s (46.3MB/s)(534MiB/12087msec) 00:17:04.171 slat (usec): min=40, max=2074.7k, avg=18725.09, stdev=154386.58 00:17:04.171 clat (msec): min=619, max=9047, avg=2678.54, stdev=3191.76 00:17:04.171 lat (msec): min=621, max=9050, avg=2697.27, stdev=3200.67 00:17:04.171 clat percentiles (msec): 00:17:04.171 | 1.00th=[ 625], 5.00th=[ 625], 10.00th=[ 625], 20.00th=[ 634], 00:17:04.171 | 30.00th=[ 651], 40.00th=[ 667], 50.00th=[ 751], 60.00th=[ 1200], 00:17:04.171 | 70.00th=[ 1469], 80.00th=[ 6946], 90.00th=[ 8792], 95.00th=[ 8926], 00:17:04.171 | 99.00th=[ 9060], 99.50th=[ 9060], 99.90th=[ 9060], 99.95th=[ 9060], 00:17:04.171 | 99.99th=[ 9060] 00:17:04.171 bw ( KiB/s): min=12263, max=208896, per=3.11%, avg=104123.62, stdev=94808.45, samples=8 00:17:04.171 iops : min= 11, max= 204, avg=101.38, stdev=92.78, samples=8 00:17:04.171 lat (msec) : 750=49.81%, 1000=6.55%, 2000=14.61%, >=2000=29.03% 00:17:04.171 cpu : usr=0.03%, sys=0.93%, ctx=639, majf=0, minf=32769 00:17:04.171 IO depths : 1=0.2%, 2=0.4%, 4=0.7%, 8=1.5%, 16=3.0%, 32=6.0%, >=64=88.2% 00:17:04.171 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.171 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:17:04.171 issued rwts: total=534,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.171 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.171 job2: (groupid=0, jobs=1): err= 0: pid=3346622: Fri Apr 26 15:46:00 2024 00:17:04.171 read: IOPS=24, BW=24.2MiB/s (25.4MB/s)(246MiB/10145msec) 00:17:04.171 slat (usec): min=41, max=2100.7k, avg=40976.24, stdev=255622.60 00:17:04.171 clat (msec): min=63, max=9228, avg=5021.15, stdev=3723.46 00:17:04.171 lat (msec): min=771, max=9246, avg=5062.13, stdev=3716.23 00:17:04.171 clat percentiles (msec): 00:17:04.171 | 1.00th=[ 768], 5.00th=[ 785], 10.00th=[ 793], 20.00th=[ 1020], 00:17:04.171 | 30.00th=[ 1045], 40.00th=[ 2123], 50.00th=[ 5000], 60.00th=[ 8658], 00:17:04.171 | 70.00th=[ 8926], 80.00th=[ 8926], 90.00th=[ 9060], 95.00th=[ 9060], 00:17:04.171 | 99.00th=[ 9194], 99.50th=[ 9194], 99.90th=[ 9194], 99.95th=[ 9194], 00:17:04.171 | 99.99th=[ 9194] 00:17:04.171 bw ( KiB/s): min= 4096, max=188416, per=1.20%, avg=40277.33, stdev=72957.87, samples=6 00:17:04.171 iops : min= 4, max= 184, avg=39.33, stdev=71.25, samples=6 00:17:04.171 lat (msec) : 100=0.41%, 1000=19.11%, 2000=20.33%, >=2000=60.16% 00:17:04.171 cpu : usr=0.01%, sys=1.08%, ctx=448, majf=0, minf=32769 00:17:04.171 IO depths : 1=0.4%, 2=0.8%, 4=1.6%, 8=3.3%, 16=6.5%, 32=13.0%, >=64=74.4% 00:17:04.171 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.171 complete : 0=0.0%, 4=99.2%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.8% 00:17:04.171 issued rwts: total=246,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.171 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.171 job2: (groupid=0, jobs=1): err= 0: pid=3346623: Fri Apr 26 15:46:00 2024 00:17:04.171 read: IOPS=42, BW=42.1MiB/s (44.1MB/s)(509MiB/12098msec) 00:17:04.171 slat (usec): min=53, max=2066.5k, avg=19655.60, stdev=129158.11 00:17:04.171 clat (msec): min=741, max=8508, avg=2590.37, stdev=1656.12 00:17:04.171 lat (msec): min=743, max=8530, avg=2610.02, stdev=1672.81 00:17:04.171 clat percentiles (msec): 00:17:04.171 | 1.00th=[ 751], 5.00th=[ 768], 10.00th=[ 785], 20.00th=[ 818], 00:17:04.171 | 30.00th=[ 1200], 40.00th=[ 1250], 50.00th=[ 2232], 60.00th=[ 3406], 00:17:04.171 | 70.00th=[ 3641], 80.00th=[ 4396], 90.00th=[ 4866], 95.00th=[ 5134], 00:17:04.171 | 99.00th=[ 5671], 99.50th=[ 6745], 99.90th=[ 8490], 99.95th=[ 8490], 00:17:04.171 | 99.99th=[ 8490] 00:17:04.171 bw ( KiB/s): min=10240, max=169984, per=2.12%, avg=71094.64, stdev=50225.10, samples=11 00:17:04.171 iops : min= 10, max= 166, avg=69.27, stdev=49.05, samples=11 00:17:04.171 lat (msec) : 750=0.59%, 1000=25.15%, 2000=22.59%, >=2000=51.67% 00:17:04.171 cpu : usr=0.00%, sys=1.01%, ctx=1036, majf=0, minf=32769 00:17:04.171 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.1%, 32=6.3%, >=64=87.6% 00:17:04.171 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.171 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:17:04.171 issued rwts: total=509,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.171 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.171 job2: (groupid=0, jobs=1): err= 0: pid=3346624: Fri Apr 26 15:46:00 2024 00:17:04.171 read: IOPS=169, BW=169MiB/s (178MB/s)(1711MiB/10105msec) 00:17:04.172 slat (usec): min=36, max=2103.2k, avg=5839.45, stdev=76928.38 00:17:04.172 clat (msec): min=102, max=4681, avg=645.23, stdev=1087.64 00:17:04.172 lat (msec): min=106, max=4681, avg=651.07, stdev=1091.69 00:17:04.172 clat percentiles (msec): 00:17:04.172 | 1.00th=[ 255], 5.00th=[ 257], 10.00th=[ 259], 20.00th=[ 259], 00:17:04.172 | 30.00th=[ 262], 40.00th=[ 264], 50.00th=[ 266], 60.00th=[ 380], 00:17:04.172 | 70.00th=[ 388], 80.00th=[ 397], 90.00th=[ 464], 95.00th=[ 4530], 00:17:04.172 | 99.00th=[ 4665], 99.50th=[ 4665], 99.90th=[ 4665], 99.95th=[ 4665], 00:17:04.172 | 99.99th=[ 4665] 00:17:04.172 bw ( KiB/s): min=24380, max=503808, per=8.79%, avg=294817.18, stdev=184507.99, samples=11 00:17:04.172 iops : min= 23, max= 492, avg=287.82, stdev=180.29, samples=11 00:17:04.172 lat (msec) : 250=0.70%, 500=90.01%, 2000=1.05%, >=2000=8.24% 00:17:04.172 cpu : usr=0.13%, sys=2.23%, ctx=1527, majf=0, minf=32769 00:17:04.172 IO depths : 1=0.1%, 2=0.1%, 4=0.2%, 8=0.5%, 16=0.9%, 32=1.9%, >=64=96.3% 00:17:04.172 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.172 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:04.172 issued rwts: total=1711,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.172 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.172 job2: (groupid=0, jobs=1): err= 0: pid=3346625: Fri Apr 26 15:46:00 2024 00:17:04.172 read: IOPS=43, BW=43.8MiB/s (45.9MB/s)(444MiB/10142msec) 00:17:04.172 slat (usec): min=413, max=2059.3k, avg=22692.39, stdev=144536.96 00:17:04.172 clat (msec): min=62, max=5691, avg=2783.93, stdev=1702.27 00:17:04.172 lat (msec): min=691, max=5886, avg=2806.63, stdev=1707.48 00:17:04.172 clat percentiles (msec): 00:17:04.172 | 1.00th=[ 693], 5.00th=[ 793], 10.00th=[ 810], 20.00th=[ 844], 00:17:04.172 | 30.00th=[ 1586], 40.00th=[ 1888], 50.00th=[ 2534], 60.00th=[ 3071], 00:17:04.172 | 70.00th=[ 3339], 80.00th=[ 5269], 90.00th=[ 5470], 95.00th=[ 5537], 00:17:04.172 | 99.00th=[ 5671], 99.50th=[ 5671], 99.90th=[ 5671], 99.95th=[ 5671], 00:17:04.172 | 99.99th=[ 5671] 00:17:04.172 bw ( KiB/s): min=10240, max=110592, per=1.75%, avg=58833.45, stdev=35449.82, samples=11 00:17:04.172 iops : min= 10, max= 108, avg=57.45, stdev=34.62, samples=11 00:17:04.172 lat (msec) : 100=0.23%, 750=3.60%, 1000=19.59%, 2000=17.57%, >=2000=59.01% 00:17:04.172 cpu : usr=0.04%, sys=1.33%, ctx=1214, majf=0, minf=32769 00:17:04.172 IO depths : 1=0.2%, 2=0.5%, 4=0.9%, 8=1.8%, 16=3.6%, 32=7.2%, >=64=85.8% 00:17:04.172 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.172 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:17:04.172 issued rwts: total=444,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.172 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.172 job2: (groupid=0, jobs=1): err= 0: pid=3346626: Fri Apr 26 15:46:00 2024 00:17:04.172 read: IOPS=93, BW=93.9MiB/s (98.5MB/s)(947MiB/10083msec) 00:17:04.172 slat (usec): min=51, max=2054.6k, avg=10564.00, stdev=67343.31 00:17:04.172 clat (msec): min=74, max=4060, avg=1299.57, stdev=1015.44 00:17:04.172 lat (msec): min=102, max=4065, avg=1310.14, stdev=1019.13 00:17:04.172 clat percentiles (msec): 00:17:04.172 | 1.00th=[ 180], 5.00th=[ 584], 10.00th=[ 642], 20.00th=[ 726], 00:17:04.172 | 30.00th=[ 793], 40.00th=[ 877], 50.00th=[ 927], 60.00th=[ 1083], 00:17:04.172 | 70.00th=[ 1183], 80.00th=[ 1284], 90.00th=[ 3641], 95.00th=[ 3876], 00:17:04.172 | 99.00th=[ 4010], 99.50th=[ 4044], 99.90th=[ 4077], 99.95th=[ 4077], 00:17:04.172 | 99.99th=[ 4077] 00:17:04.172 bw ( KiB/s): min=10240, max=206848, per=3.34%, avg=111957.33, stdev=59198.32, samples=15 00:17:04.172 iops : min= 10, max= 202, avg=109.33, stdev=57.81, samples=15 00:17:04.172 lat (msec) : 100=0.11%, 250=1.58%, 500=2.32%, 750=17.42%, 1000=32.73% 00:17:04.172 lat (msec) : 2000=32.42%, >=2000=13.41% 00:17:04.172 cpu : usr=0.03%, sys=1.82%, ctx=1713, majf=0, minf=32769 00:17:04.172 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.8%, 16=1.7%, 32=3.4%, >=64=93.3% 00:17:04.172 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.172 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:04.172 issued rwts: total=947,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.172 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.172 job3: (groupid=0, jobs=1): err= 0: pid=3346627: Fri Apr 26 15:46:00 2024 00:17:04.172 read: IOPS=11, BW=11.4MiB/s (11.9MB/s)(115MiB/10124msec) 00:17:04.172 slat (usec): min=639, max=2111.9k, avg=87014.32, stdev=349527.96 00:17:04.172 clat (msec): min=116, max=10122, avg=2407.75, stdev=3096.22 00:17:04.172 lat (msec): min=137, max=10123, avg=2494.77, stdev=3170.98 00:17:04.172 clat percentiles (msec): 00:17:04.172 | 1.00th=[ 138], 5.00th=[ 194], 10.00th=[ 275], 20.00th=[ 472], 00:17:04.172 | 30.00th=[ 785], 40.00th=[ 1028], 50.00th=[ 1234], 60.00th=[ 1452], 00:17:04.172 | 70.00th=[ 1871], 80.00th=[ 2198], 90.00th=[10000], 95.00th=[10134], 00:17:04.172 | 99.00th=[10134], 99.50th=[10134], 99.90th=[10134], 99.95th=[10134], 00:17:04.172 | 99.99th=[10134] 00:17:04.172 lat (msec) : 250=8.70%, 500=11.30%, 750=9.57%, 1000=8.70%, 2000=33.91% 00:17:04.172 lat (msec) : >=2000=27.83% 00:17:04.172 cpu : usr=0.01%, sys=0.81%, ctx=535, majf=0, minf=29441 00:17:04.172 IO depths : 1=0.9%, 2=1.7%, 4=3.5%, 8=7.0%, 16=13.9%, 32=27.8%, >=64=45.2% 00:17:04.172 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.172 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:17:04.172 issued rwts: total=115,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.172 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.172 job3: (groupid=0, jobs=1): err= 0: pid=3346628: Fri Apr 26 15:46:00 2024 00:17:04.172 read: IOPS=39, BW=39.6MiB/s (41.5MB/s)(402MiB/10151msec) 00:17:04.172 slat (usec): min=88, max=2086.5k, avg=25055.59, stdev=142573.32 00:17:04.172 clat (msec): min=74, max=7473, avg=3004.32, stdev=2496.72 00:17:04.172 lat (msec): min=158, max=7478, avg=3029.38, stdev=2503.29 00:17:04.172 clat percentiles (msec): 00:17:04.172 | 1.00th=[ 226], 5.00th=[ 567], 10.00th=[ 969], 20.00th=[ 1070], 00:17:04.172 | 30.00th=[ 1133], 40.00th=[ 1217], 50.00th=[ 1385], 60.00th=[ 2165], 00:17:04.172 | 70.00th=[ 4279], 80.00th=[ 6477], 90.00th=[ 7080], 95.00th=[ 7349], 00:17:04.172 | 99.00th=[ 7483], 99.50th=[ 7483], 99.90th=[ 7483], 99.95th=[ 7483], 00:17:04.172 | 99.99th=[ 7483] 00:17:04.172 bw ( KiB/s): min= 6131, max=106496, per=1.52%, avg=51012.64, stdev=32037.86, samples=11 00:17:04.172 iops : min= 5, max= 104, avg=49.73, stdev=31.43, samples=11 00:17:04.172 lat (msec) : 100=0.25%, 250=1.49%, 500=2.74%, 750=1.99%, 1000=6.47% 00:17:04.172 lat (msec) : 2000=45.27%, >=2000=41.79% 00:17:04.172 cpu : usr=0.04%, sys=1.60%, ctx=1046, majf=0, minf=32769 00:17:04.172 IO depths : 1=0.2%, 2=0.5%, 4=1.0%, 8=2.0%, 16=4.0%, 32=8.0%, >=64=84.3% 00:17:04.172 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.172 complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.4% 00:17:04.172 issued rwts: total=402,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.172 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.172 job3: (groupid=0, jobs=1): err= 0: pid=3346629: Fri Apr 26 15:46:00 2024 00:17:04.172 read: IOPS=103, BW=104MiB/s (109MB/s)(1043MiB/10067msec) 00:17:04.172 slat (usec): min=50, max=2058.0k, avg=9614.56, stdev=95665.44 00:17:04.172 clat (msec): min=32, max=5927, avg=778.07, stdev=1069.41 00:17:04.172 lat (msec): min=75, max=5928, avg=787.69, stdev=1081.38 00:17:04.172 clat percentiles (msec): 00:17:04.172 | 1.00th=[ 144], 5.00th=[ 215], 10.00th=[ 234], 20.00th=[ 384], 00:17:04.172 | 30.00th=[ 388], 40.00th=[ 388], 50.00th=[ 393], 60.00th=[ 397], 00:17:04.172 | 70.00th=[ 409], 80.00th=[ 944], 90.00th=[ 1536], 95.00th=[ 2534], 00:17:04.172 | 99.00th=[ 5940], 99.50th=[ 5940], 99.90th=[ 5940], 99.95th=[ 5940], 00:17:04.172 | 99.99th=[ 5940] 00:17:04.172 bw ( KiB/s): min=67584, max=384000, per=6.20%, avg=207798.33, stdev=136520.60, samples=9 00:17:04.172 iops : min= 66, max= 375, avg=202.89, stdev=133.28, samples=9 00:17:04.172 lat (msec) : 50=0.10%, 100=0.10%, 250=11.41%, 500=61.55%, 750=3.26% 00:17:04.172 lat (msec) : 1000=4.79%, 2000=11.51%, >=2000=7.29% 00:17:04.172 cpu : usr=0.06%, sys=1.84%, ctx=1153, majf=0, minf=32769 00:17:04.172 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.8%, 16=1.5%, 32=3.1%, >=64=94.0% 00:17:04.172 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.172 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:04.172 issued rwts: total=1043,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.172 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.172 job3: (groupid=0, jobs=1): err= 0: pid=3346630: Fri Apr 26 15:46:00 2024 00:17:04.172 read: IOPS=26, BW=26.0MiB/s (27.3MB/s)(263MiB/10110msec) 00:17:04.173 slat (usec): min=735, max=2076.7k, avg=38138.75, stdev=229015.90 00:17:04.173 clat (msec): min=77, max=8611, avg=1717.61, stdev=2062.00 00:17:04.173 lat (msec): min=160, max=8616, avg=1755.74, stdev=2104.17 00:17:04.173 clat percentiles (msec): 00:17:04.173 | 1.00th=[ 171], 5.00th=[ 388], 10.00th=[ 676], 20.00th=[ 869], 00:17:04.173 | 30.00th=[ 953], 40.00th=[ 995], 50.00th=[ 1020], 60.00th=[ 1070], 00:17:04.173 | 70.00th=[ 1167], 80.00th=[ 1284], 90.00th=[ 5269], 95.00th=[ 7349], 00:17:04.173 | 99.00th=[ 8557], 99.50th=[ 8557], 99.90th=[ 8658], 99.95th=[ 8658], 00:17:04.173 | 99.99th=[ 8658] 00:17:04.173 bw ( KiB/s): min=38912, max=135168, per=2.75%, avg=92160.00, stdev=48938.20, samples=3 00:17:04.173 iops : min= 38, max= 132, avg=90.00, stdev=47.79, samples=3 00:17:04.173 lat (msec) : 100=0.38%, 250=1.90%, 500=4.18%, 750=7.22%, 1000=29.28% 00:17:04.173 lat (msec) : 2000=43.73%, >=2000=13.31% 00:17:04.173 cpu : usr=0.03%, sys=1.06%, ctx=492, majf=0, minf=32769 00:17:04.173 IO depths : 1=0.4%, 2=0.8%, 4=1.5%, 8=3.0%, 16=6.1%, 32=12.2%, >=64=76.0% 00:17:04.173 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.173 complete : 0=0.0%, 4=99.3%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.7% 00:17:04.173 issued rwts: total=263,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.173 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.173 job3: (groupid=0, jobs=1): err= 0: pid=3346631: Fri Apr 26 15:46:00 2024 00:17:04.173 read: IOPS=57, BW=57.2MiB/s (60.0MB/s)(579MiB/10121msec) 00:17:04.173 slat (usec): min=38, max=2081.4k, avg=17266.10, stdev=155003.31 00:17:04.173 clat (msec): min=120, max=8279, avg=1053.85, stdev=1943.50 00:17:04.173 lat (msec): min=128, max=8282, avg=1071.12, stdev=1966.38 00:17:04.173 clat percentiles (msec): 00:17:04.173 | 1.00th=[ 136], 5.00th=[ 211], 10.00th=[ 305], 20.00th=[ 422], 00:17:04.173 | 30.00th=[ 464], 40.00th=[ 506], 50.00th=[ 514], 60.00th=[ 514], 00:17:04.173 | 70.00th=[ 518], 80.00th=[ 523], 90.00th=[ 567], 95.00th=[ 6946], 00:17:04.173 | 99.00th=[ 8288], 99.50th=[ 8288], 99.90th=[ 8288], 99.95th=[ 8288], 00:17:04.173 | 99.99th=[ 8288] 00:17:04.173 bw ( KiB/s): min=116736, max=298411, per=6.90%, avg=231274.75, stdev=79061.15, samples=4 00:17:04.173 iops : min= 114, max= 291, avg=225.75, stdev=77.09, samples=4 00:17:04.173 lat (msec) : 250=6.56%, 500=31.26%, 750=52.85%, >=2000=9.33% 00:17:04.173 cpu : usr=0.05%, sys=1.42%, ctx=581, majf=0, minf=32769 00:17:04.173 IO depths : 1=0.2%, 2=0.3%, 4=0.7%, 8=1.4%, 16=2.8%, 32=5.5%, >=64=89.1% 00:17:04.173 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.173 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:17:04.173 issued rwts: total=579,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.173 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.173 job3: (groupid=0, jobs=1): err= 0: pid=3346632: Fri Apr 26 15:46:00 2024 00:17:04.173 read: IOPS=9, BW=9.80MiB/s (10.3MB/s)(100MiB/10200msec) 00:17:04.173 slat (usec): min=688, max=2081.0k, avg=100871.13, stdev=421064.95 00:17:04.173 clat (msec): min=112, max=10196, avg=7478.75, stdev=3330.70 00:17:04.173 lat (msec): min=2167, max=10199, avg=7579.62, stdev=3257.29 00:17:04.173 clat percentiles (msec): 00:17:04.173 | 1.00th=[ 113], 5.00th=[ 2165], 10.00th=[ 2232], 20.00th=[ 2299], 00:17:04.173 | 30.00th=[ 4396], 40.00th=[ 8658], 50.00th=[10000], 60.00th=[10000], 00:17:04.173 | 70.00th=[10134], 80.00th=[10134], 90.00th=[10134], 95.00th=[10134], 00:17:04.173 | 99.00th=[10134], 99.50th=[10134], 99.90th=[10134], 99.95th=[10134], 00:17:04.173 | 99.99th=[10134] 00:17:04.173 lat (msec) : 250=1.00%, >=2000=99.00% 00:17:04.173 cpu : usr=0.01%, sys=0.88%, ctx=128, majf=0, minf=25601 00:17:04.173 IO depths : 1=1.0%, 2=2.0%, 4=4.0%, 8=8.0%, 16=16.0%, 32=32.0%, >=64=37.0% 00:17:04.173 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.173 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:17:04.173 issued rwts: total=100,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.173 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.173 job3: (groupid=0, jobs=1): err= 0: pid=3346633: Fri Apr 26 15:46:00 2024 00:17:04.173 read: IOPS=61, BW=62.0MiB/s (65.0MB/s)(626MiB/10100msec) 00:17:04.173 slat (usec): min=41, max=2087.4k, avg=15969.55, stdev=123909.08 00:17:04.173 clat (msec): min=99, max=5116, avg=1423.72, stdev=972.11 00:17:04.173 lat (msec): min=103, max=5144, avg=1439.69, stdev=984.91 00:17:04.173 clat percentiles (msec): 00:17:04.173 | 1.00th=[ 122], 5.00th=[ 667], 10.00th=[ 693], 20.00th=[ 751], 00:17:04.173 | 30.00th=[ 844], 40.00th=[ 978], 50.00th=[ 1011], 60.00th=[ 1099], 00:17:04.173 | 70.00th=[ 1150], 80.00th=[ 2467], 90.00th=[ 2903], 95.00th=[ 3037], 00:17:04.173 | 99.00th=[ 4279], 99.50th=[ 4329], 99.90th=[ 5134], 99.95th=[ 5134], 00:17:04.173 | 99.99th=[ 5134] 00:17:04.173 bw ( KiB/s): min=18177, max=188416, per=3.39%, avg=113521.89, stdev=63255.53, samples=9 00:17:04.173 iops : min= 17, max= 184, avg=110.78, stdev=61.91, samples=9 00:17:04.173 lat (msec) : 100=0.16%, 250=1.28%, 750=19.01%, 1000=28.43%, 2000=25.88% 00:17:04.173 lat (msec) : >=2000=25.24% 00:17:04.173 cpu : usr=0.01%, sys=1.07%, ctx=1023, majf=0, minf=32769 00:17:04.173 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.3%, 16=2.6%, 32=5.1%, >=64=89.9% 00:17:04.173 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.173 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:17:04.173 issued rwts: total=626,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.173 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.173 job3: (groupid=0, jobs=1): err= 0: pid=3346634: Fri Apr 26 15:46:00 2024 00:17:04.173 read: IOPS=91, BW=91.2MiB/s (95.6MB/s)(919MiB/10081msec) 00:17:04.173 slat (usec): min=40, max=2854.5k, avg=10899.32, stdev=94854.66 00:17:04.173 clat (msec): min=58, max=3928, avg=1316.23, stdev=996.72 00:17:04.173 lat (msec): min=115, max=3930, avg=1327.13, stdev=999.75 00:17:04.173 clat percentiles (msec): 00:17:04.173 | 1.00th=[ 201], 5.00th=[ 523], 10.00th=[ 584], 20.00th=[ 726], 00:17:04.173 | 30.00th=[ 860], 40.00th=[ 953], 50.00th=[ 1028], 60.00th=[ 1099], 00:17:04.173 | 70.00th=[ 1167], 80.00th=[ 1250], 90.00th=[ 3641], 95.00th=[ 3809], 00:17:04.173 | 99.00th=[ 3910], 99.50th=[ 3910], 99.90th=[ 3943], 99.95th=[ 3943], 00:17:04.173 | 99.99th=[ 3943] 00:17:04.173 bw ( KiB/s): min=91976, max=237568, per=3.72%, avg=124577.38, stdev=41547.24, samples=13 00:17:04.173 iops : min= 89, max= 232, avg=121.54, stdev=40.61, samples=13 00:17:04.173 lat (msec) : 100=0.11%, 250=1.63%, 500=2.72%, 750=17.30%, 1000=23.50% 00:17:04.173 lat (msec) : 2000=40.91%, >=2000=13.82% 00:17:04.173 cpu : usr=0.05%, sys=2.15%, ctx=1276, majf=0, minf=32769 00:17:04.173 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.9%, 16=1.7%, 32=3.5%, >=64=93.1% 00:17:04.173 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.173 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:04.173 issued rwts: total=919,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.173 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.173 job3: (groupid=0, jobs=1): err= 0: pid=3346635: Fri Apr 26 15:46:00 2024 00:17:04.173 read: IOPS=15, BW=15.5MiB/s (16.2MB/s)(156MiB/10071msec) 00:17:04.173 slat (usec): min=51, max=2099.9k, avg=64140.70, stdev=298832.96 00:17:04.173 clat (msec): min=63, max=9904, avg=3352.22, stdev=3807.34 00:17:04.173 lat (msec): min=70, max=9910, avg=3416.36, stdev=3835.71 00:17:04.173 clat percentiles (msec): 00:17:04.173 | 1.00th=[ 71], 5.00th=[ 100], 10.00th=[ 197], 20.00th=[ 584], 00:17:04.173 | 30.00th=[ 919], 40.00th=[ 1183], 50.00th=[ 1469], 60.00th=[ 1670], 00:17:04.173 | 70.00th=[ 2165], 80.00th=[ 9731], 90.00th=[ 9866], 95.00th=[ 9866], 00:17:04.173 | 99.00th=[ 9866], 99.50th=[ 9866], 99.90th=[ 9866], 99.95th=[ 9866], 00:17:04.173 | 99.99th=[ 9866] 00:17:04.173 bw ( KiB/s): min=59392, max=59392, per=1.77%, avg=59392.00, stdev= 0.00, samples=1 00:17:04.173 iops : min= 58, max= 58, avg=58.00, stdev= 0.00, samples=1 00:17:04.173 lat (msec) : 100=5.13%, 250=5.77%, 500=7.69%, 750=7.05%, 1000=7.69% 00:17:04.173 lat (msec) : 2000=33.33%, >=2000=33.33% 00:17:04.173 cpu : usr=0.01%, sys=0.85%, ctx=563, majf=0, minf=32769 00:17:04.173 IO depths : 1=0.6%, 2=1.3%, 4=2.6%, 8=5.1%, 16=10.3%, 32=20.5%, >=64=59.6% 00:17:04.173 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.173 complete : 0=0.0%, 4=96.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=3.3% 00:17:04.173 issued rwts: total=156,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.173 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.173 job3: (groupid=0, jobs=1): err= 0: pid=3346636: Fri Apr 26 15:46:00 2024 00:17:04.173 read: IOPS=34, BW=34.1MiB/s (35.8MB/s)(345MiB/10106msec) 00:17:04.173 slat (usec): min=52, max=2089.9k, avg=29158.73, stdev=199393.89 00:17:04.173 clat (msec): min=43, max=6687, avg=1644.15, stdev=1275.51 00:17:04.173 lat (msec): min=106, max=6694, avg=1673.31, stdev=1316.18 00:17:04.173 clat percentiles (msec): 00:17:04.173 | 1.00th=[ 116], 5.00th=[ 693], 10.00th=[ 701], 20.00th=[ 735], 00:17:04.173 | 30.00th=[ 802], 40.00th=[ 835], 50.00th=[ 927], 60.00th=[ 2198], 00:17:04.173 | 70.00th=[ 2433], 80.00th=[ 2601], 90.00th=[ 2735], 95.00th=[ 3239], 00:17:04.173 | 99.00th=[ 6678], 99.50th=[ 6678], 99.90th=[ 6678], 99.95th=[ 6678], 00:17:04.173 | 99.99th=[ 6678] 00:17:04.173 bw ( KiB/s): min=32572, max=174080, per=3.31%, avg=111055.00, stdev=61281.40, samples=4 00:17:04.173 iops : min= 31, max= 170, avg=108.25, stdev=60.19, samples=4 00:17:04.173 lat (msec) : 50=0.29%, 250=4.64%, 750=17.39%, 1000=33.62%, 2000=2.90% 00:17:04.173 lat (msec) : >=2000=41.16% 00:17:04.173 cpu : usr=0.03%, sys=0.89%, ctx=728, majf=0, minf=32769 00:17:04.173 IO depths : 1=0.3%, 2=0.6%, 4=1.2%, 8=2.3%, 16=4.6%, 32=9.3%, >=64=81.7% 00:17:04.173 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.173 complete : 0=0.0%, 4=99.5%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.5% 00:17:04.173 issued rwts: total=345,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.173 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.173 job3: (groupid=0, jobs=1): err= 0: pid=3346637: Fri Apr 26 15:46:00 2024 00:17:04.173 read: IOPS=19, BW=19.8MiB/s (20.8MB/s)(200MiB/10102msec) 00:17:04.173 slat (usec): min=516, max=2139.3k, avg=50190.11, stdev=271916.22 00:17:04.173 clat (msec): min=62, max=9372, avg=2146.37, stdev=2894.18 00:17:04.173 lat (msec): min=119, max=9379, avg=2196.56, stdev=2936.41 00:17:04.173 clat percentiles (msec): 00:17:04.173 | 1.00th=[ 120], 5.00th=[ 199], 10.00th=[ 288], 20.00th=[ 518], 00:17:04.173 | 30.00th=[ 760], 40.00th=[ 995], 50.00th=[ 1167], 60.00th=[ 1351], 00:17:04.174 | 70.00th=[ 1401], 80.00th=[ 1469], 90.00th=[ 9194], 95.00th=[ 9329], 00:17:04.174 | 99.00th=[ 9329], 99.50th=[ 9329], 99.90th=[ 9329], 99.95th=[ 9329], 00:17:04.174 | 99.99th=[ 9329] 00:17:04.174 bw ( KiB/s): min=61440, max=85844, per=2.20%, avg=73642.00, stdev=17256.23, samples=2 00:17:04.174 iops : min= 60, max= 83, avg=71.50, stdev=16.26, samples=2 00:17:04.174 lat (msec) : 100=0.50%, 250=8.00%, 500=10.50%, 750=9.50%, 1000=13.00% 00:17:04.174 lat (msec) : 2000=43.00%, >=2000=15.50% 00:17:04.174 cpu : usr=0.01%, sys=0.91%, ctx=479, majf=0, minf=32769 00:17:04.174 IO depths : 1=0.5%, 2=1.0%, 4=2.0%, 8=4.0%, 16=8.0%, 32=16.0%, >=64=68.5% 00:17:04.174 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.174 complete : 0=0.0%, 4=98.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=1.4% 00:17:04.174 issued rwts: total=200,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.174 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.174 job3: (groupid=0, jobs=1): err= 0: pid=3346638: Fri Apr 26 15:46:00 2024 00:17:04.174 read: IOPS=109, BW=109MiB/s (114MB/s)(1102MiB/10092msec) 00:17:04.174 slat (usec): min=40, max=1977.9k, avg=9082.66, stdev=92170.29 00:17:04.174 clat (msec): min=76, max=6424, avg=753.26, stdev=1160.87 00:17:04.174 lat (msec): min=159, max=6430, avg=762.34, stdev=1178.21 00:17:04.174 clat percentiles (msec): 00:17:04.174 | 1.00th=[ 239], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 245], 00:17:04.174 | 30.00th=[ 245], 40.00th=[ 247], 50.00th=[ 251], 60.00th=[ 284], 00:17:04.174 | 70.00th=[ 372], 80.00th=[ 1011], 90.00th=[ 2022], 95.00th=[ 2500], 00:17:04.174 | 99.00th=[ 5873], 99.50th=[ 5873], 99.90th=[ 5873], 99.95th=[ 6409], 00:17:04.174 | 99.99th=[ 6409] 00:17:04.174 bw ( KiB/s): min=36864, max=518144, per=6.61%, avg=221639.11, stdev=208616.67, samples=9 00:17:04.174 iops : min= 36, max= 506, avg=216.44, stdev=203.73, samples=9 00:17:04.174 lat (msec) : 100=0.09%, 250=48.46%, 500=27.31%, 750=1.54%, 1000=2.54% 00:17:04.174 lat (msec) : 2000=9.89%, >=2000=10.16% 00:17:04.174 cpu : usr=0.02%, sys=1.58%, ctx=1366, majf=0, minf=32769 00:17:04.174 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.7%, 16=1.5%, 32=2.9%, >=64=94.3% 00:17:04.174 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.174 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:04.174 issued rwts: total=1102,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.174 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.174 job3: (groupid=0, jobs=1): err= 0: pid=3346639: Fri Apr 26 15:46:00 2024 00:17:04.174 read: IOPS=16, BW=16.2MiB/s (16.9MB/s)(163MiB/10084msec) 00:17:04.174 slat (usec): min=121, max=2128.5k, avg=61373.55, stdev=298888.33 00:17:04.174 clat (msec): min=78, max=9862, avg=2524.88, stdev=3567.52 00:17:04.174 lat (msec): min=84, max=9865, avg=2586.26, stdev=3609.38 00:17:04.174 clat percentiles (msec): 00:17:04.174 | 1.00th=[ 85], 5.00th=[ 144], 10.00th=[ 184], 20.00th=[ 262], 00:17:04.174 | 30.00th=[ 351], 40.00th=[ 472], 50.00th=[ 869], 60.00th=[ 1284], 00:17:04.174 | 70.00th=[ 1720], 80.00th=[ 4178], 90.00th=[ 9866], 95.00th=[ 9866], 00:17:04.174 | 99.00th=[ 9866], 99.50th=[ 9866], 99.90th=[ 9866], 99.95th=[ 9866], 00:17:04.174 | 99.99th=[ 9866] 00:17:04.174 bw ( KiB/s): min=73728, max=73728, per=2.20%, avg=73728.00, stdev= 0.00, samples=1 00:17:04.174 iops : min= 72, max= 72, avg=72.00, stdev= 0.00, samples=1 00:17:04.174 lat (msec) : 100=1.23%, 250=17.79%, 500=21.47%, 750=6.75%, 1000=6.13% 00:17:04.174 lat (msec) : 2000=21.47%, >=2000=25.15% 00:17:04.174 cpu : usr=0.00%, sys=1.10%, ctx=525, majf=0, minf=32769 00:17:04.174 IO depths : 1=0.6%, 2=1.2%, 4=2.5%, 8=4.9%, 16=9.8%, 32=19.6%, >=64=61.3% 00:17:04.174 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.174 complete : 0=0.0%, 4=97.3%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=2.7% 00:17:04.174 issued rwts: total=163,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.174 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.174 job4: (groupid=0, jobs=1): err= 0: pid=3346641: Fri Apr 26 15:46:00 2024 00:17:04.174 read: IOPS=152, BW=153MiB/s (160MB/s)(1549MiB/10132msec) 00:17:04.174 slat (usec): min=38, max=2064.1k, avg=6469.91, stdev=61981.50 00:17:04.174 clat (msec): min=105, max=2530, avg=713.77, stdev=626.69 00:17:04.174 lat (msec): min=258, max=2532, avg=720.24, stdev=629.30 00:17:04.174 clat percentiles (msec): 00:17:04.174 | 1.00th=[ 257], 5.00th=[ 259], 10.00th=[ 259], 20.00th=[ 262], 00:17:04.174 | 30.00th=[ 266], 40.00th=[ 271], 50.00th=[ 592], 60.00th=[ 684], 00:17:04.174 | 70.00th=[ 735], 80.00th=[ 927], 90.00th=[ 2198], 95.00th=[ 2366], 00:17:04.174 | 99.00th=[ 2500], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], 00:17:04.174 | 99.99th=[ 2534] 00:17:04.174 bw ( KiB/s): min=83968, max=499712, per=7.23%, avg=242501.25, stdev=149592.46, samples=12 00:17:04.174 iops : min= 82, max= 488, avg=236.75, stdev=146.16, samples=12 00:17:04.174 lat (msec) : 250=0.06%, 500=46.61%, 750=24.79%, 1000=10.59%, 2000=7.81% 00:17:04.174 lat (msec) : >=2000=10.14% 00:17:04.174 cpu : usr=0.08%, sys=1.78%, ctx=2192, majf=0, minf=32769 00:17:04.174 IO depths : 1=0.1%, 2=0.1%, 4=0.3%, 8=0.5%, 16=1.0%, 32=2.1%, >=64=95.9% 00:17:04.174 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.174 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:04.174 issued rwts: total=1549,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.174 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.174 job4: (groupid=0, jobs=1): err= 0: pid=3346642: Fri Apr 26 15:46:00 2024 00:17:04.174 read: IOPS=74, BW=74.4MiB/s (78.0MB/s)(754MiB/10130msec) 00:17:04.174 slat (usec): min=40, max=2083.2k, avg=13305.90, stdev=113058.94 00:17:04.174 clat (msec): min=92, max=6768, avg=798.14, stdev=924.70 00:17:04.174 lat (msec): min=137, max=6819, avg=811.44, stdev=951.52 00:17:04.174 clat percentiles (msec): 00:17:04.174 | 1.00th=[ 186], 5.00th=[ 284], 10.00th=[ 401], 20.00th=[ 451], 00:17:04.174 | 30.00th=[ 506], 40.00th=[ 518], 50.00th=[ 523], 60.00th=[ 527], 00:17:04.174 | 70.00th=[ 651], 80.00th=[ 1083], 90.00th=[ 1250], 95.00th=[ 1301], 00:17:04.174 | 99.00th=[ 6745], 99.50th=[ 6745], 99.90th=[ 6745], 99.95th=[ 6745], 00:17:04.174 | 99.99th=[ 6745] 00:17:04.174 bw ( KiB/s): min=40878, max=284672, per=5.46%, avg=183138.00, stdev=97178.54, samples=7 00:17:04.174 iops : min= 39, max= 278, avg=178.71, stdev=95.13, samples=7 00:17:04.174 lat (msec) : 100=0.13%, 250=3.05%, 500=25.60%, 750=42.97%, 1000=5.97% 00:17:04.174 lat (msec) : 2000=19.23%, >=2000=3.05% 00:17:04.174 cpu : usr=0.07%, sys=1.53%, ctx=1216, majf=0, minf=32769 00:17:04.174 IO depths : 1=0.1%, 2=0.3%, 4=0.5%, 8=1.1%, 16=2.1%, 32=4.2%, >=64=91.6% 00:17:04.174 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.174 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:17:04.174 issued rwts: total=754,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.174 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.174 job4: (groupid=0, jobs=1): err= 0: pid=3346643: Fri Apr 26 15:46:00 2024 00:17:04.174 read: IOPS=81, BW=81.5MiB/s (85.5MB/s)(829MiB/10166msec) 00:17:04.174 slat (usec): min=56, max=2064.9k, avg=12128.28, stdev=95336.20 00:17:04.174 clat (msec): min=108, max=5204, avg=1503.15, stdev=1422.39 00:17:04.174 lat (msec): min=396, max=5215, avg=1515.27, stdev=1425.49 00:17:04.174 clat percentiles (msec): 00:17:04.174 | 1.00th=[ 397], 5.00th=[ 397], 10.00th=[ 460], 20.00th=[ 651], 00:17:04.174 | 30.00th=[ 701], 40.00th=[ 743], 50.00th=[ 835], 60.00th=[ 1167], 00:17:04.174 | 70.00th=[ 1485], 80.00th=[ 1703], 90.00th=[ 4665], 95.00th=[ 5000], 00:17:04.174 | 99.00th=[ 5134], 99.50th=[ 5201], 99.90th=[ 5201], 99.95th=[ 5201], 00:17:04.174 | 99.99th=[ 5201] 00:17:04.174 bw ( KiB/s): min=10240, max=206848, per=3.29%, avg=110448.00, stdev=67462.49, samples=13 00:17:04.174 iops : min= 10, max= 202, avg=107.85, stdev=65.89, samples=13 00:17:04.174 lat (msec) : 250=0.12%, 500=11.34%, 750=29.55%, 1000=14.60%, 2000=28.47% 00:17:04.174 lat (msec) : >=2000=15.92% 00:17:04.174 cpu : usr=0.05%, sys=1.60%, ctx=1950, majf=0, minf=32769 00:17:04.174 IO depths : 1=0.1%, 2=0.2%, 4=0.5%, 8=1.0%, 16=1.9%, 32=3.9%, >=64=92.4% 00:17:04.174 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.174 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:04.174 issued rwts: total=829,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.174 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.174 job4: (groupid=0, jobs=1): err= 0: pid=3346644: Fri Apr 26 15:46:00 2024 00:17:04.174 read: IOPS=111, BW=111MiB/s (117MB/s)(1126MiB/10119msec) 00:17:04.174 slat (usec): min=35, max=2067.4k, avg=8922.54, stdev=102012.94 00:17:04.174 clat (msec): min=65, max=5957, avg=882.93, stdev=1389.09 00:17:04.174 lat (msec): min=173, max=5959, avg=891.85, stdev=1397.28 00:17:04.174 clat percentiles (msec): 00:17:04.174 | 1.00th=[ 174], 5.00th=[ 257], 10.00th=[ 259], 20.00th=[ 262], 00:17:04.174 | 30.00th=[ 264], 40.00th=[ 266], 50.00th=[ 268], 60.00th=[ 300], 00:17:04.174 | 70.00th=[ 388], 80.00th=[ 634], 90.00th=[ 2232], 95.00th=[ 5470], 00:17:04.174 | 99.00th=[ 5805], 99.50th=[ 5873], 99.90th=[ 5940], 99.95th=[ 5940], 00:17:04.174 | 99.99th=[ 5940] 00:17:04.174 bw ( KiB/s): min=32768, max=497664, per=8.71%, avg=291844.29, stdev=192011.02, samples=7 00:17:04.174 iops : min= 32, max= 486, avg=285.00, stdev=187.51, samples=7 00:17:04.174 lat (msec) : 100=0.09%, 250=1.42%, 500=74.69%, 750=4.44%, 2000=4.44% 00:17:04.174 lat (msec) : >=2000=14.92% 00:17:04.174 cpu : usr=0.10%, sys=1.66%, ctx=1080, majf=0, minf=32769 00:17:04.174 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.7%, 16=1.4%, 32=2.8%, >=64=94.4% 00:17:04.174 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.174 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:04.174 issued rwts: total=1126,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.174 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.174 job4: (groupid=0, jobs=1): err= 0: pid=3346645: Fri Apr 26 15:46:00 2024 00:17:04.174 read: IOPS=16, BW=16.4MiB/s (17.1MB/s)(165MiB/10090msec) 00:17:04.174 slat (usec): min=1588, max=2069.6k, avg=60688.89, stdev=275687.09 00:17:04.174 clat (msec): min=74, max=7634, avg=3880.33, stdev=1653.33 00:17:04.174 lat (msec): min=90, max=7650, avg=3941.02, stdev=1648.32 00:17:04.174 clat percentiles (msec): 00:17:04.174 | 1.00th=[ 90], 5.00th=[ 2265], 10.00th=[ 2400], 20.00th=[ 2668], 00:17:04.174 | 30.00th=[ 2970], 40.00th=[ 3272], 50.00th=[ 3507], 60.00th=[ 3876], 00:17:04.174 | 70.00th=[ 4144], 80.00th=[ 4245], 90.00th=[ 7013], 95.00th=[ 7080], 00:17:04.174 | 99.00th=[ 7617], 99.50th=[ 7617], 99.90th=[ 7617], 99.95th=[ 7617], 00:17:04.174 | 99.99th=[ 7617] 00:17:04.175 bw ( KiB/s): min= 8192, max=43008, per=0.75%, avg=25258.67, stdev=17418.04, samples=3 00:17:04.175 iops : min= 8, max= 42, avg=24.67, stdev=17.01, samples=3 00:17:04.175 lat (msec) : 100=1.21%, 250=1.82%, >=2000=96.97% 00:17:04.175 cpu : usr=0.03%, sys=0.94%, ctx=816, majf=0, minf=32769 00:17:04.175 IO depths : 1=0.6%, 2=1.2%, 4=2.4%, 8=4.8%, 16=9.7%, 32=19.4%, >=64=61.8% 00:17:04.175 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.175 complete : 0=0.0%, 4=97.4%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=2.6% 00:17:04.175 issued rwts: total=165,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.175 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.175 job4: (groupid=0, jobs=1): err= 0: pid=3346646: Fri Apr 26 15:46:00 2024 00:17:04.175 read: IOPS=97, BW=97.2MiB/s (102MB/s)(983MiB/10114msec) 00:17:04.175 slat (usec): min=45, max=2062.9k, avg=10169.59, stdev=88711.62 00:17:04.175 clat (msec): min=111, max=4887, avg=1248.90, stdev=1268.64 00:17:04.175 lat (msec): min=414, max=4909, avg=1259.07, stdev=1271.76 00:17:04.175 clat percentiles (msec): 00:17:04.175 | 1.00th=[ 422], 5.00th=[ 456], 10.00th=[ 493], 20.00th=[ 550], 00:17:04.175 | 30.00th=[ 651], 40.00th=[ 726], 50.00th=[ 793], 60.00th=[ 911], 00:17:04.175 | 70.00th=[ 995], 80.00th=[ 1083], 90.00th=[ 4279], 95.00th=[ 4597], 00:17:04.175 | 99.00th=[ 4866], 99.50th=[ 4866], 99.90th=[ 4866], 99.95th=[ 4866], 00:17:04.175 | 99.99th=[ 4866] 00:17:04.175 bw ( KiB/s): min= 2048, max=253952, per=3.73%, avg=125177.57, stdev=74778.31, samples=14 00:17:04.175 iops : min= 2, max= 248, avg=122.14, stdev=73.00, samples=14 00:17:04.175 lat (msec) : 250=0.10%, 500=10.68%, 750=31.13%, 1000=28.69%, 2000=16.07% 00:17:04.175 lat (msec) : >=2000=13.33% 00:17:04.175 cpu : usr=0.09%, sys=1.54%, ctx=1172, majf=0, minf=32769 00:17:04.175 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.8%, 16=1.6%, 32=3.3%, >=64=93.6% 00:17:04.175 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.175 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:04.175 issued rwts: total=983,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.175 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.175 job4: (groupid=0, jobs=1): err= 0: pid=3346647: Fri Apr 26 15:46:00 2024 00:17:04.175 read: IOPS=63, BW=63.8MiB/s (66.8MB/s)(647MiB/10149msec) 00:17:04.175 slat (usec): min=101, max=2111.0k, avg=15513.72, stdev=112734.02 00:17:04.175 clat (msec): min=107, max=5099, avg=1856.29, stdev=1452.22 00:17:04.175 lat (msec): min=603, max=5110, avg=1871.80, stdev=1452.90 00:17:04.175 clat percentiles (msec): 00:17:04.175 | 1.00th=[ 609], 5.00th=[ 709], 10.00th=[ 760], 20.00th=[ 827], 00:17:04.175 | 30.00th=[ 860], 40.00th=[ 1011], 50.00th=[ 1267], 60.00th=[ 1401], 00:17:04.175 | 70.00th=[ 1804], 80.00th=[ 2333], 90.00th=[ 4665], 95.00th=[ 4866], 00:17:04.175 | 99.00th=[ 5067], 99.50th=[ 5067], 99.90th=[ 5067], 99.95th=[ 5067], 00:17:04.175 | 99.99th=[ 5067] 00:17:04.175 bw ( KiB/s): min= 6144, max=167936, per=2.88%, avg=96647.00, stdev=56744.95, samples=11 00:17:04.175 iops : min= 6, max= 164, avg=94.27, stdev=55.45, samples=11 00:17:04.175 lat (msec) : 250=0.15%, 750=9.12%, 1000=30.60%, 2000=33.69%, >=2000=26.43% 00:17:04.175 cpu : usr=0.04%, sys=1.25%, ctx=1784, majf=0, minf=32769 00:17:04.175 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.2%, 16=2.5%, 32=4.9%, >=64=90.3% 00:17:04.175 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.175 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:17:04.175 issued rwts: total=647,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.175 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.175 job4: (groupid=0, jobs=1): err= 0: pid=3346648: Fri Apr 26 15:46:00 2024 00:17:04.175 read: IOPS=70, BW=70.1MiB/s (73.5MB/s)(715MiB/10198msec) 00:17:04.175 slat (usec): min=31, max=2143.9k, avg=14096.73, stdev=112220.75 00:17:04.175 clat (msec): min=115, max=4954, avg=1729.95, stdev=1481.84 00:17:04.175 lat (msec): min=540, max=4966, avg=1744.05, stdev=1483.46 00:17:04.175 clat percentiles (msec): 00:17:04.175 | 1.00th=[ 542], 5.00th=[ 558], 10.00th=[ 584], 20.00th=[ 634], 00:17:04.175 | 30.00th=[ 693], 40.00th=[ 735], 50.00th=[ 978], 60.00th=[ 1452], 00:17:04.175 | 70.00th=[ 2005], 80.00th=[ 2232], 90.00th=[ 4665], 95.00th=[ 4866], 00:17:04.175 | 99.00th=[ 4933], 99.50th=[ 4933], 99.90th=[ 4933], 99.95th=[ 4933], 00:17:04.175 | 99.99th=[ 4933] 00:17:04.175 bw ( KiB/s): min= 2048, max=225280, per=3.26%, avg=109238.09, stdev=75403.29, samples=11 00:17:04.175 iops : min= 2, max= 220, avg=106.55, stdev=73.58, samples=11 00:17:04.175 lat (msec) : 250=0.14%, 750=41.40%, 1000=9.51%, 2000=19.16%, >=2000=29.79% 00:17:04.175 cpu : usr=0.02%, sys=1.40%, ctx=1831, majf=0, minf=32135 00:17:04.175 IO depths : 1=0.1%, 2=0.3%, 4=0.6%, 8=1.1%, 16=2.2%, 32=4.5%, >=64=91.2% 00:17:04.175 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.175 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:17:04.175 issued rwts: total=715,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.175 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.175 job4: (groupid=0, jobs=1): err= 0: pid=3346649: Fri Apr 26 15:46:00 2024 00:17:04.175 read: IOPS=52, BW=52.3MiB/s (54.8MB/s)(528MiB/10103msec) 00:17:04.175 slat (usec): min=35, max=2151.7k, avg=18976.25, stdev=133200.61 00:17:04.175 clat (msec): min=81, max=5297, avg=1925.56, stdev=1621.11 00:17:04.175 lat (msec): min=106, max=5300, avg=1944.53, stdev=1623.18 00:17:04.175 clat percentiles (msec): 00:17:04.175 | 1.00th=[ 609], 5.00th=[ 617], 10.00th=[ 634], 20.00th=[ 659], 00:17:04.175 | 30.00th=[ 894], 40.00th=[ 944], 50.00th=[ 1150], 60.00th=[ 1267], 00:17:04.175 | 70.00th=[ 1620], 80.00th=[ 4212], 90.00th=[ 4799], 95.00th=[ 5000], 00:17:04.175 | 99.00th=[ 5269], 99.50th=[ 5269], 99.90th=[ 5269], 99.95th=[ 5269], 00:17:04.175 | 99.99th=[ 5269] 00:17:04.175 bw ( KiB/s): min= 2048, max=212566, per=2.44%, avg=81849.60, stdev=75544.47, samples=10 00:17:04.175 iops : min= 2, max= 207, avg=79.80, stdev=73.60, samples=10 00:17:04.175 lat (msec) : 100=0.19%, 250=0.19%, 750=22.35%, 1000=19.32%, 2000=31.63% 00:17:04.175 lat (msec) : >=2000=26.33% 00:17:04.175 cpu : usr=0.00%, sys=1.03%, ctx=1658, majf=0, minf=32769 00:17:04.175 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.5%, 16=3.0%, 32=6.1%, >=64=88.1% 00:17:04.175 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.175 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:17:04.175 issued rwts: total=528,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.175 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.175 job4: (groupid=0, jobs=1): err= 0: pid=3346650: Fri Apr 26 15:46:00 2024 00:17:04.175 read: IOPS=70, BW=70.7MiB/s (74.2MB/s)(718MiB/10151msec) 00:17:04.175 slat (usec): min=65, max=2125.4k, avg=13984.36, stdev=110831.61 00:17:04.175 clat (msec): min=106, max=5015, avg=1628.09, stdev=1443.48 00:17:04.175 lat (msec): min=615, max=5021, avg=1642.07, stdev=1445.01 00:17:04.175 clat percentiles (msec): 00:17:04.175 | 1.00th=[ 634], 5.00th=[ 667], 10.00th=[ 684], 20.00th=[ 726], 00:17:04.175 | 30.00th=[ 743], 40.00th=[ 760], 50.00th=[ 927], 60.00th=[ 1200], 00:17:04.175 | 70.00th=[ 1485], 80.00th=[ 1636], 90.00th=[ 4597], 95.00th=[ 4799], 00:17:04.175 | 99.00th=[ 5000], 99.50th=[ 5000], 99.90th=[ 5000], 99.95th=[ 5000], 00:17:04.175 | 99.99th=[ 5000] 00:17:04.175 bw ( KiB/s): min= 2048, max=181908, per=3.60%, avg=120795.60, stdev=59479.68, samples=10 00:17:04.175 iops : min= 2, max= 177, avg=117.90, stdev=58.01, samples=10 00:17:04.175 lat (msec) : 250=0.14%, 750=34.96%, 1000=18.11%, 2000=28.97%, >=2000=17.83% 00:17:04.175 cpu : usr=0.01%, sys=1.28%, ctx=1714, majf=0, minf=32769 00:17:04.175 IO depths : 1=0.1%, 2=0.3%, 4=0.6%, 8=1.1%, 16=2.2%, 32=4.5%, >=64=91.2% 00:17:04.175 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.175 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:17:04.175 issued rwts: total=718,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.175 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.175 job4: (groupid=0, jobs=1): err= 0: pid=3346651: Fri Apr 26 15:46:00 2024 00:17:04.175 read: IOPS=25, BW=25.3MiB/s (26.6MB/s)(255MiB/10069msec) 00:17:04.175 slat (usec): min=540, max=2083.2k, avg=39221.07, stdev=227242.77 00:17:04.175 clat (msec): min=65, max=6679, avg=2537.95, stdev=1484.55 00:17:04.175 lat (msec): min=72, max=6691, avg=2577.17, stdev=1497.12 00:17:04.175 clat percentiles (msec): 00:17:04.175 | 1.00th=[ 106], 5.00th=[ 1200], 10.00th=[ 1217], 20.00th=[ 1234], 00:17:04.175 | 30.00th=[ 1267], 40.00th=[ 2140], 50.00th=[ 2467], 60.00th=[ 2702], 00:17:04.175 | 70.00th=[ 2970], 80.00th=[ 3171], 90.00th=[ 5403], 95.00th=[ 6611], 00:17:04.175 | 99.00th=[ 6678], 99.50th=[ 6678], 99.90th=[ 6678], 99.95th=[ 6678], 00:17:04.175 | 99.99th=[ 6678] 00:17:04.175 bw ( KiB/s): min= 6144, max=112640, per=1.95%, avg=65536.00, stdev=44336.56, samples=4 00:17:04.175 iops : min= 6, max= 110, avg=64.00, stdev=43.30, samples=4 00:17:04.175 lat (msec) : 100=0.78%, 250=0.39%, 2000=37.25%, >=2000=61.57% 00:17:04.175 cpu : usr=0.00%, sys=1.02%, ctx=773, majf=0, minf=32769 00:17:04.175 IO depths : 1=0.4%, 2=0.8%, 4=1.6%, 8=3.1%, 16=6.3%, 32=12.5%, >=64=75.3% 00:17:04.175 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.175 complete : 0=0.0%, 4=99.2%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.8% 00:17:04.175 issued rwts: total=255,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.175 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.175 job4: (groupid=0, jobs=1): err= 0: pid=3346652: Fri Apr 26 15:46:00 2024 00:17:04.175 read: IOPS=139, BW=139MiB/s (146MB/s)(1403MiB/10091msec) 00:17:04.175 slat (usec): min=38, max=2057.6k, avg=7131.41, stdev=78195.14 00:17:04.175 clat (msec): min=80, max=4845, avg=847.76, stdev=1216.55 00:17:04.175 lat (msec): min=97, max=4847, avg=854.89, stdev=1221.29 00:17:04.175 clat percentiles (msec): 00:17:04.175 | 1.00th=[ 215], 5.00th=[ 249], 10.00th=[ 251], 20.00th=[ 253], 00:17:04.175 | 30.00th=[ 255], 40.00th=[ 262], 50.00th=[ 384], 60.00th=[ 617], 00:17:04.175 | 70.00th=[ 625], 80.00th=[ 676], 90.00th=[ 2400], 95.00th=[ 4665], 00:17:04.175 | 99.00th=[ 4799], 99.50th=[ 4866], 99.90th=[ 4866], 99.95th=[ 4866], 00:17:04.175 | 99.99th=[ 4866] 00:17:04.175 bw ( KiB/s): min=14336, max=516096, per=7.09%, avg=237568.00, stdev=169667.87, samples=11 00:17:04.175 iops : min= 14, max= 504, avg=232.00, stdev=165.69, samples=11 00:17:04.175 lat (msec) : 100=0.14%, 250=9.41%, 500=46.83%, 750=25.59%, 1000=2.14% 00:17:04.175 lat (msec) : 2000=5.70%, >=2000=10.19% 00:17:04.175 cpu : usr=0.03%, sys=1.40%, ctx=1431, majf=0, minf=32769 00:17:04.176 IO depths : 1=0.1%, 2=0.1%, 4=0.3%, 8=0.6%, 16=1.1%, 32=2.3%, >=64=95.5% 00:17:04.176 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.176 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:04.176 issued rwts: total=1403,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.176 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.176 job4: (groupid=0, jobs=1): err= 0: pid=3346653: Fri Apr 26 15:46:00 2024 00:17:04.176 read: IOPS=16, BW=16.3MiB/s (17.1MB/s)(165MiB/10119msec) 00:17:04.176 slat (usec): min=1066, max=2076.5k, avg=60607.43, stdev=286749.83 00:17:04.176 clat (msec): min=117, max=7513, avg=3837.78, stdev=1651.44 00:17:04.176 lat (msec): min=120, max=7525, avg=3898.38, stdev=1646.27 00:17:04.176 clat percentiles (msec): 00:17:04.176 | 1.00th=[ 122], 5.00th=[ 2072], 10.00th=[ 2333], 20.00th=[ 2601], 00:17:04.176 | 30.00th=[ 2937], 40.00th=[ 3239], 50.00th=[ 3507], 60.00th=[ 3742], 00:17:04.176 | 70.00th=[ 3977], 80.00th=[ 4178], 90.00th=[ 7349], 95.00th=[ 7483], 00:17:04.176 | 99.00th=[ 7483], 99.50th=[ 7483], 99.90th=[ 7483], 99.95th=[ 7483], 00:17:04.176 | 99.99th=[ 7483] 00:17:04.176 bw ( KiB/s): min= 4096, max=45056, per=0.77%, avg=25922.00, stdev=20612.27, samples=3 00:17:04.176 iops : min= 4, max= 44, avg=25.00, stdev=20.07, samples=3 00:17:04.176 lat (msec) : 250=1.21%, 2000=0.61%, >=2000=98.18% 00:17:04.176 cpu : usr=0.00%, sys=1.10%, ctx=742, majf=0, minf=32769 00:17:04.176 IO depths : 1=0.6%, 2=1.2%, 4=2.4%, 8=4.8%, 16=9.7%, 32=19.4%, >=64=61.8% 00:17:04.176 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.176 complete : 0=0.0%, 4=97.4%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=2.6% 00:17:04.176 issued rwts: total=165,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.176 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.176 job5: (groupid=0, jobs=1): err= 0: pid=3346654: Fri Apr 26 15:46:00 2024 00:17:04.176 read: IOPS=61, BW=61.7MiB/s (64.7MB/s)(625MiB/10137msec) 00:17:04.176 slat (usec): min=88, max=2038.6k, avg=16025.24, stdev=115229.53 00:17:04.176 clat (msec): min=117, max=5258, avg=1890.34, stdev=1492.31 00:17:04.176 lat (msec): min=754, max=5265, avg=1906.37, stdev=1493.11 00:17:04.176 clat percentiles (msec): 00:17:04.176 | 1.00th=[ 751], 5.00th=[ 793], 10.00th=[ 835], 20.00th=[ 860], 00:17:04.176 | 30.00th=[ 986], 40.00th=[ 1183], 50.00th=[ 1351], 60.00th=[ 1385], 00:17:04.176 | 70.00th=[ 1469], 80.00th=[ 3004], 90.00th=[ 4866], 95.00th=[ 5134], 00:17:04.176 | 99.00th=[ 5269], 99.50th=[ 5269], 99.90th=[ 5269], 99.95th=[ 5269], 00:17:04.176 | 99.99th=[ 5269] 00:17:04.176 bw ( KiB/s): min=14336, max=188416, per=3.04%, avg=101822.10, stdev=47929.57, samples=10 00:17:04.176 iops : min= 14, max= 184, avg=99.30, stdev=46.84, samples=10 00:17:04.176 lat (msec) : 250=0.16%, 750=0.16%, 1000=31.68%, 2000=46.56%, >=2000=21.44% 00:17:04.176 cpu : usr=0.03%, sys=1.11%, ctx=1948, majf=0, minf=32769 00:17:04.176 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.3%, 16=2.6%, 32=5.1%, >=64=89.9% 00:17:04.176 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.176 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:17:04.176 issued rwts: total=625,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.176 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.176 job5: (groupid=0, jobs=1): err= 0: pid=3346655: Fri Apr 26 15:46:00 2024 00:17:04.176 read: IOPS=18, BW=18.1MiB/s (19.0MB/s)(183MiB/10097msec) 00:17:04.176 slat (usec): min=84, max=2168.2k, avg=54655.24, stdev=307739.26 00:17:04.176 clat (msec): min=94, max=6070, avg=3632.37, stdev=1476.29 00:17:04.176 lat (msec): min=99, max=6072, avg=3687.02, stdev=1443.68 00:17:04.176 clat percentiles (msec): 00:17:04.176 | 1.00th=[ 100], 5.00th=[ 136], 10.00th=[ 493], 20.00th=[ 2567], 00:17:04.176 | 30.00th=[ 3977], 40.00th=[ 4044], 50.00th=[ 4111], 60.00th=[ 4144], 00:17:04.176 | 70.00th=[ 4178], 80.00th=[ 4245], 90.00th=[ 4732], 95.00th=[ 6074], 00:17:04.176 | 99.00th=[ 6074], 99.50th=[ 6074], 99.90th=[ 6074], 99.95th=[ 6074], 00:17:04.176 | 99.99th=[ 6074] 00:17:04.176 bw ( KiB/s): min=16384, max=73728, per=1.14%, avg=38229.33, stdev=31014.41, samples=3 00:17:04.176 iops : min= 16, max= 72, avg=37.33, stdev=30.29, samples=3 00:17:04.176 lat (msec) : 100=1.09%, 250=5.46%, 500=3.83%, 750=0.55%, 2000=0.55% 00:17:04.176 lat (msec) : >=2000=88.52% 00:17:04.176 cpu : usr=0.01%, sys=0.93%, ctx=191, majf=0, minf=32769 00:17:04.176 IO depths : 1=0.5%, 2=1.1%, 4=2.2%, 8=4.4%, 16=8.7%, 32=17.5%, >=64=65.6% 00:17:04.176 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.176 complete : 0=0.0%, 4=98.2%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=1.8% 00:17:04.176 issued rwts: total=183,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.176 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.176 job5: (groupid=0, jobs=1): err= 0: pid=3346656: Fri Apr 26 15:46:00 2024 00:17:04.176 read: IOPS=125, BW=125MiB/s (131MB/s)(1508MiB/12059msec) 00:17:04.176 slat (usec): min=62, max=2051.5k, avg=6637.85, stdev=53091.77 00:17:04.176 clat (msec): min=255, max=3375, avg=974.35, stdev=844.75 00:17:04.176 lat (msec): min=259, max=3385, avg=980.99, stdev=847.33 00:17:04.176 clat percentiles (msec): 00:17:04.176 | 1.00th=[ 275], 5.00th=[ 334], 10.00th=[ 414], 20.00th=[ 498], 00:17:04.176 | 30.00th=[ 506], 40.00th=[ 510], 50.00th=[ 609], 60.00th=[ 667], 00:17:04.176 | 70.00th=[ 869], 80.00th=[ 1183], 90.00th=[ 2500], 95.00th=[ 3104], 00:17:04.176 | 99.00th=[ 3339], 99.50th=[ 3339], 99.90th=[ 3373], 99.95th=[ 3373], 00:17:04.176 | 99.99th=[ 3373] 00:17:04.176 bw ( KiB/s): min= 1512, max=348160, per=4.96%, avg=166338.35, stdev=102062.96, samples=17 00:17:04.176 iops : min= 1, max= 340, avg=162.41, stdev=99.72, samples=17 00:17:04.176 lat (msec) : 500=26.13%, 750=37.67%, 1000=13.86%, 2000=5.50%, >=2000=16.84% 00:17:04.176 cpu : usr=0.15%, sys=2.03%, ctx=2558, majf=0, minf=32769 00:17:04.176 IO depths : 1=0.1%, 2=0.1%, 4=0.3%, 8=0.5%, 16=1.1%, 32=2.1%, >=64=95.8% 00:17:04.176 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.176 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:04.176 issued rwts: total=1508,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.176 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.176 job5: (groupid=0, jobs=1): err= 0: pid=3346657: Fri Apr 26 15:46:00 2024 00:17:04.176 read: IOPS=108, BW=108MiB/s (113MB/s)(1098MiB/10147msec) 00:17:04.176 slat (usec): min=37, max=2163.4k, avg=9170.56, stdev=82904.71 00:17:04.176 clat (msec): min=72, max=4280, avg=981.22, stdev=1174.83 00:17:04.176 lat (msec): min=179, max=4289, avg=990.39, stdev=1179.45 00:17:04.176 clat percentiles (msec): 00:17:04.176 | 1.00th=[ 380], 5.00th=[ 384], 10.00th=[ 388], 20.00th=[ 388], 00:17:04.176 | 30.00th=[ 409], 40.00th=[ 498], 50.00th=[ 518], 60.00th=[ 567], 00:17:04.176 | 70.00th=[ 718], 80.00th=[ 869], 90.00th=[ 4111], 95.00th=[ 4178], 00:17:04.176 | 99.00th=[ 4245], 99.50th=[ 4245], 99.90th=[ 4279], 99.95th=[ 4279], 00:17:04.176 | 99.99th=[ 4279] 00:17:04.176 bw ( KiB/s): min= 2043, max=339968, per=4.94%, avg=165519.92, stdev=128197.86, samples=12 00:17:04.176 iops : min= 1, max= 332, avg=161.42, stdev=125.42, samples=12 00:17:04.176 lat (msec) : 100=0.09%, 250=0.55%, 500=39.62%, 750=31.79%, 1000=13.02% 00:17:04.176 lat (msec) : 2000=3.01%, >=2000=11.93% 00:17:04.176 cpu : usr=0.05%, sys=1.32%, ctx=1517, majf=0, minf=32769 00:17:04.176 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.7%, 16=1.5%, 32=2.9%, >=64=94.3% 00:17:04.176 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.176 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:04.176 issued rwts: total=1098,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.176 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.176 job5: (groupid=0, jobs=1): err= 0: pid=3346658: Fri Apr 26 15:46:00 2024 00:17:04.176 read: IOPS=83, BW=83.6MiB/s (87.6MB/s)(843MiB/10089msec) 00:17:04.176 slat (usec): min=35, max=2093.0k, avg=11927.49, stdev=91731.94 00:17:04.176 clat (msec): min=29, max=4775, avg=1409.79, stdev=1125.57 00:17:04.176 lat (msec): min=110, max=4780, avg=1421.71, stdev=1128.48 00:17:04.176 clat percentiles (msec): 00:17:04.176 | 1.00th=[ 489], 5.00th=[ 514], 10.00th=[ 558], 20.00th=[ 659], 00:17:04.176 | 30.00th=[ 776], 40.00th=[ 919], 50.00th=[ 1020], 60.00th=[ 1083], 00:17:04.176 | 70.00th=[ 1334], 80.00th=[ 1955], 90.00th=[ 2937], 95.00th=[ 4597], 00:17:04.176 | 99.00th=[ 4732], 99.50th=[ 4732], 99.90th=[ 4799], 99.95th=[ 4799], 00:17:04.176 | 99.99th=[ 4799] 00:17:04.176 bw ( KiB/s): min= 8192, max=247808, per=3.36%, avg=112640.00, stdev=74571.76, samples=13 00:17:04.176 iops : min= 8, max= 242, avg=110.00, stdev=72.82, samples=13 00:17:04.176 lat (msec) : 50=0.12%, 250=0.47%, 500=2.14%, 750=25.86%, 1000=18.86% 00:17:04.176 lat (msec) : 2000=33.21%, >=2000=19.34% 00:17:04.176 cpu : usr=0.01%, sys=1.30%, ctx=1761, majf=0, minf=32769 00:17:04.176 IO depths : 1=0.1%, 2=0.2%, 4=0.5%, 8=0.9%, 16=1.9%, 32=3.8%, >=64=92.5% 00:17:04.176 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.176 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:04.176 issued rwts: total=843,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.176 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.176 job5: (groupid=0, jobs=1): err= 0: pid=3346659: Fri Apr 26 15:46:00 2024 00:17:04.176 read: IOPS=76, BW=76.3MiB/s (80.0MB/s)(770MiB/10095msec) 00:17:04.176 slat (usec): min=77, max=2128.7k, avg=13010.97, stdev=108114.24 00:17:04.176 clat (msec): min=73, max=5129, avg=1541.54, stdev=1429.73 00:17:04.176 lat (msec): min=567, max=5141, avg=1554.55, stdev=1432.03 00:17:04.176 clat percentiles (msec): 00:17:04.176 | 1.00th=[ 567], 5.00th=[ 592], 10.00th=[ 659], 20.00th=[ 709], 00:17:04.176 | 30.00th=[ 827], 40.00th=[ 877], 50.00th=[ 936], 60.00th=[ 1070], 00:17:04.176 | 70.00th=[ 1183], 80.00th=[ 1318], 90.00th=[ 4732], 95.00th=[ 4866], 00:17:04.176 | 99.00th=[ 5067], 99.50th=[ 5067], 99.90th=[ 5134], 99.95th=[ 5134], 00:17:04.176 | 99.99th=[ 5134] 00:17:04.176 bw ( KiB/s): min=10240, max=221184, per=3.57%, avg=119528.73, stdev=65576.13, samples=11 00:17:04.176 iops : min= 10, max= 216, avg=116.73, stdev=64.04, samples=11 00:17:04.176 lat (msec) : 100=0.13%, 750=26.10%, 1000=29.74%, 2000=26.88%, >=2000=17.14% 00:17:04.176 cpu : usr=0.03%, sys=1.19%, ctx=1950, majf=0, minf=32769 00:17:04.176 IO depths : 1=0.1%, 2=0.3%, 4=0.5%, 8=1.0%, 16=2.1%, 32=4.2%, >=64=91.8% 00:17:04.176 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.177 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:17:04.177 issued rwts: total=770,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.177 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.177 job5: (groupid=0, jobs=1): err= 0: pid=3346660: Fri Apr 26 15:46:00 2024 00:17:04.177 read: IOPS=102, BW=103MiB/s (108MB/s)(1039MiB/10124msec) 00:17:04.177 slat (usec): min=40, max=2163.4k, avg=9623.93, stdev=110634.65 00:17:04.177 clat (msec): min=121, max=6852, avg=1176.19, stdev=1904.21 00:17:04.177 lat (msec): min=275, max=6854, avg=1185.82, stdev=1911.03 00:17:04.177 clat percentiles (msec): 00:17:04.177 | 1.00th=[ 279], 5.00th=[ 305], 10.00th=[ 347], 20.00th=[ 376], 00:17:04.177 | 30.00th=[ 384], 40.00th=[ 388], 50.00th=[ 393], 60.00th=[ 405], 00:17:04.177 | 70.00th=[ 481], 80.00th=[ 617], 90.00th=[ 4597], 95.00th=[ 6678], 00:17:04.177 | 99.00th=[ 6812], 99.50th=[ 6879], 99.90th=[ 6879], 99.95th=[ 6879], 00:17:04.177 | 99.99th=[ 6879] 00:17:04.177 bw ( KiB/s): min= 2048, max=360448, per=5.57%, avg=186771.40, stdev=157336.84, samples=10 00:17:04.177 iops : min= 2, max= 352, avg=182.30, stdev=153.75, samples=10 00:17:04.177 lat (msec) : 250=0.10%, 500=74.59%, 750=8.28%, 1000=1.35%, >=2000=15.69% 00:17:04.177 cpu : usr=0.00%, sys=1.24%, ctx=1077, majf=0, minf=32769 00:17:04.177 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.8%, 16=1.5%, 32=3.1%, >=64=93.9% 00:17:04.177 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.177 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:04.177 issued rwts: total=1039,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.177 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.177 job5: (groupid=0, jobs=1): err= 0: pid=3346661: Fri Apr 26 15:46:00 2024 00:17:04.177 read: IOPS=41, BW=41.0MiB/s (43.0MB/s)(417MiB/10163msec) 00:17:04.177 slat (usec): min=50, max=2019.1k, avg=24190.08, stdev=166888.51 00:17:04.177 clat (msec): min=73, max=4380, avg=2560.31, stdev=1195.89 00:17:04.177 lat (msec): min=181, max=6333, avg=2584.50, stdev=1198.96 00:17:04.177 clat percentiles (msec): 00:17:04.177 | 1.00th=[ 182], 5.00th=[ 409], 10.00th=[ 1234], 20.00th=[ 1435], 00:17:04.177 | 30.00th=[ 1485], 40.00th=[ 2467], 50.00th=[ 2735], 60.00th=[ 2903], 00:17:04.177 | 70.00th=[ 3104], 80.00th=[ 3977], 90.00th=[ 4044], 95.00th=[ 4111], 00:17:04.177 | 99.00th=[ 4178], 99.50th=[ 4178], 99.90th=[ 4396], 99.95th=[ 4396], 00:17:04.177 | 99.99th=[ 4396] 00:17:04.177 bw ( KiB/s): min=10240, max=210944, per=2.52%, avg=84536.14, stdev=71185.11, samples=7 00:17:04.177 iops : min= 10, max= 206, avg=82.43, stdev=69.57, samples=7 00:17:04.177 lat (msec) : 100=0.24%, 250=2.40%, 500=5.76%, 2000=27.58%, >=2000=64.03% 00:17:04.177 cpu : usr=0.03%, sys=1.12%, ctx=802, majf=0, minf=32769 00:17:04.177 IO depths : 1=0.2%, 2=0.5%, 4=1.0%, 8=1.9%, 16=3.8%, 32=7.7%, >=64=84.9% 00:17:04.177 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.177 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:17:04.177 issued rwts: total=417,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.177 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.177 job5: (groupid=0, jobs=1): err= 0: pid=3346662: Fri Apr 26 15:46:00 2024 00:17:04.177 read: IOPS=25, BW=25.4MiB/s (26.6MB/s)(257MiB/10128msec) 00:17:04.177 slat (usec): min=449, max=2141.0k, avg=39023.13, stdev=235281.58 00:17:04.177 clat (msec): min=97, max=8602, avg=3458.07, stdev=2097.19 00:17:04.177 lat (msec): min=136, max=8649, avg=3497.09, stdev=2104.65 00:17:04.177 clat percentiles (msec): 00:17:04.177 | 1.00th=[ 159], 5.00th=[ 885], 10.00th=[ 902], 20.00th=[ 919], 00:17:04.177 | 30.00th=[ 953], 40.00th=[ 3071], 50.00th=[ 4396], 60.00th=[ 5067], 00:17:04.177 | 70.00th=[ 5269], 80.00th=[ 5470], 90.00th=[ 5604], 95.00th=[ 5671], 00:17:04.177 | 99.00th=[ 5805], 99.50th=[ 6611], 99.90th=[ 8658], 99.95th=[ 8658], 00:17:04.177 | 99.99th=[ 8658] 00:17:04.177 bw ( KiB/s): min= 2048, max=149504, per=1.31%, avg=44032.00, stdev=55390.73, samples=6 00:17:04.177 iops : min= 2, max= 146, avg=43.00, stdev=54.09, samples=6 00:17:04.177 lat (msec) : 100=0.39%, 250=1.56%, 1000=34.24%, 2000=0.39%, >=2000=63.42% 00:17:04.177 cpu : usr=0.00%, sys=0.76%, ctx=853, majf=0, minf=32769 00:17:04.177 IO depths : 1=0.4%, 2=0.8%, 4=1.6%, 8=3.1%, 16=6.2%, 32=12.5%, >=64=75.5% 00:17:04.177 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.177 complete : 0=0.0%, 4=99.2%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.8% 00:17:04.177 issued rwts: total=257,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.177 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.177 job5: (groupid=0, jobs=1): err= 0: pid=3346663: Fri Apr 26 15:46:00 2024 00:17:04.177 read: IOPS=5, BW=5706KiB/s (5843kB/s)(56.0MiB/10050msec) 00:17:04.177 slat (usec): min=708, max=2140.4k, avg=179021.14, stdev=543758.10 00:17:04.177 clat (msec): min=23, max=9966, avg=6417.55, stdev=3904.60 00:17:04.177 lat (msec): min=49, max=10049, avg=6596.57, stdev=3835.33 00:17:04.177 clat percentiles (msec): 00:17:04.177 | 1.00th=[ 24], 5.00th=[ 60], 10.00th=[ 87], 20.00th=[ 134], 00:17:04.177 | 30.00th=[ 4396], 40.00th=[ 6544], 50.00th=[ 8658], 60.00th=[ 8658], 00:17:04.177 | 70.00th=[ 9731], 80.00th=[ 9731], 90.00th=[ 9866], 95.00th=[ 9866], 00:17:04.177 | 99.00th=[10000], 99.50th=[10000], 99.90th=[10000], 99.95th=[10000], 00:17:04.177 | 99.99th=[10000] 00:17:04.177 lat (msec) : 50=3.57%, 100=10.71%, 250=7.14%, >=2000=78.57% 00:17:04.177 cpu : usr=0.00%, sys=0.37%, ctx=155, majf=0, minf=14337 00:17:04.177 IO depths : 1=1.8%, 2=3.6%, 4=7.1%, 8=14.3%, 16=28.6%, 32=44.6%, >=64=0.0% 00:17:04.177 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.177 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:17:04.177 issued rwts: total=56,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.177 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.177 job5: (groupid=0, jobs=1): err= 0: pid=3346664: Fri Apr 26 15:46:00 2024 00:17:04.177 read: IOPS=107, BW=107MiB/s (113MB/s)(1304MiB/12145msec) 00:17:04.177 slat (usec): min=364, max=2052.0k, avg=7742.84, stdev=66078.95 00:17:04.177 clat (msec): min=261, max=3411, avg=1057.59, stdev=930.92 00:17:04.177 lat (msec): min=266, max=3414, avg=1065.33, stdev=934.27 00:17:04.177 clat percentiles (msec): 00:17:04.177 | 1.00th=[ 275], 5.00th=[ 330], 10.00th=[ 393], 20.00th=[ 502], 00:17:04.177 | 30.00th=[ 510], 40.00th=[ 514], 50.00th=[ 518], 60.00th=[ 634], 00:17:04.177 | 70.00th=[ 1099], 80.00th=[ 2232], 90.00th=[ 2567], 95.00th=[ 3171], 00:17:04.177 | 99.00th=[ 3373], 99.50th=[ 3373], 99.90th=[ 3406], 99.95th=[ 3406], 00:17:04.177 | 99.99th=[ 3406] 00:17:04.177 bw ( KiB/s): min= 2007, max=325632, per=5.13%, avg=172136.79, stdev=106527.80, samples=14 00:17:04.177 iops : min= 1, max= 318, avg=167.93, stdev=104.23, samples=14 00:17:04.177 lat (msec) : 500=17.56%, 750=51.46%, 1000=0.38%, 2000=8.36%, >=2000=22.24% 00:17:04.177 cpu : usr=0.08%, sys=1.89%, ctx=2492, majf=0, minf=32769 00:17:04.177 IO depths : 1=0.1%, 2=0.2%, 4=0.3%, 8=0.6%, 16=1.2%, 32=2.5%, >=64=95.2% 00:17:04.177 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.177 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:04.177 issued rwts: total=1304,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.177 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.177 job5: (groupid=0, jobs=1): err= 0: pid=3346665: Fri Apr 26 15:46:00 2024 00:17:04.177 read: IOPS=75, BW=75.0MiB/s (78.7MB/s)(761MiB/10140msec) 00:17:04.177 slat (usec): min=45, max=2083.3k, avg=13223.55, stdev=105562.62 00:17:04.177 clat (msec): min=73, max=4890, avg=1605.61, stdev=1368.57 00:17:04.177 lat (msec): min=181, max=4896, avg=1618.84, stdev=1369.85 00:17:04.177 clat percentiles (msec): 00:17:04.177 | 1.00th=[ 481], 5.00th=[ 527], 10.00th=[ 609], 20.00th=[ 751], 00:17:04.177 | 30.00th=[ 844], 40.00th=[ 1020], 50.00th=[ 1150], 60.00th=[ 1217], 00:17:04.177 | 70.00th=[ 1351], 80.00th=[ 1502], 90.00th=[ 4597], 95.00th=[ 4732], 00:17:04.177 | 99.00th=[ 4866], 99.50th=[ 4866], 99.90th=[ 4866], 99.95th=[ 4866], 00:17:04.177 | 99.99th=[ 4866] 00:17:04.177 bw ( KiB/s): min= 2048, max=247808, per=2.97%, avg=99704.23, stdev=68781.37, samples=13 00:17:04.177 iops : min= 2, max= 242, avg=97.31, stdev=67.16, samples=13 00:17:04.177 lat (msec) : 100=0.13%, 250=0.13%, 500=1.71%, 750=17.87%, 1000=19.05% 00:17:04.177 lat (msec) : 2000=43.76%, >=2000=17.35% 00:17:04.177 cpu : usr=0.05%, sys=1.09%, ctx=1979, majf=0, minf=32769 00:17:04.177 IO depths : 1=0.1%, 2=0.3%, 4=0.5%, 8=1.1%, 16=2.1%, 32=4.2%, >=64=91.7% 00:17:04.177 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.177 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:17:04.177 issued rwts: total=761,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.177 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.177 job5: (groupid=0, jobs=1): err= 0: pid=3346666: Fri Apr 26 15:46:00 2024 00:17:04.177 read: IOPS=66, BW=66.2MiB/s (69.5MB/s)(672MiB/10146msec) 00:17:04.177 slat (usec): min=59, max=2135.4k, avg=14930.02, stdev=110842.70 00:17:04.177 clat (msec): min=109, max=5184, avg=1795.00, stdev=1431.82 00:17:04.177 lat (msec): min=624, max=5191, avg=1809.93, stdev=1433.19 00:17:04.177 clat percentiles (msec): 00:17:04.177 | 1.00th=[ 625], 5.00th=[ 642], 10.00th=[ 709], 20.00th=[ 919], 00:17:04.177 | 30.00th=[ 969], 40.00th=[ 1028], 50.00th=[ 1116], 60.00th=[ 1150], 00:17:04.177 | 70.00th=[ 1754], 80.00th=[ 2232], 90.00th=[ 4732], 95.00th=[ 4933], 00:17:04.177 | 99.00th=[ 5134], 99.50th=[ 5201], 99.90th=[ 5201], 99.95th=[ 5201], 00:17:04.178 | 99.99th=[ 5201] 00:17:04.178 bw ( KiB/s): min=20480, max=208896, per=3.32%, avg=111400.50, stdev=61719.81, samples=10 00:17:04.178 iops : min= 20, max= 204, avg=108.70, stdev=60.21, samples=10 00:17:04.178 lat (msec) : 250=0.15%, 750=11.16%, 1000=25.00%, 2000=40.48%, >=2000=23.21% 00:17:04.178 cpu : usr=0.03%, sys=1.64%, ctx=1630, majf=0, minf=32769 00:17:04.178 IO depths : 1=0.1%, 2=0.3%, 4=0.6%, 8=1.2%, 16=2.4%, 32=4.8%, >=64=90.6% 00:17:04.178 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:04.178 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:17:04.178 issued rwts: total=672,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:04.178 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:04.178 00:17:04.178 Run status group 0 (all jobs): 00:17:04.178 READ: bw=3274MiB/s (3433MB/s), 1522KiB/s-169MiB/s (1559kB/s-178MB/s), io=39.1GiB (42.0GB), run=10041-12221msec 00:17:04.178 00:17:04.178 Disk stats (read/write): 00:17:04.178 nvme0n1: ios=29050/0, merge=0/0, ticks=6681969/0, in_queue=6681969, util=98.74% 00:17:04.178 nvme1n1: ios=27112/0, merge=0/0, ticks=7597299/0, in_queue=7597299, util=98.79% 00:17:04.178 nvme2n1: ios=60245/0, merge=0/0, ticks=7989754/0, in_queue=7989754, util=99.00% 00:17:04.178 nvme3n1: ios=47052/0, merge=0/0, ticks=7069492/0, in_queue=7069492, util=98.68% 00:17:04.178 nvme4n1: ios=78067/0, merge=0/0, ticks=6464661/0, in_queue=6464661, util=99.08% 00:17:04.178 nvme5n1: ios=76162/0, merge=0/0, ticks=6403699/0, in_queue=6403699, util=99.02% 00:17:04.178 15:46:00 -- target/srq_overwhelm.sh@38 -- # sync 00:17:04.178 15:46:00 -- target/srq_overwhelm.sh@40 -- # seq 0 5 00:17:04.178 15:46:00 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:17:04.178 15:46:00 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode0 00:17:04.178 NQN:nqn.2016-06.io.spdk:cnode0 disconnected 1 controller(s) 00:17:04.178 15:46:01 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000000 00:17:04.178 15:46:01 -- common/autotest_common.sh@1205 -- # local i=0 00:17:04.178 15:46:01 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:17:04.178 15:46:01 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000000 00:17:04.178 15:46:01 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:17:04.178 15:46:01 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000000 00:17:04.178 15:46:01 -- common/autotest_common.sh@1217 -- # return 0 00:17:04.178 15:46:01 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:04.178 15:46:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:04.178 15:46:01 -- common/autotest_common.sh@10 -- # set +x 00:17:04.178 15:46:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:04.178 15:46:01 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:17:04.178 15:46:01 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:17:04.178 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:17:04.178 15:46:02 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000001 00:17:04.178 15:46:02 -- common/autotest_common.sh@1205 -- # local i=0 00:17:04.178 15:46:02 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:17:04.178 15:46:02 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000001 00:17:04.178 15:46:02 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:17:04.178 15:46:02 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000001 00:17:04.178 15:46:02 -- common/autotest_common.sh@1217 -- # return 0 00:17:04.178 15:46:02 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:04.178 15:46:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:04.178 15:46:02 -- common/autotest_common.sh@10 -- # set +x 00:17:04.178 15:46:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:04.178 15:46:02 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:17:04.178 15:46:02 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:17:05.547 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:17:05.547 15:46:03 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000002 00:17:05.547 15:46:03 -- common/autotest_common.sh@1205 -- # local i=0 00:17:05.547 15:46:03 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:17:05.547 15:46:03 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000002 00:17:05.547 15:46:03 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:17:05.547 15:46:03 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000002 00:17:05.547 15:46:03 -- common/autotest_common.sh@1217 -- # return 0 00:17:05.547 15:46:03 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:17:05.547 15:46:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:05.547 15:46:03 -- common/autotest_common.sh@10 -- # set +x 00:17:05.547 15:46:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:05.547 15:46:03 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:17:05.547 15:46:03 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:17:06.478 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:17:06.478 15:46:04 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000003 00:17:06.478 15:46:04 -- common/autotest_common.sh@1205 -- # local i=0 00:17:06.478 15:46:04 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:17:06.478 15:46:04 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000003 00:17:06.478 15:46:04 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000003 00:17:06.478 15:46:04 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:17:06.478 15:46:04 -- common/autotest_common.sh@1217 -- # return 0 00:17:06.478 15:46:04 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:17:06.478 15:46:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:06.478 15:46:04 -- common/autotest_common.sh@10 -- # set +x 00:17:06.478 15:46:04 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:06.478 15:46:04 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:17:06.478 15:46:04 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:17:07.411 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:17:07.411 15:46:05 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000004 00:17:07.411 15:46:05 -- common/autotest_common.sh@1205 -- # local i=0 00:17:07.411 15:46:05 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:17:07.411 15:46:05 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000004 00:17:07.411 15:46:05 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:17:07.411 15:46:05 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000004 00:17:07.411 15:46:05 -- common/autotest_common.sh@1217 -- # return 0 00:17:07.411 15:46:05 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:17:07.411 15:46:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:07.411 15:46:05 -- common/autotest_common.sh@10 -- # set +x 00:17:07.411 15:46:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:07.411 15:46:05 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:17:07.411 15:46:05 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:17:08.343 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:17:08.343 15:46:06 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000005 00:17:08.343 15:46:06 -- common/autotest_common.sh@1205 -- # local i=0 00:17:08.343 15:46:06 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:17:08.343 15:46:06 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000005 00:17:08.343 15:46:06 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:17:08.343 15:46:06 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000005 00:17:08.343 15:46:06 -- common/autotest_common.sh@1217 -- # return 0 00:17:08.343 15:46:06 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:17:08.343 15:46:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:08.343 15:46:06 -- common/autotest_common.sh@10 -- # set +x 00:17:08.343 15:46:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:08.343 15:46:06 -- target/srq_overwhelm.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:17:08.343 15:46:06 -- target/srq_overwhelm.sh@48 -- # nvmftestfini 00:17:08.343 15:46:06 -- nvmf/common.sh@477 -- # nvmfcleanup 00:17:08.343 15:46:06 -- nvmf/common.sh@117 -- # sync 00:17:08.343 15:46:06 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:17:08.343 15:46:06 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:17:08.343 15:46:06 -- nvmf/common.sh@120 -- # set +e 00:17:08.343 15:46:06 -- nvmf/common.sh@121 -- # for i in {1..20} 00:17:08.343 15:46:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:17:08.343 rmmod nvme_rdma 00:17:08.343 rmmod nvme_fabrics 00:17:08.343 15:46:06 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:17:08.343 15:46:06 -- nvmf/common.sh@124 -- # set -e 00:17:08.343 15:46:06 -- nvmf/common.sh@125 -- # return 0 00:17:08.343 15:46:06 -- nvmf/common.sh@478 -- # '[' -n 3345050 ']' 00:17:08.343 15:46:06 -- nvmf/common.sh@479 -- # killprocess 3345050 00:17:08.343 15:46:06 -- common/autotest_common.sh@936 -- # '[' -z 3345050 ']' 00:17:08.343 15:46:06 -- common/autotest_common.sh@940 -- # kill -0 3345050 00:17:08.343 15:46:06 -- common/autotest_common.sh@941 -- # uname 00:17:08.343 15:46:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:08.343 15:46:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3345050 00:17:08.343 15:46:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:08.343 15:46:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:08.343 15:46:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3345050' 00:17:08.343 killing process with pid 3345050 00:17:08.343 15:46:06 -- common/autotest_common.sh@955 -- # kill 3345050 00:17:08.343 15:46:06 -- common/autotest_common.sh@960 -- # wait 3345050 00:17:08.343 [2024-04-26 15:46:06.925588] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:17:08.910 15:46:07 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:17:08.910 15:46:07 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:17:08.910 00:17:08.910 real 0m32.450s 00:17:08.910 user 1m54.183s 00:17:08.910 sys 0m14.551s 00:17:08.910 15:46:07 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:08.910 15:46:07 -- common/autotest_common.sh@10 -- # set +x 00:17:08.910 ************************************ 00:17:08.910 END TEST nvmf_srq_overwhelm 00:17:08.910 ************************************ 00:17:08.910 15:46:07 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=rdma 00:17:08.911 15:46:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:08.911 15:46:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:08.911 15:46:07 -- common/autotest_common.sh@10 -- # set +x 00:17:08.911 ************************************ 00:17:08.911 START TEST nvmf_shutdown 00:17:08.911 ************************************ 00:17:08.911 15:46:07 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=rdma 00:17:08.911 * Looking for test storage... 00:17:09.170 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:17:09.170 15:46:07 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:17:09.170 15:46:07 -- nvmf/common.sh@7 -- # uname -s 00:17:09.170 15:46:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:09.170 15:46:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:09.170 15:46:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:09.170 15:46:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:09.170 15:46:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:09.170 15:46:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:09.170 15:46:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:09.170 15:46:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:09.170 15:46:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:09.170 15:46:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:09.170 15:46:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:17:09.170 15:46:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:17:09.170 15:46:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:09.170 15:46:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:09.170 15:46:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:09.170 15:46:07 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:09.170 15:46:07 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:17:09.170 15:46:07 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:09.170 15:46:07 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:09.170 15:46:07 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:09.170 15:46:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:09.170 15:46:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:09.171 15:46:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:09.171 15:46:07 -- paths/export.sh@5 -- # export PATH 00:17:09.171 15:46:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:09.171 15:46:07 -- nvmf/common.sh@47 -- # : 0 00:17:09.171 15:46:07 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:17:09.171 15:46:07 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:17:09.171 15:46:07 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:09.171 15:46:07 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:09.171 15:46:07 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:09.171 15:46:07 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:17:09.171 15:46:07 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:17:09.171 15:46:07 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:17:09.171 15:46:07 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:09.171 15:46:07 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:09.171 15:46:07 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:17:09.171 15:46:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:17:09.171 15:46:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:09.171 15:46:07 -- common/autotest_common.sh@10 -- # set +x 00:17:09.171 ************************************ 00:17:09.171 START TEST nvmf_shutdown_tc1 00:17:09.171 ************************************ 00:17:09.171 15:46:07 -- common/autotest_common.sh@1111 -- # nvmf_shutdown_tc1 00:17:09.171 15:46:07 -- target/shutdown.sh@74 -- # starttarget 00:17:09.171 15:46:07 -- target/shutdown.sh@15 -- # nvmftestinit 00:17:09.171 15:46:07 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:17:09.171 15:46:07 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:09.171 15:46:07 -- nvmf/common.sh@437 -- # prepare_net_devs 00:17:09.171 15:46:07 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:17:09.171 15:46:07 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:17:09.171 15:46:07 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:09.171 15:46:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:09.171 15:46:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:09.171 15:46:07 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:17:09.171 15:46:07 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:17:09.171 15:46:07 -- nvmf/common.sh@285 -- # xtrace_disable 00:17:09.171 15:46:07 -- common/autotest_common.sh@10 -- # set +x 00:17:14.446 15:46:12 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:14.446 15:46:12 -- nvmf/common.sh@291 -- # pci_devs=() 00:17:14.446 15:46:12 -- nvmf/common.sh@291 -- # local -a pci_devs 00:17:14.446 15:46:12 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:17:14.446 15:46:12 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:17:14.446 15:46:12 -- nvmf/common.sh@293 -- # pci_drivers=() 00:17:14.446 15:46:12 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:17:14.446 15:46:12 -- nvmf/common.sh@295 -- # net_devs=() 00:17:14.446 15:46:12 -- nvmf/common.sh@295 -- # local -ga net_devs 00:17:14.446 15:46:12 -- nvmf/common.sh@296 -- # e810=() 00:17:14.446 15:46:12 -- nvmf/common.sh@296 -- # local -ga e810 00:17:14.446 15:46:12 -- nvmf/common.sh@297 -- # x722=() 00:17:14.446 15:46:12 -- nvmf/common.sh@297 -- # local -ga x722 00:17:14.446 15:46:12 -- nvmf/common.sh@298 -- # mlx=() 00:17:14.446 15:46:12 -- nvmf/common.sh@298 -- # local -ga mlx 00:17:14.446 15:46:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:14.446 15:46:12 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:14.446 15:46:12 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:14.446 15:46:12 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:14.446 15:46:12 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:14.446 15:46:12 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:14.446 15:46:12 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:14.446 15:46:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:14.446 15:46:12 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:14.446 15:46:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:14.446 15:46:12 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:14.446 15:46:12 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:17:14.446 15:46:12 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:17:14.446 15:46:12 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:17:14.446 15:46:12 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:17:14.446 15:46:12 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:17:14.446 15:46:12 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:17:14.446 15:46:12 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:17:14.446 15:46:12 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:14.446 15:46:12 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:17:14.446 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:17:14.446 15:46:12 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:17:14.446 15:46:12 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:17:14.447 15:46:12 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:17:14.447 15:46:12 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:17:14.447 15:46:12 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:14.447 15:46:12 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:14.447 15:46:12 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:14.447 15:46:12 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:17:14.447 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:17:14.447 15:46:12 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:17:14.447 15:46:12 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:17:14.447 15:46:12 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:17:14.447 15:46:12 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:17:14.447 15:46:12 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:14.447 15:46:12 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:14.447 15:46:12 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:17:14.447 15:46:12 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:17:14.447 15:46:12 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:14.447 15:46:12 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:14.447 15:46:12 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:14.447 15:46:12 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:14.447 15:46:12 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:17:14.447 Found net devices under 0000:da:00.0: mlx_0_0 00:17:14.447 15:46:12 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:14.447 15:46:12 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:14.447 15:46:12 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:14.447 15:46:12 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:14.447 15:46:12 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:14.447 15:46:12 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:17:14.447 Found net devices under 0000:da:00.1: mlx_0_1 00:17:14.447 15:46:12 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:14.447 15:46:12 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:17:14.447 15:46:12 -- nvmf/common.sh@403 -- # is_hw=yes 00:17:14.447 15:46:12 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:17:14.447 15:46:12 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:17:14.447 15:46:12 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:17:14.447 15:46:12 -- nvmf/common.sh@409 -- # rdma_device_init 00:17:14.447 15:46:12 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:17:14.447 15:46:12 -- nvmf/common.sh@58 -- # uname 00:17:14.447 15:46:12 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:17:14.447 15:46:12 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:17:14.447 15:46:12 -- nvmf/common.sh@63 -- # modprobe ib_core 00:17:14.447 15:46:12 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:17:14.447 15:46:12 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:17:14.447 15:46:12 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:17:14.447 15:46:12 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:17:14.447 15:46:12 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:17:14.447 15:46:12 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:17:14.447 15:46:12 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:17:14.447 15:46:12 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:17:14.447 15:46:12 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:14.447 15:46:12 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:14.447 15:46:12 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:14.447 15:46:12 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:14.447 15:46:12 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:14.447 15:46:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:14.447 15:46:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:14.447 15:46:12 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:17:14.447 15:46:12 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:17:14.447 15:46:12 -- nvmf/common.sh@105 -- # continue 2 00:17:14.447 15:46:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:14.447 15:46:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:14.447 15:46:12 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:17:14.447 15:46:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:14.447 15:46:12 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:17:14.447 15:46:12 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:17:14.447 15:46:12 -- nvmf/common.sh@105 -- # continue 2 00:17:14.447 15:46:12 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:14.447 15:46:12 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:17:14.447 15:46:12 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:17:14.447 15:46:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:17:14.447 15:46:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:14.447 15:46:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:14.447 15:46:12 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:17:14.447 15:46:12 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:17:14.447 15:46:12 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:17:14.447 122: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:17:14.447 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:17:14.447 altname enp218s0f0np0 00:17:14.447 altname ens818f0np0 00:17:14.447 inet 192.168.100.8/24 scope global mlx_0_0 00:17:14.447 valid_lft forever preferred_lft forever 00:17:14.447 15:46:12 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:14.447 15:46:12 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:17:14.447 15:46:12 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:17:14.447 15:46:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:17:14.447 15:46:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:14.447 15:46:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:14.447 15:46:12 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:17:14.447 15:46:12 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:17:14.447 15:46:12 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:17:14.447 123: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:17:14.447 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:17:14.447 altname enp218s0f1np1 00:17:14.447 altname ens818f1np1 00:17:14.447 inet 192.168.100.9/24 scope global mlx_0_1 00:17:14.447 valid_lft forever preferred_lft forever 00:17:14.447 15:46:12 -- nvmf/common.sh@411 -- # return 0 00:17:14.447 15:46:12 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:17:14.447 15:46:12 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:17:14.447 15:46:12 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:17:14.447 15:46:12 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:17:14.447 15:46:12 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:17:14.447 15:46:12 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:14.447 15:46:12 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:14.447 15:46:12 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:14.447 15:46:12 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:14.447 15:46:12 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:14.447 15:46:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:14.447 15:46:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:14.447 15:46:12 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:17:14.447 15:46:12 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:17:14.447 15:46:12 -- nvmf/common.sh@105 -- # continue 2 00:17:14.447 15:46:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:14.447 15:46:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:14.447 15:46:12 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:17:14.447 15:46:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:14.447 15:46:12 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:17:14.447 15:46:12 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:17:14.447 15:46:12 -- nvmf/common.sh@105 -- # continue 2 00:17:14.447 15:46:12 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:14.447 15:46:12 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:17:14.447 15:46:12 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:17:14.447 15:46:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:17:14.447 15:46:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:14.447 15:46:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:14.447 15:46:13 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:14.447 15:46:13 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:17:14.447 15:46:13 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:17:14.447 15:46:13 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:17:14.447 15:46:13 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:14.447 15:46:13 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:14.447 15:46:13 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:17:14.447 192.168.100.9' 00:17:14.447 15:46:13 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:17:14.447 192.168.100.9' 00:17:14.447 15:46:13 -- nvmf/common.sh@446 -- # head -n 1 00:17:14.447 15:46:13 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:17:14.447 15:46:13 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:17:14.447 192.168.100.9' 00:17:14.447 15:46:13 -- nvmf/common.sh@447 -- # tail -n +2 00:17:14.447 15:46:13 -- nvmf/common.sh@447 -- # head -n 1 00:17:14.447 15:46:13 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:17:14.447 15:46:13 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:17:14.447 15:46:13 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:17:14.447 15:46:13 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:17:14.447 15:46:13 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:17:14.447 15:46:13 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:17:14.752 15:46:13 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:17:14.752 15:46:13 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:17:14.752 15:46:13 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:14.752 15:46:13 -- common/autotest_common.sh@10 -- # set +x 00:17:14.752 15:46:13 -- nvmf/common.sh@470 -- # nvmfpid=3352721 00:17:14.752 15:46:13 -- nvmf/common.sh@471 -- # waitforlisten 3352721 00:17:14.752 15:46:13 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:17:14.752 15:46:13 -- common/autotest_common.sh@817 -- # '[' -z 3352721 ']' 00:17:14.752 15:46:13 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:14.752 15:46:13 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:14.752 15:46:13 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:14.752 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:14.752 15:46:13 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:14.752 15:46:13 -- common/autotest_common.sh@10 -- # set +x 00:17:14.752 [2024-04-26 15:46:13.104179] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:17:14.752 [2024-04-26 15:46:13.104229] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:14.752 EAL: No free 2048 kB hugepages reported on node 1 00:17:14.752 [2024-04-26 15:46:13.159930] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:14.752 [2024-04-26 15:46:13.233983] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:14.752 [2024-04-26 15:46:13.234022] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:14.752 [2024-04-26 15:46:13.234029] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:14.752 [2024-04-26 15:46:13.234034] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:14.752 [2024-04-26 15:46:13.234039] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:14.752 [2024-04-26 15:46:13.234138] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:14.752 [2024-04-26 15:46:13.234168] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:14.752 [2024-04-26 15:46:13.234695] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:14.753 [2024-04-26 15:46:13.234696] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:15.367 15:46:13 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:15.368 15:46:13 -- common/autotest_common.sh@850 -- # return 0 00:17:15.368 15:46:13 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:17:15.368 15:46:13 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:15.368 15:46:13 -- common/autotest_common.sh@10 -- # set +x 00:17:15.637 15:46:13 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:15.637 15:46:13 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:17:15.637 15:46:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:15.637 15:46:13 -- common/autotest_common.sh@10 -- # set +x 00:17:15.637 [2024-04-26 15:46:13.992115] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x9963f0/0x99a8e0) succeed. 00:17:15.637 [2024-04-26 15:46:14.002569] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x997a30/0x9dbf70) succeed. 00:17:15.637 15:46:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:15.637 15:46:14 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:17:15.637 15:46:14 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:17:15.637 15:46:14 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:15.637 15:46:14 -- common/autotest_common.sh@10 -- # set +x 00:17:15.637 15:46:14 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:15.637 15:46:14 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:15.637 15:46:14 -- target/shutdown.sh@28 -- # cat 00:17:15.637 15:46:14 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:15.637 15:46:14 -- target/shutdown.sh@28 -- # cat 00:17:15.637 15:46:14 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:15.637 15:46:14 -- target/shutdown.sh@28 -- # cat 00:17:15.637 15:46:14 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:15.637 15:46:14 -- target/shutdown.sh@28 -- # cat 00:17:15.637 15:46:14 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:15.637 15:46:14 -- target/shutdown.sh@28 -- # cat 00:17:15.637 15:46:14 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:15.637 15:46:14 -- target/shutdown.sh@28 -- # cat 00:17:15.637 15:46:14 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:15.637 15:46:14 -- target/shutdown.sh@28 -- # cat 00:17:15.637 15:46:14 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:15.637 15:46:14 -- target/shutdown.sh@28 -- # cat 00:17:15.637 15:46:14 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:15.637 15:46:14 -- target/shutdown.sh@28 -- # cat 00:17:15.637 15:46:14 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:15.637 15:46:14 -- target/shutdown.sh@28 -- # cat 00:17:15.637 15:46:14 -- target/shutdown.sh@35 -- # rpc_cmd 00:17:15.637 15:46:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:15.637 15:46:14 -- common/autotest_common.sh@10 -- # set +x 00:17:15.637 Malloc1 00:17:15.637 [2024-04-26 15:46:14.221512] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:17:15.894 Malloc2 00:17:15.894 Malloc3 00:17:15.894 Malloc4 00:17:15.894 Malloc5 00:17:15.894 Malloc6 00:17:15.894 Malloc7 00:17:16.152 Malloc8 00:17:16.152 Malloc9 00:17:16.152 Malloc10 00:17:16.152 15:46:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:16.152 15:46:14 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:17:16.152 15:46:14 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:16.152 15:46:14 -- common/autotest_common.sh@10 -- # set +x 00:17:16.152 15:46:14 -- target/shutdown.sh@78 -- # perfpid=3353004 00:17:16.152 15:46:14 -- target/shutdown.sh@79 -- # waitforlisten 3353004 /var/tmp/bdevperf.sock 00:17:16.152 15:46:14 -- common/autotest_common.sh@817 -- # '[' -z 3353004 ']' 00:17:16.152 15:46:14 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:16.152 15:46:14 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:17:16.152 15:46:14 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:16.152 15:46:14 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:17:16.152 15:46:14 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:16.152 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:16.152 15:46:14 -- nvmf/common.sh@521 -- # config=() 00:17:16.152 15:46:14 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:16.152 15:46:14 -- nvmf/common.sh@521 -- # local subsystem config 00:17:16.152 15:46:14 -- common/autotest_common.sh@10 -- # set +x 00:17:16.152 15:46:14 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:16.152 15:46:14 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:16.152 { 00:17:16.152 "params": { 00:17:16.152 "name": "Nvme$subsystem", 00:17:16.152 "trtype": "$TEST_TRANSPORT", 00:17:16.152 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:16.152 "adrfam": "ipv4", 00:17:16.152 "trsvcid": "$NVMF_PORT", 00:17:16.152 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:16.152 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:16.152 "hdgst": ${hdgst:-false}, 00:17:16.152 "ddgst": ${ddgst:-false} 00:17:16.152 }, 00:17:16.152 "method": "bdev_nvme_attach_controller" 00:17:16.152 } 00:17:16.152 EOF 00:17:16.152 )") 00:17:16.152 15:46:14 -- nvmf/common.sh@543 -- # cat 00:17:16.152 15:46:14 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:16.152 15:46:14 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:16.152 { 00:17:16.152 "params": { 00:17:16.152 "name": "Nvme$subsystem", 00:17:16.152 "trtype": "$TEST_TRANSPORT", 00:17:16.152 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:16.152 "adrfam": "ipv4", 00:17:16.152 "trsvcid": "$NVMF_PORT", 00:17:16.152 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:16.152 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:16.152 "hdgst": ${hdgst:-false}, 00:17:16.152 "ddgst": ${ddgst:-false} 00:17:16.152 }, 00:17:16.152 "method": "bdev_nvme_attach_controller" 00:17:16.152 } 00:17:16.153 EOF 00:17:16.153 )") 00:17:16.153 15:46:14 -- nvmf/common.sh@543 -- # cat 00:17:16.153 15:46:14 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:16.153 15:46:14 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:16.153 { 00:17:16.153 "params": { 00:17:16.153 "name": "Nvme$subsystem", 00:17:16.153 "trtype": "$TEST_TRANSPORT", 00:17:16.153 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:16.153 "adrfam": "ipv4", 00:17:16.153 "trsvcid": "$NVMF_PORT", 00:17:16.153 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:16.153 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:16.153 "hdgst": ${hdgst:-false}, 00:17:16.153 "ddgst": ${ddgst:-false} 00:17:16.153 }, 00:17:16.153 "method": "bdev_nvme_attach_controller" 00:17:16.153 } 00:17:16.153 EOF 00:17:16.153 )") 00:17:16.153 15:46:14 -- nvmf/common.sh@543 -- # cat 00:17:16.153 15:46:14 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:16.153 15:46:14 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:16.153 { 00:17:16.153 "params": { 00:17:16.153 "name": "Nvme$subsystem", 00:17:16.153 "trtype": "$TEST_TRANSPORT", 00:17:16.153 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:16.153 "adrfam": "ipv4", 00:17:16.153 "trsvcid": "$NVMF_PORT", 00:17:16.153 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:16.153 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:16.153 "hdgst": ${hdgst:-false}, 00:17:16.153 "ddgst": ${ddgst:-false} 00:17:16.153 }, 00:17:16.153 "method": "bdev_nvme_attach_controller" 00:17:16.153 } 00:17:16.153 EOF 00:17:16.153 )") 00:17:16.153 15:46:14 -- nvmf/common.sh@543 -- # cat 00:17:16.153 15:46:14 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:16.153 15:46:14 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:16.153 { 00:17:16.153 "params": { 00:17:16.153 "name": "Nvme$subsystem", 00:17:16.153 "trtype": "$TEST_TRANSPORT", 00:17:16.153 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:16.153 "adrfam": "ipv4", 00:17:16.153 "trsvcid": "$NVMF_PORT", 00:17:16.153 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:16.153 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:16.153 "hdgst": ${hdgst:-false}, 00:17:16.153 "ddgst": ${ddgst:-false} 00:17:16.153 }, 00:17:16.153 "method": "bdev_nvme_attach_controller" 00:17:16.153 } 00:17:16.153 EOF 00:17:16.153 )") 00:17:16.153 15:46:14 -- nvmf/common.sh@543 -- # cat 00:17:16.153 15:46:14 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:16.153 15:46:14 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:16.153 { 00:17:16.153 "params": { 00:17:16.153 "name": "Nvme$subsystem", 00:17:16.153 "trtype": "$TEST_TRANSPORT", 00:17:16.153 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:16.153 "adrfam": "ipv4", 00:17:16.153 "trsvcid": "$NVMF_PORT", 00:17:16.153 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:16.153 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:16.153 "hdgst": ${hdgst:-false}, 00:17:16.153 "ddgst": ${ddgst:-false} 00:17:16.153 }, 00:17:16.153 "method": "bdev_nvme_attach_controller" 00:17:16.153 } 00:17:16.153 EOF 00:17:16.153 )") 00:17:16.153 15:46:14 -- nvmf/common.sh@543 -- # cat 00:17:16.153 [2024-04-26 15:46:14.698830] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:17:16.153 [2024-04-26 15:46:14.698878] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:17:16.153 15:46:14 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:16.153 15:46:14 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:16.153 { 00:17:16.153 "params": { 00:17:16.153 "name": "Nvme$subsystem", 00:17:16.153 "trtype": "$TEST_TRANSPORT", 00:17:16.153 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:16.153 "adrfam": "ipv4", 00:17:16.153 "trsvcid": "$NVMF_PORT", 00:17:16.153 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:16.153 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:16.153 "hdgst": ${hdgst:-false}, 00:17:16.153 "ddgst": ${ddgst:-false} 00:17:16.153 }, 00:17:16.153 "method": "bdev_nvme_attach_controller" 00:17:16.153 } 00:17:16.153 EOF 00:17:16.153 )") 00:17:16.153 15:46:14 -- nvmf/common.sh@543 -- # cat 00:17:16.153 15:46:14 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:16.153 15:46:14 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:16.153 { 00:17:16.153 "params": { 00:17:16.153 "name": "Nvme$subsystem", 00:17:16.153 "trtype": "$TEST_TRANSPORT", 00:17:16.153 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:16.153 "adrfam": "ipv4", 00:17:16.153 "trsvcid": "$NVMF_PORT", 00:17:16.153 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:16.153 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:16.153 "hdgst": ${hdgst:-false}, 00:17:16.153 "ddgst": ${ddgst:-false} 00:17:16.153 }, 00:17:16.153 "method": "bdev_nvme_attach_controller" 00:17:16.153 } 00:17:16.153 EOF 00:17:16.153 )") 00:17:16.153 15:46:14 -- nvmf/common.sh@543 -- # cat 00:17:16.153 15:46:14 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:16.153 15:46:14 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:16.153 { 00:17:16.153 "params": { 00:17:16.153 "name": "Nvme$subsystem", 00:17:16.153 "trtype": "$TEST_TRANSPORT", 00:17:16.153 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:16.153 "adrfam": "ipv4", 00:17:16.153 "trsvcid": "$NVMF_PORT", 00:17:16.153 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:16.153 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:16.153 "hdgst": ${hdgst:-false}, 00:17:16.153 "ddgst": ${ddgst:-false} 00:17:16.153 }, 00:17:16.153 "method": "bdev_nvme_attach_controller" 00:17:16.153 } 00:17:16.153 EOF 00:17:16.153 )") 00:17:16.153 15:46:14 -- nvmf/common.sh@543 -- # cat 00:17:16.153 15:46:14 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:16.153 15:46:14 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:16.153 { 00:17:16.153 "params": { 00:17:16.153 "name": "Nvme$subsystem", 00:17:16.153 "trtype": "$TEST_TRANSPORT", 00:17:16.153 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:16.153 "adrfam": "ipv4", 00:17:16.153 "trsvcid": "$NVMF_PORT", 00:17:16.153 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:16.153 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:16.153 "hdgst": ${hdgst:-false}, 00:17:16.153 "ddgst": ${ddgst:-false} 00:17:16.153 }, 00:17:16.153 "method": "bdev_nvme_attach_controller" 00:17:16.153 } 00:17:16.153 EOF 00:17:16.153 )") 00:17:16.153 15:46:14 -- nvmf/common.sh@543 -- # cat 00:17:16.153 EAL: No free 2048 kB hugepages reported on node 1 00:17:16.153 15:46:14 -- nvmf/common.sh@545 -- # jq . 00:17:16.153 15:46:14 -- nvmf/common.sh@546 -- # IFS=, 00:17:16.153 15:46:14 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:17:16.153 "params": { 00:17:16.153 "name": "Nvme1", 00:17:16.153 "trtype": "rdma", 00:17:16.153 "traddr": "192.168.100.8", 00:17:16.153 "adrfam": "ipv4", 00:17:16.153 "trsvcid": "4420", 00:17:16.153 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:16.153 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:16.153 "hdgst": false, 00:17:16.153 "ddgst": false 00:17:16.153 }, 00:17:16.153 "method": "bdev_nvme_attach_controller" 00:17:16.153 },{ 00:17:16.153 "params": { 00:17:16.153 "name": "Nvme2", 00:17:16.153 "trtype": "rdma", 00:17:16.153 "traddr": "192.168.100.8", 00:17:16.153 "adrfam": "ipv4", 00:17:16.153 "trsvcid": "4420", 00:17:16.153 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:17:16.153 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:17:16.153 "hdgst": false, 00:17:16.153 "ddgst": false 00:17:16.153 }, 00:17:16.153 "method": "bdev_nvme_attach_controller" 00:17:16.153 },{ 00:17:16.153 "params": { 00:17:16.153 "name": "Nvme3", 00:17:16.153 "trtype": "rdma", 00:17:16.153 "traddr": "192.168.100.8", 00:17:16.153 "adrfam": "ipv4", 00:17:16.153 "trsvcid": "4420", 00:17:16.153 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:17:16.153 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:17:16.153 "hdgst": false, 00:17:16.153 "ddgst": false 00:17:16.153 }, 00:17:16.153 "method": "bdev_nvme_attach_controller" 00:17:16.153 },{ 00:17:16.153 "params": { 00:17:16.153 "name": "Nvme4", 00:17:16.153 "trtype": "rdma", 00:17:16.153 "traddr": "192.168.100.8", 00:17:16.153 "adrfam": "ipv4", 00:17:16.153 "trsvcid": "4420", 00:17:16.153 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:17:16.153 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:17:16.153 "hdgst": false, 00:17:16.153 "ddgst": false 00:17:16.153 }, 00:17:16.153 "method": "bdev_nvme_attach_controller" 00:17:16.153 },{ 00:17:16.153 "params": { 00:17:16.153 "name": "Nvme5", 00:17:16.153 "trtype": "rdma", 00:17:16.153 "traddr": "192.168.100.8", 00:17:16.153 "adrfam": "ipv4", 00:17:16.153 "trsvcid": "4420", 00:17:16.153 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:17:16.153 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:17:16.153 "hdgst": false, 00:17:16.153 "ddgst": false 00:17:16.153 }, 00:17:16.153 "method": "bdev_nvme_attach_controller" 00:17:16.153 },{ 00:17:16.153 "params": { 00:17:16.153 "name": "Nvme6", 00:17:16.153 "trtype": "rdma", 00:17:16.153 "traddr": "192.168.100.8", 00:17:16.153 "adrfam": "ipv4", 00:17:16.153 "trsvcid": "4420", 00:17:16.153 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:17:16.153 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:17:16.153 "hdgst": false, 00:17:16.153 "ddgst": false 00:17:16.153 }, 00:17:16.153 "method": "bdev_nvme_attach_controller" 00:17:16.153 },{ 00:17:16.153 "params": { 00:17:16.153 "name": "Nvme7", 00:17:16.153 "trtype": "rdma", 00:17:16.154 "traddr": "192.168.100.8", 00:17:16.154 "adrfam": "ipv4", 00:17:16.154 "trsvcid": "4420", 00:17:16.154 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:17:16.154 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:17:16.154 "hdgst": false, 00:17:16.154 "ddgst": false 00:17:16.154 }, 00:17:16.154 "method": "bdev_nvme_attach_controller" 00:17:16.154 },{ 00:17:16.154 "params": { 00:17:16.154 "name": "Nvme8", 00:17:16.154 "trtype": "rdma", 00:17:16.154 "traddr": "192.168.100.8", 00:17:16.154 "adrfam": "ipv4", 00:17:16.154 "trsvcid": "4420", 00:17:16.154 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:17:16.154 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:17:16.154 "hdgst": false, 00:17:16.154 "ddgst": false 00:17:16.154 }, 00:17:16.154 "method": "bdev_nvme_attach_controller" 00:17:16.154 },{ 00:17:16.154 "params": { 00:17:16.154 "name": "Nvme9", 00:17:16.154 "trtype": "rdma", 00:17:16.154 "traddr": "192.168.100.8", 00:17:16.154 "adrfam": "ipv4", 00:17:16.154 "trsvcid": "4420", 00:17:16.154 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:17:16.154 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:17:16.154 "hdgst": false, 00:17:16.154 "ddgst": false 00:17:16.154 }, 00:17:16.154 "method": "bdev_nvme_attach_controller" 00:17:16.154 },{ 00:17:16.154 "params": { 00:17:16.154 "name": "Nvme10", 00:17:16.154 "trtype": "rdma", 00:17:16.154 "traddr": "192.168.100.8", 00:17:16.154 "adrfam": "ipv4", 00:17:16.154 "trsvcid": "4420", 00:17:16.154 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:17:16.154 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:17:16.154 "hdgst": false, 00:17:16.154 "ddgst": false 00:17:16.154 }, 00:17:16.154 "method": "bdev_nvme_attach_controller" 00:17:16.154 }' 00:17:16.154 [2024-04-26 15:46:14.756525] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:16.410 [2024-04-26 15:46:14.829278] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:17.341 15:46:15 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:17.341 15:46:15 -- common/autotest_common.sh@850 -- # return 0 00:17:17.341 15:46:15 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:17:17.341 15:46:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:17.341 15:46:15 -- common/autotest_common.sh@10 -- # set +x 00:17:17.341 15:46:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:17.341 15:46:15 -- target/shutdown.sh@83 -- # kill -9 3353004 00:17:17.341 15:46:15 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:17:17.341 15:46:15 -- target/shutdown.sh@87 -- # sleep 1 00:17:18.272 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 3353004 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:17:18.272 15:46:16 -- target/shutdown.sh@88 -- # kill -0 3352721 00:17:18.272 15:46:16 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:17:18.272 15:46:16 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:17:18.272 15:46:16 -- nvmf/common.sh@521 -- # config=() 00:17:18.272 15:46:16 -- nvmf/common.sh@521 -- # local subsystem config 00:17:18.272 15:46:16 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:18.272 15:46:16 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:18.272 { 00:17:18.272 "params": { 00:17:18.272 "name": "Nvme$subsystem", 00:17:18.272 "trtype": "$TEST_TRANSPORT", 00:17:18.272 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:18.272 "adrfam": "ipv4", 00:17:18.272 "trsvcid": "$NVMF_PORT", 00:17:18.272 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:18.272 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:18.272 "hdgst": ${hdgst:-false}, 00:17:18.272 "ddgst": ${ddgst:-false} 00:17:18.272 }, 00:17:18.272 "method": "bdev_nvme_attach_controller" 00:17:18.272 } 00:17:18.272 EOF 00:17:18.272 )") 00:17:18.272 15:46:16 -- nvmf/common.sh@543 -- # cat 00:17:18.272 15:46:16 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:18.272 15:46:16 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:18.272 { 00:17:18.272 "params": { 00:17:18.272 "name": "Nvme$subsystem", 00:17:18.272 "trtype": "$TEST_TRANSPORT", 00:17:18.272 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:18.272 "adrfam": "ipv4", 00:17:18.272 "trsvcid": "$NVMF_PORT", 00:17:18.272 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:18.272 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:18.272 "hdgst": ${hdgst:-false}, 00:17:18.272 "ddgst": ${ddgst:-false} 00:17:18.272 }, 00:17:18.272 "method": "bdev_nvme_attach_controller" 00:17:18.272 } 00:17:18.272 EOF 00:17:18.272 )") 00:17:18.272 15:46:16 -- nvmf/common.sh@543 -- # cat 00:17:18.272 15:46:16 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:18.272 15:46:16 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:18.272 { 00:17:18.272 "params": { 00:17:18.272 "name": "Nvme$subsystem", 00:17:18.272 "trtype": "$TEST_TRANSPORT", 00:17:18.272 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:18.272 "adrfam": "ipv4", 00:17:18.272 "trsvcid": "$NVMF_PORT", 00:17:18.272 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:18.272 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:18.272 "hdgst": ${hdgst:-false}, 00:17:18.272 "ddgst": ${ddgst:-false} 00:17:18.272 }, 00:17:18.272 "method": "bdev_nvme_attach_controller" 00:17:18.272 } 00:17:18.272 EOF 00:17:18.272 )") 00:17:18.272 15:46:16 -- nvmf/common.sh@543 -- # cat 00:17:18.272 15:46:16 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:18.272 15:46:16 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:18.272 { 00:17:18.272 "params": { 00:17:18.272 "name": "Nvme$subsystem", 00:17:18.272 "trtype": "$TEST_TRANSPORT", 00:17:18.272 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:18.272 "adrfam": "ipv4", 00:17:18.272 "trsvcid": "$NVMF_PORT", 00:17:18.272 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:18.272 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:18.272 "hdgst": ${hdgst:-false}, 00:17:18.272 "ddgst": ${ddgst:-false} 00:17:18.272 }, 00:17:18.272 "method": "bdev_nvme_attach_controller" 00:17:18.272 } 00:17:18.272 EOF 00:17:18.272 )") 00:17:18.272 15:46:16 -- nvmf/common.sh@543 -- # cat 00:17:18.272 15:46:16 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:18.272 15:46:16 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:18.272 { 00:17:18.272 "params": { 00:17:18.272 "name": "Nvme$subsystem", 00:17:18.272 "trtype": "$TEST_TRANSPORT", 00:17:18.272 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:18.272 "adrfam": "ipv4", 00:17:18.272 "trsvcid": "$NVMF_PORT", 00:17:18.272 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:18.272 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:18.272 "hdgst": ${hdgst:-false}, 00:17:18.272 "ddgst": ${ddgst:-false} 00:17:18.272 }, 00:17:18.273 "method": "bdev_nvme_attach_controller" 00:17:18.273 } 00:17:18.273 EOF 00:17:18.273 )") 00:17:18.273 15:46:16 -- nvmf/common.sh@543 -- # cat 00:17:18.273 15:46:16 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:18.273 15:46:16 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:18.273 { 00:17:18.273 "params": { 00:17:18.273 "name": "Nvme$subsystem", 00:17:18.273 "trtype": "$TEST_TRANSPORT", 00:17:18.273 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:18.273 "adrfam": "ipv4", 00:17:18.273 "trsvcid": "$NVMF_PORT", 00:17:18.273 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:18.273 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:18.273 "hdgst": ${hdgst:-false}, 00:17:18.273 "ddgst": ${ddgst:-false} 00:17:18.273 }, 00:17:18.273 "method": "bdev_nvme_attach_controller" 00:17:18.273 } 00:17:18.273 EOF 00:17:18.273 )") 00:17:18.273 15:46:16 -- nvmf/common.sh@543 -- # cat 00:17:18.273 [2024-04-26 15:46:16.728176] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:17:18.273 [2024-04-26 15:46:16.728227] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3353480 ] 00:17:18.273 15:46:16 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:18.273 15:46:16 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:18.273 { 00:17:18.273 "params": { 00:17:18.273 "name": "Nvme$subsystem", 00:17:18.273 "trtype": "$TEST_TRANSPORT", 00:17:18.273 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:18.273 "adrfam": "ipv4", 00:17:18.273 "trsvcid": "$NVMF_PORT", 00:17:18.273 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:18.273 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:18.273 "hdgst": ${hdgst:-false}, 00:17:18.273 "ddgst": ${ddgst:-false} 00:17:18.273 }, 00:17:18.273 "method": "bdev_nvme_attach_controller" 00:17:18.273 } 00:17:18.273 EOF 00:17:18.273 )") 00:17:18.273 15:46:16 -- nvmf/common.sh@543 -- # cat 00:17:18.273 15:46:16 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:18.273 15:46:16 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:18.273 { 00:17:18.273 "params": { 00:17:18.273 "name": "Nvme$subsystem", 00:17:18.273 "trtype": "$TEST_TRANSPORT", 00:17:18.273 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:18.273 "adrfam": "ipv4", 00:17:18.273 "trsvcid": "$NVMF_PORT", 00:17:18.273 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:18.273 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:18.273 "hdgst": ${hdgst:-false}, 00:17:18.273 "ddgst": ${ddgst:-false} 00:17:18.273 }, 00:17:18.273 "method": "bdev_nvme_attach_controller" 00:17:18.273 } 00:17:18.273 EOF 00:17:18.273 )") 00:17:18.273 15:46:16 -- nvmf/common.sh@543 -- # cat 00:17:18.273 15:46:16 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:18.273 15:46:16 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:18.273 { 00:17:18.273 "params": { 00:17:18.273 "name": "Nvme$subsystem", 00:17:18.273 "trtype": "$TEST_TRANSPORT", 00:17:18.273 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:18.273 "adrfam": "ipv4", 00:17:18.273 "trsvcid": "$NVMF_PORT", 00:17:18.273 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:18.273 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:18.273 "hdgst": ${hdgst:-false}, 00:17:18.273 "ddgst": ${ddgst:-false} 00:17:18.273 }, 00:17:18.273 "method": "bdev_nvme_attach_controller" 00:17:18.273 } 00:17:18.273 EOF 00:17:18.273 )") 00:17:18.273 15:46:16 -- nvmf/common.sh@543 -- # cat 00:17:18.273 15:46:16 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:18.273 15:46:16 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:18.273 { 00:17:18.273 "params": { 00:17:18.273 "name": "Nvme$subsystem", 00:17:18.273 "trtype": "$TEST_TRANSPORT", 00:17:18.273 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:18.273 "adrfam": "ipv4", 00:17:18.273 "trsvcid": "$NVMF_PORT", 00:17:18.273 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:18.273 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:18.273 "hdgst": ${hdgst:-false}, 00:17:18.273 "ddgst": ${ddgst:-false} 00:17:18.273 }, 00:17:18.273 "method": "bdev_nvme_attach_controller" 00:17:18.273 } 00:17:18.273 EOF 00:17:18.273 )") 00:17:18.273 15:46:16 -- nvmf/common.sh@543 -- # cat 00:17:18.273 EAL: No free 2048 kB hugepages reported on node 1 00:17:18.273 15:46:16 -- nvmf/common.sh@545 -- # jq . 00:17:18.273 15:46:16 -- nvmf/common.sh@546 -- # IFS=, 00:17:18.273 15:46:16 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:17:18.273 "params": { 00:17:18.273 "name": "Nvme1", 00:17:18.273 "trtype": "rdma", 00:17:18.273 "traddr": "192.168.100.8", 00:17:18.273 "adrfam": "ipv4", 00:17:18.273 "trsvcid": "4420", 00:17:18.273 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:18.273 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:18.273 "hdgst": false, 00:17:18.273 "ddgst": false 00:17:18.273 }, 00:17:18.273 "method": "bdev_nvme_attach_controller" 00:17:18.273 },{ 00:17:18.273 "params": { 00:17:18.273 "name": "Nvme2", 00:17:18.273 "trtype": "rdma", 00:17:18.273 "traddr": "192.168.100.8", 00:17:18.273 "adrfam": "ipv4", 00:17:18.273 "trsvcid": "4420", 00:17:18.273 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:17:18.273 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:17:18.273 "hdgst": false, 00:17:18.273 "ddgst": false 00:17:18.273 }, 00:17:18.273 "method": "bdev_nvme_attach_controller" 00:17:18.273 },{ 00:17:18.273 "params": { 00:17:18.273 "name": "Nvme3", 00:17:18.273 "trtype": "rdma", 00:17:18.273 "traddr": "192.168.100.8", 00:17:18.273 "adrfam": "ipv4", 00:17:18.273 "trsvcid": "4420", 00:17:18.273 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:17:18.273 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:17:18.273 "hdgst": false, 00:17:18.273 "ddgst": false 00:17:18.273 }, 00:17:18.273 "method": "bdev_nvme_attach_controller" 00:17:18.273 },{ 00:17:18.273 "params": { 00:17:18.273 "name": "Nvme4", 00:17:18.273 "trtype": "rdma", 00:17:18.273 "traddr": "192.168.100.8", 00:17:18.273 "adrfam": "ipv4", 00:17:18.273 "trsvcid": "4420", 00:17:18.273 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:17:18.273 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:17:18.273 "hdgst": false, 00:17:18.273 "ddgst": false 00:17:18.273 }, 00:17:18.273 "method": "bdev_nvme_attach_controller" 00:17:18.273 },{ 00:17:18.273 "params": { 00:17:18.273 "name": "Nvme5", 00:17:18.273 "trtype": "rdma", 00:17:18.273 "traddr": "192.168.100.8", 00:17:18.273 "adrfam": "ipv4", 00:17:18.273 "trsvcid": "4420", 00:17:18.273 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:17:18.273 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:17:18.273 "hdgst": false, 00:17:18.273 "ddgst": false 00:17:18.273 }, 00:17:18.273 "method": "bdev_nvme_attach_controller" 00:17:18.273 },{ 00:17:18.273 "params": { 00:17:18.273 "name": "Nvme6", 00:17:18.273 "trtype": "rdma", 00:17:18.273 "traddr": "192.168.100.8", 00:17:18.273 "adrfam": "ipv4", 00:17:18.273 "trsvcid": "4420", 00:17:18.273 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:17:18.273 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:17:18.273 "hdgst": false, 00:17:18.273 "ddgst": false 00:17:18.273 }, 00:17:18.273 "method": "bdev_nvme_attach_controller" 00:17:18.273 },{ 00:17:18.273 "params": { 00:17:18.273 "name": "Nvme7", 00:17:18.273 "trtype": "rdma", 00:17:18.273 "traddr": "192.168.100.8", 00:17:18.273 "adrfam": "ipv4", 00:17:18.273 "trsvcid": "4420", 00:17:18.273 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:17:18.273 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:17:18.273 "hdgst": false, 00:17:18.273 "ddgst": false 00:17:18.273 }, 00:17:18.273 "method": "bdev_nvme_attach_controller" 00:17:18.273 },{ 00:17:18.273 "params": { 00:17:18.273 "name": "Nvme8", 00:17:18.273 "trtype": "rdma", 00:17:18.273 "traddr": "192.168.100.8", 00:17:18.273 "adrfam": "ipv4", 00:17:18.273 "trsvcid": "4420", 00:17:18.273 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:17:18.273 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:17:18.273 "hdgst": false, 00:17:18.273 "ddgst": false 00:17:18.273 }, 00:17:18.273 "method": "bdev_nvme_attach_controller" 00:17:18.273 },{ 00:17:18.273 "params": { 00:17:18.273 "name": "Nvme9", 00:17:18.273 "trtype": "rdma", 00:17:18.273 "traddr": "192.168.100.8", 00:17:18.273 "adrfam": "ipv4", 00:17:18.273 "trsvcid": "4420", 00:17:18.273 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:17:18.273 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:17:18.273 "hdgst": false, 00:17:18.273 "ddgst": false 00:17:18.273 }, 00:17:18.273 "method": "bdev_nvme_attach_controller" 00:17:18.273 },{ 00:17:18.273 "params": { 00:17:18.273 "name": "Nvme10", 00:17:18.273 "trtype": "rdma", 00:17:18.273 "traddr": "192.168.100.8", 00:17:18.273 "adrfam": "ipv4", 00:17:18.273 "trsvcid": "4420", 00:17:18.273 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:17:18.273 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:17:18.273 "hdgst": false, 00:17:18.273 "ddgst": false 00:17:18.273 }, 00:17:18.273 "method": "bdev_nvme_attach_controller" 00:17:18.273 }' 00:17:18.273 [2024-04-26 15:46:16.786206] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:18.273 [2024-04-26 15:46:16.858731] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:19.203 Running I/O for 1 seconds... 00:17:20.574 00:17:20.574 Latency(us) 00:17:20.574 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:20.574 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:20.574 Verification LBA range: start 0x0 length 0x400 00:17:20.574 Nvme1n1 : 1.17 349.73 21.86 0.00 0.00 175895.97 7614.66 239674.51 00:17:20.574 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:20.574 Verification LBA range: start 0x0 length 0x400 00:17:20.574 Nvme2n1 : 1.18 381.20 23.82 0.00 0.00 163560.39 6928.09 169769.45 00:17:20.574 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:20.574 Verification LBA range: start 0x0 length 0x400 00:17:20.574 Nvme3n1 : 1.18 380.82 23.80 0.00 0.00 161494.69 7240.17 162778.94 00:17:20.574 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:20.574 Verification LBA range: start 0x0 length 0x400 00:17:20.574 Nvme4n1 : 1.18 383.00 23.94 0.00 0.00 158343.07 4993.22 155788.43 00:17:20.574 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:20.574 Verification LBA range: start 0x0 length 0x400 00:17:20.574 Nvme5n1 : 1.18 379.99 23.75 0.00 0.00 157652.53 8051.57 144803.35 00:17:20.574 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:20.574 Verification LBA range: start 0x0 length 0x400 00:17:20.574 Nvme6n1 : 1.18 379.61 23.73 0.00 0.00 155302.70 8426.06 136814.20 00:17:20.574 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:20.574 Verification LBA range: start 0x0 length 0x400 00:17:20.574 Nvme7n1 : 1.18 379.24 23.70 0.00 0.00 153216.73 8738.13 129823.70 00:17:20.574 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:20.574 Verification LBA range: start 0x0 length 0x400 00:17:20.574 Nvme8n1 : 1.18 378.85 23.68 0.00 0.00 151231.36 9050.21 121834.54 00:17:20.574 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:20.574 Verification LBA range: start 0x0 length 0x400 00:17:20.574 Nvme9n1 : 1.18 378.40 23.65 0.00 0.00 149463.32 9611.95 110849.46 00:17:20.574 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:20.574 Verification LBA range: start 0x0 length 0x400 00:17:20.574 Nvme10n1 : 1.19 377.87 23.62 0.00 0.00 147707.68 8800.55 97867.09 00:17:20.574 =================================================================================================================== 00:17:20.574 Total : 3768.71 235.54 0.00 0.00 157220.85 4993.22 239674.51 00:17:20.832 15:46:19 -- target/shutdown.sh@94 -- # stoptarget 00:17:20.832 15:46:19 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:17:20.832 15:46:19 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:17:20.832 15:46:19 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:20.832 15:46:19 -- target/shutdown.sh@45 -- # nvmftestfini 00:17:20.832 15:46:19 -- nvmf/common.sh@477 -- # nvmfcleanup 00:17:20.832 15:46:19 -- nvmf/common.sh@117 -- # sync 00:17:20.832 15:46:19 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:17:20.832 15:46:19 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:17:20.832 15:46:19 -- nvmf/common.sh@120 -- # set +e 00:17:20.832 15:46:19 -- nvmf/common.sh@121 -- # for i in {1..20} 00:17:20.832 15:46:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:17:20.832 rmmod nvme_rdma 00:17:20.832 rmmod nvme_fabrics 00:17:20.832 15:46:19 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:17:20.832 15:46:19 -- nvmf/common.sh@124 -- # set -e 00:17:20.832 15:46:19 -- nvmf/common.sh@125 -- # return 0 00:17:20.832 15:46:19 -- nvmf/common.sh@478 -- # '[' -n 3352721 ']' 00:17:20.832 15:46:19 -- nvmf/common.sh@479 -- # killprocess 3352721 00:17:20.832 15:46:19 -- common/autotest_common.sh@936 -- # '[' -z 3352721 ']' 00:17:20.832 15:46:19 -- common/autotest_common.sh@940 -- # kill -0 3352721 00:17:20.832 15:46:19 -- common/autotest_common.sh@941 -- # uname 00:17:20.832 15:46:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:20.832 15:46:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3352721 00:17:20.832 15:46:19 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:20.832 15:46:19 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:20.832 15:46:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3352721' 00:17:20.832 killing process with pid 3352721 00:17:20.833 15:46:19 -- common/autotest_common.sh@955 -- # kill 3352721 00:17:20.833 15:46:19 -- common/autotest_common.sh@960 -- # wait 3352721 00:17:20.833 [2024-04-26 15:46:19.387342] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:17:21.399 15:46:19 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:17:21.399 15:46:19 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:17:21.399 00:17:21.399 real 0m12.114s 00:17:21.399 user 0m30.489s 00:17:21.399 sys 0m5.036s 00:17:21.399 15:46:19 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:21.399 15:46:19 -- common/autotest_common.sh@10 -- # set +x 00:17:21.399 ************************************ 00:17:21.399 END TEST nvmf_shutdown_tc1 00:17:21.399 ************************************ 00:17:21.399 15:46:19 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:17:21.399 15:46:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:17:21.399 15:46:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:21.399 15:46:19 -- common/autotest_common.sh@10 -- # set +x 00:17:21.399 ************************************ 00:17:21.399 START TEST nvmf_shutdown_tc2 00:17:21.399 ************************************ 00:17:21.399 15:46:19 -- common/autotest_common.sh@1111 -- # nvmf_shutdown_tc2 00:17:21.399 15:46:19 -- target/shutdown.sh@99 -- # starttarget 00:17:21.399 15:46:19 -- target/shutdown.sh@15 -- # nvmftestinit 00:17:21.399 15:46:19 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:17:21.399 15:46:19 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:21.399 15:46:19 -- nvmf/common.sh@437 -- # prepare_net_devs 00:17:21.399 15:46:19 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:17:21.399 15:46:19 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:17:21.399 15:46:19 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:21.399 15:46:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:21.399 15:46:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:21.399 15:46:19 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:17:21.399 15:46:19 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:17:21.399 15:46:19 -- nvmf/common.sh@285 -- # xtrace_disable 00:17:21.399 15:46:19 -- common/autotest_common.sh@10 -- # set +x 00:17:21.399 15:46:19 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:21.399 15:46:19 -- nvmf/common.sh@291 -- # pci_devs=() 00:17:21.399 15:46:19 -- nvmf/common.sh@291 -- # local -a pci_devs 00:17:21.399 15:46:19 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:17:21.399 15:46:19 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:17:21.399 15:46:19 -- nvmf/common.sh@293 -- # pci_drivers=() 00:17:21.399 15:46:19 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:17:21.399 15:46:19 -- nvmf/common.sh@295 -- # net_devs=() 00:17:21.399 15:46:19 -- nvmf/common.sh@295 -- # local -ga net_devs 00:17:21.399 15:46:19 -- nvmf/common.sh@296 -- # e810=() 00:17:21.399 15:46:19 -- nvmf/common.sh@296 -- # local -ga e810 00:17:21.399 15:46:19 -- nvmf/common.sh@297 -- # x722=() 00:17:21.399 15:46:19 -- nvmf/common.sh@297 -- # local -ga x722 00:17:21.399 15:46:19 -- nvmf/common.sh@298 -- # mlx=() 00:17:21.399 15:46:19 -- nvmf/common.sh@298 -- # local -ga mlx 00:17:21.399 15:46:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:21.399 15:46:19 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:21.399 15:46:19 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:21.399 15:46:19 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:21.399 15:46:19 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:21.399 15:46:19 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:21.399 15:46:19 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:21.399 15:46:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:21.399 15:46:19 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:21.399 15:46:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:21.399 15:46:19 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:21.399 15:46:19 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:17:21.399 15:46:19 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:17:21.399 15:46:19 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:17:21.399 15:46:19 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:17:21.399 15:46:19 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:17:21.399 15:46:19 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:17:21.399 15:46:19 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:17:21.399 15:46:19 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:21.399 15:46:19 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:17:21.399 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:17:21.399 15:46:19 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:17:21.399 15:46:19 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:17:21.399 15:46:19 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:17:21.399 15:46:19 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:17:21.399 15:46:19 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:21.399 15:46:19 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:21.399 15:46:19 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:21.399 15:46:19 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:17:21.399 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:17:21.399 15:46:19 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:17:21.399 15:46:19 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:17:21.399 15:46:19 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:17:21.399 15:46:19 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:17:21.399 15:46:19 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:21.399 15:46:19 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:21.399 15:46:19 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:17:21.399 15:46:19 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:17:21.399 15:46:19 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:21.399 15:46:19 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:21.399 15:46:19 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:21.399 15:46:19 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:21.399 15:46:19 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:17:21.399 Found net devices under 0000:da:00.0: mlx_0_0 00:17:21.400 15:46:19 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:21.400 15:46:19 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:21.400 15:46:19 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:21.400 15:46:19 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:21.400 15:46:19 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:21.400 15:46:19 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:17:21.400 Found net devices under 0000:da:00.1: mlx_0_1 00:17:21.400 15:46:19 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:21.400 15:46:19 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:17:21.400 15:46:19 -- nvmf/common.sh@403 -- # is_hw=yes 00:17:21.400 15:46:19 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:17:21.400 15:46:19 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:17:21.400 15:46:19 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:17:21.400 15:46:19 -- nvmf/common.sh@409 -- # rdma_device_init 00:17:21.400 15:46:19 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:17:21.400 15:46:19 -- nvmf/common.sh@58 -- # uname 00:17:21.400 15:46:19 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:17:21.400 15:46:19 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:17:21.400 15:46:19 -- nvmf/common.sh@63 -- # modprobe ib_core 00:17:21.658 15:46:20 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:17:21.658 15:46:20 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:17:21.658 15:46:20 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:17:21.658 15:46:20 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:17:21.658 15:46:20 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:17:21.658 15:46:20 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:17:21.658 15:46:20 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:17:21.658 15:46:20 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:17:21.658 15:46:20 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:21.658 15:46:20 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:21.658 15:46:20 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:21.658 15:46:20 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:21.658 15:46:20 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:21.658 15:46:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:21.658 15:46:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:21.658 15:46:20 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:17:21.658 15:46:20 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:17:21.658 15:46:20 -- nvmf/common.sh@105 -- # continue 2 00:17:21.658 15:46:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:21.658 15:46:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:21.658 15:46:20 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:17:21.658 15:46:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:21.658 15:46:20 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:17:21.658 15:46:20 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:17:21.658 15:46:20 -- nvmf/common.sh@105 -- # continue 2 00:17:21.658 15:46:20 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:21.658 15:46:20 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:17:21.658 15:46:20 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:17:21.658 15:46:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:17:21.658 15:46:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:21.658 15:46:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:21.658 15:46:20 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:17:21.658 15:46:20 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:17:21.658 15:46:20 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:17:21.658 122: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:17:21.658 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:17:21.658 altname enp218s0f0np0 00:17:21.658 altname ens818f0np0 00:17:21.658 inet 192.168.100.8/24 scope global mlx_0_0 00:17:21.658 valid_lft forever preferred_lft forever 00:17:21.658 15:46:20 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:21.658 15:46:20 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:17:21.658 15:46:20 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:17:21.658 15:46:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:17:21.658 15:46:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:21.658 15:46:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:21.658 15:46:20 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:17:21.658 15:46:20 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:17:21.658 15:46:20 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:17:21.658 123: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:17:21.658 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:17:21.658 altname enp218s0f1np1 00:17:21.658 altname ens818f1np1 00:17:21.658 inet 192.168.100.9/24 scope global mlx_0_1 00:17:21.658 valid_lft forever preferred_lft forever 00:17:21.658 15:46:20 -- nvmf/common.sh@411 -- # return 0 00:17:21.658 15:46:20 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:17:21.658 15:46:20 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:17:21.658 15:46:20 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:17:21.658 15:46:20 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:17:21.658 15:46:20 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:17:21.658 15:46:20 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:21.658 15:46:20 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:21.658 15:46:20 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:21.658 15:46:20 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:21.658 15:46:20 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:21.658 15:46:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:21.658 15:46:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:21.658 15:46:20 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:17:21.658 15:46:20 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:17:21.658 15:46:20 -- nvmf/common.sh@105 -- # continue 2 00:17:21.658 15:46:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:21.658 15:46:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:21.658 15:46:20 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:17:21.658 15:46:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:21.658 15:46:20 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:17:21.658 15:46:20 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:17:21.658 15:46:20 -- nvmf/common.sh@105 -- # continue 2 00:17:21.658 15:46:20 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:21.658 15:46:20 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:17:21.658 15:46:20 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:17:21.658 15:46:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:17:21.659 15:46:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:21.659 15:46:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:21.659 15:46:20 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:21.659 15:46:20 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:17:21.659 15:46:20 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:17:21.659 15:46:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:17:21.659 15:46:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:21.659 15:46:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:21.659 15:46:20 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:17:21.659 192.168.100.9' 00:17:21.659 15:46:20 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:17:21.659 192.168.100.9' 00:17:21.659 15:46:20 -- nvmf/common.sh@446 -- # head -n 1 00:17:21.659 15:46:20 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:17:21.659 15:46:20 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:17:21.659 192.168.100.9' 00:17:21.659 15:46:20 -- nvmf/common.sh@447 -- # tail -n +2 00:17:21.659 15:46:20 -- nvmf/common.sh@447 -- # head -n 1 00:17:21.659 15:46:20 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:17:21.659 15:46:20 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:17:21.659 15:46:20 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:17:21.659 15:46:20 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:17:21.659 15:46:20 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:17:21.659 15:46:20 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:17:21.659 15:46:20 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:17:21.659 15:46:20 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:17:21.659 15:46:20 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:21.659 15:46:20 -- common/autotest_common.sh@10 -- # set +x 00:17:21.659 15:46:20 -- nvmf/common.sh@470 -- # nvmfpid=3354068 00:17:21.659 15:46:20 -- nvmf/common.sh@471 -- # waitforlisten 3354068 00:17:21.659 15:46:20 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:17:21.659 15:46:20 -- common/autotest_common.sh@817 -- # '[' -z 3354068 ']' 00:17:21.659 15:46:20 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:21.659 15:46:20 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:21.659 15:46:20 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:21.659 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:21.659 15:46:20 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:21.659 15:46:20 -- common/autotest_common.sh@10 -- # set +x 00:17:21.659 [2024-04-26 15:46:20.228024] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:17:21.659 [2024-04-26 15:46:20.228072] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:21.659 EAL: No free 2048 kB hugepages reported on node 1 00:17:21.916 [2024-04-26 15:46:20.284623] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:21.916 [2024-04-26 15:46:20.361858] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:21.916 [2024-04-26 15:46:20.361896] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:21.916 [2024-04-26 15:46:20.361903] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:21.916 [2024-04-26 15:46:20.361909] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:21.916 [2024-04-26 15:46:20.361913] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:21.916 [2024-04-26 15:46:20.364164] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:21.916 [2024-04-26 15:46:20.364231] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:21.916 [2024-04-26 15:46:20.364275] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:21.916 [2024-04-26 15:46:20.364273] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:22.479 15:46:21 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:22.479 15:46:21 -- common/autotest_common.sh@850 -- # return 0 00:17:22.479 15:46:21 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:17:22.479 15:46:21 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:22.479 15:46:21 -- common/autotest_common.sh@10 -- # set +x 00:17:22.479 15:46:21 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:22.479 15:46:21 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:17:22.479 15:46:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:22.479 15:46:21 -- common/autotest_common.sh@10 -- # set +x 00:17:22.737 [2024-04-26 15:46:21.095966] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x196f3f0/0x19738e0) succeed. 00:17:22.737 [2024-04-26 15:46:21.106202] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1970a30/0x19b4f70) succeed. 00:17:22.737 15:46:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:22.737 15:46:21 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:17:22.737 15:46:21 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:17:22.737 15:46:21 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:22.737 15:46:21 -- common/autotest_common.sh@10 -- # set +x 00:17:22.737 15:46:21 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:22.737 15:46:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:22.737 15:46:21 -- target/shutdown.sh@28 -- # cat 00:17:22.737 15:46:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:22.737 15:46:21 -- target/shutdown.sh@28 -- # cat 00:17:22.737 15:46:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:22.737 15:46:21 -- target/shutdown.sh@28 -- # cat 00:17:22.737 15:46:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:22.737 15:46:21 -- target/shutdown.sh@28 -- # cat 00:17:22.737 15:46:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:22.737 15:46:21 -- target/shutdown.sh@28 -- # cat 00:17:22.737 15:46:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:22.737 15:46:21 -- target/shutdown.sh@28 -- # cat 00:17:22.737 15:46:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:22.737 15:46:21 -- target/shutdown.sh@28 -- # cat 00:17:22.737 15:46:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:22.737 15:46:21 -- target/shutdown.sh@28 -- # cat 00:17:22.737 15:46:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:22.737 15:46:21 -- target/shutdown.sh@28 -- # cat 00:17:22.737 15:46:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:22.737 15:46:21 -- target/shutdown.sh@28 -- # cat 00:17:22.737 15:46:21 -- target/shutdown.sh@35 -- # rpc_cmd 00:17:22.737 15:46:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:22.737 15:46:21 -- common/autotest_common.sh@10 -- # set +x 00:17:22.737 Malloc1 00:17:22.737 [2024-04-26 15:46:21.316754] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:17:22.737 Malloc2 00:17:22.994 Malloc3 00:17:22.994 Malloc4 00:17:22.994 Malloc5 00:17:22.994 Malloc6 00:17:22.994 Malloc7 00:17:23.252 Malloc8 00:17:23.252 Malloc9 00:17:23.252 Malloc10 00:17:23.252 15:46:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:23.252 15:46:21 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:17:23.252 15:46:21 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:23.252 15:46:21 -- common/autotest_common.sh@10 -- # set +x 00:17:23.252 15:46:21 -- target/shutdown.sh@103 -- # perfpid=3354345 00:17:23.252 15:46:21 -- target/shutdown.sh@104 -- # waitforlisten 3354345 /var/tmp/bdevperf.sock 00:17:23.252 15:46:21 -- common/autotest_common.sh@817 -- # '[' -z 3354345 ']' 00:17:23.252 15:46:21 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:23.252 15:46:21 -- target/shutdown.sh@102 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:17:23.252 15:46:21 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:23.252 15:46:21 -- target/shutdown.sh@102 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:17:23.252 15:46:21 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:23.252 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:23.252 15:46:21 -- nvmf/common.sh@521 -- # config=() 00:17:23.252 15:46:21 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:23.252 15:46:21 -- nvmf/common.sh@521 -- # local subsystem config 00:17:23.252 15:46:21 -- common/autotest_common.sh@10 -- # set +x 00:17:23.252 15:46:21 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:23.252 15:46:21 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:23.252 { 00:17:23.252 "params": { 00:17:23.252 "name": "Nvme$subsystem", 00:17:23.252 "trtype": "$TEST_TRANSPORT", 00:17:23.252 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:23.252 "adrfam": "ipv4", 00:17:23.252 "trsvcid": "$NVMF_PORT", 00:17:23.252 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:23.252 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:23.252 "hdgst": ${hdgst:-false}, 00:17:23.252 "ddgst": ${ddgst:-false} 00:17:23.252 }, 00:17:23.252 "method": "bdev_nvme_attach_controller" 00:17:23.252 } 00:17:23.252 EOF 00:17:23.252 )") 00:17:23.252 15:46:21 -- nvmf/common.sh@543 -- # cat 00:17:23.252 15:46:21 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:23.252 15:46:21 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:23.252 { 00:17:23.252 "params": { 00:17:23.252 "name": "Nvme$subsystem", 00:17:23.252 "trtype": "$TEST_TRANSPORT", 00:17:23.252 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:23.252 "adrfam": "ipv4", 00:17:23.252 "trsvcid": "$NVMF_PORT", 00:17:23.252 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:23.252 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:23.252 "hdgst": ${hdgst:-false}, 00:17:23.252 "ddgst": ${ddgst:-false} 00:17:23.252 }, 00:17:23.252 "method": "bdev_nvme_attach_controller" 00:17:23.252 } 00:17:23.252 EOF 00:17:23.252 )") 00:17:23.252 15:46:21 -- nvmf/common.sh@543 -- # cat 00:17:23.252 15:46:21 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:23.252 15:46:21 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:23.252 { 00:17:23.252 "params": { 00:17:23.252 "name": "Nvme$subsystem", 00:17:23.252 "trtype": "$TEST_TRANSPORT", 00:17:23.253 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:23.253 "adrfam": "ipv4", 00:17:23.253 "trsvcid": "$NVMF_PORT", 00:17:23.253 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:23.253 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:23.253 "hdgst": ${hdgst:-false}, 00:17:23.253 "ddgst": ${ddgst:-false} 00:17:23.253 }, 00:17:23.253 "method": "bdev_nvme_attach_controller" 00:17:23.253 } 00:17:23.253 EOF 00:17:23.253 )") 00:17:23.253 15:46:21 -- nvmf/common.sh@543 -- # cat 00:17:23.253 15:46:21 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:23.253 15:46:21 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:23.253 { 00:17:23.253 "params": { 00:17:23.253 "name": "Nvme$subsystem", 00:17:23.253 "trtype": "$TEST_TRANSPORT", 00:17:23.253 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:23.253 "adrfam": "ipv4", 00:17:23.253 "trsvcid": "$NVMF_PORT", 00:17:23.253 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:23.253 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:23.253 "hdgst": ${hdgst:-false}, 00:17:23.253 "ddgst": ${ddgst:-false} 00:17:23.253 }, 00:17:23.253 "method": "bdev_nvme_attach_controller" 00:17:23.253 } 00:17:23.253 EOF 00:17:23.253 )") 00:17:23.253 15:46:21 -- nvmf/common.sh@543 -- # cat 00:17:23.253 15:46:21 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:23.253 15:46:21 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:23.253 { 00:17:23.253 "params": { 00:17:23.253 "name": "Nvme$subsystem", 00:17:23.253 "trtype": "$TEST_TRANSPORT", 00:17:23.253 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:23.253 "adrfam": "ipv4", 00:17:23.253 "trsvcid": "$NVMF_PORT", 00:17:23.253 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:23.253 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:23.253 "hdgst": ${hdgst:-false}, 00:17:23.253 "ddgst": ${ddgst:-false} 00:17:23.253 }, 00:17:23.253 "method": "bdev_nvme_attach_controller" 00:17:23.253 } 00:17:23.253 EOF 00:17:23.253 )") 00:17:23.253 15:46:21 -- nvmf/common.sh@543 -- # cat 00:17:23.253 15:46:21 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:23.253 15:46:21 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:23.253 { 00:17:23.253 "params": { 00:17:23.253 "name": "Nvme$subsystem", 00:17:23.253 "trtype": "$TEST_TRANSPORT", 00:17:23.253 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:23.253 "adrfam": "ipv4", 00:17:23.253 "trsvcid": "$NVMF_PORT", 00:17:23.253 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:23.253 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:23.253 "hdgst": ${hdgst:-false}, 00:17:23.253 "ddgst": ${ddgst:-false} 00:17:23.253 }, 00:17:23.253 "method": "bdev_nvme_attach_controller" 00:17:23.253 } 00:17:23.253 EOF 00:17:23.253 )") 00:17:23.253 15:46:21 -- nvmf/common.sh@543 -- # cat 00:17:23.253 15:46:21 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:23.253 [2024-04-26 15:46:21.792456] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:17:23.253 [2024-04-26 15:46:21.792502] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3354345 ] 00:17:23.253 15:46:21 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:23.253 { 00:17:23.253 "params": { 00:17:23.253 "name": "Nvme$subsystem", 00:17:23.253 "trtype": "$TEST_TRANSPORT", 00:17:23.253 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:23.253 "adrfam": "ipv4", 00:17:23.253 "trsvcid": "$NVMF_PORT", 00:17:23.253 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:23.253 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:23.253 "hdgst": ${hdgst:-false}, 00:17:23.253 "ddgst": ${ddgst:-false} 00:17:23.253 }, 00:17:23.253 "method": "bdev_nvme_attach_controller" 00:17:23.253 } 00:17:23.253 EOF 00:17:23.253 )") 00:17:23.253 15:46:21 -- nvmf/common.sh@543 -- # cat 00:17:23.253 15:46:21 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:23.253 15:46:21 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:23.253 { 00:17:23.253 "params": { 00:17:23.253 "name": "Nvme$subsystem", 00:17:23.253 "trtype": "$TEST_TRANSPORT", 00:17:23.253 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:23.253 "adrfam": "ipv4", 00:17:23.253 "trsvcid": "$NVMF_PORT", 00:17:23.253 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:23.253 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:23.253 "hdgst": ${hdgst:-false}, 00:17:23.253 "ddgst": ${ddgst:-false} 00:17:23.253 }, 00:17:23.253 "method": "bdev_nvme_attach_controller" 00:17:23.253 } 00:17:23.253 EOF 00:17:23.253 )") 00:17:23.253 15:46:21 -- nvmf/common.sh@543 -- # cat 00:17:23.253 15:46:21 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:23.253 15:46:21 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:23.253 { 00:17:23.253 "params": { 00:17:23.253 "name": "Nvme$subsystem", 00:17:23.253 "trtype": "$TEST_TRANSPORT", 00:17:23.253 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:23.253 "adrfam": "ipv4", 00:17:23.253 "trsvcid": "$NVMF_PORT", 00:17:23.253 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:23.253 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:23.253 "hdgst": ${hdgst:-false}, 00:17:23.253 "ddgst": ${ddgst:-false} 00:17:23.253 }, 00:17:23.253 "method": "bdev_nvme_attach_controller" 00:17:23.253 } 00:17:23.253 EOF 00:17:23.253 )") 00:17:23.253 15:46:21 -- nvmf/common.sh@543 -- # cat 00:17:23.253 15:46:21 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:23.253 15:46:21 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:23.253 { 00:17:23.253 "params": { 00:17:23.253 "name": "Nvme$subsystem", 00:17:23.253 "trtype": "$TEST_TRANSPORT", 00:17:23.253 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:23.253 "adrfam": "ipv4", 00:17:23.253 "trsvcid": "$NVMF_PORT", 00:17:23.253 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:23.254 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:23.254 "hdgst": ${hdgst:-false}, 00:17:23.254 "ddgst": ${ddgst:-false} 00:17:23.254 }, 00:17:23.254 "method": "bdev_nvme_attach_controller" 00:17:23.254 } 00:17:23.254 EOF 00:17:23.254 )") 00:17:23.254 15:46:21 -- nvmf/common.sh@543 -- # cat 00:17:23.254 EAL: No free 2048 kB hugepages reported on node 1 00:17:23.254 15:46:21 -- nvmf/common.sh@545 -- # jq . 00:17:23.254 15:46:21 -- nvmf/common.sh@546 -- # IFS=, 00:17:23.254 15:46:21 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:17:23.254 "params": { 00:17:23.254 "name": "Nvme1", 00:17:23.254 "trtype": "rdma", 00:17:23.254 "traddr": "192.168.100.8", 00:17:23.254 "adrfam": "ipv4", 00:17:23.254 "trsvcid": "4420", 00:17:23.254 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:23.254 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:23.254 "hdgst": false, 00:17:23.254 "ddgst": false 00:17:23.254 }, 00:17:23.254 "method": "bdev_nvme_attach_controller" 00:17:23.254 },{ 00:17:23.254 "params": { 00:17:23.254 "name": "Nvme2", 00:17:23.254 "trtype": "rdma", 00:17:23.254 "traddr": "192.168.100.8", 00:17:23.254 "adrfam": "ipv4", 00:17:23.254 "trsvcid": "4420", 00:17:23.254 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:17:23.254 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:17:23.254 "hdgst": false, 00:17:23.254 "ddgst": false 00:17:23.254 }, 00:17:23.254 "method": "bdev_nvme_attach_controller" 00:17:23.254 },{ 00:17:23.254 "params": { 00:17:23.254 "name": "Nvme3", 00:17:23.254 "trtype": "rdma", 00:17:23.254 "traddr": "192.168.100.8", 00:17:23.254 "adrfam": "ipv4", 00:17:23.254 "trsvcid": "4420", 00:17:23.254 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:17:23.254 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:17:23.254 "hdgst": false, 00:17:23.254 "ddgst": false 00:17:23.254 }, 00:17:23.254 "method": "bdev_nvme_attach_controller" 00:17:23.254 },{ 00:17:23.254 "params": { 00:17:23.254 "name": "Nvme4", 00:17:23.254 "trtype": "rdma", 00:17:23.254 "traddr": "192.168.100.8", 00:17:23.254 "adrfam": "ipv4", 00:17:23.254 "trsvcid": "4420", 00:17:23.254 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:17:23.254 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:17:23.254 "hdgst": false, 00:17:23.254 "ddgst": false 00:17:23.254 }, 00:17:23.254 "method": "bdev_nvme_attach_controller" 00:17:23.254 },{ 00:17:23.254 "params": { 00:17:23.254 "name": "Nvme5", 00:17:23.254 "trtype": "rdma", 00:17:23.254 "traddr": "192.168.100.8", 00:17:23.254 "adrfam": "ipv4", 00:17:23.254 "trsvcid": "4420", 00:17:23.254 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:17:23.254 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:17:23.254 "hdgst": false, 00:17:23.254 "ddgst": false 00:17:23.254 }, 00:17:23.254 "method": "bdev_nvme_attach_controller" 00:17:23.254 },{ 00:17:23.254 "params": { 00:17:23.254 "name": "Nvme6", 00:17:23.254 "trtype": "rdma", 00:17:23.254 "traddr": "192.168.100.8", 00:17:23.254 "adrfam": "ipv4", 00:17:23.254 "trsvcid": "4420", 00:17:23.254 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:17:23.254 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:17:23.254 "hdgst": false, 00:17:23.254 "ddgst": false 00:17:23.254 }, 00:17:23.254 "method": "bdev_nvme_attach_controller" 00:17:23.254 },{ 00:17:23.254 "params": { 00:17:23.254 "name": "Nvme7", 00:17:23.254 "trtype": "rdma", 00:17:23.254 "traddr": "192.168.100.8", 00:17:23.254 "adrfam": "ipv4", 00:17:23.254 "trsvcid": "4420", 00:17:23.254 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:17:23.254 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:17:23.254 "hdgst": false, 00:17:23.254 "ddgst": false 00:17:23.254 }, 00:17:23.254 "method": "bdev_nvme_attach_controller" 00:17:23.254 },{ 00:17:23.254 "params": { 00:17:23.254 "name": "Nvme8", 00:17:23.254 "trtype": "rdma", 00:17:23.254 "traddr": "192.168.100.8", 00:17:23.254 "adrfam": "ipv4", 00:17:23.254 "trsvcid": "4420", 00:17:23.254 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:17:23.254 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:17:23.254 "hdgst": false, 00:17:23.254 "ddgst": false 00:17:23.254 }, 00:17:23.254 "method": "bdev_nvme_attach_controller" 00:17:23.254 },{ 00:17:23.254 "params": { 00:17:23.254 "name": "Nvme9", 00:17:23.254 "trtype": "rdma", 00:17:23.254 "traddr": "192.168.100.8", 00:17:23.254 "adrfam": "ipv4", 00:17:23.254 "trsvcid": "4420", 00:17:23.254 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:17:23.254 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:17:23.254 "hdgst": false, 00:17:23.254 "ddgst": false 00:17:23.254 }, 00:17:23.254 "method": "bdev_nvme_attach_controller" 00:17:23.254 },{ 00:17:23.254 "params": { 00:17:23.254 "name": "Nvme10", 00:17:23.254 "trtype": "rdma", 00:17:23.254 "traddr": "192.168.100.8", 00:17:23.254 "adrfam": "ipv4", 00:17:23.254 "trsvcid": "4420", 00:17:23.254 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:17:23.254 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:17:23.254 "hdgst": false, 00:17:23.254 "ddgst": false 00:17:23.254 }, 00:17:23.254 "method": "bdev_nvme_attach_controller" 00:17:23.254 }' 00:17:23.254 [2024-04-26 15:46:21.847616] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:23.511 [2024-04-26 15:46:21.918543] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:24.442 Running I/O for 10 seconds... 00:17:24.442 15:46:22 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:24.442 15:46:22 -- common/autotest_common.sh@850 -- # return 0 00:17:24.442 15:46:22 -- target/shutdown.sh@105 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:17:24.442 15:46:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:24.442 15:46:22 -- common/autotest_common.sh@10 -- # set +x 00:17:24.442 15:46:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:24.442 15:46:22 -- target/shutdown.sh@107 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:17:24.442 15:46:22 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:17:24.442 15:46:22 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:17:24.442 15:46:22 -- target/shutdown.sh@57 -- # local ret=1 00:17:24.442 15:46:22 -- target/shutdown.sh@58 -- # local i 00:17:24.442 15:46:22 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:17:24.442 15:46:22 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:17:24.442 15:46:22 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:17:24.442 15:46:22 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:17:24.442 15:46:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:24.442 15:46:22 -- common/autotest_common.sh@10 -- # set +x 00:17:24.442 15:46:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:24.442 15:46:22 -- target/shutdown.sh@60 -- # read_io_count=3 00:17:24.442 15:46:22 -- target/shutdown.sh@63 -- # '[' 3 -ge 100 ']' 00:17:24.442 15:46:22 -- target/shutdown.sh@67 -- # sleep 0.25 00:17:24.699 15:46:23 -- target/shutdown.sh@59 -- # (( i-- )) 00:17:24.699 15:46:23 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:17:24.699 15:46:23 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:17:24.699 15:46:23 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:17:24.699 15:46:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:24.699 15:46:23 -- common/autotest_common.sh@10 -- # set +x 00:17:24.956 15:46:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:24.956 15:46:23 -- target/shutdown.sh@60 -- # read_io_count=131 00:17:24.956 15:46:23 -- target/shutdown.sh@63 -- # '[' 131 -ge 100 ']' 00:17:24.956 15:46:23 -- target/shutdown.sh@64 -- # ret=0 00:17:24.956 15:46:23 -- target/shutdown.sh@65 -- # break 00:17:24.956 15:46:23 -- target/shutdown.sh@69 -- # return 0 00:17:24.956 15:46:23 -- target/shutdown.sh@110 -- # killprocess 3354345 00:17:24.956 15:46:23 -- common/autotest_common.sh@936 -- # '[' -z 3354345 ']' 00:17:24.956 15:46:23 -- common/autotest_common.sh@940 -- # kill -0 3354345 00:17:24.956 15:46:23 -- common/autotest_common.sh@941 -- # uname 00:17:24.956 15:46:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:24.956 15:46:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3354345 00:17:24.956 15:46:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:24.956 15:46:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:24.956 15:46:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3354345' 00:17:24.956 killing process with pid 3354345 00:17:24.956 15:46:23 -- common/autotest_common.sh@955 -- # kill 3354345 00:17:24.956 15:46:23 -- common/autotest_common.sh@960 -- # wait 3354345 00:17:25.213 Received shutdown signal, test time was about 0.841809 seconds 00:17:25.213 00:17:25.213 Latency(us) 00:17:25.213 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:25.213 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:25.213 Verification LBA range: start 0x0 length 0x400 00:17:25.213 Nvme1n1 : 0.83 348.52 21.78 0.00 0.00 180585.05 7333.79 225693.50 00:17:25.213 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:25.213 Verification LBA range: start 0x0 length 0x400 00:17:25.213 Nvme2n1 : 0.83 386.66 24.17 0.00 0.00 159635.26 6272.73 162778.94 00:17:25.213 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:25.213 Verification LBA range: start 0x0 length 0x400 00:17:25.213 Nvme3n1 : 0.83 386.05 24.13 0.00 0.00 156888.11 8113.98 153791.15 00:17:25.213 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:25.213 Verification LBA range: start 0x0 length 0x400 00:17:25.213 Nvme4n1 : 0.83 385.52 24.09 0.00 0.00 153771.25 8488.47 146800.64 00:17:25.213 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:25.213 Verification LBA range: start 0x0 length 0x400 00:17:25.213 Nvme5n1 : 0.83 384.78 24.05 0.00 0.00 151638.60 9175.04 133818.27 00:17:25.213 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:25.213 Verification LBA range: start 0x0 length 0x400 00:17:25.213 Nvme6n1 : 0.83 384.06 24.00 0.00 0.00 148758.92 9986.44 120336.58 00:17:25.213 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:25.213 Verification LBA range: start 0x0 length 0x400 00:17:25.213 Nvme7n1 : 0.83 391.91 24.49 0.00 0.00 142008.55 4649.94 108852.18 00:17:25.213 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:25.213 Verification LBA range: start 0x0 length 0x400 00:17:25.213 Nvme8n1 : 0.84 382.99 23.94 0.00 0.00 142233.80 10673.01 105856.24 00:17:25.213 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:25.213 Verification LBA range: start 0x0 length 0x400 00:17:25.213 Nvme9n1 : 0.84 382.23 23.89 0.00 0.00 140541.17 11484.40 99365.06 00:17:25.213 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:25.213 Verification LBA range: start 0x0 length 0x400 00:17:25.213 Nvme10n1 : 0.84 304.34 19.02 0.00 0.00 172282.70 2933.52 226692.14 00:17:25.213 =================================================================================================================== 00:17:25.213 Total : 3737.06 233.57 0.00 0.00 154181.66 2933.52 226692.14 00:17:25.469 15:46:23 -- target/shutdown.sh@113 -- # sleep 1 00:17:26.399 15:46:24 -- target/shutdown.sh@114 -- # kill -0 3354068 00:17:26.399 15:46:24 -- target/shutdown.sh@116 -- # stoptarget 00:17:26.399 15:46:24 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:17:26.399 15:46:24 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:17:26.399 15:46:24 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:26.399 15:46:24 -- target/shutdown.sh@45 -- # nvmftestfini 00:17:26.399 15:46:24 -- nvmf/common.sh@477 -- # nvmfcleanup 00:17:26.399 15:46:24 -- nvmf/common.sh@117 -- # sync 00:17:26.399 15:46:24 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:17:26.399 15:46:24 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:17:26.399 15:46:24 -- nvmf/common.sh@120 -- # set +e 00:17:26.399 15:46:24 -- nvmf/common.sh@121 -- # for i in {1..20} 00:17:26.399 15:46:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:17:26.399 rmmod nvme_rdma 00:17:26.399 rmmod nvme_fabrics 00:17:26.399 15:46:24 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:17:26.399 15:46:24 -- nvmf/common.sh@124 -- # set -e 00:17:26.399 15:46:24 -- nvmf/common.sh@125 -- # return 0 00:17:26.399 15:46:24 -- nvmf/common.sh@478 -- # '[' -n 3354068 ']' 00:17:26.399 15:46:24 -- nvmf/common.sh@479 -- # killprocess 3354068 00:17:26.399 15:46:24 -- common/autotest_common.sh@936 -- # '[' -z 3354068 ']' 00:17:26.399 15:46:24 -- common/autotest_common.sh@940 -- # kill -0 3354068 00:17:26.399 15:46:25 -- common/autotest_common.sh@941 -- # uname 00:17:26.656 15:46:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:26.656 15:46:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3354068 00:17:26.656 15:46:25 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:26.656 15:46:25 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:26.656 15:46:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3354068' 00:17:26.656 killing process with pid 3354068 00:17:26.656 15:46:25 -- common/autotest_common.sh@955 -- # kill 3354068 00:17:26.656 15:46:25 -- common/autotest_common.sh@960 -- # wait 3354068 00:17:26.656 [2024-04-26 15:46:25.125133] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:17:27.221 15:46:25 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:17:27.221 15:46:25 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:17:27.221 00:17:27.221 real 0m5.573s 00:17:27.221 user 0m22.497s 00:17:27.221 sys 0m1.001s 00:17:27.221 15:46:25 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:27.221 15:46:25 -- common/autotest_common.sh@10 -- # set +x 00:17:27.221 ************************************ 00:17:27.221 END TEST nvmf_shutdown_tc2 00:17:27.221 ************************************ 00:17:27.221 15:46:25 -- target/shutdown.sh@149 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:17:27.221 15:46:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:17:27.221 15:46:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:27.221 15:46:25 -- common/autotest_common.sh@10 -- # set +x 00:17:27.221 ************************************ 00:17:27.221 START TEST nvmf_shutdown_tc3 00:17:27.221 ************************************ 00:17:27.221 15:46:25 -- common/autotest_common.sh@1111 -- # nvmf_shutdown_tc3 00:17:27.221 15:46:25 -- target/shutdown.sh@121 -- # starttarget 00:17:27.221 15:46:25 -- target/shutdown.sh@15 -- # nvmftestinit 00:17:27.221 15:46:25 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:17:27.221 15:46:25 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:27.221 15:46:25 -- nvmf/common.sh@437 -- # prepare_net_devs 00:17:27.221 15:46:25 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:17:27.221 15:46:25 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:17:27.221 15:46:25 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:27.221 15:46:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:27.221 15:46:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:27.221 15:46:25 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:17:27.221 15:46:25 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:17:27.221 15:46:25 -- nvmf/common.sh@285 -- # xtrace_disable 00:17:27.221 15:46:25 -- common/autotest_common.sh@10 -- # set +x 00:17:27.221 15:46:25 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:27.221 15:46:25 -- nvmf/common.sh@291 -- # pci_devs=() 00:17:27.221 15:46:25 -- nvmf/common.sh@291 -- # local -a pci_devs 00:17:27.221 15:46:25 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:17:27.221 15:46:25 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:17:27.221 15:46:25 -- nvmf/common.sh@293 -- # pci_drivers=() 00:17:27.221 15:46:25 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:17:27.221 15:46:25 -- nvmf/common.sh@295 -- # net_devs=() 00:17:27.221 15:46:25 -- nvmf/common.sh@295 -- # local -ga net_devs 00:17:27.221 15:46:25 -- nvmf/common.sh@296 -- # e810=() 00:17:27.221 15:46:25 -- nvmf/common.sh@296 -- # local -ga e810 00:17:27.221 15:46:25 -- nvmf/common.sh@297 -- # x722=() 00:17:27.221 15:46:25 -- nvmf/common.sh@297 -- # local -ga x722 00:17:27.221 15:46:25 -- nvmf/common.sh@298 -- # mlx=() 00:17:27.221 15:46:25 -- nvmf/common.sh@298 -- # local -ga mlx 00:17:27.221 15:46:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:27.221 15:46:25 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:27.221 15:46:25 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:27.221 15:46:25 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:27.221 15:46:25 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:27.221 15:46:25 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:27.221 15:46:25 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:27.221 15:46:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:27.221 15:46:25 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:27.221 15:46:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:27.221 15:46:25 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:27.221 15:46:25 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:17:27.221 15:46:25 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:17:27.221 15:46:25 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:17:27.221 15:46:25 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:17:27.221 15:46:25 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:17:27.221 15:46:25 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:17:27.221 15:46:25 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:17:27.221 15:46:25 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:27.221 15:46:25 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:17:27.221 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:17:27.221 15:46:25 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:17:27.221 15:46:25 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:17:27.221 15:46:25 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:17:27.221 15:46:25 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:17:27.221 15:46:25 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:27.221 15:46:25 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:27.221 15:46:25 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:27.221 15:46:25 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:17:27.221 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:17:27.221 15:46:25 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:17:27.221 15:46:25 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:17:27.221 15:46:25 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:17:27.221 15:46:25 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:17:27.221 15:46:25 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:27.221 15:46:25 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:27.221 15:46:25 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:17:27.221 15:46:25 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:17:27.221 15:46:25 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:27.221 15:46:25 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:27.221 15:46:25 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:27.221 15:46:25 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:27.221 15:46:25 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:17:27.221 Found net devices under 0000:da:00.0: mlx_0_0 00:17:27.221 15:46:25 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:27.221 15:46:25 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:27.221 15:46:25 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:27.221 15:46:25 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:27.221 15:46:25 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:27.221 15:46:25 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:17:27.221 Found net devices under 0000:da:00.1: mlx_0_1 00:17:27.221 15:46:25 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:27.221 15:46:25 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:17:27.221 15:46:25 -- nvmf/common.sh@403 -- # is_hw=yes 00:17:27.221 15:46:25 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:17:27.221 15:46:25 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:17:27.221 15:46:25 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:17:27.221 15:46:25 -- nvmf/common.sh@409 -- # rdma_device_init 00:17:27.221 15:46:25 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:17:27.221 15:46:25 -- nvmf/common.sh@58 -- # uname 00:17:27.221 15:46:25 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:17:27.221 15:46:25 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:17:27.221 15:46:25 -- nvmf/common.sh@63 -- # modprobe ib_core 00:17:27.221 15:46:25 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:17:27.221 15:46:25 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:17:27.221 15:46:25 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:17:27.221 15:46:25 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:17:27.221 15:46:25 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:17:27.221 15:46:25 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:17:27.221 15:46:25 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:17:27.221 15:46:25 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:17:27.221 15:46:25 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:27.221 15:46:25 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:27.221 15:46:25 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:27.221 15:46:25 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:27.221 15:46:25 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:27.221 15:46:25 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:27.221 15:46:25 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:27.221 15:46:25 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:17:27.221 15:46:25 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:17:27.221 15:46:25 -- nvmf/common.sh@105 -- # continue 2 00:17:27.221 15:46:25 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:27.221 15:46:25 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:27.222 15:46:25 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:17:27.222 15:46:25 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:27.222 15:46:25 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:17:27.222 15:46:25 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:17:27.222 15:46:25 -- nvmf/common.sh@105 -- # continue 2 00:17:27.222 15:46:25 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:27.222 15:46:25 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:17:27.222 15:46:25 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:17:27.222 15:46:25 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:17:27.222 15:46:25 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:27.222 15:46:25 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:27.222 15:46:25 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:17:27.222 15:46:25 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:17:27.222 15:46:25 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:17:27.222 122: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:17:27.222 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:17:27.222 altname enp218s0f0np0 00:17:27.222 altname ens818f0np0 00:17:27.222 inet 192.168.100.8/24 scope global mlx_0_0 00:17:27.222 valid_lft forever preferred_lft forever 00:17:27.222 15:46:25 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:27.222 15:46:25 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:17:27.222 15:46:25 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:17:27.222 15:46:25 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:17:27.222 15:46:25 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:27.222 15:46:25 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:27.479 15:46:25 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:17:27.479 15:46:25 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:17:27.479 15:46:25 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:17:27.479 123: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:17:27.479 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:17:27.479 altname enp218s0f1np1 00:17:27.479 altname ens818f1np1 00:17:27.479 inet 192.168.100.9/24 scope global mlx_0_1 00:17:27.479 valid_lft forever preferred_lft forever 00:17:27.479 15:46:25 -- nvmf/common.sh@411 -- # return 0 00:17:27.479 15:46:25 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:17:27.479 15:46:25 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:17:27.479 15:46:25 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:17:27.479 15:46:25 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:17:27.479 15:46:25 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:17:27.479 15:46:25 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:27.479 15:46:25 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:27.479 15:46:25 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:27.479 15:46:25 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:27.479 15:46:25 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:27.479 15:46:25 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:27.479 15:46:25 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:27.479 15:46:25 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:17:27.479 15:46:25 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:17:27.479 15:46:25 -- nvmf/common.sh@105 -- # continue 2 00:17:27.479 15:46:25 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:27.479 15:46:25 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:27.479 15:46:25 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:17:27.479 15:46:25 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:27.479 15:46:25 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:17:27.479 15:46:25 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:17:27.479 15:46:25 -- nvmf/common.sh@105 -- # continue 2 00:17:27.480 15:46:25 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:27.480 15:46:25 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:17:27.480 15:46:25 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:17:27.480 15:46:25 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:17:27.480 15:46:25 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:27.480 15:46:25 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:27.480 15:46:25 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:27.480 15:46:25 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:17:27.480 15:46:25 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:17:27.480 15:46:25 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:17:27.480 15:46:25 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:27.480 15:46:25 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:27.480 15:46:25 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:17:27.480 192.168.100.9' 00:17:27.480 15:46:25 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:17:27.480 192.168.100.9' 00:17:27.480 15:46:25 -- nvmf/common.sh@446 -- # head -n 1 00:17:27.480 15:46:25 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:17:27.480 15:46:25 -- nvmf/common.sh@447 -- # tail -n +2 00:17:27.480 15:46:25 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:17:27.480 192.168.100.9' 00:17:27.480 15:46:25 -- nvmf/common.sh@447 -- # head -n 1 00:17:27.480 15:46:25 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:17:27.480 15:46:25 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:17:27.480 15:46:25 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:17:27.480 15:46:25 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:17:27.480 15:46:25 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:17:27.480 15:46:25 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:17:27.480 15:46:25 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:17:27.480 15:46:25 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:17:27.480 15:46:25 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:27.480 15:46:25 -- common/autotest_common.sh@10 -- # set +x 00:17:27.480 15:46:25 -- nvmf/common.sh@470 -- # nvmfpid=3355161 00:17:27.480 15:46:25 -- nvmf/common.sh@471 -- # waitforlisten 3355161 00:17:27.480 15:46:25 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:17:27.480 15:46:25 -- common/autotest_common.sh@817 -- # '[' -z 3355161 ']' 00:17:27.480 15:46:25 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:27.480 15:46:25 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:27.480 15:46:25 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:27.480 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:27.480 15:46:25 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:27.480 15:46:25 -- common/autotest_common.sh@10 -- # set +x 00:17:27.480 [2024-04-26 15:46:25.973907] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:17:27.480 [2024-04-26 15:46:25.973946] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:27.480 EAL: No free 2048 kB hugepages reported on node 1 00:17:27.480 [2024-04-26 15:46:26.029625] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:27.737 [2024-04-26 15:46:26.106974] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:27.737 [2024-04-26 15:46:26.107006] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:27.737 [2024-04-26 15:46:26.107013] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:27.737 [2024-04-26 15:46:26.107019] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:27.737 [2024-04-26 15:46:26.107024] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:27.737 [2024-04-26 15:46:26.107124] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:27.737 [2024-04-26 15:46:26.107212] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:27.737 [2024-04-26 15:46:26.107255] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:27.737 [2024-04-26 15:46:26.107254] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:28.301 15:46:26 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:28.301 15:46:26 -- common/autotest_common.sh@850 -- # return 0 00:17:28.301 15:46:26 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:17:28.301 15:46:26 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:28.301 15:46:26 -- common/autotest_common.sh@10 -- # set +x 00:17:28.301 15:46:26 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:28.301 15:46:26 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:17:28.301 15:46:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:28.301 15:46:26 -- common/autotest_common.sh@10 -- # set +x 00:17:28.301 [2024-04-26 15:46:26.835233] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x19383f0/0x193c8e0) succeed. 00:17:28.301 [2024-04-26 15:46:26.845483] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1939a30/0x197df70) succeed. 00:17:28.559 15:46:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:28.559 15:46:26 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:17:28.559 15:46:26 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:17:28.559 15:46:26 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:28.559 15:46:26 -- common/autotest_common.sh@10 -- # set +x 00:17:28.559 15:46:26 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:28.559 15:46:26 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:28.559 15:46:26 -- target/shutdown.sh@28 -- # cat 00:17:28.559 15:46:26 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:28.559 15:46:26 -- target/shutdown.sh@28 -- # cat 00:17:28.559 15:46:26 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:28.559 15:46:26 -- target/shutdown.sh@28 -- # cat 00:17:28.559 15:46:26 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:28.559 15:46:26 -- target/shutdown.sh@28 -- # cat 00:17:28.559 15:46:26 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:28.559 15:46:26 -- target/shutdown.sh@28 -- # cat 00:17:28.559 15:46:26 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:28.559 15:46:26 -- target/shutdown.sh@28 -- # cat 00:17:28.559 15:46:26 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:28.559 15:46:26 -- target/shutdown.sh@28 -- # cat 00:17:28.559 15:46:26 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:28.559 15:46:26 -- target/shutdown.sh@28 -- # cat 00:17:28.559 15:46:27 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:28.559 15:46:27 -- target/shutdown.sh@28 -- # cat 00:17:28.559 15:46:27 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:17:28.559 15:46:27 -- target/shutdown.sh@28 -- # cat 00:17:28.559 15:46:27 -- target/shutdown.sh@35 -- # rpc_cmd 00:17:28.559 15:46:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:28.559 15:46:27 -- common/autotest_common.sh@10 -- # set +x 00:17:28.559 Malloc1 00:17:28.559 [2024-04-26 15:46:27.055713] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:17:28.559 Malloc2 00:17:28.559 Malloc3 00:17:28.559 Malloc4 00:17:28.817 Malloc5 00:17:28.817 Malloc6 00:17:28.817 Malloc7 00:17:28.817 Malloc8 00:17:28.817 Malloc9 00:17:29.076 Malloc10 00:17:29.076 15:46:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:29.076 15:46:27 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:17:29.076 15:46:27 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:29.076 15:46:27 -- common/autotest_common.sh@10 -- # set +x 00:17:29.076 15:46:27 -- target/shutdown.sh@125 -- # perfpid=3355446 00:17:29.076 15:46:27 -- target/shutdown.sh@126 -- # waitforlisten 3355446 /var/tmp/bdevperf.sock 00:17:29.076 15:46:27 -- common/autotest_common.sh@817 -- # '[' -z 3355446 ']' 00:17:29.076 15:46:27 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:29.076 15:46:27 -- target/shutdown.sh@124 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:17:29.076 15:46:27 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:29.076 15:46:27 -- target/shutdown.sh@124 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:17:29.076 15:46:27 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:29.076 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:29.076 15:46:27 -- nvmf/common.sh@521 -- # config=() 00:17:29.076 15:46:27 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:29.076 15:46:27 -- nvmf/common.sh@521 -- # local subsystem config 00:17:29.076 15:46:27 -- common/autotest_common.sh@10 -- # set +x 00:17:29.076 15:46:27 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:29.076 15:46:27 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:29.076 { 00:17:29.076 "params": { 00:17:29.076 "name": "Nvme$subsystem", 00:17:29.076 "trtype": "$TEST_TRANSPORT", 00:17:29.076 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:29.076 "adrfam": "ipv4", 00:17:29.076 "trsvcid": "$NVMF_PORT", 00:17:29.076 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:29.076 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:29.076 "hdgst": ${hdgst:-false}, 00:17:29.076 "ddgst": ${ddgst:-false} 00:17:29.076 }, 00:17:29.076 "method": "bdev_nvme_attach_controller" 00:17:29.076 } 00:17:29.076 EOF 00:17:29.076 )") 00:17:29.076 15:46:27 -- nvmf/common.sh@543 -- # cat 00:17:29.076 15:46:27 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:29.076 15:46:27 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:29.076 { 00:17:29.076 "params": { 00:17:29.076 "name": "Nvme$subsystem", 00:17:29.076 "trtype": "$TEST_TRANSPORT", 00:17:29.076 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:29.076 "adrfam": "ipv4", 00:17:29.076 "trsvcid": "$NVMF_PORT", 00:17:29.076 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:29.076 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:29.076 "hdgst": ${hdgst:-false}, 00:17:29.076 "ddgst": ${ddgst:-false} 00:17:29.076 }, 00:17:29.076 "method": "bdev_nvme_attach_controller" 00:17:29.076 } 00:17:29.076 EOF 00:17:29.076 )") 00:17:29.077 15:46:27 -- nvmf/common.sh@543 -- # cat 00:17:29.077 15:46:27 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:29.077 15:46:27 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:29.077 { 00:17:29.077 "params": { 00:17:29.077 "name": "Nvme$subsystem", 00:17:29.077 "trtype": "$TEST_TRANSPORT", 00:17:29.077 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:29.077 "adrfam": "ipv4", 00:17:29.077 "trsvcid": "$NVMF_PORT", 00:17:29.077 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:29.077 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:29.077 "hdgst": ${hdgst:-false}, 00:17:29.077 "ddgst": ${ddgst:-false} 00:17:29.077 }, 00:17:29.077 "method": "bdev_nvme_attach_controller" 00:17:29.077 } 00:17:29.077 EOF 00:17:29.077 )") 00:17:29.077 15:46:27 -- nvmf/common.sh@543 -- # cat 00:17:29.077 15:46:27 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:29.077 15:46:27 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:29.077 { 00:17:29.077 "params": { 00:17:29.077 "name": "Nvme$subsystem", 00:17:29.077 "trtype": "$TEST_TRANSPORT", 00:17:29.077 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:29.077 "adrfam": "ipv4", 00:17:29.077 "trsvcid": "$NVMF_PORT", 00:17:29.077 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:29.077 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:29.077 "hdgst": ${hdgst:-false}, 00:17:29.077 "ddgst": ${ddgst:-false} 00:17:29.077 }, 00:17:29.077 "method": "bdev_nvme_attach_controller" 00:17:29.077 } 00:17:29.077 EOF 00:17:29.077 )") 00:17:29.077 15:46:27 -- nvmf/common.sh@543 -- # cat 00:17:29.077 15:46:27 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:29.077 15:46:27 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:29.077 { 00:17:29.077 "params": { 00:17:29.077 "name": "Nvme$subsystem", 00:17:29.077 "trtype": "$TEST_TRANSPORT", 00:17:29.077 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:29.077 "adrfam": "ipv4", 00:17:29.077 "trsvcid": "$NVMF_PORT", 00:17:29.077 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:29.077 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:29.077 "hdgst": ${hdgst:-false}, 00:17:29.077 "ddgst": ${ddgst:-false} 00:17:29.077 }, 00:17:29.077 "method": "bdev_nvme_attach_controller" 00:17:29.077 } 00:17:29.077 EOF 00:17:29.077 )") 00:17:29.077 15:46:27 -- nvmf/common.sh@543 -- # cat 00:17:29.077 15:46:27 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:29.077 15:46:27 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:29.077 { 00:17:29.077 "params": { 00:17:29.077 "name": "Nvme$subsystem", 00:17:29.077 "trtype": "$TEST_TRANSPORT", 00:17:29.077 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:29.077 "adrfam": "ipv4", 00:17:29.077 "trsvcid": "$NVMF_PORT", 00:17:29.077 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:29.077 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:29.077 "hdgst": ${hdgst:-false}, 00:17:29.077 "ddgst": ${ddgst:-false} 00:17:29.077 }, 00:17:29.077 "method": "bdev_nvme_attach_controller" 00:17:29.077 } 00:17:29.077 EOF 00:17:29.077 )") 00:17:29.077 15:46:27 -- nvmf/common.sh@543 -- # cat 00:17:29.077 [2024-04-26 15:46:27.527820] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:17:29.077 [2024-04-26 15:46:27.527867] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3355446 ] 00:17:29.077 15:46:27 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:29.077 15:46:27 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:29.077 { 00:17:29.077 "params": { 00:17:29.077 "name": "Nvme$subsystem", 00:17:29.077 "trtype": "$TEST_TRANSPORT", 00:17:29.077 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:29.077 "adrfam": "ipv4", 00:17:29.077 "trsvcid": "$NVMF_PORT", 00:17:29.077 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:29.077 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:29.077 "hdgst": ${hdgst:-false}, 00:17:29.077 "ddgst": ${ddgst:-false} 00:17:29.077 }, 00:17:29.077 "method": "bdev_nvme_attach_controller" 00:17:29.077 } 00:17:29.077 EOF 00:17:29.077 )") 00:17:29.077 15:46:27 -- nvmf/common.sh@543 -- # cat 00:17:29.077 15:46:27 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:29.077 15:46:27 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:29.077 { 00:17:29.077 "params": { 00:17:29.077 "name": "Nvme$subsystem", 00:17:29.077 "trtype": "$TEST_TRANSPORT", 00:17:29.077 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:29.077 "adrfam": "ipv4", 00:17:29.077 "trsvcid": "$NVMF_PORT", 00:17:29.077 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:29.077 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:29.077 "hdgst": ${hdgst:-false}, 00:17:29.077 "ddgst": ${ddgst:-false} 00:17:29.077 }, 00:17:29.077 "method": "bdev_nvme_attach_controller" 00:17:29.077 } 00:17:29.077 EOF 00:17:29.077 )") 00:17:29.077 15:46:27 -- nvmf/common.sh@543 -- # cat 00:17:29.077 15:46:27 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:29.077 15:46:27 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:29.077 { 00:17:29.077 "params": { 00:17:29.077 "name": "Nvme$subsystem", 00:17:29.077 "trtype": "$TEST_TRANSPORT", 00:17:29.077 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:29.077 "adrfam": "ipv4", 00:17:29.077 "trsvcid": "$NVMF_PORT", 00:17:29.077 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:29.077 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:29.077 "hdgst": ${hdgst:-false}, 00:17:29.077 "ddgst": ${ddgst:-false} 00:17:29.077 }, 00:17:29.077 "method": "bdev_nvme_attach_controller" 00:17:29.077 } 00:17:29.077 EOF 00:17:29.077 )") 00:17:29.077 15:46:27 -- nvmf/common.sh@543 -- # cat 00:17:29.077 15:46:27 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:29.077 15:46:27 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:29.077 { 00:17:29.077 "params": { 00:17:29.077 "name": "Nvme$subsystem", 00:17:29.077 "trtype": "$TEST_TRANSPORT", 00:17:29.077 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:29.077 "adrfam": "ipv4", 00:17:29.077 "trsvcid": "$NVMF_PORT", 00:17:29.077 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:29.077 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:29.077 "hdgst": ${hdgst:-false}, 00:17:29.077 "ddgst": ${ddgst:-false} 00:17:29.077 }, 00:17:29.077 "method": "bdev_nvme_attach_controller" 00:17:29.077 } 00:17:29.077 EOF 00:17:29.077 )") 00:17:29.077 EAL: No free 2048 kB hugepages reported on node 1 00:17:29.077 15:46:27 -- nvmf/common.sh@543 -- # cat 00:17:29.077 15:46:27 -- nvmf/common.sh@545 -- # jq . 00:17:29.077 15:46:27 -- nvmf/common.sh@546 -- # IFS=, 00:17:29.077 15:46:27 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:17:29.077 "params": { 00:17:29.077 "name": "Nvme1", 00:17:29.077 "trtype": "rdma", 00:17:29.077 "traddr": "192.168.100.8", 00:17:29.077 "adrfam": "ipv4", 00:17:29.077 "trsvcid": "4420", 00:17:29.077 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:29.077 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:29.077 "hdgst": false, 00:17:29.077 "ddgst": false 00:17:29.077 }, 00:17:29.077 "method": "bdev_nvme_attach_controller" 00:17:29.077 },{ 00:17:29.077 "params": { 00:17:29.077 "name": "Nvme2", 00:17:29.077 "trtype": "rdma", 00:17:29.077 "traddr": "192.168.100.8", 00:17:29.077 "adrfam": "ipv4", 00:17:29.077 "trsvcid": "4420", 00:17:29.077 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:17:29.077 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:17:29.077 "hdgst": false, 00:17:29.077 "ddgst": false 00:17:29.077 }, 00:17:29.077 "method": "bdev_nvme_attach_controller" 00:17:29.077 },{ 00:17:29.077 "params": { 00:17:29.077 "name": "Nvme3", 00:17:29.077 "trtype": "rdma", 00:17:29.077 "traddr": "192.168.100.8", 00:17:29.077 "adrfam": "ipv4", 00:17:29.077 "trsvcid": "4420", 00:17:29.077 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:17:29.077 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:17:29.077 "hdgst": false, 00:17:29.077 "ddgst": false 00:17:29.077 }, 00:17:29.077 "method": "bdev_nvme_attach_controller" 00:17:29.077 },{ 00:17:29.077 "params": { 00:17:29.077 "name": "Nvme4", 00:17:29.077 "trtype": "rdma", 00:17:29.077 "traddr": "192.168.100.8", 00:17:29.077 "adrfam": "ipv4", 00:17:29.077 "trsvcid": "4420", 00:17:29.077 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:17:29.077 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:17:29.077 "hdgst": false, 00:17:29.077 "ddgst": false 00:17:29.077 }, 00:17:29.077 "method": "bdev_nvme_attach_controller" 00:17:29.077 },{ 00:17:29.077 "params": { 00:17:29.077 "name": "Nvme5", 00:17:29.077 "trtype": "rdma", 00:17:29.077 "traddr": "192.168.100.8", 00:17:29.077 "adrfam": "ipv4", 00:17:29.077 "trsvcid": "4420", 00:17:29.077 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:17:29.077 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:17:29.077 "hdgst": false, 00:17:29.077 "ddgst": false 00:17:29.077 }, 00:17:29.077 "method": "bdev_nvme_attach_controller" 00:17:29.077 },{ 00:17:29.077 "params": { 00:17:29.077 "name": "Nvme6", 00:17:29.077 "trtype": "rdma", 00:17:29.077 "traddr": "192.168.100.8", 00:17:29.077 "adrfam": "ipv4", 00:17:29.077 "trsvcid": "4420", 00:17:29.077 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:17:29.077 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:17:29.077 "hdgst": false, 00:17:29.078 "ddgst": false 00:17:29.078 }, 00:17:29.078 "method": "bdev_nvme_attach_controller" 00:17:29.078 },{ 00:17:29.078 "params": { 00:17:29.078 "name": "Nvme7", 00:17:29.078 "trtype": "rdma", 00:17:29.078 "traddr": "192.168.100.8", 00:17:29.078 "adrfam": "ipv4", 00:17:29.078 "trsvcid": "4420", 00:17:29.078 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:17:29.078 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:17:29.078 "hdgst": false, 00:17:29.078 "ddgst": false 00:17:29.078 }, 00:17:29.078 "method": "bdev_nvme_attach_controller" 00:17:29.078 },{ 00:17:29.078 "params": { 00:17:29.078 "name": "Nvme8", 00:17:29.078 "trtype": "rdma", 00:17:29.078 "traddr": "192.168.100.8", 00:17:29.078 "adrfam": "ipv4", 00:17:29.078 "trsvcid": "4420", 00:17:29.078 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:17:29.078 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:17:29.078 "hdgst": false, 00:17:29.078 "ddgst": false 00:17:29.078 }, 00:17:29.078 "method": "bdev_nvme_attach_controller" 00:17:29.078 },{ 00:17:29.078 "params": { 00:17:29.078 "name": "Nvme9", 00:17:29.078 "trtype": "rdma", 00:17:29.078 "traddr": "192.168.100.8", 00:17:29.078 "adrfam": "ipv4", 00:17:29.078 "trsvcid": "4420", 00:17:29.078 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:17:29.078 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:17:29.078 "hdgst": false, 00:17:29.078 "ddgst": false 00:17:29.078 }, 00:17:29.078 "method": "bdev_nvme_attach_controller" 00:17:29.078 },{ 00:17:29.078 "params": { 00:17:29.078 "name": "Nvme10", 00:17:29.078 "trtype": "rdma", 00:17:29.078 "traddr": "192.168.100.8", 00:17:29.078 "adrfam": "ipv4", 00:17:29.078 "trsvcid": "4420", 00:17:29.078 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:17:29.078 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:17:29.078 "hdgst": false, 00:17:29.078 "ddgst": false 00:17:29.078 }, 00:17:29.078 "method": "bdev_nvme_attach_controller" 00:17:29.078 }' 00:17:29.078 [2024-04-26 15:46:27.585575] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:29.078 [2024-04-26 15:46:27.659078] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:30.009 Running I/O for 10 seconds... 00:17:30.009 15:46:28 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:30.009 15:46:28 -- common/autotest_common.sh@850 -- # return 0 00:17:30.009 15:46:28 -- target/shutdown.sh@127 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:17:30.009 15:46:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:30.009 15:46:28 -- common/autotest_common.sh@10 -- # set +x 00:17:30.266 15:46:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:30.266 15:46:28 -- target/shutdown.sh@130 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:30.266 15:46:28 -- target/shutdown.sh@132 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:17:30.266 15:46:28 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:17:30.266 15:46:28 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:17:30.266 15:46:28 -- target/shutdown.sh@57 -- # local ret=1 00:17:30.266 15:46:28 -- target/shutdown.sh@58 -- # local i 00:17:30.266 15:46:28 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:17:30.266 15:46:28 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:17:30.266 15:46:28 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:17:30.266 15:46:28 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:17:30.266 15:46:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:30.266 15:46:28 -- common/autotest_common.sh@10 -- # set +x 00:17:30.266 15:46:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:30.266 15:46:28 -- target/shutdown.sh@60 -- # read_io_count=27 00:17:30.266 15:46:28 -- target/shutdown.sh@63 -- # '[' 27 -ge 100 ']' 00:17:30.266 15:46:28 -- target/shutdown.sh@67 -- # sleep 0.25 00:17:30.524 15:46:29 -- target/shutdown.sh@59 -- # (( i-- )) 00:17:30.524 15:46:29 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:17:30.524 15:46:29 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:17:30.524 15:46:29 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:17:30.524 15:46:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:30.524 15:46:29 -- common/autotest_common.sh@10 -- # set +x 00:17:30.782 15:46:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:30.782 15:46:29 -- target/shutdown.sh@60 -- # read_io_count=179 00:17:30.782 15:46:29 -- target/shutdown.sh@63 -- # '[' 179 -ge 100 ']' 00:17:30.782 15:46:29 -- target/shutdown.sh@64 -- # ret=0 00:17:30.782 15:46:29 -- target/shutdown.sh@65 -- # break 00:17:30.782 15:46:29 -- target/shutdown.sh@69 -- # return 0 00:17:30.782 15:46:29 -- target/shutdown.sh@135 -- # killprocess 3355161 00:17:30.782 15:46:29 -- common/autotest_common.sh@936 -- # '[' -z 3355161 ']' 00:17:30.782 15:46:29 -- common/autotest_common.sh@940 -- # kill -0 3355161 00:17:30.782 15:46:29 -- common/autotest_common.sh@941 -- # uname 00:17:30.782 15:46:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:30.782 15:46:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3355161 00:17:30.782 15:46:29 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:30.782 15:46:29 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:30.782 15:46:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3355161' 00:17:30.782 killing process with pid 3355161 00:17:30.782 15:46:29 -- common/autotest_common.sh@955 -- # kill 3355161 00:17:30.782 15:46:29 -- common/autotest_common.sh@960 -- # wait 3355161 00:17:30.782 [2024-04-26 15:46:29.299891] rdma.c: 845:nvmf_rdma_qpair_destroy: *WARNING*: Destroying qpair when queue depth is 3 00:17:31.039 [2024-04-26 15:46:29.388922] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:17:31.296 15:46:29 -- target/shutdown.sh@136 -- # nvmfpid= 00:17:31.296 15:46:29 -- target/shutdown.sh@139 -- # sleep 1 00:17:31.868 [2024-04-26 15:46:30.349385] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.868 [2024-04-26 15:46:30.349433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:31.868 [2024-04-26 15:46:30.349445] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.868 [2024-04-26 15:46:30.349452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:31.868 [2024-04-26 15:46:30.349459] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.868 [2024-04-26 15:46:30.349465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:31.868 [2024-04-26 15:46:30.349472] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.868 [2024-04-26 15:46:30.349478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:31.868 [2024-04-26 15:46:30.351856] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:31.868 [2024-04-26 15:46:30.351893] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:17:31.868 [2024-04-26 15:46:30.351937] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.868 [2024-04-26 15:46:30.351961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:54914 cdw0:0 sqhd:1700 p:1 m:1 dnr:0 00:17:31.868 [2024-04-26 15:46:30.351985] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.868 [2024-04-26 15:46:30.352006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:54914 cdw0:0 sqhd:1700 p:1 m:1 dnr:0 00:17:31.868 [2024-04-26 15:46:30.352030] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.868 [2024-04-26 15:46:30.352051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:54914 cdw0:0 sqhd:1700 p:1 m:1 dnr:0 00:17:31.868 [2024-04-26 15:46:30.352074] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.868 [2024-04-26 15:46:30.352099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:54914 cdw0:0 sqhd:1700 p:1 m:1 dnr:0 00:17:31.868 [2024-04-26 15:46:30.354359] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:31.868 [2024-04-26 15:46:30.354378] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:17:31.868 [2024-04-26 15:46:30.354399] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.868 [2024-04-26 15:46:30.354411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:54914 cdw0:0 sqhd:1700 p:1 m:1 dnr:0 00:17:31.868 [2024-04-26 15:46:30.354423] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.868 [2024-04-26 15:46:30.354433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:54914 cdw0:0 sqhd:1700 p:1 m:1 dnr:0 00:17:31.868 [2024-04-26 15:46:30.354444] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.868 [2024-04-26 15:46:30.354454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:54914 cdw0:0 sqhd:1700 p:1 m:1 dnr:0 00:17:31.868 [2024-04-26 15:46:30.354464] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.868 [2024-04-26 15:46:30.354478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:54914 cdw0:0 sqhd:1700 p:1 m:1 dnr:0 00:17:31.868 [2024-04-26 15:46:30.356956] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:31.868 [2024-04-26 15:46:30.356986] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:31.868 [2024-04-26 15:46:30.357022] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.868 [2024-04-26 15:46:30.357045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:54914 cdw0:0 sqhd:1700 p:1 m:1 dnr:0 00:17:31.868 [2024-04-26 15:46:30.357068] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.868 [2024-04-26 15:46:30.357089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:54914 cdw0:0 sqhd:1700 p:1 m:1 dnr:0 00:17:31.868 [2024-04-26 15:46:30.357112] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.868 [2024-04-26 15:46:30.357133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:54914 cdw0:0 sqhd:1700 p:1 m:1 dnr:0 00:17:31.868 [2024-04-26 15:46:30.357170] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.868 [2024-04-26 15:46:30.357191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:54914 cdw0:0 sqhd:1700 p:1 m:1 dnr:0 00:17:31.868 [2024-04-26 15:46:30.359080] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:31.868 [2024-04-26 15:46:30.359110] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:17:31.868 [2024-04-26 15:46:30.359155] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.868 [2024-04-26 15:46:30.359179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:54914 cdw0:0 sqhd:1700 p:1 m:1 dnr:0 00:17:31.868 [2024-04-26 15:46:30.359202] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.868 [2024-04-26 15:46:30.359224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:54914 cdw0:0 sqhd:1700 p:1 m:1 dnr:0 00:17:31.868 [2024-04-26 15:46:30.359246] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.868 [2024-04-26 15:46:30.359266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:54914 cdw0:0 sqhd:1700 p:1 m:1 dnr:0 00:17:31.868 [2024-04-26 15:46:30.359289] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.868 [2024-04-26 15:46:30.359310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:54914 cdw0:0 sqhd:1700 p:1 m:1 dnr:0 00:17:31.868 [2024-04-26 15:46:30.361230] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:31.868 [2024-04-26 15:46:30.361245] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:17:31.868 [2024-04-26 15:46:30.361263] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.868 [2024-04-26 15:46:30.361274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:54914 cdw0:0 sqhd:1700 p:1 m:1 dnr:0 00:17:31.868 [2024-04-26 15:46:30.361285] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.868 [2024-04-26 15:46:30.361299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:54914 cdw0:0 sqhd:1700 p:1 m:1 dnr:0 00:17:31.868 [2024-04-26 15:46:30.361310] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.868 [2024-04-26 15:46:30.361320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:54914 cdw0:0 sqhd:1700 p:1 m:1 dnr:0 00:17:31.868 [2024-04-26 15:46:30.361331] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.868 [2024-04-26 15:46:30.361341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:54914 cdw0:0 sqhd:1700 p:1 m:1 dnr:0 00:17:31.868 [2024-04-26 15:46:30.363407] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:31.868 [2024-04-26 15:46:30.363438] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:17:31.868 [2024-04-26 15:46:30.363475] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.868 [2024-04-26 15:46:30.363499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:54914 cdw0:0 sqhd:1700 p:1 m:1 dnr:0 00:17:31.868 [2024-04-26 15:46:30.363522] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.868 [2024-04-26 15:46:30.363544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:54914 cdw0:0 sqhd:1700 p:1 m:1 dnr:0 00:17:31.868 [2024-04-26 15:46:30.363566] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.868 [2024-04-26 15:46:30.363587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:54914 cdw0:0 sqhd:1700 p:1 m:1 dnr:0 00:17:31.868 [2024-04-26 15:46:30.363609] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.869 [2024-04-26 15:46:30.363630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:54914 cdw0:0 sqhd:1700 p:1 m:1 dnr:0 00:17:31.869 [2024-04-26 15:46:30.365524] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:31.869 [2024-04-26 15:46:30.365554] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:17:31.869 [2024-04-26 15:46:30.365589] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.869 [2024-04-26 15:46:30.365612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:54914 cdw0:0 sqhd:1700 p:1 m:1 dnr:0 00:17:31.869 [2024-04-26 15:46:30.365635] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.869 [2024-04-26 15:46:30.365656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:54914 cdw0:0 sqhd:1700 p:1 m:1 dnr:0 00:17:31.869 [2024-04-26 15:46:30.365679] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.869 [2024-04-26 15:46:30.365700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:54914 cdw0:0 sqhd:1700 p:1 m:1 dnr:0 00:17:31.869 [2024-04-26 15:46:30.365721] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.869 [2024-04-26 15:46:30.365742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:54914 cdw0:0 sqhd:1700 p:1 m:1 dnr:0 00:17:31.869 [2024-04-26 15:46:30.367697] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:31.869 [2024-04-26 15:46:30.367727] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:17:31.869 [2024-04-26 15:46:30.367763] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.869 [2024-04-26 15:46:30.367786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:54914 cdw0:0 sqhd:1700 p:1 m:1 dnr:0 00:17:31.869 [2024-04-26 15:46:30.367809] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.869 [2024-04-26 15:46:30.367830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:54914 cdw0:0 sqhd:1700 p:1 m:1 dnr:0 00:17:31.869 [2024-04-26 15:46:30.367851] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.869 [2024-04-26 15:46:30.367871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:54914 cdw0:0 sqhd:1700 p:1 m:1 dnr:0 00:17:31.869 [2024-04-26 15:46:30.367894] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.869 [2024-04-26 15:46:30.367915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:54914 cdw0:0 sqhd:1700 p:1 m:1 dnr:0 00:17:31.869 [2024-04-26 15:46:30.370247] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:31.869 [2024-04-26 15:46:30.370278] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:17:31.869 [2024-04-26 15:46:30.370314] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.869 [2024-04-26 15:46:30.370338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:54914 cdw0:0 sqhd:1700 p:1 m:1 dnr:0 00:17:31.869 [2024-04-26 15:46:30.370361] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.869 [2024-04-26 15:46:30.370382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:54914 cdw0:0 sqhd:1700 p:1 m:1 dnr:0 00:17:31.869 [2024-04-26 15:46:30.370407] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.869 [2024-04-26 15:46:30.370428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:54914 cdw0:0 sqhd:1700 p:1 m:1 dnr:0 00:17:31.869 [2024-04-26 15:46:30.370450] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:17:31.869 [2024-04-26 15:46:30.370472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:54914 cdw0:0 sqhd:1700 p:1 m:1 dnr:0 00:17:31.869 [2024-04-26 15:46:30.372498] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:31.869 [2024-04-26 15:46:30.372529] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:17:31.869 [2024-04-26 15:46:30.375030] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256f00 was disconnected and freed. reset controller. 00:17:31.869 [2024-04-26 15:46:30.375063] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:31.869 [2024-04-26 15:46:30.377633] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256cc0 was disconnected and freed. reset controller. 00:17:31.869 [2024-04-26 15:46:30.377668] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:31.869 [2024-04-26 15:46:30.380235] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256a80 was disconnected and freed. reset controller. 00:17:31.869 [2024-04-26 15:46:30.380257] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:31.869 [2024-04-26 15:46:30.382456] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256840 was disconnected and freed. reset controller. 00:17:31.869 [2024-04-26 15:46:30.382490] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:31.869 [2024-04-26 15:46:30.385518] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256600 was disconnected and freed. reset controller. 00:17:31.869 [2024-04-26 15:46:30.385548] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:31.869 [2024-04-26 15:46:30.387677] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192563c0 was disconnected and freed. reset controller. 00:17:31.869 [2024-04-26 15:46:30.387714] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:31.869 [2024-04-26 15:46:30.387918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:34304 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a77fc80 len:0x10000 key:0x183100 00:17:31.869 [2024-04-26 15:46:30.387949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.869 [2024-04-26 15:46:30.388002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:34432 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a76fc00 len:0x10000 key:0x183100 00:17:31.869 [2024-04-26 15:46:30.388027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.869 [2024-04-26 15:46:30.388061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:34560 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a75fb80 len:0x10000 key:0x183100 00:17:31.869 [2024-04-26 15:46:30.388085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.869 [2024-04-26 15:46:30.388118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:34688 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a74fb00 len:0x10000 key:0x183100 00:17:31.869 [2024-04-26 15:46:30.388151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.869 [2024-04-26 15:46:30.388185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:34816 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a73fa80 len:0x10000 key:0x183100 00:17:31.869 [2024-04-26 15:46:30.388209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.869 [2024-04-26 15:46:30.388243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:34944 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a72fa00 len:0x10000 key:0x183100 00:17:31.869 [2024-04-26 15:46:30.388266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.869 [2024-04-26 15:46:30.388300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:35072 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a71f980 len:0x10000 key:0x183100 00:17:31.869 [2024-04-26 15:46:30.388324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.869 [2024-04-26 15:46:30.388356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:35200 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a70f900 len:0x10000 key:0x183100 00:17:31.869 [2024-04-26 15:46:30.388379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.869 [2024-04-26 15:46:30.388412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:35328 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a6ff880 len:0x10000 key:0x183100 00:17:31.869 [2024-04-26 15:46:30.388440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.869 [2024-04-26 15:46:30.388473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:35456 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a6ef800 len:0x10000 key:0x183100 00:17:31.869 [2024-04-26 15:46:30.388495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.869 [2024-04-26 15:46:30.388528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:35584 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a6df780 len:0x10000 key:0x183100 00:17:31.869 [2024-04-26 15:46:30.388551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.869 [2024-04-26 15:46:30.388593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:35712 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a6cf700 len:0x10000 key:0x183100 00:17:31.869 [2024-04-26 15:46:30.388605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.869 [2024-04-26 15:46:30.388620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:35840 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a6bf680 len:0x10000 key:0x183100 00:17:31.869 [2024-04-26 15:46:30.388631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.869 [2024-04-26 15:46:30.388648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:35968 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a6af600 len:0x10000 key:0x183100 00:17:31.869 [2024-04-26 15:46:30.388658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.869 [2024-04-26 15:46:30.388674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:36096 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a69f580 len:0x10000 key:0x183100 00:17:31.869 [2024-04-26 15:46:30.388685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.869 [2024-04-26 15:46:30.388700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:36224 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a68f500 len:0x10000 key:0x183100 00:17:31.869 [2024-04-26 15:46:30.388711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.870 [2024-04-26 15:46:30.388727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:36352 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a67f480 len:0x10000 key:0x183100 00:17:31.870 [2024-04-26 15:46:30.388739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.870 [2024-04-26 15:46:30.388755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a66f400 len:0x10000 key:0x183100 00:17:31.870 [2024-04-26 15:46:30.388766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.870 [2024-04-26 15:46:30.388782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:36608 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a65f380 len:0x10000 key:0x183100 00:17:31.870 [2024-04-26 15:46:30.388794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.870 [2024-04-26 15:46:30.388810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:36736 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a64f300 len:0x10000 key:0x183100 00:17:31.870 [2024-04-26 15:46:30.388824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.870 [2024-04-26 15:46:30.388841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:36864 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a63f280 len:0x10000 key:0x183100 00:17:31.870 [2024-04-26 15:46:30.388853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.870 [2024-04-26 15:46:30.388871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:36992 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a62f200 len:0x10000 key:0x183100 00:17:31.870 [2024-04-26 15:46:30.388881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.870 [2024-04-26 15:46:30.388897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:37120 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a61f180 len:0x10000 key:0x183100 00:17:31.870 [2024-04-26 15:46:30.388909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.870 [2024-04-26 15:46:30.388925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:37248 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a60f100 len:0x10000 key:0x183100 00:17:31.870 [2024-04-26 15:46:30.388936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.870 [2024-04-26 15:46:30.388952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:37376 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a9f0000 len:0x10000 key:0x183900 00:17:31.870 [2024-04-26 15:46:30.388964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.870 [2024-04-26 15:46:30.388980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:37504 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a9dff80 len:0x10000 key:0x183900 00:17:31.870 [2024-04-26 15:46:30.388993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.870 [2024-04-26 15:46:30.389010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:37632 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a9cff00 len:0x10000 key:0x183900 00:17:31.870 [2024-04-26 15:46:30.389021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.870 [2024-04-26 15:46:30.389039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:37760 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a9bfe80 len:0x10000 key:0x183900 00:17:31.870 [2024-04-26 15:46:30.389049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.870 [2024-04-26 15:46:30.389065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:37888 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a9afe00 len:0x10000 key:0x183900 00:17:31.870 [2024-04-26 15:46:30.389077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.870 [2024-04-26 15:46:30.389092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:38016 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a99fd80 len:0x10000 key:0x183900 00:17:31.870 [2024-04-26 15:46:30.389102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.870 [2024-04-26 15:46:30.389121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:38144 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a98fd00 len:0x10000 key:0x183900 00:17:31.870 [2024-04-26 15:46:30.389134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.870 [2024-04-26 15:46:30.389156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:38272 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a97fc80 len:0x10000 key:0x183900 00:17:31.870 [2024-04-26 15:46:30.389168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.870 [2024-04-26 15:46:30.389185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:38400 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a96fc00 len:0x10000 key:0x183900 00:17:31.870 [2024-04-26 15:46:30.389197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.870 [2024-04-26 15:46:30.389214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:38528 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a95fb80 len:0x10000 key:0x183900 00:17:31.870 [2024-04-26 15:46:30.389225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.870 [2024-04-26 15:46:30.389241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:38656 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a94fb00 len:0x10000 key:0x183900 00:17:31.870 [2024-04-26 15:46:30.389252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.870 [2024-04-26 15:46:30.389267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:38784 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a93fa80 len:0x10000 key:0x183900 00:17:31.870 [2024-04-26 15:46:30.389281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.870 [2024-04-26 15:46:30.389297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:38912 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a92fa00 len:0x10000 key:0x183900 00:17:31.870 [2024-04-26 15:46:30.389309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.870 [2024-04-26 15:46:30.389325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:39040 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a91f980 len:0x10000 key:0x183900 00:17:31.870 [2024-04-26 15:46:30.389336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.870 [2024-04-26 15:46:30.389352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:39168 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a90f900 len:0x10000 key:0x183900 00:17:31.870 [2024-04-26 15:46:30.389362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.870 [2024-04-26 15:46:30.389378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:39296 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a8ff880 len:0x10000 key:0x183900 00:17:31.870 [2024-04-26 15:46:30.389389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.870 [2024-04-26 15:46:30.389405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:39424 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a8ef800 len:0x10000 key:0x183900 00:17:31.870 [2024-04-26 15:46:30.389415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.870 [2024-04-26 15:46:30.389431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:39552 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a8df780 len:0x10000 key:0x183900 00:17:31.870 [2024-04-26 15:46:30.389444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.870 [2024-04-26 15:46:30.389460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:39680 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a8cf700 len:0x10000 key:0x183900 00:17:31.870 [2024-04-26 15:46:30.389471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.870 [2024-04-26 15:46:30.389488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:39808 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a8bf680 len:0x10000 key:0x183900 00:17:31.870 [2024-04-26 15:46:30.389499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.870 [2024-04-26 15:46:30.389515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:39936 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a8af600 len:0x10000 key:0x183900 00:17:31.870 [2024-04-26 15:46:30.389525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.870 [2024-04-26 15:46:30.389541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:40064 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a89f580 len:0x10000 key:0x183900 00:17:31.870 [2024-04-26 15:46:30.389553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.870 [2024-04-26 15:46:30.389569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:40192 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a88f500 len:0x10000 key:0x183900 00:17:31.870 [2024-04-26 15:46:30.389580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.870 [2024-04-26 15:46:30.389596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:40320 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a87f480 len:0x10000 key:0x183900 00:17:31.870 [2024-04-26 15:46:30.389607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.870 [2024-04-26 15:46:30.389624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:40448 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a86f400 len:0x10000 key:0x183900 00:17:31.870 [2024-04-26 15:46:30.389636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.871 [2024-04-26 15:46:30.389652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:40576 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a85f380 len:0x10000 key:0x183900 00:17:31.871 [2024-04-26 15:46:30.389663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.871 [2024-04-26 15:46:30.389679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:40704 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a84f300 len:0x10000 key:0x183900 00:17:31.871 [2024-04-26 15:46:30.389690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.871 [2024-04-26 15:46:30.389708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:40832 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a45f980 len:0x10000 key:0x183300 00:17:31.871 [2024-04-26 15:46:30.389719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.871 [2024-04-26 15:46:30.389735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:32768 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200011742000 len:0x10000 key:0x182800 00:17:31.871 [2024-04-26 15:46:30.389748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.871 [2024-04-26 15:46:30.389768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:32896 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200011721000 len:0x10000 key:0x182800 00:17:31.871 [2024-04-26 15:46:30.389779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.871 [2024-04-26 15:46:30.389796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:33024 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200011700000 len:0x10000 key:0x182800 00:17:31.871 [2024-04-26 15:46:30.389808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.871 [2024-04-26 15:46:30.389824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:33152 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000135cf000 len:0x10000 key:0x182800 00:17:31.871 [2024-04-26 15:46:30.389835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.871 [2024-04-26 15:46:30.389852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:33280 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000ebb0000 len:0x10000 key:0x182800 00:17:31.871 [2024-04-26 15:46:30.389863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.871 [2024-04-26 15:46:30.389880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:33408 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000ebd1000 len:0x10000 key:0x182800 00:17:31.871 [2024-04-26 15:46:30.389890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.871 [2024-04-26 15:46:30.389907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33536 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000c2f4000 len:0x10000 key:0x182800 00:17:31.871 [2024-04-26 15:46:30.389918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.871 [2024-04-26 15:46:30.389934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:33664 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000c2d3000 len:0x10000 key:0x182800 00:17:31.871 [2024-04-26 15:46:30.389944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.871 [2024-04-26 15:46:30.389962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:33792 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000c2b2000 len:0x10000 key:0x182800 00:17:31.871 [2024-04-26 15:46:30.389972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.871 [2024-04-26 15:46:30.389988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:33920 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000c291000 len:0x10000 key:0x182800 00:17:31.871 [2024-04-26 15:46:30.389999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.871 [2024-04-26 15:46:30.390016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:34048 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000c270000 len:0x10000 key:0x182800 00:17:31.871 [2024-04-26 15:46:30.390026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.871 [2024-04-26 15:46:30.390043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34176 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200010977000 len:0x10000 key:0x182800 00:17:31.871 [2024-04-26 15:46:30.390053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32573 cdw0:29f65010 sqhd:a46e p:0 m:0 dnr:0 00:17:31.871 [2024-04-26 15:46:30.393081] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256180 was disconnected and freed. reset controller. 00:17:31.871 [2024-04-26 15:46:30.393101] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:31.871 [2024-04-26 15:46:30.393119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:35200 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001addff80 len:0x10000 key:0x183600 00:17:31.871 [2024-04-26 15:46:30.393131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.871 [2024-04-26 15:46:30.393158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:35328 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001adcff00 len:0x10000 key:0x183600 00:17:31.871 [2024-04-26 15:46:30.393171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.871 [2024-04-26 15:46:30.393188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:35456 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001adbfe80 len:0x10000 key:0x183600 00:17:31.871 [2024-04-26 15:46:30.393198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.871 [2024-04-26 15:46:30.393216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:35584 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001adafe00 len:0x10000 key:0x183600 00:17:31.871 [2024-04-26 15:46:30.393227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.871 [2024-04-26 15:46:30.393243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:35712 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad9fd80 len:0x10000 key:0x183600 00:17:31.871 [2024-04-26 15:46:30.393254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.871 [2024-04-26 15:46:30.393270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:35840 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad8fd00 len:0x10000 key:0x183600 00:17:31.871 [2024-04-26 15:46:30.393281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.871 [2024-04-26 15:46:30.393297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:35968 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad7fc80 len:0x10000 key:0x183600 00:17:31.871 [2024-04-26 15:46:30.393308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.871 [2024-04-26 15:46:30.393324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:36096 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad6fc00 len:0x10000 key:0x183600 00:17:31.871 [2024-04-26 15:46:30.393335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.871 [2024-04-26 15:46:30.393352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:36224 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad5fb80 len:0x10000 key:0x183600 00:17:31.871 [2024-04-26 15:46:30.393362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.871 [2024-04-26 15:46:30.393379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:36352 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad4fb00 len:0x10000 key:0x183600 00:17:31.871 [2024-04-26 15:46:30.393389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.871 [2024-04-26 15:46:30.393405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad3fa80 len:0x10000 key:0x183600 00:17:31.871 [2024-04-26 15:46:30.393419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.871 [2024-04-26 15:46:30.393436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:36608 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad2fa00 len:0x10000 key:0x183600 00:17:31.871 [2024-04-26 15:46:30.393447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.871 [2024-04-26 15:46:30.393462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:36736 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad1f980 len:0x10000 key:0x183600 00:17:31.871 [2024-04-26 15:46:30.393473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.871 [2024-04-26 15:46:30.393489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:36864 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad0f900 len:0x10000 key:0x183600 00:17:31.871 [2024-04-26 15:46:30.393500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.871 [2024-04-26 15:46:30.393517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:36992 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001acff880 len:0x10000 key:0x183600 00:17:31.871 [2024-04-26 15:46:30.393528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.871 [2024-04-26 15:46:30.393544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:37120 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001acef800 len:0x10000 key:0x183600 00:17:31.871 [2024-04-26 15:46:30.393555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.871 [2024-04-26 15:46:30.393571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:37248 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001acdf780 len:0x10000 key:0x183600 00:17:31.871 [2024-04-26 15:46:30.393582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.871 [2024-04-26 15:46:30.393598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:37376 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001accf700 len:0x10000 key:0x183600 00:17:31.871 [2024-04-26 15:46:30.393608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.871 [2024-04-26 15:46:30.393624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:37504 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001acbf680 len:0x10000 key:0x183600 00:17:31.871 [2024-04-26 15:46:30.393635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.872 [2024-04-26 15:46:30.393651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:37632 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001acaf600 len:0x10000 key:0x183600 00:17:31.872 [2024-04-26 15:46:30.393662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.872 [2024-04-26 15:46:30.393678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:37760 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac9f580 len:0x10000 key:0x183600 00:17:31.872 [2024-04-26 15:46:30.393689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.872 [2024-04-26 15:46:30.393704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:37888 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac8f500 len:0x10000 key:0x183600 00:17:31.872 [2024-04-26 15:46:30.393719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.872 [2024-04-26 15:46:30.393737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:38016 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac7f480 len:0x10000 key:0x183600 00:17:31.872 [2024-04-26 15:46:30.393748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.872 [2024-04-26 15:46:30.393764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:38144 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac6f400 len:0x10000 key:0x183600 00:17:31.872 [2024-04-26 15:46:30.393775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.872 [2024-04-26 15:46:30.393791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:38272 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac5f380 len:0x10000 key:0x183600 00:17:31.872 [2024-04-26 15:46:30.393802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.872 [2024-04-26 15:46:30.393818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:38400 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac4f300 len:0x10000 key:0x183600 00:17:31.872 [2024-04-26 15:46:30.393829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.872 [2024-04-26 15:46:30.393846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:38528 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac3f280 len:0x10000 key:0x183600 00:17:31.872 [2024-04-26 15:46:30.393857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.872 [2024-04-26 15:46:30.393873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:38656 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac2f200 len:0x10000 key:0x183600 00:17:31.872 [2024-04-26 15:46:30.393884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.872 [2024-04-26 15:46:30.393900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:38784 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac1f180 len:0x10000 key:0x183600 00:17:31.872 [2024-04-26 15:46:30.393911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.872 [2024-04-26 15:46:30.393927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:38912 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac0f100 len:0x10000 key:0x183600 00:17:31.872 [2024-04-26 15:46:30.393938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.872 [2024-04-26 15:46:30.393954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:39040 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aff0000 len:0x10000 key:0x183700 00:17:31.872 [2024-04-26 15:46:30.393965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.872 [2024-04-26 15:46:30.393981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:39168 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001afdff80 len:0x10000 key:0x183700 00:17:31.872 [2024-04-26 15:46:30.393993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.872 [2024-04-26 15:46:30.394009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:39296 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001afcff00 len:0x10000 key:0x183700 00:17:31.872 [2024-04-26 15:46:30.394022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.872 [2024-04-26 15:46:30.394039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:39424 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001afbfe80 len:0x10000 key:0x183700 00:17:31.872 [2024-04-26 15:46:30.394050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.872 [2024-04-26 15:46:30.394066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:39552 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001afafe00 len:0x10000 key:0x183700 00:17:31.872 [2024-04-26 15:46:30.394077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.872 [2024-04-26 15:46:30.394093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:39680 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af9fd80 len:0x10000 key:0x183700 00:17:31.872 [2024-04-26 15:46:30.394104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.872 [2024-04-26 15:46:30.394120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:39808 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af8fd00 len:0x10000 key:0x183700 00:17:31.872 [2024-04-26 15:46:30.394131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.872 [2024-04-26 15:46:30.394192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:39936 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af7fc80 len:0x10000 key:0x183700 00:17:31.872 [2024-04-26 15:46:30.394205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.872 [2024-04-26 15:46:30.394222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:40064 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af6fc00 len:0x10000 key:0x183700 00:17:31.872 [2024-04-26 15:46:30.394233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.872 [2024-04-26 15:46:30.394249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:40192 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af5fb80 len:0x10000 key:0x183700 00:17:31.872 [2024-04-26 15:46:30.394260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.872 [2024-04-26 15:46:30.394276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:40320 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af4fb00 len:0x10000 key:0x183700 00:17:31.872 [2024-04-26 15:46:30.394287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.872 [2024-04-26 15:46:30.394304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:40448 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af3fa80 len:0x10000 key:0x183700 00:17:31.872 [2024-04-26 15:46:30.394315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.872 [2024-04-26 15:46:30.394331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:40576 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af2fa00 len:0x10000 key:0x183700 00:17:31.872 [2024-04-26 15:46:30.394341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.872 [2024-04-26 15:46:30.394357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:40704 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af1f980 len:0x10000 key:0x183700 00:17:31.872 [2024-04-26 15:46:30.394368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.872 [2024-04-26 15:46:30.394386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:40832 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aaefe00 len:0x10000 key:0x183800 00:17:31.872 [2024-04-26 15:46:30.394397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.872 [2024-04-26 15:46:30.394413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:32768 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000ceaf000 len:0x10000 key:0x182800 00:17:31.872 [2024-04-26 15:46:30.394424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.872 [2024-04-26 15:46:30.394442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:32896 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200012360000 len:0x10000 key:0x182800 00:17:31.872 [2024-04-26 15:46:30.394453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.872 [2024-04-26 15:46:30.394470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:33024 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200012381000 len:0x10000 key:0x182800 00:17:31.872 [2024-04-26 15:46:30.394481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.873 [2024-04-26 15:46:30.394498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:33152 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000123a2000 len:0x10000 key:0x182800 00:17:31.873 [2024-04-26 15:46:30.394510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.873 [2024-04-26 15:46:30.394528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:33280 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000123c3000 len:0x10000 key:0x182800 00:17:31.873 [2024-04-26 15:46:30.394539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.873 [2024-04-26 15:46:30.394555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:33408 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000f9ff000 len:0x10000 key:0x182800 00:17:31.873 [2024-04-26 15:46:30.394567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.873 [2024-04-26 15:46:30.394583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33536 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000f9de000 len:0x10000 key:0x182800 00:17:31.873 [2024-04-26 15:46:30.394594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.873 [2024-04-26 15:46:30.394611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:33664 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000f9bd000 len:0x10000 key:0x182800 00:17:31.873 [2024-04-26 15:46:30.394622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.873 [2024-04-26 15:46:30.394639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:33792 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000f99c000 len:0x10000 key:0x182800 00:17:31.873 [2024-04-26 15:46:30.394649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.873 [2024-04-26 15:46:30.394667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:33920 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000124cb000 len:0x10000 key:0x182800 00:17:31.873 [2024-04-26 15:46:30.394678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.873 [2024-04-26 15:46:30.394696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:34048 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200011b83000 len:0x10000 key:0x182800 00:17:31.873 [2024-04-26 15:46:30.394707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.873 [2024-04-26 15:46:30.394724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34176 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200011ba4000 len:0x10000 key:0x182800 00:17:31.873 [2024-04-26 15:46:30.394736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.873 [2024-04-26 15:46:30.394753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34304 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200011bc5000 len:0x10000 key:0x182800 00:17:31.873 [2024-04-26 15:46:30.394765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.873 [2024-04-26 15:46:30.394782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34432 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200011d0f000 len:0x10000 key:0x182800 00:17:31.873 [2024-04-26 15:46:30.394792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.873 [2024-04-26 15:46:30.394809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:34560 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200011cee000 len:0x10000 key:0x182800 00:17:31.873 [2024-04-26 15:46:30.394820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.873 [2024-04-26 15:46:30.394837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:34688 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200011ccd000 len:0x10000 key:0x182800 00:17:31.873 [2024-04-26 15:46:30.394847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.873 [2024-04-26 15:46:30.394864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:34816 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d1e8000 len:0x10000 key:0x182800 00:17:31.873 [2024-04-26 15:46:30.394875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.873 [2024-04-26 15:46:30.394897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:34944 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d209000 len:0x10000 key:0x182800 00:17:31.873 [2024-04-26 15:46:30.394908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.873 [2024-04-26 15:46:30.394925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:35072 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d22a000 len:0x10000 key:0x182800 00:17:31.873 [2024-04-26 15:46:30.394937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:19256180 sqhd:c010 p:0 m:0 dnr:0 00:17:31.873 [2024-04-26 15:46:30.397971] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x20001b806c00 was disconnected and freed. reset controller. 00:17:31.873 [2024-04-26 15:46:30.397991] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:31.873 [2024-04-26 15:46:30.398008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:32768 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b1f0000 len:0x10000 key:0x183a00 00:17:31.873 [2024-04-26 15:46:30.398020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.873 [2024-04-26 15:46:30.398040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32896 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b1dff80 len:0x10000 key:0x183a00 00:17:31.873 [2024-04-26 15:46:30.398054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.873 [2024-04-26 15:46:30.398072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:33024 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b1cff00 len:0x10000 key:0x183a00 00:17:31.873 [2024-04-26 15:46:30.398084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.873 [2024-04-26 15:46:30.398101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:33152 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b1bfe80 len:0x10000 key:0x183a00 00:17:31.873 [2024-04-26 15:46:30.398112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.873 [2024-04-26 15:46:30.398128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:33280 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b1afe00 len:0x10000 key:0x183a00 00:17:31.873 [2024-04-26 15:46:30.398140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.873 [2024-04-26 15:46:30.398161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:33408 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b19fd80 len:0x10000 key:0x183a00 00:17:31.873 [2024-04-26 15:46:30.398172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.873 [2024-04-26 15:46:30.398190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33536 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b18fd00 len:0x10000 key:0x183a00 00:17:31.873 [2024-04-26 15:46:30.398201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.873 [2024-04-26 15:46:30.398217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:33664 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b17fc80 len:0x10000 key:0x183a00 00:17:31.873 [2024-04-26 15:46:30.398228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.873 [2024-04-26 15:46:30.398245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:33792 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b16fc00 len:0x10000 key:0x183a00 00:17:31.873 [2024-04-26 15:46:30.398257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.873 [2024-04-26 15:46:30.398273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:33920 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b15fb80 len:0x10000 key:0x183a00 00:17:31.873 [2024-04-26 15:46:30.398284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.873 [2024-04-26 15:46:30.398300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:34048 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b14fb00 len:0x10000 key:0x183a00 00:17:31.873 [2024-04-26 15:46:30.398313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.873 [2024-04-26 15:46:30.398329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:34176 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b13fa80 len:0x10000 key:0x183a00 00:17:31.873 [2024-04-26 15:46:30.398342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.873 [2024-04-26 15:46:30.398360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:34304 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b12fa00 len:0x10000 key:0x183a00 00:17:31.873 [2024-04-26 15:46:30.398371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.873 [2024-04-26 15:46:30.398390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:34432 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b11f980 len:0x10000 key:0x183a00 00:17:31.873 [2024-04-26 15:46:30.398401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.873 [2024-04-26 15:46:30.398417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:34560 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b10f900 len:0x10000 key:0x183a00 00:17:31.873 [2024-04-26 15:46:30.398428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.873 [2024-04-26 15:46:30.398444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:34688 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0ff880 len:0x10000 key:0x183a00 00:17:31.873 [2024-04-26 15:46:30.398455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.873 [2024-04-26 15:46:30.398471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:34816 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0ef800 len:0x10000 key:0x183a00 00:17:31.873 [2024-04-26 15:46:30.398482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.873 [2024-04-26 15:46:30.398498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:34944 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0df780 len:0x10000 key:0x183a00 00:17:31.873 [2024-04-26 15:46:30.398508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.873 [2024-04-26 15:46:30.398524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:35072 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0cf700 len:0x10000 key:0x183a00 00:17:31.873 [2024-04-26 15:46:30.398536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.873 [2024-04-26 15:46:30.398551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:35200 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0bf680 len:0x10000 key:0x183a00 00:17:31.874 [2024-04-26 15:46:30.398562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.874 [2024-04-26 15:46:30.398578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:35328 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0af600 len:0x10000 key:0x183a00 00:17:31.874 [2024-04-26 15:46:30.398589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.874 [2024-04-26 15:46:30.398607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:35456 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b09f580 len:0x10000 key:0x183a00 00:17:31.874 [2024-04-26 15:46:30.398620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.874 [2024-04-26 15:46:30.398637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:35584 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b08f500 len:0x10000 key:0x183a00 00:17:31.874 [2024-04-26 15:46:30.398648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.874 [2024-04-26 15:46:30.398664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:35712 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b07f480 len:0x10000 key:0x183a00 00:17:31.874 [2024-04-26 15:46:30.398674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.874 [2024-04-26 15:46:30.398696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:35840 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b06f400 len:0x10000 key:0x183a00 00:17:31.874 [2024-04-26 15:46:30.398708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.874 [2024-04-26 15:46:30.398723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:35968 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b05f380 len:0x10000 key:0x183a00 00:17:31.874 [2024-04-26 15:46:30.398734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.874 [2024-04-26 15:46:30.398750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:36096 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b04f300 len:0x10000 key:0x183a00 00:17:31.874 [2024-04-26 15:46:30.398760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.874 [2024-04-26 15:46:30.398776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:36224 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b03f280 len:0x10000 key:0x183a00 00:17:31.874 [2024-04-26 15:46:30.398787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.874 [2024-04-26 15:46:30.398803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:36352 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b02f200 len:0x10000 key:0x183a00 00:17:31.874 [2024-04-26 15:46:30.398813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.874 [2024-04-26 15:46:30.398833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b01f180 len:0x10000 key:0x183a00 00:17:31.874 [2024-04-26 15:46:30.398844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.874 [2024-04-26 15:46:30.398861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:36608 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b00f100 len:0x10000 key:0x183a00 00:17:31.874 [2024-04-26 15:46:30.398871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.874 [2024-04-26 15:46:30.398887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:36736 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b3f0000 len:0x10000 key:0x182f00 00:17:31.874 [2024-04-26 15:46:30.398898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.874 [2024-04-26 15:46:30.398913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:36864 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b3dff80 len:0x10000 key:0x182f00 00:17:31.874 [2024-04-26 15:46:30.398924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.874 [2024-04-26 15:46:30.398940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:36992 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b3cff00 len:0x10000 key:0x182f00 00:17:31.874 [2024-04-26 15:46:30.398951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.874 [2024-04-26 15:46:30.398967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:37120 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b3bfe80 len:0x10000 key:0x182f00 00:17:31.874 [2024-04-26 15:46:30.398978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.874 [2024-04-26 15:46:30.398994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:37248 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b3afe00 len:0x10000 key:0x182f00 00:17:31.874 [2024-04-26 15:46:30.399007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.874 [2024-04-26 15:46:30.399023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:37376 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b39fd80 len:0x10000 key:0x182f00 00:17:31.874 [2024-04-26 15:46:30.399034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.874 [2024-04-26 15:46:30.399051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:37504 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b38fd00 len:0x10000 key:0x182f00 00:17:31.874 [2024-04-26 15:46:30.399061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.874 [2024-04-26 15:46:30.399077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:37632 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b37fc80 len:0x10000 key:0x182f00 00:17:31.874 [2024-04-26 15:46:30.399088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.874 [2024-04-26 15:46:30.399104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:37760 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b36fc00 len:0x10000 key:0x182f00 00:17:31.874 [2024-04-26 15:46:30.399115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.874 [2024-04-26 15:46:30.399131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:37888 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b35fb80 len:0x10000 key:0x182f00 00:17:31.874 [2024-04-26 15:46:30.399147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.874 [2024-04-26 15:46:30.399164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:38016 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b34fb00 len:0x10000 key:0x182f00 00:17:31.874 [2024-04-26 15:46:30.399174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.874 [2024-04-26 15:46:30.399191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:38144 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b33fa80 len:0x10000 key:0x182f00 00:17:31.874 [2024-04-26 15:46:30.399201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.874 [2024-04-26 15:46:30.399218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:38272 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b32fa00 len:0x10000 key:0x182f00 00:17:31.874 [2024-04-26 15:46:30.399228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.874 [2024-04-26 15:46:30.399244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:38400 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b31f980 len:0x10000 key:0x182f00 00:17:31.874 [2024-04-26 15:46:30.399256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.874 [2024-04-26 15:46:30.399272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:38528 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b30f900 len:0x10000 key:0x182f00 00:17:31.874 [2024-04-26 15:46:30.399282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.874 [2024-04-26 15:46:30.399298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:38656 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2ff880 len:0x10000 key:0x182f00 00:17:31.874 [2024-04-26 15:46:30.399311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.874 [2024-04-26 15:46:30.399327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:38784 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2ef800 len:0x10000 key:0x182f00 00:17:31.874 [2024-04-26 15:46:30.399338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.874 [2024-04-26 15:46:30.399354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:38912 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2df780 len:0x10000 key:0x182f00 00:17:31.874 [2024-04-26 15:46:30.399364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.874 [2024-04-26 15:46:30.399381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:39040 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2cf700 len:0x10000 key:0x182f00 00:17:31.874 [2024-04-26 15:46:30.399391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.874 [2024-04-26 15:46:30.399407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:39168 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2bf680 len:0x10000 key:0x182f00 00:17:31.874 [2024-04-26 15:46:30.399418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.874 [2024-04-26 15:46:30.399433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:39296 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2af600 len:0x10000 key:0x182f00 00:17:31.874 [2024-04-26 15:46:30.399444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.874 [2024-04-26 15:46:30.399461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:39424 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b29f580 len:0x10000 key:0x182f00 00:17:31.874 [2024-04-26 15:46:30.399471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.874 [2024-04-26 15:46:30.399487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:39552 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b28f500 len:0x10000 key:0x182f00 00:17:31.874 [2024-04-26 15:46:30.399497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.874 [2024-04-26 15:46:30.399514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:39680 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b27f480 len:0x10000 key:0x182f00 00:17:31.874 [2024-04-26 15:46:30.399524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.874 [2024-04-26 15:46:30.399539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:39808 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b26f400 len:0x10000 key:0x182f00 00:17:31.874 [2024-04-26 15:46:30.399550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.875 [2024-04-26 15:46:30.399566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:39936 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b25f380 len:0x10000 key:0x182f00 00:17:31.875 [2024-04-26 15:46:30.399577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.875 [2024-04-26 15:46:30.399592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:40064 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b24f300 len:0x10000 key:0x182f00 00:17:31.875 [2024-04-26 15:46:30.399605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.875 [2024-04-26 15:46:30.399621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:40192 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b23f280 len:0x10000 key:0x182f00 00:17:31.875 [2024-04-26 15:46:30.399631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.875 [2024-04-26 15:46:30.399648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:40320 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b22f200 len:0x10000 key:0x182f00 00:17:31.875 [2024-04-26 15:46:30.399659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.875 [2024-04-26 15:46:30.399675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:40448 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b21f180 len:0x10000 key:0x182f00 00:17:31.875 [2024-04-26 15:46:30.399685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.875 [2024-04-26 15:46:30.399701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:40576 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b20f100 len:0x10000 key:0x182f00 00:17:31.875 [2024-04-26 15:46:30.399712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.875 [2024-04-26 15:46:30.399728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:40704 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b5f0000 len:0x10000 key:0x182e00 00:17:31.875 [2024-04-26 15:46:30.399739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.875 [2024-04-26 15:46:30.399754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:40832 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ae0f700 len:0x10000 key:0x183700 00:17:31.875 [2024-04-26 15:46:30.399766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b806c00 sqhd:3010 p:0 m:0 dnr:0 00:17:31.875 [2024-04-26 15:46:30.402786] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x20001b8069c0 was disconnected and freed. reset controller. 00:17:31.875 [2024-04-26 15:46:30.402806] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:31.875 [2024-04-26 15:46:30.402822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:24576 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b4cfd00 len:0x10000 key:0x182e00 00:17:31.875 [2024-04-26 15:46:30.402834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.875 [2024-04-26 15:46:30.402854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:24704 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b4bfc80 len:0x10000 key:0x182e00 00:17:31.875 [2024-04-26 15:46:30.402866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.875 [2024-04-26 15:46:30.402882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:24832 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b4afc00 len:0x10000 key:0x182e00 00:17:31.875 [2024-04-26 15:46:30.402893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.875 [2024-04-26 15:46:30.402909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:24960 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b49fb80 len:0x10000 key:0x182e00 00:17:31.875 [2024-04-26 15:46:30.402920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.875 [2024-04-26 15:46:30.402941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:25088 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b48fb00 len:0x10000 key:0x182e00 00:17:31.875 [2024-04-26 15:46:30.402951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.875 [2024-04-26 15:46:30.402967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:25216 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b47fa80 len:0x10000 key:0x182e00 00:17:31.875 [2024-04-26 15:46:30.402979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.875 [2024-04-26 15:46:30.402995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25344 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b46fa00 len:0x10000 key:0x182e00 00:17:31.875 [2024-04-26 15:46:30.403006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.875 [2024-04-26 15:46:30.403022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:25472 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b45f980 len:0x10000 key:0x182e00 00:17:31.875 [2024-04-26 15:46:30.403033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.875 [2024-04-26 15:46:30.403050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:25600 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b44f900 len:0x10000 key:0x182e00 00:17:31.875 [2024-04-26 15:46:30.403061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.875 [2024-04-26 15:46:30.403076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:25728 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b43f880 len:0x10000 key:0x182e00 00:17:31.875 [2024-04-26 15:46:30.403087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.875 [2024-04-26 15:46:30.403103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:25856 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b42f800 len:0x10000 key:0x182e00 00:17:31.875 [2024-04-26 15:46:30.403114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.875 [2024-04-26 15:46:30.403129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:25984 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b41f780 len:0x10000 key:0x182e00 00:17:31.875 [2024-04-26 15:46:30.403140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.875 [2024-04-26 15:46:30.403162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:26112 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b40f700 len:0x10000 key:0x182e00 00:17:31.875 [2024-04-26 15:46:30.403173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.875 [2024-04-26 15:46:30.403188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:26240 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7f0000 len:0x10000 key:0x183f00 00:17:31.875 [2024-04-26 15:46:30.403199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.875 [2024-04-26 15:46:30.403219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:26368 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7dff80 len:0x10000 key:0x183f00 00:17:31.875 [2024-04-26 15:46:30.403232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.875 [2024-04-26 15:46:30.403248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:26496 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7cff00 len:0x10000 key:0x183f00 00:17:31.875 [2024-04-26 15:46:30.403261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.875 [2024-04-26 15:46:30.403281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:26624 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7bfe80 len:0x10000 key:0x183f00 00:17:31.875 [2024-04-26 15:46:30.403292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.875 [2024-04-26 15:46:30.403308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:26752 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7afe00 len:0x10000 key:0x183f00 00:17:31.875 [2024-04-26 15:46:30.403319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.875 [2024-04-26 15:46:30.403339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:26880 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b79fd80 len:0x10000 key:0x183f00 00:17:31.875 [2024-04-26 15:46:30.403349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.875 [2024-04-26 15:46:30.403366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:27008 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b78fd00 len:0x10000 key:0x183f00 00:17:31.875 [2024-04-26 15:46:30.403376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.875 [2024-04-26 15:46:30.403392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:27136 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b77fc80 len:0x10000 key:0x183f00 00:17:31.875 [2024-04-26 15:46:30.403403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.875 [2024-04-26 15:46:30.403419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:27264 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b76fc00 len:0x10000 key:0x183f00 00:17:31.875 [2024-04-26 15:46:30.403429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.875 [2024-04-26 15:46:30.403445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:27392 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b75fb80 len:0x10000 key:0x183f00 00:17:31.875 [2024-04-26 15:46:30.403456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.875 [2024-04-26 15:46:30.403472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:27520 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b74fb00 len:0x10000 key:0x183f00 00:17:31.875 [2024-04-26 15:46:30.403483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.875 [2024-04-26 15:46:30.403499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:27648 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b73fa80 len:0x10000 key:0x183f00 00:17:31.875 [2024-04-26 15:46:30.403510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.875 [2024-04-26 15:46:30.403525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:27776 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b72fa00 len:0x10000 key:0x183f00 00:17:31.875 [2024-04-26 15:46:30.403536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.875 [2024-04-26 15:46:30.403553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27904 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b71f980 len:0x10000 key:0x183f00 00:17:31.876 [2024-04-26 15:46:30.403567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.876 [2024-04-26 15:46:30.403583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:28032 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b70f900 len:0x10000 key:0x183f00 00:17:31.876 [2024-04-26 15:46:30.403594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.876 [2024-04-26 15:46:30.403611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:28160 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6ff880 len:0x10000 key:0x183f00 00:17:31.876 [2024-04-26 15:46:30.403622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.876 [2024-04-26 15:46:30.403638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:28288 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6ef800 len:0x10000 key:0x183f00 00:17:31.876 [2024-04-26 15:46:30.403648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.876 [2024-04-26 15:46:30.403665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:28416 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6df780 len:0x10000 key:0x183f00 00:17:31.876 [2024-04-26 15:46:30.403676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.876 [2024-04-26 15:46:30.403693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:28544 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6cf700 len:0x10000 key:0x183f00 00:17:31.876 [2024-04-26 15:46:30.403703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.876 [2024-04-26 15:46:30.403719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:28672 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6bf680 len:0x10000 key:0x183f00 00:17:31.876 [2024-04-26 15:46:30.403730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.876 [2024-04-26 15:46:30.403746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:28800 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6af600 len:0x10000 key:0x183f00 00:17:31.876 [2024-04-26 15:46:30.403757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.876 [2024-04-26 15:46:30.403773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:28928 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b69f580 len:0x10000 key:0x183f00 00:17:31.876 [2024-04-26 15:46:30.403784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.876 [2024-04-26 15:46:30.403800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:29056 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b68f500 len:0x10000 key:0x183f00 00:17:31.876 [2024-04-26 15:46:30.403811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.876 [2024-04-26 15:46:30.403828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:29184 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b67f480 len:0x10000 key:0x183f00 00:17:31.876 [2024-04-26 15:46:30.403838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.876 [2024-04-26 15:46:30.403854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:29312 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b66f400 len:0x10000 key:0x183f00 00:17:31.876 [2024-04-26 15:46:30.403865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.876 [2024-04-26 15:46:30.403883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:29440 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b65f380 len:0x10000 key:0x183f00 00:17:31.876 [2024-04-26 15:46:30.403893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.876 [2024-04-26 15:46:30.403909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:29568 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b64f300 len:0x10000 key:0x183f00 00:17:31.876 [2024-04-26 15:46:30.403920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.876 [2024-04-26 15:46:30.403936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:29696 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b63f280 len:0x10000 key:0x183f00 00:17:31.876 [2024-04-26 15:46:30.403947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.876 [2024-04-26 15:46:30.403963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:29824 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b62f200 len:0x10000 key:0x183f00 00:17:31.876 [2024-04-26 15:46:30.403974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.876 [2024-04-26 15:46:30.403991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:29952 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b61f180 len:0x10000 key:0x183f00 00:17:31.876 [2024-04-26 15:46:30.404001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.876 [2024-04-26 15:46:30.404018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:30080 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b60f100 len:0x10000 key:0x183f00 00:17:31.876 [2024-04-26 15:46:30.404028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.876 [2024-04-26 15:46:30.404044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:30208 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9f0000 len:0x10000 key:0x183000 00:17:31.876 [2024-04-26 15:46:30.404054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.876 [2024-04-26 15:46:30.404070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:30336 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9dff80 len:0x10000 key:0x183000 00:17:31.876 [2024-04-26 15:46:30.404081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.876 [2024-04-26 15:46:30.404097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:30464 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9cff00 len:0x10000 key:0x183000 00:17:31.876 [2024-04-26 15:46:30.404107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.876 [2024-04-26 15:46:30.404123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:30592 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9bfe80 len:0x10000 key:0x183000 00:17:31.876 [2024-04-26 15:46:30.404134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.876 [2024-04-26 15:46:30.404156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:30720 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9afe00 len:0x10000 key:0x183000 00:17:31.876 [2024-04-26 15:46:30.404167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.876 [2024-04-26 15:46:30.404186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:30848 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b99fd80 len:0x10000 key:0x183000 00:17:31.876 [2024-04-26 15:46:30.404196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.876 [2024-04-26 15:46:30.404213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:30976 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b98fd00 len:0x10000 key:0x183000 00:17:31.876 [2024-04-26 15:46:30.404223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.876 [2024-04-26 15:46:30.404249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:31104 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b97fc80 len:0x10000 key:0x183000 00:17:31.876 [2024-04-26 15:46:30.404260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.876 [2024-04-26 15:46:30.404276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:31232 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b96fc00 len:0x10000 key:0x183000 00:17:31.876 [2024-04-26 15:46:30.404287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.876 [2024-04-26 15:46:30.404303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:31360 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b95fb80 len:0x10000 key:0x183000 00:17:31.876 [2024-04-26 15:46:30.404314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.876 [2024-04-26 15:46:30.404331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:31488 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b94fb00 len:0x10000 key:0x183000 00:17:31.876 [2024-04-26 15:46:30.404342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.876 [2024-04-26 15:46:30.404358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:31616 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b93fa80 len:0x10000 key:0x183000 00:17:31.876 [2024-04-26 15:46:30.404368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.876 [2024-04-26 15:46:30.404384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:31744 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b92fa00 len:0x10000 key:0x183000 00:17:31.876 [2024-04-26 15:46:30.404396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.876 [2024-04-26 15:46:30.404412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:31872 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b91f980 len:0x10000 key:0x183000 00:17:31.876 [2024-04-26 15:46:30.404423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.876 [2024-04-26 15:46:30.404439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:32000 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b90f900 len:0x10000 key:0x183000 00:17:31.876 [2024-04-26 15:46:30.404450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.876 [2024-04-26 15:46:30.404466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:32128 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b8ff880 len:0x10000 key:0x183000 00:17:31.876 [2024-04-26 15:46:30.404479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.876 [2024-04-26 15:46:30.404495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:32256 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b8ef800 len:0x10000 key:0x183000 00:17:31.876 [2024-04-26 15:46:30.404507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.876 [2024-04-26 15:46:30.404523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32384 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b8df780 len:0x10000 key:0x183000 00:17:31.876 [2024-04-26 15:46:30.404533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.877 [2024-04-26 15:46:30.404550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:32512 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b8cf700 len:0x10000 key:0x183000 00:17:31.877 [2024-04-26 15:46:30.404560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.877 [2024-04-26 15:46:30.404576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:32640 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b4dfd80 len:0x10000 key:0x182e00 00:17:31.877 [2024-04-26 15:46:30.404587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:1b8069c0 sqhd:e060 p:0 m:0 dnr:0 00:17:31.877 [2024-04-26 15:46:30.424721] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x20001b806780 was disconnected and freed. reset controller. 00:17:31.877 [2024-04-26 15:46:30.424746] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:31.877 [2024-04-26 15:46:30.424830] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:31.877 [2024-04-26 15:46:30.424847] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:31.877 [2024-04-26 15:46:30.424861] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:31.877 [2024-04-26 15:46:30.424875] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:31.877 [2024-04-26 15:46:30.424888] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:31.877 [2024-04-26 15:46:30.424901] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:31.877 [2024-04-26 15:46:30.424915] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:31.877 [2024-04-26 15:46:30.424929] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:31.877 [2024-04-26 15:46:30.424943] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:31.877 [2024-04-26 15:46:30.424956] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:31.877 [2024-04-26 15:46:30.432785] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:17:31.877 [2024-04-26 15:46:30.434241] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:17:31.877 [2024-04-26 15:46:30.434265] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:17:31.877 [2024-04-26 15:46:30.434278] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:17:31.877 task offset: 38912 on job bdev=Nvme1n1 fails 00:17:31.877 00:17:31.877 Latency(us) 00:17:31.877 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:31.877 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:31.877 Job: Nvme1n1 ended in about 1.91 seconds with error 00:17:31.877 Verification LBA range: start 0x0 length 0x400 00:17:31.877 Nvme1n1 : 1.91 146.83 9.18 33.56 0.00 351028.24 6740.85 1054567.86 00:17:31.877 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:31.877 Job: Nvme2n1 ended in about 1.91 seconds with error 00:17:31.877 Verification LBA range: start 0x0 length 0x400 00:17:31.877 Nvme2n1 : 1.91 142.54 8.91 33.54 0.00 356485.75 8426.06 1054567.86 00:17:31.877 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:31.877 Job: Nvme3n1 ended in about 1.91 seconds with error 00:17:31.877 Verification LBA range: start 0x0 length 0x400 00:17:31.877 Nvme3n1 : 1.91 149.25 9.33 33.52 0.00 340302.36 16976.94 1046578.71 00:17:31.877 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:31.877 Job: Nvme4n1 ended in about 1.91 seconds with error 00:17:31.877 Verification LBA range: start 0x0 length 0x400 00:17:31.877 Nvme4n1 : 1.91 147.05 9.19 33.49 0.00 341420.76 4743.56 1046578.71 00:17:31.877 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:31.877 Job: Nvme5n1 ended in about 1.91 seconds with error 00:17:31.877 Verification LBA range: start 0x0 length 0x400 00:17:31.877 Nvme5n1 : 1.91 142.25 8.89 33.47 0.00 347664.39 26713.72 1046578.71 00:17:31.877 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:31.877 Job: Nvme6n1 ended in about 1.91 seconds with error 00:17:31.877 Verification LBA range: start 0x0 length 0x400 00:17:31.877 Nvme6n1 : 1.91 148.95 9.31 33.45 0.00 332030.29 29335.16 1046578.71 00:17:31.877 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:31.877 Job: Nvme7n1 ended in about 1.87 seconds with error 00:17:31.877 Verification LBA range: start 0x0 length 0x400 00:17:31.877 Nvme7n1 : 1.87 136.76 8.55 34.19 0.00 352752.20 37199.48 1110491.92 00:17:31.877 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:31.877 Job: Nvme8n1 ended in about 1.88 seconds with error 00:17:31.877 Verification LBA range: start 0x0 length 0x400 00:17:31.877 Nvme8n1 : 1.88 136.40 8.53 34.10 0.00 350591.46 42692.02 1102502.77 00:17:31.877 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:31.877 Job: Nvme9n1 ended in about 1.88 seconds with error 00:17:31.877 Verification LBA range: start 0x0 length 0x400 00:17:31.877 Nvme9n1 : 1.88 136.06 8.50 34.01 0.00 348608.61 50181.85 1094513.62 00:17:31.877 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:31.877 Job: Nvme10n1 ended in about 1.89 seconds with error 00:17:31.877 Verification LBA range: start 0x0 length 0x400 00:17:31.877 Nvme10n1 : 1.89 101.78 6.36 33.93 0.00 433040.34 50431.51 1078535.31 00:17:31.877 =================================================================================================================== 00:17:31.877 Total : 1387.87 86.74 337.26 0.00 353363.50 4743.56 1110491.92 00:17:31.877 [2024-04-26 15:46:30.456379] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:17:31.877 [2024-04-26 15:46:30.457791] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:17:31.877 [2024-04-26 15:46:30.457809] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:17:31.877 [2024-04-26 15:46:30.457818] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:17:31.877 [2024-04-26 15:46:30.457827] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:17:31.877 [2024-04-26 15:46:30.457845] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:17:31.877 [2024-04-26 15:46:30.457852] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:17:32.135 [2024-04-26 15:46:30.469887] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:17:32.135 [2024-04-26 15:46:30.469939] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:17:32.135 [2024-04-26 15:46:30.469968] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:17:32.135 [2024-04-26 15:46:30.471358] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:17:32.135 [2024-04-26 15:46:30.471392] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:17:32.135 [2024-04-26 15:46:30.471409] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e5380 00:17:32.135 [2024-04-26 15:46:30.471524] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:17:32.135 [2024-04-26 15:46:30.471549] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:17:32.135 [2024-04-26 15:46:30.471565] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ba540 00:17:32.135 [2024-04-26 15:46:30.471674] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:17:32.135 [2024-04-26 15:46:30.471699] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:17:32.135 [2024-04-26 15:46:30.471727] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192d9c00 00:17:32.135 [2024-04-26 15:46:30.471861] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:17:32.135 [2024-04-26 15:46:30.471873] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:17:32.135 [2024-04-26 15:46:30.471881] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192bd440 00:17:32.135 [2024-04-26 15:46:30.471975] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:17:32.135 [2024-04-26 15:46:30.471987] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:17:32.135 [2024-04-26 15:46:30.471994] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192c60c0 00:17:32.135 [2024-04-26 15:46:30.472083] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:17:32.135 [2024-04-26 15:46:30.472094] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:17:32.135 [2024-04-26 15:46:30.472102] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x20001928f280 00:17:32.135 [2024-04-26 15:46:30.472201] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:17:32.135 [2024-04-26 15:46:30.472214] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:17:32.135 [2024-04-26 15:46:30.472222] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x200019298cc0 00:17:32.135 [2024-04-26 15:46:30.472300] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:17:32.135 [2024-04-26 15:46:30.472312] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:17:32.135 [2024-04-26 15:46:30.472319] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x20001929c140 00:17:32.135 [2024-04-26 15:46:30.472401] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:17:32.135 [2024-04-26 15:46:30.472413] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:17:32.135 [2024-04-26 15:46:30.472420] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192b54c0 00:17:32.393 15:46:30 -- target/shutdown.sh@142 -- # kill -9 3355446 00:17:32.393 15:46:30 -- target/shutdown.sh@144 -- # stoptarget 00:17:32.393 15:46:30 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:17:32.393 15:46:30 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:17:32.393 15:46:30 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:32.393 15:46:30 -- target/shutdown.sh@45 -- # nvmftestfini 00:17:32.393 15:46:30 -- nvmf/common.sh@477 -- # nvmfcleanup 00:17:32.393 15:46:30 -- nvmf/common.sh@117 -- # sync 00:17:32.393 15:46:30 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:17:32.393 15:46:30 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:17:32.393 15:46:30 -- nvmf/common.sh@120 -- # set +e 00:17:32.393 15:46:30 -- nvmf/common.sh@121 -- # for i in {1..20} 00:17:32.393 15:46:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:17:32.393 rmmod nvme_rdma 00:17:32.393 rmmod nvme_fabrics 00:17:32.393 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh: line 121: 3355446 Killed $rootdir/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") -q 64 -o 65536 -w verify -t 10 00:17:32.393 15:46:30 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:17:32.393 15:46:30 -- nvmf/common.sh@124 -- # set -e 00:17:32.393 15:46:30 -- nvmf/common.sh@125 -- # return 0 00:17:32.393 15:46:30 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:17:32.393 15:46:30 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:17:32.393 15:46:30 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:17:32.393 00:17:32.393 real 0m5.145s 00:17:32.393 user 0m17.622s 00:17:32.393 sys 0m1.078s 00:17:32.393 15:46:30 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:32.393 15:46:30 -- common/autotest_common.sh@10 -- # set +x 00:17:32.393 ************************************ 00:17:32.393 END TEST nvmf_shutdown_tc3 00:17:32.393 ************************************ 00:17:32.393 15:46:30 -- target/shutdown.sh@151 -- # trap - SIGINT SIGTERM EXIT 00:17:32.393 00:17:32.393 real 0m23.461s 00:17:32.393 user 1m10.847s 00:17:32.393 sys 0m7.474s 00:17:32.393 15:46:30 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:32.393 15:46:30 -- common/autotest_common.sh@10 -- # set +x 00:17:32.393 ************************************ 00:17:32.393 END TEST nvmf_shutdown 00:17:32.393 ************************************ 00:17:32.393 15:46:30 -- nvmf/nvmf.sh@84 -- # timing_exit target 00:17:32.393 15:46:30 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:32.393 15:46:30 -- common/autotest_common.sh@10 -- # set +x 00:17:32.394 15:46:30 -- nvmf/nvmf.sh@86 -- # timing_enter host 00:17:32.394 15:46:30 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:32.394 15:46:30 -- common/autotest_common.sh@10 -- # set +x 00:17:32.394 15:46:30 -- nvmf/nvmf.sh@88 -- # [[ 0 -eq 0 ]] 00:17:32.394 15:46:30 -- nvmf/nvmf.sh@89 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=rdma 00:17:32.394 15:46:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:32.394 15:46:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:32.394 15:46:30 -- common/autotest_common.sh@10 -- # set +x 00:17:32.652 ************************************ 00:17:32.652 START TEST nvmf_multicontroller 00:17:32.652 ************************************ 00:17:32.652 15:46:31 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=rdma 00:17:32.652 * Looking for test storage... 00:17:32.652 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:17:32.652 15:46:31 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:17:32.652 15:46:31 -- nvmf/common.sh@7 -- # uname -s 00:17:32.652 15:46:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:32.652 15:46:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:32.652 15:46:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:32.652 15:46:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:32.652 15:46:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:32.652 15:46:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:32.652 15:46:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:32.652 15:46:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:32.652 15:46:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:32.652 15:46:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:32.652 15:46:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:17:32.652 15:46:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:17:32.652 15:46:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:32.652 15:46:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:32.652 15:46:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:32.652 15:46:31 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:32.652 15:46:31 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:17:32.652 15:46:31 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:32.652 15:46:31 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:32.652 15:46:31 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:32.652 15:46:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:32.652 15:46:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:32.652 15:46:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:32.652 15:46:31 -- paths/export.sh@5 -- # export PATH 00:17:32.652 15:46:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:32.652 15:46:31 -- nvmf/common.sh@47 -- # : 0 00:17:32.652 15:46:31 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:17:32.652 15:46:31 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:17:32.652 15:46:31 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:32.652 15:46:31 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:32.652 15:46:31 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:32.652 15:46:31 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:17:32.652 15:46:31 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:17:32.652 15:46:31 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:17:32.652 15:46:31 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:32.652 15:46:31 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:32.652 15:46:31 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:17:32.652 15:46:31 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:17:32.652 15:46:31 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:32.652 15:46:31 -- host/multicontroller.sh@18 -- # '[' rdma == rdma ']' 00:17:32.652 15:46:31 -- host/multicontroller.sh@19 -- # echo 'Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target.' 00:17:32.652 Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target. 00:17:32.652 15:46:31 -- host/multicontroller.sh@20 -- # exit 0 00:17:32.652 00:17:32.652 real 0m0.115s 00:17:32.652 user 0m0.053s 00:17:32.652 sys 0m0.070s 00:17:32.652 15:46:31 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:32.652 15:46:31 -- common/autotest_common.sh@10 -- # set +x 00:17:32.652 ************************************ 00:17:32.652 END TEST nvmf_multicontroller 00:17:32.652 ************************************ 00:17:32.652 15:46:31 -- nvmf/nvmf.sh@90 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=rdma 00:17:32.652 15:46:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:32.652 15:46:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:32.652 15:46:31 -- common/autotest_common.sh@10 -- # set +x 00:17:32.910 ************************************ 00:17:32.910 START TEST nvmf_aer 00:17:32.910 ************************************ 00:17:32.910 15:46:31 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=rdma 00:17:32.910 * Looking for test storage... 00:17:32.910 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:17:32.910 15:46:31 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:17:32.910 15:46:31 -- nvmf/common.sh@7 -- # uname -s 00:17:32.910 15:46:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:32.910 15:46:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:32.910 15:46:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:32.910 15:46:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:32.910 15:46:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:32.910 15:46:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:32.910 15:46:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:32.910 15:46:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:32.910 15:46:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:32.910 15:46:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:32.910 15:46:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:17:32.910 15:46:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:17:32.910 15:46:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:32.910 15:46:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:32.910 15:46:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:32.910 15:46:31 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:32.910 15:46:31 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:17:32.910 15:46:31 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:32.910 15:46:31 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:32.910 15:46:31 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:32.910 15:46:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:32.910 15:46:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:32.910 15:46:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:32.910 15:46:31 -- paths/export.sh@5 -- # export PATH 00:17:32.910 15:46:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:32.910 15:46:31 -- nvmf/common.sh@47 -- # : 0 00:17:32.910 15:46:31 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:17:32.910 15:46:31 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:17:32.910 15:46:31 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:32.910 15:46:31 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:32.910 15:46:31 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:32.910 15:46:31 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:17:32.910 15:46:31 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:17:32.910 15:46:31 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:17:32.911 15:46:31 -- host/aer.sh@11 -- # nvmftestinit 00:17:32.911 15:46:31 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:17:32.911 15:46:31 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:32.911 15:46:31 -- nvmf/common.sh@437 -- # prepare_net_devs 00:17:32.911 15:46:31 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:17:32.911 15:46:31 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:17:32.911 15:46:31 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:32.911 15:46:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:32.911 15:46:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:32.911 15:46:31 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:17:32.911 15:46:31 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:17:32.911 15:46:31 -- nvmf/common.sh@285 -- # xtrace_disable 00:17:32.911 15:46:31 -- common/autotest_common.sh@10 -- # set +x 00:17:38.168 15:46:36 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:38.168 15:46:36 -- nvmf/common.sh@291 -- # pci_devs=() 00:17:38.168 15:46:36 -- nvmf/common.sh@291 -- # local -a pci_devs 00:17:38.168 15:46:36 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:17:38.168 15:46:36 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:17:38.168 15:46:36 -- nvmf/common.sh@293 -- # pci_drivers=() 00:17:38.168 15:46:36 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:17:38.168 15:46:36 -- nvmf/common.sh@295 -- # net_devs=() 00:17:38.168 15:46:36 -- nvmf/common.sh@295 -- # local -ga net_devs 00:17:38.168 15:46:36 -- nvmf/common.sh@296 -- # e810=() 00:17:38.168 15:46:36 -- nvmf/common.sh@296 -- # local -ga e810 00:17:38.168 15:46:36 -- nvmf/common.sh@297 -- # x722=() 00:17:38.168 15:46:36 -- nvmf/common.sh@297 -- # local -ga x722 00:17:38.168 15:46:36 -- nvmf/common.sh@298 -- # mlx=() 00:17:38.168 15:46:36 -- nvmf/common.sh@298 -- # local -ga mlx 00:17:38.168 15:46:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:38.168 15:46:36 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:38.168 15:46:36 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:38.168 15:46:36 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:38.168 15:46:36 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:38.168 15:46:36 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:38.168 15:46:36 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:38.168 15:46:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:38.168 15:46:36 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:38.168 15:46:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:38.168 15:46:36 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:38.168 15:46:36 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:17:38.168 15:46:36 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:17:38.168 15:46:36 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:17:38.168 15:46:36 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:17:38.168 15:46:36 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:17:38.168 15:46:36 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:17:38.168 15:46:36 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:17:38.168 15:46:36 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:38.168 15:46:36 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:17:38.168 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:17:38.168 15:46:36 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:17:38.168 15:46:36 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:17:38.168 15:46:36 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:17:38.168 15:46:36 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:17:38.168 15:46:36 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:38.168 15:46:36 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:38.168 15:46:36 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:38.168 15:46:36 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:17:38.168 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:17:38.168 15:46:36 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:17:38.168 15:46:36 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:17:38.168 15:46:36 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:17:38.168 15:46:36 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:17:38.168 15:46:36 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:38.168 15:46:36 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:38.168 15:46:36 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:17:38.168 15:46:36 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:17:38.168 15:46:36 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:38.168 15:46:36 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:38.168 15:46:36 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:38.168 15:46:36 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:38.168 15:46:36 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:17:38.168 Found net devices under 0000:da:00.0: mlx_0_0 00:17:38.168 15:46:36 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:38.168 15:46:36 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:38.168 15:46:36 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:38.168 15:46:36 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:38.168 15:46:36 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:38.168 15:46:36 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:17:38.168 Found net devices under 0000:da:00.1: mlx_0_1 00:17:38.168 15:46:36 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:38.168 15:46:36 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:17:38.168 15:46:36 -- nvmf/common.sh@403 -- # is_hw=yes 00:17:38.168 15:46:36 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:17:38.168 15:46:36 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:17:38.168 15:46:36 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:17:38.168 15:46:36 -- nvmf/common.sh@409 -- # rdma_device_init 00:17:38.168 15:46:36 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:17:38.168 15:46:36 -- nvmf/common.sh@58 -- # uname 00:17:38.168 15:46:36 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:17:38.168 15:46:36 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:17:38.168 15:46:36 -- nvmf/common.sh@63 -- # modprobe ib_core 00:17:38.168 15:46:36 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:17:38.168 15:46:36 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:17:38.168 15:46:36 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:17:38.168 15:46:36 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:17:38.168 15:46:36 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:17:38.168 15:46:36 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:17:38.168 15:46:36 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:17:38.168 15:46:36 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:17:38.168 15:46:36 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:38.168 15:46:36 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:38.168 15:46:36 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:38.168 15:46:36 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:38.168 15:46:36 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:38.168 15:46:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:38.168 15:46:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:38.168 15:46:36 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:17:38.168 15:46:36 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:17:38.168 15:46:36 -- nvmf/common.sh@105 -- # continue 2 00:17:38.168 15:46:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:38.168 15:46:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:38.168 15:46:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:17:38.168 15:46:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:38.168 15:46:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:17:38.168 15:46:36 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:17:38.168 15:46:36 -- nvmf/common.sh@105 -- # continue 2 00:17:38.168 15:46:36 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:38.168 15:46:36 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:17:38.168 15:46:36 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:17:38.168 15:46:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:17:38.168 15:46:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:38.168 15:46:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:38.168 15:46:36 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:17:38.168 15:46:36 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:17:38.168 15:46:36 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:17:38.168 122: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:17:38.168 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:17:38.168 altname enp218s0f0np0 00:17:38.168 altname ens818f0np0 00:17:38.168 inet 192.168.100.8/24 scope global mlx_0_0 00:17:38.168 valid_lft forever preferred_lft forever 00:17:38.168 15:46:36 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:38.168 15:46:36 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:17:38.168 15:46:36 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:17:38.168 15:46:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:17:38.168 15:46:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:38.168 15:46:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:38.168 15:46:36 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:17:38.168 15:46:36 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:17:38.169 15:46:36 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:17:38.169 123: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:17:38.169 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:17:38.169 altname enp218s0f1np1 00:17:38.169 altname ens818f1np1 00:17:38.169 inet 192.168.100.9/24 scope global mlx_0_1 00:17:38.169 valid_lft forever preferred_lft forever 00:17:38.169 15:46:36 -- nvmf/common.sh@411 -- # return 0 00:17:38.169 15:46:36 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:17:38.169 15:46:36 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:17:38.169 15:46:36 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:17:38.169 15:46:36 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:17:38.169 15:46:36 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:17:38.169 15:46:36 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:38.169 15:46:36 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:38.169 15:46:36 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:38.169 15:46:36 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:38.169 15:46:36 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:38.169 15:46:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:38.169 15:46:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:38.169 15:46:36 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:17:38.169 15:46:36 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:17:38.169 15:46:36 -- nvmf/common.sh@105 -- # continue 2 00:17:38.169 15:46:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:38.169 15:46:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:38.169 15:46:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:17:38.169 15:46:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:38.169 15:46:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:17:38.169 15:46:36 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:17:38.169 15:46:36 -- nvmf/common.sh@105 -- # continue 2 00:17:38.169 15:46:36 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:38.169 15:46:36 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:17:38.169 15:46:36 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:17:38.169 15:46:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:38.169 15:46:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:38.169 15:46:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:17:38.169 15:46:36 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:38.169 15:46:36 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:17:38.169 15:46:36 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:17:38.169 15:46:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:17:38.169 15:46:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:38.169 15:46:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:38.169 15:46:36 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:17:38.169 192.168.100.9' 00:17:38.169 15:46:36 -- nvmf/common.sh@446 -- # head -n 1 00:17:38.169 15:46:36 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:17:38.169 192.168.100.9' 00:17:38.169 15:46:36 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:17:38.169 15:46:36 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:17:38.169 192.168.100.9' 00:17:38.169 15:46:36 -- nvmf/common.sh@447 -- # tail -n +2 00:17:38.169 15:46:36 -- nvmf/common.sh@447 -- # head -n 1 00:17:38.169 15:46:36 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:17:38.169 15:46:36 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:17:38.169 15:46:36 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:17:38.169 15:46:36 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:17:38.169 15:46:36 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:17:38.169 15:46:36 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:17:38.169 15:46:36 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:17:38.169 15:46:36 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:17:38.169 15:46:36 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:38.169 15:46:36 -- common/autotest_common.sh@10 -- # set +x 00:17:38.169 15:46:36 -- nvmf/common.sh@470 -- # nvmfpid=3359310 00:17:38.169 15:46:36 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:17:38.169 15:46:36 -- nvmf/common.sh@471 -- # waitforlisten 3359310 00:17:38.169 15:46:36 -- common/autotest_common.sh@817 -- # '[' -z 3359310 ']' 00:17:38.169 15:46:36 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:38.169 15:46:36 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:38.169 15:46:36 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:38.169 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:38.169 15:46:36 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:38.169 15:46:36 -- common/autotest_common.sh@10 -- # set +x 00:17:38.169 [2024-04-26 15:46:36.740291] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:17:38.169 [2024-04-26 15:46:36.740333] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:38.169 EAL: No free 2048 kB hugepages reported on node 1 00:17:38.426 [2024-04-26 15:46:36.794051] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:38.426 [2024-04-26 15:46:36.871518] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:38.426 [2024-04-26 15:46:36.871552] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:38.426 [2024-04-26 15:46:36.871559] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:38.426 [2024-04-26 15:46:36.871564] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:38.426 [2024-04-26 15:46:36.871569] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:38.426 [2024-04-26 15:46:36.871616] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:38.426 [2024-04-26 15:46:36.871711] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:38.426 [2024-04-26 15:46:36.871798] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:38.426 [2024-04-26 15:46:36.871799] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:38.988 15:46:37 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:38.988 15:46:37 -- common/autotest_common.sh@850 -- # return 0 00:17:38.988 15:46:37 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:17:38.988 15:46:37 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:38.988 15:46:37 -- common/autotest_common.sh@10 -- # set +x 00:17:39.246 15:46:37 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:39.246 15:46:37 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:17:39.246 15:46:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:39.246 15:46:37 -- common/autotest_common.sh@10 -- # set +x 00:17:39.246 [2024-04-26 15:46:37.619231] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xbe2100/0xbe65f0) succeed. 00:17:39.246 [2024-04-26 15:46:37.629383] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xbe3740/0xc27c80) succeed. 00:17:39.246 15:46:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:39.246 15:46:37 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:17:39.246 15:46:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:39.246 15:46:37 -- common/autotest_common.sh@10 -- # set +x 00:17:39.246 Malloc0 00:17:39.246 15:46:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:39.246 15:46:37 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:17:39.246 15:46:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:39.246 15:46:37 -- common/autotest_common.sh@10 -- # set +x 00:17:39.246 15:46:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:39.246 15:46:37 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:39.246 15:46:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:39.246 15:46:37 -- common/autotest_common.sh@10 -- # set +x 00:17:39.246 15:46:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:39.246 15:46:37 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:17:39.246 15:46:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:39.246 15:46:37 -- common/autotest_common.sh@10 -- # set +x 00:17:39.246 [2024-04-26 15:46:37.795860] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:17:39.246 15:46:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:39.246 15:46:37 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:17:39.246 15:46:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:39.246 15:46:37 -- common/autotest_common.sh@10 -- # set +x 00:17:39.246 [2024-04-26 15:46:37.803543] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:17:39.246 [ 00:17:39.246 { 00:17:39.246 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:17:39.246 "subtype": "Discovery", 00:17:39.246 "listen_addresses": [], 00:17:39.246 "allow_any_host": true, 00:17:39.246 "hosts": [] 00:17:39.246 }, 00:17:39.246 { 00:17:39.246 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:39.246 "subtype": "NVMe", 00:17:39.246 "listen_addresses": [ 00:17:39.246 { 00:17:39.246 "transport": "RDMA", 00:17:39.246 "trtype": "RDMA", 00:17:39.246 "adrfam": "IPv4", 00:17:39.246 "traddr": "192.168.100.8", 00:17:39.246 "trsvcid": "4420" 00:17:39.246 } 00:17:39.246 ], 00:17:39.246 "allow_any_host": true, 00:17:39.246 "hosts": [], 00:17:39.246 "serial_number": "SPDK00000000000001", 00:17:39.246 "model_number": "SPDK bdev Controller", 00:17:39.246 "max_namespaces": 2, 00:17:39.246 "min_cntlid": 1, 00:17:39.246 "max_cntlid": 65519, 00:17:39.246 "namespaces": [ 00:17:39.246 { 00:17:39.246 "nsid": 1, 00:17:39.246 "bdev_name": "Malloc0", 00:17:39.246 "name": "Malloc0", 00:17:39.246 "nguid": "33FC0E0243994028946AF04D4C115216", 00:17:39.246 "uuid": "33fc0e02-4399-4028-946a-f04d4c115216" 00:17:39.246 } 00:17:39.246 ] 00:17:39.246 } 00:17:39.246 ] 00:17:39.246 15:46:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:39.246 15:46:37 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:17:39.246 15:46:37 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:17:39.246 15:46:37 -- host/aer.sh@33 -- # aerpid=3359556 00:17:39.246 15:46:37 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:17:39.246 15:46:37 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:17:39.246 15:46:37 -- common/autotest_common.sh@1251 -- # local i=0 00:17:39.246 15:46:37 -- common/autotest_common.sh@1252 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:17:39.247 15:46:37 -- common/autotest_common.sh@1253 -- # '[' 0 -lt 200 ']' 00:17:39.247 15:46:37 -- common/autotest_common.sh@1254 -- # i=1 00:17:39.247 15:46:37 -- common/autotest_common.sh@1255 -- # sleep 0.1 00:17:39.511 EAL: No free 2048 kB hugepages reported on node 1 00:17:39.511 15:46:37 -- common/autotest_common.sh@1252 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:17:39.511 15:46:37 -- common/autotest_common.sh@1253 -- # '[' 1 -lt 200 ']' 00:17:39.511 15:46:37 -- common/autotest_common.sh@1254 -- # i=2 00:17:39.511 15:46:37 -- common/autotest_common.sh@1255 -- # sleep 0.1 00:17:39.511 15:46:38 -- common/autotest_common.sh@1252 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:17:39.511 15:46:38 -- common/autotest_common.sh@1258 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:17:39.511 15:46:38 -- common/autotest_common.sh@1262 -- # return 0 00:17:39.511 15:46:38 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:17:39.511 15:46:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:39.511 15:46:38 -- common/autotest_common.sh@10 -- # set +x 00:17:39.511 Malloc1 00:17:39.511 15:46:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:39.511 15:46:38 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:17:39.511 15:46:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:39.511 15:46:38 -- common/autotest_common.sh@10 -- # set +x 00:17:39.511 15:46:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:39.511 15:46:38 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:17:39.511 15:46:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:39.511 15:46:38 -- common/autotest_common.sh@10 -- # set +x 00:17:39.511 [ 00:17:39.511 { 00:17:39.511 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:17:39.511 "subtype": "Discovery", 00:17:39.511 "listen_addresses": [], 00:17:39.511 "allow_any_host": true, 00:17:39.511 "hosts": [] 00:17:39.511 }, 00:17:39.511 { 00:17:39.511 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:39.511 "subtype": "NVMe", 00:17:39.511 "listen_addresses": [ 00:17:39.511 { 00:17:39.511 "transport": "RDMA", 00:17:39.511 "trtype": "RDMA", 00:17:39.511 "adrfam": "IPv4", 00:17:39.511 "traddr": "192.168.100.8", 00:17:39.511 "trsvcid": "4420" 00:17:39.511 } 00:17:39.511 ], 00:17:39.511 "allow_any_host": true, 00:17:39.511 "hosts": [], 00:17:39.511 "serial_number": "SPDK00000000000001", 00:17:39.511 "model_number": "SPDK bdev Controller", 00:17:39.511 "max_namespaces": 2, 00:17:39.511 "min_cntlid": 1, 00:17:39.511 "max_cntlid": 65519, 00:17:39.511 "namespaces": [ 00:17:39.511 { 00:17:39.511 "nsid": 1, 00:17:39.511 "bdev_name": "Malloc0", 00:17:39.511 "name": "Malloc0", 00:17:39.511 "nguid": "33FC0E0243994028946AF04D4C115216", 00:17:39.511 "uuid": "33fc0e02-4399-4028-946a-f04d4c115216" 00:17:39.511 }, 00:17:39.511 { 00:17:39.511 "nsid": 2, 00:17:39.512 "bdev_name": "Malloc1", 00:17:39.512 "name": "Malloc1", 00:17:39.512 "nguid": "213493503FE44B6495536F99E9BF0463", 00:17:39.512 "uuid": "21349350-3fe4-4b64-9553-6f99e9bf0463" 00:17:39.512 } 00:17:39.512 ] 00:17:39.512 } 00:17:39.512 ] 00:17:39.512 15:46:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:39.512 15:46:38 -- host/aer.sh@43 -- # wait 3359556 00:17:39.768 Asynchronous Event Request test 00:17:39.768 Attaching to 192.168.100.8 00:17:39.768 Attached to 192.168.100.8 00:17:39.768 Registering asynchronous event callbacks... 00:17:39.768 Starting namespace attribute notice tests for all controllers... 00:17:39.768 192.168.100.8: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:17:39.768 aer_cb - Changed Namespace 00:17:39.768 Cleaning up... 00:17:39.768 15:46:38 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:17:39.768 15:46:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:39.768 15:46:38 -- common/autotest_common.sh@10 -- # set +x 00:17:39.768 15:46:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:39.768 15:46:38 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:17:39.768 15:46:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:39.768 15:46:38 -- common/autotest_common.sh@10 -- # set +x 00:17:39.768 15:46:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:39.768 15:46:38 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:39.768 15:46:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:39.768 15:46:38 -- common/autotest_common.sh@10 -- # set +x 00:17:39.769 15:46:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:39.769 15:46:38 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:17:39.769 15:46:38 -- host/aer.sh@51 -- # nvmftestfini 00:17:39.769 15:46:38 -- nvmf/common.sh@477 -- # nvmfcleanup 00:17:39.769 15:46:38 -- nvmf/common.sh@117 -- # sync 00:17:39.769 15:46:38 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:17:39.769 15:46:38 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:17:39.769 15:46:38 -- nvmf/common.sh@120 -- # set +e 00:17:39.769 15:46:38 -- nvmf/common.sh@121 -- # for i in {1..20} 00:17:39.769 15:46:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:17:39.769 rmmod nvme_rdma 00:17:39.769 rmmod nvme_fabrics 00:17:39.769 15:46:38 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:17:39.769 15:46:38 -- nvmf/common.sh@124 -- # set -e 00:17:39.769 15:46:38 -- nvmf/common.sh@125 -- # return 0 00:17:39.769 15:46:38 -- nvmf/common.sh@478 -- # '[' -n 3359310 ']' 00:17:39.769 15:46:38 -- nvmf/common.sh@479 -- # killprocess 3359310 00:17:39.769 15:46:38 -- common/autotest_common.sh@936 -- # '[' -z 3359310 ']' 00:17:39.769 15:46:38 -- common/autotest_common.sh@940 -- # kill -0 3359310 00:17:39.769 15:46:38 -- common/autotest_common.sh@941 -- # uname 00:17:39.769 15:46:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:39.769 15:46:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3359310 00:17:39.769 15:46:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:39.769 15:46:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:39.769 15:46:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3359310' 00:17:39.769 killing process with pid 3359310 00:17:39.769 15:46:38 -- common/autotest_common.sh@955 -- # kill 3359310 00:17:39.769 [2024-04-26 15:46:38.278299] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:17:39.769 15:46:38 -- common/autotest_common.sh@960 -- # wait 3359310 00:17:39.769 [2024-04-26 15:46:38.356196] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:17:40.027 15:46:38 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:17:40.027 15:46:38 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:17:40.027 00:17:40.027 real 0m7.194s 00:17:40.027 user 0m8.196s 00:17:40.027 sys 0m4.296s 00:17:40.027 15:46:38 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:40.027 15:46:38 -- common/autotest_common.sh@10 -- # set +x 00:17:40.027 ************************************ 00:17:40.027 END TEST nvmf_aer 00:17:40.027 ************************************ 00:17:40.027 15:46:38 -- nvmf/nvmf.sh@91 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=rdma 00:17:40.027 15:46:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:40.027 15:46:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:40.027 15:46:38 -- common/autotest_common.sh@10 -- # set +x 00:17:40.285 ************************************ 00:17:40.285 START TEST nvmf_async_init 00:17:40.285 ************************************ 00:17:40.285 15:46:38 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=rdma 00:17:40.285 * Looking for test storage... 00:17:40.285 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:17:40.285 15:46:38 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:17:40.285 15:46:38 -- nvmf/common.sh@7 -- # uname -s 00:17:40.285 15:46:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:40.285 15:46:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:40.285 15:46:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:40.285 15:46:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:40.285 15:46:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:40.285 15:46:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:40.285 15:46:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:40.285 15:46:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:40.285 15:46:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:40.285 15:46:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:40.285 15:46:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:17:40.285 15:46:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:17:40.285 15:46:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:40.285 15:46:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:40.285 15:46:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:40.285 15:46:38 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:40.285 15:46:38 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:17:40.285 15:46:38 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:40.285 15:46:38 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:40.285 15:46:38 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:40.285 15:46:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:40.285 15:46:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:40.285 15:46:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:40.285 15:46:38 -- paths/export.sh@5 -- # export PATH 00:17:40.286 15:46:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:40.286 15:46:38 -- nvmf/common.sh@47 -- # : 0 00:17:40.286 15:46:38 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:17:40.286 15:46:38 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:17:40.286 15:46:38 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:40.286 15:46:38 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:40.286 15:46:38 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:40.286 15:46:38 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:17:40.286 15:46:38 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:17:40.286 15:46:38 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:17:40.286 15:46:38 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:17:40.286 15:46:38 -- host/async_init.sh@14 -- # null_block_size=512 00:17:40.286 15:46:38 -- host/async_init.sh@15 -- # null_bdev=null0 00:17:40.286 15:46:38 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:17:40.286 15:46:38 -- host/async_init.sh@20 -- # uuidgen 00:17:40.286 15:46:38 -- host/async_init.sh@20 -- # tr -d - 00:17:40.286 15:46:38 -- host/async_init.sh@20 -- # nguid=fd4e6dd10c94474a845176d732c07edf 00:17:40.286 15:46:38 -- host/async_init.sh@22 -- # nvmftestinit 00:17:40.286 15:46:38 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:17:40.286 15:46:38 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:40.286 15:46:38 -- nvmf/common.sh@437 -- # prepare_net_devs 00:17:40.286 15:46:38 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:17:40.286 15:46:38 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:17:40.286 15:46:38 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:40.286 15:46:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:40.286 15:46:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:40.286 15:46:38 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:17:40.286 15:46:38 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:17:40.286 15:46:38 -- nvmf/common.sh@285 -- # xtrace_disable 00:17:40.286 15:46:38 -- common/autotest_common.sh@10 -- # set +x 00:17:45.553 15:46:43 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:45.553 15:46:43 -- nvmf/common.sh@291 -- # pci_devs=() 00:17:45.553 15:46:43 -- nvmf/common.sh@291 -- # local -a pci_devs 00:17:45.553 15:46:43 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:17:45.553 15:46:43 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:17:45.553 15:46:43 -- nvmf/common.sh@293 -- # pci_drivers=() 00:17:45.553 15:46:43 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:17:45.553 15:46:43 -- nvmf/common.sh@295 -- # net_devs=() 00:17:45.553 15:46:43 -- nvmf/common.sh@295 -- # local -ga net_devs 00:17:45.553 15:46:43 -- nvmf/common.sh@296 -- # e810=() 00:17:45.553 15:46:43 -- nvmf/common.sh@296 -- # local -ga e810 00:17:45.553 15:46:43 -- nvmf/common.sh@297 -- # x722=() 00:17:45.553 15:46:43 -- nvmf/common.sh@297 -- # local -ga x722 00:17:45.553 15:46:43 -- nvmf/common.sh@298 -- # mlx=() 00:17:45.553 15:46:43 -- nvmf/common.sh@298 -- # local -ga mlx 00:17:45.553 15:46:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:45.553 15:46:43 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:45.553 15:46:43 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:45.553 15:46:43 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:45.553 15:46:43 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:45.553 15:46:43 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:45.553 15:46:43 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:45.553 15:46:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:45.553 15:46:43 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:45.553 15:46:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:45.553 15:46:43 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:45.553 15:46:43 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:17:45.553 15:46:43 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:17:45.553 15:46:43 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:17:45.553 15:46:43 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:17:45.553 15:46:43 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:17:45.553 15:46:43 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:17:45.553 15:46:43 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:17:45.553 15:46:43 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:45.553 15:46:43 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:17:45.553 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:17:45.553 15:46:43 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:17:45.553 15:46:43 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:17:45.553 15:46:43 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:17:45.553 15:46:43 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:17:45.553 15:46:43 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:45.553 15:46:43 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:45.553 15:46:43 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:45.553 15:46:43 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:17:45.553 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:17:45.553 15:46:43 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:17:45.553 15:46:43 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:17:45.553 15:46:43 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:17:45.553 15:46:43 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:17:45.553 15:46:43 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:45.553 15:46:43 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:45.553 15:46:43 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:17:45.553 15:46:43 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:17:45.553 15:46:43 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:45.553 15:46:43 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:45.553 15:46:43 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:45.553 15:46:43 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:45.553 15:46:43 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:17:45.553 Found net devices under 0000:da:00.0: mlx_0_0 00:17:45.553 15:46:43 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:45.553 15:46:43 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:45.553 15:46:43 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:45.553 15:46:43 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:45.553 15:46:43 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:45.553 15:46:43 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:17:45.553 Found net devices under 0000:da:00.1: mlx_0_1 00:17:45.553 15:46:43 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:45.553 15:46:43 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:17:45.553 15:46:43 -- nvmf/common.sh@403 -- # is_hw=yes 00:17:45.553 15:46:43 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:17:45.553 15:46:43 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:17:45.553 15:46:43 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:17:45.553 15:46:43 -- nvmf/common.sh@409 -- # rdma_device_init 00:17:45.553 15:46:43 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:17:45.553 15:46:43 -- nvmf/common.sh@58 -- # uname 00:17:45.553 15:46:43 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:17:45.553 15:46:43 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:17:45.553 15:46:43 -- nvmf/common.sh@63 -- # modprobe ib_core 00:17:45.553 15:46:44 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:17:45.553 15:46:44 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:17:45.553 15:46:44 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:17:45.553 15:46:44 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:17:45.553 15:46:44 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:17:45.553 15:46:44 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:17:45.553 15:46:44 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:17:45.553 15:46:44 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:17:45.553 15:46:44 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:45.553 15:46:44 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:45.553 15:46:44 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:45.553 15:46:44 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:45.553 15:46:44 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:45.553 15:46:44 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:45.553 15:46:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:45.553 15:46:44 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:17:45.553 15:46:44 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:17:45.553 15:46:44 -- nvmf/common.sh@105 -- # continue 2 00:17:45.553 15:46:44 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:45.553 15:46:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:45.553 15:46:44 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:17:45.553 15:46:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:45.553 15:46:44 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:17:45.553 15:46:44 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:17:45.553 15:46:44 -- nvmf/common.sh@105 -- # continue 2 00:17:45.553 15:46:44 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:45.553 15:46:44 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:17:45.553 15:46:44 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:17:45.553 15:46:44 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:17:45.553 15:46:44 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:45.553 15:46:44 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:45.553 15:46:44 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:17:45.553 15:46:44 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:17:45.553 15:46:44 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:17:45.553 122: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:17:45.553 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:17:45.553 altname enp218s0f0np0 00:17:45.553 altname ens818f0np0 00:17:45.553 inet 192.168.100.8/24 scope global mlx_0_0 00:17:45.553 valid_lft forever preferred_lft forever 00:17:45.553 15:46:44 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:45.553 15:46:44 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:17:45.553 15:46:44 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:17:45.553 15:46:44 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:17:45.553 15:46:44 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:45.553 15:46:44 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:45.553 15:46:44 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:17:45.553 15:46:44 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:17:45.553 15:46:44 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:17:45.553 123: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:17:45.553 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:17:45.553 altname enp218s0f1np1 00:17:45.553 altname ens818f1np1 00:17:45.553 inet 192.168.100.9/24 scope global mlx_0_1 00:17:45.553 valid_lft forever preferred_lft forever 00:17:45.553 15:46:44 -- nvmf/common.sh@411 -- # return 0 00:17:45.553 15:46:44 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:17:45.553 15:46:44 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:17:45.553 15:46:44 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:17:45.553 15:46:44 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:17:45.553 15:46:44 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:17:45.553 15:46:44 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:45.553 15:46:44 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:45.553 15:46:44 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:45.553 15:46:44 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:45.553 15:46:44 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:45.553 15:46:44 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:45.554 15:46:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:45.554 15:46:44 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:17:45.554 15:46:44 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:17:45.554 15:46:44 -- nvmf/common.sh@105 -- # continue 2 00:17:45.554 15:46:44 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:45.554 15:46:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:45.554 15:46:44 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:17:45.554 15:46:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:45.554 15:46:44 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:17:45.554 15:46:44 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:17:45.554 15:46:44 -- nvmf/common.sh@105 -- # continue 2 00:17:45.554 15:46:44 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:45.554 15:46:44 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:17:45.554 15:46:44 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:17:45.554 15:46:44 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:17:45.554 15:46:44 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:45.554 15:46:44 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:45.554 15:46:44 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:45.554 15:46:44 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:17:45.554 15:46:44 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:17:45.554 15:46:44 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:45.554 15:46:44 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:17:45.554 15:46:44 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:45.554 15:46:44 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:17:45.554 192.168.100.9' 00:17:45.554 15:46:44 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:17:45.554 192.168.100.9' 00:17:45.554 15:46:44 -- nvmf/common.sh@446 -- # head -n 1 00:17:45.554 15:46:44 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:17:45.554 15:46:44 -- nvmf/common.sh@447 -- # head -n 1 00:17:45.554 15:46:44 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:17:45.554 192.168.100.9' 00:17:45.554 15:46:44 -- nvmf/common.sh@447 -- # tail -n +2 00:17:45.554 15:46:44 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:17:45.554 15:46:44 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:17:45.554 15:46:44 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:17:45.554 15:46:44 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:17:45.554 15:46:44 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:17:45.554 15:46:44 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:17:45.812 15:46:44 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:17:45.812 15:46:44 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:17:45.812 15:46:44 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:45.812 15:46:44 -- common/autotest_common.sh@10 -- # set +x 00:17:45.812 15:46:44 -- nvmf/common.sh@470 -- # nvmfpid=3362631 00:17:45.812 15:46:44 -- nvmf/common.sh@471 -- # waitforlisten 3362631 00:17:45.812 15:46:44 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:17:45.812 15:46:44 -- common/autotest_common.sh@817 -- # '[' -z 3362631 ']' 00:17:45.812 15:46:44 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:45.812 15:46:44 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:45.812 15:46:44 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:45.812 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:45.812 15:46:44 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:45.812 15:46:44 -- common/autotest_common.sh@10 -- # set +x 00:17:45.812 [2024-04-26 15:46:44.220823] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:17:45.812 [2024-04-26 15:46:44.220867] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:45.812 EAL: No free 2048 kB hugepages reported on node 1 00:17:45.812 [2024-04-26 15:46:44.274548] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:45.812 [2024-04-26 15:46:44.352094] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:45.813 [2024-04-26 15:46:44.352129] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:45.813 [2024-04-26 15:46:44.352136] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:45.813 [2024-04-26 15:46:44.352150] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:45.813 [2024-04-26 15:46:44.352172] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:45.813 [2024-04-26 15:46:44.352195] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:46.748 15:46:45 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:46.748 15:46:45 -- common/autotest_common.sh@850 -- # return 0 00:17:46.748 15:46:45 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:17:46.748 15:46:45 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:46.748 15:46:45 -- common/autotest_common.sh@10 -- # set +x 00:17:46.748 15:46:45 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:46.748 15:46:45 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:17:46.748 15:46:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:46.748 15:46:45 -- common/autotest_common.sh@10 -- # set +x 00:17:46.748 [2024-04-26 15:46:45.080042] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xb1af60/0xb1f450) succeed. 00:17:46.748 [2024-04-26 15:46:45.089328] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xb1c460/0xb60ae0) succeed. 00:17:46.748 15:46:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:46.748 15:46:45 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:17:46.748 15:46:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:46.748 15:46:45 -- common/autotest_common.sh@10 -- # set +x 00:17:46.748 null0 00:17:46.748 15:46:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:46.748 15:46:45 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:17:46.748 15:46:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:46.748 15:46:45 -- common/autotest_common.sh@10 -- # set +x 00:17:46.748 15:46:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:46.748 15:46:45 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:17:46.748 15:46:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:46.748 15:46:45 -- common/autotest_common.sh@10 -- # set +x 00:17:46.748 15:46:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:46.748 15:46:45 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g fd4e6dd10c94474a845176d732c07edf 00:17:46.748 15:46:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:46.748 15:46:45 -- common/autotest_common.sh@10 -- # set +x 00:17:46.748 15:46:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:46.748 15:46:45 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:17:46.748 15:46:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:46.748 15:46:45 -- common/autotest_common.sh@10 -- # set +x 00:17:46.748 [2024-04-26 15:46:45.183069] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:17:46.748 15:46:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:46.748 15:46:45 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -a 192.168.100.8 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:17:46.748 15:46:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:46.748 15:46:45 -- common/autotest_common.sh@10 -- # set +x 00:17:46.748 nvme0n1 00:17:46.748 15:46:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:46.748 15:46:45 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:17:46.748 15:46:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:46.748 15:46:45 -- common/autotest_common.sh@10 -- # set +x 00:17:46.748 [ 00:17:46.748 { 00:17:46.748 "name": "nvme0n1", 00:17:46.748 "aliases": [ 00:17:46.748 "fd4e6dd1-0c94-474a-8451-76d732c07edf" 00:17:46.748 ], 00:17:46.748 "product_name": "NVMe disk", 00:17:46.748 "block_size": 512, 00:17:46.748 "num_blocks": 2097152, 00:17:46.748 "uuid": "fd4e6dd1-0c94-474a-8451-76d732c07edf", 00:17:46.748 "assigned_rate_limits": { 00:17:46.748 "rw_ios_per_sec": 0, 00:17:46.748 "rw_mbytes_per_sec": 0, 00:17:46.748 "r_mbytes_per_sec": 0, 00:17:46.748 "w_mbytes_per_sec": 0 00:17:46.748 }, 00:17:46.748 "claimed": false, 00:17:46.748 "zoned": false, 00:17:46.748 "supported_io_types": { 00:17:46.748 "read": true, 00:17:46.748 "write": true, 00:17:46.748 "unmap": false, 00:17:46.748 "write_zeroes": true, 00:17:46.748 "flush": true, 00:17:46.748 "reset": true, 00:17:46.748 "compare": true, 00:17:46.748 "compare_and_write": true, 00:17:46.748 "abort": true, 00:17:46.748 "nvme_admin": true, 00:17:46.748 "nvme_io": true 00:17:46.748 }, 00:17:46.748 "memory_domains": [ 00:17:46.748 { 00:17:46.748 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:17:46.748 "dma_device_type": 0 00:17:46.748 } 00:17:46.748 ], 00:17:46.748 "driver_specific": { 00:17:46.748 "nvme": [ 00:17:46.748 { 00:17:46.748 "trid": { 00:17:46.748 "trtype": "RDMA", 00:17:46.748 "adrfam": "IPv4", 00:17:46.748 "traddr": "192.168.100.8", 00:17:46.748 "trsvcid": "4420", 00:17:46.748 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:46.748 }, 00:17:46.748 "ctrlr_data": { 00:17:46.748 "cntlid": 1, 00:17:46.748 "vendor_id": "0x8086", 00:17:46.748 "model_number": "SPDK bdev Controller", 00:17:46.748 "serial_number": "00000000000000000000", 00:17:46.748 "firmware_revision": "24.05", 00:17:46.748 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:46.748 "oacs": { 00:17:46.748 "security": 0, 00:17:46.748 "format": 0, 00:17:46.748 "firmware": 0, 00:17:46.748 "ns_manage": 0 00:17:46.748 }, 00:17:46.748 "multi_ctrlr": true, 00:17:46.748 "ana_reporting": false 00:17:46.748 }, 00:17:46.748 "vs": { 00:17:46.748 "nvme_version": "1.3" 00:17:46.748 }, 00:17:46.748 "ns_data": { 00:17:46.748 "id": 1, 00:17:46.748 "can_share": true 00:17:46.748 } 00:17:46.748 } 00:17:46.748 ], 00:17:46.748 "mp_policy": "active_passive" 00:17:46.748 } 00:17:46.748 } 00:17:46.748 ] 00:17:46.748 15:46:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:46.748 15:46:45 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:17:46.748 15:46:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:46.748 15:46:45 -- common/autotest_common.sh@10 -- # set +x 00:17:46.748 [2024-04-26 15:46:45.287013] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:17:46.748 [2024-04-26 15:46:45.313157] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:46.748 [2024-04-26 15:46:45.338481] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:46.748 15:46:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:46.748 15:46:45 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:17:46.748 15:46:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:46.748 15:46:45 -- common/autotest_common.sh@10 -- # set +x 00:17:46.748 [ 00:17:46.748 { 00:17:46.748 "name": "nvme0n1", 00:17:46.748 "aliases": [ 00:17:46.748 "fd4e6dd1-0c94-474a-8451-76d732c07edf" 00:17:46.748 ], 00:17:46.748 "product_name": "NVMe disk", 00:17:46.748 "block_size": 512, 00:17:46.748 "num_blocks": 2097152, 00:17:46.748 "uuid": "fd4e6dd1-0c94-474a-8451-76d732c07edf", 00:17:46.748 "assigned_rate_limits": { 00:17:46.748 "rw_ios_per_sec": 0, 00:17:47.090 "rw_mbytes_per_sec": 0, 00:17:47.090 "r_mbytes_per_sec": 0, 00:17:47.090 "w_mbytes_per_sec": 0 00:17:47.090 }, 00:17:47.090 "claimed": false, 00:17:47.090 "zoned": false, 00:17:47.090 "supported_io_types": { 00:17:47.090 "read": true, 00:17:47.090 "write": true, 00:17:47.090 "unmap": false, 00:17:47.090 "write_zeroes": true, 00:17:47.090 "flush": true, 00:17:47.090 "reset": true, 00:17:47.090 "compare": true, 00:17:47.090 "compare_and_write": true, 00:17:47.090 "abort": true, 00:17:47.090 "nvme_admin": true, 00:17:47.090 "nvme_io": true 00:17:47.090 }, 00:17:47.090 "memory_domains": [ 00:17:47.090 { 00:17:47.090 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:17:47.091 "dma_device_type": 0 00:17:47.091 } 00:17:47.091 ], 00:17:47.091 "driver_specific": { 00:17:47.091 "nvme": [ 00:17:47.091 { 00:17:47.091 "trid": { 00:17:47.091 "trtype": "RDMA", 00:17:47.091 "adrfam": "IPv4", 00:17:47.091 "traddr": "192.168.100.8", 00:17:47.091 "trsvcid": "4420", 00:17:47.091 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:47.091 }, 00:17:47.091 "ctrlr_data": { 00:17:47.091 "cntlid": 2, 00:17:47.091 "vendor_id": "0x8086", 00:17:47.091 "model_number": "SPDK bdev Controller", 00:17:47.091 "serial_number": "00000000000000000000", 00:17:47.091 "firmware_revision": "24.05", 00:17:47.091 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:47.091 "oacs": { 00:17:47.091 "security": 0, 00:17:47.091 "format": 0, 00:17:47.091 "firmware": 0, 00:17:47.091 "ns_manage": 0 00:17:47.091 }, 00:17:47.091 "multi_ctrlr": true, 00:17:47.091 "ana_reporting": false 00:17:47.091 }, 00:17:47.091 "vs": { 00:17:47.091 "nvme_version": "1.3" 00:17:47.091 }, 00:17:47.091 "ns_data": { 00:17:47.091 "id": 1, 00:17:47.091 "can_share": true 00:17:47.091 } 00:17:47.091 } 00:17:47.091 ], 00:17:47.091 "mp_policy": "active_passive" 00:17:47.091 } 00:17:47.091 } 00:17:47.091 ] 00:17:47.091 15:46:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:47.091 15:46:45 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:17:47.091 15:46:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:47.091 15:46:45 -- common/autotest_common.sh@10 -- # set +x 00:17:47.091 15:46:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:47.091 15:46:45 -- host/async_init.sh@53 -- # mktemp 00:17:47.091 15:46:45 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.aswzsNlgJM 00:17:47.091 15:46:45 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:47.091 15:46:45 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.aswzsNlgJM 00:17:47.091 15:46:45 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:17:47.091 15:46:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:47.091 15:46:45 -- common/autotest_common.sh@10 -- # set +x 00:17:47.091 15:46:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:47.091 15:46:45 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4421 --secure-channel 00:17:47.091 15:46:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:47.091 15:46:45 -- common/autotest_common.sh@10 -- # set +x 00:17:47.091 [2024-04-26 15:46:45.409897] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4421 *** 00:17:47.091 15:46:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:47.091 15:46:45 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.aswzsNlgJM 00:17:47.091 15:46:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:47.091 15:46:45 -- common/autotest_common.sh@10 -- # set +x 00:17:47.091 15:46:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:47.091 15:46:45 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -a 192.168.100.8 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.aswzsNlgJM 00:17:47.091 15:46:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:47.091 15:46:45 -- common/autotest_common.sh@10 -- # set +x 00:17:47.091 [2024-04-26 15:46:45.429937] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:47.091 nvme0n1 00:17:47.091 15:46:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:47.091 15:46:45 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:17:47.091 15:46:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:47.091 15:46:45 -- common/autotest_common.sh@10 -- # set +x 00:17:47.091 [ 00:17:47.091 { 00:17:47.091 "name": "nvme0n1", 00:17:47.091 "aliases": [ 00:17:47.091 "fd4e6dd1-0c94-474a-8451-76d732c07edf" 00:17:47.091 ], 00:17:47.091 "product_name": "NVMe disk", 00:17:47.091 "block_size": 512, 00:17:47.091 "num_blocks": 2097152, 00:17:47.091 "uuid": "fd4e6dd1-0c94-474a-8451-76d732c07edf", 00:17:47.091 "assigned_rate_limits": { 00:17:47.091 "rw_ios_per_sec": 0, 00:17:47.091 "rw_mbytes_per_sec": 0, 00:17:47.091 "r_mbytes_per_sec": 0, 00:17:47.091 "w_mbytes_per_sec": 0 00:17:47.091 }, 00:17:47.091 "claimed": false, 00:17:47.091 "zoned": false, 00:17:47.091 "supported_io_types": { 00:17:47.091 "read": true, 00:17:47.091 "write": true, 00:17:47.091 "unmap": false, 00:17:47.091 "write_zeroes": true, 00:17:47.091 "flush": true, 00:17:47.091 "reset": true, 00:17:47.091 "compare": true, 00:17:47.091 "compare_and_write": true, 00:17:47.091 "abort": true, 00:17:47.091 "nvme_admin": true, 00:17:47.091 "nvme_io": true 00:17:47.091 }, 00:17:47.091 "memory_domains": [ 00:17:47.091 { 00:17:47.091 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:17:47.091 "dma_device_type": 0 00:17:47.091 } 00:17:47.091 ], 00:17:47.091 "driver_specific": { 00:17:47.091 "nvme": [ 00:17:47.091 { 00:17:47.091 "trid": { 00:17:47.091 "trtype": "RDMA", 00:17:47.091 "adrfam": "IPv4", 00:17:47.091 "traddr": "192.168.100.8", 00:17:47.091 "trsvcid": "4421", 00:17:47.091 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:47.091 }, 00:17:47.091 "ctrlr_data": { 00:17:47.091 "cntlid": 3, 00:17:47.091 "vendor_id": "0x8086", 00:17:47.091 "model_number": "SPDK bdev Controller", 00:17:47.091 "serial_number": "00000000000000000000", 00:17:47.091 "firmware_revision": "24.05", 00:17:47.091 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:47.091 "oacs": { 00:17:47.091 "security": 0, 00:17:47.091 "format": 0, 00:17:47.091 "firmware": 0, 00:17:47.091 "ns_manage": 0 00:17:47.091 }, 00:17:47.091 "multi_ctrlr": true, 00:17:47.091 "ana_reporting": false 00:17:47.091 }, 00:17:47.091 "vs": { 00:17:47.091 "nvme_version": "1.3" 00:17:47.091 }, 00:17:47.091 "ns_data": { 00:17:47.091 "id": 1, 00:17:47.091 "can_share": true 00:17:47.091 } 00:17:47.091 } 00:17:47.091 ], 00:17:47.091 "mp_policy": "active_passive" 00:17:47.091 } 00:17:47.091 } 00:17:47.091 ] 00:17:47.091 15:46:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:47.091 15:46:45 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:17:47.091 15:46:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:47.091 15:46:45 -- common/autotest_common.sh@10 -- # set +x 00:17:47.091 15:46:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:47.091 15:46:45 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.aswzsNlgJM 00:17:47.091 15:46:45 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:17:47.091 15:46:45 -- host/async_init.sh@78 -- # nvmftestfini 00:17:47.091 15:46:45 -- nvmf/common.sh@477 -- # nvmfcleanup 00:17:47.091 15:46:45 -- nvmf/common.sh@117 -- # sync 00:17:47.091 15:46:45 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:17:47.091 15:46:45 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:17:47.091 15:46:45 -- nvmf/common.sh@120 -- # set +e 00:17:47.091 15:46:45 -- nvmf/common.sh@121 -- # for i in {1..20} 00:17:47.091 15:46:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:17:47.091 rmmod nvme_rdma 00:17:47.091 rmmod nvme_fabrics 00:17:47.091 15:46:45 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:17:47.091 15:46:45 -- nvmf/common.sh@124 -- # set -e 00:17:47.091 15:46:45 -- nvmf/common.sh@125 -- # return 0 00:17:47.091 15:46:45 -- nvmf/common.sh@478 -- # '[' -n 3362631 ']' 00:17:47.091 15:46:45 -- nvmf/common.sh@479 -- # killprocess 3362631 00:17:47.091 15:46:45 -- common/autotest_common.sh@936 -- # '[' -z 3362631 ']' 00:17:47.091 15:46:45 -- common/autotest_common.sh@940 -- # kill -0 3362631 00:17:47.091 15:46:45 -- common/autotest_common.sh@941 -- # uname 00:17:47.091 15:46:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:47.091 15:46:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3362631 00:17:47.091 15:46:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:47.091 15:46:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:47.091 15:46:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3362631' 00:17:47.091 killing process with pid 3362631 00:17:47.091 15:46:45 -- common/autotest_common.sh@955 -- # kill 3362631 00:17:47.091 15:46:45 -- common/autotest_common.sh@960 -- # wait 3362631 00:17:47.091 [2024-04-26 15:46:45.672706] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:17:47.356 15:46:45 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:17:47.356 15:46:45 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:17:47.356 00:17:47.356 real 0m7.159s 00:17:47.356 user 0m3.368s 00:17:47.356 sys 0m4.380s 00:17:47.356 15:46:45 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:47.356 15:46:45 -- common/autotest_common.sh@10 -- # set +x 00:17:47.356 ************************************ 00:17:47.356 END TEST nvmf_async_init 00:17:47.356 ************************************ 00:17:47.356 15:46:45 -- nvmf/nvmf.sh@92 -- # run_test dma /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=rdma 00:17:47.356 15:46:45 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:47.356 15:46:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:47.356 15:46:45 -- common/autotest_common.sh@10 -- # set +x 00:17:47.615 ************************************ 00:17:47.615 START TEST dma 00:17:47.615 ************************************ 00:17:47.615 15:46:46 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=rdma 00:17:47.615 * Looking for test storage... 00:17:47.615 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:17:47.615 15:46:46 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:17:47.615 15:46:46 -- nvmf/common.sh@7 -- # uname -s 00:17:47.615 15:46:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:47.615 15:46:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:47.615 15:46:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:47.615 15:46:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:47.615 15:46:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:47.615 15:46:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:47.615 15:46:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:47.615 15:46:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:47.615 15:46:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:47.615 15:46:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:47.615 15:46:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:17:47.615 15:46:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:17:47.615 15:46:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:47.615 15:46:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:47.615 15:46:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:47.615 15:46:46 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:47.615 15:46:46 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:17:47.615 15:46:46 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:47.615 15:46:46 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:47.615 15:46:46 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:47.615 15:46:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:47.615 15:46:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:47.615 15:46:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:47.615 15:46:46 -- paths/export.sh@5 -- # export PATH 00:17:47.615 15:46:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:47.615 15:46:46 -- nvmf/common.sh@47 -- # : 0 00:17:47.615 15:46:46 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:17:47.615 15:46:46 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:17:47.615 15:46:46 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:47.615 15:46:46 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:47.615 15:46:46 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:47.615 15:46:46 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:17:47.615 15:46:46 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:17:47.615 15:46:46 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:17:47.615 15:46:46 -- host/dma.sh@12 -- # '[' rdma '!=' rdma ']' 00:17:47.615 15:46:46 -- host/dma.sh@16 -- # MALLOC_BDEV_SIZE=256 00:17:47.615 15:46:46 -- host/dma.sh@17 -- # MALLOC_BLOCK_SIZE=512 00:17:47.616 15:46:46 -- host/dma.sh@18 -- # subsystem=0 00:17:47.616 15:46:46 -- host/dma.sh@93 -- # nvmftestinit 00:17:47.616 15:46:46 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:17:47.616 15:46:46 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:47.616 15:46:46 -- nvmf/common.sh@437 -- # prepare_net_devs 00:17:47.616 15:46:46 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:17:47.616 15:46:46 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:17:47.616 15:46:46 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:47.616 15:46:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:47.616 15:46:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:47.616 15:46:46 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:17:47.616 15:46:46 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:17:47.616 15:46:46 -- nvmf/common.sh@285 -- # xtrace_disable 00:17:47.616 15:46:46 -- common/autotest_common.sh@10 -- # set +x 00:17:52.883 15:46:51 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:52.883 15:46:51 -- nvmf/common.sh@291 -- # pci_devs=() 00:17:52.883 15:46:51 -- nvmf/common.sh@291 -- # local -a pci_devs 00:17:52.883 15:46:51 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:17:52.883 15:46:51 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:17:52.883 15:46:51 -- nvmf/common.sh@293 -- # pci_drivers=() 00:17:52.883 15:46:51 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:17:52.883 15:46:51 -- nvmf/common.sh@295 -- # net_devs=() 00:17:52.883 15:46:51 -- nvmf/common.sh@295 -- # local -ga net_devs 00:17:52.883 15:46:51 -- nvmf/common.sh@296 -- # e810=() 00:17:52.883 15:46:51 -- nvmf/common.sh@296 -- # local -ga e810 00:17:52.883 15:46:51 -- nvmf/common.sh@297 -- # x722=() 00:17:52.883 15:46:51 -- nvmf/common.sh@297 -- # local -ga x722 00:17:52.883 15:46:51 -- nvmf/common.sh@298 -- # mlx=() 00:17:52.883 15:46:51 -- nvmf/common.sh@298 -- # local -ga mlx 00:17:52.883 15:46:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:52.883 15:46:51 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:52.883 15:46:51 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:52.883 15:46:51 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:52.883 15:46:51 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:52.883 15:46:51 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:52.883 15:46:51 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:52.883 15:46:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:52.883 15:46:51 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:52.883 15:46:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:52.883 15:46:51 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:52.883 15:46:51 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:17:52.883 15:46:51 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:17:52.883 15:46:51 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:17:52.883 15:46:51 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:17:52.883 15:46:51 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:17:52.883 15:46:51 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:17:52.883 15:46:51 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:17:52.883 15:46:51 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:52.883 15:46:51 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:17:52.883 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:17:52.883 15:46:51 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:17:52.883 15:46:51 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:17:52.883 15:46:51 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:17:52.883 15:46:51 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:17:52.883 15:46:51 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:52.883 15:46:51 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:52.883 15:46:51 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:52.883 15:46:51 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:17:52.883 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:17:52.883 15:46:51 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:17:52.883 15:46:51 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:17:52.883 15:46:51 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:17:52.883 15:46:51 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:17:52.883 15:46:51 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:52.883 15:46:51 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:52.883 15:46:51 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:17:52.883 15:46:51 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:17:52.883 15:46:51 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:52.883 15:46:51 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:52.883 15:46:51 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:52.883 15:46:51 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:52.883 15:46:51 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:17:52.883 Found net devices under 0000:da:00.0: mlx_0_0 00:17:52.883 15:46:51 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:52.883 15:46:51 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:52.883 15:46:51 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:52.883 15:46:51 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:52.883 15:46:51 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:52.883 15:46:51 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:17:52.883 Found net devices under 0000:da:00.1: mlx_0_1 00:17:52.883 15:46:51 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:52.883 15:46:51 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:17:52.883 15:46:51 -- nvmf/common.sh@403 -- # is_hw=yes 00:17:52.883 15:46:51 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:17:52.883 15:46:51 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:17:52.883 15:46:51 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:17:52.883 15:46:51 -- nvmf/common.sh@409 -- # rdma_device_init 00:17:52.883 15:46:51 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:17:52.883 15:46:51 -- nvmf/common.sh@58 -- # uname 00:17:52.883 15:46:51 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:17:52.883 15:46:51 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:17:52.883 15:46:51 -- nvmf/common.sh@63 -- # modprobe ib_core 00:17:52.883 15:46:51 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:17:52.883 15:46:51 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:17:52.883 15:46:51 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:17:52.883 15:46:51 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:17:52.883 15:46:51 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:17:52.883 15:46:51 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:17:52.883 15:46:51 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:17:52.883 15:46:51 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:17:52.883 15:46:51 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:52.883 15:46:51 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:52.883 15:46:51 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:52.883 15:46:51 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:52.883 15:46:51 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:52.883 15:46:51 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:52.883 15:46:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:52.883 15:46:51 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:17:52.883 15:46:51 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:17:52.883 15:46:51 -- nvmf/common.sh@105 -- # continue 2 00:17:52.883 15:46:51 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:52.883 15:46:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:52.883 15:46:51 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:17:52.883 15:46:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:52.883 15:46:51 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:17:52.883 15:46:51 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:17:52.883 15:46:51 -- nvmf/common.sh@105 -- # continue 2 00:17:52.883 15:46:51 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:52.883 15:46:51 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:17:52.883 15:46:51 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:17:52.883 15:46:51 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:52.884 15:46:51 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:52.884 15:46:51 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:17:52.884 15:46:51 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:17:52.884 15:46:51 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:17:52.884 15:46:51 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:17:52.884 122: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:17:52.884 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:17:52.884 altname enp218s0f0np0 00:17:52.884 altname ens818f0np0 00:17:52.884 inet 192.168.100.8/24 scope global mlx_0_0 00:17:52.884 valid_lft forever preferred_lft forever 00:17:52.884 15:46:51 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:52.884 15:46:51 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:17:52.884 15:46:51 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:17:52.884 15:46:51 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:17:52.884 15:46:51 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:52.884 15:46:51 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:52.884 15:46:51 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:17:52.884 15:46:51 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:17:52.884 15:46:51 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:17:52.884 123: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:17:52.884 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:17:52.884 altname enp218s0f1np1 00:17:52.884 altname ens818f1np1 00:17:52.884 inet 192.168.100.9/24 scope global mlx_0_1 00:17:52.884 valid_lft forever preferred_lft forever 00:17:52.884 15:46:51 -- nvmf/common.sh@411 -- # return 0 00:17:52.884 15:46:51 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:17:52.884 15:46:51 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:17:52.884 15:46:51 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:17:52.884 15:46:51 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:17:52.884 15:46:51 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:17:52.884 15:46:51 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:52.884 15:46:51 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:52.884 15:46:51 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:52.884 15:46:51 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:52.884 15:46:51 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:52.884 15:46:51 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:52.884 15:46:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:52.884 15:46:51 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:17:52.884 15:46:51 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:17:52.884 15:46:51 -- nvmf/common.sh@105 -- # continue 2 00:17:52.884 15:46:51 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:52.884 15:46:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:52.884 15:46:51 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:17:52.884 15:46:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:52.884 15:46:51 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:17:52.884 15:46:51 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:17:52.884 15:46:51 -- nvmf/common.sh@105 -- # continue 2 00:17:52.884 15:46:51 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:52.884 15:46:51 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:17:52.884 15:46:51 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:17:52.884 15:46:51 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:52.884 15:46:51 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:17:52.884 15:46:51 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:52.884 15:46:51 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:52.884 15:46:51 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:17:52.884 15:46:51 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:17:52.884 15:46:51 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:17:52.884 15:46:51 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:52.884 15:46:51 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:52.884 15:46:51 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:17:52.884 192.168.100.9' 00:17:52.884 15:46:51 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:17:52.884 192.168.100.9' 00:17:52.884 15:46:51 -- nvmf/common.sh@446 -- # head -n 1 00:17:52.884 15:46:51 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:17:52.884 15:46:51 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:17:52.884 192.168.100.9' 00:17:52.884 15:46:51 -- nvmf/common.sh@447 -- # tail -n +2 00:17:52.884 15:46:51 -- nvmf/common.sh@447 -- # head -n 1 00:17:52.884 15:46:51 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:17:52.884 15:46:51 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:17:52.884 15:46:51 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:17:52.884 15:46:51 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:17:52.884 15:46:51 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:17:52.884 15:46:51 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:17:52.884 15:46:51 -- host/dma.sh@94 -- # nvmfappstart -m 0x3 00:17:52.884 15:46:51 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:17:52.884 15:46:51 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:52.884 15:46:51 -- common/autotest_common.sh@10 -- # set +x 00:17:52.884 15:46:51 -- nvmf/common.sh@470 -- # nvmfpid=3365950 00:17:52.884 15:46:51 -- nvmf/common.sh@471 -- # waitforlisten 3365950 00:17:52.884 15:46:51 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:17:52.884 15:46:51 -- common/autotest_common.sh@817 -- # '[' -z 3365950 ']' 00:17:52.884 15:46:51 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:52.884 15:46:51 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:52.884 15:46:51 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:52.884 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:52.884 15:46:51 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:52.884 15:46:51 -- common/autotest_common.sh@10 -- # set +x 00:17:52.884 [2024-04-26 15:46:51.472708] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:17:52.884 [2024-04-26 15:46:51.472749] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:53.141 EAL: No free 2048 kB hugepages reported on node 1 00:17:53.141 [2024-04-26 15:46:51.528819] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:17:53.141 [2024-04-26 15:46:51.607003] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:53.141 [2024-04-26 15:46:51.607038] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:53.141 [2024-04-26 15:46:51.607045] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:53.141 [2024-04-26 15:46:51.607051] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:53.141 [2024-04-26 15:46:51.607056] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:53.141 [2024-04-26 15:46:51.607098] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:53.141 [2024-04-26 15:46:51.607101] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:53.704 15:46:52 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:53.704 15:46:52 -- common/autotest_common.sh@850 -- # return 0 00:17:53.704 15:46:52 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:17:53.704 15:46:52 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:53.704 15:46:52 -- common/autotest_common.sh@10 -- # set +x 00:17:53.962 15:46:52 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:53.962 15:46:52 -- host/dma.sh@96 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:17:53.962 15:46:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:53.962 15:46:52 -- common/autotest_common.sh@10 -- # set +x 00:17:53.962 [2024-04-26 15:46:52.343160] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x783a60/0x787f50) succeed. 00:17:53.962 [2024-04-26 15:46:52.351981] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x784f60/0x7c95e0) succeed. 00:17:53.963 15:46:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:53.963 15:46:52 -- host/dma.sh@97 -- # rpc_cmd bdev_malloc_create 256 512 -b Malloc0 00:17:53.963 15:46:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:53.963 15:46:52 -- common/autotest_common.sh@10 -- # set +x 00:17:53.963 Malloc0 00:17:53.963 15:46:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:53.963 15:46:52 -- host/dma.sh@98 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK00000000000001 00:17:53.963 15:46:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:53.963 15:46:52 -- common/autotest_common.sh@10 -- # set +x 00:17:53.963 15:46:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:53.963 15:46:52 -- host/dma.sh@99 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Malloc0 00:17:53.963 15:46:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:53.963 15:46:52 -- common/autotest_common.sh@10 -- # set +x 00:17:53.963 15:46:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:53.963 15:46:52 -- host/dma.sh@100 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:17:53.963 15:46:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:53.963 15:46:52 -- common/autotest_common.sh@10 -- # set +x 00:17:53.963 [2024-04-26 15:46:52.507316] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:17:53.963 15:46:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:53.963 15:46:52 -- host/dma.sh@104 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dma/test_dma/test_dma -q 16 -o 4096 -w randrw -M 70 -t 5 -m 0xc --json /dev/fd/62 -b Nvme0n1 -f -x translate 00:17:53.963 15:46:52 -- host/dma.sh@104 -- # gen_nvmf_target_json 0 00:17:53.963 15:46:52 -- nvmf/common.sh@521 -- # config=() 00:17:53.963 15:46:52 -- nvmf/common.sh@521 -- # local subsystem config 00:17:53.963 15:46:52 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:53.963 15:46:52 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:53.963 { 00:17:53.963 "params": { 00:17:53.963 "name": "Nvme$subsystem", 00:17:53.963 "trtype": "$TEST_TRANSPORT", 00:17:53.963 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:53.963 "adrfam": "ipv4", 00:17:53.963 "trsvcid": "$NVMF_PORT", 00:17:53.963 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:53.963 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:53.963 "hdgst": ${hdgst:-false}, 00:17:53.963 "ddgst": ${ddgst:-false} 00:17:53.963 }, 00:17:53.963 "method": "bdev_nvme_attach_controller" 00:17:53.963 } 00:17:53.963 EOF 00:17:53.963 )") 00:17:53.963 15:46:52 -- nvmf/common.sh@543 -- # cat 00:17:53.963 15:46:52 -- nvmf/common.sh@545 -- # jq . 00:17:53.963 15:46:52 -- nvmf/common.sh@546 -- # IFS=, 00:17:53.963 15:46:52 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:17:53.963 "params": { 00:17:53.963 "name": "Nvme0", 00:17:53.963 "trtype": "rdma", 00:17:53.963 "traddr": "192.168.100.8", 00:17:53.963 "adrfam": "ipv4", 00:17:53.963 "trsvcid": "4420", 00:17:53.963 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:53.963 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:17:53.963 "hdgst": false, 00:17:53.963 "ddgst": false 00:17:53.963 }, 00:17:53.963 "method": "bdev_nvme_attach_controller" 00:17:53.963 }' 00:17:53.963 [2024-04-26 15:46:52.554544] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:17:53.963 [2024-04-26 15:46:52.554595] [ DPDK EAL parameters: test_dma --no-shconf -c 0xc --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3366197 ] 00:17:54.220 EAL: No free 2048 kB hugepages reported on node 1 00:17:54.220 [2024-04-26 15:46:52.603955] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:17:54.220 [2024-04-26 15:46:52.675780] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:54.220 [2024-04-26 15:46:52.675783] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:00.770 bdev Nvme0n1 reports 1 memory domains 00:18:00.770 bdev Nvme0n1 supports RDMA memory domain 00:18:00.770 Initialization complete, running randrw IO for 5 sec on 2 cores 00:18:00.770 ========================================================================== 00:18:00.770 Latency [us] 00:18:00.770 IOPS MiB/s Average min max 00:18:00.770 Core 2: 21636.32 84.52 738.73 240.03 8851.58 00:18:00.770 Core 3: 21789.67 85.12 733.53 241.18 8725.64 00:18:00.770 ========================================================================== 00:18:00.770 Total : 43425.99 169.63 736.12 240.03 8851.58 00:18:00.770 00:18:00.770 Total operations: 217197, translate 217197 pull_push 0 memzero 0 00:18:00.770 15:46:58 -- host/dma.sh@107 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dma/test_dma/test_dma -q 16 -o 4096 -w randrw -M 70 -t 5 -m 0xc --json /dev/fd/62 -b Malloc0 -x pull_push 00:18:00.770 15:46:58 -- host/dma.sh@107 -- # gen_malloc_json 00:18:00.770 15:46:58 -- host/dma.sh@21 -- # jq . 00:18:00.770 [2024-04-26 15:46:58.132790] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:18:00.770 [2024-04-26 15:46:58.132846] [ DPDK EAL parameters: test_dma --no-shconf -c 0xc --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3367119 ] 00:18:00.770 EAL: No free 2048 kB hugepages reported on node 1 00:18:00.770 [2024-04-26 15:46:58.182345] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:18:00.770 [2024-04-26 15:46:58.250326] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:00.770 [2024-04-26 15:46:58.250328] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:06.023 bdev Malloc0 reports 2 memory domains 00:18:06.023 bdev Malloc0 doesn't support RDMA memory domain 00:18:06.023 Initialization complete, running randrw IO for 5 sec on 2 cores 00:18:06.023 ========================================================================== 00:18:06.023 Latency [us] 00:18:06.023 IOPS MiB/s Average min max 00:18:06.023 Core 2: 14853.26 58.02 1076.47 356.72 2349.56 00:18:06.023 Core 3: 14719.30 57.50 1086.24 370.67 2294.52 00:18:06.023 ========================================================================== 00:18:06.023 Total : 29572.56 115.52 1081.33 356.72 2349.56 00:18:06.023 00:18:06.023 Total operations: 147912, translate 0 pull_push 591648 memzero 0 00:18:06.023 15:47:03 -- host/dma.sh@110 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dma/test_dma/test_dma -q 16 -o 4096 -w randread -M 70 -t 5 -m 0xc --json /dev/fd/62 -b lvs0/lvol0 -f -x memzero 00:18:06.023 15:47:03 -- host/dma.sh@110 -- # gen_lvol_nvme_json 0 00:18:06.023 15:47:03 -- host/dma.sh@48 -- # local subsystem=0 00:18:06.023 15:47:03 -- host/dma.sh@50 -- # jq . 00:18:06.023 Ignoring -M option 00:18:06.023 [2024-04-26 15:47:03.632589] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:18:06.023 [2024-04-26 15:47:03.632646] [ DPDK EAL parameters: test_dma --no-shconf -c 0xc --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3368032 ] 00:18:06.023 EAL: No free 2048 kB hugepages reported on node 1 00:18:06.023 [2024-04-26 15:47:03.681409] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:18:06.023 [2024-04-26 15:47:03.749551] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:06.023 [2024-04-26 15:47:03.749554] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:06.023 [2024-04-26 15:47:03.962126] vbdev_lvol_rpc.c: 347:rpc_bdev_lvol_create: *WARNING*: vbdev_lvol_rpc_req_size: deprecated feature rpc_bdev_lvol_create/resize req.size to be removed in v23.09 00:18:11.274 [2024-04-26 15:47:08.990270] app.c: 937:log_deprecation_hits: *WARNING*: vbdev_lvol_rpc_req_size: deprecation 'rpc_bdev_lvol_create/resize req.size' scheduled for removal in v23.09 hit 1 times 00:18:11.274 bdev 892a5c87-8d85-40c2-b9e0-a56e6d95d276 reports 1 memory domains 00:18:11.274 bdev 892a5c87-8d85-40c2-b9e0-a56e6d95d276 supports RDMA memory domain 00:18:11.274 Initialization complete, running randread IO for 5 sec on 2 cores 00:18:11.274 ========================================================================== 00:18:11.274 Latency [us] 00:18:11.274 IOPS MiB/s Average min max 00:18:11.274 Core 2: 84103.69 328.53 189.54 81.52 2798.73 00:18:11.274 Core 3: 86395.22 337.48 184.53 78.21 2740.03 00:18:11.274 ========================================================================== 00:18:11.274 Total : 170498.92 666.01 187.00 78.21 2798.73 00:18:11.274 00:18:11.274 Total operations: 852595, translate 0 pull_push 0 memzero 852595 00:18:11.274 15:47:09 -- host/dma.sh@113 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 16 -o 4096 -w write -t 1 -r 'trtype:rdma adrfam:IPV4 traddr:192.168.100.8 trsvcid:4420' 00:18:11.274 EAL: No free 2048 kB hugepages reported on node 1 00:18:11.274 [2024-04-26 15:47:09.316354] subsystem.c:1435:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on RDMA/192.168.100.8/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:18:13.168 Initializing NVMe Controllers 00:18:13.168 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode0 00:18:13.168 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:18:13.168 Initialization complete. Launching workers. 00:18:13.168 ======================================================== 00:18:13.168 Latency(us) 00:18:13.168 Device Information : IOPS MiB/s Average min max 00:18:13.168 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 0: 2016.00 7.88 7972.11 6648.71 8318.16 00:18:13.168 ======================================================== 00:18:13.168 Total : 2016.00 7.88 7972.11 6648.71 8318.16 00:18:13.168 00:18:13.168 15:47:11 -- host/dma.sh@116 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dma/test_dma/test_dma -q 16 -o 4096 -w randrw -M 70 -t 5 -m 0xc --json /dev/fd/62 -b lvs0/lvol0 -f -x translate 00:18:13.168 15:47:11 -- host/dma.sh@116 -- # gen_lvol_nvme_json 0 00:18:13.168 15:47:11 -- host/dma.sh@48 -- # local subsystem=0 00:18:13.168 15:47:11 -- host/dma.sh@50 -- # jq . 00:18:13.168 [2024-04-26 15:47:11.652060] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:18:13.168 [2024-04-26 15:47:11.652111] [ DPDK EAL parameters: test_dma --no-shconf -c 0xc --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3369397 ] 00:18:13.168 EAL: No free 2048 kB hugepages reported on node 1 00:18:13.168 [2024-04-26 15:47:11.702099] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:18:13.426 [2024-04-26 15:47:11.774851] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:13.426 [2024-04-26 15:47:11.774854] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:13.426 [2024-04-26 15:47:11.980110] vbdev_lvol_rpc.c: 347:rpc_bdev_lvol_create: *WARNING*: vbdev_lvol_rpc_req_size: deprecated feature rpc_bdev_lvol_create/resize req.size to be removed in v23.09 00:18:18.681 [2024-04-26 15:47:17.008183] app.c: 937:log_deprecation_hits: *WARNING*: vbdev_lvol_rpc_req_size: deprecation 'rpc_bdev_lvol_create/resize req.size' scheduled for removal in v23.09 hit 1 times 00:18:18.681 bdev ae1c3b98-863d-4367-8354-2b298e0fadbf reports 1 memory domains 00:18:18.681 bdev ae1c3b98-863d-4367-8354-2b298e0fadbf supports RDMA memory domain 00:18:18.681 Initialization complete, running randrw IO for 5 sec on 2 cores 00:18:18.681 ========================================================================== 00:18:18.681 Latency [us] 00:18:18.681 IOPS MiB/s Average min max 00:18:18.681 Core 2: 19327.86 75.50 827.15 26.01 12133.97 00:18:18.681 Core 3: 19594.04 76.54 815.88 19.17 12373.07 00:18:18.681 ========================================================================== 00:18:18.681 Total : 38921.90 152.04 821.48 19.17 12373.07 00:18:18.681 00:18:18.681 Total operations: 194627, translate 194519 pull_push 0 memzero 108 00:18:18.681 15:47:17 -- host/dma.sh@118 -- # trap - SIGINT SIGTERM EXIT 00:18:18.681 15:47:17 -- host/dma.sh@120 -- # nvmftestfini 00:18:18.681 15:47:17 -- nvmf/common.sh@477 -- # nvmfcleanup 00:18:18.681 15:47:17 -- nvmf/common.sh@117 -- # sync 00:18:18.681 15:47:17 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:18:18.681 15:47:17 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:18:18.681 15:47:17 -- nvmf/common.sh@120 -- # set +e 00:18:18.681 15:47:17 -- nvmf/common.sh@121 -- # for i in {1..20} 00:18:18.681 15:47:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:18:18.681 rmmod nvme_rdma 00:18:18.681 rmmod nvme_fabrics 00:18:18.681 15:47:17 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:18:18.938 15:47:17 -- nvmf/common.sh@124 -- # set -e 00:18:18.938 15:47:17 -- nvmf/common.sh@125 -- # return 0 00:18:18.938 15:47:17 -- nvmf/common.sh@478 -- # '[' -n 3365950 ']' 00:18:18.938 15:47:17 -- nvmf/common.sh@479 -- # killprocess 3365950 00:18:18.938 15:47:17 -- common/autotest_common.sh@936 -- # '[' -z 3365950 ']' 00:18:18.938 15:47:17 -- common/autotest_common.sh@940 -- # kill -0 3365950 00:18:18.938 15:47:17 -- common/autotest_common.sh@941 -- # uname 00:18:18.938 15:47:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:18.938 15:47:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3365950 00:18:18.938 15:47:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:18.938 15:47:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:18.938 15:47:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3365950' 00:18:18.938 killing process with pid 3365950 00:18:18.938 15:47:17 -- common/autotest_common.sh@955 -- # kill 3365950 00:18:18.938 15:47:17 -- common/autotest_common.sh@960 -- # wait 3365950 00:18:18.939 [2024-04-26 15:47:17.386376] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:18:19.196 15:47:17 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:18:19.196 15:47:17 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:18:19.196 00:18:19.196 real 0m31.636s 00:18:19.196 user 1m36.496s 00:18:19.196 sys 0m5.024s 00:18:19.196 15:47:17 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:18:19.196 15:47:17 -- common/autotest_common.sh@10 -- # set +x 00:18:19.196 ************************************ 00:18:19.196 END TEST dma 00:18:19.196 ************************************ 00:18:19.196 15:47:17 -- nvmf/nvmf.sh@95 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=rdma 00:18:19.196 15:47:17 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:19.196 15:47:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:19.196 15:47:17 -- common/autotest_common.sh@10 -- # set +x 00:18:19.455 ************************************ 00:18:19.455 START TEST nvmf_identify 00:18:19.455 ************************************ 00:18:19.455 15:47:17 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=rdma 00:18:19.455 * Looking for test storage... 00:18:19.455 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:18:19.456 15:47:17 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:18:19.456 15:47:17 -- nvmf/common.sh@7 -- # uname -s 00:18:19.456 15:47:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:19.456 15:47:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:19.456 15:47:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:19.456 15:47:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:19.456 15:47:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:19.456 15:47:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:19.456 15:47:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:19.456 15:47:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:19.456 15:47:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:19.456 15:47:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:19.456 15:47:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:18:19.456 15:47:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:18:19.456 15:47:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:19.456 15:47:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:19.456 15:47:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:19.456 15:47:17 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:18:19.456 15:47:17 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:18:19.456 15:47:17 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:19.456 15:47:17 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:19.456 15:47:17 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:19.456 15:47:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:19.456 15:47:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:19.456 15:47:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:19.456 15:47:17 -- paths/export.sh@5 -- # export PATH 00:18:19.456 15:47:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:19.456 15:47:17 -- nvmf/common.sh@47 -- # : 0 00:18:19.456 15:47:17 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:18:19.456 15:47:17 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:18:19.456 15:47:17 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:18:19.456 15:47:17 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:19.456 15:47:17 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:19.456 15:47:17 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:18:19.456 15:47:17 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:18:19.456 15:47:17 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:18:19.456 15:47:17 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:19.456 15:47:17 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:19.456 15:47:17 -- host/identify.sh@14 -- # nvmftestinit 00:18:19.456 15:47:17 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:18:19.456 15:47:17 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:19.456 15:47:17 -- nvmf/common.sh@437 -- # prepare_net_devs 00:18:19.456 15:47:17 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:18:19.456 15:47:17 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:18:19.456 15:47:17 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:19.456 15:47:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:19.456 15:47:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:19.456 15:47:17 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:18:19.456 15:47:17 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:18:19.456 15:47:17 -- nvmf/common.sh@285 -- # xtrace_disable 00:18:19.456 15:47:17 -- common/autotest_common.sh@10 -- # set +x 00:18:24.718 15:47:23 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:24.718 15:47:23 -- nvmf/common.sh@291 -- # pci_devs=() 00:18:24.718 15:47:23 -- nvmf/common.sh@291 -- # local -a pci_devs 00:18:24.718 15:47:23 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:18:24.718 15:47:23 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:18:24.718 15:47:23 -- nvmf/common.sh@293 -- # pci_drivers=() 00:18:24.718 15:47:23 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:18:24.718 15:47:23 -- nvmf/common.sh@295 -- # net_devs=() 00:18:24.718 15:47:23 -- nvmf/common.sh@295 -- # local -ga net_devs 00:18:24.718 15:47:23 -- nvmf/common.sh@296 -- # e810=() 00:18:24.718 15:47:23 -- nvmf/common.sh@296 -- # local -ga e810 00:18:24.718 15:47:23 -- nvmf/common.sh@297 -- # x722=() 00:18:24.718 15:47:23 -- nvmf/common.sh@297 -- # local -ga x722 00:18:24.718 15:47:23 -- nvmf/common.sh@298 -- # mlx=() 00:18:24.718 15:47:23 -- nvmf/common.sh@298 -- # local -ga mlx 00:18:24.718 15:47:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:24.718 15:47:23 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:24.718 15:47:23 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:24.718 15:47:23 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:24.718 15:47:23 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:24.718 15:47:23 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:24.718 15:47:23 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:24.718 15:47:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:24.718 15:47:23 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:24.718 15:47:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:24.718 15:47:23 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:24.718 15:47:23 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:18:24.718 15:47:23 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:18:24.718 15:47:23 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:18:24.718 15:47:23 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:18:24.718 15:47:23 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:18:24.718 15:47:23 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:18:24.718 15:47:23 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:18:24.718 15:47:23 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:24.718 15:47:23 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:18:24.718 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:18:24.718 15:47:23 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:18:24.718 15:47:23 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:18:24.718 15:47:23 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:18:24.718 15:47:23 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:18:24.718 15:47:23 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:24.718 15:47:23 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:24.718 15:47:23 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:24.718 15:47:23 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:18:24.718 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:18:24.718 15:47:23 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:18:24.718 15:47:23 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:18:24.718 15:47:23 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:18:24.718 15:47:23 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:18:24.718 15:47:23 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:24.718 15:47:23 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:24.718 15:47:23 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:18:24.718 15:47:23 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:18:24.718 15:47:23 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:24.718 15:47:23 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:24.718 15:47:23 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:24.718 15:47:23 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:24.718 15:47:23 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:18:24.718 Found net devices under 0000:da:00.0: mlx_0_0 00:18:24.718 15:47:23 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:24.718 15:47:23 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:24.718 15:47:23 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:24.718 15:47:23 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:24.718 15:47:23 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:24.718 15:47:23 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:18:24.718 Found net devices under 0000:da:00.1: mlx_0_1 00:18:24.718 15:47:23 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:24.718 15:47:23 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:18:24.718 15:47:23 -- nvmf/common.sh@403 -- # is_hw=yes 00:18:24.718 15:47:23 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:18:24.718 15:47:23 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:18:24.718 15:47:23 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:18:24.718 15:47:23 -- nvmf/common.sh@409 -- # rdma_device_init 00:18:24.718 15:47:23 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:18:24.718 15:47:23 -- nvmf/common.sh@58 -- # uname 00:18:24.718 15:47:23 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:18:24.718 15:47:23 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:18:24.718 15:47:23 -- nvmf/common.sh@63 -- # modprobe ib_core 00:18:24.718 15:47:23 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:18:24.718 15:47:23 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:18:24.718 15:47:23 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:18:24.718 15:47:23 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:18:24.718 15:47:23 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:18:24.718 15:47:23 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:18:24.718 15:47:23 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:18:24.718 15:47:23 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:18:24.718 15:47:23 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:24.718 15:47:23 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:24.718 15:47:23 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:24.718 15:47:23 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:24.718 15:47:23 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:24.718 15:47:23 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:24.718 15:47:23 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:24.718 15:47:23 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:18:24.718 15:47:23 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:18:24.718 15:47:23 -- nvmf/common.sh@105 -- # continue 2 00:18:24.718 15:47:23 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:24.718 15:47:23 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:24.718 15:47:23 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:18:24.718 15:47:23 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:24.718 15:47:23 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:18:24.718 15:47:23 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:18:24.718 15:47:23 -- nvmf/common.sh@105 -- # continue 2 00:18:24.718 15:47:23 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:24.718 15:47:23 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:18:24.718 15:47:23 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:24.718 15:47:23 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:24.718 15:47:23 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:24.718 15:47:23 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:24.718 15:47:23 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:18:24.718 15:47:23 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:18:24.718 15:47:23 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:18:24.718 122: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:18:24.718 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:18:24.718 altname enp218s0f0np0 00:18:24.718 altname ens818f0np0 00:18:24.718 inet 192.168.100.8/24 scope global mlx_0_0 00:18:24.718 valid_lft forever preferred_lft forever 00:18:24.718 15:47:23 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:24.718 15:47:23 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:18:24.718 15:47:23 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:24.718 15:47:23 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:24.718 15:47:23 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:24.718 15:47:23 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:24.718 15:47:23 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:18:24.718 15:47:23 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:18:24.718 15:47:23 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:18:24.718 123: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:18:24.718 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:18:24.718 altname enp218s0f1np1 00:18:24.718 altname ens818f1np1 00:18:24.718 inet 192.168.100.9/24 scope global mlx_0_1 00:18:24.718 valid_lft forever preferred_lft forever 00:18:24.718 15:47:23 -- nvmf/common.sh@411 -- # return 0 00:18:24.718 15:47:23 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:18:24.718 15:47:23 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:18:24.718 15:47:23 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:18:24.718 15:47:23 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:18:24.718 15:47:23 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:18:24.718 15:47:23 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:24.718 15:47:23 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:24.718 15:47:23 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:24.718 15:47:23 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:24.718 15:47:23 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:24.718 15:47:23 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:24.718 15:47:23 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:24.718 15:47:23 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:18:24.718 15:47:23 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:18:24.718 15:47:23 -- nvmf/common.sh@105 -- # continue 2 00:18:24.974 15:47:23 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:24.974 15:47:23 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:24.974 15:47:23 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:18:24.974 15:47:23 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:24.974 15:47:23 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:18:24.974 15:47:23 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:18:24.974 15:47:23 -- nvmf/common.sh@105 -- # continue 2 00:18:24.974 15:47:23 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:24.974 15:47:23 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:18:24.974 15:47:23 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:24.974 15:47:23 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:24.974 15:47:23 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:24.974 15:47:23 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:24.974 15:47:23 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:24.974 15:47:23 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:18:24.974 15:47:23 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:24.974 15:47:23 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:24.974 15:47:23 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:24.974 15:47:23 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:24.974 15:47:23 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:18:24.974 192.168.100.9' 00:18:24.974 15:47:23 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:18:24.974 192.168.100.9' 00:18:24.974 15:47:23 -- nvmf/common.sh@446 -- # head -n 1 00:18:24.974 15:47:23 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:18:24.974 15:47:23 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:18:24.974 192.168.100.9' 00:18:24.974 15:47:23 -- nvmf/common.sh@447 -- # tail -n +2 00:18:24.974 15:47:23 -- nvmf/common.sh@447 -- # head -n 1 00:18:24.974 15:47:23 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:18:24.974 15:47:23 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:18:24.974 15:47:23 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:18:24.974 15:47:23 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:18:24.974 15:47:23 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:18:24.974 15:47:23 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:18:24.974 15:47:23 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:18:24.974 15:47:23 -- common/autotest_common.sh@710 -- # xtrace_disable 00:18:24.974 15:47:23 -- common/autotest_common.sh@10 -- # set +x 00:18:24.974 15:47:23 -- host/identify.sh@19 -- # nvmfpid=3373393 00:18:24.974 15:47:23 -- host/identify.sh@18 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:18:24.974 15:47:23 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:24.974 15:47:23 -- host/identify.sh@23 -- # waitforlisten 3373393 00:18:24.974 15:47:23 -- common/autotest_common.sh@817 -- # '[' -z 3373393 ']' 00:18:24.974 15:47:23 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:24.974 15:47:23 -- common/autotest_common.sh@822 -- # local max_retries=100 00:18:24.974 15:47:23 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:24.974 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:24.974 15:47:23 -- common/autotest_common.sh@826 -- # xtrace_disable 00:18:24.974 15:47:23 -- common/autotest_common.sh@10 -- # set +x 00:18:24.974 [2024-04-26 15:47:23.429393] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:18:24.974 [2024-04-26 15:47:23.429435] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:24.974 EAL: No free 2048 kB hugepages reported on node 1 00:18:24.974 [2024-04-26 15:47:23.483842] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:24.974 [2024-04-26 15:47:23.564422] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:24.974 [2024-04-26 15:47:23.564459] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:24.974 [2024-04-26 15:47:23.564466] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:18:24.974 [2024-04-26 15:47:23.564472] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:18:24.974 [2024-04-26 15:47:23.564476] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:24.974 [2024-04-26 15:47:23.564534] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:24.974 [2024-04-26 15:47:23.564629] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:24.974 [2024-04-26 15:47:23.564715] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:24.974 [2024-04-26 15:47:23.564716] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:25.904 15:47:24 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:18:25.904 15:47:24 -- common/autotest_common.sh@850 -- # return 0 00:18:25.904 15:47:24 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:18:25.904 15:47:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:25.904 15:47:24 -- common/autotest_common.sh@10 -- # set +x 00:18:25.904 [2024-04-26 15:47:24.277950] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x56a100/0x56e5f0) succeed. 00:18:25.904 [2024-04-26 15:47:24.288064] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x56b740/0x5afc80) succeed. 00:18:25.904 15:47:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:25.904 15:47:24 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:18:25.904 15:47:24 -- common/autotest_common.sh@716 -- # xtrace_disable 00:18:25.904 15:47:24 -- common/autotest_common.sh@10 -- # set +x 00:18:25.904 15:47:24 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:25.904 15:47:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:25.904 15:47:24 -- common/autotest_common.sh@10 -- # set +x 00:18:25.904 Malloc0 00:18:25.904 15:47:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:25.904 15:47:24 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:25.904 15:47:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:25.904 15:47:24 -- common/autotest_common.sh@10 -- # set +x 00:18:25.904 15:47:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:25.904 15:47:24 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:18:25.904 15:47:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:25.904 15:47:24 -- common/autotest_common.sh@10 -- # set +x 00:18:25.904 15:47:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:25.904 15:47:24 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:18:25.904 15:47:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:25.904 15:47:24 -- common/autotest_common.sh@10 -- # set +x 00:18:25.904 [2024-04-26 15:47:24.493100] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:18:25.904 15:47:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:25.904 15:47:24 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:18:25.904 15:47:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:25.904 15:47:24 -- common/autotest_common.sh@10 -- # set +x 00:18:25.904 15:47:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:25.904 15:47:24 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:18:25.904 15:47:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:25.904 15:47:24 -- common/autotest_common.sh@10 -- # set +x 00:18:26.170 [2024-04-26 15:47:24.508760] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:18:26.170 [ 00:18:26.170 { 00:18:26.170 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:18:26.170 "subtype": "Discovery", 00:18:26.170 "listen_addresses": [ 00:18:26.170 { 00:18:26.170 "transport": "RDMA", 00:18:26.170 "trtype": "RDMA", 00:18:26.170 "adrfam": "IPv4", 00:18:26.170 "traddr": "192.168.100.8", 00:18:26.170 "trsvcid": "4420" 00:18:26.170 } 00:18:26.170 ], 00:18:26.170 "allow_any_host": true, 00:18:26.170 "hosts": [] 00:18:26.170 }, 00:18:26.170 { 00:18:26.170 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:26.170 "subtype": "NVMe", 00:18:26.170 "listen_addresses": [ 00:18:26.170 { 00:18:26.170 "transport": "RDMA", 00:18:26.170 "trtype": "RDMA", 00:18:26.170 "adrfam": "IPv4", 00:18:26.170 "traddr": "192.168.100.8", 00:18:26.170 "trsvcid": "4420" 00:18:26.170 } 00:18:26.170 ], 00:18:26.170 "allow_any_host": true, 00:18:26.170 "hosts": [], 00:18:26.170 "serial_number": "SPDK00000000000001", 00:18:26.170 "model_number": "SPDK bdev Controller", 00:18:26.170 "max_namespaces": 32, 00:18:26.170 "min_cntlid": 1, 00:18:26.170 "max_cntlid": 65519, 00:18:26.170 "namespaces": [ 00:18:26.171 { 00:18:26.171 "nsid": 1, 00:18:26.171 "bdev_name": "Malloc0", 00:18:26.171 "name": "Malloc0", 00:18:26.171 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:18:26.171 "eui64": "ABCDEF0123456789", 00:18:26.171 "uuid": "90499404-225a-4b6a-9a53-3646ff22aacc" 00:18:26.171 } 00:18:26.171 ] 00:18:26.171 } 00:18:26.171 ] 00:18:26.171 15:47:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:26.171 15:47:24 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:18:26.171 [2024-04-26 15:47:24.543215] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:18:26.171 [2024-04-26 15:47:24.543247] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3373640 ] 00:18:26.171 EAL: No free 2048 kB hugepages reported on node 1 00:18:26.171 [2024-04-26 15:47:24.587413] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:18:26.171 [2024-04-26 15:47:24.587490] nvme_rdma.c:2261:nvme_rdma_ctrlr_construct: *DEBUG*: successfully initialized the nvmf ctrlr 00:18:26.171 [2024-04-26 15:47:24.587505] nvme_rdma.c:1291:nvme_rdma_ctrlr_connect_qpair: *DEBUG*: adrfam 1 ai_family 2 00:18:26.171 [2024-04-26 15:47:24.587508] nvme_rdma.c:1295:nvme_rdma_ctrlr_connect_qpair: *DEBUG*: trsvcid is 4420 00:18:26.171 [2024-04-26 15:47:24.587539] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:18:26.171 [2024-04-26 15:47:24.593740] nvme_rdma.c: 510:nvme_rdma_qpair_process_cm_event: *DEBUG*: Requested queue depth 32. Target receive queue depth 32. 00:18:26.171 [2024-04-26 15:47:24.609447] nvme_rdma.c:1180:nvme_rdma_connect_established: *DEBUG*: rc =0 00:18:26.171 [2024-04-26 15:47:24.609456] nvme_rdma.c:1185:nvme_rdma_connect_established: *DEBUG*: RDMA requests created 00:18:26.171 [2024-04-26 15:47:24.609463] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.609469] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.609474] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.609478] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.609482] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.609486] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.609491] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.609495] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.609499] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.609503] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.609508] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.609512] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.609516] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.609520] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.609525] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.609532] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.609536] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.609540] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.609544] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.609549] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.609553] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.609557] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.609561] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.609566] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.609570] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.609574] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.609578] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.609582] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.609587] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.609591] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.609595] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.609599] nvme_rdma.c:1199:nvme_rdma_connect_established: *DEBUG*: RDMA responses created 00:18:26.171 [2024-04-26 15:47:24.609603] nvme_rdma.c:1202:nvme_rdma_connect_established: *DEBUG*: rc =0 00:18:26.171 [2024-04-26 15:47:24.609606] nvme_rdma.c:1207:nvme_rdma_connect_established: *DEBUG*: RDMA responses submitted 00:18:26.171 [2024-04-26 15:47:24.609625] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.609638] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf200 len:0x400 key:0x183800 00:18:26.171 [2024-04-26 15:47:24.615146] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.171 [2024-04-26 15:47:24.615156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:18:26.171 [2024-04-26 15:47:24.615163] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.615169] nvme_fabric.c: 622:_nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:18:26.171 [2024-04-26 15:47:24.615175] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:18:26.171 [2024-04-26 15:47:24.615179] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:18:26.171 [2024-04-26 15:47:24.615194] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.615201] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.171 [2024-04-26 15:47:24.615223] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.171 [2024-04-26 15:47:24.615228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:10300 sqhd:0002 p:0 m:0 dnr:0 00:18:26.171 [2024-04-26 15:47:24.615237] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:18:26.171 [2024-04-26 15:47:24.615241] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.615246] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:18:26.171 [2024-04-26 15:47:24.615252] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.615258] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.171 [2024-04-26 15:47:24.615277] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.171 [2024-04-26 15:47:24.615282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1e01007f sqhd:0003 p:0 m:0 dnr:0 00:18:26.171 [2024-04-26 15:47:24.615287] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:18:26.171 [2024-04-26 15:47:24.615291] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.615296] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:18:26.171 [2024-04-26 15:47:24.615302] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.615307] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.171 [2024-04-26 15:47:24.615326] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.171 [2024-04-26 15:47:24.615330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0004 p:0 m:0 dnr:0 00:18:26.171 [2024-04-26 15:47:24.615335] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:18:26.171 [2024-04-26 15:47:24.615339] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.615346] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.615352] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.171 [2024-04-26 15:47:24.615367] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.171 [2024-04-26 15:47:24.615372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0005 p:0 m:0 dnr:0 00:18:26.171 [2024-04-26 15:47:24.615376] nvme_ctrlr.c:3749:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:18:26.171 [2024-04-26 15:47:24.615380] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:18:26.171 [2024-04-26 15:47:24.615384] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183800 00:18:26.171 [2024-04-26 15:47:24.615389] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:18:26.171 [2024-04-26 15:47:24.615494] nvme_ctrlr.c:3942:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:18:26.171 [2024-04-26 15:47:24.615498] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:18:26.171 [2024-04-26 15:47:24.615506] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183800 00:18:26.172 [2024-04-26 15:47:24.615513] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.172 [2024-04-26 15:47:24.615533] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.172 [2024-04-26 15:47:24.615538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0006 p:0 m:0 dnr:0 00:18:26.172 [2024-04-26 15:47:24.615542] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:18:26.172 [2024-04-26 15:47:24.615546] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183800 00:18:26.172 [2024-04-26 15:47:24.615552] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183800 00:18:26.172 [2024-04-26 15:47:24.615558] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.172 [2024-04-26 15:47:24.615572] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.172 [2024-04-26 15:47:24.615576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:18:26.172 [2024-04-26 15:47:24.615581] nvme_ctrlr.c:3784:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:18:26.172 [2024-04-26 15:47:24.615585] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:18:26.172 [2024-04-26 15:47:24.615589] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183800 00:18:26.172 [2024-04-26 15:47:24.615594] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:18:26.172 [2024-04-26 15:47:24.615600] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:18:26.172 [2024-04-26 15:47:24.615608] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183800 00:18:26.172 [2024-04-26 15:47:24.615614] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x183800 00:18:26.172 [2024-04-26 15:47:24.615652] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.172 [2024-04-26 15:47:24.615657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0008 p:0 m:0 dnr:0 00:18:26.172 [2024-04-26 15:47:24.615664] nvme_ctrlr.c:1984:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:18:26.172 [2024-04-26 15:47:24.615669] nvme_ctrlr.c:1988:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:18:26.172 [2024-04-26 15:47:24.615672] nvme_ctrlr.c:1991:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:18:26.172 [2024-04-26 15:47:24.615680] nvme_ctrlr.c:2015:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:18:26.172 [2024-04-26 15:47:24.615684] nvme_ctrlr.c:2030:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:18:26.172 [2024-04-26 15:47:24.615688] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:18:26.172 [2024-04-26 15:47:24.615692] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183800 00:18:26.172 [2024-04-26 15:47:24.615698] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:18:26.172 [2024-04-26 15:47:24.615703] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183800 00:18:26.172 [2024-04-26 15:47:24.615711] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.172 [2024-04-26 15:47:24.615732] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.172 [2024-04-26 15:47:24.615736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0009 p:0 m:0 dnr:0 00:18:26.172 [2024-04-26 15:47:24.615744] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0500 length 0x40 lkey 0x183800 00:18:26.172 [2024-04-26 15:47:24.615749] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:18:26.172 [2024-04-26 15:47:24.615754] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0640 length 0x40 lkey 0x183800 00:18:26.172 [2024-04-26 15:47:24.615759] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:18:26.172 [2024-04-26 15:47:24.615764] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.172 [2024-04-26 15:47:24.615769] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:18:26.172 [2024-04-26 15:47:24.615774] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d08c0 length 0x40 lkey 0x183800 00:18:26.172 [2024-04-26 15:47:24.615779] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:18:26.172 [2024-04-26 15:47:24.615783] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:18:26.172 [2024-04-26 15:47:24.615787] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x183800 00:18:26.172 [2024-04-26 15:47:24.615795] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:18:26.172 [2024-04-26 15:47:24.615801] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183800 00:18:26.172 [2024-04-26 15:47:24.615807] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:0 cdw10:0000000f SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.172 [2024-04-26 15:47:24.615831] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.172 [2024-04-26 15:47:24.615835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:2710 sqhd:000a p:0 m:0 dnr:0 00:18:26.172 [2024-04-26 15:47:24.615840] nvme_ctrlr.c:2902:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:18:26.172 [2024-04-26 15:47:24.615844] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:18:26.172 [2024-04-26 15:47:24.615848] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x183800 00:18:26.172 [2024-04-26 15:47:24.615855] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183800 00:18:26.172 [2024-04-26 15:47:24.615861] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x183800 00:18:26.172 [2024-04-26 15:47:24.615885] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.172 [2024-04-26 15:47:24.615889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000b p:0 m:0 dnr:0 00:18:26.172 [2024-04-26 15:47:24.615894] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x183800 00:18:26.172 [2024-04-26 15:47:24.615902] nvme_ctrlr.c:4036:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:18:26.172 [2024-04-26 15:47:24.615920] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183800 00:18:26.172 [2024-04-26 15:47:24.615926] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:0 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf000 len:0x400 key:0x183800 00:18:26.172 [2024-04-26 15:47:24.615932] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x183800 00:18:26.172 [2024-04-26 15:47:24.615937] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:18:26.172 [2024-04-26 15:47:24.615957] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.172 [2024-04-26 15:47:24.615961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000c p:0 m:0 dnr:0 00:18:26.172 [2024-04-26 15:47:24.615970] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0b40 length 0x40 lkey 0x183800 00:18:26.172 [2024-04-26 15:47:24.615976] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0xc00 key:0x183800 00:18:26.172 [2024-04-26 15:47:24.615980] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x183800 00:18:26.172 [2024-04-26 15:47:24.615985] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.172 [2024-04-26 15:47:24.615989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:000d p:0 m:0 dnr:0 00:18:26.172 [2024-04-26 15:47:24.615993] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x183800 00:18:26.172 [2024-04-26 15:47:24.616005] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.172 [2024-04-26 15:47:24.616009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:6 cdw0:0 sqhd:000e p:0 m:0 dnr:0 00:18:26.172 [2024-04-26 15:47:24.616017] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x183800 00:18:26.172 [2024-04-26 15:47:24.616023] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:0 cdw10:00010070 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf000 len:0x8 key:0x183800 00:18:26.172 [2024-04-26 15:47:24.616027] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x183800 00:18:26.172 [2024-04-26 15:47:24.616044] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.172 [2024-04-26 15:47:24.616049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:000f p:0 m:0 dnr:0 00:18:26.172 [2024-04-26 15:47:24.616057] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x183800 00:18:26.172 ===================================================== 00:18:26.172 NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2014-08.org.nvmexpress.discovery 00:18:26.172 ===================================================== 00:18:26.172 Controller Capabilities/Features 00:18:26.172 ================================ 00:18:26.172 Vendor ID: 0000 00:18:26.172 Subsystem Vendor ID: 0000 00:18:26.172 Serial Number: .................... 00:18:26.172 Model Number: ........................................ 00:18:26.172 Firmware Version: 24.05 00:18:26.172 Recommended Arb Burst: 0 00:18:26.172 IEEE OUI Identifier: 00 00 00 00:18:26.172 Multi-path I/O 00:18:26.172 May have multiple subsystem ports: No 00:18:26.172 May have multiple controllers: No 00:18:26.172 Associated with SR-IOV VF: No 00:18:26.172 Max Data Transfer Size: 131072 00:18:26.172 Max Number of Namespaces: 0 00:18:26.172 Max Number of I/O Queues: 1024 00:18:26.172 NVMe Specification Version (VS): 1.3 00:18:26.172 NVMe Specification Version (Identify): 1.3 00:18:26.172 Maximum Queue Entries: 128 00:18:26.172 Contiguous Queues Required: Yes 00:18:26.172 Arbitration Mechanisms Supported 00:18:26.172 Weighted Round Robin: Not Supported 00:18:26.172 Vendor Specific: Not Supported 00:18:26.173 Reset Timeout: 15000 ms 00:18:26.173 Doorbell Stride: 4 bytes 00:18:26.173 NVM Subsystem Reset: Not Supported 00:18:26.173 Command Sets Supported 00:18:26.173 NVM Command Set: Supported 00:18:26.173 Boot Partition: Not Supported 00:18:26.173 Memory Page Size Minimum: 4096 bytes 00:18:26.173 Memory Page Size Maximum: 4096 bytes 00:18:26.173 Persistent Memory Region: Not Supported 00:18:26.173 Optional Asynchronous Events Supported 00:18:26.173 Namespace Attribute Notices: Not Supported 00:18:26.173 Firmware Activation Notices: Not Supported 00:18:26.173 ANA Change Notices: Not Supported 00:18:26.173 PLE Aggregate Log Change Notices: Not Supported 00:18:26.173 LBA Status Info Alert Notices: Not Supported 00:18:26.173 EGE Aggregate Log Change Notices: Not Supported 00:18:26.173 Normal NVM Subsystem Shutdown event: Not Supported 00:18:26.173 Zone Descriptor Change Notices: Not Supported 00:18:26.173 Discovery Log Change Notices: Supported 00:18:26.173 Controller Attributes 00:18:26.173 128-bit Host Identifier: Not Supported 00:18:26.173 Non-Operational Permissive Mode: Not Supported 00:18:26.173 NVM Sets: Not Supported 00:18:26.173 Read Recovery Levels: Not Supported 00:18:26.173 Endurance Groups: Not Supported 00:18:26.173 Predictable Latency Mode: Not Supported 00:18:26.173 Traffic Based Keep ALive: Not Supported 00:18:26.173 Namespace Granularity: Not Supported 00:18:26.173 SQ Associations: Not Supported 00:18:26.173 UUID List: Not Supported 00:18:26.173 Multi-Domain Subsystem: Not Supported 00:18:26.173 Fixed Capacity Management: Not Supported 00:18:26.173 Variable Capacity Management: Not Supported 00:18:26.173 Delete Endurance Group: Not Supported 00:18:26.173 Delete NVM Set: Not Supported 00:18:26.173 Extended LBA Formats Supported: Not Supported 00:18:26.173 Flexible Data Placement Supported: Not Supported 00:18:26.173 00:18:26.173 Controller Memory Buffer Support 00:18:26.173 ================================ 00:18:26.173 Supported: No 00:18:26.173 00:18:26.173 Persistent Memory Region Support 00:18:26.173 ================================ 00:18:26.173 Supported: No 00:18:26.173 00:18:26.173 Admin Command Set Attributes 00:18:26.173 ============================ 00:18:26.173 Security Send/Receive: Not Supported 00:18:26.173 Format NVM: Not Supported 00:18:26.173 Firmware Activate/Download: Not Supported 00:18:26.173 Namespace Management: Not Supported 00:18:26.173 Device Self-Test: Not Supported 00:18:26.173 Directives: Not Supported 00:18:26.173 NVMe-MI: Not Supported 00:18:26.173 Virtualization Management: Not Supported 00:18:26.173 Doorbell Buffer Config: Not Supported 00:18:26.173 Get LBA Status Capability: Not Supported 00:18:26.173 Command & Feature Lockdown Capability: Not Supported 00:18:26.173 Abort Command Limit: 1 00:18:26.173 Async Event Request Limit: 4 00:18:26.173 Number of Firmware Slots: N/A 00:18:26.173 Firmware Slot 1 Read-Only: N/A 00:18:26.173 Firmware Activation Without Reset: N/A 00:18:26.173 Multiple Update Detection Support: N/A 00:18:26.173 Firmware Update Granularity: No Information Provided 00:18:26.173 Per-Namespace SMART Log: No 00:18:26.173 Asymmetric Namespace Access Log Page: Not Supported 00:18:26.173 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:18:26.173 Command Effects Log Page: Not Supported 00:18:26.173 Get Log Page Extended Data: Supported 00:18:26.173 Telemetry Log Pages: Not Supported 00:18:26.173 Persistent Event Log Pages: Not Supported 00:18:26.173 Supported Log Pages Log Page: May Support 00:18:26.173 Commands Supported & Effects Log Page: Not Supported 00:18:26.173 Feature Identifiers & Effects Log Page:May Support 00:18:26.173 NVMe-MI Commands & Effects Log Page: May Support 00:18:26.173 Data Area 4 for Telemetry Log: Not Supported 00:18:26.173 Error Log Page Entries Supported: 128 00:18:26.173 Keep Alive: Not Supported 00:18:26.173 00:18:26.173 NVM Command Set Attributes 00:18:26.173 ========================== 00:18:26.173 Submission Queue Entry Size 00:18:26.173 Max: 1 00:18:26.173 Min: 1 00:18:26.173 Completion Queue Entry Size 00:18:26.173 Max: 1 00:18:26.173 Min: 1 00:18:26.173 Number of Namespaces: 0 00:18:26.173 Compare Command: Not Supported 00:18:26.173 Write Uncorrectable Command: Not Supported 00:18:26.173 Dataset Management Command: Not Supported 00:18:26.173 Write Zeroes Command: Not Supported 00:18:26.173 Set Features Save Field: Not Supported 00:18:26.173 Reservations: Not Supported 00:18:26.173 Timestamp: Not Supported 00:18:26.173 Copy: Not Supported 00:18:26.173 Volatile Write Cache: Not Present 00:18:26.173 Atomic Write Unit (Normal): 1 00:18:26.173 Atomic Write Unit (PFail): 1 00:18:26.173 Atomic Compare & Write Unit: 1 00:18:26.173 Fused Compare & Write: Supported 00:18:26.173 Scatter-Gather List 00:18:26.173 SGL Command Set: Supported 00:18:26.173 SGL Keyed: Supported 00:18:26.173 SGL Bit Bucket Descriptor: Not Supported 00:18:26.173 SGL Metadata Pointer: Not Supported 00:18:26.173 Oversized SGL: Not Supported 00:18:26.173 SGL Metadata Address: Not Supported 00:18:26.173 SGL Offset: Supported 00:18:26.173 Transport SGL Data Block: Not Supported 00:18:26.173 Replay Protected Memory Block: Not Supported 00:18:26.173 00:18:26.173 Firmware Slot Information 00:18:26.173 ========================= 00:18:26.173 Active slot: 0 00:18:26.173 00:18:26.173 00:18:26.173 Error Log 00:18:26.173 ========= 00:18:26.173 00:18:26.173 Active Namespaces 00:18:26.173 ================= 00:18:26.173 Discovery Log Page 00:18:26.173 ================== 00:18:26.173 Generation Counter: 2 00:18:26.173 Number of Records: 2 00:18:26.173 Record Format: 0 00:18:26.173 00:18:26.173 Discovery Log Entry 0 00:18:26.173 ---------------------- 00:18:26.173 Transport Type: 1 (RDMA) 00:18:26.173 Address Family: 1 (IPv4) 00:18:26.173 Subsystem Type: 3 (Current Discovery Subsystem) 00:18:26.173 Entry Flags: 00:18:26.173 Duplicate Returned Information: 1 00:18:26.173 Explicit Persistent Connection Support for Discovery: 1 00:18:26.173 Transport Requirements: 00:18:26.173 Secure Channel: Not Required 00:18:26.173 Port ID: 0 (0x0000) 00:18:26.173 Controller ID: 65535 (0xffff) 00:18:26.173 Admin Max SQ Size: 128 00:18:26.173 Transport Service Identifier: 4420 00:18:26.173 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:18:26.173 Transport Address: 192.168.100.8 00:18:26.173 Transport Specific Address Subtype - RDMA 00:18:26.173 RDMA QP Service Type: 1 (Reliable Connected) 00:18:26.173 RDMA Provider Type: 1 (No provider specified) 00:18:26.173 RDMA CM Service: 1 (RDMA_CM) 00:18:26.173 Discovery Log Entry 1 00:18:26.173 ---------------------- 00:18:26.173 Transport Type: 1 (RDMA) 00:18:26.173 Address Family: 1 (IPv4) 00:18:26.173 Subsystem Type: 2 (NVM Subsystem) 00:18:26.173 Entry Flags: 00:18:26.173 Duplicate Returned Information: 0 00:18:26.173 Explicit Persistent Connection Support for Discovery: 0 00:18:26.173 Transport Requirements: 00:18:26.173 Secure Channel: Not Required 00:18:26.173 Port ID: 0 (0x0000) 00:18:26.173 Controller ID: 65535 (0xffff) 00:18:26.173 Admin Max SQ Size: [2024-04-26 15:47:24.616127] nvme_ctrlr.c:4221:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:18:26.173 [2024-04-26 15:47:24.616135] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 13346 doesn't match qid 00:18:26.173 [2024-04-26 15:47:24.616152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32575 cdw0:5 sqhd:7790 p:0 m:0 dnr:0 00:18:26.173 [2024-04-26 15:47:24.616157] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 13346 doesn't match qid 00:18:26.173 [2024-04-26 15:47:24.616163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32575 cdw0:5 sqhd:7790 p:0 m:0 dnr:0 00:18:26.173 [2024-04-26 15:47:24.616168] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 13346 doesn't match qid 00:18:26.173 [2024-04-26 15:47:24.616173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32575 cdw0:5 sqhd:7790 p:0 m:0 dnr:0 00:18:26.173 [2024-04-26 15:47:24.616178] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 13346 doesn't match qid 00:18:26.173 [2024-04-26 15:47:24.616183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32575 cdw0:5 sqhd:7790 p:0 m:0 dnr:0 00:18:26.173 [2024-04-26 15:47:24.616192] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d08c0 length 0x40 lkey 0x183800 00:18:26.173 [2024-04-26 15:47:24.616198] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:4 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.173 [2024-04-26 15:47:24.616218] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.173 [2024-04-26 15:47:24.616222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:4 cdw0:460001 sqhd:0010 p:0 m:0 dnr:0 00:18:26.173 [2024-04-26 15:47:24.616231] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.173 [2024-04-26 15:47:24.616237] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.173 [2024-04-26 15:47:24.616241] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x183800 00:18:26.173 [2024-04-26 15:47:24.616264] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.174 [2024-04-26 15:47:24.616269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:0 sqhd:0011 p:0 m:0 dnr:0 00:18:26.174 [2024-04-26 15:47:24.616275] nvme_ctrlr.c:1082:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:18:26.174 [2024-04-26 15:47:24.616279] nvme_ctrlr.c:1085:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:18:26.174 [2024-04-26 15:47:24.616283] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x183800 00:18:26.174 [2024-04-26 15:47:24.616290] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.174 [2024-04-26 15:47:24.616296] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.174 [2024-04-26 15:47:24.616313] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.174 [2024-04-26 15:47:24.616317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0012 p:0 m:0 dnr:0 00:18:26.174 [2024-04-26 15:47:24.616321] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x183800 00:18:26.174 [2024-04-26 15:47:24.616329] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.174 [2024-04-26 15:47:24.616335] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.174 [2024-04-26 15:47:24.616356] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.174 [2024-04-26 15:47:24.616360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0013 p:0 m:0 dnr:0 00:18:26.174 [2024-04-26 15:47:24.616364] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x183800 00:18:26.174 [2024-04-26 15:47:24.616372] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.174 [2024-04-26 15:47:24.616378] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.174 [2024-04-26 15:47:24.616396] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.174 [2024-04-26 15:47:24.616400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0014 p:0 m:0 dnr:0 00:18:26.174 [2024-04-26 15:47:24.616405] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x183800 00:18:26.174 [2024-04-26 15:47:24.616412] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.174 [2024-04-26 15:47:24.616418] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.174 [2024-04-26 15:47:24.616433] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.174 [2024-04-26 15:47:24.616437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0015 p:0 m:0 dnr:0 00:18:26.174 [2024-04-26 15:47:24.616441] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x183800 00:18:26.174 [2024-04-26 15:47:24.616448] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.174 [2024-04-26 15:47:24.616454] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.174 [2024-04-26 15:47:24.616470] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.174 [2024-04-26 15:47:24.616474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0016 p:0 m:0 dnr:0 00:18:26.174 [2024-04-26 15:47:24.616479] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x183800 00:18:26.174 [2024-04-26 15:47:24.616485] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.174 [2024-04-26 15:47:24.616491] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.174 [2024-04-26 15:47:24.616508] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.174 [2024-04-26 15:47:24.616512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0017 p:0 m:0 dnr:0 00:18:26.174 [2024-04-26 15:47:24.616516] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x183800 00:18:26.174 [2024-04-26 15:47:24.616523] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.174 [2024-04-26 15:47:24.616529] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.174 [2024-04-26 15:47:24.616546] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.174 [2024-04-26 15:47:24.616550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0018 p:0 m:0 dnr:0 00:18:26.174 [2024-04-26 15:47:24.616555] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x183800 00:18:26.174 [2024-04-26 15:47:24.616561] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.174 [2024-04-26 15:47:24.616567] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.174 [2024-04-26 15:47:24.616586] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.174 [2024-04-26 15:47:24.616590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0019 p:0 m:0 dnr:0 00:18:26.174 [2024-04-26 15:47:24.616595] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x183800 00:18:26.174 [2024-04-26 15:47:24.616601] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.174 [2024-04-26 15:47:24.616607] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.174 [2024-04-26 15:47:24.616625] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.174 [2024-04-26 15:47:24.616629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001a p:0 m:0 dnr:0 00:18:26.174 [2024-04-26 15:47:24.616633] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x183800 00:18:26.174 [2024-04-26 15:47:24.616640] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.174 [2024-04-26 15:47:24.616647] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.174 [2024-04-26 15:47:24.616669] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.174 [2024-04-26 15:47:24.616673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:18:26.174 [2024-04-26 15:47:24.616678] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x183800 00:18:26.174 [2024-04-26 15:47:24.616684] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.174 [2024-04-26 15:47:24.616690] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.174 [2024-04-26 15:47:24.616705] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.174 [2024-04-26 15:47:24.616709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:18:26.174 [2024-04-26 15:47:24.616713] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x183800 00:18:26.174 [2024-04-26 15:47:24.616720] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.174 [2024-04-26 15:47:24.616726] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.174 [2024-04-26 15:47:24.616745] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.174 [2024-04-26 15:47:24.616749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:18:26.174 [2024-04-26 15:47:24.616754] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x183800 00:18:26.174 [2024-04-26 15:47:24.616760] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.174 [2024-04-26 15:47:24.616766] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.174 [2024-04-26 15:47:24.616790] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.174 [2024-04-26 15:47:24.616794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:18:26.174 [2024-04-26 15:47:24.616798] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x183800 00:18:26.174 [2024-04-26 15:47:24.616804] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.174 [2024-04-26 15:47:24.616810] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.174 [2024-04-26 15:47:24.616826] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.174 [2024-04-26 15:47:24.616831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001f p:0 m:0 dnr:0 00:18:26.174 [2024-04-26 15:47:24.616835] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x183800 00:18:26.174 [2024-04-26 15:47:24.616842] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.174 [2024-04-26 15:47:24.616847] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.174 [2024-04-26 15:47:24.616869] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.174 [2024-04-26 15:47:24.616873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0000 p:0 m:0 dnr:0 00:18:26.174 [2024-04-26 15:47:24.616878] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183800 00:18:26.174 [2024-04-26 15:47:24.616884] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.174 [2024-04-26 15:47:24.616892] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.174 [2024-04-26 15:47:24.616913] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.174 [2024-04-26 15:47:24.616917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:18:26.174 [2024-04-26 15:47:24.616921] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183800 00:18:26.174 [2024-04-26 15:47:24.616928] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.174 [2024-04-26 15:47:24.616934] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.174 [2024-04-26 15:47:24.616951] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.174 [2024-04-26 15:47:24.616955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0002 p:0 m:0 dnr:0 00:18:26.174 [2024-04-26 15:47:24.616960] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183800 00:18:26.174 [2024-04-26 15:47:24.616966] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.175 [2024-04-26 15:47:24.616972] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.175 [2024-04-26 15:47:24.616993] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.175 [2024-04-26 15:47:24.616997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0003 p:0 m:0 dnr:0 00:18:26.175 [2024-04-26 15:47:24.617001] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183800 00:18:26.175 [2024-04-26 15:47:24.617008] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.175 [2024-04-26 15:47:24.617014] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.175 [2024-04-26 15:47:24.617036] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.175 [2024-04-26 15:47:24.617040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0004 p:0 m:0 dnr:0 00:18:26.175 [2024-04-26 15:47:24.617044] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183800 00:18:26.175 [2024-04-26 15:47:24.617051] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.175 [2024-04-26 15:47:24.617057] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.175 [2024-04-26 15:47:24.617079] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.175 [2024-04-26 15:47:24.617083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0005 p:0 m:0 dnr:0 00:18:26.175 [2024-04-26 15:47:24.617087] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183800 00:18:26.175 [2024-04-26 15:47:24.617094] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.175 [2024-04-26 15:47:24.617100] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.175 [2024-04-26 15:47:24.617116] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.175 [2024-04-26 15:47:24.617120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0006 p:0 m:0 dnr:0 00:18:26.175 [2024-04-26 15:47:24.617124] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183800 00:18:26.175 [2024-04-26 15:47:24.617132] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.175 [2024-04-26 15:47:24.617138] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.175 [2024-04-26 15:47:24.617158] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.175 [2024-04-26 15:47:24.617162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:18:26.175 [2024-04-26 15:47:24.617166] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183800 00:18:26.175 [2024-04-26 15:47:24.617173] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.175 [2024-04-26 15:47:24.617179] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.175 [2024-04-26 15:47:24.617193] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.175 [2024-04-26 15:47:24.617198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0008 p:0 m:0 dnr:0 00:18:26.175 [2024-04-26 15:47:24.617202] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x183800 00:18:26.175 [2024-04-26 15:47:24.617209] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.175 [2024-04-26 15:47:24.617214] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.175 [2024-04-26 15:47:24.617237] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.175 [2024-04-26 15:47:24.617241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0009 p:0 m:0 dnr:0 00:18:26.175 [2024-04-26 15:47:24.617245] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x183800 00:18:26.175 [2024-04-26 15:47:24.617252] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.175 [2024-04-26 15:47:24.617257] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.175 [2024-04-26 15:47:24.617271] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.175 [2024-04-26 15:47:24.617275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000a p:0 m:0 dnr:0 00:18:26.175 [2024-04-26 15:47:24.617279] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x183800 00:18:26.175 [2024-04-26 15:47:24.617286] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.175 [2024-04-26 15:47:24.617292] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.175 [2024-04-26 15:47:24.617309] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.175 [2024-04-26 15:47:24.617313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000b p:0 m:0 dnr:0 00:18:26.175 [2024-04-26 15:47:24.617318] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x183800 00:18:26.175 [2024-04-26 15:47:24.617325] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.175 [2024-04-26 15:47:24.617330] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.175 [2024-04-26 15:47:24.617349] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.175 [2024-04-26 15:47:24.617353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000c p:0 m:0 dnr:0 00:18:26.175 [2024-04-26 15:47:24.617358] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x183800 00:18:26.175 [2024-04-26 15:47:24.617366] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.175 [2024-04-26 15:47:24.617372] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.175 [2024-04-26 15:47:24.617389] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.175 [2024-04-26 15:47:24.617393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000d p:0 m:0 dnr:0 00:18:26.175 [2024-04-26 15:47:24.617398] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x183800 00:18:26.175 [2024-04-26 15:47:24.617405] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.175 [2024-04-26 15:47:24.617410] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.175 [2024-04-26 15:47:24.617431] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.175 [2024-04-26 15:47:24.617435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000e p:0 m:0 dnr:0 00:18:26.175 [2024-04-26 15:47:24.617439] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x183800 00:18:26.175 [2024-04-26 15:47:24.617446] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.175 [2024-04-26 15:47:24.617452] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.175 [2024-04-26 15:47:24.617474] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.175 [2024-04-26 15:47:24.617478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000f p:0 m:0 dnr:0 00:18:26.175 [2024-04-26 15:47:24.617482] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x183800 00:18:26.175 [2024-04-26 15:47:24.617489] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.175 [2024-04-26 15:47:24.617495] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.175 [2024-04-26 15:47:24.617512] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.175 [2024-04-26 15:47:24.617516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0010 p:0 m:0 dnr:0 00:18:26.175 [2024-04-26 15:47:24.617521] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x183800 00:18:26.175 [2024-04-26 15:47:24.617527] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.175 [2024-04-26 15:47:24.617533] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.175 [2024-04-26 15:47:24.617548] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.175 [2024-04-26 15:47:24.617552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0011 p:0 m:0 dnr:0 00:18:26.176 [2024-04-26 15:47:24.617556] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x183800 00:18:26.176 [2024-04-26 15:47:24.617563] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.176 [2024-04-26 15:47:24.617569] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.176 [2024-04-26 15:47:24.617585] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.176 [2024-04-26 15:47:24.617589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0012 p:0 m:0 dnr:0 00:18:26.176 [2024-04-26 15:47:24.617595] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x183800 00:18:26.176 [2024-04-26 15:47:24.617601] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.176 [2024-04-26 15:47:24.617607] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.176 [2024-04-26 15:47:24.617623] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.176 [2024-04-26 15:47:24.617627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0013 p:0 m:0 dnr:0 00:18:26.176 [2024-04-26 15:47:24.617632] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x183800 00:18:26.176 [2024-04-26 15:47:24.617638] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.176 [2024-04-26 15:47:24.617644] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.176 [2024-04-26 15:47:24.617663] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.176 [2024-04-26 15:47:24.617667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0014 p:0 m:0 dnr:0 00:18:26.176 [2024-04-26 15:47:24.617671] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x183800 00:18:26.176 [2024-04-26 15:47:24.617678] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.176 [2024-04-26 15:47:24.617684] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.176 [2024-04-26 15:47:24.617702] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.176 [2024-04-26 15:47:24.617706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0015 p:0 m:0 dnr:0 00:18:26.176 [2024-04-26 15:47:24.617710] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x183800 00:18:26.176 [2024-04-26 15:47:24.617717] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.176 [2024-04-26 15:47:24.617723] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.176 [2024-04-26 15:47:24.617738] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.176 [2024-04-26 15:47:24.617742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0016 p:0 m:0 dnr:0 00:18:26.176 [2024-04-26 15:47:24.617746] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x183800 00:18:26.176 [2024-04-26 15:47:24.617753] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.176 [2024-04-26 15:47:24.617758] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.176 [2024-04-26 15:47:24.617775] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.176 [2024-04-26 15:47:24.617779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0017 p:0 m:0 dnr:0 00:18:26.176 [2024-04-26 15:47:24.617783] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x183800 00:18:26.176 [2024-04-26 15:47:24.617790] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.176 [2024-04-26 15:47:24.617796] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.176 [2024-04-26 15:47:24.617818] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.176 [2024-04-26 15:47:24.617822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0018 p:0 m:0 dnr:0 00:18:26.176 [2024-04-26 15:47:24.617827] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x183800 00:18:26.176 [2024-04-26 15:47:24.617834] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.176 [2024-04-26 15:47:24.617840] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.176 [2024-04-26 15:47:24.617862] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.176 [2024-04-26 15:47:24.617866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0019 p:0 m:0 dnr:0 00:18:26.176 [2024-04-26 15:47:24.617870] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x183800 00:18:26.176 [2024-04-26 15:47:24.617877] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.176 [2024-04-26 15:47:24.617883] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.176 [2024-04-26 15:47:24.617905] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.176 [2024-04-26 15:47:24.617909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001a p:0 m:0 dnr:0 00:18:26.176 [2024-04-26 15:47:24.617913] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x183800 00:18:26.176 [2024-04-26 15:47:24.617920] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.176 [2024-04-26 15:47:24.617926] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.176 [2024-04-26 15:47:24.617945] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.176 [2024-04-26 15:47:24.617949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:18:26.176 [2024-04-26 15:47:24.617953] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x183800 00:18:26.176 [2024-04-26 15:47:24.617960] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.176 [2024-04-26 15:47:24.617966] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.176 [2024-04-26 15:47:24.617985] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.176 [2024-04-26 15:47:24.617989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:18:26.176 [2024-04-26 15:47:24.617993] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x183800 00:18:26.176 [2024-04-26 15:47:24.618000] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.176 [2024-04-26 15:47:24.618006] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.176 [2024-04-26 15:47:24.618024] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.176 [2024-04-26 15:47:24.618028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:18:26.176 [2024-04-26 15:47:24.618032] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x183800 00:18:26.176 [2024-04-26 15:47:24.618039] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.176 [2024-04-26 15:47:24.618044] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.176 [2024-04-26 15:47:24.618062] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.176 [2024-04-26 15:47:24.618067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:18:26.176 [2024-04-26 15:47:24.618072] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x183800 00:18:26.176 [2024-04-26 15:47:24.618079] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.176 [2024-04-26 15:47:24.618084] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.176 [2024-04-26 15:47:24.618102] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.176 [2024-04-26 15:47:24.618106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001f p:0 m:0 dnr:0 00:18:26.176 [2024-04-26 15:47:24.618110] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183800 00:18:26.176 [2024-04-26 15:47:24.618117] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.176 [2024-04-26 15:47:24.618123] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.176 [2024-04-26 15:47:24.618144] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.176 [2024-04-26 15:47:24.618148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0000 p:0 m:0 dnr:0 00:18:26.176 [2024-04-26 15:47:24.618153] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183800 00:18:26.176 [2024-04-26 15:47:24.618159] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.176 [2024-04-26 15:47:24.618165] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.176 [2024-04-26 15:47:24.618186] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.176 [2024-04-26 15:47:24.618190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:18:26.176 [2024-04-26 15:47:24.618194] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183800 00:18:26.176 [2024-04-26 15:47:24.618201] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.176 [2024-04-26 15:47:24.618207] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.176 [2024-04-26 15:47:24.618224] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.176 [2024-04-26 15:47:24.618229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0002 p:0 m:0 dnr:0 00:18:26.176 [2024-04-26 15:47:24.618233] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183800 00:18:26.176 [2024-04-26 15:47:24.618240] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.176 [2024-04-26 15:47:24.618246] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.176 [2024-04-26 15:47:24.618266] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.176 [2024-04-26 15:47:24.618270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0003 p:0 m:0 dnr:0 00:18:26.177 [2024-04-26 15:47:24.618274] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183800 00:18:26.177 [2024-04-26 15:47:24.618281] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.177 [2024-04-26 15:47:24.618287] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.177 [2024-04-26 15:47:24.618304] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.177 [2024-04-26 15:47:24.618310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0004 p:0 m:0 dnr:0 00:18:26.177 [2024-04-26 15:47:24.618314] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183800 00:18:26.177 [2024-04-26 15:47:24.618321] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.177 [2024-04-26 15:47:24.618327] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.177 [2024-04-26 15:47:24.618344] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.177 [2024-04-26 15:47:24.618348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0005 p:0 m:0 dnr:0 00:18:26.177 [2024-04-26 15:47:24.618353] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183800 00:18:26.177 [2024-04-26 15:47:24.618359] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.177 [2024-04-26 15:47:24.618365] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.177 [2024-04-26 15:47:24.618381] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.177 [2024-04-26 15:47:24.618385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0006 p:0 m:0 dnr:0 00:18:26.177 [2024-04-26 15:47:24.618390] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183800 00:18:26.177 [2024-04-26 15:47:24.618396] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.177 [2024-04-26 15:47:24.618402] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.177 [2024-04-26 15:47:24.618420] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.177 [2024-04-26 15:47:24.618424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:18:26.177 [2024-04-26 15:47:24.618428] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x183800 00:18:26.177 [2024-04-26 15:47:24.618435] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.177 [2024-04-26 15:47:24.618441] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.177 [2024-04-26 15:47:24.618464] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.177 [2024-04-26 15:47:24.618468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0008 p:0 m:0 dnr:0 00:18:26.177 [2024-04-26 15:47:24.618473] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x183800 00:18:26.177 [2024-04-26 15:47:24.618479] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.177 [2024-04-26 15:47:24.618485] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.177 [2024-04-26 15:47:24.618500] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.177 [2024-04-26 15:47:24.618504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0009 p:0 m:0 dnr:0 00:18:26.177 [2024-04-26 15:47:24.618508] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x183800 00:18:26.177 [2024-04-26 15:47:24.618515] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.177 [2024-04-26 15:47:24.618521] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.177 [2024-04-26 15:47:24.618537] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.177 [2024-04-26 15:47:24.618541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000a p:0 m:0 dnr:0 00:18:26.177 [2024-04-26 15:47:24.618546] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x183800 00:18:26.177 [2024-04-26 15:47:24.618553] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.177 [2024-04-26 15:47:24.618558] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.177 [2024-04-26 15:47:24.618576] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.177 [2024-04-26 15:47:24.618580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000b p:0 m:0 dnr:0 00:18:26.177 [2024-04-26 15:47:24.618584] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x183800 00:18:26.177 [2024-04-26 15:47:24.618591] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.177 [2024-04-26 15:47:24.618597] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.177 [2024-04-26 15:47:24.618617] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.177 [2024-04-26 15:47:24.618621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000c p:0 m:0 dnr:0 00:18:26.177 [2024-04-26 15:47:24.618626] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x183800 00:18:26.177 [2024-04-26 15:47:24.618633] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.177 [2024-04-26 15:47:24.618638] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.177 [2024-04-26 15:47:24.618657] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.177 [2024-04-26 15:47:24.618661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000d p:0 m:0 dnr:0 00:18:26.177 [2024-04-26 15:47:24.618666] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x183800 00:18:26.177 [2024-04-26 15:47:24.618673] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.177 [2024-04-26 15:47:24.618678] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.177 [2024-04-26 15:47:24.618696] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.177 [2024-04-26 15:47:24.618700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000e p:0 m:0 dnr:0 00:18:26.177 [2024-04-26 15:47:24.618704] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x183800 00:18:26.177 [2024-04-26 15:47:24.618711] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.177 [2024-04-26 15:47:24.618717] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.177 [2024-04-26 15:47:24.618734] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.177 [2024-04-26 15:47:24.618738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000f p:0 m:0 dnr:0 00:18:26.177 [2024-04-26 15:47:24.618743] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x183800 00:18:26.177 [2024-04-26 15:47:24.618749] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.177 [2024-04-26 15:47:24.618755] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.177 [2024-04-26 15:47:24.618773] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.177 [2024-04-26 15:47:24.618777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0010 p:0 m:0 dnr:0 00:18:26.177 [2024-04-26 15:47:24.618781] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x183800 00:18:26.177 [2024-04-26 15:47:24.618788] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.177 [2024-04-26 15:47:24.618794] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.177 [2024-04-26 15:47:24.618813] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.177 [2024-04-26 15:47:24.618817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0011 p:0 m:0 dnr:0 00:18:26.177 [2024-04-26 15:47:24.618821] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x183800 00:18:26.177 [2024-04-26 15:47:24.618828] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.177 [2024-04-26 15:47:24.618834] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.177 [2024-04-26 15:47:24.618848] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.177 [2024-04-26 15:47:24.618853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0012 p:0 m:0 dnr:0 00:18:26.177 [2024-04-26 15:47:24.618857] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x183800 00:18:26.177 [2024-04-26 15:47:24.618864] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.177 [2024-04-26 15:47:24.618869] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.177 [2024-04-26 15:47:24.618892] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.177 [2024-04-26 15:47:24.618896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0013 p:0 m:0 dnr:0 00:18:26.177 [2024-04-26 15:47:24.618900] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x183800 00:18:26.177 [2024-04-26 15:47:24.618907] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.177 [2024-04-26 15:47:24.618913] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.177 [2024-04-26 15:47:24.618929] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.177 [2024-04-26 15:47:24.618933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0014 p:0 m:0 dnr:0 00:18:26.177 [2024-04-26 15:47:24.618937] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x183800 00:18:26.177 [2024-04-26 15:47:24.618944] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.177 [2024-04-26 15:47:24.618950] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.177 [2024-04-26 15:47:24.618967] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.177 [2024-04-26 15:47:24.618971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0015 p:0 m:0 dnr:0 00:18:26.177 [2024-04-26 15:47:24.618976] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.618983] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.618990] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.178 [2024-04-26 15:47:24.619007] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.178 [2024-04-26 15:47:24.619011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0016 p:0 m:0 dnr:0 00:18:26.178 [2024-04-26 15:47:24.619016] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.619022] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.619028] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.178 [2024-04-26 15:47:24.619044] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.178 [2024-04-26 15:47:24.619048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0017 p:0 m:0 dnr:0 00:18:26.178 [2024-04-26 15:47:24.619053] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.619059] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.619065] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.178 [2024-04-26 15:47:24.619084] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.178 [2024-04-26 15:47:24.619088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0018 p:0 m:0 dnr:0 00:18:26.178 [2024-04-26 15:47:24.619093] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.619099] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.619105] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.178 [2024-04-26 15:47:24.619126] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.178 [2024-04-26 15:47:24.619130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0019 p:0 m:0 dnr:0 00:18:26.178 [2024-04-26 15:47:24.619134] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.623145] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.623152] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.178 [2024-04-26 15:47:24.623171] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.178 [2024-04-26 15:47:24.623175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:9 sqhd:001a p:0 m:0 dnr:0 00:18:26.178 [2024-04-26 15:47:24.623179] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.623184] nvme_ctrlr.c:1204:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 6 milliseconds 00:18:26.178 128 00:18:26.178 Transport Service Identifier: 4420 00:18:26.178 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:18:26.178 Transport Address: 192.168.100.8 00:18:26.178 Transport Specific Address Subtype - RDMA 00:18:26.178 RDMA QP Service Type: 1 (Reliable Connected) 00:18:26.178 RDMA Provider Type: 1 (No provider specified) 00:18:26.178 RDMA CM Service: 1 (RDMA_CM) 00:18:26.178 15:47:24 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:18:26.178 [2024-04-26 15:47:24.688718] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:18:26.178 [2024-04-26 15:47:24.688759] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3373643 ] 00:18:26.178 EAL: No free 2048 kB hugepages reported on node 1 00:18:26.178 [2024-04-26 15:47:24.729234] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:18:26.178 [2024-04-26 15:47:24.729296] nvme_rdma.c:2261:nvme_rdma_ctrlr_construct: *DEBUG*: successfully initialized the nvmf ctrlr 00:18:26.178 [2024-04-26 15:47:24.729309] nvme_rdma.c:1291:nvme_rdma_ctrlr_connect_qpair: *DEBUG*: adrfam 1 ai_family 2 00:18:26.178 [2024-04-26 15:47:24.729312] nvme_rdma.c:1295:nvme_rdma_ctrlr_connect_qpair: *DEBUG*: trsvcid is 4420 00:18:26.178 [2024-04-26 15:47:24.729331] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:18:26.178 [2024-04-26 15:47:24.740162] nvme_rdma.c: 510:nvme_rdma_qpair_process_cm_event: *DEBUG*: Requested queue depth 32. Target receive queue depth 32. 00:18:26.178 [2024-04-26 15:47:24.750418] nvme_rdma.c:1180:nvme_rdma_connect_established: *DEBUG*: rc =0 00:18:26.178 [2024-04-26 15:47:24.750426] nvme_rdma.c:1185:nvme_rdma_connect_established: *DEBUG*: RDMA requests created 00:18:26.178 [2024-04-26 15:47:24.750432] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.750437] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.750441] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.750446] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.750450] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.750454] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.750458] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.750462] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.750467] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.750471] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.750475] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.750479] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.750484] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.750488] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.750492] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.750496] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.750500] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.750504] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.750512] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.750516] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.750520] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.750524] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.750528] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.750533] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.750537] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.750541] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.750545] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.750549] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.750554] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.750558] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.750562] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.750566] nvme_rdma.c:1199:nvme_rdma_connect_established: *DEBUG*: RDMA responses created 00:18:26.178 [2024-04-26 15:47:24.750570] nvme_rdma.c:1202:nvme_rdma_connect_established: *DEBUG*: rc =0 00:18:26.178 [2024-04-26 15:47:24.750572] nvme_rdma.c:1207:nvme_rdma_connect_established: *DEBUG*: RDMA responses submitted 00:18:26.178 [2024-04-26 15:47:24.750585] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.750595] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf200 len:0x400 key:0x183800 00:18:26.178 [2024-04-26 15:47:24.755145] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.178 [2024-04-26 15:47:24.755153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:18:26.178 [2024-04-26 15:47:24.755158] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.755164] nvme_fabric.c: 622:_nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:18:26.178 [2024-04-26 15:47:24.755169] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:18:26.178 [2024-04-26 15:47:24.755173] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:18:26.178 [2024-04-26 15:47:24.755184] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.755190] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.178 [2024-04-26 15:47:24.755209] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.178 [2024-04-26 15:47:24.755213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:10300 sqhd:0002 p:0 m:0 dnr:0 00:18:26.178 [2024-04-26 15:47:24.755221] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:18:26.178 [2024-04-26 15:47:24.755225] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183800 00:18:26.178 [2024-04-26 15:47:24.755230] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:18:26.179 [2024-04-26 15:47:24.755238] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183800 00:18:26.179 [2024-04-26 15:47:24.755244] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.179 [2024-04-26 15:47:24.755261] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.179 [2024-04-26 15:47:24.755265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1e01007f sqhd:0003 p:0 m:0 dnr:0 00:18:26.179 [2024-04-26 15:47:24.755269] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:18:26.179 [2024-04-26 15:47:24.755273] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183800 00:18:26.179 [2024-04-26 15:47:24.755279] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:18:26.179 [2024-04-26 15:47:24.755284] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183800 00:18:26.179 [2024-04-26 15:47:24.755289] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.179 [2024-04-26 15:47:24.755306] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.179 [2024-04-26 15:47:24.755310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0004 p:0 m:0 dnr:0 00:18:26.179 [2024-04-26 15:47:24.755314] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:18:26.179 [2024-04-26 15:47:24.755318] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183800 00:18:26.179 [2024-04-26 15:47:24.755325] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183800 00:18:26.179 [2024-04-26 15:47:24.755330] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.179 [2024-04-26 15:47:24.755345] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.179 [2024-04-26 15:47:24.755349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0005 p:0 m:0 dnr:0 00:18:26.179 [2024-04-26 15:47:24.755354] nvme_ctrlr.c:3749:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:18:26.179 [2024-04-26 15:47:24.755358] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:18:26.179 [2024-04-26 15:47:24.755362] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183800 00:18:26.179 [2024-04-26 15:47:24.755367] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:18:26.179 [2024-04-26 15:47:24.755471] nvme_ctrlr.c:3942:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:18:26.179 [2024-04-26 15:47:24.755475] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:18:26.179 [2024-04-26 15:47:24.755481] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183800 00:18:26.179 [2024-04-26 15:47:24.755487] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.179 [2024-04-26 15:47:24.755503] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.179 [2024-04-26 15:47:24.755508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0006 p:0 m:0 dnr:0 00:18:26.179 [2024-04-26 15:47:24.755512] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:18:26.179 [2024-04-26 15:47:24.755517] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183800 00:18:26.179 [2024-04-26 15:47:24.755524] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183800 00:18:26.179 [2024-04-26 15:47:24.755529] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.179 [2024-04-26 15:47:24.755545] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.179 [2024-04-26 15:47:24.755549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:18:26.179 [2024-04-26 15:47:24.755553] nvme_ctrlr.c:3784:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:18:26.179 [2024-04-26 15:47:24.755557] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:18:26.179 [2024-04-26 15:47:24.755560] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183800 00:18:26.179 [2024-04-26 15:47:24.755565] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:18:26.179 [2024-04-26 15:47:24.755571] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:18:26.179 [2024-04-26 15:47:24.755578] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183800 00:18:26.179 [2024-04-26 15:47:24.755584] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x183800 00:18:26.179 [2024-04-26 15:47:24.755622] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.179 [2024-04-26 15:47:24.755626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0008 p:0 m:0 dnr:0 00:18:26.179 [2024-04-26 15:47:24.755632] nvme_ctrlr.c:1984:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:18:26.179 [2024-04-26 15:47:24.755636] nvme_ctrlr.c:1988:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:18:26.179 [2024-04-26 15:47:24.755640] nvme_ctrlr.c:1991:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:18:26.179 [2024-04-26 15:47:24.755646] nvme_ctrlr.c:2015:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:18:26.179 [2024-04-26 15:47:24.755650] nvme_ctrlr.c:2030:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:18:26.179 [2024-04-26 15:47:24.755653] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:18:26.179 [2024-04-26 15:47:24.755657] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183800 00:18:26.179 [2024-04-26 15:47:24.755662] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:18:26.179 [2024-04-26 15:47:24.755668] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183800 00:18:26.179 [2024-04-26 15:47:24.755674] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.179 [2024-04-26 15:47:24.755694] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.179 [2024-04-26 15:47:24.755698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0009 p:0 m:0 dnr:0 00:18:26.179 [2024-04-26 15:47:24.755704] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0500 length 0x40 lkey 0x183800 00:18:26.179 [2024-04-26 15:47:24.755709] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:18:26.179 [2024-04-26 15:47:24.755716] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0640 length 0x40 lkey 0x183800 00:18:26.179 [2024-04-26 15:47:24.755721] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:18:26.179 [2024-04-26 15:47:24.755726] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.179 [2024-04-26 15:47:24.755731] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:18:26.179 [2024-04-26 15:47:24.755736] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d08c0 length 0x40 lkey 0x183800 00:18:26.179 [2024-04-26 15:47:24.755740] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:18:26.179 [2024-04-26 15:47:24.755744] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:18:26.179 [2024-04-26 15:47:24.755748] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x183800 00:18:26.179 [2024-04-26 15:47:24.755756] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:18:26.179 [2024-04-26 15:47:24.755761] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183800 00:18:26.179 [2024-04-26 15:47:24.755767] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:0 cdw10:0000000f SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.179 [2024-04-26 15:47:24.755786] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.179 [2024-04-26 15:47:24.755791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:2710 sqhd:000a p:0 m:0 dnr:0 00:18:26.179 [2024-04-26 15:47:24.755795] nvme_ctrlr.c:2902:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:18:26.179 [2024-04-26 15:47:24.755799] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:18:26.179 [2024-04-26 15:47:24.755803] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x183800 00:18:26.179 [2024-04-26 15:47:24.755808] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:18:26.179 [2024-04-26 15:47:24.755814] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:18:26.179 [2024-04-26 15:47:24.755819] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183800 00:18:26.179 [2024-04-26 15:47:24.755825] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:0 cdw10:00000007 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.180 [2024-04-26 15:47:24.755841] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.180 [2024-04-26 15:47:24.755845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:7e007e sqhd:000b p:0 m:0 dnr:0 00:18:26.180 [2024-04-26 15:47:24.755884] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:18:26.180 [2024-04-26 15:47:24.755888] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x183800 00:18:26.180 [2024-04-26 15:47:24.755894] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:18:26.180 [2024-04-26 15:47:24.755901] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183800 00:18:26.180 [2024-04-26 15:47:24.755907] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000002 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003cc000 len:0x1000 key:0x183800 00:18:26.180 [2024-04-26 15:47:24.755937] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.180 [2024-04-26 15:47:24.755941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000c p:0 m:0 dnr:0 00:18:26.180 [2024-04-26 15:47:24.755949] nvme_ctrlr.c:4557:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:18:26.180 [2024-04-26 15:47:24.755956] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:18:26.180 [2024-04-26 15:47:24.755960] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x183800 00:18:26.180 [2024-04-26 15:47:24.755967] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:18:26.180 [2024-04-26 15:47:24.755973] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183800 00:18:26.180 [2024-04-26 15:47:24.755979] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:1 cdw10:00000000 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x183800 00:18:26.180 [2024-04-26 15:47:24.756009] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.180 [2024-04-26 15:47:24.756013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000d p:0 m:0 dnr:0 00:18:26.180 [2024-04-26 15:47:24.756023] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:18:26.180 [2024-04-26 15:47:24.756027] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x183800 00:18:26.180 [2024-04-26 15:47:24.756033] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:18:26.180 [2024-04-26 15:47:24.756039] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183800 00:18:26.180 [2024-04-26 15:47:24.756045] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:1 cdw10:00000003 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x183800 00:18:26.180 [2024-04-26 15:47:24.756073] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.180 [2024-04-26 15:47:24.756077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000e p:0 m:0 dnr:0 00:18:26.180 [2024-04-26 15:47:24.756084] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:18:26.180 [2024-04-26 15:47:24.756088] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x183800 00:18:26.180 [2024-04-26 15:47:24.756093] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:18:26.180 [2024-04-26 15:47:24.756099] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:18:26.180 [2024-04-26 15:47:24.756105] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:18:26.180 [2024-04-26 15:47:24.756109] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:18:26.180 [2024-04-26 15:47:24.756113] nvme_ctrlr.c:2990:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:18:26.180 [2024-04-26 15:47:24.756117] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:18:26.180 [2024-04-26 15:47:24.756122] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:18:26.180 [2024-04-26 15:47:24.756134] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183800 00:18:26.180 [2024-04-26 15:47:24.756144] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:0 cdw10:00000001 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.180 [2024-04-26 15:47:24.756150] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x183800 00:18:26.180 [2024-04-26 15:47:24.756155] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:18:26.180 [2024-04-26 15:47:24.756165] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.180 [2024-04-26 15:47:24.756169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000f p:0 m:0 dnr:0 00:18:26.180 [2024-04-26 15:47:24.756174] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x183800 00:18:26.180 [2024-04-26 15:47:24.756180] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183800 00:18:26.180 [2024-04-26 15:47:24.756186] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:0 cdw10:00000002 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.180 [2024-04-26 15:47:24.756192] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.180 [2024-04-26 15:47:24.756196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:0010 p:0 m:0 dnr:0 00:18:26.180 [2024-04-26 15:47:24.756200] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x183800 00:18:26.180 [2024-04-26 15:47:24.756208] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.180 [2024-04-26 15:47:24.756212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0011 p:0 m:0 dnr:0 00:18:26.180 [2024-04-26 15:47:24.756216] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x183800 00:18:26.180 [2024-04-26 15:47:24.756223] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183800 00:18:26.180 [2024-04-26 15:47:24.756228] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:0 cdw10:00000004 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.180 [2024-04-26 15:47:24.756250] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.180 [2024-04-26 15:47:24.756254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0012 p:0 m:0 dnr:0 00:18:26.180 [2024-04-26 15:47:24.756259] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x183800 00:18:26.180 [2024-04-26 15:47:24.756265] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183800 00:18:26.180 [2024-04-26 15:47:24.756271] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:0 cdw10:00000007 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.180 [2024-04-26 15:47:24.756285] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.180 [2024-04-26 15:47:24.756289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:7e007e sqhd:0013 p:0 m:0 dnr:0 00:18:26.180 [2024-04-26 15:47:24.756294] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x183800 00:18:26.180 [2024-04-26 15:47:24.756302] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183800 00:18:26.180 [2024-04-26 15:47:24.756308] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:0 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003c9000 len:0x2000 key:0x183800 00:18:26.180 [2024-04-26 15:47:24.756314] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x183800 00:18:26.180 [2024-04-26 15:47:24.756321] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf000 len:0x200 key:0x183800 00:18:26.181 [2024-04-26 15:47:24.756328] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0b40 length 0x40 lkey 0x183800 00:18:26.181 [2024-04-26 15:47:24.756333] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x200 key:0x183800 00:18:26.181 [2024-04-26 15:47:24.756340] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0c80 length 0x40 lkey 0x183800 00:18:26.181 [2024-04-26 15:47:24.756345] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003c7000 len:0x1000 key:0x183800 00:18:26.181 [2024-04-26 15:47:24.756351] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.181 [2024-04-26 15:47:24.756355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0014 p:0 m:0 dnr:0 00:18:26.181 [2024-04-26 15:47:24.756366] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x183800 00:18:26.181 [2024-04-26 15:47:24.756373] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.181 [2024-04-26 15:47:24.756377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:0015 p:0 m:0 dnr:0 00:18:26.181 [2024-04-26 15:47:24.756383] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x183800 00:18:26.181 [2024-04-26 15:47:24.756388] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.181 [2024-04-26 15:47:24.756392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:6 cdw0:0 sqhd:0016 p:0 m:0 dnr:0 00:18:26.181 [2024-04-26 15:47:24.756396] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x183800 00:18:26.181 [2024-04-26 15:47:24.756401] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.181 [2024-04-26 15:47:24.756404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:7 cdw0:0 sqhd:0017 p:0 m:0 dnr:0 00:18:26.181 [2024-04-26 15:47:24.756412] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x183800 00:18:26.181 ===================================================== 00:18:26.181 NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:18:26.181 ===================================================== 00:18:26.181 Controller Capabilities/Features 00:18:26.181 ================================ 00:18:26.181 Vendor ID: 8086 00:18:26.181 Subsystem Vendor ID: 8086 00:18:26.181 Serial Number: SPDK00000000000001 00:18:26.181 Model Number: SPDK bdev Controller 00:18:26.181 Firmware Version: 24.05 00:18:26.181 Recommended Arb Burst: 6 00:18:26.181 IEEE OUI Identifier: e4 d2 5c 00:18:26.181 Multi-path I/O 00:18:26.181 May have multiple subsystem ports: Yes 00:18:26.181 May have multiple controllers: Yes 00:18:26.181 Associated with SR-IOV VF: No 00:18:26.181 Max Data Transfer Size: 131072 00:18:26.181 Max Number of Namespaces: 32 00:18:26.181 Max Number of I/O Queues: 127 00:18:26.181 NVMe Specification Version (VS): 1.3 00:18:26.181 NVMe Specification Version (Identify): 1.3 00:18:26.181 Maximum Queue Entries: 128 00:18:26.181 Contiguous Queues Required: Yes 00:18:26.181 Arbitration Mechanisms Supported 00:18:26.181 Weighted Round Robin: Not Supported 00:18:26.181 Vendor Specific: Not Supported 00:18:26.181 Reset Timeout: 15000 ms 00:18:26.181 Doorbell Stride: 4 bytes 00:18:26.181 NVM Subsystem Reset: Not Supported 00:18:26.181 Command Sets Supported 00:18:26.181 NVM Command Set: Supported 00:18:26.181 Boot Partition: Not Supported 00:18:26.181 Memory Page Size Minimum: 4096 bytes 00:18:26.181 Memory Page Size Maximum: 4096 bytes 00:18:26.181 Persistent Memory Region: Not Supported 00:18:26.181 Optional Asynchronous Events Supported 00:18:26.181 Namespace Attribute Notices: Supported 00:18:26.181 Firmware Activation Notices: Not Supported 00:18:26.181 ANA Change Notices: Not Supported 00:18:26.181 PLE Aggregate Log Change Notices: Not Supported 00:18:26.181 LBA Status Info Alert Notices: Not Supported 00:18:26.181 EGE Aggregate Log Change Notices: Not Supported 00:18:26.181 Normal NVM Subsystem Shutdown event: Not Supported 00:18:26.181 Zone Descriptor Change Notices: Not Supported 00:18:26.181 Discovery Log Change Notices: Not Supported 00:18:26.181 Controller Attributes 00:18:26.181 128-bit Host Identifier: Supported 00:18:26.181 Non-Operational Permissive Mode: Not Supported 00:18:26.181 NVM Sets: Not Supported 00:18:26.181 Read Recovery Levels: Not Supported 00:18:26.181 Endurance Groups: Not Supported 00:18:26.181 Predictable Latency Mode: Not Supported 00:18:26.181 Traffic Based Keep ALive: Not Supported 00:18:26.181 Namespace Granularity: Not Supported 00:18:26.181 SQ Associations: Not Supported 00:18:26.181 UUID List: Not Supported 00:18:26.181 Multi-Domain Subsystem: Not Supported 00:18:26.181 Fixed Capacity Management: Not Supported 00:18:26.181 Variable Capacity Management: Not Supported 00:18:26.181 Delete Endurance Group: Not Supported 00:18:26.181 Delete NVM Set: Not Supported 00:18:26.181 Extended LBA Formats Supported: Not Supported 00:18:26.181 Flexible Data Placement Supported: Not Supported 00:18:26.181 00:18:26.181 Controller Memory Buffer Support 00:18:26.181 ================================ 00:18:26.181 Supported: No 00:18:26.181 00:18:26.181 Persistent Memory Region Support 00:18:26.181 ================================ 00:18:26.181 Supported: No 00:18:26.181 00:18:26.181 Admin Command Set Attributes 00:18:26.181 ============================ 00:18:26.181 Security Send/Receive: Not Supported 00:18:26.181 Format NVM: Not Supported 00:18:26.181 Firmware Activate/Download: Not Supported 00:18:26.181 Namespace Management: Not Supported 00:18:26.181 Device Self-Test: Not Supported 00:18:26.181 Directives: Not Supported 00:18:26.181 NVMe-MI: Not Supported 00:18:26.181 Virtualization Management: Not Supported 00:18:26.181 Doorbell Buffer Config: Not Supported 00:18:26.181 Get LBA Status Capability: Not Supported 00:18:26.181 Command & Feature Lockdown Capability: Not Supported 00:18:26.181 Abort Command Limit: 4 00:18:26.181 Async Event Request Limit: 4 00:18:26.182 Number of Firmware Slots: N/A 00:18:26.182 Firmware Slot 1 Read-Only: N/A 00:18:26.182 Firmware Activation Without Reset: N/A 00:18:26.182 Multiple Update Detection Support: N/A 00:18:26.182 Firmware Update Granularity: No Information Provided 00:18:26.182 Per-Namespace SMART Log: No 00:18:26.182 Asymmetric Namespace Access Log Page: Not Supported 00:18:26.182 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:18:26.182 Command Effects Log Page: Supported 00:18:26.182 Get Log Page Extended Data: Supported 00:18:26.182 Telemetry Log Pages: Not Supported 00:18:26.182 Persistent Event Log Pages: Not Supported 00:18:26.182 Supported Log Pages Log Page: May Support 00:18:26.182 Commands Supported & Effects Log Page: Not Supported 00:18:26.182 Feature Identifiers & Effects Log Page:May Support 00:18:26.182 NVMe-MI Commands & Effects Log Page: May Support 00:18:26.182 Data Area 4 for Telemetry Log: Not Supported 00:18:26.182 Error Log Page Entries Supported: 128 00:18:26.182 Keep Alive: Supported 00:18:26.182 Keep Alive Granularity: 10000 ms 00:18:26.182 00:18:26.182 NVM Command Set Attributes 00:18:26.182 ========================== 00:18:26.182 Submission Queue Entry Size 00:18:26.182 Max: 64 00:18:26.182 Min: 64 00:18:26.182 Completion Queue Entry Size 00:18:26.182 Max: 16 00:18:26.182 Min: 16 00:18:26.182 Number of Namespaces: 32 00:18:26.182 Compare Command: Supported 00:18:26.182 Write Uncorrectable Command: Not Supported 00:18:26.182 Dataset Management Command: Supported 00:18:26.182 Write Zeroes Command: Supported 00:18:26.182 Set Features Save Field: Not Supported 00:18:26.182 Reservations: Supported 00:18:26.182 Timestamp: Not Supported 00:18:26.182 Copy: Supported 00:18:26.182 Volatile Write Cache: Present 00:18:26.182 Atomic Write Unit (Normal): 1 00:18:26.182 Atomic Write Unit (PFail): 1 00:18:26.182 Atomic Compare & Write Unit: 1 00:18:26.182 Fused Compare & Write: Supported 00:18:26.182 Scatter-Gather List 00:18:26.182 SGL Command Set: Supported 00:18:26.182 SGL Keyed: Supported 00:18:26.182 SGL Bit Bucket Descriptor: Not Supported 00:18:26.182 SGL Metadata Pointer: Not Supported 00:18:26.182 Oversized SGL: Not Supported 00:18:26.182 SGL Metadata Address: Not Supported 00:18:26.182 SGL Offset: Supported 00:18:26.182 Transport SGL Data Block: Not Supported 00:18:26.182 Replay Protected Memory Block: Not Supported 00:18:26.182 00:18:26.182 Firmware Slot Information 00:18:26.182 ========================= 00:18:26.182 Active slot: 1 00:18:26.182 Slot 1 Firmware Revision: 24.05 00:18:26.182 00:18:26.182 00:18:26.182 Commands Supported and Effects 00:18:26.182 ============================== 00:18:26.182 Admin Commands 00:18:26.182 -------------- 00:18:26.182 Get Log Page (02h): Supported 00:18:26.182 Identify (06h): Supported 00:18:26.182 Abort (08h): Supported 00:18:26.182 Set Features (09h): Supported 00:18:26.182 Get Features (0Ah): Supported 00:18:26.182 Asynchronous Event Request (0Ch): Supported 00:18:26.182 Keep Alive (18h): Supported 00:18:26.182 I/O Commands 00:18:26.182 ------------ 00:18:26.182 Flush (00h): Supported LBA-Change 00:18:26.182 Write (01h): Supported LBA-Change 00:18:26.182 Read (02h): Supported 00:18:26.182 Compare (05h): Supported 00:18:26.182 Write Zeroes (08h): Supported LBA-Change 00:18:26.182 Dataset Management (09h): Supported LBA-Change 00:18:26.182 Copy (19h): Supported LBA-Change 00:18:26.182 Unknown (79h): Supported LBA-Change 00:18:26.182 Unknown (7Ah): Supported 00:18:26.182 00:18:26.182 Error Log 00:18:26.182 ========= 00:18:26.182 00:18:26.182 Arbitration 00:18:26.182 =========== 00:18:26.182 Arbitration Burst: 1 00:18:26.182 00:18:26.182 Power Management 00:18:26.182 ================ 00:18:26.182 Number of Power States: 1 00:18:26.182 Current Power State: Power State #0 00:18:26.182 Power State #0: 00:18:26.182 Max Power: 0.00 W 00:18:26.182 Non-Operational State: Operational 00:18:26.182 Entry Latency: Not Reported 00:18:26.182 Exit Latency: Not Reported 00:18:26.182 Relative Read Throughput: 0 00:18:26.182 Relative Read Latency: 0 00:18:26.182 Relative Write Throughput: 0 00:18:26.182 Relative Write Latency: 0 00:18:26.182 Idle Power: Not Reported 00:18:26.182 Active Power: Not Reported 00:18:26.182 Non-Operational Permissive Mode: Not Supported 00:18:26.182 00:18:26.182 Health Information 00:18:26.182 ================== 00:18:26.182 Critical Warnings: 00:18:26.182 Available Spare Space: OK 00:18:26.182 Temperature: OK 00:18:26.182 Device Reliability: OK 00:18:26.182 Read Only: No 00:18:26.182 Volatile Memory Backup: OK 00:18:26.182 Current Temperature: 0 Kelvin (-273 Celsius) 00:18:26.182 Temperature Threshold: [2024-04-26 15:47:24.756489] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0c80 length 0x40 lkey 0x183800 00:18:26.182 [2024-04-26 15:47:24.756496] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.182 [2024-04-26 15:47:24.756515] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.182 [2024-04-26 15:47:24.756519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:7 cdw0:0 sqhd:0018 p:0 m:0 dnr:0 00:18:26.182 [2024-04-26 15:47:24.756523] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x183800 00:18:26.183 [2024-04-26 15:47:24.756545] nvme_ctrlr.c:4221:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:18:26.183 [2024-04-26 15:47:24.756552] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 21080 doesn't match qid 00:18:26.183 [2024-04-26 15:47:24.756563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32702 cdw0:5 sqhd:b790 p:0 m:0 dnr:0 00:18:26.183 [2024-04-26 15:47:24.756568] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 21080 doesn't match qid 00:18:26.183 [2024-04-26 15:47:24.756574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32702 cdw0:5 sqhd:b790 p:0 m:0 dnr:0 00:18:26.183 [2024-04-26 15:47:24.756578] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 21080 doesn't match qid 00:18:26.183 [2024-04-26 15:47:24.756584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32702 cdw0:5 sqhd:b790 p:0 m:0 dnr:0 00:18:26.183 [2024-04-26 15:47:24.756590] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 21080 doesn't match qid 00:18:26.183 [2024-04-26 15:47:24.756595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32702 cdw0:5 sqhd:b790 p:0 m:0 dnr:0 00:18:26.183 [2024-04-26 15:47:24.756602] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d08c0 length 0x40 lkey 0x183800 00:18:26.183 [2024-04-26 15:47:24.756608] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:4 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.183 [2024-04-26 15:47:24.756625] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.183 [2024-04-26 15:47:24.756629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:4 cdw0:460001 sqhd:0019 p:0 m:0 dnr:0 00:18:26.183 [2024-04-26 15:47:24.756636] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.183 [2024-04-26 15:47:24.756642] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.183 [2024-04-26 15:47:24.756646] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x183800 00:18:26.183 [2024-04-26 15:47:24.756661] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.183 [2024-04-26 15:47:24.756665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:0 sqhd:001a p:0 m:0 dnr:0 00:18:26.183 [2024-04-26 15:47:24.756669] nvme_ctrlr.c:1082:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:18:26.183 [2024-04-26 15:47:24.756673] nvme_ctrlr.c:1085:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:18:26.183 [2024-04-26 15:47:24.756677] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x183800 00:18:26.183 [2024-04-26 15:47:24.756683] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.183 [2024-04-26 15:47:24.756689] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.183 [2024-04-26 15:47:24.756709] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.183 [2024-04-26 15:47:24.756713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:18:26.183 [2024-04-26 15:47:24.756717] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x183800 00:18:26.183 [2024-04-26 15:47:24.756724] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.183 [2024-04-26 15:47:24.756730] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.183 [2024-04-26 15:47:24.756746] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.183 [2024-04-26 15:47:24.756751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:18:26.183 [2024-04-26 15:47:24.756756] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x183800 00:18:26.183 [2024-04-26 15:47:24.756762] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.183 [2024-04-26 15:47:24.756769] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.183 [2024-04-26 15:47:24.756787] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.183 [2024-04-26 15:47:24.756792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:18:26.183 [2024-04-26 15:47:24.756796] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x183800 00:18:26.183 [2024-04-26 15:47:24.756804] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.183 [2024-04-26 15:47:24.756810] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.183 [2024-04-26 15:47:24.756828] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.183 [2024-04-26 15:47:24.756832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:18:26.183 [2024-04-26 15:47:24.756836] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x183800 00:18:26.183 [2024-04-26 15:47:24.756843] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.183 [2024-04-26 15:47:24.756849] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.183 [2024-04-26 15:47:24.756864] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.183 [2024-04-26 15:47:24.756868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001f p:0 m:0 dnr:0 00:18:26.183 [2024-04-26 15:47:24.756872] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x183800 00:18:26.183 [2024-04-26 15:47:24.756879] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.183 [2024-04-26 15:47:24.756884] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.183 [2024-04-26 15:47:24.756903] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.183 [2024-04-26 15:47:24.756907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0000 p:0 m:0 dnr:0 00:18:26.183 [2024-04-26 15:47:24.756912] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183800 00:18:26.183 [2024-04-26 15:47:24.756919] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.183 [2024-04-26 15:47:24.756924] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.183 [2024-04-26 15:47:24.756939] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.183 [2024-04-26 15:47:24.756943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:18:26.183 [2024-04-26 15:47:24.756947] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183800 00:18:26.183 [2024-04-26 15:47:24.756954] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.183 [2024-04-26 15:47:24.756960] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.183 [2024-04-26 15:47:24.756978] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.183 [2024-04-26 15:47:24.756983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0002 p:0 m:0 dnr:0 00:18:26.183 [2024-04-26 15:47:24.756987] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183800 00:18:26.183 [2024-04-26 15:47:24.756993] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.184 [2024-04-26 15:47:24.756999] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.184 [2024-04-26 15:47:24.757018] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.184 [2024-04-26 15:47:24.757022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0003 p:0 m:0 dnr:0 00:18:26.184 [2024-04-26 15:47:24.757027] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183800 00:18:26.184 [2024-04-26 15:47:24.757035] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.184 [2024-04-26 15:47:24.757041] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.184 [2024-04-26 15:47:24.757057] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.184 [2024-04-26 15:47:24.757061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0004 p:0 m:0 dnr:0 00:18:26.184 [2024-04-26 15:47:24.757065] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183800 00:18:26.184 [2024-04-26 15:47:24.757072] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.184 [2024-04-26 15:47:24.757077] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.184 [2024-04-26 15:47:24.757095] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.184 [2024-04-26 15:47:24.757099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0005 p:0 m:0 dnr:0 00:18:26.184 [2024-04-26 15:47:24.757103] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183800 00:18:26.184 [2024-04-26 15:47:24.757110] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.184 [2024-04-26 15:47:24.757116] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.184 [2024-04-26 15:47:24.757136] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.184 [2024-04-26 15:47:24.757145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0006 p:0 m:0 dnr:0 00:18:26.184 [2024-04-26 15:47:24.757150] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183800 00:18:26.184 [2024-04-26 15:47:24.757157] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.184 [2024-04-26 15:47:24.757162] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.184 [2024-04-26 15:47:24.757181] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.184 [2024-04-26 15:47:24.757185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:18:26.184 [2024-04-26 15:47:24.757190] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183800 00:18:26.184 [2024-04-26 15:47:24.757196] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.184 [2024-04-26 15:47:24.757202] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.184 [2024-04-26 15:47:24.757219] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.184 [2024-04-26 15:47:24.757223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0008 p:0 m:0 dnr:0 00:18:26.184 [2024-04-26 15:47:24.757228] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x183800 00:18:26.184 [2024-04-26 15:47:24.757234] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.184 [2024-04-26 15:47:24.757240] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.184 [2024-04-26 15:47:24.757255] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.184 [2024-04-26 15:47:24.757259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0009 p:0 m:0 dnr:0 00:18:26.184 [2024-04-26 15:47:24.757266] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x183800 00:18:26.184 [2024-04-26 15:47:24.757273] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.184 [2024-04-26 15:47:24.757278] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.184 [2024-04-26 15:47:24.757296] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.184 [2024-04-26 15:47:24.757299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000a p:0 m:0 dnr:0 00:18:26.184 [2024-04-26 15:47:24.757304] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x183800 00:18:26.184 [2024-04-26 15:47:24.757310] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.184 [2024-04-26 15:47:24.757316] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.184 [2024-04-26 15:47:24.757331] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.184 [2024-04-26 15:47:24.757335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000b p:0 m:0 dnr:0 00:18:26.184 [2024-04-26 15:47:24.757339] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x183800 00:18:26.184 [2024-04-26 15:47:24.757345] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.184 [2024-04-26 15:47:24.757351] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.184 [2024-04-26 15:47:24.757366] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.184 [2024-04-26 15:47:24.757370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000c p:0 m:0 dnr:0 00:18:26.184 [2024-04-26 15:47:24.757374] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x183800 00:18:26.184 [2024-04-26 15:47:24.757381] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.184 [2024-04-26 15:47:24.757386] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.184 [2024-04-26 15:47:24.757407] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.184 [2024-04-26 15:47:24.757411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000d p:0 m:0 dnr:0 00:18:26.184 [2024-04-26 15:47:24.757415] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x183800 00:18:26.184 [2024-04-26 15:47:24.757422] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.184 [2024-04-26 15:47:24.757428] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.184 [2024-04-26 15:47:24.757442] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.184 [2024-04-26 15:47:24.757446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000e p:0 m:0 dnr:0 00:18:26.184 [2024-04-26 15:47:24.757450] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x183800 00:18:26.184 [2024-04-26 15:47:24.757457] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.185 [2024-04-26 15:47:24.757463] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.185 [2024-04-26 15:47:24.757483] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.185 [2024-04-26 15:47:24.757487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000f p:0 m:0 dnr:0 00:18:26.185 [2024-04-26 15:47:24.757493] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x183800 00:18:26.185 [2024-04-26 15:47:24.757499] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.185 [2024-04-26 15:47:24.757505] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.185 [2024-04-26 15:47:24.757524] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.185 [2024-04-26 15:47:24.757528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0010 p:0 m:0 dnr:0 00:18:26.185 [2024-04-26 15:47:24.757532] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x183800 00:18:26.185 [2024-04-26 15:47:24.757539] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.185 [2024-04-26 15:47:24.757545] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.185 [2024-04-26 15:47:24.757562] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.185 [2024-04-26 15:47:24.757566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0011 p:0 m:0 dnr:0 00:18:26.185 [2024-04-26 15:47:24.757570] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x183800 00:18:26.185 [2024-04-26 15:47:24.757577] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.185 [2024-04-26 15:47:24.757583] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.185 [2024-04-26 15:47:24.757597] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.185 [2024-04-26 15:47:24.757601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0012 p:0 m:0 dnr:0 00:18:26.185 [2024-04-26 15:47:24.757606] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x183800 00:18:26.185 [2024-04-26 15:47:24.757612] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.185 [2024-04-26 15:47:24.757618] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.185 [2024-04-26 15:47:24.757636] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.185 [2024-04-26 15:47:24.757640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0013 p:0 m:0 dnr:0 00:18:26.185 [2024-04-26 15:47:24.757644] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x183800 00:18:26.185 [2024-04-26 15:47:24.757650] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.185 [2024-04-26 15:47:24.757656] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.185 [2024-04-26 15:47:24.757677] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.185 [2024-04-26 15:47:24.757681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0014 p:0 m:0 dnr:0 00:18:26.185 [2024-04-26 15:47:24.757685] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x183800 00:18:26.185 [2024-04-26 15:47:24.757691] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.185 [2024-04-26 15:47:24.757697] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.185 [2024-04-26 15:47:24.757715] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.185 [2024-04-26 15:47:24.757720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0015 p:0 m:0 dnr:0 00:18:26.185 [2024-04-26 15:47:24.757724] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x183800 00:18:26.185 [2024-04-26 15:47:24.757731] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.185 [2024-04-26 15:47:24.757737] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.185 [2024-04-26 15:47:24.757751] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.185 [2024-04-26 15:47:24.757755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0016 p:0 m:0 dnr:0 00:18:26.185 [2024-04-26 15:47:24.757760] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x183800 00:18:26.185 [2024-04-26 15:47:24.757766] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.185 [2024-04-26 15:47:24.757772] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.185 [2024-04-26 15:47:24.757792] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.185 [2024-04-26 15:47:24.757796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0017 p:0 m:0 dnr:0 00:18:26.185 [2024-04-26 15:47:24.757801] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x183800 00:18:26.185 [2024-04-26 15:47:24.757807] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.185 [2024-04-26 15:47:24.757813] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.185 [2024-04-26 15:47:24.757832] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.185 [2024-04-26 15:47:24.757836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0018 p:0 m:0 dnr:0 00:18:26.185 [2024-04-26 15:47:24.757840] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x183800 00:18:26.185 [2024-04-26 15:47:24.757847] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.185 [2024-04-26 15:47:24.757852] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.185 [2024-04-26 15:47:24.757872] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.185 [2024-04-26 15:47:24.757876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0019 p:0 m:0 dnr:0 00:18:26.185 [2024-04-26 15:47:24.757880] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x183800 00:18:26.185 [2024-04-26 15:47:24.757887] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.185 [2024-04-26 15:47:24.757892] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.185 [2024-04-26 15:47:24.757914] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.185 [2024-04-26 15:47:24.757918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001a p:0 m:0 dnr:0 00:18:26.185 [2024-04-26 15:47:24.757922] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x183800 00:18:26.185 [2024-04-26 15:47:24.757929] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.186 [2024-04-26 15:47:24.757935] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.186 [2024-04-26 15:47:24.757956] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.186 [2024-04-26 15:47:24.757960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:18:26.186 [2024-04-26 15:47:24.757965] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x183800 00:18:26.186 [2024-04-26 15:47:24.757971] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.186 [2024-04-26 15:47:24.757977] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.186 [2024-04-26 15:47:24.757994] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.186 [2024-04-26 15:47:24.757998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:18:26.186 [2024-04-26 15:47:24.758003] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x183800 00:18:26.186 [2024-04-26 15:47:24.758009] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.186 [2024-04-26 15:47:24.758015] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.186 [2024-04-26 15:47:24.758032] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.186 [2024-04-26 15:47:24.758037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:18:26.186 [2024-04-26 15:47:24.758041] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x183800 00:18:26.186 [2024-04-26 15:47:24.758047] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.186 [2024-04-26 15:47:24.758053] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.186 [2024-04-26 15:47:24.758072] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.186 [2024-04-26 15:47:24.758076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:18:26.186 [2024-04-26 15:47:24.758080] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x183800 00:18:26.186 [2024-04-26 15:47:24.758087] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.186 [2024-04-26 15:47:24.758093] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.186 [2024-04-26 15:47:24.758110] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.186 [2024-04-26 15:47:24.758114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001f p:0 m:0 dnr:0 00:18:26.186 [2024-04-26 15:47:24.758119] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183800 00:18:26.186 [2024-04-26 15:47:24.758125] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.186 [2024-04-26 15:47:24.758131] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.186 [2024-04-26 15:47:24.758153] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.186 [2024-04-26 15:47:24.758157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0000 p:0 m:0 dnr:0 00:18:26.186 [2024-04-26 15:47:24.758162] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183800 00:18:26.186 [2024-04-26 15:47:24.758168] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.186 [2024-04-26 15:47:24.758174] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.186 [2024-04-26 15:47:24.758195] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.186 [2024-04-26 15:47:24.758199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:18:26.186 [2024-04-26 15:47:24.758203] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183800 00:18:26.186 [2024-04-26 15:47:24.758210] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.186 [2024-04-26 15:47:24.758215] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.186 [2024-04-26 15:47:24.758230] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.186 [2024-04-26 15:47:24.758234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0002 p:0 m:0 dnr:0 00:18:26.186 [2024-04-26 15:47:24.758238] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183800 00:18:26.186 [2024-04-26 15:47:24.758245] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.186 [2024-04-26 15:47:24.758251] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.186 [2024-04-26 15:47:24.758271] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.186 [2024-04-26 15:47:24.758275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0003 p:0 m:0 dnr:0 00:18:26.186 [2024-04-26 15:47:24.758280] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183800 00:18:26.187 [2024-04-26 15:47:24.758286] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.187 [2024-04-26 15:47:24.758292] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.187 [2024-04-26 15:47:24.758312] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.187 [2024-04-26 15:47:24.758316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0004 p:0 m:0 dnr:0 00:18:26.187 [2024-04-26 15:47:24.758321] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183800 00:18:26.187 [2024-04-26 15:47:24.758327] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.187 [2024-04-26 15:47:24.758333] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.187 [2024-04-26 15:47:24.758348] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.187 [2024-04-26 15:47:24.758352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0005 p:0 m:0 dnr:0 00:18:26.187 [2024-04-26 15:47:24.758356] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183800 00:18:26.187 [2024-04-26 15:47:24.758362] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.187 [2024-04-26 15:47:24.758368] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.187 [2024-04-26 15:47:24.758387] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.187 [2024-04-26 15:47:24.758391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0006 p:0 m:0 dnr:0 00:18:26.187 [2024-04-26 15:47:24.758395] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183800 00:18:26.187 [2024-04-26 15:47:24.758402] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.187 [2024-04-26 15:47:24.758408] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.187 [2024-04-26 15:47:24.758427] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.187 [2024-04-26 15:47:24.758431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:18:26.187 [2024-04-26 15:47:24.758435] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x183800 00:18:26.187 [2024-04-26 15:47:24.758442] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.187 [2024-04-26 15:47:24.758448] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.187 [2024-04-26 15:47:24.758468] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.187 [2024-04-26 15:47:24.758472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0008 p:0 m:0 dnr:0 00:18:26.187 [2024-04-26 15:47:24.758476] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x183800 00:18:26.187 [2024-04-26 15:47:24.758483] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.187 [2024-04-26 15:47:24.758489] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.187 [2024-04-26 15:47:24.758509] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.187 [2024-04-26 15:47:24.758513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0009 p:0 m:0 dnr:0 00:18:26.187 [2024-04-26 15:47:24.758517] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x183800 00:18:26.187 [2024-04-26 15:47:24.758524] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.187 [2024-04-26 15:47:24.758530] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.187 [2024-04-26 15:47:24.758552] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.187 [2024-04-26 15:47:24.758556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000a p:0 m:0 dnr:0 00:18:26.187 [2024-04-26 15:47:24.758560] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x183800 00:18:26.187 [2024-04-26 15:47:24.758567] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.187 [2024-04-26 15:47:24.758572] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.187 [2024-04-26 15:47:24.758590] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.187 [2024-04-26 15:47:24.758594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000b p:0 m:0 dnr:0 00:18:26.187 [2024-04-26 15:47:24.758598] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x183800 00:18:26.187 [2024-04-26 15:47:24.758605] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.187 [2024-04-26 15:47:24.758611] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.187 [2024-04-26 15:47:24.758625] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.187 [2024-04-26 15:47:24.758629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000c p:0 m:0 dnr:0 00:18:26.187 [2024-04-26 15:47:24.758633] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x183800 00:18:26.187 [2024-04-26 15:47:24.758640] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.187 [2024-04-26 15:47:24.758647] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.187 [2024-04-26 15:47:24.758665] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.187 [2024-04-26 15:47:24.758669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000d p:0 m:0 dnr:0 00:18:26.187 [2024-04-26 15:47:24.758673] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x183800 00:18:26.187 [2024-04-26 15:47:24.758679] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.187 [2024-04-26 15:47:24.758685] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.187 [2024-04-26 15:47:24.758704] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.187 [2024-04-26 15:47:24.758708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000e p:0 m:0 dnr:0 00:18:26.187 [2024-04-26 15:47:24.758713] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x183800 00:18:26.187 [2024-04-26 15:47:24.758719] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.187 [2024-04-26 15:47:24.758725] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.187 [2024-04-26 15:47:24.758744] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.187 [2024-04-26 15:47:24.758748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000f p:0 m:0 dnr:0 00:18:26.187 [2024-04-26 15:47:24.758752] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x183800 00:18:26.187 [2024-04-26 15:47:24.758759] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.187 [2024-04-26 15:47:24.758765] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.187 [2024-04-26 15:47:24.758784] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.188 [2024-04-26 15:47:24.758788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0010 p:0 m:0 dnr:0 00:18:26.188 [2024-04-26 15:47:24.758792] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x183800 00:18:26.188 [2024-04-26 15:47:24.758799] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.188 [2024-04-26 15:47:24.758804] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.188 [2024-04-26 15:47:24.758822] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.188 [2024-04-26 15:47:24.758826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0011 p:0 m:0 dnr:0 00:18:26.188 [2024-04-26 15:47:24.758830] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x183800 00:18:26.188 [2024-04-26 15:47:24.758837] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.188 [2024-04-26 15:47:24.758843] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.188 [2024-04-26 15:47:24.758863] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.188 [2024-04-26 15:47:24.758867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0012 p:0 m:0 dnr:0 00:18:26.188 [2024-04-26 15:47:24.758871] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x183800 00:18:26.188 [2024-04-26 15:47:24.758878] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.188 [2024-04-26 15:47:24.758885] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.188 [2024-04-26 15:47:24.758901] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.188 [2024-04-26 15:47:24.758905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0013 p:0 m:0 dnr:0 00:18:26.188 [2024-04-26 15:47:24.758910] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x183800 00:18:26.188 [2024-04-26 15:47:24.758916] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.188 [2024-04-26 15:47:24.758922] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.188 [2024-04-26 15:47:24.758936] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.188 [2024-04-26 15:47:24.758940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0014 p:0 m:0 dnr:0 00:18:26.188 [2024-04-26 15:47:24.758945] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x183800 00:18:26.188 [2024-04-26 15:47:24.758951] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.188 [2024-04-26 15:47:24.758957] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.188 [2024-04-26 15:47:24.758974] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.188 [2024-04-26 15:47:24.758979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0015 p:0 m:0 dnr:0 00:18:26.188 [2024-04-26 15:47:24.758983] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x183800 00:18:26.188 [2024-04-26 15:47:24.758989] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.188 [2024-04-26 15:47:24.758995] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.188 [2024-04-26 15:47:24.759010] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.188 [2024-04-26 15:47:24.759014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0016 p:0 m:0 dnr:0 00:18:26.188 [2024-04-26 15:47:24.759018] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x183800 00:18:26.188 [2024-04-26 15:47:24.759025] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.188 [2024-04-26 15:47:24.759031] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.188 [2024-04-26 15:47:24.759053] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.188 [2024-04-26 15:47:24.759057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0017 p:0 m:0 dnr:0 00:18:26.188 [2024-04-26 15:47:24.759061] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x183800 00:18:26.188 [2024-04-26 15:47:24.759068] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.188 [2024-04-26 15:47:24.759073] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.188 [2024-04-26 15:47:24.759091] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.188 [2024-04-26 15:47:24.759095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0018 p:0 m:0 dnr:0 00:18:26.188 [2024-04-26 15:47:24.759099] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x183800 00:18:26.188 [2024-04-26 15:47:24.759107] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.188 [2024-04-26 15:47:24.759113] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.188 [2024-04-26 15:47:24.759131] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.188 [2024-04-26 15:47:24.759135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0019 p:0 m:0 dnr:0 00:18:26.188 [2024-04-26 15:47:24.759139] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x183800 00:18:26.188 [2024-04-26 15:47:24.763151] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183800 00:18:26.188 [2024-04-26 15:47:24.763158] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:18:26.188 [2024-04-26 15:47:24.763182] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:18:26.188 [2024-04-26 15:47:24.763186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:9 sqhd:001a p:0 m:0 dnr:0 00:18:26.188 [2024-04-26 15:47:24.763190] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x183800 00:18:26.188 [2024-04-26 15:47:24.763195] nvme_ctrlr.c:1204:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 6 milliseconds 00:18:26.446 0 Kelvin (-273 Celsius) 00:18:26.446 Available Spare: 0% 00:18:26.446 Available Spare Threshold: 0% 00:18:26.446 Life Percentage Used: 0% 00:18:26.446 Data Units Read: 0 00:18:26.446 Data Units Written: 0 00:18:26.446 Host Read Commands: 0 00:18:26.446 Host Write Commands: 0 00:18:26.446 Controller Busy Time: 0 minutes 00:18:26.446 Power Cycles: 0 00:18:26.446 Power On Hours: 0 hours 00:18:26.446 Unsafe Shutdowns: 0 00:18:26.446 Unrecoverable Media Errors: 0 00:18:26.446 Lifetime Error Log Entries: 0 00:18:26.446 Warning Temperature Time: 0 minutes 00:18:26.446 Critical Temperature Time: 0 minutes 00:18:26.446 00:18:26.446 Number of Queues 00:18:26.446 ================ 00:18:26.446 Number of I/O Submission Queues: 127 00:18:26.446 Number of I/O Completion Queues: 127 00:18:26.446 00:18:26.446 Active Namespaces 00:18:26.446 ================= 00:18:26.446 Namespace ID:1 00:18:26.446 Error Recovery Timeout: Unlimited 00:18:26.446 Command Set Identifier: NVM (00h) 00:18:26.446 Deallocate: Supported 00:18:26.446 Deallocated/Unwritten Error: Not Supported 00:18:26.446 Deallocated Read Value: Unknown 00:18:26.446 Deallocate in Write Zeroes: Not Supported 00:18:26.446 Deallocated Guard Field: 0xFFFF 00:18:26.446 Flush: Supported 00:18:26.446 Reservation: Supported 00:18:26.446 Namespace Sharing Capabilities: Multiple Controllers 00:18:26.446 Size (in LBAs): 131072 (0GiB) 00:18:26.446 Capacity (in LBAs): 131072 (0GiB) 00:18:26.446 Utilization (in LBAs): 131072 (0GiB) 00:18:26.446 NGUID: ABCDEF0123456789ABCDEF0123456789 00:18:26.446 EUI64: ABCDEF0123456789 00:18:26.446 UUID: 90499404-225a-4b6a-9a53-3646ff22aacc 00:18:26.446 Thin Provisioning: Not Supported 00:18:26.446 Per-NS Atomic Units: Yes 00:18:26.446 Atomic Boundary Size (Normal): 0 00:18:26.446 Atomic Boundary Size (PFail): 0 00:18:26.446 Atomic Boundary Offset: 0 00:18:26.446 Maximum Single Source Range Length: 65535 00:18:26.446 Maximum Copy Length: 65535 00:18:26.446 Maximum Source Range Count: 1 00:18:26.446 NGUID/EUI64 Never Reused: No 00:18:26.446 Namespace Write Protected: No 00:18:26.446 Number of LBA Formats: 1 00:18:26.446 Current LBA Format: LBA Format #00 00:18:26.446 LBA Format #00: Data Size: 512 Metadata Size: 0 00:18:26.446 00:18:26.446 15:47:24 -- host/identify.sh@51 -- # sync 00:18:26.446 15:47:24 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:26.446 15:47:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:26.446 15:47:24 -- common/autotest_common.sh@10 -- # set +x 00:18:26.446 15:47:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:26.446 15:47:24 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:18:26.446 15:47:24 -- host/identify.sh@56 -- # nvmftestfini 00:18:26.446 15:47:24 -- nvmf/common.sh@477 -- # nvmfcleanup 00:18:26.447 15:47:24 -- nvmf/common.sh@117 -- # sync 00:18:26.447 15:47:24 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:18:26.447 15:47:24 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:18:26.447 15:47:24 -- nvmf/common.sh@120 -- # set +e 00:18:26.447 15:47:24 -- nvmf/common.sh@121 -- # for i in {1..20} 00:18:26.447 15:47:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:18:26.447 rmmod nvme_rdma 00:18:26.447 rmmod nvme_fabrics 00:18:26.447 15:47:24 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:18:26.447 15:47:24 -- nvmf/common.sh@124 -- # set -e 00:18:26.447 15:47:24 -- nvmf/common.sh@125 -- # return 0 00:18:26.447 15:47:24 -- nvmf/common.sh@478 -- # '[' -n 3373393 ']' 00:18:26.447 15:47:24 -- nvmf/common.sh@479 -- # killprocess 3373393 00:18:26.447 15:47:24 -- common/autotest_common.sh@936 -- # '[' -z 3373393 ']' 00:18:26.447 15:47:24 -- common/autotest_common.sh@940 -- # kill -0 3373393 00:18:26.447 15:47:24 -- common/autotest_common.sh@941 -- # uname 00:18:26.447 15:47:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:26.447 15:47:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3373393 00:18:26.447 15:47:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:26.447 15:47:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:26.447 15:47:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3373393' 00:18:26.447 killing process with pid 3373393 00:18:26.447 15:47:24 -- common/autotest_common.sh@955 -- # kill 3373393 00:18:26.447 [2024-04-26 15:47:24.929039] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:18:26.447 15:47:24 -- common/autotest_common.sh@960 -- # wait 3373393 00:18:26.447 [2024-04-26 15:47:25.011944] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:18:26.705 15:47:25 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:18:26.705 15:47:25 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:18:26.705 00:18:26.705 real 0m7.405s 00:18:26.705 user 0m8.120s 00:18:26.705 sys 0m4.527s 00:18:26.705 15:47:25 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:18:26.705 15:47:25 -- common/autotest_common.sh@10 -- # set +x 00:18:26.705 ************************************ 00:18:26.705 END TEST nvmf_identify 00:18:26.705 ************************************ 00:18:26.705 15:47:25 -- nvmf/nvmf.sh@96 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=rdma 00:18:26.705 15:47:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:26.705 15:47:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:26.705 15:47:25 -- common/autotest_common.sh@10 -- # set +x 00:18:26.963 ************************************ 00:18:26.963 START TEST nvmf_perf 00:18:26.963 ************************************ 00:18:26.963 15:47:25 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=rdma 00:18:26.963 * Looking for test storage... 00:18:26.963 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:18:26.963 15:47:25 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:18:26.963 15:47:25 -- nvmf/common.sh@7 -- # uname -s 00:18:26.963 15:47:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:26.963 15:47:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:26.963 15:47:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:26.963 15:47:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:26.963 15:47:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:26.963 15:47:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:26.963 15:47:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:26.963 15:47:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:26.963 15:47:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:26.963 15:47:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:26.963 15:47:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:18:26.963 15:47:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:18:26.963 15:47:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:26.963 15:47:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:26.963 15:47:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:26.963 15:47:25 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:18:26.963 15:47:25 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:18:26.963 15:47:25 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:26.963 15:47:25 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:26.963 15:47:25 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:26.963 15:47:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:26.963 15:47:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:26.963 15:47:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:26.963 15:47:25 -- paths/export.sh@5 -- # export PATH 00:18:26.963 15:47:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:26.963 15:47:25 -- nvmf/common.sh@47 -- # : 0 00:18:26.963 15:47:25 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:18:26.963 15:47:25 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:18:26.963 15:47:25 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:18:26.963 15:47:25 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:26.963 15:47:25 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:26.963 15:47:25 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:18:26.963 15:47:25 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:18:26.963 15:47:25 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:18:26.963 15:47:25 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:18:26.963 15:47:25 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:18:26.963 15:47:25 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:18:26.963 15:47:25 -- host/perf.sh@17 -- # nvmftestinit 00:18:26.963 15:47:25 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:18:26.963 15:47:25 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:26.963 15:47:25 -- nvmf/common.sh@437 -- # prepare_net_devs 00:18:26.963 15:47:25 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:18:26.963 15:47:25 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:18:26.963 15:47:25 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:26.963 15:47:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:26.963 15:47:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:26.963 15:47:25 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:18:26.963 15:47:25 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:18:26.963 15:47:25 -- nvmf/common.sh@285 -- # xtrace_disable 00:18:26.963 15:47:25 -- common/autotest_common.sh@10 -- # set +x 00:18:32.227 15:47:30 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:32.227 15:47:30 -- nvmf/common.sh@291 -- # pci_devs=() 00:18:32.227 15:47:30 -- nvmf/common.sh@291 -- # local -a pci_devs 00:18:32.227 15:47:30 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:18:32.227 15:47:30 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:18:32.228 15:47:30 -- nvmf/common.sh@293 -- # pci_drivers=() 00:18:32.228 15:47:30 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:18:32.228 15:47:30 -- nvmf/common.sh@295 -- # net_devs=() 00:18:32.228 15:47:30 -- nvmf/common.sh@295 -- # local -ga net_devs 00:18:32.228 15:47:30 -- nvmf/common.sh@296 -- # e810=() 00:18:32.228 15:47:30 -- nvmf/common.sh@296 -- # local -ga e810 00:18:32.228 15:47:30 -- nvmf/common.sh@297 -- # x722=() 00:18:32.228 15:47:30 -- nvmf/common.sh@297 -- # local -ga x722 00:18:32.228 15:47:30 -- nvmf/common.sh@298 -- # mlx=() 00:18:32.228 15:47:30 -- nvmf/common.sh@298 -- # local -ga mlx 00:18:32.228 15:47:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:32.228 15:47:30 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:32.228 15:47:30 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:32.228 15:47:30 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:32.228 15:47:30 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:32.228 15:47:30 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:32.228 15:47:30 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:32.228 15:47:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:32.228 15:47:30 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:32.228 15:47:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:32.228 15:47:30 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:32.228 15:47:30 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:18:32.228 15:47:30 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:18:32.228 15:47:30 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:18:32.228 15:47:30 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:18:32.228 15:47:30 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:18:32.228 15:47:30 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:18:32.228 15:47:30 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:18:32.228 15:47:30 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:32.228 15:47:30 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:18:32.228 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:18:32.228 15:47:30 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:18:32.228 15:47:30 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:18:32.228 15:47:30 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:18:32.228 15:47:30 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:18:32.228 15:47:30 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:32.228 15:47:30 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:32.228 15:47:30 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:32.228 15:47:30 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:18:32.228 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:18:32.228 15:47:30 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:18:32.228 15:47:30 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:18:32.228 15:47:30 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:18:32.228 15:47:30 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:18:32.228 15:47:30 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:32.228 15:47:30 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:32.228 15:47:30 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:18:32.228 15:47:30 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:18:32.228 15:47:30 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:32.228 15:47:30 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:32.228 15:47:30 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:32.228 15:47:30 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:32.228 15:47:30 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:18:32.228 Found net devices under 0000:da:00.0: mlx_0_0 00:18:32.228 15:47:30 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:32.228 15:47:30 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:32.228 15:47:30 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:32.228 15:47:30 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:32.228 15:47:30 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:32.228 15:47:30 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:18:32.228 Found net devices under 0000:da:00.1: mlx_0_1 00:18:32.228 15:47:30 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:32.228 15:47:30 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:18:32.228 15:47:30 -- nvmf/common.sh@403 -- # is_hw=yes 00:18:32.228 15:47:30 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:18:32.228 15:47:30 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:18:32.228 15:47:30 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:18:32.228 15:47:30 -- nvmf/common.sh@409 -- # rdma_device_init 00:18:32.228 15:47:30 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:18:32.228 15:47:30 -- nvmf/common.sh@58 -- # uname 00:18:32.228 15:47:30 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:18:32.228 15:47:30 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:18:32.228 15:47:30 -- nvmf/common.sh@63 -- # modprobe ib_core 00:18:32.228 15:47:30 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:18:32.228 15:47:30 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:18:32.228 15:47:30 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:18:32.228 15:47:30 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:18:32.228 15:47:30 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:18:32.228 15:47:30 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:18:32.228 15:47:30 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:18:32.228 15:47:30 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:18:32.228 15:47:30 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:32.228 15:47:30 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:32.228 15:47:30 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:32.228 15:47:30 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:32.228 15:47:30 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:32.228 15:47:30 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:32.228 15:47:30 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:32.228 15:47:30 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:18:32.228 15:47:30 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:18:32.228 15:47:30 -- nvmf/common.sh@105 -- # continue 2 00:18:32.228 15:47:30 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:32.228 15:47:30 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:32.228 15:47:30 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:18:32.228 15:47:30 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:32.228 15:47:30 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:18:32.228 15:47:30 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:18:32.228 15:47:30 -- nvmf/common.sh@105 -- # continue 2 00:18:32.228 15:47:30 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:32.228 15:47:30 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:18:32.228 15:47:30 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:32.228 15:47:30 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:32.228 15:47:30 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:32.228 15:47:30 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:32.228 15:47:30 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:18:32.228 15:47:30 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:18:32.228 15:47:30 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:18:32.228 122: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:18:32.228 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:18:32.228 altname enp218s0f0np0 00:18:32.228 altname ens818f0np0 00:18:32.228 inet 192.168.100.8/24 scope global mlx_0_0 00:18:32.228 valid_lft forever preferred_lft forever 00:18:32.228 15:47:30 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:32.228 15:47:30 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:18:32.228 15:47:30 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:32.228 15:47:30 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:32.228 15:47:30 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:32.228 15:47:30 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:32.228 15:47:30 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:18:32.228 15:47:30 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:18:32.228 15:47:30 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:18:32.228 123: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:18:32.228 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:18:32.228 altname enp218s0f1np1 00:18:32.228 altname ens818f1np1 00:18:32.228 inet 192.168.100.9/24 scope global mlx_0_1 00:18:32.228 valid_lft forever preferred_lft forever 00:18:32.228 15:47:30 -- nvmf/common.sh@411 -- # return 0 00:18:32.228 15:47:30 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:18:32.228 15:47:30 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:18:32.228 15:47:30 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:18:32.228 15:47:30 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:18:32.228 15:47:30 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:18:32.228 15:47:30 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:32.228 15:47:30 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:32.228 15:47:30 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:32.228 15:47:30 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:32.487 15:47:30 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:32.487 15:47:30 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:32.487 15:47:30 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:32.487 15:47:30 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:18:32.487 15:47:30 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:18:32.487 15:47:30 -- nvmf/common.sh@105 -- # continue 2 00:18:32.487 15:47:30 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:32.487 15:47:30 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:32.487 15:47:30 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:18:32.487 15:47:30 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:32.487 15:47:30 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:18:32.487 15:47:30 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:18:32.487 15:47:30 -- nvmf/common.sh@105 -- # continue 2 00:18:32.487 15:47:30 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:32.487 15:47:30 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:18:32.487 15:47:30 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:32.487 15:47:30 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:32.487 15:47:30 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:32.487 15:47:30 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:32.487 15:47:30 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:32.487 15:47:30 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:18:32.487 15:47:30 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:32.487 15:47:30 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:32.487 15:47:30 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:32.487 15:47:30 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:32.487 15:47:30 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:18:32.487 192.168.100.9' 00:18:32.487 15:47:30 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:18:32.487 192.168.100.9' 00:18:32.487 15:47:30 -- nvmf/common.sh@446 -- # head -n 1 00:18:32.487 15:47:30 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:18:32.487 15:47:30 -- nvmf/common.sh@447 -- # tail -n +2 00:18:32.487 15:47:30 -- nvmf/common.sh@447 -- # head -n 1 00:18:32.487 15:47:30 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:18:32.487 192.168.100.9' 00:18:32.487 15:47:30 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:18:32.487 15:47:30 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:18:32.487 15:47:30 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:18:32.487 15:47:30 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:18:32.487 15:47:30 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:18:32.487 15:47:30 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:18:32.487 15:47:30 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:18:32.487 15:47:30 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:18:32.487 15:47:30 -- common/autotest_common.sh@710 -- # xtrace_disable 00:18:32.487 15:47:30 -- common/autotest_common.sh@10 -- # set +x 00:18:32.487 15:47:30 -- nvmf/common.sh@470 -- # nvmfpid=3376711 00:18:32.487 15:47:30 -- nvmf/common.sh@471 -- # waitforlisten 3376711 00:18:32.487 15:47:30 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:18:32.487 15:47:30 -- common/autotest_common.sh@817 -- # '[' -z 3376711 ']' 00:18:32.487 15:47:30 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:32.487 15:47:30 -- common/autotest_common.sh@822 -- # local max_retries=100 00:18:32.487 15:47:30 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:32.487 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:32.487 15:47:30 -- common/autotest_common.sh@826 -- # xtrace_disable 00:18:32.487 15:47:30 -- common/autotest_common.sh@10 -- # set +x 00:18:32.487 [2024-04-26 15:47:30.945010] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:18:32.488 [2024-04-26 15:47:30.945052] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:32.488 EAL: No free 2048 kB hugepages reported on node 1 00:18:32.488 [2024-04-26 15:47:30.999616] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:32.488 [2024-04-26 15:47:31.081807] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:32.488 [2024-04-26 15:47:31.081841] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:32.488 [2024-04-26 15:47:31.081848] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:18:32.488 [2024-04-26 15:47:31.081854] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:18:32.488 [2024-04-26 15:47:31.081859] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:32.488 [2024-04-26 15:47:31.081902] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:32.488 [2024-04-26 15:47:31.081920] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:32.488 [2024-04-26 15:47:31.081937] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:32.488 [2024-04-26 15:47:31.081939] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:33.418 15:47:31 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:18:33.418 15:47:31 -- common/autotest_common.sh@850 -- # return 0 00:18:33.418 15:47:31 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:18:33.418 15:47:31 -- common/autotest_common.sh@716 -- # xtrace_disable 00:18:33.418 15:47:31 -- common/autotest_common.sh@10 -- # set +x 00:18:33.418 15:47:31 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:33.418 15:47:31 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/gen_nvme.sh 00:18:33.418 15:47:31 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:18:36.744 15:47:34 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:18:36.745 15:47:34 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:18:36.745 15:47:34 -- host/perf.sh@30 -- # local_nvme_trid=0000:5f:00.0 00:18:36.745 15:47:34 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:18:36.745 15:47:35 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:18:36.745 15:47:35 -- host/perf.sh@33 -- # '[' -n 0000:5f:00.0 ']' 00:18:36.745 15:47:35 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:18:36.745 15:47:35 -- host/perf.sh@37 -- # '[' rdma == rdma ']' 00:18:36.745 15:47:35 -- host/perf.sh@40 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -c 0 00:18:36.745 [2024-04-26 15:47:35.309535] rdma.c:2712:nvmf_rdma_create: *WARNING*: In capsule data size is set to 256, this is minimum size required to support msdbd=16 00:18:36.745 [2024-04-26 15:47:35.330175] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x218c570/0x22da280) succeed. 00:18:36.745 [2024-04-26 15:47:35.340538] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x218dbb0/0x219a080) succeed. 00:18:37.001 15:47:35 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:37.258 15:47:35 -- host/perf.sh@45 -- # for bdev in $bdevs 00:18:37.258 15:47:35 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:37.258 15:47:35 -- host/perf.sh@45 -- # for bdev in $bdevs 00:18:37.258 15:47:35 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:18:37.514 15:47:36 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:18:37.770 [2024-04-26 15:47:36.176182] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:18:37.770 15:47:36 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:18:38.026 15:47:36 -- host/perf.sh@52 -- # '[' -n 0000:5f:00.0 ']' 00:18:38.026 15:47:36 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:5f:00.0' 00:18:38.026 15:47:36 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:18:38.026 15:47:36 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:5f:00.0' 00:18:39.393 Initializing NVMe Controllers 00:18:39.393 Attached to NVMe Controller at 0000:5f:00.0 [8086:0a54] 00:18:39.393 Associating PCIE (0000:5f:00.0) NSID 1 with lcore 0 00:18:39.393 Initialization complete. Launching workers. 00:18:39.393 ======================================================== 00:18:39.393 Latency(us) 00:18:39.393 Device Information : IOPS MiB/s Average min max 00:18:39.393 PCIE (0000:5f:00.0) NSID 1 from core 0: 100036.16 390.77 319.38 25.60 4297.92 00:18:39.393 ======================================================== 00:18:39.393 Total : 100036.16 390.77 319.38 25.60 4297.92 00:18:39.393 00:18:39.393 15:47:37 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:18:39.393 EAL: No free 2048 kB hugepages reported on node 1 00:18:42.679 Initializing NVMe Controllers 00:18:42.679 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:18:42.679 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:18:42.679 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:18:42.679 Initialization complete. Launching workers. 00:18:42.679 ======================================================== 00:18:42.679 Latency(us) 00:18:42.679 Device Information : IOPS MiB/s Average min max 00:18:42.679 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 6768.99 26.44 146.94 46.01 4165.81 00:18:42.679 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 5287.99 20.66 188.91 65.01 4149.39 00:18:42.679 ======================================================== 00:18:42.679 Total : 12056.99 47.10 165.34 46.01 4165.81 00:18:42.679 00:18:42.679 15:47:40 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:18:42.679 EAL: No free 2048 kB hugepages reported on node 1 00:18:45.971 Initializing NVMe Controllers 00:18:45.971 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:18:45.971 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:18:45.971 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:18:45.971 Initialization complete. Launching workers. 00:18:45.971 ======================================================== 00:18:45.971 Latency(us) 00:18:45.971 Device Information : IOPS MiB/s Average min max 00:18:45.971 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 18540.57 72.42 1726.00 491.42 8930.32 00:18:45.971 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3999.91 15.62 8042.84 7729.06 12182.03 00:18:45.971 ======================================================== 00:18:45.971 Total : 22540.48 88.05 2846.95 491.42 12182.03 00:18:45.971 00:18:45.971 15:47:44 -- host/perf.sh@59 -- # [[ mlx5 == \e\8\1\0 ]] 00:18:45.971 15:47:44 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:18:45.971 EAL: No free 2048 kB hugepages reported on node 1 00:18:50.150 Initializing NVMe Controllers 00:18:50.150 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:18:50.150 Controller IO queue size 128, less than required. 00:18:50.150 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:18:50.150 Controller IO queue size 128, less than required. 00:18:50.150 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:18:50.150 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:18:50.150 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:18:50.150 Initialization complete. Launching workers. 00:18:50.150 ======================================================== 00:18:50.150 Latency(us) 00:18:50.150 Device Information : IOPS MiB/s Average min max 00:18:50.150 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 3501.45 875.36 36776.57 15179.08 88579.53 00:18:50.150 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3651.93 912.98 34719.92 15472.49 57573.11 00:18:50.150 ======================================================== 00:18:50.150 Total : 7153.38 1788.34 35726.61 15179.08 88579.53 00:18:50.150 00:18:50.150 15:47:48 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -c 0xf -P 4 00:18:50.150 EAL: No free 2048 kB hugepages reported on node 1 00:18:50.407 No valid NVMe controllers or AIO or URING devices found 00:18:50.664 Initializing NVMe Controllers 00:18:50.664 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:18:50.664 Controller IO queue size 128, less than required. 00:18:50.664 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:18:50.664 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:18:50.664 Controller IO queue size 128, less than required. 00:18:50.664 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:18:50.664 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:18:50.664 WARNING: Some requested NVMe devices were skipped 00:18:50.664 15:47:49 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' --transport-stat 00:18:50.664 EAL: No free 2048 kB hugepages reported on node 1 00:18:54.846 Initializing NVMe Controllers 00:18:54.846 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:18:54.846 Controller IO queue size 128, less than required. 00:18:54.846 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:18:54.846 Controller IO queue size 128, less than required. 00:18:54.846 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:18:54.846 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:18:54.846 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:18:54.846 Initialization complete. Launching workers. 00:18:54.846 00:18:54.846 ==================== 00:18:54.846 lcore 0, ns RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:18:54.846 RDMA transport: 00:18:54.846 dev name: mlx5_0 00:18:54.846 polls: 400086 00:18:54.846 idle_polls: 396691 00:18:54.846 completions: 44066 00:18:54.846 queued_requests: 1 00:18:54.846 total_send_wrs: 22033 00:18:54.846 send_doorbell_updates: 3124 00:18:54.846 total_recv_wrs: 22160 00:18:54.846 recv_doorbell_updates: 3127 00:18:54.846 --------------------------------- 00:18:54.846 00:18:54.846 ==================== 00:18:54.846 lcore 0, ns RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:18:54.846 RDMA transport: 00:18:54.846 dev name: mlx5_0 00:18:54.846 polls: 403523 00:18:54.846 idle_polls: 403246 00:18:54.846 completions: 20366 00:18:54.846 queued_requests: 1 00:18:54.846 total_send_wrs: 10183 00:18:54.846 send_doorbell_updates: 254 00:18:54.846 total_recv_wrs: 10310 00:18:54.846 recv_doorbell_updates: 255 00:18:54.846 --------------------------------- 00:18:54.846 ======================================================== 00:18:54.846 Latency(us) 00:18:54.846 Device Information : IOPS MiB/s Average min max 00:18:54.846 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 5508.00 1377.00 23322.42 9672.65 62698.86 00:18:54.846 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 2545.50 636.37 50147.78 30058.89 71974.94 00:18:54.846 ======================================================== 00:18:54.846 Total : 8053.50 2013.37 31801.21 9672.65 71974.94 00:18:54.846 00:18:54.846 15:47:53 -- host/perf.sh@66 -- # sync 00:18:54.846 15:47:53 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:55.103 15:47:53 -- host/perf.sh@69 -- # '[' 0 -eq 1 ']' 00:18:55.103 15:47:53 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:18:55.103 15:47:53 -- host/perf.sh@114 -- # nvmftestfini 00:18:55.103 15:47:53 -- nvmf/common.sh@477 -- # nvmfcleanup 00:18:55.103 15:47:53 -- nvmf/common.sh@117 -- # sync 00:18:55.103 15:47:53 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:18:55.103 15:47:53 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:18:55.103 15:47:53 -- nvmf/common.sh@120 -- # set +e 00:18:55.103 15:47:53 -- nvmf/common.sh@121 -- # for i in {1..20} 00:18:55.103 15:47:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:18:55.103 rmmod nvme_rdma 00:18:55.103 rmmod nvme_fabrics 00:18:55.103 15:47:53 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:18:55.103 15:47:53 -- nvmf/common.sh@124 -- # set -e 00:18:55.103 15:47:53 -- nvmf/common.sh@125 -- # return 0 00:18:55.103 15:47:53 -- nvmf/common.sh@478 -- # '[' -n 3376711 ']' 00:18:55.103 15:47:53 -- nvmf/common.sh@479 -- # killprocess 3376711 00:18:55.103 15:47:53 -- common/autotest_common.sh@936 -- # '[' -z 3376711 ']' 00:18:55.103 15:47:53 -- common/autotest_common.sh@940 -- # kill -0 3376711 00:18:55.103 15:47:53 -- common/autotest_common.sh@941 -- # uname 00:18:55.103 15:47:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:55.103 15:47:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3376711 00:18:55.103 15:47:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:55.103 15:47:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:55.103 15:47:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3376711' 00:18:55.103 killing process with pid 3376711 00:18:55.103 15:47:53 -- common/autotest_common.sh@955 -- # kill 3376711 00:18:55.103 15:47:53 -- common/autotest_common.sh@960 -- # wait 3376711 00:18:55.361 [2024-04-26 15:47:53.730171] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:18:57.262 15:47:55 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:18:57.262 15:47:55 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:18:57.262 00:18:57.262 real 0m30.361s 00:18:57.262 user 1m40.592s 00:18:57.262 sys 0m5.057s 00:18:57.263 15:47:55 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:18:57.263 15:47:55 -- common/autotest_common.sh@10 -- # set +x 00:18:57.263 ************************************ 00:18:57.263 END TEST nvmf_perf 00:18:57.263 ************************************ 00:18:57.263 15:47:55 -- nvmf/nvmf.sh@97 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=rdma 00:18:57.263 15:47:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:57.263 15:47:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:57.263 15:47:55 -- common/autotest_common.sh@10 -- # set +x 00:18:57.521 ************************************ 00:18:57.521 START TEST nvmf_fio_host 00:18:57.521 ************************************ 00:18:57.521 15:47:55 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=rdma 00:18:57.521 * Looking for test storage... 00:18:57.521 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:18:57.521 15:47:56 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:18:57.521 15:47:56 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:57.521 15:47:56 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:57.521 15:47:56 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:57.521 15:47:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:57.521 15:47:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:57.521 15:47:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:57.521 15:47:56 -- paths/export.sh@5 -- # export PATH 00:18:57.521 15:47:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:57.521 15:47:56 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:18:57.521 15:47:56 -- nvmf/common.sh@7 -- # uname -s 00:18:57.521 15:47:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:57.521 15:47:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:57.521 15:47:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:57.521 15:47:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:57.521 15:47:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:57.521 15:47:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:57.521 15:47:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:57.521 15:47:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:57.521 15:47:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:57.521 15:47:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:57.521 15:47:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:18:57.521 15:47:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:18:57.521 15:47:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:57.521 15:47:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:57.521 15:47:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:57.521 15:47:56 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:18:57.521 15:47:56 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:18:57.521 15:47:56 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:57.521 15:47:56 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:57.521 15:47:56 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:57.521 15:47:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:57.521 15:47:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:57.521 15:47:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:57.521 15:47:56 -- paths/export.sh@5 -- # export PATH 00:18:57.521 15:47:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:57.521 15:47:56 -- nvmf/common.sh@47 -- # : 0 00:18:57.521 15:47:56 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:18:57.521 15:47:56 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:18:57.521 15:47:56 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:18:57.521 15:47:56 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:57.521 15:47:56 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:57.521 15:47:56 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:18:57.521 15:47:56 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:18:57.521 15:47:56 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:18:57.521 15:47:56 -- host/fio.sh@12 -- # nvmftestinit 00:18:57.521 15:47:56 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:18:57.521 15:47:56 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:57.521 15:47:56 -- nvmf/common.sh@437 -- # prepare_net_devs 00:18:57.521 15:47:56 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:18:57.521 15:47:56 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:18:57.521 15:47:56 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:57.521 15:47:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:57.521 15:47:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:57.521 15:47:56 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:18:57.521 15:47:56 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:18:57.521 15:47:56 -- nvmf/common.sh@285 -- # xtrace_disable 00:18:57.521 15:47:56 -- common/autotest_common.sh@10 -- # set +x 00:19:02.805 15:48:00 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:02.805 15:48:00 -- nvmf/common.sh@291 -- # pci_devs=() 00:19:02.805 15:48:00 -- nvmf/common.sh@291 -- # local -a pci_devs 00:19:02.805 15:48:00 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:19:02.806 15:48:00 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:19:02.806 15:48:00 -- nvmf/common.sh@293 -- # pci_drivers=() 00:19:02.806 15:48:00 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:19:02.806 15:48:00 -- nvmf/common.sh@295 -- # net_devs=() 00:19:02.806 15:48:00 -- nvmf/common.sh@295 -- # local -ga net_devs 00:19:02.806 15:48:00 -- nvmf/common.sh@296 -- # e810=() 00:19:02.806 15:48:00 -- nvmf/common.sh@296 -- # local -ga e810 00:19:02.806 15:48:00 -- nvmf/common.sh@297 -- # x722=() 00:19:02.806 15:48:00 -- nvmf/common.sh@297 -- # local -ga x722 00:19:02.806 15:48:00 -- nvmf/common.sh@298 -- # mlx=() 00:19:02.806 15:48:00 -- nvmf/common.sh@298 -- # local -ga mlx 00:19:02.806 15:48:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:02.806 15:48:00 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:02.806 15:48:00 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:02.806 15:48:00 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:02.806 15:48:00 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:02.806 15:48:00 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:02.806 15:48:00 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:02.806 15:48:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:02.806 15:48:00 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:02.806 15:48:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:02.806 15:48:00 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:02.806 15:48:00 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:19:02.806 15:48:00 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:19:02.806 15:48:00 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:19:02.806 15:48:00 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:19:02.806 15:48:00 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:19:02.806 15:48:00 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:19:02.806 15:48:00 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:19:02.806 15:48:00 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:02.806 15:48:00 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:19:02.806 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:19:02.806 15:48:00 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:02.806 15:48:00 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:02.806 15:48:00 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:02.806 15:48:00 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:02.806 15:48:00 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:02.806 15:48:00 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:02.806 15:48:00 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:02.806 15:48:00 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:19:02.806 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:19:02.806 15:48:00 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:02.806 15:48:00 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:02.806 15:48:00 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:02.806 15:48:00 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:02.806 15:48:00 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:02.806 15:48:00 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:02.806 15:48:00 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:19:02.806 15:48:00 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:19:02.806 15:48:00 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:02.806 15:48:00 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:02.806 15:48:00 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:02.806 15:48:00 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:02.806 15:48:00 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:19:02.806 Found net devices under 0000:da:00.0: mlx_0_0 00:19:02.806 15:48:00 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:02.806 15:48:00 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:02.806 15:48:00 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:02.806 15:48:00 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:02.806 15:48:00 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:02.806 15:48:00 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:19:02.806 Found net devices under 0000:da:00.1: mlx_0_1 00:19:02.806 15:48:00 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:02.806 15:48:00 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:19:02.806 15:48:00 -- nvmf/common.sh@403 -- # is_hw=yes 00:19:02.806 15:48:00 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:19:02.806 15:48:00 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:19:02.806 15:48:00 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:19:02.806 15:48:00 -- nvmf/common.sh@409 -- # rdma_device_init 00:19:02.806 15:48:00 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:19:02.806 15:48:00 -- nvmf/common.sh@58 -- # uname 00:19:02.806 15:48:00 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:19:02.806 15:48:00 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:19:02.806 15:48:00 -- nvmf/common.sh@63 -- # modprobe ib_core 00:19:02.806 15:48:00 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:19:02.806 15:48:00 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:19:02.806 15:48:00 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:19:02.806 15:48:00 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:19:02.806 15:48:00 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:19:02.806 15:48:00 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:19:02.806 15:48:00 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:19:02.806 15:48:00 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:19:02.806 15:48:00 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:02.806 15:48:00 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:02.806 15:48:00 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:02.806 15:48:00 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:02.806 15:48:00 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:02.806 15:48:00 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:02.806 15:48:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:02.806 15:48:00 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:02.806 15:48:00 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:02.806 15:48:00 -- nvmf/common.sh@105 -- # continue 2 00:19:02.806 15:48:00 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:02.806 15:48:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:02.806 15:48:00 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:02.806 15:48:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:02.806 15:48:00 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:02.806 15:48:00 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:02.806 15:48:00 -- nvmf/common.sh@105 -- # continue 2 00:19:02.806 15:48:00 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:02.806 15:48:00 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:19:02.806 15:48:00 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:02.806 15:48:00 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:02.806 15:48:00 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:02.806 15:48:00 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:02.806 15:48:00 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:19:02.806 15:48:00 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:19:02.806 15:48:00 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:19:02.806 122: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:02.806 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:19:02.806 altname enp218s0f0np0 00:19:02.806 altname ens818f0np0 00:19:02.806 inet 192.168.100.8/24 scope global mlx_0_0 00:19:02.806 valid_lft forever preferred_lft forever 00:19:02.806 15:48:00 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:02.806 15:48:00 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:19:02.806 15:48:00 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:02.806 15:48:00 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:02.806 15:48:00 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:02.806 15:48:00 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:02.806 15:48:01 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:19:02.806 15:48:01 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:19:02.806 15:48:01 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:19:02.806 123: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:02.806 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:19:02.806 altname enp218s0f1np1 00:19:02.806 altname ens818f1np1 00:19:02.806 inet 192.168.100.9/24 scope global mlx_0_1 00:19:02.806 valid_lft forever preferred_lft forever 00:19:02.806 15:48:01 -- nvmf/common.sh@411 -- # return 0 00:19:02.806 15:48:01 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:19:02.806 15:48:01 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:19:02.806 15:48:01 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:19:02.806 15:48:01 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:19:02.806 15:48:01 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:19:02.806 15:48:01 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:02.806 15:48:01 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:02.806 15:48:01 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:02.806 15:48:01 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:02.806 15:48:01 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:02.806 15:48:01 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:02.806 15:48:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:02.806 15:48:01 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:02.806 15:48:01 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:02.806 15:48:01 -- nvmf/common.sh@105 -- # continue 2 00:19:02.806 15:48:01 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:02.806 15:48:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:02.806 15:48:01 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:02.806 15:48:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:02.806 15:48:01 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:02.806 15:48:01 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:02.806 15:48:01 -- nvmf/common.sh@105 -- # continue 2 00:19:02.806 15:48:01 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:02.806 15:48:01 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:19:02.806 15:48:01 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:02.806 15:48:01 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:02.806 15:48:01 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:02.806 15:48:01 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:02.807 15:48:01 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:02.807 15:48:01 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:19:02.807 15:48:01 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:02.807 15:48:01 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:02.807 15:48:01 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:02.807 15:48:01 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:02.807 15:48:01 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:19:02.807 192.168.100.9' 00:19:02.807 15:48:01 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:19:02.807 192.168.100.9' 00:19:02.807 15:48:01 -- nvmf/common.sh@446 -- # head -n 1 00:19:02.807 15:48:01 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:19:02.807 15:48:01 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:19:02.807 192.168.100.9' 00:19:02.807 15:48:01 -- nvmf/common.sh@447 -- # tail -n +2 00:19:02.807 15:48:01 -- nvmf/common.sh@447 -- # head -n 1 00:19:02.807 15:48:01 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:19:02.807 15:48:01 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:19:02.807 15:48:01 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:19:02.807 15:48:01 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:19:02.807 15:48:01 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:19:02.807 15:48:01 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:19:02.807 15:48:01 -- host/fio.sh@14 -- # [[ y != y ]] 00:19:02.807 15:48:01 -- host/fio.sh@19 -- # timing_enter start_nvmf_tgt 00:19:02.807 15:48:01 -- common/autotest_common.sh@710 -- # xtrace_disable 00:19:02.807 15:48:01 -- common/autotest_common.sh@10 -- # set +x 00:19:02.807 15:48:01 -- host/fio.sh@22 -- # nvmfpid=3384031 00:19:02.807 15:48:01 -- host/fio.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:02.807 15:48:01 -- host/fio.sh@24 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:19:02.807 15:48:01 -- host/fio.sh@26 -- # waitforlisten 3384031 00:19:02.807 15:48:01 -- common/autotest_common.sh@817 -- # '[' -z 3384031 ']' 00:19:02.807 15:48:01 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:02.807 15:48:01 -- common/autotest_common.sh@822 -- # local max_retries=100 00:19:02.807 15:48:01 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:02.807 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:02.807 15:48:01 -- common/autotest_common.sh@826 -- # xtrace_disable 00:19:02.807 15:48:01 -- common/autotest_common.sh@10 -- # set +x 00:19:02.807 [2024-04-26 15:48:01.149300] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:19:02.807 [2024-04-26 15:48:01.149341] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:02.807 EAL: No free 2048 kB hugepages reported on node 1 00:19:02.807 [2024-04-26 15:48:01.202153] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:02.807 [2024-04-26 15:48:01.280303] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:02.807 [2024-04-26 15:48:01.280343] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:02.807 [2024-04-26 15:48:01.280350] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:19:02.807 [2024-04-26 15:48:01.280356] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:19:02.807 [2024-04-26 15:48:01.280361] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:02.807 [2024-04-26 15:48:01.280405] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:02.807 [2024-04-26 15:48:01.280507] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:02.807 [2024-04-26 15:48:01.280584] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:02.807 [2024-04-26 15:48:01.280585] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:03.372 15:48:01 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:19:03.372 15:48:01 -- common/autotest_common.sh@850 -- # return 0 00:19:03.372 15:48:01 -- host/fio.sh@27 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:19:03.372 15:48:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:03.372 15:48:01 -- common/autotest_common.sh@10 -- # set +x 00:19:03.630 [2024-04-26 15:48:01.986725] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x6de100/0x6e25f0) succeed. 00:19:03.630 [2024-04-26 15:48:01.996917] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x6df740/0x723c80) succeed. 00:19:03.630 15:48:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:03.630 15:48:02 -- host/fio.sh@28 -- # timing_exit start_nvmf_tgt 00:19:03.630 15:48:02 -- common/autotest_common.sh@716 -- # xtrace_disable 00:19:03.630 15:48:02 -- common/autotest_common.sh@10 -- # set +x 00:19:03.630 15:48:02 -- host/fio.sh@30 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:19:03.630 15:48:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:03.630 15:48:02 -- common/autotest_common.sh@10 -- # set +x 00:19:03.630 Malloc1 00:19:03.630 15:48:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:03.630 15:48:02 -- host/fio.sh@31 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:03.630 15:48:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:03.630 15:48:02 -- common/autotest_common.sh@10 -- # set +x 00:19:03.630 15:48:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:03.630 15:48:02 -- host/fio.sh@32 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:03.630 15:48:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:03.630 15:48:02 -- common/autotest_common.sh@10 -- # set +x 00:19:03.630 15:48:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:03.630 15:48:02 -- host/fio.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:19:03.630 15:48:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:03.630 15:48:02 -- common/autotest_common.sh@10 -- # set +x 00:19:03.630 [2024-04-26 15:48:02.204651] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:19:03.630 15:48:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:03.630 15:48:02 -- host/fio.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:19:03.630 15:48:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:03.630 15:48:02 -- common/autotest_common.sh@10 -- # set +x 00:19:03.630 15:48:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:03.630 15:48:02 -- host/fio.sh@36 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme 00:19:03.630 15:48:02 -- host/fio.sh@39 -- # fio_nvme /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:19:03.630 15:48:02 -- common/autotest_common.sh@1346 -- # fio_plugin /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:19:03.630 15:48:02 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:19:03.630 15:48:02 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:19:03.630 15:48:02 -- common/autotest_common.sh@1325 -- # local sanitizers 00:19:03.630 15:48:02 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:19:03.630 15:48:02 -- common/autotest_common.sh@1327 -- # shift 00:19:03.630 15:48:02 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:19:03.630 15:48:02 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:19:03.630 15:48:02 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:19:03.630 15:48:02 -- common/autotest_common.sh@1331 -- # grep libasan 00:19:03.630 15:48:02 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:19:03.897 15:48:02 -- common/autotest_common.sh@1331 -- # asan_lib= 00:19:03.897 15:48:02 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:19:03.897 15:48:02 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:19:03.897 15:48:02 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:19:03.897 15:48:02 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:19:03.897 15:48:02 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:19:03.897 15:48:02 -- common/autotest_common.sh@1331 -- # asan_lib= 00:19:03.897 15:48:02 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:19:03.897 15:48:02 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme' 00:19:03.897 15:48:02 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:19:04.154 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:19:04.154 fio-3.35 00:19:04.154 Starting 1 thread 00:19:04.154 EAL: No free 2048 kB hugepages reported on node 1 00:19:06.680 00:19:06.680 test: (groupid=0, jobs=1): err= 0: pid=3384446: Fri Apr 26 15:48:04 2024 00:19:06.680 read: IOPS=18.0k, BW=70.2MiB/s (73.6MB/s)(141MiB/2003msec) 00:19:06.680 slat (nsec): min=1420, max=29187, avg=1630.90, stdev=536.58 00:19:06.680 clat (usec): min=2141, max=6376, avg=3548.95, stdev=92.73 00:19:06.680 lat (usec): min=2164, max=6378, avg=3550.58, stdev=92.68 00:19:06.680 clat percentiles (usec): 00:19:06.680 | 1.00th=[ 3195], 5.00th=[ 3523], 10.00th=[ 3523], 20.00th=[ 3523], 00:19:06.680 | 30.00th=[ 3523], 40.00th=[ 3556], 50.00th=[ 3556], 60.00th=[ 3556], 00:19:06.680 | 70.00th=[ 3556], 80.00th=[ 3556], 90.00th=[ 3589], 95.00th=[ 3589], 00:19:06.680 | 99.00th=[ 3884], 99.50th=[ 3884], 99.90th=[ 4621], 99.95th=[ 5473], 00:19:06.680 | 99.99th=[ 6325] 00:19:06.680 bw ( KiB/s): min=71200, max=72432, per=99.99%, avg=71876.00, stdev=508.38, samples=4 00:19:06.680 iops : min=17800, max=18108, avg=17969.00, stdev=127.10, samples=4 00:19:06.680 write: IOPS=18.0k, BW=70.3MiB/s (73.7MB/s)(141MiB/2003msec); 0 zone resets 00:19:06.680 slat (nsec): min=1458, max=17635, avg=1699.54, stdev=533.86 00:19:06.680 clat (usec): min=2175, max=6427, avg=3547.50, stdev=99.02 00:19:06.680 lat (usec): min=2187, max=6429, avg=3549.20, stdev=98.97 00:19:06.680 clat percentiles (usec): 00:19:06.680 | 1.00th=[ 3195], 5.00th=[ 3523], 10.00th=[ 3523], 20.00th=[ 3523], 00:19:06.680 | 30.00th=[ 3523], 40.00th=[ 3556], 50.00th=[ 3556], 60.00th=[ 3556], 00:19:06.680 | 70.00th=[ 3556], 80.00th=[ 3556], 90.00th=[ 3589], 95.00th=[ 3589], 00:19:06.680 | 99.00th=[ 3884], 99.50th=[ 3884], 99.90th=[ 4621], 99.95th=[ 5932], 00:19:06.680 | 99.99th=[ 6390] 00:19:06.680 bw ( KiB/s): min=71240, max=72232, per=99.96%, avg=71928.00, stdev=462.85, samples=4 00:19:06.680 iops : min=17810, max=18058, avg=17982.00, stdev=115.71, samples=4 00:19:06.680 lat (msec) : 4=99.81%, 10=0.19% 00:19:06.680 cpu : usr=99.60%, sys=0.05%, ctx=16, majf=0, minf=3 00:19:06.680 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.9% 00:19:06.680 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:06.680 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:06.680 issued rwts: total=35997,36032,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:06.680 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:06.680 00:19:06.680 Run status group 0 (all jobs): 00:19:06.680 READ: bw=70.2MiB/s (73.6MB/s), 70.2MiB/s-70.2MiB/s (73.6MB/s-73.6MB/s), io=141MiB (147MB), run=2003-2003msec 00:19:06.680 WRITE: bw=70.3MiB/s (73.7MB/s), 70.3MiB/s-70.3MiB/s (73.7MB/s-73.7MB/s), io=141MiB (148MB), run=2003-2003msec 00:19:06.680 15:48:04 -- host/fio.sh@43 -- # fio_nvme /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' 00:19:06.680 15:48:04 -- common/autotest_common.sh@1346 -- # fio_plugin /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' 00:19:06.680 15:48:04 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:19:06.680 15:48:04 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:19:06.680 15:48:04 -- common/autotest_common.sh@1325 -- # local sanitizers 00:19:06.680 15:48:04 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:19:06.680 15:48:04 -- common/autotest_common.sh@1327 -- # shift 00:19:06.680 15:48:04 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:19:06.680 15:48:04 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:19:06.680 15:48:04 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:19:06.680 15:48:04 -- common/autotest_common.sh@1331 -- # grep libasan 00:19:06.680 15:48:04 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:19:06.680 15:48:04 -- common/autotest_common.sh@1331 -- # asan_lib= 00:19:06.680 15:48:04 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:19:06.680 15:48:04 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:19:06.680 15:48:04 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:19:06.680 15:48:04 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:19:06.680 15:48:04 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:19:06.680 15:48:04 -- common/autotest_common.sh@1331 -- # asan_lib= 00:19:06.680 15:48:04 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:19:06.680 15:48:04 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme' 00:19:06.680 15:48:04 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' 00:19:06.680 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:19:06.680 fio-3.35 00:19:06.680 Starting 1 thread 00:19:06.680 EAL: No free 2048 kB hugepages reported on node 1 00:19:09.209 00:19:09.209 test: (groupid=0, jobs=1): err= 0: pid=3385183: Fri Apr 26 15:48:07 2024 00:19:09.209 read: IOPS=13.1k, BW=205MiB/s (215MB/s)(404MiB/1968msec) 00:19:09.209 slat (nsec): min=2310, max=40165, avg=2735.13, stdev=996.74 00:19:09.209 clat (usec): min=291, max=8672, avg=1831.25, stdev=1157.42 00:19:09.209 lat (usec): min=294, max=8688, avg=1833.99, stdev=1157.80 00:19:09.209 clat percentiles (usec): 00:19:09.209 | 1.00th=[ 611], 5.00th=[ 857], 10.00th=[ 988], 20.00th=[ 1139], 00:19:09.209 | 30.00th=[ 1254], 40.00th=[ 1369], 50.00th=[ 1483], 60.00th=[ 1631], 00:19:09.209 | 70.00th=[ 1827], 80.00th=[ 2089], 90.00th=[ 3032], 95.00th=[ 4883], 00:19:09.209 | 99.00th=[ 6456], 99.50th=[ 6915], 99.90th=[ 7373], 99.95th=[ 7767], 00:19:09.209 | 99.99th=[ 8586] 00:19:09.209 bw ( KiB/s): min=100224, max=105408, per=48.72%, avg=102416.00, stdev=2192.64, samples=4 00:19:09.209 iops : min= 6264, max= 6588, avg=6401.00, stdev=137.04, samples=4 00:19:09.209 write: IOPS=7268, BW=114MiB/s (119MB/s)(208MiB/1832msec); 0 zone resets 00:19:09.209 slat (usec): min=27, max=109, avg=30.60, stdev= 5.67 00:19:09.209 clat (usec): min=4877, max=21698, avg=13863.38, stdev=1705.86 00:19:09.209 lat (usec): min=4911, max=21727, avg=13893.98, stdev=1705.76 00:19:09.209 clat percentiles (usec): 00:19:09.209 | 1.00th=[ 8455], 5.00th=[11600], 10.00th=[12125], 20.00th=[12649], 00:19:09.209 | 30.00th=[13042], 40.00th=[13435], 50.00th=[13829], 60.00th=[14222], 00:19:09.209 | 70.00th=[14615], 80.00th=[15139], 90.00th=[15795], 95.00th=[16581], 00:19:09.209 | 99.00th=[18482], 99.50th=[19006], 99.90th=[19792], 99.95th=[21103], 00:19:09.209 | 99.99th=[21627] 00:19:09.209 bw ( KiB/s): min=101536, max=108224, per=91.06%, avg=105888.00, stdev=2968.82, samples=4 00:19:09.209 iops : min= 6346, max= 6764, avg=6618.00, stdev=185.55, samples=4 00:19:09.209 lat (usec) : 500=0.25%, 750=1.46%, 1000=5.27% 00:19:09.209 lat (msec) : 2=43.95%, 4=10.01%, 10=5.58%, 20=33.45%, 50=0.03% 00:19:09.209 cpu : usr=97.16%, sys=1.20%, ctx=183, majf=0, minf=2 00:19:09.209 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:19:09.209 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:09.209 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:09.209 issued rwts: total=25857,13315,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:09.209 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:09.209 00:19:09.209 Run status group 0 (all jobs): 00:19:09.209 READ: bw=205MiB/s (215MB/s), 205MiB/s-205MiB/s (215MB/s-215MB/s), io=404MiB (424MB), run=1968-1968msec 00:19:09.209 WRITE: bw=114MiB/s (119MB/s), 114MiB/s-114MiB/s (119MB/s-119MB/s), io=208MiB (218MB), run=1832-1832msec 00:19:09.209 15:48:07 -- host/fio.sh@45 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:09.209 15:48:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:09.209 15:48:07 -- common/autotest_common.sh@10 -- # set +x 00:19:09.209 15:48:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:09.209 15:48:07 -- host/fio.sh@47 -- # '[' 0 -eq 1 ']' 00:19:09.209 15:48:07 -- host/fio.sh@81 -- # trap - SIGINT SIGTERM EXIT 00:19:09.209 15:48:07 -- host/fio.sh@83 -- # rm -f ./local-test-0-verify.state 00:19:09.209 15:48:07 -- host/fio.sh@84 -- # nvmftestfini 00:19:09.209 15:48:07 -- nvmf/common.sh@477 -- # nvmfcleanup 00:19:09.209 15:48:07 -- nvmf/common.sh@117 -- # sync 00:19:09.209 15:48:07 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:19:09.209 15:48:07 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:19:09.209 15:48:07 -- nvmf/common.sh@120 -- # set +e 00:19:09.209 15:48:07 -- nvmf/common.sh@121 -- # for i in {1..20} 00:19:09.209 15:48:07 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:19:09.209 rmmod nvme_rdma 00:19:09.209 rmmod nvme_fabrics 00:19:09.209 15:48:07 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:19:09.209 15:48:07 -- nvmf/common.sh@124 -- # set -e 00:19:09.209 15:48:07 -- nvmf/common.sh@125 -- # return 0 00:19:09.209 15:48:07 -- nvmf/common.sh@478 -- # '[' -n 3384031 ']' 00:19:09.209 15:48:07 -- nvmf/common.sh@479 -- # killprocess 3384031 00:19:09.209 15:48:07 -- common/autotest_common.sh@936 -- # '[' -z 3384031 ']' 00:19:09.209 15:48:07 -- common/autotest_common.sh@940 -- # kill -0 3384031 00:19:09.209 15:48:07 -- common/autotest_common.sh@941 -- # uname 00:19:09.209 15:48:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:09.209 15:48:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3384031 00:19:09.209 15:48:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:09.209 15:48:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:09.209 15:48:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3384031' 00:19:09.209 killing process with pid 3384031 00:19:09.209 15:48:07 -- common/autotest_common.sh@955 -- # kill 3384031 00:19:09.209 15:48:07 -- common/autotest_common.sh@960 -- # wait 3384031 00:19:09.209 [2024-04-26 15:48:07.706095] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:19:09.467 15:48:07 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:19:09.467 15:48:07 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:19:09.467 00:19:09.467 real 0m12.001s 00:19:09.467 user 0m42.710s 00:19:09.467 sys 0m4.581s 00:19:09.467 15:48:07 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:19:09.467 15:48:07 -- common/autotest_common.sh@10 -- # set +x 00:19:09.467 ************************************ 00:19:09.467 END TEST nvmf_fio_host 00:19:09.467 ************************************ 00:19:09.467 15:48:07 -- nvmf/nvmf.sh@98 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=rdma 00:19:09.467 15:48:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:09.467 15:48:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:09.467 15:48:07 -- common/autotest_common.sh@10 -- # set +x 00:19:09.724 ************************************ 00:19:09.724 START TEST nvmf_failover 00:19:09.724 ************************************ 00:19:09.724 15:48:08 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=rdma 00:19:09.724 * Looking for test storage... 00:19:09.724 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:19:09.724 15:48:08 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:19:09.724 15:48:08 -- nvmf/common.sh@7 -- # uname -s 00:19:09.724 15:48:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:09.724 15:48:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:09.724 15:48:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:09.724 15:48:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:09.724 15:48:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:09.724 15:48:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:09.724 15:48:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:09.724 15:48:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:09.724 15:48:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:09.724 15:48:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:09.724 15:48:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:19:09.724 15:48:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:19:09.724 15:48:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:09.724 15:48:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:09.724 15:48:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:09.724 15:48:08 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:19:09.724 15:48:08 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:19:09.724 15:48:08 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:09.724 15:48:08 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:09.724 15:48:08 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:09.724 15:48:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:09.724 15:48:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:09.724 15:48:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:09.724 15:48:08 -- paths/export.sh@5 -- # export PATH 00:19:09.724 15:48:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:09.724 15:48:08 -- nvmf/common.sh@47 -- # : 0 00:19:09.724 15:48:08 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:19:09.724 15:48:08 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:19:09.724 15:48:08 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:19:09.724 15:48:08 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:09.724 15:48:08 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:09.724 15:48:08 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:19:09.724 15:48:08 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:19:09.724 15:48:08 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:19:09.724 15:48:08 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:09.724 15:48:08 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:09.724 15:48:08 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:19:09.724 15:48:08 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:19:09.724 15:48:08 -- host/failover.sh@18 -- # nvmftestinit 00:19:09.724 15:48:08 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:19:09.724 15:48:08 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:09.724 15:48:08 -- nvmf/common.sh@437 -- # prepare_net_devs 00:19:09.724 15:48:08 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:19:09.724 15:48:08 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:19:09.724 15:48:08 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:09.724 15:48:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:09.724 15:48:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:09.724 15:48:08 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:19:09.724 15:48:08 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:19:09.724 15:48:08 -- nvmf/common.sh@285 -- # xtrace_disable 00:19:09.724 15:48:08 -- common/autotest_common.sh@10 -- # set +x 00:19:14.982 15:48:13 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:14.982 15:48:13 -- nvmf/common.sh@291 -- # pci_devs=() 00:19:14.982 15:48:13 -- nvmf/common.sh@291 -- # local -a pci_devs 00:19:14.982 15:48:13 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:19:14.982 15:48:13 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:19:14.982 15:48:13 -- nvmf/common.sh@293 -- # pci_drivers=() 00:19:14.982 15:48:13 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:19:14.982 15:48:13 -- nvmf/common.sh@295 -- # net_devs=() 00:19:14.982 15:48:13 -- nvmf/common.sh@295 -- # local -ga net_devs 00:19:14.982 15:48:13 -- nvmf/common.sh@296 -- # e810=() 00:19:14.982 15:48:13 -- nvmf/common.sh@296 -- # local -ga e810 00:19:14.982 15:48:13 -- nvmf/common.sh@297 -- # x722=() 00:19:14.982 15:48:13 -- nvmf/common.sh@297 -- # local -ga x722 00:19:14.982 15:48:13 -- nvmf/common.sh@298 -- # mlx=() 00:19:14.982 15:48:13 -- nvmf/common.sh@298 -- # local -ga mlx 00:19:14.982 15:48:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:14.982 15:48:13 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:14.982 15:48:13 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:14.982 15:48:13 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:14.982 15:48:13 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:14.982 15:48:13 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:14.982 15:48:13 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:14.982 15:48:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:14.982 15:48:13 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:14.982 15:48:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:14.982 15:48:13 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:14.982 15:48:13 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:19:14.982 15:48:13 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:19:14.982 15:48:13 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:19:14.982 15:48:13 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:19:14.982 15:48:13 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:19:14.982 15:48:13 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:19:14.982 15:48:13 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:19:14.982 15:48:13 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:14.982 15:48:13 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:19:14.982 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:19:14.982 15:48:13 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:14.982 15:48:13 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:14.982 15:48:13 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:14.982 15:48:13 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:14.982 15:48:13 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:14.982 15:48:13 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:14.982 15:48:13 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:14.982 15:48:13 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:19:14.982 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:19:14.982 15:48:13 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:14.983 15:48:13 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:14.983 15:48:13 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:14.983 15:48:13 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:14.983 15:48:13 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:14.983 15:48:13 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:14.983 15:48:13 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:19:14.983 15:48:13 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:19:14.983 15:48:13 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:14.983 15:48:13 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:14.983 15:48:13 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:14.983 15:48:13 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:14.983 15:48:13 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:19:14.983 Found net devices under 0000:da:00.0: mlx_0_0 00:19:14.983 15:48:13 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:14.983 15:48:13 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:14.983 15:48:13 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:14.983 15:48:13 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:14.983 15:48:13 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:14.983 15:48:13 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:19:14.983 Found net devices under 0000:da:00.1: mlx_0_1 00:19:14.983 15:48:13 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:14.983 15:48:13 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:19:14.983 15:48:13 -- nvmf/common.sh@403 -- # is_hw=yes 00:19:14.983 15:48:13 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:19:14.983 15:48:13 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:19:14.983 15:48:13 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:19:14.983 15:48:13 -- nvmf/common.sh@409 -- # rdma_device_init 00:19:14.983 15:48:13 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:19:14.983 15:48:13 -- nvmf/common.sh@58 -- # uname 00:19:14.983 15:48:13 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:19:14.983 15:48:13 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:19:14.983 15:48:13 -- nvmf/common.sh@63 -- # modprobe ib_core 00:19:14.983 15:48:13 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:19:14.983 15:48:13 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:19:14.983 15:48:13 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:19:14.983 15:48:13 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:19:14.983 15:48:13 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:19:14.983 15:48:13 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:19:14.983 15:48:13 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:19:14.983 15:48:13 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:19:14.983 15:48:13 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:14.983 15:48:13 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:14.983 15:48:13 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:14.983 15:48:13 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:14.983 15:48:13 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:14.983 15:48:13 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:14.983 15:48:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:14.983 15:48:13 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:14.983 15:48:13 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:14.983 15:48:13 -- nvmf/common.sh@105 -- # continue 2 00:19:14.983 15:48:13 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:14.983 15:48:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:14.983 15:48:13 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:14.983 15:48:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:14.983 15:48:13 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:14.983 15:48:13 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:14.983 15:48:13 -- nvmf/common.sh@105 -- # continue 2 00:19:14.983 15:48:13 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:14.983 15:48:13 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:19:14.983 15:48:13 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:14.983 15:48:13 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:14.983 15:48:13 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:14.983 15:48:13 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:14.983 15:48:13 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:19:14.983 15:48:13 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:19:14.983 15:48:13 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:19:14.983 122: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:14.983 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:19:14.983 altname enp218s0f0np0 00:19:14.983 altname ens818f0np0 00:19:14.983 inet 192.168.100.8/24 scope global mlx_0_0 00:19:14.983 valid_lft forever preferred_lft forever 00:19:14.983 15:48:13 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:14.983 15:48:13 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:19:14.983 15:48:13 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:14.983 15:48:13 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:14.983 15:48:13 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:14.983 15:48:13 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:14.983 15:48:13 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:19:14.983 15:48:13 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:19:14.983 15:48:13 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:19:14.983 123: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:14.983 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:19:14.983 altname enp218s0f1np1 00:19:14.983 altname ens818f1np1 00:19:14.983 inet 192.168.100.9/24 scope global mlx_0_1 00:19:14.983 valid_lft forever preferred_lft forever 00:19:14.983 15:48:13 -- nvmf/common.sh@411 -- # return 0 00:19:14.983 15:48:13 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:19:14.983 15:48:13 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:19:14.983 15:48:13 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:19:14.983 15:48:13 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:19:14.983 15:48:13 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:19:14.983 15:48:13 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:14.983 15:48:13 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:14.983 15:48:13 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:14.983 15:48:13 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:14.983 15:48:13 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:14.983 15:48:13 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:14.983 15:48:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:14.983 15:48:13 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:14.983 15:48:13 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:14.983 15:48:13 -- nvmf/common.sh@105 -- # continue 2 00:19:14.983 15:48:13 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:14.983 15:48:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:14.983 15:48:13 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:14.983 15:48:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:14.983 15:48:13 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:14.983 15:48:13 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:14.983 15:48:13 -- nvmf/common.sh@105 -- # continue 2 00:19:14.983 15:48:13 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:14.983 15:48:13 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:19:14.983 15:48:13 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:14.983 15:48:13 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:14.983 15:48:13 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:14.983 15:48:13 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:14.983 15:48:13 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:14.983 15:48:13 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:19:14.983 15:48:13 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:14.983 15:48:13 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:14.983 15:48:13 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:14.983 15:48:13 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:14.983 15:48:13 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:19:14.983 192.168.100.9' 00:19:14.983 15:48:13 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:19:14.983 192.168.100.9' 00:19:14.983 15:48:13 -- nvmf/common.sh@446 -- # head -n 1 00:19:14.983 15:48:13 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:19:14.983 15:48:13 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:19:14.983 192.168.100.9' 00:19:14.983 15:48:13 -- nvmf/common.sh@447 -- # tail -n +2 00:19:14.983 15:48:13 -- nvmf/common.sh@447 -- # head -n 1 00:19:14.983 15:48:13 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:19:14.983 15:48:13 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:19:14.983 15:48:13 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:19:14.983 15:48:13 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:19:14.983 15:48:13 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:19:14.983 15:48:13 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:19:14.983 15:48:13 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:19:14.983 15:48:13 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:19:14.983 15:48:13 -- common/autotest_common.sh@710 -- # xtrace_disable 00:19:14.983 15:48:13 -- common/autotest_common.sh@10 -- # set +x 00:19:14.983 15:48:13 -- nvmf/common.sh@470 -- # nvmfpid=3388713 00:19:14.983 15:48:13 -- nvmf/common.sh@471 -- # waitforlisten 3388713 00:19:14.983 15:48:13 -- common/autotest_common.sh@817 -- # '[' -z 3388713 ']' 00:19:14.983 15:48:13 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:14.983 15:48:13 -- common/autotest_common.sh@822 -- # local max_retries=100 00:19:14.983 15:48:13 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:14.983 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:14.983 15:48:13 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:19:14.983 15:48:13 -- common/autotest_common.sh@826 -- # xtrace_disable 00:19:14.983 15:48:13 -- common/autotest_common.sh@10 -- # set +x 00:19:14.983 [2024-04-26 15:48:13.345267] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:19:14.983 [2024-04-26 15:48:13.345311] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:14.983 EAL: No free 2048 kB hugepages reported on node 1 00:19:14.983 [2024-04-26 15:48:13.400893] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:19:14.983 [2024-04-26 15:48:13.476794] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:14.984 [2024-04-26 15:48:13.476829] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:14.984 [2024-04-26 15:48:13.476836] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:19:14.984 [2024-04-26 15:48:13.476842] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:19:14.984 [2024-04-26 15:48:13.476847] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:14.984 [2024-04-26 15:48:13.476886] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:14.984 [2024-04-26 15:48:13.476905] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:14.984 [2024-04-26 15:48:13.476907] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:15.913 15:48:14 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:19:15.913 15:48:14 -- common/autotest_common.sh@850 -- # return 0 00:19:15.913 15:48:14 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:19:15.913 15:48:14 -- common/autotest_common.sh@716 -- # xtrace_disable 00:19:15.913 15:48:14 -- common/autotest_common.sh@10 -- # set +x 00:19:15.913 15:48:14 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:15.913 15:48:14 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:19:15.913 [2024-04-26 15:48:14.361338] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x889920/0x88de10) succeed. 00:19:15.913 [2024-04-26 15:48:14.371611] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x88aec0/0x8cf4a0) succeed. 00:19:15.913 15:48:14 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:19:16.171 Malloc0 00:19:16.171 15:48:14 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:16.427 15:48:14 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:16.683 15:48:15 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:19:16.683 [2024-04-26 15:48:15.202507] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:19:16.683 15:48:15 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4421 00:19:16.939 [2024-04-26 15:48:15.378887] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4421 *** 00:19:16.939 15:48:15 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4422 00:19:17.196 [2024-04-26 15:48:15.555490] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4422 *** 00:19:17.196 15:48:15 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:19:17.196 15:48:15 -- host/failover.sh@31 -- # bdevperf_pid=3389186 00:19:17.196 15:48:15 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:19:17.196 15:48:15 -- host/failover.sh@34 -- # waitforlisten 3389186 /var/tmp/bdevperf.sock 00:19:17.196 15:48:15 -- common/autotest_common.sh@817 -- # '[' -z 3389186 ']' 00:19:17.196 15:48:15 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:19:17.196 15:48:15 -- common/autotest_common.sh@822 -- # local max_retries=100 00:19:17.196 15:48:15 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:19:17.196 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:19:17.196 15:48:15 -- common/autotest_common.sh@826 -- # xtrace_disable 00:19:17.196 15:48:15 -- common/autotest_common.sh@10 -- # set +x 00:19:18.181 15:48:16 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:19:18.181 15:48:16 -- common/autotest_common.sh@850 -- # return 0 00:19:18.181 15:48:16 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:19:18.181 NVMe0n1 00:19:18.181 15:48:16 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:19:18.455 00:19:18.455 15:48:16 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:19:18.455 15:48:16 -- host/failover.sh@39 -- # run_test_pid=3389422 00:19:18.455 15:48:16 -- host/failover.sh@41 -- # sleep 1 00:19:19.385 15:48:17 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:19:19.641 15:48:18 -- host/failover.sh@45 -- # sleep 3 00:19:22.915 15:48:21 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:19:22.915 00:19:22.915 15:48:21 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4421 00:19:23.171 15:48:21 -- host/failover.sh@50 -- # sleep 3 00:19:26.445 15:48:24 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:19:26.445 [2024-04-26 15:48:24.700955] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:19:26.445 15:48:24 -- host/failover.sh@55 -- # sleep 1 00:19:27.376 15:48:25 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4422 00:19:27.376 15:48:25 -- host/failover.sh@59 -- # wait 3389422 00:19:33.929 0 00:19:33.929 15:48:32 -- host/failover.sh@61 -- # killprocess 3389186 00:19:33.929 15:48:32 -- common/autotest_common.sh@936 -- # '[' -z 3389186 ']' 00:19:33.929 15:48:32 -- common/autotest_common.sh@940 -- # kill -0 3389186 00:19:33.929 15:48:32 -- common/autotest_common.sh@941 -- # uname 00:19:33.929 15:48:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:33.929 15:48:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3389186 00:19:33.929 15:48:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:33.929 15:48:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:33.929 15:48:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3389186' 00:19:33.929 killing process with pid 3389186 00:19:33.929 15:48:32 -- common/autotest_common.sh@955 -- # kill 3389186 00:19:33.929 15:48:32 -- common/autotest_common.sh@960 -- # wait 3389186 00:19:33.929 15:48:32 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/try.txt 00:19:33.929 [2024-04-26 15:48:15.615114] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:19:33.929 [2024-04-26 15:48:15.615174] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3389186 ] 00:19:33.929 EAL: No free 2048 kB hugepages reported on node 1 00:19:33.929 [2024-04-26 15:48:15.669204] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:33.929 [2024-04-26 15:48:15.740899] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:33.929 Running I/O for 15 seconds... 00:19:33.929 [2024-04-26 15:48:19.095864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:25368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.929 [2024-04-26 15:48:19.095905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.929 [2024-04-26 15:48:19.095924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:25376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.929 [2024-04-26 15:48:19.095933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.929 [2024-04-26 15:48:19.095944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:25384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.929 [2024-04-26 15:48:19.095951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.929 [2024-04-26 15:48:19.095961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:25392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.929 [2024-04-26 15:48:19.095968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.929 [2024-04-26 15:48:19.095976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:25400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.929 [2024-04-26 15:48:19.095982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.929 [2024-04-26 15:48:19.095990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:25408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.929 [2024-04-26 15:48:19.095997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.929 [2024-04-26 15:48:19.096005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:25416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.929 [2024-04-26 15:48:19.096013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.929 [2024-04-26 15:48:19.096022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:25424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.929 [2024-04-26 15:48:19.096028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.929 [2024-04-26 15:48:19.096036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:25432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.929 [2024-04-26 15:48:19.096044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.929 [2024-04-26 15:48:19.096055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:25440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.929 [2024-04-26 15:48:19.096062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.929 [2024-04-26 15:48:19.096071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:25448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.929 [2024-04-26 15:48:19.096085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.929 [2024-04-26 15:48:19.096094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:25456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.929 [2024-04-26 15:48:19.096103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.929 [2024-04-26 15:48:19.096113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.929 [2024-04-26 15:48:19.096120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.929 [2024-04-26 15:48:19.096130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:25472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.929 [2024-04-26 15:48:19.096137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.929 [2024-04-26 15:48:19.096150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:25480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.929 [2024-04-26 15:48:19.096156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.929 [2024-04-26 15:48:19.096165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:25488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.929 [2024-04-26 15:48:19.096172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.929 [2024-04-26 15:48:19.096180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:25496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.930 [2024-04-26 15:48:19.096186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.930 [2024-04-26 15:48:19.096197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:25504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.930 [2024-04-26 15:48:19.096206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.930 [2024-04-26 15:48:19.096215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:25512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.930 [2024-04-26 15:48:19.096223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.930 [2024-04-26 15:48:19.096234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:25520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.930 [2024-04-26 15:48:19.096241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.930 [2024-04-26 15:48:19.096251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:25528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.930 [2024-04-26 15:48:19.096260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.930 [2024-04-26 15:48:19.096268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:25536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.930 [2024-04-26 15:48:19.096274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.930 [2024-04-26 15:48:19.096284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:25544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.930 [2024-04-26 15:48:19.096291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.930 [2024-04-26 15:48:19.096301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:25552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.930 [2024-04-26 15:48:19.096309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.930 [2024-04-26 15:48:19.096318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:25560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.930 [2024-04-26 15:48:19.096325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.930 [2024-04-26 15:48:19.096333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:25568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.930 [2024-04-26 15:48:19.096339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.930 [2024-04-26 15:48:19.096348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:25576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.930 [2024-04-26 15:48:19.096357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.930 [2024-04-26 15:48:19.096367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:25584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.930 [2024-04-26 15:48:19.096377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.930 [2024-04-26 15:48:19.096386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:25592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.930 [2024-04-26 15:48:19.096392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.930 [2024-04-26 15:48:19.096402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:24576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007500000 len:0x1000 key:0x187000 00:19:33.930 [2024-04-26 15:48:19.096411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.930 [2024-04-26 15:48:19.096419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007502000 len:0x1000 key:0x187000 00:19:33.930 [2024-04-26 15:48:19.096425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.930 [2024-04-26 15:48:19.096435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:24592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007504000 len:0x1000 key:0x187000 00:19:33.930 [2024-04-26 15:48:19.096441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.930 [2024-04-26 15:48:19.096449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:24600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007506000 len:0x1000 key:0x187000 00:19:33.930 [2024-04-26 15:48:19.096457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.930 [2024-04-26 15:48:19.096466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:24608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007508000 len:0x1000 key:0x187000 00:19:33.930 [2024-04-26 15:48:19.096472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.930 [2024-04-26 15:48:19.096480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000750a000 len:0x1000 key:0x187000 00:19:33.930 [2024-04-26 15:48:19.096491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.930 [2024-04-26 15:48:19.096501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:24624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000750c000 len:0x1000 key:0x187000 00:19:33.930 [2024-04-26 15:48:19.096508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.930 [2024-04-26 15:48:19.096517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:24632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000750e000 len:0x1000 key:0x187000 00:19:33.930 [2024-04-26 15:48:19.096525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.930 [2024-04-26 15:48:19.096536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:24640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007510000 len:0x1000 key:0x187000 00:19:33.930 [2024-04-26 15:48:19.096544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.930 [2024-04-26 15:48:19.096555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:24648 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007512000 len:0x1000 key:0x187000 00:19:33.930 [2024-04-26 15:48:19.096561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.930 [2024-04-26 15:48:19.096569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:24656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007514000 len:0x1000 key:0x187000 00:19:33.930 [2024-04-26 15:48:19.096577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.930 [2024-04-26 15:48:19.096586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:24664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007516000 len:0x1000 key:0x187000 00:19:33.930 [2024-04-26 15:48:19.096592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.930 [2024-04-26 15:48:19.096600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:24672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007518000 len:0x1000 key:0x187000 00:19:33.930 [2024-04-26 15:48:19.096607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.930 [2024-04-26 15:48:19.096615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:24680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751a000 len:0x1000 key:0x187000 00:19:33.930 [2024-04-26 15:48:19.096622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.930 [2024-04-26 15:48:19.096630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751c000 len:0x1000 key:0x187000 00:19:33.930 [2024-04-26 15:48:19.096639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.930 [2024-04-26 15:48:19.096649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:24696 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751e000 len:0x1000 key:0x187000 00:19:33.930 [2024-04-26 15:48:19.096657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.930 [2024-04-26 15:48:19.096666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:24704 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007520000 len:0x1000 key:0x187000 00:19:33.930 [2024-04-26 15:48:19.096674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.930 [2024-04-26 15:48:19.096684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:24712 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007522000 len:0x1000 key:0x187000 00:19:33.930 [2024-04-26 15:48:19.096692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.930 [2024-04-26 15:48:19.096700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:24720 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007524000 len:0x1000 key:0x187000 00:19:33.930 [2024-04-26 15:48:19.096706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.930 [2024-04-26 15:48:19.096714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:24728 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007526000 len:0x1000 key:0x187000 00:19:33.930 [2024-04-26 15:48:19.096723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.930 [2024-04-26 15:48:19.096731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:24736 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007528000 len:0x1000 key:0x187000 00:19:33.930 [2024-04-26 15:48:19.096737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.930 [2024-04-26 15:48:19.096746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:24744 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000752a000 len:0x1000 key:0x187000 00:19:33.930 [2024-04-26 15:48:19.096754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.930 [2024-04-26 15:48:19.096761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:24752 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000752c000 len:0x1000 key:0x187000 00:19:33.930 [2024-04-26 15:48:19.096767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.930 [2024-04-26 15:48:19.096778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:24760 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000752e000 len:0x1000 key:0x187000 00:19:33.930 [2024-04-26 15:48:19.096786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.930 [2024-04-26 15:48:19.096795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:24768 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007530000 len:0x1000 key:0x187000 00:19:33.930 [2024-04-26 15:48:19.096804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.931 [2024-04-26 15:48:19.096814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:24776 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007532000 len:0x1000 key:0x187000 00:19:33.931 [2024-04-26 15:48:19.096821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.931 [2024-04-26 15:48:19.096831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:24784 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007534000 len:0x1000 key:0x187000 00:19:33.931 [2024-04-26 15:48:19.096840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.931 [2024-04-26 15:48:19.096848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:24792 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007536000 len:0x1000 key:0x187000 00:19:33.931 [2024-04-26 15:48:19.096854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.931 [2024-04-26 15:48:19.096866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:24800 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007538000 len:0x1000 key:0x187000 00:19:33.931 [2024-04-26 15:48:19.096874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.931 [2024-04-26 15:48:19.096883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:24808 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753a000 len:0x1000 key:0x187000 00:19:33.931 [2024-04-26 15:48:19.096890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.931 [2024-04-26 15:48:19.096898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:24816 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753c000 len:0x1000 key:0x187000 00:19:33.931 [2024-04-26 15:48:19.096905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.931 [2024-04-26 15:48:19.096913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:24824 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753e000 len:0x1000 key:0x187000 00:19:33.931 [2024-04-26 15:48:19.096921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.931 [2024-04-26 15:48:19.096930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:24832 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007540000 len:0x1000 key:0x187000 00:19:33.931 [2024-04-26 15:48:19.096938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.931 [2024-04-26 15:48:19.096948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:24840 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007542000 len:0x1000 key:0x187000 00:19:33.931 [2024-04-26 15:48:19.096957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.931 [2024-04-26 15:48:19.096965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:24848 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007544000 len:0x1000 key:0x187000 00:19:33.931 [2024-04-26 15:48:19.096973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.931 [2024-04-26 15:48:19.096984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24856 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007546000 len:0x1000 key:0x187000 00:19:33.931 [2024-04-26 15:48:19.096991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.931 [2024-04-26 15:48:19.096999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:24864 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007548000 len:0x1000 key:0x187000 00:19:33.931 [2024-04-26 15:48:19.097005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.931 [2024-04-26 15:48:19.097014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:24872 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754a000 len:0x1000 key:0x187000 00:19:33.931 [2024-04-26 15:48:19.097020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.931 [2024-04-26 15:48:19.097029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:24880 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754c000 len:0x1000 key:0x187000 00:19:33.931 [2024-04-26 15:48:19.097036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.931 [2024-04-26 15:48:19.097045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:24888 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754e000 len:0x1000 key:0x187000 00:19:33.931 [2024-04-26 15:48:19.097055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.931 [2024-04-26 15:48:19.097066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24896 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007550000 len:0x1000 key:0x187000 00:19:33.931 [2024-04-26 15:48:19.097076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.931 [2024-04-26 15:48:19.097086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:24904 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007552000 len:0x1000 key:0x187000 00:19:33.931 [2024-04-26 15:48:19.097095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.931 [2024-04-26 15:48:19.097105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:24912 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007554000 len:0x1000 key:0x187000 00:19:33.931 [2024-04-26 15:48:19.097114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.931 [2024-04-26 15:48:19.097124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:24920 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007556000 len:0x1000 key:0x187000 00:19:33.931 [2024-04-26 15:48:19.097132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.931 [2024-04-26 15:48:19.097140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:24928 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007558000 len:0x1000 key:0x187000 00:19:33.931 [2024-04-26 15:48:19.097152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.931 [2024-04-26 15:48:19.097161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:24936 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755a000 len:0x1000 key:0x187000 00:19:33.931 [2024-04-26 15:48:19.097168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.931 [2024-04-26 15:48:19.097176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:24944 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755c000 len:0x1000 key:0x187000 00:19:33.931 [2024-04-26 15:48:19.097184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.931 [2024-04-26 15:48:19.097192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:24952 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755e000 len:0x1000 key:0x187000 00:19:33.931 [2024-04-26 15:48:19.097199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.931 [2024-04-26 15:48:19.097207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:24960 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007560000 len:0x1000 key:0x187000 00:19:33.931 [2024-04-26 15:48:19.097216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.931 [2024-04-26 15:48:19.097226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:24968 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007562000 len:0x1000 key:0x187000 00:19:33.931 [2024-04-26 15:48:19.097235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.931 [2024-04-26 15:48:19.097245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24976 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007564000 len:0x1000 key:0x187000 00:19:33.931 [2024-04-26 15:48:19.097255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.931 [2024-04-26 15:48:19.097263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:24984 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007566000 len:0x1000 key:0x187000 00:19:33.931 [2024-04-26 15:48:19.097272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.931 [2024-04-26 15:48:19.097281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:24992 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007568000 len:0x1000 key:0x187000 00:19:33.931 [2024-04-26 15:48:19.097288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.931 [2024-04-26 15:48:19.097296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:25000 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756a000 len:0x1000 key:0x187000 00:19:33.931 [2024-04-26 15:48:19.097303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.931 [2024-04-26 15:48:19.097312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25008 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756c000 len:0x1000 key:0x187000 00:19:33.931 [2024-04-26 15:48:19.097318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.931 [2024-04-26 15:48:19.097328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:25016 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756e000 len:0x1000 key:0x187000 00:19:33.931 [2024-04-26 15:48:19.097334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.931 [2024-04-26 15:48:19.097342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:25024 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007570000 len:0x1000 key:0x187000 00:19:33.931 [2024-04-26 15:48:19.097349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.931 [2024-04-26 15:48:19.097358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:25032 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007572000 len:0x1000 key:0x187000 00:19:33.931 [2024-04-26 15:48:19.097366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.931 [2024-04-26 15:48:19.097376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:25040 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007574000 len:0x1000 key:0x187000 00:19:33.931 [2024-04-26 15:48:19.097384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.931 [2024-04-26 15:48:19.097394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:25048 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007576000 len:0x1000 key:0x187000 00:19:33.931 [2024-04-26 15:48:19.097401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.931 [2024-04-26 15:48:19.097412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:25056 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007578000 len:0x1000 key:0x187000 00:19:33.931 [2024-04-26 15:48:19.097419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.932 [2024-04-26 15:48:19.097428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25064 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757a000 len:0x1000 key:0x187000 00:19:33.932 [2024-04-26 15:48:19.097435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.932 [2024-04-26 15:48:19.097446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:25072 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757c000 len:0x1000 key:0x187000 00:19:33.932 [2024-04-26 15:48:19.097453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.932 [2024-04-26 15:48:19.097461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:25080 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757e000 len:0x1000 key:0x187000 00:19:33.932 [2024-04-26 15:48:19.097470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.932 [2024-04-26 15:48:19.097478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:25088 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007580000 len:0x1000 key:0x187000 00:19:33.932 [2024-04-26 15:48:19.097485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.932 [2024-04-26 15:48:19.097493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:25096 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007582000 len:0x1000 key:0x187000 00:19:33.932 [2024-04-26 15:48:19.097502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.932 [2024-04-26 15:48:19.097511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25104 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007584000 len:0x1000 key:0x187000 00:19:33.932 [2024-04-26 15:48:19.097519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.932 [2024-04-26 15:48:19.097528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:25112 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007586000 len:0x1000 key:0x187000 00:19:33.932 [2024-04-26 15:48:19.097537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.932 [2024-04-26 15:48:19.097547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:25120 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007588000 len:0x1000 key:0x187000 00:19:33.932 [2024-04-26 15:48:19.097556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.932 [2024-04-26 15:48:19.097567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:25128 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758a000 len:0x1000 key:0x187000 00:19:33.932 [2024-04-26 15:48:19.097574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.932 [2024-04-26 15:48:19.097581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:25136 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758c000 len:0x1000 key:0x187000 00:19:33.932 [2024-04-26 15:48:19.097589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.932 [2024-04-26 15:48:19.097598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:25144 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758e000 len:0x1000 key:0x187000 00:19:33.932 [2024-04-26 15:48:19.097604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.932 [2024-04-26 15:48:19.097613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:25152 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007590000 len:0x1000 key:0x187000 00:19:33.932 [2024-04-26 15:48:19.097621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.932 [2024-04-26 15:48:19.097631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:25160 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007592000 len:0x1000 key:0x187000 00:19:33.932 [2024-04-26 15:48:19.097637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.932 [2024-04-26 15:48:19.097648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:25168 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007594000 len:0x1000 key:0x187000 00:19:33.932 [2024-04-26 15:48:19.097656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.932 [2024-04-26 15:48:19.097665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:25176 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007596000 len:0x1000 key:0x187000 00:19:33.932 [2024-04-26 15:48:19.097673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.932 [2024-04-26 15:48:19.097683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:25184 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007598000 len:0x1000 key:0x187000 00:19:33.932 [2024-04-26 15:48:19.097690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.932 [2024-04-26 15:48:19.097699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:25192 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759a000 len:0x1000 key:0x187000 00:19:33.932 [2024-04-26 15:48:19.097707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.932 [2024-04-26 15:48:19.097715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:25200 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759c000 len:0x1000 key:0x187000 00:19:33.932 [2024-04-26 15:48:19.097722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.932 [2024-04-26 15:48:19.097732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:25208 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759e000 len:0x1000 key:0x187000 00:19:33.932 [2024-04-26 15:48:19.097739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.932 [2024-04-26 15:48:19.097748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:25216 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a0000 len:0x1000 key:0x187000 00:19:33.932 [2024-04-26 15:48:19.097755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.932 [2024-04-26 15:48:19.097765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:25224 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a2000 len:0x1000 key:0x187000 00:19:33.932 [2024-04-26 15:48:19.097772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.932 [2024-04-26 15:48:19.097779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:25232 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a4000 len:0x1000 key:0x187000 00:19:33.932 [2024-04-26 15:48:19.097786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.932 [2024-04-26 15:48:19.097795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:25240 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a6000 len:0x1000 key:0x187000 00:19:33.932 [2024-04-26 15:48:19.097803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.932 [2024-04-26 15:48:19.097813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:25248 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a8000 len:0x1000 key:0x187000 00:19:33.932 [2024-04-26 15:48:19.097823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.932 [2024-04-26 15:48:19.097834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:25256 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075aa000 len:0x1000 key:0x187000 00:19:33.932 [2024-04-26 15:48:19.097842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.932 [2024-04-26 15:48:19.097853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:25264 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ac000 len:0x1000 key:0x187000 00:19:33.932 [2024-04-26 15:48:19.097859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.932 [2024-04-26 15:48:19.097867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:25272 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ae000 len:0x1000 key:0x187000 00:19:33.932 [2024-04-26 15:48:19.097874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.932 [2024-04-26 15:48:19.097883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:25280 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b0000 len:0x1000 key:0x187000 00:19:33.932 [2024-04-26 15:48:19.097890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.932 [2024-04-26 15:48:19.097897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:25288 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b2000 len:0x1000 key:0x187000 00:19:33.932 [2024-04-26 15:48:19.097905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.932 [2024-04-26 15:48:19.097914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:25296 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b4000 len:0x1000 key:0x187000 00:19:33.932 [2024-04-26 15:48:19.097921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.932 [2024-04-26 15:48:19.097929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:25304 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b6000 len:0x1000 key:0x187000 00:19:33.932 [2024-04-26 15:48:19.097937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.932 [2024-04-26 15:48:19.097946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25312 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b8000 len:0x1000 key:0x187000 00:19:33.932 [2024-04-26 15:48:19.097954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.932 [2024-04-26 15:48:19.097964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:25320 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ba000 len:0x1000 key:0x187000 00:19:33.932 [2024-04-26 15:48:19.097973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.932 [2024-04-26 15:48:19.106324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:25328 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075bc000 len:0x1000 key:0x187000 00:19:33.932 [2024-04-26 15:48:19.106336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.932 [2024-04-26 15:48:19.106348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:25336 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075be000 len:0x1000 key:0x187000 00:19:33.932 [2024-04-26 15:48:19.106359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.932 [2024-04-26 15:48:19.106371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:25344 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c0000 len:0x1000 key:0x187000 00:19:33.932 [2024-04-26 15:48:19.106379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.932 [2024-04-26 15:48:19.106390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:25352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c2000 len:0x1000 key:0x187000 00:19:33.933 [2024-04-26 15:48:19.106399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.933 [2024-04-26 15:48:19.108351] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:19:33.933 [2024-04-26 15:48:19.108364] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:19:33.933 [2024-04-26 15:48:19.108373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:25360 len:8 PRP1 0x0 PRP2 0x0 00:19:33.933 [2024-04-26 15:48:19.108382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:19:33.933 [2024-04-26 15:48:19.108423] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192e4a00 was disconnected and freed. reset controller. 00:19:33.933 [2024-04-26 15:48:19.108434] bdev_nvme.c:1857:bdev_nvme_failover_trid: *NOTICE*: Start failover from 192.168.100.8:4420 to 192.168.100.8:4421 00:19:33.933 [2024-04-26 15:48:19.108443] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:19:33.933 [2024-04-26 15:48:19.108481] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:19:33.933 [2024-04-26 15:48:19.108493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:19:33.933 [2024-04-26 15:48:19.108502] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:19:33.933 [2024-04-26 15:48:19.108511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:19:33.933 [2024-04-26 15:48:19.108521] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:19:33.933 [2024-04-26 15:48:19.108529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:19:33.933 [2024-04-26 15:48:19.108538] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:19:33.933 [2024-04-26 15:48:19.108547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:19:33.933 [2024-04-26 15:48:19.127164] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:19:33.933 [2024-04-26 15:48:19.127181] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:19:33.933 [2024-04-26 15:48:19.127188] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:19:33.933 [2024-04-26 15:48:19.129959] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:19:33.933 [2024-04-26 15:48:19.173442] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:33.933 [2024-04-26 15:48:22.520967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:110976 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007592000 len:0x1000 key:0x187000 00:19:33.933 [2024-04-26 15:48:22.521006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.933 [2024-04-26 15:48:22.521030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:110984 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007590000 len:0x1000 key:0x187000 00:19:33.933 [2024-04-26 15:48:22.521037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.933 [2024-04-26 15:48:22.521046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:110992 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758e000 len:0x1000 key:0x187000 00:19:33.933 [2024-04-26 15:48:22.521053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.933 [2024-04-26 15:48:22.521061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:111000 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758c000 len:0x1000 key:0x187000 00:19:33.933 [2024-04-26 15:48:22.521068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.933 [2024-04-26 15:48:22.521076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:111008 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758a000 len:0x1000 key:0x187000 00:19:33.933 [2024-04-26 15:48:22.521082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.933 [2024-04-26 15:48:22.521090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:111016 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007588000 len:0x1000 key:0x187000 00:19:33.933 [2024-04-26 15:48:22.521096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.933 [2024-04-26 15:48:22.521104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:111024 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007586000 len:0x1000 key:0x187000 00:19:33.933 [2024-04-26 15:48:22.521111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.933 [2024-04-26 15:48:22.521119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:111480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.933 [2024-04-26 15:48:22.521126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.933 [2024-04-26 15:48:22.521133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:111488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.933 [2024-04-26 15:48:22.521139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.933 [2024-04-26 15:48:22.521152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:111496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.933 [2024-04-26 15:48:22.521158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.933 [2024-04-26 15:48:22.521166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:111504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.933 [2024-04-26 15:48:22.521172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.933 [2024-04-26 15:48:22.521180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:111512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.933 [2024-04-26 15:48:22.521186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.933 [2024-04-26 15:48:22.521194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:111520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.933 [2024-04-26 15:48:22.521202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.933 [2024-04-26 15:48:22.521210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:111528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.933 [2024-04-26 15:48:22.521216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.933 [2024-04-26 15:48:22.521224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:111536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.933 [2024-04-26 15:48:22.521230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.933 [2024-04-26 15:48:22.521237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:111544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.933 [2024-04-26 15:48:22.521244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.933 [2024-04-26 15:48:22.521251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:111552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.933 [2024-04-26 15:48:22.521258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.933 [2024-04-26 15:48:22.521266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:111560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.933 [2024-04-26 15:48:22.521272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.933 [2024-04-26 15:48:22.521280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:111568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.933 [2024-04-26 15:48:22.521286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.933 [2024-04-26 15:48:22.521294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:111576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.933 [2024-04-26 15:48:22.521300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.933 [2024-04-26 15:48:22.521309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:111584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.933 [2024-04-26 15:48:22.521315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.933 [2024-04-26 15:48:22.521323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:111592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.934 [2024-04-26 15:48:22.521330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.934 [2024-04-26 15:48:22.521337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:111600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.934 [2024-04-26 15:48:22.521344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.934 [2024-04-26 15:48:22.521352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:111608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.934 [2024-04-26 15:48:22.521358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.934 [2024-04-26 15:48:22.521365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:111616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.934 [2024-04-26 15:48:22.521371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.934 [2024-04-26 15:48:22.521380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:111624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.934 [2024-04-26 15:48:22.521386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.934 [2024-04-26 15:48:22.521394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:111632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.934 [2024-04-26 15:48:22.521400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.934 [2024-04-26 15:48:22.521408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:111640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.934 [2024-04-26 15:48:22.521414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.934 [2024-04-26 15:48:22.521421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:111648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.934 [2024-04-26 15:48:22.521429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.934 [2024-04-26 15:48:22.521436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:111656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.934 [2024-04-26 15:48:22.521443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.934 [2024-04-26 15:48:22.521450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:111664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.934 [2024-04-26 15:48:22.521456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.934 [2024-04-26 15:48:22.521464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:111032 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a4000 len:0x1000 key:0x187000 00:19:33.934 [2024-04-26 15:48:22.521471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.934 [2024-04-26 15:48:22.521478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:111040 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a2000 len:0x1000 key:0x187000 00:19:33.934 [2024-04-26 15:48:22.521484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.934 [2024-04-26 15:48:22.521492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:111048 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a0000 len:0x1000 key:0x187000 00:19:33.934 [2024-04-26 15:48:22.521498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.934 [2024-04-26 15:48:22.521506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:111056 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759e000 len:0x1000 key:0x187000 00:19:33.934 [2024-04-26 15:48:22.521512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.934 [2024-04-26 15:48:22.521520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:111064 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759c000 len:0x1000 key:0x187000 00:19:33.934 [2024-04-26 15:48:22.521526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.934 [2024-04-26 15:48:22.521533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:111072 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759a000 len:0x1000 key:0x187000 00:19:33.934 [2024-04-26 15:48:22.521541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.934 [2024-04-26 15:48:22.521549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:111080 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007598000 len:0x1000 key:0x187000 00:19:33.934 [2024-04-26 15:48:22.521555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.934 [2024-04-26 15:48:22.521563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:111088 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007596000 len:0x1000 key:0x187000 00:19:33.934 [2024-04-26 15:48:22.521569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.934 [2024-04-26 15:48:22.521577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:111672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.934 [2024-04-26 15:48:22.521583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.934 [2024-04-26 15:48:22.521592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:111680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.934 [2024-04-26 15:48:22.521598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.934 [2024-04-26 15:48:22.521606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:111688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.934 [2024-04-26 15:48:22.521612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.934 [2024-04-26 15:48:22.521620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:111696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.934 [2024-04-26 15:48:22.521626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.934 [2024-04-26 15:48:22.521633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:111704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.934 [2024-04-26 15:48:22.521640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.934 [2024-04-26 15:48:22.521647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:111712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.934 [2024-04-26 15:48:22.521654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.934 [2024-04-26 15:48:22.521661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:111720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.934 [2024-04-26 15:48:22.521667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.934 [2024-04-26 15:48:22.521675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:111728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.934 [2024-04-26 15:48:22.521681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.934 [2024-04-26 15:48:22.521689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:111096 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007566000 len:0x1000 key:0x187000 00:19:33.934 [2024-04-26 15:48:22.521695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.934 [2024-04-26 15:48:22.521703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:111104 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007568000 len:0x1000 key:0x187000 00:19:33.934 [2024-04-26 15:48:22.521711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.934 [2024-04-26 15:48:22.521719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:111112 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756a000 len:0x1000 key:0x187000 00:19:33.934 [2024-04-26 15:48:22.521725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.934 [2024-04-26 15:48:22.521732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:111120 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756c000 len:0x1000 key:0x187000 00:19:33.934 [2024-04-26 15:48:22.521739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.934 [2024-04-26 15:48:22.521747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:111128 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756e000 len:0x1000 key:0x187000 00:19:33.934 [2024-04-26 15:48:22.521753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.934 [2024-04-26 15:48:22.521761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:111136 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007570000 len:0x1000 key:0x187000 00:19:33.934 [2024-04-26 15:48:22.521767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.934 [2024-04-26 15:48:22.521774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:111144 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007572000 len:0x1000 key:0x187000 00:19:33.934 [2024-04-26 15:48:22.521780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.934 [2024-04-26 15:48:22.521788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:111152 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007574000 len:0x1000 key:0x187000 00:19:33.934 [2024-04-26 15:48:22.521794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.934 [2024-04-26 15:48:22.521802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:111736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.934 [2024-04-26 15:48:22.521808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.934 [2024-04-26 15:48:22.521815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:111744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.934 [2024-04-26 15:48:22.521822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.934 [2024-04-26 15:48:22.521830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:111752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.934 [2024-04-26 15:48:22.521836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.934 [2024-04-26 15:48:22.521843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:111760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.935 [2024-04-26 15:48:22.521849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.935 [2024-04-26 15:48:22.521857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:111768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.935 [2024-04-26 15:48:22.521863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.935 [2024-04-26 15:48:22.521874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:111776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.935 [2024-04-26 15:48:22.521880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.935 [2024-04-26 15:48:22.521888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:111784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.935 [2024-04-26 15:48:22.521894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.935 [2024-04-26 15:48:22.521901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:111792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.935 [2024-04-26 15:48:22.521908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.935 [2024-04-26 15:48:22.521915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:111800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.935 [2024-04-26 15:48:22.521921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.935 [2024-04-26 15:48:22.521929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:111808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.935 [2024-04-26 15:48:22.521936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.935 [2024-04-26 15:48:22.521943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:111816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.935 [2024-04-26 15:48:22.521949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.935 [2024-04-26 15:48:22.521957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:111824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.935 [2024-04-26 15:48:22.521963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.935 [2024-04-26 15:48:22.521970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:111832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.935 [2024-04-26 15:48:22.521976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.935 [2024-04-26 15:48:22.521984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:111840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.935 [2024-04-26 15:48:22.521990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.935 [2024-04-26 15:48:22.521998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:111848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.935 [2024-04-26 15:48:22.522004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.935 [2024-04-26 15:48:22.522011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:111856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.935 [2024-04-26 15:48:22.522017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.935 [2024-04-26 15:48:22.522025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:111160 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007556000 len:0x1000 key:0x187000 00:19:33.935 [2024-04-26 15:48:22.522031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.935 [2024-04-26 15:48:22.522040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:111168 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007558000 len:0x1000 key:0x187000 00:19:33.935 [2024-04-26 15:48:22.522047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.935 [2024-04-26 15:48:22.522054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:111176 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755a000 len:0x1000 key:0x187000 00:19:33.935 [2024-04-26 15:48:22.522060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.935 [2024-04-26 15:48:22.522068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:111184 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755c000 len:0x1000 key:0x187000 00:19:33.935 [2024-04-26 15:48:22.522075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.935 [2024-04-26 15:48:22.522083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:111192 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755e000 len:0x1000 key:0x187000 00:19:33.935 [2024-04-26 15:48:22.522089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.935 [2024-04-26 15:48:22.522096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:111200 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007560000 len:0x1000 key:0x187000 00:19:33.935 [2024-04-26 15:48:22.522102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.935 [2024-04-26 15:48:22.522110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:111208 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007562000 len:0x1000 key:0x187000 00:19:33.935 [2024-04-26 15:48:22.522116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.935 [2024-04-26 15:48:22.522124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:111216 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007564000 len:0x1000 key:0x187000 00:19:33.935 [2024-04-26 15:48:22.522130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.935 [2024-04-26 15:48:22.522138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:111224 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b6000 len:0x1000 key:0x187000 00:19:33.935 [2024-04-26 15:48:22.522148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.935 [2024-04-26 15:48:22.522156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:111232 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b8000 len:0x1000 key:0x187000 00:19:33.935 [2024-04-26 15:48:22.522164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.935 [2024-04-26 15:48:22.522172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:111240 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ba000 len:0x1000 key:0x187000 00:19:33.935 [2024-04-26 15:48:22.522179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.935 [2024-04-26 15:48:22.522187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:111248 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075bc000 len:0x1000 key:0x187000 00:19:33.935 [2024-04-26 15:48:22.522193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.935 [2024-04-26 15:48:22.522201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:111256 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075be000 len:0x1000 key:0x187000 00:19:33.935 [2024-04-26 15:48:22.522209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.935 [2024-04-26 15:48:22.522217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:111264 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c0000 len:0x1000 key:0x187000 00:19:33.935 [2024-04-26 15:48:22.522223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.935 [2024-04-26 15:48:22.522231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:111272 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c2000 len:0x1000 key:0x187000 00:19:33.935 [2024-04-26 15:48:22.522237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.935 [2024-04-26 15:48:22.522245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:111280 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c4000 len:0x1000 key:0x187000 00:19:33.935 [2024-04-26 15:48:22.522251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.935 [2024-04-26 15:48:22.522259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:111288 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007584000 len:0x1000 key:0x187000 00:19:33.935 [2024-04-26 15:48:22.522266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.935 [2024-04-26 15:48:22.522274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:111296 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007582000 len:0x1000 key:0x187000 00:19:33.935 [2024-04-26 15:48:22.522281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.935 [2024-04-26 15:48:22.522288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:111304 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007580000 len:0x1000 key:0x187000 00:19:33.935 [2024-04-26 15:48:22.522295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.935 [2024-04-26 15:48:22.522303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:111312 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757e000 len:0x1000 key:0x187000 00:19:33.935 [2024-04-26 15:48:22.522309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.935 [2024-04-26 15:48:22.522317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:111320 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757c000 len:0x1000 key:0x187000 00:19:33.935 [2024-04-26 15:48:22.522324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.935 [2024-04-26 15:48:22.522331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:111328 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757a000 len:0x1000 key:0x187000 00:19:33.935 [2024-04-26 15:48:22.522338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.935 [2024-04-26 15:48:22.522345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:111336 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007578000 len:0x1000 key:0x187000 00:19:33.935 [2024-04-26 15:48:22.522352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.935 [2024-04-26 15:48:22.522360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:111344 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007576000 len:0x1000 key:0x187000 00:19:33.935 [2024-04-26 15:48:22.522367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.935 [2024-04-26 15:48:22.522375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:111352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007546000 len:0x1000 key:0x187000 00:19:33.935 [2024-04-26 15:48:22.522382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.936 [2024-04-26 15:48:22.522390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:111360 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007548000 len:0x1000 key:0x187000 00:19:33.936 [2024-04-26 15:48:22.522396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.936 [2024-04-26 15:48:22.522404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:111368 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754a000 len:0x1000 key:0x187000 00:19:33.936 [2024-04-26 15:48:22.522410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.936 [2024-04-26 15:48:22.522418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:111376 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754c000 len:0x1000 key:0x187000 00:19:33.936 [2024-04-26 15:48:22.522425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.936 [2024-04-26 15:48:22.522433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:111384 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754e000 len:0x1000 key:0x187000 00:19:33.936 [2024-04-26 15:48:22.522439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.936 [2024-04-26 15:48:22.522447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:111392 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007550000 len:0x1000 key:0x187000 00:19:33.936 [2024-04-26 15:48:22.522453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.936 [2024-04-26 15:48:22.522461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:111400 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007552000 len:0x1000 key:0x187000 00:19:33.936 [2024-04-26 15:48:22.522467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.936 [2024-04-26 15:48:22.522475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:111408 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007554000 len:0x1000 key:0x187000 00:19:33.936 [2024-04-26 15:48:22.522482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.936 [2024-04-26 15:48:22.522490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:111864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.936 [2024-04-26 15:48:22.522496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.936 [2024-04-26 15:48:22.522504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:111872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.936 [2024-04-26 15:48:22.522510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.936 [2024-04-26 15:48:22.522517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:111880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.936 [2024-04-26 15:48:22.522523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.936 [2024-04-26 15:48:22.522533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:111888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.936 [2024-04-26 15:48:22.522539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.936 [2024-04-26 15:48:22.522547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:111896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.936 [2024-04-26 15:48:22.522553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.936 [2024-04-26 15:48:22.522560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:111904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.936 [2024-04-26 15:48:22.522567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.936 [2024-04-26 15:48:22.522574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:111912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.936 [2024-04-26 15:48:22.522581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.936 [2024-04-26 15:48:22.522589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:111920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.936 [2024-04-26 15:48:22.522595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.936 [2024-04-26 15:48:22.522603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:111928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.936 [2024-04-26 15:48:22.522610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.936 [2024-04-26 15:48:22.522617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:111936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.936 [2024-04-26 15:48:22.522623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.936 [2024-04-26 15:48:22.522631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:111944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.936 [2024-04-26 15:48:22.522637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.936 [2024-04-26 15:48:22.522645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:111952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.936 [2024-04-26 15:48:22.522651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.936 [2024-04-26 15:48:22.522659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:111960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.936 [2024-04-26 15:48:22.522665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.936 [2024-04-26 15:48:22.522672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:111968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.936 [2024-04-26 15:48:22.522678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.936 [2024-04-26 15:48:22.522686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:111976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.936 [2024-04-26 15:48:22.522693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.936 [2024-04-26 15:48:22.522702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:111984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.936 [2024-04-26 15:48:22.522708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.936 [2024-04-26 15:48:22.522716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:111416 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007536000 len:0x1000 key:0x187000 00:19:33.936 [2024-04-26 15:48:22.522722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.936 [2024-04-26 15:48:22.522730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:111424 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007538000 len:0x1000 key:0x187000 00:19:33.936 [2024-04-26 15:48:22.522737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.936 [2024-04-26 15:48:22.522745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:111432 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753a000 len:0x1000 key:0x187000 00:19:33.936 [2024-04-26 15:48:22.522751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.936 [2024-04-26 15:48:22.522759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:111440 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753c000 len:0x1000 key:0x187000 00:19:33.936 [2024-04-26 15:48:22.522765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.936 [2024-04-26 15:48:22.522773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:111448 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753e000 len:0x1000 key:0x187000 00:19:33.936 [2024-04-26 15:48:22.522779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.936 [2024-04-26 15:48:22.522787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:111456 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007540000 len:0x1000 key:0x187000 00:19:33.936 [2024-04-26 15:48:22.522793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.936 [2024-04-26 15:48:22.522803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:111464 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007542000 len:0x1000 key:0x187000 00:19:33.936 [2024-04-26 15:48:22.522809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.936 [2024-04-26 15:48:22.522817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:111472 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007544000 len:0x1000 key:0x187000 00:19:33.936 [2024-04-26 15:48:22.522824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.936 [2024-04-26 15:48:22.524682] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:19:33.936 [2024-04-26 15:48:22.524695] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:19:33.936 [2024-04-26 15:48:22.524705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:111992 len:8 PRP1 0x0 PRP2 0x0 00:19:33.936 [2024-04-26 15:48:22.524712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:19:33.936 [2024-04-26 15:48:22.524748] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192e4940 was disconnected and freed. reset controller. 00:19:33.936 [2024-04-26 15:48:22.524757] bdev_nvme.c:1857:bdev_nvme_failover_trid: *NOTICE*: Start failover from 192.168.100.8:4421 to 192.168.100.8:4422 00:19:33.936 [2024-04-26 15:48:22.524764] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:19:33.936 [2024-04-26 15:48:22.527545] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:19:33.936 [2024-04-26 15:48:22.542070] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:19:33.936 [2024-04-26 15:48:22.584741] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:33.936 [2024-04-26 15:48:26.887191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:82656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.936 [2024-04-26 15:48:26.887232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.936 [2024-04-26 15:48:26.887248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:82664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.936 [2024-04-26 15:48:26.887256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.936 [2024-04-26 15:48:26.887264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:82672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.937 [2024-04-26 15:48:26.887271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:82680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.937 [2024-04-26 15:48:26.887287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:82688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.937 [2024-04-26 15:48:26.887301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:82696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.937 [2024-04-26 15:48:26.887317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:82704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.937 [2024-04-26 15:48:26.887332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:82712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.937 [2024-04-26 15:48:26.887347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:82720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.937 [2024-04-26 15:48:26.887362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:82728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.937 [2024-04-26 15:48:26.887376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:82736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.937 [2024-04-26 15:48:26.887391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:82744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.937 [2024-04-26 15:48:26.887410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:82752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.937 [2024-04-26 15:48:26.887425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:82760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.937 [2024-04-26 15:48:26.887442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:82768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.937 [2024-04-26 15:48:26.887456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:82776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.937 [2024-04-26 15:48:26.887472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:82784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.937 [2024-04-26 15:48:26.887487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:82792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.937 [2024-04-26 15:48:26.887504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:82800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.937 [2024-04-26 15:48:26.887519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:82808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.937 [2024-04-26 15:48:26.887534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:82816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.937 [2024-04-26 15:48:26.887547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:82824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.937 [2024-04-26 15:48:26.887561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:82832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.937 [2024-04-26 15:48:26.887575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:82840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.937 [2024-04-26 15:48:26.887590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:82848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.937 [2024-04-26 15:48:26.887604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:82856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.937 [2024-04-26 15:48:26.887619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:82864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.937 [2024-04-26 15:48:26.887633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:82424 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007576000 len:0x1000 key:0x187000 00:19:33.937 [2024-04-26 15:48:26.887647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:82432 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007578000 len:0x1000 key:0x187000 00:19:33.937 [2024-04-26 15:48:26.887663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:82440 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757a000 len:0x1000 key:0x187000 00:19:33.937 [2024-04-26 15:48:26.887677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:82872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.937 [2024-04-26 15:48:26.887691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:82880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.937 [2024-04-26 15:48:26.887705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:82888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.937 [2024-04-26 15:48:26.887718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:82896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.937 [2024-04-26 15:48:26.887732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:82904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.937 [2024-04-26 15:48:26.887747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:82912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.937 [2024-04-26 15:48:26.887763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:82920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.937 [2024-04-26 15:48:26.887777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:82928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.937 [2024-04-26 15:48:26.887791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:82936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.937 [2024-04-26 15:48:26.887805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:82944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.937 [2024-04-26 15:48:26.887820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:82952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.937 [2024-04-26 15:48:26.887835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.937 [2024-04-26 15:48:26.887843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:82960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.938 [2024-04-26 15:48:26.887849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.938 [2024-04-26 15:48:26.887857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:82968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.938 [2024-04-26 15:48:26.887863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.938 [2024-04-26 15:48:26.887871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:82976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.938 [2024-04-26 15:48:26.887877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.938 [2024-04-26 15:48:26.887884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:82984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.938 [2024-04-26 15:48:26.887890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.938 [2024-04-26 15:48:26.887898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:82992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.938 [2024-04-26 15:48:26.887905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.938 [2024-04-26 15:48:26.887912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:83000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.938 [2024-04-26 15:48:26.887918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.938 [2024-04-26 15:48:26.887926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:83008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.938 [2024-04-26 15:48:26.887933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.938 [2024-04-26 15:48:26.887941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:83016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.938 [2024-04-26 15:48:26.887947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.938 [2024-04-26 15:48:26.887955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:83024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.938 [2024-04-26 15:48:26.887961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.938 [2024-04-26 15:48:26.887969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:83032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.938 [2024-04-26 15:48:26.887975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.938 [2024-04-26 15:48:26.887983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:83040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.938 [2024-04-26 15:48:26.887989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.938 [2024-04-26 15:48:26.887997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:83048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.938 [2024-04-26 15:48:26.888003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.938 [2024-04-26 15:48:26.888011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:83056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.938 [2024-04-26 15:48:26.888017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.938 [2024-04-26 15:48:26.888025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:82448 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759c000 len:0x1000 key:0x187000 00:19:33.938 [2024-04-26 15:48:26.888031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.938 [2024-04-26 15:48:26.888040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:82456 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759e000 len:0x1000 key:0x187000 00:19:33.938 [2024-04-26 15:48:26.888046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.938 [2024-04-26 15:48:26.888054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:82464 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759a000 len:0x1000 key:0x187000 00:19:33.938 [2024-04-26 15:48:26.888060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.938 [2024-04-26 15:48:26.888068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:82472 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007598000 len:0x1000 key:0x187000 00:19:33.938 [2024-04-26 15:48:26.888074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.938 [2024-04-26 15:48:26.888082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:82480 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007596000 len:0x1000 key:0x187000 00:19:33.938 [2024-04-26 15:48:26.888088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.938 [2024-04-26 15:48:26.888096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:83064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.938 [2024-04-26 15:48:26.888104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.938 [2024-04-26 15:48:26.888112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:83072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.938 [2024-04-26 15:48:26.888118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.938 [2024-04-26 15:48:26.888126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:83080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.938 [2024-04-26 15:48:26.888132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.938 [2024-04-26 15:48:26.888139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:83088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.938 [2024-04-26 15:48:26.888149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.938 [2024-04-26 15:48:26.888156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:83096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.938 [2024-04-26 15:48:26.888162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.938 [2024-04-26 15:48:26.888170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:83104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.938 [2024-04-26 15:48:26.888176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.938 [2024-04-26 15:48:26.888183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:83112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.938 [2024-04-26 15:48:26.888189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.938 [2024-04-26 15:48:26.888197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:83120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.938 [2024-04-26 15:48:26.888203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.938 [2024-04-26 15:48:26.888211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:82488 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007526000 len:0x1000 key:0x187000 00:19:33.938 [2024-04-26 15:48:26.888218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.938 [2024-04-26 15:48:26.888226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:82496 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007528000 len:0x1000 key:0x187000 00:19:33.938 [2024-04-26 15:48:26.888232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.938 [2024-04-26 15:48:26.888240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:82504 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000752a000 len:0x1000 key:0x187000 00:19:33.938 [2024-04-26 15:48:26.888246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.938 [2024-04-26 15:48:26.888254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:82512 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757e000 len:0x1000 key:0x187000 00:19:33.938 [2024-04-26 15:48:26.888261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.938 [2024-04-26 15:48:26.888273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:82520 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757c000 len:0x1000 key:0x187000 00:19:33.938 [2024-04-26 15:48:26.888280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.938 [2024-04-26 15:48:26.888288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:82528 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007530000 len:0x1000 key:0x187000 00:19:33.938 [2024-04-26 15:48:26.888294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.938 [2024-04-26 15:48:26.888302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:82536 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007532000 len:0x1000 key:0x187000 00:19:33.939 [2024-04-26 15:48:26.888309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:82544 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007534000 len:0x1000 key:0x187000 00:19:33.939 [2024-04-26 15:48:26.888323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:82552 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a6000 len:0x1000 key:0x187000 00:19:33.939 [2024-04-26 15:48:26.888337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:82560 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a8000 len:0x1000 key:0x187000 00:19:33.939 [2024-04-26 15:48:26.888351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:82568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075aa000 len:0x1000 key:0x187000 00:19:33.939 [2024-04-26 15:48:26.888366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:82576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ac000 len:0x1000 key:0x187000 00:19:33.939 [2024-04-26 15:48:26.888379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:82584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ae000 len:0x1000 key:0x187000 00:19:33.939 [2024-04-26 15:48:26.888393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:82592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b0000 len:0x1000 key:0x187000 00:19:33.939 [2024-04-26 15:48:26.888407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:82600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b2000 len:0x1000 key:0x187000 00:19:33.939 [2024-04-26 15:48:26.888421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:82608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b4000 len:0x1000 key:0x187000 00:19:33.939 [2024-04-26 15:48:26.888437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:83128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.939 [2024-04-26 15:48:26.888451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:83136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.939 [2024-04-26 15:48:26.888465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:83144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.939 [2024-04-26 15:48:26.888478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:83152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.939 [2024-04-26 15:48:26.888492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:83160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.939 [2024-04-26 15:48:26.888506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:83168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.939 [2024-04-26 15:48:26.888520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:83176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.939 [2024-04-26 15:48:26.888533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:83184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.939 [2024-04-26 15:48:26.888547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:83192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.939 [2024-04-26 15:48:26.888561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:83200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.939 [2024-04-26 15:48:26.888574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:83208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.939 [2024-04-26 15:48:26.888589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:83216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.939 [2024-04-26 15:48:26.888604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:83224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.939 [2024-04-26 15:48:26.888618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:83232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.939 [2024-04-26 15:48:26.888632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:83240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.939 [2024-04-26 15:48:26.888646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:83248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.939 [2024-04-26 15:48:26.888659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:83256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.939 [2024-04-26 15:48:26.888673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:83264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.939 [2024-04-26 15:48:26.888687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:83272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.939 [2024-04-26 15:48:26.888700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:83280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.939 [2024-04-26 15:48:26.888715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:83288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.939 [2024-04-26 15:48:26.888729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:83296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.939 [2024-04-26 15:48:26.888742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:83304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.939 [2024-04-26 15:48:26.888756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:83312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.939 [2024-04-26 15:48:26.888769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:83320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.939 [2024-04-26 15:48:26.888786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:83328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.939 [2024-04-26 15:48:26.888800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:83336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.939 [2024-04-26 15:48:26.888815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:83344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.939 [2024-04-26 15:48:26.888829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.939 [2024-04-26 15:48:26.888837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:83352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.939 [2024-04-26 15:48:26.888843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.940 [2024-04-26 15:48:26.888851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:83360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.940 [2024-04-26 15:48:26.888857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.940 [2024-04-26 15:48:26.888865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:83368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.940 [2024-04-26 15:48:26.888872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.940 [2024-04-26 15:48:26.888879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:83376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.940 [2024-04-26 15:48:26.888885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.940 [2024-04-26 15:48:26.888893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:83384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.940 [2024-04-26 15:48:26.888899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.940 [2024-04-26 15:48:26.888907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:83392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.940 [2024-04-26 15:48:26.888913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.940 [2024-04-26 15:48:26.888920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:83400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.940 [2024-04-26 15:48:26.888927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.940 [2024-04-26 15:48:26.888934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:83408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.940 [2024-04-26 15:48:26.888940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.940 [2024-04-26 15:48:26.888949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:83416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.940 [2024-04-26 15:48:26.888955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.940 [2024-04-26 15:48:26.888963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:83424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.940 [2024-04-26 15:48:26.888970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.940 [2024-04-26 15:48:26.888977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:83432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.940 [2024-04-26 15:48:26.888984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.940 [2024-04-26 15:48:26.888991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:83440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:19:33.940 [2024-04-26 15:48:26.888997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.940 [2024-04-26 15:48:26.889005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:82616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007566000 len:0x1000 key:0x187000 00:19:33.940 [2024-04-26 15:48:26.889011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.940 [2024-04-26 15:48:26.889019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:82624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007568000 len:0x1000 key:0x187000 00:19:33.940 [2024-04-26 15:48:26.889025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.940 [2024-04-26 15:48:26.889033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:82632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756a000 len:0x1000 key:0x187000 00:19:33.940 [2024-04-26 15:48:26.889040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.940 [2024-04-26 15:48:26.889047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:82640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756c000 len:0x1000 key:0x187000 00:19:33.940 [2024-04-26 15:48:26.889053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32766 cdw0:3eff200 sqhd:15c0 p:0 m:0 dnr:0 00:19:33.940 [2024-04-26 15:48:26.890858] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:19:33.940 [2024-04-26 15:48:26.890870] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:19:33.940 [2024-04-26 15:48:26.890877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:82648 len:8 PRP1 0x0 PRP2 0x0 00:19:33.940 [2024-04-26 15:48:26.890883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:19:33.940 [2024-04-26 15:48:26.890921] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192e4940 was disconnected and freed. reset controller. 00:19:33.940 [2024-04-26 15:48:26.890930] bdev_nvme.c:1857:bdev_nvme_failover_trid: *NOTICE*: Start failover from 192.168.100.8:4422 to 192.168.100.8:4420 00:19:33.940 [2024-04-26 15:48:26.890937] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:19:33.940 [2024-04-26 15:48:26.893713] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:19:33.940 [2024-04-26 15:48:26.907971] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:19:33.940 [2024-04-26 15:48:26.949181] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:33.940 00:19:33.940 Latency(us) 00:19:33.940 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:33.940 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:19:33.940 Verification LBA range: start 0x0 length 0x4000 00:19:33.940 NVMe0n1 : 15.00 14394.95 56.23 287.71 0.00 8694.69 339.38 1046578.71 00:19:33.940 =================================================================================================================== 00:19:33.940 Total : 14394.95 56.23 287.71 0.00 8694.69 339.38 1046578.71 00:19:33.940 Received shutdown signal, test time was about 15.000000 seconds 00:19:33.940 00:19:33.940 Latency(us) 00:19:33.940 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:33.940 =================================================================================================================== 00:19:33.940 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:19:33.940 15:48:32 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:19:33.940 15:48:32 -- host/failover.sh@65 -- # count=3 00:19:33.940 15:48:32 -- host/failover.sh@67 -- # (( count != 3 )) 00:19:33.940 15:48:32 -- host/failover.sh@73 -- # bdevperf_pid=3391953 00:19:33.940 15:48:32 -- host/failover.sh@75 -- # waitforlisten 3391953 /var/tmp/bdevperf.sock 00:19:33.940 15:48:32 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:19:33.940 15:48:32 -- common/autotest_common.sh@817 -- # '[' -z 3391953 ']' 00:19:33.940 15:48:32 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:19:33.940 15:48:32 -- common/autotest_common.sh@822 -- # local max_retries=100 00:19:33.940 15:48:32 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:19:33.940 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:19:33.940 15:48:32 -- common/autotest_common.sh@826 -- # xtrace_disable 00:19:33.940 15:48:32 -- common/autotest_common.sh@10 -- # set +x 00:19:34.870 15:48:33 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:19:34.870 15:48:33 -- common/autotest_common.sh@850 -- # return 0 00:19:34.870 15:48:33 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4421 00:19:34.870 [2024-04-26 15:48:33.375268] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4421 *** 00:19:34.870 15:48:33 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4422 00:19:35.127 [2024-04-26 15:48:33.559912] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4422 *** 00:19:35.127 15:48:33 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:19:35.383 NVMe0n1 00:19:35.383 15:48:33 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:19:35.641 00:19:35.641 15:48:34 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:19:35.897 00:19:35.897 15:48:34 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:19:35.897 15:48:34 -- host/failover.sh@82 -- # grep -q NVMe0 00:19:35.898 15:48:34 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:19:36.154 15:48:34 -- host/failover.sh@87 -- # sleep 3 00:19:39.425 15:48:37 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:19:39.425 15:48:37 -- host/failover.sh@88 -- # grep -q NVMe0 00:19:39.425 15:48:37 -- host/failover.sh@90 -- # run_test_pid=3392876 00:19:39.425 15:48:37 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:19:39.425 15:48:37 -- host/failover.sh@92 -- # wait 3392876 00:19:40.356 0 00:19:40.614 15:48:38 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/try.txt 00:19:40.614 [2024-04-26 15:48:32.394729] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:19:40.614 [2024-04-26 15:48:32.394795] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3391953 ] 00:19:40.614 EAL: No free 2048 kB hugepages reported on node 1 00:19:40.614 [2024-04-26 15:48:32.452489] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:40.614 [2024-04-26 15:48:32.518433] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:40.614 [2024-04-26 15:48:34.653282] bdev_nvme.c:1857:bdev_nvme_failover_trid: *NOTICE*: Start failover from 192.168.100.8:4420 to 192.168.100.8:4421 00:19:40.614 [2024-04-26 15:48:34.653871] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:19:40.614 [2024-04-26 15:48:34.653901] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:19:40.614 [2024-04-26 15:48:34.677869] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:19:40.614 [2024-04-26 15:48:34.694966] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:40.614 Running I/O for 1 seconds... 00:19:40.614 00:19:40.614 Latency(us) 00:19:40.614 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:40.614 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:19:40.614 Verification LBA range: start 0x0 length 0x4000 00:19:40.614 NVMe0n1 : 1.00 18090.50 70.67 0.00 0.00 7036.58 2527.82 13981.01 00:19:40.614 =================================================================================================================== 00:19:40.614 Total : 18090.50 70.67 0.00 0.00 7036.58 2527.82 13981.01 00:19:40.614 15:48:38 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:19:40.614 15:48:38 -- host/failover.sh@95 -- # grep -q NVMe0 00:19:40.614 15:48:39 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t rdma -a 192.168.100.8 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:19:40.871 15:48:39 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:19:40.871 15:48:39 -- host/failover.sh@99 -- # grep -q NVMe0 00:19:41.130 15:48:39 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t rdma -a 192.168.100.8 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:19:41.130 15:48:39 -- host/failover.sh@101 -- # sleep 3 00:19:44.405 15:48:42 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:19:44.405 15:48:42 -- host/failover.sh@103 -- # grep -q NVMe0 00:19:44.405 15:48:42 -- host/failover.sh@108 -- # killprocess 3391953 00:19:44.405 15:48:42 -- common/autotest_common.sh@936 -- # '[' -z 3391953 ']' 00:19:44.405 15:48:42 -- common/autotest_common.sh@940 -- # kill -0 3391953 00:19:44.405 15:48:42 -- common/autotest_common.sh@941 -- # uname 00:19:44.405 15:48:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:44.405 15:48:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3391953 00:19:44.405 15:48:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:44.405 15:48:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:44.405 15:48:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3391953' 00:19:44.405 killing process with pid 3391953 00:19:44.405 15:48:42 -- common/autotest_common.sh@955 -- # kill 3391953 00:19:44.405 15:48:42 -- common/autotest_common.sh@960 -- # wait 3391953 00:19:44.663 15:48:43 -- host/failover.sh@110 -- # sync 00:19:44.663 15:48:43 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:44.919 15:48:43 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:19:44.919 15:48:43 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/try.txt 00:19:44.919 15:48:43 -- host/failover.sh@116 -- # nvmftestfini 00:19:44.919 15:48:43 -- nvmf/common.sh@477 -- # nvmfcleanup 00:19:44.919 15:48:43 -- nvmf/common.sh@117 -- # sync 00:19:44.919 15:48:43 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:19:44.919 15:48:43 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:19:44.919 15:48:43 -- nvmf/common.sh@120 -- # set +e 00:19:44.919 15:48:43 -- nvmf/common.sh@121 -- # for i in {1..20} 00:19:44.919 15:48:43 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:19:44.919 rmmod nvme_rdma 00:19:44.920 rmmod nvme_fabrics 00:19:44.920 15:48:43 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:19:44.920 15:48:43 -- nvmf/common.sh@124 -- # set -e 00:19:44.920 15:48:43 -- nvmf/common.sh@125 -- # return 0 00:19:44.920 15:48:43 -- nvmf/common.sh@478 -- # '[' -n 3388713 ']' 00:19:44.920 15:48:43 -- nvmf/common.sh@479 -- # killprocess 3388713 00:19:44.920 15:48:43 -- common/autotest_common.sh@936 -- # '[' -z 3388713 ']' 00:19:44.920 15:48:43 -- common/autotest_common.sh@940 -- # kill -0 3388713 00:19:44.920 15:48:43 -- common/autotest_common.sh@941 -- # uname 00:19:44.920 15:48:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:44.920 15:48:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3388713 00:19:44.920 15:48:43 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:19:44.920 15:48:43 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:19:44.920 15:48:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3388713' 00:19:44.920 killing process with pid 3388713 00:19:44.920 15:48:43 -- common/autotest_common.sh@955 -- # kill 3388713 00:19:44.920 15:48:43 -- common/autotest_common.sh@960 -- # wait 3388713 00:19:44.920 [2024-04-26 15:48:43.492107] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:19:45.177 15:48:43 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:19:45.177 15:48:43 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:19:45.177 00:19:45.177 real 0m35.637s 00:19:45.177 user 2m3.528s 00:19:45.177 sys 0m5.778s 00:19:45.177 15:48:43 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:19:45.177 15:48:43 -- common/autotest_common.sh@10 -- # set +x 00:19:45.177 ************************************ 00:19:45.177 END TEST nvmf_failover 00:19:45.177 ************************************ 00:19:45.177 15:48:43 -- nvmf/nvmf.sh@99 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=rdma 00:19:45.177 15:48:43 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:45.177 15:48:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:45.177 15:48:43 -- common/autotest_common.sh@10 -- # set +x 00:19:45.435 ************************************ 00:19:45.435 START TEST nvmf_discovery 00:19:45.435 ************************************ 00:19:45.435 15:48:43 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=rdma 00:19:45.435 * Looking for test storage... 00:19:45.435 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:19:45.435 15:48:43 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:19:45.435 15:48:43 -- nvmf/common.sh@7 -- # uname -s 00:19:45.435 15:48:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:45.435 15:48:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:45.435 15:48:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:45.435 15:48:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:45.435 15:48:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:45.435 15:48:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:45.435 15:48:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:45.435 15:48:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:45.435 15:48:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:45.435 15:48:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:45.435 15:48:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:19:45.435 15:48:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:19:45.435 15:48:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:45.435 15:48:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:45.435 15:48:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:45.435 15:48:43 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:19:45.435 15:48:43 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:19:45.435 15:48:43 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:45.435 15:48:43 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:45.435 15:48:43 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:45.435 15:48:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:45.435 15:48:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:45.435 15:48:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:45.435 15:48:43 -- paths/export.sh@5 -- # export PATH 00:19:45.435 15:48:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:45.435 15:48:43 -- nvmf/common.sh@47 -- # : 0 00:19:45.435 15:48:43 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:19:45.435 15:48:43 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:19:45.435 15:48:43 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:19:45.435 15:48:43 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:45.435 15:48:43 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:45.435 15:48:43 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:19:45.435 15:48:44 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:19:45.435 15:48:44 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:19:45.435 15:48:44 -- host/discovery.sh@11 -- # '[' rdma == rdma ']' 00:19:45.445 15:48:44 -- host/discovery.sh@12 -- # echo 'Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target.' 00:19:45.445 Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target. 00:19:45.445 15:48:44 -- host/discovery.sh@13 -- # exit 0 00:19:45.445 00:19:45.445 real 0m0.122s 00:19:45.445 user 0m0.059s 00:19:45.445 sys 0m0.071s 00:19:45.445 15:48:44 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:19:45.445 15:48:44 -- common/autotest_common.sh@10 -- # set +x 00:19:45.445 ************************************ 00:19:45.445 END TEST nvmf_discovery 00:19:45.445 ************************************ 00:19:45.703 15:48:44 -- nvmf/nvmf.sh@100 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=rdma 00:19:45.703 15:48:44 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:45.703 15:48:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:45.703 15:48:44 -- common/autotest_common.sh@10 -- # set +x 00:19:45.703 ************************************ 00:19:45.703 START TEST nvmf_discovery_remove_ifc 00:19:45.703 ************************************ 00:19:45.703 15:48:44 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=rdma 00:19:45.703 * Looking for test storage... 00:19:45.703 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:19:45.703 15:48:44 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:19:45.703 15:48:44 -- nvmf/common.sh@7 -- # uname -s 00:19:45.703 15:48:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:45.703 15:48:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:45.703 15:48:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:45.703 15:48:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:45.704 15:48:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:45.704 15:48:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:45.704 15:48:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:45.704 15:48:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:45.704 15:48:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:45.704 15:48:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:45.704 15:48:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:19:45.704 15:48:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:19:45.704 15:48:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:45.704 15:48:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:45.704 15:48:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:45.704 15:48:44 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:19:45.704 15:48:44 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:19:45.704 15:48:44 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:45.704 15:48:44 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:45.704 15:48:44 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:45.704 15:48:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:45.704 15:48:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:45.704 15:48:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:45.704 15:48:44 -- paths/export.sh@5 -- # export PATH 00:19:45.704 15:48:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:45.704 15:48:44 -- nvmf/common.sh@47 -- # : 0 00:19:45.704 15:48:44 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:19:45.704 15:48:44 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:19:45.704 15:48:44 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:19:45.704 15:48:44 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:45.704 15:48:44 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:45.704 15:48:44 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:19:45.704 15:48:44 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:19:45.704 15:48:44 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:19:45.704 15:48:44 -- host/discovery_remove_ifc.sh@14 -- # '[' rdma == rdma ']' 00:19:45.704 15:48:44 -- host/discovery_remove_ifc.sh@15 -- # echo 'Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target.' 00:19:45.704 Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target. 00:19:45.704 15:48:44 -- host/discovery_remove_ifc.sh@16 -- # exit 0 00:19:45.704 00:19:45.704 real 0m0.121s 00:19:45.704 user 0m0.061s 00:19:45.704 sys 0m0.067s 00:19:45.704 15:48:44 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:19:45.704 15:48:44 -- common/autotest_common.sh@10 -- # set +x 00:19:45.704 ************************************ 00:19:45.704 END TEST nvmf_discovery_remove_ifc 00:19:45.704 ************************************ 00:19:45.962 15:48:44 -- nvmf/nvmf.sh@101 -- # run_test nvmf_identify_kernel_target /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/identify_kernel_nvmf.sh --transport=rdma 00:19:45.962 15:48:44 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:45.962 15:48:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:45.962 15:48:44 -- common/autotest_common.sh@10 -- # set +x 00:19:45.962 ************************************ 00:19:45.962 START TEST nvmf_identify_kernel_target 00:19:45.962 ************************************ 00:19:45.962 15:48:44 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/identify_kernel_nvmf.sh --transport=rdma 00:19:45.962 * Looking for test storage... 00:19:45.962 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:19:45.962 15:48:44 -- host/identify_kernel_nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:19:45.962 15:48:44 -- nvmf/common.sh@7 -- # uname -s 00:19:45.962 15:48:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:45.962 15:48:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:45.962 15:48:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:45.962 15:48:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:45.962 15:48:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:45.962 15:48:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:45.962 15:48:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:45.962 15:48:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:45.962 15:48:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:45.962 15:48:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:45.962 15:48:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:19:45.962 15:48:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:19:45.962 15:48:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:45.962 15:48:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:45.962 15:48:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:45.962 15:48:44 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:19:45.962 15:48:44 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:19:45.962 15:48:44 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:45.962 15:48:44 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:45.962 15:48:44 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:45.962 15:48:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:45.962 15:48:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:45.962 15:48:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:45.962 15:48:44 -- paths/export.sh@5 -- # export PATH 00:19:45.962 15:48:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:45.962 15:48:44 -- nvmf/common.sh@47 -- # : 0 00:19:45.962 15:48:44 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:19:45.962 15:48:44 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:19:45.962 15:48:44 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:19:46.220 15:48:44 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:46.220 15:48:44 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:46.220 15:48:44 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:19:46.220 15:48:44 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:19:46.220 15:48:44 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:19:46.220 15:48:44 -- host/identify_kernel_nvmf.sh@11 -- # nvmftestinit 00:19:46.220 15:48:44 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:19:46.220 15:48:44 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:46.220 15:48:44 -- nvmf/common.sh@437 -- # prepare_net_devs 00:19:46.220 15:48:44 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:19:46.220 15:48:44 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:19:46.220 15:48:44 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:46.220 15:48:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:46.220 15:48:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:46.220 15:48:44 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:19:46.220 15:48:44 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:19:46.220 15:48:44 -- nvmf/common.sh@285 -- # xtrace_disable 00:19:46.220 15:48:44 -- common/autotest_common.sh@10 -- # set +x 00:19:51.486 15:48:49 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:51.486 15:48:49 -- nvmf/common.sh@291 -- # pci_devs=() 00:19:51.486 15:48:49 -- nvmf/common.sh@291 -- # local -a pci_devs 00:19:51.486 15:48:49 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:19:51.486 15:48:49 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:19:51.486 15:48:49 -- nvmf/common.sh@293 -- # pci_drivers=() 00:19:51.486 15:48:49 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:19:51.486 15:48:49 -- nvmf/common.sh@295 -- # net_devs=() 00:19:51.486 15:48:49 -- nvmf/common.sh@295 -- # local -ga net_devs 00:19:51.486 15:48:49 -- nvmf/common.sh@296 -- # e810=() 00:19:51.486 15:48:49 -- nvmf/common.sh@296 -- # local -ga e810 00:19:51.486 15:48:49 -- nvmf/common.sh@297 -- # x722=() 00:19:51.486 15:48:49 -- nvmf/common.sh@297 -- # local -ga x722 00:19:51.486 15:48:49 -- nvmf/common.sh@298 -- # mlx=() 00:19:51.486 15:48:49 -- nvmf/common.sh@298 -- # local -ga mlx 00:19:51.486 15:48:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:51.486 15:48:49 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:51.486 15:48:49 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:51.486 15:48:49 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:51.486 15:48:49 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:51.486 15:48:49 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:51.486 15:48:49 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:51.486 15:48:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:51.486 15:48:49 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:51.486 15:48:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:51.486 15:48:49 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:51.486 15:48:49 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:19:51.486 15:48:49 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:19:51.486 15:48:49 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:19:51.486 15:48:49 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:19:51.486 15:48:49 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:19:51.486 15:48:49 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:19:51.486 15:48:49 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:19:51.486 15:48:49 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:51.486 15:48:49 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:19:51.486 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:19:51.486 15:48:49 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:51.486 15:48:49 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:51.486 15:48:49 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:51.486 15:48:49 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:51.486 15:48:49 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:51.486 15:48:49 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:51.486 15:48:49 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:51.486 15:48:49 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:19:51.486 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:19:51.486 15:48:49 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:51.486 15:48:49 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:51.486 15:48:49 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:51.486 15:48:49 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:51.486 15:48:49 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:51.486 15:48:49 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:51.486 15:48:49 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:19:51.486 15:48:49 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:19:51.486 15:48:49 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:51.486 15:48:49 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:51.486 15:48:49 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:51.486 15:48:49 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:51.486 15:48:49 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:19:51.486 Found net devices under 0000:da:00.0: mlx_0_0 00:19:51.486 15:48:49 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:51.486 15:48:49 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:51.486 15:48:49 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:51.486 15:48:49 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:51.486 15:48:49 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:51.486 15:48:49 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:19:51.486 Found net devices under 0000:da:00.1: mlx_0_1 00:19:51.486 15:48:49 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:51.486 15:48:49 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:19:51.486 15:48:49 -- nvmf/common.sh@403 -- # is_hw=yes 00:19:51.486 15:48:49 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:19:51.486 15:48:49 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:19:51.486 15:48:49 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:19:51.486 15:48:49 -- nvmf/common.sh@409 -- # rdma_device_init 00:19:51.486 15:48:49 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:19:51.486 15:48:49 -- nvmf/common.sh@58 -- # uname 00:19:51.486 15:48:49 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:19:51.486 15:48:49 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:19:51.486 15:48:49 -- nvmf/common.sh@63 -- # modprobe ib_core 00:19:51.486 15:48:49 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:19:51.486 15:48:49 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:19:51.486 15:48:49 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:19:51.486 15:48:49 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:19:51.486 15:48:49 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:19:51.486 15:48:49 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:19:51.486 15:48:49 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:19:51.486 15:48:49 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:19:51.486 15:48:49 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:51.486 15:48:49 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:51.486 15:48:49 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:51.486 15:48:49 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:51.486 15:48:49 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:51.486 15:48:49 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:51.486 15:48:49 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:51.486 15:48:49 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:51.486 15:48:49 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:51.486 15:48:49 -- nvmf/common.sh@105 -- # continue 2 00:19:51.486 15:48:49 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:51.486 15:48:49 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:51.486 15:48:49 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:51.486 15:48:49 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:51.486 15:48:49 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:51.487 15:48:49 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:51.487 15:48:49 -- nvmf/common.sh@105 -- # continue 2 00:19:51.487 15:48:49 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:51.487 15:48:49 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:19:51.487 15:48:49 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:51.487 15:48:49 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:51.487 15:48:49 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:51.487 15:48:49 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:51.487 15:48:49 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:19:51.487 15:48:49 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:19:51.487 15:48:49 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:19:51.487 122: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:51.487 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:19:51.487 altname enp218s0f0np0 00:19:51.487 altname ens818f0np0 00:19:51.487 inet 192.168.100.8/24 scope global mlx_0_0 00:19:51.487 valid_lft forever preferred_lft forever 00:19:51.487 15:48:49 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:51.487 15:48:49 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:19:51.487 15:48:49 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:51.487 15:48:49 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:51.487 15:48:49 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:51.487 15:48:49 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:51.487 15:48:49 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:19:51.487 15:48:49 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:19:51.487 15:48:49 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:19:51.487 123: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:51.487 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:19:51.487 altname enp218s0f1np1 00:19:51.487 altname ens818f1np1 00:19:51.487 inet 192.168.100.9/24 scope global mlx_0_1 00:19:51.487 valid_lft forever preferred_lft forever 00:19:51.487 15:48:49 -- nvmf/common.sh@411 -- # return 0 00:19:51.487 15:48:49 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:19:51.487 15:48:49 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:19:51.487 15:48:49 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:19:51.487 15:48:49 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:19:51.487 15:48:49 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:19:51.487 15:48:49 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:51.487 15:48:49 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:51.487 15:48:49 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:51.487 15:48:49 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:51.487 15:48:49 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:51.487 15:48:49 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:51.487 15:48:49 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:51.487 15:48:49 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:51.487 15:48:49 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:51.487 15:48:49 -- nvmf/common.sh@105 -- # continue 2 00:19:51.487 15:48:49 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:51.487 15:48:49 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:51.487 15:48:49 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:51.487 15:48:49 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:51.487 15:48:49 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:51.487 15:48:49 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:51.487 15:48:49 -- nvmf/common.sh@105 -- # continue 2 00:19:51.487 15:48:49 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:51.487 15:48:49 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:19:51.487 15:48:49 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:51.487 15:48:49 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:51.487 15:48:49 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:51.487 15:48:49 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:51.487 15:48:49 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:51.487 15:48:49 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:19:51.487 15:48:49 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:51.487 15:48:49 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:51.487 15:48:49 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:51.487 15:48:49 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:51.487 15:48:49 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:19:51.487 192.168.100.9' 00:19:51.487 15:48:49 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:19:51.487 192.168.100.9' 00:19:51.487 15:48:49 -- nvmf/common.sh@446 -- # head -n 1 00:19:51.487 15:48:49 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:19:51.487 15:48:49 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:19:51.487 192.168.100.9' 00:19:51.487 15:48:49 -- nvmf/common.sh@447 -- # tail -n +2 00:19:51.487 15:48:49 -- nvmf/common.sh@447 -- # head -n 1 00:19:51.487 15:48:49 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:19:51.487 15:48:49 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:19:51.487 15:48:49 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:19:51.487 15:48:49 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:19:51.487 15:48:49 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:19:51.487 15:48:49 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:19:51.487 15:48:49 -- host/identify_kernel_nvmf.sh@13 -- # trap 'nvmftestfini || :; clean_kernel_target' EXIT 00:19:51.487 15:48:49 -- host/identify_kernel_nvmf.sh@15 -- # get_main_ns_ip 00:19:51.487 15:48:49 -- nvmf/common.sh@717 -- # local ip 00:19:51.487 15:48:49 -- nvmf/common.sh@718 -- # ip_candidates=() 00:19:51.487 15:48:49 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:19:51.487 15:48:49 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:19:51.487 15:48:49 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:19:51.487 15:48:49 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:19:51.487 15:48:49 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:19:51.487 15:48:49 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:19:51.487 15:48:49 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:19:51.487 15:48:49 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:19:51.487 15:48:49 -- host/identify_kernel_nvmf.sh@15 -- # target_ip=192.168.100.8 00:19:51.487 15:48:49 -- host/identify_kernel_nvmf.sh@16 -- # configure_kernel_target nqn.2016-06.io.spdk:testnqn 192.168.100.8 00:19:51.487 15:48:49 -- nvmf/common.sh@621 -- # local kernel_name=nqn.2016-06.io.spdk:testnqn kernel_target_ip=192.168.100.8 00:19:51.487 15:48:49 -- nvmf/common.sh@623 -- # nvmet=/sys/kernel/config/nvmet 00:19:51.487 15:48:49 -- nvmf/common.sh@624 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:19:51.487 15:48:49 -- nvmf/common.sh@625 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:19:51.487 15:48:49 -- nvmf/common.sh@626 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:19:51.487 15:48:49 -- nvmf/common.sh@628 -- # local block nvme 00:19:51.487 15:48:49 -- nvmf/common.sh@630 -- # [[ ! -e /sys/module/nvmet ]] 00:19:51.487 15:48:49 -- nvmf/common.sh@631 -- # modprobe nvmet 00:19:51.487 15:48:49 -- nvmf/common.sh@634 -- # [[ -e /sys/kernel/config/nvmet ]] 00:19:51.487 15:48:49 -- nvmf/common.sh@636 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:19:54.018 Waiting for block devices as requested 00:19:54.018 0000:5f:00.0 (8086 0a54): vfio-pci -> nvme 00:19:54.018 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:19:54.018 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:19:54.018 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:19:54.018 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:19:54.018 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:19:54.018 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:19:54.276 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:19:54.276 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:19:54.276 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:19:54.276 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:19:54.534 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:19:54.534 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:19:54.534 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:19:54.791 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:19:54.791 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:19:54.791 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:19:54.791 15:48:53 -- nvmf/common.sh@639 -- # for block in /sys/block/nvme* 00:19:54.791 15:48:53 -- nvmf/common.sh@640 -- # [[ -e /sys/block/nvme0n1 ]] 00:19:54.791 15:48:53 -- nvmf/common.sh@641 -- # is_block_zoned nvme0n1 00:19:54.791 15:48:53 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:19:54.791 15:48:53 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:19:54.791 15:48:53 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:19:54.791 15:48:53 -- nvmf/common.sh@642 -- # block_in_use nvme0n1 00:19:54.791 15:48:53 -- scripts/common.sh@378 -- # local block=nvme0n1 pt 00:19:54.791 15:48:53 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:19:55.049 No valid GPT data, bailing 00:19:55.049 15:48:53 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:19:55.049 15:48:53 -- scripts/common.sh@391 -- # pt= 00:19:55.049 15:48:53 -- scripts/common.sh@392 -- # return 1 00:19:55.049 15:48:53 -- nvmf/common.sh@642 -- # nvme=/dev/nvme0n1 00:19:55.049 15:48:53 -- nvmf/common.sh@645 -- # [[ -b /dev/nvme0n1 ]] 00:19:55.049 15:48:53 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:19:55.049 15:48:53 -- nvmf/common.sh@648 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:19:55.049 15:48:53 -- nvmf/common.sh@649 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:19:55.049 15:48:53 -- nvmf/common.sh@654 -- # echo SPDK-nqn.2016-06.io.spdk:testnqn 00:19:55.049 15:48:53 -- nvmf/common.sh@656 -- # echo 1 00:19:55.049 15:48:53 -- nvmf/common.sh@657 -- # echo /dev/nvme0n1 00:19:55.049 15:48:53 -- nvmf/common.sh@658 -- # echo 1 00:19:55.049 15:48:53 -- nvmf/common.sh@660 -- # echo 192.168.100.8 00:19:55.049 15:48:53 -- nvmf/common.sh@661 -- # echo rdma 00:19:55.049 15:48:53 -- nvmf/common.sh@662 -- # echo 4420 00:19:55.049 15:48:53 -- nvmf/common.sh@663 -- # echo ipv4 00:19:55.049 15:48:53 -- nvmf/common.sh@666 -- # ln -s /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn /sys/kernel/config/nvmet/ports/1/subsystems/ 00:19:55.049 15:48:53 -- nvmf/common.sh@669 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -a 192.168.100.8 -t rdma -s 4420 00:19:55.049 00:19:55.049 Discovery Log Number of Records 2, Generation counter 2 00:19:55.049 =====Discovery Log Entry 0====== 00:19:55.049 trtype: rdma 00:19:55.049 adrfam: ipv4 00:19:55.049 subtype: current discovery subsystem 00:19:55.049 treq: not specified, sq flow control disable supported 00:19:55.049 portid: 1 00:19:55.049 trsvcid: 4420 00:19:55.049 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:19:55.049 traddr: 192.168.100.8 00:19:55.049 eflags: none 00:19:55.049 rdma_prtype: not specified 00:19:55.049 rdma_qptype: connected 00:19:55.049 rdma_cms: rdma-cm 00:19:55.049 rdma_pkey: 0x0000 00:19:55.049 =====Discovery Log Entry 1====== 00:19:55.049 trtype: rdma 00:19:55.049 adrfam: ipv4 00:19:55.049 subtype: nvme subsystem 00:19:55.049 treq: not specified, sq flow control disable supported 00:19:55.049 portid: 1 00:19:55.049 trsvcid: 4420 00:19:55.049 subnqn: nqn.2016-06.io.spdk:testnqn 00:19:55.049 traddr: 192.168.100.8 00:19:55.049 eflags: none 00:19:55.049 rdma_prtype: not specified 00:19:55.049 rdma_qptype: connected 00:19:55.049 rdma_cms: rdma-cm 00:19:55.049 rdma_pkey: 0x0000 00:19:55.049 15:48:53 -- host/identify_kernel_nvmf.sh@18 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 00:19:55.049 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' 00:19:55.308 EAL: No free 2048 kB hugepages reported on node 1 00:19:55.308 ===================================================== 00:19:55.308 NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2014-08.org.nvmexpress.discovery 00:19:55.308 ===================================================== 00:19:55.308 Controller Capabilities/Features 00:19:55.308 ================================ 00:19:55.308 Vendor ID: 0000 00:19:55.308 Subsystem Vendor ID: 0000 00:19:55.308 Serial Number: 81726dfe52c047b62584 00:19:55.308 Model Number: Linux 00:19:55.308 Firmware Version: 6.7.0-68 00:19:55.308 Recommended Arb Burst: 0 00:19:55.308 IEEE OUI Identifier: 00 00 00 00:19:55.308 Multi-path I/O 00:19:55.308 May have multiple subsystem ports: No 00:19:55.308 May have multiple controllers: No 00:19:55.308 Associated with SR-IOV VF: No 00:19:55.308 Max Data Transfer Size: Unlimited 00:19:55.308 Max Number of Namespaces: 0 00:19:55.308 Max Number of I/O Queues: 1024 00:19:55.308 NVMe Specification Version (VS): 1.3 00:19:55.308 NVMe Specification Version (Identify): 1.3 00:19:55.308 Maximum Queue Entries: 128 00:19:55.308 Contiguous Queues Required: No 00:19:55.308 Arbitration Mechanisms Supported 00:19:55.308 Weighted Round Robin: Not Supported 00:19:55.308 Vendor Specific: Not Supported 00:19:55.308 Reset Timeout: 7500 ms 00:19:55.308 Doorbell Stride: 4 bytes 00:19:55.308 NVM Subsystem Reset: Not Supported 00:19:55.308 Command Sets Supported 00:19:55.308 NVM Command Set: Supported 00:19:55.308 Boot Partition: Not Supported 00:19:55.308 Memory Page Size Minimum: 4096 bytes 00:19:55.308 Memory Page Size Maximum: 4096 bytes 00:19:55.308 Persistent Memory Region: Not Supported 00:19:55.308 Optional Asynchronous Events Supported 00:19:55.308 Namespace Attribute Notices: Not Supported 00:19:55.308 Firmware Activation Notices: Not Supported 00:19:55.308 ANA Change Notices: Not Supported 00:19:55.308 PLE Aggregate Log Change Notices: Not Supported 00:19:55.308 LBA Status Info Alert Notices: Not Supported 00:19:55.308 EGE Aggregate Log Change Notices: Not Supported 00:19:55.308 Normal NVM Subsystem Shutdown event: Not Supported 00:19:55.308 Zone Descriptor Change Notices: Not Supported 00:19:55.308 Discovery Log Change Notices: Supported 00:19:55.308 Controller Attributes 00:19:55.308 128-bit Host Identifier: Not Supported 00:19:55.308 Non-Operational Permissive Mode: Not Supported 00:19:55.308 NVM Sets: Not Supported 00:19:55.308 Read Recovery Levels: Not Supported 00:19:55.308 Endurance Groups: Not Supported 00:19:55.308 Predictable Latency Mode: Not Supported 00:19:55.308 Traffic Based Keep ALive: Not Supported 00:19:55.308 Namespace Granularity: Not Supported 00:19:55.308 SQ Associations: Not Supported 00:19:55.308 UUID List: Not Supported 00:19:55.308 Multi-Domain Subsystem: Not Supported 00:19:55.308 Fixed Capacity Management: Not Supported 00:19:55.308 Variable Capacity Management: Not Supported 00:19:55.308 Delete Endurance Group: Not Supported 00:19:55.308 Delete NVM Set: Not Supported 00:19:55.308 Extended LBA Formats Supported: Not Supported 00:19:55.308 Flexible Data Placement Supported: Not Supported 00:19:55.308 00:19:55.308 Controller Memory Buffer Support 00:19:55.308 ================================ 00:19:55.308 Supported: No 00:19:55.308 00:19:55.308 Persistent Memory Region Support 00:19:55.308 ================================ 00:19:55.308 Supported: No 00:19:55.308 00:19:55.308 Admin Command Set Attributes 00:19:55.308 ============================ 00:19:55.308 Security Send/Receive: Not Supported 00:19:55.308 Format NVM: Not Supported 00:19:55.308 Firmware Activate/Download: Not Supported 00:19:55.308 Namespace Management: Not Supported 00:19:55.308 Device Self-Test: Not Supported 00:19:55.308 Directives: Not Supported 00:19:55.308 NVMe-MI: Not Supported 00:19:55.308 Virtualization Management: Not Supported 00:19:55.308 Doorbell Buffer Config: Not Supported 00:19:55.308 Get LBA Status Capability: Not Supported 00:19:55.308 Command & Feature Lockdown Capability: Not Supported 00:19:55.308 Abort Command Limit: 1 00:19:55.308 Async Event Request Limit: 1 00:19:55.308 Number of Firmware Slots: N/A 00:19:55.308 Firmware Slot 1 Read-Only: N/A 00:19:55.308 Firmware Activation Without Reset: N/A 00:19:55.308 Multiple Update Detection Support: N/A 00:19:55.308 Firmware Update Granularity: No Information Provided 00:19:55.308 Per-Namespace SMART Log: No 00:19:55.308 Asymmetric Namespace Access Log Page: Not Supported 00:19:55.308 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:19:55.308 Command Effects Log Page: Not Supported 00:19:55.308 Get Log Page Extended Data: Supported 00:19:55.308 Telemetry Log Pages: Not Supported 00:19:55.309 Persistent Event Log Pages: Not Supported 00:19:55.309 Supported Log Pages Log Page: May Support 00:19:55.309 Commands Supported & Effects Log Page: Not Supported 00:19:55.309 Feature Identifiers & Effects Log Page:May Support 00:19:55.309 NVMe-MI Commands & Effects Log Page: May Support 00:19:55.309 Data Area 4 for Telemetry Log: Not Supported 00:19:55.309 Error Log Page Entries Supported: 1 00:19:55.309 Keep Alive: Not Supported 00:19:55.309 00:19:55.309 NVM Command Set Attributes 00:19:55.309 ========================== 00:19:55.309 Submission Queue Entry Size 00:19:55.309 Max: 1 00:19:55.309 Min: 1 00:19:55.309 Completion Queue Entry Size 00:19:55.309 Max: 1 00:19:55.309 Min: 1 00:19:55.309 Number of Namespaces: 0 00:19:55.309 Compare Command: Not Supported 00:19:55.309 Write Uncorrectable Command: Not Supported 00:19:55.309 Dataset Management Command: Not Supported 00:19:55.309 Write Zeroes Command: Not Supported 00:19:55.309 Set Features Save Field: Not Supported 00:19:55.309 Reservations: Not Supported 00:19:55.309 Timestamp: Not Supported 00:19:55.309 Copy: Not Supported 00:19:55.309 Volatile Write Cache: Not Present 00:19:55.309 Atomic Write Unit (Normal): 1 00:19:55.309 Atomic Write Unit (PFail): 1 00:19:55.309 Atomic Compare & Write Unit: 1 00:19:55.309 Fused Compare & Write: Not Supported 00:19:55.309 Scatter-Gather List 00:19:55.309 SGL Command Set: Supported 00:19:55.309 SGL Keyed: Supported 00:19:55.309 SGL Bit Bucket Descriptor: Not Supported 00:19:55.309 SGL Metadata Pointer: Not Supported 00:19:55.309 Oversized SGL: Not Supported 00:19:55.309 SGL Metadata Address: Not Supported 00:19:55.309 SGL Offset: Supported 00:19:55.309 Transport SGL Data Block: Not Supported 00:19:55.309 Replay Protected Memory Block: Not Supported 00:19:55.309 00:19:55.309 Firmware Slot Information 00:19:55.309 ========================= 00:19:55.309 Active slot: 0 00:19:55.309 00:19:55.309 00:19:55.309 Error Log 00:19:55.309 ========= 00:19:55.309 00:19:55.309 Active Namespaces 00:19:55.309 ================= 00:19:55.309 Discovery Log Page 00:19:55.309 ================== 00:19:55.309 Generation Counter: 2 00:19:55.309 Number of Records: 2 00:19:55.309 Record Format: 0 00:19:55.309 00:19:55.309 Discovery Log Entry 0 00:19:55.309 ---------------------- 00:19:55.309 Transport Type: 1 (RDMA) 00:19:55.309 Address Family: 1 (IPv4) 00:19:55.309 Subsystem Type: 3 (Current Discovery Subsystem) 00:19:55.309 Entry Flags: 00:19:55.309 Duplicate Returned Information: 0 00:19:55.309 Explicit Persistent Connection Support for Discovery: 0 00:19:55.309 Transport Requirements: 00:19:55.309 Secure Channel: Not Specified 00:19:55.309 Port ID: 1 (0x0001) 00:19:55.309 Controller ID: 65535 (0xffff) 00:19:55.309 Admin Max SQ Size: 32 00:19:55.309 Transport Service Identifier: 4420 00:19:55.309 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:19:55.309 Transport Address: 192.168.100.8 00:19:55.309 Transport Specific Address Subtype - RDMA 00:19:55.309 RDMA QP Service Type: 1 (Reliable Connected) 00:19:55.309 RDMA Provider Type: 1 (No provider specified) 00:19:55.309 RDMA CM Service: 1 (RDMA_CM) 00:19:55.309 Discovery Log Entry 1 00:19:55.309 ---------------------- 00:19:55.309 Transport Type: 1 (RDMA) 00:19:55.309 Address Family: 1 (IPv4) 00:19:55.309 Subsystem Type: 2 (NVM Subsystem) 00:19:55.309 Entry Flags: 00:19:55.309 Duplicate Returned Information: 0 00:19:55.309 Explicit Persistent Connection Support for Discovery: 0 00:19:55.309 Transport Requirements: 00:19:55.309 Secure Channel: Not Specified 00:19:55.309 Port ID: 1 (0x0001) 00:19:55.309 Controller ID: 65535 (0xffff) 00:19:55.309 Admin Max SQ Size: 32 00:19:55.309 Transport Service Identifier: 4420 00:19:55.309 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:testnqn 00:19:55.309 Transport Address: 192.168.100.8 00:19:55.309 Transport Specific Address Subtype - RDMA 00:19:55.309 RDMA QP Service Type: 1 (Reliable Connected) 00:19:55.309 RDMA Provider Type: 1 (No provider specified) 00:19:55.309 RDMA CM Service: 1 (RDMA_CM) 00:19:55.309 15:48:53 -- host/identify_kernel_nvmf.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:testnqn' 00:19:55.309 EAL: No free 2048 kB hugepages reported on node 1 00:19:55.309 get_feature(0x01) failed 00:19:55.309 get_feature(0x02) failed 00:19:55.309 get_feature(0x04) failed 00:19:55.309 ===================================================== 00:19:55.309 NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:testnqn 00:19:55.309 ===================================================== 00:19:55.309 Controller Capabilities/Features 00:19:55.309 ================================ 00:19:55.309 Vendor ID: 0000 00:19:55.309 Subsystem Vendor ID: 0000 00:19:55.309 Serial Number: 43ddc5ce843adc1c6a18 00:19:55.309 Model Number: SPDK-nqn.2016-06.io.spdk:testnqn 00:19:55.309 Firmware Version: 6.7.0-68 00:19:55.309 Recommended Arb Burst: 6 00:19:55.309 IEEE OUI Identifier: 00 00 00 00:19:55.309 Multi-path I/O 00:19:55.309 May have multiple subsystem ports: Yes 00:19:55.309 May have multiple controllers: Yes 00:19:55.309 Associated with SR-IOV VF: No 00:19:55.309 Max Data Transfer Size: 1048576 00:19:55.309 Max Number of Namespaces: 1024 00:19:55.309 Max Number of I/O Queues: 128 00:19:55.309 NVMe Specification Version (VS): 1.3 00:19:55.309 NVMe Specification Version (Identify): 1.3 00:19:55.309 Maximum Queue Entries: 128 00:19:55.309 Contiguous Queues Required: No 00:19:55.309 Arbitration Mechanisms Supported 00:19:55.309 Weighted Round Robin: Not Supported 00:19:55.309 Vendor Specific: Not Supported 00:19:55.309 Reset Timeout: 7500 ms 00:19:55.309 Doorbell Stride: 4 bytes 00:19:55.309 NVM Subsystem Reset: Not Supported 00:19:55.309 Command Sets Supported 00:19:55.309 NVM Command Set: Supported 00:19:55.309 Boot Partition: Not Supported 00:19:55.309 Memory Page Size Minimum: 4096 bytes 00:19:55.309 Memory Page Size Maximum: 4096 bytes 00:19:55.309 Persistent Memory Region: Not Supported 00:19:55.309 Optional Asynchronous Events Supported 00:19:55.309 Namespace Attribute Notices: Supported 00:19:55.309 Firmware Activation Notices: Not Supported 00:19:55.309 ANA Change Notices: Supported 00:19:55.309 PLE Aggregate Log Change Notices: Not Supported 00:19:55.309 LBA Status Info Alert Notices: Not Supported 00:19:55.309 EGE Aggregate Log Change Notices: Not Supported 00:19:55.309 Normal NVM Subsystem Shutdown event: Not Supported 00:19:55.309 Zone Descriptor Change Notices: Not Supported 00:19:55.309 Discovery Log Change Notices: Not Supported 00:19:55.309 Controller Attributes 00:19:55.309 128-bit Host Identifier: Supported 00:19:55.309 Non-Operational Permissive Mode: Not Supported 00:19:55.309 NVM Sets: Not Supported 00:19:55.309 Read Recovery Levels: Not Supported 00:19:55.309 Endurance Groups: Not Supported 00:19:55.309 Predictable Latency Mode: Not Supported 00:19:55.309 Traffic Based Keep ALive: Supported 00:19:55.309 Namespace Granularity: Not Supported 00:19:55.309 SQ Associations: Not Supported 00:19:55.309 UUID List: Not Supported 00:19:55.309 Multi-Domain Subsystem: Not Supported 00:19:55.309 Fixed Capacity Management: Not Supported 00:19:55.309 Variable Capacity Management: Not Supported 00:19:55.309 Delete Endurance Group: Not Supported 00:19:55.309 Delete NVM Set: Not Supported 00:19:55.309 Extended LBA Formats Supported: Not Supported 00:19:55.309 Flexible Data Placement Supported: Not Supported 00:19:55.309 00:19:55.309 Controller Memory Buffer Support 00:19:55.309 ================================ 00:19:55.309 Supported: No 00:19:55.309 00:19:55.309 Persistent Memory Region Support 00:19:55.309 ================================ 00:19:55.309 Supported: No 00:19:55.309 00:19:55.309 Admin Command Set Attributes 00:19:55.309 ============================ 00:19:55.309 Security Send/Receive: Not Supported 00:19:55.309 Format NVM: Not Supported 00:19:55.309 Firmware Activate/Download: Not Supported 00:19:55.309 Namespace Management: Not Supported 00:19:55.309 Device Self-Test: Not Supported 00:19:55.309 Directives: Not Supported 00:19:55.309 NVMe-MI: Not Supported 00:19:55.309 Virtualization Management: Not Supported 00:19:55.309 Doorbell Buffer Config: Not Supported 00:19:55.309 Get LBA Status Capability: Not Supported 00:19:55.309 Command & Feature Lockdown Capability: Not Supported 00:19:55.309 Abort Command Limit: 4 00:19:55.309 Async Event Request Limit: 4 00:19:55.309 Number of Firmware Slots: N/A 00:19:55.309 Firmware Slot 1 Read-Only: N/A 00:19:55.309 Firmware Activation Without Reset: N/A 00:19:55.309 Multiple Update Detection Support: N/A 00:19:55.309 Firmware Update Granularity: No Information Provided 00:19:55.309 Per-Namespace SMART Log: Yes 00:19:55.309 Asymmetric Namespace Access Log Page: Supported 00:19:55.309 ANA Transition Time : 10 sec 00:19:55.309 00:19:55.309 Asymmetric Namespace Access Capabilities 00:19:55.309 ANA Optimized State : Supported 00:19:55.309 ANA Non-Optimized State : Supported 00:19:55.309 ANA Inaccessible State : Supported 00:19:55.309 ANA Persistent Loss State : Supported 00:19:55.309 ANA Change State : Supported 00:19:55.309 ANAGRPID is not changed : No 00:19:55.309 Non-Zero ANAGRPID for NS Mgmt Cmd : Not Supported 00:19:55.309 00:19:55.309 ANA Group Identifier Maximum : 128 00:19:55.309 Number of ANA Group Identifiers : 128 00:19:55.309 Max Number of Allowed Namespaces : 1024 00:19:55.309 Subsystem NQN: nqn.2016-06.io.spdk:testnqn 00:19:55.309 Command Effects Log Page: Supported 00:19:55.309 Get Log Page Extended Data: Supported 00:19:55.309 Telemetry Log Pages: Not Supported 00:19:55.309 Persistent Event Log Pages: Not Supported 00:19:55.309 Supported Log Pages Log Page: May Support 00:19:55.309 Commands Supported & Effects Log Page: Not Supported 00:19:55.309 Feature Identifiers & Effects Log Page:May Support 00:19:55.309 NVMe-MI Commands & Effects Log Page: May Support 00:19:55.309 Data Area 4 for Telemetry Log: Not Supported 00:19:55.309 Error Log Page Entries Supported: 128 00:19:55.309 Keep Alive: Supported 00:19:55.309 Keep Alive Granularity: 1000 ms 00:19:55.309 00:19:55.309 NVM Command Set Attributes 00:19:55.309 ========================== 00:19:55.309 Submission Queue Entry Size 00:19:55.309 Max: 64 00:19:55.309 Min: 64 00:19:55.309 Completion Queue Entry Size 00:19:55.309 Max: 16 00:19:55.309 Min: 16 00:19:55.309 Number of Namespaces: 1024 00:19:55.309 Compare Command: Not Supported 00:19:55.309 Write Uncorrectable Command: Not Supported 00:19:55.309 Dataset Management Command: Supported 00:19:55.309 Write Zeroes Command: Supported 00:19:55.309 Set Features Save Field: Not Supported 00:19:55.309 Reservations: Not Supported 00:19:55.309 Timestamp: Not Supported 00:19:55.309 Copy: Not Supported 00:19:55.309 Volatile Write Cache: Present 00:19:55.309 Atomic Write Unit (Normal): 1 00:19:55.309 Atomic Write Unit (PFail): 1 00:19:55.309 Atomic Compare & Write Unit: 1 00:19:55.309 Fused Compare & Write: Not Supported 00:19:55.309 Scatter-Gather List 00:19:55.309 SGL Command Set: Supported 00:19:55.309 SGL Keyed: Supported 00:19:55.309 SGL Bit Bucket Descriptor: Not Supported 00:19:55.309 SGL Metadata Pointer: Not Supported 00:19:55.309 Oversized SGL: Not Supported 00:19:55.309 SGL Metadata Address: Not Supported 00:19:55.309 SGL Offset: Supported 00:19:55.309 Transport SGL Data Block: Not Supported 00:19:55.309 Replay Protected Memory Block: Not Supported 00:19:55.309 00:19:55.309 Firmware Slot Information 00:19:55.309 ========================= 00:19:55.309 Active slot: 0 00:19:55.309 00:19:55.309 Asymmetric Namespace Access 00:19:55.309 =========================== 00:19:55.309 Change Count : 0 00:19:55.309 Number of ANA Group Descriptors : 1 00:19:55.309 ANA Group Descriptor : 0 00:19:55.309 ANA Group ID : 1 00:19:55.309 Number of NSID Values : 1 00:19:55.309 Change Count : 0 00:19:55.309 ANA State : 1 00:19:55.309 Namespace Identifier : 1 00:19:55.309 00:19:55.309 Commands Supported and Effects 00:19:55.309 ============================== 00:19:55.309 Admin Commands 00:19:55.309 -------------- 00:19:55.309 Get Log Page (02h): Supported 00:19:55.309 Identify (06h): Supported 00:19:55.309 Abort (08h): Supported 00:19:55.309 Set Features (09h): Supported 00:19:55.309 Get Features (0Ah): Supported 00:19:55.309 Asynchronous Event Request (0Ch): Supported 00:19:55.309 Keep Alive (18h): Supported 00:19:55.309 I/O Commands 00:19:55.309 ------------ 00:19:55.309 Flush (00h): Supported 00:19:55.309 Write (01h): Supported LBA-Change 00:19:55.309 Read (02h): Supported 00:19:55.309 Write Zeroes (08h): Supported LBA-Change 00:19:55.309 Dataset Management (09h): Supported 00:19:55.309 00:19:55.309 Error Log 00:19:55.309 ========= 00:19:55.309 Entry: 0 00:19:55.309 Error Count: 0x3 00:19:55.309 Submission Queue Id: 0x0 00:19:55.309 Command Id: 0x5 00:19:55.309 Phase Bit: 0 00:19:55.309 Status Code: 0x2 00:19:55.309 Status Code Type: 0x0 00:19:55.310 Do Not Retry: 1 00:19:55.310 Error Location: 0x28 00:19:55.310 LBA: 0x0 00:19:55.310 Namespace: 0x0 00:19:55.310 Vendor Log Page: 0x0 00:19:55.310 ----------- 00:19:55.310 Entry: 1 00:19:55.310 Error Count: 0x2 00:19:55.310 Submission Queue Id: 0x0 00:19:55.310 Command Id: 0x5 00:19:55.310 Phase Bit: 0 00:19:55.310 Status Code: 0x2 00:19:55.310 Status Code Type: 0x0 00:19:55.310 Do Not Retry: 1 00:19:55.310 Error Location: 0x28 00:19:55.310 LBA: 0x0 00:19:55.310 Namespace: 0x0 00:19:55.310 Vendor Log Page: 0x0 00:19:55.310 ----------- 00:19:55.310 Entry: 2 00:19:55.310 Error Count: 0x1 00:19:55.310 Submission Queue Id: 0x0 00:19:55.310 Command Id: 0x0 00:19:55.310 Phase Bit: 0 00:19:55.310 Status Code: 0x2 00:19:55.310 Status Code Type: 0x0 00:19:55.310 Do Not Retry: 1 00:19:55.310 Error Location: 0x28 00:19:55.310 LBA: 0x0 00:19:55.310 Namespace: 0x0 00:19:55.310 Vendor Log Page: 0x0 00:19:55.310 00:19:55.310 Number of Queues 00:19:55.310 ================ 00:19:55.310 Number of I/O Submission Queues: 128 00:19:55.310 Number of I/O Completion Queues: 128 00:19:55.310 00:19:55.310 ZNS Specific Controller Data 00:19:55.310 ============================ 00:19:55.310 Zone Append Size Limit: 0 00:19:55.310 00:19:55.310 00:19:55.310 Active Namespaces 00:19:55.310 ================= 00:19:55.310 get_feature(0x05) failed 00:19:55.310 Namespace ID:1 00:19:55.310 Command Set Identifier: NVM (00h) 00:19:55.310 Deallocate: Supported 00:19:55.310 Deallocated/Unwritten Error: Not Supported 00:19:55.310 Deallocated Read Value: Unknown 00:19:55.310 Deallocate in Write Zeroes: Not Supported 00:19:55.310 Deallocated Guard Field: 0xFFFF 00:19:55.310 Flush: Supported 00:19:55.310 Reservation: Not Supported 00:19:55.310 Namespace Sharing Capabilities: Multiple Controllers 00:19:55.310 Size (in LBAs): 3125627568 (1490GiB) 00:19:55.310 Capacity (in LBAs): 3125627568 (1490GiB) 00:19:55.310 Utilization (in LBAs): 3125627568 (1490GiB) 00:19:55.310 UUID: def41d6e-0add-4c96-b9ff-22fb61b43422 00:19:55.310 Thin Provisioning: Not Supported 00:19:55.310 Per-NS Atomic Units: Yes 00:19:55.310 Atomic Boundary Size (Normal): 0 00:19:55.310 Atomic Boundary Size (PFail): 0 00:19:55.310 Atomic Boundary Offset: 0 00:19:55.310 NGUID/EUI64 Never Reused: No 00:19:55.310 ANA group ID: 1 00:19:55.310 Namespace Write Protected: No 00:19:55.310 Number of LBA Formats: 1 00:19:55.310 Current LBA Format: LBA Format #00 00:19:55.310 LBA Format #00: Data Size: 512 Metadata Size: 0 00:19:55.310 00:19:55.310 15:48:53 -- host/identify_kernel_nvmf.sh@1 -- # nvmftestfini 00:19:55.310 15:48:53 -- nvmf/common.sh@477 -- # nvmfcleanup 00:19:55.310 15:48:53 -- nvmf/common.sh@117 -- # sync 00:19:55.310 15:48:53 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:19:55.310 15:48:53 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:19:55.310 15:48:53 -- nvmf/common.sh@120 -- # set +e 00:19:55.310 15:48:53 -- nvmf/common.sh@121 -- # for i in {1..20} 00:19:55.310 15:48:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:19:55.310 rmmod nvme_rdma 00:19:55.310 rmmod nvme_fabrics 00:19:55.567 15:48:53 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:19:55.567 15:48:53 -- nvmf/common.sh@124 -- # set -e 00:19:55.567 15:48:53 -- nvmf/common.sh@125 -- # return 0 00:19:55.567 15:48:53 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:19:55.567 15:48:53 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:19:55.567 15:48:53 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:19:55.567 15:48:53 -- host/identify_kernel_nvmf.sh@1 -- # clean_kernel_target 00:19:55.567 15:48:53 -- nvmf/common.sh@673 -- # [[ -e /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn ]] 00:19:55.567 15:48:53 -- nvmf/common.sh@675 -- # echo 0 00:19:55.567 15:48:53 -- nvmf/common.sh@677 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/nqn.2016-06.io.spdk:testnqn 00:19:55.567 15:48:53 -- nvmf/common.sh@678 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:19:55.567 15:48:53 -- nvmf/common.sh@679 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:19:55.567 15:48:53 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:19:55.567 15:48:53 -- nvmf/common.sh@682 -- # modules=(/sys/module/nvmet/holders/*) 00:19:55.567 15:48:53 -- nvmf/common.sh@684 -- # modprobe -r nvmet_rdma nvmet 00:19:55.567 15:48:53 -- nvmf/common.sh@687 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:19:58.170 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:19:58.170 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:19:58.170 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:19:58.170 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:19:58.170 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:19:58.170 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:19:58.170 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:19:58.170 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:19:58.170 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:19:58.170 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:19:58.170 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:19:58.170 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:19:58.170 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:19:58.170 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:19:58.170 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:19:58.170 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:19:59.566 0000:5f:00.0 (8086 0a54): nvme -> vfio-pci 00:19:59.566 00:19:59.566 real 0m13.666s 00:19:59.566 user 0m3.629s 00:19:59.566 sys 0m7.712s 00:19:59.566 15:48:58 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:19:59.566 15:48:58 -- common/autotest_common.sh@10 -- # set +x 00:19:59.566 ************************************ 00:19:59.566 END TEST nvmf_identify_kernel_target 00:19:59.567 ************************************ 00:19:59.567 15:48:58 -- nvmf/nvmf.sh@102 -- # run_test nvmf_auth /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/auth.sh --transport=rdma 00:19:59.567 15:48:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:59.567 15:48:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:59.567 15:48:58 -- common/autotest_common.sh@10 -- # set +x 00:19:59.825 ************************************ 00:19:59.825 START TEST nvmf_auth 00:19:59.825 ************************************ 00:19:59.825 15:48:58 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/auth.sh --transport=rdma 00:19:59.825 * Looking for test storage... 00:19:59.825 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:19:59.825 15:48:58 -- host/auth.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:19:59.825 15:48:58 -- nvmf/common.sh@7 -- # uname -s 00:19:59.825 15:48:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:59.825 15:48:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:59.825 15:48:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:59.825 15:48:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:59.825 15:48:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:59.825 15:48:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:59.825 15:48:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:59.825 15:48:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:59.825 15:48:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:59.825 15:48:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:59.825 15:48:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:19:59.825 15:48:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:19:59.825 15:48:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:59.825 15:48:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:59.825 15:48:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:59.825 15:48:58 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:19:59.825 15:48:58 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:19:59.825 15:48:58 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:59.825 15:48:58 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:59.825 15:48:58 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:59.825 15:48:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:59.825 15:48:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:59.825 15:48:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:59.825 15:48:58 -- paths/export.sh@5 -- # export PATH 00:19:59.825 15:48:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:59.825 15:48:58 -- nvmf/common.sh@47 -- # : 0 00:19:59.825 15:48:58 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:19:59.825 15:48:58 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:19:59.825 15:48:58 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:19:59.825 15:48:58 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:59.825 15:48:58 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:59.825 15:48:58 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:19:59.825 15:48:58 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:19:59.825 15:48:58 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:19:59.825 15:48:58 -- host/auth.sh@13 -- # digests=("sha256" "sha384" "sha512") 00:19:59.825 15:48:58 -- host/auth.sh@16 -- # dhgroups=("ffdhe2048" "ffdhe3072" "ffdhe4096" "ffdhe6144" "ffdhe8192") 00:19:59.825 15:48:58 -- host/auth.sh@17 -- # subnqn=nqn.2024-02.io.spdk:cnode0 00:19:59.825 15:48:58 -- host/auth.sh@18 -- # hostnqn=nqn.2024-02.io.spdk:host0 00:19:59.825 15:48:58 -- host/auth.sh@19 -- # nvmet_subsys=/sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:19:59.825 15:48:58 -- host/auth.sh@20 -- # nvmet_host=/sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 00:19:59.825 15:48:58 -- host/auth.sh@21 -- # keys=() 00:19:59.825 15:48:58 -- host/auth.sh@77 -- # nvmftestinit 00:19:59.825 15:48:58 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:19:59.825 15:48:58 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:59.825 15:48:58 -- nvmf/common.sh@437 -- # prepare_net_devs 00:19:59.825 15:48:58 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:19:59.825 15:48:58 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:19:59.825 15:48:58 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:59.825 15:48:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:59.825 15:48:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:59.825 15:48:58 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:19:59.825 15:48:58 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:19:59.825 15:48:58 -- nvmf/common.sh@285 -- # xtrace_disable 00:19:59.825 15:48:58 -- common/autotest_common.sh@10 -- # set +x 00:20:05.089 15:49:03 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:05.089 15:49:03 -- nvmf/common.sh@291 -- # pci_devs=() 00:20:05.089 15:49:03 -- nvmf/common.sh@291 -- # local -a pci_devs 00:20:05.089 15:49:03 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:20:05.089 15:49:03 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:20:05.089 15:49:03 -- nvmf/common.sh@293 -- # pci_drivers=() 00:20:05.089 15:49:03 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:20:05.089 15:49:03 -- nvmf/common.sh@295 -- # net_devs=() 00:20:05.089 15:49:03 -- nvmf/common.sh@295 -- # local -ga net_devs 00:20:05.089 15:49:03 -- nvmf/common.sh@296 -- # e810=() 00:20:05.089 15:49:03 -- nvmf/common.sh@296 -- # local -ga e810 00:20:05.089 15:49:03 -- nvmf/common.sh@297 -- # x722=() 00:20:05.089 15:49:03 -- nvmf/common.sh@297 -- # local -ga x722 00:20:05.089 15:49:03 -- nvmf/common.sh@298 -- # mlx=() 00:20:05.089 15:49:03 -- nvmf/common.sh@298 -- # local -ga mlx 00:20:05.089 15:49:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:05.089 15:49:03 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:05.089 15:49:03 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:05.089 15:49:03 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:05.089 15:49:03 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:05.089 15:49:03 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:05.089 15:49:03 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:05.089 15:49:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:05.089 15:49:03 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:05.089 15:49:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:05.089 15:49:03 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:05.089 15:49:03 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:20:05.089 15:49:03 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:20:05.089 15:49:03 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:20:05.089 15:49:03 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:20:05.089 15:49:03 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:20:05.089 15:49:03 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:20:05.089 15:49:03 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:20:05.089 15:49:03 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:05.089 15:49:03 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:20:05.089 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:20:05.089 15:49:03 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:20:05.089 15:49:03 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:20:05.089 15:49:03 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:20:05.089 15:49:03 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:20:05.089 15:49:03 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:20:05.089 15:49:03 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:20:05.089 15:49:03 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:05.089 15:49:03 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:20:05.089 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:20:05.089 15:49:03 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:20:05.089 15:49:03 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:20:05.089 15:49:03 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:20:05.089 15:49:03 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:20:05.089 15:49:03 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:20:05.089 15:49:03 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:20:05.089 15:49:03 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:20:05.089 15:49:03 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:20:05.089 15:49:03 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:05.089 15:49:03 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:05.089 15:49:03 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:05.089 15:49:03 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:05.089 15:49:03 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:20:05.089 Found net devices under 0000:da:00.0: mlx_0_0 00:20:05.089 15:49:03 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:05.089 15:49:03 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:05.089 15:49:03 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:05.089 15:49:03 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:05.089 15:49:03 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:05.089 15:49:03 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:20:05.089 Found net devices under 0000:da:00.1: mlx_0_1 00:20:05.089 15:49:03 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:05.089 15:49:03 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:20:05.089 15:49:03 -- nvmf/common.sh@403 -- # is_hw=yes 00:20:05.089 15:49:03 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:20:05.089 15:49:03 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:20:05.089 15:49:03 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:20:05.089 15:49:03 -- nvmf/common.sh@409 -- # rdma_device_init 00:20:05.089 15:49:03 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:20:05.089 15:49:03 -- nvmf/common.sh@58 -- # uname 00:20:05.089 15:49:03 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:20:05.089 15:49:03 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:20:05.089 15:49:03 -- nvmf/common.sh@63 -- # modprobe ib_core 00:20:05.089 15:49:03 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:20:05.089 15:49:03 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:20:05.089 15:49:03 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:20:05.089 15:49:03 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:20:05.089 15:49:03 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:20:05.089 15:49:03 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:20:05.089 15:49:03 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:20:05.089 15:49:03 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:20:05.089 15:49:03 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:20:05.089 15:49:03 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:20:05.089 15:49:03 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:20:05.089 15:49:03 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:20:05.089 15:49:03 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:20:05.089 15:49:03 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:05.089 15:49:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:05.089 15:49:03 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:20:05.089 15:49:03 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:20:05.089 15:49:03 -- nvmf/common.sh@105 -- # continue 2 00:20:05.089 15:49:03 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:05.089 15:49:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:05.089 15:49:03 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:20:05.089 15:49:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:05.089 15:49:03 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:20:05.089 15:49:03 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:20:05.089 15:49:03 -- nvmf/common.sh@105 -- # continue 2 00:20:05.089 15:49:03 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:20:05.089 15:49:03 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:20:05.089 15:49:03 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:20:05.089 15:49:03 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:20:05.089 15:49:03 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:05.089 15:49:03 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:05.089 15:49:03 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:20:05.089 15:49:03 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:20:05.089 15:49:03 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:20:05.089 122: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:20:05.089 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:20:05.089 altname enp218s0f0np0 00:20:05.089 altname ens818f0np0 00:20:05.089 inet 192.168.100.8/24 scope global mlx_0_0 00:20:05.089 valid_lft forever preferred_lft forever 00:20:05.089 15:49:03 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:20:05.089 15:49:03 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:20:05.089 15:49:03 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:20:05.089 15:49:03 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:20:05.089 15:49:03 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:05.089 15:49:03 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:05.089 15:49:03 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:20:05.089 15:49:03 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:20:05.089 15:49:03 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:20:05.089 123: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:20:05.089 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:20:05.089 altname enp218s0f1np1 00:20:05.089 altname ens818f1np1 00:20:05.089 inet 192.168.100.9/24 scope global mlx_0_1 00:20:05.089 valid_lft forever preferred_lft forever 00:20:05.089 15:49:03 -- nvmf/common.sh@411 -- # return 0 00:20:05.089 15:49:03 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:20:05.089 15:49:03 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:20:05.089 15:49:03 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:20:05.089 15:49:03 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:20:05.089 15:49:03 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:20:05.089 15:49:03 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:20:05.089 15:49:03 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:20:05.089 15:49:03 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:20:05.090 15:49:03 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:20:05.090 15:49:03 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:20:05.090 15:49:03 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:05.090 15:49:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:05.090 15:49:03 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:20:05.090 15:49:03 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:20:05.090 15:49:03 -- nvmf/common.sh@105 -- # continue 2 00:20:05.090 15:49:03 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:05.090 15:49:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:05.090 15:49:03 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:20:05.090 15:49:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:05.090 15:49:03 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:20:05.090 15:49:03 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:20:05.090 15:49:03 -- nvmf/common.sh@105 -- # continue 2 00:20:05.090 15:49:03 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:20:05.090 15:49:03 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:20:05.090 15:49:03 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:20:05.090 15:49:03 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:20:05.090 15:49:03 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:05.090 15:49:03 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:05.090 15:49:03 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:20:05.090 15:49:03 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:20:05.090 15:49:03 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:20:05.090 15:49:03 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:20:05.090 15:49:03 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:05.090 15:49:03 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:05.090 15:49:03 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:20:05.090 192.168.100.9' 00:20:05.090 15:49:03 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:20:05.090 192.168.100.9' 00:20:05.090 15:49:03 -- nvmf/common.sh@446 -- # head -n 1 00:20:05.090 15:49:03 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:20:05.090 15:49:03 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:20:05.090 192.168.100.9' 00:20:05.347 15:49:03 -- nvmf/common.sh@447 -- # tail -n +2 00:20:05.347 15:49:03 -- nvmf/common.sh@447 -- # head -n 1 00:20:05.347 15:49:03 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:20:05.347 15:49:03 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:20:05.347 15:49:03 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:20:05.347 15:49:03 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:20:05.347 15:49:03 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:20:05.347 15:49:03 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:20:05.347 15:49:03 -- host/auth.sh@78 -- # nvmfappstart -L nvme_auth 00:20:05.347 15:49:03 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:20:05.347 15:49:03 -- common/autotest_common.sh@710 -- # xtrace_disable 00:20:05.347 15:49:03 -- common/autotest_common.sh@10 -- # set +x 00:20:05.347 15:49:03 -- nvmf/common.sh@470 -- # nvmfpid=3402908 00:20:05.347 15:49:03 -- nvmf/common.sh@471 -- # waitforlisten 3402908 00:20:05.347 15:49:03 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -L nvme_auth 00:20:05.347 15:49:03 -- common/autotest_common.sh@817 -- # '[' -z 3402908 ']' 00:20:05.347 15:49:03 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:05.347 15:49:03 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:05.347 15:49:03 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:05.347 15:49:03 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:05.347 15:49:03 -- common/autotest_common.sh@10 -- # set +x 00:20:06.287 15:49:04 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:06.287 15:49:04 -- common/autotest_common.sh@850 -- # return 0 00:20:06.287 15:49:04 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:20:06.287 15:49:04 -- common/autotest_common.sh@716 -- # xtrace_disable 00:20:06.287 15:49:04 -- common/autotest_common.sh@10 -- # set +x 00:20:06.287 15:49:04 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:06.287 15:49:04 -- host/auth.sh@79 -- # trap 'cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/nvme-auth.log; cleanup' SIGINT SIGTERM EXIT 00:20:06.287 15:49:04 -- host/auth.sh@81 -- # gen_key null 32 00:20:06.287 15:49:04 -- host/auth.sh@53 -- # local digest len file key 00:20:06.287 15:49:04 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:20:06.287 15:49:04 -- host/auth.sh@54 -- # local -A digests 00:20:06.287 15:49:04 -- host/auth.sh@56 -- # digest=null 00:20:06.287 15:49:04 -- host/auth.sh@56 -- # len=32 00:20:06.287 15:49:04 -- host/auth.sh@57 -- # xxd -p -c0 -l 16 /dev/urandom 00:20:06.287 15:49:04 -- host/auth.sh@57 -- # key=9390ded3933bf9257dd72ee3c7f36242 00:20:06.287 15:49:04 -- host/auth.sh@58 -- # mktemp -t spdk.key-null.XXX 00:20:06.287 15:49:04 -- host/auth.sh@58 -- # file=/tmp/spdk.key-null.Zdx 00:20:06.287 15:49:04 -- host/auth.sh@59 -- # format_dhchap_key 9390ded3933bf9257dd72ee3c7f36242 0 00:20:06.287 15:49:04 -- nvmf/common.sh@708 -- # format_key DHHC-1 9390ded3933bf9257dd72ee3c7f36242 0 00:20:06.287 15:49:04 -- nvmf/common.sh@691 -- # local prefix key digest 00:20:06.287 15:49:04 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:20:06.287 15:49:04 -- nvmf/common.sh@693 -- # key=9390ded3933bf9257dd72ee3c7f36242 00:20:06.287 15:49:04 -- nvmf/common.sh@693 -- # digest=0 00:20:06.287 15:49:04 -- nvmf/common.sh@694 -- # python - 00:20:06.287 15:49:04 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-null.Zdx 00:20:06.287 15:49:04 -- host/auth.sh@62 -- # echo /tmp/spdk.key-null.Zdx 00:20:06.287 15:49:04 -- host/auth.sh@81 -- # keys[0]=/tmp/spdk.key-null.Zdx 00:20:06.287 15:49:04 -- host/auth.sh@82 -- # gen_key null 48 00:20:06.287 15:49:04 -- host/auth.sh@53 -- # local digest len file key 00:20:06.287 15:49:04 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:20:06.287 15:49:04 -- host/auth.sh@54 -- # local -A digests 00:20:06.287 15:49:04 -- host/auth.sh@56 -- # digest=null 00:20:06.287 15:49:04 -- host/auth.sh@56 -- # len=48 00:20:06.287 15:49:04 -- host/auth.sh@57 -- # xxd -p -c0 -l 24 /dev/urandom 00:20:06.287 15:49:04 -- host/auth.sh@57 -- # key=ed490f66d080226e584726fe99766bceba6089911284f039 00:20:06.287 15:49:04 -- host/auth.sh@58 -- # mktemp -t spdk.key-null.XXX 00:20:06.288 15:49:04 -- host/auth.sh@58 -- # file=/tmp/spdk.key-null.CfQ 00:20:06.288 15:49:04 -- host/auth.sh@59 -- # format_dhchap_key ed490f66d080226e584726fe99766bceba6089911284f039 0 00:20:06.288 15:49:04 -- nvmf/common.sh@708 -- # format_key DHHC-1 ed490f66d080226e584726fe99766bceba6089911284f039 0 00:20:06.288 15:49:04 -- nvmf/common.sh@691 -- # local prefix key digest 00:20:06.288 15:49:04 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:20:06.288 15:49:04 -- nvmf/common.sh@693 -- # key=ed490f66d080226e584726fe99766bceba6089911284f039 00:20:06.288 15:49:04 -- nvmf/common.sh@693 -- # digest=0 00:20:06.288 15:49:04 -- nvmf/common.sh@694 -- # python - 00:20:06.288 15:49:04 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-null.CfQ 00:20:06.288 15:49:04 -- host/auth.sh@62 -- # echo /tmp/spdk.key-null.CfQ 00:20:06.288 15:49:04 -- host/auth.sh@82 -- # keys[1]=/tmp/spdk.key-null.CfQ 00:20:06.288 15:49:04 -- host/auth.sh@83 -- # gen_key sha256 32 00:20:06.288 15:49:04 -- host/auth.sh@53 -- # local digest len file key 00:20:06.288 15:49:04 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:20:06.288 15:49:04 -- host/auth.sh@54 -- # local -A digests 00:20:06.288 15:49:04 -- host/auth.sh@56 -- # digest=sha256 00:20:06.288 15:49:04 -- host/auth.sh@56 -- # len=32 00:20:06.288 15:49:04 -- host/auth.sh@57 -- # xxd -p -c0 -l 16 /dev/urandom 00:20:06.288 15:49:04 -- host/auth.sh@57 -- # key=530b5b4c9d460dc41fe9e4169b9a3d6a 00:20:06.288 15:49:04 -- host/auth.sh@58 -- # mktemp -t spdk.key-sha256.XXX 00:20:06.288 15:49:04 -- host/auth.sh@58 -- # file=/tmp/spdk.key-sha256.5s5 00:20:06.288 15:49:04 -- host/auth.sh@59 -- # format_dhchap_key 530b5b4c9d460dc41fe9e4169b9a3d6a 1 00:20:06.288 15:49:04 -- nvmf/common.sh@708 -- # format_key DHHC-1 530b5b4c9d460dc41fe9e4169b9a3d6a 1 00:20:06.288 15:49:04 -- nvmf/common.sh@691 -- # local prefix key digest 00:20:06.288 15:49:04 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:20:06.288 15:49:04 -- nvmf/common.sh@693 -- # key=530b5b4c9d460dc41fe9e4169b9a3d6a 00:20:06.288 15:49:04 -- nvmf/common.sh@693 -- # digest=1 00:20:06.288 15:49:04 -- nvmf/common.sh@694 -- # python - 00:20:06.288 15:49:04 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-sha256.5s5 00:20:06.288 15:49:04 -- host/auth.sh@62 -- # echo /tmp/spdk.key-sha256.5s5 00:20:06.288 15:49:04 -- host/auth.sh@83 -- # keys[2]=/tmp/spdk.key-sha256.5s5 00:20:06.288 15:49:04 -- host/auth.sh@84 -- # gen_key sha384 48 00:20:06.288 15:49:04 -- host/auth.sh@53 -- # local digest len file key 00:20:06.288 15:49:04 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:20:06.288 15:49:04 -- host/auth.sh@54 -- # local -A digests 00:20:06.288 15:49:04 -- host/auth.sh@56 -- # digest=sha384 00:20:06.288 15:49:04 -- host/auth.sh@56 -- # len=48 00:20:06.288 15:49:04 -- host/auth.sh@57 -- # xxd -p -c0 -l 24 /dev/urandom 00:20:06.288 15:49:04 -- host/auth.sh@57 -- # key=d9290c6f3938d72c38869533f60bc62820993547a176a477 00:20:06.288 15:49:04 -- host/auth.sh@58 -- # mktemp -t spdk.key-sha384.XXX 00:20:06.288 15:49:04 -- host/auth.sh@58 -- # file=/tmp/spdk.key-sha384.Dk8 00:20:06.288 15:49:04 -- host/auth.sh@59 -- # format_dhchap_key d9290c6f3938d72c38869533f60bc62820993547a176a477 2 00:20:06.288 15:49:04 -- nvmf/common.sh@708 -- # format_key DHHC-1 d9290c6f3938d72c38869533f60bc62820993547a176a477 2 00:20:06.288 15:49:04 -- nvmf/common.sh@691 -- # local prefix key digest 00:20:06.288 15:49:04 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:20:06.288 15:49:04 -- nvmf/common.sh@693 -- # key=d9290c6f3938d72c38869533f60bc62820993547a176a477 00:20:06.288 15:49:04 -- nvmf/common.sh@693 -- # digest=2 00:20:06.288 15:49:04 -- nvmf/common.sh@694 -- # python - 00:20:06.288 15:49:04 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-sha384.Dk8 00:20:06.288 15:49:04 -- host/auth.sh@62 -- # echo /tmp/spdk.key-sha384.Dk8 00:20:06.288 15:49:04 -- host/auth.sh@84 -- # keys[3]=/tmp/spdk.key-sha384.Dk8 00:20:06.288 15:49:04 -- host/auth.sh@85 -- # gen_key sha512 64 00:20:06.288 15:49:04 -- host/auth.sh@53 -- # local digest len file key 00:20:06.288 15:49:04 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:20:06.288 15:49:04 -- host/auth.sh@54 -- # local -A digests 00:20:06.288 15:49:04 -- host/auth.sh@56 -- # digest=sha512 00:20:06.288 15:49:04 -- host/auth.sh@56 -- # len=64 00:20:06.288 15:49:04 -- host/auth.sh@57 -- # xxd -p -c0 -l 32 /dev/urandom 00:20:06.288 15:49:04 -- host/auth.sh@57 -- # key=43512456ca2bb7a81a674df30087a03123d530f5377cde6856b425182aadbf92 00:20:06.288 15:49:04 -- host/auth.sh@58 -- # mktemp -t spdk.key-sha512.XXX 00:20:06.288 15:49:04 -- host/auth.sh@58 -- # file=/tmp/spdk.key-sha512.uwZ 00:20:06.288 15:49:04 -- host/auth.sh@59 -- # format_dhchap_key 43512456ca2bb7a81a674df30087a03123d530f5377cde6856b425182aadbf92 3 00:20:06.288 15:49:04 -- nvmf/common.sh@708 -- # format_key DHHC-1 43512456ca2bb7a81a674df30087a03123d530f5377cde6856b425182aadbf92 3 00:20:06.288 15:49:04 -- nvmf/common.sh@691 -- # local prefix key digest 00:20:06.288 15:49:04 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:20:06.288 15:49:04 -- nvmf/common.sh@693 -- # key=43512456ca2bb7a81a674df30087a03123d530f5377cde6856b425182aadbf92 00:20:06.288 15:49:04 -- nvmf/common.sh@693 -- # digest=3 00:20:06.288 15:49:04 -- nvmf/common.sh@694 -- # python - 00:20:06.546 15:49:04 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-sha512.uwZ 00:20:06.546 15:49:04 -- host/auth.sh@62 -- # echo /tmp/spdk.key-sha512.uwZ 00:20:06.546 15:49:04 -- host/auth.sh@85 -- # keys[4]=/tmp/spdk.key-sha512.uwZ 00:20:06.546 15:49:04 -- host/auth.sh@87 -- # waitforlisten 3402908 00:20:06.546 15:49:04 -- common/autotest_common.sh@817 -- # '[' -z 3402908 ']' 00:20:06.546 15:49:04 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:06.546 15:49:04 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:06.546 15:49:04 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:06.546 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:06.546 15:49:04 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:06.546 15:49:04 -- common/autotest_common.sh@10 -- # set +x 00:20:06.546 15:49:05 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:06.546 15:49:05 -- common/autotest_common.sh@850 -- # return 0 00:20:06.546 15:49:05 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:20:06.546 15:49:05 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key0 /tmp/spdk.key-null.Zdx 00:20:06.546 15:49:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:06.546 15:49:05 -- common/autotest_common.sh@10 -- # set +x 00:20:06.546 15:49:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:06.546 15:49:05 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:20:06.546 15:49:05 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key1 /tmp/spdk.key-null.CfQ 00:20:06.546 15:49:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:06.546 15:49:05 -- common/autotest_common.sh@10 -- # set +x 00:20:06.546 15:49:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:06.546 15:49:05 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:20:06.546 15:49:05 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key2 /tmp/spdk.key-sha256.5s5 00:20:06.546 15:49:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:06.546 15:49:05 -- common/autotest_common.sh@10 -- # set +x 00:20:06.546 15:49:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:06.546 15:49:05 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:20:06.546 15:49:05 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key3 /tmp/spdk.key-sha384.Dk8 00:20:06.546 15:49:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:06.546 15:49:05 -- common/autotest_common.sh@10 -- # set +x 00:20:06.546 15:49:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:06.546 15:49:05 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:20:06.546 15:49:05 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key4 /tmp/spdk.key-sha512.uwZ 00:20:06.546 15:49:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:06.546 15:49:05 -- common/autotest_common.sh@10 -- # set +x 00:20:06.546 15:49:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:06.546 15:49:05 -- host/auth.sh@92 -- # nvmet_auth_init 00:20:06.546 15:49:05 -- host/auth.sh@35 -- # get_main_ns_ip 00:20:06.546 15:49:05 -- nvmf/common.sh@717 -- # local ip 00:20:06.546 15:49:05 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:06.546 15:49:05 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:06.546 15:49:05 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:06.546 15:49:05 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:06.546 15:49:05 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:06.546 15:49:05 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:06.546 15:49:05 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:06.546 15:49:05 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:06.546 15:49:05 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:06.546 15:49:05 -- host/auth.sh@35 -- # configure_kernel_target nqn.2024-02.io.spdk:cnode0 192.168.100.8 00:20:06.546 15:49:05 -- nvmf/common.sh@621 -- # local kernel_name=nqn.2024-02.io.spdk:cnode0 kernel_target_ip=192.168.100.8 00:20:06.546 15:49:05 -- nvmf/common.sh@623 -- # nvmet=/sys/kernel/config/nvmet 00:20:06.546 15:49:05 -- nvmf/common.sh@624 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:20:06.546 15:49:05 -- nvmf/common.sh@625 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/namespaces/1 00:20:06.546 15:49:05 -- nvmf/common.sh@626 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:20:06.546 15:49:05 -- nvmf/common.sh@628 -- # local block nvme 00:20:06.546 15:49:05 -- nvmf/common.sh@630 -- # [[ ! -e /sys/module/nvmet ]] 00:20:06.546 15:49:05 -- nvmf/common.sh@631 -- # modprobe nvmet 00:20:06.804 15:49:05 -- nvmf/common.sh@634 -- # [[ -e /sys/kernel/config/nvmet ]] 00:20:06.804 15:49:05 -- nvmf/common.sh@636 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:20:09.334 Waiting for block devices as requested 00:20:09.334 0000:5f:00.0 (8086 0a54): vfio-pci -> nvme 00:20:09.334 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:20:09.334 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:20:09.334 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:20:09.592 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:20:09.592 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:20:09.592 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:20:09.849 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:20:09.849 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:20:09.849 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:20:09.849 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:20:10.106 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:20:10.106 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:20:10.106 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:20:10.106 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:20:10.363 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:20:10.363 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:20:10.928 15:49:09 -- nvmf/common.sh@639 -- # for block in /sys/block/nvme* 00:20:10.928 15:49:09 -- nvmf/common.sh@640 -- # [[ -e /sys/block/nvme0n1 ]] 00:20:10.928 15:49:09 -- nvmf/common.sh@641 -- # is_block_zoned nvme0n1 00:20:10.928 15:49:09 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:20:10.928 15:49:09 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:20:10.928 15:49:09 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:20:10.928 15:49:09 -- nvmf/common.sh@642 -- # block_in_use nvme0n1 00:20:10.928 15:49:09 -- scripts/common.sh@378 -- # local block=nvme0n1 pt 00:20:10.928 15:49:09 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:20:10.928 No valid GPT data, bailing 00:20:10.928 15:49:09 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:20:10.928 15:49:09 -- scripts/common.sh@391 -- # pt= 00:20:10.928 15:49:09 -- scripts/common.sh@392 -- # return 1 00:20:10.928 15:49:09 -- nvmf/common.sh@642 -- # nvme=/dev/nvme0n1 00:20:10.928 15:49:09 -- nvmf/common.sh@645 -- # [[ -b /dev/nvme0n1 ]] 00:20:10.928 15:49:09 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:20:10.928 15:49:09 -- nvmf/common.sh@648 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/namespaces/1 00:20:10.928 15:49:09 -- nvmf/common.sh@649 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:20:10.928 15:49:09 -- nvmf/common.sh@654 -- # echo SPDK-nqn.2024-02.io.spdk:cnode0 00:20:10.928 15:49:09 -- nvmf/common.sh@656 -- # echo 1 00:20:11.186 15:49:09 -- nvmf/common.sh@657 -- # echo /dev/nvme0n1 00:20:11.186 15:49:09 -- nvmf/common.sh@658 -- # echo 1 00:20:11.186 15:49:09 -- nvmf/common.sh@660 -- # echo 192.168.100.8 00:20:11.186 15:49:09 -- nvmf/common.sh@661 -- # echo rdma 00:20:11.186 15:49:09 -- nvmf/common.sh@662 -- # echo 4420 00:20:11.186 15:49:09 -- nvmf/common.sh@663 -- # echo ipv4 00:20:11.186 15:49:09 -- nvmf/common.sh@666 -- # ln -s /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 /sys/kernel/config/nvmet/ports/1/subsystems/ 00:20:11.186 15:49:09 -- nvmf/common.sh@669 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 --hostid=803833e2-2ada-e911-906e-0017a4403562 -a 192.168.100.8 -t rdma -s 4420 00:20:11.186 00:20:11.186 Discovery Log Number of Records 2, Generation counter 2 00:20:11.186 =====Discovery Log Entry 0====== 00:20:11.186 trtype: rdma 00:20:11.186 adrfam: ipv4 00:20:11.186 subtype: current discovery subsystem 00:20:11.186 treq: not specified, sq flow control disable supported 00:20:11.186 portid: 1 00:20:11.186 trsvcid: 4420 00:20:11.186 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:20:11.186 traddr: 192.168.100.8 00:20:11.186 eflags: none 00:20:11.186 rdma_prtype: not specified 00:20:11.186 rdma_qptype: connected 00:20:11.186 rdma_cms: rdma-cm 00:20:11.186 rdma_pkey: 0x0000 00:20:11.186 =====Discovery Log Entry 1====== 00:20:11.186 trtype: rdma 00:20:11.186 adrfam: ipv4 00:20:11.186 subtype: nvme subsystem 00:20:11.186 treq: not specified, sq flow control disable supported 00:20:11.186 portid: 1 00:20:11.186 trsvcid: 4420 00:20:11.186 subnqn: nqn.2024-02.io.spdk:cnode0 00:20:11.186 traddr: 192.168.100.8 00:20:11.186 eflags: none 00:20:11.186 rdma_prtype: not specified 00:20:11.186 rdma_qptype: connected 00:20:11.186 rdma_cms: rdma-cm 00:20:11.186 rdma_pkey: 0x0000 00:20:11.186 15:49:09 -- host/auth.sh@36 -- # mkdir /sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 00:20:11.186 15:49:09 -- host/auth.sh@37 -- # echo 0 00:20:11.186 15:49:09 -- host/auth.sh@38 -- # ln -s /sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/allowed_hosts/nqn.2024-02.io.spdk:host0 00:20:11.186 15:49:09 -- host/auth.sh@95 -- # nvmet_auth_set_key sha256 ffdhe2048 1 00:20:11.186 15:49:09 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:11.186 15:49:09 -- host/auth.sh@44 -- # digest=sha256 00:20:11.187 15:49:09 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:20:11.187 15:49:09 -- host/auth.sh@44 -- # keyid=1 00:20:11.187 15:49:09 -- host/auth.sh@45 -- # key=DHHC-1:00:ZWQ0OTBmNjZkMDgwMjI2ZTU4NDcyNmZlOTk3NjZiY2ViYTYwODk5MTEyODRmMDM5s+pwyQ==: 00:20:11.187 15:49:09 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:20:11.187 15:49:09 -- host/auth.sh@48 -- # echo ffdhe2048 00:20:11.187 15:49:09 -- host/auth.sh@49 -- # echo DHHC-1:00:ZWQ0OTBmNjZkMDgwMjI2ZTU4NDcyNmZlOTk3NjZiY2ViYTYwODk5MTEyODRmMDM5s+pwyQ==: 00:20:11.187 15:49:09 -- host/auth.sh@100 -- # IFS=, 00:20:11.187 15:49:09 -- host/auth.sh@101 -- # printf %s sha256,sha384,sha512 00:20:11.187 15:49:09 -- host/auth.sh@100 -- # IFS=, 00:20:11.187 15:49:09 -- host/auth.sh@101 -- # printf %s ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:20:11.187 15:49:09 -- host/auth.sh@100 -- # connect_authenticate sha256,sha384,sha512 ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 1 00:20:11.187 15:49:09 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:11.187 15:49:09 -- host/auth.sh@68 -- # digest=sha256,sha384,sha512 00:20:11.187 15:49:09 -- host/auth.sh@68 -- # dhgroup=ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:20:11.187 15:49:09 -- host/auth.sh@68 -- # keyid=1 00:20:11.187 15:49:09 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256,sha384,sha512 --dhchap-dhgroups ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:20:11.187 15:49:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:11.187 15:49:09 -- common/autotest_common.sh@10 -- # set +x 00:20:11.187 15:49:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:11.187 15:49:09 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:11.187 15:49:09 -- nvmf/common.sh@717 -- # local ip 00:20:11.187 15:49:09 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:11.187 15:49:09 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:11.187 15:49:09 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:11.187 15:49:09 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:11.187 15:49:09 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:11.187 15:49:09 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:11.187 15:49:09 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:11.187 15:49:09 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:11.187 15:49:09 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:11.187 15:49:09 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:20:11.187 15:49:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:11.187 15:49:09 -- common/autotest_common.sh@10 -- # set +x 00:20:11.445 nvme0n1 00:20:11.445 15:49:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:11.445 15:49:09 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:11.445 15:49:09 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:11.445 15:49:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:11.445 15:49:09 -- common/autotest_common.sh@10 -- # set +x 00:20:11.445 15:49:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:11.445 15:49:09 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:11.445 15:49:09 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:11.446 15:49:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:11.446 15:49:09 -- common/autotest_common.sh@10 -- # set +x 00:20:11.446 15:49:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:11.446 15:49:09 -- host/auth.sh@107 -- # for digest in "${digests[@]}" 00:20:11.446 15:49:09 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:20:11.446 15:49:09 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:11.446 15:49:09 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 0 00:20:11.446 15:49:09 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:11.446 15:49:09 -- host/auth.sh@44 -- # digest=sha256 00:20:11.446 15:49:09 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:20:11.446 15:49:09 -- host/auth.sh@44 -- # keyid=0 00:20:11.446 15:49:09 -- host/auth.sh@45 -- # key=DHHC-1:00:OTM5MGRlZDM5MzNiZjkyNTdkZDcyZWUzYzdmMzYyNDJTpxB4: 00:20:11.446 15:49:09 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:20:11.446 15:49:09 -- host/auth.sh@48 -- # echo ffdhe2048 00:20:11.446 15:49:09 -- host/auth.sh@49 -- # echo DHHC-1:00:OTM5MGRlZDM5MzNiZjkyNTdkZDcyZWUzYzdmMzYyNDJTpxB4: 00:20:11.446 15:49:09 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 0 00:20:11.446 15:49:09 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:11.446 15:49:09 -- host/auth.sh@68 -- # digest=sha256 00:20:11.446 15:49:09 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:20:11.446 15:49:09 -- host/auth.sh@68 -- # keyid=0 00:20:11.446 15:49:09 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:20:11.446 15:49:09 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:11.446 15:49:09 -- common/autotest_common.sh@10 -- # set +x 00:20:11.446 15:49:09 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:11.446 15:49:09 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:11.446 15:49:09 -- nvmf/common.sh@717 -- # local ip 00:20:11.446 15:49:09 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:11.446 15:49:09 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:11.446 15:49:09 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:11.446 15:49:09 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:11.446 15:49:09 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:11.446 15:49:09 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:11.446 15:49:09 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:11.446 15:49:09 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:11.446 15:49:09 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:11.446 15:49:10 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:20:11.446 15:49:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:11.446 15:49:10 -- common/autotest_common.sh@10 -- # set +x 00:20:11.704 nvme0n1 00:20:11.704 15:49:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:11.704 15:49:10 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:11.704 15:49:10 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:11.704 15:49:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:11.704 15:49:10 -- common/autotest_common.sh@10 -- # set +x 00:20:11.704 15:49:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:11.704 15:49:10 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:11.704 15:49:10 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:11.704 15:49:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:11.704 15:49:10 -- common/autotest_common.sh@10 -- # set +x 00:20:11.704 15:49:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:11.704 15:49:10 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:11.704 15:49:10 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 1 00:20:11.704 15:49:10 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:11.704 15:49:10 -- host/auth.sh@44 -- # digest=sha256 00:20:11.704 15:49:10 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:20:11.704 15:49:10 -- host/auth.sh@44 -- # keyid=1 00:20:11.704 15:49:10 -- host/auth.sh@45 -- # key=DHHC-1:00:ZWQ0OTBmNjZkMDgwMjI2ZTU4NDcyNmZlOTk3NjZiY2ViYTYwODk5MTEyODRmMDM5s+pwyQ==: 00:20:11.704 15:49:10 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:20:11.704 15:49:10 -- host/auth.sh@48 -- # echo ffdhe2048 00:20:11.704 15:49:10 -- host/auth.sh@49 -- # echo DHHC-1:00:ZWQ0OTBmNjZkMDgwMjI2ZTU4NDcyNmZlOTk3NjZiY2ViYTYwODk5MTEyODRmMDM5s+pwyQ==: 00:20:11.704 15:49:10 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 1 00:20:11.704 15:49:10 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:11.704 15:49:10 -- host/auth.sh@68 -- # digest=sha256 00:20:11.704 15:49:10 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:20:11.704 15:49:10 -- host/auth.sh@68 -- # keyid=1 00:20:11.704 15:49:10 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:20:11.704 15:49:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:11.704 15:49:10 -- common/autotest_common.sh@10 -- # set +x 00:20:11.704 15:49:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:11.704 15:49:10 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:11.704 15:49:10 -- nvmf/common.sh@717 -- # local ip 00:20:11.704 15:49:10 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:11.704 15:49:10 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:11.704 15:49:10 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:11.704 15:49:10 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:11.704 15:49:10 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:11.704 15:49:10 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:11.704 15:49:10 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:11.704 15:49:10 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:11.704 15:49:10 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:11.704 15:49:10 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:20:11.705 15:49:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:11.705 15:49:10 -- common/autotest_common.sh@10 -- # set +x 00:20:11.973 nvme0n1 00:20:11.974 15:49:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:11.974 15:49:10 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:11.974 15:49:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:11.974 15:49:10 -- common/autotest_common.sh@10 -- # set +x 00:20:11.974 15:49:10 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:11.974 15:49:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:11.974 15:49:10 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:11.974 15:49:10 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:11.974 15:49:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:11.974 15:49:10 -- common/autotest_common.sh@10 -- # set +x 00:20:11.974 15:49:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:11.974 15:49:10 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:11.974 15:49:10 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 2 00:20:11.974 15:49:10 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:11.974 15:49:10 -- host/auth.sh@44 -- # digest=sha256 00:20:11.974 15:49:10 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:20:11.974 15:49:10 -- host/auth.sh@44 -- # keyid=2 00:20:11.974 15:49:10 -- host/auth.sh@45 -- # key=DHHC-1:01:NTMwYjViNGM5ZDQ2MGRjNDFmZTllNDE2OWI5YTNkNmGuEmCM: 00:20:11.974 15:49:10 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:20:11.974 15:49:10 -- host/auth.sh@48 -- # echo ffdhe2048 00:20:11.974 15:49:10 -- host/auth.sh@49 -- # echo DHHC-1:01:NTMwYjViNGM5ZDQ2MGRjNDFmZTllNDE2OWI5YTNkNmGuEmCM: 00:20:11.974 15:49:10 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 2 00:20:11.974 15:49:10 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:11.974 15:49:10 -- host/auth.sh@68 -- # digest=sha256 00:20:11.974 15:49:10 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:20:11.974 15:49:10 -- host/auth.sh@68 -- # keyid=2 00:20:11.974 15:49:10 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:20:11.974 15:49:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:11.974 15:49:10 -- common/autotest_common.sh@10 -- # set +x 00:20:11.974 15:49:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:12.233 15:49:10 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:12.233 15:49:10 -- nvmf/common.sh@717 -- # local ip 00:20:12.233 15:49:10 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:12.233 15:49:10 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:12.233 15:49:10 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:12.233 15:49:10 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:12.233 15:49:10 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:12.233 15:49:10 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:12.233 15:49:10 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:12.233 15:49:10 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:12.233 15:49:10 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:12.233 15:49:10 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:20:12.233 15:49:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:12.233 15:49:10 -- common/autotest_common.sh@10 -- # set +x 00:20:12.233 nvme0n1 00:20:12.233 15:49:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:12.233 15:49:10 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:12.233 15:49:10 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:12.233 15:49:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:12.233 15:49:10 -- common/autotest_common.sh@10 -- # set +x 00:20:12.233 15:49:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:12.233 15:49:10 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:12.233 15:49:10 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:12.233 15:49:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:12.233 15:49:10 -- common/autotest_common.sh@10 -- # set +x 00:20:12.491 15:49:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:12.491 15:49:10 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:12.491 15:49:10 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 3 00:20:12.491 15:49:10 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:12.491 15:49:10 -- host/auth.sh@44 -- # digest=sha256 00:20:12.491 15:49:10 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:20:12.491 15:49:10 -- host/auth.sh@44 -- # keyid=3 00:20:12.491 15:49:10 -- host/auth.sh@45 -- # key=DHHC-1:02:ZDkyOTBjNmYzOTM4ZDcyYzM4ODY5NTMzZjYwYmM2MjgyMDk5MzU0N2ExNzZhNDc3yxf8Vw==: 00:20:12.491 15:49:10 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:20:12.491 15:49:10 -- host/auth.sh@48 -- # echo ffdhe2048 00:20:12.491 15:49:10 -- host/auth.sh@49 -- # echo DHHC-1:02:ZDkyOTBjNmYzOTM4ZDcyYzM4ODY5NTMzZjYwYmM2MjgyMDk5MzU0N2ExNzZhNDc3yxf8Vw==: 00:20:12.491 15:49:10 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 3 00:20:12.491 15:49:10 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:12.491 15:49:10 -- host/auth.sh@68 -- # digest=sha256 00:20:12.491 15:49:10 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:20:12.491 15:49:10 -- host/auth.sh@68 -- # keyid=3 00:20:12.491 15:49:10 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:20:12.491 15:49:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:12.491 15:49:10 -- common/autotest_common.sh@10 -- # set +x 00:20:12.491 15:49:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:12.491 15:49:10 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:12.491 15:49:10 -- nvmf/common.sh@717 -- # local ip 00:20:12.491 15:49:10 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:12.491 15:49:10 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:12.491 15:49:10 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:12.491 15:49:10 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:12.491 15:49:10 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:12.491 15:49:10 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:12.491 15:49:10 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:12.491 15:49:10 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:12.491 15:49:10 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:12.491 15:49:10 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:20:12.491 15:49:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:12.491 15:49:10 -- common/autotest_common.sh@10 -- # set +x 00:20:12.491 nvme0n1 00:20:12.491 15:49:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:12.491 15:49:11 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:12.491 15:49:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:12.491 15:49:11 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:12.491 15:49:11 -- common/autotest_common.sh@10 -- # set +x 00:20:12.491 15:49:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:12.750 15:49:11 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:12.750 15:49:11 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:12.750 15:49:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:12.750 15:49:11 -- common/autotest_common.sh@10 -- # set +x 00:20:12.750 15:49:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:12.750 15:49:11 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:12.750 15:49:11 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 4 00:20:12.750 15:49:11 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:12.750 15:49:11 -- host/auth.sh@44 -- # digest=sha256 00:20:12.750 15:49:11 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:20:12.750 15:49:11 -- host/auth.sh@44 -- # keyid=4 00:20:12.750 15:49:11 -- host/auth.sh@45 -- # key=DHHC-1:03:NDM1MTI0NTZjYTJiYjdhODFhNjc0ZGYzMDA4N2EwMzEyM2Q1MzBmNTM3N2NkZTY4NTZiNDI1MTgyYWFkYmY5MgHOiKk=: 00:20:12.750 15:49:11 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:20:12.750 15:49:11 -- host/auth.sh@48 -- # echo ffdhe2048 00:20:12.750 15:49:11 -- host/auth.sh@49 -- # echo DHHC-1:03:NDM1MTI0NTZjYTJiYjdhODFhNjc0ZGYzMDA4N2EwMzEyM2Q1MzBmNTM3N2NkZTY4NTZiNDI1MTgyYWFkYmY5MgHOiKk=: 00:20:12.750 15:49:11 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 4 00:20:12.750 15:49:11 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:12.750 15:49:11 -- host/auth.sh@68 -- # digest=sha256 00:20:12.750 15:49:11 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:20:12.750 15:49:11 -- host/auth.sh@68 -- # keyid=4 00:20:12.750 15:49:11 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:20:12.750 15:49:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:12.750 15:49:11 -- common/autotest_common.sh@10 -- # set +x 00:20:12.750 15:49:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:12.750 15:49:11 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:12.750 15:49:11 -- nvmf/common.sh@717 -- # local ip 00:20:12.750 15:49:11 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:12.750 15:49:11 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:12.750 15:49:11 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:12.750 15:49:11 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:12.750 15:49:11 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:12.750 15:49:11 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:12.750 15:49:11 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:12.750 15:49:11 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:12.750 15:49:11 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:12.750 15:49:11 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:20:12.750 15:49:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:12.750 15:49:11 -- common/autotest_common.sh@10 -- # set +x 00:20:12.750 nvme0n1 00:20:12.750 15:49:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:12.750 15:49:11 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:12.750 15:49:11 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:12.750 15:49:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:12.750 15:49:11 -- common/autotest_common.sh@10 -- # set +x 00:20:13.008 15:49:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:13.008 15:49:11 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:13.008 15:49:11 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:13.008 15:49:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:13.008 15:49:11 -- common/autotest_common.sh@10 -- # set +x 00:20:13.008 15:49:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:13.008 15:49:11 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:20:13.008 15:49:11 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:13.008 15:49:11 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 0 00:20:13.008 15:49:11 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:13.008 15:49:11 -- host/auth.sh@44 -- # digest=sha256 00:20:13.008 15:49:11 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:20:13.008 15:49:11 -- host/auth.sh@44 -- # keyid=0 00:20:13.008 15:49:11 -- host/auth.sh@45 -- # key=DHHC-1:00:OTM5MGRlZDM5MzNiZjkyNTdkZDcyZWUzYzdmMzYyNDJTpxB4: 00:20:13.008 15:49:11 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:20:13.008 15:49:11 -- host/auth.sh@48 -- # echo ffdhe3072 00:20:13.008 15:49:11 -- host/auth.sh@49 -- # echo DHHC-1:00:OTM5MGRlZDM5MzNiZjkyNTdkZDcyZWUzYzdmMzYyNDJTpxB4: 00:20:13.008 15:49:11 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 0 00:20:13.008 15:49:11 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:13.008 15:49:11 -- host/auth.sh@68 -- # digest=sha256 00:20:13.008 15:49:11 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:20:13.008 15:49:11 -- host/auth.sh@68 -- # keyid=0 00:20:13.008 15:49:11 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:20:13.008 15:49:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:13.008 15:49:11 -- common/autotest_common.sh@10 -- # set +x 00:20:13.008 15:49:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:13.008 15:49:11 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:13.008 15:49:11 -- nvmf/common.sh@717 -- # local ip 00:20:13.008 15:49:11 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:13.008 15:49:11 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:13.008 15:49:11 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:13.008 15:49:11 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:13.008 15:49:11 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:13.008 15:49:11 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:13.008 15:49:11 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:13.008 15:49:11 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:13.008 15:49:11 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:13.008 15:49:11 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:20:13.008 15:49:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:13.008 15:49:11 -- common/autotest_common.sh@10 -- # set +x 00:20:13.267 nvme0n1 00:20:13.267 15:49:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:13.267 15:49:11 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:13.267 15:49:11 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:13.267 15:49:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:13.267 15:49:11 -- common/autotest_common.sh@10 -- # set +x 00:20:13.267 15:49:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:13.267 15:49:11 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:13.267 15:49:11 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:13.267 15:49:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:13.267 15:49:11 -- common/autotest_common.sh@10 -- # set +x 00:20:13.267 15:49:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:13.267 15:49:11 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:13.267 15:49:11 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 1 00:20:13.267 15:49:11 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:13.267 15:49:11 -- host/auth.sh@44 -- # digest=sha256 00:20:13.267 15:49:11 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:20:13.267 15:49:11 -- host/auth.sh@44 -- # keyid=1 00:20:13.267 15:49:11 -- host/auth.sh@45 -- # key=DHHC-1:00:ZWQ0OTBmNjZkMDgwMjI2ZTU4NDcyNmZlOTk3NjZiY2ViYTYwODk5MTEyODRmMDM5s+pwyQ==: 00:20:13.267 15:49:11 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:20:13.267 15:49:11 -- host/auth.sh@48 -- # echo ffdhe3072 00:20:13.267 15:49:11 -- host/auth.sh@49 -- # echo DHHC-1:00:ZWQ0OTBmNjZkMDgwMjI2ZTU4NDcyNmZlOTk3NjZiY2ViYTYwODk5MTEyODRmMDM5s+pwyQ==: 00:20:13.267 15:49:11 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 1 00:20:13.267 15:49:11 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:13.267 15:49:11 -- host/auth.sh@68 -- # digest=sha256 00:20:13.267 15:49:11 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:20:13.267 15:49:11 -- host/auth.sh@68 -- # keyid=1 00:20:13.267 15:49:11 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:20:13.267 15:49:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:13.267 15:49:11 -- common/autotest_common.sh@10 -- # set +x 00:20:13.267 15:49:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:13.267 15:49:11 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:13.267 15:49:11 -- nvmf/common.sh@717 -- # local ip 00:20:13.267 15:49:11 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:13.267 15:49:11 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:13.267 15:49:11 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:13.267 15:49:11 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:13.267 15:49:11 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:13.267 15:49:11 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:13.267 15:49:11 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:13.267 15:49:11 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:13.267 15:49:11 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:13.267 15:49:11 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:20:13.267 15:49:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:13.267 15:49:11 -- common/autotest_common.sh@10 -- # set +x 00:20:13.525 nvme0n1 00:20:13.525 15:49:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:13.526 15:49:11 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:13.526 15:49:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:13.526 15:49:11 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:13.526 15:49:11 -- common/autotest_common.sh@10 -- # set +x 00:20:13.526 15:49:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:13.526 15:49:11 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:13.526 15:49:11 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:13.526 15:49:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:13.526 15:49:11 -- common/autotest_common.sh@10 -- # set +x 00:20:13.526 15:49:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:13.526 15:49:12 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:13.526 15:49:12 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 2 00:20:13.526 15:49:12 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:13.526 15:49:12 -- host/auth.sh@44 -- # digest=sha256 00:20:13.526 15:49:12 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:20:13.526 15:49:12 -- host/auth.sh@44 -- # keyid=2 00:20:13.526 15:49:12 -- host/auth.sh@45 -- # key=DHHC-1:01:NTMwYjViNGM5ZDQ2MGRjNDFmZTllNDE2OWI5YTNkNmGuEmCM: 00:20:13.526 15:49:12 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:20:13.526 15:49:12 -- host/auth.sh@48 -- # echo ffdhe3072 00:20:13.526 15:49:12 -- host/auth.sh@49 -- # echo DHHC-1:01:NTMwYjViNGM5ZDQ2MGRjNDFmZTllNDE2OWI5YTNkNmGuEmCM: 00:20:13.526 15:49:12 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 2 00:20:13.526 15:49:12 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:13.526 15:49:12 -- host/auth.sh@68 -- # digest=sha256 00:20:13.526 15:49:12 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:20:13.526 15:49:12 -- host/auth.sh@68 -- # keyid=2 00:20:13.526 15:49:12 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:20:13.526 15:49:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:13.526 15:49:12 -- common/autotest_common.sh@10 -- # set +x 00:20:13.526 15:49:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:13.526 15:49:12 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:13.526 15:49:12 -- nvmf/common.sh@717 -- # local ip 00:20:13.526 15:49:12 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:13.526 15:49:12 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:13.526 15:49:12 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:13.526 15:49:12 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:13.526 15:49:12 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:13.526 15:49:12 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:13.526 15:49:12 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:13.526 15:49:12 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:13.526 15:49:12 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:13.526 15:49:12 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:20:13.526 15:49:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:13.526 15:49:12 -- common/autotest_common.sh@10 -- # set +x 00:20:13.784 nvme0n1 00:20:13.784 15:49:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:13.784 15:49:12 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:13.784 15:49:12 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:13.784 15:49:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:13.784 15:49:12 -- common/autotest_common.sh@10 -- # set +x 00:20:13.784 15:49:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:13.784 15:49:12 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:13.784 15:49:12 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:13.784 15:49:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:13.784 15:49:12 -- common/autotest_common.sh@10 -- # set +x 00:20:13.784 15:49:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:13.784 15:49:12 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:13.784 15:49:12 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 3 00:20:13.784 15:49:12 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:13.784 15:49:12 -- host/auth.sh@44 -- # digest=sha256 00:20:13.784 15:49:12 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:20:13.784 15:49:12 -- host/auth.sh@44 -- # keyid=3 00:20:13.784 15:49:12 -- host/auth.sh@45 -- # key=DHHC-1:02:ZDkyOTBjNmYzOTM4ZDcyYzM4ODY5NTMzZjYwYmM2MjgyMDk5MzU0N2ExNzZhNDc3yxf8Vw==: 00:20:13.784 15:49:12 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:20:13.784 15:49:12 -- host/auth.sh@48 -- # echo ffdhe3072 00:20:13.784 15:49:12 -- host/auth.sh@49 -- # echo DHHC-1:02:ZDkyOTBjNmYzOTM4ZDcyYzM4ODY5NTMzZjYwYmM2MjgyMDk5MzU0N2ExNzZhNDc3yxf8Vw==: 00:20:13.784 15:49:12 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 3 00:20:13.784 15:49:12 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:13.784 15:49:12 -- host/auth.sh@68 -- # digest=sha256 00:20:13.784 15:49:12 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:20:13.784 15:49:12 -- host/auth.sh@68 -- # keyid=3 00:20:13.784 15:49:12 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:20:13.784 15:49:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:13.784 15:49:12 -- common/autotest_common.sh@10 -- # set +x 00:20:13.784 15:49:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:13.784 15:49:12 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:13.784 15:49:12 -- nvmf/common.sh@717 -- # local ip 00:20:13.784 15:49:12 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:13.784 15:49:12 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:13.784 15:49:12 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:13.784 15:49:12 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:13.784 15:49:12 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:13.784 15:49:12 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:13.784 15:49:12 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:13.784 15:49:12 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:13.784 15:49:12 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:13.784 15:49:12 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:20:13.784 15:49:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:13.784 15:49:12 -- common/autotest_common.sh@10 -- # set +x 00:20:14.042 nvme0n1 00:20:14.042 15:49:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:14.042 15:49:12 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:14.042 15:49:12 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:14.042 15:49:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:14.042 15:49:12 -- common/autotest_common.sh@10 -- # set +x 00:20:14.042 15:49:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:14.042 15:49:12 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:14.042 15:49:12 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:14.042 15:49:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:14.042 15:49:12 -- common/autotest_common.sh@10 -- # set +x 00:20:14.300 15:49:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:14.300 15:49:12 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:14.300 15:49:12 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 4 00:20:14.300 15:49:12 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:14.300 15:49:12 -- host/auth.sh@44 -- # digest=sha256 00:20:14.301 15:49:12 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:20:14.301 15:49:12 -- host/auth.sh@44 -- # keyid=4 00:20:14.301 15:49:12 -- host/auth.sh@45 -- # key=DHHC-1:03:NDM1MTI0NTZjYTJiYjdhODFhNjc0ZGYzMDA4N2EwMzEyM2Q1MzBmNTM3N2NkZTY4NTZiNDI1MTgyYWFkYmY5MgHOiKk=: 00:20:14.301 15:49:12 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:20:14.301 15:49:12 -- host/auth.sh@48 -- # echo ffdhe3072 00:20:14.301 15:49:12 -- host/auth.sh@49 -- # echo DHHC-1:03:NDM1MTI0NTZjYTJiYjdhODFhNjc0ZGYzMDA4N2EwMzEyM2Q1MzBmNTM3N2NkZTY4NTZiNDI1MTgyYWFkYmY5MgHOiKk=: 00:20:14.301 15:49:12 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 4 00:20:14.301 15:49:12 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:14.301 15:49:12 -- host/auth.sh@68 -- # digest=sha256 00:20:14.301 15:49:12 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:20:14.301 15:49:12 -- host/auth.sh@68 -- # keyid=4 00:20:14.301 15:49:12 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:20:14.301 15:49:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:14.301 15:49:12 -- common/autotest_common.sh@10 -- # set +x 00:20:14.301 15:49:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:14.301 15:49:12 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:14.301 15:49:12 -- nvmf/common.sh@717 -- # local ip 00:20:14.301 15:49:12 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:14.301 15:49:12 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:14.301 15:49:12 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:14.301 15:49:12 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:14.301 15:49:12 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:14.301 15:49:12 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:14.301 15:49:12 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:14.301 15:49:12 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:14.301 15:49:12 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:14.301 15:49:12 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:20:14.301 15:49:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:14.301 15:49:12 -- common/autotest_common.sh@10 -- # set +x 00:20:14.301 nvme0n1 00:20:14.301 15:49:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:14.301 15:49:12 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:14.301 15:49:12 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:14.301 15:49:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:14.301 15:49:12 -- common/autotest_common.sh@10 -- # set +x 00:20:14.559 15:49:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:14.559 15:49:12 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:14.559 15:49:12 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:14.559 15:49:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:14.559 15:49:12 -- common/autotest_common.sh@10 -- # set +x 00:20:14.559 15:49:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:14.559 15:49:12 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:20:14.559 15:49:12 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:14.559 15:49:12 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 0 00:20:14.559 15:49:12 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:14.559 15:49:12 -- host/auth.sh@44 -- # digest=sha256 00:20:14.559 15:49:12 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:20:14.559 15:49:12 -- host/auth.sh@44 -- # keyid=0 00:20:14.559 15:49:12 -- host/auth.sh@45 -- # key=DHHC-1:00:OTM5MGRlZDM5MzNiZjkyNTdkZDcyZWUzYzdmMzYyNDJTpxB4: 00:20:14.559 15:49:12 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:20:14.559 15:49:12 -- host/auth.sh@48 -- # echo ffdhe4096 00:20:14.559 15:49:12 -- host/auth.sh@49 -- # echo DHHC-1:00:OTM5MGRlZDM5MzNiZjkyNTdkZDcyZWUzYzdmMzYyNDJTpxB4: 00:20:14.559 15:49:12 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 0 00:20:14.559 15:49:12 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:14.559 15:49:12 -- host/auth.sh@68 -- # digest=sha256 00:20:14.559 15:49:12 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:20:14.559 15:49:12 -- host/auth.sh@68 -- # keyid=0 00:20:14.559 15:49:12 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:20:14.559 15:49:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:14.559 15:49:12 -- common/autotest_common.sh@10 -- # set +x 00:20:14.559 15:49:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:14.559 15:49:12 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:14.559 15:49:12 -- nvmf/common.sh@717 -- # local ip 00:20:14.559 15:49:12 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:14.559 15:49:12 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:14.559 15:49:12 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:14.559 15:49:12 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:14.559 15:49:12 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:14.559 15:49:12 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:14.559 15:49:12 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:14.559 15:49:12 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:14.559 15:49:12 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:14.559 15:49:12 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:20:14.559 15:49:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:14.559 15:49:12 -- common/autotest_common.sh@10 -- # set +x 00:20:14.815 nvme0n1 00:20:14.815 15:49:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:14.815 15:49:13 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:14.815 15:49:13 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:14.815 15:49:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:14.815 15:49:13 -- common/autotest_common.sh@10 -- # set +x 00:20:14.815 15:49:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:14.815 15:49:13 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:14.815 15:49:13 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:14.815 15:49:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:14.815 15:49:13 -- common/autotest_common.sh@10 -- # set +x 00:20:14.815 15:49:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:14.815 15:49:13 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:14.815 15:49:13 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 1 00:20:14.815 15:49:13 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:14.815 15:49:13 -- host/auth.sh@44 -- # digest=sha256 00:20:14.815 15:49:13 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:20:14.815 15:49:13 -- host/auth.sh@44 -- # keyid=1 00:20:14.815 15:49:13 -- host/auth.sh@45 -- # key=DHHC-1:00:ZWQ0OTBmNjZkMDgwMjI2ZTU4NDcyNmZlOTk3NjZiY2ViYTYwODk5MTEyODRmMDM5s+pwyQ==: 00:20:14.815 15:49:13 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:20:14.816 15:49:13 -- host/auth.sh@48 -- # echo ffdhe4096 00:20:14.816 15:49:13 -- host/auth.sh@49 -- # echo DHHC-1:00:ZWQ0OTBmNjZkMDgwMjI2ZTU4NDcyNmZlOTk3NjZiY2ViYTYwODk5MTEyODRmMDM5s+pwyQ==: 00:20:14.816 15:49:13 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 1 00:20:14.816 15:49:13 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:14.816 15:49:13 -- host/auth.sh@68 -- # digest=sha256 00:20:14.816 15:49:13 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:20:14.816 15:49:13 -- host/auth.sh@68 -- # keyid=1 00:20:14.816 15:49:13 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:20:14.816 15:49:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:14.816 15:49:13 -- common/autotest_common.sh@10 -- # set +x 00:20:14.816 15:49:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:14.816 15:49:13 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:14.816 15:49:13 -- nvmf/common.sh@717 -- # local ip 00:20:14.816 15:49:13 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:14.816 15:49:13 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:14.816 15:49:13 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:14.816 15:49:13 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:14.816 15:49:13 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:14.816 15:49:13 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:14.816 15:49:13 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:14.816 15:49:13 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:14.816 15:49:13 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:14.816 15:49:13 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:20:14.816 15:49:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:14.816 15:49:13 -- common/autotest_common.sh@10 -- # set +x 00:20:15.072 nvme0n1 00:20:15.072 15:49:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:15.072 15:49:13 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:15.072 15:49:13 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:15.072 15:49:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:15.072 15:49:13 -- common/autotest_common.sh@10 -- # set +x 00:20:15.072 15:49:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:15.329 15:49:13 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:15.329 15:49:13 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:15.329 15:49:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:15.329 15:49:13 -- common/autotest_common.sh@10 -- # set +x 00:20:15.329 15:49:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:15.329 15:49:13 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:15.329 15:49:13 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 2 00:20:15.329 15:49:13 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:15.329 15:49:13 -- host/auth.sh@44 -- # digest=sha256 00:20:15.329 15:49:13 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:20:15.329 15:49:13 -- host/auth.sh@44 -- # keyid=2 00:20:15.329 15:49:13 -- host/auth.sh@45 -- # key=DHHC-1:01:NTMwYjViNGM5ZDQ2MGRjNDFmZTllNDE2OWI5YTNkNmGuEmCM: 00:20:15.329 15:49:13 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:20:15.329 15:49:13 -- host/auth.sh@48 -- # echo ffdhe4096 00:20:15.329 15:49:13 -- host/auth.sh@49 -- # echo DHHC-1:01:NTMwYjViNGM5ZDQ2MGRjNDFmZTllNDE2OWI5YTNkNmGuEmCM: 00:20:15.329 15:49:13 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 2 00:20:15.329 15:49:13 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:15.329 15:49:13 -- host/auth.sh@68 -- # digest=sha256 00:20:15.329 15:49:13 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:20:15.329 15:49:13 -- host/auth.sh@68 -- # keyid=2 00:20:15.329 15:49:13 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:20:15.329 15:49:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:15.329 15:49:13 -- common/autotest_common.sh@10 -- # set +x 00:20:15.329 15:49:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:15.329 15:49:13 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:15.329 15:49:13 -- nvmf/common.sh@717 -- # local ip 00:20:15.329 15:49:13 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:15.329 15:49:13 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:15.329 15:49:13 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:15.329 15:49:13 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:15.329 15:49:13 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:15.329 15:49:13 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:15.329 15:49:13 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:15.329 15:49:13 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:15.329 15:49:13 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:15.329 15:49:13 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:20:15.329 15:49:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:15.329 15:49:13 -- common/autotest_common.sh@10 -- # set +x 00:20:15.587 nvme0n1 00:20:15.587 15:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:15.587 15:49:14 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:15.587 15:49:14 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:15.587 15:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:15.587 15:49:14 -- common/autotest_common.sh@10 -- # set +x 00:20:15.587 15:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:15.587 15:49:14 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:15.587 15:49:14 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:15.587 15:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:15.587 15:49:14 -- common/autotest_common.sh@10 -- # set +x 00:20:15.587 15:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:15.587 15:49:14 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:15.587 15:49:14 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 3 00:20:15.587 15:49:14 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:15.587 15:49:14 -- host/auth.sh@44 -- # digest=sha256 00:20:15.587 15:49:14 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:20:15.587 15:49:14 -- host/auth.sh@44 -- # keyid=3 00:20:15.587 15:49:14 -- host/auth.sh@45 -- # key=DHHC-1:02:ZDkyOTBjNmYzOTM4ZDcyYzM4ODY5NTMzZjYwYmM2MjgyMDk5MzU0N2ExNzZhNDc3yxf8Vw==: 00:20:15.587 15:49:14 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:20:15.587 15:49:14 -- host/auth.sh@48 -- # echo ffdhe4096 00:20:15.587 15:49:14 -- host/auth.sh@49 -- # echo DHHC-1:02:ZDkyOTBjNmYzOTM4ZDcyYzM4ODY5NTMzZjYwYmM2MjgyMDk5MzU0N2ExNzZhNDc3yxf8Vw==: 00:20:15.587 15:49:14 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 3 00:20:15.587 15:49:14 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:15.587 15:49:14 -- host/auth.sh@68 -- # digest=sha256 00:20:15.587 15:49:14 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:20:15.587 15:49:14 -- host/auth.sh@68 -- # keyid=3 00:20:15.587 15:49:14 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:20:15.587 15:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:15.587 15:49:14 -- common/autotest_common.sh@10 -- # set +x 00:20:15.587 15:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:15.587 15:49:14 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:15.587 15:49:14 -- nvmf/common.sh@717 -- # local ip 00:20:15.587 15:49:14 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:15.587 15:49:14 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:15.587 15:49:14 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:15.587 15:49:14 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:15.587 15:49:14 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:15.587 15:49:14 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:15.587 15:49:14 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:15.587 15:49:14 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:15.587 15:49:14 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:15.588 15:49:14 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:20:15.588 15:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:15.588 15:49:14 -- common/autotest_common.sh@10 -- # set +x 00:20:15.846 nvme0n1 00:20:15.846 15:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:15.846 15:49:14 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:15.846 15:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:15.846 15:49:14 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:15.846 15:49:14 -- common/autotest_common.sh@10 -- # set +x 00:20:15.846 15:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:16.104 15:49:14 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:16.104 15:49:14 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:16.104 15:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:16.104 15:49:14 -- common/autotest_common.sh@10 -- # set +x 00:20:16.104 15:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:16.104 15:49:14 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:16.104 15:49:14 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 4 00:20:16.104 15:49:14 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:16.104 15:49:14 -- host/auth.sh@44 -- # digest=sha256 00:20:16.104 15:49:14 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:20:16.104 15:49:14 -- host/auth.sh@44 -- # keyid=4 00:20:16.104 15:49:14 -- host/auth.sh@45 -- # key=DHHC-1:03:NDM1MTI0NTZjYTJiYjdhODFhNjc0ZGYzMDA4N2EwMzEyM2Q1MzBmNTM3N2NkZTY4NTZiNDI1MTgyYWFkYmY5MgHOiKk=: 00:20:16.104 15:49:14 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:20:16.104 15:49:14 -- host/auth.sh@48 -- # echo ffdhe4096 00:20:16.104 15:49:14 -- host/auth.sh@49 -- # echo DHHC-1:03:NDM1MTI0NTZjYTJiYjdhODFhNjc0ZGYzMDA4N2EwMzEyM2Q1MzBmNTM3N2NkZTY4NTZiNDI1MTgyYWFkYmY5MgHOiKk=: 00:20:16.104 15:49:14 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 4 00:20:16.104 15:49:14 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:16.104 15:49:14 -- host/auth.sh@68 -- # digest=sha256 00:20:16.104 15:49:14 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:20:16.104 15:49:14 -- host/auth.sh@68 -- # keyid=4 00:20:16.104 15:49:14 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:20:16.104 15:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:16.104 15:49:14 -- common/autotest_common.sh@10 -- # set +x 00:20:16.104 15:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:16.104 15:49:14 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:16.104 15:49:14 -- nvmf/common.sh@717 -- # local ip 00:20:16.104 15:49:14 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:16.104 15:49:14 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:16.104 15:49:14 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:16.104 15:49:14 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:16.104 15:49:14 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:16.104 15:49:14 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:16.104 15:49:14 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:16.104 15:49:14 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:16.104 15:49:14 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:16.104 15:49:14 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:20:16.104 15:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:16.104 15:49:14 -- common/autotest_common.sh@10 -- # set +x 00:20:16.362 nvme0n1 00:20:16.362 15:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:16.362 15:49:14 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:16.362 15:49:14 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:16.362 15:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:16.362 15:49:14 -- common/autotest_common.sh@10 -- # set +x 00:20:16.362 15:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:16.362 15:49:14 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:16.362 15:49:14 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:16.362 15:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:16.362 15:49:14 -- common/autotest_common.sh@10 -- # set +x 00:20:16.362 15:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:16.362 15:49:14 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:20:16.362 15:49:14 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:16.362 15:49:14 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 0 00:20:16.362 15:49:14 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:16.362 15:49:14 -- host/auth.sh@44 -- # digest=sha256 00:20:16.362 15:49:14 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:20:16.362 15:49:14 -- host/auth.sh@44 -- # keyid=0 00:20:16.362 15:49:14 -- host/auth.sh@45 -- # key=DHHC-1:00:OTM5MGRlZDM5MzNiZjkyNTdkZDcyZWUzYzdmMzYyNDJTpxB4: 00:20:16.362 15:49:14 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:20:16.362 15:49:14 -- host/auth.sh@48 -- # echo ffdhe6144 00:20:16.362 15:49:14 -- host/auth.sh@49 -- # echo DHHC-1:00:OTM5MGRlZDM5MzNiZjkyNTdkZDcyZWUzYzdmMzYyNDJTpxB4: 00:20:16.362 15:49:14 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 0 00:20:16.362 15:49:14 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:16.362 15:49:14 -- host/auth.sh@68 -- # digest=sha256 00:20:16.362 15:49:14 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:20:16.362 15:49:14 -- host/auth.sh@68 -- # keyid=0 00:20:16.362 15:49:14 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:20:16.362 15:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:16.362 15:49:14 -- common/autotest_common.sh@10 -- # set +x 00:20:16.362 15:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:16.362 15:49:14 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:16.362 15:49:14 -- nvmf/common.sh@717 -- # local ip 00:20:16.362 15:49:14 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:16.362 15:49:14 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:16.362 15:49:14 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:16.362 15:49:14 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:16.362 15:49:14 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:16.362 15:49:14 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:16.362 15:49:14 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:16.362 15:49:14 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:16.362 15:49:14 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:16.362 15:49:14 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:20:16.362 15:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:16.362 15:49:14 -- common/autotest_common.sh@10 -- # set +x 00:20:16.928 nvme0n1 00:20:16.928 15:49:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:16.928 15:49:15 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:16.928 15:49:15 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:16.928 15:49:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:16.928 15:49:15 -- common/autotest_common.sh@10 -- # set +x 00:20:16.928 15:49:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:16.928 15:49:15 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:16.928 15:49:15 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:16.928 15:49:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:16.928 15:49:15 -- common/autotest_common.sh@10 -- # set +x 00:20:16.928 15:49:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:16.928 15:49:15 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:16.928 15:49:15 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 1 00:20:16.928 15:49:15 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:16.928 15:49:15 -- host/auth.sh@44 -- # digest=sha256 00:20:16.928 15:49:15 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:20:16.928 15:49:15 -- host/auth.sh@44 -- # keyid=1 00:20:16.928 15:49:15 -- host/auth.sh@45 -- # key=DHHC-1:00:ZWQ0OTBmNjZkMDgwMjI2ZTU4NDcyNmZlOTk3NjZiY2ViYTYwODk5MTEyODRmMDM5s+pwyQ==: 00:20:16.928 15:49:15 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:20:16.928 15:49:15 -- host/auth.sh@48 -- # echo ffdhe6144 00:20:16.928 15:49:15 -- host/auth.sh@49 -- # echo DHHC-1:00:ZWQ0OTBmNjZkMDgwMjI2ZTU4NDcyNmZlOTk3NjZiY2ViYTYwODk5MTEyODRmMDM5s+pwyQ==: 00:20:16.928 15:49:15 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 1 00:20:16.928 15:49:15 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:16.928 15:49:15 -- host/auth.sh@68 -- # digest=sha256 00:20:16.928 15:49:15 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:20:16.928 15:49:15 -- host/auth.sh@68 -- # keyid=1 00:20:16.928 15:49:15 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:20:16.928 15:49:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:16.928 15:49:15 -- common/autotest_common.sh@10 -- # set +x 00:20:16.928 15:49:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:16.928 15:49:15 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:16.928 15:49:15 -- nvmf/common.sh@717 -- # local ip 00:20:16.928 15:49:15 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:16.928 15:49:15 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:16.928 15:49:15 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:16.928 15:49:15 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:16.928 15:49:15 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:16.928 15:49:15 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:16.928 15:49:15 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:16.928 15:49:15 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:16.928 15:49:15 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:16.928 15:49:15 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:20:16.928 15:49:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:16.928 15:49:15 -- common/autotest_common.sh@10 -- # set +x 00:20:17.187 nvme0n1 00:20:17.187 15:49:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:17.445 15:49:15 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:17.445 15:49:15 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:17.445 15:49:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:17.445 15:49:15 -- common/autotest_common.sh@10 -- # set +x 00:20:17.445 15:49:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:17.445 15:49:15 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:17.445 15:49:15 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:17.445 15:49:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:17.445 15:49:15 -- common/autotest_common.sh@10 -- # set +x 00:20:17.445 15:49:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:17.445 15:49:15 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:17.445 15:49:15 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 2 00:20:17.445 15:49:15 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:17.445 15:49:15 -- host/auth.sh@44 -- # digest=sha256 00:20:17.445 15:49:15 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:20:17.445 15:49:15 -- host/auth.sh@44 -- # keyid=2 00:20:17.446 15:49:15 -- host/auth.sh@45 -- # key=DHHC-1:01:NTMwYjViNGM5ZDQ2MGRjNDFmZTllNDE2OWI5YTNkNmGuEmCM: 00:20:17.446 15:49:15 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:20:17.446 15:49:15 -- host/auth.sh@48 -- # echo ffdhe6144 00:20:17.446 15:49:15 -- host/auth.sh@49 -- # echo DHHC-1:01:NTMwYjViNGM5ZDQ2MGRjNDFmZTllNDE2OWI5YTNkNmGuEmCM: 00:20:17.446 15:49:15 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 2 00:20:17.446 15:49:15 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:17.446 15:49:15 -- host/auth.sh@68 -- # digest=sha256 00:20:17.446 15:49:15 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:20:17.446 15:49:15 -- host/auth.sh@68 -- # keyid=2 00:20:17.446 15:49:15 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:20:17.446 15:49:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:17.446 15:49:15 -- common/autotest_common.sh@10 -- # set +x 00:20:17.446 15:49:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:17.446 15:49:15 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:17.446 15:49:15 -- nvmf/common.sh@717 -- # local ip 00:20:17.446 15:49:15 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:17.446 15:49:15 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:17.446 15:49:15 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:17.446 15:49:15 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:17.446 15:49:15 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:17.446 15:49:15 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:17.446 15:49:15 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:17.446 15:49:15 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:17.446 15:49:15 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:17.446 15:49:15 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:20:17.446 15:49:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:17.446 15:49:15 -- common/autotest_common.sh@10 -- # set +x 00:20:17.703 nvme0n1 00:20:17.703 15:49:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:17.703 15:49:16 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:17.704 15:49:16 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:17.704 15:49:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:17.704 15:49:16 -- common/autotest_common.sh@10 -- # set +x 00:20:17.963 15:49:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:17.963 15:49:16 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:17.963 15:49:16 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:17.963 15:49:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:17.963 15:49:16 -- common/autotest_common.sh@10 -- # set +x 00:20:17.963 15:49:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:17.963 15:49:16 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:17.963 15:49:16 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 3 00:20:17.963 15:49:16 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:17.963 15:49:16 -- host/auth.sh@44 -- # digest=sha256 00:20:17.963 15:49:16 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:20:17.963 15:49:16 -- host/auth.sh@44 -- # keyid=3 00:20:17.963 15:49:16 -- host/auth.sh@45 -- # key=DHHC-1:02:ZDkyOTBjNmYzOTM4ZDcyYzM4ODY5NTMzZjYwYmM2MjgyMDk5MzU0N2ExNzZhNDc3yxf8Vw==: 00:20:17.963 15:49:16 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:20:17.963 15:49:16 -- host/auth.sh@48 -- # echo ffdhe6144 00:20:17.963 15:49:16 -- host/auth.sh@49 -- # echo DHHC-1:02:ZDkyOTBjNmYzOTM4ZDcyYzM4ODY5NTMzZjYwYmM2MjgyMDk5MzU0N2ExNzZhNDc3yxf8Vw==: 00:20:17.963 15:49:16 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 3 00:20:17.963 15:49:16 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:17.963 15:49:16 -- host/auth.sh@68 -- # digest=sha256 00:20:17.963 15:49:16 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:20:17.963 15:49:16 -- host/auth.sh@68 -- # keyid=3 00:20:17.963 15:49:16 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:20:17.963 15:49:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:17.963 15:49:16 -- common/autotest_common.sh@10 -- # set +x 00:20:17.963 15:49:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:17.963 15:49:16 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:17.963 15:49:16 -- nvmf/common.sh@717 -- # local ip 00:20:17.963 15:49:16 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:17.963 15:49:16 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:17.963 15:49:16 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:17.963 15:49:16 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:17.963 15:49:16 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:17.963 15:49:16 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:17.963 15:49:16 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:17.963 15:49:16 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:17.963 15:49:16 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:17.963 15:49:16 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:20:17.963 15:49:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:17.963 15:49:16 -- common/autotest_common.sh@10 -- # set +x 00:20:18.221 nvme0n1 00:20:18.221 15:49:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:18.221 15:49:16 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:18.221 15:49:16 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:18.221 15:49:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:18.221 15:49:16 -- common/autotest_common.sh@10 -- # set +x 00:20:18.221 15:49:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:18.480 15:49:16 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:18.480 15:49:16 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:18.480 15:49:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:18.480 15:49:16 -- common/autotest_common.sh@10 -- # set +x 00:20:18.480 15:49:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:18.480 15:49:16 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:18.480 15:49:16 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 4 00:20:18.480 15:49:16 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:18.480 15:49:16 -- host/auth.sh@44 -- # digest=sha256 00:20:18.480 15:49:16 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:20:18.480 15:49:16 -- host/auth.sh@44 -- # keyid=4 00:20:18.480 15:49:16 -- host/auth.sh@45 -- # key=DHHC-1:03:NDM1MTI0NTZjYTJiYjdhODFhNjc0ZGYzMDA4N2EwMzEyM2Q1MzBmNTM3N2NkZTY4NTZiNDI1MTgyYWFkYmY5MgHOiKk=: 00:20:18.480 15:49:16 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:20:18.480 15:49:16 -- host/auth.sh@48 -- # echo ffdhe6144 00:20:18.480 15:49:16 -- host/auth.sh@49 -- # echo DHHC-1:03:NDM1MTI0NTZjYTJiYjdhODFhNjc0ZGYzMDA4N2EwMzEyM2Q1MzBmNTM3N2NkZTY4NTZiNDI1MTgyYWFkYmY5MgHOiKk=: 00:20:18.480 15:49:16 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 4 00:20:18.480 15:49:16 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:18.480 15:49:16 -- host/auth.sh@68 -- # digest=sha256 00:20:18.480 15:49:16 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:20:18.480 15:49:16 -- host/auth.sh@68 -- # keyid=4 00:20:18.480 15:49:16 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:20:18.480 15:49:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:18.480 15:49:16 -- common/autotest_common.sh@10 -- # set +x 00:20:18.480 15:49:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:18.480 15:49:16 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:18.480 15:49:16 -- nvmf/common.sh@717 -- # local ip 00:20:18.480 15:49:16 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:18.480 15:49:16 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:18.480 15:49:16 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:18.480 15:49:16 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:18.480 15:49:16 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:18.480 15:49:16 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:18.480 15:49:16 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:18.480 15:49:16 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:18.480 15:49:16 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:18.480 15:49:16 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:20:18.480 15:49:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:18.480 15:49:16 -- common/autotest_common.sh@10 -- # set +x 00:20:18.739 nvme0n1 00:20:18.739 15:49:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:18.739 15:49:17 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:18.739 15:49:17 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:18.739 15:49:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:18.739 15:49:17 -- common/autotest_common.sh@10 -- # set +x 00:20:18.739 15:49:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:18.739 15:49:17 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:18.739 15:49:17 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:18.739 15:49:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:18.739 15:49:17 -- common/autotest_common.sh@10 -- # set +x 00:20:18.997 15:49:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:18.997 15:49:17 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:20:18.997 15:49:17 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:18.997 15:49:17 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 0 00:20:18.997 15:49:17 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:18.997 15:49:17 -- host/auth.sh@44 -- # digest=sha256 00:20:18.997 15:49:17 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:20:18.997 15:49:17 -- host/auth.sh@44 -- # keyid=0 00:20:18.997 15:49:17 -- host/auth.sh@45 -- # key=DHHC-1:00:OTM5MGRlZDM5MzNiZjkyNTdkZDcyZWUzYzdmMzYyNDJTpxB4: 00:20:18.997 15:49:17 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:20:18.997 15:49:17 -- host/auth.sh@48 -- # echo ffdhe8192 00:20:18.997 15:49:17 -- host/auth.sh@49 -- # echo DHHC-1:00:OTM5MGRlZDM5MzNiZjkyNTdkZDcyZWUzYzdmMzYyNDJTpxB4: 00:20:18.997 15:49:17 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 0 00:20:18.997 15:49:17 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:18.997 15:49:17 -- host/auth.sh@68 -- # digest=sha256 00:20:18.997 15:49:17 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:20:18.997 15:49:17 -- host/auth.sh@68 -- # keyid=0 00:20:18.997 15:49:17 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:20:18.998 15:49:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:18.998 15:49:17 -- common/autotest_common.sh@10 -- # set +x 00:20:18.998 15:49:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:18.998 15:49:17 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:18.998 15:49:17 -- nvmf/common.sh@717 -- # local ip 00:20:18.998 15:49:17 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:18.998 15:49:17 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:18.998 15:49:17 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:18.998 15:49:17 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:18.998 15:49:17 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:18.998 15:49:17 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:18.998 15:49:17 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:18.998 15:49:17 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:18.998 15:49:17 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:18.998 15:49:17 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:20:18.998 15:49:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:18.998 15:49:17 -- common/autotest_common.sh@10 -- # set +x 00:20:19.564 nvme0n1 00:20:19.564 15:49:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:19.564 15:49:17 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:19.564 15:49:17 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:19.564 15:49:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:19.564 15:49:17 -- common/autotest_common.sh@10 -- # set +x 00:20:19.564 15:49:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:19.564 15:49:18 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:19.564 15:49:18 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:19.564 15:49:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:19.564 15:49:18 -- common/autotest_common.sh@10 -- # set +x 00:20:19.564 15:49:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:19.564 15:49:18 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:19.564 15:49:18 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 1 00:20:19.564 15:49:18 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:19.564 15:49:18 -- host/auth.sh@44 -- # digest=sha256 00:20:19.564 15:49:18 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:20:19.564 15:49:18 -- host/auth.sh@44 -- # keyid=1 00:20:19.564 15:49:18 -- host/auth.sh@45 -- # key=DHHC-1:00:ZWQ0OTBmNjZkMDgwMjI2ZTU4NDcyNmZlOTk3NjZiY2ViYTYwODk5MTEyODRmMDM5s+pwyQ==: 00:20:19.564 15:49:18 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:20:19.564 15:49:18 -- host/auth.sh@48 -- # echo ffdhe8192 00:20:19.564 15:49:18 -- host/auth.sh@49 -- # echo DHHC-1:00:ZWQ0OTBmNjZkMDgwMjI2ZTU4NDcyNmZlOTk3NjZiY2ViYTYwODk5MTEyODRmMDM5s+pwyQ==: 00:20:19.564 15:49:18 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 1 00:20:19.564 15:49:18 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:19.564 15:49:18 -- host/auth.sh@68 -- # digest=sha256 00:20:19.564 15:49:18 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:20:19.564 15:49:18 -- host/auth.sh@68 -- # keyid=1 00:20:19.564 15:49:18 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:20:19.564 15:49:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:19.564 15:49:18 -- common/autotest_common.sh@10 -- # set +x 00:20:19.564 15:49:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:19.564 15:49:18 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:19.564 15:49:18 -- nvmf/common.sh@717 -- # local ip 00:20:19.564 15:49:18 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:19.564 15:49:18 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:19.564 15:49:18 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:19.564 15:49:18 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:19.564 15:49:18 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:19.564 15:49:18 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:19.564 15:49:18 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:19.564 15:49:18 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:19.564 15:49:18 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:19.564 15:49:18 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:20:19.564 15:49:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:19.564 15:49:18 -- common/autotest_common.sh@10 -- # set +x 00:20:20.131 nvme0n1 00:20:20.131 15:49:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:20.131 15:49:18 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:20.131 15:49:18 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:20.131 15:49:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:20.131 15:49:18 -- common/autotest_common.sh@10 -- # set +x 00:20:20.131 15:49:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:20.131 15:49:18 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:20.131 15:49:18 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:20.131 15:49:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:20.131 15:49:18 -- common/autotest_common.sh@10 -- # set +x 00:20:20.131 15:49:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:20.131 15:49:18 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:20.389 15:49:18 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 2 00:20:20.389 15:49:18 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:20.389 15:49:18 -- host/auth.sh@44 -- # digest=sha256 00:20:20.389 15:49:18 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:20:20.389 15:49:18 -- host/auth.sh@44 -- # keyid=2 00:20:20.389 15:49:18 -- host/auth.sh@45 -- # key=DHHC-1:01:NTMwYjViNGM5ZDQ2MGRjNDFmZTllNDE2OWI5YTNkNmGuEmCM: 00:20:20.389 15:49:18 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:20:20.389 15:49:18 -- host/auth.sh@48 -- # echo ffdhe8192 00:20:20.389 15:49:18 -- host/auth.sh@49 -- # echo DHHC-1:01:NTMwYjViNGM5ZDQ2MGRjNDFmZTllNDE2OWI5YTNkNmGuEmCM: 00:20:20.389 15:49:18 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 2 00:20:20.389 15:49:18 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:20.389 15:49:18 -- host/auth.sh@68 -- # digest=sha256 00:20:20.389 15:49:18 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:20:20.389 15:49:18 -- host/auth.sh@68 -- # keyid=2 00:20:20.389 15:49:18 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:20:20.389 15:49:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:20.389 15:49:18 -- common/autotest_common.sh@10 -- # set +x 00:20:20.389 15:49:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:20.389 15:49:18 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:20.389 15:49:18 -- nvmf/common.sh@717 -- # local ip 00:20:20.389 15:49:18 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:20.389 15:49:18 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:20.389 15:49:18 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:20.389 15:49:18 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:20.389 15:49:18 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:20.389 15:49:18 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:20.389 15:49:18 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:20.389 15:49:18 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:20.389 15:49:18 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:20.389 15:49:18 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:20:20.389 15:49:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:20.389 15:49:18 -- common/autotest_common.sh@10 -- # set +x 00:20:20.955 nvme0n1 00:20:20.955 15:49:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:20.955 15:49:19 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:20.955 15:49:19 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:20.955 15:49:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:20.955 15:49:19 -- common/autotest_common.sh@10 -- # set +x 00:20:20.955 15:49:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:20.955 15:49:19 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:20.955 15:49:19 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:20.955 15:49:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:20.955 15:49:19 -- common/autotest_common.sh@10 -- # set +x 00:20:20.955 15:49:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:20.955 15:49:19 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:20.955 15:49:19 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 3 00:20:20.955 15:49:19 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:20.955 15:49:19 -- host/auth.sh@44 -- # digest=sha256 00:20:20.955 15:49:19 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:20:20.955 15:49:19 -- host/auth.sh@44 -- # keyid=3 00:20:20.955 15:49:19 -- host/auth.sh@45 -- # key=DHHC-1:02:ZDkyOTBjNmYzOTM4ZDcyYzM4ODY5NTMzZjYwYmM2MjgyMDk5MzU0N2ExNzZhNDc3yxf8Vw==: 00:20:20.955 15:49:19 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:20:20.955 15:49:19 -- host/auth.sh@48 -- # echo ffdhe8192 00:20:20.955 15:49:19 -- host/auth.sh@49 -- # echo DHHC-1:02:ZDkyOTBjNmYzOTM4ZDcyYzM4ODY5NTMzZjYwYmM2MjgyMDk5MzU0N2ExNzZhNDc3yxf8Vw==: 00:20:20.955 15:49:19 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 3 00:20:20.955 15:49:19 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:20.955 15:49:19 -- host/auth.sh@68 -- # digest=sha256 00:20:20.955 15:49:19 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:20:20.955 15:49:19 -- host/auth.sh@68 -- # keyid=3 00:20:20.955 15:49:19 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:20:20.955 15:49:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:20.955 15:49:19 -- common/autotest_common.sh@10 -- # set +x 00:20:20.955 15:49:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:20.955 15:49:19 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:20.955 15:49:19 -- nvmf/common.sh@717 -- # local ip 00:20:20.955 15:49:19 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:20.955 15:49:19 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:20.955 15:49:19 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:20.955 15:49:19 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:20.956 15:49:19 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:20.956 15:49:19 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:20.956 15:49:19 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:20.956 15:49:19 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:20.956 15:49:19 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:20.956 15:49:19 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:20:20.956 15:49:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:20.956 15:49:19 -- common/autotest_common.sh@10 -- # set +x 00:20:21.521 nvme0n1 00:20:21.521 15:49:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:21.521 15:49:20 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:21.521 15:49:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:21.521 15:49:20 -- common/autotest_common.sh@10 -- # set +x 00:20:21.521 15:49:20 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:21.521 15:49:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:21.521 15:49:20 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:21.521 15:49:20 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:21.521 15:49:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:21.521 15:49:20 -- common/autotest_common.sh@10 -- # set +x 00:20:21.779 15:49:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:21.779 15:49:20 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:21.779 15:49:20 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 4 00:20:21.779 15:49:20 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:21.779 15:49:20 -- host/auth.sh@44 -- # digest=sha256 00:20:21.779 15:49:20 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:20:21.779 15:49:20 -- host/auth.sh@44 -- # keyid=4 00:20:21.779 15:49:20 -- host/auth.sh@45 -- # key=DHHC-1:03:NDM1MTI0NTZjYTJiYjdhODFhNjc0ZGYzMDA4N2EwMzEyM2Q1MzBmNTM3N2NkZTY4NTZiNDI1MTgyYWFkYmY5MgHOiKk=: 00:20:21.779 15:49:20 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:20:21.779 15:49:20 -- host/auth.sh@48 -- # echo ffdhe8192 00:20:21.779 15:49:20 -- host/auth.sh@49 -- # echo DHHC-1:03:NDM1MTI0NTZjYTJiYjdhODFhNjc0ZGYzMDA4N2EwMzEyM2Q1MzBmNTM3N2NkZTY4NTZiNDI1MTgyYWFkYmY5MgHOiKk=: 00:20:21.779 15:49:20 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 4 00:20:21.779 15:49:20 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:21.779 15:49:20 -- host/auth.sh@68 -- # digest=sha256 00:20:21.779 15:49:20 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:20:21.779 15:49:20 -- host/auth.sh@68 -- # keyid=4 00:20:21.779 15:49:20 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:20:21.779 15:49:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:21.779 15:49:20 -- common/autotest_common.sh@10 -- # set +x 00:20:21.779 15:49:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:21.779 15:49:20 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:21.779 15:49:20 -- nvmf/common.sh@717 -- # local ip 00:20:21.779 15:49:20 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:21.779 15:49:20 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:21.779 15:49:20 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:21.779 15:49:20 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:21.779 15:49:20 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:21.779 15:49:20 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:21.779 15:49:20 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:21.779 15:49:20 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:21.779 15:49:20 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:21.779 15:49:20 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:20:21.779 15:49:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:21.779 15:49:20 -- common/autotest_common.sh@10 -- # set +x 00:20:22.344 nvme0n1 00:20:22.344 15:49:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:22.344 15:49:20 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:22.344 15:49:20 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:22.344 15:49:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:22.344 15:49:20 -- common/autotest_common.sh@10 -- # set +x 00:20:22.344 15:49:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:22.344 15:49:20 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:22.344 15:49:20 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:22.344 15:49:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:22.344 15:49:20 -- common/autotest_common.sh@10 -- # set +x 00:20:22.344 15:49:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:22.344 15:49:20 -- host/auth.sh@107 -- # for digest in "${digests[@]}" 00:20:22.344 15:49:20 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:20:22.344 15:49:20 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:22.344 15:49:20 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 0 00:20:22.344 15:49:20 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:22.344 15:49:20 -- host/auth.sh@44 -- # digest=sha384 00:20:22.344 15:49:20 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:20:22.344 15:49:20 -- host/auth.sh@44 -- # keyid=0 00:20:22.344 15:49:20 -- host/auth.sh@45 -- # key=DHHC-1:00:OTM5MGRlZDM5MzNiZjkyNTdkZDcyZWUzYzdmMzYyNDJTpxB4: 00:20:22.344 15:49:20 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:22.344 15:49:20 -- host/auth.sh@48 -- # echo ffdhe2048 00:20:22.344 15:49:20 -- host/auth.sh@49 -- # echo DHHC-1:00:OTM5MGRlZDM5MzNiZjkyNTdkZDcyZWUzYzdmMzYyNDJTpxB4: 00:20:22.344 15:49:20 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 0 00:20:22.344 15:49:20 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:22.344 15:49:20 -- host/auth.sh@68 -- # digest=sha384 00:20:22.344 15:49:20 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:20:22.344 15:49:20 -- host/auth.sh@68 -- # keyid=0 00:20:22.344 15:49:20 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:20:22.344 15:49:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:22.344 15:49:20 -- common/autotest_common.sh@10 -- # set +x 00:20:22.344 15:49:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:22.344 15:49:20 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:22.344 15:49:20 -- nvmf/common.sh@717 -- # local ip 00:20:22.344 15:49:20 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:22.344 15:49:20 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:22.344 15:49:20 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:22.344 15:49:20 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:22.344 15:49:20 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:22.344 15:49:20 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:22.344 15:49:20 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:22.344 15:49:20 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:22.344 15:49:20 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:22.344 15:49:20 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:20:22.344 15:49:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:22.344 15:49:20 -- common/autotest_common.sh@10 -- # set +x 00:20:22.602 nvme0n1 00:20:22.602 15:49:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:22.602 15:49:21 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:22.602 15:49:21 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:22.602 15:49:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:22.602 15:49:21 -- common/autotest_common.sh@10 -- # set +x 00:20:22.602 15:49:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:22.602 15:49:21 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:22.602 15:49:21 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:22.602 15:49:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:22.602 15:49:21 -- common/autotest_common.sh@10 -- # set +x 00:20:22.602 15:49:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:22.602 15:49:21 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:22.602 15:49:21 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 1 00:20:22.602 15:49:21 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:22.602 15:49:21 -- host/auth.sh@44 -- # digest=sha384 00:20:22.602 15:49:21 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:20:22.602 15:49:21 -- host/auth.sh@44 -- # keyid=1 00:20:22.602 15:49:21 -- host/auth.sh@45 -- # key=DHHC-1:00:ZWQ0OTBmNjZkMDgwMjI2ZTU4NDcyNmZlOTk3NjZiY2ViYTYwODk5MTEyODRmMDM5s+pwyQ==: 00:20:22.602 15:49:21 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:22.602 15:49:21 -- host/auth.sh@48 -- # echo ffdhe2048 00:20:22.602 15:49:21 -- host/auth.sh@49 -- # echo DHHC-1:00:ZWQ0OTBmNjZkMDgwMjI2ZTU4NDcyNmZlOTk3NjZiY2ViYTYwODk5MTEyODRmMDM5s+pwyQ==: 00:20:22.603 15:49:21 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 1 00:20:22.603 15:49:21 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:22.603 15:49:21 -- host/auth.sh@68 -- # digest=sha384 00:20:22.603 15:49:21 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:20:22.603 15:49:21 -- host/auth.sh@68 -- # keyid=1 00:20:22.603 15:49:21 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:20:22.603 15:49:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:22.603 15:49:21 -- common/autotest_common.sh@10 -- # set +x 00:20:22.603 15:49:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:22.603 15:49:21 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:22.603 15:49:21 -- nvmf/common.sh@717 -- # local ip 00:20:22.603 15:49:21 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:22.603 15:49:21 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:22.603 15:49:21 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:22.603 15:49:21 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:22.603 15:49:21 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:22.603 15:49:21 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:22.603 15:49:21 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:22.603 15:49:21 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:22.603 15:49:21 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:22.603 15:49:21 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:20:22.603 15:49:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:22.603 15:49:21 -- common/autotest_common.sh@10 -- # set +x 00:20:22.861 nvme0n1 00:20:22.861 15:49:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:22.861 15:49:21 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:22.861 15:49:21 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:22.861 15:49:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:22.861 15:49:21 -- common/autotest_common.sh@10 -- # set +x 00:20:22.861 15:49:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:22.861 15:49:21 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:22.861 15:49:21 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:22.861 15:49:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:22.861 15:49:21 -- common/autotest_common.sh@10 -- # set +x 00:20:22.861 15:49:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:22.861 15:49:21 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:22.861 15:49:21 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 2 00:20:22.861 15:49:21 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:22.861 15:49:21 -- host/auth.sh@44 -- # digest=sha384 00:20:22.861 15:49:21 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:20:22.861 15:49:21 -- host/auth.sh@44 -- # keyid=2 00:20:22.861 15:49:21 -- host/auth.sh@45 -- # key=DHHC-1:01:NTMwYjViNGM5ZDQ2MGRjNDFmZTllNDE2OWI5YTNkNmGuEmCM: 00:20:22.861 15:49:21 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:22.861 15:49:21 -- host/auth.sh@48 -- # echo ffdhe2048 00:20:22.861 15:49:21 -- host/auth.sh@49 -- # echo DHHC-1:01:NTMwYjViNGM5ZDQ2MGRjNDFmZTllNDE2OWI5YTNkNmGuEmCM: 00:20:22.861 15:49:21 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 2 00:20:22.861 15:49:21 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:22.861 15:49:21 -- host/auth.sh@68 -- # digest=sha384 00:20:22.861 15:49:21 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:20:22.861 15:49:21 -- host/auth.sh@68 -- # keyid=2 00:20:22.861 15:49:21 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:20:22.861 15:49:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:22.861 15:49:21 -- common/autotest_common.sh@10 -- # set +x 00:20:22.861 15:49:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:22.861 15:49:21 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:22.861 15:49:21 -- nvmf/common.sh@717 -- # local ip 00:20:22.861 15:49:21 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:22.861 15:49:21 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:22.861 15:49:21 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:22.861 15:49:21 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:22.861 15:49:21 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:22.861 15:49:21 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:22.861 15:49:21 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:22.861 15:49:21 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:22.861 15:49:21 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:22.861 15:49:21 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:20:22.862 15:49:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:22.862 15:49:21 -- common/autotest_common.sh@10 -- # set +x 00:20:23.120 nvme0n1 00:20:23.120 15:49:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:23.120 15:49:21 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:23.120 15:49:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:23.120 15:49:21 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:23.120 15:49:21 -- common/autotest_common.sh@10 -- # set +x 00:20:23.120 15:49:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:23.120 15:49:21 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:23.120 15:49:21 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:23.120 15:49:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:23.120 15:49:21 -- common/autotest_common.sh@10 -- # set +x 00:20:23.120 15:49:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:23.120 15:49:21 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:23.120 15:49:21 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 3 00:20:23.120 15:49:21 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:23.120 15:49:21 -- host/auth.sh@44 -- # digest=sha384 00:20:23.120 15:49:21 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:20:23.120 15:49:21 -- host/auth.sh@44 -- # keyid=3 00:20:23.120 15:49:21 -- host/auth.sh@45 -- # key=DHHC-1:02:ZDkyOTBjNmYzOTM4ZDcyYzM4ODY5NTMzZjYwYmM2MjgyMDk5MzU0N2ExNzZhNDc3yxf8Vw==: 00:20:23.120 15:49:21 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:23.120 15:49:21 -- host/auth.sh@48 -- # echo ffdhe2048 00:20:23.120 15:49:21 -- host/auth.sh@49 -- # echo DHHC-1:02:ZDkyOTBjNmYzOTM4ZDcyYzM4ODY5NTMzZjYwYmM2MjgyMDk5MzU0N2ExNzZhNDc3yxf8Vw==: 00:20:23.120 15:49:21 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 3 00:20:23.120 15:49:21 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:23.379 15:49:21 -- host/auth.sh@68 -- # digest=sha384 00:20:23.379 15:49:21 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:20:23.379 15:49:21 -- host/auth.sh@68 -- # keyid=3 00:20:23.379 15:49:21 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:20:23.379 15:49:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:23.379 15:49:21 -- common/autotest_common.sh@10 -- # set +x 00:20:23.379 15:49:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:23.379 15:49:21 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:23.379 15:49:21 -- nvmf/common.sh@717 -- # local ip 00:20:23.379 15:49:21 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:23.379 15:49:21 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:23.379 15:49:21 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:23.379 15:49:21 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:23.379 15:49:21 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:23.379 15:49:21 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:23.379 15:49:21 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:23.379 15:49:21 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:23.379 15:49:21 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:23.379 15:49:21 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:20:23.379 15:49:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:23.379 15:49:21 -- common/autotest_common.sh@10 -- # set +x 00:20:23.379 nvme0n1 00:20:23.379 15:49:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:23.379 15:49:21 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:23.379 15:49:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:23.379 15:49:21 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:23.379 15:49:21 -- common/autotest_common.sh@10 -- # set +x 00:20:23.379 15:49:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:23.379 15:49:21 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:23.379 15:49:21 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:23.379 15:49:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:23.379 15:49:21 -- common/autotest_common.sh@10 -- # set +x 00:20:23.637 15:49:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:23.637 15:49:21 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:23.637 15:49:21 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 4 00:20:23.637 15:49:21 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:23.637 15:49:21 -- host/auth.sh@44 -- # digest=sha384 00:20:23.637 15:49:21 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:20:23.637 15:49:21 -- host/auth.sh@44 -- # keyid=4 00:20:23.637 15:49:21 -- host/auth.sh@45 -- # key=DHHC-1:03:NDM1MTI0NTZjYTJiYjdhODFhNjc0ZGYzMDA4N2EwMzEyM2Q1MzBmNTM3N2NkZTY4NTZiNDI1MTgyYWFkYmY5MgHOiKk=: 00:20:23.637 15:49:21 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:23.637 15:49:21 -- host/auth.sh@48 -- # echo ffdhe2048 00:20:23.638 15:49:21 -- host/auth.sh@49 -- # echo DHHC-1:03:NDM1MTI0NTZjYTJiYjdhODFhNjc0ZGYzMDA4N2EwMzEyM2Q1MzBmNTM3N2NkZTY4NTZiNDI1MTgyYWFkYmY5MgHOiKk=: 00:20:23.638 15:49:21 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 4 00:20:23.638 15:49:22 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:23.638 15:49:22 -- host/auth.sh@68 -- # digest=sha384 00:20:23.638 15:49:22 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:20:23.638 15:49:22 -- host/auth.sh@68 -- # keyid=4 00:20:23.638 15:49:22 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:20:23.638 15:49:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:23.638 15:49:22 -- common/autotest_common.sh@10 -- # set +x 00:20:23.638 15:49:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:23.638 15:49:22 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:23.638 15:49:22 -- nvmf/common.sh@717 -- # local ip 00:20:23.638 15:49:22 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:23.638 15:49:22 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:23.638 15:49:22 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:23.638 15:49:22 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:23.638 15:49:22 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:23.638 15:49:22 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:23.638 15:49:22 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:23.638 15:49:22 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:23.638 15:49:22 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:23.638 15:49:22 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:20:23.638 15:49:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:23.638 15:49:22 -- common/autotest_common.sh@10 -- # set +x 00:20:23.638 nvme0n1 00:20:23.638 15:49:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:23.638 15:49:22 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:23.638 15:49:22 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:23.638 15:49:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:23.638 15:49:22 -- common/autotest_common.sh@10 -- # set +x 00:20:23.638 15:49:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:23.896 15:49:22 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:23.896 15:49:22 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:23.896 15:49:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:23.896 15:49:22 -- common/autotest_common.sh@10 -- # set +x 00:20:23.896 15:49:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:23.896 15:49:22 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:20:23.896 15:49:22 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:23.896 15:49:22 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 0 00:20:23.896 15:49:22 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:23.896 15:49:22 -- host/auth.sh@44 -- # digest=sha384 00:20:23.896 15:49:22 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:20:23.896 15:49:22 -- host/auth.sh@44 -- # keyid=0 00:20:23.896 15:49:22 -- host/auth.sh@45 -- # key=DHHC-1:00:OTM5MGRlZDM5MzNiZjkyNTdkZDcyZWUzYzdmMzYyNDJTpxB4: 00:20:23.896 15:49:22 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:23.896 15:49:22 -- host/auth.sh@48 -- # echo ffdhe3072 00:20:23.896 15:49:22 -- host/auth.sh@49 -- # echo DHHC-1:00:OTM5MGRlZDM5MzNiZjkyNTdkZDcyZWUzYzdmMzYyNDJTpxB4: 00:20:23.896 15:49:22 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 0 00:20:23.896 15:49:22 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:23.896 15:49:22 -- host/auth.sh@68 -- # digest=sha384 00:20:23.896 15:49:22 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:20:23.896 15:49:22 -- host/auth.sh@68 -- # keyid=0 00:20:23.896 15:49:22 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:20:23.896 15:49:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:23.896 15:49:22 -- common/autotest_common.sh@10 -- # set +x 00:20:23.896 15:49:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:23.896 15:49:22 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:23.896 15:49:22 -- nvmf/common.sh@717 -- # local ip 00:20:23.896 15:49:22 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:23.896 15:49:22 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:23.896 15:49:22 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:23.896 15:49:22 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:23.896 15:49:22 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:23.896 15:49:22 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:23.896 15:49:22 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:23.896 15:49:22 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:23.896 15:49:22 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:23.896 15:49:22 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:20:23.896 15:49:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:23.896 15:49:22 -- common/autotest_common.sh@10 -- # set +x 00:20:24.154 nvme0n1 00:20:24.154 15:49:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.154 15:49:22 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:24.154 15:49:22 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:24.154 15:49:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.154 15:49:22 -- common/autotest_common.sh@10 -- # set +x 00:20:24.154 15:49:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.154 15:49:22 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:24.154 15:49:22 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:24.154 15:49:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.154 15:49:22 -- common/autotest_common.sh@10 -- # set +x 00:20:24.154 15:49:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.154 15:49:22 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:24.154 15:49:22 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 1 00:20:24.154 15:49:22 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:24.154 15:49:22 -- host/auth.sh@44 -- # digest=sha384 00:20:24.154 15:49:22 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:20:24.154 15:49:22 -- host/auth.sh@44 -- # keyid=1 00:20:24.154 15:49:22 -- host/auth.sh@45 -- # key=DHHC-1:00:ZWQ0OTBmNjZkMDgwMjI2ZTU4NDcyNmZlOTk3NjZiY2ViYTYwODk5MTEyODRmMDM5s+pwyQ==: 00:20:24.154 15:49:22 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:24.154 15:49:22 -- host/auth.sh@48 -- # echo ffdhe3072 00:20:24.154 15:49:22 -- host/auth.sh@49 -- # echo DHHC-1:00:ZWQ0OTBmNjZkMDgwMjI2ZTU4NDcyNmZlOTk3NjZiY2ViYTYwODk5MTEyODRmMDM5s+pwyQ==: 00:20:24.154 15:49:22 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 1 00:20:24.154 15:49:22 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:24.154 15:49:22 -- host/auth.sh@68 -- # digest=sha384 00:20:24.154 15:49:22 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:20:24.154 15:49:22 -- host/auth.sh@68 -- # keyid=1 00:20:24.154 15:49:22 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:20:24.154 15:49:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.154 15:49:22 -- common/autotest_common.sh@10 -- # set +x 00:20:24.154 15:49:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.154 15:49:22 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:24.154 15:49:22 -- nvmf/common.sh@717 -- # local ip 00:20:24.154 15:49:22 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:24.154 15:49:22 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:24.154 15:49:22 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:24.154 15:49:22 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:24.154 15:49:22 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:24.154 15:49:22 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:24.154 15:49:22 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:24.154 15:49:22 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:24.154 15:49:22 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:24.154 15:49:22 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:20:24.154 15:49:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.154 15:49:22 -- common/autotest_common.sh@10 -- # set +x 00:20:24.413 nvme0n1 00:20:24.413 15:49:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.413 15:49:22 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:24.413 15:49:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.413 15:49:22 -- common/autotest_common.sh@10 -- # set +x 00:20:24.413 15:49:22 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:24.413 15:49:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.413 15:49:22 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:24.413 15:49:22 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:24.413 15:49:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.413 15:49:22 -- common/autotest_common.sh@10 -- # set +x 00:20:24.413 15:49:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.413 15:49:22 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:24.413 15:49:22 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 2 00:20:24.413 15:49:22 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:24.413 15:49:22 -- host/auth.sh@44 -- # digest=sha384 00:20:24.413 15:49:22 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:20:24.413 15:49:22 -- host/auth.sh@44 -- # keyid=2 00:20:24.413 15:49:22 -- host/auth.sh@45 -- # key=DHHC-1:01:NTMwYjViNGM5ZDQ2MGRjNDFmZTllNDE2OWI5YTNkNmGuEmCM: 00:20:24.413 15:49:22 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:24.413 15:49:22 -- host/auth.sh@48 -- # echo ffdhe3072 00:20:24.413 15:49:22 -- host/auth.sh@49 -- # echo DHHC-1:01:NTMwYjViNGM5ZDQ2MGRjNDFmZTllNDE2OWI5YTNkNmGuEmCM: 00:20:24.413 15:49:22 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 2 00:20:24.413 15:49:22 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:24.413 15:49:22 -- host/auth.sh@68 -- # digest=sha384 00:20:24.413 15:49:22 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:20:24.413 15:49:22 -- host/auth.sh@68 -- # keyid=2 00:20:24.413 15:49:22 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:20:24.413 15:49:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.413 15:49:22 -- common/autotest_common.sh@10 -- # set +x 00:20:24.413 15:49:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.413 15:49:22 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:24.413 15:49:22 -- nvmf/common.sh@717 -- # local ip 00:20:24.413 15:49:22 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:24.413 15:49:22 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:24.413 15:49:22 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:24.413 15:49:22 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:24.413 15:49:22 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:24.413 15:49:22 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:24.413 15:49:22 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:24.413 15:49:22 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:24.413 15:49:22 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:24.413 15:49:22 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:20:24.413 15:49:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.413 15:49:22 -- common/autotest_common.sh@10 -- # set +x 00:20:24.671 nvme0n1 00:20:24.671 15:49:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.671 15:49:23 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:24.671 15:49:23 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:24.671 15:49:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.671 15:49:23 -- common/autotest_common.sh@10 -- # set +x 00:20:24.671 15:49:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.671 15:49:23 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:24.671 15:49:23 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:24.671 15:49:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.671 15:49:23 -- common/autotest_common.sh@10 -- # set +x 00:20:24.671 15:49:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.671 15:49:23 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:24.671 15:49:23 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 3 00:20:24.671 15:49:23 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:24.671 15:49:23 -- host/auth.sh@44 -- # digest=sha384 00:20:24.671 15:49:23 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:20:24.671 15:49:23 -- host/auth.sh@44 -- # keyid=3 00:20:24.671 15:49:23 -- host/auth.sh@45 -- # key=DHHC-1:02:ZDkyOTBjNmYzOTM4ZDcyYzM4ODY5NTMzZjYwYmM2MjgyMDk5MzU0N2ExNzZhNDc3yxf8Vw==: 00:20:24.671 15:49:23 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:24.671 15:49:23 -- host/auth.sh@48 -- # echo ffdhe3072 00:20:24.671 15:49:23 -- host/auth.sh@49 -- # echo DHHC-1:02:ZDkyOTBjNmYzOTM4ZDcyYzM4ODY5NTMzZjYwYmM2MjgyMDk5MzU0N2ExNzZhNDc3yxf8Vw==: 00:20:24.671 15:49:23 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 3 00:20:24.671 15:49:23 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:24.671 15:49:23 -- host/auth.sh@68 -- # digest=sha384 00:20:24.671 15:49:23 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:20:24.671 15:49:23 -- host/auth.sh@68 -- # keyid=3 00:20:24.671 15:49:23 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:20:24.671 15:49:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.671 15:49:23 -- common/autotest_common.sh@10 -- # set +x 00:20:24.671 15:49:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.671 15:49:23 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:24.671 15:49:23 -- nvmf/common.sh@717 -- # local ip 00:20:24.671 15:49:23 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:24.671 15:49:23 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:24.671 15:49:23 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:24.671 15:49:23 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:24.671 15:49:23 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:24.671 15:49:23 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:24.671 15:49:23 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:24.671 15:49:23 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:24.671 15:49:23 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:24.671 15:49:23 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:20:24.671 15:49:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.671 15:49:23 -- common/autotest_common.sh@10 -- # set +x 00:20:24.930 nvme0n1 00:20:24.930 15:49:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.930 15:49:23 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:24.930 15:49:23 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:24.930 15:49:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.930 15:49:23 -- common/autotest_common.sh@10 -- # set +x 00:20:24.930 15:49:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:24.930 15:49:23 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:24.930 15:49:23 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:24.930 15:49:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:24.930 15:49:23 -- common/autotest_common.sh@10 -- # set +x 00:20:25.189 15:49:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:25.189 15:49:23 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:25.189 15:49:23 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 4 00:20:25.189 15:49:23 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:25.189 15:49:23 -- host/auth.sh@44 -- # digest=sha384 00:20:25.189 15:49:23 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:20:25.189 15:49:23 -- host/auth.sh@44 -- # keyid=4 00:20:25.189 15:49:23 -- host/auth.sh@45 -- # key=DHHC-1:03:NDM1MTI0NTZjYTJiYjdhODFhNjc0ZGYzMDA4N2EwMzEyM2Q1MzBmNTM3N2NkZTY4NTZiNDI1MTgyYWFkYmY5MgHOiKk=: 00:20:25.189 15:49:23 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:25.189 15:49:23 -- host/auth.sh@48 -- # echo ffdhe3072 00:20:25.189 15:49:23 -- host/auth.sh@49 -- # echo DHHC-1:03:NDM1MTI0NTZjYTJiYjdhODFhNjc0ZGYzMDA4N2EwMzEyM2Q1MzBmNTM3N2NkZTY4NTZiNDI1MTgyYWFkYmY5MgHOiKk=: 00:20:25.189 15:49:23 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 4 00:20:25.189 15:49:23 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:25.189 15:49:23 -- host/auth.sh@68 -- # digest=sha384 00:20:25.189 15:49:23 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:20:25.189 15:49:23 -- host/auth.sh@68 -- # keyid=4 00:20:25.189 15:49:23 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:20:25.189 15:49:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:25.189 15:49:23 -- common/autotest_common.sh@10 -- # set +x 00:20:25.189 15:49:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:25.189 15:49:23 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:25.189 15:49:23 -- nvmf/common.sh@717 -- # local ip 00:20:25.189 15:49:23 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:25.189 15:49:23 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:25.189 15:49:23 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:25.189 15:49:23 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:25.189 15:49:23 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:25.189 15:49:23 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:25.189 15:49:23 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:25.189 15:49:23 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:25.189 15:49:23 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:25.189 15:49:23 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:20:25.189 15:49:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:25.189 15:49:23 -- common/autotest_common.sh@10 -- # set +x 00:20:25.189 nvme0n1 00:20:25.189 15:49:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:25.189 15:49:23 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:25.189 15:49:23 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:25.189 15:49:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:25.189 15:49:23 -- common/autotest_common.sh@10 -- # set +x 00:20:25.448 15:49:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:25.448 15:49:23 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:25.448 15:49:23 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:25.448 15:49:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:25.448 15:49:23 -- common/autotest_common.sh@10 -- # set +x 00:20:25.448 15:49:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:25.448 15:49:23 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:20:25.448 15:49:23 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:25.448 15:49:23 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 0 00:20:25.448 15:49:23 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:25.448 15:49:23 -- host/auth.sh@44 -- # digest=sha384 00:20:25.448 15:49:23 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:20:25.448 15:49:23 -- host/auth.sh@44 -- # keyid=0 00:20:25.448 15:49:23 -- host/auth.sh@45 -- # key=DHHC-1:00:OTM5MGRlZDM5MzNiZjkyNTdkZDcyZWUzYzdmMzYyNDJTpxB4: 00:20:25.448 15:49:23 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:25.448 15:49:23 -- host/auth.sh@48 -- # echo ffdhe4096 00:20:25.448 15:49:23 -- host/auth.sh@49 -- # echo DHHC-1:00:OTM5MGRlZDM5MzNiZjkyNTdkZDcyZWUzYzdmMzYyNDJTpxB4: 00:20:25.449 15:49:23 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 0 00:20:25.449 15:49:23 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:25.449 15:49:23 -- host/auth.sh@68 -- # digest=sha384 00:20:25.449 15:49:23 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:20:25.449 15:49:23 -- host/auth.sh@68 -- # keyid=0 00:20:25.449 15:49:23 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:20:25.449 15:49:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:25.449 15:49:23 -- common/autotest_common.sh@10 -- # set +x 00:20:25.449 15:49:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:25.449 15:49:23 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:25.449 15:49:23 -- nvmf/common.sh@717 -- # local ip 00:20:25.449 15:49:23 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:25.449 15:49:23 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:25.449 15:49:23 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:25.449 15:49:23 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:25.449 15:49:23 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:25.449 15:49:23 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:25.449 15:49:23 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:25.449 15:49:23 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:25.449 15:49:23 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:25.449 15:49:23 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:20:25.449 15:49:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:25.449 15:49:23 -- common/autotest_common.sh@10 -- # set +x 00:20:25.708 nvme0n1 00:20:25.708 15:49:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:25.708 15:49:24 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:25.708 15:49:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:25.708 15:49:24 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:25.708 15:49:24 -- common/autotest_common.sh@10 -- # set +x 00:20:25.708 15:49:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:25.708 15:49:24 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:25.708 15:49:24 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:25.708 15:49:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:25.708 15:49:24 -- common/autotest_common.sh@10 -- # set +x 00:20:25.708 15:49:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:25.708 15:49:24 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:25.708 15:49:24 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 1 00:20:25.708 15:49:24 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:25.708 15:49:24 -- host/auth.sh@44 -- # digest=sha384 00:20:25.708 15:49:24 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:20:25.708 15:49:24 -- host/auth.sh@44 -- # keyid=1 00:20:25.708 15:49:24 -- host/auth.sh@45 -- # key=DHHC-1:00:ZWQ0OTBmNjZkMDgwMjI2ZTU4NDcyNmZlOTk3NjZiY2ViYTYwODk5MTEyODRmMDM5s+pwyQ==: 00:20:25.708 15:49:24 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:25.708 15:49:24 -- host/auth.sh@48 -- # echo ffdhe4096 00:20:25.708 15:49:24 -- host/auth.sh@49 -- # echo DHHC-1:00:ZWQ0OTBmNjZkMDgwMjI2ZTU4NDcyNmZlOTk3NjZiY2ViYTYwODk5MTEyODRmMDM5s+pwyQ==: 00:20:25.708 15:49:24 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 1 00:20:25.708 15:49:24 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:25.708 15:49:24 -- host/auth.sh@68 -- # digest=sha384 00:20:25.708 15:49:24 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:20:25.708 15:49:24 -- host/auth.sh@68 -- # keyid=1 00:20:25.708 15:49:24 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:20:25.708 15:49:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:25.708 15:49:24 -- common/autotest_common.sh@10 -- # set +x 00:20:25.708 15:49:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:25.708 15:49:24 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:25.708 15:49:24 -- nvmf/common.sh@717 -- # local ip 00:20:25.708 15:49:24 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:25.708 15:49:24 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:25.708 15:49:24 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:25.708 15:49:24 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:25.708 15:49:24 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:25.708 15:49:24 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:25.708 15:49:24 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:25.708 15:49:24 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:25.708 15:49:24 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:25.708 15:49:24 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:20:25.708 15:49:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:25.708 15:49:24 -- common/autotest_common.sh@10 -- # set +x 00:20:25.967 nvme0n1 00:20:25.967 15:49:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:25.967 15:49:24 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:25.967 15:49:24 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:25.967 15:49:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:25.967 15:49:24 -- common/autotest_common.sh@10 -- # set +x 00:20:26.225 15:49:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:26.225 15:49:24 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:26.226 15:49:24 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:26.226 15:49:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:26.226 15:49:24 -- common/autotest_common.sh@10 -- # set +x 00:20:26.226 15:49:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:26.226 15:49:24 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:26.226 15:49:24 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 2 00:20:26.226 15:49:24 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:26.226 15:49:24 -- host/auth.sh@44 -- # digest=sha384 00:20:26.226 15:49:24 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:20:26.226 15:49:24 -- host/auth.sh@44 -- # keyid=2 00:20:26.226 15:49:24 -- host/auth.sh@45 -- # key=DHHC-1:01:NTMwYjViNGM5ZDQ2MGRjNDFmZTllNDE2OWI5YTNkNmGuEmCM: 00:20:26.226 15:49:24 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:26.226 15:49:24 -- host/auth.sh@48 -- # echo ffdhe4096 00:20:26.226 15:49:24 -- host/auth.sh@49 -- # echo DHHC-1:01:NTMwYjViNGM5ZDQ2MGRjNDFmZTllNDE2OWI5YTNkNmGuEmCM: 00:20:26.226 15:49:24 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 2 00:20:26.226 15:49:24 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:26.226 15:49:24 -- host/auth.sh@68 -- # digest=sha384 00:20:26.226 15:49:24 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:20:26.226 15:49:24 -- host/auth.sh@68 -- # keyid=2 00:20:26.226 15:49:24 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:20:26.226 15:49:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:26.226 15:49:24 -- common/autotest_common.sh@10 -- # set +x 00:20:26.226 15:49:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:26.226 15:49:24 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:26.226 15:49:24 -- nvmf/common.sh@717 -- # local ip 00:20:26.226 15:49:24 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:26.226 15:49:24 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:26.226 15:49:24 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:26.226 15:49:24 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:26.226 15:49:24 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:26.226 15:49:24 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:26.226 15:49:24 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:26.226 15:49:24 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:26.226 15:49:24 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:26.226 15:49:24 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:20:26.226 15:49:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:26.226 15:49:24 -- common/autotest_common.sh@10 -- # set +x 00:20:26.484 nvme0n1 00:20:26.484 15:49:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:26.484 15:49:24 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:26.484 15:49:24 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:26.484 15:49:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:26.484 15:49:24 -- common/autotest_common.sh@10 -- # set +x 00:20:26.484 15:49:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:26.484 15:49:24 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:26.484 15:49:24 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:26.484 15:49:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:26.484 15:49:24 -- common/autotest_common.sh@10 -- # set +x 00:20:26.484 15:49:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:26.484 15:49:25 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:26.484 15:49:25 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 3 00:20:26.484 15:49:25 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:26.484 15:49:25 -- host/auth.sh@44 -- # digest=sha384 00:20:26.484 15:49:25 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:20:26.484 15:49:25 -- host/auth.sh@44 -- # keyid=3 00:20:26.484 15:49:25 -- host/auth.sh@45 -- # key=DHHC-1:02:ZDkyOTBjNmYzOTM4ZDcyYzM4ODY5NTMzZjYwYmM2MjgyMDk5MzU0N2ExNzZhNDc3yxf8Vw==: 00:20:26.484 15:49:25 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:26.484 15:49:25 -- host/auth.sh@48 -- # echo ffdhe4096 00:20:26.484 15:49:25 -- host/auth.sh@49 -- # echo DHHC-1:02:ZDkyOTBjNmYzOTM4ZDcyYzM4ODY5NTMzZjYwYmM2MjgyMDk5MzU0N2ExNzZhNDc3yxf8Vw==: 00:20:26.484 15:49:25 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 3 00:20:26.484 15:49:25 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:26.484 15:49:25 -- host/auth.sh@68 -- # digest=sha384 00:20:26.484 15:49:25 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:20:26.484 15:49:25 -- host/auth.sh@68 -- # keyid=3 00:20:26.484 15:49:25 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:20:26.484 15:49:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:26.484 15:49:25 -- common/autotest_common.sh@10 -- # set +x 00:20:26.484 15:49:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:26.484 15:49:25 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:26.484 15:49:25 -- nvmf/common.sh@717 -- # local ip 00:20:26.484 15:49:25 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:26.484 15:49:25 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:26.484 15:49:25 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:26.484 15:49:25 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:26.484 15:49:25 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:26.484 15:49:25 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:26.484 15:49:25 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:26.484 15:49:25 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:26.484 15:49:25 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:26.484 15:49:25 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:20:26.484 15:49:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:26.484 15:49:25 -- common/autotest_common.sh@10 -- # set +x 00:20:26.743 nvme0n1 00:20:26.743 15:49:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:26.743 15:49:25 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:26.743 15:49:25 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:26.743 15:49:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:26.743 15:49:25 -- common/autotest_common.sh@10 -- # set +x 00:20:27.002 15:49:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:27.002 15:49:25 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:27.002 15:49:25 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:27.002 15:49:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:27.002 15:49:25 -- common/autotest_common.sh@10 -- # set +x 00:20:27.002 15:49:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:27.002 15:49:25 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:27.002 15:49:25 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 4 00:20:27.002 15:49:25 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:27.002 15:49:25 -- host/auth.sh@44 -- # digest=sha384 00:20:27.002 15:49:25 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:20:27.002 15:49:25 -- host/auth.sh@44 -- # keyid=4 00:20:27.002 15:49:25 -- host/auth.sh@45 -- # key=DHHC-1:03:NDM1MTI0NTZjYTJiYjdhODFhNjc0ZGYzMDA4N2EwMzEyM2Q1MzBmNTM3N2NkZTY4NTZiNDI1MTgyYWFkYmY5MgHOiKk=: 00:20:27.002 15:49:25 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:27.002 15:49:25 -- host/auth.sh@48 -- # echo ffdhe4096 00:20:27.002 15:49:25 -- host/auth.sh@49 -- # echo DHHC-1:03:NDM1MTI0NTZjYTJiYjdhODFhNjc0ZGYzMDA4N2EwMzEyM2Q1MzBmNTM3N2NkZTY4NTZiNDI1MTgyYWFkYmY5MgHOiKk=: 00:20:27.002 15:49:25 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 4 00:20:27.002 15:49:25 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:27.002 15:49:25 -- host/auth.sh@68 -- # digest=sha384 00:20:27.002 15:49:25 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:20:27.002 15:49:25 -- host/auth.sh@68 -- # keyid=4 00:20:27.002 15:49:25 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:20:27.002 15:49:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:27.002 15:49:25 -- common/autotest_common.sh@10 -- # set +x 00:20:27.002 15:49:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:27.002 15:49:25 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:27.002 15:49:25 -- nvmf/common.sh@717 -- # local ip 00:20:27.002 15:49:25 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:27.002 15:49:25 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:27.002 15:49:25 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:27.002 15:49:25 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:27.002 15:49:25 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:27.002 15:49:25 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:27.002 15:49:25 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:27.002 15:49:25 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:27.002 15:49:25 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:27.002 15:49:25 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:20:27.002 15:49:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:27.002 15:49:25 -- common/autotest_common.sh@10 -- # set +x 00:20:27.261 nvme0n1 00:20:27.261 15:49:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:27.261 15:49:25 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:27.261 15:49:25 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:27.261 15:49:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:27.261 15:49:25 -- common/autotest_common.sh@10 -- # set +x 00:20:27.261 15:49:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:27.261 15:49:25 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:27.261 15:49:25 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:27.261 15:49:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:27.261 15:49:25 -- common/autotest_common.sh@10 -- # set +x 00:20:27.261 15:49:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:27.261 15:49:25 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:20:27.261 15:49:25 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:27.261 15:49:25 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 0 00:20:27.261 15:49:25 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:27.261 15:49:25 -- host/auth.sh@44 -- # digest=sha384 00:20:27.261 15:49:25 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:20:27.261 15:49:25 -- host/auth.sh@44 -- # keyid=0 00:20:27.261 15:49:25 -- host/auth.sh@45 -- # key=DHHC-1:00:OTM5MGRlZDM5MzNiZjkyNTdkZDcyZWUzYzdmMzYyNDJTpxB4: 00:20:27.261 15:49:25 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:27.261 15:49:25 -- host/auth.sh@48 -- # echo ffdhe6144 00:20:27.261 15:49:25 -- host/auth.sh@49 -- # echo DHHC-1:00:OTM5MGRlZDM5MzNiZjkyNTdkZDcyZWUzYzdmMzYyNDJTpxB4: 00:20:27.261 15:49:25 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 0 00:20:27.261 15:49:25 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:27.261 15:49:25 -- host/auth.sh@68 -- # digest=sha384 00:20:27.261 15:49:25 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:20:27.261 15:49:25 -- host/auth.sh@68 -- # keyid=0 00:20:27.261 15:49:25 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:20:27.261 15:49:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:27.261 15:49:25 -- common/autotest_common.sh@10 -- # set +x 00:20:27.261 15:49:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:27.261 15:49:25 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:27.261 15:49:25 -- nvmf/common.sh@717 -- # local ip 00:20:27.261 15:49:25 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:27.261 15:49:25 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:27.261 15:49:25 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:27.261 15:49:25 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:27.261 15:49:25 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:27.261 15:49:25 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:27.261 15:49:25 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:27.261 15:49:25 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:27.261 15:49:25 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:27.261 15:49:25 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:20:27.261 15:49:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:27.261 15:49:25 -- common/autotest_common.sh@10 -- # set +x 00:20:27.904 nvme0n1 00:20:27.904 15:49:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:27.904 15:49:26 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:27.904 15:49:26 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:27.904 15:49:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:27.904 15:49:26 -- common/autotest_common.sh@10 -- # set +x 00:20:27.904 15:49:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:27.904 15:49:26 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:27.904 15:49:26 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:27.904 15:49:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:27.904 15:49:26 -- common/autotest_common.sh@10 -- # set +x 00:20:27.904 15:49:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:27.904 15:49:26 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:27.904 15:49:26 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 1 00:20:27.904 15:49:26 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:27.904 15:49:26 -- host/auth.sh@44 -- # digest=sha384 00:20:27.904 15:49:26 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:20:27.904 15:49:26 -- host/auth.sh@44 -- # keyid=1 00:20:27.904 15:49:26 -- host/auth.sh@45 -- # key=DHHC-1:00:ZWQ0OTBmNjZkMDgwMjI2ZTU4NDcyNmZlOTk3NjZiY2ViYTYwODk5MTEyODRmMDM5s+pwyQ==: 00:20:27.904 15:49:26 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:27.905 15:49:26 -- host/auth.sh@48 -- # echo ffdhe6144 00:20:27.905 15:49:26 -- host/auth.sh@49 -- # echo DHHC-1:00:ZWQ0OTBmNjZkMDgwMjI2ZTU4NDcyNmZlOTk3NjZiY2ViYTYwODk5MTEyODRmMDM5s+pwyQ==: 00:20:27.905 15:49:26 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 1 00:20:27.905 15:49:26 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:27.905 15:49:26 -- host/auth.sh@68 -- # digest=sha384 00:20:27.905 15:49:26 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:20:27.905 15:49:26 -- host/auth.sh@68 -- # keyid=1 00:20:27.905 15:49:26 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:20:27.905 15:49:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:27.905 15:49:26 -- common/autotest_common.sh@10 -- # set +x 00:20:27.905 15:49:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:27.905 15:49:26 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:27.905 15:49:26 -- nvmf/common.sh@717 -- # local ip 00:20:27.905 15:49:26 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:27.905 15:49:26 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:27.905 15:49:26 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:27.905 15:49:26 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:27.905 15:49:26 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:27.905 15:49:26 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:27.905 15:49:26 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:27.905 15:49:26 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:27.905 15:49:26 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:27.905 15:49:26 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:20:27.905 15:49:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:27.905 15:49:26 -- common/autotest_common.sh@10 -- # set +x 00:20:28.188 nvme0n1 00:20:28.188 15:49:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:28.188 15:49:26 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:28.188 15:49:26 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:28.188 15:49:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:28.188 15:49:26 -- common/autotest_common.sh@10 -- # set +x 00:20:28.188 15:49:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:28.188 15:49:26 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:28.188 15:49:26 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:28.188 15:49:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:28.188 15:49:26 -- common/autotest_common.sh@10 -- # set +x 00:20:28.448 15:49:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:28.448 15:49:26 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:28.448 15:49:26 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 2 00:20:28.448 15:49:26 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:28.448 15:49:26 -- host/auth.sh@44 -- # digest=sha384 00:20:28.448 15:49:26 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:20:28.448 15:49:26 -- host/auth.sh@44 -- # keyid=2 00:20:28.448 15:49:26 -- host/auth.sh@45 -- # key=DHHC-1:01:NTMwYjViNGM5ZDQ2MGRjNDFmZTllNDE2OWI5YTNkNmGuEmCM: 00:20:28.448 15:49:26 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:28.448 15:49:26 -- host/auth.sh@48 -- # echo ffdhe6144 00:20:28.448 15:49:26 -- host/auth.sh@49 -- # echo DHHC-1:01:NTMwYjViNGM5ZDQ2MGRjNDFmZTllNDE2OWI5YTNkNmGuEmCM: 00:20:28.448 15:49:26 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 2 00:20:28.448 15:49:26 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:28.448 15:49:26 -- host/auth.sh@68 -- # digest=sha384 00:20:28.448 15:49:26 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:20:28.448 15:49:26 -- host/auth.sh@68 -- # keyid=2 00:20:28.448 15:49:26 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:20:28.448 15:49:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:28.448 15:49:26 -- common/autotest_common.sh@10 -- # set +x 00:20:28.448 15:49:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:28.448 15:49:26 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:28.448 15:49:26 -- nvmf/common.sh@717 -- # local ip 00:20:28.448 15:49:26 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:28.448 15:49:26 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:28.448 15:49:26 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:28.448 15:49:26 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:28.448 15:49:26 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:28.448 15:49:26 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:28.448 15:49:26 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:28.448 15:49:26 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:28.448 15:49:26 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:28.448 15:49:26 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:20:28.448 15:49:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:28.448 15:49:26 -- common/autotest_common.sh@10 -- # set +x 00:20:28.706 nvme0n1 00:20:28.706 15:49:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:28.706 15:49:27 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:28.706 15:49:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:28.706 15:49:27 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:28.706 15:49:27 -- common/autotest_common.sh@10 -- # set +x 00:20:28.706 15:49:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:28.706 15:49:27 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:28.706 15:49:27 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:28.706 15:49:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:28.706 15:49:27 -- common/autotest_common.sh@10 -- # set +x 00:20:28.706 15:49:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:28.706 15:49:27 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:28.706 15:49:27 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 3 00:20:28.706 15:49:27 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:28.706 15:49:27 -- host/auth.sh@44 -- # digest=sha384 00:20:28.965 15:49:27 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:20:28.965 15:49:27 -- host/auth.sh@44 -- # keyid=3 00:20:28.965 15:49:27 -- host/auth.sh@45 -- # key=DHHC-1:02:ZDkyOTBjNmYzOTM4ZDcyYzM4ODY5NTMzZjYwYmM2MjgyMDk5MzU0N2ExNzZhNDc3yxf8Vw==: 00:20:28.965 15:49:27 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:28.965 15:49:27 -- host/auth.sh@48 -- # echo ffdhe6144 00:20:28.965 15:49:27 -- host/auth.sh@49 -- # echo DHHC-1:02:ZDkyOTBjNmYzOTM4ZDcyYzM4ODY5NTMzZjYwYmM2MjgyMDk5MzU0N2ExNzZhNDc3yxf8Vw==: 00:20:28.965 15:49:27 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 3 00:20:28.965 15:49:27 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:28.965 15:49:27 -- host/auth.sh@68 -- # digest=sha384 00:20:28.965 15:49:27 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:20:28.965 15:49:27 -- host/auth.sh@68 -- # keyid=3 00:20:28.965 15:49:27 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:20:28.965 15:49:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:28.965 15:49:27 -- common/autotest_common.sh@10 -- # set +x 00:20:28.965 15:49:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:28.965 15:49:27 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:28.965 15:49:27 -- nvmf/common.sh@717 -- # local ip 00:20:28.965 15:49:27 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:28.965 15:49:27 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:28.965 15:49:27 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:28.965 15:49:27 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:28.965 15:49:27 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:28.965 15:49:27 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:28.965 15:49:27 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:28.965 15:49:27 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:28.965 15:49:27 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:28.965 15:49:27 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:20:28.965 15:49:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:28.965 15:49:27 -- common/autotest_common.sh@10 -- # set +x 00:20:29.223 nvme0n1 00:20:29.223 15:49:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:29.223 15:49:27 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:29.223 15:49:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:29.223 15:49:27 -- common/autotest_common.sh@10 -- # set +x 00:20:29.223 15:49:27 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:29.223 15:49:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:29.223 15:49:27 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:29.223 15:49:27 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:29.223 15:49:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:29.223 15:49:27 -- common/autotest_common.sh@10 -- # set +x 00:20:29.223 15:49:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:29.223 15:49:27 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:29.223 15:49:27 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 4 00:20:29.223 15:49:27 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:29.223 15:49:27 -- host/auth.sh@44 -- # digest=sha384 00:20:29.223 15:49:27 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:20:29.480 15:49:27 -- host/auth.sh@44 -- # keyid=4 00:20:29.480 15:49:27 -- host/auth.sh@45 -- # key=DHHC-1:03:NDM1MTI0NTZjYTJiYjdhODFhNjc0ZGYzMDA4N2EwMzEyM2Q1MzBmNTM3N2NkZTY4NTZiNDI1MTgyYWFkYmY5MgHOiKk=: 00:20:29.480 15:49:27 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:29.480 15:49:27 -- host/auth.sh@48 -- # echo ffdhe6144 00:20:29.480 15:49:27 -- host/auth.sh@49 -- # echo DHHC-1:03:NDM1MTI0NTZjYTJiYjdhODFhNjc0ZGYzMDA4N2EwMzEyM2Q1MzBmNTM3N2NkZTY4NTZiNDI1MTgyYWFkYmY5MgHOiKk=: 00:20:29.480 15:49:27 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 4 00:20:29.480 15:49:27 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:29.480 15:49:27 -- host/auth.sh@68 -- # digest=sha384 00:20:29.480 15:49:27 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:20:29.480 15:49:27 -- host/auth.sh@68 -- # keyid=4 00:20:29.480 15:49:27 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:20:29.480 15:49:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:29.480 15:49:27 -- common/autotest_common.sh@10 -- # set +x 00:20:29.480 15:49:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:29.480 15:49:27 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:29.481 15:49:27 -- nvmf/common.sh@717 -- # local ip 00:20:29.481 15:49:27 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:29.481 15:49:27 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:29.481 15:49:27 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:29.481 15:49:27 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:29.481 15:49:27 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:29.481 15:49:27 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:29.481 15:49:27 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:29.481 15:49:27 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:29.481 15:49:27 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:29.481 15:49:27 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:20:29.481 15:49:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:29.481 15:49:27 -- common/autotest_common.sh@10 -- # set +x 00:20:29.739 nvme0n1 00:20:29.740 15:49:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:29.740 15:49:28 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:29.740 15:49:28 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:29.740 15:49:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:29.740 15:49:28 -- common/autotest_common.sh@10 -- # set +x 00:20:29.740 15:49:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:29.740 15:49:28 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:29.740 15:49:28 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:29.740 15:49:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:29.740 15:49:28 -- common/autotest_common.sh@10 -- # set +x 00:20:29.740 15:49:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:29.740 15:49:28 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:20:29.740 15:49:28 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:29.740 15:49:28 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 0 00:20:29.740 15:49:28 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:29.740 15:49:28 -- host/auth.sh@44 -- # digest=sha384 00:20:29.740 15:49:28 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:20:29.740 15:49:28 -- host/auth.sh@44 -- # keyid=0 00:20:29.740 15:49:28 -- host/auth.sh@45 -- # key=DHHC-1:00:OTM5MGRlZDM5MzNiZjkyNTdkZDcyZWUzYzdmMzYyNDJTpxB4: 00:20:29.740 15:49:28 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:29.740 15:49:28 -- host/auth.sh@48 -- # echo ffdhe8192 00:20:29.740 15:49:28 -- host/auth.sh@49 -- # echo DHHC-1:00:OTM5MGRlZDM5MzNiZjkyNTdkZDcyZWUzYzdmMzYyNDJTpxB4: 00:20:29.740 15:49:28 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 0 00:20:29.740 15:49:28 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:29.740 15:49:28 -- host/auth.sh@68 -- # digest=sha384 00:20:29.740 15:49:28 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:20:29.740 15:49:28 -- host/auth.sh@68 -- # keyid=0 00:20:29.740 15:49:28 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:20:29.740 15:49:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:29.740 15:49:28 -- common/autotest_common.sh@10 -- # set +x 00:20:29.740 15:49:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:29.740 15:49:28 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:29.740 15:49:28 -- nvmf/common.sh@717 -- # local ip 00:20:29.740 15:49:28 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:29.740 15:49:28 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:29.740 15:49:28 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:29.740 15:49:28 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:29.740 15:49:28 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:29.740 15:49:28 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:29.740 15:49:28 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:29.740 15:49:28 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:29.740 15:49:28 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:29.740 15:49:28 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:20:29.740 15:49:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:29.740 15:49:28 -- common/autotest_common.sh@10 -- # set +x 00:20:30.675 nvme0n1 00:20:30.675 15:49:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:30.675 15:49:28 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:30.675 15:49:28 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:30.675 15:49:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:30.675 15:49:28 -- common/autotest_common.sh@10 -- # set +x 00:20:30.675 15:49:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:30.675 15:49:28 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:30.676 15:49:28 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:30.676 15:49:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:30.676 15:49:28 -- common/autotest_common.sh@10 -- # set +x 00:20:30.676 15:49:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:30.676 15:49:29 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:30.676 15:49:29 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 1 00:20:30.676 15:49:29 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:30.676 15:49:29 -- host/auth.sh@44 -- # digest=sha384 00:20:30.676 15:49:29 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:20:30.676 15:49:29 -- host/auth.sh@44 -- # keyid=1 00:20:30.676 15:49:29 -- host/auth.sh@45 -- # key=DHHC-1:00:ZWQ0OTBmNjZkMDgwMjI2ZTU4NDcyNmZlOTk3NjZiY2ViYTYwODk5MTEyODRmMDM5s+pwyQ==: 00:20:30.676 15:49:29 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:30.676 15:49:29 -- host/auth.sh@48 -- # echo ffdhe8192 00:20:30.676 15:49:29 -- host/auth.sh@49 -- # echo DHHC-1:00:ZWQ0OTBmNjZkMDgwMjI2ZTU4NDcyNmZlOTk3NjZiY2ViYTYwODk5MTEyODRmMDM5s+pwyQ==: 00:20:30.676 15:49:29 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 1 00:20:30.676 15:49:29 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:30.676 15:49:29 -- host/auth.sh@68 -- # digest=sha384 00:20:30.676 15:49:29 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:20:30.676 15:49:29 -- host/auth.sh@68 -- # keyid=1 00:20:30.676 15:49:29 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:20:30.676 15:49:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:30.676 15:49:29 -- common/autotest_common.sh@10 -- # set +x 00:20:30.676 15:49:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:30.676 15:49:29 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:30.676 15:49:29 -- nvmf/common.sh@717 -- # local ip 00:20:30.676 15:49:29 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:30.676 15:49:29 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:30.676 15:49:29 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:30.676 15:49:29 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:30.676 15:49:29 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:30.676 15:49:29 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:30.676 15:49:29 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:30.676 15:49:29 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:30.676 15:49:29 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:30.676 15:49:29 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:20:30.676 15:49:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:30.676 15:49:29 -- common/autotest_common.sh@10 -- # set +x 00:20:31.241 nvme0n1 00:20:31.241 15:49:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:31.241 15:49:29 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:31.241 15:49:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:31.241 15:49:29 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:31.241 15:49:29 -- common/autotest_common.sh@10 -- # set +x 00:20:31.241 15:49:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:31.241 15:49:29 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:31.241 15:49:29 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:31.241 15:49:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:31.241 15:49:29 -- common/autotest_common.sh@10 -- # set +x 00:20:31.241 15:49:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:31.241 15:49:29 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:31.241 15:49:29 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 2 00:20:31.241 15:49:29 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:31.241 15:49:29 -- host/auth.sh@44 -- # digest=sha384 00:20:31.241 15:49:29 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:20:31.241 15:49:29 -- host/auth.sh@44 -- # keyid=2 00:20:31.241 15:49:29 -- host/auth.sh@45 -- # key=DHHC-1:01:NTMwYjViNGM5ZDQ2MGRjNDFmZTllNDE2OWI5YTNkNmGuEmCM: 00:20:31.241 15:49:29 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:31.241 15:49:29 -- host/auth.sh@48 -- # echo ffdhe8192 00:20:31.241 15:49:29 -- host/auth.sh@49 -- # echo DHHC-1:01:NTMwYjViNGM5ZDQ2MGRjNDFmZTllNDE2OWI5YTNkNmGuEmCM: 00:20:31.241 15:49:29 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 2 00:20:31.241 15:49:29 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:31.241 15:49:29 -- host/auth.sh@68 -- # digest=sha384 00:20:31.241 15:49:29 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:20:31.241 15:49:29 -- host/auth.sh@68 -- # keyid=2 00:20:31.241 15:49:29 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:20:31.241 15:49:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:31.241 15:49:29 -- common/autotest_common.sh@10 -- # set +x 00:20:31.241 15:49:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:31.241 15:49:29 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:31.241 15:49:29 -- nvmf/common.sh@717 -- # local ip 00:20:31.241 15:49:29 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:31.241 15:49:29 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:31.241 15:49:29 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:31.241 15:49:29 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:31.241 15:49:29 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:31.241 15:49:29 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:31.241 15:49:29 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:31.241 15:49:29 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:31.241 15:49:29 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:31.241 15:49:29 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:20:31.241 15:49:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:31.241 15:49:29 -- common/autotest_common.sh@10 -- # set +x 00:20:31.806 nvme0n1 00:20:31.806 15:49:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:31.806 15:49:30 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:31.806 15:49:30 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:31.806 15:49:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:31.806 15:49:30 -- common/autotest_common.sh@10 -- # set +x 00:20:31.806 15:49:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:32.064 15:49:30 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:32.064 15:49:30 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:32.064 15:49:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:32.064 15:49:30 -- common/autotest_common.sh@10 -- # set +x 00:20:32.064 15:49:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:32.064 15:49:30 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:32.064 15:49:30 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 3 00:20:32.064 15:49:30 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:32.064 15:49:30 -- host/auth.sh@44 -- # digest=sha384 00:20:32.064 15:49:30 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:20:32.064 15:49:30 -- host/auth.sh@44 -- # keyid=3 00:20:32.064 15:49:30 -- host/auth.sh@45 -- # key=DHHC-1:02:ZDkyOTBjNmYzOTM4ZDcyYzM4ODY5NTMzZjYwYmM2MjgyMDk5MzU0N2ExNzZhNDc3yxf8Vw==: 00:20:32.065 15:49:30 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:32.065 15:49:30 -- host/auth.sh@48 -- # echo ffdhe8192 00:20:32.065 15:49:30 -- host/auth.sh@49 -- # echo DHHC-1:02:ZDkyOTBjNmYzOTM4ZDcyYzM4ODY5NTMzZjYwYmM2MjgyMDk5MzU0N2ExNzZhNDc3yxf8Vw==: 00:20:32.065 15:49:30 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 3 00:20:32.065 15:49:30 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:32.065 15:49:30 -- host/auth.sh@68 -- # digest=sha384 00:20:32.065 15:49:30 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:20:32.065 15:49:30 -- host/auth.sh@68 -- # keyid=3 00:20:32.065 15:49:30 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:20:32.065 15:49:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:32.065 15:49:30 -- common/autotest_common.sh@10 -- # set +x 00:20:32.065 15:49:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:32.065 15:49:30 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:32.065 15:49:30 -- nvmf/common.sh@717 -- # local ip 00:20:32.065 15:49:30 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:32.065 15:49:30 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:32.065 15:49:30 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:32.065 15:49:30 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:32.065 15:49:30 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:32.065 15:49:30 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:32.065 15:49:30 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:32.065 15:49:30 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:32.065 15:49:30 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:32.065 15:49:30 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:20:32.065 15:49:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:32.065 15:49:30 -- common/autotest_common.sh@10 -- # set +x 00:20:32.630 nvme0n1 00:20:32.630 15:49:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:32.630 15:49:31 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:32.630 15:49:31 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:32.630 15:49:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:32.630 15:49:31 -- common/autotest_common.sh@10 -- # set +x 00:20:32.630 15:49:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:32.630 15:49:31 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:32.630 15:49:31 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:32.630 15:49:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:32.630 15:49:31 -- common/autotest_common.sh@10 -- # set +x 00:20:32.630 15:49:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:32.630 15:49:31 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:32.630 15:49:31 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 4 00:20:32.630 15:49:31 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:32.630 15:49:31 -- host/auth.sh@44 -- # digest=sha384 00:20:32.630 15:49:31 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:20:32.630 15:49:31 -- host/auth.sh@44 -- # keyid=4 00:20:32.630 15:49:31 -- host/auth.sh@45 -- # key=DHHC-1:03:NDM1MTI0NTZjYTJiYjdhODFhNjc0ZGYzMDA4N2EwMzEyM2Q1MzBmNTM3N2NkZTY4NTZiNDI1MTgyYWFkYmY5MgHOiKk=: 00:20:32.630 15:49:31 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:20:32.630 15:49:31 -- host/auth.sh@48 -- # echo ffdhe8192 00:20:32.630 15:49:31 -- host/auth.sh@49 -- # echo DHHC-1:03:NDM1MTI0NTZjYTJiYjdhODFhNjc0ZGYzMDA4N2EwMzEyM2Q1MzBmNTM3N2NkZTY4NTZiNDI1MTgyYWFkYmY5MgHOiKk=: 00:20:32.630 15:49:31 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 4 00:20:32.630 15:49:31 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:32.630 15:49:31 -- host/auth.sh@68 -- # digest=sha384 00:20:32.630 15:49:31 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:20:32.630 15:49:31 -- host/auth.sh@68 -- # keyid=4 00:20:32.630 15:49:31 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:20:32.630 15:49:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:32.630 15:49:31 -- common/autotest_common.sh@10 -- # set +x 00:20:32.630 15:49:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:32.630 15:49:31 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:32.630 15:49:31 -- nvmf/common.sh@717 -- # local ip 00:20:32.630 15:49:31 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:32.630 15:49:31 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:32.630 15:49:31 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:32.630 15:49:31 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:32.630 15:49:31 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:32.630 15:49:31 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:32.630 15:49:31 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:32.630 15:49:31 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:32.630 15:49:31 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:32.630 15:49:31 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:20:32.630 15:49:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:32.630 15:49:31 -- common/autotest_common.sh@10 -- # set +x 00:20:33.196 nvme0n1 00:20:33.196 15:49:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.196 15:49:31 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:33.196 15:49:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.196 15:49:31 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:33.196 15:49:31 -- common/autotest_common.sh@10 -- # set +x 00:20:33.196 15:49:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.453 15:49:31 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:33.454 15:49:31 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:33.454 15:49:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.454 15:49:31 -- common/autotest_common.sh@10 -- # set +x 00:20:33.454 15:49:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.454 15:49:31 -- host/auth.sh@107 -- # for digest in "${digests[@]}" 00:20:33.454 15:49:31 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:20:33.454 15:49:31 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:33.454 15:49:31 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 0 00:20:33.454 15:49:31 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:33.454 15:49:31 -- host/auth.sh@44 -- # digest=sha512 00:20:33.454 15:49:31 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:20:33.454 15:49:31 -- host/auth.sh@44 -- # keyid=0 00:20:33.454 15:49:31 -- host/auth.sh@45 -- # key=DHHC-1:00:OTM5MGRlZDM5MzNiZjkyNTdkZDcyZWUzYzdmMzYyNDJTpxB4: 00:20:33.454 15:49:31 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:33.454 15:49:31 -- host/auth.sh@48 -- # echo ffdhe2048 00:20:33.454 15:49:31 -- host/auth.sh@49 -- # echo DHHC-1:00:OTM5MGRlZDM5MzNiZjkyNTdkZDcyZWUzYzdmMzYyNDJTpxB4: 00:20:33.454 15:49:31 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 0 00:20:33.454 15:49:31 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:33.454 15:49:31 -- host/auth.sh@68 -- # digest=sha512 00:20:33.454 15:49:31 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:20:33.454 15:49:31 -- host/auth.sh@68 -- # keyid=0 00:20:33.454 15:49:31 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:20:33.454 15:49:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.454 15:49:31 -- common/autotest_common.sh@10 -- # set +x 00:20:33.454 15:49:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.454 15:49:31 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:33.454 15:49:31 -- nvmf/common.sh@717 -- # local ip 00:20:33.454 15:49:31 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:33.454 15:49:31 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:33.454 15:49:31 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:33.454 15:49:31 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:33.454 15:49:31 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:33.454 15:49:31 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:33.454 15:49:31 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:33.454 15:49:31 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:33.454 15:49:31 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:33.454 15:49:31 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:20:33.454 15:49:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.454 15:49:31 -- common/autotest_common.sh@10 -- # set +x 00:20:33.712 nvme0n1 00:20:33.712 15:49:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.712 15:49:32 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:33.712 15:49:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.712 15:49:32 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:33.712 15:49:32 -- common/autotest_common.sh@10 -- # set +x 00:20:33.712 15:49:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.712 15:49:32 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:33.712 15:49:32 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:33.712 15:49:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.712 15:49:32 -- common/autotest_common.sh@10 -- # set +x 00:20:33.712 15:49:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.712 15:49:32 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:33.712 15:49:32 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 1 00:20:33.712 15:49:32 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:33.712 15:49:32 -- host/auth.sh@44 -- # digest=sha512 00:20:33.712 15:49:32 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:20:33.712 15:49:32 -- host/auth.sh@44 -- # keyid=1 00:20:33.712 15:49:32 -- host/auth.sh@45 -- # key=DHHC-1:00:ZWQ0OTBmNjZkMDgwMjI2ZTU4NDcyNmZlOTk3NjZiY2ViYTYwODk5MTEyODRmMDM5s+pwyQ==: 00:20:33.712 15:49:32 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:33.712 15:49:32 -- host/auth.sh@48 -- # echo ffdhe2048 00:20:33.712 15:49:32 -- host/auth.sh@49 -- # echo DHHC-1:00:ZWQ0OTBmNjZkMDgwMjI2ZTU4NDcyNmZlOTk3NjZiY2ViYTYwODk5MTEyODRmMDM5s+pwyQ==: 00:20:33.712 15:49:32 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 1 00:20:33.712 15:49:32 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:33.712 15:49:32 -- host/auth.sh@68 -- # digest=sha512 00:20:33.712 15:49:32 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:20:33.712 15:49:32 -- host/auth.sh@68 -- # keyid=1 00:20:33.712 15:49:32 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:20:33.712 15:49:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.712 15:49:32 -- common/autotest_common.sh@10 -- # set +x 00:20:33.712 15:49:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.712 15:49:32 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:33.712 15:49:32 -- nvmf/common.sh@717 -- # local ip 00:20:33.712 15:49:32 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:33.712 15:49:32 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:33.712 15:49:32 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:33.712 15:49:32 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:33.712 15:49:32 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:33.712 15:49:32 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:33.712 15:49:32 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:33.712 15:49:32 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:33.712 15:49:32 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:33.712 15:49:32 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:20:33.712 15:49:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.712 15:49:32 -- common/autotest_common.sh@10 -- # set +x 00:20:33.970 nvme0n1 00:20:33.970 15:49:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.970 15:49:32 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:33.970 15:49:32 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:33.970 15:49:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.970 15:49:32 -- common/autotest_common.sh@10 -- # set +x 00:20:33.970 15:49:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.970 15:49:32 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:33.970 15:49:32 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:33.970 15:49:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.970 15:49:32 -- common/autotest_common.sh@10 -- # set +x 00:20:33.970 15:49:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.970 15:49:32 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:33.970 15:49:32 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 2 00:20:33.970 15:49:32 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:33.970 15:49:32 -- host/auth.sh@44 -- # digest=sha512 00:20:33.970 15:49:32 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:20:33.970 15:49:32 -- host/auth.sh@44 -- # keyid=2 00:20:33.970 15:49:32 -- host/auth.sh@45 -- # key=DHHC-1:01:NTMwYjViNGM5ZDQ2MGRjNDFmZTllNDE2OWI5YTNkNmGuEmCM: 00:20:33.970 15:49:32 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:33.970 15:49:32 -- host/auth.sh@48 -- # echo ffdhe2048 00:20:33.970 15:49:32 -- host/auth.sh@49 -- # echo DHHC-1:01:NTMwYjViNGM5ZDQ2MGRjNDFmZTllNDE2OWI5YTNkNmGuEmCM: 00:20:33.970 15:49:32 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 2 00:20:33.970 15:49:32 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:33.970 15:49:32 -- host/auth.sh@68 -- # digest=sha512 00:20:33.970 15:49:32 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:20:33.970 15:49:32 -- host/auth.sh@68 -- # keyid=2 00:20:33.970 15:49:32 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:20:33.970 15:49:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.970 15:49:32 -- common/autotest_common.sh@10 -- # set +x 00:20:33.970 15:49:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:33.970 15:49:32 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:33.970 15:49:32 -- nvmf/common.sh@717 -- # local ip 00:20:33.970 15:49:32 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:33.970 15:49:32 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:33.970 15:49:32 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:33.970 15:49:32 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:33.970 15:49:32 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:33.970 15:49:32 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:33.970 15:49:32 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:33.970 15:49:32 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:33.970 15:49:32 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:33.970 15:49:32 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:20:33.971 15:49:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:33.971 15:49:32 -- common/autotest_common.sh@10 -- # set +x 00:20:34.229 nvme0n1 00:20:34.229 15:49:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:34.229 15:49:32 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:34.229 15:49:32 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:34.229 15:49:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:34.229 15:49:32 -- common/autotest_common.sh@10 -- # set +x 00:20:34.229 15:49:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:34.229 15:49:32 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:34.229 15:49:32 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:34.229 15:49:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:34.229 15:49:32 -- common/autotest_common.sh@10 -- # set +x 00:20:34.229 15:49:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:34.229 15:49:32 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:34.229 15:49:32 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 3 00:20:34.229 15:49:32 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:34.229 15:49:32 -- host/auth.sh@44 -- # digest=sha512 00:20:34.229 15:49:32 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:20:34.229 15:49:32 -- host/auth.sh@44 -- # keyid=3 00:20:34.229 15:49:32 -- host/auth.sh@45 -- # key=DHHC-1:02:ZDkyOTBjNmYzOTM4ZDcyYzM4ODY5NTMzZjYwYmM2MjgyMDk5MzU0N2ExNzZhNDc3yxf8Vw==: 00:20:34.229 15:49:32 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:34.229 15:49:32 -- host/auth.sh@48 -- # echo ffdhe2048 00:20:34.229 15:49:32 -- host/auth.sh@49 -- # echo DHHC-1:02:ZDkyOTBjNmYzOTM4ZDcyYzM4ODY5NTMzZjYwYmM2MjgyMDk5MzU0N2ExNzZhNDc3yxf8Vw==: 00:20:34.229 15:49:32 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 3 00:20:34.229 15:49:32 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:34.229 15:49:32 -- host/auth.sh@68 -- # digest=sha512 00:20:34.229 15:49:32 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:20:34.229 15:49:32 -- host/auth.sh@68 -- # keyid=3 00:20:34.229 15:49:32 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:20:34.229 15:49:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:34.229 15:49:32 -- common/autotest_common.sh@10 -- # set +x 00:20:34.229 15:49:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:34.229 15:49:32 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:34.229 15:49:32 -- nvmf/common.sh@717 -- # local ip 00:20:34.229 15:49:32 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:34.229 15:49:32 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:34.229 15:49:32 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:34.229 15:49:32 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:34.229 15:49:32 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:34.229 15:49:32 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:34.229 15:49:32 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:34.229 15:49:32 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:34.229 15:49:32 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:34.229 15:49:32 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:20:34.229 15:49:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:34.229 15:49:32 -- common/autotest_common.sh@10 -- # set +x 00:20:34.487 nvme0n1 00:20:34.487 15:49:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:34.487 15:49:32 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:34.487 15:49:32 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:34.487 15:49:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:34.487 15:49:32 -- common/autotest_common.sh@10 -- # set +x 00:20:34.487 15:49:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:34.487 15:49:32 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:34.487 15:49:32 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:34.487 15:49:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:34.487 15:49:32 -- common/autotest_common.sh@10 -- # set +x 00:20:34.487 15:49:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:34.487 15:49:32 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:34.487 15:49:32 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 4 00:20:34.487 15:49:32 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:34.487 15:49:32 -- host/auth.sh@44 -- # digest=sha512 00:20:34.487 15:49:32 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:20:34.487 15:49:32 -- host/auth.sh@44 -- # keyid=4 00:20:34.487 15:49:32 -- host/auth.sh@45 -- # key=DHHC-1:03:NDM1MTI0NTZjYTJiYjdhODFhNjc0ZGYzMDA4N2EwMzEyM2Q1MzBmNTM3N2NkZTY4NTZiNDI1MTgyYWFkYmY5MgHOiKk=: 00:20:34.487 15:49:32 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:34.487 15:49:32 -- host/auth.sh@48 -- # echo ffdhe2048 00:20:34.487 15:49:32 -- host/auth.sh@49 -- # echo DHHC-1:03:NDM1MTI0NTZjYTJiYjdhODFhNjc0ZGYzMDA4N2EwMzEyM2Q1MzBmNTM3N2NkZTY4NTZiNDI1MTgyYWFkYmY5MgHOiKk=: 00:20:34.487 15:49:32 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 4 00:20:34.487 15:49:32 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:34.487 15:49:32 -- host/auth.sh@68 -- # digest=sha512 00:20:34.487 15:49:32 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:20:34.487 15:49:32 -- host/auth.sh@68 -- # keyid=4 00:20:34.487 15:49:32 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:20:34.488 15:49:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:34.488 15:49:32 -- common/autotest_common.sh@10 -- # set +x 00:20:34.488 15:49:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:34.488 15:49:32 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:34.488 15:49:32 -- nvmf/common.sh@717 -- # local ip 00:20:34.488 15:49:32 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:34.488 15:49:32 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:34.488 15:49:32 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:34.488 15:49:32 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:34.488 15:49:32 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:34.488 15:49:32 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:34.488 15:49:32 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:34.488 15:49:32 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:34.488 15:49:32 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:34.488 15:49:32 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:20:34.488 15:49:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:34.488 15:49:32 -- common/autotest_common.sh@10 -- # set +x 00:20:34.746 nvme0n1 00:20:34.746 15:49:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:34.746 15:49:33 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:34.746 15:49:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:34.746 15:49:33 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:34.746 15:49:33 -- common/autotest_common.sh@10 -- # set +x 00:20:34.746 15:49:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:34.746 15:49:33 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:34.746 15:49:33 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:34.746 15:49:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:34.746 15:49:33 -- common/autotest_common.sh@10 -- # set +x 00:20:34.746 15:49:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:34.746 15:49:33 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:20:34.746 15:49:33 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:34.746 15:49:33 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 0 00:20:34.746 15:49:33 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:34.746 15:49:33 -- host/auth.sh@44 -- # digest=sha512 00:20:34.746 15:49:33 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:20:34.746 15:49:33 -- host/auth.sh@44 -- # keyid=0 00:20:34.746 15:49:33 -- host/auth.sh@45 -- # key=DHHC-1:00:OTM5MGRlZDM5MzNiZjkyNTdkZDcyZWUzYzdmMzYyNDJTpxB4: 00:20:34.746 15:49:33 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:34.746 15:49:33 -- host/auth.sh@48 -- # echo ffdhe3072 00:20:34.746 15:49:33 -- host/auth.sh@49 -- # echo DHHC-1:00:OTM5MGRlZDM5MzNiZjkyNTdkZDcyZWUzYzdmMzYyNDJTpxB4: 00:20:34.746 15:49:33 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 0 00:20:34.746 15:49:33 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:34.746 15:49:33 -- host/auth.sh@68 -- # digest=sha512 00:20:34.746 15:49:33 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:20:34.746 15:49:33 -- host/auth.sh@68 -- # keyid=0 00:20:34.746 15:49:33 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:20:34.746 15:49:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:34.746 15:49:33 -- common/autotest_common.sh@10 -- # set +x 00:20:34.746 15:49:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:34.746 15:49:33 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:34.746 15:49:33 -- nvmf/common.sh@717 -- # local ip 00:20:34.746 15:49:33 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:34.746 15:49:33 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:34.746 15:49:33 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:34.746 15:49:33 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:34.746 15:49:33 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:34.746 15:49:33 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:34.746 15:49:33 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:34.746 15:49:33 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:34.746 15:49:33 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:34.746 15:49:33 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:20:34.746 15:49:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:34.746 15:49:33 -- common/autotest_common.sh@10 -- # set +x 00:20:35.004 nvme0n1 00:20:35.004 15:49:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:35.004 15:49:33 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:35.004 15:49:33 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:35.004 15:49:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:35.004 15:49:33 -- common/autotest_common.sh@10 -- # set +x 00:20:35.004 15:49:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:35.004 15:49:33 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:35.004 15:49:33 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:35.004 15:49:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:35.004 15:49:33 -- common/autotest_common.sh@10 -- # set +x 00:20:35.004 15:49:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:35.004 15:49:33 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:35.004 15:49:33 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 1 00:20:35.004 15:49:33 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:35.004 15:49:33 -- host/auth.sh@44 -- # digest=sha512 00:20:35.004 15:49:33 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:20:35.004 15:49:33 -- host/auth.sh@44 -- # keyid=1 00:20:35.004 15:49:33 -- host/auth.sh@45 -- # key=DHHC-1:00:ZWQ0OTBmNjZkMDgwMjI2ZTU4NDcyNmZlOTk3NjZiY2ViYTYwODk5MTEyODRmMDM5s+pwyQ==: 00:20:35.004 15:49:33 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:35.004 15:49:33 -- host/auth.sh@48 -- # echo ffdhe3072 00:20:35.004 15:49:33 -- host/auth.sh@49 -- # echo DHHC-1:00:ZWQ0OTBmNjZkMDgwMjI2ZTU4NDcyNmZlOTk3NjZiY2ViYTYwODk5MTEyODRmMDM5s+pwyQ==: 00:20:35.004 15:49:33 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 1 00:20:35.004 15:49:33 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:35.004 15:49:33 -- host/auth.sh@68 -- # digest=sha512 00:20:35.004 15:49:33 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:20:35.004 15:49:33 -- host/auth.sh@68 -- # keyid=1 00:20:35.004 15:49:33 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:20:35.004 15:49:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:35.004 15:49:33 -- common/autotest_common.sh@10 -- # set +x 00:20:35.004 15:49:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:35.004 15:49:33 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:35.004 15:49:33 -- nvmf/common.sh@717 -- # local ip 00:20:35.004 15:49:33 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:35.004 15:49:33 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:35.004 15:49:33 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:35.004 15:49:33 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:35.004 15:49:33 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:35.004 15:49:33 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:35.004 15:49:33 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:35.004 15:49:33 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:35.004 15:49:33 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:35.004 15:49:33 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:20:35.004 15:49:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:35.004 15:49:33 -- common/autotest_common.sh@10 -- # set +x 00:20:35.262 nvme0n1 00:20:35.262 15:49:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:35.262 15:49:33 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:35.262 15:49:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:35.262 15:49:33 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:35.262 15:49:33 -- common/autotest_common.sh@10 -- # set +x 00:20:35.262 15:49:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:35.262 15:49:33 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:35.262 15:49:33 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:35.262 15:49:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:35.262 15:49:33 -- common/autotest_common.sh@10 -- # set +x 00:20:35.520 15:49:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:35.520 15:49:33 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:35.520 15:49:33 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 2 00:20:35.520 15:49:33 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:35.520 15:49:33 -- host/auth.sh@44 -- # digest=sha512 00:20:35.520 15:49:33 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:20:35.520 15:49:33 -- host/auth.sh@44 -- # keyid=2 00:20:35.520 15:49:33 -- host/auth.sh@45 -- # key=DHHC-1:01:NTMwYjViNGM5ZDQ2MGRjNDFmZTllNDE2OWI5YTNkNmGuEmCM: 00:20:35.520 15:49:33 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:35.520 15:49:33 -- host/auth.sh@48 -- # echo ffdhe3072 00:20:35.520 15:49:33 -- host/auth.sh@49 -- # echo DHHC-1:01:NTMwYjViNGM5ZDQ2MGRjNDFmZTllNDE2OWI5YTNkNmGuEmCM: 00:20:35.520 15:49:33 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 2 00:20:35.520 15:49:33 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:35.520 15:49:33 -- host/auth.sh@68 -- # digest=sha512 00:20:35.520 15:49:33 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:20:35.520 15:49:33 -- host/auth.sh@68 -- # keyid=2 00:20:35.520 15:49:33 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:20:35.520 15:49:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:35.520 15:49:33 -- common/autotest_common.sh@10 -- # set +x 00:20:35.520 15:49:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:35.520 15:49:33 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:35.520 15:49:33 -- nvmf/common.sh@717 -- # local ip 00:20:35.520 15:49:33 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:35.520 15:49:33 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:35.520 15:49:33 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:35.520 15:49:33 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:35.520 15:49:33 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:35.520 15:49:33 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:35.520 15:49:33 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:35.520 15:49:33 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:35.520 15:49:33 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:35.520 15:49:33 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:20:35.520 15:49:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:35.520 15:49:33 -- common/autotest_common.sh@10 -- # set +x 00:20:35.778 nvme0n1 00:20:35.778 15:49:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:35.778 15:49:34 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:35.778 15:49:34 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:35.778 15:49:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:35.778 15:49:34 -- common/autotest_common.sh@10 -- # set +x 00:20:35.778 15:49:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:35.778 15:49:34 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:35.778 15:49:34 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:35.778 15:49:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:35.778 15:49:34 -- common/autotest_common.sh@10 -- # set +x 00:20:35.778 15:49:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:35.778 15:49:34 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:35.778 15:49:34 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 3 00:20:35.778 15:49:34 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:35.778 15:49:34 -- host/auth.sh@44 -- # digest=sha512 00:20:35.778 15:49:34 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:20:35.778 15:49:34 -- host/auth.sh@44 -- # keyid=3 00:20:35.778 15:49:34 -- host/auth.sh@45 -- # key=DHHC-1:02:ZDkyOTBjNmYzOTM4ZDcyYzM4ODY5NTMzZjYwYmM2MjgyMDk5MzU0N2ExNzZhNDc3yxf8Vw==: 00:20:35.778 15:49:34 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:35.778 15:49:34 -- host/auth.sh@48 -- # echo ffdhe3072 00:20:35.778 15:49:34 -- host/auth.sh@49 -- # echo DHHC-1:02:ZDkyOTBjNmYzOTM4ZDcyYzM4ODY5NTMzZjYwYmM2MjgyMDk5MzU0N2ExNzZhNDc3yxf8Vw==: 00:20:35.778 15:49:34 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 3 00:20:35.778 15:49:34 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:35.778 15:49:34 -- host/auth.sh@68 -- # digest=sha512 00:20:35.778 15:49:34 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:20:35.778 15:49:34 -- host/auth.sh@68 -- # keyid=3 00:20:35.778 15:49:34 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:20:35.778 15:49:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:35.778 15:49:34 -- common/autotest_common.sh@10 -- # set +x 00:20:35.778 15:49:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:35.778 15:49:34 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:35.778 15:49:34 -- nvmf/common.sh@717 -- # local ip 00:20:35.778 15:49:34 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:35.778 15:49:34 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:35.778 15:49:34 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:35.778 15:49:34 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:35.778 15:49:34 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:35.778 15:49:34 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:35.778 15:49:34 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:35.778 15:49:34 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:35.778 15:49:34 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:35.778 15:49:34 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:20:35.778 15:49:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:35.778 15:49:34 -- common/autotest_common.sh@10 -- # set +x 00:20:36.036 nvme0n1 00:20:36.036 15:49:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:36.036 15:49:34 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:36.036 15:49:34 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:36.036 15:49:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:36.036 15:49:34 -- common/autotest_common.sh@10 -- # set +x 00:20:36.036 15:49:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:36.036 15:49:34 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:36.036 15:49:34 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:36.036 15:49:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:36.036 15:49:34 -- common/autotest_common.sh@10 -- # set +x 00:20:36.036 15:49:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:36.036 15:49:34 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:36.036 15:49:34 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 4 00:20:36.036 15:49:34 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:36.036 15:49:34 -- host/auth.sh@44 -- # digest=sha512 00:20:36.036 15:49:34 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:20:36.036 15:49:34 -- host/auth.sh@44 -- # keyid=4 00:20:36.036 15:49:34 -- host/auth.sh@45 -- # key=DHHC-1:03:NDM1MTI0NTZjYTJiYjdhODFhNjc0ZGYzMDA4N2EwMzEyM2Q1MzBmNTM3N2NkZTY4NTZiNDI1MTgyYWFkYmY5MgHOiKk=: 00:20:36.036 15:49:34 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:36.036 15:49:34 -- host/auth.sh@48 -- # echo ffdhe3072 00:20:36.036 15:49:34 -- host/auth.sh@49 -- # echo DHHC-1:03:NDM1MTI0NTZjYTJiYjdhODFhNjc0ZGYzMDA4N2EwMzEyM2Q1MzBmNTM3N2NkZTY4NTZiNDI1MTgyYWFkYmY5MgHOiKk=: 00:20:36.036 15:49:34 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 4 00:20:36.036 15:49:34 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:36.036 15:49:34 -- host/auth.sh@68 -- # digest=sha512 00:20:36.036 15:49:34 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:20:36.036 15:49:34 -- host/auth.sh@68 -- # keyid=4 00:20:36.036 15:49:34 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:20:36.036 15:49:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:36.036 15:49:34 -- common/autotest_common.sh@10 -- # set +x 00:20:36.036 15:49:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:36.036 15:49:34 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:36.036 15:49:34 -- nvmf/common.sh@717 -- # local ip 00:20:36.036 15:49:34 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:36.036 15:49:34 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:36.036 15:49:34 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:36.036 15:49:34 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:36.036 15:49:34 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:36.036 15:49:34 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:36.036 15:49:34 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:36.036 15:49:34 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:36.036 15:49:34 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:36.036 15:49:34 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:20:36.036 15:49:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:36.036 15:49:34 -- common/autotest_common.sh@10 -- # set +x 00:20:36.293 nvme0n1 00:20:36.293 15:49:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:36.293 15:49:34 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:36.294 15:49:34 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:36.294 15:49:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:36.294 15:49:34 -- common/autotest_common.sh@10 -- # set +x 00:20:36.294 15:49:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:36.294 15:49:34 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:36.294 15:49:34 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:36.294 15:49:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:36.294 15:49:34 -- common/autotest_common.sh@10 -- # set +x 00:20:36.294 15:49:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:36.294 15:49:34 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:20:36.294 15:49:34 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:36.294 15:49:34 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 0 00:20:36.294 15:49:34 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:36.294 15:49:34 -- host/auth.sh@44 -- # digest=sha512 00:20:36.294 15:49:34 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:20:36.294 15:49:34 -- host/auth.sh@44 -- # keyid=0 00:20:36.294 15:49:34 -- host/auth.sh@45 -- # key=DHHC-1:00:OTM5MGRlZDM5MzNiZjkyNTdkZDcyZWUzYzdmMzYyNDJTpxB4: 00:20:36.294 15:49:34 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:36.294 15:49:34 -- host/auth.sh@48 -- # echo ffdhe4096 00:20:36.294 15:49:34 -- host/auth.sh@49 -- # echo DHHC-1:00:OTM5MGRlZDM5MzNiZjkyNTdkZDcyZWUzYzdmMzYyNDJTpxB4: 00:20:36.294 15:49:34 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 0 00:20:36.294 15:49:34 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:36.294 15:49:34 -- host/auth.sh@68 -- # digest=sha512 00:20:36.294 15:49:34 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:20:36.294 15:49:34 -- host/auth.sh@68 -- # keyid=0 00:20:36.294 15:49:34 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:20:36.294 15:49:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:36.294 15:49:34 -- common/autotest_common.sh@10 -- # set +x 00:20:36.294 15:49:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:36.294 15:49:34 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:36.294 15:49:34 -- nvmf/common.sh@717 -- # local ip 00:20:36.294 15:49:34 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:36.294 15:49:34 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:36.294 15:49:34 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:36.294 15:49:34 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:36.294 15:49:34 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:36.294 15:49:34 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:36.294 15:49:34 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:36.294 15:49:34 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:36.294 15:49:34 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:36.294 15:49:34 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:20:36.294 15:49:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:36.294 15:49:34 -- common/autotest_common.sh@10 -- # set +x 00:20:36.551 nvme0n1 00:20:36.551 15:49:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:36.551 15:49:35 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:36.551 15:49:35 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:36.551 15:49:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:36.551 15:49:35 -- common/autotest_common.sh@10 -- # set +x 00:20:36.551 15:49:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:36.809 15:49:35 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:36.809 15:49:35 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:36.809 15:49:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:36.809 15:49:35 -- common/autotest_common.sh@10 -- # set +x 00:20:36.809 15:49:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:36.809 15:49:35 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:36.809 15:49:35 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 1 00:20:36.809 15:49:35 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:36.809 15:49:35 -- host/auth.sh@44 -- # digest=sha512 00:20:36.809 15:49:35 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:20:36.809 15:49:35 -- host/auth.sh@44 -- # keyid=1 00:20:36.809 15:49:35 -- host/auth.sh@45 -- # key=DHHC-1:00:ZWQ0OTBmNjZkMDgwMjI2ZTU4NDcyNmZlOTk3NjZiY2ViYTYwODk5MTEyODRmMDM5s+pwyQ==: 00:20:36.809 15:49:35 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:36.809 15:49:35 -- host/auth.sh@48 -- # echo ffdhe4096 00:20:36.809 15:49:35 -- host/auth.sh@49 -- # echo DHHC-1:00:ZWQ0OTBmNjZkMDgwMjI2ZTU4NDcyNmZlOTk3NjZiY2ViYTYwODk5MTEyODRmMDM5s+pwyQ==: 00:20:36.809 15:49:35 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 1 00:20:36.809 15:49:35 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:36.809 15:49:35 -- host/auth.sh@68 -- # digest=sha512 00:20:36.809 15:49:35 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:20:36.809 15:49:35 -- host/auth.sh@68 -- # keyid=1 00:20:36.809 15:49:35 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:20:36.809 15:49:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:36.809 15:49:35 -- common/autotest_common.sh@10 -- # set +x 00:20:36.809 15:49:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:36.809 15:49:35 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:36.809 15:49:35 -- nvmf/common.sh@717 -- # local ip 00:20:36.809 15:49:35 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:36.809 15:49:35 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:36.809 15:49:35 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:36.809 15:49:35 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:36.809 15:49:35 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:36.809 15:49:35 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:36.809 15:49:35 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:36.809 15:49:35 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:36.809 15:49:35 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:36.809 15:49:35 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:20:36.809 15:49:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:36.809 15:49:35 -- common/autotest_common.sh@10 -- # set +x 00:20:37.067 nvme0n1 00:20:37.067 15:49:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:37.067 15:49:35 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:37.067 15:49:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:37.067 15:49:35 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:37.067 15:49:35 -- common/autotest_common.sh@10 -- # set +x 00:20:37.067 15:49:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:37.067 15:49:35 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:37.067 15:49:35 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:37.067 15:49:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:37.067 15:49:35 -- common/autotest_common.sh@10 -- # set +x 00:20:37.067 15:49:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:37.067 15:49:35 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:37.067 15:49:35 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 2 00:20:37.067 15:49:35 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:37.067 15:49:35 -- host/auth.sh@44 -- # digest=sha512 00:20:37.067 15:49:35 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:20:37.067 15:49:35 -- host/auth.sh@44 -- # keyid=2 00:20:37.067 15:49:35 -- host/auth.sh@45 -- # key=DHHC-1:01:NTMwYjViNGM5ZDQ2MGRjNDFmZTllNDE2OWI5YTNkNmGuEmCM: 00:20:37.067 15:49:35 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:37.067 15:49:35 -- host/auth.sh@48 -- # echo ffdhe4096 00:20:37.067 15:49:35 -- host/auth.sh@49 -- # echo DHHC-1:01:NTMwYjViNGM5ZDQ2MGRjNDFmZTllNDE2OWI5YTNkNmGuEmCM: 00:20:37.067 15:49:35 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 2 00:20:37.067 15:49:35 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:37.067 15:49:35 -- host/auth.sh@68 -- # digest=sha512 00:20:37.067 15:49:35 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:20:37.067 15:49:35 -- host/auth.sh@68 -- # keyid=2 00:20:37.067 15:49:35 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:20:37.067 15:49:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:37.067 15:49:35 -- common/autotest_common.sh@10 -- # set +x 00:20:37.067 15:49:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:37.067 15:49:35 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:37.067 15:49:35 -- nvmf/common.sh@717 -- # local ip 00:20:37.067 15:49:35 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:37.067 15:49:35 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:37.067 15:49:35 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:37.067 15:49:35 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:37.067 15:49:35 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:37.067 15:49:35 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:37.067 15:49:35 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:37.067 15:49:35 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:37.067 15:49:35 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:37.067 15:49:35 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:20:37.067 15:49:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:37.067 15:49:35 -- common/autotest_common.sh@10 -- # set +x 00:20:37.325 nvme0n1 00:20:37.325 15:49:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:37.325 15:49:35 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:37.325 15:49:35 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:37.325 15:49:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:37.325 15:49:35 -- common/autotest_common.sh@10 -- # set +x 00:20:37.583 15:49:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:37.583 15:49:35 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:37.583 15:49:35 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:37.583 15:49:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:37.583 15:49:35 -- common/autotest_common.sh@10 -- # set +x 00:20:37.583 15:49:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:37.584 15:49:35 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:37.584 15:49:35 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 3 00:20:37.584 15:49:35 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:37.584 15:49:35 -- host/auth.sh@44 -- # digest=sha512 00:20:37.584 15:49:35 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:20:37.584 15:49:35 -- host/auth.sh@44 -- # keyid=3 00:20:37.584 15:49:35 -- host/auth.sh@45 -- # key=DHHC-1:02:ZDkyOTBjNmYzOTM4ZDcyYzM4ODY5NTMzZjYwYmM2MjgyMDk5MzU0N2ExNzZhNDc3yxf8Vw==: 00:20:37.584 15:49:35 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:37.584 15:49:35 -- host/auth.sh@48 -- # echo ffdhe4096 00:20:37.584 15:49:35 -- host/auth.sh@49 -- # echo DHHC-1:02:ZDkyOTBjNmYzOTM4ZDcyYzM4ODY5NTMzZjYwYmM2MjgyMDk5MzU0N2ExNzZhNDc3yxf8Vw==: 00:20:37.584 15:49:35 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 3 00:20:37.584 15:49:35 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:37.584 15:49:35 -- host/auth.sh@68 -- # digest=sha512 00:20:37.584 15:49:35 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:20:37.584 15:49:35 -- host/auth.sh@68 -- # keyid=3 00:20:37.584 15:49:35 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:20:37.584 15:49:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:37.584 15:49:35 -- common/autotest_common.sh@10 -- # set +x 00:20:37.584 15:49:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:37.584 15:49:35 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:37.584 15:49:35 -- nvmf/common.sh@717 -- # local ip 00:20:37.584 15:49:35 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:37.584 15:49:35 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:37.584 15:49:35 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:37.584 15:49:35 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:37.584 15:49:35 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:37.584 15:49:35 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:37.584 15:49:35 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:37.584 15:49:35 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:37.584 15:49:35 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:37.584 15:49:35 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:20:37.584 15:49:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:37.584 15:49:35 -- common/autotest_common.sh@10 -- # set +x 00:20:37.842 nvme0n1 00:20:37.842 15:49:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:37.842 15:49:36 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:37.842 15:49:36 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:37.842 15:49:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:37.842 15:49:36 -- common/autotest_common.sh@10 -- # set +x 00:20:37.842 15:49:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:37.842 15:49:36 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:37.842 15:49:36 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:37.842 15:49:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:37.842 15:49:36 -- common/autotest_common.sh@10 -- # set +x 00:20:37.842 15:49:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:37.842 15:49:36 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:37.842 15:49:36 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 4 00:20:37.842 15:49:36 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:37.842 15:49:36 -- host/auth.sh@44 -- # digest=sha512 00:20:37.842 15:49:36 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:20:37.842 15:49:36 -- host/auth.sh@44 -- # keyid=4 00:20:37.842 15:49:36 -- host/auth.sh@45 -- # key=DHHC-1:03:NDM1MTI0NTZjYTJiYjdhODFhNjc0ZGYzMDA4N2EwMzEyM2Q1MzBmNTM3N2NkZTY4NTZiNDI1MTgyYWFkYmY5MgHOiKk=: 00:20:37.842 15:49:36 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:37.842 15:49:36 -- host/auth.sh@48 -- # echo ffdhe4096 00:20:37.842 15:49:36 -- host/auth.sh@49 -- # echo DHHC-1:03:NDM1MTI0NTZjYTJiYjdhODFhNjc0ZGYzMDA4N2EwMzEyM2Q1MzBmNTM3N2NkZTY4NTZiNDI1MTgyYWFkYmY5MgHOiKk=: 00:20:37.842 15:49:36 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 4 00:20:37.842 15:49:36 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:37.842 15:49:36 -- host/auth.sh@68 -- # digest=sha512 00:20:37.842 15:49:36 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:20:37.842 15:49:36 -- host/auth.sh@68 -- # keyid=4 00:20:37.842 15:49:36 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:20:37.842 15:49:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:37.842 15:49:36 -- common/autotest_common.sh@10 -- # set +x 00:20:37.842 15:49:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:37.842 15:49:36 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:37.842 15:49:36 -- nvmf/common.sh@717 -- # local ip 00:20:37.842 15:49:36 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:37.842 15:49:36 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:37.842 15:49:36 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:37.842 15:49:36 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:37.842 15:49:36 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:37.842 15:49:36 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:37.842 15:49:36 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:37.842 15:49:36 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:37.842 15:49:36 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:37.842 15:49:36 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:20:37.842 15:49:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:37.842 15:49:36 -- common/autotest_common.sh@10 -- # set +x 00:20:38.101 nvme0n1 00:20:38.101 15:49:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:38.101 15:49:36 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:38.101 15:49:36 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:38.101 15:49:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:38.101 15:49:36 -- common/autotest_common.sh@10 -- # set +x 00:20:38.101 15:49:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:38.359 15:49:36 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:38.359 15:49:36 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:38.359 15:49:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:38.359 15:49:36 -- common/autotest_common.sh@10 -- # set +x 00:20:38.359 15:49:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:38.359 15:49:36 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:20:38.359 15:49:36 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:38.359 15:49:36 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 0 00:20:38.359 15:49:36 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:38.359 15:49:36 -- host/auth.sh@44 -- # digest=sha512 00:20:38.359 15:49:36 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:20:38.359 15:49:36 -- host/auth.sh@44 -- # keyid=0 00:20:38.359 15:49:36 -- host/auth.sh@45 -- # key=DHHC-1:00:OTM5MGRlZDM5MzNiZjkyNTdkZDcyZWUzYzdmMzYyNDJTpxB4: 00:20:38.359 15:49:36 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:38.359 15:49:36 -- host/auth.sh@48 -- # echo ffdhe6144 00:20:38.359 15:49:36 -- host/auth.sh@49 -- # echo DHHC-1:00:OTM5MGRlZDM5MzNiZjkyNTdkZDcyZWUzYzdmMzYyNDJTpxB4: 00:20:38.359 15:49:36 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 0 00:20:38.359 15:49:36 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:38.359 15:49:36 -- host/auth.sh@68 -- # digest=sha512 00:20:38.359 15:49:36 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:20:38.359 15:49:36 -- host/auth.sh@68 -- # keyid=0 00:20:38.359 15:49:36 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:20:38.359 15:49:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:38.359 15:49:36 -- common/autotest_common.sh@10 -- # set +x 00:20:38.359 15:49:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:38.359 15:49:36 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:38.359 15:49:36 -- nvmf/common.sh@717 -- # local ip 00:20:38.359 15:49:36 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:38.359 15:49:36 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:38.359 15:49:36 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:38.359 15:49:36 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:38.359 15:49:36 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:38.359 15:49:36 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:38.359 15:49:36 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:38.359 15:49:36 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:38.359 15:49:36 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:38.359 15:49:36 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:20:38.359 15:49:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:38.359 15:49:36 -- common/autotest_common.sh@10 -- # set +x 00:20:38.617 nvme0n1 00:20:38.617 15:49:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:38.617 15:49:37 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:38.617 15:49:37 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:38.617 15:49:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:38.617 15:49:37 -- common/autotest_common.sh@10 -- # set +x 00:20:38.617 15:49:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:38.876 15:49:37 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:38.876 15:49:37 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:38.876 15:49:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:38.876 15:49:37 -- common/autotest_common.sh@10 -- # set +x 00:20:38.876 15:49:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:38.876 15:49:37 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:38.876 15:49:37 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 1 00:20:38.876 15:49:37 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:38.876 15:49:37 -- host/auth.sh@44 -- # digest=sha512 00:20:38.876 15:49:37 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:20:38.876 15:49:37 -- host/auth.sh@44 -- # keyid=1 00:20:38.876 15:49:37 -- host/auth.sh@45 -- # key=DHHC-1:00:ZWQ0OTBmNjZkMDgwMjI2ZTU4NDcyNmZlOTk3NjZiY2ViYTYwODk5MTEyODRmMDM5s+pwyQ==: 00:20:38.876 15:49:37 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:38.876 15:49:37 -- host/auth.sh@48 -- # echo ffdhe6144 00:20:38.876 15:49:37 -- host/auth.sh@49 -- # echo DHHC-1:00:ZWQ0OTBmNjZkMDgwMjI2ZTU4NDcyNmZlOTk3NjZiY2ViYTYwODk5MTEyODRmMDM5s+pwyQ==: 00:20:38.876 15:49:37 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 1 00:20:38.876 15:49:37 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:38.876 15:49:37 -- host/auth.sh@68 -- # digest=sha512 00:20:38.876 15:49:37 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:20:38.876 15:49:37 -- host/auth.sh@68 -- # keyid=1 00:20:38.876 15:49:37 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:20:38.876 15:49:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:38.876 15:49:37 -- common/autotest_common.sh@10 -- # set +x 00:20:38.876 15:49:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:38.876 15:49:37 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:38.876 15:49:37 -- nvmf/common.sh@717 -- # local ip 00:20:38.876 15:49:37 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:38.876 15:49:37 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:38.876 15:49:37 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:38.876 15:49:37 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:38.876 15:49:37 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:38.876 15:49:37 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:38.876 15:49:37 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:38.876 15:49:37 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:38.876 15:49:37 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:38.876 15:49:37 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:20:38.876 15:49:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:38.876 15:49:37 -- common/autotest_common.sh@10 -- # set +x 00:20:39.134 nvme0n1 00:20:39.134 15:49:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:39.134 15:49:37 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:39.134 15:49:37 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:39.134 15:49:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:39.134 15:49:37 -- common/autotest_common.sh@10 -- # set +x 00:20:39.134 15:49:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:39.392 15:49:37 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:39.392 15:49:37 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:39.392 15:49:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:39.392 15:49:37 -- common/autotest_common.sh@10 -- # set +x 00:20:39.392 15:49:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:39.392 15:49:37 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:39.392 15:49:37 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 2 00:20:39.392 15:49:37 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:39.392 15:49:37 -- host/auth.sh@44 -- # digest=sha512 00:20:39.392 15:49:37 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:20:39.392 15:49:37 -- host/auth.sh@44 -- # keyid=2 00:20:39.392 15:49:37 -- host/auth.sh@45 -- # key=DHHC-1:01:NTMwYjViNGM5ZDQ2MGRjNDFmZTllNDE2OWI5YTNkNmGuEmCM: 00:20:39.392 15:49:37 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:39.392 15:49:37 -- host/auth.sh@48 -- # echo ffdhe6144 00:20:39.392 15:49:37 -- host/auth.sh@49 -- # echo DHHC-1:01:NTMwYjViNGM5ZDQ2MGRjNDFmZTllNDE2OWI5YTNkNmGuEmCM: 00:20:39.392 15:49:37 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 2 00:20:39.392 15:49:37 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:39.392 15:49:37 -- host/auth.sh@68 -- # digest=sha512 00:20:39.392 15:49:37 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:20:39.392 15:49:37 -- host/auth.sh@68 -- # keyid=2 00:20:39.392 15:49:37 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:20:39.392 15:49:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:39.392 15:49:37 -- common/autotest_common.sh@10 -- # set +x 00:20:39.392 15:49:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:39.392 15:49:37 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:39.392 15:49:37 -- nvmf/common.sh@717 -- # local ip 00:20:39.392 15:49:37 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:39.392 15:49:37 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:39.392 15:49:37 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:39.392 15:49:37 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:39.392 15:49:37 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:39.392 15:49:37 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:39.392 15:49:37 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:39.392 15:49:37 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:39.392 15:49:37 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:39.392 15:49:37 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:20:39.392 15:49:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:39.392 15:49:37 -- common/autotest_common.sh@10 -- # set +x 00:20:39.650 nvme0n1 00:20:39.650 15:49:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:39.650 15:49:38 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:39.650 15:49:38 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:39.650 15:49:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:39.651 15:49:38 -- common/autotest_common.sh@10 -- # set +x 00:20:39.651 15:49:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:39.651 15:49:38 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:39.651 15:49:38 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:39.651 15:49:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:39.651 15:49:38 -- common/autotest_common.sh@10 -- # set +x 00:20:39.909 15:49:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:39.909 15:49:38 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:39.909 15:49:38 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 3 00:20:39.909 15:49:38 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:39.909 15:49:38 -- host/auth.sh@44 -- # digest=sha512 00:20:39.909 15:49:38 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:20:39.909 15:49:38 -- host/auth.sh@44 -- # keyid=3 00:20:39.909 15:49:38 -- host/auth.sh@45 -- # key=DHHC-1:02:ZDkyOTBjNmYzOTM4ZDcyYzM4ODY5NTMzZjYwYmM2MjgyMDk5MzU0N2ExNzZhNDc3yxf8Vw==: 00:20:39.909 15:49:38 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:39.909 15:49:38 -- host/auth.sh@48 -- # echo ffdhe6144 00:20:39.909 15:49:38 -- host/auth.sh@49 -- # echo DHHC-1:02:ZDkyOTBjNmYzOTM4ZDcyYzM4ODY5NTMzZjYwYmM2MjgyMDk5MzU0N2ExNzZhNDc3yxf8Vw==: 00:20:39.909 15:49:38 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 3 00:20:39.909 15:49:38 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:39.909 15:49:38 -- host/auth.sh@68 -- # digest=sha512 00:20:39.909 15:49:38 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:20:39.909 15:49:38 -- host/auth.sh@68 -- # keyid=3 00:20:39.909 15:49:38 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:20:39.909 15:49:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:39.909 15:49:38 -- common/autotest_common.sh@10 -- # set +x 00:20:39.909 15:49:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:39.909 15:49:38 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:39.909 15:49:38 -- nvmf/common.sh@717 -- # local ip 00:20:39.909 15:49:38 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:39.909 15:49:38 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:39.909 15:49:38 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:39.909 15:49:38 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:39.909 15:49:38 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:39.909 15:49:38 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:39.909 15:49:38 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:39.909 15:49:38 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:39.909 15:49:38 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:39.909 15:49:38 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:20:39.909 15:49:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:39.909 15:49:38 -- common/autotest_common.sh@10 -- # set +x 00:20:40.167 nvme0n1 00:20:40.167 15:49:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:40.167 15:49:38 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:40.167 15:49:38 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:40.167 15:49:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:40.167 15:49:38 -- common/autotest_common.sh@10 -- # set +x 00:20:40.167 15:49:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:40.167 15:49:38 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:40.167 15:49:38 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:40.167 15:49:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:40.167 15:49:38 -- common/autotest_common.sh@10 -- # set +x 00:20:40.167 15:49:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:40.167 15:49:38 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:40.425 15:49:38 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 4 00:20:40.425 15:49:38 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:40.426 15:49:38 -- host/auth.sh@44 -- # digest=sha512 00:20:40.426 15:49:38 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:20:40.426 15:49:38 -- host/auth.sh@44 -- # keyid=4 00:20:40.426 15:49:38 -- host/auth.sh@45 -- # key=DHHC-1:03:NDM1MTI0NTZjYTJiYjdhODFhNjc0ZGYzMDA4N2EwMzEyM2Q1MzBmNTM3N2NkZTY4NTZiNDI1MTgyYWFkYmY5MgHOiKk=: 00:20:40.426 15:49:38 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:40.426 15:49:38 -- host/auth.sh@48 -- # echo ffdhe6144 00:20:40.426 15:49:38 -- host/auth.sh@49 -- # echo DHHC-1:03:NDM1MTI0NTZjYTJiYjdhODFhNjc0ZGYzMDA4N2EwMzEyM2Q1MzBmNTM3N2NkZTY4NTZiNDI1MTgyYWFkYmY5MgHOiKk=: 00:20:40.426 15:49:38 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 4 00:20:40.426 15:49:38 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:40.426 15:49:38 -- host/auth.sh@68 -- # digest=sha512 00:20:40.426 15:49:38 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:20:40.426 15:49:38 -- host/auth.sh@68 -- # keyid=4 00:20:40.426 15:49:38 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:20:40.426 15:49:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:40.426 15:49:38 -- common/autotest_common.sh@10 -- # set +x 00:20:40.426 15:49:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:40.426 15:49:38 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:40.426 15:49:38 -- nvmf/common.sh@717 -- # local ip 00:20:40.426 15:49:38 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:40.426 15:49:38 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:40.426 15:49:38 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:40.426 15:49:38 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:40.426 15:49:38 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:40.426 15:49:38 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:40.426 15:49:38 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:40.426 15:49:38 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:40.426 15:49:38 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:40.426 15:49:38 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:20:40.426 15:49:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:40.426 15:49:38 -- common/autotest_common.sh@10 -- # set +x 00:20:40.684 nvme0n1 00:20:40.684 15:49:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:40.684 15:49:39 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:40.684 15:49:39 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:40.684 15:49:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:40.684 15:49:39 -- common/autotest_common.sh@10 -- # set +x 00:20:40.684 15:49:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:40.684 15:49:39 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:40.684 15:49:39 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:40.684 15:49:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:40.684 15:49:39 -- common/autotest_common.sh@10 -- # set +x 00:20:40.942 15:49:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:40.942 15:49:39 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:20:40.942 15:49:39 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:40.942 15:49:39 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 0 00:20:40.942 15:49:39 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:40.942 15:49:39 -- host/auth.sh@44 -- # digest=sha512 00:20:40.942 15:49:39 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:20:40.942 15:49:39 -- host/auth.sh@44 -- # keyid=0 00:20:40.942 15:49:39 -- host/auth.sh@45 -- # key=DHHC-1:00:OTM5MGRlZDM5MzNiZjkyNTdkZDcyZWUzYzdmMzYyNDJTpxB4: 00:20:40.942 15:49:39 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:40.942 15:49:39 -- host/auth.sh@48 -- # echo ffdhe8192 00:20:40.942 15:49:39 -- host/auth.sh@49 -- # echo DHHC-1:00:OTM5MGRlZDM5MzNiZjkyNTdkZDcyZWUzYzdmMzYyNDJTpxB4: 00:20:40.942 15:49:39 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 0 00:20:40.942 15:49:39 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:40.942 15:49:39 -- host/auth.sh@68 -- # digest=sha512 00:20:40.942 15:49:39 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:20:40.942 15:49:39 -- host/auth.sh@68 -- # keyid=0 00:20:40.942 15:49:39 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:20:40.942 15:49:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:40.942 15:49:39 -- common/autotest_common.sh@10 -- # set +x 00:20:40.942 15:49:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:40.942 15:49:39 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:40.942 15:49:39 -- nvmf/common.sh@717 -- # local ip 00:20:40.942 15:49:39 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:40.942 15:49:39 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:40.942 15:49:39 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:40.942 15:49:39 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:40.942 15:49:39 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:40.942 15:49:39 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:40.942 15:49:39 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:40.942 15:49:39 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:40.942 15:49:39 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:40.942 15:49:39 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:20:40.942 15:49:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:40.942 15:49:39 -- common/autotest_common.sh@10 -- # set +x 00:20:41.508 nvme0n1 00:20:41.508 15:49:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:41.508 15:49:39 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:41.508 15:49:39 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:41.508 15:49:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:41.508 15:49:39 -- common/autotest_common.sh@10 -- # set +x 00:20:41.508 15:49:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:41.508 15:49:39 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:41.508 15:49:39 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:41.508 15:49:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:41.508 15:49:39 -- common/autotest_common.sh@10 -- # set +x 00:20:41.508 15:49:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:41.508 15:49:39 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:41.508 15:49:39 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 1 00:20:41.508 15:49:39 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:41.508 15:49:39 -- host/auth.sh@44 -- # digest=sha512 00:20:41.508 15:49:39 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:20:41.508 15:49:39 -- host/auth.sh@44 -- # keyid=1 00:20:41.508 15:49:39 -- host/auth.sh@45 -- # key=DHHC-1:00:ZWQ0OTBmNjZkMDgwMjI2ZTU4NDcyNmZlOTk3NjZiY2ViYTYwODk5MTEyODRmMDM5s+pwyQ==: 00:20:41.508 15:49:39 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:41.508 15:49:39 -- host/auth.sh@48 -- # echo ffdhe8192 00:20:41.508 15:49:39 -- host/auth.sh@49 -- # echo DHHC-1:00:ZWQ0OTBmNjZkMDgwMjI2ZTU4NDcyNmZlOTk3NjZiY2ViYTYwODk5MTEyODRmMDM5s+pwyQ==: 00:20:41.508 15:49:39 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 1 00:20:41.508 15:49:39 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:41.508 15:49:39 -- host/auth.sh@68 -- # digest=sha512 00:20:41.508 15:49:39 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:20:41.508 15:49:39 -- host/auth.sh@68 -- # keyid=1 00:20:41.509 15:49:39 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:20:41.509 15:49:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:41.509 15:49:39 -- common/autotest_common.sh@10 -- # set +x 00:20:41.509 15:49:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:41.509 15:49:40 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:41.509 15:49:40 -- nvmf/common.sh@717 -- # local ip 00:20:41.509 15:49:40 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:41.509 15:49:40 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:41.509 15:49:40 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:41.509 15:49:40 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:41.509 15:49:40 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:41.509 15:49:40 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:41.509 15:49:40 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:41.509 15:49:40 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:41.509 15:49:40 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:41.509 15:49:40 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:20:41.509 15:49:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:41.509 15:49:40 -- common/autotest_common.sh@10 -- # set +x 00:20:42.073 nvme0n1 00:20:42.073 15:49:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.073 15:49:40 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:42.073 15:49:40 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:42.073 15:49:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.073 15:49:40 -- common/autotest_common.sh@10 -- # set +x 00:20:42.073 15:49:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.331 15:49:40 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:42.331 15:49:40 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:42.331 15:49:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.331 15:49:40 -- common/autotest_common.sh@10 -- # set +x 00:20:42.331 15:49:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.331 15:49:40 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:42.331 15:49:40 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 2 00:20:42.331 15:49:40 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:42.331 15:49:40 -- host/auth.sh@44 -- # digest=sha512 00:20:42.331 15:49:40 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:20:42.331 15:49:40 -- host/auth.sh@44 -- # keyid=2 00:20:42.331 15:49:40 -- host/auth.sh@45 -- # key=DHHC-1:01:NTMwYjViNGM5ZDQ2MGRjNDFmZTllNDE2OWI5YTNkNmGuEmCM: 00:20:42.331 15:49:40 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:42.331 15:49:40 -- host/auth.sh@48 -- # echo ffdhe8192 00:20:42.331 15:49:40 -- host/auth.sh@49 -- # echo DHHC-1:01:NTMwYjViNGM5ZDQ2MGRjNDFmZTllNDE2OWI5YTNkNmGuEmCM: 00:20:42.331 15:49:40 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 2 00:20:42.331 15:49:40 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:42.331 15:49:40 -- host/auth.sh@68 -- # digest=sha512 00:20:42.331 15:49:40 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:20:42.331 15:49:40 -- host/auth.sh@68 -- # keyid=2 00:20:42.331 15:49:40 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:20:42.331 15:49:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.331 15:49:40 -- common/autotest_common.sh@10 -- # set +x 00:20:42.331 15:49:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.331 15:49:40 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:42.331 15:49:40 -- nvmf/common.sh@717 -- # local ip 00:20:42.331 15:49:40 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:42.331 15:49:40 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:42.331 15:49:40 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:42.331 15:49:40 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:42.331 15:49:40 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:42.331 15:49:40 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:42.331 15:49:40 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:42.331 15:49:40 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:42.331 15:49:40 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:42.331 15:49:40 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:20:42.331 15:49:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.331 15:49:40 -- common/autotest_common.sh@10 -- # set +x 00:20:42.896 nvme0n1 00:20:42.896 15:49:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.896 15:49:41 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:42.896 15:49:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.896 15:49:41 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:42.896 15:49:41 -- common/autotest_common.sh@10 -- # set +x 00:20:42.896 15:49:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.896 15:49:41 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:42.896 15:49:41 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:42.896 15:49:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.896 15:49:41 -- common/autotest_common.sh@10 -- # set +x 00:20:42.896 15:49:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.896 15:49:41 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:42.897 15:49:41 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 3 00:20:42.897 15:49:41 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:42.897 15:49:41 -- host/auth.sh@44 -- # digest=sha512 00:20:42.897 15:49:41 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:20:42.897 15:49:41 -- host/auth.sh@44 -- # keyid=3 00:20:42.897 15:49:41 -- host/auth.sh@45 -- # key=DHHC-1:02:ZDkyOTBjNmYzOTM4ZDcyYzM4ODY5NTMzZjYwYmM2MjgyMDk5MzU0N2ExNzZhNDc3yxf8Vw==: 00:20:42.897 15:49:41 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:42.897 15:49:41 -- host/auth.sh@48 -- # echo ffdhe8192 00:20:42.897 15:49:41 -- host/auth.sh@49 -- # echo DHHC-1:02:ZDkyOTBjNmYzOTM4ZDcyYzM4ODY5NTMzZjYwYmM2MjgyMDk5MzU0N2ExNzZhNDc3yxf8Vw==: 00:20:42.897 15:49:41 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 3 00:20:42.897 15:49:41 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:42.897 15:49:41 -- host/auth.sh@68 -- # digest=sha512 00:20:42.897 15:49:41 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:20:42.897 15:49:41 -- host/auth.sh@68 -- # keyid=3 00:20:42.897 15:49:41 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:20:42.897 15:49:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.897 15:49:41 -- common/autotest_common.sh@10 -- # set +x 00:20:42.897 15:49:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.897 15:49:41 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:42.897 15:49:41 -- nvmf/common.sh@717 -- # local ip 00:20:42.897 15:49:41 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:42.897 15:49:41 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:42.897 15:49:41 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:42.897 15:49:41 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:42.897 15:49:41 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:42.897 15:49:41 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:42.897 15:49:41 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:42.897 15:49:41 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:42.897 15:49:41 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:42.897 15:49:41 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:20:42.897 15:49:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.897 15:49:41 -- common/autotest_common.sh@10 -- # set +x 00:20:43.464 nvme0n1 00:20:43.464 15:49:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:43.464 15:49:42 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:43.465 15:49:42 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:43.465 15:49:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:43.465 15:49:42 -- common/autotest_common.sh@10 -- # set +x 00:20:43.465 15:49:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:43.722 15:49:42 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:43.722 15:49:42 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:43.722 15:49:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:43.722 15:49:42 -- common/autotest_common.sh@10 -- # set +x 00:20:43.722 15:49:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:43.722 15:49:42 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:20:43.722 15:49:42 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 4 00:20:43.722 15:49:42 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:43.722 15:49:42 -- host/auth.sh@44 -- # digest=sha512 00:20:43.722 15:49:42 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:20:43.722 15:49:42 -- host/auth.sh@44 -- # keyid=4 00:20:43.722 15:49:42 -- host/auth.sh@45 -- # key=DHHC-1:03:NDM1MTI0NTZjYTJiYjdhODFhNjc0ZGYzMDA4N2EwMzEyM2Q1MzBmNTM3N2NkZTY4NTZiNDI1MTgyYWFkYmY5MgHOiKk=: 00:20:43.722 15:49:42 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:20:43.722 15:49:42 -- host/auth.sh@48 -- # echo ffdhe8192 00:20:43.722 15:49:42 -- host/auth.sh@49 -- # echo DHHC-1:03:NDM1MTI0NTZjYTJiYjdhODFhNjc0ZGYzMDA4N2EwMzEyM2Q1MzBmNTM3N2NkZTY4NTZiNDI1MTgyYWFkYmY5MgHOiKk=: 00:20:43.722 15:49:42 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 4 00:20:43.722 15:49:42 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:20:43.722 15:49:42 -- host/auth.sh@68 -- # digest=sha512 00:20:43.722 15:49:42 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:20:43.722 15:49:42 -- host/auth.sh@68 -- # keyid=4 00:20:43.722 15:49:42 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:20:43.722 15:49:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:43.722 15:49:42 -- common/autotest_common.sh@10 -- # set +x 00:20:43.722 15:49:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:43.722 15:49:42 -- host/auth.sh@70 -- # get_main_ns_ip 00:20:43.722 15:49:42 -- nvmf/common.sh@717 -- # local ip 00:20:43.722 15:49:42 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:43.722 15:49:42 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:43.722 15:49:42 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:43.722 15:49:42 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:43.722 15:49:42 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:43.722 15:49:42 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:43.722 15:49:42 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:43.722 15:49:42 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:43.722 15:49:42 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:43.722 15:49:42 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:20:43.722 15:49:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:43.722 15:49:42 -- common/autotest_common.sh@10 -- # set +x 00:20:44.287 nvme0n1 00:20:44.287 15:49:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:44.287 15:49:42 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:20:44.287 15:49:42 -- host/auth.sh@73 -- # jq -r '.[].name' 00:20:44.287 15:49:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:44.287 15:49:42 -- common/autotest_common.sh@10 -- # set +x 00:20:44.287 15:49:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:44.287 15:49:42 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:20:44.287 15:49:42 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:20:44.287 15:49:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:44.287 15:49:42 -- common/autotest_common.sh@10 -- # set +x 00:20:44.287 15:49:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:44.287 15:49:42 -- host/auth.sh@117 -- # nvmet_auth_set_key sha256 ffdhe2048 1 00:20:44.287 15:49:42 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:20:44.287 15:49:42 -- host/auth.sh@44 -- # digest=sha256 00:20:44.287 15:49:42 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:20:44.288 15:49:42 -- host/auth.sh@44 -- # keyid=1 00:20:44.288 15:49:42 -- host/auth.sh@45 -- # key=DHHC-1:00:ZWQ0OTBmNjZkMDgwMjI2ZTU4NDcyNmZlOTk3NjZiY2ViYTYwODk5MTEyODRmMDM5s+pwyQ==: 00:20:44.288 15:49:42 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:20:44.288 15:49:42 -- host/auth.sh@48 -- # echo ffdhe2048 00:20:44.288 15:49:42 -- host/auth.sh@49 -- # echo DHHC-1:00:ZWQ0OTBmNjZkMDgwMjI2ZTU4NDcyNmZlOTk3NjZiY2ViYTYwODk5MTEyODRmMDM5s+pwyQ==: 00:20:44.288 15:49:42 -- host/auth.sh@118 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:20:44.288 15:49:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:44.288 15:49:42 -- common/autotest_common.sh@10 -- # set +x 00:20:44.288 15:49:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:44.288 15:49:42 -- host/auth.sh@119 -- # get_main_ns_ip 00:20:44.288 15:49:42 -- nvmf/common.sh@717 -- # local ip 00:20:44.288 15:49:42 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:44.288 15:49:42 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:44.288 15:49:42 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:44.288 15:49:42 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:44.288 15:49:42 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:44.288 15:49:42 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:44.288 15:49:42 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:44.288 15:49:42 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:44.288 15:49:42 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:44.288 15:49:42 -- host/auth.sh@119 -- # NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 00:20:44.288 15:49:42 -- common/autotest_common.sh@638 -- # local es=0 00:20:44.288 15:49:42 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 00:20:44.288 15:49:42 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:20:44.288 15:49:42 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:20:44.288 15:49:42 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:20:44.288 15:49:42 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:20:44.288 15:49:42 -- common/autotest_common.sh@641 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 00:20:44.288 15:49:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:44.288 15:49:42 -- common/autotest_common.sh@10 -- # set +x 00:20:44.545 request: 00:20:44.545 { 00:20:44.545 "name": "nvme0", 00:20:44.545 "trtype": "rdma", 00:20:44.545 "traddr": "192.168.100.8", 00:20:44.545 "hostnqn": "nqn.2024-02.io.spdk:host0", 00:20:44.545 "adrfam": "ipv4", 00:20:44.545 "trsvcid": "4420", 00:20:44.545 "subnqn": "nqn.2024-02.io.spdk:cnode0", 00:20:44.545 "method": "bdev_nvme_attach_controller", 00:20:44.545 "req_id": 1 00:20:44.545 } 00:20:44.545 Got JSON-RPC error response 00:20:44.545 response: 00:20:44.545 { 00:20:44.545 "code": -32602, 00:20:44.545 "message": "Invalid parameters" 00:20:44.545 } 00:20:44.545 15:49:42 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:20:44.545 15:49:42 -- common/autotest_common.sh@641 -- # es=1 00:20:44.546 15:49:42 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:20:44.546 15:49:42 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:20:44.546 15:49:42 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:20:44.546 15:49:42 -- host/auth.sh@121 -- # rpc_cmd bdev_nvme_get_controllers 00:20:44.546 15:49:42 -- host/auth.sh@121 -- # jq length 00:20:44.546 15:49:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:44.546 15:49:42 -- common/autotest_common.sh@10 -- # set +x 00:20:44.546 15:49:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:44.546 15:49:42 -- host/auth.sh@121 -- # (( 0 == 0 )) 00:20:44.546 15:49:42 -- host/auth.sh@124 -- # get_main_ns_ip 00:20:44.546 15:49:42 -- nvmf/common.sh@717 -- # local ip 00:20:44.546 15:49:42 -- nvmf/common.sh@718 -- # ip_candidates=() 00:20:44.546 15:49:42 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:20:44.546 15:49:42 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:20:44.546 15:49:42 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:20:44.546 15:49:42 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:20:44.546 15:49:42 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:20:44.546 15:49:42 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:20:44.546 15:49:42 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:20:44.546 15:49:42 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:20:44.546 15:49:42 -- host/auth.sh@124 -- # NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:20:44.546 15:49:42 -- common/autotest_common.sh@638 -- # local es=0 00:20:44.546 15:49:42 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:20:44.546 15:49:42 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:20:44.546 15:49:42 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:20:44.546 15:49:42 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:20:44.546 15:49:42 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:20:44.546 15:49:42 -- common/autotest_common.sh@641 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:20:44.546 15:49:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:44.546 15:49:42 -- common/autotest_common.sh@10 -- # set +x 00:20:44.546 request: 00:20:44.546 { 00:20:44.546 "name": "nvme0", 00:20:44.546 "trtype": "rdma", 00:20:44.546 "traddr": "192.168.100.8", 00:20:44.546 "hostnqn": "nqn.2024-02.io.spdk:host0", 00:20:44.546 "adrfam": "ipv4", 00:20:44.546 "trsvcid": "4420", 00:20:44.546 "subnqn": "nqn.2024-02.io.spdk:cnode0", 00:20:44.546 "dhchap_key": "key2", 00:20:44.546 "method": "bdev_nvme_attach_controller", 00:20:44.546 "req_id": 1 00:20:44.546 } 00:20:44.546 Got JSON-RPC error response 00:20:44.546 response: 00:20:44.546 { 00:20:44.546 "code": -32602, 00:20:44.546 "message": "Invalid parameters" 00:20:44.546 } 00:20:44.546 15:49:43 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:20:44.546 15:49:43 -- common/autotest_common.sh@641 -- # es=1 00:20:44.546 15:49:43 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:20:44.546 15:49:43 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:20:44.546 15:49:43 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:20:44.546 15:49:43 -- host/auth.sh@127 -- # rpc_cmd bdev_nvme_get_controllers 00:20:44.546 15:49:43 -- host/auth.sh@127 -- # jq length 00:20:44.546 15:49:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:44.546 15:49:43 -- common/autotest_common.sh@10 -- # set +x 00:20:44.546 15:49:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:44.546 15:49:43 -- host/auth.sh@127 -- # (( 0 == 0 )) 00:20:44.546 15:49:43 -- host/auth.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:20:44.546 15:49:43 -- host/auth.sh@130 -- # cleanup 00:20:44.546 15:49:43 -- host/auth.sh@24 -- # nvmftestfini 00:20:44.546 15:49:43 -- nvmf/common.sh@477 -- # nvmfcleanup 00:20:44.546 15:49:43 -- nvmf/common.sh@117 -- # sync 00:20:44.546 15:49:43 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:20:44.546 15:49:43 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:20:44.546 15:49:43 -- nvmf/common.sh@120 -- # set +e 00:20:44.546 15:49:43 -- nvmf/common.sh@121 -- # for i in {1..20} 00:20:44.546 15:49:43 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:20:44.546 rmmod nvme_rdma 00:20:44.803 rmmod nvme_fabrics 00:20:44.803 15:49:43 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:20:44.803 15:49:43 -- nvmf/common.sh@124 -- # set -e 00:20:44.803 15:49:43 -- nvmf/common.sh@125 -- # return 0 00:20:44.803 15:49:43 -- nvmf/common.sh@478 -- # '[' -n 3402908 ']' 00:20:44.803 15:49:43 -- nvmf/common.sh@479 -- # killprocess 3402908 00:20:44.803 15:49:43 -- common/autotest_common.sh@936 -- # '[' -z 3402908 ']' 00:20:44.803 15:49:43 -- common/autotest_common.sh@940 -- # kill -0 3402908 00:20:44.803 15:49:43 -- common/autotest_common.sh@941 -- # uname 00:20:44.803 15:49:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:44.803 15:49:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3402908 00:20:44.803 15:49:43 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:20:44.803 15:49:43 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:20:44.803 15:49:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3402908' 00:20:44.803 killing process with pid 3402908 00:20:44.803 15:49:43 -- common/autotest_common.sh@955 -- # kill 3402908 00:20:44.803 15:49:43 -- common/autotest_common.sh@960 -- # wait 3402908 00:20:45.060 15:49:43 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:20:45.060 15:49:43 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:20:45.060 15:49:43 -- host/auth.sh@25 -- # rm /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/allowed_hosts/nqn.2024-02.io.spdk:host0 00:20:45.060 15:49:43 -- host/auth.sh@26 -- # rmdir /sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 00:20:45.060 15:49:43 -- host/auth.sh@27 -- # clean_kernel_target 00:20:45.060 15:49:43 -- nvmf/common.sh@673 -- # [[ -e /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 ]] 00:20:45.060 15:49:43 -- nvmf/common.sh@675 -- # echo 0 00:20:45.060 15:49:43 -- nvmf/common.sh@677 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/nqn.2024-02.io.spdk:cnode0 00:20:45.060 15:49:43 -- nvmf/common.sh@678 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/namespaces/1 00:20:45.060 15:49:43 -- nvmf/common.sh@679 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:20:45.060 15:49:43 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:20:45.060 15:49:43 -- nvmf/common.sh@682 -- # modules=(/sys/module/nvmet/holders/*) 00:20:45.060 15:49:43 -- nvmf/common.sh@684 -- # modprobe -r nvmet_rdma nvmet 00:20:45.060 15:49:43 -- nvmf/common.sh@687 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:20:47.586 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:20:47.586 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:20:47.586 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:20:47.586 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:20:47.586 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:20:47.586 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:20:47.586 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:20:47.586 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:20:47.586 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:20:47.586 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:20:47.586 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:20:47.586 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:20:47.586 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:20:47.586 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:20:47.586 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:20:47.586 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:20:48.959 0000:5f:00.0 (8086 0a54): nvme -> vfio-pci 00:20:49.215 15:49:47 -- host/auth.sh@28 -- # rm -f /tmp/spdk.key-null.Zdx /tmp/spdk.key-null.CfQ /tmp/spdk.key-sha256.5s5 /tmp/spdk.key-sha384.Dk8 /tmp/spdk.key-sha512.uwZ /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/nvme-auth.log 00:20:49.215 15:49:47 -- host/auth.sh@31 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:20:51.738 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:20:51.738 0000:5f:00.0 (8086 0a54): Already using the vfio-pci driver 00:20:51.738 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:20:51.738 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:20:51.738 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:20:51.738 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:20:51.738 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:20:51.738 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:20:51.738 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:20:51.738 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:20:51.738 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:20:51.738 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:20:51.738 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:20:51.738 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:20:51.738 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:20:51.739 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:20:51.739 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:20:51.739 00:20:51.739 real 0m51.761s 00:20:51.739 user 0m47.606s 00:20:51.739 sys 0m11.604s 00:20:51.739 15:49:50 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:20:51.739 15:49:50 -- common/autotest_common.sh@10 -- # set +x 00:20:51.739 ************************************ 00:20:51.739 END TEST nvmf_auth 00:20:51.739 ************************************ 00:20:51.739 15:49:50 -- nvmf/nvmf.sh@104 -- # [[ rdma == \t\c\p ]] 00:20:51.739 15:49:50 -- nvmf/nvmf.sh@108 -- # [[ 0 -eq 1 ]] 00:20:51.739 15:49:50 -- nvmf/nvmf.sh@113 -- # [[ 0 -eq 1 ]] 00:20:51.739 15:49:50 -- nvmf/nvmf.sh@118 -- # [[ phy == phy ]] 00:20:51.739 15:49:50 -- nvmf/nvmf.sh@119 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=rdma 00:20:51.739 15:49:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:51.739 15:49:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:51.739 15:49:50 -- common/autotest_common.sh@10 -- # set +x 00:20:51.739 ************************************ 00:20:51.739 START TEST nvmf_bdevperf 00:20:51.739 ************************************ 00:20:51.739 15:49:50 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=rdma 00:20:51.739 * Looking for test storage... 00:20:51.739 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:20:51.739 15:49:50 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:20:51.739 15:49:50 -- nvmf/common.sh@7 -- # uname -s 00:20:51.739 15:49:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:51.739 15:49:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:51.739 15:49:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:51.739 15:49:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:51.739 15:49:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:51.739 15:49:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:51.739 15:49:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:51.739 15:49:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:51.739 15:49:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:51.739 15:49:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:51.739 15:49:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:20:51.739 15:49:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:20:51.739 15:49:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:51.739 15:49:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:51.739 15:49:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:51.739 15:49:50 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:20:51.739 15:49:50 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:20:51.739 15:49:50 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:51.739 15:49:50 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:51.739 15:49:50 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:51.739 15:49:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:51.739 15:49:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:51.739 15:49:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:51.739 15:49:50 -- paths/export.sh@5 -- # export PATH 00:20:51.739 15:49:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:51.739 15:49:50 -- nvmf/common.sh@47 -- # : 0 00:20:51.739 15:49:50 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:20:51.739 15:49:50 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:20:51.739 15:49:50 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:20:51.739 15:49:50 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:51.739 15:49:50 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:51.739 15:49:50 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:20:51.739 15:49:50 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:20:51.739 15:49:50 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:20:51.739 15:49:50 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:51.739 15:49:50 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:51.739 15:49:50 -- host/bdevperf.sh@24 -- # nvmftestinit 00:20:51.739 15:49:50 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:20:51.739 15:49:50 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:51.739 15:49:50 -- nvmf/common.sh@437 -- # prepare_net_devs 00:20:51.739 15:49:50 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:20:51.739 15:49:50 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:20:51.739 15:49:50 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:51.739 15:49:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:51.739 15:49:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:51.739 15:49:50 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:20:51.739 15:49:50 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:20:51.739 15:49:50 -- nvmf/common.sh@285 -- # xtrace_disable 00:20:51.739 15:49:50 -- common/autotest_common.sh@10 -- # set +x 00:20:56.998 15:49:55 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:56.998 15:49:55 -- nvmf/common.sh@291 -- # pci_devs=() 00:20:56.998 15:49:55 -- nvmf/common.sh@291 -- # local -a pci_devs 00:20:56.998 15:49:55 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:20:56.998 15:49:55 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:20:56.998 15:49:55 -- nvmf/common.sh@293 -- # pci_drivers=() 00:20:56.998 15:49:55 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:20:56.998 15:49:55 -- nvmf/common.sh@295 -- # net_devs=() 00:20:56.998 15:49:55 -- nvmf/common.sh@295 -- # local -ga net_devs 00:20:56.998 15:49:55 -- nvmf/common.sh@296 -- # e810=() 00:20:56.998 15:49:55 -- nvmf/common.sh@296 -- # local -ga e810 00:20:56.998 15:49:55 -- nvmf/common.sh@297 -- # x722=() 00:20:56.998 15:49:55 -- nvmf/common.sh@297 -- # local -ga x722 00:20:56.998 15:49:55 -- nvmf/common.sh@298 -- # mlx=() 00:20:56.998 15:49:55 -- nvmf/common.sh@298 -- # local -ga mlx 00:20:56.998 15:49:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:56.998 15:49:55 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:56.998 15:49:55 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:56.998 15:49:55 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:56.998 15:49:55 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:56.998 15:49:55 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:56.998 15:49:55 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:56.998 15:49:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:56.998 15:49:55 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:56.998 15:49:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:56.998 15:49:55 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:56.998 15:49:55 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:20:56.998 15:49:55 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:20:56.998 15:49:55 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:20:56.998 15:49:55 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:20:56.998 15:49:55 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:20:56.998 15:49:55 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:20:56.998 15:49:55 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:20:56.998 15:49:55 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:56.998 15:49:55 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:20:56.998 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:20:56.998 15:49:55 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:20:56.998 15:49:55 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:20:56.998 15:49:55 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:20:56.998 15:49:55 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:20:56.998 15:49:55 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:20:56.998 15:49:55 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:20:56.998 15:49:55 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:56.998 15:49:55 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:20:56.998 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:20:56.998 15:49:55 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:20:56.998 15:49:55 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:20:56.998 15:49:55 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:20:56.998 15:49:55 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:20:56.998 15:49:55 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:20:56.998 15:49:55 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:20:56.998 15:49:55 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:20:56.998 15:49:55 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:20:56.998 15:49:55 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:56.998 15:49:55 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:56.998 15:49:55 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:56.998 15:49:55 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:56.998 15:49:55 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:20:56.998 Found net devices under 0000:da:00.0: mlx_0_0 00:20:56.998 15:49:55 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:56.998 15:49:55 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:56.998 15:49:55 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:56.998 15:49:55 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:56.998 15:49:55 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:56.998 15:49:55 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:20:56.998 Found net devices under 0000:da:00.1: mlx_0_1 00:20:56.998 15:49:55 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:56.998 15:49:55 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:20:56.998 15:49:55 -- nvmf/common.sh@403 -- # is_hw=yes 00:20:56.998 15:49:55 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:20:56.998 15:49:55 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:20:56.998 15:49:55 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:20:56.998 15:49:55 -- nvmf/common.sh@409 -- # rdma_device_init 00:20:56.998 15:49:55 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:20:56.998 15:49:55 -- nvmf/common.sh@58 -- # uname 00:20:56.998 15:49:55 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:20:56.998 15:49:55 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:20:56.998 15:49:55 -- nvmf/common.sh@63 -- # modprobe ib_core 00:20:56.998 15:49:55 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:20:56.998 15:49:55 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:20:56.998 15:49:55 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:20:56.998 15:49:55 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:20:56.998 15:49:55 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:20:56.998 15:49:55 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:20:56.998 15:49:55 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:20:56.998 15:49:55 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:20:56.998 15:49:55 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:20:56.998 15:49:55 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:20:56.998 15:49:55 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:20:56.998 15:49:55 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:20:56.998 15:49:55 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:20:56.998 15:49:55 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:56.998 15:49:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:56.998 15:49:55 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:20:56.998 15:49:55 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:20:56.998 15:49:55 -- nvmf/common.sh@105 -- # continue 2 00:20:56.999 15:49:55 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:56.999 15:49:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:56.999 15:49:55 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:20:56.999 15:49:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:56.999 15:49:55 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:20:56.999 15:49:55 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:20:56.999 15:49:55 -- nvmf/common.sh@105 -- # continue 2 00:20:56.999 15:49:55 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:20:56.999 15:49:55 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:20:56.999 15:49:55 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:20:56.999 15:49:55 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:20:56.999 15:49:55 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:56.999 15:49:55 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:56.999 15:49:55 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:20:56.999 15:49:55 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:20:56.999 15:49:55 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:20:56.999 122: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:20:56.999 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:20:56.999 altname enp218s0f0np0 00:20:56.999 altname ens818f0np0 00:20:56.999 inet 192.168.100.8/24 scope global mlx_0_0 00:20:56.999 valid_lft forever preferred_lft forever 00:20:56.999 15:49:55 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:20:56.999 15:49:55 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:20:56.999 15:49:55 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:20:56.999 15:49:55 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:20:56.999 15:49:55 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:56.999 15:49:55 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:56.999 15:49:55 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:20:56.999 15:49:55 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:20:56.999 15:49:55 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:20:56.999 123: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:20:56.999 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:20:56.999 altname enp218s0f1np1 00:20:56.999 altname ens818f1np1 00:20:56.999 inet 192.168.100.9/24 scope global mlx_0_1 00:20:56.999 valid_lft forever preferred_lft forever 00:20:56.999 15:49:55 -- nvmf/common.sh@411 -- # return 0 00:20:56.999 15:49:55 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:20:56.999 15:49:55 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:20:56.999 15:49:55 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:20:56.999 15:49:55 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:20:56.999 15:49:55 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:20:56.999 15:49:55 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:20:56.999 15:49:55 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:20:56.999 15:49:55 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:20:56.999 15:49:55 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:20:57.256 15:49:55 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:20:57.256 15:49:55 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:57.256 15:49:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:57.256 15:49:55 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:20:57.256 15:49:55 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:20:57.256 15:49:55 -- nvmf/common.sh@105 -- # continue 2 00:20:57.256 15:49:55 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:57.256 15:49:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:57.256 15:49:55 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:20:57.256 15:49:55 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:57.257 15:49:55 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:20:57.257 15:49:55 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:20:57.257 15:49:55 -- nvmf/common.sh@105 -- # continue 2 00:20:57.257 15:49:55 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:20:57.257 15:49:55 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:20:57.257 15:49:55 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:20:57.257 15:49:55 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:20:57.257 15:49:55 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:57.257 15:49:55 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:57.257 15:49:55 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:20:57.257 15:49:55 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:20:57.257 15:49:55 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:20:57.257 15:49:55 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:20:57.257 15:49:55 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:57.257 15:49:55 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:57.257 15:49:55 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:20:57.257 192.168.100.9' 00:20:57.257 15:49:55 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:20:57.257 192.168.100.9' 00:20:57.257 15:49:55 -- nvmf/common.sh@446 -- # head -n 1 00:20:57.257 15:49:55 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:20:57.257 15:49:55 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:20:57.257 192.168.100.9' 00:20:57.257 15:49:55 -- nvmf/common.sh@447 -- # tail -n +2 00:20:57.257 15:49:55 -- nvmf/common.sh@447 -- # head -n 1 00:20:57.257 15:49:55 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:20:57.257 15:49:55 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:20:57.257 15:49:55 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:20:57.257 15:49:55 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:20:57.257 15:49:55 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:20:57.257 15:49:55 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:20:57.257 15:49:55 -- host/bdevperf.sh@25 -- # tgt_init 00:20:57.257 15:49:55 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:20:57.257 15:49:55 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:20:57.257 15:49:55 -- common/autotest_common.sh@710 -- # xtrace_disable 00:20:57.257 15:49:55 -- common/autotest_common.sh@10 -- # set +x 00:20:57.257 15:49:55 -- nvmf/common.sh@470 -- # nvmfpid=3416304 00:20:57.257 15:49:55 -- nvmf/common.sh@471 -- # waitforlisten 3416304 00:20:57.257 15:49:55 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:20:57.257 15:49:55 -- common/autotest_common.sh@817 -- # '[' -z 3416304 ']' 00:20:57.257 15:49:55 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:57.257 15:49:55 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:57.257 15:49:55 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:57.257 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:57.257 15:49:55 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:57.257 15:49:55 -- common/autotest_common.sh@10 -- # set +x 00:20:57.257 [2024-04-26 15:49:55.720842] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:20:57.257 [2024-04-26 15:49:55.720882] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:57.257 EAL: No free 2048 kB hugepages reported on node 1 00:20:57.257 [2024-04-26 15:49:55.776897] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:20:57.257 [2024-04-26 15:49:55.854256] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:57.257 [2024-04-26 15:49:55.854290] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:57.257 [2024-04-26 15:49:55.854297] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:20:57.257 [2024-04-26 15:49:55.854303] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:20:57.257 [2024-04-26 15:49:55.854308] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:57.257 [2024-04-26 15:49:55.854407] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:57.257 [2024-04-26 15:49:55.854515] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:57.257 [2024-04-26 15:49:55.854516] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:58.188 15:49:56 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:58.188 15:49:56 -- common/autotest_common.sh@850 -- # return 0 00:20:58.188 15:49:56 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:20:58.188 15:49:56 -- common/autotest_common.sh@716 -- # xtrace_disable 00:20:58.188 15:49:56 -- common/autotest_common.sh@10 -- # set +x 00:20:58.188 15:49:56 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:58.188 15:49:56 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:20:58.188 15:49:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:58.188 15:49:56 -- common/autotest_common.sh@10 -- # set +x 00:20:58.188 [2024-04-26 15:49:56.578755] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xbbf920/0xbc3e10) succeed. 00:20:58.188 [2024-04-26 15:49:56.588992] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xbc0ec0/0xc054a0) succeed. 00:20:58.188 15:49:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:58.188 15:49:56 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:20:58.188 15:49:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:58.188 15:49:56 -- common/autotest_common.sh@10 -- # set +x 00:20:58.188 Malloc0 00:20:58.188 15:49:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:58.188 15:49:56 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:20:58.188 15:49:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:58.188 15:49:56 -- common/autotest_common.sh@10 -- # set +x 00:20:58.188 15:49:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:58.188 15:49:56 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:20:58.188 15:49:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:58.188 15:49:56 -- common/autotest_common.sh@10 -- # set +x 00:20:58.188 15:49:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:58.188 15:49:56 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:20:58.188 15:49:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:58.188 15:49:56 -- common/autotest_common.sh@10 -- # set +x 00:20:58.188 [2024-04-26 15:49:56.735016] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:20:58.188 15:49:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:58.188 15:49:56 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:20:58.188 15:49:56 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:20:58.188 15:49:56 -- nvmf/common.sh@521 -- # config=() 00:20:58.188 15:49:56 -- nvmf/common.sh@521 -- # local subsystem config 00:20:58.188 15:49:56 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:58.188 15:49:56 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:58.188 { 00:20:58.188 "params": { 00:20:58.188 "name": "Nvme$subsystem", 00:20:58.188 "trtype": "$TEST_TRANSPORT", 00:20:58.188 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:58.188 "adrfam": "ipv4", 00:20:58.188 "trsvcid": "$NVMF_PORT", 00:20:58.188 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:58.188 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:58.188 "hdgst": ${hdgst:-false}, 00:20:58.188 "ddgst": ${ddgst:-false} 00:20:58.188 }, 00:20:58.188 "method": "bdev_nvme_attach_controller" 00:20:58.188 } 00:20:58.188 EOF 00:20:58.188 )") 00:20:58.188 15:49:56 -- nvmf/common.sh@543 -- # cat 00:20:58.188 15:49:56 -- nvmf/common.sh@545 -- # jq . 00:20:58.188 15:49:56 -- nvmf/common.sh@546 -- # IFS=, 00:20:58.188 15:49:56 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:20:58.188 "params": { 00:20:58.188 "name": "Nvme1", 00:20:58.188 "trtype": "rdma", 00:20:58.188 "traddr": "192.168.100.8", 00:20:58.188 "adrfam": "ipv4", 00:20:58.188 "trsvcid": "4420", 00:20:58.188 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:58.188 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:58.188 "hdgst": false, 00:20:58.188 "ddgst": false 00:20:58.188 }, 00:20:58.188 "method": "bdev_nvme_attach_controller" 00:20:58.188 }' 00:20:58.188 [2024-04-26 15:49:56.784432] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:20:58.188 [2024-04-26 15:49:56.784478] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3416551 ] 00:20:58.445 EAL: No free 2048 kB hugepages reported on node 1 00:20:58.445 [2024-04-26 15:49:56.839621] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:58.445 [2024-04-26 15:49:56.911280] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:58.774 Running I/O for 1 seconds... 00:20:59.757 00:20:59.757 Latency(us) 00:20:59.757 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:59.757 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:20:59.757 Verification LBA range: start 0x0 length 0x4000 00:20:59.757 Nvme1n1 : 1.00 18250.56 71.29 0.00 0.00 6968.99 748.98 11983.73 00:20:59.757 =================================================================================================================== 00:20:59.757 Total : 18250.56 71.29 0.00 0.00 6968.99 748.98 11983.73 00:20:59.757 15:49:58 -- host/bdevperf.sh@30 -- # bdevperfpid=3416794 00:20:59.757 15:49:58 -- host/bdevperf.sh@32 -- # sleep 3 00:20:59.757 15:49:58 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:20:59.757 15:49:58 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:20:59.757 15:49:58 -- nvmf/common.sh@521 -- # config=() 00:20:59.757 15:49:58 -- nvmf/common.sh@521 -- # local subsystem config 00:20:59.757 15:49:58 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:20:59.757 15:49:58 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:20:59.757 { 00:20:59.757 "params": { 00:20:59.757 "name": "Nvme$subsystem", 00:20:59.757 "trtype": "$TEST_TRANSPORT", 00:20:59.757 "traddr": "$NVMF_FIRST_TARGET_IP", 00:20:59.757 "adrfam": "ipv4", 00:20:59.757 "trsvcid": "$NVMF_PORT", 00:20:59.757 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:20:59.757 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:20:59.757 "hdgst": ${hdgst:-false}, 00:20:59.757 "ddgst": ${ddgst:-false} 00:20:59.757 }, 00:20:59.757 "method": "bdev_nvme_attach_controller" 00:20:59.757 } 00:20:59.757 EOF 00:20:59.757 )") 00:20:59.757 15:49:58 -- nvmf/common.sh@543 -- # cat 00:20:59.757 15:49:58 -- nvmf/common.sh@545 -- # jq . 00:20:59.757 15:49:58 -- nvmf/common.sh@546 -- # IFS=, 00:20:59.757 15:49:58 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:20:59.757 "params": { 00:20:59.757 "name": "Nvme1", 00:20:59.757 "trtype": "rdma", 00:20:59.757 "traddr": "192.168.100.8", 00:20:59.757 "adrfam": "ipv4", 00:20:59.757 "trsvcid": "4420", 00:20:59.757 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:59.757 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:59.757 "hdgst": false, 00:20:59.757 "ddgst": false 00:20:59.757 }, 00:20:59.757 "method": "bdev_nvme_attach_controller" 00:20:59.757 }' 00:21:00.013 [2024-04-26 15:49:58.371594] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:21:00.013 [2024-04-26 15:49:58.371643] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3416794 ] 00:21:00.013 EAL: No free 2048 kB hugepages reported on node 1 00:21:00.013 [2024-04-26 15:49:58.426060] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:00.013 [2024-04-26 15:49:58.493156] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:00.270 Running I/O for 15 seconds... 00:21:02.793 15:50:01 -- host/bdevperf.sh@33 -- # kill -9 3416304 00:21:02.793 15:50:01 -- host/bdevperf.sh@35 -- # sleep 3 00:21:04.165 [2024-04-26 15:50:02.360897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:128728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 15:50:02.360939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 15:50:02.360955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:128736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 15:50:02.360961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 15:50:02.360970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:128744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 15:50:02.360976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 15:50:02.360983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:128752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 15:50:02.360989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 15:50:02.360996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:128760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 15:50:02.361002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 15:50:02.361009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:128768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 15:50:02.361015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 15:50:02.361023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:128776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 15:50:02.361028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 15:50:02.361036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:128784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 15:50:02.361042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 15:50:02.361049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:128792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 15:50:02.361055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 15:50:02.361062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:128800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 15:50:02.361067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 15:50:02.361074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:128808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 15:50:02.361080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 15:50:02.361088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:128816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 15:50:02.361094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 15:50:02.361101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:128824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 15:50:02.361108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:128832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 15:50:02.361121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:128840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 15:50:02.361134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:128848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 15:50:02.361150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:128856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 15:50:02.361163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:128864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 15:50:02.361193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:128872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 15:50:02.361206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:128880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 15:50:02.361220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:128888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 15:50:02.361234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:128896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 15:50:02.361248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:128904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 15:50:02.361261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:128912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 15:50:02.361275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:128920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 15:50:02.361289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:128928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 15:50:02.361305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:128936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 15:50:02.361320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:128944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 15:50:02.361334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:128952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 15:50:02.361348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:128960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 15:50:02.361361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:128968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 15:50:02.361375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:128976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 15:50:02.361388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:128984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 15:50:02.361402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:128992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 15:50:02.361417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:129000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 15:50:02.361431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:129008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 15:50:02.361444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:129016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 15:50:02.361458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:128000 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075fe000 len:0x1000 key:0x187000 00:21:04.166 [2024-04-26 15:50:02.361474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:128008 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075fc000 len:0x1000 key:0x187000 00:21:04.166 [2024-04-26 15:50:02.361489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:128016 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075fa000 len:0x1000 key:0x187000 00:21:04.166 [2024-04-26 15:50:02.361503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:128024 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f8000 len:0x1000 key:0x187000 00:21:04.166 [2024-04-26 15:50:02.361517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:128032 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f6000 len:0x1000 key:0x187000 00:21:04.166 [2024-04-26 15:50:02.361531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:128040 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f4000 len:0x1000 key:0x187000 00:21:04.166 [2024-04-26 15:50:02.361545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:128048 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f2000 len:0x1000 key:0x187000 00:21:04.166 [2024-04-26 15:50:02.361559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:128056 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f0000 len:0x1000 key:0x187000 00:21:04.166 [2024-04-26 15:50:02.361573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:128064 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ee000 len:0x1000 key:0x187000 00:21:04.166 [2024-04-26 15:50:02.361587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:128072 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ec000 len:0x1000 key:0x187000 00:21:04.166 [2024-04-26 15:50:02.361601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:128080 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ea000 len:0x1000 key:0x187000 00:21:04.166 [2024-04-26 15:50:02.361615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:128088 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e8000 len:0x1000 key:0x187000 00:21:04.166 [2024-04-26 15:50:02.361631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:128096 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e6000 len:0x1000 key:0x187000 00:21:04.166 [2024-04-26 15:50:02.361645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 15:50:02.361653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:128104 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e4000 len:0x1000 key:0x187000 00:21:04.166 [2024-04-26 15:50:02.361659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.361666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:128112 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e2000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.361672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.361680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:128120 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e0000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.361686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.361693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:128128 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075de000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.361699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.361707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:128136 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075dc000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.361713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.361721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:128144 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075da000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.361727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.361734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:128152 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d8000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.361740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.361748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:128160 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d6000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.361754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.361763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:128168 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d4000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.361770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.361777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:128176 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d2000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.361785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.361792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:128184 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d0000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.361798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.361806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:128192 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ce000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.361813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.361821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:128200 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075cc000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.361827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.361835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:128208 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ca000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.361841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.361848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:128216 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c8000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.361854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.361862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:128224 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c6000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.361868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.361876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:128232 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c4000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.361882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.361890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:128240 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c2000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.361897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.361904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:128248 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c0000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.361910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.361918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:128256 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075be000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.361925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.361933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:128264 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075bc000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.361939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.361948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:128272 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ba000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.361954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.361961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:128280 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b8000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.361968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.361975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:128288 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b6000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.361981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.361989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:128296 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b4000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.361995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.362002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:128304 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b2000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.362008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.362016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:128312 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b0000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.362022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.362030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:128320 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ae000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.362037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.362045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:128328 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ac000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.362051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.362058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:128336 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075aa000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.362064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.362073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:128344 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a8000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.362079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.362087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:128352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a6000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.362093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.362102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:128360 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a4000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.362108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.362116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:128368 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a2000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.362122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.362130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:128376 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a0000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.362136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.362147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:128384 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759e000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.362154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.362162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:128392 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759c000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.362169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.362176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:128400 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759a000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.362183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.362190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:128408 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007598000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.362197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.362205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:128416 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007596000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.362211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.362219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:128424 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007594000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.362225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.362232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:128432 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007592000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.362238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.362246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:128440 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007590000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.362252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.362261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:128448 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758e000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.362268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.362275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:128456 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758c000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.362281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.362289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:128464 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758a000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.362295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.362304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:128472 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007588000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.362311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.362319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:128480 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007586000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.362325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.362333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:128488 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007584000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.362339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.362346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:128496 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007582000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.362353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.362360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:128504 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007580000 len:0x1000 key:0x187000 00:21:04.167 [2024-04-26 15:50:02.362366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 15:50:02.362374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:128512 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757e000 len:0x1000 key:0x187000 00:21:04.168 [2024-04-26 15:50:02.362381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.168 [2024-04-26 15:50:02.362388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:128520 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757c000 len:0x1000 key:0x187000 00:21:04.168 [2024-04-26 15:50:02.362394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.168 [2024-04-26 15:50:02.362402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:128528 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757a000 len:0x1000 key:0x187000 00:21:04.168 [2024-04-26 15:50:02.362408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.168 [2024-04-26 15:50:02.362416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:128536 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007578000 len:0x1000 key:0x187000 00:21:04.168 [2024-04-26 15:50:02.362423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.168 [2024-04-26 15:50:02.362431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:128544 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007576000 len:0x1000 key:0x187000 00:21:04.168 [2024-04-26 15:50:02.362437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.168 [2024-04-26 15:50:02.362444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:128552 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007574000 len:0x1000 key:0x187000 00:21:04.168 [2024-04-26 15:50:02.362450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.168 [2024-04-26 15:50:02.362458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:128560 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007572000 len:0x1000 key:0x187000 00:21:04.168 [2024-04-26 15:50:02.362465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.168 [2024-04-26 15:50:02.362472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:128568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007570000 len:0x1000 key:0x187000 00:21:04.168 [2024-04-26 15:50:02.362478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.168 [2024-04-26 15:50:02.362486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:128576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756e000 len:0x1000 key:0x187000 00:21:04.168 [2024-04-26 15:50:02.362492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.168 [2024-04-26 15:50:02.362500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:128584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756c000 len:0x1000 key:0x187000 00:21:04.168 [2024-04-26 15:50:02.362506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.168 [2024-04-26 15:50:02.362514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:128592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756a000 len:0x1000 key:0x187000 00:21:04.168 [2024-04-26 15:50:02.362520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.168 [2024-04-26 15:50:02.362528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:128600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007568000 len:0x1000 key:0x187000 00:21:04.168 [2024-04-26 15:50:02.362534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.168 [2024-04-26 15:50:02.362541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:128608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007566000 len:0x1000 key:0x187000 00:21:04.168 [2024-04-26 15:50:02.362547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.168 [2024-04-26 15:50:02.362555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:128616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007564000 len:0x1000 key:0x187000 00:21:04.168 [2024-04-26 15:50:02.362561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.168 [2024-04-26 15:50:02.362569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:128624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007562000 len:0x1000 key:0x187000 00:21:04.168 [2024-04-26 15:50:02.362576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.168 [2024-04-26 15:50:02.362584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:128632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007560000 len:0x1000 key:0x187000 00:21:04.168 [2024-04-26 15:50:02.362590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.168 [2024-04-26 15:50:02.362597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:128640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755e000 len:0x1000 key:0x187000 00:21:04.168 [2024-04-26 15:50:02.362603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.168 [2024-04-26 15:50:02.362611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:128648 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755c000 len:0x1000 key:0x187000 00:21:04.168 [2024-04-26 15:50:02.362618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.168 [2024-04-26 15:50:02.362626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:128656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755a000 len:0x1000 key:0x187000 00:21:04.168 [2024-04-26 15:50:02.362632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.168 [2024-04-26 15:50:02.362640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:128664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007558000 len:0x1000 key:0x187000 00:21:04.168 [2024-04-26 15:50:02.362646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.168 [2024-04-26 15:50:02.362653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:128672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007556000 len:0x1000 key:0x187000 00:21:04.168 [2024-04-26 15:50:02.362659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.168 [2024-04-26 15:50:02.371601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:128680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007554000 len:0x1000 key:0x187000 00:21:04.168 [2024-04-26 15:50:02.371609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.168 [2024-04-26 15:50:02.371618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:128688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007552000 len:0x1000 key:0x187000 00:21:04.168 [2024-04-26 15:50:02.371625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.168 [2024-04-26 15:50:02.371632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:128696 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007550000 len:0x1000 key:0x187000 00:21:04.168 [2024-04-26 15:50:02.371638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.168 [2024-04-26 15:50:02.371646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:128704 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754e000 len:0x1000 key:0x187000 00:21:04.168 [2024-04-26 15:50:02.371652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.168 [2024-04-26 15:50:02.371659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:128712 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754c000 len:0x1000 key:0x187000 00:21:04.168 [2024-04-26 15:50:02.371665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32765 cdw0:3eff200 sqhd:9a20 p:0 m:0 dnr:0 00:21:04.168 [2024-04-26 15:50:02.373675] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:21:04.168 [2024-04-26 15:50:02.373687] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:21:04.168 [2024-04-26 15:50:02.373693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:128720 len:8 PRP1 0x0 PRP2 0x0 00:21:04.168 [2024-04-26 15:50:02.373699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:04.168 [2024-04-26 15:50:02.373739] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192e4a00 was disconnected and freed. reset controller. 00:21:04.168 [2024-04-26 15:50:02.373764] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:21:04.168 [2024-04-26 15:50:02.373772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:04.169 [2024-04-26 15:50:02.373779] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:21:04.169 [2024-04-26 15:50:02.373785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:04.169 [2024-04-26 15:50:02.373791] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:21:04.169 [2024-04-26 15:50:02.373797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:04.169 [2024-04-26 15:50:02.373804] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:21:04.169 [2024-04-26 15:50:02.373810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:04.169 [2024-04-26 15:50:02.390637] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:21:04.169 [2024-04-26 15:50:02.390681] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:04.169 [2024-04-26 15:50:02.390703] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:21:04.169 [2024-04-26 15:50:02.394078] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:04.169 [2024-04-26 15:50:02.397366] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:21:04.169 [2024-04-26 15:50:02.397391] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:21:04.169 [2024-04-26 15:50:02.397401] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:21:05.101 [2024-04-26 15:50:03.401514] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:21:05.101 [2024-04-26 15:50:03.401538] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:05.101 [2024-04-26 15:50:03.401714] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:05.101 [2024-04-26 15:50:03.401722] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:05.101 [2024-04-26 15:50:03.401730] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:21:05.101 [2024-04-26 15:50:03.404480] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:05.101 [2024-04-26 15:50:03.409265] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:05.101 [2024-04-26 15:50:03.411862] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:21:05.101 [2024-04-26 15:50:03.411885] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:21:05.101 [2024-04-26 15:50:03.411891] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:21:06.033 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 3416304 Killed "${NVMF_APP[@]}" "$@" 00:21:06.033 15:50:04 -- host/bdevperf.sh@36 -- # tgt_init 00:21:06.033 15:50:04 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:21:06.033 15:50:04 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:21:06.033 15:50:04 -- common/autotest_common.sh@710 -- # xtrace_disable 00:21:06.033 15:50:04 -- common/autotest_common.sh@10 -- # set +x 00:21:06.033 15:50:04 -- nvmf/common.sh@470 -- # nvmfpid=3417721 00:21:06.033 15:50:04 -- nvmf/common.sh@471 -- # waitforlisten 3417721 00:21:06.033 15:50:04 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:21:06.033 15:50:04 -- common/autotest_common.sh@817 -- # '[' -z 3417721 ']' 00:21:06.033 15:50:04 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:06.033 15:50:04 -- common/autotest_common.sh@822 -- # local max_retries=100 00:21:06.033 15:50:04 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:06.033 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:06.033 15:50:04 -- common/autotest_common.sh@826 -- # xtrace_disable 00:21:06.033 15:50:04 -- common/autotest_common.sh@10 -- # set +x 00:21:06.033 [2024-04-26 15:50:04.386482] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:21:06.033 [2024-04-26 15:50:04.386525] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:06.033 EAL: No free 2048 kB hugepages reported on node 1 00:21:06.033 [2024-04-26 15:50:04.415912] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:21:06.033 [2024-04-26 15:50:04.415932] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:06.033 [2024-04-26 15:50:04.416122] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:06.033 [2024-04-26 15:50:04.416130] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:06.033 [2024-04-26 15:50:04.416137] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:21:06.033 [2024-04-26 15:50:04.418862] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:06.033 [2024-04-26 15:50:04.423701] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:06.033 [2024-04-26 15:50:04.426166] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:21:06.033 [2024-04-26 15:50:04.426201] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:21:06.033 [2024-04-26 15:50:04.426207] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:21:06.033 [2024-04-26 15:50:04.442399] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:21:06.033 [2024-04-26 15:50:04.513104] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:06.033 [2024-04-26 15:50:04.513146] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:06.033 [2024-04-26 15:50:04.513153] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:21:06.033 [2024-04-26 15:50:04.513159] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:21:06.033 [2024-04-26 15:50:04.513164] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:06.033 [2024-04-26 15:50:04.513201] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:06.033 [2024-04-26 15:50:04.513287] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:06.033 [2024-04-26 15:50:04.513288] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:06.596 15:50:05 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:21:06.596 15:50:05 -- common/autotest_common.sh@850 -- # return 0 00:21:06.596 15:50:05 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:21:06.596 15:50:05 -- common/autotest_common.sh@716 -- # xtrace_disable 00:21:06.596 15:50:05 -- common/autotest_common.sh@10 -- # set +x 00:21:06.852 15:50:05 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:06.852 15:50:05 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:21:06.852 15:50:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:06.852 15:50:05 -- common/autotest_common.sh@10 -- # set +x 00:21:06.852 [2024-04-26 15:50:05.251397] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x17c9920/0x17cde10) succeed. 00:21:06.852 [2024-04-26 15:50:05.261462] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x17caec0/0x180f4a0) succeed. 00:21:06.852 15:50:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:06.852 15:50:05 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:21:06.852 15:50:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:06.852 15:50:05 -- common/autotest_common.sh@10 -- # set +x 00:21:06.852 Malloc0 00:21:06.852 15:50:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:06.852 15:50:05 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:06.852 15:50:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:06.852 15:50:05 -- common/autotest_common.sh@10 -- # set +x 00:21:06.852 15:50:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:06.852 15:50:05 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:21:06.852 15:50:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:06.852 15:50:05 -- common/autotest_common.sh@10 -- # set +x 00:21:06.852 15:50:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:06.852 15:50:05 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:21:06.852 15:50:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:06.852 15:50:05 -- common/autotest_common.sh@10 -- # set +x 00:21:06.852 [2024-04-26 15:50:05.409154] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:21:06.852 15:50:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:06.852 15:50:05 -- host/bdevperf.sh@38 -- # wait 3416794 00:21:06.852 [2024-04-26 15:50:05.430179] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:21:06.852 [2024-04-26 15:50:05.430203] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:06.852 [2024-04-26 15:50:05.430380] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:21:06.852 [2024-04-26 15:50:05.430388] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:21:06.852 [2024-04-26 15:50:05.430396] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:21:06.852 [2024-04-26 15:50:05.433119] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:21:06.852 [2024-04-26 15:50:05.436826] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:07.108 [2024-04-26 15:50:05.483278] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:21:15.214 00:21:15.214 Latency(us) 00:21:15.214 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:15.214 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:21:15.214 Verification LBA range: start 0x0 length 0x4000 00:21:15.214 Nvme1n1 : 15.01 13258.74 51.79 10386.92 0.00 5393.35 358.89 1062557.01 00:21:15.214 =================================================================================================================== 00:21:15.214 Total : 13258.74 51.79 10386.92 0.00 5393.35 358.89 1062557.01 00:21:15.471 15:50:13 -- host/bdevperf.sh@39 -- # sync 00:21:15.471 15:50:13 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:15.471 15:50:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:15.471 15:50:13 -- common/autotest_common.sh@10 -- # set +x 00:21:15.471 15:50:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:15.471 15:50:13 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:21:15.471 15:50:13 -- host/bdevperf.sh@44 -- # nvmftestfini 00:21:15.471 15:50:13 -- nvmf/common.sh@477 -- # nvmfcleanup 00:21:15.471 15:50:13 -- nvmf/common.sh@117 -- # sync 00:21:15.471 15:50:13 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:21:15.471 15:50:13 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:21:15.471 15:50:13 -- nvmf/common.sh@120 -- # set +e 00:21:15.471 15:50:13 -- nvmf/common.sh@121 -- # for i in {1..20} 00:21:15.471 15:50:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:21:15.471 rmmod nvme_rdma 00:21:15.471 rmmod nvme_fabrics 00:21:15.471 15:50:14 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:21:15.471 15:50:14 -- nvmf/common.sh@124 -- # set -e 00:21:15.471 15:50:14 -- nvmf/common.sh@125 -- # return 0 00:21:15.471 15:50:14 -- nvmf/common.sh@478 -- # '[' -n 3417721 ']' 00:21:15.471 15:50:14 -- nvmf/common.sh@479 -- # killprocess 3417721 00:21:15.471 15:50:14 -- common/autotest_common.sh@936 -- # '[' -z 3417721 ']' 00:21:15.471 15:50:14 -- common/autotest_common.sh@940 -- # kill -0 3417721 00:21:15.471 15:50:14 -- common/autotest_common.sh@941 -- # uname 00:21:15.471 15:50:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:15.471 15:50:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3417721 00:21:15.471 15:50:14 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:15.471 15:50:14 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:15.471 15:50:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3417721' 00:21:15.471 killing process with pid 3417721 00:21:15.471 15:50:14 -- common/autotest_common.sh@955 -- # kill 3417721 00:21:15.471 15:50:14 -- common/autotest_common.sh@960 -- # wait 3417721 00:21:15.729 [2024-04-26 15:50:14.133351] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:21:15.986 15:50:14 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:21:15.986 15:50:14 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:21:15.986 00:21:15.986 real 0m24.154s 00:21:15.986 user 1m4.380s 00:21:15.986 sys 0m5.065s 00:21:15.986 15:50:14 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:21:15.986 15:50:14 -- common/autotest_common.sh@10 -- # set +x 00:21:15.986 ************************************ 00:21:15.986 END TEST nvmf_bdevperf 00:21:15.986 ************************************ 00:21:15.986 15:50:14 -- nvmf/nvmf.sh@120 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=rdma 00:21:15.986 15:50:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:15.986 15:50:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:15.986 15:50:14 -- common/autotest_common.sh@10 -- # set +x 00:21:15.986 ************************************ 00:21:15.986 START TEST nvmf_target_disconnect 00:21:15.986 ************************************ 00:21:15.986 15:50:14 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=rdma 00:21:16.244 * Looking for test storage... 00:21:16.244 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:21:16.244 15:50:14 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:21:16.244 15:50:14 -- nvmf/common.sh@7 -- # uname -s 00:21:16.244 15:50:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:16.244 15:50:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:16.244 15:50:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:16.244 15:50:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:16.244 15:50:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:16.244 15:50:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:16.244 15:50:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:16.244 15:50:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:16.244 15:50:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:16.244 15:50:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:16.244 15:50:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:21:16.244 15:50:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:21:16.244 15:50:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:16.244 15:50:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:16.244 15:50:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:16.244 15:50:14 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:16.244 15:50:14 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:21:16.244 15:50:14 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:16.244 15:50:14 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:16.244 15:50:14 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:16.244 15:50:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:16.244 15:50:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:16.244 15:50:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:16.244 15:50:14 -- paths/export.sh@5 -- # export PATH 00:21:16.244 15:50:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:16.244 15:50:14 -- nvmf/common.sh@47 -- # : 0 00:21:16.244 15:50:14 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:21:16.244 15:50:14 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:21:16.244 15:50:14 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:16.244 15:50:14 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:16.244 15:50:14 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:16.244 15:50:14 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:21:16.244 15:50:14 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:21:16.244 15:50:14 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:21:16.244 15:50:14 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme 00:21:16.244 15:50:14 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:21:16.244 15:50:14 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:21:16.244 15:50:14 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:21:16.244 15:50:14 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:21:16.244 15:50:14 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:16.244 15:50:14 -- nvmf/common.sh@437 -- # prepare_net_devs 00:21:16.244 15:50:14 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:21:16.244 15:50:14 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:21:16.244 15:50:14 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:16.244 15:50:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:16.244 15:50:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:16.244 15:50:14 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:21:16.244 15:50:14 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:21:16.244 15:50:14 -- nvmf/common.sh@285 -- # xtrace_disable 00:21:16.244 15:50:14 -- common/autotest_common.sh@10 -- # set +x 00:21:21.506 15:50:19 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:21.506 15:50:19 -- nvmf/common.sh@291 -- # pci_devs=() 00:21:21.506 15:50:19 -- nvmf/common.sh@291 -- # local -a pci_devs 00:21:21.506 15:50:19 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:21:21.506 15:50:19 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:21:21.506 15:50:19 -- nvmf/common.sh@293 -- # pci_drivers=() 00:21:21.506 15:50:19 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:21:21.506 15:50:19 -- nvmf/common.sh@295 -- # net_devs=() 00:21:21.506 15:50:19 -- nvmf/common.sh@295 -- # local -ga net_devs 00:21:21.506 15:50:19 -- nvmf/common.sh@296 -- # e810=() 00:21:21.506 15:50:19 -- nvmf/common.sh@296 -- # local -ga e810 00:21:21.506 15:50:19 -- nvmf/common.sh@297 -- # x722=() 00:21:21.506 15:50:19 -- nvmf/common.sh@297 -- # local -ga x722 00:21:21.506 15:50:19 -- nvmf/common.sh@298 -- # mlx=() 00:21:21.506 15:50:19 -- nvmf/common.sh@298 -- # local -ga mlx 00:21:21.506 15:50:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:21.506 15:50:19 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:21.506 15:50:19 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:21.506 15:50:19 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:21.506 15:50:19 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:21.506 15:50:19 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:21.506 15:50:19 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:21.506 15:50:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:21.506 15:50:19 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:21.506 15:50:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:21.506 15:50:19 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:21.506 15:50:19 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:21:21.506 15:50:19 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:21:21.506 15:50:19 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:21:21.506 15:50:19 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:21:21.506 15:50:19 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:21:21.506 15:50:19 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:21:21.506 15:50:19 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:21:21.506 15:50:19 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:21.506 15:50:19 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:21:21.506 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:21:21.506 15:50:19 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:21:21.507 15:50:19 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:21:21.507 15:50:19 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:21:21.507 15:50:19 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:21:21.507 15:50:19 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:21:21.507 15:50:19 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:21:21.507 15:50:19 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:21.507 15:50:19 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:21:21.507 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:21:21.507 15:50:19 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:21:21.507 15:50:19 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:21:21.507 15:50:19 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:21:21.507 15:50:19 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:21:21.507 15:50:19 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:21:21.507 15:50:19 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:21:21.507 15:50:19 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:21:21.507 15:50:19 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:21:21.507 15:50:19 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:21.507 15:50:19 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:21.507 15:50:19 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:21.507 15:50:19 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:21.507 15:50:19 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:21:21.507 Found net devices under 0000:da:00.0: mlx_0_0 00:21:21.507 15:50:19 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:21.507 15:50:19 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:21.507 15:50:19 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:21.507 15:50:19 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:21.507 15:50:19 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:21.507 15:50:19 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:21:21.507 Found net devices under 0000:da:00.1: mlx_0_1 00:21:21.507 15:50:19 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:21.507 15:50:19 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:21:21.507 15:50:19 -- nvmf/common.sh@403 -- # is_hw=yes 00:21:21.507 15:50:19 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:21:21.507 15:50:19 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:21:21.507 15:50:19 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:21:21.507 15:50:19 -- nvmf/common.sh@409 -- # rdma_device_init 00:21:21.507 15:50:19 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:21:21.507 15:50:19 -- nvmf/common.sh@58 -- # uname 00:21:21.507 15:50:19 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:21:21.507 15:50:19 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:21:21.507 15:50:19 -- nvmf/common.sh@63 -- # modprobe ib_core 00:21:21.507 15:50:19 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:21:21.507 15:50:19 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:21:21.507 15:50:19 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:21:21.507 15:50:19 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:21:21.507 15:50:19 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:21:21.507 15:50:19 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:21:21.507 15:50:19 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:21:21.507 15:50:19 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:21:21.507 15:50:19 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:21:21.507 15:50:19 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:21:21.507 15:50:19 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:21:21.507 15:50:19 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:21:21.507 15:50:19 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:21:21.507 15:50:19 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:21.507 15:50:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:21.507 15:50:19 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:21:21.507 15:50:19 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:21:21.507 15:50:19 -- nvmf/common.sh@105 -- # continue 2 00:21:21.507 15:50:19 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:21.507 15:50:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:21.507 15:50:19 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:21:21.507 15:50:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:21.507 15:50:19 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:21:21.507 15:50:19 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:21:21.507 15:50:19 -- nvmf/common.sh@105 -- # continue 2 00:21:21.507 15:50:19 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:21:21.507 15:50:19 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:21:21.507 15:50:19 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:21:21.507 15:50:19 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:21:21.507 15:50:19 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:21.507 15:50:19 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:21.507 15:50:19 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:21:21.507 15:50:19 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:21:21.507 15:50:19 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:21:21.507 122: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:21:21.507 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:21:21.507 altname enp218s0f0np0 00:21:21.507 altname ens818f0np0 00:21:21.507 inet 192.168.100.8/24 scope global mlx_0_0 00:21:21.507 valid_lft forever preferred_lft forever 00:21:21.507 15:50:19 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:21:21.507 15:50:19 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:21:21.507 15:50:19 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:21:21.507 15:50:19 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:21:21.507 15:50:19 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:21.507 15:50:19 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:21.507 15:50:19 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:21:21.507 15:50:19 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:21:21.507 15:50:19 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:21:21.507 123: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:21:21.507 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:21:21.507 altname enp218s0f1np1 00:21:21.507 altname ens818f1np1 00:21:21.507 inet 192.168.100.9/24 scope global mlx_0_1 00:21:21.507 valid_lft forever preferred_lft forever 00:21:21.507 15:50:19 -- nvmf/common.sh@411 -- # return 0 00:21:21.507 15:50:19 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:21:21.507 15:50:19 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:21:21.507 15:50:19 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:21:21.507 15:50:19 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:21:21.507 15:50:19 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:21:21.507 15:50:19 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:21:21.507 15:50:19 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:21:21.507 15:50:19 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:21:21.507 15:50:19 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:21:21.507 15:50:19 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:21:21.507 15:50:19 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:21.507 15:50:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:21.507 15:50:19 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:21:21.507 15:50:19 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:21:21.507 15:50:19 -- nvmf/common.sh@105 -- # continue 2 00:21:21.507 15:50:19 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:21.507 15:50:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:21.507 15:50:19 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:21:21.507 15:50:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:21.507 15:50:19 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:21:21.507 15:50:19 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:21:21.507 15:50:19 -- nvmf/common.sh@105 -- # continue 2 00:21:21.507 15:50:19 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:21:21.507 15:50:19 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:21:21.507 15:50:19 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:21:21.507 15:50:19 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:21.507 15:50:19 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:21:21.507 15:50:19 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:21.507 15:50:19 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:21:21.507 15:50:19 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:21:21.507 15:50:19 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:21:21.507 15:50:19 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:21:21.507 15:50:19 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:21.507 15:50:19 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:21.507 15:50:19 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:21:21.507 192.168.100.9' 00:21:21.507 15:50:19 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:21:21.507 192.168.100.9' 00:21:21.507 15:50:19 -- nvmf/common.sh@446 -- # head -n 1 00:21:21.507 15:50:19 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:21:21.507 15:50:19 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:21:21.507 192.168.100.9' 00:21:21.507 15:50:19 -- nvmf/common.sh@447 -- # tail -n +2 00:21:21.507 15:50:19 -- nvmf/common.sh@447 -- # head -n 1 00:21:21.507 15:50:19 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:21:21.507 15:50:19 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:21:21.507 15:50:19 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:21:21.507 15:50:19 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:21:21.507 15:50:19 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:21:21.507 15:50:19 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:21:21.507 15:50:19 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:21:21.507 15:50:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:21:21.507 15:50:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:21.507 15:50:19 -- common/autotest_common.sh@10 -- # set +x 00:21:21.507 ************************************ 00:21:21.507 START TEST nvmf_target_disconnect_tc1 00:21:21.507 ************************************ 00:21:21.507 15:50:20 -- common/autotest_common.sh@1111 -- # nvmf_target_disconnect_tc1 00:21:21.507 15:50:20 -- host/target_disconnect.sh@32 -- # set +e 00:21:21.507 15:50:20 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:21:21.507 EAL: No free 2048 kB hugepages reported on node 1 00:21:21.764 [2024-04-26 15:50:20.134546] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:21:21.764 [2024-04-26 15:50:20.134634] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:21:21.764 [2024-04-26 15:50:20.134656] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d7080 00:21:22.695 [2024-04-26 15:50:21.138642] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:21:22.695 [2024-04-26 15:50:21.138693] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:21:22.695 [2024-04-26 15:50:21.138701] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr is in error state 00:21:22.695 [2024-04-26 15:50:21.138736] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:21:22.695 [2024-04-26 15:50:21.138744] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:21:22.695 spdk_nvme_probe() failed for transport address '192.168.100.8' 00:21:22.695 /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:21:22.695 Initializing NVMe Controllers 00:21:22.695 15:50:21 -- host/target_disconnect.sh@33 -- # trap - ERR 00:21:22.695 15:50:21 -- host/target_disconnect.sh@33 -- # print_backtrace 00:21:22.695 15:50:21 -- common/autotest_common.sh@1139 -- # [[ hxBET =~ e ]] 00:21:22.695 15:50:21 -- common/autotest_common.sh@1139 -- # return 0 00:21:22.695 15:50:21 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:21:22.695 15:50:21 -- host/target_disconnect.sh@41 -- # set -e 00:21:22.695 00:21:22.695 real 0m1.117s 00:21:22.695 user 0m0.927s 00:21:22.695 sys 0m0.178s 00:21:22.695 15:50:21 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:21:22.695 15:50:21 -- common/autotest_common.sh@10 -- # set +x 00:21:22.695 ************************************ 00:21:22.695 END TEST nvmf_target_disconnect_tc1 00:21:22.695 ************************************ 00:21:22.695 15:50:21 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:21:22.695 15:50:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:21:22.695 15:50:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:22.695 15:50:21 -- common/autotest_common.sh@10 -- # set +x 00:21:22.695 ************************************ 00:21:22.695 START TEST nvmf_target_disconnect_tc2 00:21:22.695 ************************************ 00:21:22.695 15:50:21 -- common/autotest_common.sh@1111 -- # nvmf_target_disconnect_tc2 00:21:22.695 15:50:21 -- host/target_disconnect.sh@45 -- # disconnect_init 192.168.100.8 00:21:22.695 15:50:21 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:21:22.695 15:50:21 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:21:22.695 15:50:21 -- common/autotest_common.sh@710 -- # xtrace_disable 00:21:22.695 15:50:21 -- common/autotest_common.sh@10 -- # set +x 00:21:22.695 15:50:21 -- nvmf/common.sh@470 -- # nvmfpid=3422671 00:21:22.695 15:50:21 -- nvmf/common.sh@471 -- # waitforlisten 3422671 00:21:22.695 15:50:21 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:21:22.695 15:50:21 -- common/autotest_common.sh@817 -- # '[' -z 3422671 ']' 00:21:22.695 15:50:21 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:22.695 15:50:21 -- common/autotest_common.sh@822 -- # local max_retries=100 00:21:22.695 15:50:21 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:22.695 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:22.695 15:50:21 -- common/autotest_common.sh@826 -- # xtrace_disable 00:21:22.695 15:50:21 -- common/autotest_common.sh@10 -- # set +x 00:21:22.953 [2024-04-26 15:50:21.335115] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:21:22.953 [2024-04-26 15:50:21.335156] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:22.953 EAL: No free 2048 kB hugepages reported on node 1 00:21:22.953 [2024-04-26 15:50:21.404037] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:22.953 [2024-04-26 15:50:21.480631] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:22.953 [2024-04-26 15:50:21.480668] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:22.953 [2024-04-26 15:50:21.480674] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:21:22.953 [2024-04-26 15:50:21.480680] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:21:22.953 [2024-04-26 15:50:21.480685] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:22.953 [2024-04-26 15:50:21.481226] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:21:22.953 [2024-04-26 15:50:21.481312] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:21:22.953 [2024-04-26 15:50:21.481419] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:21:22.953 [2024-04-26 15:50:21.481420] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:21:23.885 15:50:22 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:21:23.885 15:50:22 -- common/autotest_common.sh@850 -- # return 0 00:21:23.885 15:50:22 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:21:23.885 15:50:22 -- common/autotest_common.sh@716 -- # xtrace_disable 00:21:23.885 15:50:22 -- common/autotest_common.sh@10 -- # set +x 00:21:23.885 15:50:22 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:23.885 15:50:22 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:21:23.885 15:50:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:23.885 15:50:22 -- common/autotest_common.sh@10 -- # set +x 00:21:23.885 Malloc0 00:21:23.885 15:50:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:23.885 15:50:22 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:21:23.885 15:50:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:23.885 15:50:22 -- common/autotest_common.sh@10 -- # set +x 00:21:23.885 [2024-04-26 15:50:22.218976] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x8171a0/0x822e00) succeed. 00:21:23.885 [2024-04-26 15:50:22.229398] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x8187e0/0x8a2e80) succeed. 00:21:23.885 15:50:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:23.885 15:50:22 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:23.885 15:50:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:23.885 15:50:22 -- common/autotest_common.sh@10 -- # set +x 00:21:23.885 15:50:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:23.885 15:50:22 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:21:23.885 15:50:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:23.886 15:50:22 -- common/autotest_common.sh@10 -- # set +x 00:21:23.886 15:50:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:23.886 15:50:22 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:21:23.886 15:50:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:23.886 15:50:22 -- common/autotest_common.sh@10 -- # set +x 00:21:23.886 [2024-04-26 15:50:22.369272] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:21:23.886 15:50:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:23.886 15:50:22 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:21:23.886 15:50:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:23.886 15:50:22 -- common/autotest_common.sh@10 -- # set +x 00:21:23.886 15:50:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:23.886 15:50:22 -- host/target_disconnect.sh@50 -- # reconnectpid=3422915 00:21:23.886 15:50:22 -- host/target_disconnect.sh@52 -- # sleep 2 00:21:23.886 15:50:22 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:21:23.886 EAL: No free 2048 kB hugepages reported on node 1 00:21:25.783 15:50:24 -- host/target_disconnect.sh@53 -- # kill -9 3422671 00:21:25.783 15:50:24 -- host/target_disconnect.sh@55 -- # sleep 2 00:21:27.153 Write completed with error (sct=0, sc=8) 00:21:27.153 starting I/O failed 00:21:27.153 Read completed with error (sct=0, sc=8) 00:21:27.153 starting I/O failed 00:21:27.153 Read completed with error (sct=0, sc=8) 00:21:27.153 starting I/O failed 00:21:27.153 Write completed with error (sct=0, sc=8) 00:21:27.153 starting I/O failed 00:21:27.153 Write completed with error (sct=0, sc=8) 00:21:27.153 starting I/O failed 00:21:27.153 Write completed with error (sct=0, sc=8) 00:21:27.154 starting I/O failed 00:21:27.154 Read completed with error (sct=0, sc=8) 00:21:27.154 starting I/O failed 00:21:27.154 Write completed with error (sct=0, sc=8) 00:21:27.154 starting I/O failed 00:21:27.154 Read completed with error (sct=0, sc=8) 00:21:27.154 starting I/O failed 00:21:27.154 Read completed with error (sct=0, sc=8) 00:21:27.154 starting I/O failed 00:21:27.154 Write completed with error (sct=0, sc=8) 00:21:27.154 starting I/O failed 00:21:27.154 Write completed with error (sct=0, sc=8) 00:21:27.154 starting I/O failed 00:21:27.154 Read completed with error (sct=0, sc=8) 00:21:27.154 starting I/O failed 00:21:27.154 Read completed with error (sct=0, sc=8) 00:21:27.154 starting I/O failed 00:21:27.154 Write completed with error (sct=0, sc=8) 00:21:27.154 starting I/O failed 00:21:27.154 Read completed with error (sct=0, sc=8) 00:21:27.154 starting I/O failed 00:21:27.154 Write completed with error (sct=0, sc=8) 00:21:27.154 starting I/O failed 00:21:27.154 Read completed with error (sct=0, sc=8) 00:21:27.154 starting I/O failed 00:21:27.154 Write completed with error (sct=0, sc=8) 00:21:27.154 starting I/O failed 00:21:27.154 Write completed with error (sct=0, sc=8) 00:21:27.154 starting I/O failed 00:21:27.154 Write completed with error (sct=0, sc=8) 00:21:27.154 starting I/O failed 00:21:27.154 Write completed with error (sct=0, sc=8) 00:21:27.154 starting I/O failed 00:21:27.154 Write completed with error (sct=0, sc=8) 00:21:27.154 starting I/O failed 00:21:27.154 Read completed with error (sct=0, sc=8) 00:21:27.154 starting I/O failed 00:21:27.154 Write completed with error (sct=0, sc=8) 00:21:27.154 starting I/O failed 00:21:27.154 Write completed with error (sct=0, sc=8) 00:21:27.154 starting I/O failed 00:21:27.154 Read completed with error (sct=0, sc=8) 00:21:27.154 starting I/O failed 00:21:27.154 Write completed with error (sct=0, sc=8) 00:21:27.154 starting I/O failed 00:21:27.154 Write completed with error (sct=0, sc=8) 00:21:27.154 starting I/O failed 00:21:27.154 Read completed with error (sct=0, sc=8) 00:21:27.154 starting I/O failed 00:21:27.154 Read completed with error (sct=0, sc=8) 00:21:27.154 starting I/O failed 00:21:27.154 Read completed with error (sct=0, sc=8) 00:21:27.154 starting I/O failed 00:21:27.154 [2024-04-26 15:50:25.553305] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:28.087 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 3422671 Killed "${NVMF_APP[@]}" "$@" 00:21:28.087 15:50:26 -- host/target_disconnect.sh@56 -- # disconnect_init 192.168.100.8 00:21:28.087 15:50:26 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:21:28.087 15:50:26 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:21:28.087 15:50:26 -- common/autotest_common.sh@710 -- # xtrace_disable 00:21:28.087 15:50:26 -- common/autotest_common.sh@10 -- # set +x 00:21:28.087 15:50:26 -- nvmf/common.sh@470 -- # nvmfpid=3423611 00:21:28.087 15:50:26 -- nvmf/common.sh@471 -- # waitforlisten 3423611 00:21:28.087 15:50:26 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:21:28.087 15:50:26 -- common/autotest_common.sh@817 -- # '[' -z 3423611 ']' 00:21:28.087 15:50:26 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:28.087 15:50:26 -- common/autotest_common.sh@822 -- # local max_retries=100 00:21:28.087 15:50:26 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:28.087 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:28.087 15:50:26 -- common/autotest_common.sh@826 -- # xtrace_disable 00:21:28.087 15:50:26 -- common/autotest_common.sh@10 -- # set +x 00:21:28.087 [2024-04-26 15:50:26.423451] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:21:28.087 [2024-04-26 15:50:26.423493] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:28.087 EAL: No free 2048 kB hugepages reported on node 1 00:21:28.087 [2024-04-26 15:50:26.484286] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:28.087 Write completed with error (sct=0, sc=8) 00:21:28.087 starting I/O failed 00:21:28.087 Read completed with error (sct=0, sc=8) 00:21:28.087 starting I/O failed 00:21:28.087 Read completed with error (sct=0, sc=8) 00:21:28.087 starting I/O failed 00:21:28.087 Write completed with error (sct=0, sc=8) 00:21:28.087 starting I/O failed 00:21:28.087 Write completed with error (sct=0, sc=8) 00:21:28.087 starting I/O failed 00:21:28.087 Write completed with error (sct=0, sc=8) 00:21:28.087 starting I/O failed 00:21:28.087 Write completed with error (sct=0, sc=8) 00:21:28.087 starting I/O failed 00:21:28.087 Read completed with error (sct=0, sc=8) 00:21:28.087 starting I/O failed 00:21:28.087 Read completed with error (sct=0, sc=8) 00:21:28.087 starting I/O failed 00:21:28.087 Write completed with error (sct=0, sc=8) 00:21:28.087 starting I/O failed 00:21:28.087 Write completed with error (sct=0, sc=8) 00:21:28.087 starting I/O failed 00:21:28.087 Read completed with error (sct=0, sc=8) 00:21:28.087 starting I/O failed 00:21:28.087 Write completed with error (sct=0, sc=8) 00:21:28.087 starting I/O failed 00:21:28.087 Write completed with error (sct=0, sc=8) 00:21:28.087 starting I/O failed 00:21:28.087 Write completed with error (sct=0, sc=8) 00:21:28.087 starting I/O failed 00:21:28.087 Read completed with error (sct=0, sc=8) 00:21:28.087 starting I/O failed 00:21:28.087 Write completed with error (sct=0, sc=8) 00:21:28.087 starting I/O failed 00:21:28.087 Read completed with error (sct=0, sc=8) 00:21:28.087 starting I/O failed 00:21:28.087 Write completed with error (sct=0, sc=8) 00:21:28.087 starting I/O failed 00:21:28.087 Read completed with error (sct=0, sc=8) 00:21:28.087 starting I/O failed 00:21:28.087 Write completed with error (sct=0, sc=8) 00:21:28.087 starting I/O failed 00:21:28.087 Read completed with error (sct=0, sc=8) 00:21:28.087 starting I/O failed 00:21:28.087 Write completed with error (sct=0, sc=8) 00:21:28.087 starting I/O failed 00:21:28.087 Write completed with error (sct=0, sc=8) 00:21:28.087 starting I/O failed 00:21:28.087 Read completed with error (sct=0, sc=8) 00:21:28.087 starting I/O failed 00:21:28.087 Read completed with error (sct=0, sc=8) 00:21:28.087 starting I/O failed 00:21:28.087 Write completed with error (sct=0, sc=8) 00:21:28.087 starting I/O failed 00:21:28.087 Read completed with error (sct=0, sc=8) 00:21:28.087 starting I/O failed 00:21:28.087 Write completed with error (sct=0, sc=8) 00:21:28.087 starting I/O failed 00:21:28.087 Read completed with error (sct=0, sc=8) 00:21:28.087 starting I/O failed 00:21:28.087 Read completed with error (sct=0, sc=8) 00:21:28.087 starting I/O failed 00:21:28.087 Write completed with error (sct=0, sc=8) 00:21:28.087 starting I/O failed 00:21:28.087 [2024-04-26 15:50:26.558489] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:28.087 [2024-04-26 15:50:26.560005] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:21:28.087 [2024-04-26 15:50:26.560022] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:21:28.087 [2024-04-26 15:50:26.560028] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:28.087 [2024-04-26 15:50:26.580606] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:28.087 [2024-04-26 15:50:26.580639] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:28.087 [2024-04-26 15:50:26.580650] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:21:28.087 [2024-04-26 15:50:26.580660] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:21:28.087 [2024-04-26 15:50:26.580667] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:28.087 [2024-04-26 15:50:26.580791] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:21:28.087 [2024-04-26 15:50:26.581190] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:21:28.087 [2024-04-26 15:50:26.581279] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:21:28.087 [2024-04-26 15:50:26.581281] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:21:28.087 15:50:26 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:21:28.087 15:50:26 -- common/autotest_common.sh@850 -- # return 0 00:21:28.087 15:50:26 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:21:28.087 15:50:26 -- common/autotest_common.sh@716 -- # xtrace_disable 00:21:28.087 15:50:26 -- common/autotest_common.sh@10 -- # set +x 00:21:28.345 15:50:26 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:28.345 15:50:26 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:21:28.345 15:50:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:28.345 15:50:26 -- common/autotest_common.sh@10 -- # set +x 00:21:28.345 Malloc0 00:21:28.345 15:50:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:28.345 15:50:26 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:21:28.345 15:50:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:28.345 15:50:26 -- common/autotest_common.sh@10 -- # set +x 00:21:28.345 [2024-04-26 15:50:26.766313] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1ed31a0/0x1edee00) succeed. 00:21:28.345 [2024-04-26 15:50:26.776708] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1ed47e0/0x1f5ee80) succeed. 00:21:28.345 15:50:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:28.345 15:50:26 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:28.345 15:50:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:28.345 15:50:26 -- common/autotest_common.sh@10 -- # set +x 00:21:28.345 15:50:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:28.345 15:50:26 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:21:28.345 15:50:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:28.345 15:50:26 -- common/autotest_common.sh@10 -- # set +x 00:21:28.345 15:50:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:28.345 15:50:26 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:21:28.345 15:50:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:28.345 15:50:26 -- common/autotest_common.sh@10 -- # set +x 00:21:28.345 [2024-04-26 15:50:26.914866] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:21:28.345 15:50:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:28.345 15:50:26 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:21:28.345 15:50:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:28.345 15:50:26 -- common/autotest_common.sh@10 -- # set +x 00:21:28.345 15:50:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:28.345 15:50:26 -- host/target_disconnect.sh@58 -- # wait 3422915 00:21:29.279 [2024-04-26 15:50:27.564030] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.279 qpair failed and we were unable to recover it. 00:21:29.279 [2024-04-26 15:50:27.574619] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.279 [2024-04-26 15:50:27.574672] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.279 [2024-04-26 15:50:27.574691] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.279 [2024-04-26 15:50:27.574698] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.279 [2024-04-26 15:50:27.574704] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.279 [2024-04-26 15:50:27.584938] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.279 qpair failed and we were unable to recover it. 00:21:29.279 [2024-04-26 15:50:27.594693] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.279 [2024-04-26 15:50:27.594732] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.279 [2024-04-26 15:50:27.594748] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.279 [2024-04-26 15:50:27.594755] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.279 [2024-04-26 15:50:27.594761] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.279 [2024-04-26 15:50:27.605163] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.279 qpair failed and we were unable to recover it. 00:21:29.279 [2024-04-26 15:50:27.614723] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.279 [2024-04-26 15:50:27.614764] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.279 [2024-04-26 15:50:27.614779] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.279 [2024-04-26 15:50:27.614786] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.279 [2024-04-26 15:50:27.614791] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.279 [2024-04-26 15:50:27.625118] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.279 qpair failed and we were unable to recover it. 00:21:29.279 [2024-04-26 15:50:27.634798] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.279 [2024-04-26 15:50:27.634839] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.279 [2024-04-26 15:50:27.634854] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.279 [2024-04-26 15:50:27.634861] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.279 [2024-04-26 15:50:27.634866] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.279 [2024-04-26 15:50:27.645048] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.279 qpair failed and we were unable to recover it. 00:21:29.279 [2024-04-26 15:50:27.654880] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.279 [2024-04-26 15:50:27.654923] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.279 [2024-04-26 15:50:27.654937] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.279 [2024-04-26 15:50:27.654943] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.279 [2024-04-26 15:50:27.654949] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.279 [2024-04-26 15:50:27.665316] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.279 qpair failed and we were unable to recover it. 00:21:29.279 [2024-04-26 15:50:27.674895] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.279 [2024-04-26 15:50:27.674933] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.279 [2024-04-26 15:50:27.674948] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.279 [2024-04-26 15:50:27.674954] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.279 [2024-04-26 15:50:27.674960] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.279 [2024-04-26 15:50:27.685438] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.279 qpair failed and we were unable to recover it. 00:21:29.279 [2024-04-26 15:50:27.694893] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.279 [2024-04-26 15:50:27.694933] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.279 [2024-04-26 15:50:27.694948] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.279 [2024-04-26 15:50:27.694955] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.279 [2024-04-26 15:50:27.694964] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.279 [2024-04-26 15:50:27.705527] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.279 qpair failed and we were unable to recover it. 00:21:29.279 [2024-04-26 15:50:27.714952] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.279 [2024-04-26 15:50:27.714990] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.279 [2024-04-26 15:50:27.715005] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.279 [2024-04-26 15:50:27.715011] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.279 [2024-04-26 15:50:27.715017] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.279 [2024-04-26 15:50:27.725601] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.279 qpair failed and we were unable to recover it. 00:21:29.279 [2024-04-26 15:50:27.735022] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.279 [2024-04-26 15:50:27.735065] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.279 [2024-04-26 15:50:27.735080] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.279 [2024-04-26 15:50:27.735087] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.279 [2024-04-26 15:50:27.735093] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.279 [2024-04-26 15:50:27.745320] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.279 qpair failed and we were unable to recover it. 00:21:29.279 [2024-04-26 15:50:27.755069] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.279 [2024-04-26 15:50:27.755111] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.279 [2024-04-26 15:50:27.755126] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.279 [2024-04-26 15:50:27.755133] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.280 [2024-04-26 15:50:27.755138] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.280 [2024-04-26 15:50:27.765528] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.280 qpair failed and we were unable to recover it. 00:21:29.280 [2024-04-26 15:50:27.775065] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.280 [2024-04-26 15:50:27.775104] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.280 [2024-04-26 15:50:27.775119] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.280 [2024-04-26 15:50:27.775125] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.280 [2024-04-26 15:50:27.775131] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.280 [2024-04-26 15:50:27.785594] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.280 qpair failed and we were unable to recover it. 00:21:29.280 [2024-04-26 15:50:27.795155] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.280 [2024-04-26 15:50:27.795198] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.280 [2024-04-26 15:50:27.795213] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.280 [2024-04-26 15:50:27.795220] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.280 [2024-04-26 15:50:27.795226] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.280 [2024-04-26 15:50:27.805802] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.280 qpair failed and we were unable to recover it. 00:21:29.280 [2024-04-26 15:50:27.815206] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.280 [2024-04-26 15:50:27.815244] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.280 [2024-04-26 15:50:27.815258] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.280 [2024-04-26 15:50:27.815265] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.280 [2024-04-26 15:50:27.815271] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.280 [2024-04-26 15:50:27.825625] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.280 qpair failed and we were unable to recover it. 00:21:29.280 [2024-04-26 15:50:27.835363] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.280 [2024-04-26 15:50:27.835399] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.280 [2024-04-26 15:50:27.835414] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.280 [2024-04-26 15:50:27.835420] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.280 [2024-04-26 15:50:27.835426] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.280 [2024-04-26 15:50:27.845905] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.280 qpair failed and we were unable to recover it. 00:21:29.280 [2024-04-26 15:50:27.855379] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.280 [2024-04-26 15:50:27.855418] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.280 [2024-04-26 15:50:27.855432] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.280 [2024-04-26 15:50:27.855439] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.280 [2024-04-26 15:50:27.855444] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.280 [2024-04-26 15:50:27.865875] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.280 qpair failed and we were unable to recover it. 00:21:29.280 [2024-04-26 15:50:27.875330] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.280 [2024-04-26 15:50:27.875376] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.280 [2024-04-26 15:50:27.875399] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.280 [2024-04-26 15:50:27.875409] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.280 [2024-04-26 15:50:27.875417] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.538 [2024-04-26 15:50:27.886097] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.538 qpair failed and we were unable to recover it. 00:21:29.538 [2024-04-26 15:50:27.895576] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.538 [2024-04-26 15:50:27.895617] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.538 [2024-04-26 15:50:27.895635] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.538 [2024-04-26 15:50:27.895642] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.538 [2024-04-26 15:50:27.895648] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.538 [2024-04-26 15:50:27.906016] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.538 qpair failed and we were unable to recover it. 00:21:29.538 [2024-04-26 15:50:27.915644] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.538 [2024-04-26 15:50:27.915681] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.538 [2024-04-26 15:50:27.915696] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.538 [2024-04-26 15:50:27.915702] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.539 [2024-04-26 15:50:27.915708] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.539 [2024-04-26 15:50:27.926199] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.539 qpair failed and we were unable to recover it. 00:21:29.539 [2024-04-26 15:50:27.935600] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.539 [2024-04-26 15:50:27.935639] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.539 [2024-04-26 15:50:27.935652] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.539 [2024-04-26 15:50:27.935659] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.539 [2024-04-26 15:50:27.935665] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.539 [2024-04-26 15:50:27.946167] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.539 qpair failed and we were unable to recover it. 00:21:29.539 [2024-04-26 15:50:27.955711] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.539 [2024-04-26 15:50:27.955751] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.539 [2024-04-26 15:50:27.955765] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.539 [2024-04-26 15:50:27.955771] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.539 [2024-04-26 15:50:27.955777] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.539 [2024-04-26 15:50:27.966260] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.539 qpair failed and we were unable to recover it. 00:21:29.539 [2024-04-26 15:50:27.975761] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.539 [2024-04-26 15:50:27.975799] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.539 [2024-04-26 15:50:27.975812] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.539 [2024-04-26 15:50:27.975818] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.539 [2024-04-26 15:50:27.975824] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.539 [2024-04-26 15:50:27.986221] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.539 qpair failed and we were unable to recover it. 00:21:29.539 [2024-04-26 15:50:27.995813] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.539 [2024-04-26 15:50:27.995856] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.539 [2024-04-26 15:50:27.995869] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.539 [2024-04-26 15:50:27.995876] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.539 [2024-04-26 15:50:27.995882] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.539 [2024-04-26 15:50:28.006417] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.539 qpair failed and we were unable to recover it. 00:21:29.539 [2024-04-26 15:50:28.015881] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.539 [2024-04-26 15:50:28.015920] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.539 [2024-04-26 15:50:28.015934] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.539 [2024-04-26 15:50:28.015941] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.539 [2024-04-26 15:50:28.015946] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.539 [2024-04-26 15:50:28.026380] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.539 qpair failed and we were unable to recover it. 00:21:29.539 [2024-04-26 15:50:28.035934] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.539 [2024-04-26 15:50:28.035971] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.539 [2024-04-26 15:50:28.035985] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.539 [2024-04-26 15:50:28.035992] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.539 [2024-04-26 15:50:28.035997] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.539 [2024-04-26 15:50:28.046550] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.539 qpair failed and we were unable to recover it. 00:21:29.539 [2024-04-26 15:50:28.055978] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.539 [2024-04-26 15:50:28.056018] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.539 [2024-04-26 15:50:28.056032] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.539 [2024-04-26 15:50:28.056039] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.539 [2024-04-26 15:50:28.056044] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.539 [2024-04-26 15:50:28.066232] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.539 qpair failed and we were unable to recover it. 00:21:29.539 [2024-04-26 15:50:28.076000] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.539 [2024-04-26 15:50:28.076032] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.539 [2024-04-26 15:50:28.076050] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.539 [2024-04-26 15:50:28.076059] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.539 [2024-04-26 15:50:28.076068] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.539 [2024-04-26 15:50:28.086624] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.539 qpair failed and we were unable to recover it. 00:21:29.539 [2024-04-26 15:50:28.096066] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.539 [2024-04-26 15:50:28.096105] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.539 [2024-04-26 15:50:28.096119] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.539 [2024-04-26 15:50:28.096125] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.539 [2024-04-26 15:50:28.096131] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.539 [2024-04-26 15:50:28.106631] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.539 qpair failed and we were unable to recover it. 00:21:29.539 [2024-04-26 15:50:28.116178] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.539 [2024-04-26 15:50:28.116214] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.539 [2024-04-26 15:50:28.116229] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.539 [2024-04-26 15:50:28.116235] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.539 [2024-04-26 15:50:28.116241] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.539 [2024-04-26 15:50:28.126447] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.539 qpair failed and we were unable to recover it. 00:21:29.539 [2024-04-26 15:50:28.136128] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.539 [2024-04-26 15:50:28.136174] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.539 [2024-04-26 15:50:28.136189] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.539 [2024-04-26 15:50:28.136196] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.539 [2024-04-26 15:50:28.136204] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.797 [2024-04-26 15:50:28.146417] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.797 qpair failed and we were unable to recover it. 00:21:29.797 [2024-04-26 15:50:28.156151] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.797 [2024-04-26 15:50:28.156184] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.797 [2024-04-26 15:50:28.156199] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.797 [2024-04-26 15:50:28.156206] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.797 [2024-04-26 15:50:28.156211] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.797 [2024-04-26 15:50:28.166657] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.797 qpair failed and we were unable to recover it. 00:21:29.797 [2024-04-26 15:50:28.176352] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.797 [2024-04-26 15:50:28.176386] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.797 [2024-04-26 15:50:28.176400] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.797 [2024-04-26 15:50:28.176406] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.797 [2024-04-26 15:50:28.176412] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.797 [2024-04-26 15:50:28.186835] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.797 qpair failed and we were unable to recover it. 00:21:29.797 [2024-04-26 15:50:28.196336] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.797 [2024-04-26 15:50:28.196375] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.797 [2024-04-26 15:50:28.196390] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.797 [2024-04-26 15:50:28.196397] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.797 [2024-04-26 15:50:28.196403] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.797 [2024-04-26 15:50:28.206776] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.797 qpair failed and we were unable to recover it. 00:21:29.797 [2024-04-26 15:50:28.216383] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.797 [2024-04-26 15:50:28.216422] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.797 [2024-04-26 15:50:28.216436] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.797 [2024-04-26 15:50:28.216442] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.797 [2024-04-26 15:50:28.216448] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.798 [2024-04-26 15:50:28.227014] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.798 qpair failed and we were unable to recover it. 00:21:29.798 [2024-04-26 15:50:28.236459] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.798 [2024-04-26 15:50:28.236500] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.798 [2024-04-26 15:50:28.236514] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.798 [2024-04-26 15:50:28.236521] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.798 [2024-04-26 15:50:28.236528] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.798 [2024-04-26 15:50:28.246950] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.798 qpair failed and we were unable to recover it. 00:21:29.798 [2024-04-26 15:50:28.256562] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.798 [2024-04-26 15:50:28.256595] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.798 [2024-04-26 15:50:28.256609] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.798 [2024-04-26 15:50:28.256615] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.798 [2024-04-26 15:50:28.256621] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.798 [2024-04-26 15:50:28.267125] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.798 qpair failed and we were unable to recover it. 00:21:29.798 [2024-04-26 15:50:28.276614] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.798 [2024-04-26 15:50:28.276650] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.798 [2024-04-26 15:50:28.276665] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.798 [2024-04-26 15:50:28.276672] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.798 [2024-04-26 15:50:28.276678] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.798 [2024-04-26 15:50:28.286942] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.798 qpair failed and we were unable to recover it. 00:21:29.798 [2024-04-26 15:50:28.296579] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.798 [2024-04-26 15:50:28.296618] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.798 [2024-04-26 15:50:28.296632] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.798 [2024-04-26 15:50:28.296638] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.798 [2024-04-26 15:50:28.296644] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.798 [2024-04-26 15:50:28.306911] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.798 qpair failed and we were unable to recover it. 00:21:29.798 [2024-04-26 15:50:28.316576] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.798 [2024-04-26 15:50:28.316613] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.798 [2024-04-26 15:50:28.316630] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.798 [2024-04-26 15:50:28.316636] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.798 [2024-04-26 15:50:28.316642] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.798 [2024-04-26 15:50:28.327094] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.798 qpair failed and we were unable to recover it. 00:21:29.798 [2024-04-26 15:50:28.336648] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.798 [2024-04-26 15:50:28.336687] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.798 [2024-04-26 15:50:28.336701] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.798 [2024-04-26 15:50:28.336708] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.798 [2024-04-26 15:50:28.336713] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.798 [2024-04-26 15:50:28.346940] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.798 qpair failed and we were unable to recover it. 00:21:29.798 [2024-04-26 15:50:28.356741] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.798 [2024-04-26 15:50:28.356779] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.798 [2024-04-26 15:50:28.356793] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.798 [2024-04-26 15:50:28.356799] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.798 [2024-04-26 15:50:28.356805] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.798 [2024-04-26 15:50:28.367103] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.798 qpair failed and we were unable to recover it. 00:21:29.798 [2024-04-26 15:50:28.376757] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.798 [2024-04-26 15:50:28.376797] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.798 [2024-04-26 15:50:28.376811] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.798 [2024-04-26 15:50:28.376817] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.798 [2024-04-26 15:50:28.376823] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:29.798 [2024-04-26 15:50:28.387187] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:29.798 qpair failed and we were unable to recover it. 00:21:29.798 [2024-04-26 15:50:28.396881] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:29.798 [2024-04-26 15:50:28.396914] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:29.798 [2024-04-26 15:50:28.396928] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:29.798 [2024-04-26 15:50:28.396934] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:29.798 [2024-04-26 15:50:28.396940] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.055 [2024-04-26 15:50:28.407346] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.055 qpair failed and we were unable to recover it. 00:21:30.055 [2024-04-26 15:50:28.416931] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.055 [2024-04-26 15:50:28.416968] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.055 [2024-04-26 15:50:28.416984] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.055 [2024-04-26 15:50:28.416990] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.055 [2024-04-26 15:50:28.416996] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.055 [2024-04-26 15:50:28.427376] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.055 qpair failed and we were unable to recover it. 00:21:30.055 [2024-04-26 15:50:28.436917] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.055 [2024-04-26 15:50:28.436952] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.055 [2024-04-26 15:50:28.436967] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.055 [2024-04-26 15:50:28.436973] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.055 [2024-04-26 15:50:28.436979] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.055 [2024-04-26 15:50:28.447340] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.055 qpair failed and we were unable to recover it. 00:21:30.055 [2024-04-26 15:50:28.456977] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.055 [2024-04-26 15:50:28.457015] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.055 [2024-04-26 15:50:28.457029] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.055 [2024-04-26 15:50:28.457035] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.055 [2024-04-26 15:50:28.457041] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.055 [2024-04-26 15:50:28.467524] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.055 qpair failed and we were unable to recover it. 00:21:30.055 [2024-04-26 15:50:28.477076] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.055 [2024-04-26 15:50:28.477110] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.055 [2024-04-26 15:50:28.477125] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.056 [2024-04-26 15:50:28.477131] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.056 [2024-04-26 15:50:28.477137] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.056 [2024-04-26 15:50:28.487361] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.056 qpair failed and we were unable to recover it. 00:21:30.056 [2024-04-26 15:50:28.497082] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.056 [2024-04-26 15:50:28.497126] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.056 [2024-04-26 15:50:28.497146] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.056 [2024-04-26 15:50:28.497153] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.056 [2024-04-26 15:50:28.497158] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.056 [2024-04-26 15:50:28.507477] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.056 qpair failed and we were unable to recover it. 00:21:30.056 [2024-04-26 15:50:28.517147] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.056 [2024-04-26 15:50:28.517190] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.056 [2024-04-26 15:50:28.517204] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.056 [2024-04-26 15:50:28.517211] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.056 [2024-04-26 15:50:28.517216] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.056 [2024-04-26 15:50:28.527583] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.056 qpair failed and we were unable to recover it. 00:21:30.056 [2024-04-26 15:50:28.537225] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.056 [2024-04-26 15:50:28.537268] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.056 [2024-04-26 15:50:28.537282] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.056 [2024-04-26 15:50:28.537288] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.056 [2024-04-26 15:50:28.537294] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.056 [2024-04-26 15:50:28.547685] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.056 qpair failed and we were unable to recover it. 00:21:30.056 [2024-04-26 15:50:28.557327] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.056 [2024-04-26 15:50:28.557362] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.056 [2024-04-26 15:50:28.557375] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.056 [2024-04-26 15:50:28.557382] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.056 [2024-04-26 15:50:28.557387] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.056 [2024-04-26 15:50:28.567644] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.056 qpair failed and we were unable to recover it. 00:21:30.056 [2024-04-26 15:50:28.577276] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.056 [2024-04-26 15:50:28.577309] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.056 [2024-04-26 15:50:28.577323] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.056 [2024-04-26 15:50:28.577329] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.056 [2024-04-26 15:50:28.577339] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.056 [2024-04-26 15:50:28.587699] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.056 qpair failed and we were unable to recover it. 00:21:30.056 [2024-04-26 15:50:28.597412] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.056 [2024-04-26 15:50:28.597449] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.056 [2024-04-26 15:50:28.597463] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.056 [2024-04-26 15:50:28.597469] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.056 [2024-04-26 15:50:28.597475] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.056 [2024-04-26 15:50:28.607848] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.056 qpair failed and we were unable to recover it. 00:21:30.056 [2024-04-26 15:50:28.617341] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.056 [2024-04-26 15:50:28.617377] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.056 [2024-04-26 15:50:28.617391] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.056 [2024-04-26 15:50:28.617397] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.056 [2024-04-26 15:50:28.617403] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.056 [2024-04-26 15:50:28.627937] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.056 qpair failed and we were unable to recover it. 00:21:30.056 [2024-04-26 15:50:28.637503] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.056 [2024-04-26 15:50:28.637540] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.056 [2024-04-26 15:50:28.637554] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.056 [2024-04-26 15:50:28.637560] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.056 [2024-04-26 15:50:28.637566] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.056 [2024-04-26 15:50:28.648005] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.056 qpair failed and we were unable to recover it. 00:21:30.056 [2024-04-26 15:50:28.657620] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.056 [2024-04-26 15:50:28.657662] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.056 [2024-04-26 15:50:28.657679] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.056 [2024-04-26 15:50:28.657686] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.056 [2024-04-26 15:50:28.657692] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.314 [2024-04-26 15:50:28.667992] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.314 qpair failed and we were unable to recover it. 00:21:30.314 [2024-04-26 15:50:28.677611] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.314 [2024-04-26 15:50:28.677651] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.314 [2024-04-26 15:50:28.677666] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.314 [2024-04-26 15:50:28.677673] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.314 [2024-04-26 15:50:28.677679] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.314 [2024-04-26 15:50:28.688087] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.314 qpair failed and we were unable to recover it. 00:21:30.314 [2024-04-26 15:50:28.697687] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.314 [2024-04-26 15:50:28.697730] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.314 [2024-04-26 15:50:28.697744] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.314 [2024-04-26 15:50:28.697751] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.314 [2024-04-26 15:50:28.697757] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.314 [2024-04-26 15:50:28.708151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.314 qpair failed and we were unable to recover it. 00:21:30.314 [2024-04-26 15:50:28.717730] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.314 [2024-04-26 15:50:28.717763] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.314 [2024-04-26 15:50:28.717777] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.314 [2024-04-26 15:50:28.717784] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.314 [2024-04-26 15:50:28.717789] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.314 [2024-04-26 15:50:28.728176] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.314 qpair failed and we were unable to recover it. 00:21:30.314 [2024-04-26 15:50:28.737808] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.314 [2024-04-26 15:50:28.737841] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.314 [2024-04-26 15:50:28.737855] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.314 [2024-04-26 15:50:28.737861] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.314 [2024-04-26 15:50:28.737867] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.314 [2024-04-26 15:50:28.748060] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.314 qpair failed and we were unable to recover it. 00:21:30.314 [2024-04-26 15:50:28.757887] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.314 [2024-04-26 15:50:28.757922] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.314 [2024-04-26 15:50:28.757939] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.314 [2024-04-26 15:50:28.757946] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.314 [2024-04-26 15:50:28.757951] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.314 [2024-04-26 15:50:28.768222] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.314 qpair failed and we were unable to recover it. 00:21:30.314 [2024-04-26 15:50:28.778051] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.314 [2024-04-26 15:50:28.778087] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.314 [2024-04-26 15:50:28.778101] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.314 [2024-04-26 15:50:28.778107] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.314 [2024-04-26 15:50:28.778113] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.314 [2024-04-26 15:50:28.788289] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.314 qpair failed and we were unable to recover it. 00:21:30.314 [2024-04-26 15:50:28.797962] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.314 [2024-04-26 15:50:28.798001] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.314 [2024-04-26 15:50:28.798015] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.314 [2024-04-26 15:50:28.798021] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.314 [2024-04-26 15:50:28.798027] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.314 [2024-04-26 15:50:28.808305] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.314 qpair failed and we were unable to recover it. 00:21:30.314 [2024-04-26 15:50:28.818019] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.314 [2024-04-26 15:50:28.818058] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.314 [2024-04-26 15:50:28.818072] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.314 [2024-04-26 15:50:28.818079] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.314 [2024-04-26 15:50:28.818084] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.314 [2024-04-26 15:50:28.828625] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.314 qpair failed and we were unable to recover it. 00:21:30.314 [2024-04-26 15:50:28.838083] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.314 [2024-04-26 15:50:28.838119] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.314 [2024-04-26 15:50:28.838132] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.314 [2024-04-26 15:50:28.838138] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.314 [2024-04-26 15:50:28.838149] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.314 [2024-04-26 15:50:28.848540] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.314 qpair failed and we were unable to recover it. 00:21:30.314 [2024-04-26 15:50:28.858112] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.314 [2024-04-26 15:50:28.858154] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.314 [2024-04-26 15:50:28.858168] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.314 [2024-04-26 15:50:28.858175] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.314 [2024-04-26 15:50:28.858180] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.314 [2024-04-26 15:50:28.868631] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.314 qpair failed and we were unable to recover it. 00:21:30.314 [2024-04-26 15:50:28.878190] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.314 [2024-04-26 15:50:28.878230] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.314 [2024-04-26 15:50:28.878244] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.314 [2024-04-26 15:50:28.878251] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.314 [2024-04-26 15:50:28.878256] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.314 [2024-04-26 15:50:28.888666] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.314 qpair failed and we were unable to recover it. 00:21:30.314 [2024-04-26 15:50:28.898314] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.314 [2024-04-26 15:50:28.898349] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.315 [2024-04-26 15:50:28.898363] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.315 [2024-04-26 15:50:28.898370] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.315 [2024-04-26 15:50:28.898376] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.315 [2024-04-26 15:50:28.908543] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.315 qpair failed and we were unable to recover it. 00:21:30.573 [2024-04-26 15:50:28.918395] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.573 [2024-04-26 15:50:28.918433] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.573 [2024-04-26 15:50:28.918451] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.573 [2024-04-26 15:50:28.918458] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.573 [2024-04-26 15:50:28.918464] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.573 [2024-04-26 15:50:28.928781] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.573 qpair failed and we were unable to recover it. 00:21:30.573 [2024-04-26 15:50:28.938413] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.573 [2024-04-26 15:50:28.938450] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.573 [2024-04-26 15:50:28.938465] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.573 [2024-04-26 15:50:28.938472] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.573 [2024-04-26 15:50:28.938478] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.573 [2024-04-26 15:50:28.948723] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.573 qpair failed and we were unable to recover it. 00:21:30.573 [2024-04-26 15:50:28.958483] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.573 [2024-04-26 15:50:28.958523] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.573 [2024-04-26 15:50:28.958537] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.573 [2024-04-26 15:50:28.958543] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.573 [2024-04-26 15:50:28.958549] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.573 [2024-04-26 15:50:28.968798] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.573 qpair failed and we were unable to recover it. 00:21:30.573 [2024-04-26 15:50:28.978567] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.573 [2024-04-26 15:50:28.978602] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.573 [2024-04-26 15:50:28.978616] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.573 [2024-04-26 15:50:28.978622] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.573 [2024-04-26 15:50:28.978628] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.573 [2024-04-26 15:50:28.989083] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.573 qpair failed and we were unable to recover it. 00:21:30.573 [2024-04-26 15:50:28.998609] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.573 [2024-04-26 15:50:28.998647] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.573 [2024-04-26 15:50:28.998660] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.573 [2024-04-26 15:50:28.998667] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.573 [2024-04-26 15:50:28.998673] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.573 [2024-04-26 15:50:29.009023] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.573 qpair failed and we were unable to recover it. 00:21:30.573 [2024-04-26 15:50:29.018681] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.573 [2024-04-26 15:50:29.018721] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.573 [2024-04-26 15:50:29.018735] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.573 [2024-04-26 15:50:29.018741] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.573 [2024-04-26 15:50:29.018749] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.573 [2024-04-26 15:50:29.028993] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.573 qpair failed and we were unable to recover it. 00:21:30.573 [2024-04-26 15:50:29.038665] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.573 [2024-04-26 15:50:29.038705] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.573 [2024-04-26 15:50:29.038719] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.573 [2024-04-26 15:50:29.038725] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.573 [2024-04-26 15:50:29.038731] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.573 [2024-04-26 15:50:29.049011] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.573 qpair failed and we were unable to recover it. 00:21:30.573 [2024-04-26 15:50:29.058866] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.573 [2024-04-26 15:50:29.058905] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.573 [2024-04-26 15:50:29.058919] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.573 [2024-04-26 15:50:29.058925] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.573 [2024-04-26 15:50:29.058931] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.573 [2024-04-26 15:50:29.069090] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.573 qpair failed and we were unable to recover it. 00:21:30.573 [2024-04-26 15:50:29.078926] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.573 [2024-04-26 15:50:29.078962] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.573 [2024-04-26 15:50:29.078977] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.573 [2024-04-26 15:50:29.078983] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.573 [2024-04-26 15:50:29.078989] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.573 [2024-04-26 15:50:29.089357] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.573 qpair failed and we were unable to recover it. 00:21:30.573 [2024-04-26 15:50:29.098959] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.573 [2024-04-26 15:50:29.099002] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.573 [2024-04-26 15:50:29.099016] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.573 [2024-04-26 15:50:29.099022] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.573 [2024-04-26 15:50:29.099028] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.573 [2024-04-26 15:50:29.109250] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.573 qpair failed and we were unable to recover it. 00:21:30.573 [2024-04-26 15:50:29.119057] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.573 [2024-04-26 15:50:29.119092] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.573 [2024-04-26 15:50:29.119105] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.573 [2024-04-26 15:50:29.119111] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.574 [2024-04-26 15:50:29.119117] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.574 [2024-04-26 15:50:29.129385] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.574 qpair failed and we were unable to recover it. 00:21:30.574 [2024-04-26 15:50:29.139077] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.574 [2024-04-26 15:50:29.139114] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.574 [2024-04-26 15:50:29.139128] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.574 [2024-04-26 15:50:29.139134] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.574 [2024-04-26 15:50:29.139145] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.574 [2024-04-26 15:50:29.149331] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.574 qpair failed and we were unable to recover it. 00:21:30.574 [2024-04-26 15:50:29.159234] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.574 [2024-04-26 15:50:29.159273] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.574 [2024-04-26 15:50:29.159287] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.574 [2024-04-26 15:50:29.159293] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.574 [2024-04-26 15:50:29.159299] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.574 [2024-04-26 15:50:29.169308] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.574 qpair failed and we were unable to recover it. 00:21:30.831 [2024-04-26 15:50:29.179294] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.831 [2024-04-26 15:50:29.179334] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.831 [2024-04-26 15:50:29.179351] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.831 [2024-04-26 15:50:29.179358] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.831 [2024-04-26 15:50:29.179364] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.831 [2024-04-26 15:50:29.189564] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.831 qpair failed and we were unable to recover it. 00:21:30.831 [2024-04-26 15:50:29.199233] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.831 [2024-04-26 15:50:29.199274] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.831 [2024-04-26 15:50:29.199292] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.831 [2024-04-26 15:50:29.199299] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.831 [2024-04-26 15:50:29.199305] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.831 [2024-04-26 15:50:29.209508] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.831 qpair failed and we were unable to recover it. 00:21:30.832 [2024-04-26 15:50:29.219430] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.832 [2024-04-26 15:50:29.219471] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.832 [2024-04-26 15:50:29.219486] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.832 [2024-04-26 15:50:29.219492] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.832 [2024-04-26 15:50:29.219498] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.832 [2024-04-26 15:50:29.229648] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.832 qpair failed and we were unable to recover it. 00:21:30.832 [2024-04-26 15:50:29.239340] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.832 [2024-04-26 15:50:29.239380] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.832 [2024-04-26 15:50:29.239394] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.832 [2024-04-26 15:50:29.239400] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.832 [2024-04-26 15:50:29.239406] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.832 [2024-04-26 15:50:29.249694] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.832 qpair failed and we were unable to recover it. 00:21:30.832 [2024-04-26 15:50:29.259402] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.832 [2024-04-26 15:50:29.259444] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.832 [2024-04-26 15:50:29.259457] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.832 [2024-04-26 15:50:29.259464] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.832 [2024-04-26 15:50:29.259469] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.832 [2024-04-26 15:50:29.269899] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.832 qpair failed and we were unable to recover it. 00:21:30.832 [2024-04-26 15:50:29.279451] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.832 [2024-04-26 15:50:29.279494] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.832 [2024-04-26 15:50:29.279509] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.832 [2024-04-26 15:50:29.279516] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.832 [2024-04-26 15:50:29.279521] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.832 [2024-04-26 15:50:29.289834] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.832 qpair failed and we were unable to recover it. 00:21:30.832 [2024-04-26 15:50:29.299473] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.832 [2024-04-26 15:50:29.299506] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.832 [2024-04-26 15:50:29.299521] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.832 [2024-04-26 15:50:29.299527] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.832 [2024-04-26 15:50:29.299532] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.832 [2024-04-26 15:50:29.310032] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.832 qpair failed and we were unable to recover it. 00:21:30.832 [2024-04-26 15:50:29.319642] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.832 [2024-04-26 15:50:29.319679] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.832 [2024-04-26 15:50:29.319693] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.832 [2024-04-26 15:50:29.319699] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.832 [2024-04-26 15:50:29.319705] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.832 [2024-04-26 15:50:29.329927] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.832 qpair failed and we were unable to recover it. 00:21:30.832 [2024-04-26 15:50:29.339553] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.832 [2024-04-26 15:50:29.339590] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.832 [2024-04-26 15:50:29.339603] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.832 [2024-04-26 15:50:29.339610] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.832 [2024-04-26 15:50:29.339615] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.832 [2024-04-26 15:50:29.350056] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.832 qpair failed and we were unable to recover it. 00:21:30.832 [2024-04-26 15:50:29.359707] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.832 [2024-04-26 15:50:29.359743] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.832 [2024-04-26 15:50:29.359756] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.832 [2024-04-26 15:50:29.359762] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.832 [2024-04-26 15:50:29.359768] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.832 [2024-04-26 15:50:29.370128] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.832 qpair failed and we were unable to recover it. 00:21:30.832 [2024-04-26 15:50:29.379730] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.832 [2024-04-26 15:50:29.379774] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.832 [2024-04-26 15:50:29.379787] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.832 [2024-04-26 15:50:29.379794] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.832 [2024-04-26 15:50:29.379799] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.832 [2024-04-26 15:50:29.390270] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.832 qpair failed and we were unable to recover it. 00:21:30.832 [2024-04-26 15:50:29.399750] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.832 [2024-04-26 15:50:29.399788] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.832 [2024-04-26 15:50:29.399802] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.832 [2024-04-26 15:50:29.399808] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.832 [2024-04-26 15:50:29.399814] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.832 [2024-04-26 15:50:29.410100] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.832 qpair failed and we were unable to recover it. 00:21:30.832 [2024-04-26 15:50:29.419711] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:30.832 [2024-04-26 15:50:29.419754] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:30.832 [2024-04-26 15:50:29.419767] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:30.832 [2024-04-26 15:50:29.419773] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:30.832 [2024-04-26 15:50:29.419779] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:30.833 [2024-04-26 15:50:29.430476] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:30.833 qpair failed and we were unable to recover it. 00:21:31.090 [2024-04-26 15:50:29.439954] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.090 [2024-04-26 15:50:29.439990] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.090 [2024-04-26 15:50:29.440008] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.090 [2024-04-26 15:50:29.440016] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.090 [2024-04-26 15:50:29.440022] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.090 [2024-04-26 15:50:29.450322] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.090 qpair failed and we were unable to recover it. 00:21:31.090 [2024-04-26 15:50:29.459870] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.090 [2024-04-26 15:50:29.459907] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.090 [2024-04-26 15:50:29.459921] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.090 [2024-04-26 15:50:29.459927] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.090 [2024-04-26 15:50:29.459936] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.090 [2024-04-26 15:50:29.470464] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.090 qpair failed and we were unable to recover it. 00:21:31.090 [2024-04-26 15:50:29.480029] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.090 [2024-04-26 15:50:29.480067] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.090 [2024-04-26 15:50:29.480081] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.090 [2024-04-26 15:50:29.480088] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.090 [2024-04-26 15:50:29.480094] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.090 [2024-04-26 15:50:29.490401] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.090 qpair failed and we were unable to recover it. 00:21:31.090 [2024-04-26 15:50:29.500039] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.090 [2024-04-26 15:50:29.500078] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.090 [2024-04-26 15:50:29.500091] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.090 [2024-04-26 15:50:29.500098] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.090 [2024-04-26 15:50:29.500104] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.090 [2024-04-26 15:50:29.510506] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.090 qpair failed and we were unable to recover it. 00:21:31.090 [2024-04-26 15:50:29.520209] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.090 [2024-04-26 15:50:29.520242] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.090 [2024-04-26 15:50:29.520256] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.090 [2024-04-26 15:50:29.520262] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.090 [2024-04-26 15:50:29.520268] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.090 [2024-04-26 15:50:29.530517] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.090 qpair failed and we were unable to recover it. 00:21:31.091 [2024-04-26 15:50:29.540263] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.091 [2024-04-26 15:50:29.540304] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.091 [2024-04-26 15:50:29.540318] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.091 [2024-04-26 15:50:29.540325] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.091 [2024-04-26 15:50:29.540330] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.091 [2024-04-26 15:50:29.550766] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.091 qpair failed and we were unable to recover it. 00:21:31.091 [2024-04-26 15:50:29.560345] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.091 [2024-04-26 15:50:29.560381] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.091 [2024-04-26 15:50:29.560395] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.091 [2024-04-26 15:50:29.560401] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.091 [2024-04-26 15:50:29.560407] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.091 [2024-04-26 15:50:29.570744] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.091 qpair failed and we were unable to recover it. 00:21:31.091 [2024-04-26 15:50:29.580320] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.091 [2024-04-26 15:50:29.580360] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.091 [2024-04-26 15:50:29.580374] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.091 [2024-04-26 15:50:29.580380] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.091 [2024-04-26 15:50:29.580386] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.091 [2024-04-26 15:50:29.590676] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.091 qpair failed and we were unable to recover it. 00:21:31.091 [2024-04-26 15:50:29.600375] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.091 [2024-04-26 15:50:29.600413] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.091 [2024-04-26 15:50:29.600427] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.091 [2024-04-26 15:50:29.600433] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.091 [2024-04-26 15:50:29.600439] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.091 [2024-04-26 15:50:29.610892] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.091 qpair failed and we were unable to recover it. 00:21:31.091 [2024-04-26 15:50:29.620485] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.091 [2024-04-26 15:50:29.620524] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.091 [2024-04-26 15:50:29.620538] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.091 [2024-04-26 15:50:29.620545] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.091 [2024-04-26 15:50:29.620551] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.091 [2024-04-26 15:50:29.630967] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.091 qpair failed and we were unable to recover it. 00:21:31.091 [2024-04-26 15:50:29.640567] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.091 [2024-04-26 15:50:29.640602] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.091 [2024-04-26 15:50:29.640619] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.091 [2024-04-26 15:50:29.640626] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.091 [2024-04-26 15:50:29.640632] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.091 [2024-04-26 15:50:29.650962] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.091 qpair failed and we were unable to recover it. 00:21:31.091 [2024-04-26 15:50:29.660553] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.091 [2024-04-26 15:50:29.660591] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.091 [2024-04-26 15:50:29.660605] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.091 [2024-04-26 15:50:29.660611] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.091 [2024-04-26 15:50:29.660617] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.091 [2024-04-26 15:50:29.671057] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.091 qpair failed and we were unable to recover it. 00:21:31.091 [2024-04-26 15:50:29.680584] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.091 [2024-04-26 15:50:29.680616] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.091 [2024-04-26 15:50:29.680630] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.091 [2024-04-26 15:50:29.680637] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.091 [2024-04-26 15:50:29.680643] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.091 [2024-04-26 15:50:29.690830] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.091 qpair failed and we were unable to recover it. 00:21:31.349 [2024-04-26 15:50:29.700648] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.349 [2024-04-26 15:50:29.700687] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.349 [2024-04-26 15:50:29.700705] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.349 [2024-04-26 15:50:29.700712] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.349 [2024-04-26 15:50:29.700718] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.349 [2024-04-26 15:50:29.711281] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.349 qpair failed and we were unable to recover it. 00:21:31.349 [2024-04-26 15:50:29.720669] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.349 [2024-04-26 15:50:29.720706] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.349 [2024-04-26 15:50:29.720720] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.349 [2024-04-26 15:50:29.720727] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.349 [2024-04-26 15:50:29.720732] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.349 [2024-04-26 15:50:29.731243] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.349 qpair failed and we were unable to recover it. 00:21:31.349 [2024-04-26 15:50:29.740778] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.349 [2024-04-26 15:50:29.740816] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.349 [2024-04-26 15:50:29.740830] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.349 [2024-04-26 15:50:29.740836] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.349 [2024-04-26 15:50:29.740842] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.349 [2024-04-26 15:50:29.751277] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.349 qpair failed and we were unable to recover it. 00:21:31.349 [2024-04-26 15:50:29.760854] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.349 [2024-04-26 15:50:29.760890] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.349 [2024-04-26 15:50:29.760904] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.349 [2024-04-26 15:50:29.760910] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.349 [2024-04-26 15:50:29.760916] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.349 [2024-04-26 15:50:29.771296] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.349 qpair failed and we were unable to recover it. 00:21:31.349 [2024-04-26 15:50:29.780899] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.349 [2024-04-26 15:50:29.780935] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.350 [2024-04-26 15:50:29.780949] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.350 [2024-04-26 15:50:29.780955] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.350 [2024-04-26 15:50:29.780961] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.350 [2024-04-26 15:50:29.791396] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.350 qpair failed and we were unable to recover it. 00:21:31.350 [2024-04-26 15:50:29.800947] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.350 [2024-04-26 15:50:29.800982] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.350 [2024-04-26 15:50:29.800996] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.350 [2024-04-26 15:50:29.801002] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.350 [2024-04-26 15:50:29.801008] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.350 [2024-04-26 15:50:29.811444] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.350 qpair failed and we were unable to recover it. 00:21:31.350 [2024-04-26 15:50:29.821033] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.350 [2024-04-26 15:50:29.821073] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.350 [2024-04-26 15:50:29.821087] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.350 [2024-04-26 15:50:29.821093] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.350 [2024-04-26 15:50:29.821099] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.350 [2024-04-26 15:50:29.831473] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.350 qpair failed and we were unable to recover it. 00:21:31.350 [2024-04-26 15:50:29.841034] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.350 [2024-04-26 15:50:29.841066] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.350 [2024-04-26 15:50:29.841080] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.350 [2024-04-26 15:50:29.841086] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.350 [2024-04-26 15:50:29.841092] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.350 [2024-04-26 15:50:29.851553] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.350 qpair failed and we were unable to recover it. 00:21:31.350 [2024-04-26 15:50:29.861189] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.350 [2024-04-26 15:50:29.861227] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.350 [2024-04-26 15:50:29.861241] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.350 [2024-04-26 15:50:29.861247] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.350 [2024-04-26 15:50:29.861253] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.350 [2024-04-26 15:50:29.871573] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.350 qpair failed and we were unable to recover it. 00:21:31.350 [2024-04-26 15:50:29.881313] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.350 [2024-04-26 15:50:29.881352] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.350 [2024-04-26 15:50:29.881367] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.350 [2024-04-26 15:50:29.881373] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.350 [2024-04-26 15:50:29.881379] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.350 [2024-04-26 15:50:29.891682] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.350 qpair failed and we were unable to recover it. 00:21:31.350 [2024-04-26 15:50:29.901297] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.350 [2024-04-26 15:50:29.901337] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.350 [2024-04-26 15:50:29.901350] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.350 [2024-04-26 15:50:29.901357] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.350 [2024-04-26 15:50:29.901365] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.350 [2024-04-26 15:50:29.911786] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.350 qpair failed and we were unable to recover it. 00:21:31.350 [2024-04-26 15:50:29.921415] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.350 [2024-04-26 15:50:29.921447] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.350 [2024-04-26 15:50:29.921461] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.350 [2024-04-26 15:50:29.921468] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.350 [2024-04-26 15:50:29.921473] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.350 [2024-04-26 15:50:29.931758] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.350 qpair failed and we were unable to recover it. 00:21:31.350 [2024-04-26 15:50:29.941430] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.350 [2024-04-26 15:50:29.941467] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.350 [2024-04-26 15:50:29.941480] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.350 [2024-04-26 15:50:29.941487] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.350 [2024-04-26 15:50:29.941492] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.350 [2024-04-26 15:50:29.951785] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.350 qpair failed and we were unable to recover it. 00:21:31.608 [2024-04-26 15:50:29.961473] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.608 [2024-04-26 15:50:29.961510] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.608 [2024-04-26 15:50:29.961528] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.608 [2024-04-26 15:50:29.961535] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.608 [2024-04-26 15:50:29.961541] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.608 [2024-04-26 15:50:29.971815] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.608 qpair failed and we were unable to recover it. 00:21:31.608 [2024-04-26 15:50:29.981503] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.608 [2024-04-26 15:50:29.981540] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.608 [2024-04-26 15:50:29.981555] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.608 [2024-04-26 15:50:29.981562] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.608 [2024-04-26 15:50:29.981567] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.608 [2024-04-26 15:50:29.992062] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.608 qpair failed and we were unable to recover it. 00:21:31.608 [2024-04-26 15:50:30.002213] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.608 [2024-04-26 15:50:30.002255] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.608 [2024-04-26 15:50:30.002287] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.608 [2024-04-26 15:50:30.002294] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.608 [2024-04-26 15:50:30.002301] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.608 [2024-04-26 15:50:30.012126] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.608 qpair failed and we were unable to recover it. 00:21:31.608 [2024-04-26 15:50:30.021588] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.608 [2024-04-26 15:50:30.021631] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.608 [2024-04-26 15:50:30.021648] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.608 [2024-04-26 15:50:30.021656] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.608 [2024-04-26 15:50:30.021663] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.608 [2024-04-26 15:50:30.032101] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.608 qpair failed and we were unable to recover it. 00:21:31.608 [2024-04-26 15:50:30.041713] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.608 [2024-04-26 15:50:30.041751] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.608 [2024-04-26 15:50:30.041765] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.608 [2024-04-26 15:50:30.041772] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.608 [2024-04-26 15:50:30.041778] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.608 [2024-04-26 15:50:30.051976] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.608 qpair failed and we were unable to recover it. 00:21:31.609 [2024-04-26 15:50:30.061653] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.609 [2024-04-26 15:50:30.061691] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.609 [2024-04-26 15:50:30.061705] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.609 [2024-04-26 15:50:30.061711] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.609 [2024-04-26 15:50:30.061717] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.609 [2024-04-26 15:50:30.072122] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.609 qpair failed and we were unable to recover it. 00:21:31.609 [2024-04-26 15:50:30.081762] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.609 [2024-04-26 15:50:30.081803] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.609 [2024-04-26 15:50:30.081822] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.609 [2024-04-26 15:50:30.081829] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.609 [2024-04-26 15:50:30.081835] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.609 [2024-04-26 15:50:30.092174] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.609 qpair failed and we were unable to recover it. 00:21:31.609 [2024-04-26 15:50:30.101848] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.609 [2024-04-26 15:50:30.101886] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.609 [2024-04-26 15:50:30.101900] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.609 [2024-04-26 15:50:30.101907] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.609 [2024-04-26 15:50:30.101912] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.609 [2024-04-26 15:50:30.112046] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.609 qpair failed and we were unable to recover it. 00:21:31.609 [2024-04-26 15:50:30.121943] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.609 [2024-04-26 15:50:30.121981] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.609 [2024-04-26 15:50:30.121995] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.609 [2024-04-26 15:50:30.122002] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.609 [2024-04-26 15:50:30.122008] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.609 [2024-04-26 15:50:30.132392] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.609 qpair failed and we were unable to recover it. 00:21:31.609 [2024-04-26 15:50:30.142015] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.609 [2024-04-26 15:50:30.142059] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.609 [2024-04-26 15:50:30.142073] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.609 [2024-04-26 15:50:30.142079] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.609 [2024-04-26 15:50:30.142087] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.609 [2024-04-26 15:50:30.152586] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.609 qpair failed and we were unable to recover it. 00:21:31.609 [2024-04-26 15:50:30.162096] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.609 [2024-04-26 15:50:30.162135] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.609 [2024-04-26 15:50:30.162154] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.609 [2024-04-26 15:50:30.162161] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.609 [2024-04-26 15:50:30.162166] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.609 [2024-04-26 15:50:30.172531] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.609 qpair failed and we were unable to recover it. 00:21:31.609 [2024-04-26 15:50:30.182176] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.609 [2024-04-26 15:50:30.182215] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.609 [2024-04-26 15:50:30.182228] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.609 [2024-04-26 15:50:30.182234] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.609 [2024-04-26 15:50:30.182240] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.609 [2024-04-26 15:50:30.192658] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.609 qpair failed and we were unable to recover it. 00:21:31.609 [2024-04-26 15:50:30.202165] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.609 [2024-04-26 15:50:30.202206] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.609 [2024-04-26 15:50:30.202220] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.609 [2024-04-26 15:50:30.202226] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.609 [2024-04-26 15:50:30.202232] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.867 [2024-04-26 15:50:30.212756] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.867 qpair failed and we were unable to recover it. 00:21:31.867 [2024-04-26 15:50:30.222347] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.867 [2024-04-26 15:50:30.222387] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.867 [2024-04-26 15:50:30.222405] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.867 [2024-04-26 15:50:30.222412] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.867 [2024-04-26 15:50:30.222417] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.867 [2024-04-26 15:50:30.232828] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.867 qpair failed and we were unable to recover it. 00:21:31.867 [2024-04-26 15:50:30.242192] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.867 [2024-04-26 15:50:30.242230] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.867 [2024-04-26 15:50:30.242244] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.867 [2024-04-26 15:50:30.242250] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.867 [2024-04-26 15:50:30.242256] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.867 [2024-04-26 15:50:30.252635] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.867 qpair failed and we were unable to recover it. 00:21:31.867 [2024-04-26 15:50:30.262213] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.867 [2024-04-26 15:50:30.262250] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.867 [2024-04-26 15:50:30.262282] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.867 [2024-04-26 15:50:30.262289] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.867 [2024-04-26 15:50:30.262295] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.867 [2024-04-26 15:50:30.272941] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.867 qpair failed and we were unable to recover it. 00:21:31.867 [2024-04-26 15:50:30.282415] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.867 [2024-04-26 15:50:30.282452] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.867 [2024-04-26 15:50:30.282467] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.867 [2024-04-26 15:50:30.282474] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.867 [2024-04-26 15:50:30.282480] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.867 [2024-04-26 15:50:30.292726] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.867 qpair failed and we were unable to recover it. 00:21:31.867 [2024-04-26 15:50:30.302491] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.867 [2024-04-26 15:50:30.302529] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.867 [2024-04-26 15:50:30.302543] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.867 [2024-04-26 15:50:30.302550] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.867 [2024-04-26 15:50:30.302555] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.867 [2024-04-26 15:50:30.312845] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.867 qpair failed and we were unable to recover it. 00:21:31.867 [2024-04-26 15:50:30.322560] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.867 [2024-04-26 15:50:30.322599] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.867 [2024-04-26 15:50:30.322613] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.867 [2024-04-26 15:50:30.322620] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.867 [2024-04-26 15:50:30.322625] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.867 [2024-04-26 15:50:30.332790] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.867 qpair failed and we were unable to recover it. 00:21:31.867 [2024-04-26 15:50:30.342627] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.867 [2024-04-26 15:50:30.342670] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.867 [2024-04-26 15:50:30.342683] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.867 [2024-04-26 15:50:30.342690] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.867 [2024-04-26 15:50:30.342698] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.868 [2024-04-26 15:50:30.352829] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.868 qpair failed and we were unable to recover it. 00:21:31.868 [2024-04-26 15:50:30.362681] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.868 [2024-04-26 15:50:30.362718] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.868 [2024-04-26 15:50:30.362731] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.868 [2024-04-26 15:50:30.362737] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.868 [2024-04-26 15:50:30.362743] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.868 [2024-04-26 15:50:30.373078] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.868 qpair failed and we were unable to recover it. 00:21:31.868 [2024-04-26 15:50:30.382669] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.868 [2024-04-26 15:50:30.382708] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.868 [2024-04-26 15:50:30.382722] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.868 [2024-04-26 15:50:30.382728] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.868 [2024-04-26 15:50:30.382734] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.868 [2024-04-26 15:50:30.393201] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.868 qpair failed and we were unable to recover it. 00:21:31.868 [2024-04-26 15:50:30.402779] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.868 [2024-04-26 15:50:30.402816] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.868 [2024-04-26 15:50:30.402830] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.868 [2024-04-26 15:50:30.402836] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.868 [2024-04-26 15:50:30.402842] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.868 [2024-04-26 15:50:30.412972] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.868 qpair failed and we were unable to recover it. 00:21:31.868 [2024-04-26 15:50:30.422816] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.868 [2024-04-26 15:50:30.422856] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.868 [2024-04-26 15:50:30.422870] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.868 [2024-04-26 15:50:30.422877] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.868 [2024-04-26 15:50:30.422882] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.868 [2024-04-26 15:50:30.433299] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.868 qpair failed and we were unable to recover it. 00:21:31.868 [2024-04-26 15:50:30.442930] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.868 [2024-04-26 15:50:30.442973] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.868 [2024-04-26 15:50:30.442986] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.868 [2024-04-26 15:50:30.442993] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.868 [2024-04-26 15:50:30.442999] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:31.868 [2024-04-26 15:50:30.453279] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:31.868 qpair failed and we were unable to recover it. 00:21:31.868 [2024-04-26 15:50:30.462919] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:31.868 [2024-04-26 15:50:30.462960] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:31.868 [2024-04-26 15:50:30.462974] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:31.868 [2024-04-26 15:50:30.462980] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:31.868 [2024-04-26 15:50:30.462986] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.126 [2024-04-26 15:50:30.473425] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.126 qpair failed and we were unable to recover it. 00:21:32.126 [2024-04-26 15:50:30.483041] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.126 [2024-04-26 15:50:30.483080] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.126 [2024-04-26 15:50:30.483097] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.126 [2024-04-26 15:50:30.483104] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.126 [2024-04-26 15:50:30.483110] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.126 [2024-04-26 15:50:30.493633] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.126 qpair failed and we were unable to recover it. 00:21:32.126 [2024-04-26 15:50:30.503068] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.126 [2024-04-26 15:50:30.503107] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.126 [2024-04-26 15:50:30.503121] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.126 [2024-04-26 15:50:30.503127] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.126 [2024-04-26 15:50:30.503133] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.126 [2024-04-26 15:50:30.513508] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.126 qpair failed and we were unable to recover it. 00:21:32.126 [2024-04-26 15:50:30.522990] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.126 [2024-04-26 15:50:30.523033] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.126 [2024-04-26 15:50:30.523049] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.126 [2024-04-26 15:50:30.523056] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.126 [2024-04-26 15:50:30.523061] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.126 [2024-04-26 15:50:30.533531] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.126 qpair failed and we were unable to recover it. 00:21:32.126 [2024-04-26 15:50:30.543274] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.126 [2024-04-26 15:50:30.543316] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.126 [2024-04-26 15:50:30.543330] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.126 [2024-04-26 15:50:30.543336] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.126 [2024-04-26 15:50:30.543342] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.126 [2024-04-26 15:50:30.553447] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.126 qpair failed and we were unable to recover it. 00:21:32.126 [2024-04-26 15:50:30.563353] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.126 [2024-04-26 15:50:30.563392] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.126 [2024-04-26 15:50:30.563407] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.126 [2024-04-26 15:50:30.563413] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.126 [2024-04-26 15:50:30.563419] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.126 [2024-04-26 15:50:30.573599] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.126 qpair failed and we were unable to recover it. 00:21:32.126 [2024-04-26 15:50:30.583313] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.126 [2024-04-26 15:50:30.583347] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.126 [2024-04-26 15:50:30.583360] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.126 [2024-04-26 15:50:30.583367] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.126 [2024-04-26 15:50:30.583373] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.126 [2024-04-26 15:50:30.593740] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.126 qpair failed and we were unable to recover it. 00:21:32.126 [2024-04-26 15:50:30.603519] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.126 [2024-04-26 15:50:30.603557] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.126 [2024-04-26 15:50:30.603570] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.126 [2024-04-26 15:50:30.603577] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.126 [2024-04-26 15:50:30.603582] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.126 [2024-04-26 15:50:30.613708] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.126 qpair failed and we were unable to recover it. 00:21:32.126 [2024-04-26 15:50:30.623416] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.126 [2024-04-26 15:50:30.623456] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.126 [2024-04-26 15:50:30.623470] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.126 [2024-04-26 15:50:30.623476] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.126 [2024-04-26 15:50:30.623482] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.126 [2024-04-26 15:50:30.633907] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.126 qpair failed and we were unable to recover it. 00:21:32.126 [2024-04-26 15:50:30.643573] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.126 [2024-04-26 15:50:30.643607] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.126 [2024-04-26 15:50:30.643620] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.127 [2024-04-26 15:50:30.643626] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.127 [2024-04-26 15:50:30.643632] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.127 [2024-04-26 15:50:30.653838] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.127 qpair failed and we were unable to recover it. 00:21:32.127 [2024-04-26 15:50:30.663627] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.127 [2024-04-26 15:50:30.663666] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.127 [2024-04-26 15:50:30.663680] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.127 [2024-04-26 15:50:30.663686] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.127 [2024-04-26 15:50:30.663692] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.127 [2024-04-26 15:50:30.673966] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.127 qpair failed and we were unable to recover it. 00:21:32.127 [2024-04-26 15:50:30.683727] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.127 [2024-04-26 15:50:30.683766] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.127 [2024-04-26 15:50:30.683782] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.127 [2024-04-26 15:50:30.683789] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.127 [2024-04-26 15:50:30.683794] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.127 [2024-04-26 15:50:30.694186] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.127 qpair failed and we were unable to recover it. 00:21:32.127 [2024-04-26 15:50:30.703823] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.127 [2024-04-26 15:50:30.703865] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.127 [2024-04-26 15:50:30.703879] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.127 [2024-04-26 15:50:30.703885] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.127 [2024-04-26 15:50:30.703891] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.127 [2024-04-26 15:50:30.714000] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.127 qpair failed and we were unable to recover it. 00:21:32.127 [2024-04-26 15:50:30.723853] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.127 [2024-04-26 15:50:30.723894] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.127 [2024-04-26 15:50:30.723907] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.127 [2024-04-26 15:50:30.723914] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.127 [2024-04-26 15:50:30.723920] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.385 [2024-04-26 15:50:30.734177] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.385 qpair failed and we were unable to recover it. 00:21:32.385 [2024-04-26 15:50:30.743869] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.385 [2024-04-26 15:50:30.743903] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.385 [2024-04-26 15:50:30.743919] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.385 [2024-04-26 15:50:30.743925] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.385 [2024-04-26 15:50:30.743931] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.385 [2024-04-26 15:50:30.754223] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.385 qpair failed and we were unable to recover it. 00:21:32.385 [2024-04-26 15:50:30.763951] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.385 [2024-04-26 15:50:30.763992] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.385 [2024-04-26 15:50:30.764006] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.385 [2024-04-26 15:50:30.764013] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.385 [2024-04-26 15:50:30.764018] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.385 [2024-04-26 15:50:30.774267] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.385 qpair failed and we were unable to recover it. 00:21:32.385 [2024-04-26 15:50:30.784007] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.385 [2024-04-26 15:50:30.784049] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.385 [2024-04-26 15:50:30.784062] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.385 [2024-04-26 15:50:30.784069] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.385 [2024-04-26 15:50:30.784077] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.385 [2024-04-26 15:50:30.794314] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.385 qpair failed and we were unable to recover it. 00:21:32.385 [2024-04-26 15:50:30.804126] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.385 [2024-04-26 15:50:30.804170] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.385 [2024-04-26 15:50:30.804184] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.385 [2024-04-26 15:50:30.804191] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.385 [2024-04-26 15:50:30.804197] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.385 [2024-04-26 15:50:30.814462] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.385 qpair failed and we were unable to recover it. 00:21:32.385 [2024-04-26 15:50:30.824139] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.385 [2024-04-26 15:50:30.824186] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.385 [2024-04-26 15:50:30.824200] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.385 [2024-04-26 15:50:30.824207] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.385 [2024-04-26 15:50:30.824213] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.385 [2024-04-26 15:50:30.834597] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.385 qpair failed and we were unable to recover it. 00:21:32.385 [2024-04-26 15:50:30.844264] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.385 [2024-04-26 15:50:30.844302] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.385 [2024-04-26 15:50:30.844317] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.385 [2024-04-26 15:50:30.844323] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.385 [2024-04-26 15:50:30.844329] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.385 [2024-04-26 15:50:30.854611] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.385 qpair failed and we were unable to recover it. 00:21:32.385 [2024-04-26 15:50:30.864204] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.386 [2024-04-26 15:50:30.864239] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.386 [2024-04-26 15:50:30.864252] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.386 [2024-04-26 15:50:30.864258] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.386 [2024-04-26 15:50:30.864264] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.386 [2024-04-26 15:50:30.874527] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.386 qpair failed and we were unable to recover it. 00:21:32.386 [2024-04-26 15:50:30.884328] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.386 [2024-04-26 15:50:30.884367] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.386 [2024-04-26 15:50:30.884381] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.386 [2024-04-26 15:50:30.884388] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.386 [2024-04-26 15:50:30.884394] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.386 [2024-04-26 15:50:30.894680] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.386 qpair failed and we were unable to recover it. 00:21:32.386 [2024-04-26 15:50:30.904299] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.386 [2024-04-26 15:50:30.904336] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.386 [2024-04-26 15:50:30.904349] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.386 [2024-04-26 15:50:30.904355] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.386 [2024-04-26 15:50:30.904361] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.386 [2024-04-26 15:50:30.914557] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.386 qpair failed and we were unable to recover it. 00:21:32.386 [2024-04-26 15:50:30.924380] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.386 [2024-04-26 15:50:30.924419] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.386 [2024-04-26 15:50:30.924434] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.386 [2024-04-26 15:50:30.924440] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.386 [2024-04-26 15:50:30.924446] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.386 [2024-04-26 15:50:30.934732] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.386 qpair failed and we were unable to recover it. 00:21:32.386 [2024-04-26 15:50:30.944471] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.386 [2024-04-26 15:50:30.944507] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.386 [2024-04-26 15:50:30.944521] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.386 [2024-04-26 15:50:30.944527] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.386 [2024-04-26 15:50:30.944533] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.386 [2024-04-26 15:50:30.954792] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.386 qpair failed and we were unable to recover it. 00:21:32.386 [2024-04-26 15:50:30.964469] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.386 [2024-04-26 15:50:30.964507] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.386 [2024-04-26 15:50:30.964524] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.386 [2024-04-26 15:50:30.964531] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.386 [2024-04-26 15:50:30.964536] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.386 [2024-04-26 15:50:30.974991] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.386 qpair failed and we were unable to recover it. 00:21:32.386 [2024-04-26 15:50:30.984574] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.386 [2024-04-26 15:50:30.984613] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.386 [2024-04-26 15:50:30.984627] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.386 [2024-04-26 15:50:30.984634] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.386 [2024-04-26 15:50:30.984639] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.643 [2024-04-26 15:50:30.994883] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.643 qpair failed and we were unable to recover it. 00:21:32.643 [2024-04-26 15:50:31.004692] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.643 [2024-04-26 15:50:31.004730] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.643 [2024-04-26 15:50:31.004746] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.643 [2024-04-26 15:50:31.004753] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.643 [2024-04-26 15:50:31.004759] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.643 [2024-04-26 15:50:31.015159] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.643 qpair failed and we were unable to recover it. 00:21:32.643 [2024-04-26 15:50:31.024733] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.643 [2024-04-26 15:50:31.024773] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.643 [2024-04-26 15:50:31.024787] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.643 [2024-04-26 15:50:31.024793] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.643 [2024-04-26 15:50:31.024798] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.643 [2024-04-26 15:50:31.035082] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.643 qpair failed and we were unable to recover it. 00:21:32.643 [2024-04-26 15:50:31.044812] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.643 [2024-04-26 15:50:31.044849] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.643 [2024-04-26 15:50:31.044863] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.643 [2024-04-26 15:50:31.044869] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.643 [2024-04-26 15:50:31.044875] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.643 [2024-04-26 15:50:31.055129] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.643 qpair failed and we were unable to recover it. 00:21:32.643 [2024-04-26 15:50:31.064814] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.643 [2024-04-26 15:50:31.064852] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.643 [2024-04-26 15:50:31.064865] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.643 [2024-04-26 15:50:31.064872] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.643 [2024-04-26 15:50:31.064877] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.643 [2024-04-26 15:50:31.075083] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.643 qpair failed and we were unable to recover it. 00:21:32.643 [2024-04-26 15:50:31.084835] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.643 [2024-04-26 15:50:31.084870] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.643 [2024-04-26 15:50:31.084884] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.643 [2024-04-26 15:50:31.084891] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.643 [2024-04-26 15:50:31.084897] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.643 [2024-04-26 15:50:31.095361] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.643 qpair failed and we were unable to recover it. 00:21:32.643 [2024-04-26 15:50:31.104934] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.643 [2024-04-26 15:50:31.104972] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.643 [2024-04-26 15:50:31.104985] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.643 [2024-04-26 15:50:31.104991] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.643 [2024-04-26 15:50:31.104997] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.643 [2024-04-26 15:50:31.115292] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.643 qpair failed and we were unable to recover it. 00:21:32.643 [2024-04-26 15:50:31.124946] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.643 [2024-04-26 15:50:31.124984] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.643 [2024-04-26 15:50:31.124998] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.643 [2024-04-26 15:50:31.125004] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.643 [2024-04-26 15:50:31.125010] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.643 [2024-04-26 15:50:31.135415] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.643 qpair failed and we were unable to recover it. 00:21:32.643 [2024-04-26 15:50:31.145031] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.643 [2024-04-26 15:50:31.145071] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.643 [2024-04-26 15:50:31.145085] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.643 [2024-04-26 15:50:31.145091] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.643 [2024-04-26 15:50:31.145097] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.643 [2024-04-26 15:50:31.155391] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.643 qpair failed and we were unable to recover it. 00:21:32.643 [2024-04-26 15:50:31.164962] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.643 [2024-04-26 15:50:31.164998] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.643 [2024-04-26 15:50:31.165012] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.643 [2024-04-26 15:50:31.165018] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.643 [2024-04-26 15:50:31.165024] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.643 [2024-04-26 15:50:31.175898] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.643 qpair failed and we were unable to recover it. 00:21:32.643 [2024-04-26 15:50:31.185148] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.643 [2024-04-26 15:50:31.185195] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.644 [2024-04-26 15:50:31.185209] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.644 [2024-04-26 15:50:31.185216] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.644 [2024-04-26 15:50:31.185221] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.644 [2024-04-26 15:50:31.195529] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.644 qpair failed and we were unable to recover it. 00:21:32.644 [2024-04-26 15:50:31.205249] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.644 [2024-04-26 15:50:31.205285] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.644 [2024-04-26 15:50:31.205299] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.644 [2024-04-26 15:50:31.205306] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.644 [2024-04-26 15:50:31.205311] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.644 [2024-04-26 15:50:31.215906] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.644 qpair failed and we were unable to recover it. 00:21:32.644 [2024-04-26 15:50:31.225268] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.644 [2024-04-26 15:50:31.225306] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.644 [2024-04-26 15:50:31.225320] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.644 [2024-04-26 15:50:31.225329] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.644 [2024-04-26 15:50:31.225335] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.644 [2024-04-26 15:50:31.235732] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.644 qpair failed and we were unable to recover it. 00:21:32.644 [2024-04-26 15:50:31.245367] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.644 [2024-04-26 15:50:31.245407] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.644 [2024-04-26 15:50:31.245424] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.644 [2024-04-26 15:50:31.245431] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.644 [2024-04-26 15:50:31.245437] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.901 [2024-04-26 15:50:31.255847] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.901 qpair failed and we were unable to recover it. 00:21:32.901 [2024-04-26 15:50:31.265496] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.901 [2024-04-26 15:50:31.265534] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.901 [2024-04-26 15:50:31.265549] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.901 [2024-04-26 15:50:31.265555] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.901 [2024-04-26 15:50:31.265561] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.901 [2024-04-26 15:50:31.275778] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.901 qpair failed and we were unable to recover it. 00:21:32.901 [2024-04-26 15:50:31.285509] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.901 [2024-04-26 15:50:31.285548] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.901 [2024-04-26 15:50:31.285563] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.901 [2024-04-26 15:50:31.285569] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.901 [2024-04-26 15:50:31.285575] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.901 [2024-04-26 15:50:31.296048] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.901 qpair failed and we were unable to recover it. 00:21:32.901 [2024-04-26 15:50:31.305523] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.901 [2024-04-26 15:50:31.305561] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.901 [2024-04-26 15:50:31.305575] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.901 [2024-04-26 15:50:31.305582] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.901 [2024-04-26 15:50:31.305587] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.901 [2024-04-26 15:50:31.315898] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.901 qpair failed and we were unable to recover it. 00:21:32.902 [2024-04-26 15:50:31.325668] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.902 [2024-04-26 15:50:31.325706] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.902 [2024-04-26 15:50:31.325720] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.902 [2024-04-26 15:50:31.325727] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.902 [2024-04-26 15:50:31.325733] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.902 [2024-04-26 15:50:31.335975] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.902 qpair failed and we were unable to recover it. 00:21:32.902 [2024-04-26 15:50:31.345667] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.902 [2024-04-26 15:50:31.345707] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.902 [2024-04-26 15:50:31.345721] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.902 [2024-04-26 15:50:31.345728] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.902 [2024-04-26 15:50:31.345734] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.902 [2024-04-26 15:50:31.356192] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.902 qpair failed and we were unable to recover it. 00:21:32.902 [2024-04-26 15:50:31.365691] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.902 [2024-04-26 15:50:31.365727] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.902 [2024-04-26 15:50:31.365741] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.902 [2024-04-26 15:50:31.365747] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.902 [2024-04-26 15:50:31.365753] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.902 [2024-04-26 15:50:31.376021] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.902 qpair failed and we were unable to recover it. 00:21:32.902 [2024-04-26 15:50:31.385798] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.902 [2024-04-26 15:50:31.385833] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.902 [2024-04-26 15:50:31.385847] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.902 [2024-04-26 15:50:31.385853] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.902 [2024-04-26 15:50:31.385859] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.902 [2024-04-26 15:50:31.396240] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.902 qpair failed and we were unable to recover it. 00:21:32.902 [2024-04-26 15:50:31.405835] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.902 [2024-04-26 15:50:31.405872] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.902 [2024-04-26 15:50:31.405889] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.902 [2024-04-26 15:50:31.405895] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.902 [2024-04-26 15:50:31.405901] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.902 [2024-04-26 15:50:31.416329] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.902 qpair failed and we were unable to recover it. 00:21:32.902 [2024-04-26 15:50:31.425870] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.902 [2024-04-26 15:50:31.425913] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.902 [2024-04-26 15:50:31.425926] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.902 [2024-04-26 15:50:31.425932] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.902 [2024-04-26 15:50:31.425938] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.902 [2024-04-26 15:50:31.436183] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.902 qpair failed and we were unable to recover it. 00:21:32.902 [2024-04-26 15:50:31.445875] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.902 [2024-04-26 15:50:31.445913] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.902 [2024-04-26 15:50:31.445926] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.902 [2024-04-26 15:50:31.445932] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.902 [2024-04-26 15:50:31.445938] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.902 [2024-04-26 15:50:31.456439] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.902 qpair failed and we were unable to recover it. 00:21:32.902 [2024-04-26 15:50:31.465975] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.902 [2024-04-26 15:50:31.466009] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.902 [2024-04-26 15:50:31.466023] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.902 [2024-04-26 15:50:31.466029] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.902 [2024-04-26 15:50:31.466035] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.902 [2024-04-26 15:50:31.476465] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.902 qpair failed and we were unable to recover it. 00:21:32.902 [2024-04-26 15:50:31.486053] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:32.902 [2024-04-26 15:50:31.486088] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:32.902 [2024-04-26 15:50:31.486101] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:32.902 [2024-04-26 15:50:31.486108] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:32.902 [2024-04-26 15:50:31.486114] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:32.902 [2024-04-26 15:50:31.496781] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:32.902 qpair failed and we were unable to recover it. 00:21:33.160 [2024-04-26 15:50:31.506089] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.161 [2024-04-26 15:50:31.506127] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.161 [2024-04-26 15:50:31.506149] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.161 [2024-04-26 15:50:31.506157] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.161 [2024-04-26 15:50:31.506162] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.161 [2024-04-26 15:50:31.516629] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.161 qpair failed and we were unable to recover it. 00:21:33.161 [2024-04-26 15:50:31.526268] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.161 [2024-04-26 15:50:31.526309] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.161 [2024-04-26 15:50:31.526323] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.161 [2024-04-26 15:50:31.526330] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.161 [2024-04-26 15:50:31.526336] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.161 [2024-04-26 15:50:31.536657] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.161 qpair failed and we were unable to recover it. 00:21:33.161 [2024-04-26 15:50:31.546213] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.161 [2024-04-26 15:50:31.546253] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.161 [2024-04-26 15:50:31.546267] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.161 [2024-04-26 15:50:31.546274] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.161 [2024-04-26 15:50:31.546280] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.161 [2024-04-26 15:50:31.556723] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.161 qpair failed and we were unable to recover it. 00:21:33.161 [2024-04-26 15:50:31.566279] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.161 [2024-04-26 15:50:31.566315] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.161 [2024-04-26 15:50:31.566328] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.161 [2024-04-26 15:50:31.566335] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.161 [2024-04-26 15:50:31.566341] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.161 [2024-04-26 15:50:31.576831] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.161 qpair failed and we were unable to recover it. 00:21:33.161 [2024-04-26 15:50:31.586468] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.161 [2024-04-26 15:50:31.586508] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.161 [2024-04-26 15:50:31.586521] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.161 [2024-04-26 15:50:31.586528] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.161 [2024-04-26 15:50:31.586533] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.161 [2024-04-26 15:50:31.597020] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.161 qpair failed and we were unable to recover it. 00:21:33.161 [2024-04-26 15:50:31.606445] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.161 [2024-04-26 15:50:31.606485] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.161 [2024-04-26 15:50:31.606499] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.161 [2024-04-26 15:50:31.606505] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.161 [2024-04-26 15:50:31.606511] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.161 [2024-04-26 15:50:31.617024] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.161 qpair failed and we were unable to recover it. 00:21:33.161 [2024-04-26 15:50:31.626641] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.161 [2024-04-26 15:50:31.626679] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.161 [2024-04-26 15:50:31.626692] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.161 [2024-04-26 15:50:31.626699] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.161 [2024-04-26 15:50:31.626705] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.161 [2024-04-26 15:50:31.636913] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.161 qpair failed and we were unable to recover it. 00:21:33.161 [2024-04-26 15:50:31.646570] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.161 [2024-04-26 15:50:31.646609] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.161 [2024-04-26 15:50:31.646622] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.161 [2024-04-26 15:50:31.646628] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.161 [2024-04-26 15:50:31.646635] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.161 [2024-04-26 15:50:31.656919] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.161 qpair failed and we were unable to recover it. 00:21:33.161 [2024-04-26 15:50:31.666586] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.161 [2024-04-26 15:50:31.666629] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.161 [2024-04-26 15:50:31.666644] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.161 [2024-04-26 15:50:31.666653] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.161 [2024-04-26 15:50:31.666659] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.161 [2024-04-26 15:50:31.677055] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.161 qpair failed and we were unable to recover it. 00:21:33.161 [2024-04-26 15:50:31.686734] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.161 [2024-04-26 15:50:31.686767] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.161 [2024-04-26 15:50:31.686781] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.161 [2024-04-26 15:50:31.686788] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.161 [2024-04-26 15:50:31.686794] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.161 [2024-04-26 15:50:31.696988] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.161 qpair failed and we were unable to recover it. 00:21:33.161 [2024-04-26 15:50:31.706782] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.161 [2024-04-26 15:50:31.706821] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.161 [2024-04-26 15:50:31.706835] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.161 [2024-04-26 15:50:31.706841] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.161 [2024-04-26 15:50:31.706847] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.161 [2024-04-26 15:50:31.717145] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.161 qpair failed and we were unable to recover it. 00:21:33.161 [2024-04-26 15:50:31.726680] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.161 [2024-04-26 15:50:31.726717] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.161 [2024-04-26 15:50:31.726730] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.161 [2024-04-26 15:50:31.726736] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.161 [2024-04-26 15:50:31.726742] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.161 [2024-04-26 15:50:31.737123] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.161 qpair failed and we were unable to recover it. 00:21:33.161 [2024-04-26 15:50:31.746843] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.161 [2024-04-26 15:50:31.746885] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.161 [2024-04-26 15:50:31.746898] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.161 [2024-04-26 15:50:31.746904] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.161 [2024-04-26 15:50:31.746910] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.161 [2024-04-26 15:50:31.757195] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.161 qpair failed and we were unable to recover it. 00:21:33.419 [2024-04-26 15:50:31.766907] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.419 [2024-04-26 15:50:31.766948] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.419 [2024-04-26 15:50:31.766966] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.419 [2024-04-26 15:50:31.766972] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.419 [2024-04-26 15:50:31.766978] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.419 [2024-04-26 15:50:31.777286] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.419 qpair failed and we were unable to recover it. 00:21:33.419 [2024-04-26 15:50:31.786932] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.419 [2024-04-26 15:50:31.786967] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.419 [2024-04-26 15:50:31.786981] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.419 [2024-04-26 15:50:31.786988] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.419 [2024-04-26 15:50:31.786993] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.419 [2024-04-26 15:50:31.797309] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.419 qpair failed and we were unable to recover it. 00:21:33.419 [2024-04-26 15:50:31.807000] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.419 [2024-04-26 15:50:31.807041] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.419 [2024-04-26 15:50:31.807054] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.419 [2024-04-26 15:50:31.807060] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.419 [2024-04-26 15:50:31.807066] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.419 [2024-04-26 15:50:31.817338] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.419 qpair failed and we were unable to recover it. 00:21:33.419 [2024-04-26 15:50:31.827122] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.419 [2024-04-26 15:50:31.827167] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.419 [2024-04-26 15:50:31.827181] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.419 [2024-04-26 15:50:31.827187] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.420 [2024-04-26 15:50:31.827193] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.420 [2024-04-26 15:50:31.837614] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.420 qpair failed and we were unable to recover it. 00:21:33.420 [2024-04-26 15:50:31.847215] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.420 [2024-04-26 15:50:31.847246] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.420 [2024-04-26 15:50:31.847263] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.420 [2024-04-26 15:50:31.847270] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.420 [2024-04-26 15:50:31.847275] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.420 [2024-04-26 15:50:31.857666] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.420 qpair failed and we were unable to recover it. 00:21:33.420 [2024-04-26 15:50:31.867235] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.420 [2024-04-26 15:50:31.867274] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.420 [2024-04-26 15:50:31.867287] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.420 [2024-04-26 15:50:31.867294] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.420 [2024-04-26 15:50:31.867299] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.420 [2024-04-26 15:50:31.877696] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.420 qpair failed and we were unable to recover it. 00:21:33.420 [2024-04-26 15:50:31.887263] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.420 [2024-04-26 15:50:31.887299] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.420 [2024-04-26 15:50:31.887313] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.420 [2024-04-26 15:50:31.887319] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.420 [2024-04-26 15:50:31.887325] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.420 [2024-04-26 15:50:31.897667] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.420 qpair failed and we were unable to recover it. 00:21:33.420 [2024-04-26 15:50:31.907394] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.420 [2024-04-26 15:50:31.907433] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.420 [2024-04-26 15:50:31.907446] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.420 [2024-04-26 15:50:31.907453] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.420 [2024-04-26 15:50:31.907458] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.420 [2024-04-26 15:50:31.917631] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.420 qpair failed and we were unable to recover it. 00:21:33.420 [2024-04-26 15:50:31.927511] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.420 [2024-04-26 15:50:31.927549] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.420 [2024-04-26 15:50:31.927563] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.420 [2024-04-26 15:50:31.927569] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.420 [2024-04-26 15:50:31.927575] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.420 [2024-04-26 15:50:31.937887] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.420 qpair failed and we were unable to recover it. 00:21:33.420 [2024-04-26 15:50:31.947433] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.420 [2024-04-26 15:50:31.947466] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.420 [2024-04-26 15:50:31.947480] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.420 [2024-04-26 15:50:31.947487] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.420 [2024-04-26 15:50:31.947492] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.420 [2024-04-26 15:50:31.957837] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.420 qpair failed and we were unable to recover it. 00:21:33.420 [2024-04-26 15:50:31.967487] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.420 [2024-04-26 15:50:31.967524] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.420 [2024-04-26 15:50:31.967537] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.420 [2024-04-26 15:50:31.967544] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.420 [2024-04-26 15:50:31.967549] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.420 [2024-04-26 15:50:31.978059] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.420 qpair failed and we were unable to recover it. 00:21:33.420 [2024-04-26 15:50:31.987535] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.420 [2024-04-26 15:50:31.987574] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.420 [2024-04-26 15:50:31.987587] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.420 [2024-04-26 15:50:31.987594] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.420 [2024-04-26 15:50:31.987599] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.420 [2024-04-26 15:50:31.998078] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.420 qpair failed and we were unable to recover it. 00:21:33.420 [2024-04-26 15:50:32.007616] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.420 [2024-04-26 15:50:32.007653] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.420 [2024-04-26 15:50:32.007667] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.420 [2024-04-26 15:50:32.007673] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.420 [2024-04-26 15:50:32.007679] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.420 [2024-04-26 15:50:32.018017] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.420 qpair failed and we were unable to recover it. 00:21:33.678 [2024-04-26 15:50:32.027659] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.678 [2024-04-26 15:50:32.027697] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.678 [2024-04-26 15:50:32.027715] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.678 [2024-04-26 15:50:32.027722] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.678 [2024-04-26 15:50:32.027728] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.678 [2024-04-26 15:50:32.038199] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.678 qpair failed and we were unable to recover it. 00:21:33.678 [2024-04-26 15:50:32.047703] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.678 [2024-04-26 15:50:32.047739] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.678 [2024-04-26 15:50:32.047754] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.678 [2024-04-26 15:50:32.047760] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.678 [2024-04-26 15:50:32.047766] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.678 [2024-04-26 15:50:32.058288] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.678 qpair failed and we were unable to recover it. 00:21:33.678 [2024-04-26 15:50:32.067802] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.678 [2024-04-26 15:50:32.067839] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.678 [2024-04-26 15:50:32.067853] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.678 [2024-04-26 15:50:32.067859] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.678 [2024-04-26 15:50:32.067865] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.678 [2024-04-26 15:50:32.078343] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.678 qpair failed and we were unable to recover it. 00:21:33.678 [2024-04-26 15:50:32.087838] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.678 [2024-04-26 15:50:32.087877] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.678 [2024-04-26 15:50:32.087891] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.678 [2024-04-26 15:50:32.087897] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.678 [2024-04-26 15:50:32.087903] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.678 [2024-04-26 15:50:32.098205] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.678 qpair failed and we were unable to recover it. 00:21:33.678 [2024-04-26 15:50:32.107906] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.678 [2024-04-26 15:50:32.107939] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.678 [2024-04-26 15:50:32.107952] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.678 [2024-04-26 15:50:32.107962] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.678 [2024-04-26 15:50:32.107968] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.678 [2024-04-26 15:50:32.118515] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.678 qpair failed and we were unable to recover it. 00:21:33.678 [2024-04-26 15:50:32.127962] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.678 [2024-04-26 15:50:32.127997] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.678 [2024-04-26 15:50:32.128011] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.678 [2024-04-26 15:50:32.128018] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.678 [2024-04-26 15:50:32.128024] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.678 [2024-04-26 15:50:32.138399] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.678 qpair failed and we were unable to recover it. 00:21:33.678 [2024-04-26 15:50:32.147987] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.678 [2024-04-26 15:50:32.148023] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.678 [2024-04-26 15:50:32.148038] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.678 [2024-04-26 15:50:32.148044] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.678 [2024-04-26 15:50:32.148050] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.678 [2024-04-26 15:50:32.158571] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.678 qpair failed and we were unable to recover it. 00:21:33.678 [2024-04-26 15:50:32.168111] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.678 [2024-04-26 15:50:32.168152] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.678 [2024-04-26 15:50:32.168166] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.678 [2024-04-26 15:50:32.168172] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.678 [2024-04-26 15:50:32.168178] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.678 [2024-04-26 15:50:32.178384] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.678 qpair failed and we were unable to recover it. 00:21:33.678 [2024-04-26 15:50:32.188163] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.678 [2024-04-26 15:50:32.188199] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.678 [2024-04-26 15:50:32.188212] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.678 [2024-04-26 15:50:32.188219] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.678 [2024-04-26 15:50:32.188225] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.678 [2024-04-26 15:50:32.198695] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.678 qpair failed and we were unable to recover it. 00:21:33.678 [2024-04-26 15:50:32.208176] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.678 [2024-04-26 15:50:32.208212] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.678 [2024-04-26 15:50:32.208226] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.678 [2024-04-26 15:50:32.208233] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.678 [2024-04-26 15:50:32.208238] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.678 [2024-04-26 15:50:32.218703] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.678 qpair failed and we were unable to recover it. 00:21:33.678 [2024-04-26 15:50:32.228318] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.678 [2024-04-26 15:50:32.228355] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.678 [2024-04-26 15:50:32.228368] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.678 [2024-04-26 15:50:32.228375] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.678 [2024-04-26 15:50:32.228380] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.678 [2024-04-26 15:50:32.238612] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.678 qpair failed and we were unable to recover it. 00:21:33.678 [2024-04-26 15:50:32.248386] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.678 [2024-04-26 15:50:32.248431] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.678 [2024-04-26 15:50:32.248446] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.678 [2024-04-26 15:50:32.248452] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.678 [2024-04-26 15:50:32.248458] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.678 [2024-04-26 15:50:32.258779] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.678 qpair failed and we were unable to recover it. 00:21:33.678 [2024-04-26 15:50:32.268316] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.678 [2024-04-26 15:50:32.268349] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.678 [2024-04-26 15:50:32.268363] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.678 [2024-04-26 15:50:32.268369] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.678 [2024-04-26 15:50:32.268375] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.679 [2024-04-26 15:50:32.278784] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.679 qpair failed and we were unable to recover it. 00:21:33.939 [2024-04-26 15:50:32.288502] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.939 [2024-04-26 15:50:32.288542] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.939 [2024-04-26 15:50:32.288564] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.939 [2024-04-26 15:50:32.288571] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.939 [2024-04-26 15:50:32.288577] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.939 [2024-04-26 15:50:32.298854] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.939 qpair failed and we were unable to recover it. 00:21:33.939 [2024-04-26 15:50:32.308523] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.939 [2024-04-26 15:50:32.308562] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.939 [2024-04-26 15:50:32.308577] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.939 [2024-04-26 15:50:32.308584] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.939 [2024-04-26 15:50:32.308589] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.939 [2024-04-26 15:50:32.318973] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.939 qpair failed and we were unable to recover it. 00:21:33.939 [2024-04-26 15:50:32.328692] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.939 [2024-04-26 15:50:32.328724] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.939 [2024-04-26 15:50:32.328739] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.939 [2024-04-26 15:50:32.328745] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.939 [2024-04-26 15:50:32.328751] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.939 [2024-04-26 15:50:32.339020] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.939 qpair failed and we were unable to recover it. 00:21:33.939 [2024-04-26 15:50:32.348663] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.939 [2024-04-26 15:50:32.348698] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.939 [2024-04-26 15:50:32.348711] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.939 [2024-04-26 15:50:32.348718] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.939 [2024-04-26 15:50:32.348724] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.939 [2024-04-26 15:50:32.359123] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.939 qpair failed and we were unable to recover it. 00:21:33.939 [2024-04-26 15:50:32.368759] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.939 [2024-04-26 15:50:32.368800] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.939 [2024-04-26 15:50:32.368814] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.939 [2024-04-26 15:50:32.368820] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.939 [2024-04-26 15:50:32.368826] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.939 [2024-04-26 15:50:32.379075] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.939 qpair failed and we were unable to recover it. 00:21:33.939 [2024-04-26 15:50:32.388862] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.939 [2024-04-26 15:50:32.388901] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.939 [2024-04-26 15:50:32.388915] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.939 [2024-04-26 15:50:32.388923] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.939 [2024-04-26 15:50:32.388930] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.939 [2024-04-26 15:50:32.399267] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.939 qpair failed and we were unable to recover it. 00:21:33.939 [2024-04-26 15:50:32.408837] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.939 [2024-04-26 15:50:32.408871] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.939 [2024-04-26 15:50:32.408885] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.939 [2024-04-26 15:50:32.408892] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.939 [2024-04-26 15:50:32.408898] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.939 [2024-04-26 15:50:32.419357] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.939 qpair failed and we were unable to recover it. 00:21:33.939 [2024-04-26 15:50:32.428971] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.939 [2024-04-26 15:50:32.429010] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.939 [2024-04-26 15:50:32.429024] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.939 [2024-04-26 15:50:32.429031] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.939 [2024-04-26 15:50:32.429037] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.939 [2024-04-26 15:50:32.439431] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.939 qpair failed and we were unable to recover it. 00:21:33.939 [2024-04-26 15:50:32.449023] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.939 [2024-04-26 15:50:32.449060] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.939 [2024-04-26 15:50:32.449074] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.939 [2024-04-26 15:50:32.449080] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.939 [2024-04-26 15:50:32.449086] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.939 [2024-04-26 15:50:32.459356] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.939 qpair failed and we were unable to recover it. 00:21:33.939 [2024-04-26 15:50:32.469089] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.939 [2024-04-26 15:50:32.469128] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.939 [2024-04-26 15:50:32.469152] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.939 [2024-04-26 15:50:32.469159] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.939 [2024-04-26 15:50:32.469165] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.939 [2024-04-26 15:50:32.479479] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.939 qpair failed and we were unable to recover it. 00:21:33.939 [2024-04-26 15:50:32.489156] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.939 [2024-04-26 15:50:32.489190] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.939 [2024-04-26 15:50:32.489203] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.939 [2024-04-26 15:50:32.489210] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.939 [2024-04-26 15:50:32.489215] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.939 [2024-04-26 15:50:32.499515] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.939 qpair failed and we were unable to recover it. 00:21:33.939 [2024-04-26 15:50:32.509243] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.939 [2024-04-26 15:50:32.509281] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.940 [2024-04-26 15:50:32.509295] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.940 [2024-04-26 15:50:32.509301] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.940 [2024-04-26 15:50:32.509307] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.940 [2024-04-26 15:50:32.519598] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.940 qpair failed and we were unable to recover it. 00:21:33.940 [2024-04-26 15:50:32.529311] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:33.940 [2024-04-26 15:50:32.529349] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:33.940 [2024-04-26 15:50:32.529362] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:33.940 [2024-04-26 15:50:32.529368] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:33.940 [2024-04-26 15:50:32.529374] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:33.940 [2024-04-26 15:50:32.539532] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:33.940 qpair failed and we were unable to recover it. 00:21:34.197 [2024-04-26 15:50:32.549357] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:34.197 [2024-04-26 15:50:32.549401] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:34.197 [2024-04-26 15:50:32.549418] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:34.197 [2024-04-26 15:50:32.549431] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:34.197 [2024-04-26 15:50:32.549437] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:34.197 [2024-04-26 15:50:32.559666] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:34.197 qpair failed and we were unable to recover it. 00:21:34.197 [2024-04-26 15:50:32.569324] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:34.197 [2024-04-26 15:50:32.569367] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:34.197 [2024-04-26 15:50:32.569382] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:34.197 [2024-04-26 15:50:32.569389] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:34.197 [2024-04-26 15:50:32.569394] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:34.197 [2024-04-26 15:50:32.579637] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:34.197 qpair failed and we were unable to recover it. 00:21:34.197 [2024-04-26 15:50:32.589454] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:34.197 [2024-04-26 15:50:32.589491] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:34.197 [2024-04-26 15:50:32.589505] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:34.197 [2024-04-26 15:50:32.589511] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:34.197 [2024-04-26 15:50:32.589517] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:34.197 [2024-04-26 15:50:32.599740] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:34.197 qpair failed and we were unable to recover it. 00:21:35.212 Read completed with error (sct=0, sc=8) 00:21:35.212 starting I/O failed 00:21:35.212 Read completed with error (sct=0, sc=8) 00:21:35.212 starting I/O failed 00:21:35.212 Write completed with error (sct=0, sc=8) 00:21:35.212 starting I/O failed 00:21:35.212 Write completed with error (sct=0, sc=8) 00:21:35.212 starting I/O failed 00:21:35.212 Read completed with error (sct=0, sc=8) 00:21:35.212 starting I/O failed 00:21:35.212 Read completed with error (sct=0, sc=8) 00:21:35.212 starting I/O failed 00:21:35.212 Read completed with error (sct=0, sc=8) 00:21:35.212 starting I/O failed 00:21:35.212 Write completed with error (sct=0, sc=8) 00:21:35.212 starting I/O failed 00:21:35.212 Read completed with error (sct=0, sc=8) 00:21:35.212 starting I/O failed 00:21:35.212 Read completed with error (sct=0, sc=8) 00:21:35.212 starting I/O failed 00:21:35.212 Write completed with error (sct=0, sc=8) 00:21:35.212 starting I/O failed 00:21:35.212 Write completed with error (sct=0, sc=8) 00:21:35.212 starting I/O failed 00:21:35.212 Read completed with error (sct=0, sc=8) 00:21:35.212 starting I/O failed 00:21:35.212 Write completed with error (sct=0, sc=8) 00:21:35.212 starting I/O failed 00:21:35.212 Write completed with error (sct=0, sc=8) 00:21:35.212 starting I/O failed 00:21:35.212 Read completed with error (sct=0, sc=8) 00:21:35.212 starting I/O failed 00:21:35.212 Write completed with error (sct=0, sc=8) 00:21:35.212 starting I/O failed 00:21:35.212 Write completed with error (sct=0, sc=8) 00:21:35.212 starting I/O failed 00:21:35.212 Write completed with error (sct=0, sc=8) 00:21:35.212 starting I/O failed 00:21:35.212 Read completed with error (sct=0, sc=8) 00:21:35.212 starting I/O failed 00:21:35.212 Write completed with error (sct=0, sc=8) 00:21:35.212 starting I/O failed 00:21:35.212 Read completed with error (sct=0, sc=8) 00:21:35.212 starting I/O failed 00:21:35.212 Read completed with error (sct=0, sc=8) 00:21:35.212 starting I/O failed 00:21:35.212 Write completed with error (sct=0, sc=8) 00:21:35.212 starting I/O failed 00:21:35.212 Read completed with error (sct=0, sc=8) 00:21:35.212 starting I/O failed 00:21:35.212 Write completed with error (sct=0, sc=8) 00:21:35.212 starting I/O failed 00:21:35.212 Write completed with error (sct=0, sc=8) 00:21:35.213 starting I/O failed 00:21:35.213 Read completed with error (sct=0, sc=8) 00:21:35.213 starting I/O failed 00:21:35.213 Read completed with error (sct=0, sc=8) 00:21:35.213 starting I/O failed 00:21:35.213 Write completed with error (sct=0, sc=8) 00:21:35.213 starting I/O failed 00:21:35.213 Read completed with error (sct=0, sc=8) 00:21:35.213 starting I/O failed 00:21:35.213 Write completed with error (sct=0, sc=8) 00:21:35.213 starting I/O failed 00:21:35.213 [2024-04-26 15:50:33.604994] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:21:36.156 Read completed with error (sct=0, sc=8) 00:21:36.156 starting I/O failed 00:21:36.156 Write completed with error (sct=0, sc=8) 00:21:36.156 starting I/O failed 00:21:36.156 Write completed with error (sct=0, sc=8) 00:21:36.156 starting I/O failed 00:21:36.156 Read completed with error (sct=0, sc=8) 00:21:36.156 starting I/O failed 00:21:36.156 Write completed with error (sct=0, sc=8) 00:21:36.156 starting I/O failed 00:21:36.156 Read completed with error (sct=0, sc=8) 00:21:36.156 starting I/O failed 00:21:36.156 Write completed with error (sct=0, sc=8) 00:21:36.156 starting I/O failed 00:21:36.156 Read completed with error (sct=0, sc=8) 00:21:36.156 starting I/O failed 00:21:36.156 Write completed with error (sct=0, sc=8) 00:21:36.156 starting I/O failed 00:21:36.156 Write completed with error (sct=0, sc=8) 00:21:36.156 starting I/O failed 00:21:36.156 Read completed with error (sct=0, sc=8) 00:21:36.156 starting I/O failed 00:21:36.156 Write completed with error (sct=0, sc=8) 00:21:36.156 starting I/O failed 00:21:36.156 Read completed with error (sct=0, sc=8) 00:21:36.156 starting I/O failed 00:21:36.156 Read completed with error (sct=0, sc=8) 00:21:36.156 starting I/O failed 00:21:36.156 Read completed with error (sct=0, sc=8) 00:21:36.156 starting I/O failed 00:21:36.156 Read completed with error (sct=0, sc=8) 00:21:36.156 starting I/O failed 00:21:36.156 Read completed with error (sct=0, sc=8) 00:21:36.157 starting I/O failed 00:21:36.157 Write completed with error (sct=0, sc=8) 00:21:36.157 starting I/O failed 00:21:36.157 Write completed with error (sct=0, sc=8) 00:21:36.157 starting I/O failed 00:21:36.157 Write completed with error (sct=0, sc=8) 00:21:36.157 starting I/O failed 00:21:36.157 Read completed with error (sct=0, sc=8) 00:21:36.157 starting I/O failed 00:21:36.157 Write completed with error (sct=0, sc=8) 00:21:36.157 starting I/O failed 00:21:36.157 Read completed with error (sct=0, sc=8) 00:21:36.157 starting I/O failed 00:21:36.157 Write completed with error (sct=0, sc=8) 00:21:36.157 starting I/O failed 00:21:36.157 Read completed with error (sct=0, sc=8) 00:21:36.157 starting I/O failed 00:21:36.157 Read completed with error (sct=0, sc=8) 00:21:36.157 starting I/O failed 00:21:36.157 Read completed with error (sct=0, sc=8) 00:21:36.157 starting I/O failed 00:21:36.157 Write completed with error (sct=0, sc=8) 00:21:36.157 starting I/O failed 00:21:36.157 Read completed with error (sct=0, sc=8) 00:21:36.157 starting I/O failed 00:21:36.157 Read completed with error (sct=0, sc=8) 00:21:36.157 starting I/O failed 00:21:36.157 Read completed with error (sct=0, sc=8) 00:21:36.157 starting I/O failed 00:21:36.157 Write completed with error (sct=0, sc=8) 00:21:36.157 starting I/O failed 00:21:36.157 [2024-04-26 15:50:34.609911] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.157 [2024-04-26 15:50:34.615109] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.157 [2024-04-26 15:50:34.615157] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.157 [2024-04-26 15:50:34.615175] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.157 [2024-04-26 15:50:34.615182] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.157 [2024-04-26 15:50:34.615189] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:21:36.157 [2024-04-26 15:50:34.625797] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.157 qpair failed and we were unable to recover it. 00:21:36.157 [2024-04-26 15:50:34.635488] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.157 [2024-04-26 15:50:34.635530] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.157 [2024-04-26 15:50:34.635547] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.157 [2024-04-26 15:50:34.635555] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.157 [2024-04-26 15:50:34.635561] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:21:36.157 [2024-04-26 15:50:34.645907] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:36.157 qpair failed and we were unable to recover it. 00:21:36.157 [2024-04-26 15:50:34.655638] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.157 [2024-04-26 15:50:34.655683] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.157 [2024-04-26 15:50:34.655710] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.157 [2024-04-26 15:50:34.655723] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.157 [2024-04-26 15:50:34.655732] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000002d15c0 00:21:36.157 [2024-04-26 15:50:34.665992] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:21:36.157 qpair failed and we were unable to recover it. 00:21:36.157 [2024-04-26 15:50:34.675550] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.157 [2024-04-26 15:50:34.675588] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.157 [2024-04-26 15:50:34.675603] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.157 [2024-04-26 15:50:34.675610] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.157 [2024-04-26 15:50:34.675616] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000002d15c0 00:21:36.157 [2024-04-26 15:50:34.686074] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:21:36.157 qpair failed and we were unable to recover it. 00:21:36.157 [2024-04-26 15:50:34.695621] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.157 [2024-04-26 15:50:34.695660] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.157 [2024-04-26 15:50:34.695679] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.157 [2024-04-26 15:50:34.695687] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.157 [2024-04-26 15:50:34.695693] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:21:36.157 [2024-04-26 15:50:34.706078] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:36.157 qpair failed and we were unable to recover it. 00:21:36.157 [2024-04-26 15:50:34.715591] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:21:36.157 [2024-04-26 15:50:34.715629] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:21:36.157 [2024-04-26 15:50:34.715644] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:21:36.157 [2024-04-26 15:50:34.715651] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:21:36.157 [2024-04-26 15:50:34.715658] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:21:36.157 [2024-04-26 15:50:34.726208] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:36.157 qpair failed and we were unable to recover it. 00:21:36.157 [2024-04-26 15:50:34.726343] nvme_ctrlr.c:4340:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:21:36.157 A controller has encountered a failure and is being reset. 00:21:36.157 [2024-04-26 15:50:34.726454] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:21:36.157 [2024-04-26 15:50:34.757783] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:21:36.415 Controller properly reset. 00:21:36.415 Initializing NVMe Controllers 00:21:36.415 Attaching to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:21:36.415 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:21:36.415 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:21:36.415 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:21:36.415 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:21:36.415 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:21:36.415 Initialization complete. Launching workers. 00:21:36.415 Starting thread on core 1 00:21:36.415 Starting thread on core 2 00:21:36.415 Starting thread on core 3 00:21:36.415 Starting thread on core 0 00:21:36.415 15:50:34 -- host/target_disconnect.sh@59 -- # sync 00:21:36.415 00:21:36.415 real 0m13.522s 00:21:36.415 user 0m27.568s 00:21:36.415 sys 0m2.405s 00:21:36.415 15:50:34 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:21:36.415 15:50:34 -- common/autotest_common.sh@10 -- # set +x 00:21:36.415 ************************************ 00:21:36.415 END TEST nvmf_target_disconnect_tc2 00:21:36.415 ************************************ 00:21:36.415 15:50:34 -- host/target_disconnect.sh@80 -- # '[' -n 192.168.100.9 ']' 00:21:36.415 15:50:34 -- host/target_disconnect.sh@81 -- # run_test nvmf_target_disconnect_tc3 nvmf_target_disconnect_tc3 00:21:36.415 15:50:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:21:36.415 15:50:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:36.415 15:50:34 -- common/autotest_common.sh@10 -- # set +x 00:21:36.415 ************************************ 00:21:36.415 START TEST nvmf_target_disconnect_tc3 00:21:36.415 ************************************ 00:21:36.415 15:50:34 -- common/autotest_common.sh@1111 -- # nvmf_target_disconnect_tc3 00:21:36.415 15:50:34 -- host/target_disconnect.sh@65 -- # reconnectpid=3425024 00:21:36.415 15:50:34 -- host/target_disconnect.sh@67 -- # sleep 2 00:21:36.415 15:50:34 -- host/target_disconnect.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 alt_traddr:192.168.100.9' 00:21:36.672 EAL: No free 2048 kB hugepages reported on node 1 00:21:38.565 15:50:36 -- host/target_disconnect.sh@68 -- # kill -9 3423611 00:21:38.565 15:50:36 -- host/target_disconnect.sh@70 -- # sleep 2 00:21:39.933 Write completed with error (sct=0, sc=8) 00:21:39.933 starting I/O failed 00:21:39.933 Write completed with error (sct=0, sc=8) 00:21:39.933 starting I/O failed 00:21:39.933 Write completed with error (sct=0, sc=8) 00:21:39.933 starting I/O failed 00:21:39.933 Write completed with error (sct=0, sc=8) 00:21:39.933 starting I/O failed 00:21:39.933 Write completed with error (sct=0, sc=8) 00:21:39.933 starting I/O failed 00:21:39.933 Write completed with error (sct=0, sc=8) 00:21:39.933 starting I/O failed 00:21:39.933 Read completed with error (sct=0, sc=8) 00:21:39.933 starting I/O failed 00:21:39.933 Write completed with error (sct=0, sc=8) 00:21:39.933 starting I/O failed 00:21:39.933 Read completed with error (sct=0, sc=8) 00:21:39.933 starting I/O failed 00:21:39.933 Read completed with error (sct=0, sc=8) 00:21:39.933 starting I/O failed 00:21:39.933 Write completed with error (sct=0, sc=8) 00:21:39.933 starting I/O failed 00:21:39.933 Write completed with error (sct=0, sc=8) 00:21:39.933 starting I/O failed 00:21:39.933 Write completed with error (sct=0, sc=8) 00:21:39.933 starting I/O failed 00:21:39.933 Read completed with error (sct=0, sc=8) 00:21:39.933 starting I/O failed 00:21:39.933 Write completed with error (sct=0, sc=8) 00:21:39.933 starting I/O failed 00:21:39.933 Read completed with error (sct=0, sc=8) 00:21:39.933 starting I/O failed 00:21:39.933 Write completed with error (sct=0, sc=8) 00:21:39.933 starting I/O failed 00:21:39.933 Read completed with error (sct=0, sc=8) 00:21:39.933 starting I/O failed 00:21:39.933 Write completed with error (sct=0, sc=8) 00:21:39.933 starting I/O failed 00:21:39.933 Read completed with error (sct=0, sc=8) 00:21:39.933 starting I/O failed 00:21:39.933 Read completed with error (sct=0, sc=8) 00:21:39.933 starting I/O failed 00:21:39.933 Read completed with error (sct=0, sc=8) 00:21:39.933 starting I/O failed 00:21:39.933 Read completed with error (sct=0, sc=8) 00:21:39.933 starting I/O failed 00:21:39.933 Write completed with error (sct=0, sc=8) 00:21:39.933 starting I/O failed 00:21:39.933 Read completed with error (sct=0, sc=8) 00:21:39.933 starting I/O failed 00:21:39.933 Write completed with error (sct=0, sc=8) 00:21:39.933 starting I/O failed 00:21:39.933 Write completed with error (sct=0, sc=8) 00:21:39.933 starting I/O failed 00:21:39.933 Write completed with error (sct=0, sc=8) 00:21:39.933 starting I/O failed 00:21:39.933 Read completed with error (sct=0, sc=8) 00:21:39.933 starting I/O failed 00:21:39.933 Read completed with error (sct=0, sc=8) 00:21:39.933 starting I/O failed 00:21:39.933 Read completed with error (sct=0, sc=8) 00:21:39.933 starting I/O failed 00:21:39.933 Write completed with error (sct=0, sc=8) 00:21:39.933 starting I/O failed 00:21:39.933 [2024-04-26 15:50:38.152625] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:40.496 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 62: 3423611 Killed "${NVMF_APP[@]}" "$@" 00:21:40.496 15:50:38 -- host/target_disconnect.sh@71 -- # disconnect_init 192.168.100.9 00:21:40.496 15:50:38 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:21:40.496 15:50:38 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:21:40.496 15:50:38 -- common/autotest_common.sh@710 -- # xtrace_disable 00:21:40.496 15:50:38 -- common/autotest_common.sh@10 -- # set +x 00:21:40.496 15:50:38 -- nvmf/common.sh@470 -- # nvmfpid=3425717 00:21:40.496 15:50:38 -- nvmf/common.sh@471 -- # waitforlisten 3425717 00:21:40.496 15:50:38 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:21:40.496 15:50:38 -- common/autotest_common.sh@817 -- # '[' -z 3425717 ']' 00:21:40.496 15:50:38 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:40.496 15:50:38 -- common/autotest_common.sh@822 -- # local max_retries=100 00:21:40.496 15:50:38 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:40.496 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:40.496 15:50:38 -- common/autotest_common.sh@826 -- # xtrace_disable 00:21:40.496 15:50:38 -- common/autotest_common.sh@10 -- # set +x 00:21:40.496 [2024-04-26 15:50:39.042105] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:21:40.496 [2024-04-26 15:50:39.042159] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:40.496 EAL: No free 2048 kB hugepages reported on node 1 00:21:40.754 [2024-04-26 15:50:39.111016] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:40.754 Read completed with error (sct=0, sc=8) 00:21:40.754 starting I/O failed 00:21:40.754 Read completed with error (sct=0, sc=8) 00:21:40.754 starting I/O failed 00:21:40.754 Write completed with error (sct=0, sc=8) 00:21:40.754 starting I/O failed 00:21:40.754 Read completed with error (sct=0, sc=8) 00:21:40.754 starting I/O failed 00:21:40.754 Write completed with error (sct=0, sc=8) 00:21:40.754 starting I/O failed 00:21:40.754 Read completed with error (sct=0, sc=8) 00:21:40.754 starting I/O failed 00:21:40.754 Write completed with error (sct=0, sc=8) 00:21:40.754 starting I/O failed 00:21:40.754 Write completed with error (sct=0, sc=8) 00:21:40.754 starting I/O failed 00:21:40.754 Read completed with error (sct=0, sc=8) 00:21:40.754 starting I/O failed 00:21:40.754 Read completed with error (sct=0, sc=8) 00:21:40.754 starting I/O failed 00:21:40.754 Read completed with error (sct=0, sc=8) 00:21:40.754 starting I/O failed 00:21:40.754 Write completed with error (sct=0, sc=8) 00:21:40.754 starting I/O failed 00:21:40.754 Write completed with error (sct=0, sc=8) 00:21:40.754 starting I/O failed 00:21:40.754 Write completed with error (sct=0, sc=8) 00:21:40.754 starting I/O failed 00:21:40.754 Write completed with error (sct=0, sc=8) 00:21:40.754 starting I/O failed 00:21:40.754 Write completed with error (sct=0, sc=8) 00:21:40.754 starting I/O failed 00:21:40.754 Read completed with error (sct=0, sc=8) 00:21:40.754 starting I/O failed 00:21:40.754 Write completed with error (sct=0, sc=8) 00:21:40.754 starting I/O failed 00:21:40.754 Write completed with error (sct=0, sc=8) 00:21:40.754 starting I/O failed 00:21:40.754 Write completed with error (sct=0, sc=8) 00:21:40.754 starting I/O failed 00:21:40.754 Read completed with error (sct=0, sc=8) 00:21:40.754 starting I/O failed 00:21:40.754 Write completed with error (sct=0, sc=8) 00:21:40.754 starting I/O failed 00:21:40.754 Read completed with error (sct=0, sc=8) 00:21:40.754 starting I/O failed 00:21:40.754 Read completed with error (sct=0, sc=8) 00:21:40.754 starting I/O failed 00:21:40.754 Read completed with error (sct=0, sc=8) 00:21:40.754 starting I/O failed 00:21:40.754 Read completed with error (sct=0, sc=8) 00:21:40.754 starting I/O failed 00:21:40.754 Read completed with error (sct=0, sc=8) 00:21:40.754 starting I/O failed 00:21:40.754 Read completed with error (sct=0, sc=8) 00:21:40.754 starting I/O failed 00:21:40.754 Read completed with error (sct=0, sc=8) 00:21:40.754 starting I/O failed 00:21:40.754 Read completed with error (sct=0, sc=8) 00:21:40.754 starting I/O failed 00:21:40.754 Write completed with error (sct=0, sc=8) 00:21:40.754 starting I/O failed 00:21:40.754 Write completed with error (sct=0, sc=8) 00:21:40.754 starting I/O failed 00:21:40.754 [2024-04-26 15:50:39.157609] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:40.754 [2024-04-26 15:50:39.180908] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:40.754 [2024-04-26 15:50:39.180942] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:40.754 [2024-04-26 15:50:39.180948] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:21:40.754 [2024-04-26 15:50:39.180954] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:21:40.754 [2024-04-26 15:50:39.180958] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:40.754 [2024-04-26 15:50:39.181070] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:21:40.754 [2024-04-26 15:50:39.181190] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:21:40.754 [2024-04-26 15:50:39.181292] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:21:40.754 [2024-04-26 15:50:39.181294] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:21:41.320 15:50:39 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:21:41.320 15:50:39 -- common/autotest_common.sh@850 -- # return 0 00:21:41.320 15:50:39 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:21:41.320 15:50:39 -- common/autotest_common.sh@716 -- # xtrace_disable 00:21:41.320 15:50:39 -- common/autotest_common.sh@10 -- # set +x 00:21:41.320 15:50:39 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:41.320 15:50:39 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:21:41.320 15:50:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:41.320 15:50:39 -- common/autotest_common.sh@10 -- # set +x 00:21:41.320 Malloc0 00:21:41.320 15:50:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:41.320 15:50:39 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:21:41.320 15:50:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:41.320 15:50:39 -- common/autotest_common.sh@10 -- # set +x 00:21:41.320 [2024-04-26 15:50:39.918294] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x242c1a0/0x2437e00) succeed. 00:21:41.579 [2024-04-26 15:50:39.928862] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x242d7e0/0x24b7e80) succeed. 00:21:41.579 15:50:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:41.579 15:50:40 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:41.579 15:50:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:41.579 15:50:40 -- common/autotest_common.sh@10 -- # set +x 00:21:41.579 15:50:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:41.579 15:50:40 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:21:41.579 15:50:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:41.579 15:50:40 -- common/autotest_common.sh@10 -- # set +x 00:21:41.579 15:50:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:41.579 15:50:40 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.9 -s 4420 00:21:41.579 15:50:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:41.579 15:50:40 -- common/autotest_common.sh@10 -- # set +x 00:21:41.579 [2024-04-26 15:50:40.068059] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:21:41.579 15:50:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:41.579 15:50:40 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.9 -s 4420 00:21:41.579 15:50:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:41.579 15:50:40 -- common/autotest_common.sh@10 -- # set +x 00:21:41.579 15:50:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:41.579 15:50:40 -- host/target_disconnect.sh@73 -- # wait 3425024 00:21:41.579 Write completed with error (sct=0, sc=8) 00:21:41.579 starting I/O failed 00:21:41.579 Read completed with error (sct=0, sc=8) 00:21:41.579 starting I/O failed 00:21:41.579 Write completed with error (sct=0, sc=8) 00:21:41.579 starting I/O failed 00:21:41.579 Read completed with error (sct=0, sc=8) 00:21:41.579 starting I/O failed 00:21:41.579 Write completed with error (sct=0, sc=8) 00:21:41.579 starting I/O failed 00:21:41.579 Read completed with error (sct=0, sc=8) 00:21:41.579 starting I/O failed 00:21:41.579 Read completed with error (sct=0, sc=8) 00:21:41.579 starting I/O failed 00:21:41.579 Write completed with error (sct=0, sc=8) 00:21:41.579 starting I/O failed 00:21:41.579 Read completed with error (sct=0, sc=8) 00:21:41.579 starting I/O failed 00:21:41.579 Write completed with error (sct=0, sc=8) 00:21:41.579 starting I/O failed 00:21:41.579 Read completed with error (sct=0, sc=8) 00:21:41.579 starting I/O failed 00:21:41.579 Read completed with error (sct=0, sc=8) 00:21:41.579 starting I/O failed 00:21:41.579 Read completed with error (sct=0, sc=8) 00:21:41.579 starting I/O failed 00:21:41.579 Write completed with error (sct=0, sc=8) 00:21:41.579 starting I/O failed 00:21:41.579 Write completed with error (sct=0, sc=8) 00:21:41.579 starting I/O failed 00:21:41.579 Write completed with error (sct=0, sc=8) 00:21:41.579 starting I/O failed 00:21:41.579 Write completed with error (sct=0, sc=8) 00:21:41.579 starting I/O failed 00:21:41.579 Write completed with error (sct=0, sc=8) 00:21:41.579 starting I/O failed 00:21:41.579 Write completed with error (sct=0, sc=8) 00:21:41.579 starting I/O failed 00:21:41.579 Read completed with error (sct=0, sc=8) 00:21:41.579 starting I/O failed 00:21:41.579 Read completed with error (sct=0, sc=8) 00:21:41.579 starting I/O failed 00:21:41.579 Read completed with error (sct=0, sc=8) 00:21:41.579 starting I/O failed 00:21:41.579 Write completed with error (sct=0, sc=8) 00:21:41.579 starting I/O failed 00:21:41.579 Write completed with error (sct=0, sc=8) 00:21:41.579 starting I/O failed 00:21:41.579 Read completed with error (sct=0, sc=8) 00:21:41.579 starting I/O failed 00:21:41.579 Write completed with error (sct=0, sc=8) 00:21:41.579 starting I/O failed 00:21:41.579 Write completed with error (sct=0, sc=8) 00:21:41.579 starting I/O failed 00:21:41.579 Write completed with error (sct=0, sc=8) 00:21:41.579 starting I/O failed 00:21:41.579 Read completed with error (sct=0, sc=8) 00:21:41.579 starting I/O failed 00:21:41.580 Write completed with error (sct=0, sc=8) 00:21:41.580 starting I/O failed 00:21:41.580 Write completed with error (sct=0, sc=8) 00:21:41.580 starting I/O failed 00:21:41.580 Read completed with error (sct=0, sc=8) 00:21:41.580 starting I/O failed 00:21:41.580 [2024-04-26 15:50:40.162590] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:41.580 [2024-04-26 15:50:40.164071] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:21:41.580 [2024-04-26 15:50:40.164087] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:21:41.580 [2024-04-26 15:50:40.164093] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:21:42.954 [2024-04-26 15:50:41.168120] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:42.954 qpair failed and we were unable to recover it. 00:21:42.954 [2024-04-26 15:50:41.169629] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:21:42.954 [2024-04-26 15:50:41.169644] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:21:42.954 [2024-04-26 15:50:41.169649] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:21:43.887 [2024-04-26 15:50:42.173326] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:43.887 qpair failed and we were unable to recover it. 00:21:43.887 [2024-04-26 15:50:42.174807] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:21:43.887 [2024-04-26 15:50:42.174821] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:21:43.887 [2024-04-26 15:50:42.174826] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:21:44.820 [2024-04-26 15:50:43.178710] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:44.820 qpair failed and we were unable to recover it. 00:21:44.820 [2024-04-26 15:50:43.180138] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:21:44.820 [2024-04-26 15:50:43.180156] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:21:44.820 [2024-04-26 15:50:43.180164] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:21:45.751 [2024-04-26 15:50:44.184060] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:45.751 qpair failed and we were unable to recover it. 00:21:45.751 [2024-04-26 15:50:44.185472] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:21:45.751 [2024-04-26 15:50:44.185487] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:21:45.751 [2024-04-26 15:50:44.185493] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:21:46.684 [2024-04-26 15:50:45.189420] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:46.684 qpair failed and we were unable to recover it. 00:21:46.684 [2024-04-26 15:50:45.190895] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:21:46.684 [2024-04-26 15:50:45.190910] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:21:46.684 [2024-04-26 15:50:45.190916] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:21:47.633 [2024-04-26 15:50:46.194865] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:47.634 qpair failed and we were unable to recover it. 00:21:47.634 [2024-04-26 15:50:46.196209] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:21:47.634 [2024-04-26 15:50:46.196223] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:21:47.634 [2024-04-26 15:50:46.196229] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:21:49.008 [2024-04-26 15:50:47.200153] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:21:49.008 qpair failed and we were unable to recover it. 00:21:49.008 [2024-04-26 15:50:47.201943] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:21:49.008 [2024-04-26 15:50:47.201963] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:21:49.008 [2024-04-26 15:50:47.201971] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:21:49.977 [2024-04-26 15:50:48.205839] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:49.977 qpair failed and we were unable to recover it. 00:21:49.977 [2024-04-26 15:50:48.207209] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:21:49.977 [2024-04-26 15:50:48.207224] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:21:49.977 [2024-04-26 15:50:48.207230] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:21:50.910 [2024-04-26 15:50:49.211156] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:21:50.910 qpair failed and we were unable to recover it. 00:21:50.910 [2024-04-26 15:50:49.211280] nvme_ctrlr.c:4340:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:21:50.910 A controller has encountered a failure and is being reset. 00:21:50.910 Resorting to new failover address 192.168.100.9 00:21:50.910 [2024-04-26 15:50:49.212931] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:21:50.910 [2024-04-26 15:50:49.212958] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:21:50.911 [2024-04-26 15:50:49.212973] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:51.843 [2024-04-26 15:50:50.216945] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:51.843 qpair failed and we were unable to recover it. 00:21:51.843 [2024-04-26 15:50:50.218365] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:21:51.843 [2024-04-26 15:50:50.218381] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:21:51.843 [2024-04-26 15:50:50.218387] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:21:52.777 [2024-04-26 15:50:51.222240] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:21:52.777 qpair failed and we were unable to recover it. 00:21:52.777 [2024-04-26 15:50:51.222358] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:52.777 [2024-04-26 15:50:51.222464] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:21:52.777 [2024-04-26 15:50:51.224273] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:21:52.777 Controller properly reset. 00:21:53.710 Write completed with error (sct=0, sc=8) 00:21:53.710 starting I/O failed 00:21:53.710 Read completed with error (sct=0, sc=8) 00:21:53.710 starting I/O failed 00:21:53.710 Write completed with error (sct=0, sc=8) 00:21:53.710 starting I/O failed 00:21:53.710 Write completed with error (sct=0, sc=8) 00:21:53.710 starting I/O failed 00:21:53.710 Read completed with error (sct=0, sc=8) 00:21:53.710 starting I/O failed 00:21:53.710 Read completed with error (sct=0, sc=8) 00:21:53.710 starting I/O failed 00:21:53.710 Write completed with error (sct=0, sc=8) 00:21:53.710 starting I/O failed 00:21:53.710 Write completed with error (sct=0, sc=8) 00:21:53.710 starting I/O failed 00:21:53.710 Read completed with error (sct=0, sc=8) 00:21:53.710 starting I/O failed 00:21:53.710 Read completed with error (sct=0, sc=8) 00:21:53.710 starting I/O failed 00:21:53.710 Write completed with error (sct=0, sc=8) 00:21:53.710 starting I/O failed 00:21:53.710 Write completed with error (sct=0, sc=8) 00:21:53.710 starting I/O failed 00:21:53.710 Write completed with error (sct=0, sc=8) 00:21:53.710 starting I/O failed 00:21:53.710 Write completed with error (sct=0, sc=8) 00:21:53.710 starting I/O failed 00:21:53.710 Read completed with error (sct=0, sc=8) 00:21:53.710 starting I/O failed 00:21:53.710 Read completed with error (sct=0, sc=8) 00:21:53.710 starting I/O failed 00:21:53.710 Write completed with error (sct=0, sc=8) 00:21:53.710 starting I/O failed 00:21:53.710 Write completed with error (sct=0, sc=8) 00:21:53.710 starting I/O failed 00:21:53.710 Read completed with error (sct=0, sc=8) 00:21:53.710 starting I/O failed 00:21:53.710 Read completed with error (sct=0, sc=8) 00:21:53.710 starting I/O failed 00:21:53.710 Write completed with error (sct=0, sc=8) 00:21:53.710 starting I/O failed 00:21:53.710 Read completed with error (sct=0, sc=8) 00:21:53.710 starting I/O failed 00:21:53.710 Write completed with error (sct=0, sc=8) 00:21:53.710 starting I/O failed 00:21:53.710 Write completed with error (sct=0, sc=8) 00:21:53.710 starting I/O failed 00:21:53.710 Read completed with error (sct=0, sc=8) 00:21:53.710 starting I/O failed 00:21:53.710 Read completed with error (sct=0, sc=8) 00:21:53.710 starting I/O failed 00:21:53.710 Read completed with error (sct=0, sc=8) 00:21:53.710 starting I/O failed 00:21:53.710 Write completed with error (sct=0, sc=8) 00:21:53.710 starting I/O failed 00:21:53.710 Write completed with error (sct=0, sc=8) 00:21:53.710 starting I/O failed 00:21:53.710 Write completed with error (sct=0, sc=8) 00:21:53.710 starting I/O failed 00:21:53.710 Read completed with error (sct=0, sc=8) 00:21:53.710 starting I/O failed 00:21:53.710 Read completed with error (sct=0, sc=8) 00:21:53.710 starting I/O failed 00:21:53.710 [2024-04-26 15:50:52.266883] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:21:53.710 Initializing NVMe Controllers 00:21:53.710 Attaching to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:21:53.710 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:21:53.710 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:21:53.710 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:21:53.710 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:21:53.710 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:21:53.710 Initialization complete. Launching workers. 00:21:53.710 Starting thread on core 1 00:21:53.710 Starting thread on core 2 00:21:53.710 Starting thread on core 3 00:21:53.710 Starting thread on core 0 00:21:53.710 15:50:52 -- host/target_disconnect.sh@74 -- # sync 00:21:53.710 00:21:53.710 real 0m17.331s 00:21:53.710 user 1m5.477s 00:21:53.710 sys 0m3.971s 00:21:53.710 15:50:52 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:21:53.710 15:50:52 -- common/autotest_common.sh@10 -- # set +x 00:21:53.710 ************************************ 00:21:53.710 END TEST nvmf_target_disconnect_tc3 00:21:53.710 ************************************ 00:21:53.968 15:50:52 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:21:53.968 15:50:52 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:21:53.968 15:50:52 -- nvmf/common.sh@477 -- # nvmfcleanup 00:21:53.968 15:50:52 -- nvmf/common.sh@117 -- # sync 00:21:53.968 15:50:52 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:21:53.968 15:50:52 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:21:53.968 15:50:52 -- nvmf/common.sh@120 -- # set +e 00:21:53.968 15:50:52 -- nvmf/common.sh@121 -- # for i in {1..20} 00:21:53.968 15:50:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:21:53.968 rmmod nvme_rdma 00:21:53.968 rmmod nvme_fabrics 00:21:53.968 15:50:52 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:21:53.968 15:50:52 -- nvmf/common.sh@124 -- # set -e 00:21:53.968 15:50:52 -- nvmf/common.sh@125 -- # return 0 00:21:53.968 15:50:52 -- nvmf/common.sh@478 -- # '[' -n 3425717 ']' 00:21:53.968 15:50:52 -- nvmf/common.sh@479 -- # killprocess 3425717 00:21:53.968 15:50:52 -- common/autotest_common.sh@936 -- # '[' -z 3425717 ']' 00:21:53.969 15:50:52 -- common/autotest_common.sh@940 -- # kill -0 3425717 00:21:53.969 15:50:52 -- common/autotest_common.sh@941 -- # uname 00:21:53.969 15:50:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:53.969 15:50:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3425717 00:21:53.969 15:50:52 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:21:53.969 15:50:52 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:21:53.969 15:50:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3425717' 00:21:53.969 killing process with pid 3425717 00:21:53.969 15:50:52 -- common/autotest_common.sh@955 -- # kill 3425717 00:21:53.969 15:50:52 -- common/autotest_common.sh@960 -- # wait 3425717 00:21:53.969 [2024-04-26 15:50:52.518312] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:21:54.228 15:50:52 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:21:54.228 15:50:52 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:21:54.228 00:21:54.228 real 0m38.215s 00:21:54.228 user 2m29.313s 00:21:54.228 sys 0m11.079s 00:21:54.228 15:50:52 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:21:54.228 15:50:52 -- common/autotest_common.sh@10 -- # set +x 00:21:54.228 ************************************ 00:21:54.228 END TEST nvmf_target_disconnect 00:21:54.228 ************************************ 00:21:54.228 15:50:52 -- nvmf/nvmf.sh@123 -- # timing_exit host 00:21:54.228 15:50:52 -- common/autotest_common.sh@716 -- # xtrace_disable 00:21:54.228 15:50:52 -- common/autotest_common.sh@10 -- # set +x 00:21:54.228 15:50:52 -- nvmf/nvmf.sh@125 -- # trap - SIGINT SIGTERM EXIT 00:21:54.228 00:21:54.228 real 15m28.940s 00:21:54.228 user 41m0.510s 00:21:54.228 sys 3m57.390s 00:21:54.228 15:50:52 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:21:54.228 15:50:52 -- common/autotest_common.sh@10 -- # set +x 00:21:54.228 ************************************ 00:21:54.228 END TEST nvmf_rdma 00:21:54.228 ************************************ 00:21:54.486 15:50:52 -- spdk/autotest.sh@283 -- # run_test spdkcli_nvmf_rdma /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=rdma 00:21:54.486 15:50:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:54.486 15:50:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:54.486 15:50:52 -- common/autotest_common.sh@10 -- # set +x 00:21:54.486 ************************************ 00:21:54.486 START TEST spdkcli_nvmf_rdma 00:21:54.486 ************************************ 00:21:54.486 15:50:52 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=rdma 00:21:54.486 * Looking for test storage... 00:21:54.486 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli 00:21:54.486 15:50:53 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/common.sh 00:21:54.486 15:50:53 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:21:54.486 15:50:53 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/clear_config.py 00:21:54.486 15:50:53 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:21:54.486 15:50:53 -- nvmf/common.sh@7 -- # uname -s 00:21:54.745 15:50:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:54.745 15:50:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:54.745 15:50:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:54.745 15:50:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:54.745 15:50:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:54.745 15:50:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:54.745 15:50:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:54.745 15:50:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:54.745 15:50:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:54.745 15:50:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:54.745 15:50:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:803833e2-2ada-e911-906e-0017a4403562 00:21:54.745 15:50:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=803833e2-2ada-e911-906e-0017a4403562 00:21:54.745 15:50:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:54.745 15:50:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:54.745 15:50:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:54.745 15:50:53 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:54.745 15:50:53 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:21:54.745 15:50:53 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:54.745 15:50:53 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:54.745 15:50:53 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:54.745 15:50:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:54.745 15:50:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:54.745 15:50:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:54.745 15:50:53 -- paths/export.sh@5 -- # export PATH 00:21:54.745 15:50:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:54.745 15:50:53 -- nvmf/common.sh@47 -- # : 0 00:21:54.745 15:50:53 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:21:54.745 15:50:53 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:21:54.745 15:50:53 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:54.745 15:50:53 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:54.745 15:50:53 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:54.745 15:50:53 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:21:54.745 15:50:53 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:21:54.745 15:50:53 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:21:54.745 15:50:53 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:21:54.745 15:50:53 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:21:54.745 15:50:53 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:21:54.745 15:50:53 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:21:54.745 15:50:53 -- common/autotest_common.sh@710 -- # xtrace_disable 00:21:54.745 15:50:53 -- common/autotest_common.sh@10 -- # set +x 00:21:54.745 15:50:53 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:21:54.745 15:50:53 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=3428125 00:21:54.745 15:50:53 -- spdkcli/common.sh@34 -- # waitforlisten 3428125 00:21:54.745 15:50:53 -- common/autotest_common.sh@817 -- # '[' -z 3428125 ']' 00:21:54.745 15:50:53 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:54.745 15:50:53 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:21:54.745 15:50:53 -- common/autotest_common.sh@822 -- # local max_retries=100 00:21:54.745 15:50:53 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:54.745 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:54.745 15:50:53 -- common/autotest_common.sh@826 -- # xtrace_disable 00:21:54.745 15:50:53 -- common/autotest_common.sh@10 -- # set +x 00:21:54.745 [2024-04-26 15:50:53.164747] Starting SPDK v24.05-pre git sha1 bca9154a0 / DPDK 23.11.0 initialization... 00:21:54.745 [2024-04-26 15:50:53.164788] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3428125 ] 00:21:54.745 EAL: No free 2048 kB hugepages reported on node 1 00:21:54.745 [2024-04-26 15:50:53.220198] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:21:54.745 [2024-04-26 15:50:53.297987] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:54.745 [2024-04-26 15:50:53.297990] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:55.675 15:50:53 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:21:55.676 15:50:53 -- common/autotest_common.sh@850 -- # return 0 00:21:55.676 15:50:53 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:21:55.676 15:50:53 -- common/autotest_common.sh@716 -- # xtrace_disable 00:21:55.676 15:50:53 -- common/autotest_common.sh@10 -- # set +x 00:21:55.676 15:50:53 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:21:55.676 15:50:53 -- spdkcli/nvmf.sh@22 -- # [[ rdma == \r\d\m\a ]] 00:21:55.676 15:50:53 -- spdkcli/nvmf.sh@23 -- # nvmftestinit 00:21:55.676 15:50:53 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:21:55.676 15:50:53 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:55.676 15:50:53 -- nvmf/common.sh@437 -- # prepare_net_devs 00:21:55.676 15:50:53 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:21:55.676 15:50:53 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:21:55.676 15:50:53 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:55.676 15:50:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:21:55.676 15:50:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:55.676 15:50:53 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:21:55.676 15:50:53 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:21:55.676 15:50:53 -- nvmf/common.sh@285 -- # xtrace_disable 00:21:55.676 15:50:54 -- common/autotest_common.sh@10 -- # set +x 00:22:00.966 15:50:59 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:00.967 15:50:59 -- nvmf/common.sh@291 -- # pci_devs=() 00:22:00.967 15:50:59 -- nvmf/common.sh@291 -- # local -a pci_devs 00:22:00.967 15:50:59 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:22:00.967 15:50:59 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:22:00.967 15:50:59 -- nvmf/common.sh@293 -- # pci_drivers=() 00:22:00.967 15:50:59 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:22:00.967 15:50:59 -- nvmf/common.sh@295 -- # net_devs=() 00:22:00.967 15:50:59 -- nvmf/common.sh@295 -- # local -ga net_devs 00:22:00.967 15:50:59 -- nvmf/common.sh@296 -- # e810=() 00:22:00.967 15:50:59 -- nvmf/common.sh@296 -- # local -ga e810 00:22:00.967 15:50:59 -- nvmf/common.sh@297 -- # x722=() 00:22:00.967 15:50:59 -- nvmf/common.sh@297 -- # local -ga x722 00:22:00.967 15:50:59 -- nvmf/common.sh@298 -- # mlx=() 00:22:00.967 15:50:59 -- nvmf/common.sh@298 -- # local -ga mlx 00:22:00.967 15:50:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:00.967 15:50:59 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:00.967 15:50:59 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:00.967 15:50:59 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:00.967 15:50:59 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:00.967 15:50:59 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:00.967 15:50:59 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:00.967 15:50:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:00.967 15:50:59 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:00.967 15:50:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:00.967 15:50:59 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:00.967 15:50:59 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:22:00.967 15:50:59 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:22:00.967 15:50:59 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:22:00.967 15:50:59 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:22:00.967 15:50:59 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:22:00.967 15:50:59 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:22:00.967 15:50:59 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:22:00.967 15:50:59 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:22:00.967 15:50:59 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.0 (0x15b3 - 0x1015)' 00:22:00.967 Found 0000:da:00.0 (0x15b3 - 0x1015) 00:22:00.967 15:50:59 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:22:00.967 15:50:59 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:22:00.967 15:50:59 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:22:00.967 15:50:59 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:22:00.967 15:50:59 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:22:00.967 15:50:59 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:22:00.967 15:50:59 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:22:00.967 15:50:59 -- nvmf/common.sh@341 -- # echo 'Found 0000:da:00.1 (0x15b3 - 0x1015)' 00:22:00.967 Found 0000:da:00.1 (0x15b3 - 0x1015) 00:22:00.967 15:50:59 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:22:00.967 15:50:59 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:22:00.967 15:50:59 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:22:00.967 15:50:59 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:22:00.967 15:50:59 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:22:00.967 15:50:59 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:22:00.967 15:50:59 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:22:00.967 15:50:59 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:22:00.967 15:50:59 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:22:00.967 15:50:59 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:00.967 15:50:59 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:22:00.967 15:50:59 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:00.967 15:50:59 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.0: mlx_0_0' 00:22:00.967 Found net devices under 0000:da:00.0: mlx_0_0 00:22:00.967 15:50:59 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:22:00.967 15:50:59 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:22:00.967 15:50:59 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:00.967 15:50:59 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:22:00.967 15:50:59 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:00.967 15:50:59 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:da:00.1: mlx_0_1' 00:22:00.967 Found net devices under 0000:da:00.1: mlx_0_1 00:22:00.967 15:50:59 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:22:00.967 15:50:59 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:22:00.967 15:50:59 -- nvmf/common.sh@403 -- # is_hw=yes 00:22:00.967 15:50:59 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:22:00.967 15:50:59 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:22:00.967 15:50:59 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:22:00.967 15:50:59 -- nvmf/common.sh@409 -- # rdma_device_init 00:22:00.967 15:50:59 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:22:00.967 15:50:59 -- nvmf/common.sh@58 -- # uname 00:22:00.967 15:50:59 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:22:00.967 15:50:59 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:22:00.967 15:50:59 -- nvmf/common.sh@63 -- # modprobe ib_core 00:22:00.967 15:50:59 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:22:00.967 15:50:59 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:22:00.967 15:50:59 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:22:00.967 15:50:59 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:22:00.967 15:50:59 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:22:00.967 15:50:59 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:22:00.967 15:50:59 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:22:00.967 15:50:59 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:22:00.967 15:50:59 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:22:00.967 15:50:59 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:22:00.967 15:50:59 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:22:00.967 15:50:59 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:22:00.967 15:50:59 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:22:00.967 15:50:59 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:00.967 15:50:59 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:00.967 15:50:59 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:22:00.967 15:50:59 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:22:00.967 15:50:59 -- nvmf/common.sh@105 -- # continue 2 00:22:00.967 15:50:59 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:00.967 15:50:59 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:00.967 15:50:59 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:22:00.967 15:50:59 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:00.967 15:50:59 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:22:00.967 15:50:59 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:22:00.967 15:50:59 -- nvmf/common.sh@105 -- # continue 2 00:22:00.967 15:50:59 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:22:00.967 15:50:59 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:22:00.967 15:50:59 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:22:00.967 15:50:59 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:22:00.967 15:50:59 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:00.967 15:50:59 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:00.967 15:50:59 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:22:00.967 15:50:59 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:22:00.967 15:50:59 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:22:00.967 122: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:22:00.967 link/ether ec:0d:9a:8b:2b:7c brd ff:ff:ff:ff:ff:ff 00:22:00.967 altname enp218s0f0np0 00:22:00.967 altname ens818f0np0 00:22:00.967 inet 192.168.100.8/24 scope global mlx_0_0 00:22:00.967 valid_lft forever preferred_lft forever 00:22:00.967 15:50:59 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:22:00.967 15:50:59 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:22:00.967 15:50:59 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:22:00.967 15:50:59 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:22:00.967 15:50:59 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:00.967 15:50:59 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:00.967 15:50:59 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:22:00.967 15:50:59 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:22:00.967 15:50:59 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:22:00.967 123: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:22:00.967 link/ether ec:0d:9a:8b:2b:7d brd ff:ff:ff:ff:ff:ff 00:22:00.967 altname enp218s0f1np1 00:22:00.967 altname ens818f1np1 00:22:00.967 inet 192.168.100.9/24 scope global mlx_0_1 00:22:00.967 valid_lft forever preferred_lft forever 00:22:00.967 15:50:59 -- nvmf/common.sh@411 -- # return 0 00:22:00.967 15:50:59 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:22:00.967 15:50:59 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:22:00.967 15:50:59 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:22:00.967 15:50:59 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:22:00.967 15:50:59 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:22:00.967 15:50:59 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:22:00.967 15:50:59 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:22:00.967 15:50:59 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:22:00.967 15:50:59 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:22:00.967 15:50:59 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:22:00.967 15:50:59 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:00.967 15:50:59 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:00.967 15:50:59 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:22:00.967 15:50:59 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:22:00.967 15:50:59 -- nvmf/common.sh@105 -- # continue 2 00:22:00.967 15:50:59 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:00.967 15:50:59 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:00.967 15:50:59 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:22:00.967 15:50:59 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:00.967 15:50:59 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:22:00.967 15:50:59 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:22:00.967 15:50:59 -- nvmf/common.sh@105 -- # continue 2 00:22:00.967 15:50:59 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:22:00.967 15:50:59 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:22:00.968 15:50:59 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:22:00.968 15:50:59 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:22:00.968 15:50:59 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:00.968 15:50:59 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:00.968 15:50:59 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:22:00.968 15:50:59 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:22:00.968 15:50:59 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:22:00.968 15:50:59 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:22:00.968 15:50:59 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:00.968 15:50:59 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:00.968 15:50:59 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:22:00.968 192.168.100.9' 00:22:00.968 15:50:59 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:22:00.968 192.168.100.9' 00:22:00.968 15:50:59 -- nvmf/common.sh@446 -- # head -n 1 00:22:00.968 15:50:59 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:22:00.968 15:50:59 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:22:00.968 192.168.100.9' 00:22:00.968 15:50:59 -- nvmf/common.sh@447 -- # tail -n +2 00:22:00.968 15:50:59 -- nvmf/common.sh@447 -- # head -n 1 00:22:00.968 15:50:59 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:22:00.968 15:50:59 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:22:00.968 15:50:59 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:22:00.968 15:50:59 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:22:00.968 15:50:59 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:22:00.968 15:50:59 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:22:00.968 15:50:59 -- spdkcli/nvmf.sh@24 -- # NVMF_TARGET_IP=192.168.100.8 00:22:00.968 15:50:59 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:22:00.968 15:50:59 -- common/autotest_common.sh@710 -- # xtrace_disable 00:22:00.968 15:50:59 -- common/autotest_common.sh@10 -- # set +x 00:22:00.968 15:50:59 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:22:00.968 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:22:00.968 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:22:00.968 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:22:00.968 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:22:00.968 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:22:00.968 '\''nvmf/transport create rdma max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:22:00.968 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:22:00.968 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:22:00.968 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:22:00.968 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4260 IPv4'\'' '\''192.168.100.8:4260'\'' True 00:22:00.968 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:22:00.968 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:22:00.968 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create rdma 192.168.100.8 4260 IPv4'\'' '\''192.168.100.8:4260'\'' True 00:22:00.968 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:22:00.968 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:22:00.968 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create rdma 192.168.100.8 4260 IPv4'\'' '\''192.168.100.8:4260'\'' True 00:22:00.968 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create rdma 192.168.100.8 4261 IPv4'\'' '\''192.168.100.8:4261'\'' True 00:22:00.968 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:22:00.968 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:22:00.968 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:22:00.968 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:22:00.968 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4261 IPv4'\'' '\''192.168.100.8:4261'\'' True 00:22:00.968 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4262 IPv4'\'' '\''192.168.100.8:4262'\'' True 00:22:00.968 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:22:00.968 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:22:00.968 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:22:00.968 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:22:00.968 ' 00:22:01.226 [2024-04-26 15:50:59.825109] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:22:03.755 [2024-04-26 15:51:01.886269] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x2038470/0x2049830) succeed. 00:22:03.755 [2024-04-26 15:51:01.898086] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x2039880/0x208aec0) succeed. 00:22:04.689 [2024-04-26 15:51:03.127994] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4260 *** 00:22:07.216 [2024-04-26 15:51:05.290788] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4261 *** 00:22:08.588 [2024-04-26 15:51:07.148878] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4262 *** 00:22:10.505 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:22:10.505 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:22:10.505 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:22:10.505 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:22:10.505 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:22:10.505 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:22:10.505 Executing command: ['nvmf/transport create rdma max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:22:10.505 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:22:10.505 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:22:10.505 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:22:10.505 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4260 IPv4', '192.168.100.8:4260', True] 00:22:10.505 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:22:10.505 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:22:10.505 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create rdma 192.168.100.8 4260 IPv4', '192.168.100.8:4260', True] 00:22:10.505 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:22:10.505 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:22:10.505 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create rdma 192.168.100.8 4260 IPv4', '192.168.100.8:4260', True] 00:22:10.505 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create rdma 192.168.100.8 4261 IPv4', '192.168.100.8:4261', True] 00:22:10.505 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:22:10.505 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:22:10.505 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:22:10.505 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:22:10.505 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4261 IPv4', '192.168.100.8:4261', True] 00:22:10.505 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4262 IPv4', '192.168.100.8:4262', True] 00:22:10.505 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:22:10.505 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:22:10.505 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:22:10.505 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:22:10.505 15:51:08 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:22:10.505 15:51:08 -- common/autotest_common.sh@716 -- # xtrace_disable 00:22:10.505 15:51:08 -- common/autotest_common.sh@10 -- # set +x 00:22:10.505 15:51:08 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:22:10.505 15:51:08 -- common/autotest_common.sh@710 -- # xtrace_disable 00:22:10.505 15:51:08 -- common/autotest_common.sh@10 -- # set +x 00:22:10.505 15:51:08 -- spdkcli/nvmf.sh@69 -- # check_match 00:22:10.505 15:51:08 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:22:10.505 15:51:09 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:22:10.782 15:51:09 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:22:10.782 15:51:09 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:22:10.782 15:51:09 -- common/autotest_common.sh@716 -- # xtrace_disable 00:22:10.782 15:51:09 -- common/autotest_common.sh@10 -- # set +x 00:22:10.782 15:51:09 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:22:10.782 15:51:09 -- common/autotest_common.sh@710 -- # xtrace_disable 00:22:10.782 15:51:09 -- common/autotest_common.sh@10 -- # set +x 00:22:10.782 15:51:09 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:22:10.782 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:22:10.782 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:22:10.782 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:22:10.782 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete rdma 192.168.100.8 4262'\'' '\''192.168.100.8:4262'\'' 00:22:10.782 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''192.168.100.8:4261'\'' 00:22:10.782 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:22:10.782 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:22:10.782 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:22:10.782 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:22:10.782 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:22:10.782 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:22:10.782 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:22:10.782 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:22:10.782 ' 00:22:16.049 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:22:16.049 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:22:16.049 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:22:16.049 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:22:16.049 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete rdma 192.168.100.8 4262', '192.168.100.8:4262', False] 00:22:16.049 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '192.168.100.8:4261', False] 00:22:16.049 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:22:16.049 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:22:16.049 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:22:16.049 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:22:16.049 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:22:16.049 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:22:16.049 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:22:16.049 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:22:16.049 15:51:14 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:22:16.049 15:51:14 -- common/autotest_common.sh@716 -- # xtrace_disable 00:22:16.049 15:51:14 -- common/autotest_common.sh@10 -- # set +x 00:22:16.049 15:51:14 -- spdkcli/nvmf.sh@90 -- # killprocess 3428125 00:22:16.049 15:51:14 -- common/autotest_common.sh@936 -- # '[' -z 3428125 ']' 00:22:16.049 15:51:14 -- common/autotest_common.sh@940 -- # kill -0 3428125 00:22:16.049 15:51:14 -- common/autotest_common.sh@941 -- # uname 00:22:16.049 15:51:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:16.049 15:51:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3428125 00:22:16.049 15:51:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:16.049 15:51:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:16.049 15:51:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3428125' 00:22:16.049 killing process with pid 3428125 00:22:16.049 15:51:14 -- common/autotest_common.sh@955 -- # kill 3428125 00:22:16.049 [2024-04-26 15:51:14.291393] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:22:16.049 15:51:14 -- common/autotest_common.sh@960 -- # wait 3428125 00:22:16.049 [2024-04-26 15:51:14.346267] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:22:16.049 15:51:14 -- spdkcli/nvmf.sh@1 -- # nvmftestfini 00:22:16.049 15:51:14 -- nvmf/common.sh@477 -- # nvmfcleanup 00:22:16.049 15:51:14 -- nvmf/common.sh@117 -- # sync 00:22:16.049 15:51:14 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:22:16.049 15:51:14 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:22:16.049 15:51:14 -- nvmf/common.sh@120 -- # set +e 00:22:16.049 15:51:14 -- nvmf/common.sh@121 -- # for i in {1..20} 00:22:16.049 15:51:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:22:16.049 rmmod nvme_rdma 00:22:16.049 rmmod nvme_fabrics 00:22:16.049 15:51:14 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:22:16.049 15:51:14 -- nvmf/common.sh@124 -- # set -e 00:22:16.049 15:51:14 -- nvmf/common.sh@125 -- # return 0 00:22:16.049 15:51:14 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:22:16.049 15:51:14 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:22:16.049 15:51:14 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:22:16.049 00:22:16.049 real 0m21.608s 00:22:16.049 user 0m45.768s 00:22:16.049 sys 0m4.893s 00:22:16.049 15:51:14 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:22:16.049 15:51:14 -- common/autotest_common.sh@10 -- # set +x 00:22:16.049 ************************************ 00:22:16.049 END TEST spdkcli_nvmf_rdma 00:22:16.049 ************************************ 00:22:16.049 15:51:14 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:22:16.049 15:51:14 -- spdk/autotest.sh@310 -- # '[' 0 -eq 1 ']' 00:22:16.049 15:51:14 -- spdk/autotest.sh@314 -- # '[' 0 -eq 1 ']' 00:22:16.049 15:51:14 -- spdk/autotest.sh@319 -- # '[' 0 -eq 1 ']' 00:22:16.049 15:51:14 -- spdk/autotest.sh@328 -- # '[' 0 -eq 1 ']' 00:22:16.049 15:51:14 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:22:16.049 15:51:14 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:22:16.049 15:51:14 -- spdk/autotest.sh@341 -- # '[' 0 -eq 1 ']' 00:22:16.049 15:51:14 -- spdk/autotest.sh@345 -- # '[' 0 -eq 1 ']' 00:22:16.049 15:51:14 -- spdk/autotest.sh@350 -- # '[' 0 -eq 1 ']' 00:22:16.049 15:51:14 -- spdk/autotest.sh@354 -- # '[' 0 -eq 1 ']' 00:22:16.049 15:51:14 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:22:16.049 15:51:14 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:22:16.049 15:51:14 -- spdk/autotest.sh@369 -- # [[ 0 -eq 1 ]] 00:22:16.049 15:51:14 -- spdk/autotest.sh@373 -- # [[ 0 -eq 1 ]] 00:22:16.049 15:51:14 -- spdk/autotest.sh@378 -- # trap - SIGINT SIGTERM EXIT 00:22:16.049 15:51:14 -- spdk/autotest.sh@380 -- # timing_enter post_cleanup 00:22:16.049 15:51:14 -- common/autotest_common.sh@710 -- # xtrace_disable 00:22:16.049 15:51:14 -- common/autotest_common.sh@10 -- # set +x 00:22:16.049 15:51:14 -- spdk/autotest.sh@381 -- # autotest_cleanup 00:22:16.049 15:51:14 -- common/autotest_common.sh@1378 -- # local autotest_es=0 00:22:16.049 15:51:14 -- common/autotest_common.sh@1379 -- # xtrace_disable 00:22:16.049 15:51:14 -- common/autotest_common.sh@10 -- # set +x 00:22:21.312 INFO: APP EXITING 00:22:21.312 INFO: killing all VMs 00:22:21.312 INFO: killing vhost app 00:22:21.312 INFO: EXIT DONE 00:22:22.686 Waiting for block devices as requested 00:22:22.686 0000:5f:00.0 (8086 0a54): vfio-pci -> nvme 00:22:22.944 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:22:22.944 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:22:22.944 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:22:23.201 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:22:23.201 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:22:23.201 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:22:23.201 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:22:23.458 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:22:23.458 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:22:23.458 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:22:23.458 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:22:23.716 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:22:23.716 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:22:23.716 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:22:23.974 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:22:23.974 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:22:27.252 Cleaning 00:22:27.252 Removing: /var/run/dpdk/spdk0/config 00:22:27.253 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:22:27.253 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:22:27.253 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:22:27.253 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:22:27.253 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:22:27.253 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:22:27.253 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:22:27.253 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:22:27.253 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:22:27.253 Removing: /var/run/dpdk/spdk0/hugepage_info 00:22:27.253 Removing: /var/run/dpdk/spdk1/config 00:22:27.253 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:22:27.253 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:22:27.253 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:22:27.253 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:22:27.253 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:22:27.253 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:22:27.253 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:22:27.253 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:22:27.253 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:22:27.253 Removing: /var/run/dpdk/spdk1/hugepage_info 00:22:27.253 Removing: /var/run/dpdk/spdk1/mp_socket 00:22:27.253 Removing: /var/run/dpdk/spdk2/config 00:22:27.253 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:22:27.253 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:22:27.253 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:22:27.253 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:22:27.253 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:22:27.253 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:22:27.253 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:22:27.253 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:22:27.253 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:22:27.253 Removing: /var/run/dpdk/spdk2/hugepage_info 00:22:27.253 Removing: /var/run/dpdk/spdk3/config 00:22:27.253 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:22:27.253 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:22:27.253 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:22:27.253 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:22:27.253 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:22:27.253 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:22:27.253 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:22:27.253 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:22:27.253 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:22:27.253 Removing: /var/run/dpdk/spdk3/hugepage_info 00:22:27.253 Removing: /var/run/dpdk/spdk4/config 00:22:27.253 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:22:27.253 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:22:27.253 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:22:27.253 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:22:27.253 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:22:27.253 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:22:27.253 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:22:27.253 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:22:27.253 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:22:27.253 Removing: /var/run/dpdk/spdk4/hugepage_info 00:22:27.253 Removing: /dev/shm/bdevperf_trace.pid3261256 00:22:27.253 Removing: /dev/shm/bdevperf_trace.pid3355446 00:22:27.253 Removing: /dev/shm/bdev_svc_trace.1 00:22:27.253 Removing: /dev/shm/nvmf_trace.0 00:22:27.253 Removing: /dev/shm/spdk_tgt_trace.pid3153188 00:22:27.253 Removing: /var/run/dpdk/spdk0 00:22:27.253 Removing: /var/run/dpdk/spdk1 00:22:27.253 Removing: /var/run/dpdk/spdk2 00:22:27.253 Removing: /var/run/dpdk/spdk3 00:22:27.253 Removing: /var/run/dpdk/spdk4 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3150059 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3151857 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3153188 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3153871 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3154821 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3155059 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3156050 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3156277 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3156626 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3161152 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3162424 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3162780 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3163224 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3163537 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3163847 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3164105 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3164361 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3164647 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3165636 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3168637 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3168972 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3169397 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3169418 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3169910 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3170135 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3170448 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3170648 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3170920 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3171150 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3171417 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3171452 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3172007 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3172260 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3172560 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3172895 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3173091 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3173247 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3173582 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3173910 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3174162 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3174424 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3174679 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3174943 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3175195 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3175455 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3175734 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3176085 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3176423 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3176701 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3176955 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3177215 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3177470 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3177733 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3177989 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3178254 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3178543 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3178920 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3179053 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3179402 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3183288 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3224714 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3228721 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3237628 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3242585 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3246241 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3247327 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3261256 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3261659 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3265471 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3271126 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3273726 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3283394 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3307193 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3310791 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3326259 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3353480 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3354345 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3355446 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3359556 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3366197 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3367119 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3368032 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3368952 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3369397 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3373640 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3373643 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3377912 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3378391 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3379053 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3379743 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3379752 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3384306 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3384904 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3389186 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3391953 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3398521 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3398531 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3416551 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3416794 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3422439 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3422915 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3425024 00:22:27.253 Removing: /var/run/dpdk/spdk_pid3428125 00:22:27.253 Clean 00:22:27.511 15:51:25 -- common/autotest_common.sh@1437 -- # return 0 00:22:27.511 15:51:25 -- spdk/autotest.sh@382 -- # timing_exit post_cleanup 00:22:27.511 15:51:25 -- common/autotest_common.sh@716 -- # xtrace_disable 00:22:27.511 15:51:25 -- common/autotest_common.sh@10 -- # set +x 00:22:27.511 15:51:25 -- spdk/autotest.sh@384 -- # timing_exit autotest 00:22:27.511 15:51:25 -- common/autotest_common.sh@716 -- # xtrace_disable 00:22:27.511 15:51:25 -- common/autotest_common.sh@10 -- # set +x 00:22:27.511 15:51:26 -- spdk/autotest.sh@385 -- # chmod a+r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/timing.txt 00:22:27.511 15:51:26 -- spdk/autotest.sh@387 -- # [[ -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/udev.log ]] 00:22:27.511 15:51:26 -- spdk/autotest.sh@387 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/udev.log 00:22:27.511 15:51:26 -- spdk/autotest.sh@389 -- # hash lcov 00:22:27.511 15:51:26 -- spdk/autotest.sh@389 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:22:27.511 15:51:26 -- spdk/autotest.sh@391 -- # hostname 00:22:27.511 15:51:26 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -d /var/jenkins/workspace/nvmf-phy-autotest/spdk -t spdk-wfp-05 -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_test.info 00:22:27.768 geninfo: WARNING: invalid characters removed from testname! 00:22:49.676 15:51:44 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -a /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:22:49.676 15:51:47 -- spdk/autotest.sh@393 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:22:50.241 15:51:48 -- spdk/autotest.sh@394 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info '/usr/*' -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:22:52.138 15:51:50 -- spdk/autotest.sh@395 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:22:53.509 15:51:52 -- spdk/autotest.sh@396 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:22:55.404 15:51:53 -- spdk/autotest.sh@397 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:22:56.775 15:51:55 -- spdk/autotest.sh@398 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:22:57.033 15:51:55 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:22:57.033 15:51:55 -- scripts/common.sh@508 -- $ [[ -e /bin/wpdk_common.sh ]] 00:22:57.033 15:51:55 -- scripts/common.sh@516 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:57.033 15:51:55 -- scripts/common.sh@517 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:57.033 15:51:55 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:57.033 15:51:55 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:57.033 15:51:55 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:57.033 15:51:55 -- paths/export.sh@5 -- $ export PATH 00:22:57.033 15:51:55 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:57.033 15:51:55 -- common/autobuild_common.sh@434 -- $ out=/var/jenkins/workspace/nvmf-phy-autotest/spdk/../output 00:22:57.033 15:51:55 -- common/autobuild_common.sh@435 -- $ date +%s 00:22:57.033 15:51:55 -- common/autobuild_common.sh@435 -- $ mktemp -dt spdk_1714139515.XXXXXX 00:22:57.033 15:51:55 -- common/autobuild_common.sh@435 -- $ SPDK_WORKSPACE=/tmp/spdk_1714139515.SpFfto 00:22:57.033 15:51:55 -- common/autobuild_common.sh@437 -- $ [[ -n '' ]] 00:22:57.033 15:51:55 -- common/autobuild_common.sh@441 -- $ '[' -n '' ']' 00:22:57.033 15:51:55 -- common/autobuild_common.sh@444 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/' 00:22:57.033 15:51:55 -- common/autobuild_common.sh@448 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/xnvme --exclude /tmp' 00:22:57.033 15:51:55 -- common/autobuild_common.sh@450 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:22:57.033 15:51:55 -- common/autobuild_common.sh@451 -- $ get_config_params 00:22:57.033 15:51:55 -- common/autotest_common.sh@385 -- $ xtrace_disable 00:22:57.033 15:51:55 -- common/autotest_common.sh@10 -- $ set +x 00:22:57.033 15:51:55 -- common/autobuild_common.sh@451 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:22:57.033 15:51:55 -- common/autobuild_common.sh@453 -- $ start_monitor_resources 00:22:57.033 15:51:55 -- pm/common@17 -- $ local monitor 00:22:57.033 15:51:55 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:22:57.033 15:51:55 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=3442659 00:22:57.033 15:51:55 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:22:57.033 15:51:55 -- pm/common@21 -- $ date +%s 00:22:57.033 15:51:55 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=3442661 00:22:57.033 15:51:55 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:22:57.033 15:51:55 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=3442664 00:22:57.033 15:51:55 -- pm/common@21 -- $ date +%s 00:22:57.033 15:51:55 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:22:57.033 15:51:55 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=3442666 00:22:57.033 15:51:55 -- pm/common@21 -- $ date +%s 00:22:57.033 15:51:55 -- pm/common@26 -- $ sleep 1 00:22:57.033 15:51:55 -- pm/common@21 -- $ date +%s 00:22:57.033 15:51:55 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1714139515 00:22:57.033 15:51:55 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1714139515 00:22:57.033 15:51:55 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1714139515 00:22:57.034 15:51:55 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1714139515 00:22:57.034 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1714139515_collect-cpu-temp.pm.log 00:22:57.034 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1714139515_collect-cpu-load.pm.log 00:22:57.034 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1714139515_collect-vmstat.pm.log 00:22:57.034 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1714139515_collect-bmc-pm.bmc.pm.log 00:22:57.967 15:51:56 -- common/autobuild_common.sh@454 -- $ trap stop_monitor_resources EXIT 00:22:57.967 15:51:56 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j96 00:22:57.967 15:51:56 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:22:57.967 15:51:56 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:22:57.967 15:51:56 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:22:57.967 15:51:56 -- spdk/autopackage.sh@19 -- $ timing_finish 00:22:57.967 15:51:56 -- common/autotest_common.sh@722 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:22:57.967 15:51:56 -- common/autotest_common.sh@723 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:22:57.967 15:51:56 -- common/autotest_common.sh@725 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/timing.txt 00:22:57.967 15:51:56 -- spdk/autopackage.sh@20 -- $ exit 0 00:22:57.967 15:51:56 -- spdk/autopackage.sh@1 -- $ stop_monitor_resources 00:22:57.967 15:51:56 -- pm/common@30 -- $ signal_monitor_resources TERM 00:22:57.967 15:51:56 -- pm/common@41 -- $ local monitor pid pids signal=TERM 00:22:57.967 15:51:56 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:22:57.967 15:51:56 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-cpu-load.pid ]] 00:22:57.967 15:51:56 -- pm/common@45 -- $ pid=3442673 00:22:57.967 15:51:56 -- pm/common@52 -- $ sudo kill -TERM 3442673 00:22:57.967 15:51:56 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:22:57.967 15:51:56 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-vmstat.pid ]] 00:22:57.967 15:51:56 -- pm/common@45 -- $ pid=3442675 00:22:57.967 15:51:56 -- pm/common@52 -- $ sudo kill -TERM 3442675 00:22:57.967 15:51:56 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:22:57.967 15:51:56 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-cpu-temp.pid ]] 00:22:57.967 15:51:56 -- pm/common@45 -- $ pid=3442679 00:22:57.967 15:51:56 -- pm/common@52 -- $ sudo kill -TERM 3442679 00:22:58.226 15:51:56 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:22:58.226 15:51:56 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-bmc-pm.pid ]] 00:22:58.226 15:51:56 -- pm/common@45 -- $ pid=3442676 00:22:58.226 15:51:56 -- pm/common@52 -- $ sudo kill -TERM 3442676 00:22:58.226 + [[ -n 3047173 ]] 00:22:58.226 + sudo kill 3047173 00:22:58.236 [Pipeline] } 00:22:58.254 [Pipeline] // stage 00:22:58.260 [Pipeline] } 00:22:58.279 [Pipeline] // timeout 00:22:58.284 [Pipeline] } 00:22:58.301 [Pipeline] // catchError 00:22:58.306 [Pipeline] } 00:22:58.324 [Pipeline] // wrap 00:22:58.330 [Pipeline] } 00:22:58.346 [Pipeline] // catchError 00:22:58.355 [Pipeline] stage 00:22:58.358 [Pipeline] { (Epilogue) 00:22:58.372 [Pipeline] catchError 00:22:58.374 [Pipeline] { 00:22:58.388 [Pipeline] echo 00:22:58.390 Cleanup processes 00:22:58.396 [Pipeline] sh 00:22:58.676 + sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:22:58.676 3442799 /usr/bin/ipmitool sdr dump /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/sdr.cache 00:22:58.676 3443081 sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:22:58.689 [Pipeline] sh 00:22:58.967 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:22:58.967 ++ grep -v 'sudo pgrep' 00:22:58.967 ++ awk '{print $1}' 00:22:58.967 + sudo kill -9 3442799 00:22:58.978 [Pipeline] sh 00:22:59.256 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:23:07.467 [Pipeline] sh 00:23:07.752 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:23:07.752 Artifacts sizes are good 00:23:07.766 [Pipeline] archiveArtifacts 00:23:07.772 Archiving artifacts 00:23:07.874 [Pipeline] sh 00:23:08.153 + sudo chown -R sys_sgci /var/jenkins/workspace/nvmf-phy-autotest 00:23:08.172 [Pipeline] cleanWs 00:23:08.184 [WS-CLEANUP] Deleting project workspace... 00:23:08.184 [WS-CLEANUP] Deferred wipeout is used... 00:23:08.191 [WS-CLEANUP] done 00:23:08.196 [Pipeline] } 00:23:08.216 [Pipeline] // catchError 00:23:08.229 [Pipeline] sh 00:23:08.523 + logger -p user.info -t JENKINS-CI 00:23:08.535 [Pipeline] } 00:23:08.551 [Pipeline] // stage 00:23:08.556 [Pipeline] } 00:23:08.574 [Pipeline] // node 00:23:08.579 [Pipeline] End of Pipeline 00:23:08.619 Finished: SUCCESS