00:00:00.001 Started by user sys_sgci 00:00:00.009 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/autotest-per-patch_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-upstream/autotest.groovy 00:00:00.009 The recommended git tool is: git 00:00:00.009 using credential 00000000-0000-0000-0000-000000000002 00:00:00.012 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/autotest-per-patch_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.026 Fetching changes from the remote Git repository 00:00:00.027 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.041 Using shallow fetch with depth 1 00:00:00.041 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.041 > git --version # timeout=10 00:00:00.054 > git --version # 'git version 2.39.2' 00:00:00.054 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.068 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.068 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:02.247 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:02.260 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:02.272 Checking out Revision 7510e71a2b3ec6fca98e4ec196065590f900d444 (FETCH_HEAD) 00:00:02.272 > git config core.sparsecheckout # timeout=10 00:00:02.284 > git read-tree -mu HEAD # timeout=10 00:00:02.301 > git checkout -f 7510e71a2b3ec6fca98e4ec196065590f900d444 # timeout=5 00:00:02.321 Commit message: "kid: add issue 3541" 00:00:02.321 > git rev-list --no-walk 7510e71a2b3ec6fca98e4ec196065590f900d444 # timeout=10 00:00:02.465 [Pipeline] Start of Pipeline 00:00:02.481 [Pipeline] library 00:00:02.483 Loading library shm_lib@master 00:00:02.483 Library shm_lib@master is cached. Copying from home. 00:00:02.508 [Pipeline] node 00:00:02.513 Running on ME3 in /var/jenkins/workspace/autotest-per-patch_2 00:00:02.518 [Pipeline] { 00:00:02.532 [Pipeline] cleanWs 00:00:02.542 [WS-CLEANUP] Deleting project workspace... 00:00:02.542 [WS-CLEANUP] Deferred wipeout is used... 00:00:02.549 [WS-CLEANUP] done 00:00:02.554 [Pipeline] stage 00:00:02.558 [Pipeline] { (Prologue) 00:00:02.680 [Pipeline] withCredentials 00:00:02.689 > git --version # timeout=10 00:00:02.701 > git --version # 'git version 2.39.2' 00:00:02.717 Masking supported pattern matches of $GIT_USERNAME or $GIT_PASSWORD or $GIT_ASKPASS 00:00:02.719 [Pipeline] { 00:00:02.724 [Pipeline] retry 00:00:02.725 [Pipeline] { 00:00:02.898 [Pipeline] sh 00:00:03.180 + git ls-remote https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master 00:00:04.569 [Pipeline] } 00:00:04.587 [Pipeline] // retry 00:00:04.591 [Pipeline] } 00:00:04.608 [Pipeline] // withCredentials 00:00:04.617 [Pipeline] httpRequest 00:00:05.001 [Pipeline] echo 00:00:05.003 Sorcerer 10.211.164.101 is alive 00:00:05.011 [Pipeline] retry 00:00:05.013 [Pipeline] { 00:00:05.026 [Pipeline] httpRequest 00:00:05.031 HttpMethod: GET 00:00:05.032 URL: http://10.211.164.101/packages/jbp_7510e71a2b3ec6fca98e4ec196065590f900d444.tar.gz 00:00:05.032 Sending request to url: http://10.211.164.101/packages/jbp_7510e71a2b3ec6fca98e4ec196065590f900d444.tar.gz 00:00:05.044 Response Code: HTTP/1.1 200 OK 00:00:05.045 Success: Status code 200 is in the accepted range: 200,404 00:00:05.045 Saving response body to /var/jenkins/workspace/autotest-per-patch_2/jbp_7510e71a2b3ec6fca98e4ec196065590f900d444.tar.gz 00:00:12.097 [Pipeline] } 00:00:12.116 [Pipeline] // retry 00:00:12.123 [Pipeline] sh 00:00:12.401 + tar --no-same-owner -xf jbp_7510e71a2b3ec6fca98e4ec196065590f900d444.tar.gz 00:00:12.418 [Pipeline] httpRequest 00:00:12.826 [Pipeline] echo 00:00:12.828 Sorcerer 10.211.164.101 is alive 00:00:12.838 [Pipeline] retry 00:00:12.840 [Pipeline] { 00:00:12.856 [Pipeline] httpRequest 00:00:12.861 HttpMethod: GET 00:00:12.861 URL: http://10.211.164.101/packages/spdk_71dc0c1e9d880d7a3a970b961426bccd54c6c096.tar.gz 00:00:12.862 Sending request to url: http://10.211.164.101/packages/spdk_71dc0c1e9d880d7a3a970b961426bccd54c6c096.tar.gz 00:00:12.876 Response Code: HTTP/1.1 404 Not Found 00:00:12.877 Success: Status code 404 is in the accepted range: 200,404 00:00:12.877 Saving response body to /var/jenkins/workspace/autotest-per-patch_2/spdk_71dc0c1e9d880d7a3a970b961426bccd54c6c096.tar.gz 00:00:12.880 [Pipeline] } 00:00:12.898 [Pipeline] // retry 00:00:12.906 [Pipeline] sh 00:00:13.192 + rm -f spdk_71dc0c1e9d880d7a3a970b961426bccd54c6c096.tar.gz 00:00:13.206 [Pipeline] retry 00:00:13.208 [Pipeline] { 00:00:13.230 [Pipeline] checkout 00:00:13.238 The recommended git tool is: NONE 00:00:13.248 using credential 00000000-0000-0000-0000-000000000002 00:00:13.250 Wiping out workspace first. 00:00:13.258 Cloning the remote Git repository 00:00:13.261 Honoring refspec on initial clone 00:00:13.263 Cloning repository https://review.spdk.io/gerrit/a/spdk/spdk 00:00:13.263 > git init /var/jenkins/workspace/autotest-per-patch_2/spdk # timeout=10 00:00:13.271 Using reference repository: /var/ci_repos/spdk_multi 00:00:13.271 Fetching upstream changes from https://review.spdk.io/gerrit/a/spdk/spdk 00:00:13.271 > git --version # timeout=10 00:00:13.274 > git --version # 'git version 2.25.1' 00:00:13.274 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:13.277 Setting http proxy: proxy-dmz.intel.com:911 00:00:13.277 > git fetch --tags --force --progress -- https://review.spdk.io/gerrit/a/spdk/spdk refs/changes/87/24887/13 +refs/heads/master:refs/remotes/origin/master # timeout=10 00:00:21.354 Avoid second fetch 00:00:21.364 Checking out Revision 71dc0c1e9d880d7a3a970b961426bccd54c6c096 (FETCH_HEAD) 00:00:21.343 > git config remote.origin.url https://review.spdk.io/gerrit/a/spdk/spdk # timeout=10 00:00:21.345 > git config --add remote.origin.fetch refs/changes/87/24887/13 # timeout=10 00:00:21.346 > git config --add remote.origin.fetch +refs/heads/master:refs/remotes/origin/master # timeout=10 00:00:21.354 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:21.360 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:21.365 > git config core.sparsecheckout # timeout=10 00:00:21.368 > git checkout -f 71dc0c1e9d880d7a3a970b961426bccd54c6c096 # timeout=10 00:00:21.532 Commit message: "test/nvmf: Solve ambiguity around $NVMF_SECOND_TARGET_IP" 00:00:21.536 First time build. Skipping changelog. 00:00:21.532 > git rev-list --no-walk 2f53232cd98f27e6236d785272cffc38fe1b0e84 # timeout=10 00:00:21.538 > git remote # timeout=10 00:00:21.540 > git submodule init # timeout=10 00:00:21.572 > git submodule sync # timeout=10 00:00:21.597 > git config --get remote.origin.url # timeout=10 00:00:21.601 > git submodule init # timeout=10 00:00:21.629 > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10 00:00:21.632 > git config --get submodule.dpdk.url # timeout=10 00:00:21.634 > git remote # timeout=10 00:00:21.637 > git config --get remote.origin.url # timeout=10 00:00:21.639 > git config -f .gitmodules --get submodule.dpdk.path # timeout=10 00:00:21.641 > git config --get submodule.intel-ipsec-mb.url # timeout=10 00:00:21.643 > git remote # timeout=10 00:00:21.645 > git config --get remote.origin.url # timeout=10 00:00:21.647 > git config -f .gitmodules --get submodule.intel-ipsec-mb.path # timeout=10 00:00:21.649 > git config --get submodule.isa-l.url # timeout=10 00:00:21.650 > git remote # timeout=10 00:00:21.652 > git config --get remote.origin.url # timeout=10 00:00:21.654 > git config -f .gitmodules --get submodule.isa-l.path # timeout=10 00:00:21.655 > git config --get submodule.ocf.url # timeout=10 00:00:21.657 > git remote # timeout=10 00:00:21.659 > git config --get remote.origin.url # timeout=10 00:00:21.661 > git config -f .gitmodules --get submodule.ocf.path # timeout=10 00:00:21.663 > git config --get submodule.libvfio-user.url # timeout=10 00:00:21.665 > git remote # timeout=10 00:00:21.667 > git config --get remote.origin.url # timeout=10 00:00:21.669 > git config -f .gitmodules --get submodule.libvfio-user.path # timeout=10 00:00:21.671 > git config --get submodule.xnvme.url # timeout=10 00:00:21.673 > git remote # timeout=10 00:00:21.676 > git config --get remote.origin.url # timeout=10 00:00:21.678 > git config -f .gitmodules --get submodule.xnvme.path # timeout=10 00:00:21.680 > git config --get submodule.isa-l-crypto.url # timeout=10 00:00:21.683 > git remote # timeout=10 00:00:21.685 > git config --get remote.origin.url # timeout=10 00:00:21.688 > git config -f .gitmodules --get submodule.isa-l-crypto.path # timeout=10 00:00:21.691 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:21.691 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:21.691 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:21.691 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:21.691 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:21.691 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:21.691 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:21.694 Setting http proxy: proxy-dmz.intel.com:911 00:00:21.694 > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi ocf # timeout=10 00:00:21.695 Setting http proxy: proxy-dmz.intel.com:911 00:00:21.695 > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi libvfio-user # timeout=10 00:00:21.695 Setting http proxy: proxy-dmz.intel.com:911 00:00:21.695 > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi xnvme # timeout=10 00:00:21.695 Setting http proxy: proxy-dmz.intel.com:911 00:00:21.695 > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi isa-l # timeout=10 00:00:21.695 Setting http proxy: proxy-dmz.intel.com:911 00:00:21.695 > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi dpdk # timeout=10 00:00:21.696 Setting http proxy: proxy-dmz.intel.com:911 00:00:21.696 > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi isa-l-crypto # timeout=10 00:00:21.696 Setting http proxy: proxy-dmz.intel.com:911 00:00:21.696 > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi intel-ipsec-mb # timeout=10 00:00:48.687 [Pipeline] dir 00:00:48.688 Running in /var/jenkins/workspace/autotest-per-patch_2/spdk 00:00:48.690 [Pipeline] { 00:00:48.705 [Pipeline] sh 00:00:48.987 ++ nproc 00:00:48.987 + threads=8 00:00:48.987 + git repack -a -d --threads=8 00:00:52.265 + git submodule foreach git repack -a -d --threads=8 00:00:52.265 Entering 'dpdk' 00:00:55.546 Entering 'intel-ipsec-mb' 00:00:55.546 Entering 'isa-l' 00:00:55.546 Entering 'isa-l-crypto' 00:00:55.546 Entering 'libvfio-user' 00:00:55.803 Entering 'ocf' 00:00:56.061 Entering 'xnvme' 00:00:56.319 + find .git -type f -name alternates -print -delete 00:00:56.319 .git/objects/info/alternates 00:00:56.319 .git/modules/ocf/objects/info/alternates 00:00:56.319 .git/modules/intel-ipsec-mb/objects/info/alternates 00:00:56.319 .git/modules/isa-l-crypto/objects/info/alternates 00:00:56.319 .git/modules/xnvme/objects/info/alternates 00:00:56.319 .git/modules/libvfio-user/objects/info/alternates 00:00:56.319 .git/modules/dpdk/objects/info/alternates 00:00:56.319 .git/modules/isa-l/objects/info/alternates 00:00:56.328 [Pipeline] } 00:00:56.347 [Pipeline] // dir 00:00:56.353 [Pipeline] } 00:00:56.372 [Pipeline] // retry 00:00:56.379 [Pipeline] sh 00:00:56.662 + hash pigz 00:00:56.662 + tar -cf spdk_71dc0c1e9d880d7a3a970b961426bccd54c6c096.tar.gz -I pigz spdk 00:00:59.201 [Pipeline] retry 00:00:59.203 [Pipeline] { 00:00:59.220 [Pipeline] httpRequest 00:00:59.228 HttpMethod: PUT 00:00:59.229 URL: http://10.211.164.101/cgi-bin/sorcerer.py?group=packages&filename=spdk_71dc0c1e9d880d7a3a970b961426bccd54c6c096.tar.gz 00:00:59.229 Sending request to url: http://10.211.164.101/cgi-bin/sorcerer.py?group=packages&filename=spdk_71dc0c1e9d880d7a3a970b961426bccd54c6c096.tar.gz 00:01:01.729 Response Code: HTTP/1.1 200 OK 00:01:01.736 Success: Status code 200 is in the accepted range: 200 00:01:01.738 [Pipeline] } 00:01:01.756 [Pipeline] // retry 00:01:01.763 [Pipeline] echo 00:01:01.765 00:01:01.765 Locking 00:01:01.765 Waited 0s for lock 00:01:01.765 Everything Fine. Saved: /storage/packages/spdk_71dc0c1e9d880d7a3a970b961426bccd54c6c096.tar.gz 00:01:01.765 00:01:01.768 [Pipeline] sh 00:01:02.048 + git -C spdk log --oneline -n5 00:01:02.048 71dc0c1e9 test/nvmf: Solve ambiguity around $NVMF_SECOND_TARGET_IP 00:01:02.048 5495ea97a test/nvmf: Don't pin nvmf_bdevperf and nvmf_target_disconnect to phy 00:01:02.048 41a395c47 test/nvmf: Remove all transport conditions from the test suites 00:01:02.048 0d645b00a test/nvmf: Drop $RDMA_IP_LIST 00:01:02.048 f09fa45e8 test/nvmf: Drop $NVMF_INITIATOR_IP in favor of $NVMF_FIRST_INITIATOR_IP 00:01:02.065 [Pipeline] setCustomBuildProperty 00:01:02.074 [Pipeline] setCustomBuildProperty 00:01:02.083 [Pipeline] catchError 00:01:02.086 [Pipeline] { 00:01:02.104 [Pipeline] sh 00:01:02.388 + git -C spdk describe --tags --abbrev=0 origin/master 00:01:02.404 [Pipeline] sh 00:01:02.683 + git -C spdk describe --tags --abbrev=0 --exclude=LTS HEAD 00:01:02.702 [Pipeline] echo 00:01:02.704 Branch: master 00:01:02.708 [Pipeline] fileExists 00:01:02.725 [Pipeline] readJSON 00:01:02.740 [Pipeline] } 00:01:02.762 [Pipeline] // catchError 00:01:02.774 [Pipeline] sh 00:01:03.055 + /var/jenkins/workspace/autotest-per-patch_2/jbp/jenkins/jjb-config/jobs/scripts/get-pkgdep-jobs.sh /var/jenkins/workspace/autotest-per-patch_2/spdk 00:01:03.070 [Pipeline] } 00:01:03.093 [Pipeline] // stage 00:01:03.114 [Pipeline] catchError 00:01:03.116 [Pipeline] { 00:01:03.136 [Pipeline] stage 00:01:03.138 [Pipeline] { (Pre tests) 00:01:03.182 [Pipeline] parallel 00:01:03.196 [Pipeline] { (Branch: check-format-docker-autotest) 00:01:03.198 [Pipeline] { (Branch: check-so-deps-docker-autotest) 00:01:03.200 [Pipeline] { (Branch: doc-docker-autotest) 00:01:03.202 [Pipeline] { (Branch: build-files-docker-autotest) 00:01:03.223 [Pipeline] retry 00:01:03.225 [Pipeline] { 00:01:03.231 [Pipeline] retry 00:01:03.233 [Pipeline] { 00:01:03.238 [Pipeline] retry 00:01:03.240 [Pipeline] { 00:01:03.246 [Pipeline] retry 00:01:03.248 [Pipeline] { 00:01:03.270 [Pipeline] build 00:01:03.274 Scheduling project: check-format-docker-autotest 00:01:03.285 [Pipeline] build 00:01:03.289 Scheduling project: check-so-deps-docker-autotest 00:01:03.299 [Pipeline] build 00:01:03.302 Scheduling project: doc-docker-autotest 00:01:03.310 [Pipeline] build 00:01:03.313 Scheduling project: build-files-docker-autotest 00:01:10.686 Starting building: build-files-docker-autotest #32381 00:01:10.689 Starting building: check-format-docker-autotest #32407 00:01:10.693 Starting building: doc-docker-autotest #32710 00:01:10.695 Starting building: check-so-deps-docker-autotest #32628 00:02:09.637 Build doc-docker-autotest #32710 completed: SUCCESS 00:02:09.640 [Pipeline] } 00:02:09.667 [Pipeline] // retry 00:02:09.672 [Pipeline] } 00:02:13.787 Build check-format-docker-autotest #32407 completed: SUCCESS 00:02:13.790 [Pipeline] } 00:02:13.819 [Pipeline] // retry 00:02:13.823 [Pipeline] } 00:04:22.853 Build check-so-deps-docker-autotest #32628 completed: SUCCESS 00:04:22.856 [Pipeline] } 00:04:22.883 [Pipeline] // retry 00:04:22.889 [Pipeline] } 00:04:28.433 Build build-files-docker-autotest #32381 completed: SUCCESS 00:04:28.435 [Pipeline] } 00:04:28.461 [Pipeline] // retry 00:04:28.467 [Pipeline] } 00:04:28.513 [Pipeline] // parallel 00:04:28.518 [Pipeline] } 00:04:28.545 [Pipeline] // stage 00:04:28.549 [Pipeline] } 00:04:28.569 [Pipeline] // catchError 00:04:28.576 [Pipeline] catchError 00:04:28.578 [Pipeline] { 00:04:28.594 [Pipeline] stage 00:04:28.596 [Pipeline] { (Tests) 00:04:28.715 [Pipeline] parallel 00:04:28.807 [Pipeline] { (Branch: unittest-clang-docker-autotest) 00:04:28.808 [Pipeline] { (Branch: unittest-main-docker-autotest) 00:04:28.809 [Pipeline] { (Branch: autobuild-external-vg-autotest) 00:04:28.810 [Pipeline] { (Branch: scan-build-docker-autotest) 00:04:28.812 [Pipeline] { (Branch: unittest-valgrind-docker-autotest) 00:04:28.813 [Pipeline] { (Branch: lvol-vg-autotest) 00:04:28.814 [Pipeline] { (Branch: vhost-initiator-vg-autotest) 00:04:28.815 [Pipeline] { (Branch: nvmf-tcp-vg-autotest) 00:04:28.817 [Pipeline] { (Branch: nvmf-tcp-uring-vg-autotest) 00:04:28.818 [Pipeline] { (Branch: nvme-vg-autotest) 00:04:28.819 [Pipeline] { (Branch: rocky9-vg-autotest) 00:04:28.821 [Pipeline] { (Branch: ubuntu22-vg-autotest) 00:04:28.822 [Pipeline] { (Branch: ubuntu24-vg-autotest) 00:04:28.823 [Pipeline] { (Branch: freebsd-vg-autotest) 00:04:28.824 [Pipeline] { (Branch: iscsi-vg-autotest) 00:04:28.825 [Pipeline] { (Branch: iscsi-uring-vg-autotest) 00:04:28.826 [Pipeline] { (Branch: zns-vg-autotest) 00:04:28.828 [Pipeline] { (Branch: nvme-cmb-pmr-vg-autotest) 00:04:28.829 [Pipeline] { (Branch: raid-vg-autotest) 00:04:28.830 [Pipeline] { (Branch: BlobFS-phy-autotest) 00:04:28.831 [Pipeline] { (Branch: crypto-phy-autotest) 00:04:28.833 [Pipeline] { (Branch: vhost-phy-autotest) 00:04:28.835 [Pipeline] { (Branch: nvmf-phy-autotest) 00:04:28.837 [Pipeline] { (Branch: nvmf-tcp-phy-autotest) 00:04:28.838 [Pipeline] { (Branch: nvme-phy-autotest) 00:04:28.840 [Pipeline] { (Branch: vfio-user-phy-autotest) 00:04:28.841 [Pipeline] { (Branch: short-fuzz-phy-autotest) 00:04:28.843 [Pipeline] { (Branch: packaging-docker-autotest) 00:04:28.844 [Pipeline] { (Branch: release-build-main-docker-autotest) 00:04:28.845 [Pipeline] { (Branch: release-build-clang-docker-autotest) 00:04:28.872 [Pipeline] retry 00:04:28.874 [Pipeline] { 00:04:28.879 [Pipeline] retry 00:04:28.881 [Pipeline] { 00:04:28.886 [Pipeline] retry 00:04:28.888 [Pipeline] { 00:04:28.893 [Pipeline] retry 00:04:28.894 [Pipeline] { 00:04:28.898 [Pipeline] retry 00:04:28.900 [Pipeline] { 00:04:28.905 [Pipeline] retry 00:04:28.906 [Pipeline] { 00:04:28.910 [Pipeline] retry 00:04:28.911 [Pipeline] { 00:04:28.914 [Pipeline] retry 00:04:28.915 [Pipeline] { 00:04:28.918 [Pipeline] retry 00:04:28.919 [Pipeline] { 00:04:28.922 [Pipeline] retry 00:04:28.923 [Pipeline] { 00:04:28.927 [Pipeline] retry 00:04:28.928 [Pipeline] { 00:04:28.933 [Pipeline] retry 00:04:28.934 [Pipeline] { 00:04:28.937 [Pipeline] retry 00:04:28.938 [Pipeline] { 00:04:28.941 [Pipeline] retry 00:04:28.942 [Pipeline] { 00:04:28.946 [Pipeline] retry 00:04:28.947 [Pipeline] { 00:04:28.950 [Pipeline] retry 00:04:28.951 [Pipeline] { 00:04:28.954 [Pipeline] retry 00:04:28.955 [Pipeline] { 00:04:28.957 [Pipeline] retry 00:04:28.959 [Pipeline] { 00:04:28.961 [Pipeline] retry 00:04:28.963 [Pipeline] { 00:04:28.966 [Pipeline] retry 00:04:28.967 [Pipeline] { 00:04:28.970 [Pipeline] retry 00:04:28.971 [Pipeline] { 00:04:28.974 [Pipeline] retry 00:04:28.975 [Pipeline] { 00:04:28.978 [Pipeline] retry 00:04:28.980 [Pipeline] { 00:04:28.983 [Pipeline] retry 00:04:28.984 [Pipeline] { 00:04:28.987 [Pipeline] retry 00:04:28.988 [Pipeline] { 00:04:28.992 [Pipeline] retry 00:04:28.993 [Pipeline] { 00:04:28.996 [Pipeline] retry 00:04:28.997 [Pipeline] { 00:04:29.001 [Pipeline] retry 00:04:29.002 [Pipeline] { 00:04:29.005 [Pipeline] retry 00:04:29.007 [Pipeline] { 00:04:29.010 [Pipeline] retry 00:04:29.011 [Pipeline] { 00:04:29.032 [Pipeline] build 00:04:29.035 Scheduling project: unittest-clang-docker-autotest 00:04:29.042 [Pipeline] build 00:04:29.045 Scheduling project: unittest-main-docker-autotest 00:04:29.052 [Pipeline] build 00:04:29.055 Scheduling project: autobuild-external-vg-autotest 00:04:29.063 [Pipeline] build 00:04:29.065 Scheduling project: scan-build-docker-autotest 00:04:29.072 [Pipeline] build 00:04:29.075 Scheduling project: unittest-valgrind-docker-autotest 00:04:29.082 [Pipeline] build 00:04:29.086 Scheduling project: lvol-vg-autotest 00:04:29.093 [Pipeline] build 00:04:29.096 Scheduling project: vhost-initiator-vg-autotest 00:04:29.103 [Pipeline] build 00:04:29.105 Scheduling project: nvmf-tcp-vg-autotest 00:04:29.112 [Pipeline] build 00:04:29.114 Scheduling project: nvmf-tcp-uring-vg-autotest 00:04:29.122 [Pipeline] build 00:04:29.125 Scheduling project: nvme-vg-autotest 00:04:29.133 [Pipeline] build 00:04:29.136 Scheduling project: rocky9-vg-autotest 00:04:29.144 [Pipeline] build 00:04:29.147 Scheduling project: ubuntu22-vg-autotest 00:04:29.154 [Pipeline] build 00:04:29.157 Scheduling project: ubuntu24-vg-autotest 00:04:29.164 [Pipeline] build 00:04:29.167 Scheduling project: freebsd-vg-autotest 00:04:29.174 [Pipeline] build 00:04:29.176 Scheduling project: iscsi-vg-autotest 00:04:29.183 [Pipeline] build 00:04:29.185 Scheduling project: iscsi-uring-vg-autotest 00:04:29.191 [Pipeline] build 00:04:29.193 Scheduling project: zns-vg-autotest 00:04:29.199 [Pipeline] build 00:04:29.201 Scheduling project: nvme-cmb-pmr-vg-autotest 00:04:29.207 [Pipeline] build 00:04:29.209 Scheduling project: raid-vg-autotest 00:04:29.215 [Pipeline] build 00:04:29.217 Scheduling project: BlobFS-phy-autotest 00:04:29.223 [Pipeline] build 00:04:29.225 Scheduling project: crypto-phy-autotest 00:04:29.231 [Pipeline] build 00:04:29.233 Scheduling project: vhost-phy-autotest 00:04:29.238 [Pipeline] build 00:04:29.240 Scheduling project: nvmf-phy-autotest 00:04:29.246 [Pipeline] build 00:04:29.248 Scheduling project: nvmf-tcp-phy-autotest 00:04:29.254 [Pipeline] build 00:04:29.256 Scheduling project: nvme-phy-autotest 00:04:29.261 [Pipeline] build 00:04:29.263 Scheduling project: vfio-user-phy-autotest 00:04:29.268 [Pipeline] build 00:04:29.270 Scheduling project: short-fuzz-phy-autotest 00:04:29.276 [Pipeline] build 00:04:29.278 Scheduling project: packaging-docker-autotest 00:04:29.283 [Pipeline] build 00:04:29.286 Scheduling project: release-build-main-docker-autotest 00:04:29.291 [Pipeline] build 00:04:29.293 Scheduling project: release-build-clang-docker-autotest 00:04:36.106 Starting building: release-build-clang-docker-autotest #2438 00:04:36.110 Starting building: ubuntu24-vg-autotest #6432 00:04:36.115 Starting building: release-build-main-docker-autotest #2438 00:04:36.120 Starting building: BlobFS-phy-autotest #37580 00:04:36.124 Starting building: scan-build-docker-autotest #29226 00:04:36.129 Starting building: rocky9-vg-autotest #27174 00:04:36.133 Starting building: autobuild-external-vg-autotest #29843 00:04:36.136 Starting building: unittest-valgrind-docker-autotest #29224 00:04:36.140 Starting building: crypto-phy-autotest #37569 00:04:36.144 Starting building: iscsi-vg-autotest #89871 00:04:36.147 Starting building: nvme-phy-autotest #83736 00:04:36.151 Starting building: nvmf-tcp-uring-vg-autotest #89777 00:04:36.155 Starting building: nvme-cmb-pmr-vg-autotest #90959 00:04:36.158 Starting building: vhost-initiator-vg-autotest #89852 00:04:36.161 Starting building: zns-vg-autotest #88936 00:04:36.164 Starting building: raid-vg-autotest #4568 00:04:36.168 Starting building: vhost-phy-autotest #37630 00:04:36.171 Starting building: vfio-user-phy-autotest #37570 00:04:36.175 Starting building: short-fuzz-phy-autotest #37565 00:04:36.181 Starting building: unittest-main-docker-autotest #29221 00:04:36.184 Starting building: packaging-docker-autotest #29219 00:04:36.187 Starting building: nvmf-tcp-vg-autotest #89816 00:04:36.190 Starting building: nvme-vg-autotest #89834 00:04:36.193 Starting building: ubuntu22-vg-autotest #48871 00:04:36.197 Starting building: nvmf-tcp-phy-autotest #83694 00:04:36.201 Starting building: lvol-vg-autotest #89783 00:04:36.204 Starting building: iscsi-uring-vg-autotest #89735 00:04:36.208 Starting building: nvmf-phy-autotest #83812 00:04:36.212 Starting building: freebsd-vg-autotest #68080 00:04:36.213 Starting building: unittest-clang-docker-autotest #29219 00:09:12.996 Build release-build-clang-docker-autotest #2438 completed: SUCCESS 00:09:13.004 [Pipeline] } 00:09:13.044 [Pipeline] // retry 00:09:13.052 [Pipeline] } 00:09:29.722 Build scan-build-docker-autotest #29226 completed: SUCCESS 00:09:29.725 [Pipeline] } 00:09:29.765 [Pipeline] // retry 00:09:29.771 [Pipeline] } 00:09:41.713 Build packaging-docker-autotest #29219 completed: SUCCESS 00:09:41.715 [Pipeline] } 00:09:41.750 [Pipeline] // retry 00:09:41.756 [Pipeline] } 00:09:55.404 Build unittest-clang-docker-autotest #29219 completed: SUCCESS 00:09:55.407 [Pipeline] } 00:09:55.449 [Pipeline] // retry 00:09:55.455 [Pipeline] } 00:10:10.810 Build release-build-main-docker-autotest #2438 completed: SUCCESS 00:10:10.813 [Pipeline] } 00:10:10.850 [Pipeline] // retry 00:10:10.857 [Pipeline] } 00:10:59.861 Build unittest-main-docker-autotest #29221 completed: SUCCESS 00:10:59.863 [Pipeline] } 00:10:59.897 [Pipeline] // retry 00:10:59.903 [Pipeline] } 00:13:17.383 Build autobuild-external-vg-autotest #29843 completed: SUCCESS 00:13:17.386 [Pipeline] } 00:13:17.424 [Pipeline] // retry 00:13:17.430 [Pipeline] } 00:13:20.609 Build short-fuzz-phy-autotest #37565 completed: SUCCESS 00:13:20.611 [Pipeline] } 00:13:20.638 [Pipeline] // retry 00:13:20.644 [Pipeline] } 00:14:53.560 Build unittest-valgrind-docker-autotest #29224 completed: SUCCESS 00:14:53.562 [Pipeline] } 00:14:53.599 [Pipeline] // retry 00:14:53.605 [Pipeline] } 00:16:00.354 Build vhost-initiator-vg-autotest #89852 completed: SUCCESS 00:16:00.356 [Pipeline] } 00:16:00.393 [Pipeline] // retry 00:16:00.402 [Pipeline] } 00:16:57.041 Build BlobFS-phy-autotest #37580 completed: SUCCESS 00:16:57.044 [Pipeline] } 00:16:57.091 [Pipeline] // retry 00:16:57.098 [Pipeline] } 00:18:14.727 Build zns-vg-autotest #88936 completed: SUCCESS 00:18:14.730 [Pipeline] } 00:18:14.764 [Pipeline] // retry 00:18:14.773 [Pipeline] } 00:19:24.214 Build nvme-cmb-pmr-vg-autotest #90959 completed: SUCCESS 00:19:24.217 [Pipeline] } 00:19:24.256 [Pipeline] // retry 00:19:24.262 [Pipeline] } 00:19:51.455 Build crypto-phy-autotest #37569 completed: SUCCESS 00:19:51.458 [Pipeline] } 00:19:51.497 [Pipeline] // retry 00:19:51.502 [Pipeline] } 00:20:14.864 Build vhost-phy-autotest #37630 completed: SUCCESS 00:20:14.866 [Pipeline] } 00:20:14.900 [Pipeline] // retry 00:20:14.905 [Pipeline] } 00:20:29.568 Build freebsd-vg-autotest #68080 completed: SUCCESS 00:20:29.571 [Pipeline] } 00:20:29.607 [Pipeline] // retry 00:20:29.615 [Pipeline] } 00:21:06.001 Build vfio-user-phy-autotest #37570 completed: SUCCESS 00:21:06.003 [Pipeline] } 00:21:06.026 [Pipeline] // retry 00:21:06.033 [Pipeline] } 00:23:13.011 Build iscsi-uring-vg-autotest #89735 completed: SUCCESS 00:23:13.014 [Pipeline] } 00:23:13.052 [Pipeline] // retry 00:23:13.059 [Pipeline] } 00:25:01.682 Build lvol-vg-autotest #89783 completed: SUCCESS 00:25:01.684 [Pipeline] } 00:25:01.712 [Pipeline] // retry 00:25:01.716 [Pipeline] } 00:25:01.906 Build nvme-phy-autotest #83736 completed: SUCCESS 00:25:01.908 [Pipeline] } 00:25:01.943 [Pipeline] // retry 00:25:01.948 [Pipeline] } 00:27:46.476 Build nvmf-tcp-uring-vg-autotest #89777 completed: FAILURE 00:27:48.042 [Pipeline] echo 00:27:48.044 No retry patterns found. 00:27:48.045 [Pipeline] } 00:27:48.074 [Pipeline] // retry 00:27:48.083 [Pipeline] error 00:27:48.090 [Pipeline] } 00:27:48.095 Failed in branch nvmf-tcp-uring-vg-autotest 00:27:49.104 Build ubuntu24-vg-autotest #6432 completed: SUCCESS 00:27:49.107 [Pipeline] } 00:27:49.140 [Pipeline] // retry 00:27:49.147 [Pipeline] } 00:27:56.542 Build iscsi-vg-autotest #89871 completed: SUCCESS 00:27:56.544 [Pipeline] } 00:27:56.579 [Pipeline] // retry 00:27:56.586 [Pipeline] } 00:28:02.973 Build nvmf-tcp-vg-autotest #89816 completed: FAILURE 00:28:04.701 [Pipeline] echo 00:28:04.703 No retry patterns found. 00:28:04.704 [Pipeline] } 00:28:04.736 [Pipeline] // retry 00:28:04.743 [Pipeline] error 00:28:04.747 [Pipeline] } 00:28:04.750 Failed in branch nvmf-tcp-vg-autotest 00:28:09.630 Build nvmf-phy-autotest #83812 completed: FAILURE 00:28:11.541 [Pipeline] echo 00:28:11.542 No retry patterns found. 00:28:11.543 [Pipeline] } 00:28:11.579 [Pipeline] // retry 00:28:11.586 [Pipeline] error 00:28:11.594 [Pipeline] } 00:28:11.600 Failed in branch nvmf-phy-autotest 00:29:21.833 Build ubuntu22-vg-autotest #48871 completed: SUCCESS 00:29:21.835 [Pipeline] } 00:29:21.866 [Pipeline] // retry 00:29:21.873 [Pipeline] } 00:30:46.660 Build raid-vg-autotest #4568 completed: SUCCESS 00:30:46.662 [Pipeline] } 00:30:46.699 [Pipeline] // retry 00:30:46.706 [Pipeline] } 00:35:05.267 Build rocky9-vg-autotest #27174 completed: SUCCESS 00:35:05.269 [Pipeline] } 00:35:05.306 [Pipeline] // retry 00:35:05.312 [Pipeline] } 00:36:42.043 Build nvmf-tcp-phy-autotest #83694 completed: FAILURE 00:36:44.378 [Pipeline] echo 00:36:44.379 No retry patterns found. 00:36:44.380 [Pipeline] } 00:36:44.398 [Pipeline] // retry 00:36:44.406 [Pipeline] error 00:36:44.410 [Pipeline] } 00:36:44.413 Failed in branch nvmf-tcp-phy-autotest 00:38:01.746 Build nvme-vg-autotest #89834 completed: SUCCESS 00:38:01.748 [Pipeline] } 00:38:01.781 [Pipeline] // retry 00:38:01.787 [Pipeline] } 00:38:02.017 [Pipeline] // parallel 00:38:02.026 [Pipeline] } 00:38:02.054 [Pipeline] // stage 00:38:02.062 [Pipeline] } 00:38:02.072 ERROR: Build nvmf-tcp-uring-vg-autotest #89777 failed 00:38:02.072 Setting overall build result to FAILURE 00:38:02.093 [Pipeline] // catchError 00:38:02.103 [Pipeline] stage 00:38:02.105 [Pipeline] { (Autorun Post and Coverage) 00:38:02.127 [Pipeline] setCustomBuildProperty 00:38:02.146 [Pipeline] dir 00:38:02.146 Running in /var/jenkins/workspace/autotest-per-patch_2/doc-docker-autotest_32710 00:38:02.147 [Pipeline] { 00:38:02.162 [Pipeline] copyArtifacts 00:38:02.445 Copied 6 artifacts from "doc-docker-autotest" build number 32710 00:38:02.448 [Pipeline] writeFile 00:38:02.468 [Pipeline] } 00:38:02.491 [Pipeline] // dir 00:38:02.509 [Pipeline] dir 00:38:02.509 Running in /var/jenkins/workspace/autotest-per-patch_2/check-format-docker-autotest_32407 00:38:02.511 [Pipeline] { 00:38:02.532 [Pipeline] copyArtifacts 00:38:02.581 Copied 5 artifacts from "check-format-docker-autotest" build number 32407 00:38:02.585 [Pipeline] writeFile 00:38:02.606 [Pipeline] } 00:38:02.631 [Pipeline] // dir 00:38:02.708 [Pipeline] dir 00:38:02.708 Running in /var/jenkins/workspace/autotest-per-patch_2/check-so-deps-docker-autotest_32628 00:38:02.710 [Pipeline] { 00:38:02.735 [Pipeline] copyArtifacts 00:38:02.781 Copied 5 artifacts from "check-so-deps-docker-autotest" build number 32628 00:38:02.785 [Pipeline] writeFile 00:38:02.809 [Pipeline] } 00:38:02.827 [Pipeline] // dir 00:38:02.892 [Pipeline] dir 00:38:02.892 Running in /var/jenkins/workspace/autotest-per-patch_2/build-files-docker-autotest_32381 00:38:02.894 [Pipeline] { 00:38:02.912 [Pipeline] copyArtifacts 00:38:02.963 Copied 5 artifacts from "build-files-docker-autotest" build number 32381 00:38:02.968 [Pipeline] writeFile 00:38:03.013 [Pipeline] } 00:38:03.040 [Pipeline] // dir 00:38:03.073 [Pipeline] dir 00:38:03.074 Running in /var/jenkins/workspace/autotest-per-patch_2/release-build-clang-docker-autotest_2438 00:38:03.075 [Pipeline] { 00:38:03.090 [Pipeline] copyArtifacts 00:38:03.146 Copied 5 artifacts from "release-build-clang-docker-autotest" build number 2438 00:38:03.148 [Pipeline] writeFile 00:38:03.176 [Pipeline] } 00:38:03.198 [Pipeline] // dir 00:38:03.225 [Pipeline] dir 00:38:03.226 Running in /var/jenkins/workspace/autotest-per-patch_2/scan-build-docker-autotest_29226 00:38:03.227 [Pipeline] { 00:38:03.247 [Pipeline] copyArtifacts 00:38:03.329 Copied 9 artifacts from "scan-build-docker-autotest" build number 29226 00:38:03.333 [Pipeline] writeFile 00:38:03.354 [Pipeline] } 00:38:03.378 [Pipeline] // dir 00:38:03.746 [Pipeline] dir 00:38:03.747 Running in /var/jenkins/workspace/autotest-per-patch_2/packaging-docker-autotest_29219 00:38:03.748 [Pipeline] { 00:38:03.777 [Pipeline] copyArtifacts 00:38:03.830 Copied 5 artifacts from "packaging-docker-autotest" build number 29219 00:38:03.832 [Pipeline] writeFile 00:38:04.009 [Pipeline] } 00:38:04.072 [Pipeline] // dir 00:38:04.201 [Pipeline] dir 00:38:04.201 Running in /var/jenkins/workspace/autotest-per-patch_2/unittest-clang-docker-autotest_29219 00:38:04.202 [Pipeline] { 00:38:04.225 [Pipeline] copyArtifacts 00:38:04.648 Copied 6 artifacts from "unittest-clang-docker-autotest" build number 29219 00:38:04.651 [Pipeline] writeFile 00:38:04.699 [Pipeline] } 00:38:04.728 [Pipeline] // dir 00:38:04.759 [Pipeline] dir 00:38:04.759 Running in /var/jenkins/workspace/autotest-per-patch_2/release-build-main-docker-autotest_2438 00:38:04.760 [Pipeline] { 00:38:04.776 [Pipeline] copyArtifacts 00:38:04.823 Copied 5 artifacts from "release-build-main-docker-autotest" build number 2438 00:38:04.826 [Pipeline] writeFile 00:38:04.846 [Pipeline] } 00:38:04.867 [Pipeline] // dir 00:38:04.964 [Pipeline] dir 00:38:04.964 Running in /var/jenkins/workspace/autotest-per-patch_2/unittest-main-docker-autotest_29221 00:38:04.966 [Pipeline] { 00:38:04.985 [Pipeline] copyArtifacts 00:38:05.240 Copied 6 artifacts from "unittest-main-docker-autotest" build number 29221 00:38:05.244 [Pipeline] writeFile 00:38:05.296 [Pipeline] } 00:38:05.328 [Pipeline] // dir 00:38:05.448 [Pipeline] dir 00:38:05.448 Running in /var/jenkins/workspace/autotest-per-patch_2/autobuild-external-vg-autotest_29843 00:38:05.449 [Pipeline] { 00:38:05.468 [Pipeline] copyArtifacts 00:38:05.553 Copied 9 artifacts from "autobuild-external-vg-autotest" build number 29843 00:38:05.556 [Pipeline] writeFile 00:38:05.621 [Pipeline] } 00:38:05.659 [Pipeline] // dir 00:38:06.012 [Pipeline] dir 00:38:06.012 Running in /var/jenkins/workspace/autotest-per-patch_2/short-fuzz-phy-autotest_37565 00:38:06.014 [Pipeline] { 00:38:06.049 [Pipeline] copyArtifacts 00:38:06.283 Copied 14 artifacts from "short-fuzz-phy-autotest" build number 37565 00:38:06.287 [Pipeline] writeFile 00:38:06.432 [Pipeline] } 00:38:06.519 [Pipeline] // dir 00:38:06.875 [Pipeline] dir 00:38:06.876 Running in /var/jenkins/workspace/autotest-per-patch_2/unittest-valgrind-docker-autotest_29224 00:38:06.877 [Pipeline] { 00:38:06.905 [Pipeline] copyArtifacts 00:38:07.167 Copied 6 artifacts from "unittest-valgrind-docker-autotest" build number 29224 00:38:07.171 [Pipeline] writeFile 00:38:07.303 [Pipeline] } 00:38:07.345 [Pipeline] // dir 00:38:07.589 [Pipeline] dir 00:38:07.589 Running in /var/jenkins/workspace/autotest-per-patch_2/vhost-initiator-vg-autotest_89852 00:38:07.590 [Pipeline] { 00:38:07.617 [Pipeline] copyArtifacts 00:38:07.845 Copied 16 artifacts from "vhost-initiator-vg-autotest" build number 89852 00:38:07.850 [Pipeline] writeFile 00:38:07.968 [Pipeline] } 00:38:08.022 [Pipeline] // dir 00:38:08.174 [Pipeline] dir 00:38:08.175 Running in /var/jenkins/workspace/autotest-per-patch_2/BlobFS-phy-autotest_37580 00:38:08.176 [Pipeline] { 00:38:08.197 [Pipeline] copyArtifacts 00:38:08.555 Copied 29 artifacts from "BlobFS-phy-autotest" build number 37580 00:38:08.559 [Pipeline] writeFile 00:38:08.617 [Pipeline] } 00:38:08.654 [Pipeline] // dir 00:38:08.890 [Pipeline] dir 00:38:08.890 Running in /var/jenkins/workspace/autotest-per-patch_2/zns-vg-autotest_88936 00:38:08.891 [Pipeline] { 00:38:08.917 [Pipeline] copyArtifacts 00:38:09.102 Copied 13 artifacts from "zns-vg-autotest" build number 88936 00:38:09.105 [Pipeline] writeFile 00:38:09.189 [Pipeline] } 00:38:09.230 [Pipeline] // dir 00:38:09.540 [Pipeline] dir 00:38:09.541 Running in /var/jenkins/workspace/autotest-per-patch_2/nvme-cmb-pmr-vg-autotest_90959 00:38:09.542 [Pipeline] { 00:38:09.567 [Pipeline] copyArtifacts 00:38:09.751 Copied 13 artifacts from "nvme-cmb-pmr-vg-autotest" build number 90959 00:38:09.755 [Pipeline] writeFile 00:38:09.843 [Pipeline] } 00:38:09.888 [Pipeline] // dir 00:38:10.449 [Pipeline] dir 00:38:10.450 Running in /var/jenkins/workspace/autotest-per-patch_2/crypto-phy-autotest_37569 00:38:10.451 [Pipeline] { 00:38:10.487 [Pipeline] copyArtifacts 00:38:10.729 Copied 13 artifacts from "crypto-phy-autotest" build number 37569 00:38:10.733 [Pipeline] writeFile 00:38:10.922 [Pipeline] } 00:38:11.025 [Pipeline] // dir 00:38:11.291 [Pipeline] dir 00:38:11.292 Running in /var/jenkins/workspace/autotest-per-patch_2/vhost-phy-autotest_37630 00:38:11.293 [Pipeline] { 00:38:11.321 [Pipeline] copyArtifacts 00:38:11.522 Copied 13 artifacts from "vhost-phy-autotest" build number 37630 00:38:11.526 [Pipeline] writeFile 00:38:11.613 [Pipeline] } 00:38:11.660 [Pipeline] // dir 00:38:11.922 [Pipeline] dir 00:38:11.922 Running in /var/jenkins/workspace/autotest-per-patch_2/freebsd-vg-autotest_68080 00:38:11.923 [Pipeline] { 00:38:11.950 [Pipeline] copyArtifacts 00:38:12.276 Copied 12 artifacts from "freebsd-vg-autotest" build number 68080 00:38:12.281 [Pipeline] writeFile 00:38:12.372 [Pipeline] } 00:38:12.420 [Pipeline] // dir 00:38:12.752 [Pipeline] dir 00:38:12.752 Running in /var/jenkins/workspace/autotest-per-patch_2/vfio-user-phy-autotest_37570 00:38:12.754 [Pipeline] { 00:38:12.785 [Pipeline] copyArtifacts 00:38:12.947 Copied 13 artifacts from "vfio-user-phy-autotest" build number 37570 00:38:12.950 [Pipeline] writeFile 00:38:13.071 [Pipeline] } 00:38:13.132 [Pipeline] // dir 00:38:13.490 [Pipeline] dir 00:38:13.491 Running in /var/jenkins/workspace/autotest-per-patch_2/iscsi-uring-vg-autotest_89735 00:38:13.492 [Pipeline] { 00:38:13.525 [Pipeline] copyArtifacts 00:38:17.112 Copied 17 artifacts from "iscsi-uring-vg-autotest" build number 89735 00:38:17.117 [Pipeline] writeFile 00:38:17.243 [Pipeline] } 00:38:17.305 [Pipeline] // dir 00:38:17.889 [Pipeline] dir 00:38:17.889 Running in /var/jenkins/workspace/autotest-per-patch_2/lvol-vg-autotest_89783 00:38:17.890 [Pipeline] { 00:38:17.931 [Pipeline] copyArtifacts 00:38:18.156 Copied 13 artifacts from "lvol-vg-autotest" build number 89783 00:38:18.161 [Pipeline] writeFile 00:38:18.418 [Pipeline] } 00:38:18.526 [Pipeline] // dir 00:38:19.102 [Pipeline] dir 00:38:19.102 Running in /var/jenkins/workspace/autotest-per-patch_2/nvme-phy-autotest_83736 00:38:19.104 [Pipeline] { 00:38:19.147 [Pipeline] copyArtifacts 00:38:19.403 Copied 13 artifacts from "nvme-phy-autotest" build number 83736 00:38:19.407 [Pipeline] writeFile 00:38:19.623 [Pipeline] } 00:38:19.712 [Pipeline] // dir 00:38:20.730 [Pipeline] dir 00:38:20.730 Running in /var/jenkins/workspace/autotest-per-patch_2/nvmf-tcp-uring-vg-autotest_89777 00:38:20.731 [Pipeline] { 00:38:20.790 [Pipeline] copyArtifacts 00:38:21.212 Copied 13 artifacts from "nvmf-tcp-uring-vg-autotest" build number 89777 00:38:21.217 [Pipeline] writeFile 00:38:21.666 [Pipeline] } 00:38:21.809 [Pipeline] // dir 00:38:22.257 [Pipeline] dir 00:38:22.257 Running in /var/jenkins/workspace/autotest-per-patch_2/ubuntu24-vg-autotest_6432 00:38:22.259 [Pipeline] { 00:38:22.296 [Pipeline] copyArtifacts 00:38:22.757 Copied 13 artifacts from "ubuntu24-vg-autotest" build number 6432 00:38:22.761 [Pipeline] writeFile 00:38:22.948 [Pipeline] } 00:38:23.022 [Pipeline] // dir 00:38:23.342 [Pipeline] dir 00:38:23.342 Running in /var/jenkins/workspace/autotest-per-patch_2/iscsi-vg-autotest_89871 00:38:23.343 [Pipeline] { 00:38:23.375 [Pipeline] copyArtifacts 00:38:25.860 Copied 17 artifacts from "iscsi-vg-autotest" build number 89871 00:38:25.865 [Pipeline] writeFile 00:38:25.970 [Pipeline] } 00:38:26.048 [Pipeline] // dir 00:38:27.192 [Pipeline] dir 00:38:27.193 Running in /var/jenkins/workspace/autotest-per-patch_2/nvmf-tcp-vg-autotest_89816 00:38:27.194 [Pipeline] { 00:38:27.264 [Pipeline] copyArtifacts 00:38:27.766 Copied 13 artifacts from "nvmf-tcp-vg-autotest" build number 89816 00:38:27.770 [Pipeline] writeFile 00:38:28.255 [Pipeline] } 00:38:28.420 [Pipeline] // dir 00:38:29.425 [Pipeline] dir 00:38:29.426 Running in /var/jenkins/workspace/autotest-per-patch_2/nvmf-phy-autotest_83812 00:38:29.427 [Pipeline] { 00:38:29.487 [Pipeline] copyArtifacts 00:38:29.918 Copied 13 artifacts from "nvmf-phy-autotest" build number 83812 00:38:29.921 [Pipeline] writeFile 00:38:30.323 [Pipeline] } 00:38:30.488 [Pipeline] // dir 00:38:30.916 [Pipeline] dir 00:38:30.916 Running in /var/jenkins/workspace/autotest-per-patch_2/ubuntu22-vg-autotest_48871 00:38:30.917 [Pipeline] { 00:38:30.953 [Pipeline] copyArtifacts 00:38:31.400 Copied 13 artifacts from "ubuntu22-vg-autotest" build number 48871 00:38:31.404 [Pipeline] writeFile 00:38:31.564 [Pipeline] } 00:38:31.655 [Pipeline] // dir 00:38:32.815 [Pipeline] dir 00:38:32.815 Running in /var/jenkins/workspace/autotest-per-patch_2/raid-vg-autotest_4568 00:38:32.816 [Pipeline] { 00:38:32.871 [Pipeline] copyArtifacts 00:38:33.033 Copied 13 artifacts from "raid-vg-autotest" build number 4568 00:38:33.037 [Pipeline] writeFile 00:38:33.375 [Pipeline] } 00:38:33.482 [Pipeline] // dir 00:38:33.961 [Pipeline] dir 00:38:33.961 Running in /var/jenkins/workspace/autotest-per-patch_2/rocky9-vg-autotest_27174 00:38:33.962 [Pipeline] { 00:38:33.987 [Pipeline] copyArtifacts 00:38:34.289 Copied 13 artifacts from "rocky9-vg-autotest" build number 27174 00:38:34.294 [Pipeline] writeFile 00:38:34.434 [Pipeline] } 00:38:34.498 [Pipeline] // dir 00:38:35.666 [Pipeline] dir 00:38:35.666 Running in /var/jenkins/workspace/autotest-per-patch_2/nvmf-tcp-phy-autotest_83694 00:38:35.667 [Pipeline] { 00:38:35.738 [Pipeline] copyArtifacts 00:38:36.333 Copied 13 artifacts from "nvmf-tcp-phy-autotest" build number 83694 00:38:36.337 [Pipeline] writeFile 00:38:36.718 [Pipeline] } 00:38:36.890 [Pipeline] // dir 00:38:37.477 [Pipeline] dir 00:38:37.477 Running in /var/jenkins/workspace/autotest-per-patch_2/nvme-vg-autotest_89834 00:38:37.478 [Pipeline] { 00:38:37.515 [Pipeline] copyArtifacts 00:38:37.727 Copied 13 artifacts from "nvme-vg-autotest" build number 89834 00:38:37.731 [Pipeline] writeFile 00:38:37.950 [Pipeline] } 00:38:38.012 [Pipeline] // dir 00:38:38.020 [Pipeline] catchError 00:38:38.021 [Pipeline] { 00:38:38.035 [Pipeline] sh 00:38:38.313 + jbp/jenkins/jjb-config/jobs/scripts/post_gen_coverage.sh 00:38:38.313 + shopt -s globstar nullglob 00:38:38.313 + echo 'Start stage post_gen_coverage.sh' 00:38:38.313 Start stage post_gen_coverage.sh 00:38:38.313 + cd /var/jenkins/workspace/autotest-per-patch_2 00:38:38.313 + rm -rf /var/jenkins/workspace/autotest-per-patch_2/spdk/doc 00:38:38.313 + trap 'compress_coverage_and_docs; remove_partial_coverage_files && echo '\''End stage post_gen_coverage.sh'\''' EXIT 00:38:38.313 + move_artifacts 00:38:38.313 + local out_dirs 00:38:38.313 + out_dirs=(./**/output/) 00:38:38.313 + for dir in "${out_dirs[@]}" 00:38:38.313 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.313 + [[ -f ./autobuild-external-vg-autotest_29843/output//doc.tar.xz ]] 00:38:38.313 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.313 + [[ -f ./autobuild-external-vg-autotest_29843/output//ut_coverage.tar.xz ]] 00:38:38.313 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.313 + [[ -f ./autobuild-external-vg-autotest_29843/output//llvm.tar.xz ]] 00:38:38.313 + mv ./autobuild-external-vg-autotest_29843/output//build-kernel-manifest.txt ./autobuild-external-vg-autotest_29843/output//build-pkg-manifest.txt ./autobuild-external-vg-autotest_29843/output//build-repo-manifest.txt ./autobuild-external-vg-autotest_29843/output//dmesg.init.log ./autobuild-external-vg-autotest_29843/output//dmesg.log ./autobuild-external-vg-autotest_29843/output//power.tar.xz ./autobuild-external-vg-autotest_29843/output//test_completions.txt ./autobuild-external-vg-autotest_29843/output//timing.svg ./autobuild-external-vg-autotest_29843/output//timing.txt ./autobuild-external-vg-autotest_29843/output//.. 00:38:38.313 + rmdir ./autobuild-external-vg-autotest_29843/output/ 00:38:38.313 + for dir in "${out_dirs[@]}" 00:38:38.313 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.313 + [[ -f ./BlobFS-phy-autotest_37580/output//doc.tar.xz ]] 00:38:38.313 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.314 + [[ -f ./BlobFS-phy-autotest_37580/output//ut_coverage.tar.xz ]] 00:38:38.314 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.314 + [[ -f ./BlobFS-phy-autotest_37580/output//llvm.tar.xz ]] 00:38:38.314 + mv ./BlobFS-phy-autotest_37580/output//all_tests.txt ./BlobFS-phy-autotest_37580/output//build-kernel-manifest.txt ./BlobFS-phy-autotest_37580/output//build-pkg-manifest.txt ./BlobFS-phy-autotest_37580/output//build-repo-manifest.txt ./BlobFS-phy-autotest_37580/output//cov_base.info.xz ./BlobFS-phy-autotest_37580/output//cov_test.info.xz ./BlobFS-phy-autotest_37580/output//cov_total.info.xz ./BlobFS-phy-autotest_37580/output//dmesg.init.log ./BlobFS-phy-autotest_37580/output//dmesg.log ./BlobFS-phy-autotest_37580/output//power.tar.xz ./BlobFS-phy-autotest_37580/output//rocksdb ./BlobFS-phy-autotest_37580/output//test_completions.txt ./BlobFS-phy-autotest_37580/output//timing.svg ./BlobFS-phy-autotest_37580/output//timing.txt ./BlobFS-phy-autotest_37580/output//.. 00:38:38.314 + rmdir ./BlobFS-phy-autotest_37580/output/ 00:38:38.314 + for dir in "${out_dirs[@]}" 00:38:38.314 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.314 + [[ -f ./build-files-docker-autotest_32381/output//doc.tar.xz ]] 00:38:38.314 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.314 + [[ -f ./build-files-docker-autotest_32381/output//ut_coverage.tar.xz ]] 00:38:38.314 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.314 + [[ -f ./build-files-docker-autotest_32381/output//llvm.tar.xz ]] 00:38:38.314 + mv ./build-files-docker-autotest_32381/output//build-repo-manifest.txt ./build-files-docker-autotest_32381/output//power.tar.xz ./build-files-docker-autotest_32381/output//test_completions.txt ./build-files-docker-autotest_32381/output//timing.svg ./build-files-docker-autotest_32381/output//timing.txt ./build-files-docker-autotest_32381/output//.. 00:38:38.314 + rmdir ./build-files-docker-autotest_32381/output/ 00:38:38.314 + for dir in "${out_dirs[@]}" 00:38:38.314 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.314 + [[ -f ./check-format-docker-autotest_32407/output//doc.tar.xz ]] 00:38:38.314 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.314 + [[ -f ./check-format-docker-autotest_32407/output//ut_coverage.tar.xz ]] 00:38:38.314 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.314 + [[ -f ./check-format-docker-autotest_32407/output//llvm.tar.xz ]] 00:38:38.314 + mv ./check-format-docker-autotest_32407/output//build-repo-manifest.txt ./check-format-docker-autotest_32407/output//power.tar.xz ./check-format-docker-autotest_32407/output//test_completions.txt ./check-format-docker-autotest_32407/output//timing.svg ./check-format-docker-autotest_32407/output//timing.txt ./check-format-docker-autotest_32407/output//.. 00:38:38.314 + rmdir ./check-format-docker-autotest_32407/output/ 00:38:38.314 + for dir in "${out_dirs[@]}" 00:38:38.314 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.314 + [[ -f ./check-so-deps-docker-autotest_32628/output//doc.tar.xz ]] 00:38:38.314 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.314 + [[ -f ./check-so-deps-docker-autotest_32628/output//ut_coverage.tar.xz ]] 00:38:38.314 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.314 + [[ -f ./check-so-deps-docker-autotest_32628/output//llvm.tar.xz ]] 00:38:38.314 + mv ./check-so-deps-docker-autotest_32628/output//build-repo-manifest.txt ./check-so-deps-docker-autotest_32628/output//power.tar.xz ./check-so-deps-docker-autotest_32628/output//test_completions.txt ./check-so-deps-docker-autotest_32628/output//timing.svg ./check-so-deps-docker-autotest_32628/output//timing.txt ./check-so-deps-docker-autotest_32628/output//.. 00:38:38.314 + rmdir ./check-so-deps-docker-autotest_32628/output/ 00:38:38.314 + for dir in "${out_dirs[@]}" 00:38:38.314 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.314 + [[ -f ./crypto-phy-autotest_37569/output//doc.tar.xz ]] 00:38:38.314 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.314 + [[ -f ./crypto-phy-autotest_37569/output//ut_coverage.tar.xz ]] 00:38:38.314 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.314 + [[ -f ./crypto-phy-autotest_37569/output//llvm.tar.xz ]] 00:38:38.314 + mv ./crypto-phy-autotest_37569/output//all_tests.txt ./crypto-phy-autotest_37569/output//build-kernel-manifest.txt ./crypto-phy-autotest_37569/output//build-pkg-manifest.txt ./crypto-phy-autotest_37569/output//build-repo-manifest.txt ./crypto-phy-autotest_37569/output//cov_base.info.xz ./crypto-phy-autotest_37569/output//cov_test.info.xz ./crypto-phy-autotest_37569/output//cov_total.info.xz ./crypto-phy-autotest_37569/output//dmesg.init.log ./crypto-phy-autotest_37569/output//dmesg.log ./crypto-phy-autotest_37569/output//power.tar.xz ./crypto-phy-autotest_37569/output//test_completions.txt ./crypto-phy-autotest_37569/output//timing.svg ./crypto-phy-autotest_37569/output//timing.txt ./crypto-phy-autotest_37569/output//.. 00:38:38.314 + rmdir ./crypto-phy-autotest_37569/output/ 00:38:38.314 + for dir in "${out_dirs[@]}" 00:38:38.314 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.314 + [[ -f ./doc-docker-autotest_32710/output//doc.tar.xz ]] 00:38:38.314 + tar -C ./doc-docker-autotest_32710/output/ -xf ./doc-docker-autotest_32710/output//doc.tar.xz 00:38:38.578 + rm ./doc-docker-autotest_32710/output//doc.tar.xz 00:38:38.578 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.578 + [[ -f ./doc-docker-autotest_32710/output//ut_coverage.tar.xz ]] 00:38:38.578 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.578 + [[ -f ./doc-docker-autotest_32710/output//llvm.tar.xz ]] 00:38:38.578 + mv ./doc-docker-autotest_32710/output//build-repo-manifest.txt ./doc-docker-autotest_32710/output//doc ./doc-docker-autotest_32710/output//power.tar.xz ./doc-docker-autotest_32710/output//test_completions.txt ./doc-docker-autotest_32710/output//timing.svg ./doc-docker-autotest_32710/output//timing.txt ./doc-docker-autotest_32710/output//.. 00:38:38.578 + rmdir ./doc-docker-autotest_32710/output/ 00:38:38.578 + for dir in "${out_dirs[@]}" 00:38:38.578 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.578 + [[ -f ./freebsd-vg-autotest_68080/output//doc.tar.xz ]] 00:38:38.578 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.578 + [[ -f ./freebsd-vg-autotest_68080/output//ut_coverage.tar.xz ]] 00:38:38.578 + tar -C ./freebsd-vg-autotest_68080/output/ -xf ./freebsd-vg-autotest_68080/output//ut_coverage.tar.xz 00:38:38.839 + rm ./freebsd-vg-autotest_68080/output//ut_coverage.tar.xz 00:38:38.839 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.840 + [[ -f ./freebsd-vg-autotest_68080/output//llvm.tar.xz ]] 00:38:38.840 + mv ./freebsd-vg-autotest_68080/output//all_tests.txt ./freebsd-vg-autotest_68080/output//build-pkg-manifest.txt ./freebsd-vg-autotest_68080/output//build-repo-manifest.txt ./freebsd-vg-autotest_68080/output//cov_base.info.xz ./freebsd-vg-autotest_68080/output//cov_test.info.xz ./freebsd-vg-autotest_68080/output//cov_total.info.xz ./freebsd-vg-autotest_68080/output//messages ./freebsd-vg-autotest_68080/output//power.tar.xz ./freebsd-vg-autotest_68080/output//test_completions.txt ./freebsd-vg-autotest_68080/output//timing.svg ./freebsd-vg-autotest_68080/output//timing.txt ./freebsd-vg-autotest_68080/output//ut_coverage ./freebsd-vg-autotest_68080/output//.. 00:38:38.840 + rmdir ./freebsd-vg-autotest_68080/output/ 00:38:38.840 + for dir in "${out_dirs[@]}" 00:38:38.840 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.840 + [[ -f ./iscsi-uring-vg-autotest_89735/output//doc.tar.xz ]] 00:38:38.840 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.840 + [[ -f ./iscsi-uring-vg-autotest_89735/output//ut_coverage.tar.xz ]] 00:38:38.840 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.840 + [[ -f ./iscsi-uring-vg-autotest_89735/output//llvm.tar.xz ]] 00:38:38.840 + mv ./iscsi-uring-vg-autotest_89735/output//all_tests.txt ./iscsi-uring-vg-autotest_89735/output//build-kernel-manifest.txt ./iscsi-uring-vg-autotest_89735/output//build-pkg-manifest.txt ./iscsi-uring-vg-autotest_89735/output//build-repo-manifest.txt ./iscsi-uring-vg-autotest_89735/output//calsoft.json ./iscsi-uring-vg-autotest_89735/output//calsoft.tar.xz ./iscsi-uring-vg-autotest_89735/output//cov_base.info.xz ./iscsi-uring-vg-autotest_89735/output//cov_test.info.xz ./iscsi-uring-vg-autotest_89735/output//cov_total.info.xz ./iscsi-uring-vg-autotest_89735/output//dmesg.init.log ./iscsi-uring-vg-autotest_89735/output//dmesg.log ./iscsi-uring-vg-autotest_89735/output//iscsi_autofuzz_logs.txt ./iscsi-uring-vg-autotest_89735/output//iscsi_autofuzz_tgt_output.txt ./iscsi-uring-vg-autotest_89735/output//power.tar.xz ./iscsi-uring-vg-autotest_89735/output//test_completions.txt ./iscsi-uring-vg-autotest_89735/output//timing.svg ./iscsi-uring-vg-autotest_89735/output//timing.txt ./iscsi-uring-vg-autotest_89735/output//.. 00:38:38.840 + rmdir ./iscsi-uring-vg-autotest_89735/output/ 00:38:38.840 + for dir in "${out_dirs[@]}" 00:38:38.840 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.840 + [[ -f ./iscsi-vg-autotest_89871/output//doc.tar.xz ]] 00:38:38.840 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.840 + [[ -f ./iscsi-vg-autotest_89871/output//ut_coverage.tar.xz ]] 00:38:38.840 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.840 + [[ -f ./iscsi-vg-autotest_89871/output//llvm.tar.xz ]] 00:38:38.840 + mv ./iscsi-vg-autotest_89871/output//all_tests.txt ./iscsi-vg-autotest_89871/output//build-kernel-manifest.txt ./iscsi-vg-autotest_89871/output//build-pkg-manifest.txt ./iscsi-vg-autotest_89871/output//build-repo-manifest.txt ./iscsi-vg-autotest_89871/output//calsoft.json ./iscsi-vg-autotest_89871/output//calsoft.tar.xz ./iscsi-vg-autotest_89871/output//cov_base.info.xz ./iscsi-vg-autotest_89871/output//cov_test.info.xz ./iscsi-vg-autotest_89871/output//cov_total.info.xz ./iscsi-vg-autotest_89871/output//dmesg.init.log ./iscsi-vg-autotest_89871/output//dmesg.log ./iscsi-vg-autotest_89871/output//iscsi_autofuzz_logs.txt ./iscsi-vg-autotest_89871/output//iscsi_autofuzz_tgt_output.txt ./iscsi-vg-autotest_89871/output//power.tar.xz ./iscsi-vg-autotest_89871/output//test_completions.txt ./iscsi-vg-autotest_89871/output//timing.svg ./iscsi-vg-autotest_89871/output//timing.txt ./iscsi-vg-autotest_89871/output//.. 00:38:38.840 + rmdir ./iscsi-vg-autotest_89871/output/ 00:38:38.840 + for dir in "${out_dirs[@]}" 00:38:38.840 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.840 + [[ -f ./lvol-vg-autotest_89783/output//doc.tar.xz ]] 00:38:38.840 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.840 + [[ -f ./lvol-vg-autotest_89783/output//ut_coverage.tar.xz ]] 00:38:38.840 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.840 + [[ -f ./lvol-vg-autotest_89783/output//llvm.tar.xz ]] 00:38:38.840 + mv ./lvol-vg-autotest_89783/output//all_tests.txt ./lvol-vg-autotest_89783/output//build-kernel-manifest.txt ./lvol-vg-autotest_89783/output//build-pkg-manifest.txt ./lvol-vg-autotest_89783/output//build-repo-manifest.txt ./lvol-vg-autotest_89783/output//cov_base.info.xz ./lvol-vg-autotest_89783/output//cov_test.info.xz ./lvol-vg-autotest_89783/output//cov_total.info.xz ./lvol-vg-autotest_89783/output//dmesg.init.log ./lvol-vg-autotest_89783/output//dmesg.log ./lvol-vg-autotest_89783/output//power.tar.xz ./lvol-vg-autotest_89783/output//test_completions.txt ./lvol-vg-autotest_89783/output//timing.svg ./lvol-vg-autotest_89783/output//timing.txt ./lvol-vg-autotest_89783/output//.. 00:38:38.840 + rmdir ./lvol-vg-autotest_89783/output/ 00:38:38.840 + for dir in "${out_dirs[@]}" 00:38:38.840 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.840 + [[ -f ./nvme-cmb-pmr-vg-autotest_90959/output//doc.tar.xz ]] 00:38:38.840 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.840 + [[ -f ./nvme-cmb-pmr-vg-autotest_90959/output//ut_coverage.tar.xz ]] 00:38:38.840 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.840 + [[ -f ./nvme-cmb-pmr-vg-autotest_90959/output//llvm.tar.xz ]] 00:38:38.840 + mv ./nvme-cmb-pmr-vg-autotest_90959/output//all_tests.txt ./nvme-cmb-pmr-vg-autotest_90959/output//build-kernel-manifest.txt ./nvme-cmb-pmr-vg-autotest_90959/output//build-pkg-manifest.txt ./nvme-cmb-pmr-vg-autotest_90959/output//build-repo-manifest.txt ./nvme-cmb-pmr-vg-autotest_90959/output//cov_base.info.xz ./nvme-cmb-pmr-vg-autotest_90959/output//cov_test.info.xz ./nvme-cmb-pmr-vg-autotest_90959/output//cov_total.info.xz ./nvme-cmb-pmr-vg-autotest_90959/output//dmesg.init.log ./nvme-cmb-pmr-vg-autotest_90959/output//dmesg.log ./nvme-cmb-pmr-vg-autotest_90959/output//power.tar.xz ./nvme-cmb-pmr-vg-autotest_90959/output//test_completions.txt ./nvme-cmb-pmr-vg-autotest_90959/output//timing.svg ./nvme-cmb-pmr-vg-autotest_90959/output//timing.txt ./nvme-cmb-pmr-vg-autotest_90959/output//.. 00:38:38.840 + rmdir ./nvme-cmb-pmr-vg-autotest_90959/output/ 00:38:38.840 + for dir in "${out_dirs[@]}" 00:38:38.840 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.840 + [[ -f ./nvme-phy-autotest_83736/output//doc.tar.xz ]] 00:38:38.840 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.840 + [[ -f ./nvme-phy-autotest_83736/output//ut_coverage.tar.xz ]] 00:38:38.840 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.840 + [[ -f ./nvme-phy-autotest_83736/output//llvm.tar.xz ]] 00:38:38.840 + mv ./nvme-phy-autotest_83736/output//all_tests.txt ./nvme-phy-autotest_83736/output//build-kernel-manifest.txt ./nvme-phy-autotest_83736/output//build-pkg-manifest.txt ./nvme-phy-autotest_83736/output//build-repo-manifest.txt ./nvme-phy-autotest_83736/output//cov_base.info.xz ./nvme-phy-autotest_83736/output//cov_test.info.xz ./nvme-phy-autotest_83736/output//cov_total.info.xz ./nvme-phy-autotest_83736/output//dmesg.init.log ./nvme-phy-autotest_83736/output//dmesg.log ./nvme-phy-autotest_83736/output//power.tar.xz ./nvme-phy-autotest_83736/output//test_completions.txt ./nvme-phy-autotest_83736/output//timing.svg ./nvme-phy-autotest_83736/output//timing.txt ./nvme-phy-autotest_83736/output//.. 00:38:38.840 + rmdir ./nvme-phy-autotest_83736/output/ 00:38:38.840 + for dir in "${out_dirs[@]}" 00:38:38.840 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.840 + [[ -f ./nvme-vg-autotest_89834/output//doc.tar.xz ]] 00:38:38.840 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.840 + [[ -f ./nvme-vg-autotest_89834/output//ut_coverage.tar.xz ]] 00:38:38.840 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.840 + [[ -f ./nvme-vg-autotest_89834/output//llvm.tar.xz ]] 00:38:38.840 + mv ./nvme-vg-autotest_89834/output//all_tests.txt ./nvme-vg-autotest_89834/output//build-kernel-manifest.txt ./nvme-vg-autotest_89834/output//build-pkg-manifest.txt ./nvme-vg-autotest_89834/output//build-repo-manifest.txt ./nvme-vg-autotest_89834/output//cov_base.info.xz ./nvme-vg-autotest_89834/output//cov_test.info.xz ./nvme-vg-autotest_89834/output//cov_total.info.xz ./nvme-vg-autotest_89834/output//dmesg.init.log ./nvme-vg-autotest_89834/output//dmesg.log ./nvme-vg-autotest_89834/output//power.tar.xz ./nvme-vg-autotest_89834/output//test_completions.txt ./nvme-vg-autotest_89834/output//timing.svg ./nvme-vg-autotest_89834/output//timing.txt ./nvme-vg-autotest_89834/output//.. 00:38:38.840 + rmdir ./nvme-vg-autotest_89834/output/ 00:38:38.840 + for dir in "${out_dirs[@]}" 00:38:38.840 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.840 + [[ -f ./nvmf-phy-autotest_83812/output//doc.tar.xz ]] 00:38:38.840 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.840 + [[ -f ./nvmf-phy-autotest_83812/output//ut_coverage.tar.xz ]] 00:38:38.840 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.840 + [[ -f ./nvmf-phy-autotest_83812/output//llvm.tar.xz ]] 00:38:38.840 + mv ./nvmf-phy-autotest_83812/output//all_tests.txt ./nvmf-phy-autotest_83812/output//build-kernel-manifest.txt ./nvmf-phy-autotest_83812/output//build-pkg-manifest.txt ./nvmf-phy-autotest_83812/output//build-repo-manifest.txt ./nvmf-phy-autotest_83812/output//cov_base.info.xz ./nvmf-phy-autotest_83812/output//dmesg.init.log ./nvmf-phy-autotest_83812/output//dmesg.log ./nvmf-phy-autotest_83812/output//nvmf_trace.0_shm.tar.gz ./nvmf-phy-autotest_83812/output//power.tar.xz ./nvmf-phy-autotest_83812/output//proc_list.txt ./nvmf-phy-autotest_83812/output//test_completions.txt ./nvmf-phy-autotest_83812/output//timing.txt ./nvmf-phy-autotest_83812/output//udev.log ./nvmf-phy-autotest_83812/output//.. 00:38:38.840 + rmdir ./nvmf-phy-autotest_83812/output/ 00:38:38.840 + for dir in "${out_dirs[@]}" 00:38:38.840 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.840 + [[ -f ./nvmf-tcp-phy-autotest_83694/output//doc.tar.xz ]] 00:38:38.840 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.840 + [[ -f ./nvmf-tcp-phy-autotest_83694/output//ut_coverage.tar.xz ]] 00:38:38.840 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.840 + [[ -f ./nvmf-tcp-phy-autotest_83694/output//llvm.tar.xz ]] 00:38:38.841 + mv ./nvmf-tcp-phy-autotest_83694/output//all_tests.txt ./nvmf-tcp-phy-autotest_83694/output//build-kernel-manifest.txt ./nvmf-tcp-phy-autotest_83694/output//build-pkg-manifest.txt ./nvmf-tcp-phy-autotest_83694/output//build-repo-manifest.txt ./nvmf-tcp-phy-autotest_83694/output//cov_base.info.xz ./nvmf-tcp-phy-autotest_83694/output//dmesg.init.log ./nvmf-tcp-phy-autotest_83694/output//dmesg.log ./nvmf-tcp-phy-autotest_83694/output//nvmf_trace.0_shm.tar.gz ./nvmf-tcp-phy-autotest_83694/output//power.tar.xz ./nvmf-tcp-phy-autotest_83694/output//proc_list.txt ./nvmf-tcp-phy-autotest_83694/output//test_completions.txt ./nvmf-tcp-phy-autotest_83694/output//timing.txt ./nvmf-tcp-phy-autotest_83694/output//udev.log ./nvmf-tcp-phy-autotest_83694/output//.. 00:38:38.841 + rmdir ./nvmf-tcp-phy-autotest_83694/output/ 00:38:38.841 + for dir in "${out_dirs[@]}" 00:38:38.841 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.841 + [[ -f ./nvmf-tcp-uring-vg-autotest_89777/output//doc.tar.xz ]] 00:38:38.841 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.841 + [[ -f ./nvmf-tcp-uring-vg-autotest_89777/output//ut_coverage.tar.xz ]] 00:38:38.841 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.841 + [[ -f ./nvmf-tcp-uring-vg-autotest_89777/output//llvm.tar.xz ]] 00:38:38.841 + mv ./nvmf-tcp-uring-vg-autotest_89777/output//all_tests.txt ./nvmf-tcp-uring-vg-autotest_89777/output//build-kernel-manifest.txt ./nvmf-tcp-uring-vg-autotest_89777/output//build-pkg-manifest.txt ./nvmf-tcp-uring-vg-autotest_89777/output//build-repo-manifest.txt ./nvmf-tcp-uring-vg-autotest_89777/output//cov_base.info.xz ./nvmf-tcp-uring-vg-autotest_89777/output//dmesg.init.log ./nvmf-tcp-uring-vg-autotest_89777/output//dmesg.log ./nvmf-tcp-uring-vg-autotest_89777/output//nvmf_trace.0_shm.tar.gz ./nvmf-tcp-uring-vg-autotest_89777/output//power.tar.xz ./nvmf-tcp-uring-vg-autotest_89777/output//proc_list.txt ./nvmf-tcp-uring-vg-autotest_89777/output//test_completions.txt ./nvmf-tcp-uring-vg-autotest_89777/output//timing.txt ./nvmf-tcp-uring-vg-autotest_89777/output//udev.log ./nvmf-tcp-uring-vg-autotest_89777/output//.. 00:38:38.841 + rmdir ./nvmf-tcp-uring-vg-autotest_89777/output/ 00:38:38.841 + for dir in "${out_dirs[@]}" 00:38:38.841 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.841 + [[ -f ./nvmf-tcp-vg-autotest_89816/output//doc.tar.xz ]] 00:38:38.841 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.841 + [[ -f ./nvmf-tcp-vg-autotest_89816/output//ut_coverage.tar.xz ]] 00:38:38.841 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.841 + [[ -f ./nvmf-tcp-vg-autotest_89816/output//llvm.tar.xz ]] 00:38:38.841 + mv ./nvmf-tcp-vg-autotest_89816/output//all_tests.txt ./nvmf-tcp-vg-autotest_89816/output//build-kernel-manifest.txt ./nvmf-tcp-vg-autotest_89816/output//build-pkg-manifest.txt ./nvmf-tcp-vg-autotest_89816/output//build-repo-manifest.txt ./nvmf-tcp-vg-autotest_89816/output//cov_base.info.xz ./nvmf-tcp-vg-autotest_89816/output//dmesg.init.log ./nvmf-tcp-vg-autotest_89816/output//dmesg.log ./nvmf-tcp-vg-autotest_89816/output//nvmf_trace.0_shm.tar.gz ./nvmf-tcp-vg-autotest_89816/output//power.tar.xz ./nvmf-tcp-vg-autotest_89816/output//proc_list.txt ./nvmf-tcp-vg-autotest_89816/output//test_completions.txt ./nvmf-tcp-vg-autotest_89816/output//timing.txt ./nvmf-tcp-vg-autotest_89816/output//udev.log ./nvmf-tcp-vg-autotest_89816/output//.. 00:38:38.841 + rmdir ./nvmf-tcp-vg-autotest_89816/output/ 00:38:38.841 + for dir in "${out_dirs[@]}" 00:38:38.841 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.841 + [[ -f ./packaging-docker-autotest_29219/output//doc.tar.xz ]] 00:38:38.841 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.841 + [[ -f ./packaging-docker-autotest_29219/output//ut_coverage.tar.xz ]] 00:38:38.841 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.841 + [[ -f ./packaging-docker-autotest_29219/output//llvm.tar.xz ]] 00:38:38.841 + mv ./packaging-docker-autotest_29219/output//build-repo-manifest.txt ./packaging-docker-autotest_29219/output//power.tar.xz ./packaging-docker-autotest_29219/output//test_completions.txt ./packaging-docker-autotest_29219/output//timing.svg ./packaging-docker-autotest_29219/output//timing.txt ./packaging-docker-autotest_29219/output//.. 00:38:38.841 + rmdir ./packaging-docker-autotest_29219/output/ 00:38:38.841 + for dir in "${out_dirs[@]}" 00:38:38.841 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.841 + [[ -f ./raid-vg-autotest_4568/output//doc.tar.xz ]] 00:38:38.841 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.841 + [[ -f ./raid-vg-autotest_4568/output//ut_coverage.tar.xz ]] 00:38:38.841 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.841 + [[ -f ./raid-vg-autotest_4568/output//llvm.tar.xz ]] 00:38:38.841 + mv ./raid-vg-autotest_4568/output//all_tests.txt ./raid-vg-autotest_4568/output//build-kernel-manifest.txt ./raid-vg-autotest_4568/output//build-pkg-manifest.txt ./raid-vg-autotest_4568/output//build-repo-manifest.txt ./raid-vg-autotest_4568/output//cov_base.info.xz ./raid-vg-autotest_4568/output//cov_test.info.xz ./raid-vg-autotest_4568/output//cov_total.info.xz ./raid-vg-autotest_4568/output//dmesg.init.log ./raid-vg-autotest_4568/output//dmesg.log ./raid-vg-autotest_4568/output//power.tar.xz ./raid-vg-autotest_4568/output//test_completions.txt ./raid-vg-autotest_4568/output//timing.svg ./raid-vg-autotest_4568/output//timing.txt ./raid-vg-autotest_4568/output//.. 00:38:38.841 + rmdir ./raid-vg-autotest_4568/output/ 00:38:38.841 + for dir in "${out_dirs[@]}" 00:38:38.841 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.841 + [[ -f ./release-build-clang-docker-autotest_2438/output//doc.tar.xz ]] 00:38:38.841 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.841 + [[ -f ./release-build-clang-docker-autotest_2438/output//ut_coverage.tar.xz ]] 00:38:38.841 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.841 + [[ -f ./release-build-clang-docker-autotest_2438/output//llvm.tar.xz ]] 00:38:38.841 + mv ./release-build-clang-docker-autotest_2438/output//build-repo-manifest.txt ./release-build-clang-docker-autotest_2438/output//power.tar.xz ./release-build-clang-docker-autotest_2438/output//test_completions.txt ./release-build-clang-docker-autotest_2438/output//timing.svg ./release-build-clang-docker-autotest_2438/output//timing.txt ./release-build-clang-docker-autotest_2438/output//.. 00:38:38.841 + rmdir ./release-build-clang-docker-autotest_2438/output/ 00:38:38.841 + for dir in "${out_dirs[@]}" 00:38:38.841 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.841 + [[ -f ./release-build-main-docker-autotest_2438/output//doc.tar.xz ]] 00:38:38.841 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.841 + [[ -f ./release-build-main-docker-autotest_2438/output//ut_coverage.tar.xz ]] 00:38:38.841 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.841 + [[ -f ./release-build-main-docker-autotest_2438/output//llvm.tar.xz ]] 00:38:38.841 + mv ./release-build-main-docker-autotest_2438/output//build-repo-manifest.txt ./release-build-main-docker-autotest_2438/output//power.tar.xz ./release-build-main-docker-autotest_2438/output//test_completions.txt ./release-build-main-docker-autotest_2438/output//timing.svg ./release-build-main-docker-autotest_2438/output//timing.txt ./release-build-main-docker-autotest_2438/output//.. 00:38:38.841 + rmdir ./release-build-main-docker-autotest_2438/output/ 00:38:38.841 + for dir in "${out_dirs[@]}" 00:38:38.841 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.841 + [[ -f ./rocky9-vg-autotest_27174/output//doc.tar.xz ]] 00:38:38.841 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:38.841 + [[ -f ./rocky9-vg-autotest_27174/output//ut_coverage.tar.xz ]] 00:38:38.841 + tar -C ./rocky9-vg-autotest_27174/output/ -xf ./rocky9-vg-autotest_27174/output//ut_coverage.tar.xz 00:38:39.104 + rm ./rocky9-vg-autotest_27174/output//ut_coverage.tar.xz 00:38:39.104 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:39.104 + [[ -f ./rocky9-vg-autotest_27174/output//llvm.tar.xz ]] 00:38:39.104 + mv ./rocky9-vg-autotest_27174/output//all_tests.txt ./rocky9-vg-autotest_27174/output//build-pkg-manifest.txt ./rocky9-vg-autotest_27174/output//build-repo-manifest.txt ./rocky9-vg-autotest_27174/output//cov_base.info.xz ./rocky9-vg-autotest_27174/output//cov_test.info.xz ./rocky9-vg-autotest_27174/output//cov_total.info.xz ./rocky9-vg-autotest_27174/output//dmesg.init.log ./rocky9-vg-autotest_27174/output//dmesg.log ./rocky9-vg-autotest_27174/output//power.tar.xz ./rocky9-vg-autotest_27174/output//test_completions.txt ./rocky9-vg-autotest_27174/output//timing.svg ./rocky9-vg-autotest_27174/output//timing.txt ./rocky9-vg-autotest_27174/output//ut_coverage ./rocky9-vg-autotest_27174/output//.. 00:38:39.104 + rmdir ./rocky9-vg-autotest_27174/output/ 00:38:39.104 + for dir in "${out_dirs[@]}" 00:38:39.104 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:39.104 + [[ -f ./scan-build-docker-autotest_29226/output//doc.tar.xz ]] 00:38:39.104 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:39.104 + [[ -f ./scan-build-docker-autotest_29226/output//ut_coverage.tar.xz ]] 00:38:39.104 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:39.104 + [[ -f ./scan-build-docker-autotest_29226/output//llvm.tar.xz ]] 00:38:39.104 + mv ./scan-build-docker-autotest_29226/output//all_c_files.txt ./scan-build-docker-autotest_29226/output//build_output.txt ./scan-build-docker-autotest_29226/output//build-repo-manifest.txt ./scan-build-docker-autotest_29226/output//built_c_files.txt ./scan-build-docker-autotest_29226/output//power.tar.xz ./scan-build-docker-autotest_29226/output//test_completions.txt ./scan-build-docker-autotest_29226/output//timing.svg ./scan-build-docker-autotest_29226/output//timing.txt ./scan-build-docker-autotest_29226/output//unbuilt_c_files.txt ./scan-build-docker-autotest_29226/output//.. 00:38:39.104 + rmdir ./scan-build-docker-autotest_29226/output/ 00:38:39.104 + for dir in "${out_dirs[@]}" 00:38:39.104 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:39.104 + [[ -f ./short-fuzz-phy-autotest_37565/output//doc.tar.xz ]] 00:38:39.104 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:39.104 + [[ -f ./short-fuzz-phy-autotest_37565/output//ut_coverage.tar.xz ]] 00:38:39.104 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:39.104 + [[ -f ./short-fuzz-phy-autotest_37565/output//llvm.tar.xz ]] 00:38:39.104 + tar -C ./short-fuzz-phy-autotest_37565/output/ -xf ./short-fuzz-phy-autotest_37565/output//llvm.tar.xz 00:38:39.104 + rm ./short-fuzz-phy-autotest_37565/output//llvm.tar.xz 00:38:39.104 + mv ./short-fuzz-phy-autotest_37565/output//all_tests.txt ./short-fuzz-phy-autotest_37565/output//build-kernel-manifest.txt ./short-fuzz-phy-autotest_37565/output//build-pkg-manifest.txt ./short-fuzz-phy-autotest_37565/output//build-repo-manifest.txt ./short-fuzz-phy-autotest_37565/output//cov_base.info.xz ./short-fuzz-phy-autotest_37565/output//cov_test.info.xz ./short-fuzz-phy-autotest_37565/output//cov_total.info.xz ./short-fuzz-phy-autotest_37565/output//dmesg.init.log ./short-fuzz-phy-autotest_37565/output//dmesg.log ./short-fuzz-phy-autotest_37565/output//llvm ./short-fuzz-phy-autotest_37565/output//power.tar.xz ./short-fuzz-phy-autotest_37565/output//test_completions.txt ./short-fuzz-phy-autotest_37565/output//timing.svg ./short-fuzz-phy-autotest_37565/output//timing.txt ./short-fuzz-phy-autotest_37565/output//.. 00:38:39.104 + rmdir ./short-fuzz-phy-autotest_37565/output/ 00:38:39.104 + for dir in "${out_dirs[@]}" 00:38:39.104 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:39.104 + [[ -f ./ubuntu22-vg-autotest_48871/output//doc.tar.xz ]] 00:38:39.104 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:39.104 + [[ -f ./ubuntu22-vg-autotest_48871/output//ut_coverage.tar.xz ]] 00:38:39.104 + tar -C ./ubuntu22-vg-autotest_48871/output/ -xf ./ubuntu22-vg-autotest_48871/output//ut_coverage.tar.xz 00:38:39.372 + rm ./ubuntu22-vg-autotest_48871/output//ut_coverage.tar.xz 00:38:39.372 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:39.372 + [[ -f ./ubuntu22-vg-autotest_48871/output//llvm.tar.xz ]] 00:38:39.372 + mv ./ubuntu22-vg-autotest_48871/output//all_tests.txt ./ubuntu22-vg-autotest_48871/output//build-pkg-manifest.txt ./ubuntu22-vg-autotest_48871/output//build-repo-manifest.txt ./ubuntu22-vg-autotest_48871/output//cov_base.info.xz ./ubuntu22-vg-autotest_48871/output//cov_test.info.xz ./ubuntu22-vg-autotest_48871/output//cov_total.info.xz ./ubuntu22-vg-autotest_48871/output//dmesg.init.log ./ubuntu22-vg-autotest_48871/output//dmesg.log ./ubuntu22-vg-autotest_48871/output//power.tar.xz ./ubuntu22-vg-autotest_48871/output//test_completions.txt ./ubuntu22-vg-autotest_48871/output//timing.svg ./ubuntu22-vg-autotest_48871/output//timing.txt ./ubuntu22-vg-autotest_48871/output//ut_coverage ./ubuntu22-vg-autotest_48871/output//.. 00:38:39.372 + rmdir ./ubuntu22-vg-autotest_48871/output/ 00:38:39.372 + for dir in "${out_dirs[@]}" 00:38:39.372 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:39.372 + [[ -f ./ubuntu24-vg-autotest_6432/output//doc.tar.xz ]] 00:38:39.372 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:39.372 + [[ -f ./ubuntu24-vg-autotest_6432/output//ut_coverage.tar.xz ]] 00:38:39.372 + tar -C ./ubuntu24-vg-autotest_6432/output/ -xf ./ubuntu24-vg-autotest_6432/output//ut_coverage.tar.xz 00:38:39.633 + rm ./ubuntu24-vg-autotest_6432/output//ut_coverage.tar.xz 00:38:39.633 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:39.633 + [[ -f ./ubuntu24-vg-autotest_6432/output//llvm.tar.xz ]] 00:38:39.633 + mv ./ubuntu24-vg-autotest_6432/output//all_tests.txt ./ubuntu24-vg-autotest_6432/output//build-pkg-manifest.txt ./ubuntu24-vg-autotest_6432/output//build-repo-manifest.txt ./ubuntu24-vg-autotest_6432/output//cov_base.info.xz ./ubuntu24-vg-autotest_6432/output//cov_test.info.xz ./ubuntu24-vg-autotest_6432/output//cov_total.info.xz ./ubuntu24-vg-autotest_6432/output//dmesg.init.log ./ubuntu24-vg-autotest_6432/output//dmesg.log ./ubuntu24-vg-autotest_6432/output//power.tar.xz ./ubuntu24-vg-autotest_6432/output//test_completions.txt ./ubuntu24-vg-autotest_6432/output//timing.svg ./ubuntu24-vg-autotest_6432/output//timing.txt ./ubuntu24-vg-autotest_6432/output//ut_coverage ./ubuntu24-vg-autotest_6432/output//.. 00:38:39.633 + rmdir ./ubuntu24-vg-autotest_6432/output/ 00:38:39.633 + for dir in "${out_dirs[@]}" 00:38:39.633 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:39.633 + [[ -f ./unittest-clang-docker-autotest_29219/output//doc.tar.xz ]] 00:38:39.633 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:39.633 + [[ -f ./unittest-clang-docker-autotest_29219/output//ut_coverage.tar.xz ]] 00:38:39.633 + tar -C ./unittest-clang-docker-autotest_29219/output/ -xf ./unittest-clang-docker-autotest_29219/output//ut_coverage.tar.xz 00:38:40.197 + rm ./unittest-clang-docker-autotest_29219/output//ut_coverage.tar.xz 00:38:40.197 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:40.197 + [[ -f ./unittest-clang-docker-autotest_29219/output//llvm.tar.xz ]] 00:38:40.197 + mv ./unittest-clang-docker-autotest_29219/output//build-repo-manifest.txt ./unittest-clang-docker-autotest_29219/output//power.tar.xz ./unittest-clang-docker-autotest_29219/output//test_completions.txt ./unittest-clang-docker-autotest_29219/output//timing.svg ./unittest-clang-docker-autotest_29219/output//timing.txt ./unittest-clang-docker-autotest_29219/output//ut_coverage ./unittest-clang-docker-autotest_29219/output//.. 00:38:40.197 + rmdir ./unittest-clang-docker-autotest_29219/output/ 00:38:40.197 + for dir in "${out_dirs[@]}" 00:38:40.197 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:40.197 + [[ -f ./unittest-main-docker-autotest_29221/output//doc.tar.xz ]] 00:38:40.197 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:40.197 + [[ -f ./unittest-main-docker-autotest_29221/output//ut_coverage.tar.xz ]] 00:38:40.197 + tar -C ./unittest-main-docker-autotest_29221/output/ -xf ./unittest-main-docker-autotest_29221/output//ut_coverage.tar.xz 00:38:40.453 + rm ./unittest-main-docker-autotest_29221/output//ut_coverage.tar.xz 00:38:40.453 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:40.453 + [[ -f ./unittest-main-docker-autotest_29221/output//llvm.tar.xz ]] 00:38:40.454 + mv ./unittest-main-docker-autotest_29221/output//build-repo-manifest.txt ./unittest-main-docker-autotest_29221/output//power.tar.xz ./unittest-main-docker-autotest_29221/output//test_completions.txt ./unittest-main-docker-autotest_29221/output//timing.svg ./unittest-main-docker-autotest_29221/output//timing.txt ./unittest-main-docker-autotest_29221/output//ut_coverage ./unittest-main-docker-autotest_29221/output//.. 00:38:40.454 + rmdir ./unittest-main-docker-autotest_29221/output/ 00:38:40.454 + for dir in "${out_dirs[@]}" 00:38:40.454 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:40.454 + [[ -f ./unittest-valgrind-docker-autotest_29224/output//doc.tar.xz ]] 00:38:40.454 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:40.454 + [[ -f ./unittest-valgrind-docker-autotest_29224/output//ut_coverage.tar.xz ]] 00:38:40.454 + tar -C ./unittest-valgrind-docker-autotest_29224/output/ -xf ./unittest-valgrind-docker-autotest_29224/output//ut_coverage.tar.xz 00:38:40.711 + rm ./unittest-valgrind-docker-autotest_29224/output//ut_coverage.tar.xz 00:38:40.711 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:40.711 + [[ -f ./unittest-valgrind-docker-autotest_29224/output//llvm.tar.xz ]] 00:38:40.711 + mv ./unittest-valgrind-docker-autotest_29224/output//build-repo-manifest.txt ./unittest-valgrind-docker-autotest_29224/output//power.tar.xz ./unittest-valgrind-docker-autotest_29224/output//test_completions.txt ./unittest-valgrind-docker-autotest_29224/output//timing.svg ./unittest-valgrind-docker-autotest_29224/output//timing.txt ./unittest-valgrind-docker-autotest_29224/output//ut_coverage ./unittest-valgrind-docker-autotest_29224/output//.. 00:38:40.711 + rmdir ./unittest-valgrind-docker-autotest_29224/output/ 00:38:40.711 + for dir in "${out_dirs[@]}" 00:38:40.711 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:40.711 + [[ -f ./vfio-user-phy-autotest_37570/output//doc.tar.xz ]] 00:38:40.711 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:40.711 + [[ -f ./vfio-user-phy-autotest_37570/output//ut_coverage.tar.xz ]] 00:38:40.711 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:40.711 + [[ -f ./vfio-user-phy-autotest_37570/output//llvm.tar.xz ]] 00:38:40.711 + mv ./vfio-user-phy-autotest_37570/output//all_tests.txt ./vfio-user-phy-autotest_37570/output//build-kernel-manifest.txt ./vfio-user-phy-autotest_37570/output//build-pkg-manifest.txt ./vfio-user-phy-autotest_37570/output//build-repo-manifest.txt ./vfio-user-phy-autotest_37570/output//cov_base.info.xz ./vfio-user-phy-autotest_37570/output//cov_test.info.xz ./vfio-user-phy-autotest_37570/output//cov_total.info.xz ./vfio-user-phy-autotest_37570/output//dmesg.init.log ./vfio-user-phy-autotest_37570/output//dmesg.log ./vfio-user-phy-autotest_37570/output//power.tar.xz ./vfio-user-phy-autotest_37570/output//test_completions.txt ./vfio-user-phy-autotest_37570/output//timing.svg ./vfio-user-phy-autotest_37570/output//timing.txt ./vfio-user-phy-autotest_37570/output//.. 00:38:40.711 + rmdir ./vfio-user-phy-autotest_37570/output/ 00:38:40.711 + for dir in "${out_dirs[@]}" 00:38:40.711 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:40.711 + [[ -f ./vhost-initiator-vg-autotest_89852/output//doc.tar.xz ]] 00:38:40.711 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:40.711 + [[ -f ./vhost-initiator-vg-autotest_89852/output//ut_coverage.tar.xz ]] 00:38:40.711 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:40.711 + [[ -f ./vhost-initiator-vg-autotest_89852/output//llvm.tar.xz ]] 00:38:40.711 + mv ./vhost-initiator-vg-autotest_89852/output//all_tests.txt ./vhost-initiator-vg-autotest_89852/output//build-kernel-manifest.txt ./vhost-initiator-vg-autotest_89852/output//build-pkg-manifest.txt ./vhost-initiator-vg-autotest_89852/output//build-repo-manifest.txt ./vhost-initiator-vg-autotest_89852/output//cov_base.info.xz ./vhost-initiator-vg-autotest_89852/output//cov_test.info.xz ./vhost-initiator-vg-autotest_89852/output//cov_total.info.xz ./vhost-initiator-vg-autotest_89852/output//dmesg.init.log ./vhost-initiator-vg-autotest_89852/output//dmesg.log ./vhost-initiator-vg-autotest_89852/output//power.tar.xz ./vhost-initiator-vg-autotest_89852/output//test_completions.txt ./vhost-initiator-vg-autotest_89852/output//timing.svg ./vhost-initiator-vg-autotest_89852/output//timing.txt ./vhost-initiator-vg-autotest_89852/output//vhost_fuzz_output1.txt.xz ./vhost-initiator-vg-autotest_89852/output//vhost_fuzz_output2.txt.xz ./vhost-initiator-vg-autotest_89852/output//vhost_fuzz_tgt_output.txt.xz ./vhost-initiator-vg-autotest_89852/output//.. 00:38:40.711 + rmdir ./vhost-initiator-vg-autotest_89852/output/ 00:38:40.711 + for dir in "${out_dirs[@]}" 00:38:40.711 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:40.711 + [[ -f ./vhost-phy-autotest_37630/output//doc.tar.xz ]] 00:38:40.711 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:40.711 + [[ -f ./vhost-phy-autotest_37630/output//ut_coverage.tar.xz ]] 00:38:40.711 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:40.711 + [[ -f ./vhost-phy-autotest_37630/output//llvm.tar.xz ]] 00:38:40.711 + mv ./vhost-phy-autotest_37630/output//all_tests.txt ./vhost-phy-autotest_37630/output//build-kernel-manifest.txt ./vhost-phy-autotest_37630/output//build-pkg-manifest.txt ./vhost-phy-autotest_37630/output//build-repo-manifest.txt ./vhost-phy-autotest_37630/output//cov_base.info.xz ./vhost-phy-autotest_37630/output//cov_test.info.xz ./vhost-phy-autotest_37630/output//cov_total.info.xz ./vhost-phy-autotest_37630/output//dmesg.init.log ./vhost-phy-autotest_37630/output//dmesg.log ./vhost-phy-autotest_37630/output//power.tar.xz ./vhost-phy-autotest_37630/output//test_completions.txt ./vhost-phy-autotest_37630/output//timing.svg ./vhost-phy-autotest_37630/output//timing.txt ./vhost-phy-autotest_37630/output//.. 00:38:40.711 + rmdir ./vhost-phy-autotest_37630/output/ 00:38:40.711 + for dir in "${out_dirs[@]}" 00:38:40.711 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:40.711 + [[ -f ./zns-vg-autotest_88936/output//doc.tar.xz ]] 00:38:40.711 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:40.711 + [[ -f ./zns-vg-autotest_88936/output//ut_coverage.tar.xz ]] 00:38:40.711 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:38:40.711 + [[ -f ./zns-vg-autotest_88936/output//llvm.tar.xz ]] 00:38:40.711 + mv ./zns-vg-autotest_88936/output//all_tests.txt ./zns-vg-autotest_88936/output//build-kernel-manifest.txt ./zns-vg-autotest_88936/output//build-pkg-manifest.txt ./zns-vg-autotest_88936/output//build-repo-manifest.txt ./zns-vg-autotest_88936/output//cov_base.info.xz ./zns-vg-autotest_88936/output//cov_test.info.xz ./zns-vg-autotest_88936/output//cov_total.info.xz ./zns-vg-autotest_88936/output//dmesg.init.log ./zns-vg-autotest_88936/output//dmesg.log ./zns-vg-autotest_88936/output//power.tar.xz ./zns-vg-autotest_88936/output//test_completions.txt ./zns-vg-autotest_88936/output//timing.svg ./zns-vg-autotest_88936/output//timing.txt ./zns-vg-autotest_88936/output//.. 00:38:40.711 + rmdir ./zns-vg-autotest_88936/output/ 00:38:40.712 + unpack_cov_files 00:38:40.712 + local info_files 00:38:40.712 + info_files=(*/cov_*.info.xz) 00:38:40.712 + xargs -P0 -r -n1 xz -d 00:38:40.712 + printf '%s\n' BlobFS-phy-autotest_37580/cov_base.info.xz BlobFS-phy-autotest_37580/cov_test.info.xz BlobFS-phy-autotest_37580/cov_total.info.xz crypto-phy-autotest_37569/cov_base.info.xz crypto-phy-autotest_37569/cov_test.info.xz crypto-phy-autotest_37569/cov_total.info.xz freebsd-vg-autotest_68080/cov_base.info.xz freebsd-vg-autotest_68080/cov_test.info.xz freebsd-vg-autotest_68080/cov_total.info.xz iscsi-uring-vg-autotest_89735/cov_base.info.xz iscsi-uring-vg-autotest_89735/cov_test.info.xz iscsi-uring-vg-autotest_89735/cov_total.info.xz iscsi-vg-autotest_89871/cov_base.info.xz iscsi-vg-autotest_89871/cov_test.info.xz iscsi-vg-autotest_89871/cov_total.info.xz lvol-vg-autotest_89783/cov_base.info.xz lvol-vg-autotest_89783/cov_test.info.xz lvol-vg-autotest_89783/cov_total.info.xz nvme-cmb-pmr-vg-autotest_90959/cov_base.info.xz nvme-cmb-pmr-vg-autotest_90959/cov_test.info.xz nvme-cmb-pmr-vg-autotest_90959/cov_total.info.xz nvme-phy-autotest_83736/cov_base.info.xz nvme-phy-autotest_83736/cov_test.info.xz nvme-phy-autotest_83736/cov_total.info.xz nvme-vg-autotest_89834/cov_base.info.xz nvme-vg-autotest_89834/cov_test.info.xz nvme-vg-autotest_89834/cov_total.info.xz nvmf-phy-autotest_83812/cov_base.info.xz nvmf-tcp-phy-autotest_83694/cov_base.info.xz nvmf-tcp-uring-vg-autotest_89777/cov_base.info.xz nvmf-tcp-vg-autotest_89816/cov_base.info.xz raid-vg-autotest_4568/cov_base.info.xz raid-vg-autotest_4568/cov_test.info.xz raid-vg-autotest_4568/cov_total.info.xz rocky9-vg-autotest_27174/cov_base.info.xz rocky9-vg-autotest_27174/cov_test.info.xz rocky9-vg-autotest_27174/cov_total.info.xz short-fuzz-phy-autotest_37565/cov_base.info.xz short-fuzz-phy-autotest_37565/cov_test.info.xz short-fuzz-phy-autotest_37565/cov_total.info.xz ubuntu22-vg-autotest_48871/cov_base.info.xz ubuntu22-vg-autotest_48871/cov_test.info.xz ubuntu22-vg-autotest_48871/cov_total.info.xz ubuntu24-vg-autotest_6432/cov_base.info.xz ubuntu24-vg-autotest_6432/cov_test.info.xz ubuntu24-vg-autotest_6432/cov_total.info.xz vfio-user-phy-autotest_37570/cov_base.info.xz vfio-user-phy-autotest_37570/cov_test.info.xz vfio-user-phy-autotest_37570/cov_total.info.xz vhost-initiator-vg-autotest_89852/cov_base.info.xz vhost-initiator-vg-autotest_89852/cov_test.info.xz vhost-initiator-vg-autotest_89852/cov_total.info.xz vhost-phy-autotest_37630/cov_base.info.xz vhost-phy-autotest_37630/cov_test.info.xz vhost-phy-autotest_37630/cov_total.info.xz zns-vg-autotest_88936/cov_base.info.xz zns-vg-autotest_88936/cov_test.info.xz zns-vg-autotest_88936/cov_total.info.xz 00:38:41.276 + fix_downstream_job_paths 00:38:41.276 + sed -i -e 's#^SF:/.\+/spdk/#SF:/var/jenkins/workspace/autotest-per-patch_2/spdk/#g' BlobFS-phy-autotest_37580/cov_total.info crypto-phy-autotest_37569/cov_total.info freebsd-vg-autotest_68080/cov_total.info iscsi-uring-vg-autotest_89735/cov_total.info iscsi-vg-autotest_89871/cov_total.info lvol-vg-autotest_89783/cov_total.info nvme-cmb-pmr-vg-autotest_90959/cov_total.info nvme-phy-autotest_83736/cov_total.info nvme-vg-autotest_89834/cov_total.info raid-vg-autotest_4568/cov_total.info rocky9-vg-autotest_27174/cov_total.info short-fuzz-phy-autotest_37565/cov_total.info ubuntu22-vg-autotest_48871/cov_total.info ubuntu24-vg-autotest_6432/cov_total.info vfio-user-phy-autotest_37570/cov_total.info vhost-initiator-vg-autotest_89852/cov_total.info vhost-phy-autotest_37630/cov_total.info zns-vg-autotest_88936/cov_total.info 00:38:42.655 + ignore_ocf_headers 00:38:42.655 + sed -i 's#--show-details#--show-details --ignore-errors source#g' spdk/autorun_post.py 00:38:42.655 + create_errtrace_files_for_all_builds 00:38:42.655 + local build_log_list 00:38:42.655 + build_log_list=($(find "$WORKSPACE" -type f -name 'build.log')) 00:38:42.655 ++ find /var/jenkins/workspace/autotest-per-patch_2 -type f -name build.log 00:38:42.655 + for build in "${build_log_list[@]}" 00:38:42.655 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_2/lvol-vg-autotest_89783/build.log 00:38:42.655 + local build_log job_name start_pattern end_pattern backtraces 00:38:42.655 + build_log=/var/jenkins/workspace/autotest-per-patch_2/lvol-vg-autotest_89783/build.log 00:38:42.655 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/lvol-vg-autotest_89783/build.log 00:38:42.655 ++ basename /var/jenkins/workspace/autotest-per-patch_2/lvol-vg-autotest_89783 00:38:42.655 + job_name=lvol-vg-autotest_89783 00:38:42.655 + start_pattern='Backtrace start' 00:38:42.655 + end_pattern='Backtrace end' 00:38:42.655 + [[ -f /var/jenkins/workspace/autotest-per-patch_2/lvol-vg-autotest_89783/build.log ]] 00:38:42.655 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_2/lvol-vg-autotest_89783/build.log 00:38:42.655 + backtraces= 00:38:42.655 + [[ -n '' ]] 00:38:42.655 + for build in "${build_log_list[@]}" 00:38:42.655 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_2/vhost-initiator-vg-autotest_89852/build.log 00:38:42.655 + local build_log job_name start_pattern end_pattern backtraces 00:38:42.655 + build_log=/var/jenkins/workspace/autotest-per-patch_2/vhost-initiator-vg-autotest_89852/build.log 00:38:42.655 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/vhost-initiator-vg-autotest_89852/build.log 00:38:42.655 ++ basename /var/jenkins/workspace/autotest-per-patch_2/vhost-initiator-vg-autotest_89852 00:38:42.655 + job_name=vhost-initiator-vg-autotest_89852 00:38:42.655 + start_pattern='Backtrace start' 00:38:42.655 + end_pattern='Backtrace end' 00:38:42.655 + [[ -f /var/jenkins/workspace/autotest-per-patch_2/vhost-initiator-vg-autotest_89852/build.log ]] 00:38:42.655 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_2/vhost-initiator-vg-autotest_89852/build.log 00:38:42.655 + backtraces= 00:38:42.655 + [[ -n '' ]] 00:38:42.655 + for build in "${build_log_list[@]}" 00:38:42.655 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_2/unittest-main-docker-autotest_29221/build.log 00:38:42.655 + local build_log job_name start_pattern end_pattern backtraces 00:38:42.655 + build_log=/var/jenkins/workspace/autotest-per-patch_2/unittest-main-docker-autotest_29221/build.log 00:38:42.655 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/unittest-main-docker-autotest_29221/build.log 00:38:42.655 ++ basename /var/jenkins/workspace/autotest-per-patch_2/unittest-main-docker-autotest_29221 00:38:42.655 + job_name=unittest-main-docker-autotest_29221 00:38:42.655 + start_pattern='Backtrace start' 00:38:42.655 + end_pattern='Backtrace end' 00:38:42.655 + [[ -f /var/jenkins/workspace/autotest-per-patch_2/unittest-main-docker-autotest_29221/build.log ]] 00:38:42.655 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_2/unittest-main-docker-autotest_29221/build.log 00:38:42.655 + backtraces= 00:38:42.655 + [[ -n '' ]] 00:38:42.655 + for build in "${build_log_list[@]}" 00:38:42.655 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_2/ubuntu24-vg-autotest_6432/build.log 00:38:42.655 + local build_log job_name start_pattern end_pattern backtraces 00:38:42.655 + build_log=/var/jenkins/workspace/autotest-per-patch_2/ubuntu24-vg-autotest_6432/build.log 00:38:42.655 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/ubuntu24-vg-autotest_6432/build.log 00:38:42.655 ++ basename /var/jenkins/workspace/autotest-per-patch_2/ubuntu24-vg-autotest_6432 00:38:42.655 + job_name=ubuntu24-vg-autotest_6432 00:38:42.655 + start_pattern='Backtrace start' 00:38:42.655 + end_pattern='Backtrace end' 00:38:42.655 + [[ -f /var/jenkins/workspace/autotest-per-patch_2/ubuntu24-vg-autotest_6432/build.log ]] 00:38:42.655 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_2/ubuntu24-vg-autotest_6432/build.log 00:38:42.655 + backtraces= 00:38:42.655 + [[ -n '' ]] 00:38:42.655 + for build in "${build_log_list[@]}" 00:38:42.655 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_2/nvme-cmb-pmr-vg-autotest_90959/build.log 00:38:42.655 + local build_log job_name start_pattern end_pattern backtraces 00:38:42.655 + build_log=/var/jenkins/workspace/autotest-per-patch_2/nvme-cmb-pmr-vg-autotest_90959/build.log 00:38:42.655 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/nvme-cmb-pmr-vg-autotest_90959/build.log 00:38:42.655 ++ basename /var/jenkins/workspace/autotest-per-patch_2/nvme-cmb-pmr-vg-autotest_90959 00:38:42.655 + job_name=nvme-cmb-pmr-vg-autotest_90959 00:38:42.655 + start_pattern='Backtrace start' 00:38:42.655 + end_pattern='Backtrace end' 00:38:42.655 + [[ -f /var/jenkins/workspace/autotest-per-patch_2/nvme-cmb-pmr-vg-autotest_90959/build.log ]] 00:38:42.655 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_2/nvme-cmb-pmr-vg-autotest_90959/build.log 00:38:42.655 + backtraces= 00:38:42.655 + [[ -n '' ]] 00:38:42.655 + for build in "${build_log_list[@]}" 00:38:42.655 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_2/nvme-phy-autotest_83736/build.log 00:38:42.655 + local build_log job_name start_pattern end_pattern backtraces 00:38:42.655 + build_log=/var/jenkins/workspace/autotest-per-patch_2/nvme-phy-autotest_83736/build.log 00:38:42.655 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/nvme-phy-autotest_83736/build.log 00:38:42.655 ++ basename /var/jenkins/workspace/autotest-per-patch_2/nvme-phy-autotest_83736 00:38:42.655 + job_name=nvme-phy-autotest_83736 00:38:42.655 + start_pattern='Backtrace start' 00:38:42.655 + end_pattern='Backtrace end' 00:38:42.655 + [[ -f /var/jenkins/workspace/autotest-per-patch_2/nvme-phy-autotest_83736/build.log ]] 00:38:42.655 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_2/nvme-phy-autotest_83736/build.log 00:38:42.655 + backtraces= 00:38:42.655 + [[ -n '' ]] 00:38:42.655 + for build in "${build_log_list[@]}" 00:38:42.655 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_2/unittest-valgrind-docker-autotest_29224/build.log 00:38:42.655 + local build_log job_name start_pattern end_pattern backtraces 00:38:42.655 + build_log=/var/jenkins/workspace/autotest-per-patch_2/unittest-valgrind-docker-autotest_29224/build.log 00:38:42.655 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/unittest-valgrind-docker-autotest_29224/build.log 00:38:42.655 ++ basename /var/jenkins/workspace/autotest-per-patch_2/unittest-valgrind-docker-autotest_29224 00:38:42.655 + job_name=unittest-valgrind-docker-autotest_29224 00:38:42.655 + start_pattern='Backtrace start' 00:38:42.655 + end_pattern='Backtrace end' 00:38:42.655 + [[ -f /var/jenkins/workspace/autotest-per-patch_2/unittest-valgrind-docker-autotest_29224/build.log ]] 00:38:42.655 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_2/unittest-valgrind-docker-autotest_29224/build.log 00:38:42.655 + backtraces= 00:38:42.655 + [[ -n '' ]] 00:38:42.655 + for build in "${build_log_list[@]}" 00:38:42.655 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_2/freebsd-vg-autotest_68080/build.log 00:38:42.655 + local build_log job_name start_pattern end_pattern backtraces 00:38:42.655 + build_log=/var/jenkins/workspace/autotest-per-patch_2/freebsd-vg-autotest_68080/build.log 00:38:42.655 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/freebsd-vg-autotest_68080/build.log 00:38:42.655 ++ basename /var/jenkins/workspace/autotest-per-patch_2/freebsd-vg-autotest_68080 00:38:42.655 + job_name=freebsd-vg-autotest_68080 00:38:42.655 + start_pattern='Backtrace start' 00:38:42.655 + end_pattern='Backtrace end' 00:38:42.655 + [[ -f /var/jenkins/workspace/autotest-per-patch_2/freebsd-vg-autotest_68080/build.log ]] 00:38:42.655 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_2/freebsd-vg-autotest_68080/build.log 00:38:42.655 + backtraces= 00:38:42.655 + [[ -n '' ]] 00:38:42.655 + for build in "${build_log_list[@]}" 00:38:42.655 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_2/autobuild-external-vg-autotest_29843/build.log 00:38:42.655 + local build_log job_name start_pattern end_pattern backtraces 00:38:42.655 + build_log=/var/jenkins/workspace/autotest-per-patch_2/autobuild-external-vg-autotest_29843/build.log 00:38:42.655 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/autobuild-external-vg-autotest_29843/build.log 00:38:42.655 ++ basename /var/jenkins/workspace/autotest-per-patch_2/autobuild-external-vg-autotest_29843 00:38:42.655 + job_name=autobuild-external-vg-autotest_29843 00:38:42.655 + start_pattern='Backtrace start' 00:38:42.655 + end_pattern='Backtrace end' 00:38:42.655 + [[ -f /var/jenkins/workspace/autotest-per-patch_2/autobuild-external-vg-autotest_29843/build.log ]] 00:38:42.655 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_2/autobuild-external-vg-autotest_29843/build.log 00:38:42.655 + backtraces= 00:38:42.655 + [[ -n '' ]] 00:38:42.655 + for build in "${build_log_list[@]}" 00:38:42.655 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_2/nvme-vg-autotest_89834/build.log 00:38:42.655 + local build_log job_name start_pattern end_pattern backtraces 00:38:42.656 + build_log=/var/jenkins/workspace/autotest-per-patch_2/nvme-vg-autotest_89834/build.log 00:38:42.656 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/nvme-vg-autotest_89834/build.log 00:38:42.656 ++ basename /var/jenkins/workspace/autotest-per-patch_2/nvme-vg-autotest_89834 00:38:42.656 + job_name=nvme-vg-autotest_89834 00:38:42.656 + start_pattern='Backtrace start' 00:38:42.656 + end_pattern='Backtrace end' 00:38:42.656 + [[ -f /var/jenkins/workspace/autotest-per-patch_2/nvme-vg-autotest_89834/build.log ]] 00:38:42.656 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_2/nvme-vg-autotest_89834/build.log 00:38:42.656 + backtraces= 00:38:42.656 + [[ -n '' ]] 00:38:42.656 + for build in "${build_log_list[@]}" 00:38:42.656 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_2/nvmf-tcp-vg-autotest_89816/build.log 00:38:42.656 + local build_log job_name start_pattern end_pattern backtraces 00:38:42.656 + build_log=/var/jenkins/workspace/autotest-per-patch_2/nvmf-tcp-vg-autotest_89816/build.log 00:38:42.656 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/nvmf-tcp-vg-autotest_89816/build.log 00:38:42.656 ++ basename /var/jenkins/workspace/autotest-per-patch_2/nvmf-tcp-vg-autotest_89816 00:38:42.656 + job_name=nvmf-tcp-vg-autotest_89816 00:38:42.656 + start_pattern='Backtrace start' 00:38:42.656 + end_pattern='Backtrace end' 00:38:42.656 + [[ -f /var/jenkins/workspace/autotest-per-patch_2/nvmf-tcp-vg-autotest_89816/build.log ]] 00:38:42.656 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_2/nvmf-tcp-vg-autotest_89816/build.log 00:38:42.656 + backtraces='00:22:45.010 ========== Backtrace start: ========== 00:38:42.656 00:22:45.010 00:38:42.656 00:22:45.010 in /home/vagrant/spdk_repo/spdk/test/nvmf/host/auth.sh:128 -> main(["--transport=tcp"]) 00:38:42.656 00:22:45.010 ... 00:38:42.656 00:22:45.010 123 NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.656 00:22:45.010 124 -a "$NVMF_FIRST_INITIATOR_IP" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.656 00:22:45.010 125 --dhchap-key "key1" --dhchap-ctrlr-key "ckey2" 00:38:42.656 00:22:45.010 126 00:38:42.656 00:22:45.010 127 # Check reauthentication 00:38:42.656 00:22:45.010 => 128 rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.656 00:22:45.010 129 -a "$(get_main_ns_ip)" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.656 00:22:45.010 130 --dhchap-key "key1" --dhchap-ctrlr-key "ckey1" --ctrlr-loss-timeout-sec 1 \ 00:38:42.656 00:22:45.010 131 --reconnect-delay-sec 1 00:38:42.656 00:22:45.010 132 nvmet_auth_set_key "sha256" "ffdhe2048" 2 00:38:42.656 00:22:45.010 133 rpc_cmd bdev_nvme_set_keys "nvme0" --dhchap-key "key2" --dhchap-ctrlr-key "ckey2" 00:38:42.656 00:22:45.010 ... 00:38:42.656 00:22:45.010 00:38:42.656 00:22:45.010 ========== Backtrace end ========== 00:38:42.656 00:22:45.010 ========== Backtrace start: ========== 00:38:42.656 00:22:45.010 00:38:42.656 00:22:45.010 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:589 -> rpc_cmd(["bdev_nvme_attach_controller"],["-b"],["nvme0"],["-t"],["tcp"],["-f"],["ipv4"],["-a"],[""],["-s"],["4420"],["-q"],["nqn.2024-02.io.spdk:host0"],["-n"],["nqn.2024-02.io.spdk:cnode0"],["--dhchap-key"],["key1"],["--dhchap-ctrlr-key"],["ckey1"],["--ctrlr-loss-timeout-sec"],["1"],["--reconnect-delay-sec"],["1"]) 00:38:42.656 00:22:45.010 ... 00:38:42.656 00:22:45.010 584 echo "$rsp" 00:38:42.656 00:22:45.010 585 done 00:38:42.656 00:22:45.010 586 00:38:42.656 00:22:45.010 587 rc=${!status[*]} 00:38:42.656 00:22:45.010 588 xtrace_restore 00:38:42.656 00:22:45.010 => 589 [[ $rc == 0 ]] 00:38:42.656 00:22:45.010 590 } 00:38:42.656 00:22:45.010 591 00:38:42.656 00:22:45.010 592 function rpc_cmd_simple_data_json() { 00:38:42.656 00:22:45.010 593 00:38:42.656 00:22:45.010 594 local elems="$1[@]" elem 00:38:42.656 00:22:45.010 ... 00:38:42.656 00:22:45.011 in /home/vagrant/spdk_repo/spdk/test/nvmf/host/auth.sh:128 -> main(["--transport=tcp"]) 00:38:42.656 00:22:45.011 ... 00:38:42.656 00:22:45.011 123 NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.656 00:22:45.011 124 -a "$NVMF_FIRST_INITIATOR_IP" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.656 00:22:45.011 125 --dhchap-key "key1" --dhchap-ctrlr-key "ckey2" 00:38:42.656 00:22:45.011 126 00:38:42.656 00:22:45.011 127 # Check reauthentication 00:38:42.656 00:22:45.011 => 128 rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.656 00:22:45.011 129 -a "$(get_main_ns_ip)" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.656 00:22:45.011 130 --dhchap-key "key1" --dhchap-ctrlr-key "ckey1" --ctrlr-loss-timeout-sec 1 \ 00:38:42.656 00:22:45.011 131 --reconnect-delay-sec 1 00:38:42.656 00:22:45.011 132 nvmet_auth_set_key "sha256" "ffdhe2048" 2 00:38:42.656 00:22:45.011 133 rpc_cmd bdev_nvme_set_keys "nvme0" --dhchap-key "key2" --dhchap-ctrlr-key "ckey2" 00:38:42.656 00:22:45.011 ... 00:38:42.656 00:22:45.011 00:38:42.656 00:22:45.011 ========== Backtrace end ========== 00:38:42.656 00:22:47.108 ========== Backtrace start: ========== 00:38:42.656 00:22:47.108 00:38:42.656 00:22:47.108 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_auth_host"],["/home/vagrant/spdk_repo/spdk/test/nvmf/host/auth.sh"],["--transport=tcp"]) 00:38:42.656 00:22:47.108 ... 00:38:42.656 00:22:47.108 1120 timing_enter $test_name 00:38:42.656 00:22:47.108 1121 echo "************************************" 00:38:42.656 00:22:47.108 1122 echo "START TEST $test_name" 00:38:42.656 00:22:47.108 1123 echo "************************************" 00:38:42.656 00:22:47.108 1124 xtrace_restore 00:38:42.656 00:22:47.108 1125 time "$@" 00:38:42.656 00:22:47.108 1126 xtrace_disable 00:38:42.656 00:22:47.108 1127 echo "************************************" 00:38:42.656 00:22:47.108 1128 echo "END TEST $test_name" 00:38:42.656 00:22:47.108 1129 echo "************************************" 00:38:42.656 00:22:47.108 1130 timing_exit $test_name 00:38:42.656 00:22:47.108 ... 00:38:42.656 00:22:47.108 in /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_host.sh:27 -> main(["--transport=tcp"]) 00:38:42.656 00:22:47.108 ... 00:38:42.656 00:22:47.108 22 run_test "nvmf_fio_host" $rootdir/test/nvmf/host/fio.sh "${TEST_ARGS[@]}" 00:38:42.656 00:22:47.108 23 run_test "nvmf_failover" $rootdir/test/nvmf/host/failover.sh "${TEST_ARGS[@]}" 00:38:42.656 00:22:47.108 24 run_test "nvmf_host_multipath_status" $rootdir/test/nvmf/host/multipath_status.sh "${TEST_ARGS[@]}" 00:38:42.656 00:22:47.108 25 run_test "nvmf_discovery_remove_ifc" $rootdir/test/nvmf/host/discovery_remove_ifc.sh "${TEST_ARGS[@]}" 00:38:42.656 00:22:47.108 26 run_test "nvmf_identify_kernel_target" "$rootdir/test/nvmf/host/identify_kernel_nvmf.sh" "${TEST_ARGS[@]}" 00:38:42.656 00:22:47.108 => 27 run_test "nvmf_auth_host" "$rootdir/test/nvmf/host/auth.sh" "${TEST_ARGS[@]}" 00:38:42.656 00:22:47.108 28 run_test "nvmf_bdevperf" "$rootdir/test/nvmf/host/bdevperf.sh" "${TEST_ARGS[@]}" 00:38:42.656 00:22:47.108 29 run_test "nvmf_target_disconnect" "$rootdir/test/nvmf/host/target_disconnect.sh" "${TEST_ARGS[@]}" 00:38:42.656 00:22:47.108 30 00:38:42.656 00:22:47.108 31 if [[ "$SPDK_TEST_NVMF_TRANSPORT" == "tcp" ]]; then 00:38:42.656 00:22:47.108 32 run_test "nvmf_digest" "$rootdir/test/nvmf/host/digest.sh" "${TEST_ARGS[@]}" 00:38:42.656 00:22:47.108 ... 00:38:42.656 00:22:47.108 00:38:42.656 00:22:47.108 ========== Backtrace end ========== 00:38:42.656 00:22:47.108 ========== Backtrace start: ========== 00:38:42.656 00:22:47.108 00:38:42.656 00:22:47.108 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_host"],["/home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_host.sh"],["--transport=tcp"]) 00:38:42.656 00:22:47.108 ... 00:38:42.656 00:22:47.108 1120 timing_enter $test_name 00:38:42.656 00:22:47.108 1121 echo "************************************" 00:38:42.656 00:22:47.108 1122 echo "START TEST $test_name" 00:38:42.656 00:22:47.108 1123 echo "************************************" 00:38:42.656 00:22:47.108 1124 xtrace_restore 00:38:42.656 00:22:47.108 1125 time "$@" 00:38:42.656 00:22:47.108 1126 xtrace_disable 00:38:42.656 00:22:47.108 1127 echo "************************************" 00:38:42.656 00:22:47.108 1128 echo "END TEST $test_name" 00:38:42.656 00:22:47.108 1129 echo "************************************" 00:38:42.656 00:22:47.108 1130 timing_exit $test_name 00:38:42.656 00:22:47.108 ... 00:38:42.656 00:22:47.108 in /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh:12 -> main(["--transport=tcp"]) 00:38:42.656 00:22:47.108 ... 00:38:42.656 00:22:47.108 7 rootdir=$(readlink -f $testdir/../..) 00:38:42.656 00:22:47.108 8 source $rootdir/test/common/autotest_common.sh 00:38:42.656 00:22:47.108 9 00:38:42.656 00:22:47.108 10 run_test "nvmf_target_core" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.656 00:22:47.108 11 run_test "nvmf_target_extra" $rootdir/test/nvmf/nvmf_target_extra.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.656 00:22:47.108 => 12 run_test "nvmf_host" $rootdir/test/nvmf/nvmf_host.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.656 00:22:47.108 13 00:38:42.656 00:22:47.108 14 # Interrupt mode for now is supported only on the target, with the TCP transport and posix or ssl socket implementations. 00:38:42.656 00:22:47.108 15 if [[ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" && $SPDK_TEST_URING -eq 0 ]]; then 00:38:42.656 00:22:47.108 16 run_test "nvmf_target_core_interrupt_mode" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT --interrupt-mode 00:38:42.656 00:22:47.108 17 run_test "nvmf_interrupt" $rootdir/test/nvmf/target/interrupt.sh --transport=$SPDK_TEST_NVMF_TRANSPORT --interrupt-mode 00:38:42.656 00:22:47.108 ... 00:38:42.656 00:22:47.108 00:38:42.656 00:22:47.108 ========== Backtrace end ========== 00:38:42.656 00:22:47.109 ========== Backtrace start: ========== 00:38:42.656 00:22:47.109 00:38:42.656 00:22:47.109 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_tcp"],["/home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh"],["--transport=tcp"]) 00:38:42.656 00:22:47.109 ... 00:38:42.656 00:22:47.109 1120 timing_enter $test_name 00:38:42.656 00:22:47.109 1121 echo "************************************" 00:38:42.656 00:22:47.109 1122 echo "START TEST $test_name" 00:38:42.656 00:22:47.109 1123 echo "************************************" 00:38:42.656 00:22:47.109 1124 xtrace_restore 00:38:42.656 00:22:47.109 1125 time "$@" 00:38:42.656 00:22:47.109 1126 xtrace_disable 00:38:42.656 00:22:47.109 1127 echo "************************************" 00:38:42.656 00:22:47.109 1128 echo "END TEST $test_name" 00:38:42.656 00:22:47.109 1129 echo "************************************" 00:38:42.656 00:22:47.109 1130 timing_exit $test_name 00:38:42.656 00:22:47.109 ... 00:38:42.656 00:22:47.109 in /home/vagrant/spdk_repo/spdk/autotest.sh:280 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 00:38:42.656 00:22:47.109 ... 00:38:42.657 00:22:47.109 275 # list of all tests can properly differentiate them. Please do not merge them into one line. 00:38:42.657 00:22:47.109 276 if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then 00:38:42.657 00:22:47.109 277 run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.657 00:22:47.109 278 run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.657 00:22:47.109 279 elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then 00:38:42.657 00:22:47.109 => 280 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.657 00:22:47.109 281 if [[ $SPDK_TEST_URING -eq 0 ]]; then 00:38:42.657 00:22:47.109 282 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.657 00:22:47.109 283 run_test "nvmf_identify_passthru" $rootdir/test/nvmf/target/identify_passthru.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.657 00:22:47.109 284 fi 00:38:42.657 00:22:47.109 285 run_test "nvmf_dif" $rootdir/test/nvmf/target/dif.sh 00:38:42.657 00:22:47.109 ... 00:38:42.657 00:22:47.109 00:38:42.657 00:22:47.109 ========== Backtrace end ==========' 00:38:42.657 + [[ -n 00:22:45.010 ========== Backtrace start: ========== 00:38:42.657 00:22:45.010 00:38:42.657 00:22:45.010 in /home/vagrant/spdk_repo/spdk/test/nvmf/host/auth.sh:128 -> main(["--transport=tcp"]) 00:38:42.657 00:22:45.010 ... 00:38:42.657 00:22:45.010 123 NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.657 00:22:45.010 124 -a "$NVMF_FIRST_INITIATOR_IP" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.657 00:22:45.010 125 --dhchap-key "key1" --dhchap-ctrlr-key "ckey2" 00:38:42.657 00:22:45.010 126 00:38:42.657 00:22:45.010 127 # Check reauthentication 00:38:42.657 00:22:45.010 => 128 rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.657 00:22:45.010 129 -a "$(get_main_ns_ip)" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.657 00:22:45.010 130 --dhchap-key "key1" --dhchap-ctrlr-key "ckey1" --ctrlr-loss-timeout-sec 1 \ 00:38:42.657 00:22:45.010 131 --reconnect-delay-sec 1 00:38:42.657 00:22:45.010 132 nvmet_auth_set_key "sha256" "ffdhe2048" 2 00:38:42.657 00:22:45.010 133 rpc_cmd bdev_nvme_set_keys "nvme0" --dhchap-key "key2" --dhchap-ctrlr-key "ckey2" 00:38:42.657 00:22:45.010 ... 00:38:42.657 00:22:45.010 00:38:42.657 00:22:45.010 ========== Backtrace end ========== 00:38:42.657 00:22:45.010 ========== Backtrace start: ========== 00:38:42.657 00:22:45.010 00:38:42.657 00:22:45.010 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:589 -> rpc_cmd(["bdev_nvme_attach_controller"],["-b"],["nvme0"],["-t"],["tcp"],["-f"],["ipv4"],["-a"],[""],["-s"],["4420"],["-q"],["nqn.2024-02.io.spdk:host0"],["-n"],["nqn.2024-02.io.spdk:cnode0"],["--dhchap-key"],["key1"],["--dhchap-ctrlr-key"],["ckey1"],["--ctrlr-loss-timeout-sec"],["1"],["--reconnect-delay-sec"],["1"]) 00:38:42.657 00:22:45.010 ... 00:38:42.657 00:22:45.010 584 echo "$rsp" 00:38:42.657 00:22:45.010 585 done 00:38:42.657 00:22:45.010 586 00:38:42.657 00:22:45.010 587 rc=${!status[*]} 00:38:42.657 00:22:45.010 588 xtrace_restore 00:38:42.657 00:22:45.010 => 589 [[ $rc == 0 ]] 00:38:42.657 00:22:45.010 590 } 00:38:42.657 00:22:45.010 591 00:38:42.657 00:22:45.010 592 function rpc_cmd_simple_data_json() { 00:38:42.657 00:22:45.010 593 00:38:42.657 00:22:45.010 594 local elems="$1[@]" elem 00:38:42.657 00:22:45.010 ... 00:38:42.657 00:22:45.011 in /home/vagrant/spdk_repo/spdk/test/nvmf/host/auth.sh:128 -> main(["--transport=tcp"]) 00:38:42.657 00:22:45.011 ... 00:38:42.657 00:22:45.011 123 NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.657 00:22:45.011 124 -a "$NVMF_FIRST_INITIATOR_IP" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.657 00:22:45.011 125 --dhchap-key "key1" --dhchap-ctrlr-key "ckey2" 00:38:42.657 00:22:45.011 126 00:38:42.657 00:22:45.011 127 # Check reauthentication 00:38:42.657 00:22:45.011 => 128 rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.657 00:22:45.011 129 -a "$(get_main_ns_ip)" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.657 00:22:45.011 130 --dhchap-key "key1" --dhchap-ctrlr-key "ckey1" --ctrlr-loss-timeout-sec 1 \ 00:38:42.657 00:22:45.011 131 --reconnect-delay-sec 1 00:38:42.657 00:22:45.011 132 nvmet_auth_set_key "sha256" "ffdhe2048" 2 00:38:42.657 00:22:45.011 133 rpc_cmd bdev_nvme_set_keys "nvme0" --dhchap-key "key2" --dhchap-ctrlr-key "ckey2" 00:38:42.657 00:22:45.011 ... 00:38:42.657 00:22:45.011 00:38:42.657 00:22:45.011 ========== Backtrace end ========== 00:38:42.657 00:22:47.108 ========== Backtrace start: ========== 00:38:42.657 00:22:47.108 00:38:42.657 00:22:47.108 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_auth_host"],["/home/vagrant/spdk_repo/spdk/test/nvmf/host/auth.sh"],["--transport=tcp"]) 00:38:42.657 00:22:47.108 ... 00:38:42.657 00:22:47.108 1120 timing_enter $test_name 00:38:42.657 00:22:47.108 1121 echo "************************************" 00:38:42.657 00:22:47.108 1122 echo "START TEST $test_name" 00:38:42.657 00:22:47.108 1123 echo "************************************" 00:38:42.657 00:22:47.108 1124 xtrace_restore 00:38:42.657 00:22:47.108 1125 time "$@" 00:38:42.657 00:22:47.108 1126 xtrace_disable 00:38:42.657 00:22:47.108 1127 echo "************************************" 00:38:42.657 00:22:47.108 1128 echo "END TEST $test_name" 00:38:42.657 00:22:47.108 1129 echo "************************************" 00:38:42.657 00:22:47.108 1130 timing_exit $test_name 00:38:42.657 00:22:47.108 ... 00:38:42.657 00:22:47.108 in /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_host.sh:27 -> main(["--transport=tcp"]) 00:38:42.657 00:22:47.108 ... 00:38:42.657 00:22:47.108 22 run_test "nvmf_fio_host" $rootdir/test/nvmf/host/fio.sh "${TEST_ARGS[@]}" 00:38:42.657 00:22:47.108 23 run_test "nvmf_failover" $rootdir/test/nvmf/host/failover.sh "${TEST_ARGS[@]}" 00:38:42.657 00:22:47.108 24 run_test "nvmf_host_multipath_status" $rootdir/test/nvmf/host/multipath_status.sh "${TEST_ARGS[@]}" 00:38:42.657 00:22:47.108 25 run_test "nvmf_discovery_remove_ifc" $rootdir/test/nvmf/host/discovery_remove_ifc.sh "${TEST_ARGS[@]}" 00:38:42.657 00:22:47.108 26 run_test "nvmf_identify_kernel_target" "$rootdir/test/nvmf/host/identify_kernel_nvmf.sh" "${TEST_ARGS[@]}" 00:38:42.657 00:22:47.108 => 27 run_test "nvmf_auth_host" "$rootdir/test/nvmf/host/auth.sh" "${TEST_ARGS[@]}" 00:38:42.657 00:22:47.108 28 run_test "nvmf_bdevperf" "$rootdir/test/nvmf/host/bdevperf.sh" "${TEST_ARGS[@]}" 00:38:42.657 00:22:47.108 29 run_test "nvmf_target_disconnect" "$rootdir/test/nvmf/host/target_disconnect.sh" "${TEST_ARGS[@]}" 00:38:42.657 00:22:47.108 30 00:38:42.657 00:22:47.108 31 if [[ "$SPDK_TEST_NVMF_TRANSPORT" == "tcp" ]]; then 00:38:42.657 00:22:47.108 32 run_test "nvmf_digest" "$rootdir/test/nvmf/host/digest.sh" "${TEST_ARGS[@]}" 00:38:42.657 00:22:47.108 ... 00:38:42.657 00:22:47.108 00:38:42.657 00:22:47.108 ========== Backtrace end ========== 00:38:42.657 00:22:47.108 ========== Backtrace start: ========== 00:38:42.657 00:22:47.108 00:38:42.657 00:22:47.108 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_host"],["/home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_host.sh"],["--transport=tcp"]) 00:38:42.657 00:22:47.108 ... 00:38:42.657 00:22:47.108 1120 timing_enter $test_name 00:38:42.657 00:22:47.108 1121 echo "************************************" 00:38:42.657 00:22:47.108 1122 echo "START TEST $test_name" 00:38:42.657 00:22:47.108 1123 echo "************************************" 00:38:42.657 00:22:47.108 1124 xtrace_restore 00:38:42.657 00:22:47.108 1125 time "$@" 00:38:42.657 00:22:47.108 1126 xtrace_disable 00:38:42.657 00:22:47.108 1127 echo "************************************" 00:38:42.657 00:22:47.108 1128 echo "END TEST $test_name" 00:38:42.657 00:22:47.108 1129 echo "************************************" 00:38:42.657 00:22:47.108 1130 timing_exit $test_name 00:38:42.657 00:22:47.108 ... 00:38:42.657 00:22:47.108 in /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh:12 -> main(["--transport=tcp"]) 00:38:42.657 00:22:47.108 ... 00:38:42.657 00:22:47.108 7 rootdir=$(readlink -f $testdir/../..) 00:38:42.657 00:22:47.108 8 source $rootdir/test/common/autotest_common.sh 00:38:42.657 00:22:47.108 9 00:38:42.657 00:22:47.108 10 run_test "nvmf_target_core" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.657 00:22:47.108 11 run_test "nvmf_target_extra" $rootdir/test/nvmf/nvmf_target_extra.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.657 00:22:47.108 => 12 run_test "nvmf_host" $rootdir/test/nvmf/nvmf_host.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.657 00:22:47.108 13 00:38:42.657 00:22:47.108 14 # Interrupt mode for now is supported only on the target, with the TCP transport and posix or ssl socket implementations. 00:38:42.657 00:22:47.108 15 if [[ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" && $SPDK_TEST_URING -eq 0 ]]; then 00:38:42.657 00:22:47.108 16 run_test "nvmf_target_core_interrupt_mode" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT --interrupt-mode 00:38:42.657 00:22:47.108 17 run_test "nvmf_interrupt" $rootdir/test/nvmf/target/interrupt.sh --transport=$SPDK_TEST_NVMF_TRANSPORT --interrupt-mode 00:38:42.657 00:22:47.108 ... 00:38:42.657 00:22:47.108 00:38:42.657 00:22:47.108 ========== Backtrace end ========== 00:38:42.657 00:22:47.109 ========== Backtrace start: ========== 00:38:42.657 00:22:47.109 00:38:42.657 00:22:47.109 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_tcp"],["/home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh"],["--transport=tcp"]) 00:38:42.657 00:22:47.109 ... 00:38:42.657 00:22:47.109 1120 timing_enter $test_name 00:38:42.657 00:22:47.109 1121 echo "************************************" 00:38:42.657 00:22:47.109 1122 echo "START TEST $test_name" 00:38:42.657 00:22:47.109 1123 echo "************************************" 00:38:42.657 00:22:47.109 1124 xtrace_restore 00:38:42.657 00:22:47.109 1125 time "$@" 00:38:42.657 00:22:47.109 1126 xtrace_disable 00:38:42.657 00:22:47.109 1127 echo "************************************" 00:38:42.657 00:22:47.109 1128 echo "END TEST $test_name" 00:38:42.657 00:22:47.109 1129 echo "************************************" 00:38:42.657 00:22:47.109 1130 timing_exit $test_name 00:38:42.657 00:22:47.109 ... 00:38:42.657 00:22:47.109 in /home/vagrant/spdk_repo/spdk/autotest.sh:280 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 00:38:42.657 00:22:47.109 ... 00:38:42.657 00:22:47.109 275 # list of all tests can properly differentiate them. Please do not merge them into one line. 00:38:42.657 00:22:47.109 276 if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then 00:38:42.657 00:22:47.109 277 run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.657 00:22:47.109 278 run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.657 00:22:47.109 279 elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then 00:38:42.657 00:22:47.109 => 280 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.657 00:22:47.109 281 if [[ $SPDK_TEST_URING -eq 0 ]]; then 00:38:42.658 00:22:47.109 282 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.658 00:22:47.109 283 run_test "nvmf_identify_passthru" $rootdir/test/nvmf/target/identify_passthru.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.658 00:22:47.109 284 fi 00:38:42.658 00:22:47.109 285 run_test "nvmf_dif" $rootdir/test/nvmf/target/dif.sh 00:38:42.658 00:22:47.109 ... 00:38:42.658 00:22:47.109 00:38:42.658 00:22:47.109 ========== Backtrace end ========== ]] 00:38:42.658 + echo '00:22:45.010 ========== Backtrace start: ========== 00:38:42.658 00:22:45.010 00:38:42.658 00:22:45.010 in /home/vagrant/spdk_repo/spdk/test/nvmf/host/auth.sh:128 -> main(["--transport=tcp"]) 00:38:42.658 00:22:45.010 ... 00:38:42.658 00:22:45.010 123 NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.658 00:22:45.010 124 -a "$NVMF_FIRST_INITIATOR_IP" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.658 00:22:45.010 125 --dhchap-key "key1" --dhchap-ctrlr-key "ckey2" 00:38:42.658 00:22:45.010 126 00:38:42.658 00:22:45.010 127 # Check reauthentication 00:38:42.658 00:22:45.010 => 128 rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.658 00:22:45.010 129 -a "$(get_main_ns_ip)" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.658 00:22:45.010 130 --dhchap-key "key1" --dhchap-ctrlr-key "ckey1" --ctrlr-loss-timeout-sec 1 \ 00:38:42.658 00:22:45.010 131 --reconnect-delay-sec 1 00:38:42.658 00:22:45.010 132 nvmet_auth_set_key "sha256" "ffdhe2048" 2 00:38:42.658 00:22:45.010 133 rpc_cmd bdev_nvme_set_keys "nvme0" --dhchap-key "key2" --dhchap-ctrlr-key "ckey2" 00:38:42.658 00:22:45.010 ... 00:38:42.658 00:22:45.010 00:38:42.658 00:22:45.010 ========== Backtrace end ========== 00:38:42.658 00:22:45.010 ========== Backtrace start: ========== 00:38:42.658 00:22:45.010 00:38:42.658 00:22:45.010 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:589 -> rpc_cmd(["bdev_nvme_attach_controller"],["-b"],["nvme0"],["-t"],["tcp"],["-f"],["ipv4"],["-a"],[""],["-s"],["4420"],["-q"],["nqn.2024-02.io.spdk:host0"],["-n"],["nqn.2024-02.io.spdk:cnode0"],["--dhchap-key"],["key1"],["--dhchap-ctrlr-key"],["ckey1"],["--ctrlr-loss-timeout-sec"],["1"],["--reconnect-delay-sec"],["1"]) 00:38:42.658 00:22:45.010 ... 00:38:42.658 00:22:45.010 584 echo "$rsp" 00:38:42.658 00:22:45.010 585 done 00:38:42.658 00:22:45.010 586 00:38:42.658 00:22:45.010 587 rc=${!status[*]} 00:38:42.658 00:22:45.010 588 xtrace_restore 00:38:42.658 00:22:45.010 => 589 [[ $rc == 0 ]] 00:38:42.658 00:22:45.010 590 } 00:38:42.658 00:22:45.010 591 00:38:42.658 00:22:45.010 592 function rpc_cmd_simple_data_json() { 00:38:42.658 00:22:45.010 593 00:38:42.658 00:22:45.010 594 local elems="$1[@]" elem 00:38:42.658 00:22:45.010 ... 00:38:42.658 00:22:45.011 in /home/vagrant/spdk_repo/spdk/test/nvmf/host/auth.sh:128 -> main(["--transport=tcp"]) 00:38:42.658 00:22:45.011 ... 00:38:42.658 00:22:45.011 123 NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.658 00:22:45.011 124 -a "$NVMF_FIRST_INITIATOR_IP" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.658 00:22:45.011 125 --dhchap-key "key1" --dhchap-ctrlr-key "ckey2" 00:38:42.658 00:22:45.011 126 00:38:42.658 00:22:45.011 127 # Check reauthentication 00:38:42.658 00:22:45.011 => 128 rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.658 00:22:45.011 129 -a "$(get_main_ns_ip)" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.658 00:22:45.011 130 --dhchap-key "key1" --dhchap-ctrlr-key "ckey1" --ctrlr-loss-timeout-sec 1 \ 00:38:42.658 00:22:45.011 131 --reconnect-delay-sec 1 00:38:42.658 00:22:45.011 132 nvmet_auth_set_key "sha256" "ffdhe2048" 2 00:38:42.658 00:22:45.011 133 rpc_cmd bdev_nvme_set_keys "nvme0" --dhchap-key "key2" --dhchap-ctrlr-key "ckey2" 00:38:42.658 00:22:45.011 ... 00:38:42.658 00:22:45.011 00:38:42.658 00:22:45.011 ========== Backtrace end ========== 00:38:42.658 00:22:47.108 ========== Backtrace start: ========== 00:38:42.658 00:22:47.108 00:38:42.658 00:22:47.108 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_auth_host"],["/home/vagrant/spdk_repo/spdk/test/nvmf/host/auth.sh"],["--transport=tcp"]) 00:38:42.658 00:22:47.108 ... 00:38:42.658 00:22:47.108 1120 timing_enter $test_name 00:38:42.658 00:22:47.108 1121 echo "************************************" 00:38:42.658 00:22:47.108 1122 echo "START TEST $test_name" 00:38:42.658 00:22:47.108 1123 echo "************************************" 00:38:42.658 00:22:47.108 1124 xtrace_restore 00:38:42.658 00:22:47.108 1125 time "$@" 00:38:42.658 00:22:47.108 1126 xtrace_disable 00:38:42.658 00:22:47.108 1127 echo "************************************" 00:38:42.658 00:22:47.108 1128 echo "END TEST $test_name" 00:38:42.658 00:22:47.108 1129 echo "************************************" 00:38:42.658 00:22:47.108 1130 timing_exit $test_name 00:38:42.658 00:22:47.108 ... 00:38:42.658 00:22:47.108 in /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_host.sh:27 -> main(["--transport=tcp"]) 00:38:42.658 00:22:47.108 ... 00:38:42.658 00:22:47.108 22 run_test "nvmf_fio_host" $rootdir/test/nvmf/host/fio.sh "${TEST_ARGS[@]}" 00:38:42.658 00:22:47.108 23 run_test "nvmf_failover" $rootdir/test/nvmf/host/failover.sh "${TEST_ARGS[@]}" 00:38:42.658 00:22:47.108 24 run_test "nvmf_host_multipath_status" $rootdir/test/nvmf/host/multipath_status.sh "${TEST_ARGS[@]}" 00:38:42.658 00:22:47.108 25 run_test "nvmf_discovery_remove_ifc" $rootdir/test/nvmf/host/discovery_remove_ifc.sh "${TEST_ARGS[@]}" 00:38:42.658 00:22:47.108 26 run_test "nvmf_identify_kernel_target" "$rootdir/test/nvmf/host/identify_kernel_nvmf.sh" "${TEST_ARGS[@]}" 00:38:42.658 00:22:47.108 => 27 run_test "nvmf_auth_host" "$rootdir/test/nvmf/host/auth.sh" "${TEST_ARGS[@]}" 00:38:42.658 00:22:47.108 28 run_test "nvmf_bdevperf" "$rootdir/test/nvmf/host/bdevperf.sh" "${TEST_ARGS[@]}" 00:38:42.658 00:22:47.108 29 run_test "nvmf_target_disconnect" "$rootdir/test/nvmf/host/target_disconnect.sh" "${TEST_ARGS[@]}" 00:38:42.658 00:22:47.108 30 00:38:42.658 00:22:47.108 31 if [[ "$SPDK_TEST_NVMF_TRANSPORT" == "tcp" ]]; then 00:38:42.658 00:22:47.108 32 run_test "nvmf_digest" "$rootdir/test/nvmf/host/digest.sh" "${TEST_ARGS[@]}" 00:38:42.658 00:22:47.108 ... 00:38:42.658 00:22:47.108 00:38:42.658 00:22:47.108 ========== Backtrace end ========== 00:38:42.658 00:22:47.108 ========== Backtrace start: ========== 00:38:42.658 00:22:47.108 00:38:42.658 00:22:47.108 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_host"],["/home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_host.sh"],["--transport=tcp"]) 00:38:42.658 00:22:47.108 ... 00:38:42.658 00:22:47.108 1120 timing_enter $test_name 00:38:42.658 00:22:47.108 1121 echo "************************************" 00:38:42.658 00:22:47.108 1122 echo "START TEST $test_name" 00:38:42.658 00:22:47.108 1123 echo "************************************" 00:38:42.658 00:22:47.108 1124 xtrace_restore 00:38:42.658 00:22:47.108 1125 time "$@" 00:38:42.658 00:22:47.108 1126 xtrace_disable 00:38:42.658 00:22:47.108 1127 echo "************************************" 00:38:42.658 00:22:47.108 1128 echo "END TEST $test_name" 00:38:42.658 00:22:47.108 1129 echo "************************************" 00:38:42.658 00:22:47.108 1130 timing_exit $test_name 00:38:42.658 00:22:47.108 ... 00:38:42.658 00:22:47.108 in /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh:12 -> main(["--transport=tcp"]) 00:38:42.658 00:22:47.108 ... 00:38:42.658 00:22:47.108 7 rootdir=$(readlink -f $testdir/../..) 00:38:42.658 00:22:47.108 8 source $rootdir/test/common/autotest_common.sh 00:38:42.658 00:22:47.108 9 00:38:42.658 00:22:47.108 10 run_test "nvmf_target_core" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.658 00:22:47.108 11 run_test "nvmf_target_extra" $rootdir/test/nvmf/nvmf_target_extra.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.658 00:22:47.108 => 12 run_test "nvmf_host" $rootdir/test/nvmf/nvmf_host.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.658 00:22:47.108 13 00:38:42.658 00:22:47.108 14 # Interrupt mode for now is supported only on the target, with the TCP transport and posix or ssl socket implementations. 00:38:42.658 00:22:47.108 15 if [[ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" && $SPDK_TEST_URING -eq 0 ]]; then 00:38:42.658 00:22:47.108 16 run_test "nvmf_target_core_interrupt_mode" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT --interrupt-mode 00:38:42.658 00:22:47.108 17 run_test "nvmf_interrupt" $rootdir/test/nvmf/target/interrupt.sh --transport=$SPDK_TEST_NVMF_TRANSPORT --interrupt-mode 00:38:42.658 00:22:47.108 ... 00:38:42.658 00:22:47.108 00:38:42.658 00:22:47.108 ========== Backtrace end ========== 00:38:42.658 00:22:47.109 ========== Backtrace start: ========== 00:38:42.658 00:22:47.109 00:38:42.658 00:22:47.109 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_tcp"],["/home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh"],["--transport=tcp"]) 00:38:42.658 00:22:47.109 ... 00:38:42.658 00:22:47.109 1120 timing_enter $test_name 00:38:42.658 00:22:47.109 1121 echo "************************************" 00:38:42.658 00:22:47.109 1122 echo "START TEST $test_name" 00:38:42.658 00:22:47.109 1123 echo "************************************" 00:38:42.658 00:22:47.109 1124 xtrace_restore 00:38:42.658 00:22:47.109 1125 time "$@" 00:38:42.658 00:22:47.109 1126 xtrace_disable 00:38:42.658 00:22:47.109 1127 echo "************************************" 00:38:42.658 00:22:47.109 1128 echo "END TEST $test_name" 00:38:42.658 00:22:47.109 1129 echo "************************************" 00:38:42.658 00:22:47.109 1130 timing_exit $test_name 00:38:42.658 00:22:47.109 ... 00:38:42.658 00:22:47.109 in /home/vagrant/spdk_repo/spdk/autotest.sh:280 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 00:38:42.658 00:22:47.109 ... 00:38:42.658 00:22:47.109 275 # list of all tests can properly differentiate them. Please do not merge them into one line. 00:38:42.658 00:22:47.109 276 if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then 00:38:42.658 00:22:47.109 277 run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.658 00:22:47.109 278 run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.658 00:22:47.109 279 elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then 00:38:42.658 00:22:47.109 => 280 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.658 00:22:47.109 281 if [[ $SPDK_TEST_URING -eq 0 ]]; then 00:38:42.658 00:22:47.109 282 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.658 00:22:47.109 283 run_test "nvmf_identify_passthru" $rootdir/test/nvmf/target/identify_passthru.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.658 00:22:47.109 284 fi 00:38:42.658 00:22:47.109 285 run_test "nvmf_dif" $rootdir/test/nvmf/target/dif.sh 00:38:42.658 00:22:47.109 ... 00:38:42.658 00:22:47.109 00:38:42.658 00:22:47.109 ========== Backtrace end ==========' 00:38:42.658 + for build in "${build_log_list[@]}" 00:38:42.658 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_2/release-build-main-docker-autotest_2438/build.log 00:38:42.659 + local build_log job_name start_pattern end_pattern backtraces 00:38:42.659 + build_log=/var/jenkins/workspace/autotest-per-patch_2/release-build-main-docker-autotest_2438/build.log 00:38:42.659 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/release-build-main-docker-autotest_2438/build.log 00:38:42.659 ++ basename /var/jenkins/workspace/autotest-per-patch_2/release-build-main-docker-autotest_2438 00:38:42.659 + job_name=release-build-main-docker-autotest_2438 00:38:42.659 + start_pattern='Backtrace start' 00:38:42.659 + end_pattern='Backtrace end' 00:38:42.659 + [[ -f /var/jenkins/workspace/autotest-per-patch_2/release-build-main-docker-autotest_2438/build.log ]] 00:38:42.659 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_2/release-build-main-docker-autotest_2438/build.log 00:38:42.659 + backtraces= 00:38:42.659 + [[ -n '' ]] 00:38:42.659 + for build in "${build_log_list[@]}" 00:38:42.659 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_2/doc-docker-autotest_32710/build.log 00:38:42.659 + local build_log job_name start_pattern end_pattern backtraces 00:38:42.659 + build_log=/var/jenkins/workspace/autotest-per-patch_2/doc-docker-autotest_32710/build.log 00:38:42.659 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/doc-docker-autotest_32710/build.log 00:38:42.659 ++ basename /var/jenkins/workspace/autotest-per-patch_2/doc-docker-autotest_32710 00:38:42.659 + job_name=doc-docker-autotest_32710 00:38:42.659 + start_pattern='Backtrace start' 00:38:42.659 + end_pattern='Backtrace end' 00:38:42.659 + [[ -f /var/jenkins/workspace/autotest-per-patch_2/doc-docker-autotest_32710/build.log ]] 00:38:42.659 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_2/doc-docker-autotest_32710/build.log 00:38:42.659 + backtraces= 00:38:42.659 + [[ -n '' ]] 00:38:42.659 + for build in "${build_log_list[@]}" 00:38:42.659 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_2/raid-vg-autotest_4568/build.log 00:38:42.659 + local build_log job_name start_pattern end_pattern backtraces 00:38:42.659 + build_log=/var/jenkins/workspace/autotest-per-patch_2/raid-vg-autotest_4568/build.log 00:38:42.659 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/raid-vg-autotest_4568/build.log 00:38:42.659 ++ basename /var/jenkins/workspace/autotest-per-patch_2/raid-vg-autotest_4568 00:38:42.659 + job_name=raid-vg-autotest_4568 00:38:42.659 + start_pattern='Backtrace start' 00:38:42.659 + end_pattern='Backtrace end' 00:38:42.659 + [[ -f /var/jenkins/workspace/autotest-per-patch_2/raid-vg-autotest_4568/build.log ]] 00:38:42.659 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_2/raid-vg-autotest_4568/build.log 00:38:42.659 + backtraces= 00:38:42.659 + [[ -n '' ]] 00:38:42.659 + for build in "${build_log_list[@]}" 00:38:42.659 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_2/scan-build-docker-autotest_29226/build.log 00:38:42.659 + local build_log job_name start_pattern end_pattern backtraces 00:38:42.659 + build_log=/var/jenkins/workspace/autotest-per-patch_2/scan-build-docker-autotest_29226/build.log 00:38:42.659 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/scan-build-docker-autotest_29226/build.log 00:38:42.659 ++ basename /var/jenkins/workspace/autotest-per-patch_2/scan-build-docker-autotest_29226 00:38:42.659 + job_name=scan-build-docker-autotest_29226 00:38:42.659 + start_pattern='Backtrace start' 00:38:42.659 + end_pattern='Backtrace end' 00:38:42.659 + [[ -f /var/jenkins/workspace/autotest-per-patch_2/scan-build-docker-autotest_29226/build.log ]] 00:38:42.659 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_2/scan-build-docker-autotest_29226/build.log 00:38:42.659 + backtraces= 00:38:42.659 + [[ -n '' ]] 00:38:42.659 + for build in "${build_log_list[@]}" 00:38:42.659 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_2/nvmf-tcp-uring-vg-autotest_89777/build.log 00:38:42.659 + local build_log job_name start_pattern end_pattern backtraces 00:38:42.659 + build_log=/var/jenkins/workspace/autotest-per-patch_2/nvmf-tcp-uring-vg-autotest_89777/build.log 00:38:42.659 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/nvmf-tcp-uring-vg-autotest_89777/build.log 00:38:42.659 ++ basename /var/jenkins/workspace/autotest-per-patch_2/nvmf-tcp-uring-vg-autotest_89777 00:38:42.659 + job_name=nvmf-tcp-uring-vg-autotest_89777 00:38:42.659 + start_pattern='Backtrace start' 00:38:42.659 + end_pattern='Backtrace end' 00:38:42.659 + [[ -f /var/jenkins/workspace/autotest-per-patch_2/nvmf-tcp-uring-vg-autotest_89777/build.log ]] 00:38:42.659 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_2/nvmf-tcp-uring-vg-autotest_89777/build.log 00:38:42.659 + backtraces='00:22:29.124 ========== Backtrace start: ========== 00:38:42.659 00:22:29.124 00:38:42.659 00:22:29.124 in /home/vagrant/spdk_repo/spdk/test/nvmf/host/auth.sh:128 -> main(["--transport=tcp"]) 00:38:42.659 00:22:29.124 ... 00:38:42.659 00:22:29.124 123 NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.659 00:22:29.124 124 -a "$NVMF_FIRST_INITIATOR_IP" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.659 00:22:29.124 125 --dhchap-key "key1" --dhchap-ctrlr-key "ckey2" 00:38:42.659 00:22:29.124 126 00:38:42.659 00:22:29.124 127 # Check reauthentication 00:38:42.659 00:22:29.124 => 128 rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.659 00:22:29.124 129 -a "$(get_main_ns_ip)" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.659 00:22:29.124 130 --dhchap-key "key1" --dhchap-ctrlr-key "ckey1" --ctrlr-loss-timeout-sec 1 \ 00:38:42.659 00:22:29.124 131 --reconnect-delay-sec 1 00:38:42.659 00:22:29.124 132 nvmet_auth_set_key "sha256" "ffdhe2048" 2 00:38:42.659 00:22:29.124 133 rpc_cmd bdev_nvme_set_keys "nvme0" --dhchap-key "key2" --dhchap-ctrlr-key "ckey2" 00:38:42.659 00:22:29.124 ... 00:38:42.659 00:22:29.124 00:38:42.659 00:22:29.124 ========== Backtrace end ========== 00:38:42.659 00:22:29.125 ========== Backtrace start: ========== 00:38:42.659 00:22:29.125 00:38:42.659 00:22:29.125 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:589 -> rpc_cmd(["bdev_nvme_attach_controller"],["-b"],["nvme0"],["-t"],["tcp"],["-f"],["ipv4"],["-a"],[""],["-s"],["4420"],["-q"],["nqn.2024-02.io.spdk:host0"],["-n"],["nqn.2024-02.io.spdk:cnode0"],["--dhchap-key"],["key1"],["--dhchap-ctrlr-key"],["ckey1"],["--ctrlr-loss-timeout-sec"],["1"],["--reconnect-delay-sec"],["1"]) 00:38:42.659 00:22:29.125 ... 00:38:42.659 00:22:29.125 584 echo "$rsp" 00:38:42.659 00:22:29.125 585 done 00:38:42.659 00:22:29.125 586 00:38:42.659 00:22:29.125 587 rc=${!status[*]} 00:38:42.659 00:22:29.125 588 xtrace_restore 00:38:42.659 00:22:29.125 => 589 [[ $rc == 0 ]] 00:38:42.659 00:22:29.125 590 } 00:38:42.659 00:22:29.125 591 00:38:42.659 00:22:29.125 592 function rpc_cmd_simple_data_json() { 00:38:42.659 00:22:29.125 593 00:38:42.659 00:22:29.125 594 local elems="$1[@]" elem 00:38:42.659 00:22:29.125 ... 00:38:42.659 00:22:29.432 in /home/vagrant/spdk_repo/spdk/test/nvmf/host/auth.sh:128 -> main(["--transport=tcp"]) 00:38:42.659 00:22:29.432 ... 00:38:42.659 00:22:29.432 123 NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.659 00:22:29.432 124 -a "$NVMF_FIRST_INITIATOR_IP" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.659 00:22:29.432 125 --dhchap-key "key1" --dhchap-ctrlr-key "ckey2" 00:38:42.659 00:22:29.432 126 00:38:42.659 00:22:29.432 127 # Check reauthentication 00:38:42.659 00:22:29.432 => 128 rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.659 00:22:29.432 129 -a "$(get_main_ns_ip)" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.659 00:22:29.432 130 --dhchap-key "key1" --dhchap-ctrlr-key "ckey1" --ctrlr-loss-timeout-sec 1 \ 00:38:42.659 00:22:29.432 131 --reconnect-delay-sec 1 00:38:42.659 00:22:29.432 132 nvmet_auth_set_key "sha256" "ffdhe2048" 2 00:38:42.659 00:22:29.432 133 rpc_cmd bdev_nvme_set_keys "nvme0" --dhchap-key "key2" --dhchap-ctrlr-key "ckey2" 00:38:42.659 00:22:29.432 ... 00:38:42.659 00:22:29.432 00:38:42.659 00:22:29.432 ========== Backtrace end ========== 00:38:42.659 00:22:30.938 ========== Backtrace start: ========== 00:38:42.659 00:22:30.938 00:38:42.659 00:22:30.938 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_auth_host"],["/home/vagrant/spdk_repo/spdk/test/nvmf/host/auth.sh"],["--transport=tcp"]) 00:38:42.659 00:22:30.938 ... 00:38:42.659 00:22:30.938 1120 timing_enter $test_name 00:38:42.659 00:22:30.938 1121 echo "************************************" 00:38:42.659 00:22:30.938 1122 echo "START TEST $test_name" 00:38:42.659 00:22:30.938 1123 echo "************************************" 00:38:42.659 00:22:30.938 1124 xtrace_restore 00:38:42.659 00:22:30.938 1125 time "$@" 00:38:42.659 00:22:30.938 1126 xtrace_disable 00:38:42.659 00:22:30.938 1127 echo "************************************" 00:38:42.659 00:22:30.938 1128 echo "END TEST $test_name" 00:38:42.659 00:22:30.939 1129 echo "************************************" 00:38:42.659 00:22:30.939 1130 timing_exit $test_name 00:38:42.659 00:22:30.939 ... 00:38:42.659 00:22:30.939 in /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_host.sh:27 -> main(["--transport=tcp"]) 00:38:42.659 00:22:30.939 ... 00:38:42.659 00:22:30.939 22 run_test "nvmf_fio_host" $rootdir/test/nvmf/host/fio.sh "${TEST_ARGS[@]}" 00:38:42.659 00:22:30.939 23 run_test "nvmf_failover" $rootdir/test/nvmf/host/failover.sh "${TEST_ARGS[@]}" 00:38:42.660 00:22:30.939 24 run_test "nvmf_host_multipath_status" $rootdir/test/nvmf/host/multipath_status.sh "${TEST_ARGS[@]}" 00:38:42.660 00:22:30.939 25 run_test "nvmf_discovery_remove_ifc" $rootdir/test/nvmf/host/discovery_remove_ifc.sh "${TEST_ARGS[@]}" 00:38:42.660 00:22:30.939 26 run_test "nvmf_identify_kernel_target" "$rootdir/test/nvmf/host/identify_kernel_nvmf.sh" "${TEST_ARGS[@]}" 00:38:42.660 00:22:30.939 => 27 run_test "nvmf_auth_host" "$rootdir/test/nvmf/host/auth.sh" "${TEST_ARGS[@]}" 00:38:42.660 00:22:30.939 28 run_test "nvmf_bdevperf" "$rootdir/test/nvmf/host/bdevperf.sh" "${TEST_ARGS[@]}" 00:38:42.660 00:22:30.939 29 run_test "nvmf_target_disconnect" "$rootdir/test/nvmf/host/target_disconnect.sh" "${TEST_ARGS[@]}" 00:38:42.660 00:22:30.939 30 00:38:42.660 00:22:30.939 31 if [[ "$SPDK_TEST_NVMF_TRANSPORT" == "tcp" ]]; then 00:38:42.660 00:22:30.939 32 run_test "nvmf_digest" "$rootdir/test/nvmf/host/digest.sh" "${TEST_ARGS[@]}" 00:38:42.660 00:22:30.939 ... 00:38:42.660 00:22:30.939 00:38:42.660 00:22:30.939 ========== Backtrace end ========== 00:38:42.660 00:22:30.939 ========== Backtrace start: ========== 00:38:42.660 00:22:30.939 00:38:42.660 00:22:30.939 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_host"],["/home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_host.sh"],["--transport=tcp"]) 00:38:42.660 00:22:30.939 ... 00:38:42.660 00:22:30.939 1120 timing_enter $test_name 00:38:42.660 00:22:30.939 1121 echo "************************************" 00:38:42.660 00:22:30.939 1122 echo "START TEST $test_name" 00:38:42.660 00:22:30.939 1123 echo "************************************" 00:38:42.660 00:22:30.939 1124 xtrace_restore 00:38:42.660 00:22:30.939 1125 time "$@" 00:38:42.660 00:22:30.939 1126 xtrace_disable 00:38:42.660 00:22:30.939 1127 echo "************************************" 00:38:42.660 00:22:30.939 1128 echo "END TEST $test_name" 00:38:42.660 00:22:30.939 1129 echo "************************************" 00:38:42.660 00:22:30.939 1130 timing_exit $test_name 00:38:42.660 00:22:30.939 ... 00:38:42.660 00:22:30.939 in /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh:12 -> main(["--transport=tcp"]) 00:38:42.660 00:22:30.939 ... 00:38:42.660 00:22:30.939 7 rootdir=$(readlink -f $testdir/../..) 00:38:42.660 00:22:30.939 8 source $rootdir/test/common/autotest_common.sh 00:38:42.660 00:22:30.939 9 00:38:42.660 00:22:30.939 10 run_test "nvmf_target_core" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.660 00:22:30.939 11 run_test "nvmf_target_extra" $rootdir/test/nvmf/nvmf_target_extra.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.660 00:22:30.939 => 12 run_test "nvmf_host" $rootdir/test/nvmf/nvmf_host.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.660 00:22:30.939 13 00:38:42.660 00:22:30.939 14 # Interrupt mode for now is supported only on the target, with the TCP transport and posix or ssl socket implementations. 00:38:42.660 00:22:30.939 15 if [[ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" && $SPDK_TEST_URING -eq 0 ]]; then 00:38:42.660 00:22:30.939 16 run_test "nvmf_target_core_interrupt_mode" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT --interrupt-mode 00:38:42.660 00:22:30.939 17 run_test "nvmf_interrupt" $rootdir/test/nvmf/target/interrupt.sh --transport=$SPDK_TEST_NVMF_TRANSPORT --interrupt-mode 00:38:42.660 00:22:30.939 ... 00:38:42.660 00:22:30.939 00:38:42.660 00:22:30.939 ========== Backtrace end ========== 00:38:42.660 00:22:30.939 ========== Backtrace start: ========== 00:38:42.660 00:22:30.939 00:38:42.660 00:22:30.939 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_tcp"],["/home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh"],["--transport=tcp"]) 00:38:42.660 00:22:30.939 ... 00:38:42.660 00:22:30.939 1120 timing_enter $test_name 00:38:42.660 00:22:30.939 1121 echo "************************************" 00:38:42.660 00:22:30.939 1122 echo "START TEST $test_name" 00:38:42.660 00:22:30.939 1123 echo "************************************" 00:38:42.660 00:22:30.939 1124 xtrace_restore 00:38:42.660 00:22:30.939 1125 time "$@" 00:38:42.660 00:22:30.939 1126 xtrace_disable 00:38:42.660 00:22:30.939 1127 echo "************************************" 00:38:42.660 00:22:30.939 1128 echo "END TEST $test_name" 00:38:42.660 00:22:30.939 1129 echo "************************************" 00:38:42.660 00:22:30.939 1130 timing_exit $test_name 00:38:42.660 00:22:30.939 ... 00:38:42.660 00:22:30.939 in /home/vagrant/spdk_repo/spdk/autotest.sh:280 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 00:38:42.660 00:22:30.939 ... 00:38:42.660 00:22:30.939 275 # list of all tests can properly differentiate them. Please do not merge them into one line. 00:38:42.660 00:22:30.939 276 if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then 00:38:42.660 00:22:30.939 277 run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.660 00:22:30.939 278 run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.660 00:22:30.939 279 elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then 00:38:42.660 00:22:30.939 => 280 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.660 00:22:30.939 281 if [[ $SPDK_TEST_URING -eq 0 ]]; then 00:38:42.660 00:22:30.939 282 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.660 00:22:30.939 283 run_test "nvmf_identify_passthru" $rootdir/test/nvmf/target/identify_passthru.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.660 00:22:30.939 284 fi 00:38:42.660 00:22:30.939 285 run_test "nvmf_dif" $rootdir/test/nvmf/target/dif.sh 00:38:42.660 00:22:30.939 ... 00:38:42.660 00:22:30.939 00:38:42.660 00:22:30.939 ========== Backtrace end ==========' 00:38:42.660 + [[ -n 00:22:29.124 ========== Backtrace start: ========== 00:38:42.660 00:22:29.124 00:38:42.660 00:22:29.124 in /home/vagrant/spdk_repo/spdk/test/nvmf/host/auth.sh:128 -> main(["--transport=tcp"]) 00:38:42.660 00:22:29.124 ... 00:38:42.660 00:22:29.124 123 NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.660 00:22:29.124 124 -a "$NVMF_FIRST_INITIATOR_IP" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.660 00:22:29.124 125 --dhchap-key "key1" --dhchap-ctrlr-key "ckey2" 00:38:42.660 00:22:29.124 126 00:38:42.660 00:22:29.124 127 # Check reauthentication 00:38:42.660 00:22:29.124 => 128 rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.660 00:22:29.124 129 -a "$(get_main_ns_ip)" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.660 00:22:29.124 130 --dhchap-key "key1" --dhchap-ctrlr-key "ckey1" --ctrlr-loss-timeout-sec 1 \ 00:38:42.660 00:22:29.124 131 --reconnect-delay-sec 1 00:38:42.660 00:22:29.124 132 nvmet_auth_set_key "sha256" "ffdhe2048" 2 00:38:42.660 00:22:29.124 133 rpc_cmd bdev_nvme_set_keys "nvme0" --dhchap-key "key2" --dhchap-ctrlr-key "ckey2" 00:38:42.660 00:22:29.124 ... 00:38:42.660 00:22:29.124 00:38:42.660 00:22:29.124 ========== Backtrace end ========== 00:38:42.660 00:22:29.125 ========== Backtrace start: ========== 00:38:42.660 00:22:29.125 00:38:42.660 00:22:29.125 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:589 -> rpc_cmd(["bdev_nvme_attach_controller"],["-b"],["nvme0"],["-t"],["tcp"],["-f"],["ipv4"],["-a"],[""],["-s"],["4420"],["-q"],["nqn.2024-02.io.spdk:host0"],["-n"],["nqn.2024-02.io.spdk:cnode0"],["--dhchap-key"],["key1"],["--dhchap-ctrlr-key"],["ckey1"],["--ctrlr-loss-timeout-sec"],["1"],["--reconnect-delay-sec"],["1"]) 00:38:42.660 00:22:29.125 ... 00:38:42.660 00:22:29.125 584 echo "$rsp" 00:38:42.660 00:22:29.125 585 done 00:38:42.660 00:22:29.125 586 00:38:42.660 00:22:29.125 587 rc=${!status[*]} 00:38:42.660 00:22:29.125 588 xtrace_restore 00:38:42.660 00:22:29.125 => 589 [[ $rc == 0 ]] 00:38:42.660 00:22:29.125 590 } 00:38:42.660 00:22:29.125 591 00:38:42.660 00:22:29.125 592 function rpc_cmd_simple_data_json() { 00:38:42.660 00:22:29.125 593 00:38:42.660 00:22:29.125 594 local elems="$1[@]" elem 00:38:42.660 00:22:29.125 ... 00:38:42.660 00:22:29.432 in /home/vagrant/spdk_repo/spdk/test/nvmf/host/auth.sh:128 -> main(["--transport=tcp"]) 00:38:42.660 00:22:29.432 ... 00:38:42.660 00:22:29.432 123 NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.660 00:22:29.432 124 -a "$NVMF_FIRST_INITIATOR_IP" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.660 00:22:29.432 125 --dhchap-key "key1" --dhchap-ctrlr-key "ckey2" 00:38:42.660 00:22:29.432 126 00:38:42.660 00:22:29.432 127 # Check reauthentication 00:38:42.660 00:22:29.432 => 128 rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.660 00:22:29.432 129 -a "$(get_main_ns_ip)" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.660 00:22:29.432 130 --dhchap-key "key1" --dhchap-ctrlr-key "ckey1" --ctrlr-loss-timeout-sec 1 \ 00:38:42.660 00:22:29.432 131 --reconnect-delay-sec 1 00:38:42.660 00:22:29.432 132 nvmet_auth_set_key "sha256" "ffdhe2048" 2 00:38:42.660 00:22:29.432 133 rpc_cmd bdev_nvme_set_keys "nvme0" --dhchap-key "key2" --dhchap-ctrlr-key "ckey2" 00:38:42.660 00:22:29.432 ... 00:38:42.660 00:22:29.432 00:38:42.660 00:22:29.432 ========== Backtrace end ========== 00:38:42.660 00:22:30.938 ========== Backtrace start: ========== 00:38:42.660 00:22:30.938 00:38:42.660 00:22:30.938 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_auth_host"],["/home/vagrant/spdk_repo/spdk/test/nvmf/host/auth.sh"],["--transport=tcp"]) 00:38:42.660 00:22:30.938 ... 00:38:42.660 00:22:30.938 1120 timing_enter $test_name 00:38:42.660 00:22:30.938 1121 echo "************************************" 00:38:42.660 00:22:30.938 1122 echo "START TEST $test_name" 00:38:42.660 00:22:30.938 1123 echo "************************************" 00:38:42.660 00:22:30.938 1124 xtrace_restore 00:38:42.660 00:22:30.938 1125 time "$@" 00:38:42.660 00:22:30.938 1126 xtrace_disable 00:38:42.660 00:22:30.938 1127 echo "************************************" 00:38:42.660 00:22:30.938 1128 echo "END TEST $test_name" 00:38:42.660 00:22:30.939 1129 echo "************************************" 00:38:42.660 00:22:30.939 1130 timing_exit $test_name 00:38:42.660 00:22:30.939 ... 00:38:42.660 00:22:30.939 in /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_host.sh:27 -> main(["--transport=tcp"]) 00:38:42.660 00:22:30.939 ... 00:38:42.660 00:22:30.939 22 run_test "nvmf_fio_host" $rootdir/test/nvmf/host/fio.sh "${TEST_ARGS[@]}" 00:38:42.660 00:22:30.939 23 run_test "nvmf_failover" $rootdir/test/nvmf/host/failover.sh "${TEST_ARGS[@]}" 00:38:42.660 00:22:30.939 24 run_test "nvmf_host_multipath_status" $rootdir/test/nvmf/host/multipath_status.sh "${TEST_ARGS[@]}" 00:38:42.660 00:22:30.939 25 run_test "nvmf_discovery_remove_ifc" $rootdir/test/nvmf/host/discovery_remove_ifc.sh "${TEST_ARGS[@]}" 00:38:42.660 00:22:30.939 26 run_test "nvmf_identify_kernel_target" "$rootdir/test/nvmf/host/identify_kernel_nvmf.sh" "${TEST_ARGS[@]}" 00:38:42.660 00:22:30.939 => 27 run_test "nvmf_auth_host" "$rootdir/test/nvmf/host/auth.sh" "${TEST_ARGS[@]}" 00:38:42.660 00:22:30.939 28 run_test "nvmf_bdevperf" "$rootdir/test/nvmf/host/bdevperf.sh" "${TEST_ARGS[@]}" 00:38:42.660 00:22:30.939 29 run_test "nvmf_target_disconnect" "$rootdir/test/nvmf/host/target_disconnect.sh" "${TEST_ARGS[@]}" 00:38:42.660 00:22:30.939 30 00:38:42.661 00:22:30.939 31 if [[ "$SPDK_TEST_NVMF_TRANSPORT" == "tcp" ]]; then 00:38:42.661 00:22:30.939 32 run_test "nvmf_digest" "$rootdir/test/nvmf/host/digest.sh" "${TEST_ARGS[@]}" 00:38:42.661 00:22:30.939 ... 00:38:42.661 00:22:30.939 00:38:42.661 00:22:30.939 ========== Backtrace end ========== 00:38:42.661 00:22:30.939 ========== Backtrace start: ========== 00:38:42.661 00:22:30.939 00:38:42.661 00:22:30.939 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_host"],["/home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_host.sh"],["--transport=tcp"]) 00:38:42.661 00:22:30.939 ... 00:38:42.661 00:22:30.939 1120 timing_enter $test_name 00:38:42.661 00:22:30.939 1121 echo "************************************" 00:38:42.661 00:22:30.939 1122 echo "START TEST $test_name" 00:38:42.661 00:22:30.939 1123 echo "************************************" 00:38:42.661 00:22:30.939 1124 xtrace_restore 00:38:42.661 00:22:30.939 1125 time "$@" 00:38:42.661 00:22:30.939 1126 xtrace_disable 00:38:42.661 00:22:30.939 1127 echo "************************************" 00:38:42.661 00:22:30.939 1128 echo "END TEST $test_name" 00:38:42.661 00:22:30.939 1129 echo "************************************" 00:38:42.661 00:22:30.939 1130 timing_exit $test_name 00:38:42.661 00:22:30.939 ... 00:38:42.661 00:22:30.939 in /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh:12 -> main(["--transport=tcp"]) 00:38:42.661 00:22:30.939 ... 00:38:42.661 00:22:30.939 7 rootdir=$(readlink -f $testdir/../..) 00:38:42.661 00:22:30.939 8 source $rootdir/test/common/autotest_common.sh 00:38:42.661 00:22:30.939 9 00:38:42.661 00:22:30.939 10 run_test "nvmf_target_core" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.661 00:22:30.939 11 run_test "nvmf_target_extra" $rootdir/test/nvmf/nvmf_target_extra.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.661 00:22:30.939 => 12 run_test "nvmf_host" $rootdir/test/nvmf/nvmf_host.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.661 00:22:30.939 13 00:38:42.661 00:22:30.939 14 # Interrupt mode for now is supported only on the target, with the TCP transport and posix or ssl socket implementations. 00:38:42.661 00:22:30.939 15 if [[ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" && $SPDK_TEST_URING -eq 0 ]]; then 00:38:42.661 00:22:30.939 16 run_test "nvmf_target_core_interrupt_mode" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT --interrupt-mode 00:38:42.661 00:22:30.939 17 run_test "nvmf_interrupt" $rootdir/test/nvmf/target/interrupt.sh --transport=$SPDK_TEST_NVMF_TRANSPORT --interrupt-mode 00:38:42.661 00:22:30.939 ... 00:38:42.661 00:22:30.939 00:38:42.661 00:22:30.939 ========== Backtrace end ========== 00:38:42.661 00:22:30.939 ========== Backtrace start: ========== 00:38:42.661 00:22:30.939 00:38:42.661 00:22:30.939 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_tcp"],["/home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh"],["--transport=tcp"]) 00:38:42.661 00:22:30.939 ... 00:38:42.661 00:22:30.939 1120 timing_enter $test_name 00:38:42.661 00:22:30.939 1121 echo "************************************" 00:38:42.661 00:22:30.939 1122 echo "START TEST $test_name" 00:38:42.661 00:22:30.939 1123 echo "************************************" 00:38:42.661 00:22:30.939 1124 xtrace_restore 00:38:42.661 00:22:30.939 1125 time "$@" 00:38:42.661 00:22:30.939 1126 xtrace_disable 00:38:42.661 00:22:30.939 1127 echo "************************************" 00:38:42.661 00:22:30.939 1128 echo "END TEST $test_name" 00:38:42.661 00:22:30.939 1129 echo "************************************" 00:38:42.661 00:22:30.939 1130 timing_exit $test_name 00:38:42.661 00:22:30.939 ... 00:38:42.661 00:22:30.939 in /home/vagrant/spdk_repo/spdk/autotest.sh:280 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 00:38:42.661 00:22:30.939 ... 00:38:42.661 00:22:30.939 275 # list of all tests can properly differentiate them. Please do not merge them into one line. 00:38:42.661 00:22:30.939 276 if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then 00:38:42.661 00:22:30.939 277 run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.661 00:22:30.939 278 run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.661 00:22:30.939 279 elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then 00:38:42.661 00:22:30.939 => 280 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.661 00:22:30.939 281 if [[ $SPDK_TEST_URING -eq 0 ]]; then 00:38:42.661 00:22:30.939 282 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.661 00:22:30.939 283 run_test "nvmf_identify_passthru" $rootdir/test/nvmf/target/identify_passthru.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.661 00:22:30.939 284 fi 00:38:42.661 00:22:30.939 285 run_test "nvmf_dif" $rootdir/test/nvmf/target/dif.sh 00:38:42.661 00:22:30.939 ... 00:38:42.661 00:22:30.939 00:38:42.661 00:22:30.939 ========== Backtrace end ========== ]] 00:38:42.661 + echo '00:22:29.124 ========== Backtrace start: ========== 00:38:42.661 00:22:29.124 00:38:42.661 00:22:29.124 in /home/vagrant/spdk_repo/spdk/test/nvmf/host/auth.sh:128 -> main(["--transport=tcp"]) 00:38:42.661 00:22:29.124 ... 00:38:42.661 00:22:29.124 123 NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.661 00:22:29.124 124 -a "$NVMF_FIRST_INITIATOR_IP" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.661 00:22:29.124 125 --dhchap-key "key1" --dhchap-ctrlr-key "ckey2" 00:38:42.661 00:22:29.124 126 00:38:42.661 00:22:29.124 127 # Check reauthentication 00:38:42.661 00:22:29.124 => 128 rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.661 00:22:29.124 129 -a "$(get_main_ns_ip)" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.661 00:22:29.124 130 --dhchap-key "key1" --dhchap-ctrlr-key "ckey1" --ctrlr-loss-timeout-sec 1 \ 00:38:42.661 00:22:29.124 131 --reconnect-delay-sec 1 00:38:42.661 00:22:29.124 132 nvmet_auth_set_key "sha256" "ffdhe2048" 2 00:38:42.661 00:22:29.124 133 rpc_cmd bdev_nvme_set_keys "nvme0" --dhchap-key "key2" --dhchap-ctrlr-key "ckey2" 00:38:42.661 00:22:29.124 ... 00:38:42.661 00:22:29.124 00:38:42.661 00:22:29.124 ========== Backtrace end ========== 00:38:42.661 00:22:29.125 ========== Backtrace start: ========== 00:38:42.661 00:22:29.125 00:38:42.661 00:22:29.125 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:589 -> rpc_cmd(["bdev_nvme_attach_controller"],["-b"],["nvme0"],["-t"],["tcp"],["-f"],["ipv4"],["-a"],[""],["-s"],["4420"],["-q"],["nqn.2024-02.io.spdk:host0"],["-n"],["nqn.2024-02.io.spdk:cnode0"],["--dhchap-key"],["key1"],["--dhchap-ctrlr-key"],["ckey1"],["--ctrlr-loss-timeout-sec"],["1"],["--reconnect-delay-sec"],["1"]) 00:38:42.661 00:22:29.125 ... 00:38:42.661 00:22:29.125 584 echo "$rsp" 00:38:42.661 00:22:29.125 585 done 00:38:42.661 00:22:29.125 586 00:38:42.661 00:22:29.125 587 rc=${!status[*]} 00:38:42.661 00:22:29.125 588 xtrace_restore 00:38:42.661 00:22:29.125 => 589 [[ $rc == 0 ]] 00:38:42.661 00:22:29.125 590 } 00:38:42.661 00:22:29.125 591 00:38:42.661 00:22:29.125 592 function rpc_cmd_simple_data_json() { 00:38:42.661 00:22:29.125 593 00:38:42.661 00:22:29.125 594 local elems="$1[@]" elem 00:38:42.661 00:22:29.125 ... 00:38:42.661 00:22:29.432 in /home/vagrant/spdk_repo/spdk/test/nvmf/host/auth.sh:128 -> main(["--transport=tcp"]) 00:38:42.661 00:22:29.432 ... 00:38:42.661 00:22:29.432 123 NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.661 00:22:29.432 124 -a "$NVMF_FIRST_INITIATOR_IP" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.661 00:22:29.432 125 --dhchap-key "key1" --dhchap-ctrlr-key "ckey2" 00:38:42.661 00:22:29.432 126 00:38:42.661 00:22:29.432 127 # Check reauthentication 00:38:42.661 00:22:29.432 => 128 rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.661 00:22:29.432 129 -a "$(get_main_ns_ip)" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.661 00:22:29.432 130 --dhchap-key "key1" --dhchap-ctrlr-key "ckey1" --ctrlr-loss-timeout-sec 1 \ 00:38:42.661 00:22:29.432 131 --reconnect-delay-sec 1 00:38:42.661 00:22:29.432 132 nvmet_auth_set_key "sha256" "ffdhe2048" 2 00:38:42.661 00:22:29.432 133 rpc_cmd bdev_nvme_set_keys "nvme0" --dhchap-key "key2" --dhchap-ctrlr-key "ckey2" 00:38:42.661 00:22:29.432 ... 00:38:42.661 00:22:29.432 00:38:42.661 00:22:29.432 ========== Backtrace end ========== 00:38:42.661 00:22:30.938 ========== Backtrace start: ========== 00:38:42.661 00:22:30.938 00:38:42.661 00:22:30.938 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_auth_host"],["/home/vagrant/spdk_repo/spdk/test/nvmf/host/auth.sh"],["--transport=tcp"]) 00:38:42.661 00:22:30.938 ... 00:38:42.661 00:22:30.938 1120 timing_enter $test_name 00:38:42.661 00:22:30.938 1121 echo "************************************" 00:38:42.661 00:22:30.938 1122 echo "START TEST $test_name" 00:38:42.661 00:22:30.938 1123 echo "************************************" 00:38:42.661 00:22:30.938 1124 xtrace_restore 00:38:42.661 00:22:30.938 1125 time "$@" 00:38:42.661 00:22:30.938 1126 xtrace_disable 00:38:42.661 00:22:30.938 1127 echo "************************************" 00:38:42.661 00:22:30.938 1128 echo "END TEST $test_name" 00:38:42.661 00:22:30.939 1129 echo "************************************" 00:38:42.661 00:22:30.939 1130 timing_exit $test_name 00:38:42.661 00:22:30.939 ... 00:38:42.661 00:22:30.939 in /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_host.sh:27 -> main(["--transport=tcp"]) 00:38:42.661 00:22:30.939 ... 00:38:42.661 00:22:30.939 22 run_test "nvmf_fio_host" $rootdir/test/nvmf/host/fio.sh "${TEST_ARGS[@]}" 00:38:42.661 00:22:30.939 23 run_test "nvmf_failover" $rootdir/test/nvmf/host/failover.sh "${TEST_ARGS[@]}" 00:38:42.661 00:22:30.939 24 run_test "nvmf_host_multipath_status" $rootdir/test/nvmf/host/multipath_status.sh "${TEST_ARGS[@]}" 00:38:42.661 00:22:30.939 25 run_test "nvmf_discovery_remove_ifc" $rootdir/test/nvmf/host/discovery_remove_ifc.sh "${TEST_ARGS[@]}" 00:38:42.661 00:22:30.939 26 run_test "nvmf_identify_kernel_target" "$rootdir/test/nvmf/host/identify_kernel_nvmf.sh" "${TEST_ARGS[@]}" 00:38:42.661 00:22:30.939 => 27 run_test "nvmf_auth_host" "$rootdir/test/nvmf/host/auth.sh" "${TEST_ARGS[@]}" 00:38:42.661 00:22:30.939 28 run_test "nvmf_bdevperf" "$rootdir/test/nvmf/host/bdevperf.sh" "${TEST_ARGS[@]}" 00:38:42.661 00:22:30.939 29 run_test "nvmf_target_disconnect" "$rootdir/test/nvmf/host/target_disconnect.sh" "${TEST_ARGS[@]}" 00:38:42.661 00:22:30.939 30 00:38:42.661 00:22:30.939 31 if [[ "$SPDK_TEST_NVMF_TRANSPORT" == "tcp" ]]; then 00:38:42.661 00:22:30.939 32 run_test "nvmf_digest" "$rootdir/test/nvmf/host/digest.sh" "${TEST_ARGS[@]}" 00:38:42.661 00:22:30.939 ... 00:38:42.661 00:22:30.939 00:38:42.661 00:22:30.939 ========== Backtrace end ========== 00:38:42.661 00:22:30.939 ========== Backtrace start: ========== 00:38:42.661 00:22:30.939 00:38:42.662 00:22:30.939 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_host"],["/home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_host.sh"],["--transport=tcp"]) 00:38:42.662 00:22:30.939 ... 00:38:42.662 00:22:30.939 1120 timing_enter $test_name 00:38:42.662 00:22:30.939 1121 echo "************************************" 00:38:42.662 00:22:30.939 1122 echo "START TEST $test_name" 00:38:42.662 00:22:30.939 1123 echo "************************************" 00:38:42.662 00:22:30.939 1124 xtrace_restore 00:38:42.662 00:22:30.939 1125 time "$@" 00:38:42.662 00:22:30.939 1126 xtrace_disable 00:38:42.662 00:22:30.939 1127 echo "************************************" 00:38:42.662 00:22:30.939 1128 echo "END TEST $test_name" 00:38:42.662 00:22:30.939 1129 echo "************************************" 00:38:42.662 00:22:30.939 1130 timing_exit $test_name 00:38:42.662 00:22:30.939 ... 00:38:42.662 00:22:30.939 in /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh:12 -> main(["--transport=tcp"]) 00:38:42.662 00:22:30.939 ... 00:38:42.662 00:22:30.939 7 rootdir=$(readlink -f $testdir/../..) 00:38:42.662 00:22:30.939 8 source $rootdir/test/common/autotest_common.sh 00:38:42.662 00:22:30.939 9 00:38:42.662 00:22:30.939 10 run_test "nvmf_target_core" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.662 00:22:30.939 11 run_test "nvmf_target_extra" $rootdir/test/nvmf/nvmf_target_extra.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.662 00:22:30.939 => 12 run_test "nvmf_host" $rootdir/test/nvmf/nvmf_host.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.662 00:22:30.939 13 00:38:42.662 00:22:30.939 14 # Interrupt mode for now is supported only on the target, with the TCP transport and posix or ssl socket implementations. 00:38:42.662 00:22:30.939 15 if [[ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" && $SPDK_TEST_URING -eq 0 ]]; then 00:38:42.662 00:22:30.939 16 run_test "nvmf_target_core_interrupt_mode" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT --interrupt-mode 00:38:42.662 00:22:30.939 17 run_test "nvmf_interrupt" $rootdir/test/nvmf/target/interrupt.sh --transport=$SPDK_TEST_NVMF_TRANSPORT --interrupt-mode 00:38:42.662 00:22:30.939 ... 00:38:42.662 00:22:30.939 00:38:42.662 00:22:30.939 ========== Backtrace end ========== 00:38:42.662 00:22:30.939 ========== Backtrace start: ========== 00:38:42.662 00:22:30.939 00:38:42.662 00:22:30.939 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_tcp"],["/home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh"],["--transport=tcp"]) 00:38:42.662 00:22:30.939 ... 00:38:42.662 00:22:30.939 1120 timing_enter $test_name 00:38:42.662 00:22:30.939 1121 echo "************************************" 00:38:42.662 00:22:30.939 1122 echo "START TEST $test_name" 00:38:42.662 00:22:30.939 1123 echo "************************************" 00:38:42.662 00:22:30.939 1124 xtrace_restore 00:38:42.662 00:22:30.939 1125 time "$@" 00:38:42.662 00:22:30.939 1126 xtrace_disable 00:38:42.662 00:22:30.939 1127 echo "************************************" 00:38:42.662 00:22:30.939 1128 echo "END TEST $test_name" 00:38:42.662 00:22:30.939 1129 echo "************************************" 00:38:42.662 00:22:30.939 1130 timing_exit $test_name 00:38:42.662 00:22:30.939 ... 00:38:42.662 00:22:30.939 in /home/vagrant/spdk_repo/spdk/autotest.sh:280 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 00:38:42.662 00:22:30.939 ... 00:38:42.662 00:22:30.939 275 # list of all tests can properly differentiate them. Please do not merge them into one line. 00:38:42.662 00:22:30.939 276 if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then 00:38:42.662 00:22:30.939 277 run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.662 00:22:30.939 278 run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.662 00:22:30.939 279 elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then 00:38:42.662 00:22:30.939 => 280 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.662 00:22:30.939 281 if [[ $SPDK_TEST_URING -eq 0 ]]; then 00:38:42.662 00:22:30.939 282 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.662 00:22:30.939 283 run_test "nvmf_identify_passthru" $rootdir/test/nvmf/target/identify_passthru.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.662 00:22:30.939 284 fi 00:38:42.662 00:22:30.939 285 run_test "nvmf_dif" $rootdir/test/nvmf/target/dif.sh 00:38:42.662 00:22:30.939 ... 00:38:42.662 00:22:30.939 00:38:42.662 00:22:30.939 ========== Backtrace end ==========' 00:38:42.662 + for build in "${build_log_list[@]}" 00:38:42.662 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_2/short-fuzz-phy-autotest_37565/build.log 00:38:42.662 + local build_log job_name start_pattern end_pattern backtraces 00:38:42.662 + build_log=/var/jenkins/workspace/autotest-per-patch_2/short-fuzz-phy-autotest_37565/build.log 00:38:42.662 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/short-fuzz-phy-autotest_37565/build.log 00:38:42.662 ++ basename /var/jenkins/workspace/autotest-per-patch_2/short-fuzz-phy-autotest_37565 00:38:42.662 + job_name=short-fuzz-phy-autotest_37565 00:38:42.662 + start_pattern='Backtrace start' 00:38:42.662 + end_pattern='Backtrace end' 00:38:42.662 + [[ -f /var/jenkins/workspace/autotest-per-patch_2/short-fuzz-phy-autotest_37565/build.log ]] 00:38:42.662 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_2/short-fuzz-phy-autotest_37565/build.log 00:38:42.662 + backtraces= 00:38:42.662 + [[ -n '' ]] 00:38:42.662 + for build in "${build_log_list[@]}" 00:38:42.662 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_2/rocky9-vg-autotest_27174/build.log 00:38:42.662 + local build_log job_name start_pattern end_pattern backtraces 00:38:42.662 + build_log=/var/jenkins/workspace/autotest-per-patch_2/rocky9-vg-autotest_27174/build.log 00:38:42.662 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/rocky9-vg-autotest_27174/build.log 00:38:42.662 ++ basename /var/jenkins/workspace/autotest-per-patch_2/rocky9-vg-autotest_27174 00:38:42.662 + job_name=rocky9-vg-autotest_27174 00:38:42.662 + start_pattern='Backtrace start' 00:38:42.662 + end_pattern='Backtrace end' 00:38:42.662 + [[ -f /var/jenkins/workspace/autotest-per-patch_2/rocky9-vg-autotest_27174/build.log ]] 00:38:42.662 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_2/rocky9-vg-autotest_27174/build.log 00:38:42.662 + backtraces= 00:38:42.662 + [[ -n '' ]] 00:38:42.662 + for build in "${build_log_list[@]}" 00:38:42.662 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_2/nvmf-tcp-phy-autotest_83694/build.log 00:38:42.662 + local build_log job_name start_pattern end_pattern backtraces 00:38:42.662 + build_log=/var/jenkins/workspace/autotest-per-patch_2/nvmf-tcp-phy-autotest_83694/build.log 00:38:42.662 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/nvmf-tcp-phy-autotest_83694/build.log 00:38:42.662 ++ basename /var/jenkins/workspace/autotest-per-patch_2/nvmf-tcp-phy-autotest_83694 00:38:42.662 + job_name=nvmf-tcp-phy-autotest_83694 00:38:42.662 + start_pattern='Backtrace start' 00:38:42.662 + end_pattern='Backtrace end' 00:38:42.662 + [[ -f /var/jenkins/workspace/autotest-per-patch_2/nvmf-tcp-phy-autotest_83694/build.log ]] 00:38:42.662 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_2/nvmf-tcp-phy-autotest_83694/build.log 00:38:42.662 + backtraces='00:27:53.061 ========== Backtrace start: ========== 00:38:42.662 00:27:53.061 00:38:42.662 00:27:53.061 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/auth.sh:128 -> main(["--transport=tcp"]) 00:38:42.662 00:27:53.061 ... 00:38:42.662 00:27:53.061 123 NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.662 00:27:53.061 124 -a "$NVMF_FIRST_INITIATOR_IP" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.662 00:27:53.061 125 --dhchap-key "key1" --dhchap-ctrlr-key "ckey2" 00:38:42.662 00:27:53.061 126 00:38:42.662 00:27:53.061 127 # Check reauthentication 00:38:42.662 00:27:53.061 => 128 rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.662 00:27:53.061 129 -a "$(get_main_ns_ip)" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.662 00:27:53.061 130 --dhchap-key "key1" --dhchap-ctrlr-key "ckey1" --ctrlr-loss-timeout-sec 1 \ 00:38:42.662 00:27:53.061 131 --reconnect-delay-sec 1 00:38:42.662 00:27:53.061 132 nvmet_auth_set_key "sha256" "ffdhe2048" 2 00:38:42.662 00:27:53.061 133 rpc_cmd bdev_nvme_set_keys "nvme0" --dhchap-key "key2" --dhchap-ctrlr-key "ckey2" 00:38:42.662 00:27:53.061 ... 00:38:42.662 00:27:53.061 00:38:42.662 00:27:53.061 ========== Backtrace end ========== 00:38:42.662 00:27:53.062 ========== Backtrace start: ========== 00:38:42.662 00:27:53.062 00:38:42.662 00:27:53.062 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:589 -> rpc_cmd(["bdev_nvme_attach_controller"],["-b"],["nvme0"],["-t"],["tcp"],["-f"],["ipv4"],["-a"],[""],["-s"],["4420"],["-q"],["nqn.2024-02.io.spdk:host0"],["-n"],["nqn.2024-02.io.spdk:cnode0"],["--dhchap-key"],["key1"],["--dhchap-ctrlr-key"],["ckey1"],["--ctrlr-loss-timeout-sec"],["1"],["--reconnect-delay-sec"],["1"]) 00:38:42.662 00:27:53.062 ... 00:38:42.662 00:27:53.062 584 echo "$rsp" 00:38:42.662 00:27:53.062 585 done 00:38:42.662 00:27:53.062 586 00:38:42.662 00:27:53.062 587 rc=${!status[*]} 00:38:42.662 00:27:53.062 588 xtrace_restore 00:38:42.662 00:27:53.062 => 589 [[ $rc == 0 ]] 00:38:42.662 00:27:53.062 590 } 00:38:42.662 00:27:53.062 591 00:38:42.662 00:27:53.062 592 function rpc_cmd_simple_data_json() { 00:38:42.662 00:27:53.062 593 00:38:42.662 00:27:53.062 594 local elems="$1[@]" elem 00:38:42.662 00:27:53.062 ... 00:38:42.662 00:27:53.062 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/auth.sh:128 -> main(["--transport=tcp"]) 00:38:42.662 00:27:53.062 ... 00:38:42.662 00:27:53.062 123 NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.662 00:27:53.062 124 -a "$NVMF_FIRST_INITIATOR_IP" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.662 00:27:53.062 125 --dhchap-key "key1" --dhchap-ctrlr-key "ckey2" 00:38:42.662 00:27:53.062 126 00:38:42.662 00:27:53.062 127 # Check reauthentication 00:38:42.662 00:27:53.062 => 128 rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.662 00:27:53.062 129 -a "$(get_main_ns_ip)" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.662 00:27:53.062 130 --dhchap-key "key1" --dhchap-ctrlr-key "ckey1" --ctrlr-loss-timeout-sec 1 \ 00:38:42.662 00:27:53.062 131 --reconnect-delay-sec 1 00:38:42.662 00:27:53.062 132 nvmet_auth_set_key "sha256" "ffdhe2048" 2 00:38:42.662 00:27:53.062 133 rpc_cmd bdev_nvme_set_keys "nvme0" --dhchap-key "key2" --dhchap-ctrlr-key "ckey2" 00:38:42.662 00:27:53.062 ... 00:38:42.662 00:27:53.062 00:38:42.662 00:27:53.062 ========== Backtrace end ========== 00:38:42.662 00:28:04.349 ========== Backtrace start: ========== 00:38:42.662 00:28:04.349 00:38:42.662 00:28:04.350 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_auth_host"],["/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/auth.sh"],["--transport=tcp"]) 00:38:42.662 00:28:04.350 ... 00:38:42.662 00:28:04.350 1120 timing_enter $test_name 00:38:42.662 00:28:04.350 1121 echo "************************************" 00:38:42.663 00:28:04.350 1122 echo "START TEST $test_name" 00:38:42.663 00:28:04.350 1123 echo "************************************" 00:38:42.663 00:28:04.350 1124 xtrace_restore 00:38:42.663 00:28:04.350 1125 time "$@" 00:38:42.663 00:28:04.350 1126 xtrace_disable 00:38:42.663 00:28:04.350 1127 echo "************************************" 00:38:42.663 00:28:04.350 1128 echo "END TEST $test_name" 00:38:42.663 00:28:04.350 1129 echo "************************************" 00:38:42.663 00:28:04.350 1130 timing_exit $test_name 00:38:42.663 00:28:04.350 ... 00:38:42.663 00:28:04.611 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf_host.sh:27 -> main(["--transport=tcp"]) 00:38:42.663 00:28:04.611 ... 00:38:42.663 00:28:04.611 22 run_test "nvmf_fio_host" $rootdir/test/nvmf/host/fio.sh "${TEST_ARGS[@]}" 00:38:42.663 00:28:04.611 23 run_test "nvmf_failover" $rootdir/test/nvmf/host/failover.sh "${TEST_ARGS[@]}" 00:38:42.663 00:28:04.611 24 run_test "nvmf_host_multipath_status" $rootdir/test/nvmf/host/multipath_status.sh "${TEST_ARGS[@]}" 00:38:42.663 00:28:04.611 25 run_test "nvmf_discovery_remove_ifc" $rootdir/test/nvmf/host/discovery_remove_ifc.sh "${TEST_ARGS[@]}" 00:38:42.663 00:28:04.611 26 run_test "nvmf_identify_kernel_target" "$rootdir/test/nvmf/host/identify_kernel_nvmf.sh" "${TEST_ARGS[@]}" 00:38:42.663 00:28:04.611 => 27 run_test "nvmf_auth_host" "$rootdir/test/nvmf/host/auth.sh" "${TEST_ARGS[@]}" 00:38:42.663 00:28:04.611 28 run_test "nvmf_bdevperf" "$rootdir/test/nvmf/host/bdevperf.sh" "${TEST_ARGS[@]}" 00:38:42.663 00:28:04.611 29 run_test "nvmf_target_disconnect" "$rootdir/test/nvmf/host/target_disconnect.sh" "${TEST_ARGS[@]}" 00:38:42.663 00:28:04.611 30 00:38:42.663 00:28:04.611 31 if [[ "$SPDK_TEST_NVMF_TRANSPORT" == "tcp" ]]; then 00:38:42.663 00:28:04.611 32 run_test "nvmf_digest" "$rootdir/test/nvmf/host/digest.sh" "${TEST_ARGS[@]}" 00:38:42.663 00:28:04.611 ... 00:38:42.663 00:28:04.611 00:38:42.663 00:28:04.611 ========== Backtrace end ========== 00:38:42.663 00:28:04.611 ========== Backtrace start: ========== 00:38:42.663 00:28:04.611 00:38:42.663 00:28:04.611 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_host"],["/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf_host.sh"],["--transport=tcp"]) 00:38:42.663 00:28:04.611 ... 00:38:42.663 00:28:04.611 1120 timing_enter $test_name 00:38:42.663 00:28:04.611 1121 echo "************************************" 00:38:42.663 00:28:04.611 1122 echo "START TEST $test_name" 00:38:42.663 00:28:04.611 1123 echo "************************************" 00:38:42.663 00:28:04.611 1124 xtrace_restore 00:38:42.663 00:28:04.611 1125 time "$@" 00:38:42.663 00:28:04.611 1126 xtrace_disable 00:38:42.663 00:28:04.611 1127 echo "************************************" 00:38:42.663 00:28:04.611 1128 echo "END TEST $test_name" 00:38:42.663 00:28:04.611 1129 echo "************************************" 00:38:42.663 00:28:04.611 1130 timing_exit $test_name 00:38:42.663 00:28:04.611 ... 00:38:42.663 00:28:04.611 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh:12 -> main(["--transport=tcp"]) 00:38:42.663 00:28:04.611 ... 00:38:42.663 00:28:04.611 7 rootdir=$(readlink -f $testdir/../..) 00:38:42.663 00:28:04.611 8 source $rootdir/test/common/autotest_common.sh 00:38:42.663 00:28:04.611 9 00:38:42.663 00:28:04.611 10 run_test "nvmf_target_core" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.663 00:28:04.611 11 run_test "nvmf_target_extra" $rootdir/test/nvmf/nvmf_target_extra.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.663 00:28:04.611 => 12 run_test "nvmf_host" $rootdir/test/nvmf/nvmf_host.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.663 00:28:04.611 13 00:38:42.663 00:28:04.611 14 # Interrupt mode for now is supported only on the target, with the TCP transport and posix or ssl socket implementations. 00:38:42.663 00:28:04.611 15 if [[ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" && $SPDK_TEST_URING -eq 0 ]]; then 00:38:42.663 00:28:04.611 16 run_test "nvmf_target_core_interrupt_mode" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT --interrupt-mode 00:38:42.663 00:28:04.611 17 run_test "nvmf_interrupt" $rootdir/test/nvmf/target/interrupt.sh --transport=$SPDK_TEST_NVMF_TRANSPORT --interrupt-mode 00:38:42.663 00:28:04.611 ... 00:38:42.663 00:28:04.611 00:38:42.663 00:28:04.611 ========== Backtrace end ========== 00:38:42.663 00:28:04.611 ========== Backtrace start: ========== 00:38:42.663 00:28:04.611 00:38:42.663 00:28:04.611 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_tcp"],["/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh"],["--transport=tcp"]) 00:38:42.663 00:28:04.611 ... 00:38:42.663 00:28:04.611 1120 timing_enter $test_name 00:38:42.663 00:28:04.611 1121 echo "************************************" 00:38:42.663 00:28:04.611 1122 echo "START TEST $test_name" 00:38:42.663 00:28:04.611 1123 echo "************************************" 00:38:42.663 00:28:04.611 1124 xtrace_restore 00:38:42.663 00:28:04.611 1125 time "$@" 00:38:42.663 00:28:04.611 1126 xtrace_disable 00:38:42.663 00:28:04.611 1127 echo "************************************" 00:38:42.663 00:28:04.611 1128 echo "END TEST $test_name" 00:38:42.663 00:28:04.611 1129 echo "************************************" 00:38:42.663 00:28:04.611 1130 timing_exit $test_name 00:38:42.663 00:28:04.611 ... 00:38:42.663 00:28:04.611 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh:280 -> main(["/var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf"]) 00:38:42.663 00:28:04.611 ... 00:38:42.663 00:28:04.611 275 # list of all tests can properly differentiate them. Please do not merge them into one line. 00:38:42.663 00:28:04.611 276 if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then 00:38:42.663 00:28:04.611 277 run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.663 00:28:04.611 278 run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.663 00:28:04.611 279 elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then 00:38:42.663 00:28:04.611 => 280 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.663 00:28:04.611 281 if [[ $SPDK_TEST_URING -eq 0 ]]; then 00:38:42.663 00:28:04.611 282 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.663 00:28:04.611 283 run_test "nvmf_identify_passthru" $rootdir/test/nvmf/target/identify_passthru.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.663 00:28:04.611 284 fi 00:38:42.663 00:28:04.611 285 run_test "nvmf_dif" $rootdir/test/nvmf/target/dif.sh 00:38:42.663 00:28:04.611 ... 00:38:42.663 00:28:04.611 00:38:42.663 00:28:04.611 ========== Backtrace end ==========' 00:38:42.663 + [[ -n 00:27:53.061 ========== Backtrace start: ========== 00:38:42.663 00:27:53.061 00:38:42.663 00:27:53.061 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/auth.sh:128 -> main(["--transport=tcp"]) 00:38:42.663 00:27:53.061 ... 00:38:42.663 00:27:53.061 123 NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.663 00:27:53.061 124 -a "$NVMF_FIRST_INITIATOR_IP" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.663 00:27:53.061 125 --dhchap-key "key1" --dhchap-ctrlr-key "ckey2" 00:38:42.663 00:27:53.061 126 00:38:42.663 00:27:53.061 127 # Check reauthentication 00:38:42.663 00:27:53.061 => 128 rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.663 00:27:53.061 129 -a "$(get_main_ns_ip)" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.663 00:27:53.061 130 --dhchap-key "key1" --dhchap-ctrlr-key "ckey1" --ctrlr-loss-timeout-sec 1 \ 00:38:42.663 00:27:53.061 131 --reconnect-delay-sec 1 00:38:42.663 00:27:53.061 132 nvmet_auth_set_key "sha256" "ffdhe2048" 2 00:38:42.663 00:27:53.061 133 rpc_cmd bdev_nvme_set_keys "nvme0" --dhchap-key "key2" --dhchap-ctrlr-key "ckey2" 00:38:42.663 00:27:53.061 ... 00:38:42.663 00:27:53.061 00:38:42.663 00:27:53.061 ========== Backtrace end ========== 00:38:42.663 00:27:53.062 ========== Backtrace start: ========== 00:38:42.663 00:27:53.062 00:38:42.663 00:27:53.062 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:589 -> rpc_cmd(["bdev_nvme_attach_controller"],["-b"],["nvme0"],["-t"],["tcp"],["-f"],["ipv4"],["-a"],[""],["-s"],["4420"],["-q"],["nqn.2024-02.io.spdk:host0"],["-n"],["nqn.2024-02.io.spdk:cnode0"],["--dhchap-key"],["key1"],["--dhchap-ctrlr-key"],["ckey1"],["--ctrlr-loss-timeout-sec"],["1"],["--reconnect-delay-sec"],["1"]) 00:38:42.663 00:27:53.062 ... 00:38:42.663 00:27:53.062 584 echo "$rsp" 00:38:42.663 00:27:53.062 585 done 00:38:42.663 00:27:53.062 586 00:38:42.663 00:27:53.062 587 rc=${!status[*]} 00:38:42.663 00:27:53.062 588 xtrace_restore 00:38:42.663 00:27:53.062 => 589 [[ $rc == 0 ]] 00:38:42.663 00:27:53.062 590 } 00:38:42.663 00:27:53.062 591 00:38:42.663 00:27:53.062 592 function rpc_cmd_simple_data_json() { 00:38:42.663 00:27:53.062 593 00:38:42.663 00:27:53.062 594 local elems="$1[@]" elem 00:38:42.663 00:27:53.062 ... 00:38:42.663 00:27:53.062 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/auth.sh:128 -> main(["--transport=tcp"]) 00:38:42.663 00:27:53.062 ... 00:38:42.663 00:27:53.062 123 NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.663 00:27:53.062 124 -a "$NVMF_FIRST_INITIATOR_IP" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.663 00:27:53.062 125 --dhchap-key "key1" --dhchap-ctrlr-key "ckey2" 00:38:42.663 00:27:53.062 126 00:38:42.663 00:27:53.062 127 # Check reauthentication 00:38:42.663 00:27:53.062 => 128 rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.663 00:27:53.062 129 -a "$(get_main_ns_ip)" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.663 00:27:53.062 130 --dhchap-key "key1" --dhchap-ctrlr-key "ckey1" --ctrlr-loss-timeout-sec 1 \ 00:38:42.663 00:27:53.062 131 --reconnect-delay-sec 1 00:38:42.663 00:27:53.062 132 nvmet_auth_set_key "sha256" "ffdhe2048" 2 00:38:42.663 00:27:53.062 133 rpc_cmd bdev_nvme_set_keys "nvme0" --dhchap-key "key2" --dhchap-ctrlr-key "ckey2" 00:38:42.663 00:27:53.062 ... 00:38:42.663 00:27:53.062 00:38:42.663 00:27:53.062 ========== Backtrace end ========== 00:38:42.663 00:28:04.349 ========== Backtrace start: ========== 00:38:42.663 00:28:04.349 00:38:42.663 00:28:04.350 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_auth_host"],["/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/auth.sh"],["--transport=tcp"]) 00:38:42.663 00:28:04.350 ... 00:38:42.663 00:28:04.350 1120 timing_enter $test_name 00:38:42.663 00:28:04.350 1121 echo "************************************" 00:38:42.663 00:28:04.350 1122 echo "START TEST $test_name" 00:38:42.663 00:28:04.350 1123 echo "************************************" 00:38:42.663 00:28:04.350 1124 xtrace_restore 00:38:42.663 00:28:04.350 1125 time "$@" 00:38:42.663 00:28:04.350 1126 xtrace_disable 00:38:42.663 00:28:04.350 1127 echo "************************************" 00:38:42.663 00:28:04.350 1128 echo "END TEST $test_name" 00:38:42.663 00:28:04.350 1129 echo "************************************" 00:38:42.664 00:28:04.350 1130 timing_exit $test_name 00:38:42.664 00:28:04.350 ... 00:38:42.664 00:28:04.611 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf_host.sh:27 -> main(["--transport=tcp"]) 00:38:42.664 00:28:04.611 ... 00:38:42.664 00:28:04.611 22 run_test "nvmf_fio_host" $rootdir/test/nvmf/host/fio.sh "${TEST_ARGS[@]}" 00:38:42.664 00:28:04.611 23 run_test "nvmf_failover" $rootdir/test/nvmf/host/failover.sh "${TEST_ARGS[@]}" 00:38:42.664 00:28:04.611 24 run_test "nvmf_host_multipath_status" $rootdir/test/nvmf/host/multipath_status.sh "${TEST_ARGS[@]}" 00:38:42.664 00:28:04.611 25 run_test "nvmf_discovery_remove_ifc" $rootdir/test/nvmf/host/discovery_remove_ifc.sh "${TEST_ARGS[@]}" 00:38:42.664 00:28:04.611 26 run_test "nvmf_identify_kernel_target" "$rootdir/test/nvmf/host/identify_kernel_nvmf.sh" "${TEST_ARGS[@]}" 00:38:42.664 00:28:04.611 => 27 run_test "nvmf_auth_host" "$rootdir/test/nvmf/host/auth.sh" "${TEST_ARGS[@]}" 00:38:42.664 00:28:04.611 28 run_test "nvmf_bdevperf" "$rootdir/test/nvmf/host/bdevperf.sh" "${TEST_ARGS[@]}" 00:38:42.664 00:28:04.611 29 run_test "nvmf_target_disconnect" "$rootdir/test/nvmf/host/target_disconnect.sh" "${TEST_ARGS[@]}" 00:38:42.664 00:28:04.611 30 00:38:42.664 00:28:04.611 31 if [[ "$SPDK_TEST_NVMF_TRANSPORT" == "tcp" ]]; then 00:38:42.664 00:28:04.611 32 run_test "nvmf_digest" "$rootdir/test/nvmf/host/digest.sh" "${TEST_ARGS[@]}" 00:38:42.664 00:28:04.611 ... 00:38:42.664 00:28:04.611 00:38:42.664 00:28:04.611 ========== Backtrace end ========== 00:38:42.664 00:28:04.611 ========== Backtrace start: ========== 00:38:42.664 00:28:04.611 00:38:42.664 00:28:04.611 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_host"],["/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf_host.sh"],["--transport=tcp"]) 00:38:42.664 00:28:04.611 ... 00:38:42.664 00:28:04.611 1120 timing_enter $test_name 00:38:42.664 00:28:04.611 1121 echo "************************************" 00:38:42.664 00:28:04.611 1122 echo "START TEST $test_name" 00:38:42.664 00:28:04.611 1123 echo "************************************" 00:38:42.664 00:28:04.611 1124 xtrace_restore 00:38:42.664 00:28:04.611 1125 time "$@" 00:38:42.664 00:28:04.611 1126 xtrace_disable 00:38:42.664 00:28:04.611 1127 echo "************************************" 00:38:42.664 00:28:04.611 1128 echo "END TEST $test_name" 00:38:42.664 00:28:04.611 1129 echo "************************************" 00:38:42.664 00:28:04.611 1130 timing_exit $test_name 00:38:42.664 00:28:04.611 ... 00:38:42.664 00:28:04.611 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh:12 -> main(["--transport=tcp"]) 00:38:42.664 00:28:04.611 ... 00:38:42.664 00:28:04.611 7 rootdir=$(readlink -f $testdir/../..) 00:38:42.664 00:28:04.611 8 source $rootdir/test/common/autotest_common.sh 00:38:42.664 00:28:04.611 9 00:38:42.664 00:28:04.611 10 run_test "nvmf_target_core" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.664 00:28:04.611 11 run_test "nvmf_target_extra" $rootdir/test/nvmf/nvmf_target_extra.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.664 00:28:04.611 => 12 run_test "nvmf_host" $rootdir/test/nvmf/nvmf_host.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.664 00:28:04.611 13 00:38:42.664 00:28:04.611 14 # Interrupt mode for now is supported only on the target, with the TCP transport and posix or ssl socket implementations. 00:38:42.664 00:28:04.611 15 if [[ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" && $SPDK_TEST_URING -eq 0 ]]; then 00:38:42.664 00:28:04.611 16 run_test "nvmf_target_core_interrupt_mode" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT --interrupt-mode 00:38:42.664 00:28:04.611 17 run_test "nvmf_interrupt" $rootdir/test/nvmf/target/interrupt.sh --transport=$SPDK_TEST_NVMF_TRANSPORT --interrupt-mode 00:38:42.664 00:28:04.611 ... 00:38:42.664 00:28:04.611 00:38:42.664 00:28:04.611 ========== Backtrace end ========== 00:38:42.664 00:28:04.611 ========== Backtrace start: ========== 00:38:42.664 00:28:04.611 00:38:42.664 00:28:04.611 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_tcp"],["/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh"],["--transport=tcp"]) 00:38:42.664 00:28:04.611 ... 00:38:42.664 00:28:04.611 1120 timing_enter $test_name 00:38:42.664 00:28:04.611 1121 echo "************************************" 00:38:42.664 00:28:04.611 1122 echo "START TEST $test_name" 00:38:42.664 00:28:04.611 1123 echo "************************************" 00:38:42.664 00:28:04.611 1124 xtrace_restore 00:38:42.664 00:28:04.611 1125 time "$@" 00:38:42.664 00:28:04.611 1126 xtrace_disable 00:38:42.664 00:28:04.611 1127 echo "************************************" 00:38:42.664 00:28:04.611 1128 echo "END TEST $test_name" 00:38:42.664 00:28:04.611 1129 echo "************************************" 00:38:42.664 00:28:04.611 1130 timing_exit $test_name 00:38:42.664 00:28:04.611 ... 00:38:42.664 00:28:04.611 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh:280 -> main(["/var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf"]) 00:38:42.664 00:28:04.611 ... 00:38:42.664 00:28:04.611 275 # list of all tests can properly differentiate them. Please do not merge them into one line. 00:38:42.664 00:28:04.611 276 if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then 00:38:42.664 00:28:04.611 277 run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.664 00:28:04.611 278 run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.664 00:28:04.611 279 elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then 00:38:42.664 00:28:04.611 => 280 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.664 00:28:04.611 281 if [[ $SPDK_TEST_URING -eq 0 ]]; then 00:38:42.664 00:28:04.611 282 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.664 00:28:04.611 283 run_test "nvmf_identify_passthru" $rootdir/test/nvmf/target/identify_passthru.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.664 00:28:04.611 284 fi 00:38:42.664 00:28:04.611 285 run_test "nvmf_dif" $rootdir/test/nvmf/target/dif.sh 00:38:42.664 00:28:04.611 ... 00:38:42.664 00:28:04.611 00:38:42.664 00:28:04.611 ========== Backtrace end ========== ]] 00:38:42.664 + echo '00:27:53.061 ========== Backtrace start: ========== 00:38:42.664 00:27:53.061 00:38:42.664 00:27:53.061 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/auth.sh:128 -> main(["--transport=tcp"]) 00:38:42.664 00:27:53.061 ... 00:38:42.664 00:27:53.061 123 NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.664 00:27:53.061 124 -a "$NVMF_FIRST_INITIATOR_IP" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.664 00:27:53.061 125 --dhchap-key "key1" --dhchap-ctrlr-key "ckey2" 00:38:42.664 00:27:53.061 126 00:38:42.664 00:27:53.061 127 # Check reauthentication 00:38:42.664 00:27:53.061 => 128 rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.664 00:27:53.061 129 -a "$(get_main_ns_ip)" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.664 00:27:53.061 130 --dhchap-key "key1" --dhchap-ctrlr-key "ckey1" --ctrlr-loss-timeout-sec 1 \ 00:38:42.664 00:27:53.061 131 --reconnect-delay-sec 1 00:38:42.664 00:27:53.061 132 nvmet_auth_set_key "sha256" "ffdhe2048" 2 00:38:42.664 00:27:53.061 133 rpc_cmd bdev_nvme_set_keys "nvme0" --dhchap-key "key2" --dhchap-ctrlr-key "ckey2" 00:38:42.664 00:27:53.061 ... 00:38:42.664 00:27:53.061 00:38:42.664 00:27:53.061 ========== Backtrace end ========== 00:38:42.664 00:27:53.062 ========== Backtrace start: ========== 00:38:42.664 00:27:53.062 00:38:42.664 00:27:53.062 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:589 -> rpc_cmd(["bdev_nvme_attach_controller"],["-b"],["nvme0"],["-t"],["tcp"],["-f"],["ipv4"],["-a"],[""],["-s"],["4420"],["-q"],["nqn.2024-02.io.spdk:host0"],["-n"],["nqn.2024-02.io.spdk:cnode0"],["--dhchap-key"],["key1"],["--dhchap-ctrlr-key"],["ckey1"],["--ctrlr-loss-timeout-sec"],["1"],["--reconnect-delay-sec"],["1"]) 00:38:42.664 00:27:53.062 ... 00:38:42.664 00:27:53.062 584 echo "$rsp" 00:38:42.664 00:27:53.062 585 done 00:38:42.664 00:27:53.062 586 00:38:42.664 00:27:53.062 587 rc=${!status[*]} 00:38:42.664 00:27:53.062 588 xtrace_restore 00:38:42.664 00:27:53.062 => 589 [[ $rc == 0 ]] 00:38:42.664 00:27:53.062 590 } 00:38:42.664 00:27:53.062 591 00:38:42.664 00:27:53.062 592 function rpc_cmd_simple_data_json() { 00:38:42.664 00:27:53.062 593 00:38:42.664 00:27:53.062 594 local elems="$1[@]" elem 00:38:42.664 00:27:53.062 ... 00:38:42.664 00:27:53.062 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/auth.sh:128 -> main(["--transport=tcp"]) 00:38:42.664 00:27:53.062 ... 00:38:42.664 00:27:53.062 123 NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.664 00:27:53.062 124 -a "$NVMF_FIRST_INITIATOR_IP" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.664 00:27:53.062 125 --dhchap-key "key1" --dhchap-ctrlr-key "ckey2" 00:38:42.664 00:27:53.062 126 00:38:42.664 00:27:53.062 127 # Check reauthentication 00:38:42.664 00:27:53.062 => 128 rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.664 00:27:53.062 129 -a "$(get_main_ns_ip)" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.664 00:27:53.062 130 --dhchap-key "key1" --dhchap-ctrlr-key "ckey1" --ctrlr-loss-timeout-sec 1 \ 00:38:42.664 00:27:53.062 131 --reconnect-delay-sec 1 00:38:42.664 00:27:53.062 132 nvmet_auth_set_key "sha256" "ffdhe2048" 2 00:38:42.664 00:27:53.062 133 rpc_cmd bdev_nvme_set_keys "nvme0" --dhchap-key "key2" --dhchap-ctrlr-key "ckey2" 00:38:42.664 00:27:53.062 ... 00:38:42.664 00:27:53.062 00:38:42.664 00:27:53.062 ========== Backtrace end ========== 00:38:42.665 00:28:04.349 ========== Backtrace start: ========== 00:38:42.665 00:28:04.349 00:38:42.665 00:28:04.350 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_auth_host"],["/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/auth.sh"],["--transport=tcp"]) 00:38:42.665 00:28:04.350 ... 00:38:42.665 00:28:04.350 1120 timing_enter $test_name 00:38:42.665 00:28:04.350 1121 echo "************************************" 00:38:42.665 00:28:04.350 1122 echo "START TEST $test_name" 00:38:42.665 00:28:04.350 1123 echo "************************************" 00:38:42.665 00:28:04.350 1124 xtrace_restore 00:38:42.665 00:28:04.350 1125 time "$@" 00:38:42.665 00:28:04.350 1126 xtrace_disable 00:38:42.665 00:28:04.350 1127 echo "************************************" 00:38:42.665 00:28:04.350 1128 echo "END TEST $test_name" 00:38:42.665 00:28:04.350 1129 echo "************************************" 00:38:42.665 00:28:04.350 1130 timing_exit $test_name 00:38:42.665 00:28:04.350 ... 00:38:42.665 00:28:04.611 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf_host.sh:27 -> main(["--transport=tcp"]) 00:38:42.665 00:28:04.611 ... 00:38:42.665 00:28:04.611 22 run_test "nvmf_fio_host" $rootdir/test/nvmf/host/fio.sh "${TEST_ARGS[@]}" 00:38:42.665 00:28:04.611 23 run_test "nvmf_failover" $rootdir/test/nvmf/host/failover.sh "${TEST_ARGS[@]}" 00:38:42.665 00:28:04.611 24 run_test "nvmf_host_multipath_status" $rootdir/test/nvmf/host/multipath_status.sh "${TEST_ARGS[@]}" 00:38:42.665 00:28:04.611 25 run_test "nvmf_discovery_remove_ifc" $rootdir/test/nvmf/host/discovery_remove_ifc.sh "${TEST_ARGS[@]}" 00:38:42.665 00:28:04.611 26 run_test "nvmf_identify_kernel_target" "$rootdir/test/nvmf/host/identify_kernel_nvmf.sh" "${TEST_ARGS[@]}" 00:38:42.665 00:28:04.611 => 27 run_test "nvmf_auth_host" "$rootdir/test/nvmf/host/auth.sh" "${TEST_ARGS[@]}" 00:38:42.665 00:28:04.611 28 run_test "nvmf_bdevperf" "$rootdir/test/nvmf/host/bdevperf.sh" "${TEST_ARGS[@]}" 00:38:42.665 00:28:04.611 29 run_test "nvmf_target_disconnect" "$rootdir/test/nvmf/host/target_disconnect.sh" "${TEST_ARGS[@]}" 00:38:42.665 00:28:04.611 30 00:38:42.665 00:28:04.611 31 if [[ "$SPDK_TEST_NVMF_TRANSPORT" == "tcp" ]]; then 00:38:42.665 00:28:04.611 32 run_test "nvmf_digest" "$rootdir/test/nvmf/host/digest.sh" "${TEST_ARGS[@]}" 00:38:42.665 00:28:04.611 ... 00:38:42.665 00:28:04.611 00:38:42.665 00:28:04.611 ========== Backtrace end ========== 00:38:42.665 00:28:04.611 ========== Backtrace start: ========== 00:38:42.665 00:28:04.611 00:38:42.665 00:28:04.611 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_host"],["/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf_host.sh"],["--transport=tcp"]) 00:38:42.665 00:28:04.611 ... 00:38:42.665 00:28:04.611 1120 timing_enter $test_name 00:38:42.665 00:28:04.611 1121 echo "************************************" 00:38:42.665 00:28:04.611 1122 echo "START TEST $test_name" 00:38:42.665 00:28:04.611 1123 echo "************************************" 00:38:42.665 00:28:04.611 1124 xtrace_restore 00:38:42.665 00:28:04.611 1125 time "$@" 00:38:42.665 00:28:04.611 1126 xtrace_disable 00:38:42.665 00:28:04.611 1127 echo "************************************" 00:38:42.665 00:28:04.611 1128 echo "END TEST $test_name" 00:38:42.665 00:28:04.611 1129 echo "************************************" 00:38:42.665 00:28:04.611 1130 timing_exit $test_name 00:38:42.665 00:28:04.611 ... 00:38:42.665 00:28:04.611 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh:12 -> main(["--transport=tcp"]) 00:38:42.665 00:28:04.611 ... 00:38:42.665 00:28:04.611 7 rootdir=$(readlink -f $testdir/../..) 00:38:42.665 00:28:04.611 8 source $rootdir/test/common/autotest_common.sh 00:38:42.665 00:28:04.611 9 00:38:42.665 00:28:04.611 10 run_test "nvmf_target_core" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.665 00:28:04.611 11 run_test "nvmf_target_extra" $rootdir/test/nvmf/nvmf_target_extra.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.665 00:28:04.611 => 12 run_test "nvmf_host" $rootdir/test/nvmf/nvmf_host.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.665 00:28:04.611 13 00:38:42.665 00:28:04.611 14 # Interrupt mode for now is supported only on the target, with the TCP transport and posix or ssl socket implementations. 00:38:42.665 00:28:04.611 15 if [[ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" && $SPDK_TEST_URING -eq 0 ]]; then 00:38:42.665 00:28:04.611 16 run_test "nvmf_target_core_interrupt_mode" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT --interrupt-mode 00:38:42.665 00:28:04.611 17 run_test "nvmf_interrupt" $rootdir/test/nvmf/target/interrupt.sh --transport=$SPDK_TEST_NVMF_TRANSPORT --interrupt-mode 00:38:42.665 00:28:04.611 ... 00:38:42.665 00:28:04.611 00:38:42.665 00:28:04.611 ========== Backtrace end ========== 00:38:42.665 00:28:04.611 ========== Backtrace start: ========== 00:38:42.665 00:28:04.611 00:38:42.665 00:28:04.611 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_tcp"],["/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh"],["--transport=tcp"]) 00:38:42.665 00:28:04.611 ... 00:38:42.665 00:28:04.611 1120 timing_enter $test_name 00:38:42.665 00:28:04.611 1121 echo "************************************" 00:38:42.665 00:28:04.611 1122 echo "START TEST $test_name" 00:38:42.665 00:28:04.611 1123 echo "************************************" 00:38:42.665 00:28:04.611 1124 xtrace_restore 00:38:42.665 00:28:04.611 1125 time "$@" 00:38:42.665 00:28:04.611 1126 xtrace_disable 00:38:42.665 00:28:04.611 1127 echo "************************************" 00:38:42.665 00:28:04.611 1128 echo "END TEST $test_name" 00:38:42.665 00:28:04.611 1129 echo "************************************" 00:38:42.665 00:28:04.611 1130 timing_exit $test_name 00:38:42.665 00:28:04.611 ... 00:38:42.665 00:28:04.611 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh:280 -> main(["/var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf"]) 00:38:42.665 00:28:04.611 ... 00:38:42.665 00:28:04.611 275 # list of all tests can properly differentiate them. Please do not merge them into one line. 00:38:42.665 00:28:04.611 276 if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then 00:38:42.665 00:28:04.611 277 run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.665 00:28:04.611 278 run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.665 00:28:04.611 279 elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then 00:38:42.665 00:28:04.611 => 280 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.665 00:28:04.611 281 if [[ $SPDK_TEST_URING -eq 0 ]]; then 00:38:42.665 00:28:04.611 282 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.665 00:28:04.611 283 run_test "nvmf_identify_passthru" $rootdir/test/nvmf/target/identify_passthru.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.665 00:28:04.611 284 fi 00:38:42.665 00:28:04.611 285 run_test "nvmf_dif" $rootdir/test/nvmf/target/dif.sh 00:38:42.665 00:28:04.611 ... 00:38:42.665 00:28:04.611 00:38:42.665 00:28:04.611 ========== Backtrace end ==========' 00:38:42.665 + for build in "${build_log_list[@]}" 00:38:42.665 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_2/zns-vg-autotest_88936/build.log 00:38:42.665 + local build_log job_name start_pattern end_pattern backtraces 00:38:42.665 + build_log=/var/jenkins/workspace/autotest-per-patch_2/zns-vg-autotest_88936/build.log 00:38:42.665 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/zns-vg-autotest_88936/build.log 00:38:42.665 ++ basename /var/jenkins/workspace/autotest-per-patch_2/zns-vg-autotest_88936 00:38:42.665 + job_name=zns-vg-autotest_88936 00:38:42.665 + start_pattern='Backtrace start' 00:38:42.665 + end_pattern='Backtrace end' 00:38:42.665 + [[ -f /var/jenkins/workspace/autotest-per-patch_2/zns-vg-autotest_88936/build.log ]] 00:38:42.665 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_2/zns-vg-autotest_88936/build.log 00:38:42.665 + backtraces= 00:38:42.665 + [[ -n '' ]] 00:38:42.665 + for build in "${build_log_list[@]}" 00:38:42.665 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_2/crypto-phy-autotest_37569/build.log 00:38:42.665 + local build_log job_name start_pattern end_pattern backtraces 00:38:42.665 + build_log=/var/jenkins/workspace/autotest-per-patch_2/crypto-phy-autotest_37569/build.log 00:38:42.665 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/crypto-phy-autotest_37569/build.log 00:38:42.665 ++ basename /var/jenkins/workspace/autotest-per-patch_2/crypto-phy-autotest_37569 00:38:42.665 + job_name=crypto-phy-autotest_37569 00:38:42.665 + start_pattern='Backtrace start' 00:38:42.665 + end_pattern='Backtrace end' 00:38:42.665 + [[ -f /var/jenkins/workspace/autotest-per-patch_2/crypto-phy-autotest_37569/build.log ]] 00:38:42.665 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_2/crypto-phy-autotest_37569/build.log 00:38:42.665 + backtraces= 00:38:42.665 + [[ -n '' ]] 00:38:42.665 + for build in "${build_log_list[@]}" 00:38:42.665 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_2/BlobFS-phy-autotest_37580/build.log 00:38:42.665 + local build_log job_name start_pattern end_pattern backtraces 00:38:42.665 + build_log=/var/jenkins/workspace/autotest-per-patch_2/BlobFS-phy-autotest_37580/build.log 00:38:42.665 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/BlobFS-phy-autotest_37580/build.log 00:38:42.665 ++ basename /var/jenkins/workspace/autotest-per-patch_2/BlobFS-phy-autotest_37580 00:38:42.665 + job_name=BlobFS-phy-autotest_37580 00:38:42.665 + start_pattern='Backtrace start' 00:38:42.665 + end_pattern='Backtrace end' 00:38:42.665 + [[ -f /var/jenkins/workspace/autotest-per-patch_2/BlobFS-phy-autotest_37580/build.log ]] 00:38:42.665 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_2/BlobFS-phy-autotest_37580/build.log 00:38:42.665 + backtraces= 00:38:42.665 + [[ -n '' ]] 00:38:42.665 + for build in "${build_log_list[@]}" 00:38:42.665 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_2/ubuntu22-vg-autotest_48871/build.log 00:38:42.665 + local build_log job_name start_pattern end_pattern backtraces 00:38:42.665 + build_log=/var/jenkins/workspace/autotest-per-patch_2/ubuntu22-vg-autotest_48871/build.log 00:38:42.665 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/ubuntu22-vg-autotest_48871/build.log 00:38:42.665 ++ basename /var/jenkins/workspace/autotest-per-patch_2/ubuntu22-vg-autotest_48871 00:38:42.665 + job_name=ubuntu22-vg-autotest_48871 00:38:42.665 + start_pattern='Backtrace start' 00:38:42.665 + end_pattern='Backtrace end' 00:38:42.665 + [[ -f /var/jenkins/workspace/autotest-per-patch_2/ubuntu22-vg-autotest_48871/build.log ]] 00:38:42.665 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_2/ubuntu22-vg-autotest_48871/build.log 00:38:42.665 + backtraces= 00:38:42.665 + [[ -n '' ]] 00:38:42.665 + for build in "${build_log_list[@]}" 00:38:42.665 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_2/nvmf-phy-autotest_83812/build.log 00:38:42.665 + local build_log job_name start_pattern end_pattern backtraces 00:38:42.665 + build_log=/var/jenkins/workspace/autotest-per-patch_2/nvmf-phy-autotest_83812/build.log 00:38:42.665 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/nvmf-phy-autotest_83812/build.log 00:38:42.666 ++ basename /var/jenkins/workspace/autotest-per-patch_2/nvmf-phy-autotest_83812 00:38:42.666 + job_name=nvmf-phy-autotest_83812 00:38:42.666 + start_pattern='Backtrace start' 00:38:42.666 + end_pattern='Backtrace end' 00:38:42.666 + [[ -f /var/jenkins/workspace/autotest-per-patch_2/nvmf-phy-autotest_83812/build.log ]] 00:38:42.666 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_2/nvmf-phy-autotest_83812/build.log 00:38:42.928 + backtraces='00:20:33.843 ========== Backtrace start: ========== 00:38:42.928 00:20:33.843 00:38:42.928 00:20:33.843 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/auth.sh:128 -> main(["--transport=rdma"]) 00:38:42.928 00:20:33.843 ... 00:38:42.928 00:20:33.843 123 NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.928 00:20:33.844 124 -a "$NVMF_FIRST_INITIATOR_IP" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.928 00:20:33.844 125 --dhchap-key "key1" --dhchap-ctrlr-key "ckey2" 00:38:42.928 00:20:33.844 126 00:38:42.928 00:20:33.844 127 # Check reauthentication 00:38:42.928 00:20:33.844 => 128 rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.928 00:20:33.844 129 -a "$(get_main_ns_ip)" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.928 00:20:33.844 130 --dhchap-key "key1" --dhchap-ctrlr-key "ckey1" --ctrlr-loss-timeout-sec 1 \ 00:38:42.928 00:20:33.844 131 --reconnect-delay-sec 1 00:38:42.928 00:20:33.844 132 nvmet_auth_set_key "sha256" "ffdhe2048" 2 00:38:42.928 00:20:33.844 133 rpc_cmd bdev_nvme_set_keys "nvme0" --dhchap-key "key2" --dhchap-ctrlr-key "ckey2" 00:38:42.928 00:20:33.844 ... 00:38:42.928 00:20:33.844 00:38:42.928 00:20:33.844 ========== Backtrace end ========== 00:38:42.928 00:20:33.844 ========== Backtrace start: ========== 00:38:42.928 00:20:33.844 00:38:42.928 00:20:33.844 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:589 -> rpc_cmd(["bdev_nvme_attach_controller"],["-b"],["nvme0"],["-t"],["rdma"],["-f"],["ipv4"],["-a"],[""],["-s"],["4420"],["-q"],["nqn.2024-02.io.spdk:host0"],["-n"],["nqn.2024-02.io.spdk:cnode0"],["--dhchap-key"],["key1"],["--dhchap-ctrlr-key"],["ckey1"],["--ctrlr-loss-timeout-sec"],["1"],["--reconnect-delay-sec"],["1"]) 00:38:42.928 00:20:33.844 ... 00:38:42.928 00:20:33.844 584 echo "$rsp" 00:38:42.928 00:20:33.844 585 done 00:38:42.928 00:20:33.844 586 00:38:42.928 00:20:33.844 587 rc=${!status[*]} 00:38:42.928 00:20:33.844 588 xtrace_restore 00:38:42.928 00:20:33.844 => 589 [[ $rc == 0 ]] 00:38:42.928 00:20:33.844 590 } 00:38:42.928 00:20:33.844 591 00:38:42.928 00:20:33.844 592 function rpc_cmd_simple_data_json() { 00:38:42.928 00:20:33.844 593 00:38:42.928 00:20:33.844 594 local elems="$1[@]" elem 00:38:42.928 00:20:33.844 ... 00:38:42.928 00:20:33.844 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/auth.sh:128 -> main(["--transport=rdma"]) 00:38:42.928 00:20:33.844 ... 00:38:42.928 00:20:33.844 123 NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.928 00:20:33.844 124 -a "$NVMF_FIRST_INITIATOR_IP" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.928 00:20:33.844 125 --dhchap-key "key1" --dhchap-ctrlr-key "ckey2" 00:38:42.928 00:20:33.844 126 00:38:42.928 00:20:33.844 127 # Check reauthentication 00:38:42.928 00:20:33.844 => 128 rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.928 00:20:33.844 129 -a "$(get_main_ns_ip)" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.928 00:20:33.844 130 --dhchap-key "key1" --dhchap-ctrlr-key "ckey1" --ctrlr-loss-timeout-sec 1 \ 00:38:42.928 00:20:33.844 131 --reconnect-delay-sec 1 00:38:42.928 00:20:33.844 132 nvmet_auth_set_key "sha256" "ffdhe2048" 2 00:38:42.928 00:20:33.844 133 rpc_cmd bdev_nvme_set_keys "nvme0" --dhchap-key "key2" --dhchap-ctrlr-key "ckey2" 00:38:42.928 00:20:33.844 ... 00:38:42.928 00:20:33.844 00:38:42.928 00:20:33.844 ========== Backtrace end ========== 00:38:42.928 00:20:41.170 ========== Backtrace start: ========== 00:38:42.928 00:20:41.170 00:38:42.928 00:20:41.430 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_auth_host"],["/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/auth.sh"],["--transport=rdma"]) 00:38:42.928 00:20:41.430 ... 00:38:42.928 00:20:41.430 1120 timing_enter $test_name 00:38:42.928 00:20:41.430 1121 echo "************************************" 00:38:42.928 00:20:41.430 1122 echo "START TEST $test_name" 00:38:42.928 00:20:41.430 1123 echo "************************************" 00:38:42.928 00:20:41.430 1124 xtrace_restore 00:38:42.928 00:20:41.430 1125 time "$@" 00:38:42.928 00:20:41.430 1126 xtrace_disable 00:38:42.928 00:20:41.430 1127 echo "************************************" 00:38:42.928 00:20:41.430 1128 echo "END TEST $test_name" 00:38:42.928 00:20:41.430 1129 echo "************************************" 00:38:42.928 00:20:41.430 1130 timing_exit $test_name 00:38:42.928 00:20:41.430 ... 00:38:42.928 00:20:41.430 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf_host.sh:27 -> main(["--transport=rdma"]) 00:38:42.928 00:20:41.430 ... 00:38:42.928 00:20:41.430 22 run_test "nvmf_fio_host" $rootdir/test/nvmf/host/fio.sh "${TEST_ARGS[@]}" 00:38:42.928 00:20:41.430 23 run_test "nvmf_failover" $rootdir/test/nvmf/host/failover.sh "${TEST_ARGS[@]}" 00:38:42.928 00:20:41.430 24 run_test "nvmf_host_multipath_status" $rootdir/test/nvmf/host/multipath_status.sh "${TEST_ARGS[@]}" 00:38:42.928 00:20:41.430 25 run_test "nvmf_discovery_remove_ifc" $rootdir/test/nvmf/host/discovery_remove_ifc.sh "${TEST_ARGS[@]}" 00:38:42.928 00:20:41.430 26 run_test "nvmf_identify_kernel_target" "$rootdir/test/nvmf/host/identify_kernel_nvmf.sh" "${TEST_ARGS[@]}" 00:38:42.928 00:20:41.430 => 27 run_test "nvmf_auth_host" "$rootdir/test/nvmf/host/auth.sh" "${TEST_ARGS[@]}" 00:38:42.928 00:20:41.430 28 run_test "nvmf_bdevperf" "$rootdir/test/nvmf/host/bdevperf.sh" "${TEST_ARGS[@]}" 00:38:42.928 00:20:41.430 29 run_test "nvmf_target_disconnect" "$rootdir/test/nvmf/host/target_disconnect.sh" "${TEST_ARGS[@]}" 00:38:42.928 00:20:41.430 30 00:38:42.928 00:20:41.430 31 if [[ "$SPDK_TEST_NVMF_TRANSPORT" == "tcp" ]]; then 00:38:42.928 00:20:41.430 32 run_test "nvmf_digest" "$rootdir/test/nvmf/host/digest.sh" "${TEST_ARGS[@]}" 00:38:42.928 00:20:41.430 ... 00:38:42.928 00:20:41.430 00:38:42.928 00:20:41.430 ========== Backtrace end ========== 00:38:42.928 00:20:41.430 ========== Backtrace start: ========== 00:38:42.928 00:20:41.430 00:38:42.928 00:20:41.430 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_host"],["/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf_host.sh"],["--transport=rdma"]) 00:38:42.928 00:20:41.430 ... 00:38:42.928 00:20:41.430 1120 timing_enter $test_name 00:38:42.928 00:20:41.430 1121 echo "************************************" 00:38:42.928 00:20:41.430 1122 echo "START TEST $test_name" 00:38:42.928 00:20:41.430 1123 echo "************************************" 00:38:42.928 00:20:41.430 1124 xtrace_restore 00:38:42.928 00:20:41.430 1125 time "$@" 00:38:42.928 00:20:41.430 1126 xtrace_disable 00:38:42.928 00:20:41.430 1127 echo "************************************" 00:38:42.928 00:20:41.430 1128 echo "END TEST $test_name" 00:38:42.928 00:20:41.430 1129 echo "************************************" 00:38:42.928 00:20:41.430 1130 timing_exit $test_name 00:38:42.928 00:20:41.430 ... 00:38:42.928 00:20:41.430 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh:12 -> main(["--transport=rdma"]) 00:38:42.928 00:20:41.430 ... 00:38:42.928 00:20:41.430 7 rootdir=$(readlink -f $testdir/../..) 00:38:42.929 00:20:41.430 8 source $rootdir/test/common/autotest_common.sh 00:38:42.929 00:20:41.430 9 00:38:42.929 00:20:41.430 10 run_test "nvmf_target_core" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.929 00:20:41.430 11 run_test "nvmf_target_extra" $rootdir/test/nvmf/nvmf_target_extra.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.929 00:20:41.430 => 12 run_test "nvmf_host" $rootdir/test/nvmf/nvmf_host.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.929 00:20:41.430 13 00:38:42.929 00:20:41.430 14 # Interrupt mode for now is supported only on the target, with the TCP transport and posix or ssl socket implementations. 00:38:42.929 00:20:41.430 15 if [[ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" && $SPDK_TEST_URING -eq 0 ]]; then 00:38:42.929 00:20:41.430 16 run_test "nvmf_target_core_interrupt_mode" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT --interrupt-mode 00:38:42.929 00:20:41.430 17 run_test "nvmf_interrupt" $rootdir/test/nvmf/target/interrupt.sh --transport=$SPDK_TEST_NVMF_TRANSPORT --interrupt-mode 00:38:42.929 00:20:41.430 ... 00:38:42.929 00:20:41.430 00:38:42.929 00:20:41.430 ========== Backtrace end ========== 00:38:42.929 00:20:41.431 ========== Backtrace start: ========== 00:38:42.929 00:20:41.431 00:38:42.929 00:20:41.431 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_rdma"],["/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh"],["--transport=rdma"]) 00:38:42.929 00:20:41.431 ... 00:38:42.929 00:20:41.431 1120 timing_enter $test_name 00:38:42.929 00:20:41.431 1121 echo "************************************" 00:38:42.929 00:20:41.431 1122 echo "START TEST $test_name" 00:38:42.929 00:20:41.431 1123 echo "************************************" 00:38:42.929 00:20:41.431 1124 xtrace_restore 00:38:42.929 00:20:41.431 1125 time "$@" 00:38:42.929 00:20:41.431 1126 xtrace_disable 00:38:42.929 00:20:41.431 1127 echo "************************************" 00:38:42.929 00:20:41.431 1128 echo "END TEST $test_name" 00:38:42.929 00:20:41.431 1129 echo "************************************" 00:38:42.929 00:20:41.431 1130 timing_exit $test_name 00:38:42.929 00:20:41.431 ... 00:38:42.929 00:20:41.431 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/autotest.sh:277 -> main(["/var/jenkins/workspace/nvmf-phy-autotest/autorun-spdk.conf"]) 00:38:42.929 00:20:41.431 ... 00:38:42.929 00:20:41.431 272 if [ $SPDK_TEST_NVMF -eq 1 ]; then 00:38:42.929 00:20:41.431 273 export NET_TYPE 00:38:42.929 00:20:41.431 274 # The NVMe-oF run test cases are split out like this so that the parser that compiles the 00:38:42.929 00:20:41.431 275 # list of all tests can properly differentiate them. Please do not merge them into one line. 00:38:42.929 00:20:41.431 276 if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then 00:38:42.929 00:20:41.431 => 277 run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.929 00:20:41.431 278 run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.929 00:20:41.431 279 elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then 00:38:42.929 00:20:41.431 280 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.929 00:20:41.431 281 if [[ $SPDK_TEST_URING -eq 0 ]]; then 00:38:42.929 00:20:41.431 282 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.929 00:20:41.431 ... 00:38:42.929 00:20:41.431 00:38:42.929 00:20:41.431 ========== Backtrace end ==========' 00:38:42.929 + [[ -n 00:20:33.843 ========== Backtrace start: ========== 00:38:42.929 00:20:33.843 00:38:42.929 00:20:33.843 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/auth.sh:128 -> main(["--transport=rdma"]) 00:38:42.929 00:20:33.843 ... 00:38:42.929 00:20:33.843 123 NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.929 00:20:33.844 124 -a "$NVMF_FIRST_INITIATOR_IP" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.929 00:20:33.844 125 --dhchap-key "key1" --dhchap-ctrlr-key "ckey2" 00:38:42.929 00:20:33.844 126 00:38:42.929 00:20:33.844 127 # Check reauthentication 00:38:42.929 00:20:33.844 => 128 rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.929 00:20:33.844 129 -a "$(get_main_ns_ip)" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.929 00:20:33.844 130 --dhchap-key "key1" --dhchap-ctrlr-key "ckey1" --ctrlr-loss-timeout-sec 1 \ 00:38:42.929 00:20:33.844 131 --reconnect-delay-sec 1 00:38:42.929 00:20:33.844 132 nvmet_auth_set_key "sha256" "ffdhe2048" 2 00:38:42.929 00:20:33.844 133 rpc_cmd bdev_nvme_set_keys "nvme0" --dhchap-key "key2" --dhchap-ctrlr-key "ckey2" 00:38:42.929 00:20:33.844 ... 00:38:42.929 00:20:33.844 00:38:42.929 00:20:33.844 ========== Backtrace end ========== 00:38:42.929 00:20:33.844 ========== Backtrace start: ========== 00:38:42.929 00:20:33.844 00:38:42.929 00:20:33.844 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:589 -> rpc_cmd(["bdev_nvme_attach_controller"],["-b"],["nvme0"],["-t"],["rdma"],["-f"],["ipv4"],["-a"],[""],["-s"],["4420"],["-q"],["nqn.2024-02.io.spdk:host0"],["-n"],["nqn.2024-02.io.spdk:cnode0"],["--dhchap-key"],["key1"],["--dhchap-ctrlr-key"],["ckey1"],["--ctrlr-loss-timeout-sec"],["1"],["--reconnect-delay-sec"],["1"]) 00:38:42.929 00:20:33.844 ... 00:38:42.929 00:20:33.844 584 echo "$rsp" 00:38:42.929 00:20:33.844 585 done 00:38:42.929 00:20:33.844 586 00:38:42.929 00:20:33.844 587 rc=${!status[*]} 00:38:42.929 00:20:33.844 588 xtrace_restore 00:38:42.929 00:20:33.844 => 589 [[ $rc == 0 ]] 00:38:42.929 00:20:33.844 590 } 00:38:42.929 00:20:33.844 591 00:38:42.929 00:20:33.844 592 function rpc_cmd_simple_data_json() { 00:38:42.929 00:20:33.844 593 00:38:42.929 00:20:33.844 594 local elems="$1[@]" elem 00:38:42.929 00:20:33.844 ... 00:38:42.929 00:20:33.844 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/auth.sh:128 -> main(["--transport=rdma"]) 00:38:42.929 00:20:33.844 ... 00:38:42.929 00:20:33.844 123 NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.929 00:20:33.844 124 -a "$NVMF_FIRST_INITIATOR_IP" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.929 00:20:33.844 125 --dhchap-key "key1" --dhchap-ctrlr-key "ckey2" 00:38:42.929 00:20:33.844 126 00:38:42.929 00:20:33.844 127 # Check reauthentication 00:38:42.929 00:20:33.844 => 128 rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.929 00:20:33.844 129 -a "$(get_main_ns_ip)" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.929 00:20:33.844 130 --dhchap-key "key1" --dhchap-ctrlr-key "ckey1" --ctrlr-loss-timeout-sec 1 \ 00:38:42.929 00:20:33.844 131 --reconnect-delay-sec 1 00:38:42.929 00:20:33.844 132 nvmet_auth_set_key "sha256" "ffdhe2048" 2 00:38:42.929 00:20:33.844 133 rpc_cmd bdev_nvme_set_keys "nvme0" --dhchap-key "key2" --dhchap-ctrlr-key "ckey2" 00:38:42.929 00:20:33.844 ... 00:38:42.929 00:20:33.844 00:38:42.929 00:20:33.844 ========== Backtrace end ========== 00:38:42.929 00:20:41.170 ========== Backtrace start: ========== 00:38:42.929 00:20:41.170 00:38:42.929 00:20:41.430 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_auth_host"],["/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/auth.sh"],["--transport=rdma"]) 00:38:42.929 00:20:41.430 ... 00:38:42.929 00:20:41.430 1120 timing_enter $test_name 00:38:42.929 00:20:41.430 1121 echo "************************************" 00:38:42.929 00:20:41.430 1122 echo "START TEST $test_name" 00:38:42.929 00:20:41.430 1123 echo "************************************" 00:38:42.929 00:20:41.430 1124 xtrace_restore 00:38:42.929 00:20:41.430 1125 time "$@" 00:38:42.929 00:20:41.430 1126 xtrace_disable 00:38:42.929 00:20:41.430 1127 echo "************************************" 00:38:42.929 00:20:41.430 1128 echo "END TEST $test_name" 00:38:42.929 00:20:41.430 1129 echo "************************************" 00:38:42.929 00:20:41.430 1130 timing_exit $test_name 00:38:42.929 00:20:41.430 ... 00:38:42.929 00:20:41.430 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf_host.sh:27 -> main(["--transport=rdma"]) 00:38:42.929 00:20:41.430 ... 00:38:42.929 00:20:41.430 22 run_test "nvmf_fio_host" $rootdir/test/nvmf/host/fio.sh "${TEST_ARGS[@]}" 00:38:42.929 00:20:41.430 23 run_test "nvmf_failover" $rootdir/test/nvmf/host/failover.sh "${TEST_ARGS[@]}" 00:38:42.929 00:20:41.430 24 run_test "nvmf_host_multipath_status" $rootdir/test/nvmf/host/multipath_status.sh "${TEST_ARGS[@]}" 00:38:42.929 00:20:41.430 25 run_test "nvmf_discovery_remove_ifc" $rootdir/test/nvmf/host/discovery_remove_ifc.sh "${TEST_ARGS[@]}" 00:38:42.929 00:20:41.430 26 run_test "nvmf_identify_kernel_target" "$rootdir/test/nvmf/host/identify_kernel_nvmf.sh" "${TEST_ARGS[@]}" 00:38:42.929 00:20:41.430 => 27 run_test "nvmf_auth_host" "$rootdir/test/nvmf/host/auth.sh" "${TEST_ARGS[@]}" 00:38:42.929 00:20:41.430 28 run_test "nvmf_bdevperf" "$rootdir/test/nvmf/host/bdevperf.sh" "${TEST_ARGS[@]}" 00:38:42.929 00:20:41.430 29 run_test "nvmf_target_disconnect" "$rootdir/test/nvmf/host/target_disconnect.sh" "${TEST_ARGS[@]}" 00:38:42.929 00:20:41.430 30 00:38:42.929 00:20:41.430 31 if [[ "$SPDK_TEST_NVMF_TRANSPORT" == "tcp" ]]; then 00:38:42.929 00:20:41.430 32 run_test "nvmf_digest" "$rootdir/test/nvmf/host/digest.sh" "${TEST_ARGS[@]}" 00:38:42.929 00:20:41.430 ... 00:38:42.929 00:20:41.430 00:38:42.929 00:20:41.430 ========== Backtrace end ========== 00:38:42.929 00:20:41.430 ========== Backtrace start: ========== 00:38:42.929 00:20:41.430 00:38:42.929 00:20:41.430 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_host"],["/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf_host.sh"],["--transport=rdma"]) 00:38:42.929 00:20:41.430 ... 00:38:42.929 00:20:41.430 1120 timing_enter $test_name 00:38:42.929 00:20:41.430 1121 echo "************************************" 00:38:42.929 00:20:41.430 1122 echo "START TEST $test_name" 00:38:42.929 00:20:41.430 1123 echo "************************************" 00:38:42.929 00:20:41.430 1124 xtrace_restore 00:38:42.929 00:20:41.430 1125 time "$@" 00:38:42.929 00:20:41.430 1126 xtrace_disable 00:38:42.929 00:20:41.430 1127 echo "************************************" 00:38:42.929 00:20:41.430 1128 echo "END TEST $test_name" 00:38:42.929 00:20:41.430 1129 echo "************************************" 00:38:42.929 00:20:41.430 1130 timing_exit $test_name 00:38:42.929 00:20:41.430 ... 00:38:42.929 00:20:41.430 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh:12 -> main(["--transport=rdma"]) 00:38:42.929 00:20:41.430 ... 00:38:42.929 00:20:41.430 7 rootdir=$(readlink -f $testdir/../..) 00:38:42.929 00:20:41.430 8 source $rootdir/test/common/autotest_common.sh 00:38:42.929 00:20:41.430 9 00:38:42.929 00:20:41.430 10 run_test "nvmf_target_core" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.929 00:20:41.430 11 run_test "nvmf_target_extra" $rootdir/test/nvmf/nvmf_target_extra.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.929 00:20:41.430 => 12 run_test "nvmf_host" $rootdir/test/nvmf/nvmf_host.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.929 00:20:41.430 13 00:38:42.930 00:20:41.430 14 # Interrupt mode for now is supported only on the target, with the TCP transport and posix or ssl socket implementations. 00:38:42.930 00:20:41.430 15 if [[ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" && $SPDK_TEST_URING -eq 0 ]]; then 00:38:42.930 00:20:41.430 16 run_test "nvmf_target_core_interrupt_mode" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT --interrupt-mode 00:38:42.930 00:20:41.430 17 run_test "nvmf_interrupt" $rootdir/test/nvmf/target/interrupt.sh --transport=$SPDK_TEST_NVMF_TRANSPORT --interrupt-mode 00:38:42.930 00:20:41.430 ... 00:38:42.930 00:20:41.430 00:38:42.930 00:20:41.430 ========== Backtrace end ========== 00:38:42.930 00:20:41.431 ========== Backtrace start: ========== 00:38:42.930 00:20:41.431 00:38:42.930 00:20:41.431 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_rdma"],["/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh"],["--transport=rdma"]) 00:38:42.930 00:20:41.431 ... 00:38:42.930 00:20:41.431 1120 timing_enter $test_name 00:38:42.930 00:20:41.431 1121 echo "************************************" 00:38:42.930 00:20:41.431 1122 echo "START TEST $test_name" 00:38:42.930 00:20:41.431 1123 echo "************************************" 00:38:42.930 00:20:41.431 1124 xtrace_restore 00:38:42.930 00:20:41.431 1125 time "$@" 00:38:42.930 00:20:41.431 1126 xtrace_disable 00:38:42.930 00:20:41.431 1127 echo "************************************" 00:38:42.930 00:20:41.431 1128 echo "END TEST $test_name" 00:38:42.930 00:20:41.431 1129 echo "************************************" 00:38:42.930 00:20:41.431 1130 timing_exit $test_name 00:38:42.930 00:20:41.431 ... 00:38:42.930 00:20:41.431 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/autotest.sh:277 -> main(["/var/jenkins/workspace/nvmf-phy-autotest/autorun-spdk.conf"]) 00:38:42.930 00:20:41.431 ... 00:38:42.930 00:20:41.431 272 if [ $SPDK_TEST_NVMF -eq 1 ]; then 00:38:42.930 00:20:41.431 273 export NET_TYPE 00:38:42.930 00:20:41.431 274 # The NVMe-oF run test cases are split out like this so that the parser that compiles the 00:38:42.930 00:20:41.431 275 # list of all tests can properly differentiate them. Please do not merge them into one line. 00:38:42.930 00:20:41.431 276 if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then 00:38:42.930 00:20:41.431 => 277 run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.930 00:20:41.431 278 run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.930 00:20:41.431 279 elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then 00:38:42.930 00:20:41.431 280 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.930 00:20:41.431 281 if [[ $SPDK_TEST_URING -eq 0 ]]; then 00:38:42.930 00:20:41.431 282 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.930 00:20:41.431 ... 00:38:42.930 00:20:41.431 00:38:42.930 00:20:41.431 ========== Backtrace end ========== ]] 00:38:42.930 + echo '00:20:33.843 ========== Backtrace start: ========== 00:38:42.930 00:20:33.843 00:38:42.930 00:20:33.843 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/auth.sh:128 -> main(["--transport=rdma"]) 00:38:42.930 00:20:33.843 ... 00:38:42.930 00:20:33.843 123 NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.930 00:20:33.844 124 -a "$NVMF_FIRST_INITIATOR_IP" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.930 00:20:33.844 125 --dhchap-key "key1" --dhchap-ctrlr-key "ckey2" 00:38:42.930 00:20:33.844 126 00:38:42.930 00:20:33.844 127 # Check reauthentication 00:38:42.930 00:20:33.844 => 128 rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.930 00:20:33.844 129 -a "$(get_main_ns_ip)" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.930 00:20:33.844 130 --dhchap-key "key1" --dhchap-ctrlr-key "ckey1" --ctrlr-loss-timeout-sec 1 \ 00:38:42.930 00:20:33.844 131 --reconnect-delay-sec 1 00:38:42.930 00:20:33.844 132 nvmet_auth_set_key "sha256" "ffdhe2048" 2 00:38:42.930 00:20:33.844 133 rpc_cmd bdev_nvme_set_keys "nvme0" --dhchap-key "key2" --dhchap-ctrlr-key "ckey2" 00:38:42.930 00:20:33.844 ... 00:38:42.930 00:20:33.844 00:38:42.930 00:20:33.844 ========== Backtrace end ========== 00:38:42.930 00:20:33.844 ========== Backtrace start: ========== 00:38:42.930 00:20:33.844 00:38:42.930 00:20:33.844 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:589 -> rpc_cmd(["bdev_nvme_attach_controller"],["-b"],["nvme0"],["-t"],["rdma"],["-f"],["ipv4"],["-a"],[""],["-s"],["4420"],["-q"],["nqn.2024-02.io.spdk:host0"],["-n"],["nqn.2024-02.io.spdk:cnode0"],["--dhchap-key"],["key1"],["--dhchap-ctrlr-key"],["ckey1"],["--ctrlr-loss-timeout-sec"],["1"],["--reconnect-delay-sec"],["1"]) 00:38:42.930 00:20:33.844 ... 00:38:42.930 00:20:33.844 584 echo "$rsp" 00:38:42.930 00:20:33.844 585 done 00:38:42.930 00:20:33.844 586 00:38:42.930 00:20:33.844 587 rc=${!status[*]} 00:38:42.930 00:20:33.844 588 xtrace_restore 00:38:42.930 00:20:33.844 => 589 [[ $rc == 0 ]] 00:38:42.930 00:20:33.844 590 } 00:38:42.930 00:20:33.844 591 00:38:42.930 00:20:33.844 592 function rpc_cmd_simple_data_json() { 00:38:42.930 00:20:33.844 593 00:38:42.930 00:20:33.844 594 local elems="$1[@]" elem 00:38:42.930 00:20:33.844 ... 00:38:42.930 00:20:33.844 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/auth.sh:128 -> main(["--transport=rdma"]) 00:38:42.930 00:20:33.844 ... 00:38:42.930 00:20:33.844 123 NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.930 00:20:33.844 124 -a "$NVMF_FIRST_INITIATOR_IP" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.930 00:20:33.844 125 --dhchap-key "key1" --dhchap-ctrlr-key "ckey2" 00:38:42.930 00:20:33.844 126 00:38:42.930 00:20:33.844 127 # Check reauthentication 00:38:42.930 00:20:33.844 => 128 rpc_cmd bdev_nvme_attach_controller -b nvme0 -t "$TEST_TRANSPORT" -f ipv4 \ 00:38:42.930 00:20:33.844 129 -a "$(get_main_ns_ip)" -s "$NVMF_PORT" -q "$hostnqn" -n "$subnqn" \ 00:38:42.930 00:20:33.844 130 --dhchap-key "key1" --dhchap-ctrlr-key "ckey1" --ctrlr-loss-timeout-sec 1 \ 00:38:42.930 00:20:33.844 131 --reconnect-delay-sec 1 00:38:42.930 00:20:33.844 132 nvmet_auth_set_key "sha256" "ffdhe2048" 2 00:38:42.930 00:20:33.844 133 rpc_cmd bdev_nvme_set_keys "nvme0" --dhchap-key "key2" --dhchap-ctrlr-key "ckey2" 00:38:42.930 00:20:33.844 ... 00:38:42.930 00:20:33.844 00:38:42.930 00:20:33.844 ========== Backtrace end ========== 00:38:42.930 00:20:41.170 ========== Backtrace start: ========== 00:38:42.930 00:20:41.170 00:38:42.930 00:20:41.430 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_auth_host"],["/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/auth.sh"],["--transport=rdma"]) 00:38:42.930 00:20:41.430 ... 00:38:42.930 00:20:41.430 1120 timing_enter $test_name 00:38:42.930 00:20:41.430 1121 echo "************************************" 00:38:42.930 00:20:41.430 1122 echo "START TEST $test_name" 00:38:42.930 00:20:41.430 1123 echo "************************************" 00:38:42.930 00:20:41.430 1124 xtrace_restore 00:38:42.930 00:20:41.430 1125 time "$@" 00:38:42.930 00:20:41.430 1126 xtrace_disable 00:38:42.930 00:20:41.430 1127 echo "************************************" 00:38:42.930 00:20:41.430 1128 echo "END TEST $test_name" 00:38:42.930 00:20:41.430 1129 echo "************************************" 00:38:42.930 00:20:41.430 1130 timing_exit $test_name 00:38:42.930 00:20:41.430 ... 00:38:42.930 00:20:41.430 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf_host.sh:27 -> main(["--transport=rdma"]) 00:38:42.930 00:20:41.430 ... 00:38:42.930 00:20:41.430 22 run_test "nvmf_fio_host" $rootdir/test/nvmf/host/fio.sh "${TEST_ARGS[@]}" 00:38:42.930 00:20:41.430 23 run_test "nvmf_failover" $rootdir/test/nvmf/host/failover.sh "${TEST_ARGS[@]}" 00:38:42.930 00:20:41.430 24 run_test "nvmf_host_multipath_status" $rootdir/test/nvmf/host/multipath_status.sh "${TEST_ARGS[@]}" 00:38:42.930 00:20:41.430 25 run_test "nvmf_discovery_remove_ifc" $rootdir/test/nvmf/host/discovery_remove_ifc.sh "${TEST_ARGS[@]}" 00:38:42.930 00:20:41.430 26 run_test "nvmf_identify_kernel_target" "$rootdir/test/nvmf/host/identify_kernel_nvmf.sh" "${TEST_ARGS[@]}" 00:38:42.930 00:20:41.430 => 27 run_test "nvmf_auth_host" "$rootdir/test/nvmf/host/auth.sh" "${TEST_ARGS[@]}" 00:38:42.930 00:20:41.430 28 run_test "nvmf_bdevperf" "$rootdir/test/nvmf/host/bdevperf.sh" "${TEST_ARGS[@]}" 00:38:42.930 00:20:41.430 29 run_test "nvmf_target_disconnect" "$rootdir/test/nvmf/host/target_disconnect.sh" "${TEST_ARGS[@]}" 00:38:42.930 00:20:41.430 30 00:38:42.930 00:20:41.430 31 if [[ "$SPDK_TEST_NVMF_TRANSPORT" == "tcp" ]]; then 00:38:42.930 00:20:41.430 32 run_test "nvmf_digest" "$rootdir/test/nvmf/host/digest.sh" "${TEST_ARGS[@]}" 00:38:42.930 00:20:41.430 ... 00:38:42.930 00:20:41.430 00:38:42.930 00:20:41.430 ========== Backtrace end ========== 00:38:42.930 00:20:41.430 ========== Backtrace start: ========== 00:38:42.930 00:20:41.430 00:38:42.930 00:20:41.430 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_host"],["/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf_host.sh"],["--transport=rdma"]) 00:38:42.930 00:20:41.430 ... 00:38:42.930 00:20:41.430 1120 timing_enter $test_name 00:38:42.930 00:20:41.430 1121 echo "************************************" 00:38:42.930 00:20:41.430 1122 echo "START TEST $test_name" 00:38:42.930 00:20:41.430 1123 echo "************************************" 00:38:42.930 00:20:41.430 1124 xtrace_restore 00:38:42.930 00:20:41.430 1125 time "$@" 00:38:42.930 00:20:41.430 1126 xtrace_disable 00:38:42.930 00:20:41.430 1127 echo "************************************" 00:38:42.930 00:20:41.430 1128 echo "END TEST $test_name" 00:38:42.930 00:20:41.430 1129 echo "************************************" 00:38:42.930 00:20:41.430 1130 timing_exit $test_name 00:38:42.930 00:20:41.430 ... 00:38:42.930 00:20:41.430 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh:12 -> main(["--transport=rdma"]) 00:38:42.930 00:20:41.430 ... 00:38:42.930 00:20:41.430 7 rootdir=$(readlink -f $testdir/../..) 00:38:42.930 00:20:41.430 8 source $rootdir/test/common/autotest_common.sh 00:38:42.930 00:20:41.430 9 00:38:42.930 00:20:41.430 10 run_test "nvmf_target_core" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.930 00:20:41.430 11 run_test "nvmf_target_extra" $rootdir/test/nvmf/nvmf_target_extra.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.930 00:20:41.430 => 12 run_test "nvmf_host" $rootdir/test/nvmf/nvmf_host.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.930 00:20:41.430 13 00:38:42.930 00:20:41.430 14 # Interrupt mode for now is supported only on the target, with the TCP transport and posix or ssl socket implementations. 00:38:42.930 00:20:41.430 15 if [[ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" && $SPDK_TEST_URING -eq 0 ]]; then 00:38:42.930 00:20:41.430 16 run_test "nvmf_target_core_interrupt_mode" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT --interrupt-mode 00:38:42.931 00:20:41.430 17 run_test "nvmf_interrupt" $rootdir/test/nvmf/target/interrupt.sh --transport=$SPDK_TEST_NVMF_TRANSPORT --interrupt-mode 00:38:42.931 00:20:41.430 ... 00:38:42.931 00:20:41.430 00:38:42.931 00:20:41.430 ========== Backtrace end ========== 00:38:42.931 00:20:41.431 ========== Backtrace start: ========== 00:38:42.931 00:20:41.431 00:38:42.931 00:20:41.431 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_rdma"],["/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh"],["--transport=rdma"]) 00:38:42.931 00:20:41.431 ... 00:38:42.931 00:20:41.431 1120 timing_enter $test_name 00:38:42.931 00:20:41.431 1121 echo "************************************" 00:38:42.931 00:20:41.431 1122 echo "START TEST $test_name" 00:38:42.931 00:20:41.431 1123 echo "************************************" 00:38:42.931 00:20:41.431 1124 xtrace_restore 00:38:42.931 00:20:41.431 1125 time "$@" 00:38:42.931 00:20:41.431 1126 xtrace_disable 00:38:42.931 00:20:41.431 1127 echo "************************************" 00:38:42.931 00:20:41.431 1128 echo "END TEST $test_name" 00:38:42.931 00:20:41.431 1129 echo "************************************" 00:38:42.931 00:20:41.431 1130 timing_exit $test_name 00:38:42.931 00:20:41.431 ... 00:38:42.931 00:20:41.431 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/autotest.sh:277 -> main(["/var/jenkins/workspace/nvmf-phy-autotest/autorun-spdk.conf"]) 00:38:42.931 00:20:41.431 ... 00:38:42.931 00:20:41.431 272 if [ $SPDK_TEST_NVMF -eq 1 ]; then 00:38:42.931 00:20:41.431 273 export NET_TYPE 00:38:42.931 00:20:41.431 274 # The NVMe-oF run test cases are split out like this so that the parser that compiles the 00:38:42.931 00:20:41.431 275 # list of all tests can properly differentiate them. Please do not merge them into one line. 00:38:42.931 00:20:41.431 276 if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then 00:38:42.931 00:20:41.431 => 277 run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.931 00:20:41.431 278 run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.931 00:20:41.431 279 elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then 00:38:42.931 00:20:41.431 280 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.931 00:20:41.431 281 if [[ $SPDK_TEST_URING -eq 0 ]]; then 00:38:42.931 00:20:41.431 282 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:38:42.931 00:20:41.431 ... 00:38:42.931 00:20:41.431 00:38:42.931 00:20:41.431 ========== Backtrace end ==========' 00:38:42.931 + for build in "${build_log_list[@]}" 00:38:42.931 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_2/release-build-clang-docker-autotest_2438/build.log 00:38:42.931 + local build_log job_name start_pattern end_pattern backtraces 00:38:42.931 + build_log=/var/jenkins/workspace/autotest-per-patch_2/release-build-clang-docker-autotest_2438/build.log 00:38:42.931 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/release-build-clang-docker-autotest_2438/build.log 00:38:42.931 ++ basename /var/jenkins/workspace/autotest-per-patch_2/release-build-clang-docker-autotest_2438 00:38:42.931 + job_name=release-build-clang-docker-autotest_2438 00:38:42.931 + start_pattern='Backtrace start' 00:38:42.931 + end_pattern='Backtrace end' 00:38:42.931 + [[ -f /var/jenkins/workspace/autotest-per-patch_2/release-build-clang-docker-autotest_2438/build.log ]] 00:38:42.931 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_2/release-build-clang-docker-autotest_2438/build.log 00:38:42.931 + backtraces= 00:38:42.931 + [[ -n '' ]] 00:38:42.931 + for build in "${build_log_list[@]}" 00:38:42.931 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_2/unittest-clang-docker-autotest_29219/build.log 00:38:42.931 + local build_log job_name start_pattern end_pattern backtraces 00:38:42.931 + build_log=/var/jenkins/workspace/autotest-per-patch_2/unittest-clang-docker-autotest_29219/build.log 00:38:42.931 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/unittest-clang-docker-autotest_29219/build.log 00:38:42.931 ++ basename /var/jenkins/workspace/autotest-per-patch_2/unittest-clang-docker-autotest_29219 00:38:42.931 + job_name=unittest-clang-docker-autotest_29219 00:38:42.931 + start_pattern='Backtrace start' 00:38:42.931 + end_pattern='Backtrace end' 00:38:42.931 + [[ -f /var/jenkins/workspace/autotest-per-patch_2/unittest-clang-docker-autotest_29219/build.log ]] 00:38:42.931 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_2/unittest-clang-docker-autotest_29219/build.log 00:38:42.931 + backtraces= 00:38:42.931 + [[ -n '' ]] 00:38:42.931 + for build in "${build_log_list[@]}" 00:38:42.931 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_2/vhost-phy-autotest_37630/build.log 00:38:42.931 + local build_log job_name start_pattern end_pattern backtraces 00:38:42.931 + build_log=/var/jenkins/workspace/autotest-per-patch_2/vhost-phy-autotest_37630/build.log 00:38:42.931 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/vhost-phy-autotest_37630/build.log 00:38:42.931 ++ basename /var/jenkins/workspace/autotest-per-patch_2/vhost-phy-autotest_37630 00:38:42.931 + job_name=vhost-phy-autotest_37630 00:38:42.931 + start_pattern='Backtrace start' 00:38:42.931 + end_pattern='Backtrace end' 00:38:42.931 + [[ -f /var/jenkins/workspace/autotest-per-patch_2/vhost-phy-autotest_37630/build.log ]] 00:38:42.931 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_2/vhost-phy-autotest_37630/build.log 00:38:42.931 + backtraces= 00:38:42.931 + [[ -n '' ]] 00:38:42.931 + for build in "${build_log_list[@]}" 00:38:42.931 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_2/check-so-deps-docker-autotest_32628/build.log 00:38:42.931 + local build_log job_name start_pattern end_pattern backtraces 00:38:42.931 + build_log=/var/jenkins/workspace/autotest-per-patch_2/check-so-deps-docker-autotest_32628/build.log 00:38:42.931 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/check-so-deps-docker-autotest_32628/build.log 00:38:42.931 ++ basename /var/jenkins/workspace/autotest-per-patch_2/check-so-deps-docker-autotest_32628 00:38:42.931 + job_name=check-so-deps-docker-autotest_32628 00:38:42.931 + start_pattern='Backtrace start' 00:38:42.931 + end_pattern='Backtrace end' 00:38:42.931 + [[ -f /var/jenkins/workspace/autotest-per-patch_2/check-so-deps-docker-autotest_32628/build.log ]] 00:38:42.931 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_2/check-so-deps-docker-autotest_32628/build.log 00:38:42.931 + backtraces= 00:38:42.931 + [[ -n '' ]] 00:38:42.931 + for build in "${build_log_list[@]}" 00:38:42.931 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_2/build-files-docker-autotest_32381/build.log 00:38:42.931 + local build_log job_name start_pattern end_pattern backtraces 00:38:42.931 + build_log=/var/jenkins/workspace/autotest-per-patch_2/build-files-docker-autotest_32381/build.log 00:38:42.931 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/build-files-docker-autotest_32381/build.log 00:38:42.931 ++ basename /var/jenkins/workspace/autotest-per-patch_2/build-files-docker-autotest_32381 00:38:42.931 + job_name=build-files-docker-autotest_32381 00:38:42.931 + start_pattern='Backtrace start' 00:38:42.931 + end_pattern='Backtrace end' 00:38:42.931 + [[ -f /var/jenkins/workspace/autotest-per-patch_2/build-files-docker-autotest_32381/build.log ]] 00:38:42.931 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_2/build-files-docker-autotest_32381/build.log 00:38:42.931 + backtraces= 00:38:42.931 + [[ -n '' ]] 00:38:42.931 + for build in "${build_log_list[@]}" 00:38:42.931 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_2/check-format-docker-autotest_32407/build.log 00:38:42.931 + local build_log job_name start_pattern end_pattern backtraces 00:38:42.931 + build_log=/var/jenkins/workspace/autotest-per-patch_2/check-format-docker-autotest_32407/build.log 00:38:42.931 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/check-format-docker-autotest_32407/build.log 00:38:42.931 ++ basename /var/jenkins/workspace/autotest-per-patch_2/check-format-docker-autotest_32407 00:38:42.931 + job_name=check-format-docker-autotest_32407 00:38:42.931 + start_pattern='Backtrace start' 00:38:42.931 + end_pattern='Backtrace end' 00:38:42.931 + [[ -f /var/jenkins/workspace/autotest-per-patch_2/check-format-docker-autotest_32407/build.log ]] 00:38:42.931 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_2/check-format-docker-autotest_32407/build.log 00:38:42.931 + backtraces= 00:38:42.931 + [[ -n '' ]] 00:38:42.931 + for build in "${build_log_list[@]}" 00:38:42.931 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_2/iscsi-uring-vg-autotest_89735/build.log 00:38:42.931 + local build_log job_name start_pattern end_pattern backtraces 00:38:42.931 + build_log=/var/jenkins/workspace/autotest-per-patch_2/iscsi-uring-vg-autotest_89735/build.log 00:38:42.931 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/iscsi-uring-vg-autotest_89735/build.log 00:38:42.931 ++ basename /var/jenkins/workspace/autotest-per-patch_2/iscsi-uring-vg-autotest_89735 00:38:42.931 + job_name=iscsi-uring-vg-autotest_89735 00:38:42.931 + start_pattern='Backtrace start' 00:38:42.931 + end_pattern='Backtrace end' 00:38:42.931 + [[ -f /var/jenkins/workspace/autotest-per-patch_2/iscsi-uring-vg-autotest_89735/build.log ]] 00:38:42.931 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_2/iscsi-uring-vg-autotest_89735/build.log 00:38:42.931 + backtraces= 00:38:42.931 + [[ -n '' ]] 00:38:42.931 + for build in "${build_log_list[@]}" 00:38:42.931 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_2/iscsi-vg-autotest_89871/build.log 00:38:42.931 + local build_log job_name start_pattern end_pattern backtraces 00:38:42.931 + build_log=/var/jenkins/workspace/autotest-per-patch_2/iscsi-vg-autotest_89871/build.log 00:38:42.931 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/iscsi-vg-autotest_89871/build.log 00:38:42.931 ++ basename /var/jenkins/workspace/autotest-per-patch_2/iscsi-vg-autotest_89871 00:38:42.931 + job_name=iscsi-vg-autotest_89871 00:38:42.931 + start_pattern='Backtrace start' 00:38:42.931 + end_pattern='Backtrace end' 00:38:42.931 + [[ -f /var/jenkins/workspace/autotest-per-patch_2/iscsi-vg-autotest_89871/build.log ]] 00:38:42.931 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_2/iscsi-vg-autotest_89871/build.log 00:38:42.931 + backtraces= 00:38:42.931 + [[ -n '' ]] 00:38:42.931 + for build in "${build_log_list[@]}" 00:38:42.931 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_2/packaging-docker-autotest_29219/build.log 00:38:42.931 + local build_log job_name start_pattern end_pattern backtraces 00:38:42.931 + build_log=/var/jenkins/workspace/autotest-per-patch_2/packaging-docker-autotest_29219/build.log 00:38:42.931 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/packaging-docker-autotest_29219/build.log 00:38:42.931 ++ basename /var/jenkins/workspace/autotest-per-patch_2/packaging-docker-autotest_29219 00:38:42.931 + job_name=packaging-docker-autotest_29219 00:38:42.931 + start_pattern='Backtrace start' 00:38:42.931 + end_pattern='Backtrace end' 00:38:42.931 + [[ -f /var/jenkins/workspace/autotest-per-patch_2/packaging-docker-autotest_29219/build.log ]] 00:38:42.931 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_2/packaging-docker-autotest_29219/build.log 00:38:42.931 + backtraces= 00:38:42.931 + [[ -n '' ]] 00:38:42.931 + for build in "${build_log_list[@]}" 00:38:42.932 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_2/vfio-user-phy-autotest_37570/build.log 00:38:42.932 + local build_log job_name start_pattern end_pattern backtraces 00:38:42.932 + build_log=/var/jenkins/workspace/autotest-per-patch_2/vfio-user-phy-autotest_37570/build.log 00:38:42.932 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/vfio-user-phy-autotest_37570/build.log 00:38:42.932 ++ basename /var/jenkins/workspace/autotest-per-patch_2/vfio-user-phy-autotest_37570 00:38:42.932 + job_name=vfio-user-phy-autotest_37570 00:38:42.932 + start_pattern='Backtrace start' 00:38:42.932 + end_pattern='Backtrace end' 00:38:42.932 + [[ -f /var/jenkins/workspace/autotest-per-patch_2/vfio-user-phy-autotest_37570/build.log ]] 00:38:42.932 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_2/vfio-user-phy-autotest_37570/build.log 00:38:42.932 + backtraces= 00:38:42.932 + [[ -n '' ]] 00:38:42.932 + run_flamegraph 00:38:42.932 + create_timing_file 00:38:42.932 + local array file 00:38:42.932 + array=($(find $WORKSPACE -type f -name 'timing.txt')) 00:38:42.932 ++ find /var/jenkins/workspace/autotest-per-patch_2 -type f -name timing.txt 00:38:42.932 + timing_dir=/var/jenkins/workspace/autotest-per-patch_2/post_process 00:38:42.932 + mkdir -p /var/jenkins/workspace/autotest-per-patch_2/post_process 00:38:42.932 + timing_file=/var/jenkins/workspace/autotest-per-patch_2/post_process/total_timing.txt 00:38:42.932 + for file in "${array[@]}" 00:38:42.932 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_2/lvol-vg-autotest_89783/timing.txt 00:38:42.932 + local job_file job_name 00:38:42.932 + job_file=/var/jenkins/workspace/autotest-per-patch_2/lvol-vg-autotest_89783/timing.txt 00:38:42.932 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/lvol-vg-autotest_89783/timing.txt 00:38:42.932 ++ basename /var/jenkins/workspace/autotest-per-patch_2/lvol-vg-autotest_89783 00:38:42.932 + job_name=lvol-vg-autotest_89783 00:38:42.932 + sed 's/^/lvol-vg-autotest_89783;autorun;/' /var/jenkins/workspace/autotest-per-patch_2/lvol-vg-autotest_89783/timing.txt 00:38:42.932 + for file in "${array[@]}" 00:38:42.932 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_2/vhost-initiator-vg-autotest_89852/timing.txt 00:38:42.932 + local job_file job_name 00:38:42.932 + job_file=/var/jenkins/workspace/autotest-per-patch_2/vhost-initiator-vg-autotest_89852/timing.txt 00:38:42.932 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/vhost-initiator-vg-autotest_89852/timing.txt 00:38:42.932 ++ basename /var/jenkins/workspace/autotest-per-patch_2/vhost-initiator-vg-autotest_89852 00:38:42.932 + job_name=vhost-initiator-vg-autotest_89852 00:38:42.932 + sed 's/^/vhost-initiator-vg-autotest_89852;autorun;/' /var/jenkins/workspace/autotest-per-patch_2/vhost-initiator-vg-autotest_89852/timing.txt 00:38:42.932 + for file in "${array[@]}" 00:38:42.932 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_2/unittest-main-docker-autotest_29221/timing.txt 00:38:42.932 + local job_file job_name 00:38:42.932 + job_file=/var/jenkins/workspace/autotest-per-patch_2/unittest-main-docker-autotest_29221/timing.txt 00:38:42.932 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/unittest-main-docker-autotest_29221/timing.txt 00:38:42.932 ++ basename /var/jenkins/workspace/autotest-per-patch_2/unittest-main-docker-autotest_29221 00:38:42.932 + job_name=unittest-main-docker-autotest_29221 00:38:42.932 + sed 's/^/unittest-main-docker-autotest_29221;autorun;/' /var/jenkins/workspace/autotest-per-patch_2/unittest-main-docker-autotest_29221/timing.txt 00:38:42.932 + for file in "${array[@]}" 00:38:42.932 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_2/ubuntu24-vg-autotest_6432/timing.txt 00:38:42.932 + local job_file job_name 00:38:42.932 + job_file=/var/jenkins/workspace/autotest-per-patch_2/ubuntu24-vg-autotest_6432/timing.txt 00:38:42.932 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/ubuntu24-vg-autotest_6432/timing.txt 00:38:42.932 ++ basename /var/jenkins/workspace/autotest-per-patch_2/ubuntu24-vg-autotest_6432 00:38:42.932 + job_name=ubuntu24-vg-autotest_6432 00:38:42.932 + sed 's/^/ubuntu24-vg-autotest_6432;autorun;/' /var/jenkins/workspace/autotest-per-patch_2/ubuntu24-vg-autotest_6432/timing.txt 00:38:42.932 + for file in "${array[@]}" 00:38:42.932 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_2/nvme-cmb-pmr-vg-autotest_90959/timing.txt 00:38:42.932 + local job_file job_name 00:38:42.932 + job_file=/var/jenkins/workspace/autotest-per-patch_2/nvme-cmb-pmr-vg-autotest_90959/timing.txt 00:38:42.932 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/nvme-cmb-pmr-vg-autotest_90959/timing.txt 00:38:42.932 ++ basename /var/jenkins/workspace/autotest-per-patch_2/nvme-cmb-pmr-vg-autotest_90959 00:38:42.932 + job_name=nvme-cmb-pmr-vg-autotest_90959 00:38:42.932 + sed 's/^/nvme-cmb-pmr-vg-autotest_90959;autorun;/' /var/jenkins/workspace/autotest-per-patch_2/nvme-cmb-pmr-vg-autotest_90959/timing.txt 00:38:42.932 + for file in "${array[@]}" 00:38:42.932 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_2/nvme-phy-autotest_83736/timing.txt 00:38:42.932 + local job_file job_name 00:38:42.932 + job_file=/var/jenkins/workspace/autotest-per-patch_2/nvme-phy-autotest_83736/timing.txt 00:38:42.932 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/nvme-phy-autotest_83736/timing.txt 00:38:42.932 ++ basename /var/jenkins/workspace/autotest-per-patch_2/nvme-phy-autotest_83736 00:38:42.932 + job_name=nvme-phy-autotest_83736 00:38:42.932 + sed 's/^/nvme-phy-autotest_83736;autorun;/' /var/jenkins/workspace/autotest-per-patch_2/nvme-phy-autotest_83736/timing.txt 00:38:42.932 + for file in "${array[@]}" 00:38:42.932 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_2/unittest-valgrind-docker-autotest_29224/timing.txt 00:38:42.932 + local job_file job_name 00:38:42.932 + job_file=/var/jenkins/workspace/autotest-per-patch_2/unittest-valgrind-docker-autotest_29224/timing.txt 00:38:42.932 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/unittest-valgrind-docker-autotest_29224/timing.txt 00:38:42.932 ++ basename /var/jenkins/workspace/autotest-per-patch_2/unittest-valgrind-docker-autotest_29224 00:38:42.932 + job_name=unittest-valgrind-docker-autotest_29224 00:38:42.932 + sed 's/^/unittest-valgrind-docker-autotest_29224;autorun;/' /var/jenkins/workspace/autotest-per-patch_2/unittest-valgrind-docker-autotest_29224/timing.txt 00:38:42.932 + for file in "${array[@]}" 00:38:42.932 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_2/freebsd-vg-autotest_68080/timing.txt 00:38:42.932 + local job_file job_name 00:38:42.932 + job_file=/var/jenkins/workspace/autotest-per-patch_2/freebsd-vg-autotest_68080/timing.txt 00:38:42.932 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/freebsd-vg-autotest_68080/timing.txt 00:38:42.932 ++ basename /var/jenkins/workspace/autotest-per-patch_2/freebsd-vg-autotest_68080 00:38:42.932 + job_name=freebsd-vg-autotest_68080 00:38:42.932 + sed 's/^/freebsd-vg-autotest_68080;autorun;/' /var/jenkins/workspace/autotest-per-patch_2/freebsd-vg-autotest_68080/timing.txt 00:38:42.932 + for file in "${array[@]}" 00:38:42.932 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_2/autobuild-external-vg-autotest_29843/timing.txt 00:38:42.932 + local job_file job_name 00:38:42.932 + job_file=/var/jenkins/workspace/autotest-per-patch_2/autobuild-external-vg-autotest_29843/timing.txt 00:38:42.932 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/autobuild-external-vg-autotest_29843/timing.txt 00:38:42.932 ++ basename /var/jenkins/workspace/autotest-per-patch_2/autobuild-external-vg-autotest_29843 00:38:42.932 + job_name=autobuild-external-vg-autotest_29843 00:38:42.932 + sed 's/^/autobuild-external-vg-autotest_29843;autorun;/' /var/jenkins/workspace/autotest-per-patch_2/autobuild-external-vg-autotest_29843/timing.txt 00:38:42.932 + for file in "${array[@]}" 00:38:42.932 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_2/nvme-vg-autotest_89834/timing.txt 00:38:42.932 + local job_file job_name 00:38:42.932 + job_file=/var/jenkins/workspace/autotest-per-patch_2/nvme-vg-autotest_89834/timing.txt 00:38:42.932 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/nvme-vg-autotest_89834/timing.txt 00:38:42.932 ++ basename /var/jenkins/workspace/autotest-per-patch_2/nvme-vg-autotest_89834 00:38:42.932 + job_name=nvme-vg-autotest_89834 00:38:42.932 + sed 's/^/nvme-vg-autotest_89834;autorun;/' /var/jenkins/workspace/autotest-per-patch_2/nvme-vg-autotest_89834/timing.txt 00:38:42.932 + for file in "${array[@]}" 00:38:42.932 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_2/nvmf-tcp-vg-autotest_89816/timing.txt 00:38:42.932 + local job_file job_name 00:38:42.932 + job_file=/var/jenkins/workspace/autotest-per-patch_2/nvmf-tcp-vg-autotest_89816/timing.txt 00:38:42.932 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/nvmf-tcp-vg-autotest_89816/timing.txt 00:38:42.932 ++ basename /var/jenkins/workspace/autotest-per-patch_2/nvmf-tcp-vg-autotest_89816 00:38:42.932 + job_name=nvmf-tcp-vg-autotest_89816 00:38:42.932 + sed 's/^/nvmf-tcp-vg-autotest_89816;autorun;/' /var/jenkins/workspace/autotest-per-patch_2/nvmf-tcp-vg-autotest_89816/timing.txt 00:38:42.932 + for file in "${array[@]}" 00:38:42.932 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_2/release-build-main-docker-autotest_2438/timing.txt 00:38:42.932 + local job_file job_name 00:38:42.932 + job_file=/var/jenkins/workspace/autotest-per-patch_2/release-build-main-docker-autotest_2438/timing.txt 00:38:42.932 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/release-build-main-docker-autotest_2438/timing.txt 00:38:42.932 ++ basename /var/jenkins/workspace/autotest-per-patch_2/release-build-main-docker-autotest_2438 00:38:42.932 + job_name=release-build-main-docker-autotest_2438 00:38:42.932 + sed 's/^/release-build-main-docker-autotest_2438;autorun;/' /var/jenkins/workspace/autotest-per-patch_2/release-build-main-docker-autotest_2438/timing.txt 00:38:42.932 + for file in "${array[@]}" 00:38:42.932 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_2/doc-docker-autotest_32710/timing.txt 00:38:42.932 + local job_file job_name 00:38:42.932 + job_file=/var/jenkins/workspace/autotest-per-patch_2/doc-docker-autotest_32710/timing.txt 00:38:42.932 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/doc-docker-autotest_32710/timing.txt 00:38:42.932 ++ basename /var/jenkins/workspace/autotest-per-patch_2/doc-docker-autotest_32710 00:38:42.932 + job_name=doc-docker-autotest_32710 00:38:42.932 + sed 's/^/doc-docker-autotest_32710;autorun;/' /var/jenkins/workspace/autotest-per-patch_2/doc-docker-autotest_32710/timing.txt 00:38:42.932 + for file in "${array[@]}" 00:38:42.932 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_2/raid-vg-autotest_4568/timing.txt 00:38:42.932 + local job_file job_name 00:38:42.932 + job_file=/var/jenkins/workspace/autotest-per-patch_2/raid-vg-autotest_4568/timing.txt 00:38:42.932 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/raid-vg-autotest_4568/timing.txt 00:38:42.932 ++ basename /var/jenkins/workspace/autotest-per-patch_2/raid-vg-autotest_4568 00:38:42.932 + job_name=raid-vg-autotest_4568 00:38:42.932 + sed 's/^/raid-vg-autotest_4568;autorun;/' /var/jenkins/workspace/autotest-per-patch_2/raid-vg-autotest_4568/timing.txt 00:38:42.932 + for file in "${array[@]}" 00:38:42.933 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_2/scan-build-docker-autotest_29226/timing.txt 00:38:42.933 + local job_file job_name 00:38:42.933 + job_file=/var/jenkins/workspace/autotest-per-patch_2/scan-build-docker-autotest_29226/timing.txt 00:38:42.933 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/scan-build-docker-autotest_29226/timing.txt 00:38:42.933 ++ basename /var/jenkins/workspace/autotest-per-patch_2/scan-build-docker-autotest_29226 00:38:42.933 + job_name=scan-build-docker-autotest_29226 00:38:42.933 + sed 's/^/scan-build-docker-autotest_29226;autorun;/' /var/jenkins/workspace/autotest-per-patch_2/scan-build-docker-autotest_29226/timing.txt 00:38:42.933 + for file in "${array[@]}" 00:38:42.933 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_2/nvmf-tcp-uring-vg-autotest_89777/timing.txt 00:38:42.933 + local job_file job_name 00:38:42.933 + job_file=/var/jenkins/workspace/autotest-per-patch_2/nvmf-tcp-uring-vg-autotest_89777/timing.txt 00:38:42.933 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/nvmf-tcp-uring-vg-autotest_89777/timing.txt 00:38:42.933 ++ basename /var/jenkins/workspace/autotest-per-patch_2/nvmf-tcp-uring-vg-autotest_89777 00:38:42.933 + job_name=nvmf-tcp-uring-vg-autotest_89777 00:38:42.933 + sed 's/^/nvmf-tcp-uring-vg-autotest_89777;autorun;/' /var/jenkins/workspace/autotest-per-patch_2/nvmf-tcp-uring-vg-autotest_89777/timing.txt 00:38:42.933 + for file in "${array[@]}" 00:38:42.933 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_2/short-fuzz-phy-autotest_37565/timing.txt 00:38:42.933 + local job_file job_name 00:38:42.933 + job_file=/var/jenkins/workspace/autotest-per-patch_2/short-fuzz-phy-autotest_37565/timing.txt 00:38:42.933 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/short-fuzz-phy-autotest_37565/timing.txt 00:38:42.933 ++ basename /var/jenkins/workspace/autotest-per-patch_2/short-fuzz-phy-autotest_37565 00:38:42.933 + job_name=short-fuzz-phy-autotest_37565 00:38:42.933 + sed 's/^/short-fuzz-phy-autotest_37565;autorun;/' /var/jenkins/workspace/autotest-per-patch_2/short-fuzz-phy-autotest_37565/timing.txt 00:38:42.933 + for file in "${array[@]}" 00:38:42.933 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_2/rocky9-vg-autotest_27174/timing.txt 00:38:42.933 + local job_file job_name 00:38:42.933 + job_file=/var/jenkins/workspace/autotest-per-patch_2/rocky9-vg-autotest_27174/timing.txt 00:38:42.933 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/rocky9-vg-autotest_27174/timing.txt 00:38:42.933 ++ basename /var/jenkins/workspace/autotest-per-patch_2/rocky9-vg-autotest_27174 00:38:42.933 + job_name=rocky9-vg-autotest_27174 00:38:42.933 + sed 's/^/rocky9-vg-autotest_27174;autorun;/' /var/jenkins/workspace/autotest-per-patch_2/rocky9-vg-autotest_27174/timing.txt 00:38:42.933 + for file in "${array[@]}" 00:38:42.933 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_2/nvmf-tcp-phy-autotest_83694/timing.txt 00:38:42.933 + local job_file job_name 00:38:42.933 + job_file=/var/jenkins/workspace/autotest-per-patch_2/nvmf-tcp-phy-autotest_83694/timing.txt 00:38:42.933 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/nvmf-tcp-phy-autotest_83694/timing.txt 00:38:42.933 ++ basename /var/jenkins/workspace/autotest-per-patch_2/nvmf-tcp-phy-autotest_83694 00:38:42.933 + job_name=nvmf-tcp-phy-autotest_83694 00:38:42.933 + sed 's/^/nvmf-tcp-phy-autotest_83694;autorun;/' /var/jenkins/workspace/autotest-per-patch_2/nvmf-tcp-phy-autotest_83694/timing.txt 00:38:42.933 + for file in "${array[@]}" 00:38:42.933 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_2/zns-vg-autotest_88936/timing.txt 00:38:42.933 + local job_file job_name 00:38:42.933 + job_file=/var/jenkins/workspace/autotest-per-patch_2/zns-vg-autotest_88936/timing.txt 00:38:42.933 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/zns-vg-autotest_88936/timing.txt 00:38:42.933 ++ basename /var/jenkins/workspace/autotest-per-patch_2/zns-vg-autotest_88936 00:38:42.933 + job_name=zns-vg-autotest_88936 00:38:42.933 + sed 's/^/zns-vg-autotest_88936;autorun;/' /var/jenkins/workspace/autotest-per-patch_2/zns-vg-autotest_88936/timing.txt 00:38:42.933 + for file in "${array[@]}" 00:38:42.933 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_2/crypto-phy-autotest_37569/timing.txt 00:38:42.933 + local job_file job_name 00:38:42.933 + job_file=/var/jenkins/workspace/autotest-per-patch_2/crypto-phy-autotest_37569/timing.txt 00:38:42.933 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/crypto-phy-autotest_37569/timing.txt 00:38:42.933 ++ basename /var/jenkins/workspace/autotest-per-patch_2/crypto-phy-autotest_37569 00:38:42.933 + job_name=crypto-phy-autotest_37569 00:38:42.933 + sed 's/^/crypto-phy-autotest_37569;autorun;/' /var/jenkins/workspace/autotest-per-patch_2/crypto-phy-autotest_37569/timing.txt 00:38:42.933 + for file in "${array[@]}" 00:38:42.933 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_2/BlobFS-phy-autotest_37580/timing.txt 00:38:42.933 + local job_file job_name 00:38:42.933 + job_file=/var/jenkins/workspace/autotest-per-patch_2/BlobFS-phy-autotest_37580/timing.txt 00:38:42.933 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/BlobFS-phy-autotest_37580/timing.txt 00:38:42.933 ++ basename /var/jenkins/workspace/autotest-per-patch_2/BlobFS-phy-autotest_37580 00:38:42.933 + job_name=BlobFS-phy-autotest_37580 00:38:42.933 + sed 's/^/BlobFS-phy-autotest_37580;autorun;/' /var/jenkins/workspace/autotest-per-patch_2/BlobFS-phy-autotest_37580/timing.txt 00:38:42.933 + for file in "${array[@]}" 00:38:42.933 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_2/ubuntu22-vg-autotest_48871/timing.txt 00:38:42.933 + local job_file job_name 00:38:42.933 + job_file=/var/jenkins/workspace/autotest-per-patch_2/ubuntu22-vg-autotest_48871/timing.txt 00:38:42.933 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/ubuntu22-vg-autotest_48871/timing.txt 00:38:42.933 ++ basename /var/jenkins/workspace/autotest-per-patch_2/ubuntu22-vg-autotest_48871 00:38:42.933 + job_name=ubuntu22-vg-autotest_48871 00:38:42.933 + sed 's/^/ubuntu22-vg-autotest_48871;autorun;/' /var/jenkins/workspace/autotest-per-patch_2/ubuntu22-vg-autotest_48871/timing.txt 00:38:42.933 + for file in "${array[@]}" 00:38:42.933 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_2/nvmf-phy-autotest_83812/timing.txt 00:38:42.933 + local job_file job_name 00:38:42.933 + job_file=/var/jenkins/workspace/autotest-per-patch_2/nvmf-phy-autotest_83812/timing.txt 00:38:42.933 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/nvmf-phy-autotest_83812/timing.txt 00:38:42.933 ++ basename /var/jenkins/workspace/autotest-per-patch_2/nvmf-phy-autotest_83812 00:38:42.933 + job_name=nvmf-phy-autotest_83812 00:38:42.933 + sed 's/^/nvmf-phy-autotest_83812;autorun;/' /var/jenkins/workspace/autotest-per-patch_2/nvmf-phy-autotest_83812/timing.txt 00:38:42.933 + for file in "${array[@]}" 00:38:42.933 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_2/release-build-clang-docker-autotest_2438/timing.txt 00:38:42.933 + local job_file job_name 00:38:42.933 + job_file=/var/jenkins/workspace/autotest-per-patch_2/release-build-clang-docker-autotest_2438/timing.txt 00:38:42.933 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/release-build-clang-docker-autotest_2438/timing.txt 00:38:42.933 ++ basename /var/jenkins/workspace/autotest-per-patch_2/release-build-clang-docker-autotest_2438 00:38:42.933 + job_name=release-build-clang-docker-autotest_2438 00:38:42.933 + sed 's/^/release-build-clang-docker-autotest_2438;autorun;/' /var/jenkins/workspace/autotest-per-patch_2/release-build-clang-docker-autotest_2438/timing.txt 00:38:42.933 + for file in "${array[@]}" 00:38:42.933 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_2/unittest-clang-docker-autotest_29219/timing.txt 00:38:42.933 + local job_file job_name 00:38:42.933 + job_file=/var/jenkins/workspace/autotest-per-patch_2/unittest-clang-docker-autotest_29219/timing.txt 00:38:42.933 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/unittest-clang-docker-autotest_29219/timing.txt 00:38:42.933 ++ basename /var/jenkins/workspace/autotest-per-patch_2/unittest-clang-docker-autotest_29219 00:38:42.933 + job_name=unittest-clang-docker-autotest_29219 00:38:42.933 + sed 's/^/unittest-clang-docker-autotest_29219;autorun;/' /var/jenkins/workspace/autotest-per-patch_2/unittest-clang-docker-autotest_29219/timing.txt 00:38:42.933 + for file in "${array[@]}" 00:38:42.933 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_2/vhost-phy-autotest_37630/timing.txt 00:38:42.933 + local job_file job_name 00:38:42.933 + job_file=/var/jenkins/workspace/autotest-per-patch_2/vhost-phy-autotest_37630/timing.txt 00:38:42.933 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/vhost-phy-autotest_37630/timing.txt 00:38:42.933 ++ basename /var/jenkins/workspace/autotest-per-patch_2/vhost-phy-autotest_37630 00:38:42.933 + job_name=vhost-phy-autotest_37630 00:38:42.933 + sed 's/^/vhost-phy-autotest_37630;autorun;/' /var/jenkins/workspace/autotest-per-patch_2/vhost-phy-autotest_37630/timing.txt 00:38:42.933 + for file in "${array[@]}" 00:38:42.933 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_2/check-so-deps-docker-autotest_32628/timing.txt 00:38:42.933 + local job_file job_name 00:38:42.933 + job_file=/var/jenkins/workspace/autotest-per-patch_2/check-so-deps-docker-autotest_32628/timing.txt 00:38:42.933 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/check-so-deps-docker-autotest_32628/timing.txt 00:38:42.933 ++ basename /var/jenkins/workspace/autotest-per-patch_2/check-so-deps-docker-autotest_32628 00:38:42.933 + job_name=check-so-deps-docker-autotest_32628 00:38:42.933 + sed 's/^/check-so-deps-docker-autotest_32628;autorun;/' /var/jenkins/workspace/autotest-per-patch_2/check-so-deps-docker-autotest_32628/timing.txt 00:38:42.933 + for file in "${array[@]}" 00:38:42.933 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_2/build-files-docker-autotest_32381/timing.txt 00:38:42.933 + local job_file job_name 00:38:42.933 + job_file=/var/jenkins/workspace/autotest-per-patch_2/build-files-docker-autotest_32381/timing.txt 00:38:42.933 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/build-files-docker-autotest_32381/timing.txt 00:38:42.933 ++ basename /var/jenkins/workspace/autotest-per-patch_2/build-files-docker-autotest_32381 00:38:42.933 + job_name=build-files-docker-autotest_32381 00:38:42.933 + sed 's/^/build-files-docker-autotest_32381;autorun;/' /var/jenkins/workspace/autotest-per-patch_2/build-files-docker-autotest_32381/timing.txt 00:38:42.933 + for file in "${array[@]}" 00:38:42.933 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_2/check-format-docker-autotest_32407/timing.txt 00:38:42.933 + local job_file job_name 00:38:42.933 + job_file=/var/jenkins/workspace/autotest-per-patch_2/check-format-docker-autotest_32407/timing.txt 00:38:42.933 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/check-format-docker-autotest_32407/timing.txt 00:38:42.933 ++ basename /var/jenkins/workspace/autotest-per-patch_2/check-format-docker-autotest_32407 00:38:42.933 + job_name=check-format-docker-autotest_32407 00:38:42.934 + sed 's/^/check-format-docker-autotest_32407;autorun;/' /var/jenkins/workspace/autotest-per-patch_2/check-format-docker-autotest_32407/timing.txt 00:38:42.934 + for file in "${array[@]}" 00:38:42.934 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_2/iscsi-uring-vg-autotest_89735/timing.txt 00:38:42.934 + local job_file job_name 00:38:42.934 + job_file=/var/jenkins/workspace/autotest-per-patch_2/iscsi-uring-vg-autotest_89735/timing.txt 00:38:42.934 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/iscsi-uring-vg-autotest_89735/timing.txt 00:38:42.934 ++ basename /var/jenkins/workspace/autotest-per-patch_2/iscsi-uring-vg-autotest_89735 00:38:42.934 + job_name=iscsi-uring-vg-autotest_89735 00:38:42.934 + sed 's/^/iscsi-uring-vg-autotest_89735;autorun;/' /var/jenkins/workspace/autotest-per-patch_2/iscsi-uring-vg-autotest_89735/timing.txt 00:38:42.934 + for file in "${array[@]}" 00:38:42.934 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_2/iscsi-vg-autotest_89871/timing.txt 00:38:42.934 + local job_file job_name 00:38:42.934 + job_file=/var/jenkins/workspace/autotest-per-patch_2/iscsi-vg-autotest_89871/timing.txt 00:38:42.934 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/iscsi-vg-autotest_89871/timing.txt 00:38:42.934 ++ basename /var/jenkins/workspace/autotest-per-patch_2/iscsi-vg-autotest_89871 00:38:42.934 + job_name=iscsi-vg-autotest_89871 00:38:42.934 + sed 's/^/iscsi-vg-autotest_89871;autorun;/' /var/jenkins/workspace/autotest-per-patch_2/iscsi-vg-autotest_89871/timing.txt 00:38:42.934 + for file in "${array[@]}" 00:38:42.934 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_2/packaging-docker-autotest_29219/timing.txt 00:38:42.934 + local job_file job_name 00:38:42.934 + job_file=/var/jenkins/workspace/autotest-per-patch_2/packaging-docker-autotest_29219/timing.txt 00:38:42.934 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/packaging-docker-autotest_29219/timing.txt 00:38:42.934 ++ basename /var/jenkins/workspace/autotest-per-patch_2/packaging-docker-autotest_29219 00:38:42.934 + job_name=packaging-docker-autotest_29219 00:38:42.934 + sed 's/^/packaging-docker-autotest_29219;autorun;/' /var/jenkins/workspace/autotest-per-patch_2/packaging-docker-autotest_29219/timing.txt 00:38:42.934 + for file in "${array[@]}" 00:38:42.934 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_2/vfio-user-phy-autotest_37570/timing.txt 00:38:42.934 + local job_file job_name 00:38:42.934 + job_file=/var/jenkins/workspace/autotest-per-patch_2/vfio-user-phy-autotest_37570/timing.txt 00:38:42.934 +++ dirname /var/jenkins/workspace/autotest-per-patch_2/vfio-user-phy-autotest_37570/timing.txt 00:38:42.934 ++ basename /var/jenkins/workspace/autotest-per-patch_2/vfio-user-phy-autotest_37570 00:38:42.934 + job_name=vfio-user-phy-autotest_37570 00:38:42.934 + sed 's/^/vfio-user-phy-autotest_37570;autorun;/' /var/jenkins/workspace/autotest-per-patch_2/vfio-user-phy-autotest_37570/timing.txt 00:38:42.934 + /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/autotest-per-patch_2/post_process/total_timing.txt 00:38:43.192 + run_autorun_post 00:38:43.192 + s_opt= 00:38:43.192 + [[ '' == true ]] 00:38:43.192 + spdk/autorun_post.py -d ./ -r ./spdk 00:38:58.111 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_2/spdk/lib/event/reactor.c:1511 00:38:58.111 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_2/spdk/lib/env_dpdk/pci.c:1078 00:38:58.111 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_2/spdk/lib/env_dpdk/pci.c:1085 00:38:58.111 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_2/spdk/lib/env_dpdk/pci_event.c:233 00:38:58.111 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_2/spdk/lib/env_dpdk/pci_event.c:226 00:38:58.111 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_2/spdk/test/unit/lib/env_dpdk/pci_event.c/pci_event_ut.c:111 00:38:58.111 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_2/spdk/module/bdev/aio/bdev_aio.c:164 00:38:58.111 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_2/spdk/module/bdev/aio/bdev_aio.c:344 00:38:58.111 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_2/spdk/module/bdev/aio/bdev_aio.c:696 00:38:58.111 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_2/spdk/module/bdev/aio/bdev_aio.c:326 00:38:58.111 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_2/spdk/module/bdev/aio/bdev_aio.c:684 00:38:58.111 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_2/spdk/lib/thread/thread.c:1594 00:38:58.111 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_2/spdk/lib/thread/thread.c:2786 00:38:58.111 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_2/spdk/lib/thread/thread.c:1600 00:38:58.111 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_2/spdk/lib/thread/thread.c:1578 00:38:58.111 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_2/spdk/lib/thread/thread.c:1584 00:38:58.111 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_2/spdk/lib/thread/thread.c:1589 00:38:58.111 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_2/spdk/lib/util/fd_group.c:529 00:38:58.111 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_2/spdk/lib/util/fd_group.c:536 00:38:58.111 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_2/spdk/lib/util/fd_group.c:510 00:38:58.111 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_2/spdk/lib/util/fd_group.c:517 00:38:58.111 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_2/spdk/lib/util/fd_group.c:542 00:38:58.111 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_2/spdk/lib/util/fd_group.c:547 00:38:58.111 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_2/spdk/lib/util/fd_group.c:504 00:38:58.111 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_2/spdk/lib/util/fd_group.c:559 00:38:58.111 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_2/spdk/lib/util/fd_group.c:553 00:38:58.111 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_2/spdk/lib/util/fd_group.c:524 00:38:58.111 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_2/spdk/lib/util/uuid.c:121 00:38:58.112 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_2/spdk/lib/util/uuid.c:133 00:38:58.112 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_2/spdk/lib/util/uuid.c:127 00:38:58.112 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_2/spdk/lib/util/uuid.c:93 00:38:58.112 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_2/spdk/lib/util/uuid.c:115 00:38:58.112 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_2/spdk/lib/util/uuid.c:139 00:38:58.112 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_2/spdk/lib/util/uuid.c:74 00:39:36.795 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_2/spdk/module/blobfs/bdev/blobfs_bdev.c:254 00:40:23.444 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_2/spdk/nvmf_transport.h! 00:40:23.444 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_2/spdk/histogram_data.h! 00:40:23.444 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_2/spdk/thread.h! 00:40:23.444 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_2/spdk/mmio.h! 00:40:23.444 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_2/spdk/endian.h! 00:40:23.444 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_2/spdk/fsdev_module.h! 00:40:23.444 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_2/spdk/bdev_module.h! 00:40:23.444 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_2/spdk/trace.h! 00:40:23.444 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_2/spdk/base64.h! 00:40:23.444 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_2/spdk/nvme_spec.h! 00:40:23.444 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_2/spdk/nvme.h! 00:40:23.444 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_2/spdk/util.h! 00:40:24.375 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_2/spdk/histogram_data.h/histogram_ut.c! 00:40:27.649 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_2/spdk/lib/env_ocf/include/ocf/ocf_mngt.h! 00:40:27.649 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_2/spdk/lib/env_ocf/include/ocf/ocf_core.h! 00:40:27.649 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_2/spdk/lib/env_ocf/include/ocf/ocf_io.h! 00:40:49.559 -----Begin Post Process Script------ 00:40:49.559 /var/jenkins/workspace/autotest-per-patch_2/lvol-vg-autotest_89783/cov_total.info 00:40:49.559 /var/jenkins/workspace/autotest-per-patch_2/vhost-initiator-vg-autotest_89852/cov_total.info 00:40:49.559 /var/jenkins/workspace/autotest-per-patch_2/ubuntu24-vg-autotest_6432/cov_total.info 00:40:49.559 /var/jenkins/workspace/autotest-per-patch_2/nvme-cmb-pmr-vg-autotest_90959/cov_total.info 00:40:49.559 /var/jenkins/workspace/autotest-per-patch_2/nvme-phy-autotest_83736/cov_total.info 00:40:49.559 /var/jenkins/workspace/autotest-per-patch_2/freebsd-vg-autotest_68080/cov_total.info 00:40:49.559 /var/jenkins/workspace/autotest-per-patch_2/nvme-vg-autotest_89834/cov_total.info 00:40:49.559 /var/jenkins/workspace/autotest-per-patch_2/raid-vg-autotest_4568/cov_total.info 00:40:49.559 /var/jenkins/workspace/autotest-per-patch_2/short-fuzz-phy-autotest_37565/cov_total.info 00:40:49.559 /var/jenkins/workspace/autotest-per-patch_2/rocky9-vg-autotest_27174/cov_total.info 00:40:49.559 /var/jenkins/workspace/autotest-per-patch_2/zns-vg-autotest_88936/cov_total.info 00:40:49.559 /var/jenkins/workspace/autotest-per-patch_2/crypto-phy-autotest_37569/cov_total.info 00:40:49.559 /var/jenkins/workspace/autotest-per-patch_2/BlobFS-phy-autotest_37580/cov_total.info 00:40:49.559 /var/jenkins/workspace/autotest-per-patch_2/ubuntu22-vg-autotest_48871/cov_total.info 00:40:49.559 /var/jenkins/workspace/autotest-per-patch_2/vhost-phy-autotest_37630/cov_total.info 00:40:49.559 /var/jenkins/workspace/autotest-per-patch_2/iscsi-uring-vg-autotest_89735/cov_total.info 00:40:49.559 /var/jenkins/workspace/autotest-per-patch_2/iscsi-vg-autotest_89871/cov_total.info 00:40:49.559 /var/jenkins/workspace/autotest-per-patch_2/vfio-user-phy-autotest_37570/cov_total.info 00:40:49.559 00:40:49.559 00:40:49.559 -----Tests Executed in Build------ 00:40:49.559 accel 00:40:49.559 accel_assign_opcode 00:40:49.559 accel_cdev_comp 00:40:49.559 accel_cdev_decomp 00:40:49.559 accel_cdev_decomp_full 00:40:49.559 accel_cdev_decomp_full_mcore 00:40:49.559 accel_cdev_decomp_full_mthread 00:40:49.559 accel_cdev_decomp_mcore 00:40:49.559 accel_cdev_decomp_mthread 00:40:49.559 accel_comp 00:40:49.559 accel_compare 00:40:49.559 accel_compress_verify 00:40:49.559 accel_copy 00:40:49.559 accel_copy_crc32c 00:40:49.559 accel_copy_crc32c_C2 00:40:49.559 accel_crc32c 00:40:49.559 accel_crc32c_C2 00:40:49.559 accel_decomp 00:40:49.559 accel_decomp_full 00:40:49.559 accel_decomp_full_mcore 00:40:49.559 accel_decomp_full_mthread 00:40:49.559 accel_decomp_mcore 00:40:49.559 accel_decomp_mthread 00:40:49.559 accel_dif_functional_tests 00:40:49.559 accel_dif_generate 00:40:49.559 accel_dif_generate_copy 00:40:49.559 accel_dif_verify 00:40:49.559 accel_dix_generate 00:40:49.559 accel_dix_verify 00:40:49.559 accel_dualcast 00:40:49.559 accel_fill 00:40:49.559 accel_help 00:40:49.559 accel_missing_filename 00:40:49.559 accel_negative_buffers 00:40:49.559 accel_rpc 00:40:49.559 accel_wrong_workload 00:40:49.559 accel_xor 00:40:49.559 acl 00:40:49.559 alias_rpc 00:40:49.559 allowed 00:40:49.559 app_cmdline 00:40:49.559 app_repeat 00:40:49.559 asan 00:40:49.559 autobuild 00:40:49.559 autobuild_build_doc 00:40:49.559 autobuild_check_dpdk_pci_api 00:40:49.559 autobuild_check_format 00:40:49.559 autobuild_check_so_deps 00:40:49.559 autobuild_external_code 00:40:49.559 autobuild_generated_files_check 00:40:49.559 autobuild_generated_files_check_post_clean 00:40:49.559 autobuild_header_dependency_check 00:40:49.559 autobuild_llvm_precompile 00:40:49.559 autobuild_make_install 00:40:49.559 autobuild_make_uninstall 00:40:49.559 autobuild_ocf_precompile 00:40:49.559 bdev_bounds 00:40:49.559 bdev_crypto_enomem 00:40:49.559 bdev_error 00:40:49.559 bdev_fio 00:40:49.559 bdev_fio_rw_verify 00:40:49.559 bdev_fio_trim 00:40:49.559 bdev_gpt_uuid 00:40:49.559 bdev_hello_world 00:40:49.559 bdev_json_nonarray 00:40:49.559 bdev_json_nonenclosed 00:40:49.559 bdev_nbd 00:40:49.559 bdev_nvme_reset_stuck_adm_cmd 00:40:49.559 bdev_qd_sampling 00:40:49.559 bdev_qos 00:40:49.559 bdev_qos_bw 00:40:49.559 bdev_qos_iops 00:40:49.559 bdev_qos_ro_bw 00:40:49.559 bdev_raid 00:40:49.559 bdev_stat 00:40:49.559 bdev_verify 00:40:49.559 bdev_verify_big_io 00:40:49.559 bdev_write_zeroes 00:40:49.560 bdevperf_config 00:40:49.560 blob_io_wait 00:40:49.560 blobfs 00:40:49.560 blobfs_mkfs 00:40:49.560 blobstore 00:40:49.560 blobstore_grow 00:40:49.560 blockdev_crypto_aesni 00:40:49.560 blockdev_crypto_qat 00:40:49.560 blockdev_crypto_sw 00:40:49.560 blockdev_general 00:40:49.560 blockdev_nvme 00:40:49.560 blockdev_nvme_gpt 00:40:49.560 blockdev_raid5f 00:40:49.560 blockdev_rbd 00:40:49.560 blockdev_xnvme 00:40:49.560 build_release 00:40:49.560 build_rpm_from_gen_spec 00:40:49.560 build_shared_rpm 00:40:49.560 chaining 00:40:49.560 chap_during_discovery 00:40:49.560 chap_mutual_auth 00:40:49.560 check_header_filenames 00:40:49.560 cmb_copy 00:40:49.560 compress_compdev 00:40:49.560 compress_isal 00:40:49.560 confirm_abi_deps 00:40:49.560 confirm_makefile_deps 00:40:49.560 core_isolating 00:40:49.560 cpu_locks 00:40:49.560 custom_alloc 00:40:49.560 dd_bs_lt_native_bs 00:40:49.560 dd_bs_not_multiple 00:40:49.560 dd_copy_to_out_bdev 00:40:49.560 dd_double_input 00:40:49.560 dd_double_output 00:40:49.560 dd_flag_append 00:40:49.560 dd_flag_append_forced_aio 00:40:49.560 dd_flag_directory 00:40:49.560 dd_flag_directory_forced_aio 00:40:49.560 dd_flag_noatime 00:40:49.560 dd_flag_noatime_forced_aio 00:40:49.560 dd_flag_nofollow 00:40:49.560 dd_flag_nofollow_forced_aio 00:40:49.560 dd_flags_misc 00:40:49.560 dd_flags_misc_forced_aio 00:40:49.560 dd_inflate_file 00:40:49.560 dd_invalid_arguments 00:40:49.560 dd_invalid_count 00:40:49.560 dd_invalid_iflag 00:40:49.560 dd_invalid_input_count 00:40:49.560 dd_invalid_json 00:40:49.560 dd_invalid_oflag 00:40:49.560 dd_invalid_output_count 00:40:49.560 dd_invalid_seek 00:40:49.560 dd_invalid_skip 00:40:49.560 dd_malloc_copy 00:40:49.560 dd_no_input 00:40:49.560 dd_no_output 00:40:49.560 dd_offset_magic 00:40:49.560 dd_rw 00:40:49.560 dd_rw_offset 00:40:49.560 dd_smaller_blocksize 00:40:49.560 dd_sparse_bdev_to_file 00:40:49.560 dd_sparse_file_to_bdev 00:40:49.560 dd_sparse_file_to_file 00:40:49.560 dd_unknown_flag 00:40:49.560 dd_uring_copy 00:40:49.560 dd_wrong_blocksize 00:40:49.560 default_locks 00:40:49.560 default_locks_via_rpc 00:40:49.560 denied 00:40:49.560 devices 00:40:49.560 dm_mount 00:40:49.560 dpdk_governor 00:40:49.560 dpdk_mem_utility 00:40:49.560 driver 00:40:49.560 env 00:40:49.560 env_dpdk_post_init 00:40:49.560 env_mem_callbacks 00:40:49.560 env_memory 00:40:49.560 env_pci 00:40:49.560 env_vtophys 00:40:49.560 even_2G_alloc 00:40:49.560 event 00:40:49.560 event_perf 00:40:49.560 event_reactor 00:40:49.560 event_reactor_perf 00:40:49.560 event_scheduler 00:40:49.560 exit_on_failed_rpc_init 00:40:49.560 external_make_accel_driver_shared 00:40:49.560 external_make_accel_driver_static 00:40:49.560 external_make_accel_module_shared 00:40:49.560 external_make_accel_module_static 00:40:49.560 external_make_hello_bdev_shared_combo 00:40:49.560 external_make_hello_bdev_shared_iso 00:40:49.560 external_make_hello_bdev_static 00:40:49.560 external_make_hello_no_bdev_shared_combo 00:40:49.560 external_make_hello_no_bdev_shared_iso 00:40:49.560 external_make_hello_no_bdev_static 00:40:49.560 external_make_nvme_shared 00:40:49.560 external_make_nvme_static 00:40:49.560 external_run_accel_driver_shared 00:40:49.560 external_run_accel_driver_static 00:40:49.560 external_run_accel_module_shared 00:40:49.560 external_run_accel_module_static 00:40:49.560 external_run_hello_bdev_shared_combo 00:40:49.560 external_run_hello_bdev_shared_iso 00:40:49.560 external_run_hello_bdev_static 00:40:49.560 external_run_hello_no_bdev_shared_combo 00:40:49.560 external_run_hello_no_bdev_shared_iso 00:40:49.560 external_run_hello_no_bdev_static 00:40:49.560 external_run_nvme_shared 00:40:49.560 external_run_nvme_static 00:40:49.560 filesystem_btrfs 00:40:49.560 filesystem_ext4 00:40:49.560 filesystem_in_capsule_btrfs 00:40:49.560 filesystem_in_capsule_ext4 00:40:49.560 filesystem_in_capsule_xfs 00:40:49.560 filesystem_xfs 00:40:49.560 framework_get_governor 00:40:49.560 ftl 00:40:49.560 ftl_bdevperf 00:40:49.560 ftl_dirty_shutdown 00:40:49.560 ftl_fio_basic 00:40:49.560 ftl_restore 00:40:49.560 ftl_trim 00:40:49.560 ftl_upgrade_shutdown 00:40:49.560 go_rpc 00:40:49.560 guess_driver 00:40:49.560 hello_blob 00:40:49.560 hugepages 00:40:49.560 idle 00:40:49.560 interrupt_mode 00:40:49.560 ioat 00:40:49.560 ioat_perf 00:40:49.560 ioat_verify 00:40:49.560 is_zoned 00:40:49.560 iscsi_tgt 00:40:49.560 iscsi_tgt_bdev_io_wait 00:40:49.560 iscsi_tgt_calsoft 00:40:49.560 iscsi_tgt_digest 00:40:49.560 iscsi_tgt_digests 00:40:49.560 iscsi_tgt_filesystem 00:40:49.560 iscsi_tgt_filesystem_btrfs 00:40:49.560 iscsi_tgt_filesystem_ext4 00:40:49.560 iscsi_tgt_filesystem_xfs 00:40:49.560 iscsi_tgt_fio 00:40:49.560 iscsi_tgt_fuzz 00:40:49.560 iscsi_tgt_initiator 00:40:49.560 iscsi_tgt_ip_migration 00:40:49.560 iscsi_tgt_iscsi_lvol 00:40:49.560 iscsi_tgt_login_redirection 00:40:49.560 iscsi_tgt_multiconnection 00:40:49.560 iscsi_tgt_qos 00:40:49.560 iscsi_tgt_rbd 00:40:49.560 iscsi_tgt_reset 00:40:49.560 iscsi_tgt_resize 00:40:49.560 iscsi_tgt_rpc_config 00:40:49.560 iscsi_tgt_sock 00:40:49.560 iscsi_tgt_trace_record 00:40:49.560 json_config 00:40:49.560 json_config_extra_key 00:40:49.560 llvm_fuzz 00:40:49.560 locking_app_on_locked_coremask 00:40:49.560 locking_app_on_unlocked_coremask 00:40:49.560 locking_overlapped_coremask 00:40:49.560 locking_overlapped_coremask_via_rpc 00:40:49.560 lvol 00:40:49.560 lvol_basic 00:40:49.560 lvol_esnap 00:40:49.560 lvol_external_copy 00:40:49.560 lvol_external_snapshot 00:40:49.560 lvol_hotremove 00:40:49.560 lvol_provisioning 00:40:49.560 lvol_rename 00:40:49.560 lvol_resize 00:40:49.560 lvol_snapshot_clone 00:40:49.560 lvol_tasting 00:40:49.560 lvs_grow_clean 00:40:49.560 lvs_grow_dirty 00:40:49.560 make 00:40:49.560 no_shrink_alloc 00:40:49.560 non_locking_app_on_locked_coremask 00:40:49.560 nvme 00:40:49.560 nvme_arbitration 00:40:49.560 nvme_cli_cuse 00:40:49.560 nvme_cli_plugin 00:40:49.560 nvme_cmb 00:40:49.560 nvme_cuse 00:40:49.560 nvme_cuse_app 00:40:49.560 nvme_cuse_rpc 00:40:49.560 nvme_doorbell_aers 00:40:49.560 nvme_e2edp 00:40:49.560 nvme_err_injection 00:40:49.560 nvme_fdp 00:40:49.560 nvme_fio 00:40:49.560 nvme_flexible_data_placement 00:40:49.560 nvme_hello_world 00:40:49.560 nvme_identify 00:40:49.560 nvme_mount 00:40:49.560 nvme_multi_aen 00:40:49.560 nvme_multi_secondary 00:40:49.560 nvme_ns_manage_cuse 00:40:49.560 nvme_overhead 00:40:49.560 nvme_perf 00:40:49.560 nvme_pmr 00:40:49.560 nvme_pmr_persistence 00:40:49.560 nvme_reserve 00:40:49.560 nvme_reset 00:40:49.560 nvme_rpc 00:40:49.560 nvme_rpc_timeouts 00:40:49.560 nvme_scc 00:40:49.560 nvme_sgl 00:40:49.560 nvme_simple_copy 00:40:49.560 nvme_single_aen 00:40:49.560 nvme_smartctl_cuse 00:40:49.560 nvme_startup 00:40:49.560 nvme_xnvme 00:40:49.560 nvme_zns 00:40:49.560 nvmf_abort 00:40:49.560 nvmf_aer 00:40:49.560 nvmf_async_init 00:40:49.560 nvmf_auth_target 00:40:49.560 nvmf_bdev_io_wait 00:40:49.560 nvmf_bdevio 00:40:49.560 nvmf_bdevio_no_huge 00:40:49.560 nvmf_connect_disconnect 00:40:49.560 nvmf_connect_stress 00:40:49.560 nvmf_control_msg_list 00:40:49.560 nvmf_delete_subsystem 00:40:49.560 nvmf_discovery_remove_ifc 00:40:49.560 nvmf_example 00:40:49.560 nvmf_failover 00:40:49.560 nvmf_filesystem 00:40:49.560 nvmf_filesystem_in_capsule 00:40:49.560 nvmf_filesystem_no_in_capsule 00:40:49.560 nvmf_fio_host 00:40:49.560 nvmf_fio_target 00:40:49.560 nvmf_fips 00:40:49.560 nvmf_fused_ordering 00:40:49.560 nvmf_host_management 00:40:49.560 nvmf_host_multipath_status 00:40:49.560 nvmf_identify 00:40:49.560 nvmf_identify_kernel_target 00:40:49.560 nvmf_invalid 00:40:49.560 nvmf_llvm_fuzz 00:40:49.560 nvmf_lvol 00:40:49.560 nvmf_lvs_grow 00:40:49.560 nvmf_multitarget 00:40:49.560 nvmf_nmic 00:40:49.560 nvmf_ns_hotplug_stress 00:40:49.560 nvmf_ns_masking 00:40:49.560 nvmf_nvme_cli 00:40:49.560 nvmf_perf 00:40:49.560 nvmf_perf_adq 00:40:49.560 nvmf_queue_depth 00:40:49.560 nvmf_referrals 00:40:49.560 nvmf_rpc 00:40:49.560 nvmf_shutdown 00:40:49.560 nvmf_shutdown_tc1 00:40:49.560 nvmf_shutdown_tc2 00:40:49.560 nvmf_shutdown_tc3 00:40:49.560 nvmf_shutdown_tc4 00:40:49.560 nvmf_srq_overwhelm 00:40:49.560 nvmf_target_core 00:40:49.560 nvmf_target_discovery 00:40:49.560 nvmf_target_extra 00:40:49.560 nvmf_target_multipath 00:40:49.560 nvmf_tls 00:40:49.560 nvmf_vfio_user 00:40:49.560 nvmf_vfio_user_fuzz 00:40:49.560 nvmf_vfio_user_nvme_compliance 00:40:49.560 nvmf_vhost 00:40:49.560 nvmf_wait_for_buf 00:40:49.560 nvmf_zcopy 00:40:49.560 ocf 00:40:49.560 ocf_bdevperf_iotypes 00:40:49.560 ocf_configuration_change 00:40:49.560 ocf_create_destruct 00:40:49.560 ocf_fio_modes 00:40:49.561 ocf_flush 00:40:49.561 ocf_multicore 00:40:49.561 ocf_remove 00:40:49.561 ocf_stats 00:40:49.561 odd_alloc 00:40:49.561 packaging 00:40:49.561 raid0_resize_superblock_test 00:40:49.561 raid0_resize_test 00:40:49.561 raid1_resize_data_offset_test 00:40:49.561 raid1_resize_superblock_test 00:40:49.561 raid1_resize_test 00:40:49.561 raid5f_rebuild_test 00:40:49.561 raid5f_rebuild_test_sb 00:40:49.561 raid5f_state_function_test 00:40:49.561 raid5f_state_function_test_sb 00:40:49.561 raid5f_superblock_test 00:40:49.561 raid_function_test_concat 00:40:49.561 raid_function_test_raid0 00:40:49.561 raid_read_error_test 00:40:49.561 raid_rebuild_test 00:40:49.561 raid_rebuild_test_io 00:40:49.561 raid_rebuild_test_sb 00:40:49.561 raid_rebuild_test_sb_4k 00:40:49.561 raid_rebuild_test_sb_io 00:40:49.561 raid_rebuild_test_sb_md_interleaved 00:40:49.561 raid_rebuild_test_sb_md_separate 00:40:49.561 raid_state_function_test 00:40:49.561 raid_state_function_test_sb 00:40:49.561 raid_state_function_test_sb_4k 00:40:49.561 raid_state_function_test_sb_md_interleaved 00:40:49.561 raid_state_function_test_sb_md_separate 00:40:49.561 raid_superblock_test 00:40:49.561 raid_superblock_test_4k 00:40:49.561 raid_superblock_test_md_interleaved 00:40:49.561 raid_superblock_test_md_separate 00:40:49.561 raid_write_error_test 00:40:49.561 reactor_set_interrupt 00:40:49.561 reap_unregistered_poller 00:40:49.561 rocksdb 00:40:49.561 rocksdb_insert 00:40:49.561 rocksdb_overwrite 00:40:49.561 rocksdb_randread 00:40:49.561 rocksdb_readwrite 00:40:49.561 rocksdb_writesync 00:40:49.561 rpc 00:40:49.561 rpc_client 00:40:49.561 rpc_daemon_integrity 00:40:49.561 rpc_integrity 00:40:49.561 rpc_plugins 00:40:49.561 rpc_trace_cmd_test 00:40:49.561 rpm_packaging 00:40:49.561 scanbuild_make 00:40:49.561 scheduler 00:40:49.561 scheduler_create_thread 00:40:49.561 scheduler_opts 00:40:49.561 scheduler_rpc 00:40:49.561 setup.sh 00:40:49.561 single_node_setup 00:40:49.561 skip_rpc 00:40:49.561 skip_rpc_with_delay 00:40:49.561 skip_rpc_with_json 00:40:49.561 sma 00:40:49.561 sma_crypto 00:40:49.561 sma_discovery 00:40:49.561 sma_nvmf_tcp 00:40:49.561 sma_plugins 00:40:49.561 sma_qos 00:40:49.561 sma_vfiouser_qemu 00:40:49.561 sma_vhost 00:40:49.561 spdk_dd 00:40:49.561 spdk_dd_basic_rw 00:40:49.561 spdk_dd_bdev_to_bdev 00:40:49.561 spdk_dd_malloc 00:40:49.561 spdk_dd_negative 00:40:49.561 spdk_dd_posix 00:40:49.561 spdk_dd_sparse 00:40:49.561 spdk_dd_uring 00:40:49.561 spdkcli_iscsi 00:40:49.561 spdkcli_raid 00:40:49.561 spdkcli_rbd 00:40:49.561 spdkcli_tcp 00:40:49.561 spdkcli_vhost 00:40:49.561 spdkcli_virtio 00:40:49.561 static_as_default 00:40:49.561 sw_hotplug 00:40:49.561 test_bdev_lvol_delete_lvstore_with_clones 00:40:49.561 test_bdev_lvol_delete_ordering 00:40:49.561 test_clone_decouple_parent 00:40:49.561 test_clone_inflate 00:40:49.561 test_clone_snapshot_relations 00:40:49.561 test_construct_lvol 00:40:49.561 test_construct_lvol_alias_conflict 00:40:49.561 test_construct_lvol_fio_clear_method_none 00:40:49.561 test_construct_lvol_fio_clear_method_unmap 00:40:49.561 test_construct_lvol_full_lvs 00:40:49.561 test_construct_lvol_inexistent_lvs 00:40:49.561 test_construct_lvols_conflict_alias 00:40:49.561 test_construct_lvs 00:40:49.561 test_construct_lvs_clear_methods 00:40:49.561 test_construct_lvs_conflict_alias 00:40:49.561 test_construct_lvs_different_cluster_size 00:40:49.561 test_construct_lvs_nonexistent_bdev 00:40:49.561 test_construct_multi_lvols 00:40:49.561 test_construct_nested_lvol 00:40:49.561 test_construct_two_lvs_on_the_same_bdev 00:40:49.561 test_create_multi_ublk 00:40:49.561 test_create_snapshot_of_snapshot 00:40:49.561 test_create_snapshot_with_io 00:40:49.561 test_create_ublk 00:40:49.561 test_delete_lvol_store_persistent_positive 00:40:49.561 test_delete_snapshot_with_clone 00:40:49.561 test_delete_snapshot_with_snapshot 00:40:49.561 test_destroy_after_bdev_lvol_resize_positive 00:40:49.561 test_esnap_clones 00:40:49.561 test_esnap_late_arrival 00:40:49.561 test_esnap_reload 00:40:49.561 test_esnap_remove_degraded 00:40:49.561 test_hotremove_lvol_store 00:40:49.561 test_hotremove_lvol_store_base 00:40:49.561 test_hotremove_lvol_store_base_with_lvols 00:40:49.561 test_hotremove_lvol_store_multiple_lvols 00:40:49.561 test_lvol_bdev_readonly 00:40:49.561 test_lvol_list 00:40:49.561 test_lvol_rename_negative 00:40:49.561 test_lvol_set_parent_bdev_from_esnap 00:40:49.561 test_lvol_set_parent_bdev_from_none 00:40:49.561 test_lvol_set_parent_bdev_from_snapshot 00:40:49.561 test_lvol_set_parent_failed 00:40:49.561 test_lvol_set_parent_from_esnap 00:40:49.561 test_lvol_set_parent_from_none 00:40:49.561 test_lvol_set_parent_from_snapshot 00:40:49.561 test_rename_lvs_negative 00:40:49.561 test_rename_positive 00:40:49.561 test_resize_lvol 00:40:49.561 test_resize_lvol_negative 00:40:49.561 test_resize_lvol_with_io_traffic 00:40:49.561 test_save_ublk_config 00:40:49.561 test_shallow_copy_compare 00:40:49.561 test_sigterm 00:40:49.561 test_snapshot_compare_with_lvol_bdev 00:40:49.561 test_tasting 00:40:49.561 test_thin_lvol_check_integrity 00:40:49.561 test_thin_lvol_check_space 00:40:49.561 test_thin_lvol_check_zeroes 00:40:49.561 test_thin_lvol_resize 00:40:49.561 test_thin_overprovisioning 00:40:49.561 test_unregister_lvol_bdev 00:40:49.561 thread 00:40:49.561 thread_poller_perf 00:40:49.561 thread_spdk_lock 00:40:49.561 ublk 00:40:49.561 ublk_recovery 00:40:49.561 ubsan 00:40:49.561 unittest 00:40:49.561 unittest_accel 00:40:49.561 unittest_bdev 00:40:49.561 unittest_bdev_compress 00:40:49.561 unittest_bdev_crypto 00:40:49.561 unittest_bdev_raid5f 00:40:49.561 unittest_blob_blobfs 00:40:49.561 unittest_build 00:40:49.561 unittest_dma 00:40:49.561 unittest_dpdk_compressdev 00:40:49.561 unittest_event 00:40:49.561 unittest_fsdev 00:40:49.561 unittest_ftl 00:40:49.561 unittest_idxd_user 00:40:49.561 unittest_include 00:40:49.561 unittest_init 00:40:49.561 unittest_ioat 00:40:49.561 unittest_iobuf 00:40:49.561 unittest_iscsi 00:40:49.561 unittest_json 00:40:49.561 unittest_keyring 00:40:49.561 unittest_lib_reduce 00:40:49.561 unittest_log 00:40:49.561 unittest_lvol 00:40:49.561 unittest_notify 00:40:49.561 unittest_nvme 00:40:49.561 unittest_nvme_cuse 00:40:49.561 unittest_nvme_rdma 00:40:49.561 unittest_nvmf 00:40:49.561 unittest_nvmf_rdma 00:40:49.561 unittest_nvmf_transport 00:40:49.561 unittest_nvmf_vfio_user 00:40:49.561 unittest_pci_event 00:40:49.561 unittest_rdma 00:40:49.561 unittest_rpc 00:40:49.561 unittest_scsi 00:40:49.561 unittest_sock 00:40:49.561 unittest_thread 00:40:49.561 unittest_util 00:40:49.561 unittest_vhost 00:40:49.561 valgrind 00:40:49.561 version 00:40:49.561 vfio_llvm_fuzz 00:40:49.561 vfio_user_nvme_fio 00:40:49.561 vfio_user_nvme_restart_vm 00:40:49.561 vfio_user_qemu 00:40:49.561 vfio_user_virtio_bdevperf 00:40:49.561 vfio_user_virtio_blk_restart_vm 00:40:49.561 vfio_user_virtio_fs_fio 00:40:49.561 vfio_user_virtio_scsi_restart_vm 00:40:49.561 vhost 00:40:49.561 vhost_blk_lvol_integrity 00:40:49.561 vhost_blk_packed_ring_integrity 00:40:49.561 vhost_blockdev 00:40:49.561 vhost_boot 00:40:49.561 vhost_fuzz 00:40:49.561 vhost_negative 00:40:49.561 vhost_scsi_lvol_integrity 00:40:49.561 vhost_shared 00:40:49.561 xnvme_bdevperf 00:40:49.561 xnvme_to_malloc_dd_copy 00:40:49.561 zoned_fio 00:40:49.561 00:40:49.561 00:40:49.561 -----Tests Missing From Build------ 00:40:49.561 accel_mlx5_copy 00:40:49.561 accel_mlx5_crc32c 00:40:49.561 accel_mlx5_crypto 00:40:49.561 accel_scan_dsa_modules 00:40:49.561 accel_scan_iaa_modules 00:40:49.561 balanced 00:40:49.561 build_native_dpdk 00:40:49.561 build_shared_native_dpdk_rpm 00:40:49.561 build_shared_rpm_with_rpmed_dpdk 00:40:49.561 busy 00:40:49.561 core_load 00:40:49.561 dma 00:40:49.561 fio_dif_1_default 00:40:49.561 fio_dif_1_multi_subsystems 00:40:49.561 fio_dif_digest 00:40:49.561 fio_dif_rand_params 00:40:49.561 ftl_restore_fast 00:40:49.561 iscsi_tgt_data_digest 00:40:49.561 iscsi_tgt_ext4test 00:40:49.561 kernel_target_abort 00:40:49.561 keyring_file 00:40:49.561 keyring_linux 00:40:49.561 nvme_boot_partition 00:40:49.561 nvme_bp 00:40:49.561 nvme_opal 00:40:49.561 nvme_opal_bdevio 00:40:49.561 nvme_opal_bdevperf 00:40:49.561 nvme_opal_spdk_tgt 00:40:49.561 nvmf_abort_qd_sizes 00:40:49.561 nvmf_auth_host 00:40:49.561 nvmf_bdevperf 00:40:49.561 nvmf_device_removal_pci_remove 00:40:49.561 nvmf_device_removal_pci_remove_no_srq 00:40:49.561 nvmf_dif 00:40:49.561 nvmf_digest 00:40:49.561 nvmf_digest_clean 00:40:49.561 nvmf_digest_dsa_initiator 00:40:49.561 nvmf_digest_dsa_target 00:40:49.561 nvmf_digest_error 00:40:49.561 nvmf_fc 00:40:49.561 nvmf_fuzz 00:40:49.561 nvmf_host 00:40:49.561 nvmf_host_discovery 00:40:49.561 nvmf_host_multipath 00:40:49.561 nvmf_identify_passthru 00:40:49.561 nvmf_initiator_timeout 00:40:49.561 nvmf_interrupt 00:40:49.561 nvmf_mdns_discovery 00:40:49.561 nvmf_multiconnection 00:40:49.561 nvmf_multicontroller 00:40:49.561 nvmf_rdma 00:40:49.561 nvmf_target_core_interrupt_mode 00:40:49.561 nvmf_target_disconnect 00:40:49.561 nvmf_target_disconnect_tc1 00:40:49.561 nvmf_target_disconnect_tc2 00:40:49.561 nvmf_target_disconnect_tc3 00:40:49.561 nvmf_tcp 00:40:49.561 nvmf_timeout 00:40:49.561 spdk_target_abort 00:40:49.562 spdkcli_nvmf_fc 00:40:49.562 spdkcli_nvmf_rdma 00:40:49.562 spdkcli_nvmf_tcp 00:40:49.562 unittest_nvmf_fc 00:40:49.562 unittest_nvmf_fc_ls 00:40:49.562 vhost_blk_cores_2ctrl 00:40:49.562 vhost_blk_fs_integrity 00:40:49.562 vhost_blk_hot_remove 00:40:49.562 vhost_blk_integrity 00:40:49.562 vhost_hotplug 00:40:49.562 vhost_migration 00:40:49.562 vhost_migration_tc1 00:40:49.562 vhost_migration_tc2 00:40:49.562 vhost_readonly 00:40:49.562 vhost_scsi_cores_2ctrl 00:40:49.562 vhost_scsi_fs_integrity 00:40:49.562 vhost_scsi_hot_remove 00:40:49.562 vhost_scsi_integrity 00:40:49.562 vmd 00:40:49.562 vmd_bdev_svc 00:40:49.562 vmd_fio 00:40:49.562 vmd_hello_world 00:40:49.562 vmd_identify 00:40:49.562 vmd_perf 00:40:49.562 00:40:49.562 00:40:49.562 -----Tests Missing ASAN------ 00:40:49.562 accel_cdev_comp 00:40:49.562 accel_cdev_decomp 00:40:49.562 accel_cdev_decomp_full 00:40:49.562 accel_cdev_decomp_full_mcore 00:40:49.562 accel_cdev_decomp_full_mthread 00:40:49.562 accel_cdev_decomp_mcore 00:40:49.562 accel_cdev_decomp_mthread 00:40:49.562 accel_mlx5_copy 00:40:49.562 accel_mlx5_crc32c 00:40:49.562 accel_mlx5_crypto 00:40:49.562 accel_scan_dsa_modules 00:40:49.562 accel_scan_iaa_modules 00:40:49.562 acl 00:40:49.562 allowed 00:40:49.562 autobuild 00:40:49.562 autobuild_build_doc 00:40:49.562 autobuild_check_dpdk_pci_api 00:40:49.562 autobuild_check_format 00:40:49.562 autobuild_check_so_deps 00:40:49.562 autobuild_external_code 00:40:49.562 autobuild_generated_files_check 00:40:49.562 autobuild_generated_files_check_post_clean 00:40:49.562 autobuild_header_dependency_check 00:40:49.562 autobuild_llvm_precompile 00:40:49.562 autobuild_make_install 00:40:49.562 autobuild_make_uninstall 00:40:49.562 autobuild_ocf_precompile 00:40:49.562 balanced 00:40:49.562 bdev_crypto_enomem 00:40:49.562 blockdev_crypto_aesni 00:40:49.562 blockdev_crypto_qat 00:40:49.562 blockdev_crypto_sw 00:40:49.562 blockdev_rbd 00:40:49.562 build_native_dpdk 00:40:49.562 build_rpm_from_gen_spec 00:40:49.562 build_shared_native_dpdk_rpm 00:40:49.562 build_shared_rpm 00:40:49.562 build_shared_rpm_with_rpmed_dpdk 00:40:49.562 busy 00:40:49.562 chaining 00:40:49.562 chap_during_discovery 00:40:49.562 chap_mutual_auth 00:40:49.562 check_header_filenames 00:40:49.562 cmb_copy 00:40:49.562 compress_compdev 00:40:49.562 compress_isal 00:40:49.562 confirm_abi_deps 00:40:49.562 confirm_makefile_deps 00:40:49.562 core_isolating 00:40:49.562 core_load 00:40:49.562 custom_alloc 00:40:49.562 dd_uring_copy 00:40:49.562 denied 00:40:49.562 devices 00:40:49.562 dm_mount 00:40:49.562 dma 00:40:49.562 dpdk_governor 00:40:49.562 driver 00:40:49.562 even_2G_alloc 00:40:49.562 external_make_accel_driver_shared 00:40:49.562 external_make_accel_driver_static 00:40:49.562 external_make_accel_module_shared 00:40:49.562 external_make_accel_module_static 00:40:49.562 external_make_hello_bdev_shared_combo 00:40:49.562 external_make_hello_bdev_shared_iso 00:40:49.562 external_make_hello_bdev_static 00:40:49.562 external_make_hello_no_bdev_shared_combo 00:40:49.562 external_make_hello_no_bdev_shared_iso 00:40:49.562 external_make_hello_no_bdev_static 00:40:49.562 external_make_nvme_shared 00:40:49.562 external_make_nvme_static 00:40:49.562 external_run_accel_driver_shared 00:40:49.562 external_run_accel_driver_static 00:40:49.562 external_run_accel_module_shared 00:40:49.562 external_run_accel_module_static 00:40:49.562 external_run_hello_bdev_shared_combo 00:40:49.562 external_run_hello_bdev_shared_iso 00:40:49.562 external_run_hello_bdev_static 00:40:49.562 external_run_hello_no_bdev_shared_combo 00:40:49.562 external_run_hello_no_bdev_shared_iso 00:40:49.562 external_run_hello_no_bdev_static 00:40:49.562 external_run_nvme_shared 00:40:49.562 external_run_nvme_static 00:40:49.562 filesystem_btrfs 00:40:49.562 filesystem_ext4 00:40:49.562 filesystem_in_capsule_btrfs 00:40:49.562 filesystem_in_capsule_ext4 00:40:49.562 filesystem_in_capsule_xfs 00:40:49.562 filesystem_xfs 00:40:49.562 fio_dif_1_default 00:40:49.562 fio_dif_1_multi_subsystems 00:40:49.562 fio_dif_digest 00:40:49.562 fio_dif_rand_params 00:40:49.562 framework_get_governor 00:40:49.562 ftl_restore_fast 00:40:49.562 go_rpc 00:40:49.562 guess_driver 00:40:49.562 hugepages 00:40:49.562 idle 00:40:49.562 interrupt_mode 00:40:49.562 ioat 00:40:49.562 ioat_perf 00:40:49.562 ioat_verify 00:40:49.562 is_zoned 00:40:49.562 iscsi_tgt 00:40:49.562 iscsi_tgt_bdev_io_wait 00:40:49.562 iscsi_tgt_calsoft 00:40:49.562 iscsi_tgt_data_digest 00:40:49.562 iscsi_tgt_digest 00:40:49.562 iscsi_tgt_digests 00:40:49.562 iscsi_tgt_ext4test 00:40:49.562 iscsi_tgt_filesystem 00:40:49.562 iscsi_tgt_filesystem_btrfs 00:40:49.562 iscsi_tgt_filesystem_ext4 00:40:49.562 iscsi_tgt_filesystem_xfs 00:40:49.562 iscsi_tgt_fio 00:40:49.562 iscsi_tgt_fuzz 00:40:49.562 iscsi_tgt_initiator 00:40:49.562 iscsi_tgt_ip_migration 00:40:49.562 iscsi_tgt_iscsi_lvol 00:40:49.562 iscsi_tgt_login_redirection 00:40:49.562 iscsi_tgt_multiconnection 00:40:49.562 iscsi_tgt_qos 00:40:49.562 iscsi_tgt_rbd 00:40:49.562 iscsi_tgt_reset 00:40:49.562 iscsi_tgt_resize 00:40:49.562 iscsi_tgt_rpc_config 00:40:49.562 iscsi_tgt_sock 00:40:49.562 iscsi_tgt_trace_record 00:40:49.562 kernel_target_abort 00:40:49.562 keyring_file 00:40:49.562 keyring_linux 00:40:49.562 llvm_fuzz 00:40:49.562 lvs_grow_clean 00:40:49.562 lvs_grow_dirty 00:40:49.562 no_shrink_alloc 00:40:49.562 nvme_boot_partition 00:40:49.562 nvme_bp 00:40:49.562 nvme_cli_cuse 00:40:49.562 nvme_cli_plugin 00:40:49.562 nvme_cmb 00:40:49.562 nvme_cuse 00:40:49.562 nvme_cuse_app 00:40:49.562 nvme_cuse_rpc 00:40:49.562 nvme_mount 00:40:49.562 nvme_ns_manage_cuse 00:40:49.562 nvme_opal 00:40:49.562 nvme_opal_bdevio 00:40:49.562 nvme_opal_bdevperf 00:40:49.562 nvme_opal_spdk_tgt 00:40:49.562 nvme_pmr 00:40:49.562 nvme_pmr_persistence 00:40:49.562 nvme_smartctl_cuse 00:40:49.562 nvme_zns 00:40:49.562 nvmf_abort 00:40:49.562 nvmf_abort_qd_sizes 00:40:49.562 nvmf_aer 00:40:49.562 nvmf_async_init 00:40:49.562 nvmf_auth_host 00:40:49.562 nvmf_auth_target 00:40:49.562 nvmf_bdev_io_wait 00:40:49.562 nvmf_bdevio 00:40:49.562 nvmf_bdevio_no_huge 00:40:49.562 nvmf_bdevperf 00:40:49.562 nvmf_connect_disconnect 00:40:49.562 nvmf_connect_stress 00:40:49.562 nvmf_control_msg_list 00:40:49.562 nvmf_delete_subsystem 00:40:49.562 nvmf_device_removal_pci_remove 00:40:49.562 nvmf_device_removal_pci_remove_no_srq 00:40:49.562 nvmf_dif 00:40:49.562 nvmf_digest 00:40:49.562 nvmf_digest_clean 00:40:49.562 nvmf_digest_dsa_initiator 00:40:49.562 nvmf_digest_dsa_target 00:40:49.562 nvmf_digest_error 00:40:49.562 nvmf_discovery_remove_ifc 00:40:49.562 nvmf_example 00:40:49.562 nvmf_failover 00:40:49.562 nvmf_fc 00:40:49.562 nvmf_filesystem 00:40:49.562 nvmf_filesystem_in_capsule 00:40:49.562 nvmf_filesystem_no_in_capsule 00:40:49.562 nvmf_fio_host 00:40:49.562 nvmf_fio_target 00:40:49.562 nvmf_fips 00:40:49.562 nvmf_fused_ordering 00:40:49.562 nvmf_fuzz 00:40:49.562 nvmf_host 00:40:49.562 nvmf_host_discovery 00:40:49.562 nvmf_host_management 00:40:49.562 nvmf_host_multipath 00:40:49.562 nvmf_host_multipath_status 00:40:49.562 nvmf_identify 00:40:49.562 nvmf_identify_kernel_target 00:40:49.562 nvmf_identify_passthru 00:40:49.562 nvmf_initiator_timeout 00:40:49.562 nvmf_interrupt 00:40:49.562 nvmf_invalid 00:40:49.562 nvmf_llvm_fuzz 00:40:49.562 nvmf_lvol 00:40:49.562 nvmf_lvs_grow 00:40:49.562 nvmf_mdns_discovery 00:40:49.562 nvmf_multiconnection 00:40:49.562 nvmf_multicontroller 00:40:49.562 nvmf_multitarget 00:40:49.562 nvmf_nmic 00:40:49.562 nvmf_ns_hotplug_stress 00:40:49.562 nvmf_ns_masking 00:40:49.562 nvmf_nvme_cli 00:40:49.562 nvmf_perf 00:40:49.562 nvmf_perf_adq 00:40:49.562 nvmf_queue_depth 00:40:49.562 nvmf_rdma 00:40:49.562 nvmf_referrals 00:40:49.562 nvmf_rpc 00:40:49.562 nvmf_shutdown 00:40:49.562 nvmf_shutdown_tc1 00:40:49.562 nvmf_shutdown_tc2 00:40:49.562 nvmf_shutdown_tc3 00:40:49.562 nvmf_shutdown_tc4 00:40:49.562 nvmf_srq_overwhelm 00:40:49.562 nvmf_target_core 00:40:49.562 nvmf_target_core_interrupt_mode 00:40:49.562 nvmf_target_disconnect 00:40:49.562 nvmf_target_disconnect_tc1 00:40:49.562 nvmf_target_disconnect_tc2 00:40:49.562 nvmf_target_disconnect_tc3 00:40:49.562 nvmf_target_discovery 00:40:49.562 nvmf_target_extra 00:40:49.562 nvmf_target_multipath 00:40:49.562 nvmf_tcp 00:40:49.562 nvmf_timeout 00:40:49.562 nvmf_tls 00:40:49.562 nvmf_vfio_user 00:40:49.562 nvmf_vfio_user_fuzz 00:40:49.562 nvmf_vfio_user_nvme_compliance 00:40:49.562 nvmf_wait_for_buf 00:40:49.562 nvmf_zcopy 00:40:49.562 ocf 00:40:49.562 ocf_bdevperf_iotypes 00:40:49.562 ocf_configuration_change 00:40:49.562 ocf_create_destruct 00:40:49.562 ocf_fio_modes 00:40:49.562 ocf_flush 00:40:49.562 ocf_multicore 00:40:49.562 ocf_remove 00:40:49.562 ocf_stats 00:40:49.562 odd_alloc 00:40:49.562 packaging 00:40:49.562 rpm_packaging 00:40:49.562 scanbuild_make 00:40:49.562 scheduler 00:40:49.562 scheduler_opts 00:40:49.562 scheduler_rpc 00:40:49.562 setup.sh 00:40:49.562 single_node_setup 00:40:49.562 spdk_dd_uring 00:40:49.563 spdk_target_abort 00:40:49.563 spdkcli_iscsi 00:40:49.563 spdkcli_nvmf_fc 00:40:49.563 spdkcli_nvmf_rdma 00:40:49.563 spdkcli_nvmf_tcp 00:40:49.563 spdkcli_rbd 00:40:49.563 spdkcli_virtio 00:40:49.563 static_as_default 00:40:49.563 unittest_bdev_compress 00:40:49.563 unittest_bdev_crypto 00:40:49.563 unittest_bdev_raid5f 00:40:49.563 unittest_dpdk_compressdev 00:40:49.563 unittest_lib_reduce 00:40:49.563 unittest_nvmf_fc 00:40:49.563 unittest_nvmf_fc_ls 00:40:49.563 unittest_nvmf_vfio_user 00:40:49.563 valgrind 00:40:49.563 vfio_llvm_fuzz 00:40:49.563 vhost_blk_cores_2ctrl 00:40:49.563 vhost_blk_fs_integrity 00:40:49.563 vhost_blk_hot_remove 00:40:49.563 vhost_blk_integrity 00:40:49.563 vhost_blockdev 00:40:49.563 vhost_fuzz 00:40:49.563 vhost_hotplug 00:40:49.563 vhost_migration 00:40:49.563 vhost_migration_tc1 00:40:49.563 vhost_migration_tc2 00:40:49.563 vhost_readonly 00:40:49.563 vhost_scsi_cores_2ctrl 00:40:49.563 vhost_scsi_fs_integrity 00:40:49.563 vhost_scsi_hot_remove 00:40:49.563 vhost_scsi_integrity 00:40:49.563 vhost_shared 00:40:49.563 vmd 00:40:49.563 vmd_bdev_svc 00:40:49.563 vmd_fio 00:40:49.563 vmd_hello_world 00:40:49.563 vmd_identify 00:40:49.563 vmd_perf 00:40:49.563 zoned_fio 00:40:49.563 00:40:49.563 00:40:49.563 -----Tests Missing UBSAN------ 00:40:49.563 accel_mlx5_copy 00:40:49.563 accel_mlx5_crc32c 00:40:49.563 accel_mlx5_crypto 00:40:49.563 accel_scan_dsa_modules 00:40:49.563 accel_scan_iaa_modules 00:40:49.563 autobuild 00:40:49.563 autobuild_build_doc 00:40:49.563 autobuild_check_dpdk_pci_api 00:40:49.563 autobuild_check_format 00:40:49.563 autobuild_check_so_deps 00:40:49.563 autobuild_external_code 00:40:49.563 autobuild_generated_files_check 00:40:49.563 autobuild_generated_files_check_post_clean 00:40:49.563 autobuild_header_dependency_check 00:40:49.563 autobuild_make_install 00:40:49.563 autobuild_make_uninstall 00:40:49.563 balanced 00:40:49.563 build_native_dpdk 00:40:49.563 build_release 00:40:49.563 build_rpm_from_gen_spec 00:40:49.563 build_shared_native_dpdk_rpm 00:40:49.563 build_shared_rpm 00:40:49.563 build_shared_rpm_with_rpmed_dpdk 00:40:49.563 busy 00:40:49.563 check_header_filenames 00:40:49.563 cmb_copy 00:40:49.563 confirm_abi_deps 00:40:49.563 confirm_makefile_deps 00:40:49.563 core_load 00:40:49.563 dma 00:40:49.563 external_make_accel_driver_shared 00:40:49.563 external_make_accel_driver_static 00:40:49.563 external_make_accel_module_shared 00:40:49.563 external_make_accel_module_static 00:40:49.563 external_make_hello_bdev_shared_combo 00:40:49.563 external_make_hello_bdev_shared_iso 00:40:49.563 external_make_hello_bdev_static 00:40:49.563 external_make_hello_no_bdev_shared_combo 00:40:49.563 external_make_hello_no_bdev_shared_iso 00:40:49.563 external_make_hello_no_bdev_static 00:40:49.563 external_make_nvme_shared 00:40:49.563 external_make_nvme_static 00:40:49.563 external_run_accel_driver_shared 00:40:49.563 external_run_accel_driver_static 00:40:49.563 external_run_accel_module_shared 00:40:49.563 external_run_accel_module_static 00:40:49.563 external_run_hello_bdev_shared_combo 00:40:49.563 external_run_hello_bdev_shared_iso 00:40:49.563 external_run_hello_bdev_static 00:40:49.563 external_run_hello_no_bdev_shared_combo 00:40:49.563 external_run_hello_no_bdev_shared_iso 00:40:49.563 external_run_hello_no_bdev_static 00:40:49.563 external_run_nvme_shared 00:40:49.563 external_run_nvme_static 00:40:49.563 fio_dif_1_default 00:40:49.563 fio_dif_1_multi_subsystems 00:40:49.563 fio_dif_digest 00:40:49.563 fio_dif_rand_params 00:40:49.563 ftl_restore_fast 00:40:49.563 is_zoned 00:40:49.563 iscsi_tgt_data_digest 00:40:49.563 iscsi_tgt_ext4test 00:40:49.563 kernel_target_abort 00:40:49.563 keyring_file 00:40:49.563 keyring_linux 00:40:49.563 nvme_boot_partition 00:40:49.563 nvme_bp 00:40:49.563 nvme_cmb 00:40:49.563 nvme_opal 00:40:49.563 nvme_opal_bdevio 00:40:49.563 nvme_opal_bdevperf 00:40:49.563 nvme_opal_spdk_tgt 00:40:49.563 nvme_pmr 00:40:49.563 nvme_pmr_persistence 00:40:49.563 nvme_zns 00:40:49.563 nvmf_abort_qd_sizes 00:40:49.563 nvmf_auth_host 00:40:49.563 nvmf_bdevperf 00:40:49.563 nvmf_device_removal_pci_remove 00:40:49.563 nvmf_device_removal_pci_remove_no_srq 00:40:49.563 nvmf_dif 00:40:49.563 nvmf_digest 00:40:49.563 nvmf_digest_clean 00:40:49.563 nvmf_digest_dsa_initiator 00:40:49.563 nvmf_digest_dsa_target 00:40:49.563 nvmf_digest_error 00:40:49.563 nvmf_fc 00:40:49.563 nvmf_fuzz 00:40:49.563 nvmf_host 00:40:49.563 nvmf_host_discovery 00:40:49.563 nvmf_host_multipath 00:40:49.563 nvmf_identify_passthru 00:40:49.563 nvmf_initiator_timeout 00:40:49.563 nvmf_interrupt 00:40:49.563 nvmf_mdns_discovery 00:40:49.563 nvmf_multiconnection 00:40:49.563 nvmf_multicontroller 00:40:49.563 nvmf_rdma 00:40:49.563 nvmf_target_core_interrupt_mode 00:40:49.563 nvmf_target_disconnect 00:40:49.563 nvmf_target_disconnect_tc1 00:40:49.563 nvmf_target_disconnect_tc2 00:40:49.563 nvmf_target_disconnect_tc3 00:40:49.563 nvmf_tcp 00:40:49.563 nvmf_timeout 00:40:49.563 packaging 00:40:49.563 rpm_packaging 00:40:49.563 scanbuild_make 00:40:49.563 spdk_target_abort 00:40:49.563 spdkcli_nvmf_fc 00:40:49.563 spdkcli_nvmf_rdma 00:40:49.563 spdkcli_nvmf_tcp 00:40:49.563 unittest_bdev_compress 00:40:49.563 unittest_bdev_crypto 00:40:49.563 unittest_bdev_raid5f 00:40:49.563 unittest_dpdk_compressdev 00:40:49.563 unittest_lib_reduce 00:40:49.563 unittest_nvmf_fc 00:40:49.563 unittest_nvmf_fc_ls 00:40:49.563 unittest_nvmf_vfio_user 00:40:49.563 valgrind 00:40:49.563 vhost_blk_cores_2ctrl 00:40:49.563 vhost_blk_fs_integrity 00:40:49.563 vhost_blk_hot_remove 00:40:49.563 vhost_blk_integrity 00:40:49.563 vhost_hotplug 00:40:49.563 vhost_migration 00:40:49.563 vhost_migration_tc1 00:40:49.563 vhost_migration_tc2 00:40:49.563 vhost_readonly 00:40:49.563 vhost_scsi_cores_2ctrl 00:40:49.563 vhost_scsi_fs_integrity 00:40:49.563 vhost_scsi_hot_remove 00:40:49.563 vhost_scsi_integrity 00:40:49.563 vmd 00:40:49.563 vmd_bdev_svc 00:40:49.563 vmd_fio 00:40:49.563 vmd_hello_world 00:40:49.563 vmd_identify 00:40:49.563 vmd_perf 00:40:49.563 zoned_fio 00:40:49.563 Not all tests were run. Failing the build. 00:40:49.563 ['dma', 'fio_dif_1_default', 'fio_dif_1_multi_subsystems', 'fio_dif_digest', 'fio_dif_rand_params', 'kernel_target_abort', 'keyring_file', 'nvmf_abort_qd_sizes', 'nvmf_auth_host', 'nvmf_bdevperf', 'nvmf_dif', 'nvmf_digest', 'nvmf_digest_clean', 'nvmf_digest_error', 'nvmf_host', 'nvmf_host_discovery', 'nvmf_host_multipath', 'nvmf_identify_passthru', 'nvmf_interrupt', 'nvmf_mdns_discovery', 'nvmf_multicontroller', 'nvmf_rdma', 'nvmf_target_core_interrupt_mode', 'nvmf_target_disconnect', 'nvmf_target_disconnect_tc1', 'nvmf_target_disconnect_tc2', 'nvmf_target_disconnect_tc3', 'nvmf_tcp', 'nvmf_timeout', 'spdk_target_abort', 'spdkcli_nvmf_rdma', 'spdkcli_nvmf_tcp'] 00:40:49.563 + compress_coverage_and_docs 00:40:49.563 + echo 'Start compress coverage and docs' 00:40:49.563 Start compress coverage and docs 00:40:49.563 + tar -C coverage -czf coverage_autotest-per-patch_130487.tar.gz ./ --remove-files 00:40:50.930 + tar -C ut_coverage -czf ut_coverage_autotest-per-patch_130487.tar.gz ./ --remove-files 00:40:51.494 + tar -C doc -czf doc_autotest-per-patch_130487.tar.gz ./ --remove-files 00:40:51.752 + [[ -d llvm ]] 00:40:51.752 + true 00:40:51.752 + echo 'End compress coverage and docs' 00:40:51.752 End compress coverage and docs 00:40:51.752 + remove_partial_coverage_files 00:40:51.752 + find . -name 'cov_*.info' -delete 00:40:51.752 + echo 'End stage post_gen_coverage.sh' 00:40:51.752 End stage post_gen_coverage.sh 00:40:51.765 [Pipeline] } 00:40:51.768 ERROR: script returned exit code 1 00:40:51.793 [Pipeline] // catchError 00:40:51.802 [Pipeline] catchError 00:40:51.803 [Pipeline] { 00:40:51.819 [Pipeline] dir 00:40:51.820 Running in /var/jenkins/workspace/autotest-per-patch_2/post_process 00:40:51.821 [Pipeline] {