00:00:00.000 Started by user sys_sgci 00:00:00.009 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/autotest-per-patch_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-upstream/autotest.groovy 00:00:00.010 The recommended git tool is: git 00:00:00.011 using credential 00000000-0000-0000-0000-000000000002 00:00:00.013 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/autotest-per-patch_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.026 Fetching changes from the remote Git repository 00:00:00.028 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.039 Using shallow fetch with depth 1 00:00:00.039 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.039 > git --version # timeout=10 00:00:00.050 > git --version # 'git version 2.39.2' 00:00:00.050 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.050 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.050 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:02.118 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:02.131 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:02.145 Checking out Revision c7986954d8037b9c61764d44ed2af24625b251c6 (FETCH_HEAD) 00:00:02.145 > git config core.sparsecheckout # timeout=10 00:00:02.158 > git read-tree -mu HEAD # timeout=10 00:00:02.176 > git checkout -f c7986954d8037b9c61764d44ed2af24625b251c6 # timeout=5 00:00:02.194 Commit message: "inventory/dev: add missing long names" 00:00:02.195 > git rev-list --no-walk c7986954d8037b9c61764d44ed2af24625b251c6 # timeout=10 00:00:02.797 [Pipeline] Start of Pipeline 00:00:02.812 [Pipeline] library 00:00:02.814 Loading library shm_lib@master 00:00:02.814 Library shm_lib@master is cached. Copying from home. 00:00:02.841 [Pipeline] node 00:00:02.848 Running on ME2 in /var/jenkins/workspace/autotest-per-patch_3 00:00:02.853 [Pipeline] { 00:00:02.867 [Pipeline] cleanWs 00:00:02.875 [WS-CLEANUP] Deleting project workspace... 00:00:02.876 [WS-CLEANUP] Deferred wipeout is used... 00:00:02.881 [WS-CLEANUP] done 00:00:02.885 [Pipeline] stage 00:00:02.889 [Pipeline] { (Prologue) 00:00:02.981 [Pipeline] withCredentials 00:00:02.992 > git --version # timeout=10 00:00:03.003 > git --version # 'git version 2.39.2' 00:00:03.022 Masking supported pattern matches of $GIT_USERNAME or $GIT_PASSWORD or $GIT_ASKPASS 00:00:03.024 [Pipeline] { 00:00:03.032 [Pipeline] retry 00:00:03.034 [Pipeline] { 00:00:03.197 [Pipeline] sh 00:00:03.474 + git ls-remote https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master 00:00:05.396 [Pipeline] } 00:00:05.422 [Pipeline] // retry 00:00:05.429 [Pipeline] } 00:00:05.453 [Pipeline] // withCredentials 00:00:05.463 [Pipeline] nodesByLabel 00:00:05.465 Found a total of 1 nodes with the 'sorcerer' label 00:00:05.480 [Pipeline] httpRequest 00:00:05.484 HttpMethod: GET 00:00:05.485 URL: http://10.211.164.101/packages/jbp_c7986954d8037b9c61764d44ed2af24625b251c6.tar.gz 00:00:05.485 Sending request to url: http://10.211.164.101/packages/jbp_c7986954d8037b9c61764d44ed2af24625b251c6.tar.gz 00:00:05.486 Response Code: HTTP/1.1 200 OK 00:00:05.487 Success: Status code 200 is in the accepted range: 200,404 00:00:05.487 Saving response body to /var/jenkins/workspace/autotest-per-patch_3/jbp_c7986954d8037b9c61764d44ed2af24625b251c6.tar.gz 00:00:05.629 [Pipeline] sh 00:00:05.921 + tar --no-same-owner -xf jbp_c7986954d8037b9c61764d44ed2af24625b251c6.tar.gz 00:00:05.950 [Pipeline] httpRequest 00:00:05.956 HttpMethod: GET 00:00:05.957 URL: http://10.211.164.101/packages/spdk_b7a2519d9a8bfd4d92b109ad21c121341f8d5e38.tar.gz 00:00:05.957 Sending request to url: http://10.211.164.101/packages/spdk_b7a2519d9a8bfd4d92b109ad21c121341f8d5e38.tar.gz 00:00:05.958 Response Code: HTTP/1.1 404 Not Found 00:00:05.959 Success: Status code 404 is in the accepted range: 200,404 00:00:05.960 Saving response body to /var/jenkins/workspace/autotest-per-patch_3/spdk_b7a2519d9a8bfd4d92b109ad21c121341f8d5e38.tar.gz 00:00:05.972 [Pipeline] sh 00:00:06.259 + rm -f spdk_b7a2519d9a8bfd4d92b109ad21c121341f8d5e38.tar.gz 00:00:06.276 [Pipeline] node 00:00:06.286 Running on GP10 in /var/jenkins/workspace/autotest-per-patch 00:00:06.292 [Pipeline] { 00:00:06.312 [Pipeline] cleanWs 00:00:06.323 [WS-CLEANUP] Deleting project workspace... 00:00:06.323 [WS-CLEANUP] Deferred wipeout is used... 00:00:06.329 [WS-CLEANUP] done 00:00:06.334 [Pipeline] sh 00:00:06.620 + find /storage/packages/ -type f -mtime +34 -print -delete 00:00:06.634 [Pipeline] retry 00:00:06.636 [Pipeline] { 00:00:06.658 [Pipeline] checkout 00:00:06.665 The recommended git tool is: NONE 00:00:06.678 using credential 00000000-0000-0000-0000-000000000002 00:00:06.684 Cloning the remote Git repository 00:00:06.687 Honoring refspec on initial clone 00:00:06.690 Cloning repository https://review.spdk.io/gerrit/a/spdk/spdk 00:00:06.691 > git init /var/jenkins/workspace/autotest-per-patch/spdk # timeout=10 00:00:06.698 Using reference repository: /var/ci_repos/spdk_multi 00:00:06.698 Fetching upstream changes from https://review.spdk.io/gerrit/a/spdk/spdk 00:00:06.698 > git --version # timeout=10 00:00:06.701 > git --version # 'git version 2.42.0' 00:00:06.701 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:06.702 Setting http proxy: proxy-dmz.intel.com:911 00:00:06.702 > git fetch --tags --force --progress -- https://review.spdk.io/gerrit/a/spdk/spdk refs/changes/60/23160/2 +refs/heads/master:refs/remotes/origin/master # timeout=10 00:00:23.496 Avoid second fetch 00:00:23.510 Checking out Revision b7a2519d9a8bfd4d92b109ad21c121341f8d5e38 (FETCH_HEAD) 00:00:23.817 Commit message: "python/rpc: Unify parameters in all calls bdev.py" 00:00:23.825 First time build. Skipping changelog. 00:00:23.479 > git config remote.origin.url https://review.spdk.io/gerrit/a/spdk/spdk # timeout=10 00:00:23.484 > git config --add remote.origin.fetch refs/changes/60/23160/2 # timeout=10 00:00:23.488 > git config --add remote.origin.fetch +refs/heads/master:refs/remotes/origin/master # timeout=10 00:00:23.498 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:23.505 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:23.512 > git config core.sparsecheckout # timeout=10 00:00:23.515 > git checkout -f b7a2519d9a8bfd4d92b109ad21c121341f8d5e38 # timeout=10 00:00:23.819 > git rev-list --no-walk f9277e176fb220009c66a8e88912fd6deb514dde # timeout=10 00:00:23.830 > git remote # timeout=10 00:00:23.833 > git submodule init # timeout=10 00:00:23.882 > git submodule sync # timeout=10 00:00:23.927 > git config --get remote.origin.url # timeout=10 00:00:23.934 > git submodule init # timeout=10 00:00:23.978 > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10 00:00:23.981 > git config --get submodule.dpdk.url # timeout=10 00:00:23.985 > git remote # timeout=10 00:00:23.988 > git config --get remote.origin.url # timeout=10 00:00:23.991 > git config -f .gitmodules --get submodule.dpdk.path # timeout=10 00:00:23.995 > git config --get submodule.intel-ipsec-mb.url # timeout=10 00:00:23.998 > git remote # timeout=10 00:00:24.001 > git config --get remote.origin.url # timeout=10 00:00:24.005 > git config -f .gitmodules --get submodule.intel-ipsec-mb.path # timeout=10 00:00:24.008 > git config --get submodule.isa-l.url # timeout=10 00:00:24.011 > git remote # timeout=10 00:00:24.015 > git config --get remote.origin.url # timeout=10 00:00:24.018 > git config -f .gitmodules --get submodule.isa-l.path # timeout=10 00:00:24.022 > git config --get submodule.ocf.url # timeout=10 00:00:24.025 > git remote # timeout=10 00:00:24.028 > git config --get remote.origin.url # timeout=10 00:00:24.032 > git config -f .gitmodules --get submodule.ocf.path # timeout=10 00:00:24.035 > git config --get submodule.libvfio-user.url # timeout=10 00:00:24.039 > git remote # timeout=10 00:00:24.042 > git config --get remote.origin.url # timeout=10 00:00:24.045 > git config -f .gitmodules --get submodule.libvfio-user.path # timeout=10 00:00:24.049 > git config --get submodule.xnvme.url # timeout=10 00:00:24.053 > git remote # timeout=10 00:00:24.056 > git config --get remote.origin.url # timeout=10 00:00:24.060 > git config -f .gitmodules --get submodule.xnvme.path # timeout=10 00:00:24.063 > git config --get submodule.isa-l-crypto.url # timeout=10 00:00:24.066 > git remote # timeout=10 00:00:24.069 > git config --get remote.origin.url # timeout=10 00:00:24.073 > git config -f .gitmodules --get submodule.isa-l-crypto.path # timeout=10 00:00:24.076 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:24.076 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:24.077 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:24.077 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:24.077 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:24.077 Setting http proxy: proxy-dmz.intel.com:911 00:00:24.077 Setting http proxy: proxy-dmz.intel.com:911 00:00:24.077 > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi intel-ipsec-mb # timeout=10 00:00:24.077 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:24.077 > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi dpdk # timeout=10 00:00:24.077 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:24.077 Setting http proxy: proxy-dmz.intel.com:911 00:00:24.077 > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi ocf # timeout=10 00:00:24.077 Setting http proxy: proxy-dmz.intel.com:911 00:00:24.077 > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi isa-l # timeout=10 00:00:24.077 Setting http proxy: proxy-dmz.intel.com:911 00:00:24.077 > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi libvfio-user # timeout=10 00:00:24.078 Setting http proxy: proxy-dmz.intel.com:911 00:00:24.078 > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi xnvme # timeout=10 00:00:24.078 Setting http proxy: proxy-dmz.intel.com:911 00:00:24.078 > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi isa-l-crypto # timeout=10 00:00:33.117 [Pipeline] dir 00:00:33.117 Running in /var/jenkins/workspace/autotest-per-patch/spdk 00:00:33.118 [Pipeline] { 00:00:33.131 [Pipeline] sh 00:00:33.417 ++ nproc 00:00:33.417 + threads=48 00:00:33.417 + git repack -a -d --threads=48 00:00:41.549 + git submodule foreach git repack -a -d --threads=48 00:00:41.549 Entering 'dpdk' 00:00:45.750 Entering 'intel-ipsec-mb' 00:00:46.008 Entering 'isa-l' 00:00:46.008 Entering 'isa-l-crypto' 00:00:46.268 Entering 'libvfio-user' 00:00:46.268 Entering 'ocf' 00:00:46.528 Entering 'xnvme' 00:00:46.787 + find .git -type f -name alternates -print -delete 00:00:46.787 .git/modules/libvfio-user/objects/info/alternates 00:00:46.787 .git/modules/dpdk/objects/info/alternates 00:00:46.787 .git/modules/ocf/objects/info/alternates 00:00:46.787 .git/modules/intel-ipsec-mb/objects/info/alternates 00:00:46.787 .git/modules/isa-l/objects/info/alternates 00:00:46.788 .git/modules/xnvme/objects/info/alternates 00:00:46.788 .git/modules/isa-l-crypto/objects/info/alternates 00:00:46.788 .git/objects/info/alternates 00:00:46.799 [Pipeline] } 00:00:46.820 [Pipeline] // dir 00:00:46.826 [Pipeline] } 00:00:46.848 [Pipeline] // retry 00:00:46.855 [Pipeline] sh 00:00:47.137 + tar -cf spdk_b7a2519d9a8bfd4d92b109ad21c121341f8d5e38.tar.gz -I pigz spdk 00:00:47.723 [Pipeline] httpRequest 00:00:47.731 HttpMethod: PUT 00:00:47.732 URL: http://10.211.164.101/cgi-bin/sorcerer.py?group=packages&filename=spdk_b7a2519d9a8bfd4d92b109ad21c121341f8d5e38.tar.gz 00:00:47.732 Sending request to url: http://10.211.164.101/cgi-bin/sorcerer.py?group=packages&filename=spdk_b7a2519d9a8bfd4d92b109ad21c121341f8d5e38.tar.gz 00:00:48.574 Response Code: HTTP/1.1 200 OK 00:00:48.579 Success: Status code 200 is in the accepted range: 200 00:00:48.584 [Pipeline] echo 00:00:48.585 00:00:48.585 Locking 00:00:48.585 Waited 0s for lock 00:00:48.585 Everything Fine. Saved: /storage/packages/spdk_b7a2519d9a8bfd4d92b109ad21c121341f8d5e38.tar.gz 00:00:48.585 00:00:48.591 [Pipeline] cleanWs 00:00:48.599 [WS-CLEANUP] Deleting project workspace... 00:00:48.599 [WS-CLEANUP] Deferred wipeout is used... 00:00:48.606 [WS-CLEANUP] done 00:00:48.609 [Pipeline] } 00:00:48.643 [Pipeline] // node 00:00:48.652 [Pipeline] retry 00:00:48.654 [Pipeline] { 00:00:48.672 [Pipeline] httpRequest 00:00:48.676 HttpMethod: GET 00:00:48.677 URL: http://10.211.164.101/packages/spdk_b7a2519d9a8bfd4d92b109ad21c121341f8d5e38.tar.gz 00:00:48.677 Sending request to url: http://10.211.164.101/packages/spdk_b7a2519d9a8bfd4d92b109ad21c121341f8d5e38.tar.gz 00:00:48.679 Response Code: HTTP/1.1 200 OK 00:00:48.680 Success: Status code 200 is in the accepted range: 200,404 00:00:48.680 Saving response body to /var/jenkins/workspace/autotest-per-patch_3/spdk_b7a2519d9a8bfd4d92b109ad21c121341f8d5e38.tar.gz 00:00:52.120 [Pipeline] } 00:00:52.138 [Pipeline] // retry 00:00:52.146 [Pipeline] sh 00:00:52.430 + tar --no-same-owner -xf spdk_b7a2519d9a8bfd4d92b109ad21c121341f8d5e38.tar.gz 00:00:54.389 [Pipeline] sh 00:00:54.662 + git -C spdk log --oneline -n5 00:00:54.662 b7a2519d9 python/rpc: Unify parameters in all calls bdev.py 00:00:54.662 3389cbfa6 python/rpc: Fix mismatches in bdev rpc docs 00:00:54.662 b68ae4fb9 nvmf-tcp: Added queue depth tracing support 00:00:54.662 46d7b94f0 nvmf-rdma: Added queue depth tracing support 00:00:54.662 0127345c8 nvme-tcp: Added queue depth tracing support 00:00:54.677 [Pipeline] setCustomBuildProperty 00:00:54.682 [Pipeline] setCustomBuildProperty 00:00:54.687 [Pipeline] catchError 00:00:54.688 [Pipeline] { 00:00:54.702 [Pipeline] sh 00:00:54.978 + git -C spdk describe --tags --abbrev=0 origin/master 00:00:54.990 [Pipeline] sh 00:00:55.264 + git -C spdk describe --tags --abbrev=0 --exclude=LTS HEAD 00:00:55.281 [Pipeline] echo 00:00:55.283 Branch: master 00:00:55.290 [Pipeline] fileExists 00:00:55.305 [Pipeline] readJSON 00:00:55.314 [Pipeline] } 00:00:55.330 [Pipeline] // catchError 00:00:55.334 [Pipeline] } 00:00:55.352 [Pipeline] // stage 00:00:55.362 [Pipeline] catchError 00:00:55.363 [Pipeline] { 00:00:55.377 [Pipeline] stage 00:00:55.379 [Pipeline] { (Pre tests) 00:00:55.411 [Pipeline] parallel 00:00:55.418 [Pipeline] { (Branch: check-format-docker-autotest) 00:00:55.418 [Pipeline] { (Branch: check-so-deps-docker-autotest) 00:00:55.419 [Pipeline] { (Branch: doc-docker-autotest) 00:00:55.420 [Pipeline] { (Branch: build-files-docker-autotest) 00:00:55.433 [Pipeline] retry 00:00:55.434 [Pipeline] { 00:00:55.437 [Pipeline] retry 00:00:55.438 [Pipeline] { 00:00:55.441 [Pipeline] retry 00:00:55.442 [Pipeline] { 00:00:55.445 [Pipeline] retry 00:00:55.446 [Pipeline] { 00:00:55.461 [Pipeline] build 00:00:55.463 Scheduling project: check-format-docker-autotest 00:00:55.469 [Pipeline] build 00:00:55.471 Scheduling project: check-so-deps-docker-autotest 00:00:55.477 [Pipeline] build 00:00:55.479 Scheduling project: doc-docker-autotest 00:00:55.484 [Pipeline] build 00:00:55.485 Scheduling project: build-files-docker-autotest 00:01:05.104 Starting building: check-format-docker-autotest #22167 00:01:05.107 Starting building: build-files-docker-autotest #22156 00:01:05.112 Starting building: doc-docker-autotest #22347 00:01:05.116 Starting building: check-so-deps-docker-autotest #22180 00:01:47.412 Build doc-docker-autotest #22347 completed: SUCCESS 00:01:47.415 [Pipeline] } 00:01:47.449 [Pipeline] // retry 00:01:47.455 [Pipeline] } 00:02:03.923 Build check-format-docker-autotest #22167 completed: SUCCESS 00:02:03.925 [Pipeline] } 00:02:03.960 [Pipeline] // retry 00:02:03.966 [Pipeline] } 00:03:20.888 Build build-files-docker-autotest #22156 completed: SUCCESS 00:03:20.892 [Pipeline] } 00:03:20.926 [Pipeline] // retry 00:03:20.933 [Pipeline] } 00:04:08.659 Build check-so-deps-docker-autotest #22180 completed: SUCCESS 00:04:08.662 [Pipeline] } 00:04:08.697 [Pipeline] // retry 00:04:08.702 [Pipeline] } 00:04:08.766 [Pipeline] // parallel 00:04:08.772 [Pipeline] } 00:04:08.797 [Pipeline] // stage 00:04:08.803 [Pipeline] } 00:04:08.832 [Pipeline] // catchError 00:04:08.841 [Pipeline] catchError 00:04:08.843 [Pipeline] { 00:04:08.863 [Pipeline] stage 00:04:08.865 [Pipeline] { (Tests) 00:04:09.040 [Pipeline] parallel 00:04:09.124 [Pipeline] { (Branch: unittest-clang-docker-autotest) 00:04:09.125 [Pipeline] { (Branch: unittest-main-docker-autotest) 00:04:09.126 [Pipeline] { (Branch: autobuild-external-vg-autotest) 00:04:09.127 [Pipeline] { (Branch: scan-build-docker-autotest) 00:04:09.128 [Pipeline] { (Branch: unittest-valgrind-docker-autotest) 00:04:09.129 [Pipeline] { (Branch: lvol-vg-autotest) 00:04:09.130 [Pipeline] { (Branch: vhost-initiator-vg-autotest) 00:04:09.131 [Pipeline] { (Branch: nvmf-tcp-vg-autotest) 00:04:09.132 [Pipeline] { (Branch: nvmf-tcp-uring-vg-autotest) 00:04:09.133 [Pipeline] { (Branch: nvme-vg-autotest) 00:04:09.134 [Pipeline] { (Branch: centos7-vg-autotest) 00:04:09.135 [Pipeline] { (Branch: rocky9-vg-autotest) 00:04:09.136 [Pipeline] { (Branch: ubuntu20-vg-autotest) 00:04:09.137 [Pipeline] { (Branch: ubuntu22-vg-autotest) 00:04:09.138 [Pipeline] { (Branch: freebsd-vg-autotest) 00:04:09.139 [Pipeline] { (Branch: iscsi-vg-autotest) 00:04:09.140 [Pipeline] { (Branch: iscsi-uring-vg-autotest) 00:04:09.141 [Pipeline] { (Branch: zns-vg-autotest) 00:04:09.143 [Pipeline] { (Branch: nvme-cmb-pmr-vg-autotest) 00:04:09.143 [Pipeline] { (Branch: BlobFS-phy-autotest) 00:04:09.144 [Pipeline] { (Branch: crypto-phy-autotest) 00:04:09.145 [Pipeline] { (Branch: vhost-phy-autotest) 00:04:09.146 [Pipeline] { (Branch: nvmf-phy-autotest) 00:04:09.147 [Pipeline] { (Branch: nvmf-tcp-phy-autotest) 00:04:09.148 [Pipeline] { (Branch: nvme-phy-autotest) 00:04:09.149 [Pipeline] { (Branch: vfio-user-phy-autotest) 00:04:09.150 [Pipeline] { (Branch: short-fuzz-phy-autotest) 00:04:09.152 [Pipeline] { (Branch: dsa-phy-autotest) 00:04:09.152 [Pipeline] { (Branch: packaging-docker-autotest) 00:04:09.185 [Pipeline] retry 00:04:09.187 [Pipeline] { 00:04:09.191 [Pipeline] retry 00:04:09.193 [Pipeline] { 00:04:09.198 [Pipeline] retry 00:04:09.199 [Pipeline] { 00:04:09.204 [Pipeline] retry 00:04:09.206 [Pipeline] { 00:04:09.210 [Pipeline] retry 00:04:09.212 [Pipeline] { 00:04:09.216 [Pipeline] retry 00:04:09.218 [Pipeline] { 00:04:09.221 [Pipeline] retry 00:04:09.222 [Pipeline] { 00:04:09.226 [Pipeline] retry 00:04:09.227 [Pipeline] { 00:04:09.230 [Pipeline] retry 00:04:09.231 [Pipeline] { 00:04:09.233 [Pipeline] retry 00:04:09.234 [Pipeline] { 00:04:09.238 [Pipeline] retry 00:04:09.239 [Pipeline] { 00:04:09.244 [Pipeline] retry 00:04:09.245 [Pipeline] { 00:04:09.249 [Pipeline] retry 00:04:09.250 [Pipeline] { 00:04:09.254 [Pipeline] retry 00:04:09.255 [Pipeline] { 00:04:09.259 [Pipeline] retry 00:04:09.260 [Pipeline] { 00:04:09.264 [Pipeline] retry 00:04:09.265 [Pipeline] { 00:04:09.269 [Pipeline] retry 00:04:09.270 [Pipeline] { 00:04:09.274 [Pipeline] retry 00:04:09.275 [Pipeline] { 00:04:09.279 [Pipeline] retry 00:04:09.281 [Pipeline] { 00:04:09.285 [Pipeline] retry 00:04:09.286 [Pipeline] { 00:04:09.290 [Pipeline] retry 00:04:09.292 [Pipeline] { 00:04:09.296 [Pipeline] retry 00:04:09.297 [Pipeline] { 00:04:09.301 [Pipeline] retry 00:04:09.302 [Pipeline] { 00:04:09.305 [Pipeline] retry 00:04:09.306 [Pipeline] { 00:04:09.309 [Pipeline] retry 00:04:09.310 [Pipeline] { 00:04:09.314 [Pipeline] retry 00:04:09.315 [Pipeline] { 00:04:09.318 [Pipeline] retry 00:04:09.319 [Pipeline] { 00:04:09.323 [Pipeline] retry 00:04:09.324 [Pipeline] { 00:04:09.327 [Pipeline] retry 00:04:09.328 [Pipeline] { 00:04:09.353 [Pipeline] build 00:04:09.357 Scheduling project: unittest-clang-docker-autotest 00:04:09.365 [Pipeline] build 00:04:09.369 Scheduling project: unittest-main-docker-autotest 00:04:09.379 [Pipeline] build 00:04:09.382 Scheduling project: autobuild-external-vg-autotest 00:04:09.390 [Pipeline] build 00:04:09.393 Scheduling project: scan-build-docker-autotest 00:04:09.402 [Pipeline] build 00:04:09.404 Scheduling project: unittest-valgrind-docker-autotest 00:04:09.409 [Pipeline] build 00:04:09.410 Scheduling project: lvol-vg-autotest 00:04:09.415 [Pipeline] build 00:04:09.417 Scheduling project: vhost-initiator-vg-autotest 00:04:09.421 [Pipeline] build 00:04:09.423 Scheduling project: nvmf-tcp-vg-autotest 00:04:09.428 [Pipeline] build 00:04:09.430 Scheduling project: nvmf-tcp-uring-vg-autotest 00:04:09.434 [Pipeline] build 00:04:09.436 Scheduling project: nvme-vg-autotest 00:04:09.442 [Pipeline] build 00:04:09.444 Scheduling project: centos7-vg-autotest 00:04:09.450 [Pipeline] build 00:04:09.452 Scheduling project: rocky9-vg-autotest 00:04:09.457 [Pipeline] build 00:04:09.459 Scheduling project: ubuntu20-vg-autotest 00:04:09.465 [Pipeline] build 00:04:09.467 Scheduling project: ubuntu22-vg-autotest 00:04:09.473 [Pipeline] build 00:04:09.476 Scheduling project: freebsd-vg-autotest 00:04:09.482 [Pipeline] build 00:04:09.484 Scheduling project: iscsi-vg-autotest 00:04:09.489 [Pipeline] build 00:04:09.491 Scheduling project: iscsi-uring-vg-autotest 00:04:09.497 [Pipeline] build 00:04:09.499 Scheduling project: zns-vg-autotest 00:04:09.504 [Pipeline] build 00:04:09.505 Scheduling project: nvme-cmb-pmr-vg-autotest 00:04:09.510 [Pipeline] build 00:04:09.512 Scheduling project: BlobFS-phy-autotest 00:04:09.517 [Pipeline] build 00:04:09.519 Scheduling project: crypto-phy-autotest 00:04:09.523 [Pipeline] build 00:04:09.525 Scheduling project: vhost-phy-autotest 00:04:09.530 [Pipeline] build 00:04:09.532 Scheduling project: nvmf-phy-autotest 00:04:09.538 [Pipeline] build 00:04:09.539 Scheduling project: nvmf-tcp-phy-autotest 00:04:09.545 [Pipeline] build 00:04:09.547 Scheduling project: nvme-phy-autotest 00:04:09.552 [Pipeline] build 00:04:09.554 Scheduling project: vfio-user-phy-autotest 00:04:09.560 [Pipeline] build 00:04:09.562 Scheduling project: short-fuzz-phy-autotest 00:04:09.567 [Pipeline] build 00:04:09.569 Scheduling project: dsa-phy-autotest 00:04:09.574 [Pipeline] build 00:04:09.576 Scheduling project: packaging-docker-autotest 00:04:15.487 Starting building: BlobFS-phy-autotest #26229 00:04:15.490 Starting building: vfio-user-phy-autotest #26231 00:04:15.492 Starting building: scan-build-docker-autotest #19886 00:04:15.496 Starting building: dsa-phy-autotest #4923 00:04:15.499 Starting building: short-fuzz-phy-autotest #26220 00:04:15.506 Starting building: vhost-phy-autotest #26248 00:04:15.509 Starting building: unittest-clang-docker-autotest #19883 00:04:15.512 Starting building: crypto-phy-autotest #26223 00:04:15.515 Starting building: iscsi-uring-vg-autotest #77408 00:04:15.520 Starting building: nvme-phy-autotest #72395 00:04:15.523 Starting building: autobuild-external-vg-autotest #19846 00:04:15.526 Starting building: unittest-main-docker-autotest #19884 00:04:15.530 Starting building: unittest-valgrind-docker-autotest #19887 00:04:15.534 Starting building: ubuntu22-vg-autotest #37836 00:04:15.537 Starting building: nvmf-tcp-vg-autotest #77494 00:04:15.540 Starting building: lvol-vg-autotest #77452 00:04:15.542 Starting building: rocky9-vg-autotest #16113 00:04:15.548 Starting building: packaging-docker-autotest #19885 00:04:15.551 Starting building: nvmf-tcp-phy-autotest #72354 00:04:15.553 Starting building: centos7-vg-autotest #73682 00:04:15.557 Starting building: nvmf-phy-autotest #72467 00:04:15.560 Starting building: nvme-cmb-pmr-vg-autotest #78626 00:04:15.563 Starting building: iscsi-vg-autotest #77541 00:04:15.568 Starting building: nvmf-tcp-uring-vg-autotest #77428 00:04:15.571 Starting building: zns-vg-autotest #76609 00:04:15.572 Starting building: ubuntu20-vg-autotest #73822 00:04:15.575 Starting building: nvme-vg-autotest #77503 00:04:15.579 Starting building: vhost-initiator-vg-autotest #77523 00:04:15.581 Starting building: freebsd-vg-autotest #59146 00:07:21.190 Build unittest-clang-docker-autotest #19883 completed: SUCCESS 00:07:21.192 [Pipeline] } 00:07:21.239 [Pipeline] // retry 00:07:21.247 [Pipeline] } 00:08:06.430 Build packaging-docker-autotest #19885 completed: SUCCESS 00:08:06.432 [Pipeline] } 00:08:06.470 [Pipeline] // retry 00:08:06.476 [Pipeline] } 00:08:50.064 Build scan-build-docker-autotest #19886 completed: SUCCESS 00:08:50.067 [Pipeline] } 00:08:50.118 [Pipeline] // retry 00:08:50.125 [Pipeline] } 00:09:57.848 Build unittest-main-docker-autotest #19884 completed: SUCCESS 00:09:57.852 [Pipeline] } 00:09:57.903 [Pipeline] // retry 00:09:57.912 [Pipeline] } 00:11:45.760 Build short-fuzz-phy-autotest #26220 completed: SUCCESS 00:11:45.763 [Pipeline] } 00:11:45.812 [Pipeline] // retry 00:11:45.819 [Pipeline] } 00:13:25.025 Build unittest-valgrind-docker-autotest #19887 completed: SUCCESS 00:13:25.028 [Pipeline] } 00:13:25.075 [Pipeline] // retry 00:13:25.083 [Pipeline] } 00:19:53.608 Build vhost-phy-autotest #26248 completed: SUCCESS 00:19:53.610 [Pipeline] } 00:19:53.638 [Pipeline] // retry 00:19:53.643 [Pipeline] } 00:23:01.045 Build nvme-phy-autotest #72395 completed: SUCCESS 00:23:01.047 [Pipeline] } 00:23:01.091 [Pipeline] // retry 00:23:01.097 [Pipeline] } 00:23:26.742 Build nvmf-phy-autotest #72467 completed: FAILURE 00:23:27.596 [Pipeline] echo 00:23:27.597 No retry patterns found. 00:23:27.598 [Pipeline] } 00:23:27.621 [Pipeline] // retry 00:23:27.629 [Pipeline] error 00:23:27.632 [Pipeline] } 00:23:27.635 Failed in branch nvmf-phy-autotest 00:23:28.804 Build autobuild-external-vg-autotest #19846 completed: SUCCESS 00:23:28.806 [Pipeline] } 00:23:28.853 [Pipeline] // retry 00:23:28.858 [Pipeline] } 00:23:57.358 Build vfio-user-phy-autotest #26231 completed: SUCCESS 00:23:57.361 [Pipeline] } 00:23:57.415 [Pipeline] // retry 00:23:57.422 [Pipeline] } 00:24:25.523 Build BlobFS-phy-autotest #26229 completed: SUCCESS 00:24:25.526 [Pipeline] } 00:24:25.571 [Pipeline] // retry 00:24:25.577 [Pipeline] } 00:26:59.774 Build dsa-phy-autotest #4923 completed: FAILURE 00:27:00.847 [Pipeline] echo 00:27:00.848 No retry patterns found. 00:27:00.849 [Pipeline] } 00:27:00.887 [Pipeline] // retry 00:27:00.894 [Pipeline] error 00:27:00.899 [Pipeline] } 00:27:00.904 Failed in branch dsa-phy-autotest 00:28:22.088 Build nvmf-tcp-phy-autotest #72354 completed: FAILURE 00:28:23.429 [Pipeline] echo 00:28:23.430 No retry patterns found. 00:28:23.431 [Pipeline] } 00:28:23.479 [Pipeline] // retry 00:28:23.487 [Pipeline] error 00:28:23.493 [Pipeline] } 00:28:23.499 Failed in branch nvmf-tcp-phy-autotest 00:29:50.683 Build zns-vg-autotest #76609 completed: SUCCESS 00:29:50.686 [Pipeline] } 00:29:50.735 [Pipeline] // retry 00:29:50.741 [Pipeline] } 00:30:09.579 Build vhost-initiator-vg-autotest #77523 completed: SUCCESS 00:30:09.581 [Pipeline] } 00:30:09.632 [Pipeline] // retry 00:30:09.641 [Pipeline] } 00:30:31.385 Build nvmf-tcp-uring-vg-autotest #77428 completed: FAILURE 00:30:32.154 [Pipeline] echo 00:30:32.155 No retry patterns found. 00:30:32.156 [Pipeline] } 00:30:32.193 [Pipeline] // retry 00:30:32.198 [Pipeline] error 00:30:32.203 [Pipeline] } 00:30:32.207 Failed in branch nvmf-tcp-uring-vg-autotest 00:31:18.378 Build nvmf-tcp-vg-autotest #77494 completed: FAILURE 00:31:19.259 [Pipeline] echo 00:31:19.260 No retry patterns found. 00:31:19.261 [Pipeline] } 00:31:19.293 [Pipeline] // retry 00:31:19.300 [Pipeline] error 00:31:19.305 [Pipeline] } 00:31:19.310 Failed in branch nvmf-tcp-vg-autotest 00:31:20.077 Build iscsi-uring-vg-autotest #77408 completed: SUCCESS 00:31:20.080 [Pipeline] } 00:31:20.144 [Pipeline] // retry 00:31:20.148 [Pipeline] } 00:31:21.538 Build lvol-vg-autotest #77452 completed: SUCCESS 00:31:21.540 [Pipeline] } 00:31:21.590 [Pipeline] // retry 00:31:21.596 [Pipeline] } 00:31:45.740 Build nvme-cmb-pmr-vg-autotest #78626 completed: SUCCESS 00:31:45.741 [Pipeline] } 00:31:45.773 [Pipeline] // retry 00:31:45.777 [Pipeline] } 00:35:58.796 Build freebsd-vg-autotest #59146 completed: SUCCESS 00:35:58.798 [Pipeline] } 00:35:58.831 [Pipeline] // retry 00:35:58.836 [Pipeline] } 00:36:25.357 Build iscsi-vg-autotest #77541 completed: SUCCESS 00:36:25.359 [Pipeline] } 00:36:25.407 [Pipeline] // retry 00:36:25.415 [Pipeline] } 00:39:35.445 Build crypto-phy-autotest #26223 completed: SUCCESS 00:39:35.449 [Pipeline] } 00:39:35.497 [Pipeline] // retry 00:39:35.504 [Pipeline] } 00:46:14.414 Build centos7-vg-autotest #73682 completed: SUCCESS 00:46:14.416 [Pipeline] } 00:46:14.453 [Pipeline] // retry 00:46:14.461 [Pipeline] } 00:47:50.579 Build nvme-vg-autotest #77503 completed: SUCCESS 00:47:50.581 [Pipeline] } 00:47:50.617 [Pipeline] // retry 00:47:50.621 [Pipeline] } 01:00:15.258 Build rocky9-vg-autotest #16113 completed: SUCCESS 01:00:15.261 [Pipeline] } 01:00:15.307 [Pipeline] // retry 01:00:15.313 [Pipeline] } 01:08:11.689 Build ubuntu22-vg-autotest #37836 completed: SUCCESS 01:08:11.692 [Pipeline] } 01:08:11.736 [Pipeline] // retry 01:08:11.743 [Pipeline] } 01:09:41.342 Build ubuntu20-vg-autotest #73822 completed: SUCCESS 01:09:41.344 [Pipeline] } 01:09:41.388 [Pipeline] // retry 01:09:41.395 [Pipeline] } 01:09:41.583 [Pipeline] // parallel 01:09:41.591 [Pipeline] } 01:09:41.612 [Pipeline] // stage 01:09:41.622 [Pipeline] } 01:09:41.634 ERROR: Build nvmf-phy-autotest #72467 failed 01:09:41.660 [Pipeline] // catchError 01:09:41.669 [Pipeline] stage 01:09:41.671 [Pipeline] { (Autorun Post and Coverage) 01:09:41.700 [Pipeline] setCustomBuildProperty 01:09:41.722 [Pipeline] dir 01:09:41.723 Running in /var/jenkins/workspace/autotest-per-patch_3/doc-docker-autotest_22347 01:09:41.724 [Pipeline] { 01:09:41.749 [Pipeline] copyArtifacts 01:09:42.024 Copied 6 artifacts from "doc-docker-autotest" build number 22347 01:09:42.028 [Pipeline] writeFile 01:09:42.054 [Pipeline] } 01:09:42.086 [Pipeline] // dir 01:09:42.102 [Pipeline] dir 01:09:42.103 Running in /var/jenkins/workspace/autotest-per-patch_3/check-format-docker-autotest_22167 01:09:42.104 [Pipeline] { 01:09:42.127 [Pipeline] copyArtifacts 01:09:42.197 Copied 5 artifacts from "check-format-docker-autotest" build number 22167 01:09:42.201 [Pipeline] writeFile 01:09:42.225 [Pipeline] } 01:09:42.257 [Pipeline] // dir 01:09:42.356 [Pipeline] dir 01:09:42.356 Running in /var/jenkins/workspace/autotest-per-patch_3/build-files-docker-autotest_22156 01:09:42.357 [Pipeline] { 01:09:42.380 [Pipeline] copyArtifacts 01:09:42.456 Copied 5 artifacts from "build-files-docker-autotest" build number 22156 01:09:42.460 [Pipeline] writeFile 01:09:42.524 [Pipeline] } 01:09:42.573 [Pipeline] // dir 01:09:42.612 [Pipeline] dir 01:09:42.613 Running in /var/jenkins/workspace/autotest-per-patch_3/check-so-deps-docker-autotest_22180 01:09:42.614 [Pipeline] { 01:09:42.633 [Pipeline] copyArtifacts 01:09:42.738 Copied 5 artifacts from "check-so-deps-docker-autotest" build number 22180 01:09:42.742 [Pipeline] writeFile 01:09:42.776 [Pipeline] } 01:09:42.804 [Pipeline] // dir 01:09:42.939 [Pipeline] dir 01:09:42.939 Running in /var/jenkins/workspace/autotest-per-patch_3/unittest-clang-docker-autotest_19883 01:09:42.941 [Pipeline] { 01:09:42.969 [Pipeline] copyArtifacts 01:09:43.044 Copied 5 artifacts from "unittest-clang-docker-autotest" build number 19883 01:09:43.048 [Pipeline] writeFile 01:09:43.133 [Pipeline] } 01:09:43.192 [Pipeline] // dir 01:09:43.501 [Pipeline] dir 01:09:43.502 Running in /var/jenkins/workspace/autotest-per-patch_3/packaging-docker-autotest_19885 01:09:43.503 [Pipeline] { 01:09:43.542 [Pipeline] copyArtifacts 01:09:43.608 Copied 5 artifacts from "packaging-docker-autotest" build number 19885 01:09:43.611 [Pipeline] writeFile 01:09:43.759 [Pipeline] } 01:09:43.837 [Pipeline] // dir 01:09:43.864 [Pipeline] dir 01:09:43.865 Running in /var/jenkins/workspace/autotest-per-patch_3/scan-build-docker-autotest_19886 01:09:43.867 [Pipeline] { 01:09:43.890 [Pipeline] copyArtifacts 01:09:43.992 Copied 9 artifacts from "scan-build-docker-autotest" build number 19886 01:09:43.996 [Pipeline] writeFile 01:09:44.013 [Pipeline] } 01:09:44.035 [Pipeline] // dir 01:09:44.183 [Pipeline] dir 01:09:44.183 Running in /var/jenkins/workspace/autotest-per-patch_3/unittest-main-docker-autotest_19884 01:09:44.184 [Pipeline] { 01:09:44.208 [Pipeline] copyArtifacts 01:09:44.502 Copied 6 artifacts from "unittest-main-docker-autotest" build number 19884 01:09:44.504 [Pipeline] writeFile 01:09:44.566 [Pipeline] } 01:09:44.597 [Pipeline] // dir 01:09:44.940 [Pipeline] dir 01:09:44.940 Running in /var/jenkins/workspace/autotest-per-patch_3/short-fuzz-phy-autotest_26220 01:09:44.941 [Pipeline] { 01:09:44.981 [Pipeline] copyArtifacts 01:09:45.093 Copied 10 artifacts from "short-fuzz-phy-autotest" build number 26220 01:09:45.096 [Pipeline] writeFile 01:09:45.293 [Pipeline] } 01:09:45.425 [Pipeline] // dir 01:09:45.778 [Pipeline] dir 01:09:45.778 Running in /var/jenkins/workspace/autotest-per-patch_3/unittest-valgrind-docker-autotest_19887 01:09:45.780 [Pipeline] { 01:09:45.815 [Pipeline] copyArtifacts 01:09:46.099 Copied 6 artifacts from "unittest-valgrind-docker-autotest" build number 19887 01:09:46.103 [Pipeline] writeFile 01:09:46.242 [Pipeline] } 01:09:46.352 [Pipeline] // dir 01:09:46.738 [Pipeline] dir 01:09:46.739 Running in /var/jenkins/workspace/autotest-per-patch_3/vhost-phy-autotest_26248 01:09:46.740 [Pipeline] { 01:09:46.783 [Pipeline] copyArtifacts 01:09:47.010 Copied 12 artifacts from "vhost-phy-autotest" build number 26248 01:09:47.015 [Pipeline] writeFile 01:09:47.209 [Pipeline] } 01:09:47.321 [Pipeline] // dir 01:09:47.863 [Pipeline] dir 01:09:47.863 Running in /var/jenkins/workspace/autotest-per-patch_3/nvme-phy-autotest_72395 01:09:47.864 [Pipeline] { 01:09:47.917 [Pipeline] copyArtifacts 01:09:48.148 Copied 12 artifacts from "nvme-phy-autotest" build number 72395 01:09:48.152 [Pipeline] writeFile 01:09:48.425 [Pipeline] } 01:09:48.572 [Pipeline] // dir 01:09:49.077 [Pipeline] dir 01:09:49.078 Running in /var/jenkins/workspace/autotest-per-patch_3/nvmf-phy-autotest_72467 01:09:49.079 [Pipeline] { 01:09:49.131 [Pipeline] copyArtifacts 01:09:50.200 Copied 17 artifacts from "nvmf-phy-autotest" build number 72467 01:09:50.204 [Pipeline] writeFile 01:09:50.411 [Pipeline] } 01:09:50.524 [Pipeline] // dir 01:09:50.657 [Pipeline] dir 01:09:50.657 Running in /var/jenkins/workspace/autotest-per-patch_3/autobuild-external-vg-autotest_19846 01:09:50.658 [Pipeline] { 01:09:50.684 [Pipeline] copyArtifacts 01:09:50.748 Copied 9 artifacts from "autobuild-external-vg-autotest" build number 19846 01:09:50.751 [Pipeline] writeFile 01:09:50.794 [Pipeline] } 01:09:50.844 [Pipeline] // dir 01:09:51.282 [Pipeline] dir 01:09:51.283 Running in /var/jenkins/workspace/autotest-per-patch_3/vfio-user-phy-autotest_26231 01:09:51.284 [Pipeline] { 01:09:51.328 [Pipeline] copyArtifacts 01:09:51.553 Copied 12 artifacts from "vfio-user-phy-autotest" build number 26231 01:09:51.558 [Pipeline] writeFile 01:09:51.774 [Pipeline] } 01:09:51.898 [Pipeline] // dir 01:09:52.159 [Pipeline] dir 01:09:52.160 Running in /var/jenkins/workspace/autotest-per-patch_3/BlobFS-phy-autotest_26229 01:09:52.161 [Pipeline] { 01:09:52.203 [Pipeline] copyArtifacts 01:09:52.641 Copied 28 artifacts from "BlobFS-phy-autotest" build number 26229 01:09:52.646 [Pipeline] writeFile 01:09:52.765 [Pipeline] } 01:09:52.853 [Pipeline] // dir 01:09:53.487 [Pipeline] dir 01:09:53.487 Running in /var/jenkins/workspace/autotest-per-patch_3/dsa-phy-autotest_4923 01:09:53.488 [Pipeline] { 01:09:53.548 [Pipeline] copyArtifacts 01:09:55.142 Copied 17 artifacts from "dsa-phy-autotest" build number 4923 01:09:55.146 [Pipeline] writeFile 01:09:55.393 [Pipeline] } 01:09:55.588 [Pipeline] // dir 01:09:56.474 [Pipeline] dir 01:09:56.474 Running in /var/jenkins/workspace/autotest-per-patch_3/nvmf-tcp-phy-autotest_72354 01:09:56.475 [Pipeline] { 01:09:56.544 [Pipeline] copyArtifacts 01:09:57.860 Copied 17 artifacts from "nvmf-tcp-phy-autotest" build number 72354 01:09:57.865 [Pipeline] writeFile 01:09:58.340 [Pipeline] } 01:09:58.522 [Pipeline] // dir 01:09:58.834 [Pipeline] dir 01:09:58.834 Running in /var/jenkins/workspace/autotest-per-patch_3/zns-vg-autotest_76609 01:09:58.835 [Pipeline] { 01:09:58.879 [Pipeline] copyArtifacts 01:09:59.123 Copied 12 artifacts from "zns-vg-autotest" build number 76609 01:09:59.127 [Pipeline] writeFile 01:09:59.296 [Pipeline] } 01:09:59.392 [Pipeline] // dir 01:09:59.712 [Pipeline] dir 01:09:59.713 Running in /var/jenkins/workspace/autotest-per-patch_3/vhost-initiator-vg-autotest_77523 01:09:59.714 [Pipeline] { 01:09:59.752 [Pipeline] copyArtifacts 01:10:00.091 Copied 16 artifacts from "vhost-initiator-vg-autotest" build number 77523 01:10:00.102 [Pipeline] writeFile 01:10:00.260 [Pipeline] } 01:10:00.328 [Pipeline] // dir 01:10:00.830 [Pipeline] dir 01:10:00.831 Running in /var/jenkins/workspace/autotest-per-patch_3/nvmf-tcp-uring-vg-autotest_77428 01:10:00.832 [Pipeline] { 01:10:00.882 [Pipeline] copyArtifacts 01:10:01.351 Copied 18 artifacts from "nvmf-tcp-uring-vg-autotest" build number 77428 01:10:01.355 [Pipeline] writeFile 01:10:01.557 [Pipeline] } 01:10:01.692 [Pipeline] // dir 01:10:02.256 [Pipeline] dir 01:10:02.257 Running in /var/jenkins/workspace/autotest-per-patch_3/nvmf-tcp-vg-autotest_77494 01:10:02.258 [Pipeline] { 01:10:02.310 [Pipeline] copyArtifacts 01:10:02.873 Copied 17 artifacts from "nvmf-tcp-vg-autotest" build number 77494 01:10:02.877 [Pipeline] writeFile 01:10:03.163 [Pipeline] } 01:10:03.310 [Pipeline] // dir 01:10:05.307 [Pipeline] dir 01:10:05.307 Running in /var/jenkins/workspace/autotest-per-patch_3/iscsi-uring-vg-autotest_77408 01:10:05.308 [Pipeline] { 01:10:05.489 [Pipeline] copyArtifacts 01:10:07.860 Copied 16 artifacts from "iscsi-uring-vg-autotest" build number 77408 01:10:07.865 [Pipeline] writeFile 01:10:08.934 [Pipeline] } 01:10:09.445 [Pipeline] // dir 01:10:10.064 [Pipeline] dir 01:10:10.064 Running in /var/jenkins/workspace/autotest-per-patch_3/lvol-vg-autotest_77452 01:10:10.065 [Pipeline] { 01:10:10.128 [Pipeline] copyArtifacts 01:10:10.318 Copied 12 artifacts from "lvol-vg-autotest" build number 77452 01:10:10.322 [Pipeline] writeFile 01:10:10.559 [Pipeline] } 01:10:10.674 [Pipeline] // dir 01:10:11.010 [Pipeline] dir 01:10:11.010 Running in /var/jenkins/workspace/autotest-per-patch_3/nvme-cmb-pmr-vg-autotest_78626 01:10:11.011 [Pipeline] { 01:10:11.076 [Pipeline] copyArtifacts 01:10:11.277 Copied 13 artifacts from "nvme-cmb-pmr-vg-autotest" build number 78626 01:10:11.280 [Pipeline] writeFile 01:10:11.426 [Pipeline] } 01:10:11.538 [Pipeline] // dir 01:10:12.264 [Pipeline] dir 01:10:12.264 Running in /var/jenkins/workspace/autotest-per-patch_3/freebsd-vg-autotest_59146 01:10:12.265 [Pipeline] { 01:10:12.316 [Pipeline] copyArtifacts 01:10:12.420 Copied 7 artifacts from "freebsd-vg-autotest" build number 59146 01:10:12.424 [Pipeline] writeFile 01:10:12.708 [Pipeline] } 01:10:12.853 [Pipeline] // dir 01:10:15.297 [Pipeline] dir 01:10:15.298 Running in /var/jenkins/workspace/autotest-per-patch_3/iscsi-vg-autotest_77541 01:10:15.299 [Pipeline] { 01:10:15.528 [Pipeline] copyArtifacts 01:10:18.917 Copied 16 artifacts from "iscsi-vg-autotest" build number 77541 01:10:18.921 [Pipeline] writeFile 01:10:20.352 [Pipeline] } 01:10:20.960 [Pipeline] // dir 01:10:22.287 [Pipeline] dir 01:10:22.287 Running in /var/jenkins/workspace/autotest-per-patch_3/crypto-phy-autotest_26223 01:10:22.289 [Pipeline] { 01:10:22.388 [Pipeline] copyArtifacts 01:10:22.609 Copied 12 artifacts from "crypto-phy-autotest" build number 26223 01:10:22.613 [Pipeline] writeFile 01:10:23.103 [Pipeline] } 01:10:23.313 [Pipeline] // dir 01:10:24.141 [Pipeline] dir 01:10:24.141 Running in /var/jenkins/workspace/autotest-per-patch_3/centos7-vg-autotest_73682 01:10:24.142 [Pipeline] { 01:10:24.232 [Pipeline] copyArtifacts 01:10:24.592 Copied 13 artifacts from "centos7-vg-autotest" build number 73682 01:10:24.596 [Pipeline] writeFile 01:10:24.909 [Pipeline] } 01:10:25.113 [Pipeline] // dir 01:10:25.733 [Pipeline] dir 01:10:25.733 Running in /var/jenkins/workspace/autotest-per-patch_3/nvme-vg-autotest_77503 01:10:25.734 [Pipeline] { 01:10:25.793 [Pipeline] copyArtifacts 01:10:26.014 Copied 12 artifacts from "nvme-vg-autotest" build number 77503 01:10:26.019 [Pipeline] writeFile 01:10:26.330 [Pipeline] } 01:10:26.468 [Pipeline] // dir 01:10:27.675 [Pipeline] dir 01:10:27.675 Running in /var/jenkins/workspace/autotest-per-patch_3/rocky9-vg-autotest_16113 01:10:27.676 [Pipeline] { 01:10:27.762 [Pipeline] copyArtifacts 01:10:28.163 Copied 13 artifacts from "rocky9-vg-autotest" build number 16113 01:10:28.167 [Pipeline] writeFile 01:10:28.677 [Pipeline] } 01:10:28.897 [Pipeline] // dir 01:10:30.056 [Pipeline] dir 01:10:30.056 Running in /var/jenkins/workspace/autotest-per-patch_3/ubuntu22-vg-autotest_37836 01:10:30.057 [Pipeline] { 01:10:30.139 [Pipeline] copyArtifacts 01:10:30.520 Copied 13 artifacts from "ubuntu22-vg-autotest" build number 37836 01:10:30.524 [Pipeline] writeFile 01:10:31.000 [Pipeline] } 01:10:31.226 [Pipeline] // dir 01:10:32.411 [Pipeline] dir 01:10:32.412 Running in /var/jenkins/workspace/autotest-per-patch_3/ubuntu20-vg-autotest_73822 01:10:32.413 [Pipeline] { 01:10:32.499 [Pipeline] copyArtifacts 01:10:32.964 Copied 13 artifacts from "ubuntu20-vg-autotest" build number 73822 01:10:32.969 [Pipeline] writeFile 01:10:33.445 [Pipeline] } 01:10:33.700 [Pipeline] // dir 01:10:33.709 [Pipeline] catchError 01:10:33.711 [Pipeline] { 01:10:33.731 [Pipeline] sh 01:10:34.008 + jbp/jenkins/jjb-config/jobs/scripts/post_gen_coverage.sh 01:10:34.008 + shopt -s globstar nullglob 01:10:34.008 + echo 'Start stage post_gen_coverage.sh' 01:10:34.008 Start stage post_gen_coverage.sh 01:10:34.008 + cd /var/jenkins/workspace/autotest-per-patch_3 01:10:34.008 + rm -rf /var/jenkins/workspace/autotest-per-patch_3/spdk/doc 01:10:34.008 + trap 'compress_coverage_and_docs; remove_partial_coverage_files && echo '\''End stage post_gen_coverage.sh'\''' EXIT 01:10:34.008 + move_artifacts 01:10:34.008 + local out_dirs 01:10:34.008 + out_dirs=(./**/output/) 01:10:34.008 + for dir in "${out_dirs[@]}" 01:10:34.008 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.008 + [[ -f ./autobuild-external-vg-autotest_19846/output//doc.tar.xz ]] 01:10:34.008 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.008 + [[ -f ./autobuild-external-vg-autotest_19846/output//ut_coverage.tar.xz ]] 01:10:34.008 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.008 + [[ -f ./autobuild-external-vg-autotest_19846/output//llvm.tar.xz ]] 01:10:34.008 + mv ./autobuild-external-vg-autotest_19846/output//build-kernel-manifest.txt ./autobuild-external-vg-autotest_19846/output//build-pkg-manifest.txt ./autobuild-external-vg-autotest_19846/output//build-repo-manifest.txt ./autobuild-external-vg-autotest_19846/output//dmesg.init.log ./autobuild-external-vg-autotest_19846/output//dmesg.log ./autobuild-external-vg-autotest_19846/output//power.tar.xz ./autobuild-external-vg-autotest_19846/output//test_completions.txt ./autobuild-external-vg-autotest_19846/output//timing.svg ./autobuild-external-vg-autotest_19846/output//timing.txt ./autobuild-external-vg-autotest_19846/output//.. 01:10:34.008 + rmdir ./autobuild-external-vg-autotest_19846/output/ 01:10:34.008 + for dir in "${out_dirs[@]}" 01:10:34.008 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.008 + [[ -f ./BlobFS-phy-autotest_26229/output//doc.tar.xz ]] 01:10:34.008 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.008 + [[ -f ./BlobFS-phy-autotest_26229/output//ut_coverage.tar.xz ]] 01:10:34.008 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.008 + [[ -f ./BlobFS-phy-autotest_26229/output//llvm.tar.xz ]] 01:10:34.009 + mv ./BlobFS-phy-autotest_26229/output//all_tests.txt ./BlobFS-phy-autotest_26229/output//build-pkg-manifest.txt ./BlobFS-phy-autotest_26229/output//build-repo-manifest.txt ./BlobFS-phy-autotest_26229/output//cov_base.info.xz ./BlobFS-phy-autotest_26229/output//cov_test.info.xz ./BlobFS-phy-autotest_26229/output//cov_total.info.xz ./BlobFS-phy-autotest_26229/output//dmesg.init.log ./BlobFS-phy-autotest_26229/output//dmesg.log ./BlobFS-phy-autotest_26229/output//power.tar.xz ./BlobFS-phy-autotest_26229/output//rocksdb ./BlobFS-phy-autotest_26229/output//test_completions.txt ./BlobFS-phy-autotest_26229/output//timing.svg ./BlobFS-phy-autotest_26229/output//timing.txt ./BlobFS-phy-autotest_26229/output//.. 01:10:34.009 + rmdir ./BlobFS-phy-autotest_26229/output/ 01:10:34.009 + for dir in "${out_dirs[@]}" 01:10:34.009 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.009 + [[ -f ./build-files-docker-autotest_22156/output//doc.tar.xz ]] 01:10:34.009 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.009 + [[ -f ./build-files-docker-autotest_22156/output//ut_coverage.tar.xz ]] 01:10:34.009 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.009 + [[ -f ./build-files-docker-autotest_22156/output//llvm.tar.xz ]] 01:10:34.009 + mv ./build-files-docker-autotest_22156/output//build-pkg-manifest.txt ./build-files-docker-autotest_22156/output//build-repo-manifest.txt ./build-files-docker-autotest_22156/output//power.tar.xz ./build-files-docker-autotest_22156/output//test_completions.txt ./build-files-docker-autotest_22156/output//timing.txt ./build-files-docker-autotest_22156/output//.. 01:10:34.009 + rmdir ./build-files-docker-autotest_22156/output/ 01:10:34.009 + for dir in "${out_dirs[@]}" 01:10:34.009 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.009 + [[ -f ./centos7-vg-autotest_73682/output//doc.tar.xz ]] 01:10:34.009 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.009 + [[ -f ./centos7-vg-autotest_73682/output//ut_coverage.tar.xz ]] 01:10:34.009 + tar -C ./centos7-vg-autotest_73682/output/ -xf ./centos7-vg-autotest_73682/output//ut_coverage.tar.xz 01:10:34.267 + rm ./centos7-vg-autotest_73682/output//ut_coverage.tar.xz 01:10:34.267 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.267 + [[ -f ./centos7-vg-autotest_73682/output//llvm.tar.xz ]] 01:10:34.267 + mv ./centos7-vg-autotest_73682/output//all_tests.txt ./centos7-vg-autotest_73682/output//build-pkg-manifest.txt ./centos7-vg-autotest_73682/output//build-repo-manifest.txt ./centos7-vg-autotest_73682/output//cov_base.info.xz ./centos7-vg-autotest_73682/output//cov_test.info.xz ./centos7-vg-autotest_73682/output//cov_total.info.xz ./centos7-vg-autotest_73682/output//dmesg.init.log ./centos7-vg-autotest_73682/output//dmesg.log ./centos7-vg-autotest_73682/output//power.tar.xz ./centos7-vg-autotest_73682/output//test_completions.txt ./centos7-vg-autotest_73682/output//timing.svg ./centos7-vg-autotest_73682/output//timing.txt ./centos7-vg-autotest_73682/output//ut_coverage ./centos7-vg-autotest_73682/output//.. 01:10:34.267 + rmdir ./centos7-vg-autotest_73682/output/ 01:10:34.267 + for dir in "${out_dirs[@]}" 01:10:34.267 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.267 + [[ -f ./check-format-docker-autotest_22167/output//doc.tar.xz ]] 01:10:34.267 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.267 + [[ -f ./check-format-docker-autotest_22167/output//ut_coverage.tar.xz ]] 01:10:34.267 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.267 + [[ -f ./check-format-docker-autotest_22167/output//llvm.tar.xz ]] 01:10:34.267 + mv ./check-format-docker-autotest_22167/output//build-pkg-manifest.txt ./check-format-docker-autotest_22167/output//build-repo-manifest.txt ./check-format-docker-autotest_22167/output//power.tar.xz ./check-format-docker-autotest_22167/output//test_completions.txt ./check-format-docker-autotest_22167/output//timing.txt ./check-format-docker-autotest_22167/output//.. 01:10:34.267 + rmdir ./check-format-docker-autotest_22167/output/ 01:10:34.267 + for dir in "${out_dirs[@]}" 01:10:34.267 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.267 + [[ -f ./check-so-deps-docker-autotest_22180/output//doc.tar.xz ]] 01:10:34.267 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.267 + [[ -f ./check-so-deps-docker-autotest_22180/output//ut_coverage.tar.xz ]] 01:10:34.267 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.267 + [[ -f ./check-so-deps-docker-autotest_22180/output//llvm.tar.xz ]] 01:10:34.267 + mv ./check-so-deps-docker-autotest_22180/output//build-pkg-manifest.txt ./check-so-deps-docker-autotest_22180/output//build-repo-manifest.txt ./check-so-deps-docker-autotest_22180/output//power.tar.xz ./check-so-deps-docker-autotest_22180/output//test_completions.txt ./check-so-deps-docker-autotest_22180/output//timing.txt ./check-so-deps-docker-autotest_22180/output//.. 01:10:34.267 + rmdir ./check-so-deps-docker-autotest_22180/output/ 01:10:34.267 + for dir in "${out_dirs[@]}" 01:10:34.267 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.267 + [[ -f ./crypto-phy-autotest_26223/output//doc.tar.xz ]] 01:10:34.267 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.267 + [[ -f ./crypto-phy-autotest_26223/output//ut_coverage.tar.xz ]] 01:10:34.267 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.267 + [[ -f ./crypto-phy-autotest_26223/output//llvm.tar.xz ]] 01:10:34.267 + mv ./crypto-phy-autotest_26223/output//all_tests.txt ./crypto-phy-autotest_26223/output//build-pkg-manifest.txt ./crypto-phy-autotest_26223/output//build-repo-manifest.txt ./crypto-phy-autotest_26223/output//cov_base.info.xz ./crypto-phy-autotest_26223/output//cov_test.info.xz ./crypto-phy-autotest_26223/output//cov_total.info.xz ./crypto-phy-autotest_26223/output//dmesg.init.log ./crypto-phy-autotest_26223/output//dmesg.log ./crypto-phy-autotest_26223/output//power.tar.xz ./crypto-phy-autotest_26223/output//test_completions.txt ./crypto-phy-autotest_26223/output//timing.svg ./crypto-phy-autotest_26223/output//timing.txt ./crypto-phy-autotest_26223/output//.. 01:10:34.267 + rmdir ./crypto-phy-autotest_26223/output/ 01:10:34.267 + for dir in "${out_dirs[@]}" 01:10:34.267 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.267 + [[ -f ./doc-docker-autotest_22347/output//doc.tar.xz ]] 01:10:34.267 + tar -C ./doc-docker-autotest_22347/output/ -xf ./doc-docker-autotest_22347/output//doc.tar.xz 01:10:34.267 + rm ./doc-docker-autotest_22347/output//doc.tar.xz 01:10:34.267 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.267 + [[ -f ./doc-docker-autotest_22347/output//ut_coverage.tar.xz ]] 01:10:34.267 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.267 + [[ -f ./doc-docker-autotest_22347/output//llvm.tar.xz ]] 01:10:34.267 + mv ./doc-docker-autotest_22347/output//build-pkg-manifest.txt ./doc-docker-autotest_22347/output//build-repo-manifest.txt ./doc-docker-autotest_22347/output//doc ./doc-docker-autotest_22347/output//power.tar.xz ./doc-docker-autotest_22347/output//test_completions.txt ./doc-docker-autotest_22347/output//timing.txt ./doc-docker-autotest_22347/output//.. 01:10:34.267 + rmdir ./doc-docker-autotest_22347/output/ 01:10:34.267 + for dir in "${out_dirs[@]}" 01:10:34.267 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.267 + [[ -f ./dsa-phy-autotest_4923/output//doc.tar.xz ]] 01:10:34.268 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.268 + [[ -f ./dsa-phy-autotest_4923/output//ut_coverage.tar.xz ]] 01:10:34.268 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.268 + [[ -f ./dsa-phy-autotest_4923/output//llvm.tar.xz ]] 01:10:34.268 + mv ./dsa-phy-autotest_4923/output//all_tests.txt ./dsa-phy-autotest_4923/output//build-pkg-manifest.txt ./dsa-phy-autotest_4923/output//build-repo-manifest.txt ./dsa-phy-autotest_4923/output//coredumps ./dsa-phy-autotest_4923/output//cov_base.info.xz ./dsa-phy-autotest_4923/output//dmesg.init.log ./dsa-phy-autotest_4923/output//dmesg.log ./dsa-phy-autotest_4923/output//nvmf_trace.0_shm.tar.gz ./dsa-phy-autotest_4923/output//power.tar.xz ./dsa-phy-autotest_4923/output//proc_list.txt ./dsa-phy-autotest_4923/output//test_completions.txt ./dsa-phy-autotest_4923/output//timing.txt ./dsa-phy-autotest_4923/output//udev.log ./dsa-phy-autotest_4923/output//.. 01:10:34.268 + rmdir ./dsa-phy-autotest_4923/output/ 01:10:34.268 + for dir in "${out_dirs[@]}" 01:10:34.268 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.268 + [[ -f ./freebsd-vg-autotest_59146/output//doc.tar.xz ]] 01:10:34.268 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.268 + [[ -f ./freebsd-vg-autotest_59146/output//ut_coverage.tar.xz ]] 01:10:34.268 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.268 + [[ -f ./freebsd-vg-autotest_59146/output//llvm.tar.xz ]] 01:10:34.268 + mv ./freebsd-vg-autotest_59146/output//all_tests.txt ./freebsd-vg-autotest_59146/output//build-pkg-manifest.txt ./freebsd-vg-autotest_59146/output//build-repo-manifest.txt ./freebsd-vg-autotest_59146/output//messages ./freebsd-vg-autotest_59146/output//power.tar.xz ./freebsd-vg-autotest_59146/output//test_completions.txt ./freebsd-vg-autotest_59146/output//timing.txt ./freebsd-vg-autotest_59146/output//.. 01:10:34.268 + rmdir ./freebsd-vg-autotest_59146/output/ 01:10:34.268 + for dir in "${out_dirs[@]}" 01:10:34.268 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.268 + [[ -f ./iscsi-uring-vg-autotest_77408/output//doc.tar.xz ]] 01:10:34.268 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.268 + [[ -f ./iscsi-uring-vg-autotest_77408/output//ut_coverage.tar.xz ]] 01:10:34.268 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.268 + [[ -f ./iscsi-uring-vg-autotest_77408/output//llvm.tar.xz ]] 01:10:34.268 + mv ./iscsi-uring-vg-autotest_77408/output//all_tests.txt ./iscsi-uring-vg-autotest_77408/output//build-pkg-manifest.txt ./iscsi-uring-vg-autotest_77408/output//build-repo-manifest.txt ./iscsi-uring-vg-autotest_77408/output//calsoft.json ./iscsi-uring-vg-autotest_77408/output//calsoft.tar.xz ./iscsi-uring-vg-autotest_77408/output//cov_base.info.xz ./iscsi-uring-vg-autotest_77408/output//cov_test.info.xz ./iscsi-uring-vg-autotest_77408/output//cov_total.info.xz ./iscsi-uring-vg-autotest_77408/output//dmesg.init.log ./iscsi-uring-vg-autotest_77408/output//dmesg.log ./iscsi-uring-vg-autotest_77408/output//iscsi_autofuzz_logs.txt ./iscsi-uring-vg-autotest_77408/output//iscsi_autofuzz_tgt_output.txt ./iscsi-uring-vg-autotest_77408/output//power.tar.xz ./iscsi-uring-vg-autotest_77408/output//test_completions.txt ./iscsi-uring-vg-autotest_77408/output//timing.svg ./iscsi-uring-vg-autotest_77408/output//timing.txt ./iscsi-uring-vg-autotest_77408/output//.. 01:10:34.268 + rmdir ./iscsi-uring-vg-autotest_77408/output/ 01:10:34.268 + for dir in "${out_dirs[@]}" 01:10:34.268 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.268 + [[ -f ./iscsi-vg-autotest_77541/output//doc.tar.xz ]] 01:10:34.268 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.268 + [[ -f ./iscsi-vg-autotest_77541/output//ut_coverage.tar.xz ]] 01:10:34.268 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.268 + [[ -f ./iscsi-vg-autotest_77541/output//llvm.tar.xz ]] 01:10:34.268 + mv ./iscsi-vg-autotest_77541/output//all_tests.txt ./iscsi-vg-autotest_77541/output//build-pkg-manifest.txt ./iscsi-vg-autotest_77541/output//build-repo-manifest.txt ./iscsi-vg-autotest_77541/output//calsoft.json ./iscsi-vg-autotest_77541/output//calsoft.tar.xz ./iscsi-vg-autotest_77541/output//cov_base.info.xz ./iscsi-vg-autotest_77541/output//cov_test.info.xz ./iscsi-vg-autotest_77541/output//cov_total.info.xz ./iscsi-vg-autotest_77541/output//dmesg.init.log ./iscsi-vg-autotest_77541/output//dmesg.log ./iscsi-vg-autotest_77541/output//iscsi_autofuzz_logs.txt ./iscsi-vg-autotest_77541/output//iscsi_autofuzz_tgt_output.txt ./iscsi-vg-autotest_77541/output//power.tar.xz ./iscsi-vg-autotest_77541/output//test_completions.txt ./iscsi-vg-autotest_77541/output//timing.svg ./iscsi-vg-autotest_77541/output//timing.txt ./iscsi-vg-autotest_77541/output//.. 01:10:34.268 + rmdir ./iscsi-vg-autotest_77541/output/ 01:10:34.268 + for dir in "${out_dirs[@]}" 01:10:34.268 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.268 + [[ -f ./lvol-vg-autotest_77452/output//doc.tar.xz ]] 01:10:34.268 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.268 + [[ -f ./lvol-vg-autotest_77452/output//ut_coverage.tar.xz ]] 01:10:34.268 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.268 + [[ -f ./lvol-vg-autotest_77452/output//llvm.tar.xz ]] 01:10:34.268 + mv ./lvol-vg-autotest_77452/output//all_tests.txt ./lvol-vg-autotest_77452/output//build-pkg-manifest.txt ./lvol-vg-autotest_77452/output//build-repo-manifest.txt ./lvol-vg-autotest_77452/output//cov_base.info.xz ./lvol-vg-autotest_77452/output//cov_test.info.xz ./lvol-vg-autotest_77452/output//cov_total.info.xz ./lvol-vg-autotest_77452/output//dmesg.init.log ./lvol-vg-autotest_77452/output//dmesg.log ./lvol-vg-autotest_77452/output//power.tar.xz ./lvol-vg-autotest_77452/output//test_completions.txt ./lvol-vg-autotest_77452/output//timing.svg ./lvol-vg-autotest_77452/output//timing.txt ./lvol-vg-autotest_77452/output//.. 01:10:34.268 + rmdir ./lvol-vg-autotest_77452/output/ 01:10:34.268 + for dir in "${out_dirs[@]}" 01:10:34.268 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.268 + [[ -f ./nvme-cmb-pmr-vg-autotest_78626/output//doc.tar.xz ]] 01:10:34.268 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.268 + [[ -f ./nvme-cmb-pmr-vg-autotest_78626/output//ut_coverage.tar.xz ]] 01:10:34.268 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.268 + [[ -f ./nvme-cmb-pmr-vg-autotest_78626/output//llvm.tar.xz ]] 01:10:34.268 + mv ./nvme-cmb-pmr-vg-autotest_78626/output//all_tests.txt ./nvme-cmb-pmr-vg-autotest_78626/output//build-kernel-manifest.txt ./nvme-cmb-pmr-vg-autotest_78626/output//build-pkg-manifest.txt ./nvme-cmb-pmr-vg-autotest_78626/output//build-repo-manifest.txt ./nvme-cmb-pmr-vg-autotest_78626/output//cov_base.info.xz ./nvme-cmb-pmr-vg-autotest_78626/output//cov_test.info.xz ./nvme-cmb-pmr-vg-autotest_78626/output//cov_total.info.xz ./nvme-cmb-pmr-vg-autotest_78626/output//dmesg.init.log ./nvme-cmb-pmr-vg-autotest_78626/output//dmesg.log ./nvme-cmb-pmr-vg-autotest_78626/output//power.tar.xz ./nvme-cmb-pmr-vg-autotest_78626/output//test_completions.txt ./nvme-cmb-pmr-vg-autotest_78626/output//timing.svg ./nvme-cmb-pmr-vg-autotest_78626/output//timing.txt ./nvme-cmb-pmr-vg-autotest_78626/output//.. 01:10:34.268 + rmdir ./nvme-cmb-pmr-vg-autotest_78626/output/ 01:10:34.268 + for dir in "${out_dirs[@]}" 01:10:34.268 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.268 + [[ -f ./nvme-phy-autotest_72395/output//doc.tar.xz ]] 01:10:34.268 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.268 + [[ -f ./nvme-phy-autotest_72395/output//ut_coverage.tar.xz ]] 01:10:34.268 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.268 + [[ -f ./nvme-phy-autotest_72395/output//llvm.tar.xz ]] 01:10:34.268 + mv ./nvme-phy-autotest_72395/output//all_tests.txt ./nvme-phy-autotest_72395/output//build-pkg-manifest.txt ./nvme-phy-autotest_72395/output//build-repo-manifest.txt ./nvme-phy-autotest_72395/output//cov_base.info.xz ./nvme-phy-autotest_72395/output//cov_test.info.xz ./nvme-phy-autotest_72395/output//cov_total.info.xz ./nvme-phy-autotest_72395/output//dmesg.init.log ./nvme-phy-autotest_72395/output//dmesg.log ./nvme-phy-autotest_72395/output//power.tar.xz ./nvme-phy-autotest_72395/output//test_completions.txt ./nvme-phy-autotest_72395/output//timing.svg ./nvme-phy-autotest_72395/output//timing.txt ./nvme-phy-autotest_72395/output//.. 01:10:34.268 + rmdir ./nvme-phy-autotest_72395/output/ 01:10:34.268 + for dir in "${out_dirs[@]}" 01:10:34.268 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.268 + [[ -f ./nvme-vg-autotest_77503/output//doc.tar.xz ]] 01:10:34.268 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.268 + [[ -f ./nvme-vg-autotest_77503/output//ut_coverage.tar.xz ]] 01:10:34.268 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.268 + [[ -f ./nvme-vg-autotest_77503/output//llvm.tar.xz ]] 01:10:34.268 + mv ./nvme-vg-autotest_77503/output//all_tests.txt ./nvme-vg-autotest_77503/output//build-pkg-manifest.txt ./nvme-vg-autotest_77503/output//build-repo-manifest.txt ./nvme-vg-autotest_77503/output//cov_base.info.xz ./nvme-vg-autotest_77503/output//cov_test.info.xz ./nvme-vg-autotest_77503/output//cov_total.info.xz ./nvme-vg-autotest_77503/output//dmesg.init.log ./nvme-vg-autotest_77503/output//dmesg.log ./nvme-vg-autotest_77503/output//power.tar.xz ./nvme-vg-autotest_77503/output//test_completions.txt ./nvme-vg-autotest_77503/output//timing.svg ./nvme-vg-autotest_77503/output//timing.txt ./nvme-vg-autotest_77503/output//.. 01:10:34.268 + rmdir ./nvme-vg-autotest_77503/output/ 01:10:34.268 + for dir in "${out_dirs[@]}" 01:10:34.268 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.268 + [[ -f ./nvmf-phy-autotest_72467/output//doc.tar.xz ]] 01:10:34.268 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.268 + [[ -f ./nvmf-phy-autotest_72467/output//ut_coverage.tar.xz ]] 01:10:34.268 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.268 + [[ -f ./nvmf-phy-autotest_72467/output//llvm.tar.xz ]] 01:10:34.268 + mv ./nvmf-phy-autotest_72467/output//all_tests.txt ./nvmf-phy-autotest_72467/output//build-pkg-manifest.txt ./nvmf-phy-autotest_72467/output//build-repo-manifest.txt ./nvmf-phy-autotest_72467/output//coredumps ./nvmf-phy-autotest_72467/output//cov_base.info.xz ./nvmf-phy-autotest_72467/output//dmesg.init.log ./nvmf-phy-autotest_72467/output//dmesg.log ./nvmf-phy-autotest_72467/output//nvmf_trace.0_shm.tar.gz ./nvmf-phy-autotest_72467/output//power.tar.xz ./nvmf-phy-autotest_72467/output//proc_list.txt ./nvmf-phy-autotest_72467/output//test_completions.txt ./nvmf-phy-autotest_72467/output//timing.txt ./nvmf-phy-autotest_72467/output//udev.log ./nvmf-phy-autotest_72467/output//.. 01:10:34.268 + rmdir ./nvmf-phy-autotest_72467/output/ 01:10:34.268 + for dir in "${out_dirs[@]}" 01:10:34.268 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.268 + [[ -f ./nvmf-tcp-phy-autotest_72354/output//doc.tar.xz ]] 01:10:34.268 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.268 + [[ -f ./nvmf-tcp-phy-autotest_72354/output//ut_coverage.tar.xz ]] 01:10:34.268 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.268 + [[ -f ./nvmf-tcp-phy-autotest_72354/output//llvm.tar.xz ]] 01:10:34.269 + mv ./nvmf-tcp-phy-autotest_72354/output//all_tests.txt ./nvmf-tcp-phy-autotest_72354/output//build-pkg-manifest.txt ./nvmf-tcp-phy-autotest_72354/output//build-repo-manifest.txt ./nvmf-tcp-phy-autotest_72354/output//coredumps ./nvmf-tcp-phy-autotest_72354/output//cov_base.info.xz ./nvmf-tcp-phy-autotest_72354/output//dmesg.init.log ./nvmf-tcp-phy-autotest_72354/output//dmesg.log ./nvmf-tcp-phy-autotest_72354/output//nvmf_trace.0_shm.tar.gz ./nvmf-tcp-phy-autotest_72354/output//power.tar.xz ./nvmf-tcp-phy-autotest_72354/output//proc_list.txt ./nvmf-tcp-phy-autotest_72354/output//test_completions.txt ./nvmf-tcp-phy-autotest_72354/output//timing.txt ./nvmf-tcp-phy-autotest_72354/output//udev.log ./nvmf-tcp-phy-autotest_72354/output//.. 01:10:34.269 + rmdir ./nvmf-tcp-phy-autotest_72354/output/ 01:10:34.269 + for dir in "${out_dirs[@]}" 01:10:34.269 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.269 + [[ -f ./nvmf-tcp-uring-vg-autotest_77428/output//doc.tar.xz ]] 01:10:34.269 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.269 + [[ -f ./nvmf-tcp-uring-vg-autotest_77428/output//ut_coverage.tar.xz ]] 01:10:34.269 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.269 + [[ -f ./nvmf-tcp-uring-vg-autotest_77428/output//llvm.tar.xz ]] 01:10:34.269 + mv ./nvmf-tcp-uring-vg-autotest_77428/output//all_tests.txt ./nvmf-tcp-uring-vg-autotest_77428/output//build-kernel-manifest.txt ./nvmf-tcp-uring-vg-autotest_77428/output//build-pkg-manifest.txt ./nvmf-tcp-uring-vg-autotest_77428/output//build-repo-manifest.txt ./nvmf-tcp-uring-vg-autotest_77428/output//coredumps ./nvmf-tcp-uring-vg-autotest_77428/output//cov_base.info.xz ./nvmf-tcp-uring-vg-autotest_77428/output//dmesg.init.log ./nvmf-tcp-uring-vg-autotest_77428/output//dmesg.log ./nvmf-tcp-uring-vg-autotest_77428/output//nvmf_trace.0_shm.tar.gz ./nvmf-tcp-uring-vg-autotest_77428/output//power.tar.xz ./nvmf-tcp-uring-vg-autotest_77428/output//proc_list.txt ./nvmf-tcp-uring-vg-autotest_77428/output//test_completions.txt ./nvmf-tcp-uring-vg-autotest_77428/output//timing.txt ./nvmf-tcp-uring-vg-autotest_77428/output//udev.log ./nvmf-tcp-uring-vg-autotest_77428/output//.. 01:10:34.269 + rmdir ./nvmf-tcp-uring-vg-autotest_77428/output/ 01:10:34.269 + for dir in "${out_dirs[@]}" 01:10:34.269 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.269 + [[ -f ./nvmf-tcp-vg-autotest_77494/output//doc.tar.xz ]] 01:10:34.269 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.269 + [[ -f ./nvmf-tcp-vg-autotest_77494/output//ut_coverage.tar.xz ]] 01:10:34.269 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.269 + [[ -f ./nvmf-tcp-vg-autotest_77494/output//llvm.tar.xz ]] 01:10:34.269 + mv ./nvmf-tcp-vg-autotest_77494/output//all_tests.txt ./nvmf-tcp-vg-autotest_77494/output//build-pkg-manifest.txt ./nvmf-tcp-vg-autotest_77494/output//build-repo-manifest.txt ./nvmf-tcp-vg-autotest_77494/output//coredumps ./nvmf-tcp-vg-autotest_77494/output//cov_base.info.xz ./nvmf-tcp-vg-autotest_77494/output//dmesg.init.log ./nvmf-tcp-vg-autotest_77494/output//dmesg.log ./nvmf-tcp-vg-autotest_77494/output//nvmf_trace.0_shm.tar.gz ./nvmf-tcp-vg-autotest_77494/output//power.tar.xz ./nvmf-tcp-vg-autotest_77494/output//proc_list.txt ./nvmf-tcp-vg-autotest_77494/output//test_completions.txt ./nvmf-tcp-vg-autotest_77494/output//timing.txt ./nvmf-tcp-vg-autotest_77494/output//udev.log ./nvmf-tcp-vg-autotest_77494/output//.. 01:10:34.269 + rmdir ./nvmf-tcp-vg-autotest_77494/output/ 01:10:34.269 + for dir in "${out_dirs[@]}" 01:10:34.269 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.269 + [[ -f ./packaging-docker-autotest_19885/output//doc.tar.xz ]] 01:10:34.269 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.269 + [[ -f ./packaging-docker-autotest_19885/output//ut_coverage.tar.xz ]] 01:10:34.269 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.269 + [[ -f ./packaging-docker-autotest_19885/output//llvm.tar.xz ]] 01:10:34.269 + mv ./packaging-docker-autotest_19885/output//build-pkg-manifest.txt ./packaging-docker-autotest_19885/output//build-repo-manifest.txt ./packaging-docker-autotest_19885/output//power.tar.xz ./packaging-docker-autotest_19885/output//test_completions.txt ./packaging-docker-autotest_19885/output//timing.txt ./packaging-docker-autotest_19885/output//.. 01:10:34.269 + rmdir ./packaging-docker-autotest_19885/output/ 01:10:34.269 + for dir in "${out_dirs[@]}" 01:10:34.269 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.269 + [[ -f ./rocky9-vg-autotest_16113/output//doc.tar.xz ]] 01:10:34.269 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.269 + [[ -f ./rocky9-vg-autotest_16113/output//ut_coverage.tar.xz ]] 01:10:34.269 + tar -C ./rocky9-vg-autotest_16113/output/ -xf ./rocky9-vg-autotest_16113/output//ut_coverage.tar.xz 01:10:34.526 + rm ./rocky9-vg-autotest_16113/output//ut_coverage.tar.xz 01:10:34.526 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.526 + [[ -f ./rocky9-vg-autotest_16113/output//llvm.tar.xz ]] 01:10:34.526 + mv ./rocky9-vg-autotest_16113/output//all_tests.txt ./rocky9-vg-autotest_16113/output//build-pkg-manifest.txt ./rocky9-vg-autotest_16113/output//build-repo-manifest.txt ./rocky9-vg-autotest_16113/output//cov_base.info.xz ./rocky9-vg-autotest_16113/output//cov_test.info.xz ./rocky9-vg-autotest_16113/output//cov_total.info.xz ./rocky9-vg-autotest_16113/output//dmesg.init.log ./rocky9-vg-autotest_16113/output//dmesg.log ./rocky9-vg-autotest_16113/output//power.tar.xz ./rocky9-vg-autotest_16113/output//test_completions.txt ./rocky9-vg-autotest_16113/output//timing.svg ./rocky9-vg-autotest_16113/output//timing.txt ./rocky9-vg-autotest_16113/output//ut_coverage ./rocky9-vg-autotest_16113/output//.. 01:10:34.526 + rmdir ./rocky9-vg-autotest_16113/output/ 01:10:34.526 + for dir in "${out_dirs[@]}" 01:10:34.526 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.526 + [[ -f ./scan-build-docker-autotest_19886/output//doc.tar.xz ]] 01:10:34.526 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.526 + [[ -f ./scan-build-docker-autotest_19886/output//ut_coverage.tar.xz ]] 01:10:34.526 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.526 + [[ -f ./scan-build-docker-autotest_19886/output//llvm.tar.xz ]] 01:10:34.526 + mv ./scan-build-docker-autotest_19886/output//all_c_files.txt ./scan-build-docker-autotest_19886/output//build_output.txt ./scan-build-docker-autotest_19886/output//build-pkg-manifest.txt ./scan-build-docker-autotest_19886/output//build-repo-manifest.txt ./scan-build-docker-autotest_19886/output//built_c_files.txt ./scan-build-docker-autotest_19886/output//power.tar.xz ./scan-build-docker-autotest_19886/output//test_completions.txt ./scan-build-docker-autotest_19886/output//timing.txt ./scan-build-docker-autotest_19886/output//unbuilt_c_files.txt ./scan-build-docker-autotest_19886/output//.. 01:10:34.526 + rmdir ./scan-build-docker-autotest_19886/output/ 01:10:34.526 + for dir in "${out_dirs[@]}" 01:10:34.526 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.526 + [[ -f ./short-fuzz-phy-autotest_26220/output//doc.tar.xz ]] 01:10:34.526 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.526 + [[ -f ./short-fuzz-phy-autotest_26220/output//ut_coverage.tar.xz ]] 01:10:34.526 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.526 + [[ -f ./short-fuzz-phy-autotest_26220/output//llvm.tar.xz ]] 01:10:34.526 + tar -C ./short-fuzz-phy-autotest_26220/output/ -xf ./short-fuzz-phy-autotest_26220/output//llvm.tar.xz 01:10:34.526 + rm ./short-fuzz-phy-autotest_26220/output//llvm.tar.xz 01:10:34.527 + mv ./short-fuzz-phy-autotest_26220/output//all_tests.txt ./short-fuzz-phy-autotest_26220/output//build-pkg-manifest.txt ./short-fuzz-phy-autotest_26220/output//build-repo-manifest.txt ./short-fuzz-phy-autotest_26220/output//dmesg.init.log ./short-fuzz-phy-autotest_26220/output//dmesg.log ./short-fuzz-phy-autotest_26220/output//llvm ./short-fuzz-phy-autotest_26220/output//power.tar.xz ./short-fuzz-phy-autotest_26220/output//test_completions.txt ./short-fuzz-phy-autotest_26220/output//timing.svg ./short-fuzz-phy-autotest_26220/output//timing.txt ./short-fuzz-phy-autotest_26220/output//.. 01:10:34.527 + rmdir ./short-fuzz-phy-autotest_26220/output/ 01:10:34.527 + for dir in "${out_dirs[@]}" 01:10:34.527 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.527 + [[ -f ./ubuntu20-vg-autotest_73822/output//doc.tar.xz ]] 01:10:34.527 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.527 + [[ -f ./ubuntu20-vg-autotest_73822/output//ut_coverage.tar.xz ]] 01:10:34.527 + tar -C ./ubuntu20-vg-autotest_73822/output/ -xf ./ubuntu20-vg-autotest_73822/output//ut_coverage.tar.xz 01:10:34.784 + rm ./ubuntu20-vg-autotest_73822/output//ut_coverage.tar.xz 01:10:34.784 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.784 + [[ -f ./ubuntu20-vg-autotest_73822/output//llvm.tar.xz ]] 01:10:34.784 + mv ./ubuntu20-vg-autotest_73822/output//all_tests.txt ./ubuntu20-vg-autotest_73822/output//build-pkg-manifest.txt ./ubuntu20-vg-autotest_73822/output//build-repo-manifest.txt ./ubuntu20-vg-autotest_73822/output//cov_base.info.xz ./ubuntu20-vg-autotest_73822/output//cov_test.info.xz ./ubuntu20-vg-autotest_73822/output//cov_total.info.xz ./ubuntu20-vg-autotest_73822/output//dmesg.init.log ./ubuntu20-vg-autotest_73822/output//dmesg.log ./ubuntu20-vg-autotest_73822/output//power.tar.xz ./ubuntu20-vg-autotest_73822/output//test_completions.txt ./ubuntu20-vg-autotest_73822/output//timing.svg ./ubuntu20-vg-autotest_73822/output//timing.txt ./ubuntu20-vg-autotest_73822/output//ut_coverage ./ubuntu20-vg-autotest_73822/output//.. 01:10:34.784 + rmdir ./ubuntu20-vg-autotest_73822/output/ 01:10:34.784 + for dir in "${out_dirs[@]}" 01:10:34.784 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.784 + [[ -f ./ubuntu22-vg-autotest_37836/output//doc.tar.xz ]] 01:10:34.784 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:34.784 + [[ -f ./ubuntu22-vg-autotest_37836/output//ut_coverage.tar.xz ]] 01:10:34.784 + tar -C ./ubuntu22-vg-autotest_37836/output/ -xf ./ubuntu22-vg-autotest_37836/output//ut_coverage.tar.xz 01:10:35.041 + rm ./ubuntu22-vg-autotest_37836/output//ut_coverage.tar.xz 01:10:35.041 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:35.041 + [[ -f ./ubuntu22-vg-autotest_37836/output//llvm.tar.xz ]] 01:10:35.041 + mv ./ubuntu22-vg-autotest_37836/output//all_tests.txt ./ubuntu22-vg-autotest_37836/output//build-pkg-manifest.txt ./ubuntu22-vg-autotest_37836/output//build-repo-manifest.txt ./ubuntu22-vg-autotest_37836/output//cov_base.info.xz ./ubuntu22-vg-autotest_37836/output//cov_test.info.xz ./ubuntu22-vg-autotest_37836/output//cov_total.info.xz ./ubuntu22-vg-autotest_37836/output//dmesg.init.log ./ubuntu22-vg-autotest_37836/output//dmesg.log ./ubuntu22-vg-autotest_37836/output//power.tar.xz ./ubuntu22-vg-autotest_37836/output//test_completions.txt ./ubuntu22-vg-autotest_37836/output//timing.svg ./ubuntu22-vg-autotest_37836/output//timing.txt ./ubuntu22-vg-autotest_37836/output//ut_coverage ./ubuntu22-vg-autotest_37836/output//.. 01:10:35.041 + rmdir ./ubuntu22-vg-autotest_37836/output/ 01:10:35.041 + for dir in "${out_dirs[@]}" 01:10:35.041 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:35.041 + [[ -f ./unittest-clang-docker-autotest_19883/output//doc.tar.xz ]] 01:10:35.041 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:35.041 + [[ -f ./unittest-clang-docker-autotest_19883/output//ut_coverage.tar.xz ]] 01:10:35.041 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:35.041 + [[ -f ./unittest-clang-docker-autotest_19883/output//llvm.tar.xz ]] 01:10:35.041 + mv ./unittest-clang-docker-autotest_19883/output//build-pkg-manifest.txt ./unittest-clang-docker-autotest_19883/output//build-repo-manifest.txt ./unittest-clang-docker-autotest_19883/output//power.tar.xz ./unittest-clang-docker-autotest_19883/output//test_completions.txt ./unittest-clang-docker-autotest_19883/output//timing.txt ./unittest-clang-docker-autotest_19883/output//.. 01:10:35.041 + rmdir ./unittest-clang-docker-autotest_19883/output/ 01:10:35.041 + for dir in "${out_dirs[@]}" 01:10:35.041 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:35.041 + [[ -f ./unittest-main-docker-autotest_19884/output//doc.tar.xz ]] 01:10:35.041 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:35.041 + [[ -f ./unittest-main-docker-autotest_19884/output//ut_coverage.tar.xz ]] 01:10:35.041 + tar -C ./unittest-main-docker-autotest_19884/output/ -xf ./unittest-main-docker-autotest_19884/output//ut_coverage.tar.xz 01:10:35.299 + rm ./unittest-main-docker-autotest_19884/output//ut_coverage.tar.xz 01:10:35.299 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:35.299 + [[ -f ./unittest-main-docker-autotest_19884/output//llvm.tar.xz ]] 01:10:35.299 + mv ./unittest-main-docker-autotest_19884/output//build-pkg-manifest.txt ./unittest-main-docker-autotest_19884/output//build-repo-manifest.txt ./unittest-main-docker-autotest_19884/output//power.tar.xz ./unittest-main-docker-autotest_19884/output//test_completions.txt ./unittest-main-docker-autotest_19884/output//timing.txt ./unittest-main-docker-autotest_19884/output//ut_coverage ./unittest-main-docker-autotest_19884/output//.. 01:10:35.299 + rmdir ./unittest-main-docker-autotest_19884/output/ 01:10:35.299 + for dir in "${out_dirs[@]}" 01:10:35.299 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:35.299 + [[ -f ./unittest-valgrind-docker-autotest_19887/output//doc.tar.xz ]] 01:10:35.299 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:35.299 + [[ -f ./unittest-valgrind-docker-autotest_19887/output//ut_coverage.tar.xz ]] 01:10:35.299 + tar -C ./unittest-valgrind-docker-autotest_19887/output/ -xf ./unittest-valgrind-docker-autotest_19887/output//ut_coverage.tar.xz 01:10:35.558 + rm ./unittest-valgrind-docker-autotest_19887/output//ut_coverage.tar.xz 01:10:35.558 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:35.558 + [[ -f ./unittest-valgrind-docker-autotest_19887/output//llvm.tar.xz ]] 01:10:35.558 + mv ./unittest-valgrind-docker-autotest_19887/output//build-pkg-manifest.txt ./unittest-valgrind-docker-autotest_19887/output//build-repo-manifest.txt ./unittest-valgrind-docker-autotest_19887/output//power.tar.xz ./unittest-valgrind-docker-autotest_19887/output//test_completions.txt ./unittest-valgrind-docker-autotest_19887/output//timing.txt ./unittest-valgrind-docker-autotest_19887/output//ut_coverage ./unittest-valgrind-docker-autotest_19887/output//.. 01:10:35.558 + rmdir ./unittest-valgrind-docker-autotest_19887/output/ 01:10:35.558 + for dir in "${out_dirs[@]}" 01:10:35.558 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:35.558 + [[ -f ./vfio-user-phy-autotest_26231/output//doc.tar.xz ]] 01:10:35.558 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:35.558 + [[ -f ./vfio-user-phy-autotest_26231/output//ut_coverage.tar.xz ]] 01:10:35.558 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:35.558 + [[ -f ./vfio-user-phy-autotest_26231/output//llvm.tar.xz ]] 01:10:35.558 + mv ./vfio-user-phy-autotest_26231/output//all_tests.txt ./vfio-user-phy-autotest_26231/output//build-pkg-manifest.txt ./vfio-user-phy-autotest_26231/output//build-repo-manifest.txt ./vfio-user-phy-autotest_26231/output//cov_base.info.xz ./vfio-user-phy-autotest_26231/output//cov_test.info.xz ./vfio-user-phy-autotest_26231/output//cov_total.info.xz ./vfio-user-phy-autotest_26231/output//dmesg.init.log ./vfio-user-phy-autotest_26231/output//dmesg.log ./vfio-user-phy-autotest_26231/output//power.tar.xz ./vfio-user-phy-autotest_26231/output//test_completions.txt ./vfio-user-phy-autotest_26231/output//timing.svg ./vfio-user-phy-autotest_26231/output//timing.txt ./vfio-user-phy-autotest_26231/output//.. 01:10:35.558 + rmdir ./vfio-user-phy-autotest_26231/output/ 01:10:35.558 + for dir in "${out_dirs[@]}" 01:10:35.558 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:35.558 + [[ -f ./vhost-initiator-vg-autotest_77523/output//doc.tar.xz ]] 01:10:35.558 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:35.558 + [[ -f ./vhost-initiator-vg-autotest_77523/output//ut_coverage.tar.xz ]] 01:10:35.558 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:35.558 + [[ -f ./vhost-initiator-vg-autotest_77523/output//llvm.tar.xz ]] 01:10:35.558 + mv ./vhost-initiator-vg-autotest_77523/output//all_tests.txt ./vhost-initiator-vg-autotest_77523/output//build-kernel-manifest.txt ./vhost-initiator-vg-autotest_77523/output//build-pkg-manifest.txt ./vhost-initiator-vg-autotest_77523/output//build-repo-manifest.txt ./vhost-initiator-vg-autotest_77523/output//cov_base.info.xz ./vhost-initiator-vg-autotest_77523/output//cov_test.info.xz ./vhost-initiator-vg-autotest_77523/output//cov_total.info.xz ./vhost-initiator-vg-autotest_77523/output//dmesg.init.log ./vhost-initiator-vg-autotest_77523/output//dmesg.log ./vhost-initiator-vg-autotest_77523/output//power.tar.xz ./vhost-initiator-vg-autotest_77523/output//test_completions.txt ./vhost-initiator-vg-autotest_77523/output//timing.svg ./vhost-initiator-vg-autotest_77523/output//timing.txt ./vhost-initiator-vg-autotest_77523/output//vhost_fuzz_output1.txt.xz ./vhost-initiator-vg-autotest_77523/output//vhost_fuzz_output2.txt.xz ./vhost-initiator-vg-autotest_77523/output//vhost_fuzz_tgt_output.txt.xz ./vhost-initiator-vg-autotest_77523/output//.. 01:10:35.558 + rmdir ./vhost-initiator-vg-autotest_77523/output/ 01:10:35.558 + for dir in "${out_dirs[@]}" 01:10:35.558 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:35.558 + [[ -f ./vhost-phy-autotest_26248/output//doc.tar.xz ]] 01:10:35.558 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:35.558 + [[ -f ./vhost-phy-autotest_26248/output//ut_coverage.tar.xz ]] 01:10:35.558 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:35.558 + [[ -f ./vhost-phy-autotest_26248/output//llvm.tar.xz ]] 01:10:35.558 + mv ./vhost-phy-autotest_26248/output//all_tests.txt ./vhost-phy-autotest_26248/output//build-pkg-manifest.txt ./vhost-phy-autotest_26248/output//build-repo-manifest.txt ./vhost-phy-autotest_26248/output//cov_base.info.xz ./vhost-phy-autotest_26248/output//cov_test.info.xz ./vhost-phy-autotest_26248/output//cov_total.info.xz ./vhost-phy-autotest_26248/output//dmesg.init.log ./vhost-phy-autotest_26248/output//dmesg.log ./vhost-phy-autotest_26248/output//power.tar.xz ./vhost-phy-autotest_26248/output//test_completions.txt ./vhost-phy-autotest_26248/output//timing.svg ./vhost-phy-autotest_26248/output//timing.txt ./vhost-phy-autotest_26248/output//.. 01:10:35.558 + rmdir ./vhost-phy-autotest_26248/output/ 01:10:35.558 + for dir in "${out_dirs[@]}" 01:10:35.558 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:35.558 + [[ -f ./zns-vg-autotest_76609/output//doc.tar.xz ]] 01:10:35.558 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:35.558 + [[ -f ./zns-vg-autotest_76609/output//ut_coverage.tar.xz ]] 01:10:35.558 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:10:35.558 + [[ -f ./zns-vg-autotest_76609/output//llvm.tar.xz ]] 01:10:35.558 + mv ./zns-vg-autotest_76609/output//all_tests.txt ./zns-vg-autotest_76609/output//build-pkg-manifest.txt ./zns-vg-autotest_76609/output//build-repo-manifest.txt ./zns-vg-autotest_76609/output//cov_base.info.xz ./zns-vg-autotest_76609/output//cov_test.info.xz ./zns-vg-autotest_76609/output//cov_total.info.xz ./zns-vg-autotest_76609/output//dmesg.init.log ./zns-vg-autotest_76609/output//dmesg.log ./zns-vg-autotest_76609/output//power.tar.xz ./zns-vg-autotest_76609/output//test_completions.txt ./zns-vg-autotest_76609/output//timing.svg ./zns-vg-autotest_76609/output//timing.txt ./zns-vg-autotest_76609/output//.. 01:10:35.558 + rmdir ./zns-vg-autotest_76609/output/ 01:10:35.558 + unpack_cov_files 01:10:35.558 + local info_files 01:10:35.558 + info_files=(*/cov_*.info.xz) 01:10:35.558 + xargs -P0 -r -n1 xz -d 01:10:35.558 + printf '%s\n' BlobFS-phy-autotest_26229/cov_base.info.xz BlobFS-phy-autotest_26229/cov_test.info.xz BlobFS-phy-autotest_26229/cov_total.info.xz centos7-vg-autotest_73682/cov_base.info.xz centos7-vg-autotest_73682/cov_test.info.xz centos7-vg-autotest_73682/cov_total.info.xz crypto-phy-autotest_26223/cov_base.info.xz crypto-phy-autotest_26223/cov_test.info.xz crypto-phy-autotest_26223/cov_total.info.xz dsa-phy-autotest_4923/cov_base.info.xz iscsi-uring-vg-autotest_77408/cov_base.info.xz iscsi-uring-vg-autotest_77408/cov_test.info.xz iscsi-uring-vg-autotest_77408/cov_total.info.xz iscsi-vg-autotest_77541/cov_base.info.xz iscsi-vg-autotest_77541/cov_test.info.xz iscsi-vg-autotest_77541/cov_total.info.xz lvol-vg-autotest_77452/cov_base.info.xz lvol-vg-autotest_77452/cov_test.info.xz lvol-vg-autotest_77452/cov_total.info.xz nvme-cmb-pmr-vg-autotest_78626/cov_base.info.xz nvme-cmb-pmr-vg-autotest_78626/cov_test.info.xz nvme-cmb-pmr-vg-autotest_78626/cov_total.info.xz nvme-phy-autotest_72395/cov_base.info.xz nvme-phy-autotest_72395/cov_test.info.xz nvme-phy-autotest_72395/cov_total.info.xz nvme-vg-autotest_77503/cov_base.info.xz nvme-vg-autotest_77503/cov_test.info.xz nvme-vg-autotest_77503/cov_total.info.xz nvmf-phy-autotest_72467/cov_base.info.xz nvmf-tcp-phy-autotest_72354/cov_base.info.xz nvmf-tcp-uring-vg-autotest_77428/cov_base.info.xz nvmf-tcp-vg-autotest_77494/cov_base.info.xz rocky9-vg-autotest_16113/cov_base.info.xz rocky9-vg-autotest_16113/cov_test.info.xz rocky9-vg-autotest_16113/cov_total.info.xz ubuntu20-vg-autotest_73822/cov_base.info.xz ubuntu20-vg-autotest_73822/cov_test.info.xz ubuntu20-vg-autotest_73822/cov_total.info.xz ubuntu22-vg-autotest_37836/cov_base.info.xz ubuntu22-vg-autotest_37836/cov_test.info.xz ubuntu22-vg-autotest_37836/cov_total.info.xz vfio-user-phy-autotest_26231/cov_base.info.xz vfio-user-phy-autotest_26231/cov_test.info.xz vfio-user-phy-autotest_26231/cov_total.info.xz vhost-initiator-vg-autotest_77523/cov_base.info.xz vhost-initiator-vg-autotest_77523/cov_test.info.xz vhost-initiator-vg-autotest_77523/cov_total.info.xz vhost-phy-autotest_26248/cov_base.info.xz vhost-phy-autotest_26248/cov_test.info.xz vhost-phy-autotest_26248/cov_total.info.xz zns-vg-autotest_76609/cov_base.info.xz zns-vg-autotest_76609/cov_test.info.xz zns-vg-autotest_76609/cov_total.info.xz 01:10:36.123 + fix_downstream_job_paths 01:10:36.123 + sed -i -e 's#^SF:/.\+/spdk/#SF:/var/jenkins/workspace/autotest-per-patch_3/spdk/#g' BlobFS-phy-autotest_26229/cov_total.info centos7-vg-autotest_73682/cov_total.info crypto-phy-autotest_26223/cov_total.info iscsi-uring-vg-autotest_77408/cov_total.info iscsi-vg-autotest_77541/cov_total.info lvol-vg-autotest_77452/cov_total.info nvme-cmb-pmr-vg-autotest_78626/cov_total.info nvme-phy-autotest_72395/cov_total.info nvme-vg-autotest_77503/cov_total.info rocky9-vg-autotest_16113/cov_total.info ubuntu20-vg-autotest_73822/cov_total.info ubuntu22-vg-autotest_37836/cov_total.info vfio-user-phy-autotest_26231/cov_total.info vhost-initiator-vg-autotest_77523/cov_total.info vhost-phy-autotest_26248/cov_total.info zns-vg-autotest_76609/cov_total.info 01:10:36.688 + ignore_ocf_headers 01:10:36.688 + sed -i 's#--show-details#--show-details --ignore-errors source#g' spdk/autorun_post.py 01:10:36.688 + create_errtrace_files_for_all_builds 01:10:36.688 + local build_log_list 01:10:36.688 + build_log_list=($(find "$WORKSPACE" -type f -name 'build.log')) 01:10:36.688 ++ find /var/jenkins/workspace/autotest-per-patch_3 -type f -name build.log 01:10:36.688 + for build in "${build_log_list[@]}" 01:10:36.688 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_3/build-files-docker-autotest_22156/build.log 01:10:36.688 + local build_log job_name start_pattern end_pattern backtraces 01:10:36.688 + build_log=/var/jenkins/workspace/autotest-per-patch_3/build-files-docker-autotest_22156/build.log 01:10:36.688 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/build-files-docker-autotest_22156/build.log 01:10:36.688 ++ basename /var/jenkins/workspace/autotest-per-patch_3/build-files-docker-autotest_22156 01:10:36.688 + job_name=build-files-docker-autotest_22156 01:10:36.688 + start_pattern='Backtrace start' 01:10:36.688 + end_pattern='Backtrace end' 01:10:36.688 + [[ -f /var/jenkins/workspace/autotest-per-patch_3/build-files-docker-autotest_22156/build.log ]] 01:10:36.688 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_3/build-files-docker-autotest_22156/build.log 01:10:36.688 + backtraces= 01:10:36.688 + [[ -n '' ]] 01:10:36.688 + for build in "${build_log_list[@]}" 01:10:36.688 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_3/vhost-phy-autotest_26248/build.log 01:10:36.688 + local build_log job_name start_pattern end_pattern backtraces 01:10:36.688 + build_log=/var/jenkins/workspace/autotest-per-patch_3/vhost-phy-autotest_26248/build.log 01:10:36.688 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/vhost-phy-autotest_26248/build.log 01:10:36.688 ++ basename /var/jenkins/workspace/autotest-per-patch_3/vhost-phy-autotest_26248 01:10:36.688 + job_name=vhost-phy-autotest_26248 01:10:36.688 + start_pattern='Backtrace start' 01:10:36.688 + end_pattern='Backtrace end' 01:10:36.688 + [[ -f /var/jenkins/workspace/autotest-per-patch_3/vhost-phy-autotest_26248/build.log ]] 01:10:36.688 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_3/vhost-phy-autotest_26248/build.log 01:10:36.688 + backtraces= 01:10:36.688 + [[ -n '' ]] 01:10:36.688 + for build in "${build_log_list[@]}" 01:10:36.688 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_3/lvol-vg-autotest_77452/build.log 01:10:36.688 + local build_log job_name start_pattern end_pattern backtraces 01:10:36.688 + build_log=/var/jenkins/workspace/autotest-per-patch_3/lvol-vg-autotest_77452/build.log 01:10:36.688 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/lvol-vg-autotest_77452/build.log 01:10:36.688 ++ basename /var/jenkins/workspace/autotest-per-patch_3/lvol-vg-autotest_77452 01:10:36.688 + job_name=lvol-vg-autotest_77452 01:10:36.688 + start_pattern='Backtrace start' 01:10:36.689 + end_pattern='Backtrace end' 01:10:36.689 + [[ -f /var/jenkins/workspace/autotest-per-patch_3/lvol-vg-autotest_77452/build.log ]] 01:10:36.689 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_3/lvol-vg-autotest_77452/build.log 01:10:36.689 + backtraces= 01:10:36.689 + [[ -n '' ]] 01:10:36.689 + for build in "${build_log_list[@]}" 01:10:36.689 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_3/autobuild-external-vg-autotest_19846/build.log 01:10:36.689 + local build_log job_name start_pattern end_pattern backtraces 01:10:36.689 + build_log=/var/jenkins/workspace/autotest-per-patch_3/autobuild-external-vg-autotest_19846/build.log 01:10:36.689 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/autobuild-external-vg-autotest_19846/build.log 01:10:36.689 ++ basename /var/jenkins/workspace/autotest-per-patch_3/autobuild-external-vg-autotest_19846 01:10:36.689 + job_name=autobuild-external-vg-autotest_19846 01:10:36.689 + start_pattern='Backtrace start' 01:10:36.689 + end_pattern='Backtrace end' 01:10:36.689 + [[ -f /var/jenkins/workspace/autotest-per-patch_3/autobuild-external-vg-autotest_19846/build.log ]] 01:10:36.689 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_3/autobuild-external-vg-autotest_19846/build.log 01:10:36.689 + backtraces= 01:10:36.689 + [[ -n '' ]] 01:10:36.689 + for build in "${build_log_list[@]}" 01:10:36.689 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_3/packaging-docker-autotest_19885/build.log 01:10:36.689 + local build_log job_name start_pattern end_pattern backtraces 01:10:36.689 + build_log=/var/jenkins/workspace/autotest-per-patch_3/packaging-docker-autotest_19885/build.log 01:10:36.689 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/packaging-docker-autotest_19885/build.log 01:10:36.689 ++ basename /var/jenkins/workspace/autotest-per-patch_3/packaging-docker-autotest_19885 01:10:36.689 + job_name=packaging-docker-autotest_19885 01:10:36.689 + start_pattern='Backtrace start' 01:10:36.689 + end_pattern='Backtrace end' 01:10:36.689 + [[ -f /var/jenkins/workspace/autotest-per-patch_3/packaging-docker-autotest_19885/build.log ]] 01:10:36.689 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_3/packaging-docker-autotest_19885/build.log 01:10:36.689 + backtraces= 01:10:36.689 + [[ -n '' ]] 01:10:36.689 + for build in "${build_log_list[@]}" 01:10:36.689 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_3/ubuntu22-vg-autotest_37836/build.log 01:10:36.689 + local build_log job_name start_pattern end_pattern backtraces 01:10:36.689 + build_log=/var/jenkins/workspace/autotest-per-patch_3/ubuntu22-vg-autotest_37836/build.log 01:10:36.689 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/ubuntu22-vg-autotest_37836/build.log 01:10:36.689 ++ basename /var/jenkins/workspace/autotest-per-patch_3/ubuntu22-vg-autotest_37836 01:10:36.689 + job_name=ubuntu22-vg-autotest_37836 01:10:36.689 + start_pattern='Backtrace start' 01:10:36.689 + end_pattern='Backtrace end' 01:10:36.689 + [[ -f /var/jenkins/workspace/autotest-per-patch_3/ubuntu22-vg-autotest_37836/build.log ]] 01:10:36.689 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_3/ubuntu22-vg-autotest_37836/build.log 01:10:36.689 + backtraces= 01:10:36.689 + [[ -n '' ]] 01:10:36.689 + for build in "${build_log_list[@]}" 01:10:36.689 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_3/vfio-user-phy-autotest_26231/build.log 01:10:36.689 + local build_log job_name start_pattern end_pattern backtraces 01:10:36.689 + build_log=/var/jenkins/workspace/autotest-per-patch_3/vfio-user-phy-autotest_26231/build.log 01:10:36.689 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/vfio-user-phy-autotest_26231/build.log 01:10:36.689 ++ basename /var/jenkins/workspace/autotest-per-patch_3/vfio-user-phy-autotest_26231 01:10:36.689 + job_name=vfio-user-phy-autotest_26231 01:10:36.689 + start_pattern='Backtrace start' 01:10:36.689 + end_pattern='Backtrace end' 01:10:36.689 + [[ -f /var/jenkins/workspace/autotest-per-patch_3/vfio-user-phy-autotest_26231/build.log ]] 01:10:36.689 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_3/vfio-user-phy-autotest_26231/build.log 01:10:36.952 + backtraces= 01:10:36.952 + [[ -n '' ]] 01:10:36.952 + for build in "${build_log_list[@]}" 01:10:36.952 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_3/nvmf-tcp-phy-autotest_72354/build.log 01:10:36.952 + local build_log job_name start_pattern end_pattern backtraces 01:10:36.952 + build_log=/var/jenkins/workspace/autotest-per-patch_3/nvmf-tcp-phy-autotest_72354/build.log 01:10:36.952 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/nvmf-tcp-phy-autotest_72354/build.log 01:10:36.952 ++ basename /var/jenkins/workspace/autotest-per-patch_3/nvmf-tcp-phy-autotest_72354 01:10:36.952 + job_name=nvmf-tcp-phy-autotest_72354 01:10:36.952 + start_pattern='Backtrace start' 01:10:36.952 + end_pattern='Backtrace end' 01:10:36.952 + [[ -f /var/jenkins/workspace/autotest-per-patch_3/nvmf-tcp-phy-autotest_72354/build.log ]] 01:10:36.952 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_3/nvmf-tcp-phy-autotest_72354/build.log 01:10:36.952 + backtraces='00:23:28.691 ========== Backtrace start: ========== 01:10:36.952 00:23:28.691 01:10:36.952 00:23:28.691 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:587 -> rpc_cmd(["-s"],["/tmp/host.sock"],["bdev_nvme_start_discovery"],["-b"],["nvme"],["-t"],["tcp"],["-a"],["10.0.0.2"],["-s"],["8009"],["-f"],["ipv4"],["-q"],["nqn.2021-12.io.spdk:test"]) 01:10:36.952 00:23:28.691 ... 01:10:36.952 00:23:28.691 582 echo "$rsp" 01:10:36.952 00:23:28.691 583 done 01:10:36.952 00:23:28.691 584 01:10:36.952 00:23:28.691 585 rc=${!status[*]} 01:10:36.952 00:23:28.691 586 xtrace_restore 01:10:36.952 00:23:28.691 => 587 [[ $rc == 0 ]] 01:10:36.952 00:23:28.691 588 } 01:10:36.952 00:23:28.691 589 01:10:36.952 00:23:28.691 590 function rpc_cmd_simple_data_json() { 01:10:36.952 00:23:28.691 591 01:10:36.952 00:23:28.691 592 local elems="$1[@]" elem 01:10:36.952 00:23:28.691 ... 01:10:36.952 00:23:28.691 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh:51 -> main(["--transport=tcp"]) 01:10:36.952 00:23:28.691 ... 01:10:36.952 00:23:28.691 46 waitforlisten $hostpid $HOST_SOCK 01:10:36.952 00:23:28.691 47 01:10:36.952 00:23:28.691 48 trap '\''process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1'\'' SIGINT SIGTERM EXIT 01:10:36.952 00:23:28.691 49 01:10:36.952 00:23:28.691 50 $rpc_py -s $HOST_SOCK log_set_flag bdev_nvme 01:10:36.952 00:23:28.691 => 51 $rpc_py -s $HOST_SOCK bdev_nvme_start_discovery -b nvme -t $TEST_TRANSPORT -a $NVMF_FIRST_TARGET_IP \ 01:10:36.952 00:23:28.691 52 -s $DISCOVERY_PORT -f ipv4 -q $HOST_NQN 01:10:36.952 00:23:28.691 53 01:10:36.952 00:23:28.691 54 function get_bdev_list() { 01:10:36.952 00:23:28.691 55 $rpc_py -s $HOST_SOCK bdev_get_bdevs | jq -r '\''.[].name'\'' | sort | xargs 01:10:36.952 00:23:28.691 56 } 01:10:36.952 00:23:28.691 ... 01:10:36.952 00:23:28.691 01:10:36.952 00:23:28.691 ========== Backtrace end ========== 01:10:36.952 00:23:30.077 ========== Backtrace start: ========== 01:10:36.952 00:23:30.077 01:10:36.952 00:23:30.077 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:1121 -> run_test(["nvmf_host_discovery"],["/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh"],["--transport=tcp"]) 01:10:36.953 00:23:30.077 ... 01:10:36.953 00:23:30.077 1116 timing_enter $test_name 01:10:36.953 00:23:30.077 1117 echo "************************************" 01:10:36.953 00:23:30.077 1118 echo "START TEST $test_name" 01:10:36.953 00:23:30.077 1119 echo "************************************" 01:10:36.953 00:23:30.077 1120 xtrace_restore 01:10:36.953 00:23:30.077 1121 time "$@" 01:10:36.953 00:23:30.077 1122 xtrace_disable 01:10:36.953 00:23:30.077 1123 echo "************************************" 01:10:36.953 00:23:30.077 1124 echo "END TEST $test_name" 01:10:36.953 00:23:30.077 1125 echo "************************************" 01:10:36.953 00:23:30.077 1126 timing_exit $test_name 01:10:36.953 00:23:30.077 ... 01:10:36.953 00:23:30.078 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh:99 -> main(["--transport=tcp"]) 01:10:36.953 00:23:30.078 ... 01:10:36.953 00:23:30.078 94 01:10:36.953 00:23:30.078 95 run_test "nvmf_identify" $rootdir/test/nvmf/host/identify.sh "${TEST_ARGS[@]}" 01:10:36.953 00:23:30.078 96 run_test "nvmf_perf" $rootdir/test/nvmf/host/perf.sh "${TEST_ARGS[@]}" 01:10:36.953 00:23:30.078 97 run_test "nvmf_fio_host" $rootdir/test/nvmf/host/fio.sh "${TEST_ARGS[@]}" 01:10:36.953 00:23:30.078 98 run_test "nvmf_failover" $rootdir/test/nvmf/host/failover.sh "${TEST_ARGS[@]}" 01:10:36.953 00:23:30.078 => 99 run_test "nvmf_host_discovery" $rootdir/test/nvmf/host/discovery.sh "${TEST_ARGS[@]}" 01:10:36.953 00:23:30.078 100 run_test "nvmf_host_multipath_status" $rootdir/test/nvmf/host/multipath_status.sh "${TEST_ARGS[@]}" 01:10:36.953 00:23:30.078 101 run_test "nvmf_discovery_remove_ifc" $rootdir/test/nvmf/host/discovery_remove_ifc.sh "${TEST_ARGS[@]}" 01:10:36.953 00:23:30.078 102 run_test "nvmf_identify_kernel_target" "$rootdir/test/nvmf/host/identify_kernel_nvmf.sh" "${TEST_ARGS[@]}" 01:10:36.953 00:23:30.078 103 run_test "nvmf_auth" "$rootdir/test/nvmf/host/auth.sh" "${TEST_ARGS[@]}" 01:10:36.953 00:23:30.078 104 01:10:36.953 00:23:30.078 ... 01:10:36.953 00:23:30.078 01:10:36.953 00:23:30.078 ========== Backtrace end ========== 01:10:36.953 00:23:30.078 ========== Backtrace start: ========== 01:10:36.953 00:23:30.078 01:10:36.953 00:23:30.078 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:1121 -> run_test(["nvmf_tcp"],["/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh"],["--transport=tcp"]) 01:10:36.953 00:23:30.078 ... 01:10:36.953 00:23:30.078 1116 timing_enter $test_name 01:10:36.953 00:23:30.078 1117 echo "************************************" 01:10:36.953 00:23:30.078 1118 echo "START TEST $test_name" 01:10:36.953 00:23:30.078 1119 echo "************************************" 01:10:36.953 00:23:30.078 1120 xtrace_restore 01:10:36.953 00:23:30.078 1121 time "$@" 01:10:36.953 00:23:30.078 1122 xtrace_disable 01:10:36.953 00:23:30.078 1123 echo "************************************" 01:10:36.953 00:23:30.078 1124 echo "END TEST $test_name" 01:10:36.953 00:23:30.078 1125 echo "************************************" 01:10:36.953 00:23:30.078 1126 timing_exit $test_name 01:10:36.953 00:23:30.078 ... 01:10:36.953 00:23:30.078 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh:283 -> main(["/var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf"]) 01:10:36.953 00:23:30.078 ... 01:10:36.953 00:23:30.078 278 # list of all tests can properly differentiate them. Please do not merge them into one line. 01:10:36.953 00:23:30.078 279 if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then 01:10:36.953 00:23:30.078 280 run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.953 00:23:30.078 281 run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.953 00:23:30.078 282 elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then 01:10:36.953 00:23:30.078 => 283 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.953 00:23:30.078 284 if [[ $SPDK_TEST_URING -eq 0 ]]; then 01:10:36.953 00:23:30.078 285 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.953 00:23:30.078 286 run_test "nvmf_identify_passthru" $rootdir/test/nvmf/target/identify_passthru.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.953 00:23:30.078 287 fi 01:10:36.953 00:23:30.078 288 run_test "nvmf_dif" $rootdir/test/nvmf/target/dif.sh 01:10:36.953 00:23:30.078 ... 01:10:36.953 00:23:30.078 01:10:36.953 00:23:30.078 ========== Backtrace end ==========' 01:10:36.953 + [[ -n 00:23:28.691 ========== Backtrace start: ========== 01:10:36.953 00:23:28.691 01:10:36.953 00:23:28.691 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:587 -> rpc_cmd(["-s"],["/tmp/host.sock"],["bdev_nvme_start_discovery"],["-b"],["nvme"],["-t"],["tcp"],["-a"],["10.0.0.2"],["-s"],["8009"],["-f"],["ipv4"],["-q"],["nqn.2021-12.io.spdk:test"]) 01:10:36.953 00:23:28.691 ... 01:10:36.953 00:23:28.691 582 echo "$rsp" 01:10:36.953 00:23:28.691 583 done 01:10:36.953 00:23:28.691 584 01:10:36.953 00:23:28.691 585 rc=${!status[*]} 01:10:36.953 00:23:28.691 586 xtrace_restore 01:10:36.953 00:23:28.691 => 587 [[ $rc == 0 ]] 01:10:36.953 00:23:28.691 588 } 01:10:36.953 00:23:28.691 589 01:10:36.953 00:23:28.691 590 function rpc_cmd_simple_data_json() { 01:10:36.953 00:23:28.691 591 01:10:36.953 00:23:28.691 592 local elems="$1[@]" elem 01:10:36.953 00:23:28.691 ... 01:10:36.953 00:23:28.691 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh:51 -> main(["--transport=tcp"]) 01:10:36.953 00:23:28.691 ... 01:10:36.953 00:23:28.691 46 waitforlisten $hostpid $HOST_SOCK 01:10:36.953 00:23:28.691 47 01:10:36.953 00:23:28.691 48 trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 01:10:36.953 00:23:28.691 49 01:10:36.953 00:23:28.691 50 $rpc_py -s $HOST_SOCK log_set_flag bdev_nvme 01:10:36.953 00:23:28.691 => 51 $rpc_py -s $HOST_SOCK bdev_nvme_start_discovery -b nvme -t $TEST_TRANSPORT -a $NVMF_FIRST_TARGET_IP \ 01:10:36.953 00:23:28.691 52 -s $DISCOVERY_PORT -f ipv4 -q $HOST_NQN 01:10:36.953 00:23:28.691 53 01:10:36.953 00:23:28.691 54 function get_bdev_list() { 01:10:36.953 00:23:28.691 55 $rpc_py -s $HOST_SOCK bdev_get_bdevs | jq -r '.[].name' | sort | xargs 01:10:36.953 00:23:28.691 56 } 01:10:36.953 00:23:28.691 ... 01:10:36.953 00:23:28.691 01:10:36.953 00:23:28.691 ========== Backtrace end ========== 01:10:36.953 00:23:30.077 ========== Backtrace start: ========== 01:10:36.953 00:23:30.077 01:10:36.953 00:23:30.077 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:1121 -> run_test(["nvmf_host_discovery"],["/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh"],["--transport=tcp"]) 01:10:36.953 00:23:30.077 ... 01:10:36.953 00:23:30.077 1116 timing_enter $test_name 01:10:36.953 00:23:30.077 1117 echo "************************************" 01:10:36.953 00:23:30.077 1118 echo "START TEST $test_name" 01:10:36.953 00:23:30.077 1119 echo "************************************" 01:10:36.953 00:23:30.077 1120 xtrace_restore 01:10:36.953 00:23:30.077 1121 time "$@" 01:10:36.953 00:23:30.077 1122 xtrace_disable 01:10:36.954 00:23:30.077 1123 echo "************************************" 01:10:36.954 00:23:30.077 1124 echo "END TEST $test_name" 01:10:36.954 00:23:30.077 1125 echo "************************************" 01:10:36.954 00:23:30.077 1126 timing_exit $test_name 01:10:36.954 00:23:30.077 ... 01:10:36.954 00:23:30.078 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh:99 -> main(["--transport=tcp"]) 01:10:36.954 00:23:30.078 ... 01:10:36.954 00:23:30.078 94 01:10:36.954 00:23:30.078 95 run_test "nvmf_identify" $rootdir/test/nvmf/host/identify.sh "${TEST_ARGS[@]}" 01:10:36.954 00:23:30.078 96 run_test "nvmf_perf" $rootdir/test/nvmf/host/perf.sh "${TEST_ARGS[@]}" 01:10:36.954 00:23:30.078 97 run_test "nvmf_fio_host" $rootdir/test/nvmf/host/fio.sh "${TEST_ARGS[@]}" 01:10:36.954 00:23:30.078 98 run_test "nvmf_failover" $rootdir/test/nvmf/host/failover.sh "${TEST_ARGS[@]}" 01:10:36.954 00:23:30.078 => 99 run_test "nvmf_host_discovery" $rootdir/test/nvmf/host/discovery.sh "${TEST_ARGS[@]}" 01:10:36.954 00:23:30.078 100 run_test "nvmf_host_multipath_status" $rootdir/test/nvmf/host/multipath_status.sh "${TEST_ARGS[@]}" 01:10:36.954 00:23:30.078 101 run_test "nvmf_discovery_remove_ifc" $rootdir/test/nvmf/host/discovery_remove_ifc.sh "${TEST_ARGS[@]}" 01:10:36.954 00:23:30.078 102 run_test "nvmf_identify_kernel_target" "$rootdir/test/nvmf/host/identify_kernel_nvmf.sh" "${TEST_ARGS[@]}" 01:10:36.954 00:23:30.078 103 run_test "nvmf_auth" "$rootdir/test/nvmf/host/auth.sh" "${TEST_ARGS[@]}" 01:10:36.954 00:23:30.078 104 01:10:36.954 00:23:30.078 ... 01:10:36.954 00:23:30.078 01:10:36.954 00:23:30.078 ========== Backtrace end ========== 01:10:36.954 00:23:30.078 ========== Backtrace start: ========== 01:10:36.954 00:23:30.078 01:10:36.954 00:23:30.078 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:1121 -> run_test(["nvmf_tcp"],["/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh"],["--transport=tcp"]) 01:10:36.954 00:23:30.078 ... 01:10:36.954 00:23:30.078 1116 timing_enter $test_name 01:10:36.954 00:23:30.078 1117 echo "************************************" 01:10:36.954 00:23:30.078 1118 echo "START TEST $test_name" 01:10:36.954 00:23:30.078 1119 echo "************************************" 01:10:36.954 00:23:30.078 1120 xtrace_restore 01:10:36.954 00:23:30.078 1121 time "$@" 01:10:36.954 00:23:30.078 1122 xtrace_disable 01:10:36.954 00:23:30.078 1123 echo "************************************" 01:10:36.954 00:23:30.078 1124 echo "END TEST $test_name" 01:10:36.954 00:23:30.078 1125 echo "************************************" 01:10:36.954 00:23:30.078 1126 timing_exit $test_name 01:10:36.954 00:23:30.078 ... 01:10:36.954 00:23:30.078 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh:283 -> main(["/var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf"]) 01:10:36.954 00:23:30.078 ... 01:10:36.954 00:23:30.078 278 # list of all tests can properly differentiate them. Please do not merge them into one line. 01:10:36.954 00:23:30.078 279 if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then 01:10:36.954 00:23:30.078 280 run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.954 00:23:30.078 281 run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.954 00:23:30.078 282 elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then 01:10:36.954 00:23:30.078 => 283 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.954 00:23:30.078 284 if [[ $SPDK_TEST_URING -eq 0 ]]; then 01:10:36.954 00:23:30.078 285 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.954 00:23:30.078 286 run_test "nvmf_identify_passthru" $rootdir/test/nvmf/target/identify_passthru.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.954 00:23:30.078 287 fi 01:10:36.954 00:23:30.078 288 run_test "nvmf_dif" $rootdir/test/nvmf/target/dif.sh 01:10:36.954 00:23:30.078 ... 01:10:36.954 00:23:30.078 01:10:36.954 00:23:30.078 ========== Backtrace end ========== ]] 01:10:36.954 + echo '00:23:28.691 ========== Backtrace start: ========== 01:10:36.954 00:23:28.691 01:10:36.954 00:23:28.691 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:587 -> rpc_cmd(["-s"],["/tmp/host.sock"],["bdev_nvme_start_discovery"],["-b"],["nvme"],["-t"],["tcp"],["-a"],["10.0.0.2"],["-s"],["8009"],["-f"],["ipv4"],["-q"],["nqn.2021-12.io.spdk:test"]) 01:10:36.954 00:23:28.691 ... 01:10:36.954 00:23:28.691 582 echo "$rsp" 01:10:36.954 00:23:28.691 583 done 01:10:36.954 00:23:28.691 584 01:10:36.954 00:23:28.691 585 rc=${!status[*]} 01:10:36.954 00:23:28.691 586 xtrace_restore 01:10:36.954 00:23:28.691 => 587 [[ $rc == 0 ]] 01:10:36.954 00:23:28.691 588 } 01:10:36.954 00:23:28.691 589 01:10:36.954 00:23:28.691 590 function rpc_cmd_simple_data_json() { 01:10:36.954 00:23:28.691 591 01:10:36.954 00:23:28.691 592 local elems="$1[@]" elem 01:10:36.954 00:23:28.691 ... 01:10:36.954 00:23:28.691 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh:51 -> main(["--transport=tcp"]) 01:10:36.954 00:23:28.691 ... 01:10:36.954 00:23:28.691 46 waitforlisten $hostpid $HOST_SOCK 01:10:36.954 00:23:28.691 47 01:10:36.954 00:23:28.691 48 trap '\''process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1'\'' SIGINT SIGTERM EXIT 01:10:36.954 00:23:28.691 49 01:10:36.954 00:23:28.691 50 $rpc_py -s $HOST_SOCK log_set_flag bdev_nvme 01:10:36.954 00:23:28.691 => 51 $rpc_py -s $HOST_SOCK bdev_nvme_start_discovery -b nvme -t $TEST_TRANSPORT -a $NVMF_FIRST_TARGET_IP \ 01:10:36.954 00:23:28.691 52 -s $DISCOVERY_PORT -f ipv4 -q $HOST_NQN 01:10:36.954 00:23:28.691 53 01:10:36.954 00:23:28.691 54 function get_bdev_list() { 01:10:36.954 00:23:28.691 55 $rpc_py -s $HOST_SOCK bdev_get_bdevs | jq -r '\''.[].name'\'' | sort | xargs 01:10:36.954 00:23:28.691 56 } 01:10:36.954 00:23:28.691 ... 01:10:36.954 00:23:28.691 01:10:36.954 00:23:28.691 ========== Backtrace end ========== 01:10:36.954 00:23:30.077 ========== Backtrace start: ========== 01:10:36.954 00:23:30.077 01:10:36.954 00:23:30.077 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:1121 -> run_test(["nvmf_host_discovery"],["/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh"],["--transport=tcp"]) 01:10:36.954 00:23:30.077 ... 01:10:36.954 00:23:30.077 1116 timing_enter $test_name 01:10:36.954 00:23:30.077 1117 echo "************************************" 01:10:36.954 00:23:30.077 1118 echo "START TEST $test_name" 01:10:36.954 00:23:30.077 1119 echo "************************************" 01:10:36.954 00:23:30.077 1120 xtrace_restore 01:10:36.954 00:23:30.077 1121 time "$@" 01:10:36.954 00:23:30.077 1122 xtrace_disable 01:10:36.954 00:23:30.077 1123 echo "************************************" 01:10:36.954 00:23:30.077 1124 echo "END TEST $test_name" 01:10:36.954 00:23:30.077 1125 echo "************************************" 01:10:36.954 00:23:30.077 1126 timing_exit $test_name 01:10:36.954 00:23:30.077 ... 01:10:36.955 00:23:30.078 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh:99 -> main(["--transport=tcp"]) 01:10:36.955 00:23:30.078 ... 01:10:36.955 00:23:30.078 94 01:10:36.955 00:23:30.078 95 run_test "nvmf_identify" $rootdir/test/nvmf/host/identify.sh "${TEST_ARGS[@]}" 01:10:36.955 00:23:30.078 96 run_test "nvmf_perf" $rootdir/test/nvmf/host/perf.sh "${TEST_ARGS[@]}" 01:10:36.955 00:23:30.078 97 run_test "nvmf_fio_host" $rootdir/test/nvmf/host/fio.sh "${TEST_ARGS[@]}" 01:10:36.955 00:23:30.078 98 run_test "nvmf_failover" $rootdir/test/nvmf/host/failover.sh "${TEST_ARGS[@]}" 01:10:36.955 00:23:30.078 => 99 run_test "nvmf_host_discovery" $rootdir/test/nvmf/host/discovery.sh "${TEST_ARGS[@]}" 01:10:36.955 00:23:30.078 100 run_test "nvmf_host_multipath_status" $rootdir/test/nvmf/host/multipath_status.sh "${TEST_ARGS[@]}" 01:10:36.955 00:23:30.078 101 run_test "nvmf_discovery_remove_ifc" $rootdir/test/nvmf/host/discovery_remove_ifc.sh "${TEST_ARGS[@]}" 01:10:36.955 00:23:30.078 102 run_test "nvmf_identify_kernel_target" "$rootdir/test/nvmf/host/identify_kernel_nvmf.sh" "${TEST_ARGS[@]}" 01:10:36.955 00:23:30.078 103 run_test "nvmf_auth" "$rootdir/test/nvmf/host/auth.sh" "${TEST_ARGS[@]}" 01:10:36.955 00:23:30.078 104 01:10:36.955 00:23:30.078 ... 01:10:36.955 00:23:30.078 01:10:36.955 00:23:30.078 ========== Backtrace end ========== 01:10:36.955 00:23:30.078 ========== Backtrace start: ========== 01:10:36.955 00:23:30.078 01:10:36.955 00:23:30.078 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:1121 -> run_test(["nvmf_tcp"],["/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh"],["--transport=tcp"]) 01:10:36.955 00:23:30.078 ... 01:10:36.955 00:23:30.078 1116 timing_enter $test_name 01:10:36.955 00:23:30.078 1117 echo "************************************" 01:10:36.955 00:23:30.078 1118 echo "START TEST $test_name" 01:10:36.955 00:23:30.078 1119 echo "************************************" 01:10:36.955 00:23:30.078 1120 xtrace_restore 01:10:36.955 00:23:30.078 1121 time "$@" 01:10:36.955 00:23:30.078 1122 xtrace_disable 01:10:36.955 00:23:30.078 1123 echo "************************************" 01:10:36.955 00:23:30.078 1124 echo "END TEST $test_name" 01:10:36.955 00:23:30.078 1125 echo "************************************" 01:10:36.955 00:23:30.078 1126 timing_exit $test_name 01:10:36.955 00:23:30.078 ... 01:10:36.955 00:23:30.078 in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh:283 -> main(["/var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf"]) 01:10:36.955 00:23:30.078 ... 01:10:36.955 00:23:30.078 278 # list of all tests can properly differentiate them. Please do not merge them into one line. 01:10:36.955 00:23:30.078 279 if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then 01:10:36.955 00:23:30.078 280 run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.955 00:23:30.078 281 run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.955 00:23:30.078 282 elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then 01:10:36.955 00:23:30.078 => 283 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.955 00:23:30.078 284 if [[ $SPDK_TEST_URING -eq 0 ]]; then 01:10:36.955 00:23:30.078 285 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.955 00:23:30.078 286 run_test "nvmf_identify_passthru" $rootdir/test/nvmf/target/identify_passthru.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.955 00:23:30.078 287 fi 01:10:36.955 00:23:30.078 288 run_test "nvmf_dif" $rootdir/test/nvmf/target/dif.sh 01:10:36.955 00:23:30.078 ... 01:10:36.955 00:23:30.078 01:10:36.955 00:23:30.078 ========== Backtrace end ==========' 01:10:36.955 + for build in "${build_log_list[@]}" 01:10:36.955 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_3/short-fuzz-phy-autotest_26220/build.log 01:10:36.955 + local build_log job_name start_pattern end_pattern backtraces 01:10:36.955 + build_log=/var/jenkins/workspace/autotest-per-patch_3/short-fuzz-phy-autotest_26220/build.log 01:10:36.955 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/short-fuzz-phy-autotest_26220/build.log 01:10:36.955 ++ basename /var/jenkins/workspace/autotest-per-patch_3/short-fuzz-phy-autotest_26220 01:10:36.955 + job_name=short-fuzz-phy-autotest_26220 01:10:36.955 + start_pattern='Backtrace start' 01:10:36.955 + end_pattern='Backtrace end' 01:10:36.955 + [[ -f /var/jenkins/workspace/autotest-per-patch_3/short-fuzz-phy-autotest_26220/build.log ]] 01:10:36.955 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_3/short-fuzz-phy-autotest_26220/build.log 01:10:36.955 + backtraces= 01:10:36.955 + [[ -n '' ]] 01:10:36.955 + for build in "${build_log_list[@]}" 01:10:36.955 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_3/BlobFS-phy-autotest_26229/build.log 01:10:36.955 + local build_log job_name start_pattern end_pattern backtraces 01:10:36.955 + build_log=/var/jenkins/workspace/autotest-per-patch_3/BlobFS-phy-autotest_26229/build.log 01:10:36.955 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/BlobFS-phy-autotest_26229/build.log 01:10:36.955 ++ basename /var/jenkins/workspace/autotest-per-patch_3/BlobFS-phy-autotest_26229 01:10:36.955 + job_name=BlobFS-phy-autotest_26229 01:10:36.955 + start_pattern='Backtrace start' 01:10:36.955 + end_pattern='Backtrace end' 01:10:36.955 + [[ -f /var/jenkins/workspace/autotest-per-patch_3/BlobFS-phy-autotest_26229/build.log ]] 01:10:36.955 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_3/BlobFS-phy-autotest_26229/build.log 01:10:36.955 + backtraces= 01:10:36.955 + [[ -n '' ]] 01:10:36.955 + for build in "${build_log_list[@]}" 01:10:36.955 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_3/nvme-phy-autotest_72395/build.log 01:10:36.955 + local build_log job_name start_pattern end_pattern backtraces 01:10:36.955 + build_log=/var/jenkins/workspace/autotest-per-patch_3/nvme-phy-autotest_72395/build.log 01:10:36.955 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/nvme-phy-autotest_72395/build.log 01:10:36.955 ++ basename /var/jenkins/workspace/autotest-per-patch_3/nvme-phy-autotest_72395 01:10:36.955 + job_name=nvme-phy-autotest_72395 01:10:36.955 + start_pattern='Backtrace start' 01:10:36.955 + end_pattern='Backtrace end' 01:10:36.955 + [[ -f /var/jenkins/workspace/autotest-per-patch_3/nvme-phy-autotest_72395/build.log ]] 01:10:36.955 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_3/nvme-phy-autotest_72395/build.log 01:10:36.955 + backtraces= 01:10:36.955 + [[ -n '' ]] 01:10:36.955 + for build in "${build_log_list[@]}" 01:10:36.955 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_3/nvmf-tcp-vg-autotest_77494/build.log 01:10:36.955 + local build_log job_name start_pattern end_pattern backtraces 01:10:36.955 + build_log=/var/jenkins/workspace/autotest-per-patch_3/nvmf-tcp-vg-autotest_77494/build.log 01:10:36.955 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/nvmf-tcp-vg-autotest_77494/build.log 01:10:36.955 ++ basename /var/jenkins/workspace/autotest-per-patch_3/nvmf-tcp-vg-autotest_77494 01:10:36.955 + job_name=nvmf-tcp-vg-autotest_77494 01:10:36.956 + start_pattern='Backtrace start' 01:10:36.956 + end_pattern='Backtrace end' 01:10:36.956 + [[ -f /var/jenkins/workspace/autotest-per-patch_3/nvmf-tcp-vg-autotest_77494/build.log ]] 01:10:36.956 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_3/nvmf-tcp-vg-autotest_77494/build.log 01:10:36.956 + backtraces='00:26:25.080 ========== Backtrace start: ========== 01:10:36.956 00:26:25.080 01:10:36.956 00:26:25.080 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:587 -> rpc_cmd(["-s"],["/tmp/host.sock"],["bdev_nvme_start_discovery"],["-b"],["nvme"],["-t"],["tcp"],["-a"],["10.0.0.2"],["-s"],["8009"],["-f"],["ipv4"],["-q"],["nqn.2021-12.io.spdk:test"]) 01:10:36.956 00:26:25.080 ... 01:10:36.956 00:26:25.080 582 echo "$rsp" 01:10:36.956 00:26:25.080 583 done 01:10:36.956 00:26:25.080 584 01:10:36.956 00:26:25.080 585 rc=${!status[*]} 01:10:36.956 00:26:25.080 586 xtrace_restore 01:10:36.956 00:26:25.080 => 587 [[ $rc == 0 ]] 01:10:36.956 00:26:25.080 588 } 01:10:36.956 00:26:25.080 589 01:10:36.956 00:26:25.080 590 function rpc_cmd_simple_data_json() { 01:10:36.956 00:26:25.080 591 01:10:36.956 00:26:25.080 592 local elems="$1[@]" elem 01:10:36.956 00:26:25.080 ... 01:10:36.956 00:26:25.080 in /home/vagrant/spdk_repo/spdk/test/nvmf/host/discovery.sh:51 -> main(["--transport=tcp"]) 01:10:36.956 00:26:25.080 ... 01:10:36.956 00:26:25.080 46 waitforlisten $hostpid $HOST_SOCK 01:10:36.956 00:26:25.080 47 01:10:36.956 00:26:25.080 48 trap '\''process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1'\'' SIGINT SIGTERM EXIT 01:10:36.956 00:26:25.080 49 01:10:36.956 00:26:25.080 50 $rpc_py -s $HOST_SOCK log_set_flag bdev_nvme 01:10:36.956 00:26:25.080 => 51 $rpc_py -s $HOST_SOCK bdev_nvme_start_discovery -b nvme -t $TEST_TRANSPORT -a $NVMF_FIRST_TARGET_IP \ 01:10:36.956 00:26:25.080 52 -s $DISCOVERY_PORT -f ipv4 -q $HOST_NQN 01:10:36.956 00:26:25.080 53 01:10:36.956 00:26:25.080 54 function get_bdev_list() { 01:10:36.956 00:26:25.080 55 $rpc_py -s $HOST_SOCK bdev_get_bdevs | jq -r '\''.[].name'\'' | sort | xargs 01:10:36.956 00:26:25.080 56 } 01:10:36.956 00:26:25.080 ... 01:10:36.956 00:26:25.080 01:10:36.956 00:26:25.080 ========== Backtrace end ========== 01:10:36.956 00:26:25.080 ========== Backtrace start: ========== 01:10:36.956 00:26:25.080 01:10:36.956 00:26:25.080 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1121 -> run_test(["nvmf_host_discovery"],["/home/vagrant/spdk_repo/spdk/test/nvmf/host/discovery.sh"],["--transport=tcp"]) 01:10:36.956 00:26:25.080 ... 01:10:36.956 00:26:25.080 1116 timing_enter $test_name 01:10:36.956 00:26:25.080 1117 echo "************************************" 01:10:36.956 00:26:25.080 1118 echo "START TEST $test_name" 01:10:36.956 00:26:25.080 1119 echo "************************************" 01:10:36.956 00:26:25.080 1120 xtrace_restore 01:10:36.956 00:26:25.080 1121 time "$@" 01:10:36.956 00:26:25.080 1122 xtrace_disable 01:10:36.956 00:26:25.080 1123 echo "************************************" 01:10:36.956 00:26:25.080 1124 echo "END TEST $test_name" 01:10:36.956 00:26:25.080 1125 echo "************************************" 01:10:36.956 00:26:25.080 1126 timing_exit $test_name 01:10:36.956 00:26:25.080 ... 01:10:36.956 00:26:25.080 in /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh:99 -> main(["--transport=tcp"]) 01:10:36.956 00:26:25.080 ... 01:10:36.956 00:26:25.080 94 01:10:36.956 00:26:25.080 95 run_test "nvmf_identify" $rootdir/test/nvmf/host/identify.sh "${TEST_ARGS[@]}" 01:10:36.956 00:26:25.080 96 run_test "nvmf_perf" $rootdir/test/nvmf/host/perf.sh "${TEST_ARGS[@]}" 01:10:36.956 00:26:25.080 97 run_test "nvmf_fio_host" $rootdir/test/nvmf/host/fio.sh "${TEST_ARGS[@]}" 01:10:36.956 00:26:25.080 98 run_test "nvmf_failover" $rootdir/test/nvmf/host/failover.sh "${TEST_ARGS[@]}" 01:10:36.956 00:26:25.081 => 99 run_test "nvmf_host_discovery" $rootdir/test/nvmf/host/discovery.sh "${TEST_ARGS[@]}" 01:10:36.956 00:26:25.081 100 run_test "nvmf_host_multipath_status" $rootdir/test/nvmf/host/multipath_status.sh "${TEST_ARGS[@]}" 01:10:36.956 00:26:25.081 101 run_test "nvmf_discovery_remove_ifc" $rootdir/test/nvmf/host/discovery_remove_ifc.sh "${TEST_ARGS[@]}" 01:10:36.956 00:26:25.081 102 run_test "nvmf_identify_kernel_target" "$rootdir/test/nvmf/host/identify_kernel_nvmf.sh" "${TEST_ARGS[@]}" 01:10:36.956 00:26:25.081 103 run_test "nvmf_auth" "$rootdir/test/nvmf/host/auth.sh" "${TEST_ARGS[@]}" 01:10:36.956 00:26:25.081 104 01:10:36.956 00:26:25.081 ... 01:10:36.956 00:26:25.081 01:10:36.956 00:26:25.081 ========== Backtrace end ========== 01:10:36.956 00:26:25.081 ========== Backtrace start: ========== 01:10:36.956 00:26:25.081 01:10:36.956 00:26:25.081 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1121 -> run_test(["nvmf_tcp"],["/home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh"],["--transport=tcp"]) 01:10:36.956 00:26:25.081 ... 01:10:36.956 00:26:25.081 1116 timing_enter $test_name 01:10:36.956 00:26:25.081 1117 echo "************************************" 01:10:36.956 00:26:25.081 1118 echo "START TEST $test_name" 01:10:36.956 00:26:25.081 1119 echo "************************************" 01:10:36.956 00:26:25.081 1120 xtrace_restore 01:10:36.956 00:26:25.081 1121 time "$@" 01:10:36.956 00:26:25.081 1122 xtrace_disable 01:10:36.956 00:26:25.081 1123 echo "************************************" 01:10:36.956 00:26:25.081 1124 echo "END TEST $test_name" 01:10:36.956 00:26:25.081 1125 echo "************************************" 01:10:36.956 00:26:25.081 1126 timing_exit $test_name 01:10:36.956 00:26:25.081 ... 01:10:36.956 00:26:25.081 in /home/vagrant/spdk_repo/spdk/autotest.sh:283 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 01:10:36.956 00:26:25.081 ... 01:10:36.956 00:26:25.081 278 # list of all tests can properly differentiate them. Please do not merge them into one line. 01:10:36.956 00:26:25.081 279 if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then 01:10:36.956 00:26:25.081 280 run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.956 00:26:25.081 281 run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.956 00:26:25.081 282 elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then 01:10:36.956 00:26:25.081 => 283 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.956 00:26:25.081 284 if [[ $SPDK_TEST_URING -eq 0 ]]; then 01:10:36.956 00:26:25.081 285 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.956 00:26:25.081 286 run_test "nvmf_identify_passthru" $rootdir/test/nvmf/target/identify_passthru.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.956 00:26:25.081 287 fi 01:10:36.956 00:26:25.081 288 run_test "nvmf_dif" $rootdir/test/nvmf/target/dif.sh 01:10:36.956 00:26:25.081 ... 01:10:36.956 00:26:25.081 01:10:36.956 00:26:25.081 ========== Backtrace end ==========' 01:10:36.956 + [[ -n 00:26:25.080 ========== Backtrace start: ========== 01:10:36.956 00:26:25.080 01:10:36.957 00:26:25.080 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:587 -> rpc_cmd(["-s"],["/tmp/host.sock"],["bdev_nvme_start_discovery"],["-b"],["nvme"],["-t"],["tcp"],["-a"],["10.0.0.2"],["-s"],["8009"],["-f"],["ipv4"],["-q"],["nqn.2021-12.io.spdk:test"]) 01:10:36.957 00:26:25.080 ... 01:10:36.957 00:26:25.080 582 echo "$rsp" 01:10:36.957 00:26:25.080 583 done 01:10:36.957 00:26:25.080 584 01:10:36.957 00:26:25.080 585 rc=${!status[*]} 01:10:36.957 00:26:25.080 586 xtrace_restore 01:10:36.957 00:26:25.080 => 587 [[ $rc == 0 ]] 01:10:36.957 00:26:25.080 588 } 01:10:36.957 00:26:25.080 589 01:10:36.957 00:26:25.080 590 function rpc_cmd_simple_data_json() { 01:10:36.957 00:26:25.080 591 01:10:36.957 00:26:25.080 592 local elems="$1[@]" elem 01:10:36.957 00:26:25.080 ... 01:10:36.957 00:26:25.080 in /home/vagrant/spdk_repo/spdk/test/nvmf/host/discovery.sh:51 -> main(["--transport=tcp"]) 01:10:36.957 00:26:25.080 ... 01:10:36.957 00:26:25.080 46 waitforlisten $hostpid $HOST_SOCK 01:10:36.957 00:26:25.080 47 01:10:36.957 00:26:25.080 48 trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 01:10:36.957 00:26:25.080 49 01:10:36.957 00:26:25.080 50 $rpc_py -s $HOST_SOCK log_set_flag bdev_nvme 01:10:36.957 00:26:25.080 => 51 $rpc_py -s $HOST_SOCK bdev_nvme_start_discovery -b nvme -t $TEST_TRANSPORT -a $NVMF_FIRST_TARGET_IP \ 01:10:36.957 00:26:25.080 52 -s $DISCOVERY_PORT -f ipv4 -q $HOST_NQN 01:10:36.957 00:26:25.080 53 01:10:36.957 00:26:25.080 54 function get_bdev_list() { 01:10:36.957 00:26:25.080 55 $rpc_py -s $HOST_SOCK bdev_get_bdevs | jq -r '.[].name' | sort | xargs 01:10:36.957 00:26:25.080 56 } 01:10:36.957 00:26:25.080 ... 01:10:36.957 00:26:25.080 01:10:36.957 00:26:25.080 ========== Backtrace end ========== 01:10:36.957 00:26:25.080 ========== Backtrace start: ========== 01:10:36.957 00:26:25.080 01:10:36.957 00:26:25.080 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1121 -> run_test(["nvmf_host_discovery"],["/home/vagrant/spdk_repo/spdk/test/nvmf/host/discovery.sh"],["--transport=tcp"]) 01:10:36.957 00:26:25.080 ... 01:10:36.957 00:26:25.080 1116 timing_enter $test_name 01:10:36.957 00:26:25.080 1117 echo "************************************" 01:10:36.957 00:26:25.080 1118 echo "START TEST $test_name" 01:10:36.957 00:26:25.080 1119 echo "************************************" 01:10:36.957 00:26:25.080 1120 xtrace_restore 01:10:36.957 00:26:25.080 1121 time "$@" 01:10:36.957 00:26:25.080 1122 xtrace_disable 01:10:36.957 00:26:25.080 1123 echo "************************************" 01:10:36.957 00:26:25.080 1124 echo "END TEST $test_name" 01:10:36.957 00:26:25.080 1125 echo "************************************" 01:10:36.957 00:26:25.080 1126 timing_exit $test_name 01:10:36.957 00:26:25.080 ... 01:10:36.957 00:26:25.080 in /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh:99 -> main(["--transport=tcp"]) 01:10:36.957 00:26:25.080 ... 01:10:36.957 00:26:25.080 94 01:10:36.957 00:26:25.080 95 run_test "nvmf_identify" $rootdir/test/nvmf/host/identify.sh "${TEST_ARGS[@]}" 01:10:36.957 00:26:25.080 96 run_test "nvmf_perf" $rootdir/test/nvmf/host/perf.sh "${TEST_ARGS[@]}" 01:10:36.957 00:26:25.080 97 run_test "nvmf_fio_host" $rootdir/test/nvmf/host/fio.sh "${TEST_ARGS[@]}" 01:10:36.957 00:26:25.080 98 run_test "nvmf_failover" $rootdir/test/nvmf/host/failover.sh "${TEST_ARGS[@]}" 01:10:36.957 00:26:25.081 => 99 run_test "nvmf_host_discovery" $rootdir/test/nvmf/host/discovery.sh "${TEST_ARGS[@]}" 01:10:36.957 00:26:25.081 100 run_test "nvmf_host_multipath_status" $rootdir/test/nvmf/host/multipath_status.sh "${TEST_ARGS[@]}" 01:10:36.957 00:26:25.081 101 run_test "nvmf_discovery_remove_ifc" $rootdir/test/nvmf/host/discovery_remove_ifc.sh "${TEST_ARGS[@]}" 01:10:36.957 00:26:25.081 102 run_test "nvmf_identify_kernel_target" "$rootdir/test/nvmf/host/identify_kernel_nvmf.sh" "${TEST_ARGS[@]}" 01:10:36.957 00:26:25.081 103 run_test "nvmf_auth" "$rootdir/test/nvmf/host/auth.sh" "${TEST_ARGS[@]}" 01:10:36.957 00:26:25.081 104 01:10:36.957 00:26:25.081 ... 01:10:36.957 00:26:25.081 01:10:36.957 00:26:25.081 ========== Backtrace end ========== 01:10:36.957 00:26:25.081 ========== Backtrace start: ========== 01:10:36.957 00:26:25.081 01:10:36.957 00:26:25.081 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1121 -> run_test(["nvmf_tcp"],["/home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh"],["--transport=tcp"]) 01:10:36.957 00:26:25.081 ... 01:10:36.957 00:26:25.081 1116 timing_enter $test_name 01:10:36.957 00:26:25.081 1117 echo "************************************" 01:10:36.957 00:26:25.081 1118 echo "START TEST $test_name" 01:10:36.957 00:26:25.081 1119 echo "************************************" 01:10:36.957 00:26:25.081 1120 xtrace_restore 01:10:36.957 00:26:25.081 1121 time "$@" 01:10:36.957 00:26:25.081 1122 xtrace_disable 01:10:36.957 00:26:25.081 1123 echo "************************************" 01:10:36.957 00:26:25.081 1124 echo "END TEST $test_name" 01:10:36.957 00:26:25.081 1125 echo "************************************" 01:10:36.957 00:26:25.081 1126 timing_exit $test_name 01:10:36.957 00:26:25.081 ... 01:10:36.957 00:26:25.081 in /home/vagrant/spdk_repo/spdk/autotest.sh:283 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 01:10:36.957 00:26:25.081 ... 01:10:36.957 00:26:25.081 278 # list of all tests can properly differentiate them. Please do not merge them into one line. 01:10:36.957 00:26:25.081 279 if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then 01:10:36.957 00:26:25.081 280 run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.957 00:26:25.081 281 run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.957 00:26:25.081 282 elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then 01:10:36.957 00:26:25.081 => 283 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.957 00:26:25.081 284 if [[ $SPDK_TEST_URING -eq 0 ]]; then 01:10:36.957 00:26:25.081 285 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.957 00:26:25.081 286 run_test "nvmf_identify_passthru" $rootdir/test/nvmf/target/identify_passthru.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.957 00:26:25.081 287 fi 01:10:36.957 00:26:25.081 288 run_test "nvmf_dif" $rootdir/test/nvmf/target/dif.sh 01:10:36.957 00:26:25.081 ... 01:10:36.957 00:26:25.081 01:10:36.957 00:26:25.081 ========== Backtrace end ========== ]] 01:10:36.957 + echo '00:26:25.080 ========== Backtrace start: ========== 01:10:36.957 00:26:25.080 01:10:36.957 00:26:25.080 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:587 -> rpc_cmd(["-s"],["/tmp/host.sock"],["bdev_nvme_start_discovery"],["-b"],["nvme"],["-t"],["tcp"],["-a"],["10.0.0.2"],["-s"],["8009"],["-f"],["ipv4"],["-q"],["nqn.2021-12.io.spdk:test"]) 01:10:36.957 00:26:25.080 ... 01:10:36.957 00:26:25.080 582 echo "$rsp" 01:10:36.957 00:26:25.080 583 done 01:10:36.957 00:26:25.080 584 01:10:36.957 00:26:25.080 585 rc=${!status[*]} 01:10:36.957 00:26:25.080 586 xtrace_restore 01:10:36.957 00:26:25.080 => 587 [[ $rc == 0 ]] 01:10:36.958 00:26:25.080 588 } 01:10:36.958 00:26:25.080 589 01:10:36.958 00:26:25.080 590 function rpc_cmd_simple_data_json() { 01:10:36.958 00:26:25.080 591 01:10:36.958 00:26:25.080 592 local elems="$1[@]" elem 01:10:36.958 00:26:25.080 ... 01:10:36.958 00:26:25.080 in /home/vagrant/spdk_repo/spdk/test/nvmf/host/discovery.sh:51 -> main(["--transport=tcp"]) 01:10:36.958 00:26:25.080 ... 01:10:36.958 00:26:25.080 46 waitforlisten $hostpid $HOST_SOCK 01:10:36.958 00:26:25.080 47 01:10:36.958 00:26:25.080 48 trap '\''process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1'\'' SIGINT SIGTERM EXIT 01:10:36.958 00:26:25.080 49 01:10:36.958 00:26:25.080 50 $rpc_py -s $HOST_SOCK log_set_flag bdev_nvme 01:10:36.958 00:26:25.080 => 51 $rpc_py -s $HOST_SOCK bdev_nvme_start_discovery -b nvme -t $TEST_TRANSPORT -a $NVMF_FIRST_TARGET_IP \ 01:10:36.958 00:26:25.080 52 -s $DISCOVERY_PORT -f ipv4 -q $HOST_NQN 01:10:36.958 00:26:25.080 53 01:10:36.958 00:26:25.080 54 function get_bdev_list() { 01:10:36.958 00:26:25.080 55 $rpc_py -s $HOST_SOCK bdev_get_bdevs | jq -r '\''.[].name'\'' | sort | xargs 01:10:36.958 00:26:25.080 56 } 01:10:36.958 00:26:25.080 ... 01:10:36.958 00:26:25.080 01:10:36.958 00:26:25.080 ========== Backtrace end ========== 01:10:36.958 00:26:25.080 ========== Backtrace start: ========== 01:10:36.958 00:26:25.080 01:10:36.958 00:26:25.080 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1121 -> run_test(["nvmf_host_discovery"],["/home/vagrant/spdk_repo/spdk/test/nvmf/host/discovery.sh"],["--transport=tcp"]) 01:10:36.958 00:26:25.080 ... 01:10:36.958 00:26:25.080 1116 timing_enter $test_name 01:10:36.958 00:26:25.080 1117 echo "************************************" 01:10:36.958 00:26:25.080 1118 echo "START TEST $test_name" 01:10:36.958 00:26:25.080 1119 echo "************************************" 01:10:36.958 00:26:25.080 1120 xtrace_restore 01:10:36.958 00:26:25.080 1121 time "$@" 01:10:36.958 00:26:25.080 1122 xtrace_disable 01:10:36.958 00:26:25.080 1123 echo "************************************" 01:10:36.958 00:26:25.080 1124 echo "END TEST $test_name" 01:10:36.958 00:26:25.080 1125 echo "************************************" 01:10:36.958 00:26:25.080 1126 timing_exit $test_name 01:10:36.958 00:26:25.080 ... 01:10:36.958 00:26:25.080 in /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh:99 -> main(["--transport=tcp"]) 01:10:36.958 00:26:25.080 ... 01:10:36.958 00:26:25.080 94 01:10:36.958 00:26:25.080 95 run_test "nvmf_identify" $rootdir/test/nvmf/host/identify.sh "${TEST_ARGS[@]}" 01:10:36.958 00:26:25.080 96 run_test "nvmf_perf" $rootdir/test/nvmf/host/perf.sh "${TEST_ARGS[@]}" 01:10:36.958 00:26:25.080 97 run_test "nvmf_fio_host" $rootdir/test/nvmf/host/fio.sh "${TEST_ARGS[@]}" 01:10:36.958 00:26:25.080 98 run_test "nvmf_failover" $rootdir/test/nvmf/host/failover.sh "${TEST_ARGS[@]}" 01:10:36.958 00:26:25.081 => 99 run_test "nvmf_host_discovery" $rootdir/test/nvmf/host/discovery.sh "${TEST_ARGS[@]}" 01:10:36.958 00:26:25.081 100 run_test "nvmf_host_multipath_status" $rootdir/test/nvmf/host/multipath_status.sh "${TEST_ARGS[@]}" 01:10:36.958 00:26:25.081 101 run_test "nvmf_discovery_remove_ifc" $rootdir/test/nvmf/host/discovery_remove_ifc.sh "${TEST_ARGS[@]}" 01:10:36.958 00:26:25.081 102 run_test "nvmf_identify_kernel_target" "$rootdir/test/nvmf/host/identify_kernel_nvmf.sh" "${TEST_ARGS[@]}" 01:10:36.958 00:26:25.081 103 run_test "nvmf_auth" "$rootdir/test/nvmf/host/auth.sh" "${TEST_ARGS[@]}" 01:10:36.958 00:26:25.081 104 01:10:36.958 00:26:25.081 ... 01:10:36.958 00:26:25.081 01:10:36.958 00:26:25.081 ========== Backtrace end ========== 01:10:36.958 00:26:25.081 ========== Backtrace start: ========== 01:10:36.958 00:26:25.081 01:10:36.958 00:26:25.081 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1121 -> run_test(["nvmf_tcp"],["/home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh"],["--transport=tcp"]) 01:10:36.958 00:26:25.081 ... 01:10:36.958 00:26:25.081 1116 timing_enter $test_name 01:10:36.958 00:26:25.081 1117 echo "************************************" 01:10:36.958 00:26:25.081 1118 echo "START TEST $test_name" 01:10:36.958 00:26:25.081 1119 echo "************************************" 01:10:36.958 00:26:25.081 1120 xtrace_restore 01:10:36.958 00:26:25.081 1121 time "$@" 01:10:36.958 00:26:25.081 1122 xtrace_disable 01:10:36.958 00:26:25.081 1123 echo "************************************" 01:10:36.958 00:26:25.081 1124 echo "END TEST $test_name" 01:10:36.958 00:26:25.081 1125 echo "************************************" 01:10:36.958 00:26:25.081 1126 timing_exit $test_name 01:10:36.958 00:26:25.081 ... 01:10:36.958 00:26:25.081 in /home/vagrant/spdk_repo/spdk/autotest.sh:283 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 01:10:36.958 00:26:25.081 ... 01:10:36.958 00:26:25.081 278 # list of all tests can properly differentiate them. Please do not merge them into one line. 01:10:36.958 00:26:25.081 279 if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then 01:10:36.958 00:26:25.081 280 run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.958 00:26:25.081 281 run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.958 00:26:25.081 282 elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then 01:10:36.958 00:26:25.081 => 283 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.958 00:26:25.081 284 if [[ $SPDK_TEST_URING -eq 0 ]]; then 01:10:36.958 00:26:25.081 285 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.958 00:26:25.081 286 run_test "nvmf_identify_passthru" $rootdir/test/nvmf/target/identify_passthru.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.958 00:26:25.081 287 fi 01:10:36.958 00:26:25.081 288 run_test "nvmf_dif" $rootdir/test/nvmf/target/dif.sh 01:10:36.958 00:26:25.081 ... 01:10:36.958 00:26:25.081 01:10:36.958 00:26:25.081 ========== Backtrace end ==========' 01:10:36.958 + for build in "${build_log_list[@]}" 01:10:36.958 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_3/crypto-phy-autotest_26223/build.log 01:10:36.958 + local build_log job_name start_pattern end_pattern backtraces 01:10:36.958 + build_log=/var/jenkins/workspace/autotest-per-patch_3/crypto-phy-autotest_26223/build.log 01:10:36.958 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/crypto-phy-autotest_26223/build.log 01:10:36.958 ++ basename /var/jenkins/workspace/autotest-per-patch_3/crypto-phy-autotest_26223 01:10:36.958 + job_name=crypto-phy-autotest_26223 01:10:36.958 + start_pattern='Backtrace start' 01:10:36.958 + end_pattern='Backtrace end' 01:10:36.958 + [[ -f /var/jenkins/workspace/autotest-per-patch_3/crypto-phy-autotest_26223/build.log ]] 01:10:36.958 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_3/crypto-phy-autotest_26223/build.log 01:10:36.958 + backtraces= 01:10:36.958 + [[ -n '' ]] 01:10:36.958 + for build in "${build_log_list[@]}" 01:10:36.958 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_3/ubuntu20-vg-autotest_73822/build.log 01:10:36.958 + local build_log job_name start_pattern end_pattern backtraces 01:10:36.958 + build_log=/var/jenkins/workspace/autotest-per-patch_3/ubuntu20-vg-autotest_73822/build.log 01:10:36.959 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/ubuntu20-vg-autotest_73822/build.log 01:10:36.959 ++ basename /var/jenkins/workspace/autotest-per-patch_3/ubuntu20-vg-autotest_73822 01:10:36.959 + job_name=ubuntu20-vg-autotest_73822 01:10:36.959 + start_pattern='Backtrace start' 01:10:36.959 + end_pattern='Backtrace end' 01:10:36.959 + [[ -f /var/jenkins/workspace/autotest-per-patch_3/ubuntu20-vg-autotest_73822/build.log ]] 01:10:36.959 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_3/ubuntu20-vg-autotest_73822/build.log 01:10:36.959 + backtraces= 01:10:36.959 + [[ -n '' ]] 01:10:36.959 + for build in "${build_log_list[@]}" 01:10:36.959 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_3/dsa-phy-autotest_4923/build.log 01:10:36.959 + local build_log job_name start_pattern end_pattern backtraces 01:10:36.959 + build_log=/var/jenkins/workspace/autotest-per-patch_3/dsa-phy-autotest_4923/build.log 01:10:36.959 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/dsa-phy-autotest_4923/build.log 01:10:36.959 ++ basename /var/jenkins/workspace/autotest-per-patch_3/dsa-phy-autotest_4923 01:10:36.959 + job_name=dsa-phy-autotest_4923 01:10:36.959 + start_pattern='Backtrace start' 01:10:36.959 + end_pattern='Backtrace end' 01:10:36.959 + [[ -f /var/jenkins/workspace/autotest-per-patch_3/dsa-phy-autotest_4923/build.log ]] 01:10:36.959 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_3/dsa-phy-autotest_4923/build.log 01:10:36.959 + backtraces='00:22:10.804 ========== Backtrace start: ========== 01:10:36.959 00:22:10.804 01:10:36.959 00:22:10.804 in /var/jenkins/workspace/dsa-phy-autotest/spdk/test/common/autotest_common.sh:587 -> rpc_cmd(["-s"],["/tmp/host.sock"],["bdev_nvme_start_discovery"],["-b"],["nvme"],["-t"],["tcp"],["-a"],["10.0.0.2"],["-s"],["8009"],["-f"],["ipv4"],["-q"],["nqn.2021-12.io.spdk:test"]) 01:10:36.959 00:22:10.804 ... 01:10:36.959 00:22:10.804 582 echo "$rsp" 01:10:36.959 00:22:10.804 583 done 01:10:36.959 00:22:10.804 584 01:10:36.959 00:22:10.804 585 rc=${!status[*]} 01:10:36.959 00:22:10.804 586 xtrace_restore 01:10:36.959 00:22:10.804 => 587 [[ $rc == 0 ]] 01:10:36.959 00:22:10.804 588 } 01:10:36.959 00:22:10.804 589 01:10:36.959 00:22:10.804 590 function rpc_cmd_simple_data_json() { 01:10:36.959 00:22:10.804 591 01:10:36.959 00:22:10.804 592 local elems="$1[@]" elem 01:10:36.959 00:22:10.804 ... 01:10:36.959 00:22:10.804 in /var/jenkins/workspace/dsa-phy-autotest/spdk/test/nvmf/host/discovery.sh:51 -> main(["--transport=tcp"]) 01:10:36.959 00:22:10.804 ... 01:10:36.959 00:22:10.804 46 waitforlisten $hostpid $HOST_SOCK 01:10:36.959 00:22:10.804 47 01:10:36.959 00:22:10.804 48 trap '\''process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1'\'' SIGINT SIGTERM EXIT 01:10:36.959 00:22:10.804 49 01:10:36.959 00:22:10.804 50 $rpc_py -s $HOST_SOCK log_set_flag bdev_nvme 01:10:36.959 00:22:10.804 => 51 $rpc_py -s $HOST_SOCK bdev_nvme_start_discovery -b nvme -t $TEST_TRANSPORT -a $NVMF_FIRST_TARGET_IP \ 01:10:36.959 00:22:10.804 52 -s $DISCOVERY_PORT -f ipv4 -q $HOST_NQN 01:10:36.959 00:22:10.804 53 01:10:36.959 00:22:10.804 54 function get_bdev_list() { 01:10:36.959 00:22:10.804 55 $rpc_py -s $HOST_SOCK bdev_get_bdevs | jq -r '\''.[].name'\'' | sort | xargs 01:10:36.959 00:22:10.804 56 } 01:10:36.959 00:22:10.804 ... 01:10:36.959 00:22:10.804 01:10:36.959 00:22:10.804 ========== Backtrace end ========== 01:10:36.959 00:22:12.713 ========== Backtrace start: ========== 01:10:36.959 00:22:12.713 01:10:36.959 00:22:12.713 in /var/jenkins/workspace/dsa-phy-autotest/spdk/test/common/autotest_common.sh:1121 -> run_test(["nvmf_host_discovery"],["/var/jenkins/workspace/dsa-phy-autotest/spdk/test/nvmf/host/discovery.sh"],["--transport=tcp"]) 01:10:36.959 00:22:12.713 ... 01:10:36.959 00:22:12.713 1116 timing_enter $test_name 01:10:36.959 00:22:12.713 1117 echo "************************************" 01:10:36.959 00:22:12.713 1118 echo "START TEST $test_name" 01:10:36.959 00:22:12.713 1119 echo "************************************" 01:10:36.959 00:22:12.713 1120 xtrace_restore 01:10:36.959 00:22:12.713 1121 time "$@" 01:10:36.959 00:22:12.713 1122 xtrace_disable 01:10:36.959 00:22:12.713 1123 echo "************************************" 01:10:36.959 00:22:12.713 1124 echo "END TEST $test_name" 01:10:36.959 00:22:12.713 1125 echo "************************************" 01:10:36.959 00:22:12.713 1126 timing_exit $test_name 01:10:36.959 00:22:12.713 ... 01:10:36.959 00:22:12.713 in /var/jenkins/workspace/dsa-phy-autotest/spdk/test/nvmf/nvmf.sh:99 -> main(["--transport=tcp"]) 01:10:36.959 00:22:12.713 ... 01:10:36.959 00:22:12.713 94 01:10:36.959 00:22:12.713 95 run_test "nvmf_identify" $rootdir/test/nvmf/host/identify.sh "${TEST_ARGS[@]}" 01:10:36.959 00:22:12.713 96 run_test "nvmf_perf" $rootdir/test/nvmf/host/perf.sh "${TEST_ARGS[@]}" 01:10:36.959 00:22:12.713 97 run_test "nvmf_fio_host" $rootdir/test/nvmf/host/fio.sh "${TEST_ARGS[@]}" 01:10:36.959 00:22:12.713 98 run_test "nvmf_failover" $rootdir/test/nvmf/host/failover.sh "${TEST_ARGS[@]}" 01:10:36.959 00:22:12.713 => 99 run_test "nvmf_host_discovery" $rootdir/test/nvmf/host/discovery.sh "${TEST_ARGS[@]}" 01:10:36.960 00:22:12.713 100 run_test "nvmf_host_multipath_status" $rootdir/test/nvmf/host/multipath_status.sh "${TEST_ARGS[@]}" 01:10:36.960 00:22:12.713 101 run_test "nvmf_discovery_remove_ifc" $rootdir/test/nvmf/host/discovery_remove_ifc.sh "${TEST_ARGS[@]}" 01:10:36.960 00:22:12.713 102 run_test "nvmf_identify_kernel_target" "$rootdir/test/nvmf/host/identify_kernel_nvmf.sh" "${TEST_ARGS[@]}" 01:10:36.960 00:22:12.713 103 run_test "nvmf_auth" "$rootdir/test/nvmf/host/auth.sh" "${TEST_ARGS[@]}" 01:10:36.960 00:22:12.713 104 01:10:36.960 00:22:12.713 ... 01:10:36.960 00:22:12.713 01:10:36.960 00:22:12.713 ========== Backtrace end ========== 01:10:36.960 00:22:12.713 ========== Backtrace start: ========== 01:10:36.960 00:22:12.713 01:10:36.960 00:22:12.713 in /var/jenkins/workspace/dsa-phy-autotest/spdk/test/common/autotest_common.sh:1121 -> run_test(["nvmf_tcp"],["/var/jenkins/workspace/dsa-phy-autotest/spdk/test/nvmf/nvmf.sh"],["--transport=tcp"]) 01:10:36.960 00:22:12.713 ... 01:10:36.960 00:22:12.713 1116 timing_enter $test_name 01:10:36.960 00:22:12.713 1117 echo "************************************" 01:10:36.960 00:22:12.713 1118 echo "START TEST $test_name" 01:10:36.960 00:22:12.713 1119 echo "************************************" 01:10:36.960 00:22:12.713 1120 xtrace_restore 01:10:36.960 00:22:12.713 1121 time "$@" 01:10:36.960 00:22:12.713 1122 xtrace_disable 01:10:36.960 00:22:12.713 1123 echo "************************************" 01:10:36.960 00:22:12.713 1124 echo "END TEST $test_name" 01:10:36.960 00:22:12.713 1125 echo "************************************" 01:10:36.960 00:22:12.713 1126 timing_exit $test_name 01:10:36.960 00:22:12.713 ... 01:10:36.960 00:22:12.713 in /var/jenkins/workspace/dsa-phy-autotest/spdk/autotest.sh:283 -> main(["/var/jenkins/workspace/dsa-phy-autotest/autorun-spdk.conf"]) 01:10:36.960 00:22:12.713 ... 01:10:36.960 00:22:12.713 278 # list of all tests can properly differentiate them. Please do not merge them into one line. 01:10:36.960 00:22:12.713 279 if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then 01:10:36.960 00:22:12.713 280 run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.960 00:22:12.713 281 run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.960 00:22:12.713 282 elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then 01:10:36.960 00:22:12.713 => 283 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.960 00:22:12.713 284 if [[ $SPDK_TEST_URING -eq 0 ]]; then 01:10:36.960 00:22:12.713 285 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.960 00:22:12.713 286 run_test "nvmf_identify_passthru" $rootdir/test/nvmf/target/identify_passthru.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.960 00:22:12.713 287 fi 01:10:36.960 00:22:12.713 288 run_test "nvmf_dif" $rootdir/test/nvmf/target/dif.sh 01:10:36.960 00:22:12.713 ... 01:10:36.960 00:22:12.713 01:10:36.960 00:22:12.713 ========== Backtrace end ==========' 01:10:36.960 + [[ -n 00:22:10.804 ========== Backtrace start: ========== 01:10:36.960 00:22:10.804 01:10:36.960 00:22:10.804 in /var/jenkins/workspace/dsa-phy-autotest/spdk/test/common/autotest_common.sh:587 -> rpc_cmd(["-s"],["/tmp/host.sock"],["bdev_nvme_start_discovery"],["-b"],["nvme"],["-t"],["tcp"],["-a"],["10.0.0.2"],["-s"],["8009"],["-f"],["ipv4"],["-q"],["nqn.2021-12.io.spdk:test"]) 01:10:36.960 00:22:10.804 ... 01:10:36.960 00:22:10.804 582 echo "$rsp" 01:10:36.960 00:22:10.804 583 done 01:10:36.960 00:22:10.804 584 01:10:36.960 00:22:10.804 585 rc=${!status[*]} 01:10:36.960 00:22:10.804 586 xtrace_restore 01:10:36.960 00:22:10.804 => 587 [[ $rc == 0 ]] 01:10:36.960 00:22:10.804 588 } 01:10:36.960 00:22:10.804 589 01:10:36.960 00:22:10.804 590 function rpc_cmd_simple_data_json() { 01:10:36.960 00:22:10.804 591 01:10:36.960 00:22:10.804 592 local elems="$1[@]" elem 01:10:36.960 00:22:10.804 ... 01:10:36.960 00:22:10.804 in /var/jenkins/workspace/dsa-phy-autotest/spdk/test/nvmf/host/discovery.sh:51 -> main(["--transport=tcp"]) 01:10:36.960 00:22:10.804 ... 01:10:36.960 00:22:10.804 46 waitforlisten $hostpid $HOST_SOCK 01:10:36.960 00:22:10.804 47 01:10:36.960 00:22:10.804 48 trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 01:10:36.960 00:22:10.804 49 01:10:36.960 00:22:10.804 50 $rpc_py -s $HOST_SOCK log_set_flag bdev_nvme 01:10:36.960 00:22:10.804 => 51 $rpc_py -s $HOST_SOCK bdev_nvme_start_discovery -b nvme -t $TEST_TRANSPORT -a $NVMF_FIRST_TARGET_IP \ 01:10:36.960 00:22:10.804 52 -s $DISCOVERY_PORT -f ipv4 -q $HOST_NQN 01:10:36.960 00:22:10.804 53 01:10:36.960 00:22:10.804 54 function get_bdev_list() { 01:10:36.960 00:22:10.804 55 $rpc_py -s $HOST_SOCK bdev_get_bdevs | jq -r '.[].name' | sort | xargs 01:10:36.960 00:22:10.804 56 } 01:10:36.960 00:22:10.804 ... 01:10:36.960 00:22:10.804 01:10:36.960 00:22:10.804 ========== Backtrace end ========== 01:10:36.960 00:22:12.713 ========== Backtrace start: ========== 01:10:36.960 00:22:12.713 01:10:36.960 00:22:12.713 in /var/jenkins/workspace/dsa-phy-autotest/spdk/test/common/autotest_common.sh:1121 -> run_test(["nvmf_host_discovery"],["/var/jenkins/workspace/dsa-phy-autotest/spdk/test/nvmf/host/discovery.sh"],["--transport=tcp"]) 01:10:36.960 00:22:12.713 ... 01:10:36.960 00:22:12.713 1116 timing_enter $test_name 01:10:36.960 00:22:12.713 1117 echo "************************************" 01:10:36.960 00:22:12.713 1118 echo "START TEST $test_name" 01:10:36.960 00:22:12.713 1119 echo "************************************" 01:10:36.960 00:22:12.713 1120 xtrace_restore 01:10:36.960 00:22:12.713 1121 time "$@" 01:10:36.960 00:22:12.713 1122 xtrace_disable 01:10:36.960 00:22:12.713 1123 echo "************************************" 01:10:36.960 00:22:12.713 1124 echo "END TEST $test_name" 01:10:36.960 00:22:12.713 1125 echo "************************************" 01:10:36.960 00:22:12.713 1126 timing_exit $test_name 01:10:36.960 00:22:12.713 ... 01:10:36.960 00:22:12.713 in /var/jenkins/workspace/dsa-phy-autotest/spdk/test/nvmf/nvmf.sh:99 -> main(["--transport=tcp"]) 01:10:36.960 00:22:12.713 ... 01:10:36.960 00:22:12.713 94 01:10:36.960 00:22:12.713 95 run_test "nvmf_identify" $rootdir/test/nvmf/host/identify.sh "${TEST_ARGS[@]}" 01:10:36.960 00:22:12.713 96 run_test "nvmf_perf" $rootdir/test/nvmf/host/perf.sh "${TEST_ARGS[@]}" 01:10:36.960 00:22:12.713 97 run_test "nvmf_fio_host" $rootdir/test/nvmf/host/fio.sh "${TEST_ARGS[@]}" 01:10:36.960 00:22:12.713 98 run_test "nvmf_failover" $rootdir/test/nvmf/host/failover.sh "${TEST_ARGS[@]}" 01:10:36.960 00:22:12.713 => 99 run_test "nvmf_host_discovery" $rootdir/test/nvmf/host/discovery.sh "${TEST_ARGS[@]}" 01:10:36.960 00:22:12.713 100 run_test "nvmf_host_multipath_status" $rootdir/test/nvmf/host/multipath_status.sh "${TEST_ARGS[@]}" 01:10:36.960 00:22:12.713 101 run_test "nvmf_discovery_remove_ifc" $rootdir/test/nvmf/host/discovery_remove_ifc.sh "${TEST_ARGS[@]}" 01:10:36.960 00:22:12.713 102 run_test "nvmf_identify_kernel_target" "$rootdir/test/nvmf/host/identify_kernel_nvmf.sh" "${TEST_ARGS[@]}" 01:10:36.960 00:22:12.713 103 run_test "nvmf_auth" "$rootdir/test/nvmf/host/auth.sh" "${TEST_ARGS[@]}" 01:10:36.960 00:22:12.713 104 01:10:36.960 00:22:12.713 ... 01:10:36.960 00:22:12.713 01:10:36.960 00:22:12.713 ========== Backtrace end ========== 01:10:36.960 00:22:12.713 ========== Backtrace start: ========== 01:10:36.960 00:22:12.713 01:10:36.960 00:22:12.713 in /var/jenkins/workspace/dsa-phy-autotest/spdk/test/common/autotest_common.sh:1121 -> run_test(["nvmf_tcp"],["/var/jenkins/workspace/dsa-phy-autotest/spdk/test/nvmf/nvmf.sh"],["--transport=tcp"]) 01:10:36.960 00:22:12.713 ... 01:10:36.960 00:22:12.713 1116 timing_enter $test_name 01:10:36.960 00:22:12.713 1117 echo "************************************" 01:10:36.960 00:22:12.713 1118 echo "START TEST $test_name" 01:10:36.960 00:22:12.713 1119 echo "************************************" 01:10:36.960 00:22:12.713 1120 xtrace_restore 01:10:36.960 00:22:12.713 1121 time "$@" 01:10:36.960 00:22:12.713 1122 xtrace_disable 01:10:36.960 00:22:12.713 1123 echo "************************************" 01:10:36.960 00:22:12.713 1124 echo "END TEST $test_name" 01:10:36.960 00:22:12.713 1125 echo "************************************" 01:10:36.960 00:22:12.713 1126 timing_exit $test_name 01:10:36.960 00:22:12.713 ... 01:10:36.960 00:22:12.713 in /var/jenkins/workspace/dsa-phy-autotest/spdk/autotest.sh:283 -> main(["/var/jenkins/workspace/dsa-phy-autotest/autorun-spdk.conf"]) 01:10:36.960 00:22:12.713 ... 01:10:36.960 00:22:12.713 278 # list of all tests can properly differentiate them. Please do not merge them into one line. 01:10:36.960 00:22:12.713 279 if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then 01:10:36.960 00:22:12.713 280 run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.960 00:22:12.713 281 run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.960 00:22:12.713 282 elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then 01:10:36.960 00:22:12.713 => 283 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.960 00:22:12.713 284 if [[ $SPDK_TEST_URING -eq 0 ]]; then 01:10:36.960 00:22:12.713 285 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.960 00:22:12.713 286 run_test "nvmf_identify_passthru" $rootdir/test/nvmf/target/identify_passthru.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.960 00:22:12.713 287 fi 01:10:36.961 00:22:12.713 288 run_test "nvmf_dif" $rootdir/test/nvmf/target/dif.sh 01:10:36.961 00:22:12.713 ... 01:10:36.961 00:22:12.713 01:10:36.961 00:22:12.713 ========== Backtrace end ========== ]] 01:10:36.961 + echo '00:22:10.804 ========== Backtrace start: ========== 01:10:36.961 00:22:10.804 01:10:36.961 00:22:10.804 in /var/jenkins/workspace/dsa-phy-autotest/spdk/test/common/autotest_common.sh:587 -> rpc_cmd(["-s"],["/tmp/host.sock"],["bdev_nvme_start_discovery"],["-b"],["nvme"],["-t"],["tcp"],["-a"],["10.0.0.2"],["-s"],["8009"],["-f"],["ipv4"],["-q"],["nqn.2021-12.io.spdk:test"]) 01:10:36.961 00:22:10.804 ... 01:10:36.961 00:22:10.804 582 echo "$rsp" 01:10:36.961 00:22:10.804 583 done 01:10:36.961 00:22:10.804 584 01:10:36.961 00:22:10.804 585 rc=${!status[*]} 01:10:36.961 00:22:10.804 586 xtrace_restore 01:10:36.961 00:22:10.804 => 587 [[ $rc == 0 ]] 01:10:36.961 00:22:10.804 588 } 01:10:36.961 00:22:10.804 589 01:10:36.961 00:22:10.804 590 function rpc_cmd_simple_data_json() { 01:10:36.961 00:22:10.804 591 01:10:36.961 00:22:10.804 592 local elems="$1[@]" elem 01:10:36.961 00:22:10.804 ... 01:10:36.961 00:22:10.804 in /var/jenkins/workspace/dsa-phy-autotest/spdk/test/nvmf/host/discovery.sh:51 -> main(["--transport=tcp"]) 01:10:36.961 00:22:10.804 ... 01:10:36.961 00:22:10.804 46 waitforlisten $hostpid $HOST_SOCK 01:10:36.961 00:22:10.804 47 01:10:36.961 00:22:10.804 48 trap '\''process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1'\'' SIGINT SIGTERM EXIT 01:10:36.961 00:22:10.804 49 01:10:36.961 00:22:10.804 50 $rpc_py -s $HOST_SOCK log_set_flag bdev_nvme 01:10:36.961 00:22:10.804 => 51 $rpc_py -s $HOST_SOCK bdev_nvme_start_discovery -b nvme -t $TEST_TRANSPORT -a $NVMF_FIRST_TARGET_IP \ 01:10:36.961 00:22:10.804 52 -s $DISCOVERY_PORT -f ipv4 -q $HOST_NQN 01:10:36.961 00:22:10.804 53 01:10:36.961 00:22:10.804 54 function get_bdev_list() { 01:10:36.961 00:22:10.804 55 $rpc_py -s $HOST_SOCK bdev_get_bdevs | jq -r '\''.[].name'\'' | sort | xargs 01:10:36.961 00:22:10.804 56 } 01:10:36.961 00:22:10.804 ... 01:10:36.961 00:22:10.804 01:10:36.961 00:22:10.804 ========== Backtrace end ========== 01:10:36.961 00:22:12.713 ========== Backtrace start: ========== 01:10:36.961 00:22:12.713 01:10:36.961 00:22:12.713 in /var/jenkins/workspace/dsa-phy-autotest/spdk/test/common/autotest_common.sh:1121 -> run_test(["nvmf_host_discovery"],["/var/jenkins/workspace/dsa-phy-autotest/spdk/test/nvmf/host/discovery.sh"],["--transport=tcp"]) 01:10:36.961 00:22:12.713 ... 01:10:36.961 00:22:12.713 1116 timing_enter $test_name 01:10:36.961 00:22:12.713 1117 echo "************************************" 01:10:36.961 00:22:12.713 1118 echo "START TEST $test_name" 01:10:36.961 00:22:12.713 1119 echo "************************************" 01:10:36.961 00:22:12.713 1120 xtrace_restore 01:10:36.961 00:22:12.713 1121 time "$@" 01:10:36.961 00:22:12.713 1122 xtrace_disable 01:10:36.961 00:22:12.713 1123 echo "************************************" 01:10:36.961 00:22:12.713 1124 echo "END TEST $test_name" 01:10:36.961 00:22:12.713 1125 echo "************************************" 01:10:36.961 00:22:12.713 1126 timing_exit $test_name 01:10:36.961 00:22:12.713 ... 01:10:36.961 00:22:12.713 in /var/jenkins/workspace/dsa-phy-autotest/spdk/test/nvmf/nvmf.sh:99 -> main(["--transport=tcp"]) 01:10:36.961 00:22:12.713 ... 01:10:36.961 00:22:12.713 94 01:10:36.961 00:22:12.713 95 run_test "nvmf_identify" $rootdir/test/nvmf/host/identify.sh "${TEST_ARGS[@]}" 01:10:36.961 00:22:12.713 96 run_test "nvmf_perf" $rootdir/test/nvmf/host/perf.sh "${TEST_ARGS[@]}" 01:10:36.961 00:22:12.713 97 run_test "nvmf_fio_host" $rootdir/test/nvmf/host/fio.sh "${TEST_ARGS[@]}" 01:10:36.961 00:22:12.713 98 run_test "nvmf_failover" $rootdir/test/nvmf/host/failover.sh "${TEST_ARGS[@]}" 01:10:36.961 00:22:12.713 => 99 run_test "nvmf_host_discovery" $rootdir/test/nvmf/host/discovery.sh "${TEST_ARGS[@]}" 01:10:36.961 00:22:12.713 100 run_test "nvmf_host_multipath_status" $rootdir/test/nvmf/host/multipath_status.sh "${TEST_ARGS[@]}" 01:10:36.961 00:22:12.713 101 run_test "nvmf_discovery_remove_ifc" $rootdir/test/nvmf/host/discovery_remove_ifc.sh "${TEST_ARGS[@]}" 01:10:36.961 00:22:12.713 102 run_test "nvmf_identify_kernel_target" "$rootdir/test/nvmf/host/identify_kernel_nvmf.sh" "${TEST_ARGS[@]}" 01:10:36.961 00:22:12.713 103 run_test "nvmf_auth" "$rootdir/test/nvmf/host/auth.sh" "${TEST_ARGS[@]}" 01:10:36.961 00:22:12.713 104 01:10:36.961 00:22:12.713 ... 01:10:36.961 00:22:12.713 01:10:36.961 00:22:12.713 ========== Backtrace end ========== 01:10:36.961 00:22:12.713 ========== Backtrace start: ========== 01:10:36.961 00:22:12.713 01:10:36.961 00:22:12.713 in /var/jenkins/workspace/dsa-phy-autotest/spdk/test/common/autotest_common.sh:1121 -> run_test(["nvmf_tcp"],["/var/jenkins/workspace/dsa-phy-autotest/spdk/test/nvmf/nvmf.sh"],["--transport=tcp"]) 01:10:36.961 00:22:12.713 ... 01:10:36.961 00:22:12.713 1116 timing_enter $test_name 01:10:36.961 00:22:12.713 1117 echo "************************************" 01:10:36.961 00:22:12.713 1118 echo "START TEST $test_name" 01:10:36.961 00:22:12.713 1119 echo "************************************" 01:10:36.961 00:22:12.713 1120 xtrace_restore 01:10:36.961 00:22:12.713 1121 time "$@" 01:10:36.961 00:22:12.713 1122 xtrace_disable 01:10:36.961 00:22:12.713 1123 echo "************************************" 01:10:36.961 00:22:12.713 1124 echo "END TEST $test_name" 01:10:36.961 00:22:12.713 1125 echo "************************************" 01:10:36.961 00:22:12.713 1126 timing_exit $test_name 01:10:36.961 00:22:12.713 ... 01:10:36.961 00:22:12.713 in /var/jenkins/workspace/dsa-phy-autotest/spdk/autotest.sh:283 -> main(["/var/jenkins/workspace/dsa-phy-autotest/autorun-spdk.conf"]) 01:10:36.961 00:22:12.713 ... 01:10:36.961 00:22:12.713 278 # list of all tests can properly differentiate them. Please do not merge them into one line. 01:10:36.961 00:22:12.713 279 if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then 01:10:36.961 00:22:12.713 280 run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.961 00:22:12.713 281 run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.961 00:22:12.713 282 elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then 01:10:36.961 00:22:12.713 => 283 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.961 00:22:12.713 284 if [[ $SPDK_TEST_URING -eq 0 ]]; then 01:10:36.961 00:22:12.713 285 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.961 00:22:12.713 286 run_test "nvmf_identify_passthru" $rootdir/test/nvmf/target/identify_passthru.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.961 00:22:12.713 287 fi 01:10:36.961 00:22:12.713 288 run_test "nvmf_dif" $rootdir/test/nvmf/target/dif.sh 01:10:36.961 00:22:12.713 ... 01:10:36.961 00:22:12.713 01:10:36.961 00:22:12.713 ========== Backtrace end ==========' 01:10:36.961 + for build in "${build_log_list[@]}" 01:10:36.961 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_3/check-format-docker-autotest_22167/build.log 01:10:36.961 + local build_log job_name start_pattern end_pattern backtraces 01:10:36.961 + build_log=/var/jenkins/workspace/autotest-per-patch_3/check-format-docker-autotest_22167/build.log 01:10:36.961 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/check-format-docker-autotest_22167/build.log 01:10:36.961 ++ basename /var/jenkins/workspace/autotest-per-patch_3/check-format-docker-autotest_22167 01:10:36.961 + job_name=check-format-docker-autotest_22167 01:10:36.961 + start_pattern='Backtrace start' 01:10:36.961 + end_pattern='Backtrace end' 01:10:36.961 + [[ -f /var/jenkins/workspace/autotest-per-patch_3/check-format-docker-autotest_22167/build.log ]] 01:10:36.961 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_3/check-format-docker-autotest_22167/build.log 01:10:36.961 + backtraces= 01:10:36.961 + [[ -n '' ]] 01:10:36.961 + for build in "${build_log_list[@]}" 01:10:36.961 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_3/nvmf-phy-autotest_72467/build.log 01:10:36.961 + local build_log job_name start_pattern end_pattern backtraces 01:10:36.961 + build_log=/var/jenkins/workspace/autotest-per-patch_3/nvmf-phy-autotest_72467/build.log 01:10:36.961 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/nvmf-phy-autotest_72467/build.log 01:10:36.961 ++ basename /var/jenkins/workspace/autotest-per-patch_3/nvmf-phy-autotest_72467 01:10:36.961 + job_name=nvmf-phy-autotest_72467 01:10:36.961 + start_pattern='Backtrace start' 01:10:36.961 + end_pattern='Backtrace end' 01:10:36.961 + [[ -f /var/jenkins/workspace/autotest-per-patch_3/nvmf-phy-autotest_72467/build.log ]] 01:10:36.961 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_3/nvmf-phy-autotest_72467/build.log 01:10:36.961 + backtraces='00:16:32.750 ========== Backtrace start: ========== 01:10:36.961 00:16:32.750 01:10:36.961 00:16:32.750 in test/nvmf/target/device_removal.sh:116 -> stop_bdevperf([]) 01:10:36.961 00:16:32.750 ... 01:10:36.961 00:16:32.750 111 01:10:36.961 00:16:32.750 112 sleep 5 01:10:36.961 00:16:32.750 113 } 01:10:36.961 00:16:32.750 114 01:10:36.961 00:16:32.750 115 function stop_bdevperf() { 01:10:36.961 00:16:32.750 => 116 wait $bdevperf_rpc_pid 01:10:36.961 00:16:32.750 117 01:10:36.961 00:16:32.750 118 killprocess $bdevperf_pid 01:10:36.961 00:16:32.750 119 bdevperf_pid= 01:10:36.961 00:16:32.750 120 01:10:36.961 00:16:32.750 121 cat $testdir/try.txt 01:10:36.961 00:16:32.750 ... 01:10:36.961 00:16:32.750 in test/nvmf/target/device_removal.sh:200 -> test_remove_and_rescan([]) 01:10:36.961 00:16:32.750 ... 01:10:36.961 00:16:32.750 195 fi 01:10:36.961 00:16:32.750 196 sleep 2 01:10:36.961 00:16:32.750 197 done 01:10:36.961 00:16:32.750 198 done 01:10:36.961 00:16:32.750 199 01:10:36.961 00:16:32.750 => 200 stop_bdevperf 01:10:36.961 00:16:32.750 201 01:10:36.961 00:16:32.750 202 killprocess $nvmfpid 01:10:36.961 00:16:32.750 203 nvmfpid= 01:10:36.961 00:16:32.750 204 01:10:36.961 00:16:32.750 205 return 0 01:10:36.961 00:16:32.750 ... 01:10:36.961 00:16:32.750 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:1121 -> run_test(["nvmf_device_removal_pci_remove"],["test_remove_and_rescan"]) 01:10:36.961 00:16:32.750 ... 01:10:36.961 00:16:32.750 1116 timing_enter $test_name 01:10:36.961 00:16:32.750 1117 echo "************************************" 01:10:36.961 00:16:32.750 1118 echo "START TEST $test_name" 01:10:36.961 00:16:32.750 1119 echo "************************************" 01:10:36.961 00:16:32.750 1120 xtrace_restore 01:10:36.961 00:16:32.750 1121 time "$@" 01:10:36.961 00:16:32.750 1122 xtrace_disable 01:10:36.961 00:16:32.750 1123 echo "************************************" 01:10:36.961 00:16:32.750 1124 echo "END TEST $test_name" 01:10:36.961 00:16:32.750 1125 echo "************************************" 01:10:36.961 00:16:32.750 1126 timing_exit $test_name 01:10:36.961 00:16:32.750 ... 01:10:36.961 00:16:32.750 in test/nvmf/target/device_removal.sh:312 -> main(["--transport=rdma"]) 01:10:36.961 00:16:32.750 ... 01:10:36.961 00:16:32.750 307 fi 01:10:36.962 00:16:32.750 308 test_bonding_slaves_on_nics "${target_nics[@]}" 01:10:36.962 00:16:32.750 309 } 01:10:36.962 00:16:32.750 310 01:10:36.962 00:16:32.750 311 run_test "nvmf_device_removal_pci_remove_no_srq" test_remove_and_rescan --no-srq 01:10:36.962 00:16:32.750 => 312 run_test "nvmf_device_removal_pci_remove" test_remove_and_rescan 01:10:36.962 00:16:32.750 313 # bond slaves case needs lag_master & vport_manager are enabled by mlxconfig 01:10:36.962 00:16:32.750 314 # and not work on CI machine currently. 01:10:36.962 00:16:32.750 315 # run_test "nvmf_device_removal_bond_slaves" test_bond_slaves 01:10:36.962 00:16:32.750 316 01:10:36.962 00:16:32.750 317 nvmftestfini 01:10:36.962 00:16:32.750 ... 01:10:36.962 00:16:32.750 01:10:36.962 00:16:32.750 ========== Backtrace end ========== 01:10:36.962 00:16:32.764 ========== Backtrace start: ========== 01:10:36.962 00:16:32.764 01:10:36.962 00:16:32.764 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:1121 -> run_test(["nvmf_device_removal"],["test/nvmf/target/device_removal.sh"],["--transport=rdma"]) 01:10:36.962 00:16:32.764 ... 01:10:36.962 00:16:32.764 1116 timing_enter $test_name 01:10:36.962 00:16:32.764 1117 echo "************************************" 01:10:36.962 00:16:32.764 1118 echo "START TEST $test_name" 01:10:36.962 00:16:32.764 1119 echo "************************************" 01:10:36.962 00:16:32.764 1120 xtrace_restore 01:10:36.962 00:16:32.764 1121 time "$@" 01:10:36.962 00:16:32.764 1122 xtrace_disable 01:10:36.962 00:16:32.764 1123 echo "************************************" 01:10:36.962 00:16:32.764 1124 echo "END TEST $test_name" 01:10:36.962 00:16:32.764 1125 echo "************************************" 01:10:36.962 00:16:32.764 1126 timing_exit $test_name 01:10:36.962 00:16:32.764 ... 01:10:36.962 00:16:32.764 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh:78 -> main(["--transport=rdma"]) 01:10:36.962 00:16:32.764 ... 01:10:36.962 00:16:32.764 73 TCP_INTERFACE_LIST=("${net_devs[@]}") 01:10:36.962 00:16:32.764 74 if ((${#TCP_INTERFACE_LIST[@]} > 0)); then 01:10:36.962 00:16:32.764 75 run_test "nvmf_perf_adq" $rootdir/test/nvmf/target/perf_adq.sh "${TEST_ARGS[@]}" 01:10:36.962 00:16:32.764 76 fi 01:10:36.962 00:16:32.764 77 elif [[ $SPDK_TEST_NVMF_TRANSPORT == "rdma" ]]; then 01:10:36.962 00:16:32.764 => 78 run_test "nvmf_device_removal" test/nvmf/target/device_removal.sh "${TEST_ARGS[@]}" 01:10:36.962 00:16:32.764 79 run_test "nvmf_srq_overwhelm" "$rootdir/test/nvmf/target/srq_overwhelm.sh" "${TEST_ARGS[@]}" 01:10:36.962 00:16:32.764 80 fi 01:10:36.962 00:16:32.765 81 run_test "nvmf_shutdown" $rootdir/test/nvmf/target/shutdown.sh "${TEST_ARGS[@]}" 01:10:36.962 00:16:32.765 82 fi 01:10:36.962 00:16:32.765 83 01:10:36.962 00:16:32.765 ... 01:10:36.962 00:16:32.765 01:10:36.962 00:16:32.765 ========== Backtrace end ========== 01:10:36.962 00:16:32.765 ========== Backtrace start: ========== 01:10:36.962 00:16:32.765 01:10:36.962 00:16:32.765 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:1121 -> run_test(["nvmf_rdma"],["/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh"],["--transport=rdma"]) 01:10:36.962 00:16:32.765 ... 01:10:36.962 00:16:32.765 1116 timing_enter $test_name 01:10:36.962 00:16:32.765 1117 echo "************************************" 01:10:36.962 00:16:32.765 1118 echo "START TEST $test_name" 01:10:36.962 00:16:32.765 1119 echo "************************************" 01:10:36.962 00:16:32.765 1120 xtrace_restore 01:10:36.962 00:16:32.765 1121 time "$@" 01:10:36.962 00:16:32.765 1122 xtrace_disable 01:10:36.962 00:16:32.765 1123 echo "************************************" 01:10:36.962 00:16:32.765 1124 echo "END TEST $test_name" 01:10:36.962 00:16:32.765 1125 echo "************************************" 01:10:36.962 00:16:32.765 1126 timing_exit $test_name 01:10:36.962 00:16:32.765 ... 01:10:36.962 00:16:33.024 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/autotest.sh:280 -> main(["/var/jenkins/workspace/nvmf-phy-autotest/autorun-spdk.conf"]) 01:10:36.962 00:16:33.024 ... 01:10:36.962 00:16:33.024 275 if [ $SPDK_TEST_NVMF -eq 1 ]; then 01:10:36.962 00:16:33.024 276 export NET_TYPE 01:10:36.962 00:16:33.024 277 # The NVMe-oF run test cases are split out like this so that the parser that compiles the 01:10:36.962 00:16:33.024 278 # list of all tests can properly differentiate them. Please do not merge them into one line. 01:10:36.962 00:16:33.024 279 if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then 01:10:36.962 00:16:33.024 => 280 run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.962 00:16:33.024 281 run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.962 00:16:33.024 282 elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then 01:10:36.962 00:16:33.024 283 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.962 00:16:33.024 284 if [[ $SPDK_TEST_URING -eq 0 ]]; then 01:10:36.962 00:16:33.024 285 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.962 00:16:33.024 ... 01:10:36.962 00:16:33.024 01:10:36.962 00:16:33.024 ========== Backtrace end ==========' 01:10:36.962 + [[ -n 00:16:32.750 ========== Backtrace start: ========== 01:10:36.962 00:16:32.750 01:10:36.962 00:16:32.750 in test/nvmf/target/device_removal.sh:116 -> stop_bdevperf([]) 01:10:36.962 00:16:32.750 ... 01:10:36.962 00:16:32.750 111 01:10:36.962 00:16:32.750 112 sleep 5 01:10:36.962 00:16:32.750 113 } 01:10:36.962 00:16:32.750 114 01:10:36.962 00:16:32.750 115 function stop_bdevperf() { 01:10:36.962 00:16:32.750 => 116 wait $bdevperf_rpc_pid 01:10:36.962 00:16:32.750 117 01:10:36.962 00:16:32.750 118 killprocess $bdevperf_pid 01:10:36.962 00:16:32.750 119 bdevperf_pid= 01:10:36.962 00:16:32.750 120 01:10:36.962 00:16:32.750 121 cat $testdir/try.txt 01:10:36.962 00:16:32.750 ... 01:10:36.962 00:16:32.750 in test/nvmf/target/device_removal.sh:200 -> test_remove_and_rescan([]) 01:10:36.962 00:16:32.750 ... 01:10:36.962 00:16:32.750 195 fi 01:10:36.962 00:16:32.750 196 sleep 2 01:10:36.962 00:16:32.750 197 done 01:10:36.962 00:16:32.750 198 done 01:10:36.962 00:16:32.750 199 01:10:36.962 00:16:32.750 => 200 stop_bdevperf 01:10:36.962 00:16:32.750 201 01:10:36.962 00:16:32.750 202 killprocess $nvmfpid 01:10:36.962 00:16:32.750 203 nvmfpid= 01:10:36.962 00:16:32.750 204 01:10:36.962 00:16:32.750 205 return 0 01:10:36.962 00:16:32.750 ... 01:10:36.962 00:16:32.750 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:1121 -> run_test(["nvmf_device_removal_pci_remove"],["test_remove_and_rescan"]) 01:10:36.962 00:16:32.750 ... 01:10:36.962 00:16:32.750 1116 timing_enter $test_name 01:10:36.962 00:16:32.750 1117 echo "************************************" 01:10:36.962 00:16:32.750 1118 echo "START TEST $test_name" 01:10:36.962 00:16:32.750 1119 echo "************************************" 01:10:36.962 00:16:32.750 1120 xtrace_restore 01:10:36.962 00:16:32.750 1121 time "$@" 01:10:36.962 00:16:32.750 1122 xtrace_disable 01:10:36.962 00:16:32.750 1123 echo "************************************" 01:10:36.962 00:16:32.750 1124 echo "END TEST $test_name" 01:10:36.962 00:16:32.750 1125 echo "************************************" 01:10:36.962 00:16:32.750 1126 timing_exit $test_name 01:10:36.962 00:16:32.750 ... 01:10:36.962 00:16:32.750 in test/nvmf/target/device_removal.sh:312 -> main(["--transport=rdma"]) 01:10:36.962 00:16:32.750 ... 01:10:36.962 00:16:32.750 307 fi 01:10:36.962 00:16:32.750 308 test_bonding_slaves_on_nics "${target_nics[@]}" 01:10:36.962 00:16:32.750 309 } 01:10:36.962 00:16:32.750 310 01:10:36.962 00:16:32.750 311 run_test "nvmf_device_removal_pci_remove_no_srq" test_remove_and_rescan --no-srq 01:10:36.962 00:16:32.750 => 312 run_test "nvmf_device_removal_pci_remove" test_remove_and_rescan 01:10:36.962 00:16:32.750 313 # bond slaves case needs lag_master & vport_manager are enabled by mlxconfig 01:10:36.962 00:16:32.750 314 # and not work on CI machine currently. 01:10:36.962 00:16:32.750 315 # run_test "nvmf_device_removal_bond_slaves" test_bond_slaves 01:10:36.962 00:16:32.750 316 01:10:36.962 00:16:32.750 317 nvmftestfini 01:10:36.962 00:16:32.750 ... 01:10:36.962 00:16:32.750 01:10:36.962 00:16:32.750 ========== Backtrace end ========== 01:10:36.962 00:16:32.764 ========== Backtrace start: ========== 01:10:36.962 00:16:32.764 01:10:36.962 00:16:32.764 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:1121 -> run_test(["nvmf_device_removal"],["test/nvmf/target/device_removal.sh"],["--transport=rdma"]) 01:10:36.962 00:16:32.764 ... 01:10:36.962 00:16:32.764 1116 timing_enter $test_name 01:10:36.962 00:16:32.764 1117 echo "************************************" 01:10:36.962 00:16:32.764 1118 echo "START TEST $test_name" 01:10:36.962 00:16:32.764 1119 echo "************************************" 01:10:36.962 00:16:32.764 1120 xtrace_restore 01:10:36.962 00:16:32.764 1121 time "$@" 01:10:36.962 00:16:32.764 1122 xtrace_disable 01:10:36.962 00:16:32.764 1123 echo "************************************" 01:10:36.962 00:16:32.764 1124 echo "END TEST $test_name" 01:10:36.962 00:16:32.764 1125 echo "************************************" 01:10:36.962 00:16:32.764 1126 timing_exit $test_name 01:10:36.962 00:16:32.764 ... 01:10:36.962 00:16:32.764 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh:78 -> main(["--transport=rdma"]) 01:10:36.962 00:16:32.764 ... 01:10:36.962 00:16:32.764 73 TCP_INTERFACE_LIST=("${net_devs[@]}") 01:10:36.962 00:16:32.764 74 if ((${#TCP_INTERFACE_LIST[@]} > 0)); then 01:10:36.962 00:16:32.764 75 run_test "nvmf_perf_adq" $rootdir/test/nvmf/target/perf_adq.sh "${TEST_ARGS[@]}" 01:10:36.962 00:16:32.764 76 fi 01:10:36.962 00:16:32.764 77 elif [[ $SPDK_TEST_NVMF_TRANSPORT == "rdma" ]]; then 01:10:36.962 00:16:32.764 => 78 run_test "nvmf_device_removal" test/nvmf/target/device_removal.sh "${TEST_ARGS[@]}" 01:10:36.962 00:16:32.764 79 run_test "nvmf_srq_overwhelm" "$rootdir/test/nvmf/target/srq_overwhelm.sh" "${TEST_ARGS[@]}" 01:10:36.962 00:16:32.764 80 fi 01:10:36.962 00:16:32.765 81 run_test "nvmf_shutdown" $rootdir/test/nvmf/target/shutdown.sh "${TEST_ARGS[@]}" 01:10:36.962 00:16:32.765 82 fi 01:10:36.962 00:16:32.765 83 01:10:36.962 00:16:32.765 ... 01:10:36.962 00:16:32.765 01:10:36.962 00:16:32.765 ========== Backtrace end ========== 01:10:36.962 00:16:32.765 ========== Backtrace start: ========== 01:10:36.962 00:16:32.765 01:10:36.962 00:16:32.765 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:1121 -> run_test(["nvmf_rdma"],["/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh"],["--transport=rdma"]) 01:10:36.962 00:16:32.765 ... 01:10:36.962 00:16:32.765 1116 timing_enter $test_name 01:10:36.963 00:16:32.765 1117 echo "************************************" 01:10:36.963 00:16:32.765 1118 echo "START TEST $test_name" 01:10:36.963 00:16:32.765 1119 echo "************************************" 01:10:36.963 00:16:32.765 1120 xtrace_restore 01:10:36.963 00:16:32.765 1121 time "$@" 01:10:36.963 00:16:32.765 1122 xtrace_disable 01:10:36.963 00:16:32.765 1123 echo "************************************" 01:10:36.963 00:16:32.765 1124 echo "END TEST $test_name" 01:10:36.963 00:16:32.765 1125 echo "************************************" 01:10:36.963 00:16:32.765 1126 timing_exit $test_name 01:10:36.963 00:16:32.765 ... 01:10:36.963 00:16:33.024 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/autotest.sh:280 -> main(["/var/jenkins/workspace/nvmf-phy-autotest/autorun-spdk.conf"]) 01:10:36.963 00:16:33.024 ... 01:10:36.963 00:16:33.024 275 if [ $SPDK_TEST_NVMF -eq 1 ]; then 01:10:36.963 00:16:33.024 276 export NET_TYPE 01:10:36.963 00:16:33.024 277 # The NVMe-oF run test cases are split out like this so that the parser that compiles the 01:10:36.963 00:16:33.024 278 # list of all tests can properly differentiate them. Please do not merge them into one line. 01:10:36.963 00:16:33.024 279 if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then 01:10:36.963 00:16:33.024 => 280 run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.963 00:16:33.024 281 run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.963 00:16:33.024 282 elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then 01:10:36.963 00:16:33.024 283 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.963 00:16:33.024 284 if [[ $SPDK_TEST_URING -eq 0 ]]; then 01:10:36.963 00:16:33.024 285 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.963 00:16:33.024 ... 01:10:36.963 00:16:33.024 01:10:36.963 00:16:33.024 ========== Backtrace end ========== ]] 01:10:36.963 + echo '00:16:32.750 ========== Backtrace start: ========== 01:10:36.963 00:16:32.750 01:10:36.963 00:16:32.750 in test/nvmf/target/device_removal.sh:116 -> stop_bdevperf([]) 01:10:36.963 00:16:32.750 ... 01:10:36.963 00:16:32.750 111 01:10:36.963 00:16:32.750 112 sleep 5 01:10:36.963 00:16:32.750 113 } 01:10:36.963 00:16:32.750 114 01:10:36.963 00:16:32.750 115 function stop_bdevperf() { 01:10:36.963 00:16:32.750 => 116 wait $bdevperf_rpc_pid 01:10:36.963 00:16:32.750 117 01:10:36.963 00:16:32.750 118 killprocess $bdevperf_pid 01:10:36.963 00:16:32.750 119 bdevperf_pid= 01:10:36.963 00:16:32.750 120 01:10:36.963 00:16:32.750 121 cat $testdir/try.txt 01:10:36.963 00:16:32.750 ... 01:10:36.963 00:16:32.750 in test/nvmf/target/device_removal.sh:200 -> test_remove_and_rescan([]) 01:10:36.963 00:16:32.750 ... 01:10:36.963 00:16:32.750 195 fi 01:10:36.963 00:16:32.750 196 sleep 2 01:10:36.963 00:16:32.750 197 done 01:10:36.963 00:16:32.750 198 done 01:10:36.963 00:16:32.750 199 01:10:36.963 00:16:32.750 => 200 stop_bdevperf 01:10:36.963 00:16:32.750 201 01:10:36.963 00:16:32.750 202 killprocess $nvmfpid 01:10:36.963 00:16:32.750 203 nvmfpid= 01:10:36.963 00:16:32.750 204 01:10:36.963 00:16:32.750 205 return 0 01:10:36.963 00:16:32.750 ... 01:10:36.963 00:16:32.750 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:1121 -> run_test(["nvmf_device_removal_pci_remove"],["test_remove_and_rescan"]) 01:10:36.963 00:16:32.750 ... 01:10:36.963 00:16:32.750 1116 timing_enter $test_name 01:10:36.963 00:16:32.750 1117 echo "************************************" 01:10:36.963 00:16:32.750 1118 echo "START TEST $test_name" 01:10:36.963 00:16:32.750 1119 echo "************************************" 01:10:36.963 00:16:32.750 1120 xtrace_restore 01:10:36.963 00:16:32.750 1121 time "$@" 01:10:36.963 00:16:32.750 1122 xtrace_disable 01:10:36.963 00:16:32.750 1123 echo "************************************" 01:10:36.963 00:16:32.750 1124 echo "END TEST $test_name" 01:10:36.963 00:16:32.750 1125 echo "************************************" 01:10:36.963 00:16:32.750 1126 timing_exit $test_name 01:10:36.963 00:16:32.750 ... 01:10:36.963 00:16:32.750 in test/nvmf/target/device_removal.sh:312 -> main(["--transport=rdma"]) 01:10:36.963 00:16:32.750 ... 01:10:36.963 00:16:32.750 307 fi 01:10:36.963 00:16:32.750 308 test_bonding_slaves_on_nics "${target_nics[@]}" 01:10:36.963 00:16:32.750 309 } 01:10:36.963 00:16:32.750 310 01:10:36.963 00:16:32.750 311 run_test "nvmf_device_removal_pci_remove_no_srq" test_remove_and_rescan --no-srq 01:10:36.963 00:16:32.750 => 312 run_test "nvmf_device_removal_pci_remove" test_remove_and_rescan 01:10:36.963 00:16:32.750 313 # bond slaves case needs lag_master & vport_manager are enabled by mlxconfig 01:10:36.963 00:16:32.750 314 # and not work on CI machine currently. 01:10:36.963 00:16:32.750 315 # run_test "nvmf_device_removal_bond_slaves" test_bond_slaves 01:10:36.963 00:16:32.750 316 01:10:36.963 00:16:32.750 317 nvmftestfini 01:10:36.963 00:16:32.750 ... 01:10:36.963 00:16:32.750 01:10:36.963 00:16:32.750 ========== Backtrace end ========== 01:10:36.963 00:16:32.764 ========== Backtrace start: ========== 01:10:36.963 00:16:32.764 01:10:36.963 00:16:32.764 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:1121 -> run_test(["nvmf_device_removal"],["test/nvmf/target/device_removal.sh"],["--transport=rdma"]) 01:10:36.963 00:16:32.764 ... 01:10:36.963 00:16:32.764 1116 timing_enter $test_name 01:10:36.963 00:16:32.764 1117 echo "************************************" 01:10:36.963 00:16:32.764 1118 echo "START TEST $test_name" 01:10:36.963 00:16:32.764 1119 echo "************************************" 01:10:36.963 00:16:32.764 1120 xtrace_restore 01:10:36.963 00:16:32.764 1121 time "$@" 01:10:36.963 00:16:32.764 1122 xtrace_disable 01:10:36.963 00:16:32.764 1123 echo "************************************" 01:10:36.963 00:16:32.764 1124 echo "END TEST $test_name" 01:10:36.963 00:16:32.764 1125 echo "************************************" 01:10:36.963 00:16:32.764 1126 timing_exit $test_name 01:10:36.963 00:16:32.764 ... 01:10:36.963 00:16:32.764 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh:78 -> main(["--transport=rdma"]) 01:10:36.963 00:16:32.764 ... 01:10:36.963 00:16:32.764 73 TCP_INTERFACE_LIST=("${net_devs[@]}") 01:10:36.963 00:16:32.764 74 if ((${#TCP_INTERFACE_LIST[@]} > 0)); then 01:10:36.963 00:16:32.764 75 run_test "nvmf_perf_adq" $rootdir/test/nvmf/target/perf_adq.sh "${TEST_ARGS[@]}" 01:10:36.963 00:16:32.764 76 fi 01:10:36.963 00:16:32.764 77 elif [[ $SPDK_TEST_NVMF_TRANSPORT == "rdma" ]]; then 01:10:36.963 00:16:32.764 => 78 run_test "nvmf_device_removal" test/nvmf/target/device_removal.sh "${TEST_ARGS[@]}" 01:10:36.963 00:16:32.764 79 run_test "nvmf_srq_overwhelm" "$rootdir/test/nvmf/target/srq_overwhelm.sh" "${TEST_ARGS[@]}" 01:10:36.963 00:16:32.764 80 fi 01:10:36.963 00:16:32.765 81 run_test "nvmf_shutdown" $rootdir/test/nvmf/target/shutdown.sh "${TEST_ARGS[@]}" 01:10:36.963 00:16:32.765 82 fi 01:10:36.963 00:16:32.765 83 01:10:36.963 00:16:32.765 ... 01:10:36.963 00:16:32.765 01:10:36.963 00:16:32.765 ========== Backtrace end ========== 01:10:36.963 00:16:32.765 ========== Backtrace start: ========== 01:10:36.963 00:16:32.765 01:10:36.963 00:16:32.765 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:1121 -> run_test(["nvmf_rdma"],["/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh"],["--transport=rdma"]) 01:10:36.963 00:16:32.765 ... 01:10:36.963 00:16:32.765 1116 timing_enter $test_name 01:10:36.963 00:16:32.765 1117 echo "************************************" 01:10:36.963 00:16:32.765 1118 echo "START TEST $test_name" 01:10:36.963 00:16:32.765 1119 echo "************************************" 01:10:36.963 00:16:32.765 1120 xtrace_restore 01:10:36.963 00:16:32.765 1121 time "$@" 01:10:36.963 00:16:32.765 1122 xtrace_disable 01:10:36.963 00:16:32.765 1123 echo "************************************" 01:10:36.963 00:16:32.765 1124 echo "END TEST $test_name" 01:10:36.963 00:16:32.765 1125 echo "************************************" 01:10:36.963 00:16:32.765 1126 timing_exit $test_name 01:10:36.963 00:16:32.765 ... 01:10:36.963 00:16:33.024 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/autotest.sh:280 -> main(["/var/jenkins/workspace/nvmf-phy-autotest/autorun-spdk.conf"]) 01:10:36.963 00:16:33.024 ... 01:10:36.963 00:16:33.024 275 if [ $SPDK_TEST_NVMF -eq 1 ]; then 01:10:36.963 00:16:33.024 276 export NET_TYPE 01:10:36.963 00:16:33.024 277 # The NVMe-oF run test cases are split out like this so that the parser that compiles the 01:10:36.963 00:16:33.024 278 # list of all tests can properly differentiate them. Please do not merge them into one line. 01:10:36.963 00:16:33.024 279 if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then 01:10:36.963 00:16:33.024 => 280 run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.963 00:16:33.024 281 run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.963 00:16:33.024 282 elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then 01:10:36.963 00:16:33.024 283 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.963 00:16:33.024 284 if [[ $SPDK_TEST_URING -eq 0 ]]; then 01:10:36.963 00:16:33.024 285 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:36.963 00:16:33.024 ... 01:10:36.963 00:16:33.024 01:10:36.963 00:16:33.024 ========== Backtrace end ==========' 01:10:36.963 + for build in "${build_log_list[@]}" 01:10:36.963 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_3/vhost-initiator-vg-autotest_77523/build.log 01:10:36.963 + local build_log job_name start_pattern end_pattern backtraces 01:10:36.963 + build_log=/var/jenkins/workspace/autotest-per-patch_3/vhost-initiator-vg-autotest_77523/build.log 01:10:36.963 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/vhost-initiator-vg-autotest_77523/build.log 01:10:36.963 ++ basename /var/jenkins/workspace/autotest-per-patch_3/vhost-initiator-vg-autotest_77523 01:10:36.963 + job_name=vhost-initiator-vg-autotest_77523 01:10:36.963 + start_pattern='Backtrace start' 01:10:36.963 + end_pattern='Backtrace end' 01:10:36.963 + [[ -f /var/jenkins/workspace/autotest-per-patch_3/vhost-initiator-vg-autotest_77523/build.log ]] 01:10:36.963 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_3/vhost-initiator-vg-autotest_77523/build.log 01:10:36.963 + backtraces= 01:10:36.963 + [[ -n '' ]] 01:10:36.963 + for build in "${build_log_list[@]}" 01:10:36.963 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_3/centos7-vg-autotest_73682/build.log 01:10:36.963 + local build_log job_name start_pattern end_pattern backtraces 01:10:36.963 + build_log=/var/jenkins/workspace/autotest-per-patch_3/centos7-vg-autotest_73682/build.log 01:10:36.963 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/centos7-vg-autotest_73682/build.log 01:10:36.963 ++ basename /var/jenkins/workspace/autotest-per-patch_3/centos7-vg-autotest_73682 01:10:36.963 + job_name=centos7-vg-autotest_73682 01:10:36.963 + start_pattern='Backtrace start' 01:10:36.964 + end_pattern='Backtrace end' 01:10:36.964 + [[ -f /var/jenkins/workspace/autotest-per-patch_3/centos7-vg-autotest_73682/build.log ]] 01:10:36.964 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_3/centos7-vg-autotest_73682/build.log 01:10:36.964 + backtraces= 01:10:36.964 + [[ -n '' ]] 01:10:36.964 + for build in "${build_log_list[@]}" 01:10:36.964 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_3/unittest-main-docker-autotest_19884/build.log 01:10:36.964 + local build_log job_name start_pattern end_pattern backtraces 01:10:36.964 + build_log=/var/jenkins/workspace/autotest-per-patch_3/unittest-main-docker-autotest_19884/build.log 01:10:36.964 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/unittest-main-docker-autotest_19884/build.log 01:10:36.964 ++ basename /var/jenkins/workspace/autotest-per-patch_3/unittest-main-docker-autotest_19884 01:10:36.964 + job_name=unittest-main-docker-autotest_19884 01:10:36.964 + start_pattern='Backtrace start' 01:10:36.964 + end_pattern='Backtrace end' 01:10:36.964 + [[ -f /var/jenkins/workspace/autotest-per-patch_3/unittest-main-docker-autotest_19884/build.log ]] 01:10:36.964 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_3/unittest-main-docker-autotest_19884/build.log 01:10:36.964 + backtraces= 01:10:36.964 + [[ -n '' ]] 01:10:36.964 + for build in "${build_log_list[@]}" 01:10:36.964 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_3/zns-vg-autotest_76609/build.log 01:10:36.964 + local build_log job_name start_pattern end_pattern backtraces 01:10:36.964 + build_log=/var/jenkins/workspace/autotest-per-patch_3/zns-vg-autotest_76609/build.log 01:10:36.964 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/zns-vg-autotest_76609/build.log 01:10:36.964 ++ basename /var/jenkins/workspace/autotest-per-patch_3/zns-vg-autotest_76609 01:10:36.964 + job_name=zns-vg-autotest_76609 01:10:36.964 + start_pattern='Backtrace start' 01:10:36.964 + end_pattern='Backtrace end' 01:10:36.964 + [[ -f /var/jenkins/workspace/autotest-per-patch_3/zns-vg-autotest_76609/build.log ]] 01:10:36.964 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_3/zns-vg-autotest_76609/build.log 01:10:36.964 + backtraces= 01:10:36.964 + [[ -n '' ]] 01:10:36.964 + for build in "${build_log_list[@]}" 01:10:36.964 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_3/nvme-cmb-pmr-vg-autotest_78626/build.log 01:10:36.964 + local build_log job_name start_pattern end_pattern backtraces 01:10:36.964 + build_log=/var/jenkins/workspace/autotest-per-patch_3/nvme-cmb-pmr-vg-autotest_78626/build.log 01:10:36.964 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/nvme-cmb-pmr-vg-autotest_78626/build.log 01:10:36.964 ++ basename /var/jenkins/workspace/autotest-per-patch_3/nvme-cmb-pmr-vg-autotest_78626 01:10:36.964 + job_name=nvme-cmb-pmr-vg-autotest_78626 01:10:36.964 + start_pattern='Backtrace start' 01:10:36.964 + end_pattern='Backtrace end' 01:10:36.964 + [[ -f /var/jenkins/workspace/autotest-per-patch_3/nvme-cmb-pmr-vg-autotest_78626/build.log ]] 01:10:36.964 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_3/nvme-cmb-pmr-vg-autotest_78626/build.log 01:10:36.964 + backtraces= 01:10:36.964 + [[ -n '' ]] 01:10:36.964 + for build in "${build_log_list[@]}" 01:10:36.964 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_3/rocky9-vg-autotest_16113/build.log 01:10:36.964 + local build_log job_name start_pattern end_pattern backtraces 01:10:36.964 + build_log=/var/jenkins/workspace/autotest-per-patch_3/rocky9-vg-autotest_16113/build.log 01:10:36.964 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/rocky9-vg-autotest_16113/build.log 01:10:36.964 ++ basename /var/jenkins/workspace/autotest-per-patch_3/rocky9-vg-autotest_16113 01:10:36.964 + job_name=rocky9-vg-autotest_16113 01:10:36.964 + start_pattern='Backtrace start' 01:10:36.964 + end_pattern='Backtrace end' 01:10:36.964 + [[ -f /var/jenkins/workspace/autotest-per-patch_3/rocky9-vg-autotest_16113/build.log ]] 01:10:36.964 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_3/rocky9-vg-autotest_16113/build.log 01:10:36.964 + backtraces= 01:10:36.964 + [[ -n '' ]] 01:10:36.964 + for build in "${build_log_list[@]}" 01:10:36.964 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_3/iscsi-vg-autotest_77541/build.log 01:10:36.964 + local build_log job_name start_pattern end_pattern backtraces 01:10:36.964 + build_log=/var/jenkins/workspace/autotest-per-patch_3/iscsi-vg-autotest_77541/build.log 01:10:36.964 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/iscsi-vg-autotest_77541/build.log 01:10:36.964 ++ basename /var/jenkins/workspace/autotest-per-patch_3/iscsi-vg-autotest_77541 01:10:36.964 + job_name=iscsi-vg-autotest_77541 01:10:36.964 + start_pattern='Backtrace start' 01:10:36.964 + end_pattern='Backtrace end' 01:10:36.964 + [[ -f /var/jenkins/workspace/autotest-per-patch_3/iscsi-vg-autotest_77541/build.log ]] 01:10:36.964 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_3/iscsi-vg-autotest_77541/build.log 01:10:36.964 + backtraces= 01:10:36.964 + [[ -n '' ]] 01:10:36.964 + for build in "${build_log_list[@]}" 01:10:36.964 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_3/doc-docker-autotest_22347/build.log 01:10:36.964 + local build_log job_name start_pattern end_pattern backtraces 01:10:36.964 + build_log=/var/jenkins/workspace/autotest-per-patch_3/doc-docker-autotest_22347/build.log 01:10:36.964 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/doc-docker-autotest_22347/build.log 01:10:36.964 ++ basename /var/jenkins/workspace/autotest-per-patch_3/doc-docker-autotest_22347 01:10:36.964 + job_name=doc-docker-autotest_22347 01:10:36.964 + start_pattern='Backtrace start' 01:10:36.964 + end_pattern='Backtrace end' 01:10:36.964 + [[ -f /var/jenkins/workspace/autotest-per-patch_3/doc-docker-autotest_22347/build.log ]] 01:10:36.964 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_3/doc-docker-autotest_22347/build.log 01:10:36.964 + backtraces= 01:10:36.964 + [[ -n '' ]] 01:10:36.964 + for build in "${build_log_list[@]}" 01:10:36.964 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_3/nvme-vg-autotest_77503/build.log 01:10:36.964 + local build_log job_name start_pattern end_pattern backtraces 01:10:36.964 + build_log=/var/jenkins/workspace/autotest-per-patch_3/nvme-vg-autotest_77503/build.log 01:10:36.964 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/nvme-vg-autotest_77503/build.log 01:10:36.964 ++ basename /var/jenkins/workspace/autotest-per-patch_3/nvme-vg-autotest_77503 01:10:36.964 + job_name=nvme-vg-autotest_77503 01:10:36.964 + start_pattern='Backtrace start' 01:10:36.964 + end_pattern='Backtrace end' 01:10:36.964 + [[ -f /var/jenkins/workspace/autotest-per-patch_3/nvme-vg-autotest_77503/build.log ]] 01:10:36.964 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_3/nvme-vg-autotest_77503/build.log 01:10:36.964 + backtraces= 01:10:36.964 + [[ -n '' ]] 01:10:36.964 + for build in "${build_log_list[@]}" 01:10:36.964 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_3/unittest-valgrind-docker-autotest_19887/build.log 01:10:36.964 + local build_log job_name start_pattern end_pattern backtraces 01:10:36.964 + build_log=/var/jenkins/workspace/autotest-per-patch_3/unittest-valgrind-docker-autotest_19887/build.log 01:10:36.964 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/unittest-valgrind-docker-autotest_19887/build.log 01:10:36.964 ++ basename /var/jenkins/workspace/autotest-per-patch_3/unittest-valgrind-docker-autotest_19887 01:10:36.964 + job_name=unittest-valgrind-docker-autotest_19887 01:10:36.964 + start_pattern='Backtrace start' 01:10:36.964 + end_pattern='Backtrace end' 01:10:36.964 + [[ -f /var/jenkins/workspace/autotest-per-patch_3/unittest-valgrind-docker-autotest_19887/build.log ]] 01:10:36.964 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_3/unittest-valgrind-docker-autotest_19887/build.log 01:10:36.964 + backtraces= 01:10:36.964 + [[ -n '' ]] 01:10:36.964 + for build in "${build_log_list[@]}" 01:10:36.964 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_3/freebsd-vg-autotest_59146/build.log 01:10:36.964 + local build_log job_name start_pattern end_pattern backtraces 01:10:36.964 + build_log=/var/jenkins/workspace/autotest-per-patch_3/freebsd-vg-autotest_59146/build.log 01:10:36.964 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/freebsd-vg-autotest_59146/build.log 01:10:36.964 ++ basename /var/jenkins/workspace/autotest-per-patch_3/freebsd-vg-autotest_59146 01:10:36.964 + job_name=freebsd-vg-autotest_59146 01:10:36.964 + start_pattern='Backtrace start' 01:10:36.964 + end_pattern='Backtrace end' 01:10:36.964 + [[ -f /var/jenkins/workspace/autotest-per-patch_3/freebsd-vg-autotest_59146/build.log ]] 01:10:36.964 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_3/freebsd-vg-autotest_59146/build.log 01:10:36.964 + backtraces= 01:10:36.964 + [[ -n '' ]] 01:10:36.964 + for build in "${build_log_list[@]}" 01:10:36.964 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_3/check-so-deps-docker-autotest_22180/build.log 01:10:36.964 + local build_log job_name start_pattern end_pattern backtraces 01:10:36.964 + build_log=/var/jenkins/workspace/autotest-per-patch_3/check-so-deps-docker-autotest_22180/build.log 01:10:36.964 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/check-so-deps-docker-autotest_22180/build.log 01:10:36.964 ++ basename /var/jenkins/workspace/autotest-per-patch_3/check-so-deps-docker-autotest_22180 01:10:36.964 + job_name=check-so-deps-docker-autotest_22180 01:10:36.964 + start_pattern='Backtrace start' 01:10:36.964 + end_pattern='Backtrace end' 01:10:36.965 + [[ -f /var/jenkins/workspace/autotest-per-patch_3/check-so-deps-docker-autotest_22180/build.log ]] 01:10:36.965 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_3/check-so-deps-docker-autotest_22180/build.log 01:10:36.965 + backtraces= 01:10:36.965 + [[ -n '' ]] 01:10:36.965 + for build in "${build_log_list[@]}" 01:10:36.965 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_3/iscsi-uring-vg-autotest_77408/build.log 01:10:36.965 + local build_log job_name start_pattern end_pattern backtraces 01:10:36.965 + build_log=/var/jenkins/workspace/autotest-per-patch_3/iscsi-uring-vg-autotest_77408/build.log 01:10:36.965 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/iscsi-uring-vg-autotest_77408/build.log 01:10:36.965 ++ basename /var/jenkins/workspace/autotest-per-patch_3/iscsi-uring-vg-autotest_77408 01:10:36.965 + job_name=iscsi-uring-vg-autotest_77408 01:10:36.965 + start_pattern='Backtrace start' 01:10:36.965 + end_pattern='Backtrace end' 01:10:36.965 + [[ -f /var/jenkins/workspace/autotest-per-patch_3/iscsi-uring-vg-autotest_77408/build.log ]] 01:10:36.965 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_3/iscsi-uring-vg-autotest_77408/build.log 01:10:37.225 + backtraces= 01:10:37.225 + [[ -n '' ]] 01:10:37.225 + for build in "${build_log_list[@]}" 01:10:37.225 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_3/unittest-clang-docker-autotest_19883/build.log 01:10:37.225 + local build_log job_name start_pattern end_pattern backtraces 01:10:37.225 + build_log=/var/jenkins/workspace/autotest-per-patch_3/unittest-clang-docker-autotest_19883/build.log 01:10:37.225 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/unittest-clang-docker-autotest_19883/build.log 01:10:37.225 ++ basename /var/jenkins/workspace/autotest-per-patch_3/unittest-clang-docker-autotest_19883 01:10:37.225 + job_name=unittest-clang-docker-autotest_19883 01:10:37.225 + start_pattern='Backtrace start' 01:10:37.225 + end_pattern='Backtrace end' 01:10:37.225 + [[ -f /var/jenkins/workspace/autotest-per-patch_3/unittest-clang-docker-autotest_19883/build.log ]] 01:10:37.225 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_3/unittest-clang-docker-autotest_19883/build.log 01:10:37.225 + backtraces= 01:10:37.225 + [[ -n '' ]] 01:10:37.225 + for build in "${build_log_list[@]}" 01:10:37.225 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_3/nvmf-tcp-uring-vg-autotest_77428/build.log 01:10:37.225 + local build_log job_name start_pattern end_pattern backtraces 01:10:37.225 + build_log=/var/jenkins/workspace/autotest-per-patch_3/nvmf-tcp-uring-vg-autotest_77428/build.log 01:10:37.225 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/nvmf-tcp-uring-vg-autotest_77428/build.log 01:10:37.225 ++ basename /var/jenkins/workspace/autotest-per-patch_3/nvmf-tcp-uring-vg-autotest_77428 01:10:37.225 + job_name=nvmf-tcp-uring-vg-autotest_77428 01:10:37.225 + start_pattern='Backtrace start' 01:10:37.225 + end_pattern='Backtrace end' 01:10:37.225 + [[ -f /var/jenkins/workspace/autotest-per-patch_3/nvmf-tcp-uring-vg-autotest_77428/build.log ]] 01:10:37.225 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_3/nvmf-tcp-uring-vg-autotest_77428/build.log 01:10:37.225 + backtraces='00:25:37.028 ========== Backtrace start: ========== 01:10:37.225 00:25:37.028 01:10:37.225 00:25:37.028 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:587 -> rpc_cmd(["-s"],["/tmp/host.sock"],["bdev_nvme_start_discovery"],["-b"],["nvme"],["-t"],["tcp"],["-a"],["10.0.0.2"],["-s"],["8009"],["-f"],["ipv4"],["-q"],["nqn.2021-12.io.spdk:test"]) 01:10:37.225 00:25:37.028 ... 01:10:37.225 00:25:37.028 582 echo "$rsp" 01:10:37.225 00:25:37.028 583 done 01:10:37.225 00:25:37.028 584 01:10:37.225 00:25:37.028 585 rc=${!status[*]} 01:10:37.225 00:25:37.028 586 xtrace_restore 01:10:37.225 00:25:37.028 => 587 [[ $rc == 0 ]] 01:10:37.225 00:25:37.028 588 } 01:10:37.225 00:25:37.028 589 01:10:37.225 00:25:37.028 590 function rpc_cmd_simple_data_json() { 01:10:37.225 00:25:37.028 591 01:10:37.225 00:25:37.028 592 local elems="$1[@]" elem 01:10:37.225 00:25:37.028 ... 01:10:37.225 00:25:37.028 in /home/vagrant/spdk_repo/spdk/test/nvmf/host/discovery.sh:51 -> main(["--transport=tcp"]) 01:10:37.225 00:25:37.028 ... 01:10:37.225 00:25:37.028 46 waitforlisten $hostpid $HOST_SOCK 01:10:37.225 00:25:37.028 47 01:10:37.225 00:25:37.028 48 trap '\''process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1'\'' SIGINT SIGTERM EXIT 01:10:37.225 00:25:37.028 49 01:10:37.225 00:25:37.028 50 $rpc_py -s $HOST_SOCK log_set_flag bdev_nvme 01:10:37.225 00:25:37.028 => 51 $rpc_py -s $HOST_SOCK bdev_nvme_start_discovery -b nvme -t $TEST_TRANSPORT -a $NVMF_FIRST_TARGET_IP \ 01:10:37.225 00:25:37.028 52 -s $DISCOVERY_PORT -f ipv4 -q $HOST_NQN 01:10:37.225 00:25:37.028 53 01:10:37.225 00:25:37.028 54 function get_bdev_list() { 01:10:37.225 00:25:37.028 55 $rpc_py -s $HOST_SOCK bdev_get_bdevs | jq -r '\''.[].name'\'' | sort | xargs 01:10:37.225 00:25:37.028 56 } 01:10:37.225 00:25:37.028 ... 01:10:37.225 00:25:37.028 01:10:37.225 00:25:37.028 ========== Backtrace end ========== 01:10:37.225 00:25:37.028 ========== Backtrace start: ========== 01:10:37.225 00:25:37.028 01:10:37.225 00:25:37.028 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1121 -> run_test(["nvmf_host_discovery"],["/home/vagrant/spdk_repo/spdk/test/nvmf/host/discovery.sh"],["--transport=tcp"]) 01:10:37.225 00:25:37.028 ... 01:10:37.225 00:25:37.028 1116 timing_enter $test_name 01:10:37.225 00:25:37.028 1117 echo "************************************" 01:10:37.225 00:25:37.028 1118 echo "START TEST $test_name" 01:10:37.225 00:25:37.028 1119 echo "************************************" 01:10:37.225 00:25:37.028 1120 xtrace_restore 01:10:37.225 00:25:37.028 1121 time "$@" 01:10:37.225 00:25:37.028 1122 xtrace_disable 01:10:37.225 00:25:37.028 1123 echo "************************************" 01:10:37.225 00:25:37.028 1124 echo "END TEST $test_name" 01:10:37.225 00:25:37.028 1125 echo "************************************" 01:10:37.225 00:25:37.028 1126 timing_exit $test_name 01:10:37.225 00:25:37.028 ... 01:10:37.225 00:25:37.028 in /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh:99 -> main(["--transport=tcp"]) 01:10:37.225 00:25:37.028 ... 01:10:37.225 00:25:37.028 94 01:10:37.225 00:25:37.028 95 run_test "nvmf_identify" $rootdir/test/nvmf/host/identify.sh "${TEST_ARGS[@]}" 01:10:37.225 00:25:37.028 96 run_test "nvmf_perf" $rootdir/test/nvmf/host/perf.sh "${TEST_ARGS[@]}" 01:10:37.225 00:25:37.028 97 run_test "nvmf_fio_host" $rootdir/test/nvmf/host/fio.sh "${TEST_ARGS[@]}" 01:10:37.225 00:25:37.028 98 run_test "nvmf_failover" $rootdir/test/nvmf/host/failover.sh "${TEST_ARGS[@]}" 01:10:37.225 00:25:37.028 => 99 run_test "nvmf_host_discovery" $rootdir/test/nvmf/host/discovery.sh "${TEST_ARGS[@]}" 01:10:37.225 00:25:37.028 100 run_test "nvmf_host_multipath_status" $rootdir/test/nvmf/host/multipath_status.sh "${TEST_ARGS[@]}" 01:10:37.225 00:25:37.028 101 run_test "nvmf_discovery_remove_ifc" $rootdir/test/nvmf/host/discovery_remove_ifc.sh "${TEST_ARGS[@]}" 01:10:37.225 00:25:37.028 102 run_test "nvmf_identify_kernel_target" "$rootdir/test/nvmf/host/identify_kernel_nvmf.sh" "${TEST_ARGS[@]}" 01:10:37.225 00:25:37.028 103 run_test "nvmf_auth" "$rootdir/test/nvmf/host/auth.sh" "${TEST_ARGS[@]}" 01:10:37.225 00:25:37.028 104 01:10:37.225 00:25:37.028 ... 01:10:37.225 00:25:37.028 01:10:37.225 00:25:37.028 ========== Backtrace end ========== 01:10:37.225 00:25:37.029 ========== Backtrace start: ========== 01:10:37.225 00:25:37.029 01:10:37.225 00:25:37.029 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1121 -> run_test(["nvmf_tcp"],["/home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh"],["--transport=tcp"]) 01:10:37.225 00:25:37.029 ... 01:10:37.225 00:25:37.029 1116 timing_enter $test_name 01:10:37.225 00:25:37.029 1117 echo "************************************" 01:10:37.225 00:25:37.029 1118 echo "START TEST $test_name" 01:10:37.225 00:25:37.029 1119 echo "************************************" 01:10:37.225 00:25:37.029 1120 xtrace_restore 01:10:37.225 00:25:37.029 1121 time "$@" 01:10:37.225 00:25:37.029 1122 xtrace_disable 01:10:37.225 00:25:37.029 1123 echo "************************************" 01:10:37.225 00:25:37.029 1124 echo "END TEST $test_name" 01:10:37.225 00:25:37.029 1125 echo "************************************" 01:10:37.225 00:25:37.029 1126 timing_exit $test_name 01:10:37.225 00:25:37.029 ... 01:10:37.225 00:25:37.029 in /home/vagrant/spdk_repo/spdk/autotest.sh:283 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 01:10:37.225 00:25:37.029 ... 01:10:37.225 00:25:37.029 278 # list of all tests can properly differentiate them. Please do not merge them into one line. 01:10:37.225 00:25:37.029 279 if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then 01:10:37.225 00:25:37.029 280 run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:37.225 00:25:37.029 281 run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:37.225 00:25:37.029 282 elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then 01:10:37.225 00:25:37.029 => 283 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:37.225 00:25:37.029 284 if [[ $SPDK_TEST_URING -eq 0 ]]; then 01:10:37.225 00:25:37.029 285 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:37.225 00:25:37.029 286 run_test "nvmf_identify_passthru" $rootdir/test/nvmf/target/identify_passthru.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:37.225 00:25:37.029 287 fi 01:10:37.225 00:25:37.029 288 run_test "nvmf_dif" $rootdir/test/nvmf/target/dif.sh 01:10:37.225 00:25:37.029 ... 01:10:37.225 00:25:37.029 01:10:37.225 00:25:37.029 ========== Backtrace end ==========' 01:10:37.225 + [[ -n 00:25:37.028 ========== Backtrace start: ========== 01:10:37.225 00:25:37.028 01:10:37.225 00:25:37.028 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:587 -> rpc_cmd(["-s"],["/tmp/host.sock"],["bdev_nvme_start_discovery"],["-b"],["nvme"],["-t"],["tcp"],["-a"],["10.0.0.2"],["-s"],["8009"],["-f"],["ipv4"],["-q"],["nqn.2021-12.io.spdk:test"]) 01:10:37.225 00:25:37.028 ... 01:10:37.225 00:25:37.028 582 echo "$rsp" 01:10:37.225 00:25:37.028 583 done 01:10:37.225 00:25:37.028 584 01:10:37.225 00:25:37.028 585 rc=${!status[*]} 01:10:37.226 00:25:37.028 586 xtrace_restore 01:10:37.226 00:25:37.028 => 587 [[ $rc == 0 ]] 01:10:37.226 00:25:37.028 588 } 01:10:37.226 00:25:37.028 589 01:10:37.226 00:25:37.028 590 function rpc_cmd_simple_data_json() { 01:10:37.226 00:25:37.028 591 01:10:37.226 00:25:37.028 592 local elems="$1[@]" elem 01:10:37.226 00:25:37.028 ... 01:10:37.226 00:25:37.028 in /home/vagrant/spdk_repo/spdk/test/nvmf/host/discovery.sh:51 -> main(["--transport=tcp"]) 01:10:37.226 00:25:37.028 ... 01:10:37.226 00:25:37.028 46 waitforlisten $hostpid $HOST_SOCK 01:10:37.226 00:25:37.028 47 01:10:37.226 00:25:37.028 48 trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 01:10:37.226 00:25:37.028 49 01:10:37.226 00:25:37.028 50 $rpc_py -s $HOST_SOCK log_set_flag bdev_nvme 01:10:37.226 00:25:37.028 => 51 $rpc_py -s $HOST_SOCK bdev_nvme_start_discovery -b nvme -t $TEST_TRANSPORT -a $NVMF_FIRST_TARGET_IP \ 01:10:37.226 00:25:37.028 52 -s $DISCOVERY_PORT -f ipv4 -q $HOST_NQN 01:10:37.226 00:25:37.028 53 01:10:37.226 00:25:37.028 54 function get_bdev_list() { 01:10:37.226 00:25:37.028 55 $rpc_py -s $HOST_SOCK bdev_get_bdevs | jq -r '.[].name' | sort | xargs 01:10:37.226 00:25:37.028 56 } 01:10:37.226 00:25:37.028 ... 01:10:37.226 00:25:37.028 01:10:37.226 00:25:37.028 ========== Backtrace end ========== 01:10:37.226 00:25:37.028 ========== Backtrace start: ========== 01:10:37.226 00:25:37.028 01:10:37.226 00:25:37.028 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1121 -> run_test(["nvmf_host_discovery"],["/home/vagrant/spdk_repo/spdk/test/nvmf/host/discovery.sh"],["--transport=tcp"]) 01:10:37.226 00:25:37.028 ... 01:10:37.226 00:25:37.028 1116 timing_enter $test_name 01:10:37.226 00:25:37.028 1117 echo "************************************" 01:10:37.226 00:25:37.028 1118 echo "START TEST $test_name" 01:10:37.226 00:25:37.028 1119 echo "************************************" 01:10:37.226 00:25:37.028 1120 xtrace_restore 01:10:37.226 00:25:37.028 1121 time "$@" 01:10:37.226 00:25:37.028 1122 xtrace_disable 01:10:37.226 00:25:37.028 1123 echo "************************************" 01:10:37.226 00:25:37.028 1124 echo "END TEST $test_name" 01:10:37.226 00:25:37.028 1125 echo "************************************" 01:10:37.226 00:25:37.028 1126 timing_exit $test_name 01:10:37.226 00:25:37.028 ... 01:10:37.226 00:25:37.028 in /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh:99 -> main(["--transport=tcp"]) 01:10:37.226 00:25:37.028 ... 01:10:37.226 00:25:37.028 94 01:10:37.226 00:25:37.028 95 run_test "nvmf_identify" $rootdir/test/nvmf/host/identify.sh "${TEST_ARGS[@]}" 01:10:37.226 00:25:37.028 96 run_test "nvmf_perf" $rootdir/test/nvmf/host/perf.sh "${TEST_ARGS[@]}" 01:10:37.226 00:25:37.028 97 run_test "nvmf_fio_host" $rootdir/test/nvmf/host/fio.sh "${TEST_ARGS[@]}" 01:10:37.226 00:25:37.028 98 run_test "nvmf_failover" $rootdir/test/nvmf/host/failover.sh "${TEST_ARGS[@]}" 01:10:37.226 00:25:37.028 => 99 run_test "nvmf_host_discovery" $rootdir/test/nvmf/host/discovery.sh "${TEST_ARGS[@]}" 01:10:37.226 00:25:37.028 100 run_test "nvmf_host_multipath_status" $rootdir/test/nvmf/host/multipath_status.sh "${TEST_ARGS[@]}" 01:10:37.226 00:25:37.028 101 run_test "nvmf_discovery_remove_ifc" $rootdir/test/nvmf/host/discovery_remove_ifc.sh "${TEST_ARGS[@]}" 01:10:37.226 00:25:37.028 102 run_test "nvmf_identify_kernel_target" "$rootdir/test/nvmf/host/identify_kernel_nvmf.sh" "${TEST_ARGS[@]}" 01:10:37.226 00:25:37.028 103 run_test "nvmf_auth" "$rootdir/test/nvmf/host/auth.sh" "${TEST_ARGS[@]}" 01:10:37.226 00:25:37.028 104 01:10:37.226 00:25:37.028 ... 01:10:37.226 00:25:37.028 01:10:37.226 00:25:37.028 ========== Backtrace end ========== 01:10:37.226 00:25:37.029 ========== Backtrace start: ========== 01:10:37.226 00:25:37.029 01:10:37.226 00:25:37.029 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1121 -> run_test(["nvmf_tcp"],["/home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh"],["--transport=tcp"]) 01:10:37.226 00:25:37.029 ... 01:10:37.226 00:25:37.029 1116 timing_enter $test_name 01:10:37.226 00:25:37.029 1117 echo "************************************" 01:10:37.226 00:25:37.029 1118 echo "START TEST $test_name" 01:10:37.226 00:25:37.029 1119 echo "************************************" 01:10:37.226 00:25:37.029 1120 xtrace_restore 01:10:37.226 00:25:37.029 1121 time "$@" 01:10:37.226 00:25:37.029 1122 xtrace_disable 01:10:37.226 00:25:37.029 1123 echo "************************************" 01:10:37.226 00:25:37.029 1124 echo "END TEST $test_name" 01:10:37.226 00:25:37.029 1125 echo "************************************" 01:10:37.226 00:25:37.029 1126 timing_exit $test_name 01:10:37.226 00:25:37.029 ... 01:10:37.226 00:25:37.029 in /home/vagrant/spdk_repo/spdk/autotest.sh:283 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 01:10:37.226 00:25:37.029 ... 01:10:37.226 00:25:37.029 278 # list of all tests can properly differentiate them. Please do not merge them into one line. 01:10:37.226 00:25:37.029 279 if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then 01:10:37.226 00:25:37.029 280 run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:37.226 00:25:37.029 281 run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:37.226 00:25:37.029 282 elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then 01:10:37.226 00:25:37.029 => 283 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:37.226 00:25:37.029 284 if [[ $SPDK_TEST_URING -eq 0 ]]; then 01:10:37.226 00:25:37.029 285 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:37.226 00:25:37.029 286 run_test "nvmf_identify_passthru" $rootdir/test/nvmf/target/identify_passthru.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:37.226 00:25:37.029 287 fi 01:10:37.226 00:25:37.029 288 run_test "nvmf_dif" $rootdir/test/nvmf/target/dif.sh 01:10:37.226 00:25:37.029 ... 01:10:37.226 00:25:37.029 01:10:37.226 00:25:37.029 ========== Backtrace end ========== ]] 01:10:37.226 + echo '00:25:37.028 ========== Backtrace start: ========== 01:10:37.226 00:25:37.028 01:10:37.226 00:25:37.028 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:587 -> rpc_cmd(["-s"],["/tmp/host.sock"],["bdev_nvme_start_discovery"],["-b"],["nvme"],["-t"],["tcp"],["-a"],["10.0.0.2"],["-s"],["8009"],["-f"],["ipv4"],["-q"],["nqn.2021-12.io.spdk:test"]) 01:10:37.226 00:25:37.028 ... 01:10:37.226 00:25:37.028 582 echo "$rsp" 01:10:37.226 00:25:37.028 583 done 01:10:37.226 00:25:37.028 584 01:10:37.226 00:25:37.028 585 rc=${!status[*]} 01:10:37.226 00:25:37.028 586 xtrace_restore 01:10:37.226 00:25:37.028 => 587 [[ $rc == 0 ]] 01:10:37.226 00:25:37.028 588 } 01:10:37.226 00:25:37.028 589 01:10:37.226 00:25:37.028 590 function rpc_cmd_simple_data_json() { 01:10:37.226 00:25:37.028 591 01:10:37.226 00:25:37.028 592 local elems="$1[@]" elem 01:10:37.226 00:25:37.028 ... 01:10:37.226 00:25:37.028 in /home/vagrant/spdk_repo/spdk/test/nvmf/host/discovery.sh:51 -> main(["--transport=tcp"]) 01:10:37.226 00:25:37.028 ... 01:10:37.226 00:25:37.028 46 waitforlisten $hostpid $HOST_SOCK 01:10:37.226 00:25:37.028 47 01:10:37.226 00:25:37.028 48 trap '\''process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1'\'' SIGINT SIGTERM EXIT 01:10:37.226 00:25:37.028 49 01:10:37.226 00:25:37.028 50 $rpc_py -s $HOST_SOCK log_set_flag bdev_nvme 01:10:37.226 00:25:37.028 => 51 $rpc_py -s $HOST_SOCK bdev_nvme_start_discovery -b nvme -t $TEST_TRANSPORT -a $NVMF_FIRST_TARGET_IP \ 01:10:37.226 00:25:37.028 52 -s $DISCOVERY_PORT -f ipv4 -q $HOST_NQN 01:10:37.226 00:25:37.028 53 01:10:37.226 00:25:37.028 54 function get_bdev_list() { 01:10:37.226 00:25:37.028 55 $rpc_py -s $HOST_SOCK bdev_get_bdevs | jq -r '\''.[].name'\'' | sort | xargs 01:10:37.226 00:25:37.028 56 } 01:10:37.226 00:25:37.028 ... 01:10:37.226 00:25:37.028 01:10:37.226 00:25:37.028 ========== Backtrace end ========== 01:10:37.226 00:25:37.028 ========== Backtrace start: ========== 01:10:37.226 00:25:37.028 01:10:37.226 00:25:37.028 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1121 -> run_test(["nvmf_host_discovery"],["/home/vagrant/spdk_repo/spdk/test/nvmf/host/discovery.sh"],["--transport=tcp"]) 01:10:37.226 00:25:37.028 ... 01:10:37.226 00:25:37.028 1116 timing_enter $test_name 01:10:37.226 00:25:37.028 1117 echo "************************************" 01:10:37.226 00:25:37.028 1118 echo "START TEST $test_name" 01:10:37.226 00:25:37.028 1119 echo "************************************" 01:10:37.226 00:25:37.028 1120 xtrace_restore 01:10:37.226 00:25:37.028 1121 time "$@" 01:10:37.226 00:25:37.028 1122 xtrace_disable 01:10:37.226 00:25:37.028 1123 echo "************************************" 01:10:37.226 00:25:37.028 1124 echo "END TEST $test_name" 01:10:37.226 00:25:37.028 1125 echo "************************************" 01:10:37.226 00:25:37.028 1126 timing_exit $test_name 01:10:37.226 00:25:37.028 ... 01:10:37.226 00:25:37.028 in /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh:99 -> main(["--transport=tcp"]) 01:10:37.226 00:25:37.028 ... 01:10:37.226 00:25:37.028 94 01:10:37.226 00:25:37.028 95 run_test "nvmf_identify" $rootdir/test/nvmf/host/identify.sh "${TEST_ARGS[@]}" 01:10:37.226 00:25:37.028 96 run_test "nvmf_perf" $rootdir/test/nvmf/host/perf.sh "${TEST_ARGS[@]}" 01:10:37.226 00:25:37.028 97 run_test "nvmf_fio_host" $rootdir/test/nvmf/host/fio.sh "${TEST_ARGS[@]}" 01:10:37.226 00:25:37.028 98 run_test "nvmf_failover" $rootdir/test/nvmf/host/failover.sh "${TEST_ARGS[@]}" 01:10:37.226 00:25:37.028 => 99 run_test "nvmf_host_discovery" $rootdir/test/nvmf/host/discovery.sh "${TEST_ARGS[@]}" 01:10:37.226 00:25:37.028 100 run_test "nvmf_host_multipath_status" $rootdir/test/nvmf/host/multipath_status.sh "${TEST_ARGS[@]}" 01:10:37.226 00:25:37.028 101 run_test "nvmf_discovery_remove_ifc" $rootdir/test/nvmf/host/discovery_remove_ifc.sh "${TEST_ARGS[@]}" 01:10:37.226 00:25:37.028 102 run_test "nvmf_identify_kernel_target" "$rootdir/test/nvmf/host/identify_kernel_nvmf.sh" "${TEST_ARGS[@]}" 01:10:37.226 00:25:37.028 103 run_test "nvmf_auth" "$rootdir/test/nvmf/host/auth.sh" "${TEST_ARGS[@]}" 01:10:37.226 00:25:37.028 104 01:10:37.226 00:25:37.028 ... 01:10:37.226 00:25:37.028 01:10:37.226 00:25:37.028 ========== Backtrace end ========== 01:10:37.226 00:25:37.029 ========== Backtrace start: ========== 01:10:37.226 00:25:37.029 01:10:37.226 00:25:37.029 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1121 -> run_test(["nvmf_tcp"],["/home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh"],["--transport=tcp"]) 01:10:37.226 00:25:37.029 ... 01:10:37.226 00:25:37.029 1116 timing_enter $test_name 01:10:37.226 00:25:37.029 1117 echo "************************************" 01:10:37.226 00:25:37.029 1118 echo "START TEST $test_name" 01:10:37.226 00:25:37.029 1119 echo "************************************" 01:10:37.226 00:25:37.029 1120 xtrace_restore 01:10:37.226 00:25:37.029 1121 time "$@" 01:10:37.226 00:25:37.029 1122 xtrace_disable 01:10:37.226 00:25:37.029 1123 echo "************************************" 01:10:37.226 00:25:37.029 1124 echo "END TEST $test_name" 01:10:37.226 00:25:37.029 1125 echo "************************************" 01:10:37.226 00:25:37.029 1126 timing_exit $test_name 01:10:37.227 00:25:37.029 ... 01:10:37.227 00:25:37.029 in /home/vagrant/spdk_repo/spdk/autotest.sh:283 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 01:10:37.227 00:25:37.029 ... 01:10:37.227 00:25:37.029 278 # list of all tests can properly differentiate them. Please do not merge them into one line. 01:10:37.227 00:25:37.029 279 if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then 01:10:37.227 00:25:37.029 280 run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:37.227 00:25:37.029 281 run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:37.227 00:25:37.029 282 elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then 01:10:37.227 00:25:37.029 => 283 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:37.227 00:25:37.029 284 if [[ $SPDK_TEST_URING -eq 0 ]]; then 01:10:37.227 00:25:37.029 285 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:37.227 00:25:37.029 286 run_test "nvmf_identify_passthru" $rootdir/test/nvmf/target/identify_passthru.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 01:10:37.227 00:25:37.029 287 fi 01:10:37.227 00:25:37.029 288 run_test "nvmf_dif" $rootdir/test/nvmf/target/dif.sh 01:10:37.227 00:25:37.029 ... 01:10:37.227 00:25:37.029 01:10:37.227 00:25:37.029 ========== Backtrace end ==========' 01:10:37.227 + for build in "${build_log_list[@]}" 01:10:37.227 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_3/scan-build-docker-autotest_19886/build.log 01:10:37.227 + local build_log job_name start_pattern end_pattern backtraces 01:10:37.227 + build_log=/var/jenkins/workspace/autotest-per-patch_3/scan-build-docker-autotest_19886/build.log 01:10:37.227 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/scan-build-docker-autotest_19886/build.log 01:10:37.227 ++ basename /var/jenkins/workspace/autotest-per-patch_3/scan-build-docker-autotest_19886 01:10:37.227 + job_name=scan-build-docker-autotest_19886 01:10:37.227 + start_pattern='Backtrace start' 01:10:37.227 + end_pattern='Backtrace end' 01:10:37.227 + [[ -f /var/jenkins/workspace/autotest-per-patch_3/scan-build-docker-autotest_19886/build.log ]] 01:10:37.227 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_3/scan-build-docker-autotest_19886/build.log 01:10:37.227 + backtraces= 01:10:37.227 + [[ -n '' ]] 01:10:37.227 + run_flamegraph 01:10:37.227 + create_timing_file 01:10:37.227 + local array file 01:10:37.227 + array=($(find $WORKSPACE -type f -name 'timing.txt')) 01:10:37.227 ++ find /var/jenkins/workspace/autotest-per-patch_3 -type f -name timing.txt 01:10:37.227 + timing_dir=/var/jenkins/workspace/autotest-per-patch_3/post_process 01:10:37.227 + mkdir -p /var/jenkins/workspace/autotest-per-patch_3/post_process 01:10:37.227 + timing_file=/var/jenkins/workspace/autotest-per-patch_3/post_process/total_timing.txt 01:10:37.227 + for file in "${array[@]}" 01:10:37.227 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_3/build-files-docker-autotest_22156/timing.txt 01:10:37.227 + local job_file job_name 01:10:37.227 + job_file=/var/jenkins/workspace/autotest-per-patch_3/build-files-docker-autotest_22156/timing.txt 01:10:37.227 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/build-files-docker-autotest_22156/timing.txt 01:10:37.227 ++ basename /var/jenkins/workspace/autotest-per-patch_3/build-files-docker-autotest_22156 01:10:37.227 + job_name=build-files-docker-autotest_22156 01:10:37.227 + sed 's/^/build-files-docker-autotest_22156;autorun;/' /var/jenkins/workspace/autotest-per-patch_3/build-files-docker-autotest_22156/timing.txt 01:10:37.227 + for file in "${array[@]}" 01:10:37.227 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_3/vhost-phy-autotest_26248/timing.txt 01:10:37.227 + local job_file job_name 01:10:37.227 + job_file=/var/jenkins/workspace/autotest-per-patch_3/vhost-phy-autotest_26248/timing.txt 01:10:37.227 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/vhost-phy-autotest_26248/timing.txt 01:10:37.227 ++ basename /var/jenkins/workspace/autotest-per-patch_3/vhost-phy-autotest_26248 01:10:37.227 + job_name=vhost-phy-autotest_26248 01:10:37.227 + sed 's/^/vhost-phy-autotest_26248;autorun;/' /var/jenkins/workspace/autotest-per-patch_3/vhost-phy-autotest_26248/timing.txt 01:10:37.227 + for file in "${array[@]}" 01:10:37.227 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_3/lvol-vg-autotest_77452/timing.txt 01:10:37.227 + local job_file job_name 01:10:37.227 + job_file=/var/jenkins/workspace/autotest-per-patch_3/lvol-vg-autotest_77452/timing.txt 01:10:37.227 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/lvol-vg-autotest_77452/timing.txt 01:10:37.227 ++ basename /var/jenkins/workspace/autotest-per-patch_3/lvol-vg-autotest_77452 01:10:37.227 + job_name=lvol-vg-autotest_77452 01:10:37.227 + sed 's/^/lvol-vg-autotest_77452;autorun;/' /var/jenkins/workspace/autotest-per-patch_3/lvol-vg-autotest_77452/timing.txt 01:10:37.227 + for file in "${array[@]}" 01:10:37.227 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_3/autobuild-external-vg-autotest_19846/timing.txt 01:10:37.227 + local job_file job_name 01:10:37.227 + job_file=/var/jenkins/workspace/autotest-per-patch_3/autobuild-external-vg-autotest_19846/timing.txt 01:10:37.227 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/autobuild-external-vg-autotest_19846/timing.txt 01:10:37.227 ++ basename /var/jenkins/workspace/autotest-per-patch_3/autobuild-external-vg-autotest_19846 01:10:37.227 + job_name=autobuild-external-vg-autotest_19846 01:10:37.227 + sed 's/^/autobuild-external-vg-autotest_19846;autorun;/' /var/jenkins/workspace/autotest-per-patch_3/autobuild-external-vg-autotest_19846/timing.txt 01:10:37.227 + for file in "${array[@]}" 01:10:37.227 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_3/packaging-docker-autotest_19885/timing.txt 01:10:37.227 + local job_file job_name 01:10:37.227 + job_file=/var/jenkins/workspace/autotest-per-patch_3/packaging-docker-autotest_19885/timing.txt 01:10:37.227 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/packaging-docker-autotest_19885/timing.txt 01:10:37.227 ++ basename /var/jenkins/workspace/autotest-per-patch_3/packaging-docker-autotest_19885 01:10:37.227 + job_name=packaging-docker-autotest_19885 01:10:37.227 + sed 's/^/packaging-docker-autotest_19885;autorun;/' /var/jenkins/workspace/autotest-per-patch_3/packaging-docker-autotest_19885/timing.txt 01:10:37.227 + for file in "${array[@]}" 01:10:37.227 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_3/ubuntu22-vg-autotest_37836/timing.txt 01:10:37.227 + local job_file job_name 01:10:37.227 + job_file=/var/jenkins/workspace/autotest-per-patch_3/ubuntu22-vg-autotest_37836/timing.txt 01:10:37.227 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/ubuntu22-vg-autotest_37836/timing.txt 01:10:37.227 ++ basename /var/jenkins/workspace/autotest-per-patch_3/ubuntu22-vg-autotest_37836 01:10:37.227 + job_name=ubuntu22-vg-autotest_37836 01:10:37.227 + sed 's/^/ubuntu22-vg-autotest_37836;autorun;/' /var/jenkins/workspace/autotest-per-patch_3/ubuntu22-vg-autotest_37836/timing.txt 01:10:37.227 + for file in "${array[@]}" 01:10:37.227 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_3/vfio-user-phy-autotest_26231/timing.txt 01:10:37.227 + local job_file job_name 01:10:37.227 + job_file=/var/jenkins/workspace/autotest-per-patch_3/vfio-user-phy-autotest_26231/timing.txt 01:10:37.227 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/vfio-user-phy-autotest_26231/timing.txt 01:10:37.227 ++ basename /var/jenkins/workspace/autotest-per-patch_3/vfio-user-phy-autotest_26231 01:10:37.227 + job_name=vfio-user-phy-autotest_26231 01:10:37.227 + sed 's/^/vfio-user-phy-autotest_26231;autorun;/' /var/jenkins/workspace/autotest-per-patch_3/vfio-user-phy-autotest_26231/timing.txt 01:10:37.227 + for file in "${array[@]}" 01:10:37.227 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_3/nvmf-tcp-phy-autotest_72354/timing.txt 01:10:37.227 + local job_file job_name 01:10:37.227 + job_file=/var/jenkins/workspace/autotest-per-patch_3/nvmf-tcp-phy-autotest_72354/timing.txt 01:10:37.227 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/nvmf-tcp-phy-autotest_72354/timing.txt 01:10:37.227 ++ basename /var/jenkins/workspace/autotest-per-patch_3/nvmf-tcp-phy-autotest_72354 01:10:37.227 + job_name=nvmf-tcp-phy-autotest_72354 01:10:37.227 + sed 's/^/nvmf-tcp-phy-autotest_72354;autorun;/' /var/jenkins/workspace/autotest-per-patch_3/nvmf-tcp-phy-autotest_72354/timing.txt 01:10:37.227 + for file in "${array[@]}" 01:10:37.227 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_3/short-fuzz-phy-autotest_26220/timing.txt 01:10:37.227 + local job_file job_name 01:10:37.227 + job_file=/var/jenkins/workspace/autotest-per-patch_3/short-fuzz-phy-autotest_26220/timing.txt 01:10:37.227 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/short-fuzz-phy-autotest_26220/timing.txt 01:10:37.227 ++ basename /var/jenkins/workspace/autotest-per-patch_3/short-fuzz-phy-autotest_26220 01:10:37.227 + job_name=short-fuzz-phy-autotest_26220 01:10:37.227 + sed 's/^/short-fuzz-phy-autotest_26220;autorun;/' /var/jenkins/workspace/autotest-per-patch_3/short-fuzz-phy-autotest_26220/timing.txt 01:10:37.227 + for file in "${array[@]}" 01:10:37.227 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_3/BlobFS-phy-autotest_26229/timing.txt 01:10:37.227 + local job_file job_name 01:10:37.227 + job_file=/var/jenkins/workspace/autotest-per-patch_3/BlobFS-phy-autotest_26229/timing.txt 01:10:37.227 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/BlobFS-phy-autotest_26229/timing.txt 01:10:37.227 ++ basename /var/jenkins/workspace/autotest-per-patch_3/BlobFS-phy-autotest_26229 01:10:37.227 + job_name=BlobFS-phy-autotest_26229 01:10:37.227 + sed 's/^/BlobFS-phy-autotest_26229;autorun;/' /var/jenkins/workspace/autotest-per-patch_3/BlobFS-phy-autotest_26229/timing.txt 01:10:37.227 + for file in "${array[@]}" 01:10:37.227 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_3/nvme-phy-autotest_72395/timing.txt 01:10:37.227 + local job_file job_name 01:10:37.227 + job_file=/var/jenkins/workspace/autotest-per-patch_3/nvme-phy-autotest_72395/timing.txt 01:10:37.227 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/nvme-phy-autotest_72395/timing.txt 01:10:37.227 ++ basename /var/jenkins/workspace/autotest-per-patch_3/nvme-phy-autotest_72395 01:10:37.227 + job_name=nvme-phy-autotest_72395 01:10:37.227 + sed 's/^/nvme-phy-autotest_72395;autorun;/' /var/jenkins/workspace/autotest-per-patch_3/nvme-phy-autotest_72395/timing.txt 01:10:37.227 + for file in "${array[@]}" 01:10:37.227 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_3/nvmf-tcp-vg-autotest_77494/timing.txt 01:10:37.227 + local job_file job_name 01:10:37.227 + job_file=/var/jenkins/workspace/autotest-per-patch_3/nvmf-tcp-vg-autotest_77494/timing.txt 01:10:37.227 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/nvmf-tcp-vg-autotest_77494/timing.txt 01:10:37.227 ++ basename /var/jenkins/workspace/autotest-per-patch_3/nvmf-tcp-vg-autotest_77494 01:10:37.227 + job_name=nvmf-tcp-vg-autotest_77494 01:10:37.227 + sed 's/^/nvmf-tcp-vg-autotest_77494;autorun;/' /var/jenkins/workspace/autotest-per-patch_3/nvmf-tcp-vg-autotest_77494/timing.txt 01:10:37.227 + for file in "${array[@]}" 01:10:37.227 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_3/crypto-phy-autotest_26223/timing.txt 01:10:37.227 + local job_file job_name 01:10:37.227 + job_file=/var/jenkins/workspace/autotest-per-patch_3/crypto-phy-autotest_26223/timing.txt 01:10:37.227 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/crypto-phy-autotest_26223/timing.txt 01:10:37.227 ++ basename /var/jenkins/workspace/autotest-per-patch_3/crypto-phy-autotest_26223 01:10:37.227 + job_name=crypto-phy-autotest_26223 01:10:37.227 + sed 's/^/crypto-phy-autotest_26223;autorun;/' /var/jenkins/workspace/autotest-per-patch_3/crypto-phy-autotest_26223/timing.txt 01:10:37.227 + for file in "${array[@]}" 01:10:37.227 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_3/ubuntu20-vg-autotest_73822/timing.txt 01:10:37.227 + local job_file job_name 01:10:37.227 + job_file=/var/jenkins/workspace/autotest-per-patch_3/ubuntu20-vg-autotest_73822/timing.txt 01:10:37.227 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/ubuntu20-vg-autotest_73822/timing.txt 01:10:37.228 ++ basename /var/jenkins/workspace/autotest-per-patch_3/ubuntu20-vg-autotest_73822 01:10:37.228 + job_name=ubuntu20-vg-autotest_73822 01:10:37.228 + sed 's/^/ubuntu20-vg-autotest_73822;autorun;/' /var/jenkins/workspace/autotest-per-patch_3/ubuntu20-vg-autotest_73822/timing.txt 01:10:37.228 + for file in "${array[@]}" 01:10:37.228 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_3/dsa-phy-autotest_4923/timing.txt 01:10:37.228 + local job_file job_name 01:10:37.228 + job_file=/var/jenkins/workspace/autotest-per-patch_3/dsa-phy-autotest_4923/timing.txt 01:10:37.228 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/dsa-phy-autotest_4923/timing.txt 01:10:37.228 ++ basename /var/jenkins/workspace/autotest-per-patch_3/dsa-phy-autotest_4923 01:10:37.228 + job_name=dsa-phy-autotest_4923 01:10:37.228 + sed 's/^/dsa-phy-autotest_4923;autorun;/' /var/jenkins/workspace/autotest-per-patch_3/dsa-phy-autotest_4923/timing.txt 01:10:37.228 + for file in "${array[@]}" 01:10:37.228 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_3/check-format-docker-autotest_22167/timing.txt 01:10:37.228 + local job_file job_name 01:10:37.228 + job_file=/var/jenkins/workspace/autotest-per-patch_3/check-format-docker-autotest_22167/timing.txt 01:10:37.228 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/check-format-docker-autotest_22167/timing.txt 01:10:37.228 ++ basename /var/jenkins/workspace/autotest-per-patch_3/check-format-docker-autotest_22167 01:10:37.228 + job_name=check-format-docker-autotest_22167 01:10:37.228 + sed 's/^/check-format-docker-autotest_22167;autorun;/' /var/jenkins/workspace/autotest-per-patch_3/check-format-docker-autotest_22167/timing.txt 01:10:37.228 + for file in "${array[@]}" 01:10:37.228 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_3/nvmf-phy-autotest_72467/timing.txt 01:10:37.228 + local job_file job_name 01:10:37.228 + job_file=/var/jenkins/workspace/autotest-per-patch_3/nvmf-phy-autotest_72467/timing.txt 01:10:37.228 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/nvmf-phy-autotest_72467/timing.txt 01:10:37.228 ++ basename /var/jenkins/workspace/autotest-per-patch_3/nvmf-phy-autotest_72467 01:10:37.228 + job_name=nvmf-phy-autotest_72467 01:10:37.228 + sed 's/^/nvmf-phy-autotest_72467;autorun;/' /var/jenkins/workspace/autotest-per-patch_3/nvmf-phy-autotest_72467/timing.txt 01:10:37.228 + for file in "${array[@]}" 01:10:37.228 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_3/vhost-initiator-vg-autotest_77523/timing.txt 01:10:37.228 + local job_file job_name 01:10:37.228 + job_file=/var/jenkins/workspace/autotest-per-patch_3/vhost-initiator-vg-autotest_77523/timing.txt 01:10:37.228 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/vhost-initiator-vg-autotest_77523/timing.txt 01:10:37.228 ++ basename /var/jenkins/workspace/autotest-per-patch_3/vhost-initiator-vg-autotest_77523 01:10:37.228 + job_name=vhost-initiator-vg-autotest_77523 01:10:37.228 + sed 's/^/vhost-initiator-vg-autotest_77523;autorun;/' /var/jenkins/workspace/autotest-per-patch_3/vhost-initiator-vg-autotest_77523/timing.txt 01:10:37.228 + for file in "${array[@]}" 01:10:37.228 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_3/centos7-vg-autotest_73682/timing.txt 01:10:37.228 + local job_file job_name 01:10:37.228 + job_file=/var/jenkins/workspace/autotest-per-patch_3/centos7-vg-autotest_73682/timing.txt 01:10:37.228 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/centos7-vg-autotest_73682/timing.txt 01:10:37.228 ++ basename /var/jenkins/workspace/autotest-per-patch_3/centos7-vg-autotest_73682 01:10:37.228 + job_name=centos7-vg-autotest_73682 01:10:37.228 + sed 's/^/centos7-vg-autotest_73682;autorun;/' /var/jenkins/workspace/autotest-per-patch_3/centos7-vg-autotest_73682/timing.txt 01:10:37.228 + for file in "${array[@]}" 01:10:37.228 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_3/unittest-main-docker-autotest_19884/timing.txt 01:10:37.228 + local job_file job_name 01:10:37.228 + job_file=/var/jenkins/workspace/autotest-per-patch_3/unittest-main-docker-autotest_19884/timing.txt 01:10:37.228 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/unittest-main-docker-autotest_19884/timing.txt 01:10:37.228 ++ basename /var/jenkins/workspace/autotest-per-patch_3/unittest-main-docker-autotest_19884 01:10:37.228 + job_name=unittest-main-docker-autotest_19884 01:10:37.228 + sed 's/^/unittest-main-docker-autotest_19884;autorun;/' /var/jenkins/workspace/autotest-per-patch_3/unittest-main-docker-autotest_19884/timing.txt 01:10:37.228 + for file in "${array[@]}" 01:10:37.228 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_3/zns-vg-autotest_76609/timing.txt 01:10:37.228 + local job_file job_name 01:10:37.228 + job_file=/var/jenkins/workspace/autotest-per-patch_3/zns-vg-autotest_76609/timing.txt 01:10:37.228 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/zns-vg-autotest_76609/timing.txt 01:10:37.228 ++ basename /var/jenkins/workspace/autotest-per-patch_3/zns-vg-autotest_76609 01:10:37.228 + job_name=zns-vg-autotest_76609 01:10:37.228 + sed 's/^/zns-vg-autotest_76609;autorun;/' /var/jenkins/workspace/autotest-per-patch_3/zns-vg-autotest_76609/timing.txt 01:10:37.228 + for file in "${array[@]}" 01:10:37.228 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_3/nvme-cmb-pmr-vg-autotest_78626/timing.txt 01:10:37.228 + local job_file job_name 01:10:37.228 + job_file=/var/jenkins/workspace/autotest-per-patch_3/nvme-cmb-pmr-vg-autotest_78626/timing.txt 01:10:37.228 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/nvme-cmb-pmr-vg-autotest_78626/timing.txt 01:10:37.228 ++ basename /var/jenkins/workspace/autotest-per-patch_3/nvme-cmb-pmr-vg-autotest_78626 01:10:37.228 + job_name=nvme-cmb-pmr-vg-autotest_78626 01:10:37.228 + sed 's/^/nvme-cmb-pmr-vg-autotest_78626;autorun;/' /var/jenkins/workspace/autotest-per-patch_3/nvme-cmb-pmr-vg-autotest_78626/timing.txt 01:10:37.228 + for file in "${array[@]}" 01:10:37.228 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_3/rocky9-vg-autotest_16113/timing.txt 01:10:37.228 + local job_file job_name 01:10:37.228 + job_file=/var/jenkins/workspace/autotest-per-patch_3/rocky9-vg-autotest_16113/timing.txt 01:10:37.228 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/rocky9-vg-autotest_16113/timing.txt 01:10:37.228 ++ basename /var/jenkins/workspace/autotest-per-patch_3/rocky9-vg-autotest_16113 01:10:37.228 + job_name=rocky9-vg-autotest_16113 01:10:37.228 + sed 's/^/rocky9-vg-autotest_16113;autorun;/' /var/jenkins/workspace/autotest-per-patch_3/rocky9-vg-autotest_16113/timing.txt 01:10:37.228 + for file in "${array[@]}" 01:10:37.228 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_3/iscsi-vg-autotest_77541/timing.txt 01:10:37.228 + local job_file job_name 01:10:37.228 + job_file=/var/jenkins/workspace/autotest-per-patch_3/iscsi-vg-autotest_77541/timing.txt 01:10:37.228 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/iscsi-vg-autotest_77541/timing.txt 01:10:37.228 ++ basename /var/jenkins/workspace/autotest-per-patch_3/iscsi-vg-autotest_77541 01:10:37.228 + job_name=iscsi-vg-autotest_77541 01:10:37.228 + sed 's/^/iscsi-vg-autotest_77541;autorun;/' /var/jenkins/workspace/autotest-per-patch_3/iscsi-vg-autotest_77541/timing.txt 01:10:37.228 + for file in "${array[@]}" 01:10:37.228 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_3/doc-docker-autotest_22347/timing.txt 01:10:37.228 + local job_file job_name 01:10:37.228 + job_file=/var/jenkins/workspace/autotest-per-patch_3/doc-docker-autotest_22347/timing.txt 01:10:37.228 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/doc-docker-autotest_22347/timing.txt 01:10:37.228 ++ basename /var/jenkins/workspace/autotest-per-patch_3/doc-docker-autotest_22347 01:10:37.228 + job_name=doc-docker-autotest_22347 01:10:37.228 + sed 's/^/doc-docker-autotest_22347;autorun;/' /var/jenkins/workspace/autotest-per-patch_3/doc-docker-autotest_22347/timing.txt 01:10:37.228 + for file in "${array[@]}" 01:10:37.228 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_3/nvme-vg-autotest_77503/timing.txt 01:10:37.228 + local job_file job_name 01:10:37.228 + job_file=/var/jenkins/workspace/autotest-per-patch_3/nvme-vg-autotest_77503/timing.txt 01:10:37.228 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/nvme-vg-autotest_77503/timing.txt 01:10:37.228 ++ basename /var/jenkins/workspace/autotest-per-patch_3/nvme-vg-autotest_77503 01:10:37.228 + job_name=nvme-vg-autotest_77503 01:10:37.228 + sed 's/^/nvme-vg-autotest_77503;autorun;/' /var/jenkins/workspace/autotest-per-patch_3/nvme-vg-autotest_77503/timing.txt 01:10:37.228 + for file in "${array[@]}" 01:10:37.228 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_3/unittest-valgrind-docker-autotest_19887/timing.txt 01:10:37.228 + local job_file job_name 01:10:37.228 + job_file=/var/jenkins/workspace/autotest-per-patch_3/unittest-valgrind-docker-autotest_19887/timing.txt 01:10:37.228 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/unittest-valgrind-docker-autotest_19887/timing.txt 01:10:37.228 ++ basename /var/jenkins/workspace/autotest-per-patch_3/unittest-valgrind-docker-autotest_19887 01:10:37.228 + job_name=unittest-valgrind-docker-autotest_19887 01:10:37.228 + sed 's/^/unittest-valgrind-docker-autotest_19887;autorun;/' /var/jenkins/workspace/autotest-per-patch_3/unittest-valgrind-docker-autotest_19887/timing.txt 01:10:37.228 + for file in "${array[@]}" 01:10:37.228 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_3/freebsd-vg-autotest_59146/timing.txt 01:10:37.228 + local job_file job_name 01:10:37.228 + job_file=/var/jenkins/workspace/autotest-per-patch_3/freebsd-vg-autotest_59146/timing.txt 01:10:37.228 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/freebsd-vg-autotest_59146/timing.txt 01:10:37.228 ++ basename /var/jenkins/workspace/autotest-per-patch_3/freebsd-vg-autotest_59146 01:10:37.228 + job_name=freebsd-vg-autotest_59146 01:10:37.228 + sed 's/^/freebsd-vg-autotest_59146;autorun;/' /var/jenkins/workspace/autotest-per-patch_3/freebsd-vg-autotest_59146/timing.txt 01:10:37.228 + for file in "${array[@]}" 01:10:37.228 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_3/check-so-deps-docker-autotest_22180/timing.txt 01:10:37.228 + local job_file job_name 01:10:37.228 + job_file=/var/jenkins/workspace/autotest-per-patch_3/check-so-deps-docker-autotest_22180/timing.txt 01:10:37.228 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/check-so-deps-docker-autotest_22180/timing.txt 01:10:37.228 ++ basename /var/jenkins/workspace/autotest-per-patch_3/check-so-deps-docker-autotest_22180 01:10:37.228 + job_name=check-so-deps-docker-autotest_22180 01:10:37.228 + sed 's/^/check-so-deps-docker-autotest_22180;autorun;/' /var/jenkins/workspace/autotest-per-patch_3/check-so-deps-docker-autotest_22180/timing.txt 01:10:37.228 + for file in "${array[@]}" 01:10:37.228 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_3/iscsi-uring-vg-autotest_77408/timing.txt 01:10:37.228 + local job_file job_name 01:10:37.228 + job_file=/var/jenkins/workspace/autotest-per-patch_3/iscsi-uring-vg-autotest_77408/timing.txt 01:10:37.228 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/iscsi-uring-vg-autotest_77408/timing.txt 01:10:37.228 ++ basename /var/jenkins/workspace/autotest-per-patch_3/iscsi-uring-vg-autotest_77408 01:10:37.228 + job_name=iscsi-uring-vg-autotest_77408 01:10:37.228 + sed 's/^/iscsi-uring-vg-autotest_77408;autorun;/' /var/jenkins/workspace/autotest-per-patch_3/iscsi-uring-vg-autotest_77408/timing.txt 01:10:37.228 + for file in "${array[@]}" 01:10:37.228 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_3/unittest-clang-docker-autotest_19883/timing.txt 01:10:37.228 + local job_file job_name 01:10:37.228 + job_file=/var/jenkins/workspace/autotest-per-patch_3/unittest-clang-docker-autotest_19883/timing.txt 01:10:37.228 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/unittest-clang-docker-autotest_19883/timing.txt 01:10:37.228 ++ basename /var/jenkins/workspace/autotest-per-patch_3/unittest-clang-docker-autotest_19883 01:10:37.228 + job_name=unittest-clang-docker-autotest_19883 01:10:37.228 + sed 's/^/unittest-clang-docker-autotest_19883;autorun;/' /var/jenkins/workspace/autotest-per-patch_3/unittest-clang-docker-autotest_19883/timing.txt 01:10:37.228 + for file in "${array[@]}" 01:10:37.228 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_3/nvmf-tcp-uring-vg-autotest_77428/timing.txt 01:10:37.228 + local job_file job_name 01:10:37.228 + job_file=/var/jenkins/workspace/autotest-per-patch_3/nvmf-tcp-uring-vg-autotest_77428/timing.txt 01:10:37.229 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/nvmf-tcp-uring-vg-autotest_77428/timing.txt 01:10:37.229 ++ basename /var/jenkins/workspace/autotest-per-patch_3/nvmf-tcp-uring-vg-autotest_77428 01:10:37.229 + job_name=nvmf-tcp-uring-vg-autotest_77428 01:10:37.229 + sed 's/^/nvmf-tcp-uring-vg-autotest_77428;autorun;/' /var/jenkins/workspace/autotest-per-patch_3/nvmf-tcp-uring-vg-autotest_77428/timing.txt 01:10:37.229 + for file in "${array[@]}" 01:10:37.229 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_3/scan-build-docker-autotest_19886/timing.txt 01:10:37.229 + local job_file job_name 01:10:37.229 + job_file=/var/jenkins/workspace/autotest-per-patch_3/scan-build-docker-autotest_19886/timing.txt 01:10:37.229 +++ dirname /var/jenkins/workspace/autotest-per-patch_3/scan-build-docker-autotest_19886/timing.txt 01:10:37.229 ++ basename /var/jenkins/workspace/autotest-per-patch_3/scan-build-docker-autotest_19886 01:10:37.229 + job_name=scan-build-docker-autotest_19886 01:10:37.229 + sed 's/^/scan-build-docker-autotest_19886;autorun;/' /var/jenkins/workspace/autotest-per-patch_3/scan-build-docker-autotest_19886/timing.txt 01:10:37.229 + /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/autotest-per-patch_3/post_process/total_timing.txt 01:10:37.229 + run_autorun_post 01:10:37.229 + s_opt= 01:10:37.229 + [[ '' == true ]] 01:10:37.229 + spdk/autorun_post.py -d ./ -r ./spdk 01:10:49.417 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_3/spdk/module/blobfs/bdev/blobfs_bdev.c:254 01:11:04.275 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_3/spdk/lib/util/crc32c.c:21 01:11:04.275 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_3/spdk/lib/util/crc64.c:165 01:11:04.275 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_3/spdk/lib/util/crc16.c:628 01:11:04.275 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_3/spdk/lib/util/crc16.c:634 01:11:04.275 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_3/spdk/lib/util/xor.c:120 01:11:42.952 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_3/spdk/mmio.h! 01:11:42.952 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_3/spdk/nvmf_transport.h! 01:11:42.952 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_3/spdk/util.h! 01:11:42.952 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_3/spdk/endian.h! 01:11:42.952 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_3/spdk/histogram_data.h! 01:11:42.952 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_3/spdk/thread.h! 01:11:42.952 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_3/spdk/trace.h! 01:11:42.952 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_3/spdk/nvme.h! 01:11:42.952 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_3/spdk/base64.h! 01:11:42.952 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_3/spdk/nvme_spec.h! 01:11:42.952 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_3/spdk/bdev_module.h! 01:11:42.953 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_3/spdk/histogram_data.h/histogram_ut.c! 01:11:42.953 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_3/spdk/lib/env_ocf/include/ocf/ocf_core.h! 01:11:42.953 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_3/spdk/lib/env_ocf/include/ocf/ocf_mngt.h! 01:11:42.953 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_3/spdk/lib/env_ocf/include/ocf/ocf_io.h! 01:11:57.932 -----Begin Post Process Script------ 01:11:57.932 /var/jenkins/workspace/autotest-per-patch_3/vhost-phy-autotest_26248/cov_total.info 01:11:57.932 /var/jenkins/workspace/autotest-per-patch_3/lvol-vg-autotest_77452/cov_total.info 01:11:57.932 /var/jenkins/workspace/autotest-per-patch_3/ubuntu22-vg-autotest_37836/cov_total.info 01:11:57.932 /var/jenkins/workspace/autotest-per-patch_3/vfio-user-phy-autotest_26231/cov_total.info 01:11:57.932 /var/jenkins/workspace/autotest-per-patch_3/BlobFS-phy-autotest_26229/cov_total.info 01:11:57.932 /var/jenkins/workspace/autotest-per-patch_3/nvme-phy-autotest_72395/cov_total.info 01:11:57.932 /var/jenkins/workspace/autotest-per-patch_3/crypto-phy-autotest_26223/cov_total.info 01:11:57.932 /var/jenkins/workspace/autotest-per-patch_3/ubuntu20-vg-autotest_73822/cov_total.info 01:11:57.932 /var/jenkins/workspace/autotest-per-patch_3/vhost-initiator-vg-autotest_77523/cov_total.info 01:11:57.932 /var/jenkins/workspace/autotest-per-patch_3/centos7-vg-autotest_73682/cov_total.info 01:11:57.932 /var/jenkins/workspace/autotest-per-patch_3/zns-vg-autotest_76609/cov_total.info 01:11:57.932 /var/jenkins/workspace/autotest-per-patch_3/nvme-cmb-pmr-vg-autotest_78626/cov_total.info 01:11:57.932 /var/jenkins/workspace/autotest-per-patch_3/rocky9-vg-autotest_16113/cov_total.info 01:11:57.932 /var/jenkins/workspace/autotest-per-patch_3/iscsi-vg-autotest_77541/cov_total.info 01:11:57.932 /var/jenkins/workspace/autotest-per-patch_3/nvme-vg-autotest_77503/cov_total.info 01:11:57.932 /var/jenkins/workspace/autotest-per-patch_3/iscsi-uring-vg-autotest_77408/cov_total.info 01:11:57.932 01:11:57.932 01:11:57.932 -----Tests Executed in Build------ 01:11:57.932 accel 01:11:57.932 accel_assign_opcode 01:11:57.932 accel_cdev_comp 01:11:57.932 accel_cdev_decmop_full 01:11:57.932 accel_cdev_decomp 01:11:57.932 accel_cdev_decomp_full_mcore 01:11:57.932 accel_cdev_decomp_full_mthread 01:11:57.932 accel_cdev_decomp_mcore 01:11:57.932 accel_cdev_decomp_mthread 01:11:57.932 accel_comp 01:11:57.932 accel_compare 01:11:57.932 accel_compress_verify 01:11:57.932 accel_copy 01:11:57.932 accel_copy_crc32c 01:11:57.932 accel_copy_crc32c_C2 01:11:57.932 accel_crc32c 01:11:57.932 accel_crc32c_C2 01:11:57.932 accel_decmop_full 01:11:57.932 accel_decomp 01:11:57.932 accel_decomp_full_mcore 01:11:57.932 accel_decomp_full_mthread 01:11:57.932 accel_decomp_mcore 01:11:57.932 accel_decomp_mthread 01:11:57.932 accel_dif_functional_tests 01:11:57.932 accel_dif_generate 01:11:57.932 accel_dif_generate_copy 01:11:57.932 accel_dif_verify 01:11:57.932 accel_dualcast 01:11:57.932 accel_fill 01:11:57.932 accel_help 01:11:57.932 accel_missing_filename 01:11:57.932 accel_negative_buffers 01:11:57.932 accel_rpc 01:11:57.932 accel_scan_dsa_modules 01:11:57.932 accel_scan_iaa_modules 01:11:57.932 accel_wrong_workload 01:11:57.932 accel_xor 01:11:57.932 acl 01:11:57.932 alias_rpc 01:11:57.932 allowed 01:11:57.932 app_cmdline 01:11:57.932 app_repeat 01:11:57.932 asan 01:11:57.932 autobuild 01:11:57.932 autobuild_build_doc 01:11:57.932 autobuild_check_dpdk_pci_api 01:11:57.932 autobuild_check_format 01:11:57.932 autobuild_check_so_deps 01:11:57.932 autobuild_external_code 01:11:57.932 autobuild_generated_files_check 01:11:57.932 autobuild_generated_files_check_post_clean 01:11:57.932 autobuild_header_dependency_check 01:11:57.932 autobuild_llvm_precompile 01:11:57.932 autobuild_make_install 01:11:57.932 autobuild_make_uninstall 01:11:57.932 autobuild_ocf_precompile 01:11:57.932 bdev_bounds 01:11:57.932 bdev_crypto_enomem 01:11:57.932 bdev_error 01:11:57.932 bdev_fio 01:11:57.932 bdev_fio_rw_verify 01:11:57.932 bdev_fio_trim 01:11:57.932 bdev_gpt_uuid 01:11:57.932 bdev_hello_world 01:11:57.932 bdev_json_nonarray 01:11:57.932 bdev_json_nonenclosed 01:11:57.932 bdev_nbd 01:11:57.932 bdev_nvme_reset_stuck_adm_cmd 01:11:57.932 bdev_qd_sampling 01:11:57.932 bdev_qos 01:11:57.932 bdev_qos_bw 01:11:57.932 bdev_qos_iops 01:11:57.932 bdev_qos_ro_bw 01:11:57.932 bdev_raid 01:11:57.932 bdev_stat 01:11:57.932 bdev_verify 01:11:57.932 bdev_verify_big_io 01:11:57.932 bdev_write_zeroes 01:11:57.932 bdevperf_config 01:11:57.932 blob_io_wait 01:11:57.932 blobfs 01:11:57.932 blobfs_mkfs 01:11:57.932 blobstore 01:11:57.932 blobstore_grow 01:11:57.932 blockdev_crypto_aesni 01:11:57.932 blockdev_crypto_qat 01:11:57.932 blockdev_crypto_sw 01:11:57.932 blockdev_general 01:11:57.932 blockdev_nvme 01:11:57.932 blockdev_nvme_gpt 01:11:57.932 blockdev_raid5f 01:11:57.932 blockdev_rbd 01:11:57.932 blockdev_xnvme 01:11:57.932 build_rpm_from_gen_spec 01:11:57.932 build_shared_rpm 01:11:57.932 chaining 01:11:57.932 check_header_filenames 01:11:57.932 cmb_copy 01:11:57.932 compress_compdev 01:11:57.932 compress_isal 01:11:57.932 confirm_abi_deps 01:11:57.932 confirm_makefile_deps 01:11:57.932 cpu_locks 01:11:57.932 custom_alloc 01:11:57.932 dd_bs_lt_native_bs 01:11:57.932 dd_copy_to_out_bdev 01:11:57.932 dd_double_input 01:11:57.932 dd_double_output 01:11:57.932 dd_flag_append 01:11:57.932 dd_flag_append_forced_aio 01:11:57.932 dd_flag_directory 01:11:57.932 dd_flag_directory_forced_aio 01:11:57.932 dd_flag_noatime 01:11:57.932 dd_flag_noatime_forced_aio 01:11:57.932 dd_flag_nofollow 01:11:57.932 dd_flag_nofollow_forced_aio 01:11:57.932 dd_flags_misc 01:11:57.933 dd_flags_misc_forced_aio 01:11:57.933 dd_inflate_file 01:11:57.933 dd_invalid_arguments 01:11:57.933 dd_invalid_count 01:11:57.933 dd_invalid_iflag 01:11:57.933 dd_invalid_json 01:11:57.933 dd_invalid_oflag 01:11:57.933 dd_malloc_copy 01:11:57.933 dd_no_input 01:11:57.933 dd_no_output 01:11:57.933 dd_offset_magic 01:11:57.933 dd_rw 01:11:57.933 dd_rw_offset 01:11:57.933 dd_smaller_blocksize 01:11:57.933 dd_sparse_bdev_to_file 01:11:57.933 dd_sparse_file_to_bdev 01:11:57.933 dd_sparse_file_to_file 01:11:57.933 dd_unknown_flag 01:11:57.933 dd_uring_copy 01:11:57.933 dd_wrong_blocksize 01:11:57.933 default_locks 01:11:57.933 default_locks_via_rpc 01:11:57.933 default_setup 01:11:57.933 denied 01:11:57.933 devices 01:11:57.933 dm_mount 01:11:57.933 dma 01:11:57.933 dpdk_governor 01:11:57.933 dpdk_mem_utility 01:11:57.933 driver 01:11:57.933 env 01:11:57.933 env_dpdk_post_init 01:11:57.933 env_mem_callbacks 01:11:57.933 env_memory 01:11:57.933 env_pci 01:11:57.933 env_vtophys 01:11:57.933 even_2G_alloc 01:11:57.933 event 01:11:57.933 event_perf 01:11:57.933 event_reactor 01:11:57.933 event_reactor_perf 01:11:57.933 event_scheduler 01:11:57.933 exit_on_failed_rpc_init 01:11:57.933 external_make_accel_driver_shared 01:11:57.933 external_make_accel_driver_static 01:11:57.933 external_make_accel_module_shared 01:11:57.933 external_make_accel_module_static 01:11:57.933 external_make_hello_bdev_shared_combo 01:11:57.933 external_make_hello_bdev_shared_iso 01:11:57.933 external_make_hello_bdev_static 01:11:57.933 external_make_hello_no_bdev_shared_combo 01:11:57.933 external_make_hello_no_bdev_shared_iso 01:11:57.933 external_make_hello_no_bdev_static 01:11:57.933 external_make_nvme_shared 01:11:57.933 external_make_nvme_static 01:11:57.933 external_run_accel_driver_shared 01:11:57.933 external_run_accel_driver_static 01:11:57.933 external_run_accel_module_shared 01:11:57.933 external_run_accel_module_static 01:11:57.933 external_run_hello_bdev_shared_combo 01:11:57.933 external_run_hello_bdev_shared_iso 01:11:57.933 external_run_hello_bdev_static 01:11:57.933 external_run_hello_no_bdev_shared_combo 01:11:57.933 external_run_hello_no_bdev_shared_iso 01:11:57.933 external_run_hello_no_bdev_static 01:11:57.933 external_run_nvme_shared 01:11:57.933 external_run_nvme_static 01:11:57.933 filesystem_btrfs 01:11:57.933 filesystem_ext4 01:11:57.933 filesystem_in_capsule_btrfs 01:11:57.933 filesystem_in_capsule_ext4 01:11:57.933 filesystem_in_capsule_xfs 01:11:57.933 filesystem_xfs 01:11:57.933 ftl 01:11:57.933 ftl_bdevperf 01:11:57.933 ftl_dirty_shutdown 01:11:57.933 ftl_fio_basic 01:11:57.933 ftl_restore 01:11:57.933 ftl_trim 01:11:57.933 ftl_upgrade_shutdown 01:11:57.933 go_rpc 01:11:57.933 guess_driver 01:11:57.933 hello_blob 01:11:57.933 hugepages 01:11:57.933 idle 01:11:57.933 interrupt_mode 01:11:57.933 ioat 01:11:57.933 ioat_perf 01:11:57.933 ioat_verify 01:11:57.933 is_zoned 01:11:57.933 iscsi_tgt 01:11:57.933 iscsi_tgt_bdev_io_wait 01:11:57.933 iscsi_tgt_calsoft 01:11:57.933 iscsi_tgt_digest 01:11:57.933 iscsi_tgt_digests 01:11:57.933 iscsi_tgt_filesystem 01:11:57.933 iscsi_tgt_filesystem_btrfs 01:11:57.933 iscsi_tgt_filesystem_ext4 01:11:57.933 iscsi_tgt_filesystem_xfs 01:11:57.933 iscsi_tgt_fio 01:11:57.933 iscsi_tgt_fuzz 01:11:57.933 iscsi_tgt_initiator 01:11:57.933 iscsi_tgt_ip_migration 01:11:57.933 iscsi_tgt_iscsi_lvol 01:11:57.933 iscsi_tgt_login_redirection 01:11:57.933 iscsi_tgt_multiconnection 01:11:57.933 iscsi_tgt_qos 01:11:57.933 iscsi_tgt_rbd 01:11:57.933 iscsi_tgt_reset 01:11:57.933 iscsi_tgt_resize 01:11:57.933 iscsi_tgt_rpc_config 01:11:57.933 iscsi_tgt_sock 01:11:57.933 iscsi_tgt_trace_record 01:11:57.933 json_config 01:11:57.933 json_config_extra_key 01:11:57.933 llvm_fuzz 01:11:57.933 locking_app_on_locked_coremask 01:11:57.933 locking_app_on_unlocked_coremask 01:11:57.933 locking_overlapped_coremask 01:11:57.933 locking_overlapped_coremask_via_rpc 01:11:57.933 lvol 01:11:57.933 lvol_basic 01:11:57.933 lvol_esnap 01:11:57.933 lvol_external_copy 01:11:57.933 lvol_external_snapshot 01:11:57.933 lvol_hotremove 01:11:57.933 lvol_provisioning 01:11:57.933 lvol_rename 01:11:57.933 lvol_resize 01:11:57.933 lvol_snapshot_clone 01:11:57.933 lvol_tasting 01:11:57.933 lvs_grow_clean 01:11:57.933 lvs_grow_dirty 01:11:57.933 make 01:11:57.933 no_shrink_alloc 01:11:57.933 non_locking_app_on_locked_coremask 01:11:57.933 nvme 01:11:57.933 nvme_arbitration 01:11:57.933 nvme_cli_cuse 01:11:57.933 nvme_cli_plugin 01:11:57.933 nvme_cmb 01:11:57.933 nvme_cuse 01:11:57.933 nvme_cuse_app 01:11:57.933 nvme_cuse_rpc 01:11:57.933 nvme_doorbell_aers 01:11:57.933 nvme_e2edp 01:11:57.933 nvme_err_injection 01:11:57.933 nvme_fdp 01:11:57.933 nvme_fio 01:11:57.933 nvme_flexible_data_placement 01:11:57.933 nvme_hello_world 01:11:57.933 nvme_identify 01:11:57.933 nvme_mount 01:11:57.933 nvme_multi_aen 01:11:57.933 nvme_multi_secondary 01:11:57.933 nvme_ns_manage_cuse 01:11:57.933 nvme_overhead 01:11:57.933 nvme_perf 01:11:57.933 nvme_pmr 01:11:57.933 nvme_pmr_persistence 01:11:57.933 nvme_reserve 01:11:57.933 nvme_reset 01:11:57.933 nvme_rpc 01:11:57.933 nvme_rpc_timeouts 01:11:57.933 nvme_scc 01:11:57.933 nvme_sgl 01:11:57.933 nvme_simple_copy 01:11:57.933 nvme_single_aen 01:11:57.933 nvme_smartctl_cuse 01:11:57.933 nvme_startup 01:11:57.933 nvme_xnvme 01:11:57.933 nvme_zns 01:11:57.933 nvmf_abort 01:11:57.933 nvmf_aer 01:11:57.933 nvmf_async_init 01:11:57.933 nvmf_bdev_io_wait 01:11:57.933 nvmf_bdevio 01:11:57.933 nvmf_bdevio_no_huge 01:11:57.933 nvmf_connect_disconnect 01:11:57.933 nvmf_connect_stress 01:11:57.933 nvmf_delete_subsystem 01:11:57.933 nvmf_device_removal_pci_remove_no_srq 01:11:57.933 nvmf_example 01:11:57.933 nvmf_failover 01:11:57.933 nvmf_filesystem 01:11:57.933 nvmf_filesystem_in_capsule 01:11:57.933 nvmf_filesystem_no_in_capsule 01:11:57.933 nvmf_fio_host 01:11:57.933 nvmf_fio_target 01:11:57.933 nvmf_fips 01:11:57.933 nvmf_fused_ordering 01:11:57.933 nvmf_fuzz 01:11:57.933 nvmf_host_management 01:11:57.933 nvmf_identify 01:11:57.933 nvmf_invalid 01:11:57.933 nvmf_lvol 01:11:57.933 nvmf_lvs_grow 01:11:57.933 nvmf_multicontroller 01:11:57.933 nvmf_multitarget 01:11:57.933 nvmf_nmic 01:11:57.933 nvmf_ns_hotplug_stress 01:11:57.933 nvmf_ns_masking 01:11:57.933 nvmf_nvme_cli 01:11:57.933 nvmf_perf 01:11:57.933 nvmf_perf_adq 01:11:57.933 nvmf_queue_depth 01:11:57.933 nvmf_referrals 01:11:57.933 nvmf_rpc 01:11:57.933 nvmf_shutdown 01:11:57.933 nvmf_shutdown_tc1 01:11:57.933 nvmf_shutdown_tc2 01:11:57.933 nvmf_shutdown_tc3 01:11:57.933 nvmf_target_discovery 01:11:57.933 nvmf_target_multipath 01:11:57.933 nvmf_tls 01:11:57.933 nvmf_vfio_user 01:11:57.933 nvmf_vfio_user_fuzz 01:11:57.933 nvmf_vfio_user_nvme_compliance 01:11:57.933 nvmf_vhost 01:11:57.933 nvmf_zcopy 01:11:57.933 ocf 01:11:57.933 ocf_bdevperf_iotypes 01:11:57.933 ocf_configuration_change 01:11:57.933 ocf_create_destruct 01:11:57.933 ocf_fio_modes 01:11:57.933 ocf_flush 01:11:57.933 ocf_multicore 01:11:57.933 ocf_remove 01:11:57.933 ocf_stats 01:11:57.933 odd_alloc 01:11:57.933 packaging 01:11:57.933 per_node_1G_alloc 01:11:57.933 raid0_resize_test 01:11:57.933 raid5f_rebuild_test 01:11:57.933 raid5f_rebuild_test_sb 01:11:57.933 raid5f_state_function_test 01:11:57.933 raid5f_state_function_test_sb 01:11:57.933 raid5f_superblock_test 01:11:57.933 raid_function_test_concat 01:11:57.933 raid_function_test_raid0 01:11:57.933 raid_rebuild_test 01:11:57.933 raid_rebuild_test_io 01:11:57.933 raid_rebuild_test_sb 01:11:57.933 raid_rebuild_test_sb_4k 01:11:57.933 raid_rebuild_test_sb_io 01:11:57.933 raid_rebuild_test_sb_md_interleaved 01:11:57.933 raid_rebuild_test_sb_md_separate 01:11:57.933 raid_state_function_test 01:11:57.933 raid_state_function_test_sb 01:11:57.933 raid_state_function_test_sb_4k 01:11:57.933 raid_state_function_test_sb_md_interleaved 01:11:57.933 raid_state_function_test_sb_md_separate 01:11:57.933 raid_superblock_test 01:11:57.933 raid_superblock_test_4k 01:11:57.933 raid_superblock_test_md_interleaved 01:11:57.933 raid_superblock_test_md_separate 01:11:57.933 reactor_set_interrupt 01:11:57.933 reap_unregistered_poller 01:11:57.933 rocksdb 01:11:57.933 rocksdb_insert 01:11:57.933 rocksdb_overwrite 01:11:57.933 rocksdb_randread 01:11:57.933 rocksdb_readwrite 01:11:57.933 rocksdb_writesync 01:11:57.933 rpc 01:11:57.933 rpc_client 01:11:57.933 rpc_daemon_integrity 01:11:57.933 rpc_integrity 01:11:57.933 rpc_plugins 01:11:57.933 rpc_trace_cmd_test 01:11:57.933 rpm_packaging 01:11:57.933 scanbuild_make 01:11:57.933 scheduler 01:11:57.933 scheduler_create_thread 01:11:57.933 setup.sh 01:11:57.933 skip_rpc 01:11:57.933 skip_rpc_with_delay 01:11:57.933 skip_rpc_with_json 01:11:57.933 sma 01:11:57.933 sma_crypto 01:11:57.933 sma_discovery 01:11:57.933 sma_nvmf_tcp 01:11:57.933 sma_plugins 01:11:57.933 sma_qos 01:11:57.933 sma_vfiouser_qemu 01:11:57.933 sma_vhost 01:11:57.933 spdk_dd 01:11:57.933 spdk_dd_basic_rw 01:11:57.933 spdk_dd_bdev_to_bdev 01:11:57.933 spdk_dd_malloc 01:11:57.933 spdk_dd_negative 01:11:57.933 spdk_dd_posix 01:11:57.933 spdk_dd_sparse 01:11:57.933 spdk_dd_uring 01:11:57.933 spdkcli_iscsi 01:11:57.933 spdkcli_raid 01:11:57.933 spdkcli_rbd 01:11:57.933 spdkcli_tcp 01:11:57.933 spdkcli_vhost 01:11:57.933 spdkcli_virtio 01:11:57.933 sw_hotplug 01:11:57.933 test_bdev_lvol_delete_lvstore_with_clones 01:11:57.933 test_bdev_lvol_delete_ordering 01:11:57.933 test_clone_decouple_parent 01:11:57.933 test_clone_inflate 01:11:57.933 test_clone_snapshot_relations 01:11:57.933 test_construct_lvol 01:11:57.933 test_construct_lvol_alias_conflict 01:11:57.933 test_construct_lvol_fio_clear_method_none 01:11:57.934 test_construct_lvol_fio_clear_method_unmap 01:11:57.934 test_construct_lvol_full_lvs 01:11:57.934 test_construct_lvol_inexistent_lvs 01:11:57.934 test_construct_lvols_conflict_alias 01:11:57.934 test_construct_lvs 01:11:57.934 test_construct_lvs_clear_methods 01:11:57.934 test_construct_lvs_conflict_alias 01:11:57.934 test_construct_lvs_different_cluster_size 01:11:57.934 test_construct_lvs_nonexistent_bdev 01:11:57.934 test_construct_multi_lvols 01:11:57.934 test_construct_nested_lvol 01:11:57.934 test_construct_two_lvs_on_the_same_bdev 01:11:57.934 test_create_multi_ublk 01:11:57.934 test_create_snapshot_of_snapshot 01:11:57.934 test_create_snapshot_with_io 01:11:57.934 test_create_ublk 01:11:57.934 test_delete_lvol_store_persistent_positive 01:11:57.934 test_delete_snapshot_with_clone 01:11:57.934 test_delete_snapshot_with_snapshot 01:11:57.934 test_destroy_after_bdev_lvol_resize_positive 01:11:57.934 test_esnap_clones 01:11:57.934 test_esnap_late_arrival 01:11:57.934 test_esnap_reload 01:11:57.934 test_esnap_remove_degraded 01:11:57.934 test_hotremove_lvol_store 01:11:57.934 test_hotremove_lvol_store_base 01:11:57.934 test_hotremove_lvol_store_base_with_lvols 01:11:57.934 test_hotremove_lvol_store_multiple_lvols 01:11:57.934 test_lvol_bdev_readonly 01:11:57.934 test_lvol_list 01:11:57.934 test_lvol_rename_negative 01:11:57.934 test_rename_lvs_negative 01:11:57.934 test_rename_positive 01:11:57.934 test_resize_lvol 01:11:57.934 test_resize_lvol_negative 01:11:57.934 test_resize_lvol_with_io_traffic 01:11:57.934 test_save_ublk_config 01:11:57.934 test_shallow_copy_compare 01:11:57.934 test_sigterm 01:11:57.934 test_snapshot_compare_with_lvol_bdev 01:11:57.934 test_tasting 01:11:57.934 test_thin_lvol_check_integrity 01:11:57.934 test_thin_lvol_check_space 01:11:57.934 test_thin_lvol_check_zeroes 01:11:57.934 test_thin_lvol_resize 01:11:57.934 test_thin_overprovisioning 01:11:57.934 test_unregister_lvol_bdev 01:11:57.934 thread 01:11:57.934 thread_poller_perf 01:11:57.934 thread_spdk_lock 01:11:57.934 ublk 01:11:57.934 ublk_recovery 01:11:57.934 ubsan 01:11:57.934 unittest 01:11:57.934 unittest_accel 01:11:57.934 unittest_bdev 01:11:57.934 unittest_bdev_compress 01:11:57.934 unittest_bdev_crypto 01:11:57.934 unittest_bdev_raid5f 01:11:57.934 unittest_blob_blobfs 01:11:57.934 unittest_build 01:11:57.934 unittest_dma 01:11:57.934 unittest_dpdk_compressdev 01:11:57.934 unittest_event 01:11:57.934 unittest_ftl 01:11:57.934 unittest_idxd_user 01:11:57.934 unittest_include 01:11:57.934 unittest_init 01:11:57.934 unittest_ioat 01:11:57.934 unittest_iobuf 01:11:57.934 unittest_iscsi 01:11:57.934 unittest_json 01:11:57.934 unittest_keyring 01:11:57.934 unittest_lib_reduce 01:11:57.934 unittest_log 01:11:57.934 unittest_lvol 01:11:57.934 unittest_notify 01:11:57.934 unittest_nvme 01:11:57.934 unittest_nvme_cuse 01:11:57.934 unittest_nvme_rdma 01:11:57.934 unittest_nvmf 01:11:57.934 unittest_nvmf_rdma 01:11:57.934 unittest_nvmf_transport 01:11:57.934 unittest_nvmf_vfio_user 01:11:57.934 unittest_pci_event 01:11:57.934 unittest_rdma 01:11:57.934 unittest_rpc 01:11:57.934 unittest_scsi 01:11:57.934 unittest_sock 01:11:57.934 unittest_thread 01:11:57.934 unittest_util 01:11:57.934 unittest_vhost 01:11:57.934 valgrind 01:11:57.934 version 01:11:57.934 vfio_fuzz 01:11:57.934 vfio_user_nvme_fio 01:11:57.934 vfio_user_nvme_restart_vm 01:11:57.934 vfio_user_qemu 01:11:57.934 vfio_user_virtio_bdevperf 01:11:57.934 vfio_user_virtio_blk_restart_vm 01:11:57.934 vfio_user_virtio_scsi_restart_vm 01:11:57.934 vhost 01:11:57.934 vhost_blk_lvol_integrity 01:11:57.934 vhost_blk_packed_ring_integrity 01:11:57.934 vhost_blockdev 01:11:57.934 vhost_boot 01:11:57.934 vhost_fuzz 01:11:57.934 vhost_negative 01:11:57.934 vhost_scsi_lvol_integrity 01:11:57.934 vhost_shared 01:11:57.934 xnvme_bdevperf 01:11:57.934 xnvme_to_malloc_dd_copy 01:11:57.934 zoned_fio 01:11:57.934 01:11:57.934 01:11:57.934 -----Tests Missing From Build------ 01:11:57.934 balanced 01:11:57.934 build_native_dpdk 01:11:57.934 build_shared_native_dpdk_rpm 01:11:57.934 build_shared_rpm_with_rpmed_dpdk 01:11:57.934 busy 01:11:57.934 core_load 01:11:57.934 fio_dif_1_default 01:11:57.934 fio_dif_1_multi_subsystems 01:11:57.934 fio_dif_digest 01:11:57.934 fio_dif_rand_params 01:11:57.934 ftl_fio_extended 01:11:57.934 ftl_fio_nightly 01:11:57.934 ftl_restore_fast 01:11:57.934 ftl_write_after_write 01:11:57.934 iscsi_tgt_data_digest 01:11:57.934 iscsi_tgt_ext4test 01:11:57.934 kernel_target_abort 01:11:57.934 keyring_file 01:11:57.934 keyring_linux 01:11:57.934 nvme_boot_partition 01:11:57.934 nvme_bp 01:11:57.934 nvme_opal 01:11:57.934 nvme_opal_bdevio 01:11:57.934 nvme_opal_bdevperf 01:11:57.934 nvme_opal_spdk_tgt 01:11:57.934 nvmf_abort_qd_sizes 01:11:57.934 nvmf_auth 01:11:57.934 nvmf_bdevperf 01:11:57.934 nvmf_device_removal 01:11:57.934 nvmf_device_removal_pci_remove 01:11:57.934 nvmf_dif 01:11:57.934 nvmf_digest 01:11:57.934 nvmf_digest_clean 01:11:57.934 nvmf_digest_dsa_initiator 01:11:57.934 nvmf_digest_dsa_target 01:11:57.934 nvmf_digest_error 01:11:57.934 nvmf_discovery_remove_ifc 01:11:57.934 nvmf_fc 01:11:57.934 nvmf_host_discovery 01:11:57.934 nvmf_host_multipath 01:11:57.934 nvmf_host_multipath_status 01:11:57.934 nvmf_identify_kernel_target 01:11:57.934 nvmf_identify_passthru 01:11:57.934 nvmf_initiator_timeout 01:11:57.934 nvmf_mdns_discovery 01:11:57.934 nvmf_multiconnection 01:11:57.934 nvmf_rdma 01:11:57.934 nvmf_srq_overwhelm 01:11:57.934 nvmf_target_disconnect 01:11:57.934 nvmf_target_disconnect_tc1 01:11:57.934 nvmf_target_disconnect_tc2 01:11:57.934 nvmf_target_disconnect_tc3 01:11:57.934 nvmf_tcp 01:11:57.934 nvmf_timeout 01:11:57.934 spdk_target_abort 01:11:57.934 spdkcli_nvmf_fc 01:11:57.934 spdkcli_nvmf_rdma 01:11:57.934 spdkcli_nvmf_tcp 01:11:57.934 unittest_nvmf_fc 01:11:57.934 unittest_nvmf_fc_ls 01:11:57.934 vhost_blk_cores_2ctrl 01:11:57.934 vhost_blk_fs_integrity 01:11:57.934 vhost_blk_hot_remove 01:11:57.934 vhost_blk_integrity 01:11:57.934 vhost_hotplug 01:11:57.934 vhost_migration 01:11:57.934 vhost_migration_tc1 01:11:57.934 vhost_migration_tc2 01:11:57.934 vhost_readonly 01:11:57.934 vhost_scsi_cores_2ctrl 01:11:57.934 vhost_scsi_fs_integrity 01:11:57.934 vhost_scsi_hot_remove 01:11:57.934 vhost_scsi_integrity 01:11:57.934 vmd 01:11:57.934 vmd_bdev_svc 01:11:57.934 vmd_fio 01:11:57.934 vmd_hello_world 01:11:57.934 vmd_identify 01:11:57.934 vmd_perf 01:11:57.934 01:11:57.934 01:11:57.934 -----Tests Missing ASAN------ 01:11:57.934 accel_cdev_comp 01:11:57.934 accel_cdev_decmop_full 01:11:57.934 accel_cdev_decomp 01:11:57.934 accel_cdev_decomp_full_mcore 01:11:57.934 accel_cdev_decomp_full_mthread 01:11:57.934 accel_cdev_decomp_mcore 01:11:57.934 accel_cdev_decomp_mthread 01:11:57.934 autobuild 01:11:57.934 autobuild_build_doc 01:11:57.934 autobuild_check_dpdk_pci_api 01:11:57.934 autobuild_check_format 01:11:57.934 autobuild_check_so_deps 01:11:57.934 autobuild_external_code 01:11:57.934 autobuild_generated_files_check 01:11:57.934 autobuild_generated_files_check_post_clean 01:11:57.934 autobuild_header_dependency_check 01:11:57.934 autobuild_llvm_precompile 01:11:57.934 autobuild_make_install 01:11:57.934 autobuild_make_uninstall 01:11:57.934 autobuild_ocf_precompile 01:11:57.934 balanced 01:11:57.934 bdev_crypto_enomem 01:11:57.934 blockdev_crypto_aesni 01:11:57.934 blockdev_crypto_qat 01:11:57.934 blockdev_crypto_sw 01:11:57.934 blockdev_rbd 01:11:57.934 build_native_dpdk 01:11:57.934 build_shared_native_dpdk_rpm 01:11:57.934 build_shared_rpm_with_rpmed_dpdk 01:11:57.934 busy 01:11:57.934 chaining 01:11:57.934 check_header_filenames 01:11:57.934 cmb_copy 01:11:57.934 compress_compdev 01:11:57.934 compress_isal 01:11:57.934 confirm_abi_deps 01:11:57.934 confirm_makefile_deps 01:11:57.934 core_load 01:11:57.934 dd_uring_copy 01:11:57.934 dpdk_governor 01:11:57.934 external_make_accel_driver_shared 01:11:57.934 external_make_accel_driver_static 01:11:57.934 external_make_accel_module_shared 01:11:57.934 external_make_accel_module_static 01:11:57.934 external_make_hello_bdev_shared_combo 01:11:57.934 external_make_hello_bdev_shared_iso 01:11:57.934 external_make_hello_bdev_static 01:11:57.934 external_make_hello_no_bdev_shared_combo 01:11:57.934 external_make_hello_no_bdev_shared_iso 01:11:57.934 external_make_hello_no_bdev_static 01:11:57.934 external_make_nvme_shared 01:11:57.934 external_make_nvme_static 01:11:57.934 external_run_accel_driver_shared 01:11:57.934 external_run_accel_driver_static 01:11:57.934 external_run_accel_module_shared 01:11:57.934 external_run_accel_module_static 01:11:57.934 external_run_hello_bdev_shared_combo 01:11:57.934 external_run_hello_bdev_shared_iso 01:11:57.934 external_run_hello_bdev_static 01:11:57.934 external_run_hello_no_bdev_shared_combo 01:11:57.934 external_run_hello_no_bdev_shared_iso 01:11:57.934 external_run_hello_no_bdev_static 01:11:57.934 external_run_nvme_shared 01:11:57.934 external_run_nvme_static 01:11:57.934 fio_dif_1_default 01:11:57.934 fio_dif_1_multi_subsystems 01:11:57.934 fio_dif_digest 01:11:57.934 fio_dif_rand_params 01:11:57.934 ftl_fio_extended 01:11:57.934 ftl_fio_nightly 01:11:57.934 ftl_restore_fast 01:11:57.934 ftl_write_after_write 01:11:57.934 go_rpc 01:11:57.934 idle 01:11:57.934 interrupt_mode 01:11:57.934 ioat 01:11:57.934 ioat_perf 01:11:57.934 ioat_verify 01:11:57.934 is_zoned 01:11:57.934 iscsi_tgt 01:11:57.934 iscsi_tgt_bdev_io_wait 01:11:57.934 iscsi_tgt_calsoft 01:11:57.934 iscsi_tgt_data_digest 01:11:57.934 iscsi_tgt_digest 01:11:57.934 iscsi_tgt_digests 01:11:57.934 iscsi_tgt_ext4test 01:11:57.934 iscsi_tgt_filesystem 01:11:57.934 iscsi_tgt_filesystem_btrfs 01:11:57.934 iscsi_tgt_filesystem_ext4 01:11:57.934 iscsi_tgt_filesystem_xfs 01:11:57.934 iscsi_tgt_fio 01:11:57.934 iscsi_tgt_fuzz 01:11:57.934 iscsi_tgt_initiator 01:11:57.934 iscsi_tgt_ip_migration 01:11:57.934 iscsi_tgt_iscsi_lvol 01:11:57.934 iscsi_tgt_login_redirection 01:11:57.934 iscsi_tgt_multiconnection 01:11:57.934 iscsi_tgt_qos 01:11:57.934 iscsi_tgt_rbd 01:11:57.934 iscsi_tgt_reset 01:11:57.934 iscsi_tgt_resize 01:11:57.934 iscsi_tgt_rpc_config 01:11:57.934 iscsi_tgt_sock 01:11:57.935 iscsi_tgt_trace_record 01:11:57.935 kernel_target_abort 01:11:57.935 keyring_file 01:11:57.935 keyring_linux 01:11:57.935 llvm_fuzz 01:11:57.935 nvme_boot_partition 01:11:57.935 nvme_bp 01:11:57.935 nvme_cli_cuse 01:11:57.935 nvme_cli_plugin 01:11:57.935 nvme_cmb 01:11:57.935 nvme_cuse 01:11:57.935 nvme_cuse_app 01:11:57.935 nvme_cuse_rpc 01:11:57.935 nvme_ns_manage_cuse 01:11:57.935 nvme_opal 01:11:57.935 nvme_opal_bdevio 01:11:57.935 nvme_opal_bdevperf 01:11:57.935 nvme_opal_spdk_tgt 01:11:57.935 nvme_pmr 01:11:57.935 nvme_pmr_persistence 01:11:57.935 nvme_smartctl_cuse 01:11:57.935 nvme_zns 01:11:57.935 nvmf_abort_qd_sizes 01:11:57.935 nvmf_auth 01:11:57.935 nvmf_bdevperf 01:11:57.935 nvmf_device_removal 01:11:57.935 nvmf_device_removal_pci_remove 01:11:57.935 nvmf_device_removal_pci_remove_no_srq 01:11:57.935 nvmf_dif 01:11:57.935 nvmf_digest 01:11:57.935 nvmf_digest_clean 01:11:57.935 nvmf_digest_dsa_initiator 01:11:57.935 nvmf_digest_dsa_target 01:11:57.935 nvmf_digest_error 01:11:57.935 nvmf_discovery_remove_ifc 01:11:57.935 nvmf_fc 01:11:57.935 nvmf_fuzz 01:11:57.935 nvmf_host_discovery 01:11:57.935 nvmf_host_multipath 01:11:57.935 nvmf_host_multipath_status 01:11:57.935 nvmf_identify_kernel_target 01:11:57.935 nvmf_identify_passthru 01:11:57.935 nvmf_initiator_timeout 01:11:57.935 nvmf_mdns_discovery 01:11:57.935 nvmf_multiconnection 01:11:57.935 nvmf_nvme_cli 01:11:57.935 nvmf_perf_adq 01:11:57.935 nvmf_rdma 01:11:57.935 nvmf_shutdown 01:11:57.935 nvmf_shutdown_tc1 01:11:57.935 nvmf_shutdown_tc2 01:11:57.935 nvmf_shutdown_tc3 01:11:57.935 nvmf_srq_overwhelm 01:11:57.935 nvmf_target_disconnect 01:11:57.935 nvmf_target_disconnect_tc1 01:11:57.935 nvmf_target_disconnect_tc2 01:11:57.935 nvmf_target_disconnect_tc3 01:11:57.935 nvmf_tcp 01:11:57.935 nvmf_timeout 01:11:57.935 nvmf_vfio_user 01:11:57.935 nvmf_vfio_user_fuzz 01:11:57.935 nvmf_vfio_user_nvme_compliance 01:11:57.935 ocf 01:11:57.935 ocf_bdevperf_iotypes 01:11:57.935 ocf_configuration_change 01:11:57.935 ocf_create_destruct 01:11:57.935 ocf_fio_modes 01:11:57.935 ocf_flush 01:11:57.935 ocf_multicore 01:11:57.935 ocf_remove 01:11:57.935 ocf_stats 01:11:57.935 scanbuild_make 01:11:57.935 scheduler 01:11:57.935 spdk_dd_uring 01:11:57.935 spdk_target_abort 01:11:57.935 spdkcli_iscsi 01:11:57.935 spdkcli_nvmf_fc 01:11:57.935 spdkcli_nvmf_rdma 01:11:57.935 spdkcli_nvmf_tcp 01:11:57.935 spdkcli_raid 01:11:57.935 spdkcli_rbd 01:11:57.935 spdkcli_virtio 01:11:57.935 unittest_bdev_compress 01:11:57.935 unittest_bdev_crypto 01:11:57.935 unittest_dpdk_compressdev 01:11:57.935 unittest_lib_reduce 01:11:57.935 unittest_nvmf_fc 01:11:57.935 unittest_nvmf_fc_ls 01:11:57.935 unittest_nvmf_vfio_user 01:11:57.935 valgrind 01:11:57.935 vfio_fuzz 01:11:57.935 vhost_blk_cores_2ctrl 01:11:57.935 vhost_blk_fs_integrity 01:11:57.935 vhost_blk_hot_remove 01:11:57.935 vhost_blk_integrity 01:11:57.935 vhost_blockdev 01:11:57.935 vhost_fuzz 01:11:57.935 vhost_hotplug 01:11:57.935 vhost_migration 01:11:57.935 vhost_migration_tc1 01:11:57.935 vhost_migration_tc2 01:11:57.935 vhost_readonly 01:11:57.935 vhost_scsi_cores_2ctrl 01:11:57.935 vhost_scsi_fs_integrity 01:11:57.935 vhost_scsi_hot_remove 01:11:57.935 vhost_scsi_integrity 01:11:57.935 vhost_shared 01:11:57.935 vmd 01:11:57.935 vmd_bdev_svc 01:11:57.935 vmd_fio 01:11:57.935 vmd_hello_world 01:11:57.935 vmd_identify 01:11:57.935 vmd_perf 01:11:57.935 zoned_fio 01:11:57.935 01:11:57.935 01:11:57.935 -----Tests Missing UBSAN------ 01:11:57.935 autobuild 01:11:57.935 autobuild_build_doc 01:11:57.935 autobuild_check_dpdk_pci_api 01:11:57.935 autobuild_check_format 01:11:57.935 autobuild_check_so_deps 01:11:57.935 autobuild_external_code 01:11:57.935 autobuild_generated_files_check 01:11:57.935 autobuild_generated_files_check_post_clean 01:11:57.935 autobuild_header_dependency_check 01:11:57.935 autobuild_make_install 01:11:57.935 autobuild_make_uninstall 01:11:57.935 balanced 01:11:57.935 build_native_dpdk 01:11:57.935 build_rpm_from_gen_spec 01:11:57.935 build_shared_native_dpdk_rpm 01:11:57.935 build_shared_rpm 01:11:57.935 build_shared_rpm_with_rpmed_dpdk 01:11:57.935 busy 01:11:57.935 check_header_filenames 01:11:57.935 cmb_copy 01:11:57.935 confirm_abi_deps 01:11:57.935 confirm_makefile_deps 01:11:57.935 core_load 01:11:57.935 external_make_accel_driver_shared 01:11:57.935 external_make_accel_driver_static 01:11:57.935 external_make_accel_module_shared 01:11:57.935 external_make_accel_module_static 01:11:57.935 external_make_hello_bdev_shared_combo 01:11:57.935 external_make_hello_bdev_shared_iso 01:11:57.935 external_make_hello_bdev_static 01:11:57.935 external_make_hello_no_bdev_shared_combo 01:11:57.935 external_make_hello_no_bdev_shared_iso 01:11:57.935 external_make_hello_no_bdev_static 01:11:57.935 external_make_nvme_shared 01:11:57.935 external_make_nvme_static 01:11:57.935 external_run_accel_driver_shared 01:11:57.935 external_run_accel_driver_static 01:11:57.935 external_run_accel_module_shared 01:11:57.935 external_run_accel_module_static 01:11:57.935 external_run_hello_bdev_shared_combo 01:11:57.935 external_run_hello_bdev_shared_iso 01:11:57.935 external_run_hello_bdev_static 01:11:57.935 external_run_hello_no_bdev_shared_combo 01:11:57.935 external_run_hello_no_bdev_shared_iso 01:11:57.935 external_run_hello_no_bdev_static 01:11:57.935 external_run_nvme_shared 01:11:57.935 external_run_nvme_static 01:11:57.935 fio_dif_1_default 01:11:57.935 fio_dif_1_multi_subsystems 01:11:57.935 fio_dif_digest 01:11:57.935 fio_dif_rand_params 01:11:57.935 ftl_fio_extended 01:11:57.935 ftl_fio_nightly 01:11:57.935 ftl_restore_fast 01:11:57.935 ftl_write_after_write 01:11:57.935 is_zoned 01:11:57.935 iscsi_tgt_data_digest 01:11:57.935 iscsi_tgt_ext4test 01:11:57.935 kernel_target_abort 01:11:57.935 keyring_file 01:11:57.935 keyring_linux 01:11:57.935 nvme_boot_partition 01:11:57.935 nvme_bp 01:11:57.935 nvme_cmb 01:11:57.935 nvme_opal 01:11:57.935 nvme_opal_bdevio 01:11:57.935 nvme_opal_bdevperf 01:11:57.935 nvme_opal_spdk_tgt 01:11:57.935 nvme_pmr 01:11:57.935 nvme_pmr_persistence 01:11:57.935 nvme_zns 01:11:57.935 nvmf_abort_qd_sizes 01:11:57.935 nvmf_auth 01:11:57.935 nvmf_bdevperf 01:11:57.935 nvmf_device_removal 01:11:57.935 nvmf_device_removal_pci_remove 01:11:57.935 nvmf_dif 01:11:57.935 nvmf_digest 01:11:57.935 nvmf_digest_clean 01:11:57.935 nvmf_digest_dsa_initiator 01:11:57.935 nvmf_digest_dsa_target 01:11:57.935 nvmf_digest_error 01:11:57.935 nvmf_discovery_remove_ifc 01:11:57.935 nvmf_fc 01:11:57.935 nvmf_host_discovery 01:11:57.935 nvmf_host_multipath 01:11:57.935 nvmf_host_multipath_status 01:11:57.935 nvmf_identify_kernel_target 01:11:57.935 nvmf_identify_passthru 01:11:57.935 nvmf_initiator_timeout 01:11:57.935 nvmf_mdns_discovery 01:11:57.935 nvmf_multiconnection 01:11:57.935 nvmf_rdma 01:11:57.935 nvmf_srq_overwhelm 01:11:57.935 nvmf_target_disconnect 01:11:57.935 nvmf_target_disconnect_tc1 01:11:57.935 nvmf_target_disconnect_tc2 01:11:57.935 nvmf_target_disconnect_tc3 01:11:57.935 nvmf_tcp 01:11:57.935 nvmf_timeout 01:11:57.935 packaging 01:11:57.935 rpm_packaging 01:11:57.935 scanbuild_make 01:11:57.935 spdk_target_abort 01:11:57.935 spdkcli_nvmf_fc 01:11:57.935 spdkcli_nvmf_rdma 01:11:57.935 spdkcli_nvmf_tcp 01:11:57.935 unittest_bdev_compress 01:11:57.935 unittest_bdev_crypto 01:11:57.935 unittest_dpdk_compressdev 01:11:57.935 unittest_lib_reduce 01:11:57.935 unittest_nvmf_fc 01:11:57.935 unittest_nvmf_fc_ls 01:11:57.935 unittest_nvmf_vfio_user 01:11:57.935 valgrind 01:11:57.935 vhost_blk_cores_2ctrl 01:11:57.935 vhost_blk_fs_integrity 01:11:57.935 vhost_blk_hot_remove 01:11:57.935 vhost_blk_integrity 01:11:57.935 vhost_hotplug 01:11:57.935 vhost_migration 01:11:57.935 vhost_migration_tc1 01:11:57.935 vhost_migration_tc2 01:11:57.935 vhost_readonly 01:11:57.935 vhost_scsi_cores_2ctrl 01:11:57.935 vhost_scsi_fs_integrity 01:11:57.935 vhost_scsi_hot_remove 01:11:57.935 vhost_scsi_integrity 01:11:57.935 vmd 01:11:57.935 vmd_bdev_svc 01:11:57.935 vmd_fio 01:11:57.935 vmd_hello_world 01:11:57.935 vmd_identify 01:11:57.935 vmd_perf 01:11:57.935 zoned_fio 01:11:57.935 Not all tests were run. Failing the build. 01:11:57.935 ['fio_dif_1_default', 'fio_dif_1_multi_subsystems', 'fio_dif_digest', 'fio_dif_rand_params', 'kernel_target_abort', 'keyring_file', 'nvmf_abort_qd_sizes', 'nvmf_auth', 'nvmf_bdevperf', 'nvmf_dif', 'nvmf_digest', 'nvmf_digest_clean', 'nvmf_digest_error', 'nvmf_discovery_remove_ifc', 'nvmf_host_discovery', 'nvmf_host_multipath', 'nvmf_host_multipath_status', 'nvmf_identify_kernel_target', 'nvmf_identify_passthru', 'nvmf_mdns_discovery', 'nvmf_rdma', 'nvmf_srq_overwhelm', 'nvmf_target_disconnect', 'nvmf_target_disconnect_tc1', 'nvmf_target_disconnect_tc2', 'nvmf_target_disconnect_tc3', 'nvmf_tcp', 'nvmf_timeout', 'spdk_target_abort', 'spdkcli_nvmf_rdma', 'spdkcli_nvmf_tcp'] 01:11:57.935 + compress_coverage_and_docs 01:11:57.935 + echo 'Start compress coverage and docs' 01:11:57.935 Start compress coverage and docs 01:11:57.935 + tar -C coverage -czf coverage_autotest-per-patch_122897.tar.gz ./ --remove-files 01:11:57.935 + tar -C ut_coverage -czf ut_coverage_autotest-per-patch_122897.tar.gz ./ --remove-files 01:11:58.192 + tar -C doc -czf doc_autotest-per-patch_122897.tar.gz ./ --remove-files 01:11:58.453 + [[ -d llvm ]] 01:11:58.453 + true 01:11:58.453 + echo 'End compress coverage and docs' 01:11:58.453 End compress coverage and docs 01:11:58.453 + remove_partial_coverage_files 01:11:58.453 + find . -name 'cov_*.info' -delete 01:11:58.453 + echo 'End stage post_gen_coverage.sh' 01:11:58.453 End stage post_gen_coverage.sh 01:11:58.489 [Pipeline] } 01:11:58.492 ERROR: script returned exit code 1 01:11:58.508 [Pipeline] // catchError 01:11:58.515 [Pipeline] catchError 01:11:58.516 [Pipeline] { 01:11:58.530 [Pipeline] dir 01:11:58.530 Running in /var/jenkins/workspace/autotest-per-patch_3/post_process 01:11:58.531 [Pipeline] {