00:00:00.001 Started by upstream project "nightly-trigger" build number 3086 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.009 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/autotest-nightly_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-upstream/autotest.groovy 00:00:00.010 The recommended git tool is: git 00:00:00.010 using credential 00000000-0000-0000-0000-000000000002 00:00:00.011 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/autotest-nightly_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.022 Fetching changes from the remote Git repository 00:00:00.023 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.034 Using shallow fetch with depth 1 00:00:00.034 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.034 > git --version # timeout=10 00:00:00.043 > git --version # 'git version 2.39.2' 00:00:00.043 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.043 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.043 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:02.282 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:02.294 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:02.305 Checking out Revision 10da8f6d99838e411e4e94523ded0bfebf3e7100 (FETCH_HEAD) 00:00:02.305 > git config core.sparsecheckout # timeout=10 00:00:02.315 > git read-tree -mu HEAD # timeout=10 00:00:02.330 > git checkout -f 10da8f6d99838e411e4e94523ded0bfebf3e7100 # timeout=5 00:00:02.353 Commit message: "scripts/create_git_mirror: Update path to xnvme submodule" 00:00:02.354 > git rev-list --no-walk 5638be4635c3733e64b6b5e5e6cff24d93e32882 # timeout=10 00:00:02.492 [Pipeline] Start of Pipeline 00:00:02.507 [Pipeline] library 00:00:02.508 Loading library shm_lib@master 00:00:02.508 Library shm_lib@master is cached. Copying from home. 00:00:02.530 [Pipeline] node 00:00:02.535 Running on ME2 in /var/jenkins/workspace/autotest-nightly 00:00:02.542 [Pipeline] { 00:00:02.562 [Pipeline] cleanWs 00:00:02.571 [WS-CLEANUP] Deleting project workspace... 00:00:02.572 [WS-CLEANUP] Deferred wipeout is used... 00:00:02.577 [WS-CLEANUP] done 00:00:02.583 [Pipeline] stage 00:00:02.587 [Pipeline] { (Prologue) 00:00:02.684 [Pipeline] withCredentials 00:00:02.695 > git --version # timeout=10 00:00:02.706 > git --version # 'git version 2.39.2' 00:00:02.724 Masking supported pattern matches of $GIT_USERNAME or $GIT_PASSWORD or $GIT_ASKPASS 00:00:02.726 [Pipeline] { 00:00:02.735 [Pipeline] retry 00:00:02.737 [Pipeline] { 00:00:02.902 [Pipeline] sh 00:00:03.180 + git ls-remote https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master 00:00:05.099 [Pipeline] } 00:00:05.125 [Pipeline] // retry 00:00:05.130 [Pipeline] } 00:00:05.153 [Pipeline] // withCredentials 00:00:05.163 [Pipeline] nodesByLabel 00:00:05.164 Found a total of 1 nodes with the 'sorcerer' label 00:00:05.175 [Pipeline] httpRequest 00:00:05.180 HttpMethod: GET 00:00:05.180 URL: http://10.211.164.101/packages/jbp_10da8f6d99838e411e4e94523ded0bfebf3e7100.tar.gz 00:00:05.181 Sending request to url: http://10.211.164.101/packages/jbp_10da8f6d99838e411e4e94523ded0bfebf3e7100.tar.gz 00:00:05.182 Response Code: HTTP/1.1 200 OK 00:00:05.182 Success: Status code 200 is in the accepted range: 200,404 00:00:05.183 Saving response body to /var/jenkins/workspace/autotest-nightly/jbp_10da8f6d99838e411e4e94523ded0bfebf3e7100.tar.gz 00:00:05.321 [Pipeline] sh 00:00:05.600 + tar --no-same-owner -xf jbp_10da8f6d99838e411e4e94523ded0bfebf3e7100.tar.gz 00:00:05.618 [Pipeline] withCredentials 00:00:05.626 > git --version # timeout=10 00:00:05.639 > git --version # 'git version 2.39.2' 00:00:05.651 Masking supported pattern matches of $GIT_USERNAME or $GIT_PASSWORD or $GIT_ASKPASS 00:00:05.653 [Pipeline] { 00:00:05.661 [Pipeline] retry 00:00:05.663 [Pipeline] { 00:00:05.681 [Pipeline] sh 00:00:05.956 + git ls-remote https://review.spdk.io/gerrit/a/spdk/spdk refs/heads/master 00:00:09.264 [Pipeline] } 00:00:09.293 [Pipeline] // retry 00:00:09.297 [Pipeline] } 00:00:09.319 [Pipeline] // withCredentials 00:00:09.330 [Pipeline] httpRequest 00:00:09.334 HttpMethod: GET 00:00:09.335 URL: http://10.211.164.101/packages/spdk_4506c0c368f63ba9b9b013ecff216cef6ee8d0a4.tar.gz 00:00:09.335 Sending request to url: http://10.211.164.101/packages/spdk_4506c0c368f63ba9b9b013ecff216cef6ee8d0a4.tar.gz 00:00:09.336 Response Code: HTTP/1.1 200 OK 00:00:09.336 Success: Status code 200 is in the accepted range: 200,404 00:00:09.336 Saving response body to /var/jenkins/workspace/autotest-nightly/spdk_4506c0c368f63ba9b9b013ecff216cef6ee8d0a4.tar.gz 00:00:11.460 [Pipeline] sh 00:00:11.743 + tar --no-same-owner -xf spdk_4506c0c368f63ba9b9b013ecff216cef6ee8d0a4.tar.gz 00:00:13.653 [Pipeline] sh 00:00:13.934 + git -C spdk log --oneline -n5 00:00:13.934 4506c0c36 test/common: Enable inherit_errexit 00:00:13.934 b24df7cfa test: Drop superfluous calls to print_backtrace() 00:00:13.934 7b52e4c17 test/scheduler: Meassure utime of $spdk_pid threads as a fallback 00:00:13.934 1dc065205 test/scheduler: Calculate median of the cpu load samples 00:00:13.934 b22f1b34d test/scheduler: Enhance lookup of the $old_cgroup in move_proc() 00:00:13.952 [Pipeline] sh 00:00:14.238 + git -C spdk show -s --format=%s 4506c0c368f63ba9b9b013ecff216cef6ee8d0a4 00:00:14.256 [Pipeline] setCustomBuildProperty 00:00:14.264 [Pipeline] setCustomBuildProperty 00:00:14.273 [Pipeline] catchError 00:00:14.275 [Pipeline] { 00:00:14.296 [Pipeline] readJSON 00:00:14.313 [Pipeline] } 00:00:14.340 [Pipeline] // catchError 00:00:14.345 [Pipeline] } 00:00:14.373 [Pipeline] // stage 00:00:14.391 [Pipeline] catchError 00:00:14.392 [Pipeline] { 00:00:14.417 [Pipeline] stage 00:00:14.419 [Pipeline] { (Tests) 00:00:14.614 [Pipeline] parallel 00:00:14.724 [Pipeline] { (Branch: check-format-docker-autotest) 00:00:14.725 [Pipeline] { (Branch: check-so-deps-docker-autotest) 00:00:14.726 [Pipeline] { (Branch: doc-docker-autotest) 00:00:14.727 [Pipeline] { (Branch: build-files-docker-autotest) 00:00:14.728 [Pipeline] { (Branch: unittest-clang-docker-autotest) 00:00:14.729 [Pipeline] { (Branch: unittest-main-docker-autotest) 00:00:14.730 [Pipeline] { (Branch: unittest-valgrind-docker-autotest) 00:00:14.731 [Pipeline] { (Branch: scan-build-docker-autotest) 00:00:14.732 [Pipeline] { (Branch: packaging-docker-autotest) 00:00:14.733 [Pipeline] { (Branch: autobuild-external-vg-autotest) 00:00:14.734 [Pipeline] { (Branch: lvol-vg-autotest) 00:00:14.735 [Pipeline] { (Branch: vhost-initiator-vg-autotest) 00:00:14.736 [Pipeline] { (Branch: nvmf-tcp-vg-autotest) 00:00:14.737 [Pipeline] { (Branch: nvmf-tcp-uring-vg-autotest) 00:00:14.738 [Pipeline] { (Branch: nvme-vg-autotest) 00:00:14.738 [Pipeline] { (Branch: centos7-vg-autotest) 00:00:14.739 [Pipeline] { (Branch: rocky9-vg-autotest) 00:00:14.740 [Pipeline] { (Branch: ubuntu20-vg-autotest) 00:00:14.741 [Pipeline] { (Branch: ubuntu22-vg-autotest) 00:00:14.742 [Pipeline] { (Branch: freebsd-vg-autotest) 00:00:14.743 [Pipeline] { (Branch: iscsi-vg-autotest) 00:00:14.744 [Pipeline] { (Branch: iscsi-uring-vg-autotest) 00:00:14.745 [Pipeline] { (Branch: zns-vg-autotest) 00:00:14.746 [Pipeline] { (Branch: nvme-cmb-pmr-vg-autotest) 00:00:14.747 [Pipeline] { (Branch: BlobFS-phy-autotest) 00:00:14.748 [Pipeline] { (Branch: crypto-phy-autotest) 00:00:14.750 [Pipeline] { (Branch: vhost-phy-autotest) 00:00:14.751 [Pipeline] { (Branch: nvmf-phy-autotest) 00:00:14.752 [Pipeline] { (Branch: nvmf-cvl-phy-autotest) 00:00:14.753 [Pipeline] { (Branch: nvmf-tcp-phy-autotest) 00:00:14.754 [Pipeline] { (Branch: nvme-phy-autotest) 00:00:14.755 [Pipeline] { (Branch: vfio-user-phy-autotest) 00:00:14.756 [Pipeline] { (Branch: short-fuzz-phy-autotest) 00:00:14.757 [Pipeline] { (Branch: dsa-phy-autotest) 00:00:14.758 [Pipeline] { (Branch: vmd-phy-autotest) 00:00:14.791 [Pipeline] retry 00:00:14.793 [Pipeline] { 00:00:14.798 [Pipeline] retry 00:00:14.799 [Pipeline] { 00:00:14.805 [Pipeline] retry 00:00:14.806 [Pipeline] { 00:00:14.811 [Pipeline] retry 00:00:14.813 [Pipeline] { 00:00:14.817 [Pipeline] retry 00:00:14.819 [Pipeline] { 00:00:14.824 [Pipeline] retry 00:00:14.826 [Pipeline] { 00:00:14.831 [Pipeline] retry 00:00:14.833 [Pipeline] { 00:00:14.838 [Pipeline] retry 00:00:14.840 [Pipeline] { 00:00:14.845 [Pipeline] retry 00:00:14.846 [Pipeline] { 00:00:14.851 [Pipeline] retry 00:00:14.853 [Pipeline] { 00:00:14.858 [Pipeline] retry 00:00:14.860 [Pipeline] { 00:00:14.865 [Pipeline] retry 00:00:14.867 [Pipeline] { 00:00:14.872 [Pipeline] retry 00:00:14.874 [Pipeline] { 00:00:14.879 [Pipeline] retry 00:00:14.880 [Pipeline] { 00:00:14.885 [Pipeline] retry 00:00:14.887 [Pipeline] { 00:00:14.892 [Pipeline] retry 00:00:14.893 [Pipeline] { 00:00:14.898 [Pipeline] retry 00:00:14.900 [Pipeline] { 00:00:14.904 [Pipeline] retry 00:00:14.906 [Pipeline] { 00:00:14.911 [Pipeline] retry 00:00:14.913 [Pipeline] { 00:00:14.917 [Pipeline] retry 00:00:14.919 [Pipeline] { 00:00:14.924 [Pipeline] retry 00:00:14.926 [Pipeline] { 00:00:14.931 [Pipeline] retry 00:00:14.932 [Pipeline] { 00:00:14.937 [Pipeline] retry 00:00:14.939 [Pipeline] { 00:00:14.943 [Pipeline] retry 00:00:14.945 [Pipeline] { 00:00:14.950 [Pipeline] retry 00:00:14.951 [Pipeline] { 00:00:14.956 [Pipeline] retry 00:00:14.958 [Pipeline] { 00:00:14.963 [Pipeline] retry 00:00:14.965 [Pipeline] { 00:00:14.969 [Pipeline] retry 00:00:14.971 [Pipeline] { 00:00:14.976 [Pipeline] retry 00:00:14.977 [Pipeline] { 00:00:14.982 [Pipeline] retry 00:00:14.984 [Pipeline] { 00:00:14.989 [Pipeline] retry 00:00:14.990 [Pipeline] { 00:00:14.995 [Pipeline] retry 00:00:14.996 [Pipeline] { 00:00:15.001 [Pipeline] retry 00:00:15.003 [Pipeline] { 00:00:15.008 [Pipeline] retry 00:00:15.010 [Pipeline] { 00:00:15.014 [Pipeline] retry 00:00:15.016 [Pipeline] { 00:00:15.045 [Pipeline] build 00:00:15.047 Scheduling project: check-format-docker-autotest 00:00:15.053 [Pipeline] build 00:00:15.055 Scheduling project: check-so-deps-docker-autotest 00:00:15.060 [Pipeline] build 00:00:15.062 Scheduling project: doc-docker-autotest 00:00:15.067 [Pipeline] build 00:00:15.069 Scheduling project: build-files-docker-autotest 00:00:15.074 [Pipeline] build 00:00:15.076 Scheduling project: unittest-clang-docker-autotest 00:00:15.081 [Pipeline] build 00:00:15.083 Scheduling project: unittest-main-docker-autotest 00:00:15.088 [Pipeline] build 00:00:15.090 Scheduling project: unittest-valgrind-docker-autotest 00:00:15.095 [Pipeline] build 00:00:15.097 Scheduling project: scan-build-docker-autotest 00:00:15.102 [Pipeline] build 00:00:15.104 Scheduling project: packaging-docker-autotest 00:00:15.109 [Pipeline] build 00:00:15.111 Scheduling project: autobuild-external-vg-autotest 00:00:15.116 [Pipeline] build 00:00:15.118 Scheduling project: lvol-vg-autotest 00:00:15.124 [Pipeline] build 00:00:15.126 Scheduling project: vhost-initiator-vg-autotest 00:00:15.130 [Pipeline] build 00:00:15.132 Scheduling project: nvmf-tcp-vg-autotest 00:00:15.136 [Pipeline] build 00:00:15.138 Scheduling project: nvmf-tcp-uring-vg-autotest 00:00:15.143 [Pipeline] build 00:00:15.145 Scheduling project: nvme-vg-autotest 00:00:15.150 [Pipeline] build 00:00:15.152 Scheduling project: centos7-vg-autotest 00:00:15.156 [Pipeline] build 00:00:15.158 Scheduling project: rocky9-vg-autotest 00:00:15.162 [Pipeline] build 00:00:15.164 Scheduling project: ubuntu20-vg-autotest 00:00:15.169 [Pipeline] build 00:00:15.171 Scheduling project: ubuntu22-vg-autotest 00:00:15.175 [Pipeline] build 00:00:15.177 Scheduling project: freebsd-vg-autotest 00:00:15.182 [Pipeline] build 00:00:15.184 Scheduling project: iscsi-vg-autotest 00:00:15.190 [Pipeline] build 00:00:15.192 Scheduling project: iscsi-uring-vg-autotest 00:00:15.196 [Pipeline] build 00:00:15.198 Scheduling project: zns-vg-autotest 00:00:15.202 [Pipeline] build 00:00:15.204 Scheduling project: nvme-cmb-pmr-vg-autotest 00:00:15.215 [Pipeline] build 00:00:15.217 Scheduling project: BlobFS-phy-autotest 00:00:15.222 [Pipeline] build 00:00:15.224 Scheduling project: crypto-phy-autotest 00:00:15.229 [Pipeline] build 00:00:15.230 Scheduling project: vhost-phy-autotest 00:00:15.236 [Pipeline] build 00:00:15.238 Scheduling project: nvmf-phy-autotest 00:00:15.243 [Pipeline] build 00:00:15.244 Scheduling project: nvmf-cvl-phy-autotest 00:00:15.249 [Pipeline] build 00:00:15.251 Scheduling project: nvmf-tcp-phy-autotest 00:00:15.256 [Pipeline] build 00:00:15.258 Scheduling project: nvme-phy-autotest 00:00:15.263 [Pipeline] build 00:00:15.265 Scheduling project: vfio-user-phy-autotest 00:00:15.271 [Pipeline] build 00:00:15.273 Scheduling project: short-fuzz-phy-autotest 00:00:15.279 [Pipeline] build 00:00:15.281 Scheduling project: dsa-phy-autotest 00:00:15.286 [Pipeline] build 00:00:15.288 Scheduling project: vmd-phy-autotest 00:00:25.096 Starting building: BlobFS-phy-autotest #26123 00:00:25.099 Starting building: crypto-phy-autotest #26117 00:00:25.100 Starting building: vmd-phy-autotest #2611 00:00:25.104 Starting building: short-fuzz-phy-autotest #26114 00:00:25.107 Starting building: check-so-deps-docker-autotest #22084 00:00:25.110 Starting building: dsa-phy-autotest #4817 00:00:25.113 Starting building: unittest-main-docker-autotest #19788 00:00:25.116 Starting building: check-format-docker-autotest #22071 00:00:25.120 Starting building: scan-build-docker-autotest #19790 00:00:25.123 Starting building: vhost-phy-autotest #26142 00:00:25.125 Starting building: nvmf-tcp-uring-vg-autotest #77322 00:00:25.130 Starting building: ubuntu22-vg-autotest #37730 00:00:25.139 Starting building: lvol-vg-autotest #77346 00:00:25.142 Starting building: vhost-initiator-vg-autotest #77417 00:00:25.145 Starting building: nvmf-tcp-vg-autotest #77388 00:00:25.148 Starting building: nvmf-phy-autotest #72361 00:00:25.151 Starting building: vfio-user-phy-autotest #26125 00:00:25.156 Starting building: rocky9-vg-autotest #16007 00:00:25.160 Starting building: unittest-valgrind-docker-autotest #19791 00:00:25.162 Starting building: build-files-docker-autotest #22060 00:00:25.164 Starting building: unittest-clang-docker-autotest #19787 00:00:25.168 Starting building: doc-docker-autotest #22251 00:00:25.170 Starting building: packaging-docker-autotest #19789 00:00:25.173 Starting building: nvmf-cvl-phy-autotest #3013 00:00:25.175 Starting building: autobuild-external-vg-autotest #19750 00:00:25.178 Starting building: nvmf-tcp-phy-autotest #72248 00:00:25.181 Starting building: nvme-vg-autotest #77397 00:00:25.184 Starting building: iscsi-uring-vg-autotest #77302 00:00:25.187 Starting building: nvme-phy-autotest #72289 00:00:25.190 Starting building: zns-vg-autotest #76503 00:00:25.194 Starting building: iscsi-vg-autotest #77435 00:00:25.197 Starting building: centos7-vg-autotest #73576 00:00:25.200 Starting building: ubuntu20-vg-autotest #73716 00:00:25.203 Starting building: freebsd-vg-autotest #59050 00:00:25.204 Starting building: nvme-cmb-pmr-vg-autotest #78520 00:01:27.821 Build check-format-docker-autotest #22071 completed: SUCCESS 00:01:27.823 [Pipeline] } 00:01:27.851 [Pipeline] // retry 00:01:27.857 [Pipeline] } 00:01:37.199 Build doc-docker-autotest #22251 completed: SUCCESS 00:01:37.202 [Pipeline] } 00:01:37.252 [Pipeline] // retry 00:01:37.259 [Pipeline] } 00:03:02.994 Build build-files-docker-autotest #22060 completed: SUCCESS 00:03:02.996 [Pipeline] } 00:03:03.052 [Pipeline] // retry 00:03:03.058 [Pipeline] } 00:03:39.930 Build check-so-deps-docker-autotest #22084 completed: SUCCESS 00:03:39.933 [Pipeline] } 00:03:39.989 [Pipeline] // retry 00:03:39.996 [Pipeline] } 00:04:13.714 Build unittest-clang-docker-autotest #19787 completed: SUCCESS 00:04:13.719 [Pipeline] } 00:04:13.769 [Pipeline] // retry 00:04:13.775 [Pipeline] } 00:04:55.468 Build scan-build-docker-autotest #19790 completed: SUCCESS 00:04:55.472 [Pipeline] } 00:04:55.529 [Pipeline] // retry 00:04:55.536 [Pipeline] } 00:05:42.017 Build packaging-docker-autotest #19789 completed: SUCCESS 00:05:42.020 [Pipeline] } 00:05:42.055 [Pipeline] // retry 00:05:42.062 [Pipeline] } 00:06:02.507 Build unittest-main-docker-autotest #19788 completed: SUCCESS 00:06:02.511 [Pipeline] } 00:06:02.562 [Pipeline] // retry 00:06:02.569 [Pipeline] } 00:10:00.983 Build unittest-valgrind-docker-autotest #19791 completed: SUCCESS 00:10:00.986 [Pipeline] } 00:10:01.049 [Pipeline] // retry 00:10:01.056 [Pipeline] } 00:10:24.562 Build short-fuzz-phy-autotest #26114 completed: SUCCESS 00:10:24.564 [Pipeline] } 00:10:24.614 [Pipeline] // retry 00:10:24.621 [Pipeline] } 00:11:02.766 Build vhost-initiator-vg-autotest #77417 completed: SUCCESS 00:11:02.768 [Pipeline] } 00:11:02.809 [Pipeline] // retry 00:11:02.815 [Pipeline] } 00:11:15.716 Build autobuild-external-vg-autotest #19750 completed: SUCCESS 00:11:15.718 [Pipeline] } 00:11:15.749 [Pipeline] // retry 00:11:15.756 [Pipeline] } 00:12:23.726 Build vmd-phy-autotest #2611 completed: SUCCESS 00:12:23.729 [Pipeline] } 00:12:23.769 [Pipeline] // retry 00:12:23.774 [Pipeline] } 00:15:17.747 Build lvol-vg-autotest #77346 completed: SUCCESS 00:15:17.749 [Pipeline] } 00:15:17.776 [Pipeline] // retry 00:15:17.780 [Pipeline] } 00:17:12.718 Build nvme-cmb-pmr-vg-autotest #78520 completed: SUCCESS 00:17:12.720 [Pipeline] } 00:17:12.758 [Pipeline] // retry 00:17:12.764 [Pipeline] } 00:17:51.567 Build zns-vg-autotest #76503 completed: SUCCESS 00:17:51.569 [Pipeline] } 00:17:51.616 [Pipeline] // retry 00:17:51.621 [Pipeline] } 00:18:38.145 Build nvme-vg-autotest #77397 completed: FAILURE 00:18:38.858 [Pipeline] echo 00:18:38.859 No retry patterns found. 00:18:38.859 [Pipeline] } 00:18:38.893 [Pipeline] // retry 00:18:38.901 [Pipeline] error 00:18:38.906 [Pipeline] } 00:18:38.911 Failed in branch nvme-vg-autotest 00:22:06.494 Build BlobFS-phy-autotest #26123 completed: SUCCESS 00:22:06.496 [Pipeline] } 00:22:06.545 [Pipeline] // retry 00:22:06.551 [Pipeline] } 00:24:26.148 Build nvme-phy-autotest #72289 completed: SUCCESS 00:24:26.149 [Pipeline] } 00:24:26.171 [Pipeline] // retry 00:24:26.174 [Pipeline] } 00:25:39.081 Build vfio-user-phy-autotest #26125 completed: SUCCESS 00:25:39.084 [Pipeline] } 00:25:39.130 [Pipeline] // retry 00:25:39.137 [Pipeline] } 00:25:55.614 Build freebsd-vg-autotest #59050 completed: SUCCESS 00:25:55.617 [Pipeline] } 00:25:55.661 [Pipeline] // retry 00:25:55.670 [Pipeline] } 00:26:26.022 Build nvmf-tcp-uring-vg-autotest #77322 completed: SUCCESS 00:26:26.029 [Pipeline] } 00:26:26.074 [Pipeline] // retry 00:26:26.080 [Pipeline] } 00:30:03.090 Build crypto-phy-autotest #26117 completed: SUCCESS 00:30:03.093 [Pipeline] } 00:30:03.144 [Pipeline] // retry 00:30:03.151 [Pipeline] } 00:30:10.934 Build vhost-phy-autotest #26142 completed: SUCCESS 00:30:10.937 [Pipeline] } 00:30:10.983 [Pipeline] // retry 00:30:10.990 [Pipeline] } 00:31:29.288 Build iscsi-uring-vg-autotest #77302 completed: SUCCESS 00:31:29.291 [Pipeline] } 00:31:29.339 [Pipeline] // retry 00:31:29.346 [Pipeline] } 00:33:52.889 Build nvmf-tcp-vg-autotest #77388 completed: SUCCESS 00:33:52.891 [Pipeline] } 00:33:52.939 [Pipeline] // retry 00:33:52.947 [Pipeline] } 00:37:16.359 Build nvmf-cvl-phy-autotest #3013 completed: SUCCESS 00:37:16.361 [Pipeline] } 00:37:16.407 [Pipeline] // retry 00:37:16.414 [Pipeline] } 00:37:47.356 Build iscsi-vg-autotest #77435 completed: SUCCESS 00:37:47.358 [Pipeline] } 00:37:47.398 [Pipeline] // retry 00:37:47.405 [Pipeline] } 00:40:51.851 Build nvmf-tcp-phy-autotest #72248 completed: SUCCESS 00:40:51.853 [Pipeline] } 00:40:51.900 [Pipeline] // retry 00:40:51.906 [Pipeline] } 00:41:35.997 Build nvmf-phy-autotest #72361 completed: ABORTED 00:41:37.274 [Pipeline] echo 00:41:37.275 No retry patterns found. 00:41:37.276 [Pipeline] } 00:41:37.308 [Pipeline] // retry 00:41:37.315 [Pipeline] error 00:41:37.320 [Pipeline] } 00:41:37.324 Failed in branch nvmf-phy-autotest 00:42:08.361 Build dsa-phy-autotest #4817 completed: SUCCESS 00:42:08.364 [Pipeline] } 00:42:08.405 [Pipeline] // retry 00:42:08.411 [Pipeline] } 00:44:58.756 Build centos7-vg-autotest #73576 completed: SUCCESS 00:44:58.759 [Pipeline] } 00:44:58.803 [Pipeline] // retry 00:44:58.810 [Pipeline] } 00:49:45.033 Build ubuntu20-vg-autotest #73716 completed: FAILURE 00:49:47.146 [Pipeline] echo 00:49:47.148 No retry patterns found. 00:49:47.149 [Pipeline] } 00:49:47.183 [Pipeline] // retry 00:49:47.191 [Pipeline] error 00:49:47.196 [Pipeline] } 00:49:47.201 Failed in branch ubuntu20-vg-autotest 00:57:58.553 Build rocky9-vg-autotest #16007 completed: SUCCESS 00:57:58.556 [Pipeline] } 00:57:58.604 [Pipeline] // retry 00:57:58.612 [Pipeline] } 01:03:46.239 Build ubuntu22-vg-autotest #37730 completed: ABORTED 01:03:48.297 [Pipeline] echo 01:03:48.299 No retry patterns found. 01:03:48.300 [Pipeline] } 01:03:48.335 [Pipeline] // retry 01:03:48.343 [Pipeline] error 01:03:48.348 [Pipeline] } 01:03:48.352 Failed in branch ubuntu22-vg-autotest 01:03:48.618 [Pipeline] // parallel 01:03:48.627 [Pipeline] } 01:03:48.664 [Pipeline] // stage 01:03:48.672 [Pipeline] } 01:03:48.682 ERROR: Build nvme-vg-autotest #77397 failed 01:03:48.711 [Pipeline] // catchError 01:03:48.720 [Pipeline] stage 01:03:48.723 [Pipeline] { (Autorun Post and Coverage) 01:03:48.750 [Pipeline] setCustomBuildProperty 01:03:48.772 [Pipeline] dir 01:03:48.773 Running in /var/jenkins/workspace/autotest-nightly/check-format-docker-autotest_22071 01:03:48.775 [Pipeline] { 01:03:48.804 [Pipeline] copyArtifacts 01:03:48.867 Copied 5 artifacts from "check-format-docker-autotest" build number 22071 01:03:48.873 [Pipeline] writeFile 01:03:48.904 [Pipeline] } 01:03:48.935 [Pipeline] // dir 01:03:48.952 [Pipeline] dir 01:03:48.952 Running in /var/jenkins/workspace/autotest-nightly/doc-docker-autotest_22251 01:03:48.954 [Pipeline] { 01:03:48.981 [Pipeline] copyArtifacts 01:03:49.241 Copied 6 artifacts from "doc-docker-autotest" build number 22251 01:03:49.246 [Pipeline] writeFile 01:03:49.272 [Pipeline] } 01:03:49.304 [Pipeline] // dir 01:03:49.425 [Pipeline] dir 01:03:49.425 Running in /var/jenkins/workspace/autotest-nightly/build-files-docker-autotest_22060 01:03:49.426 [Pipeline] { 01:03:49.451 [Pipeline] copyArtifacts 01:03:49.521 Copied 5 artifacts from "build-files-docker-autotest" build number 22060 01:03:49.525 [Pipeline] writeFile 01:03:49.577 [Pipeline] } 01:03:49.614 [Pipeline] // dir 01:03:49.669 [Pipeline] dir 01:03:49.670 Running in /var/jenkins/workspace/autotest-nightly/check-so-deps-docker-autotest_22084 01:03:49.671 [Pipeline] { 01:03:49.691 [Pipeline] copyArtifacts 01:03:49.761 Copied 5 artifacts from "check-so-deps-docker-autotest" build number 22084 01:03:49.765 [Pipeline] writeFile 01:03:49.795 [Pipeline] } 01:03:49.834 [Pipeline] // dir 01:03:49.960 [Pipeline] dir 01:03:49.960 Running in /var/jenkins/workspace/autotest-nightly/unittest-clang-docker-autotest_19787 01:03:49.961 [Pipeline] { 01:03:49.986 [Pipeline] copyArtifacts 01:03:50.057 Copied 5 artifacts from "unittest-clang-docker-autotest" build number 19787 01:03:50.062 [Pipeline] writeFile 01:03:50.132 [Pipeline] } 01:03:50.220 [Pipeline] // dir 01:03:50.271 [Pipeline] dir 01:03:50.271 Running in /var/jenkins/workspace/autotest-nightly/scan-build-docker-autotest_19790 01:03:50.273 [Pipeline] { 01:03:50.298 [Pipeline] copyArtifacts 01:03:50.415 Copied 9 artifacts from "scan-build-docker-autotest" build number 19790 01:03:50.419 [Pipeline] writeFile 01:03:50.443 [Pipeline] } 01:03:50.464 [Pipeline] // dir 01:03:50.818 [Pipeline] dir 01:03:50.819 Running in /var/jenkins/workspace/autotest-nightly/packaging-docker-autotest_19789 01:03:50.820 [Pipeline] { 01:03:50.859 [Pipeline] copyArtifacts 01:03:50.931 Copied 5 artifacts from "packaging-docker-autotest" build number 19789 01:03:50.936 [Pipeline] writeFile 01:03:51.095 [Pipeline] } 01:03:51.194 [Pipeline] // dir 01:03:51.333 [Pipeline] dir 01:03:51.334 Running in /var/jenkins/workspace/autotest-nightly/unittest-main-docker-autotest_19788 01:03:51.335 [Pipeline] { 01:03:51.359 [Pipeline] copyArtifacts 01:03:51.620 Copied 6 artifacts from "unittest-main-docker-autotest" build number 19788 01:03:51.625 [Pipeline] writeFile 01:03:51.672 [Pipeline] } 01:03:51.730 [Pipeline] // dir 01:03:52.055 [Pipeline] dir 01:03:52.055 Running in /var/jenkins/workspace/autotest-nightly/unittest-valgrind-docker-autotest_19791 01:03:52.057 [Pipeline] { 01:03:52.095 [Pipeline] copyArtifacts 01:03:52.337 Copied 6 artifacts from "unittest-valgrind-docker-autotest" build number 19791 01:03:52.341 [Pipeline] writeFile 01:03:52.470 [Pipeline] } 01:03:52.580 [Pipeline] // dir 01:03:52.932 [Pipeline] dir 01:03:52.932 Running in /var/jenkins/workspace/autotest-nightly/short-fuzz-phy-autotest_26114 01:03:52.933 [Pipeline] { 01:03:52.976 [Pipeline] copyArtifacts 01:03:53.173 Copied 10 artifacts from "short-fuzz-phy-autotest" build number 26114 01:03:53.177 [Pipeline] writeFile 01:03:53.327 [Pipeline] } 01:03:53.441 [Pipeline] // dir 01:03:53.741 [Pipeline] dir 01:03:53.741 Running in /var/jenkins/workspace/autotest-nightly/vhost-initiator-vg-autotest_77417 01:03:53.742 [Pipeline] { 01:03:53.776 [Pipeline] copyArtifacts 01:03:54.089 Copied 16 artifacts from "vhost-initiator-vg-autotest" build number 77417 01:03:54.093 [Pipeline] writeFile 01:03:54.239 [Pipeline] } 01:03:54.331 [Pipeline] // dir 01:03:54.464 [Pipeline] dir 01:03:54.465 Running in /var/jenkins/workspace/autotest-nightly/autobuild-external-vg-autotest_19750 01:03:54.466 [Pipeline] { 01:03:54.495 [Pipeline] copyArtifacts 01:03:54.597 Copied 9 artifacts from "autobuild-external-vg-autotest" build number 19750 01:03:54.601 [Pipeline] writeFile 01:03:54.669 [Pipeline] } 01:03:54.713 [Pipeline] // dir 01:03:54.996 [Pipeline] dir 01:03:54.996 Running in /var/jenkins/workspace/autotest-nightly/vmd-phy-autotest_2611 01:03:54.997 [Pipeline] { 01:03:55.036 [Pipeline] copyArtifacts 01:03:55.240 Copied 12 artifacts from "vmd-phy-autotest" build number 2611 01:03:55.244 [Pipeline] writeFile 01:03:55.386 [Pipeline] } 01:03:55.465 [Pipeline] // dir 01:03:56.111 [Pipeline] dir 01:03:56.112 Running in /var/jenkins/workspace/autotest-nightly/lvol-vg-autotest_77346 01:03:56.113 [Pipeline] { 01:03:56.172 [Pipeline] copyArtifacts 01:03:56.367 Copied 12 artifacts from "lvol-vg-autotest" build number 77346 01:03:56.372 [Pipeline] writeFile 01:03:56.607 [Pipeline] } 01:03:56.745 [Pipeline] // dir 01:03:57.131 [Pipeline] dir 01:03:57.131 Running in /var/jenkins/workspace/autotest-nightly/nvme-cmb-pmr-vg-autotest_78520 01:03:57.133 [Pipeline] { 01:03:57.171 [Pipeline] copyArtifacts 01:03:57.382 Copied 12 artifacts from "nvme-cmb-pmr-vg-autotest" build number 78520 01:03:57.386 [Pipeline] writeFile 01:03:57.538 [Pipeline] } 01:03:57.677 [Pipeline] // dir 01:03:57.979 [Pipeline] dir 01:03:57.979 Running in /var/jenkins/workspace/autotest-nightly/zns-vg-autotest_76503 01:03:57.980 [Pipeline] { 01:03:58.018 [Pipeline] copyArtifacts 01:03:58.255 Copied 13 artifacts from "zns-vg-autotest" build number 76503 01:03:58.259 [Pipeline] writeFile 01:03:58.431 [Pipeline] } 01:03:58.546 [Pipeline] // dir 01:03:59.012 [Pipeline] dir 01:03:59.012 Running in /var/jenkins/workspace/autotest-nightly/nvme-vg-autotest_77397 01:03:59.013 [Pipeline] { 01:03:59.058 [Pipeline] copyArtifacts 01:03:59.339 Copied 11 artifacts from "nvme-vg-autotest" build number 77397 01:03:59.343 [Pipeline] writeFile 01:03:59.528 [Pipeline] } 01:03:59.625 [Pipeline] // dir 01:03:59.916 [Pipeline] dir 01:03:59.916 Running in /var/jenkins/workspace/autotest-nightly/BlobFS-phy-autotest_26123 01:03:59.918 [Pipeline] { 01:03:59.952 [Pipeline] copyArtifacts 01:04:00.373 Copied 28 artifacts from "BlobFS-phy-autotest" build number 26123 01:04:00.377 [Pipeline] writeFile 01:04:00.523 [Pipeline] } 01:04:00.596 [Pipeline] // dir 01:04:01.150 [Pipeline] dir 01:04:01.150 Running in /var/jenkins/workspace/autotest-nightly/nvme-phy-autotest_72289 01:04:01.151 [Pipeline] { 01:04:01.194 [Pipeline] copyArtifacts 01:04:01.465 Copied 12 artifacts from "nvme-phy-autotest" build number 72289 01:04:01.469 [Pipeline] writeFile 01:04:01.752 [Pipeline] } 01:04:01.876 [Pipeline] // dir 01:04:02.336 [Pipeline] dir 01:04:02.336 Running in /var/jenkins/workspace/autotest-nightly/vfio-user-phy-autotest_26125 01:04:02.337 [Pipeline] { 01:04:02.381 [Pipeline] copyArtifacts 01:04:02.628 Copied 12 artifacts from "vfio-user-phy-autotest" build number 26125 01:04:02.631 [Pipeline] writeFile 01:04:02.828 [Pipeline] } 01:04:02.946 [Pipeline] // dir 01:04:03.889 [Pipeline] dir 01:04:03.889 Running in /var/jenkins/workspace/autotest-nightly/freebsd-vg-autotest_59050 01:04:03.890 [Pipeline] { 01:04:03.945 [Pipeline] copyArtifacts 01:04:04.046 Copied 7 artifacts from "freebsd-vg-autotest" build number 59050 01:04:04.049 [Pipeline] writeFile 01:04:04.336 [Pipeline] } 01:04:04.480 [Pipeline] // dir 01:04:05.392 [Pipeline] dir 01:04:05.393 Running in /var/jenkins/workspace/autotest-nightly/nvmf-tcp-uring-vg-autotest_77322 01:04:05.394 [Pipeline] { 01:04:05.470 [Pipeline] copyArtifacts 01:04:05.736 Copied 14 artifacts from "nvmf-tcp-uring-vg-autotest" build number 77322 01:04:05.740 [Pipeline] writeFile 01:04:06.077 [Pipeline] } 01:04:06.276 [Pipeline] // dir 01:04:07.582 [Pipeline] dir 01:04:07.582 Running in /var/jenkins/workspace/autotest-nightly/crypto-phy-autotest_26117 01:04:07.583 [Pipeline] { 01:04:07.670 [Pipeline] copyArtifacts 01:04:07.894 Copied 12 artifacts from "crypto-phy-autotest" build number 26117 01:04:07.898 [Pipeline] writeFile 01:04:08.413 [Pipeline] } 01:04:08.674 [Pipeline] // dir 01:04:09.269 [Pipeline] dir 01:04:09.270 Running in /var/jenkins/workspace/autotest-nightly/vhost-phy-autotest_26142 01:04:09.271 [Pipeline] { 01:04:09.325 [Pipeline] copyArtifacts 01:04:09.606 Copied 13 artifacts from "vhost-phy-autotest" build number 26142 01:04:09.611 [Pipeline] writeFile 01:04:09.884 [Pipeline] } 01:04:10.001 [Pipeline] // dir 01:04:11.737 [Pipeline] dir 01:04:11.737 Running in /var/jenkins/workspace/autotest-nightly/iscsi-uring-vg-autotest_77302 01:04:11.738 [Pipeline] { 01:04:11.884 [Pipeline] copyArtifacts 01:04:14.117 Copied 16 artifacts from "iscsi-uring-vg-autotest" build number 77302 01:04:14.121 [Pipeline] writeFile 01:04:15.068 [Pipeline] } 01:04:15.461 [Pipeline] // dir 01:04:16.409 [Pipeline] dir 01:04:16.410 Running in /var/jenkins/workspace/autotest-nightly/nvmf-tcp-vg-autotest_77388 01:04:16.410 [Pipeline] { 01:04:16.485 [Pipeline] copyArtifacts 01:04:16.746 Copied 14 artifacts from "nvmf-tcp-vg-autotest" build number 77388 01:04:16.756 [Pipeline] writeFile 01:04:17.241 [Pipeline] } 01:04:17.426 [Pipeline] // dir 01:04:18.347 [Pipeline] dir 01:04:18.347 Running in /var/jenkins/workspace/autotest-nightly/nvmf-cvl-phy-autotest_3013 01:04:18.348 [Pipeline] { 01:04:18.414 [Pipeline] copyArtifacts 01:04:18.856 Copied 14 artifacts from "nvmf-cvl-phy-autotest" build number 3013 01:04:18.860 [Pipeline] writeFile 01:04:19.239 [Pipeline] } 01:04:19.425 [Pipeline] // dir 01:04:21.001 [Pipeline] dir 01:04:21.001 Running in /var/jenkins/workspace/autotest-nightly/iscsi-vg-autotest_77435 01:04:21.002 [Pipeline] { 01:04:21.144 [Pipeline] copyArtifacts 01:04:23.768 Copied 17 artifacts from "iscsi-vg-autotest" build number 77435 01:04:23.770 [Pipeline] writeFile 01:04:24.755 [Pipeline] } 01:04:25.132 [Pipeline] // dir 01:04:26.326 [Pipeline] dir 01:04:26.327 Running in /var/jenkins/workspace/autotest-nightly/nvmf-tcp-phy-autotest_72248 01:04:26.328 [Pipeline] { 01:04:26.417 [Pipeline] copyArtifacts 01:04:26.945 Copied 14 artifacts from "nvmf-tcp-phy-autotest" build number 72248 01:04:26.948 [Pipeline] writeFile 01:04:27.505 [Pipeline] } 01:04:27.844 [Pipeline] // dir 01:04:28.582 [Pipeline] dir 01:04:28.582 Running in /var/jenkins/workspace/autotest-nightly/nvmf-phy-autotest_72361 01:04:28.583 [Pipeline] { 01:04:28.647 [Pipeline] copyArtifacts 01:04:29.164 Copied 13 artifacts from "nvmf-phy-autotest" build number 72361 01:04:29.168 [Pipeline] writeFile 01:04:29.543 [Pipeline] } 01:04:29.741 [Pipeline] // dir 01:04:30.596 [Pipeline] dir 01:04:30.597 Running in /var/jenkins/workspace/autotest-nightly/dsa-phy-autotest_4817 01:04:30.597 [Pipeline] { 01:04:30.664 [Pipeline] copyArtifacts 01:04:31.117 Copied 14 artifacts from "dsa-phy-autotest" build number 4817 01:04:31.121 [Pipeline] writeFile 01:04:31.495 [Pipeline] } 01:04:31.708 [Pipeline] // dir 01:04:32.561 [Pipeline] dir 01:04:32.561 Running in /var/jenkins/workspace/autotest-nightly/centos7-vg-autotest_73576 01:04:32.562 [Pipeline] { 01:04:32.624 [Pipeline] copyArtifacts 01:04:32.991 Copied 13 artifacts from "centos7-vg-autotest" build number 73576 01:04:32.995 [Pipeline] writeFile 01:04:33.318 [Pipeline] } 01:04:33.489 [Pipeline] // dir 01:04:34.765 [Pipeline] dir 01:04:34.765 Running in /var/jenkins/workspace/autotest-nightly/ubuntu20-vg-autotest_73716 01:04:34.766 [Pipeline] { 01:04:34.849 [Pipeline] copyArtifacts 01:04:35.977 Copied 12 artifacts from "ubuntu20-vg-autotest" build number 73716 01:04:35.981 [Pipeline] writeFile 01:04:36.412 [Pipeline] } 01:04:36.630 [Pipeline] // dir 01:04:38.013 [Pipeline] dir 01:04:38.013 Running in /var/jenkins/workspace/autotest-nightly/rocky9-vg-autotest_16007 01:04:38.014 [Pipeline] { 01:04:38.105 [Pipeline] copyArtifacts 01:04:38.461 Copied 13 artifacts from "rocky9-vg-autotest" build number 16007 01:04:38.465 [Pipeline] writeFile 01:04:38.944 [Pipeline] } 01:04:39.177 [Pipeline] // dir 01:04:40.187 [Pipeline] dir 01:04:40.188 Running in /var/jenkins/workspace/autotest-nightly/ubuntu22-vg-autotest_37730 01:04:40.189 [Pipeline] { 01:04:40.270 [Pipeline] copyArtifacts 01:04:40.656 Copied 12 artifacts from "ubuntu22-vg-autotest" build number 37730 01:04:40.660 [Pipeline] writeFile 01:04:41.183 [Pipeline] } 01:04:41.422 [Pipeline] // dir 01:04:41.431 [Pipeline] catchError 01:04:41.433 [Pipeline] { 01:04:41.456 [Pipeline] sh 01:04:41.731 + jbp/jenkins/jjb-config/jobs/scripts/post_gen_coverage.sh 01:04:41.731 + shopt -s globstar nullglob 01:04:41.731 + echo 'Start stage post_gen_coverage.sh' 01:04:41.731 Start stage post_gen_coverage.sh 01:04:41.731 + cd /var/jenkins/workspace/autotest-nightly 01:04:41.731 + rm -rf /var/jenkins/workspace/autotest-nightly/spdk/doc 01:04:41.731 + trap 'compress_coverage_and_docs; remove_partial_coverage_files && echo '\''End stage post_gen_coverage.sh'\''' EXIT 01:04:41.731 + move_artifacts 01:04:41.731 + local out_dirs 01:04:41.731 + out_dirs=(./**/output/) 01:04:41.731 + for dir in "${out_dirs[@]}" 01:04:41.731 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:41.731 + [[ -f ./autobuild-external-vg-autotest_19750/output//doc.tar.xz ]] 01:04:41.731 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:41.731 + [[ -f ./autobuild-external-vg-autotest_19750/output//ut_coverage.tar.xz ]] 01:04:41.731 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:41.731 + [[ -f ./autobuild-external-vg-autotest_19750/output//llvm.tar.xz ]] 01:04:41.731 + mv ./autobuild-external-vg-autotest_19750/output//build-kernel-manifest.txt ./autobuild-external-vg-autotest_19750/output//build-pkg-manifest.txt ./autobuild-external-vg-autotest_19750/output//build-repo-manifest.txt ./autobuild-external-vg-autotest_19750/output//dmesg.init.log ./autobuild-external-vg-autotest_19750/output//dmesg.log ./autobuild-external-vg-autotest_19750/output//power.tar.xz ./autobuild-external-vg-autotest_19750/output//test_completions.txt ./autobuild-external-vg-autotest_19750/output//timing.svg ./autobuild-external-vg-autotest_19750/output//timing.txt ./autobuild-external-vg-autotest_19750/output//.. 01:04:41.731 + rmdir ./autobuild-external-vg-autotest_19750/output/ 01:04:41.731 + for dir in "${out_dirs[@]}" 01:04:41.731 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:41.731 + [[ -f ./BlobFS-phy-autotest_26123/output//doc.tar.xz ]] 01:04:41.731 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:41.731 + [[ -f ./BlobFS-phy-autotest_26123/output//ut_coverage.tar.xz ]] 01:04:41.731 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:41.731 + [[ -f ./BlobFS-phy-autotest_26123/output//llvm.tar.xz ]] 01:04:41.731 + mv ./BlobFS-phy-autotest_26123/output//all_tests.txt ./BlobFS-phy-autotest_26123/output//build-pkg-manifest.txt ./BlobFS-phy-autotest_26123/output//build-repo-manifest.txt ./BlobFS-phy-autotest_26123/output//cov_base.info.xz ./BlobFS-phy-autotest_26123/output//cov_test.info.xz ./BlobFS-phy-autotest_26123/output//cov_total.info.xz ./BlobFS-phy-autotest_26123/output//dmesg.init.log ./BlobFS-phy-autotest_26123/output//dmesg.log ./BlobFS-phy-autotest_26123/output//power.tar.xz ./BlobFS-phy-autotest_26123/output//rocksdb ./BlobFS-phy-autotest_26123/output//test_completions.txt ./BlobFS-phy-autotest_26123/output//timing.svg ./BlobFS-phy-autotest_26123/output//timing.txt ./BlobFS-phy-autotest_26123/output//.. 01:04:41.731 + rmdir ./BlobFS-phy-autotest_26123/output/ 01:04:41.731 + for dir in "${out_dirs[@]}" 01:04:41.731 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:41.731 + [[ -f ./build-files-docker-autotest_22060/output//doc.tar.xz ]] 01:04:41.731 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:41.731 + [[ -f ./build-files-docker-autotest_22060/output//ut_coverage.tar.xz ]] 01:04:41.731 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:41.731 + [[ -f ./build-files-docker-autotest_22060/output//llvm.tar.xz ]] 01:04:41.731 + mv ./build-files-docker-autotest_22060/output//build-pkg-manifest.txt ./build-files-docker-autotest_22060/output//build-repo-manifest.txt ./build-files-docker-autotest_22060/output//power.tar.xz ./build-files-docker-autotest_22060/output//test_completions.txt ./build-files-docker-autotest_22060/output//timing.txt ./build-files-docker-autotest_22060/output//.. 01:04:41.731 + rmdir ./build-files-docker-autotest_22060/output/ 01:04:41.731 + for dir in "${out_dirs[@]}" 01:04:41.731 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:41.731 + [[ -f ./centos7-vg-autotest_73576/output//doc.tar.xz ]] 01:04:41.731 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:41.731 + [[ -f ./centos7-vg-autotest_73576/output//ut_coverage.tar.xz ]] 01:04:41.731 + tar -C ./centos7-vg-autotest_73576/output/ -xf ./centos7-vg-autotest_73576/output//ut_coverage.tar.xz 01:04:41.989 + rm ./centos7-vg-autotest_73576/output//ut_coverage.tar.xz 01:04:41.989 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:41.989 + [[ -f ./centos7-vg-autotest_73576/output//llvm.tar.xz ]] 01:04:41.989 + mv ./centos7-vg-autotest_73576/output//all_tests.txt ./centos7-vg-autotest_73576/output//build-pkg-manifest.txt ./centos7-vg-autotest_73576/output//build-repo-manifest.txt ./centos7-vg-autotest_73576/output//cov_base.info.xz ./centos7-vg-autotest_73576/output//cov_test.info.xz ./centos7-vg-autotest_73576/output//cov_total.info.xz ./centos7-vg-autotest_73576/output//dmesg.init.log ./centos7-vg-autotest_73576/output//dmesg.log ./centos7-vg-autotest_73576/output//power.tar.xz ./centos7-vg-autotest_73576/output//test_completions.txt ./centos7-vg-autotest_73576/output//timing.svg ./centos7-vg-autotest_73576/output//timing.txt ./centos7-vg-autotest_73576/output//ut_coverage ./centos7-vg-autotest_73576/output//.. 01:04:41.989 + rmdir ./centos7-vg-autotest_73576/output/ 01:04:41.989 + for dir in "${out_dirs[@]}" 01:04:41.989 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:41.989 + [[ -f ./check-format-docker-autotest_22071/output//doc.tar.xz ]] 01:04:41.989 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:41.989 + [[ -f ./check-format-docker-autotest_22071/output//ut_coverage.tar.xz ]] 01:04:41.989 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:41.989 + [[ -f ./check-format-docker-autotest_22071/output//llvm.tar.xz ]] 01:04:41.989 + mv ./check-format-docker-autotest_22071/output//build-pkg-manifest.txt ./check-format-docker-autotest_22071/output//build-repo-manifest.txt ./check-format-docker-autotest_22071/output//power.tar.xz ./check-format-docker-autotest_22071/output//test_completions.txt ./check-format-docker-autotest_22071/output//timing.txt ./check-format-docker-autotest_22071/output//.. 01:04:41.989 + rmdir ./check-format-docker-autotest_22071/output/ 01:04:41.989 + for dir in "${out_dirs[@]}" 01:04:41.989 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:41.989 + [[ -f ./check-so-deps-docker-autotest_22084/output//doc.tar.xz ]] 01:04:41.989 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:41.989 + [[ -f ./check-so-deps-docker-autotest_22084/output//ut_coverage.tar.xz ]] 01:04:41.989 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:41.989 + [[ -f ./check-so-deps-docker-autotest_22084/output//llvm.tar.xz ]] 01:04:41.989 + mv ./check-so-deps-docker-autotest_22084/output//build-pkg-manifest.txt ./check-so-deps-docker-autotest_22084/output//build-repo-manifest.txt ./check-so-deps-docker-autotest_22084/output//power.tar.xz ./check-so-deps-docker-autotest_22084/output//test_completions.txt ./check-so-deps-docker-autotest_22084/output//timing.txt ./check-so-deps-docker-autotest_22084/output//.. 01:04:41.989 + rmdir ./check-so-deps-docker-autotest_22084/output/ 01:04:41.989 + for dir in "${out_dirs[@]}" 01:04:41.989 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:41.989 + [[ -f ./crypto-phy-autotest_26117/output//doc.tar.xz ]] 01:04:41.989 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:41.989 + [[ -f ./crypto-phy-autotest_26117/output//ut_coverage.tar.xz ]] 01:04:41.989 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:41.989 + [[ -f ./crypto-phy-autotest_26117/output//llvm.tar.xz ]] 01:04:41.989 + mv ./crypto-phy-autotest_26117/output//all_tests.txt ./crypto-phy-autotest_26117/output//build-pkg-manifest.txt ./crypto-phy-autotest_26117/output//build-repo-manifest.txt ./crypto-phy-autotest_26117/output//cov_base.info.xz ./crypto-phy-autotest_26117/output//cov_test.info.xz ./crypto-phy-autotest_26117/output//cov_total.info.xz ./crypto-phy-autotest_26117/output//dmesg.init.log ./crypto-phy-autotest_26117/output//dmesg.log ./crypto-phy-autotest_26117/output//power.tar.xz ./crypto-phy-autotest_26117/output//test_completions.txt ./crypto-phy-autotest_26117/output//timing.svg ./crypto-phy-autotest_26117/output//timing.txt ./crypto-phy-autotest_26117/output//.. 01:04:41.989 + rmdir ./crypto-phy-autotest_26117/output/ 01:04:41.989 + for dir in "${out_dirs[@]}" 01:04:41.989 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:41.989 + [[ -f ./doc-docker-autotest_22251/output//doc.tar.xz ]] 01:04:41.989 + tar -C ./doc-docker-autotest_22251/output/ -xf ./doc-docker-autotest_22251/output//doc.tar.xz 01:04:42.248 + rm ./doc-docker-autotest_22251/output//doc.tar.xz 01:04:42.248 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.248 + [[ -f ./doc-docker-autotest_22251/output//ut_coverage.tar.xz ]] 01:04:42.248 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.248 + [[ -f ./doc-docker-autotest_22251/output//llvm.tar.xz ]] 01:04:42.248 + mv ./doc-docker-autotest_22251/output//build-pkg-manifest.txt ./doc-docker-autotest_22251/output//build-repo-manifest.txt ./doc-docker-autotest_22251/output//doc ./doc-docker-autotest_22251/output//power.tar.xz ./doc-docker-autotest_22251/output//test_completions.txt ./doc-docker-autotest_22251/output//timing.txt ./doc-docker-autotest_22251/output//.. 01:04:42.248 + rmdir ./doc-docker-autotest_22251/output/ 01:04:42.248 + for dir in "${out_dirs[@]}" 01:04:42.248 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.248 + [[ -f ./dsa-phy-autotest_4817/output//doc.tar.xz ]] 01:04:42.248 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.248 + [[ -f ./dsa-phy-autotest_4817/output//ut_coverage.tar.xz ]] 01:04:42.248 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.248 + [[ -f ./dsa-phy-autotest_4817/output//llvm.tar.xz ]] 01:04:42.248 + mv ./dsa-phy-autotest_4817/output//all_tests.txt ./dsa-phy-autotest_4817/output//build-pkg-manifest.txt ./dsa-phy-autotest_4817/output//build-repo-manifest.txt ./dsa-phy-autotest_4817/output//cov_base.info.xz ./dsa-phy-autotest_4817/output//cov_test.info.xz ./dsa-phy-autotest_4817/output//cov_total.info.xz ./dsa-phy-autotest_4817/output//dmesg.init.log ./dsa-phy-autotest_4817/output//dmesg.log ./dsa-phy-autotest_4817/output//nvmf_fuzz_tgt_output.txt ./dsa-phy-autotest_4817/output//nvmf_trace.0_shm.tar.gz ./dsa-phy-autotest_4817/output//power.tar.xz ./dsa-phy-autotest_4817/output//test_completions.txt ./dsa-phy-autotest_4817/output//timing.svg ./dsa-phy-autotest_4817/output//timing.txt ./dsa-phy-autotest_4817/output//.. 01:04:42.248 + rmdir ./dsa-phy-autotest_4817/output/ 01:04:42.248 + for dir in "${out_dirs[@]}" 01:04:42.248 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.248 + [[ -f ./freebsd-vg-autotest_59050/output//doc.tar.xz ]] 01:04:42.248 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.248 + [[ -f ./freebsd-vg-autotest_59050/output//ut_coverage.tar.xz ]] 01:04:42.248 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.248 + [[ -f ./freebsd-vg-autotest_59050/output//llvm.tar.xz ]] 01:04:42.248 + mv ./freebsd-vg-autotest_59050/output//all_tests.txt ./freebsd-vg-autotest_59050/output//build-pkg-manifest.txt ./freebsd-vg-autotest_59050/output//build-repo-manifest.txt ./freebsd-vg-autotest_59050/output//messages ./freebsd-vg-autotest_59050/output//power.tar.xz ./freebsd-vg-autotest_59050/output//test_completions.txt ./freebsd-vg-autotest_59050/output//timing.txt ./freebsd-vg-autotest_59050/output//.. 01:04:42.248 + rmdir ./freebsd-vg-autotest_59050/output/ 01:04:42.248 + for dir in "${out_dirs[@]}" 01:04:42.248 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.248 + [[ -f ./iscsi-uring-vg-autotest_77302/output//doc.tar.xz ]] 01:04:42.248 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.248 + [[ -f ./iscsi-uring-vg-autotest_77302/output//ut_coverage.tar.xz ]] 01:04:42.248 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.248 + [[ -f ./iscsi-uring-vg-autotest_77302/output//llvm.tar.xz ]] 01:04:42.248 + mv ./iscsi-uring-vg-autotest_77302/output//all_tests.txt ./iscsi-uring-vg-autotest_77302/output//build-pkg-manifest.txt ./iscsi-uring-vg-autotest_77302/output//build-repo-manifest.txt ./iscsi-uring-vg-autotest_77302/output//calsoft.json ./iscsi-uring-vg-autotest_77302/output//calsoft.tar.xz ./iscsi-uring-vg-autotest_77302/output//cov_base.info.xz ./iscsi-uring-vg-autotest_77302/output//cov_test.info.xz ./iscsi-uring-vg-autotest_77302/output//cov_total.info.xz ./iscsi-uring-vg-autotest_77302/output//dmesg.init.log ./iscsi-uring-vg-autotest_77302/output//dmesg.log ./iscsi-uring-vg-autotest_77302/output//iscsi_autofuzz_logs.txt ./iscsi-uring-vg-autotest_77302/output//iscsi_autofuzz_tgt_output.txt ./iscsi-uring-vg-autotest_77302/output//power.tar.xz ./iscsi-uring-vg-autotest_77302/output//test_completions.txt ./iscsi-uring-vg-autotest_77302/output//timing.svg ./iscsi-uring-vg-autotest_77302/output//timing.txt ./iscsi-uring-vg-autotest_77302/output//.. 01:04:42.248 + rmdir ./iscsi-uring-vg-autotest_77302/output/ 01:04:42.248 + for dir in "${out_dirs[@]}" 01:04:42.248 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.248 + [[ -f ./iscsi-vg-autotest_77435/output//doc.tar.xz ]] 01:04:42.248 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.248 + [[ -f ./iscsi-vg-autotest_77435/output//ut_coverage.tar.xz ]] 01:04:42.248 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.248 + [[ -f ./iscsi-vg-autotest_77435/output//llvm.tar.xz ]] 01:04:42.248 + mv ./iscsi-vg-autotest_77435/output//all_tests.txt ./iscsi-vg-autotest_77435/output//build-kernel-manifest.txt ./iscsi-vg-autotest_77435/output//build-pkg-manifest.txt ./iscsi-vg-autotest_77435/output//build-repo-manifest.txt ./iscsi-vg-autotest_77435/output//calsoft.json ./iscsi-vg-autotest_77435/output//calsoft.tar.xz ./iscsi-vg-autotest_77435/output//cov_base.info.xz ./iscsi-vg-autotest_77435/output//cov_test.info.xz ./iscsi-vg-autotest_77435/output//cov_total.info.xz ./iscsi-vg-autotest_77435/output//dmesg.init.log ./iscsi-vg-autotest_77435/output//dmesg.log ./iscsi-vg-autotest_77435/output//iscsi_autofuzz_logs.txt ./iscsi-vg-autotest_77435/output//iscsi_autofuzz_tgt_output.txt ./iscsi-vg-autotest_77435/output//power.tar.xz ./iscsi-vg-autotest_77435/output//test_completions.txt ./iscsi-vg-autotest_77435/output//timing.svg ./iscsi-vg-autotest_77435/output//timing.txt ./iscsi-vg-autotest_77435/output//.. 01:04:42.248 + rmdir ./iscsi-vg-autotest_77435/output/ 01:04:42.248 + for dir in "${out_dirs[@]}" 01:04:42.248 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.248 + [[ -f ./lvol-vg-autotest_77346/output//doc.tar.xz ]] 01:04:42.248 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.248 + [[ -f ./lvol-vg-autotest_77346/output//ut_coverage.tar.xz ]] 01:04:42.248 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.248 + [[ -f ./lvol-vg-autotest_77346/output//llvm.tar.xz ]] 01:04:42.248 + mv ./lvol-vg-autotest_77346/output//all_tests.txt ./lvol-vg-autotest_77346/output//build-pkg-manifest.txt ./lvol-vg-autotest_77346/output//build-repo-manifest.txt ./lvol-vg-autotest_77346/output//cov_base.info.xz ./lvol-vg-autotest_77346/output//cov_test.info.xz ./lvol-vg-autotest_77346/output//cov_total.info.xz ./lvol-vg-autotest_77346/output//dmesg.init.log ./lvol-vg-autotest_77346/output//dmesg.log ./lvol-vg-autotest_77346/output//power.tar.xz ./lvol-vg-autotest_77346/output//test_completions.txt ./lvol-vg-autotest_77346/output//timing.svg ./lvol-vg-autotest_77346/output//timing.txt ./lvol-vg-autotest_77346/output//.. 01:04:42.248 + rmdir ./lvol-vg-autotest_77346/output/ 01:04:42.248 + for dir in "${out_dirs[@]}" 01:04:42.248 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.248 + [[ -f ./nvme-cmb-pmr-vg-autotest_78520/output//doc.tar.xz ]] 01:04:42.248 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.248 + [[ -f ./nvme-cmb-pmr-vg-autotest_78520/output//ut_coverage.tar.xz ]] 01:04:42.248 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.248 + [[ -f ./nvme-cmb-pmr-vg-autotest_78520/output//llvm.tar.xz ]] 01:04:42.248 + mv ./nvme-cmb-pmr-vg-autotest_78520/output//all_tests.txt ./nvme-cmb-pmr-vg-autotest_78520/output//build-pkg-manifest.txt ./nvme-cmb-pmr-vg-autotest_78520/output//build-repo-manifest.txt ./nvme-cmb-pmr-vg-autotest_78520/output//cov_base.info.xz ./nvme-cmb-pmr-vg-autotest_78520/output//cov_test.info.xz ./nvme-cmb-pmr-vg-autotest_78520/output//cov_total.info.xz ./nvme-cmb-pmr-vg-autotest_78520/output//dmesg.init.log ./nvme-cmb-pmr-vg-autotest_78520/output//dmesg.log ./nvme-cmb-pmr-vg-autotest_78520/output//power.tar.xz ./nvme-cmb-pmr-vg-autotest_78520/output//test_completions.txt ./nvme-cmb-pmr-vg-autotest_78520/output//timing.svg ./nvme-cmb-pmr-vg-autotest_78520/output//timing.txt ./nvme-cmb-pmr-vg-autotest_78520/output//.. 01:04:42.248 + rmdir ./nvme-cmb-pmr-vg-autotest_78520/output/ 01:04:42.248 + for dir in "${out_dirs[@]}" 01:04:42.248 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.248 + [[ -f ./nvme-phy-autotest_72289/output//doc.tar.xz ]] 01:04:42.248 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.248 + [[ -f ./nvme-phy-autotest_72289/output//ut_coverage.tar.xz ]] 01:04:42.248 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.248 + [[ -f ./nvme-phy-autotest_72289/output//llvm.tar.xz ]] 01:04:42.248 + mv ./nvme-phy-autotest_72289/output//all_tests.txt ./nvme-phy-autotest_72289/output//build-pkg-manifest.txt ./nvme-phy-autotest_72289/output//build-repo-manifest.txt ./nvme-phy-autotest_72289/output//cov_base.info.xz ./nvme-phy-autotest_72289/output//cov_test.info.xz ./nvme-phy-autotest_72289/output//cov_total.info.xz ./nvme-phy-autotest_72289/output//dmesg.init.log ./nvme-phy-autotest_72289/output//dmesg.log ./nvme-phy-autotest_72289/output//power.tar.xz ./nvme-phy-autotest_72289/output//test_completions.txt ./nvme-phy-autotest_72289/output//timing.svg ./nvme-phy-autotest_72289/output//timing.txt ./nvme-phy-autotest_72289/output//.. 01:04:42.248 + rmdir ./nvme-phy-autotest_72289/output/ 01:04:42.248 + for dir in "${out_dirs[@]}" 01:04:42.248 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.249 + [[ -f ./nvme-vg-autotest_77397/output//doc.tar.xz ]] 01:04:42.249 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.249 + [[ -f ./nvme-vg-autotest_77397/output//ut_coverage.tar.xz ]] 01:04:42.249 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.249 + [[ -f ./nvme-vg-autotest_77397/output//llvm.tar.xz ]] 01:04:42.249 + mv ./nvme-vg-autotest_77397/output//all_tests.txt ./nvme-vg-autotest_77397/output//build-pkg-manifest.txt ./nvme-vg-autotest_77397/output//build-repo-manifest.txt ./nvme-vg-autotest_77397/output//cov_base.info.xz ./nvme-vg-autotest_77397/output//dmesg.init.log ./nvme-vg-autotest_77397/output//dmesg.log ./nvme-vg-autotest_77397/output//power.tar.xz ./nvme-vg-autotest_77397/output//proc_list.txt ./nvme-vg-autotest_77397/output//test_completions.txt ./nvme-vg-autotest_77397/output//timing.txt ./nvme-vg-autotest_77397/output//udev.log ./nvme-vg-autotest_77397/output//.. 01:04:42.249 + rmdir ./nvme-vg-autotest_77397/output/ 01:04:42.249 + for dir in "${out_dirs[@]}" 01:04:42.249 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.249 + [[ -f ./nvmf-cvl-phy-autotest_3013/output//doc.tar.xz ]] 01:04:42.249 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.249 + [[ -f ./nvmf-cvl-phy-autotest_3013/output//ut_coverage.tar.xz ]] 01:04:42.249 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.249 + [[ -f ./nvmf-cvl-phy-autotest_3013/output//llvm.tar.xz ]] 01:04:42.249 + mv ./nvmf-cvl-phy-autotest_3013/output//all_tests.txt ./nvmf-cvl-phy-autotest_3013/output//build-pkg-manifest.txt ./nvmf-cvl-phy-autotest_3013/output//build-repo-manifest.txt ./nvmf-cvl-phy-autotest_3013/output//cov_base.info.xz ./nvmf-cvl-phy-autotest_3013/output//cov_test.info.xz ./nvmf-cvl-phy-autotest_3013/output//cov_total.info.xz ./nvmf-cvl-phy-autotest_3013/output//dmesg.init.log ./nvmf-cvl-phy-autotest_3013/output//dmesg.log ./nvmf-cvl-phy-autotest_3013/output//nvmf_fuzz_tgt_output.txt ./nvmf-cvl-phy-autotest_3013/output//nvmf_trace.0_shm.tar.gz ./nvmf-cvl-phy-autotest_3013/output//power.tar.xz ./nvmf-cvl-phy-autotest_3013/output//test_completions.txt ./nvmf-cvl-phy-autotest_3013/output//timing.svg ./nvmf-cvl-phy-autotest_3013/output//timing.txt ./nvmf-cvl-phy-autotest_3013/output//.. 01:04:42.249 + rmdir ./nvmf-cvl-phy-autotest_3013/output/ 01:04:42.249 + for dir in "${out_dirs[@]}" 01:04:42.249 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.249 + [[ -f ./nvmf-phy-autotest_72361/output//doc.tar.xz ]] 01:04:42.249 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.249 + [[ -f ./nvmf-phy-autotest_72361/output//ut_coverage.tar.xz ]] 01:04:42.249 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.249 + [[ -f ./nvmf-phy-autotest_72361/output//llvm.tar.xz ]] 01:04:42.249 + mv ./nvmf-phy-autotest_72361/output//all_tests.txt ./nvmf-phy-autotest_72361/output//build-pkg-manifest.txt ./nvmf-phy-autotest_72361/output//build-repo-manifest.txt ./nvmf-phy-autotest_72361/output//cov_base.info.xz ./nvmf-phy-autotest_72361/output//dmesg.init.log ./nvmf-phy-autotest_72361/output//dmesg.log ./nvmf-phy-autotest_72361/output//nvme-auth.log ./nvmf-phy-autotest_72361/output//nvmf_fuzz_tgt_output.txt ./nvmf-phy-autotest_72361/output//nvmf_trace.0_shm.tar.gz ./nvmf-phy-autotest_72361/output//power.tar.xz ./nvmf-phy-autotest_72361/output//test_completions.txt ./nvmf-phy-autotest_72361/output//timing.txt ./nvmf-phy-autotest_72361/output//udev.log ./nvmf-phy-autotest_72361/output//.. 01:04:42.249 + rmdir ./nvmf-phy-autotest_72361/output/ 01:04:42.249 + for dir in "${out_dirs[@]}" 01:04:42.249 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.249 + [[ -f ./nvmf-tcp-phy-autotest_72248/output//doc.tar.xz ]] 01:04:42.249 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.249 + [[ -f ./nvmf-tcp-phy-autotest_72248/output//ut_coverage.tar.xz ]] 01:04:42.249 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.249 + [[ -f ./nvmf-tcp-phy-autotest_72248/output//llvm.tar.xz ]] 01:04:42.249 + mv ./nvmf-tcp-phy-autotest_72248/output//all_tests.txt ./nvmf-tcp-phy-autotest_72248/output//build-pkg-manifest.txt ./nvmf-tcp-phy-autotest_72248/output//build-repo-manifest.txt ./nvmf-tcp-phy-autotest_72248/output//cov_base.info.xz ./nvmf-tcp-phy-autotest_72248/output//cov_test.info.xz ./nvmf-tcp-phy-autotest_72248/output//cov_total.info.xz ./nvmf-tcp-phy-autotest_72248/output//dmesg.init.log ./nvmf-tcp-phy-autotest_72248/output//dmesg.log ./nvmf-tcp-phy-autotest_72248/output//nvmf_fuzz_tgt_output.txt ./nvmf-tcp-phy-autotest_72248/output//nvmf_trace.0_shm.tar.gz ./nvmf-tcp-phy-autotest_72248/output//power.tar.xz ./nvmf-tcp-phy-autotest_72248/output//test_completions.txt ./nvmf-tcp-phy-autotest_72248/output//timing.svg ./nvmf-tcp-phy-autotest_72248/output//timing.txt ./nvmf-tcp-phy-autotest_72248/output//.. 01:04:42.249 + rmdir ./nvmf-tcp-phy-autotest_72248/output/ 01:04:42.249 + for dir in "${out_dirs[@]}" 01:04:42.249 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.249 + [[ -f ./nvmf-tcp-uring-vg-autotest_77322/output//doc.tar.xz ]] 01:04:42.249 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.249 + [[ -f ./nvmf-tcp-uring-vg-autotest_77322/output//ut_coverage.tar.xz ]] 01:04:42.249 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.249 + [[ -f ./nvmf-tcp-uring-vg-autotest_77322/output//llvm.tar.xz ]] 01:04:42.249 + mv ./nvmf-tcp-uring-vg-autotest_77322/output//all_tests.txt ./nvmf-tcp-uring-vg-autotest_77322/output//build-pkg-manifest.txt ./nvmf-tcp-uring-vg-autotest_77322/output//build-repo-manifest.txt ./nvmf-tcp-uring-vg-autotest_77322/output//cov_base.info.xz ./nvmf-tcp-uring-vg-autotest_77322/output//cov_test.info.xz ./nvmf-tcp-uring-vg-autotest_77322/output//cov_total.info.xz ./nvmf-tcp-uring-vg-autotest_77322/output//dmesg.init.log ./nvmf-tcp-uring-vg-autotest_77322/output//dmesg.log ./nvmf-tcp-uring-vg-autotest_77322/output//nvmf_fuzz_tgt_output.txt ./nvmf-tcp-uring-vg-autotest_77322/output//nvmf_trace.0_shm.tar.gz ./nvmf-tcp-uring-vg-autotest_77322/output//power.tar.xz ./nvmf-tcp-uring-vg-autotest_77322/output//test_completions.txt ./nvmf-tcp-uring-vg-autotest_77322/output//timing.svg ./nvmf-tcp-uring-vg-autotest_77322/output//timing.txt ./nvmf-tcp-uring-vg-autotest_77322/output//.. 01:04:42.249 + rmdir ./nvmf-tcp-uring-vg-autotest_77322/output/ 01:04:42.249 + for dir in "${out_dirs[@]}" 01:04:42.249 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.249 + [[ -f ./nvmf-tcp-vg-autotest_77388/output//doc.tar.xz ]] 01:04:42.249 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.249 + [[ -f ./nvmf-tcp-vg-autotest_77388/output//ut_coverage.tar.xz ]] 01:04:42.249 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.249 + [[ -f ./nvmf-tcp-vg-autotest_77388/output//llvm.tar.xz ]] 01:04:42.249 + mv ./nvmf-tcp-vg-autotest_77388/output//all_tests.txt ./nvmf-tcp-vg-autotest_77388/output//build-pkg-manifest.txt ./nvmf-tcp-vg-autotest_77388/output//build-repo-manifest.txt ./nvmf-tcp-vg-autotest_77388/output//cov_base.info.xz ./nvmf-tcp-vg-autotest_77388/output//cov_test.info.xz ./nvmf-tcp-vg-autotest_77388/output//cov_total.info.xz ./nvmf-tcp-vg-autotest_77388/output//dmesg.init.log ./nvmf-tcp-vg-autotest_77388/output//dmesg.log ./nvmf-tcp-vg-autotest_77388/output//nvmf_fuzz_tgt_output.txt ./nvmf-tcp-vg-autotest_77388/output//nvmf_trace.0_shm.tar.gz ./nvmf-tcp-vg-autotest_77388/output//power.tar.xz ./nvmf-tcp-vg-autotest_77388/output//test_completions.txt ./nvmf-tcp-vg-autotest_77388/output//timing.svg ./nvmf-tcp-vg-autotest_77388/output//timing.txt ./nvmf-tcp-vg-autotest_77388/output//.. 01:04:42.249 + rmdir ./nvmf-tcp-vg-autotest_77388/output/ 01:04:42.249 + for dir in "${out_dirs[@]}" 01:04:42.249 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.249 + [[ -f ./packaging-docker-autotest_19789/output//doc.tar.xz ]] 01:04:42.249 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.249 + [[ -f ./packaging-docker-autotest_19789/output//ut_coverage.tar.xz ]] 01:04:42.249 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.249 + [[ -f ./packaging-docker-autotest_19789/output//llvm.tar.xz ]] 01:04:42.249 + mv ./packaging-docker-autotest_19789/output//build-pkg-manifest.txt ./packaging-docker-autotest_19789/output//build-repo-manifest.txt ./packaging-docker-autotest_19789/output//power.tar.xz ./packaging-docker-autotest_19789/output//test_completions.txt ./packaging-docker-autotest_19789/output//timing.txt ./packaging-docker-autotest_19789/output//.. 01:04:42.249 + rmdir ./packaging-docker-autotest_19789/output/ 01:04:42.249 + for dir in "${out_dirs[@]}" 01:04:42.249 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.249 + [[ -f ./rocky9-vg-autotest_16007/output//doc.tar.xz ]] 01:04:42.249 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.249 + [[ -f ./rocky9-vg-autotest_16007/output//ut_coverage.tar.xz ]] 01:04:42.249 + tar -C ./rocky9-vg-autotest_16007/output/ -xf ./rocky9-vg-autotest_16007/output//ut_coverage.tar.xz 01:04:42.249 + rm ./rocky9-vg-autotest_16007/output//ut_coverage.tar.xz 01:04:42.249 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.249 + [[ -f ./rocky9-vg-autotest_16007/output//llvm.tar.xz ]] 01:04:42.249 + mv ./rocky9-vg-autotest_16007/output//all_tests.txt ./rocky9-vg-autotest_16007/output//build-pkg-manifest.txt ./rocky9-vg-autotest_16007/output//build-repo-manifest.txt ./rocky9-vg-autotest_16007/output//cov_base.info.xz ./rocky9-vg-autotest_16007/output//cov_test.info.xz ./rocky9-vg-autotest_16007/output//cov_total.info.xz ./rocky9-vg-autotest_16007/output//dmesg.init.log ./rocky9-vg-autotest_16007/output//dmesg.log ./rocky9-vg-autotest_16007/output//power.tar.xz ./rocky9-vg-autotest_16007/output//test_completions.txt ./rocky9-vg-autotest_16007/output//timing.svg ./rocky9-vg-autotest_16007/output//timing.txt ./rocky9-vg-autotest_16007/output//ut_coverage ./rocky9-vg-autotest_16007/output//.. 01:04:42.249 + rmdir ./rocky9-vg-autotest_16007/output/ 01:04:42.249 + for dir in "${out_dirs[@]}" 01:04:42.249 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.249 + [[ -f ./scan-build-docker-autotest_19790/output//doc.tar.xz ]] 01:04:42.249 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.249 + [[ -f ./scan-build-docker-autotest_19790/output//ut_coverage.tar.xz ]] 01:04:42.249 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.249 + [[ -f ./scan-build-docker-autotest_19790/output//llvm.tar.xz ]] 01:04:42.249 + mv ./scan-build-docker-autotest_19790/output//all_c_files.txt ./scan-build-docker-autotest_19790/output//build_output.txt ./scan-build-docker-autotest_19790/output//build-pkg-manifest.txt ./scan-build-docker-autotest_19790/output//build-repo-manifest.txt ./scan-build-docker-autotest_19790/output//built_c_files.txt ./scan-build-docker-autotest_19790/output//power.tar.xz ./scan-build-docker-autotest_19790/output//test_completions.txt ./scan-build-docker-autotest_19790/output//timing.txt ./scan-build-docker-autotest_19790/output//unbuilt_c_files.txt ./scan-build-docker-autotest_19790/output//.. 01:04:42.249 + rmdir ./scan-build-docker-autotest_19790/output/ 01:04:42.249 + for dir in "${out_dirs[@]}" 01:04:42.249 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.249 + [[ -f ./short-fuzz-phy-autotest_26114/output//doc.tar.xz ]] 01:04:42.249 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.249 + [[ -f ./short-fuzz-phy-autotest_26114/output//ut_coverage.tar.xz ]] 01:04:42.249 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.249 + [[ -f ./short-fuzz-phy-autotest_26114/output//llvm.tar.xz ]] 01:04:42.249 + tar -C ./short-fuzz-phy-autotest_26114/output/ -xf ./short-fuzz-phy-autotest_26114/output//llvm.tar.xz 01:04:42.249 + rm ./short-fuzz-phy-autotest_26114/output//llvm.tar.xz 01:04:42.507 + mv ./short-fuzz-phy-autotest_26114/output//all_tests.txt ./short-fuzz-phy-autotest_26114/output//build-pkg-manifest.txt ./short-fuzz-phy-autotest_26114/output//build-repo-manifest.txt ./short-fuzz-phy-autotest_26114/output//dmesg.init.log ./short-fuzz-phy-autotest_26114/output//dmesg.log ./short-fuzz-phy-autotest_26114/output//llvm ./short-fuzz-phy-autotest_26114/output//power.tar.xz ./short-fuzz-phy-autotest_26114/output//test_completions.txt ./short-fuzz-phy-autotest_26114/output//timing.svg ./short-fuzz-phy-autotest_26114/output//timing.txt ./short-fuzz-phy-autotest_26114/output//.. 01:04:42.507 + rmdir ./short-fuzz-phy-autotest_26114/output/ 01:04:42.507 + for dir in "${out_dirs[@]}" 01:04:42.507 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.507 + [[ -f ./ubuntu20-vg-autotest_73716/output//doc.tar.xz ]] 01:04:42.507 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.507 + [[ -f ./ubuntu20-vg-autotest_73716/output//ut_coverage.tar.xz ]] 01:04:42.507 + tar -C ./ubuntu20-vg-autotest_73716/output/ -xf ./ubuntu20-vg-autotest_73716/output//ut_coverage.tar.xz 01:04:42.507 + rm ./ubuntu20-vg-autotest_73716/output//ut_coverage.tar.xz 01:04:42.507 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.507 + [[ -f ./ubuntu20-vg-autotest_73716/output//llvm.tar.xz ]] 01:04:42.507 + mv ./ubuntu20-vg-autotest_73716/output//all_tests.txt ./ubuntu20-vg-autotest_73716/output//build-pkg-manifest.txt ./ubuntu20-vg-autotest_73716/output//build-repo-manifest.txt ./ubuntu20-vg-autotest_73716/output//cov_base.info.xz ./ubuntu20-vg-autotest_73716/output//dmesg.init.log ./ubuntu20-vg-autotest_73716/output//dmesg.log ./ubuntu20-vg-autotest_73716/output//power.tar.xz ./ubuntu20-vg-autotest_73716/output//proc_list.txt ./ubuntu20-vg-autotest_73716/output//test_completions.txt ./ubuntu20-vg-autotest_73716/output//timing.txt ./ubuntu20-vg-autotest_73716/output//udev.log ./ubuntu20-vg-autotest_73716/output//ut_coverage ./ubuntu20-vg-autotest_73716/output//.. 01:04:42.507 + rmdir ./ubuntu20-vg-autotest_73716/output/ 01:04:42.507 + for dir in "${out_dirs[@]}" 01:04:42.507 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.507 + [[ -f ./ubuntu22-vg-autotest_37730/output//doc.tar.xz ]] 01:04:42.507 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.507 + [[ -f ./ubuntu22-vg-autotest_37730/output//ut_coverage.tar.xz ]] 01:04:42.507 + tar -C ./ubuntu22-vg-autotest_37730/output/ -xf ./ubuntu22-vg-autotest_37730/output//ut_coverage.tar.xz 01:04:42.765 + rm ./ubuntu22-vg-autotest_37730/output//ut_coverage.tar.xz 01:04:42.765 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.765 + [[ -f ./ubuntu22-vg-autotest_37730/output//llvm.tar.xz ]] 01:04:42.765 + mv ./ubuntu22-vg-autotest_37730/output//all_tests.txt ./ubuntu22-vg-autotest_37730/output//build-pkg-manifest.txt ./ubuntu22-vg-autotest_37730/output//build-repo-manifest.txt ./ubuntu22-vg-autotest_37730/output//cov_base.info.xz ./ubuntu22-vg-autotest_37730/output//cov_test.info.xz ./ubuntu22-vg-autotest_37730/output//cov_total.info.xz ./ubuntu22-vg-autotest_37730/output//dmesg.init.log ./ubuntu22-vg-autotest_37730/output//dmesg.log ./ubuntu22-vg-autotest_37730/output//power.tar.xz ./ubuntu22-vg-autotest_37730/output//test_completions.txt ./ubuntu22-vg-autotest_37730/output//timing.txt ./ubuntu22-vg-autotest_37730/output//ut_coverage ./ubuntu22-vg-autotest_37730/output//.. 01:04:42.765 + rmdir ./ubuntu22-vg-autotest_37730/output/ 01:04:42.765 + for dir in "${out_dirs[@]}" 01:04:42.765 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.765 + [[ -f ./unittest-clang-docker-autotest_19787/output//doc.tar.xz ]] 01:04:42.765 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.765 + [[ -f ./unittest-clang-docker-autotest_19787/output//ut_coverage.tar.xz ]] 01:04:42.765 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.765 + [[ -f ./unittest-clang-docker-autotest_19787/output//llvm.tar.xz ]] 01:04:42.765 + mv ./unittest-clang-docker-autotest_19787/output//build-pkg-manifest.txt ./unittest-clang-docker-autotest_19787/output//build-repo-manifest.txt ./unittest-clang-docker-autotest_19787/output//power.tar.xz ./unittest-clang-docker-autotest_19787/output//test_completions.txt ./unittest-clang-docker-autotest_19787/output//timing.txt ./unittest-clang-docker-autotest_19787/output//.. 01:04:42.765 + rmdir ./unittest-clang-docker-autotest_19787/output/ 01:04:42.765 + for dir in "${out_dirs[@]}" 01:04:42.765 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.765 + [[ -f ./unittest-main-docker-autotest_19788/output//doc.tar.xz ]] 01:04:42.765 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:42.765 + [[ -f ./unittest-main-docker-autotest_19788/output//ut_coverage.tar.xz ]] 01:04:42.765 + tar -C ./unittest-main-docker-autotest_19788/output/ -xf ./unittest-main-docker-autotest_19788/output//ut_coverage.tar.xz 01:04:43.023 + rm ./unittest-main-docker-autotest_19788/output//ut_coverage.tar.xz 01:04:43.023 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:43.023 + [[ -f ./unittest-main-docker-autotest_19788/output//llvm.tar.xz ]] 01:04:43.023 + mv ./unittest-main-docker-autotest_19788/output//build-pkg-manifest.txt ./unittest-main-docker-autotest_19788/output//build-repo-manifest.txt ./unittest-main-docker-autotest_19788/output//power.tar.xz ./unittest-main-docker-autotest_19788/output//test_completions.txt ./unittest-main-docker-autotest_19788/output//timing.txt ./unittest-main-docker-autotest_19788/output//ut_coverage ./unittest-main-docker-autotest_19788/output//.. 01:04:43.023 + rmdir ./unittest-main-docker-autotest_19788/output/ 01:04:43.023 + for dir in "${out_dirs[@]}" 01:04:43.023 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:43.023 + [[ -f ./unittest-valgrind-docker-autotest_19791/output//doc.tar.xz ]] 01:04:43.023 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:43.023 + [[ -f ./unittest-valgrind-docker-autotest_19791/output//ut_coverage.tar.xz ]] 01:04:43.023 + tar -C ./unittest-valgrind-docker-autotest_19791/output/ -xf ./unittest-valgrind-docker-autotest_19791/output//ut_coverage.tar.xz 01:04:43.281 + rm ./unittest-valgrind-docker-autotest_19791/output//ut_coverage.tar.xz 01:04:43.281 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:43.281 + [[ -f ./unittest-valgrind-docker-autotest_19791/output//llvm.tar.xz ]] 01:04:43.281 + mv ./unittest-valgrind-docker-autotest_19791/output//build-pkg-manifest.txt ./unittest-valgrind-docker-autotest_19791/output//build-repo-manifest.txt ./unittest-valgrind-docker-autotest_19791/output//power.tar.xz ./unittest-valgrind-docker-autotest_19791/output//test_completions.txt ./unittest-valgrind-docker-autotest_19791/output//timing.txt ./unittest-valgrind-docker-autotest_19791/output//ut_coverage ./unittest-valgrind-docker-autotest_19791/output//.. 01:04:43.281 + rmdir ./unittest-valgrind-docker-autotest_19791/output/ 01:04:43.281 + for dir in "${out_dirs[@]}" 01:04:43.281 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:43.281 + [[ -f ./vfio-user-phy-autotest_26125/output//doc.tar.xz ]] 01:04:43.281 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:43.281 + [[ -f ./vfio-user-phy-autotest_26125/output//ut_coverage.tar.xz ]] 01:04:43.281 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:43.281 + [[ -f ./vfio-user-phy-autotest_26125/output//llvm.tar.xz ]] 01:04:43.281 + mv ./vfio-user-phy-autotest_26125/output//all_tests.txt ./vfio-user-phy-autotest_26125/output//build-pkg-manifest.txt ./vfio-user-phy-autotest_26125/output//build-repo-manifest.txt ./vfio-user-phy-autotest_26125/output//cov_base.info.xz ./vfio-user-phy-autotest_26125/output//cov_test.info.xz ./vfio-user-phy-autotest_26125/output//cov_total.info.xz ./vfio-user-phy-autotest_26125/output//dmesg.init.log ./vfio-user-phy-autotest_26125/output//dmesg.log ./vfio-user-phy-autotest_26125/output//power.tar.xz ./vfio-user-phy-autotest_26125/output//test_completions.txt ./vfio-user-phy-autotest_26125/output//timing.svg ./vfio-user-phy-autotest_26125/output//timing.txt ./vfio-user-phy-autotest_26125/output//.. 01:04:43.281 + rmdir ./vfio-user-phy-autotest_26125/output/ 01:04:43.281 + for dir in "${out_dirs[@]}" 01:04:43.281 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:43.281 + [[ -f ./vhost-initiator-vg-autotest_77417/output//doc.tar.xz ]] 01:04:43.281 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:43.281 + [[ -f ./vhost-initiator-vg-autotest_77417/output//ut_coverage.tar.xz ]] 01:04:43.281 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:43.281 + [[ -f ./vhost-initiator-vg-autotest_77417/output//llvm.tar.xz ]] 01:04:43.281 + mv ./vhost-initiator-vg-autotest_77417/output//all_tests.txt ./vhost-initiator-vg-autotest_77417/output//build-kernel-manifest.txt ./vhost-initiator-vg-autotest_77417/output//build-pkg-manifest.txt ./vhost-initiator-vg-autotest_77417/output//build-repo-manifest.txt ./vhost-initiator-vg-autotest_77417/output//cov_base.info.xz ./vhost-initiator-vg-autotest_77417/output//cov_test.info.xz ./vhost-initiator-vg-autotest_77417/output//cov_total.info.xz ./vhost-initiator-vg-autotest_77417/output//dmesg.init.log ./vhost-initiator-vg-autotest_77417/output//dmesg.log ./vhost-initiator-vg-autotest_77417/output//power.tar.xz ./vhost-initiator-vg-autotest_77417/output//test_completions.txt ./vhost-initiator-vg-autotest_77417/output//timing.svg ./vhost-initiator-vg-autotest_77417/output//timing.txt ./vhost-initiator-vg-autotest_77417/output//vhost_fuzz_output1.txt.xz ./vhost-initiator-vg-autotest_77417/output//vhost_fuzz_output2.txt.xz ./vhost-initiator-vg-autotest_77417/output//vhost_fuzz_tgt_output.txt.xz ./vhost-initiator-vg-autotest_77417/output//.. 01:04:43.281 + rmdir ./vhost-initiator-vg-autotest_77417/output/ 01:04:43.281 + for dir in "${out_dirs[@]}" 01:04:43.281 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:43.281 + [[ -f ./vhost-phy-autotest_26142/output//doc.tar.xz ]] 01:04:43.281 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:43.281 + [[ -f ./vhost-phy-autotest_26142/output//ut_coverage.tar.xz ]] 01:04:43.281 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:43.281 + [[ -f ./vhost-phy-autotest_26142/output//llvm.tar.xz ]] 01:04:43.281 + mv ./vhost-phy-autotest_26142/output//all_tests.txt ./vhost-phy-autotest_26142/output//build-pkg-manifest.txt ./vhost-phy-autotest_26142/output//build-repo-manifest.txt ./vhost-phy-autotest_26142/output//cov_base.info.xz ./vhost-phy-autotest_26142/output//cov_test.info.xz ./vhost-phy-autotest_26142/output//cov_total.info.xz ./vhost-phy-autotest_26142/output//dmesg.init.log ./vhost-phy-autotest_26142/output//dmesg.log ./vhost-phy-autotest_26142/output//nvmf_trace.0_shm.tar.gz ./vhost-phy-autotest_26142/output//power.tar.xz ./vhost-phy-autotest_26142/output//test_completions.txt ./vhost-phy-autotest_26142/output//timing.svg ./vhost-phy-autotest_26142/output//timing.txt ./vhost-phy-autotest_26142/output//.. 01:04:43.281 + rmdir ./vhost-phy-autotest_26142/output/ 01:04:43.281 + for dir in "${out_dirs[@]}" 01:04:43.281 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:43.281 + [[ -f ./vmd-phy-autotest_2611/output//doc.tar.xz ]] 01:04:43.281 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:43.281 + [[ -f ./vmd-phy-autotest_2611/output//ut_coverage.tar.xz ]] 01:04:43.281 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:43.281 + [[ -f ./vmd-phy-autotest_2611/output//llvm.tar.xz ]] 01:04:43.281 + mv ./vmd-phy-autotest_2611/output//all_tests.txt ./vmd-phy-autotest_2611/output//build-pkg-manifest.txt ./vmd-phy-autotest_2611/output//build-repo-manifest.txt ./vmd-phy-autotest_2611/output//cov_base.info.xz ./vmd-phy-autotest_2611/output//cov_test.info.xz ./vmd-phy-autotest_2611/output//cov_total.info.xz ./vmd-phy-autotest_2611/output//dmesg.init.log ./vmd-phy-autotest_2611/output//dmesg.log ./vmd-phy-autotest_2611/output//power.tar.xz ./vmd-phy-autotest_2611/output//test_completions.txt ./vmd-phy-autotest_2611/output//timing.svg ./vmd-phy-autotest_2611/output//timing.txt ./vmd-phy-autotest_2611/output//.. 01:04:43.281 + rmdir ./vmd-phy-autotest_2611/output/ 01:04:43.281 + for dir in "${out_dirs[@]}" 01:04:43.281 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:43.281 + [[ -f ./zns-vg-autotest_76503/output//doc.tar.xz ]] 01:04:43.281 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:43.281 + [[ -f ./zns-vg-autotest_76503/output//ut_coverage.tar.xz ]] 01:04:43.281 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:04:43.281 + [[ -f ./zns-vg-autotest_76503/output//llvm.tar.xz ]] 01:04:43.281 + mv ./zns-vg-autotest_76503/output//all_tests.txt ./zns-vg-autotest_76503/output//build-kernel-manifest.txt ./zns-vg-autotest_76503/output//build-pkg-manifest.txt ./zns-vg-autotest_76503/output//build-repo-manifest.txt ./zns-vg-autotest_76503/output//cov_base.info.xz ./zns-vg-autotest_76503/output//cov_test.info.xz ./zns-vg-autotest_76503/output//cov_total.info.xz ./zns-vg-autotest_76503/output//dmesg.init.log ./zns-vg-autotest_76503/output//dmesg.log ./zns-vg-autotest_76503/output//power.tar.xz ./zns-vg-autotest_76503/output//test_completions.txt ./zns-vg-autotest_76503/output//timing.svg ./zns-vg-autotest_76503/output//timing.txt ./zns-vg-autotest_76503/output//.. 01:04:43.281 + rmdir ./zns-vg-autotest_76503/output/ 01:04:43.281 + unpack_cov_files 01:04:43.281 + local info_files 01:04:43.281 + info_files=(*/cov_*.info.xz) 01:04:43.281 + xargs -P0 -r -n1 xz -d 01:04:43.282 + printf '%s\n' BlobFS-phy-autotest_26123/cov_base.info.xz BlobFS-phy-autotest_26123/cov_test.info.xz BlobFS-phy-autotest_26123/cov_total.info.xz centos7-vg-autotest_73576/cov_base.info.xz centos7-vg-autotest_73576/cov_test.info.xz centos7-vg-autotest_73576/cov_total.info.xz crypto-phy-autotest_26117/cov_base.info.xz crypto-phy-autotest_26117/cov_test.info.xz crypto-phy-autotest_26117/cov_total.info.xz dsa-phy-autotest_4817/cov_base.info.xz dsa-phy-autotest_4817/cov_test.info.xz dsa-phy-autotest_4817/cov_total.info.xz iscsi-uring-vg-autotest_77302/cov_base.info.xz iscsi-uring-vg-autotest_77302/cov_test.info.xz iscsi-uring-vg-autotest_77302/cov_total.info.xz iscsi-vg-autotest_77435/cov_base.info.xz iscsi-vg-autotest_77435/cov_test.info.xz iscsi-vg-autotest_77435/cov_total.info.xz lvol-vg-autotest_77346/cov_base.info.xz lvol-vg-autotest_77346/cov_test.info.xz lvol-vg-autotest_77346/cov_total.info.xz nvme-cmb-pmr-vg-autotest_78520/cov_base.info.xz nvme-cmb-pmr-vg-autotest_78520/cov_test.info.xz nvme-cmb-pmr-vg-autotest_78520/cov_total.info.xz nvme-phy-autotest_72289/cov_base.info.xz nvme-phy-autotest_72289/cov_test.info.xz nvme-phy-autotest_72289/cov_total.info.xz nvme-vg-autotest_77397/cov_base.info.xz nvmf-cvl-phy-autotest_3013/cov_base.info.xz nvmf-cvl-phy-autotest_3013/cov_test.info.xz nvmf-cvl-phy-autotest_3013/cov_total.info.xz nvmf-phy-autotest_72361/cov_base.info.xz nvmf-tcp-phy-autotest_72248/cov_base.info.xz nvmf-tcp-phy-autotest_72248/cov_test.info.xz nvmf-tcp-phy-autotest_72248/cov_total.info.xz nvmf-tcp-uring-vg-autotest_77322/cov_base.info.xz nvmf-tcp-uring-vg-autotest_77322/cov_test.info.xz nvmf-tcp-uring-vg-autotest_77322/cov_total.info.xz nvmf-tcp-vg-autotest_77388/cov_base.info.xz nvmf-tcp-vg-autotest_77388/cov_test.info.xz nvmf-tcp-vg-autotest_77388/cov_total.info.xz rocky9-vg-autotest_16007/cov_base.info.xz rocky9-vg-autotest_16007/cov_test.info.xz rocky9-vg-autotest_16007/cov_total.info.xz ubuntu20-vg-autotest_73716/cov_base.info.xz ubuntu22-vg-autotest_37730/cov_base.info.xz ubuntu22-vg-autotest_37730/cov_test.info.xz ubuntu22-vg-autotest_37730/cov_total.info.xz vfio-user-phy-autotest_26125/cov_base.info.xz vfio-user-phy-autotest_26125/cov_test.info.xz vfio-user-phy-autotest_26125/cov_total.info.xz vhost-initiator-vg-autotest_77417/cov_base.info.xz vhost-initiator-vg-autotest_77417/cov_test.info.xz vhost-initiator-vg-autotest_77417/cov_total.info.xz vhost-phy-autotest_26142/cov_base.info.xz vhost-phy-autotest_26142/cov_test.info.xz vhost-phy-autotest_26142/cov_total.info.xz vmd-phy-autotest_2611/cov_base.info.xz vmd-phy-autotest_2611/cov_test.info.xz vmd-phy-autotest_2611/cov_total.info.xz zns-vg-autotest_76503/cov_base.info.xz zns-vg-autotest_76503/cov_test.info.xz zns-vg-autotest_76503/cov_total.info.xz 01:04:43.846 + fix_downstream_job_paths 01:04:43.846 + sed -i -e 's#^SF:/.\+/spdk/#SF:/var/jenkins/workspace/autotest-nightly/spdk/#g' BlobFS-phy-autotest_26123/cov_total.info centos7-vg-autotest_73576/cov_total.info crypto-phy-autotest_26117/cov_total.info dsa-phy-autotest_4817/cov_total.info iscsi-uring-vg-autotest_77302/cov_total.info iscsi-vg-autotest_77435/cov_total.info lvol-vg-autotest_77346/cov_total.info nvme-cmb-pmr-vg-autotest_78520/cov_total.info nvme-phy-autotest_72289/cov_total.info nvmf-cvl-phy-autotest_3013/cov_total.info nvmf-tcp-phy-autotest_72248/cov_total.info nvmf-tcp-uring-vg-autotest_77322/cov_total.info nvmf-tcp-vg-autotest_77388/cov_total.info rocky9-vg-autotest_16007/cov_total.info ubuntu22-vg-autotest_37730/cov_total.info vfio-user-phy-autotest_26125/cov_total.info vhost-initiator-vg-autotest_77417/cov_total.info vhost-phy-autotest_26142/cov_total.info vmd-phy-autotest_2611/cov_total.info zns-vg-autotest_76503/cov_total.info 01:04:44.779 + ignore_ocf_headers 01:04:44.779 + sed -i 's#--show-details#--show-details --ignore-errors source#g' spdk/autorun_post.py 01:04:44.779 + create_errtrace_files_for_all_builds 01:04:44.779 + local build_log_list 01:04:44.779 + build_log_list=($(find "$WORKSPACE" -type f -name 'build.log')) 01:04:44.779 ++ find /var/jenkins/workspace/autotest-nightly -type f -name build.log 01:04:44.779 + for build in "${build_log_list[@]}" 01:04:44.779 + create_errtrace_file /var/jenkins/workspace/autotest-nightly/centos7-vg-autotest_73576/build.log 01:04:44.779 + local build_log job_name start_pattern end_pattern backtraces 01:04:44.779 + build_log=/var/jenkins/workspace/autotest-nightly/centos7-vg-autotest_73576/build.log 01:04:44.779 +++ dirname /var/jenkins/workspace/autotest-nightly/centos7-vg-autotest_73576/build.log 01:04:44.779 ++ basename /var/jenkins/workspace/autotest-nightly/centos7-vg-autotest_73576 01:04:44.779 + job_name=centos7-vg-autotest_73576 01:04:44.779 + start_pattern='Backtrace start' 01:04:44.779 + end_pattern='Backtrace end' 01:04:44.779 + [[ -f /var/jenkins/workspace/autotest-nightly/centos7-vg-autotest_73576/build.log ]] 01:04:44.779 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-nightly/centos7-vg-autotest_73576/build.log 01:04:44.779 + backtraces= 01:04:44.779 + [[ -n '' ]] 01:04:44.779 + for build in "${build_log_list[@]}" 01:04:44.779 + create_errtrace_file /var/jenkins/workspace/autotest-nightly/freebsd-vg-autotest_59050/build.log 01:04:44.779 + local build_log job_name start_pattern end_pattern backtraces 01:04:44.779 + build_log=/var/jenkins/workspace/autotest-nightly/freebsd-vg-autotest_59050/build.log 01:04:44.779 +++ dirname /var/jenkins/workspace/autotest-nightly/freebsd-vg-autotest_59050/build.log 01:04:44.779 ++ basename /var/jenkins/workspace/autotest-nightly/freebsd-vg-autotest_59050 01:04:44.779 + job_name=freebsd-vg-autotest_59050 01:04:44.779 + start_pattern='Backtrace start' 01:04:44.779 + end_pattern='Backtrace end' 01:04:44.779 + [[ -f /var/jenkins/workspace/autotest-nightly/freebsd-vg-autotest_59050/build.log ]] 01:04:44.779 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-nightly/freebsd-vg-autotest_59050/build.log 01:04:44.779 + backtraces= 01:04:44.779 + [[ -n '' ]] 01:04:44.779 + for build in "${build_log_list[@]}" 01:04:44.779 + create_errtrace_file /var/jenkins/workspace/autotest-nightly/iscsi-uring-vg-autotest_77302/build.log 01:04:44.779 + local build_log job_name start_pattern end_pattern backtraces 01:04:44.779 + build_log=/var/jenkins/workspace/autotest-nightly/iscsi-uring-vg-autotest_77302/build.log 01:04:44.779 +++ dirname /var/jenkins/workspace/autotest-nightly/iscsi-uring-vg-autotest_77302/build.log 01:04:44.779 ++ basename /var/jenkins/workspace/autotest-nightly/iscsi-uring-vg-autotest_77302 01:04:44.779 + job_name=iscsi-uring-vg-autotest_77302 01:04:44.779 + start_pattern='Backtrace start' 01:04:44.779 + end_pattern='Backtrace end' 01:04:44.779 + [[ -f /var/jenkins/workspace/autotest-nightly/iscsi-uring-vg-autotest_77302/build.log ]] 01:04:44.779 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-nightly/iscsi-uring-vg-autotest_77302/build.log 01:04:44.779 + backtraces= 01:04:44.779 + [[ -n '' ]] 01:04:44.779 + for build in "${build_log_list[@]}" 01:04:44.779 + create_errtrace_file /var/jenkins/workspace/autotest-nightly/vmd-phy-autotest_2611/build.log 01:04:44.779 + local build_log job_name start_pattern end_pattern backtraces 01:04:44.779 + build_log=/var/jenkins/workspace/autotest-nightly/vmd-phy-autotest_2611/build.log 01:04:44.779 +++ dirname /var/jenkins/workspace/autotest-nightly/vmd-phy-autotest_2611/build.log 01:04:44.779 ++ basename /var/jenkins/workspace/autotest-nightly/vmd-phy-autotest_2611 01:04:44.779 + job_name=vmd-phy-autotest_2611 01:04:44.779 + start_pattern='Backtrace start' 01:04:44.779 + end_pattern='Backtrace end' 01:04:44.779 + [[ -f /var/jenkins/workspace/autotest-nightly/vmd-phy-autotest_2611/build.log ]] 01:04:44.779 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-nightly/vmd-phy-autotest_2611/build.log 01:04:44.779 + backtraces= 01:04:44.779 + [[ -n '' ]] 01:04:44.779 + for build in "${build_log_list[@]}" 01:04:44.779 + create_errtrace_file /var/jenkins/workspace/autotest-nightly/vhost-phy-autotest_26142/build.log 01:04:44.779 + local build_log job_name start_pattern end_pattern backtraces 01:04:44.779 + build_log=/var/jenkins/workspace/autotest-nightly/vhost-phy-autotest_26142/build.log 01:04:44.779 +++ dirname /var/jenkins/workspace/autotest-nightly/vhost-phy-autotest_26142/build.log 01:04:44.779 ++ basename /var/jenkins/workspace/autotest-nightly/vhost-phy-autotest_26142 01:04:44.779 + job_name=vhost-phy-autotest_26142 01:04:44.779 + start_pattern='Backtrace start' 01:04:44.779 + end_pattern='Backtrace end' 01:04:44.779 + [[ -f /var/jenkins/workspace/autotest-nightly/vhost-phy-autotest_26142/build.log ]] 01:04:44.779 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-nightly/vhost-phy-autotest_26142/build.log 01:04:44.779 + backtraces= 01:04:44.779 + [[ -n '' ]] 01:04:44.779 + for build in "${build_log_list[@]}" 01:04:44.779 + create_errtrace_file /var/jenkins/workspace/autotest-nightly/short-fuzz-phy-autotest_26114/build.log 01:04:44.779 + local build_log job_name start_pattern end_pattern backtraces 01:04:44.779 + build_log=/var/jenkins/workspace/autotest-nightly/short-fuzz-phy-autotest_26114/build.log 01:04:45.039 +++ dirname /var/jenkins/workspace/autotest-nightly/short-fuzz-phy-autotest_26114/build.log 01:04:45.039 ++ basename /var/jenkins/workspace/autotest-nightly/short-fuzz-phy-autotest_26114 01:04:45.039 + job_name=short-fuzz-phy-autotest_26114 01:04:45.040 + start_pattern='Backtrace start' 01:04:45.040 + end_pattern='Backtrace end' 01:04:45.040 + [[ -f /var/jenkins/workspace/autotest-nightly/short-fuzz-phy-autotest_26114/build.log ]] 01:04:45.040 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-nightly/short-fuzz-phy-autotest_26114/build.log 01:04:45.040 + backtraces= 01:04:45.040 + [[ -n '' ]] 01:04:45.040 + for build in "${build_log_list[@]}" 01:04:45.040 + create_errtrace_file /var/jenkins/workspace/autotest-nightly/check-format-docker-autotest_22071/build.log 01:04:45.040 + local build_log job_name start_pattern end_pattern backtraces 01:04:45.040 + build_log=/var/jenkins/workspace/autotest-nightly/check-format-docker-autotest_22071/build.log 01:04:45.040 +++ dirname /var/jenkins/workspace/autotest-nightly/check-format-docker-autotest_22071/build.log 01:04:45.040 ++ basename /var/jenkins/workspace/autotest-nightly/check-format-docker-autotest_22071 01:04:45.040 + job_name=check-format-docker-autotest_22071 01:04:45.040 + start_pattern='Backtrace start' 01:04:45.040 + end_pattern='Backtrace end' 01:04:45.040 + [[ -f /var/jenkins/workspace/autotest-nightly/check-format-docker-autotest_22071/build.log ]] 01:04:45.040 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-nightly/check-format-docker-autotest_22071/build.log 01:04:45.040 + backtraces= 01:04:45.040 + [[ -n '' ]] 01:04:45.040 + for build in "${build_log_list[@]}" 01:04:45.040 + create_errtrace_file /var/jenkins/workspace/autotest-nightly/vhost-initiator-vg-autotest_77417/build.log 01:04:45.040 + local build_log job_name start_pattern end_pattern backtraces 01:04:45.040 + build_log=/var/jenkins/workspace/autotest-nightly/vhost-initiator-vg-autotest_77417/build.log 01:04:45.040 +++ dirname /var/jenkins/workspace/autotest-nightly/vhost-initiator-vg-autotest_77417/build.log 01:04:45.040 ++ basename /var/jenkins/workspace/autotest-nightly/vhost-initiator-vg-autotest_77417 01:04:45.040 + job_name=vhost-initiator-vg-autotest_77417 01:04:45.040 + start_pattern='Backtrace start' 01:04:45.040 + end_pattern='Backtrace end' 01:04:45.040 + [[ -f /var/jenkins/workspace/autotest-nightly/vhost-initiator-vg-autotest_77417/build.log ]] 01:04:45.040 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-nightly/vhost-initiator-vg-autotest_77417/build.log 01:04:45.040 + backtraces= 01:04:45.040 + [[ -n '' ]] 01:04:45.040 + for build in "${build_log_list[@]}" 01:04:45.040 + create_errtrace_file /var/jenkins/workspace/autotest-nightly/check-so-deps-docker-autotest_22084/build.log 01:04:45.040 + local build_log job_name start_pattern end_pattern backtraces 01:04:45.040 + build_log=/var/jenkins/workspace/autotest-nightly/check-so-deps-docker-autotest_22084/build.log 01:04:45.040 +++ dirname /var/jenkins/workspace/autotest-nightly/check-so-deps-docker-autotest_22084/build.log 01:04:45.040 ++ basename /var/jenkins/workspace/autotest-nightly/check-so-deps-docker-autotest_22084 01:04:45.040 + job_name=check-so-deps-docker-autotest_22084 01:04:45.040 + start_pattern='Backtrace start' 01:04:45.040 + end_pattern='Backtrace end' 01:04:45.040 + [[ -f /var/jenkins/workspace/autotest-nightly/check-so-deps-docker-autotest_22084/build.log ]] 01:04:45.040 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-nightly/check-so-deps-docker-autotest_22084/build.log 01:04:45.040 + backtraces= 01:04:45.040 + [[ -n '' ]] 01:04:45.040 + for build in "${build_log_list[@]}" 01:04:45.040 + create_errtrace_file /var/jenkins/workspace/autotest-nightly/nvme-cmb-pmr-vg-autotest_78520/build.log 01:04:45.040 + local build_log job_name start_pattern end_pattern backtraces 01:04:45.040 + build_log=/var/jenkins/workspace/autotest-nightly/nvme-cmb-pmr-vg-autotest_78520/build.log 01:04:45.040 +++ dirname /var/jenkins/workspace/autotest-nightly/nvme-cmb-pmr-vg-autotest_78520/build.log 01:04:45.040 ++ basename /var/jenkins/workspace/autotest-nightly/nvme-cmb-pmr-vg-autotest_78520 01:04:45.040 + job_name=nvme-cmb-pmr-vg-autotest_78520 01:04:45.040 + start_pattern='Backtrace start' 01:04:45.040 + end_pattern='Backtrace end' 01:04:45.040 + [[ -f /var/jenkins/workspace/autotest-nightly/nvme-cmb-pmr-vg-autotest_78520/build.log ]] 01:04:45.040 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-nightly/nvme-cmb-pmr-vg-autotest_78520/build.log 01:04:45.040 + backtraces= 01:04:45.040 + [[ -n '' ]] 01:04:45.040 + for build in "${build_log_list[@]}" 01:04:45.040 + create_errtrace_file /var/jenkins/workspace/autotest-nightly/packaging-docker-autotest_19789/build.log 01:04:45.040 + local build_log job_name start_pattern end_pattern backtraces 01:04:45.040 + build_log=/var/jenkins/workspace/autotest-nightly/packaging-docker-autotest_19789/build.log 01:04:45.040 +++ dirname /var/jenkins/workspace/autotest-nightly/packaging-docker-autotest_19789/build.log 01:04:45.040 ++ basename /var/jenkins/workspace/autotest-nightly/packaging-docker-autotest_19789 01:04:45.040 + job_name=packaging-docker-autotest_19789 01:04:45.040 + start_pattern='Backtrace start' 01:04:45.040 + end_pattern='Backtrace end' 01:04:45.040 + [[ -f /var/jenkins/workspace/autotest-nightly/packaging-docker-autotest_19789/build.log ]] 01:04:45.040 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-nightly/packaging-docker-autotest_19789/build.log 01:04:45.040 + backtraces= 01:04:45.040 + [[ -n '' ]] 01:04:45.040 + for build in "${build_log_list[@]}" 01:04:45.040 + create_errtrace_file /var/jenkins/workspace/autotest-nightly/unittest-clang-docker-autotest_19787/build.log 01:04:45.040 + local build_log job_name start_pattern end_pattern backtraces 01:04:45.040 + build_log=/var/jenkins/workspace/autotest-nightly/unittest-clang-docker-autotest_19787/build.log 01:04:45.040 +++ dirname /var/jenkins/workspace/autotest-nightly/unittest-clang-docker-autotest_19787/build.log 01:04:45.040 ++ basename /var/jenkins/workspace/autotest-nightly/unittest-clang-docker-autotest_19787 01:04:45.040 + job_name=unittest-clang-docker-autotest_19787 01:04:45.040 + start_pattern='Backtrace start' 01:04:45.040 + end_pattern='Backtrace end' 01:04:45.040 + [[ -f /var/jenkins/workspace/autotest-nightly/unittest-clang-docker-autotest_19787/build.log ]] 01:04:45.040 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-nightly/unittest-clang-docker-autotest_19787/build.log 01:04:45.040 + backtraces= 01:04:45.040 + [[ -n '' ]] 01:04:45.040 + for build in "${build_log_list[@]}" 01:04:45.040 + create_errtrace_file /var/jenkins/workspace/autotest-nightly/lvol-vg-autotest_77346/build.log 01:04:45.040 + local build_log job_name start_pattern end_pattern backtraces 01:04:45.040 + build_log=/var/jenkins/workspace/autotest-nightly/lvol-vg-autotest_77346/build.log 01:04:45.040 +++ dirname /var/jenkins/workspace/autotest-nightly/lvol-vg-autotest_77346/build.log 01:04:45.040 ++ basename /var/jenkins/workspace/autotest-nightly/lvol-vg-autotest_77346 01:04:45.040 + job_name=lvol-vg-autotest_77346 01:04:45.040 + start_pattern='Backtrace start' 01:04:45.040 + end_pattern='Backtrace end' 01:04:45.040 + [[ -f /var/jenkins/workspace/autotest-nightly/lvol-vg-autotest_77346/build.log ]] 01:04:45.040 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-nightly/lvol-vg-autotest_77346/build.log 01:04:45.040 + backtraces= 01:04:45.040 + [[ -n '' ]] 01:04:45.040 + for build in "${build_log_list[@]}" 01:04:45.040 + create_errtrace_file /var/jenkins/workspace/autotest-nightly/nvmf-cvl-phy-autotest_3013/build.log 01:04:45.040 + local build_log job_name start_pattern end_pattern backtraces 01:04:45.040 + build_log=/var/jenkins/workspace/autotest-nightly/nvmf-cvl-phy-autotest_3013/build.log 01:04:45.040 +++ dirname /var/jenkins/workspace/autotest-nightly/nvmf-cvl-phy-autotest_3013/build.log 01:04:45.040 ++ basename /var/jenkins/workspace/autotest-nightly/nvmf-cvl-phy-autotest_3013 01:04:45.040 + job_name=nvmf-cvl-phy-autotest_3013 01:04:45.040 + start_pattern='Backtrace start' 01:04:45.040 + end_pattern='Backtrace end' 01:04:45.040 + [[ -f /var/jenkins/workspace/autotest-nightly/nvmf-cvl-phy-autotest_3013/build.log ]] 01:04:45.040 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-nightly/nvmf-cvl-phy-autotest_3013/build.log 01:04:45.040 + backtraces= 01:04:45.040 + [[ -n '' ]] 01:04:45.040 + for build in "${build_log_list[@]}" 01:04:45.040 + create_errtrace_file /var/jenkins/workspace/autotest-nightly/unittest-valgrind-docker-autotest_19791/build.log 01:04:45.040 + local build_log job_name start_pattern end_pattern backtraces 01:04:45.040 + build_log=/var/jenkins/workspace/autotest-nightly/unittest-valgrind-docker-autotest_19791/build.log 01:04:45.040 +++ dirname /var/jenkins/workspace/autotest-nightly/unittest-valgrind-docker-autotest_19791/build.log 01:04:45.040 ++ basename /var/jenkins/workspace/autotest-nightly/unittest-valgrind-docker-autotest_19791 01:04:45.040 + job_name=unittest-valgrind-docker-autotest_19791 01:04:45.040 + start_pattern='Backtrace start' 01:04:45.040 + end_pattern='Backtrace end' 01:04:45.040 + [[ -f /var/jenkins/workspace/autotest-nightly/unittest-valgrind-docker-autotest_19791/build.log ]] 01:04:45.040 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-nightly/unittest-valgrind-docker-autotest_19791/build.log 01:04:45.040 + backtraces= 01:04:45.040 + [[ -n '' ]] 01:04:45.040 + for build in "${build_log_list[@]}" 01:04:45.040 + create_errtrace_file /var/jenkins/workspace/autotest-nightly/crypto-phy-autotest_26117/build.log 01:04:45.040 + local build_log job_name start_pattern end_pattern backtraces 01:04:45.040 + build_log=/var/jenkins/workspace/autotest-nightly/crypto-phy-autotest_26117/build.log 01:04:45.040 +++ dirname /var/jenkins/workspace/autotest-nightly/crypto-phy-autotest_26117/build.log 01:04:45.040 ++ basename /var/jenkins/workspace/autotest-nightly/crypto-phy-autotest_26117 01:04:45.040 + job_name=crypto-phy-autotest_26117 01:04:45.040 + start_pattern='Backtrace start' 01:04:45.040 + end_pattern='Backtrace end' 01:04:45.040 + [[ -f /var/jenkins/workspace/autotest-nightly/crypto-phy-autotest_26117/build.log ]] 01:04:45.040 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-nightly/crypto-phy-autotest_26117/build.log 01:04:45.040 + backtraces= 01:04:45.040 + [[ -n '' ]] 01:04:45.040 + for build in "${build_log_list[@]}" 01:04:45.040 + create_errtrace_file /var/jenkins/workspace/autotest-nightly/scan-build-docker-autotest_19790/build.log 01:04:45.040 + local build_log job_name start_pattern end_pattern backtraces 01:04:45.040 + build_log=/var/jenkins/workspace/autotest-nightly/scan-build-docker-autotest_19790/build.log 01:04:45.040 +++ dirname /var/jenkins/workspace/autotest-nightly/scan-build-docker-autotest_19790/build.log 01:04:45.040 ++ basename /var/jenkins/workspace/autotest-nightly/scan-build-docker-autotest_19790 01:04:45.040 + job_name=scan-build-docker-autotest_19790 01:04:45.040 + start_pattern='Backtrace start' 01:04:45.040 + end_pattern='Backtrace end' 01:04:45.040 + [[ -f /var/jenkins/workspace/autotest-nightly/scan-build-docker-autotest_19790/build.log ]] 01:04:45.040 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-nightly/scan-build-docker-autotest_19790/build.log 01:04:45.040 + backtraces= 01:04:45.040 + [[ -n '' ]] 01:04:45.040 + for build in "${build_log_list[@]}" 01:04:45.040 + create_errtrace_file /var/jenkins/workspace/autotest-nightly/ubuntu22-vg-autotest_37730/build.log 01:04:45.040 + local build_log job_name start_pattern end_pattern backtraces 01:04:45.040 + build_log=/var/jenkins/workspace/autotest-nightly/ubuntu22-vg-autotest_37730/build.log 01:04:45.040 +++ dirname /var/jenkins/workspace/autotest-nightly/ubuntu22-vg-autotest_37730/build.log 01:04:45.040 ++ basename /var/jenkins/workspace/autotest-nightly/ubuntu22-vg-autotest_37730 01:04:45.040 + job_name=ubuntu22-vg-autotest_37730 01:04:45.040 + start_pattern='Backtrace start' 01:04:45.040 + end_pattern='Backtrace end' 01:04:45.040 + [[ -f /var/jenkins/workspace/autotest-nightly/ubuntu22-vg-autotest_37730/build.log ]] 01:04:45.040 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-nightly/ubuntu22-vg-autotest_37730/build.log 01:04:45.040 + backtraces= 01:04:45.041 + [[ -n '' ]] 01:04:45.041 + for build in "${build_log_list[@]}" 01:04:45.041 + create_errtrace_file /var/jenkins/workspace/autotest-nightly/unittest-main-docker-autotest_19788/build.log 01:04:45.041 + local build_log job_name start_pattern end_pattern backtraces 01:04:45.041 + build_log=/var/jenkins/workspace/autotest-nightly/unittest-main-docker-autotest_19788/build.log 01:04:45.041 +++ dirname /var/jenkins/workspace/autotest-nightly/unittest-main-docker-autotest_19788/build.log 01:04:45.041 ++ basename /var/jenkins/workspace/autotest-nightly/unittest-main-docker-autotest_19788 01:04:45.041 + job_name=unittest-main-docker-autotest_19788 01:04:45.041 + start_pattern='Backtrace start' 01:04:45.041 + end_pattern='Backtrace end' 01:04:45.041 + [[ -f /var/jenkins/workspace/autotest-nightly/unittest-main-docker-autotest_19788/build.log ]] 01:04:45.041 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-nightly/unittest-main-docker-autotest_19788/build.log 01:04:45.041 + backtraces= 01:04:45.041 + [[ -n '' ]] 01:04:45.041 + for build in "${build_log_list[@]}" 01:04:45.041 + create_errtrace_file /var/jenkins/workspace/autotest-nightly/nvme-vg-autotest_77397/build.log 01:04:45.041 + local build_log job_name start_pattern end_pattern backtraces 01:04:45.041 + build_log=/var/jenkins/workspace/autotest-nightly/nvme-vg-autotest_77397/build.log 01:04:45.041 +++ dirname /var/jenkins/workspace/autotest-nightly/nvme-vg-autotest_77397/build.log 01:04:45.041 ++ basename /var/jenkins/workspace/autotest-nightly/nvme-vg-autotest_77397 01:04:45.041 + job_name=nvme-vg-autotest_77397 01:04:45.041 + start_pattern='Backtrace start' 01:04:45.041 + end_pattern='Backtrace end' 01:04:45.041 + [[ -f /var/jenkins/workspace/autotest-nightly/nvme-vg-autotest_77397/build.log ]] 01:04:45.041 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-nightly/nvme-vg-autotest_77397/build.log 01:04:45.041 + backtraces='00:17:27.548 20:46:57 sw_hotplug -- common/autotest_common.sh@715 -- # time='\''========== Backtrace start: ========== 01:04:45.041 00:17:27.548 01:04:45.041 00:17:27.548 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:04:45.041 00:17:27.548 ... 01:04:45.041 00:17:27.548 710 01:04:45.041 00:17:27.548 711 # We redirect cmd'\''\'\'''\''s std{out,err} to a separate fd dup'\''\'\'''\''ed to stdin'\''\'\'''\''s device (or /dev/null) to 01:04:45.041 00:17:27.548 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 01:04:45.041 00:17:27.548 713 # but $() will return just the time'\''\'\'''\''s data, hence making it possible to just do: 01:04:45.041 00:17:27.548 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:04:45.041 00:17:27.548 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:04:45.041 00:17:27.548 716 01:04:45.041 00:17:27.548 717 echo "$time" 01:04:45.041 00:17:27.548 718 ) 01:04:45.041 00:17:27.548 719 01:04:45.041 00:17:27.548 720 function timing_enter() { 01:04:45.041 00:17:27.548 ... 01:04:45.041 00:17:27.548 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:04:45.041 00:17:27.548 ... 01:04:45.041 00:17:27.548 11 # Pci bus hotplug 01:04:45.041 00:17:27.548 12 # Helper function to remove/attach cotrollers 01:04:45.041 00:17:27.548 13 debug_remove_attach_helper() { 01:04:45.041 00:17:27.548 14 local helper_time=0 01:04:45.041 00:17:27.548 15 01:04:45.041 00:17:27.548 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:04:45.041 00:17:27.548 17 printf '\''\'\'''\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\''\'\'''\'' \ 01:04:45.041 00:17:27.548 18 "$helper_time" "$nvme_count" >&2 01:04:45.041 00:17:27.548 19 } 01:04:45.041 00:17:27.548 20 01:04:45.041 00:17:27.548 21 remove_attach_helper() { 01:04:45.041 00:17:27.548 ... 01:04:45.041 00:17:27.548 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:04:45.041 00:17:27.548 ... 01:04:45.041 00:17:27.548 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:04:45.041 00:17:27.548 106 done 01:04:45.041 00:17:27.548 107 01:04:45.041 00:17:27.548 108 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.041 00:17:27.548 109 01:04:45.041 00:17:27.548 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.041 00:17:27.548 111 # Verify reregistering hotplug poller 01:04:45.041 00:17:27.548 112 rpc_cmd bdev_nvme_set_hotplug -d 01:04:45.041 00:17:27.548 113 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.041 00:17:27.548 114 01:04:45.041 00:17:27.548 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.041 00:17:27.548 ... 01:04:45.041 00:17:27.548 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:04:45.041 00:17:27.548 ... 01:04:45.041 00:17:27.548 133 01:04:45.041 00:17:27.548 134 # Run pci bus hotplug test 01:04:45.041 00:17:27.548 135 run_hotplug 01:04:45.041 00:17:27.548 136 01:04:45.041 00:17:27.548 137 # Run SPDK target based hotplug 01:04:45.041 00:17:27.548 => 138 tgt_run_hotplug 01:04:45.041 00:17:27.548 ... 01:04:45.041 00:17:27.548 01:04:45.041 00:17:27.548 ========== Backtrace end =========='\'' 01:04:45.041 00:17:27.549 ========== Backtrace start: ========== 01:04:45.041 00:17:27.549 01:04:45.041 00:17:27.549 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:04:45.041 00:17:27.549 ... 01:04:45.041 00:17:27.549 710 01:04:45.041 00:17:27.549 711 # We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to 01:04:45.041 00:17:27.549 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 01:04:45.041 00:17:27.549 713 # but $() will return just the time'\''s data, hence making it possible to just do: 01:04:45.041 00:17:27.549 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:04:45.041 00:17:27.549 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:04:45.041 00:17:27.549 716 01:04:45.041 00:17:27.549 717 echo "$time" 01:04:45.041 00:17:27.549 718 ) 01:04:45.041 00:17:27.549 719 01:04:45.041 00:17:27.549 720 function timing_enter() { 01:04:45.041 00:17:27.549 ... 01:04:45.041 00:17:27.549 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:04:45.041 00:17:27.549 ... 01:04:45.041 00:17:27.549 11 # Pci bus hotplug 01:04:45.041 00:17:27.549 12 # Helper function to remove/attach cotrollers 01:04:45.041 00:17:27.549 13 debug_remove_attach_helper() { 01:04:45.041 00:17:27.549 14 local helper_time=0 01:04:45.041 00:17:27.549 15 01:04:45.041 00:17:27.549 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:04:45.041 00:17:27.549 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:04:45.041 00:17:27.549 18 "$helper_time" "$nvme_count" >&2 01:04:45.041 00:17:27.549 19 } 01:04:45.041 00:17:27.549 20 01:04:45.041 00:17:27.549 21 remove_attach_helper() { 01:04:45.041 00:17:27.549 ... 01:04:45.041 00:17:27.549 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:04:45.041 00:17:27.549 ... 01:04:45.041 00:17:27.549 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:04:45.041 00:17:27.549 106 done 01:04:45.041 00:17:27.549 107 01:04:45.041 00:17:27.549 108 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.041 00:17:27.549 109 01:04:45.041 00:17:27.549 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.041 00:17:27.549 111 # Verify reregistering hotplug poller 01:04:45.041 00:17:27.549 112 rpc_cmd bdev_nvme_set_hotplug -d 01:04:45.041 00:17:27.549 113 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.041 00:17:27.549 114 01:04:45.041 00:17:27.549 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.041 00:17:27.549 ... 01:04:45.041 00:17:27.549 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:04:45.041 00:17:27.549 ... 01:04:45.041 00:17:27.549 133 01:04:45.041 00:17:27.549 134 # Run pci bus hotplug test 01:04:45.041 00:17:27.549 135 run_hotplug 01:04:45.041 00:17:27.549 136 01:04:45.041 00:17:27.549 137 # Run SPDK target based hotplug 01:04:45.041 00:17:27.549 => 138 tgt_run_hotplug 01:04:45.041 00:17:27.549 ... 01:04:45.041 00:17:27.549 01:04:45.041 00:17:27.549 ========== Backtrace end ========== 01:04:45.041 00:17:27.549 ========== Backtrace start: ========== 01:04:45.041 00:17:27.549 01:04:45.041 00:17:27.549 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:04:45.041 00:17:27.549 ... 01:04:45.041 00:17:27.549 713 # but $() will return just the time'\''s data, hence making it possible to just do: 01:04:45.041 00:17:27.549 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:04:45.041 00:17:27.549 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:04:45.041 00:17:27.549 716 01:04:45.041 00:17:27.549 717 echo "$time" 01:04:45.041 00:17:27.549 => 718 ) 01:04:45.041 00:17:27.549 719 01:04:45.041 00:17:27.549 720 function timing_enter() { 01:04:45.041 00:17:27.549 721 xtrace_disable 01:04:45.041 00:17:27.549 722 timing "enter" "$1" 01:04:45.041 00:17:27.549 723 xtrace_restore 01:04:45.041 00:17:27.549 ... 01:04:45.041 00:17:27.549 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:04:45.041 00:17:27.549 ... 01:04:45.041 00:17:27.549 11 # Pci bus hotplug 01:04:45.041 00:17:27.549 12 # Helper function to remove/attach cotrollers 01:04:45.041 00:17:27.549 13 debug_remove_attach_helper() { 01:04:45.041 00:17:27.549 14 local helper_time=0 01:04:45.041 00:17:27.549 15 01:04:45.041 00:17:27.549 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:04:45.041 00:17:27.549 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:04:45.041 00:17:27.549 18 "$helper_time" "$nvme_count" >&2 01:04:45.041 00:17:27.549 19 } 01:04:45.041 00:17:27.549 20 01:04:45.041 00:17:27.549 21 remove_attach_helper() { 01:04:45.041 00:17:27.549 ... 01:04:45.041 00:17:27.549 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:04:45.041 00:17:27.549 ... 01:04:45.041 00:17:27.549 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:04:45.041 00:17:27.549 106 done 01:04:45.041 00:17:27.549 107 01:04:45.041 00:17:27.549 108 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.041 00:17:27.549 109 01:04:45.041 00:17:27.549 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.041 00:17:27.549 111 # Verify reregistering hotplug poller 01:04:45.041 00:17:27.549 112 rpc_cmd bdev_nvme_set_hotplug -d 01:04:45.041 00:17:27.549 113 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.042 00:17:27.549 114 01:04:45.042 00:17:27.549 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.042 00:17:27.549 ... 01:04:45.042 00:17:27.549 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:04:45.042 00:17:27.549 ... 01:04:45.042 00:17:27.549 133 01:04:45.042 00:17:27.549 134 # Run pci bus hotplug test 01:04:45.042 00:17:27.549 135 run_hotplug 01:04:45.042 00:17:27.549 136 01:04:45.042 00:17:27.549 137 # Run SPDK target based hotplug 01:04:45.042 00:17:27.549 => 138 tgt_run_hotplug 01:04:45.042 00:17:27.549 ... 01:04:45.042 00:17:27.549 01:04:45.042 00:17:27.549 ========== Backtrace end ========== 01:04:45.042 00:17:27.549 ========== Backtrace start: ========== 01:04:45.042 00:17:27.549 01:04:45.042 00:17:27.549 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:04:45.042 00:17:27.549 ... 01:04:45.042 00:17:27.549 11 # Pci bus hotplug 01:04:45.042 00:17:27.549 12 # Helper function to remove/attach cotrollers 01:04:45.042 00:17:27.549 13 debug_remove_attach_helper() { 01:04:45.042 00:17:27.549 14 local helper_time=0 01:04:45.042 00:17:27.549 15 01:04:45.042 00:17:27.549 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:04:45.042 00:17:27.549 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:04:45.042 00:17:27.549 18 "$helper_time" "$nvme_count" >&2 01:04:45.042 00:17:27.549 19 } 01:04:45.042 00:17:27.549 20 01:04:45.042 00:17:27.549 21 remove_attach_helper() { 01:04:45.042 00:17:27.549 ... 01:04:45.042 00:17:27.549 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:04:45.042 00:17:27.549 ... 01:04:45.042 00:17:27.549 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:04:45.042 00:17:27.549 106 done 01:04:45.042 00:17:27.549 107 01:04:45.042 00:17:27.549 108 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.042 00:17:27.549 109 01:04:45.042 00:17:27.549 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.042 00:17:27.549 111 # Verify reregistering hotplug poller 01:04:45.042 00:17:27.549 112 rpc_cmd bdev_nvme_set_hotplug -d 01:04:45.042 00:17:27.549 113 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.042 00:17:27.549 114 01:04:45.042 00:17:27.549 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.042 00:17:27.549 ... 01:04:45.042 00:17:27.549 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:04:45.042 00:17:27.549 ... 01:04:45.042 00:17:27.550 133 01:04:45.042 00:17:27.550 134 # Run pci bus hotplug test 01:04:45.042 00:17:27.550 135 run_hotplug 01:04:45.042 00:17:27.550 136 01:04:45.042 00:17:27.550 137 # Run SPDK target based hotplug 01:04:45.042 00:17:27.550 => 138 tgt_run_hotplug 01:04:45.042 00:17:27.550 ... 01:04:45.042 00:17:27.550 01:04:45.042 00:17:27.550 ========== Backtrace end ========== 01:04:45.042 00:17:29.464 ========== Backtrace start: ========== 01:04:45.042 00:17:29.464 01:04:45.042 00:17:29.464 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh"]) 01:04:45.042 00:17:29.464 ... 01:04:45.042 00:17:29.464 1117 timing_enter $test_name 01:04:45.042 00:17:29.464 1118 echo "************************************" 01:04:45.042 00:17:29.464 1119 echo "START TEST $test_name" 01:04:45.042 00:17:29.464 1120 echo "************************************" 01:04:45.042 00:17:29.464 1121 xtrace_restore 01:04:45.042 00:17:29.464 1122 time "$@" 01:04:45.042 00:17:29.464 1123 xtrace_disable 01:04:45.042 00:17:29.464 1124 echo "************************************" 01:04:45.042 00:17:29.464 1125 echo "END TEST $test_name" 01:04:45.042 00:17:29.464 1126 echo "************************************" 01:04:45.042 00:17:29.464 1127 timing_exit $test_name 01:04:45.042 00:17:29.464 ... 01:04:45.042 00:17:29.464 in /home/vagrant/spdk_repo/spdk/autotest.sh:240 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 01:04:45.042 00:17:29.464 ... 01:04:45.042 00:17:29.464 235 01:04:45.042 00:17:29.464 236 run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh 01:04:45.042 00:17:29.464 237 run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh 01:04:45.042 00:17:29.464 238 01:04:45.042 00:17:29.464 239 if [ $(uname -s) = Linux ]; then 01:04:45.042 00:17:29.464 => 240 run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh 01:04:45.042 00:17:29.464 241 fi 01:04:45.042 00:17:29.464 242 01:04:45.042 00:17:29.464 243 if [[ $SPDK_TEST_XNVME -eq 1 ]]; then 01:04:45.042 00:17:29.464 244 run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh 01:04:45.042 00:17:29.464 245 run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme" 01:04:45.042 00:17:29.464 ... 01:04:45.042 00:17:29.464 01:04:45.042 00:17:29.464 ========== Backtrace end ==========' 01:04:45.042 + [[ -n 00:17:27.548 20:46:57 sw_hotplug -- common/autotest_common.sh@715 -- # time='========== Backtrace start: ========== 01:04:45.042 00:17:27.548 01:04:45.042 00:17:27.548 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:04:45.042 00:17:27.548 ... 01:04:45.042 00:17:27.548 710 01:04:45.042 00:17:27.548 711 # We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to 01:04:45.042 00:17:27.548 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 01:04:45.042 00:17:27.548 713 # but $() will return just the time'\''s data, hence making it possible to just do: 01:04:45.042 00:17:27.548 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:04:45.042 00:17:27.548 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:04:45.042 00:17:27.548 716 01:04:45.042 00:17:27.548 717 echo "$time" 01:04:45.042 00:17:27.548 718 ) 01:04:45.042 00:17:27.548 719 01:04:45.042 00:17:27.548 720 function timing_enter() { 01:04:45.042 00:17:27.548 ... 01:04:45.042 00:17:27.548 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:04:45.042 00:17:27.548 ... 01:04:45.042 00:17:27.548 11 # Pci bus hotplug 01:04:45.042 00:17:27.548 12 # Helper function to remove/attach cotrollers 01:04:45.042 00:17:27.548 13 debug_remove_attach_helper() { 01:04:45.042 00:17:27.548 14 local helper_time=0 01:04:45.042 00:17:27.548 15 01:04:45.042 00:17:27.548 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:04:45.042 00:17:27.548 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:04:45.042 00:17:27.548 18 "$helper_time" "$nvme_count" >&2 01:04:45.042 00:17:27.548 19 } 01:04:45.042 00:17:27.548 20 01:04:45.042 00:17:27.548 21 remove_attach_helper() { 01:04:45.042 00:17:27.548 ... 01:04:45.042 00:17:27.548 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:04:45.042 00:17:27.548 ... 01:04:45.042 00:17:27.548 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:04:45.042 00:17:27.548 106 done 01:04:45.042 00:17:27.548 107 01:04:45.042 00:17:27.548 108 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.042 00:17:27.548 109 01:04:45.042 00:17:27.548 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.042 00:17:27.548 111 # Verify reregistering hotplug poller 01:04:45.042 00:17:27.548 112 rpc_cmd bdev_nvme_set_hotplug -d 01:04:45.042 00:17:27.548 113 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.042 00:17:27.548 114 01:04:45.042 00:17:27.548 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.042 00:17:27.548 ... 01:04:45.042 00:17:27.548 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:04:45.042 00:17:27.548 ... 01:04:45.042 00:17:27.548 133 01:04:45.042 00:17:27.548 134 # Run pci bus hotplug test 01:04:45.042 00:17:27.548 135 run_hotplug 01:04:45.042 00:17:27.548 136 01:04:45.042 00:17:27.548 137 # Run SPDK target based hotplug 01:04:45.042 00:17:27.548 => 138 tgt_run_hotplug 01:04:45.042 00:17:27.548 ... 01:04:45.042 00:17:27.548 01:04:45.042 00:17:27.548 ========== Backtrace end ==========' 01:04:45.042 00:17:27.549 ========== Backtrace start: ========== 01:04:45.042 00:17:27.549 01:04:45.042 00:17:27.549 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:04:45.042 00:17:27.549 ... 01:04:45.042 00:17:27.549 710 01:04:45.042 00:17:27.549 711 # We redirect cmd's std{out,err} to a separate fd dup'ed to stdin's device (or /dev/null) to 01:04:45.042 00:17:27.549 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 01:04:45.042 00:17:27.549 713 # but $() will return just the time's data, hence making it possible to just do: 01:04:45.042 00:17:27.549 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:04:45.042 00:17:27.549 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:04:45.042 00:17:27.549 716 01:04:45.042 00:17:27.549 717 echo "$time" 01:04:45.042 00:17:27.549 718 ) 01:04:45.042 00:17:27.549 719 01:04:45.042 00:17:27.549 720 function timing_enter() { 01:04:45.042 00:17:27.549 ... 01:04:45.042 00:17:27.549 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:04:45.042 00:17:27.549 ... 01:04:45.042 00:17:27.549 11 # Pci bus hotplug 01:04:45.042 00:17:27.549 12 # Helper function to remove/attach cotrollers 01:04:45.042 00:17:27.549 13 debug_remove_attach_helper() { 01:04:45.042 00:17:27.549 14 local helper_time=0 01:04:45.042 00:17:27.549 15 01:04:45.042 00:17:27.549 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:04:45.042 00:17:27.549 17 printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \ 01:04:45.042 00:17:27.549 18 "$helper_time" "$nvme_count" >&2 01:04:45.042 00:17:27.549 19 } 01:04:45.042 00:17:27.549 20 01:04:45.042 00:17:27.549 21 remove_attach_helper() { 01:04:45.042 00:17:27.549 ... 01:04:45.042 00:17:27.549 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:04:45.042 00:17:27.549 ... 01:04:45.042 00:17:27.549 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:04:45.042 00:17:27.549 106 done 01:04:45.042 00:17:27.549 107 01:04:45.042 00:17:27.549 108 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.042 00:17:27.549 109 01:04:45.042 00:17:27.549 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.042 00:17:27.549 111 # Verify reregistering hotplug poller 01:04:45.042 00:17:27.549 112 rpc_cmd bdev_nvme_set_hotplug -d 01:04:45.042 00:17:27.549 113 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.043 00:17:27.549 114 01:04:45.043 00:17:27.549 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.043 00:17:27.549 ... 01:04:45.043 00:17:27.549 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:04:45.043 00:17:27.549 ... 01:04:45.043 00:17:27.549 133 01:04:45.043 00:17:27.549 134 # Run pci bus hotplug test 01:04:45.043 00:17:27.549 135 run_hotplug 01:04:45.043 00:17:27.549 136 01:04:45.043 00:17:27.549 137 # Run SPDK target based hotplug 01:04:45.043 00:17:27.549 => 138 tgt_run_hotplug 01:04:45.043 00:17:27.549 ... 01:04:45.043 00:17:27.549 01:04:45.043 00:17:27.549 ========== Backtrace end ========== 01:04:45.043 00:17:27.549 ========== Backtrace start: ========== 01:04:45.043 00:17:27.549 01:04:45.043 00:17:27.549 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:04:45.043 00:17:27.549 ... 01:04:45.043 00:17:27.549 713 # but $() will return just the time's data, hence making it possible to just do: 01:04:45.043 00:17:27.549 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:04:45.043 00:17:27.549 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:04:45.043 00:17:27.549 716 01:04:45.043 00:17:27.549 717 echo "$time" 01:04:45.043 00:17:27.549 => 718 ) 01:04:45.043 00:17:27.549 719 01:04:45.043 00:17:27.549 720 function timing_enter() { 01:04:45.043 00:17:27.549 721 xtrace_disable 01:04:45.043 00:17:27.549 722 timing "enter" "$1" 01:04:45.043 00:17:27.549 723 xtrace_restore 01:04:45.043 00:17:27.549 ... 01:04:45.043 00:17:27.549 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:04:45.043 00:17:27.549 ... 01:04:45.043 00:17:27.549 11 # Pci bus hotplug 01:04:45.043 00:17:27.549 12 # Helper function to remove/attach cotrollers 01:04:45.043 00:17:27.549 13 debug_remove_attach_helper() { 01:04:45.043 00:17:27.549 14 local helper_time=0 01:04:45.043 00:17:27.549 15 01:04:45.043 00:17:27.549 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:04:45.043 00:17:27.549 17 printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \ 01:04:45.043 00:17:27.549 18 "$helper_time" "$nvme_count" >&2 01:04:45.043 00:17:27.549 19 } 01:04:45.043 00:17:27.549 20 01:04:45.043 00:17:27.549 21 remove_attach_helper() { 01:04:45.043 00:17:27.549 ... 01:04:45.043 00:17:27.549 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:04:45.043 00:17:27.549 ... 01:04:45.043 00:17:27.549 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:04:45.043 00:17:27.549 106 done 01:04:45.043 00:17:27.549 107 01:04:45.043 00:17:27.549 108 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.043 00:17:27.549 109 01:04:45.043 00:17:27.549 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.043 00:17:27.549 111 # Verify reregistering hotplug poller 01:04:45.043 00:17:27.549 112 rpc_cmd bdev_nvme_set_hotplug -d 01:04:45.043 00:17:27.549 113 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.043 00:17:27.549 114 01:04:45.043 00:17:27.549 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.043 00:17:27.549 ... 01:04:45.043 00:17:27.549 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:04:45.043 00:17:27.549 ... 01:04:45.043 00:17:27.549 133 01:04:45.043 00:17:27.549 134 # Run pci bus hotplug test 01:04:45.043 00:17:27.549 135 run_hotplug 01:04:45.043 00:17:27.549 136 01:04:45.043 00:17:27.549 137 # Run SPDK target based hotplug 01:04:45.043 00:17:27.549 => 138 tgt_run_hotplug 01:04:45.043 00:17:27.549 ... 01:04:45.043 00:17:27.549 01:04:45.043 00:17:27.549 ========== Backtrace end ========== 01:04:45.043 00:17:27.549 ========== Backtrace start: ========== 01:04:45.043 00:17:27.549 01:04:45.043 00:17:27.549 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:04:45.043 00:17:27.549 ... 01:04:45.043 00:17:27.549 11 # Pci bus hotplug 01:04:45.043 00:17:27.549 12 # Helper function to remove/attach cotrollers 01:04:45.043 00:17:27.549 13 debug_remove_attach_helper() { 01:04:45.043 00:17:27.549 14 local helper_time=0 01:04:45.043 00:17:27.549 15 01:04:45.043 00:17:27.549 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:04:45.043 00:17:27.549 17 printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \ 01:04:45.043 00:17:27.549 18 "$helper_time" "$nvme_count" >&2 01:04:45.043 00:17:27.549 19 } 01:04:45.043 00:17:27.549 20 01:04:45.043 00:17:27.549 21 remove_attach_helper() { 01:04:45.043 00:17:27.549 ... 01:04:45.043 00:17:27.549 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:04:45.043 00:17:27.549 ... 01:04:45.043 00:17:27.549 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:04:45.043 00:17:27.549 106 done 01:04:45.043 00:17:27.549 107 01:04:45.043 00:17:27.549 108 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.043 00:17:27.549 109 01:04:45.043 00:17:27.549 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.043 00:17:27.549 111 # Verify reregistering hotplug poller 01:04:45.043 00:17:27.549 112 rpc_cmd bdev_nvme_set_hotplug -d 01:04:45.043 00:17:27.549 113 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.043 00:17:27.549 114 01:04:45.043 00:17:27.549 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.043 00:17:27.549 ... 01:04:45.043 00:17:27.549 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:04:45.043 00:17:27.549 ... 01:04:45.043 00:17:27.550 133 01:04:45.043 00:17:27.550 134 # Run pci bus hotplug test 01:04:45.043 00:17:27.550 135 run_hotplug 01:04:45.043 00:17:27.550 136 01:04:45.043 00:17:27.550 137 # Run SPDK target based hotplug 01:04:45.043 00:17:27.550 => 138 tgt_run_hotplug 01:04:45.043 00:17:27.550 ... 01:04:45.043 00:17:27.550 01:04:45.043 00:17:27.550 ========== Backtrace end ========== 01:04:45.043 00:17:29.464 ========== Backtrace start: ========== 01:04:45.043 00:17:29.464 01:04:45.043 00:17:29.464 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh"]) 01:04:45.043 00:17:29.464 ... 01:04:45.043 00:17:29.464 1117 timing_enter $test_name 01:04:45.043 00:17:29.464 1118 echo "************************************" 01:04:45.043 00:17:29.464 1119 echo "START TEST $test_name" 01:04:45.043 00:17:29.464 1120 echo "************************************" 01:04:45.043 00:17:29.464 1121 xtrace_restore 01:04:45.043 00:17:29.464 1122 time "$@" 01:04:45.043 00:17:29.464 1123 xtrace_disable 01:04:45.043 00:17:29.464 1124 echo "************************************" 01:04:45.043 00:17:29.464 1125 echo "END TEST $test_name" 01:04:45.043 00:17:29.464 1126 echo "************************************" 01:04:45.043 00:17:29.464 1127 timing_exit $test_name 01:04:45.043 00:17:29.464 ... 01:04:45.043 00:17:29.464 in /home/vagrant/spdk_repo/spdk/autotest.sh:240 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 01:04:45.043 00:17:29.464 ... 01:04:45.043 00:17:29.464 235 01:04:45.043 00:17:29.464 236 run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh 01:04:45.043 00:17:29.464 237 run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh 01:04:45.043 00:17:29.464 238 01:04:45.043 00:17:29.464 239 if [ $(uname -s) = Linux ]; then 01:04:45.043 00:17:29.464 => 240 run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh 01:04:45.043 00:17:29.464 241 fi 01:04:45.043 00:17:29.464 242 01:04:45.043 00:17:29.464 243 if [[ $SPDK_TEST_XNVME -eq 1 ]]; then 01:04:45.043 00:17:29.464 244 run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh 01:04:45.043 00:17:29.464 245 run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme" 01:04:45.043 00:17:29.464 ... 01:04:45.043 00:17:29.464 01:04:45.043 00:17:29.464 ========== Backtrace end ========== ]] 01:04:45.043 + echo '00:17:27.548 20:46:57 sw_hotplug -- common/autotest_common.sh@715 -- # time='\''========== Backtrace start: ========== 01:04:45.043 00:17:27.548 01:04:45.043 00:17:27.548 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:04:45.043 00:17:27.548 ... 01:04:45.043 00:17:27.548 710 01:04:45.043 00:17:27.548 711 # We redirect cmd'\''\'\'''\''s std{out,err} to a separate fd dup'\''\'\'''\''ed to stdin'\''\'\'''\''s device (or /dev/null) to 01:04:45.043 00:17:27.548 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 01:04:45.043 00:17:27.548 713 # but $() will return just the time'\''\'\'''\''s data, hence making it possible to just do: 01:04:45.043 00:17:27.548 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:04:45.043 00:17:27.548 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:04:45.043 00:17:27.548 716 01:04:45.043 00:17:27.548 717 echo "$time" 01:04:45.043 00:17:27.548 718 ) 01:04:45.043 00:17:27.548 719 01:04:45.043 00:17:27.548 720 function timing_enter() { 01:04:45.043 00:17:27.548 ... 01:04:45.043 00:17:27.548 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:04:45.043 00:17:27.548 ... 01:04:45.043 00:17:27.548 11 # Pci bus hotplug 01:04:45.043 00:17:27.548 12 # Helper function to remove/attach cotrollers 01:04:45.043 00:17:27.548 13 debug_remove_attach_helper() { 01:04:45.043 00:17:27.548 14 local helper_time=0 01:04:45.043 00:17:27.548 15 01:04:45.043 00:17:27.548 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:04:45.043 00:17:27.548 17 printf '\''\'\'''\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\''\'\'''\'' \ 01:04:45.043 00:17:27.548 18 "$helper_time" "$nvme_count" >&2 01:04:45.043 00:17:27.548 19 } 01:04:45.043 00:17:27.548 20 01:04:45.043 00:17:27.548 21 remove_attach_helper() { 01:04:45.043 00:17:27.548 ... 01:04:45.043 00:17:27.548 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:04:45.043 00:17:27.548 ... 01:04:45.043 00:17:27.548 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:04:45.043 00:17:27.548 106 done 01:04:45.043 00:17:27.548 107 01:04:45.043 00:17:27.548 108 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.043 00:17:27.548 109 01:04:45.043 00:17:27.548 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.043 00:17:27.548 111 # Verify reregistering hotplug poller 01:04:45.043 00:17:27.548 112 rpc_cmd bdev_nvme_set_hotplug -d 01:04:45.043 00:17:27.548 113 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.043 00:17:27.548 114 01:04:45.043 00:17:27.548 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.043 00:17:27.548 ... 01:04:45.044 00:17:27.548 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:04:45.044 00:17:27.548 ... 01:04:45.044 00:17:27.548 133 01:04:45.044 00:17:27.548 134 # Run pci bus hotplug test 01:04:45.044 00:17:27.548 135 run_hotplug 01:04:45.044 00:17:27.548 136 01:04:45.044 00:17:27.548 137 # Run SPDK target based hotplug 01:04:45.044 00:17:27.548 => 138 tgt_run_hotplug 01:04:45.044 00:17:27.548 ... 01:04:45.044 00:17:27.548 01:04:45.044 00:17:27.548 ========== Backtrace end =========='\'' 01:04:45.044 00:17:27.549 ========== Backtrace start: ========== 01:04:45.044 00:17:27.549 01:04:45.044 00:17:27.549 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:04:45.044 00:17:27.549 ... 01:04:45.044 00:17:27.549 710 01:04:45.044 00:17:27.549 711 # We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to 01:04:45.044 00:17:27.549 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 01:04:45.044 00:17:27.549 713 # but $() will return just the time'\''s data, hence making it possible to just do: 01:04:45.044 00:17:27.549 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:04:45.044 00:17:27.549 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:04:45.044 00:17:27.549 716 01:04:45.044 00:17:27.549 717 echo "$time" 01:04:45.044 00:17:27.549 718 ) 01:04:45.044 00:17:27.549 719 01:04:45.044 00:17:27.549 720 function timing_enter() { 01:04:45.044 00:17:27.549 ... 01:04:45.044 00:17:27.549 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:04:45.044 00:17:27.549 ... 01:04:45.044 00:17:27.549 11 # Pci bus hotplug 01:04:45.044 00:17:27.549 12 # Helper function to remove/attach cotrollers 01:04:45.044 00:17:27.549 13 debug_remove_attach_helper() { 01:04:45.044 00:17:27.549 14 local helper_time=0 01:04:45.044 00:17:27.549 15 01:04:45.044 00:17:27.549 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:04:45.044 00:17:27.549 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:04:45.044 00:17:27.549 18 "$helper_time" "$nvme_count" >&2 01:04:45.044 00:17:27.549 19 } 01:04:45.044 00:17:27.549 20 01:04:45.044 00:17:27.549 21 remove_attach_helper() { 01:04:45.044 00:17:27.549 ... 01:04:45.044 00:17:27.549 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:04:45.044 00:17:27.549 ... 01:04:45.044 00:17:27.549 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:04:45.044 00:17:27.549 106 done 01:04:45.044 00:17:27.549 107 01:04:45.044 00:17:27.549 108 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.044 00:17:27.549 109 01:04:45.044 00:17:27.549 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.044 00:17:27.549 111 # Verify reregistering hotplug poller 01:04:45.044 00:17:27.549 112 rpc_cmd bdev_nvme_set_hotplug -d 01:04:45.044 00:17:27.549 113 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.044 00:17:27.549 114 01:04:45.044 00:17:27.549 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.044 00:17:27.549 ... 01:04:45.044 00:17:27.549 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:04:45.044 00:17:27.549 ... 01:04:45.044 00:17:27.549 133 01:04:45.044 00:17:27.549 134 # Run pci bus hotplug test 01:04:45.044 00:17:27.549 135 run_hotplug 01:04:45.044 00:17:27.549 136 01:04:45.044 00:17:27.549 137 # Run SPDK target based hotplug 01:04:45.044 00:17:27.549 => 138 tgt_run_hotplug 01:04:45.044 00:17:27.549 ... 01:04:45.044 00:17:27.549 01:04:45.044 00:17:27.549 ========== Backtrace end ========== 01:04:45.044 00:17:27.549 ========== Backtrace start: ========== 01:04:45.044 00:17:27.549 01:04:45.044 00:17:27.549 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:04:45.044 00:17:27.549 ... 01:04:45.044 00:17:27.549 713 # but $() will return just the time'\''s data, hence making it possible to just do: 01:04:45.044 00:17:27.549 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:04:45.044 00:17:27.549 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:04:45.044 00:17:27.549 716 01:04:45.044 00:17:27.549 717 echo "$time" 01:04:45.044 00:17:27.549 => 718 ) 01:04:45.044 00:17:27.549 719 01:04:45.044 00:17:27.549 720 function timing_enter() { 01:04:45.044 00:17:27.549 721 xtrace_disable 01:04:45.044 00:17:27.549 722 timing "enter" "$1" 01:04:45.044 00:17:27.549 723 xtrace_restore 01:04:45.044 00:17:27.549 ... 01:04:45.044 00:17:27.549 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:04:45.044 00:17:27.549 ... 01:04:45.044 00:17:27.549 11 # Pci bus hotplug 01:04:45.044 00:17:27.549 12 # Helper function to remove/attach cotrollers 01:04:45.044 00:17:27.549 13 debug_remove_attach_helper() { 01:04:45.044 00:17:27.549 14 local helper_time=0 01:04:45.044 00:17:27.549 15 01:04:45.044 00:17:27.549 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:04:45.044 00:17:27.549 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:04:45.044 00:17:27.549 18 "$helper_time" "$nvme_count" >&2 01:04:45.044 00:17:27.549 19 } 01:04:45.044 00:17:27.549 20 01:04:45.044 00:17:27.549 21 remove_attach_helper() { 01:04:45.044 00:17:27.549 ... 01:04:45.044 00:17:27.549 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:04:45.044 00:17:27.549 ... 01:04:45.044 00:17:27.549 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:04:45.044 00:17:27.549 106 done 01:04:45.044 00:17:27.549 107 01:04:45.044 00:17:27.549 108 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.044 00:17:27.549 109 01:04:45.044 00:17:27.549 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.044 00:17:27.549 111 # Verify reregistering hotplug poller 01:04:45.044 00:17:27.549 112 rpc_cmd bdev_nvme_set_hotplug -d 01:04:45.044 00:17:27.549 113 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.044 00:17:27.549 114 01:04:45.044 00:17:27.549 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.044 00:17:27.549 ... 01:04:45.044 00:17:27.549 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:04:45.044 00:17:27.549 ... 01:04:45.044 00:17:27.549 133 01:04:45.044 00:17:27.549 134 # Run pci bus hotplug test 01:04:45.044 00:17:27.549 135 run_hotplug 01:04:45.044 00:17:27.549 136 01:04:45.044 00:17:27.549 137 # Run SPDK target based hotplug 01:04:45.044 00:17:27.549 => 138 tgt_run_hotplug 01:04:45.044 00:17:27.549 ... 01:04:45.044 00:17:27.549 01:04:45.044 00:17:27.549 ========== Backtrace end ========== 01:04:45.044 00:17:27.549 ========== Backtrace start: ========== 01:04:45.044 00:17:27.549 01:04:45.044 00:17:27.549 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:04:45.044 00:17:27.549 ... 01:04:45.044 00:17:27.549 11 # Pci bus hotplug 01:04:45.044 00:17:27.549 12 # Helper function to remove/attach cotrollers 01:04:45.044 00:17:27.549 13 debug_remove_attach_helper() { 01:04:45.044 00:17:27.549 14 local helper_time=0 01:04:45.044 00:17:27.549 15 01:04:45.044 00:17:27.549 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:04:45.044 00:17:27.549 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:04:45.044 00:17:27.549 18 "$helper_time" "$nvme_count" >&2 01:04:45.044 00:17:27.549 19 } 01:04:45.044 00:17:27.549 20 01:04:45.044 00:17:27.549 21 remove_attach_helper() { 01:04:45.044 00:17:27.549 ... 01:04:45.044 00:17:27.549 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:04:45.044 00:17:27.549 ... 01:04:45.044 00:17:27.549 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:04:45.044 00:17:27.549 106 done 01:04:45.044 00:17:27.549 107 01:04:45.044 00:17:27.549 108 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.044 00:17:27.549 109 01:04:45.044 00:17:27.549 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.044 00:17:27.549 111 # Verify reregistering hotplug poller 01:04:45.044 00:17:27.549 112 rpc_cmd bdev_nvme_set_hotplug -d 01:04:45.044 00:17:27.549 113 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.044 00:17:27.549 114 01:04:45.044 00:17:27.549 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.044 00:17:27.549 ... 01:04:45.045 00:17:27.549 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:04:45.045 00:17:27.549 ... 01:04:45.045 00:17:27.550 133 01:04:45.045 00:17:27.550 134 # Run pci bus hotplug test 01:04:45.045 00:17:27.550 135 run_hotplug 01:04:45.045 00:17:27.550 136 01:04:45.045 00:17:27.550 137 # Run SPDK target based hotplug 01:04:45.045 00:17:27.550 => 138 tgt_run_hotplug 01:04:45.045 00:17:27.550 ... 01:04:45.045 00:17:27.550 01:04:45.045 00:17:27.550 ========== Backtrace end ========== 01:04:45.045 00:17:29.464 ========== Backtrace start: ========== 01:04:45.045 00:17:29.464 01:04:45.045 00:17:29.464 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh"]) 01:04:45.045 00:17:29.464 ... 01:04:45.045 00:17:29.464 1117 timing_enter $test_name 01:04:45.045 00:17:29.464 1118 echo "************************************" 01:04:45.045 00:17:29.464 1119 echo "START TEST $test_name" 01:04:45.045 00:17:29.464 1120 echo "************************************" 01:04:45.045 00:17:29.464 1121 xtrace_restore 01:04:45.045 00:17:29.464 1122 time "$@" 01:04:45.045 00:17:29.464 1123 xtrace_disable 01:04:45.045 00:17:29.464 1124 echo "************************************" 01:04:45.045 00:17:29.464 1125 echo "END TEST $test_name" 01:04:45.045 00:17:29.464 1126 echo "************************************" 01:04:45.045 00:17:29.464 1127 timing_exit $test_name 01:04:45.045 00:17:29.464 ... 01:04:45.045 00:17:29.464 in /home/vagrant/spdk_repo/spdk/autotest.sh:240 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 01:04:45.045 00:17:29.464 ... 01:04:45.045 00:17:29.464 235 01:04:45.045 00:17:29.464 236 run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh 01:04:45.045 00:17:29.464 237 run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh 01:04:45.045 00:17:29.464 238 01:04:45.045 00:17:29.464 239 if [ $(uname -s) = Linux ]; then 01:04:45.045 00:17:29.464 => 240 run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh 01:04:45.045 00:17:29.464 241 fi 01:04:45.045 00:17:29.464 242 01:04:45.045 00:17:29.464 243 if [[ $SPDK_TEST_XNVME -eq 1 ]]; then 01:04:45.045 00:17:29.464 244 run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh 01:04:45.045 00:17:29.464 245 run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme" 01:04:45.045 00:17:29.464 ... 01:04:45.045 00:17:29.464 01:04:45.045 00:17:29.464 ========== Backtrace end ==========' 01:04:45.045 + for build in "${build_log_list[@]}" 01:04:45.045 + create_errtrace_file /var/jenkins/workspace/autotest-nightly/autobuild-external-vg-autotest_19750/build.log 01:04:45.045 + local build_log job_name start_pattern end_pattern backtraces 01:04:45.045 + build_log=/var/jenkins/workspace/autotest-nightly/autobuild-external-vg-autotest_19750/build.log 01:04:45.045 +++ dirname /var/jenkins/workspace/autotest-nightly/autobuild-external-vg-autotest_19750/build.log 01:04:45.045 ++ basename /var/jenkins/workspace/autotest-nightly/autobuild-external-vg-autotest_19750 01:04:45.045 + job_name=autobuild-external-vg-autotest_19750 01:04:45.045 + start_pattern='Backtrace start' 01:04:45.045 + end_pattern='Backtrace end' 01:04:45.045 + [[ -f /var/jenkins/workspace/autotest-nightly/autobuild-external-vg-autotest_19750/build.log ]] 01:04:45.045 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-nightly/autobuild-external-vg-autotest_19750/build.log 01:04:45.045 + backtraces= 01:04:45.045 + [[ -n '' ]] 01:04:45.045 + for build in "${build_log_list[@]}" 01:04:45.045 + create_errtrace_file /var/jenkins/workspace/autotest-nightly/doc-docker-autotest_22251/build.log 01:04:45.045 + local build_log job_name start_pattern end_pattern backtraces 01:04:45.045 + build_log=/var/jenkins/workspace/autotest-nightly/doc-docker-autotest_22251/build.log 01:04:45.045 +++ dirname /var/jenkins/workspace/autotest-nightly/doc-docker-autotest_22251/build.log 01:04:45.045 ++ basename /var/jenkins/workspace/autotest-nightly/doc-docker-autotest_22251 01:04:45.045 + job_name=doc-docker-autotest_22251 01:04:45.045 + start_pattern='Backtrace start' 01:04:45.045 + end_pattern='Backtrace end' 01:04:45.045 + [[ -f /var/jenkins/workspace/autotest-nightly/doc-docker-autotest_22251/build.log ]] 01:04:45.045 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-nightly/doc-docker-autotest_22251/build.log 01:04:45.045 + backtraces= 01:04:45.045 + [[ -n '' ]] 01:04:45.045 + for build in "${build_log_list[@]}" 01:04:45.045 + create_errtrace_file /var/jenkins/workspace/autotest-nightly/nvmf-phy-autotest_72361/build.log 01:04:45.045 + local build_log job_name start_pattern end_pattern backtraces 01:04:45.045 + build_log=/var/jenkins/workspace/autotest-nightly/nvmf-phy-autotest_72361/build.log 01:04:45.045 +++ dirname /var/jenkins/workspace/autotest-nightly/nvmf-phy-autotest_72361/build.log 01:04:45.045 ++ basename /var/jenkins/workspace/autotest-nightly/nvmf-phy-autotest_72361 01:04:45.045 + job_name=nvmf-phy-autotest_72361 01:04:45.045 + start_pattern='Backtrace start' 01:04:45.045 + end_pattern='Backtrace end' 01:04:45.045 + [[ -f /var/jenkins/workspace/autotest-nightly/nvmf-phy-autotest_72361/build.log ]] 01:04:45.045 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-nightly/nvmf-phy-autotest_72361/build.log 01:04:45.045 + backtraces= 01:04:45.045 + [[ -n '' ]] 01:04:45.045 + for build in "${build_log_list[@]}" 01:04:45.045 + create_errtrace_file /var/jenkins/workspace/autotest-nightly/build-files-docker-autotest_22060/build.log 01:04:45.045 + local build_log job_name start_pattern end_pattern backtraces 01:04:45.045 + build_log=/var/jenkins/workspace/autotest-nightly/build-files-docker-autotest_22060/build.log 01:04:45.045 +++ dirname /var/jenkins/workspace/autotest-nightly/build-files-docker-autotest_22060/build.log 01:04:45.045 ++ basename /var/jenkins/workspace/autotest-nightly/build-files-docker-autotest_22060 01:04:45.045 + job_name=build-files-docker-autotest_22060 01:04:45.045 + start_pattern='Backtrace start' 01:04:45.045 + end_pattern='Backtrace end' 01:04:45.045 + [[ -f /var/jenkins/workspace/autotest-nightly/build-files-docker-autotest_22060/build.log ]] 01:04:45.045 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-nightly/build-files-docker-autotest_22060/build.log 01:04:45.045 + backtraces= 01:04:45.045 + [[ -n '' ]] 01:04:45.045 + for build in "${build_log_list[@]}" 01:04:45.045 + create_errtrace_file /var/jenkins/workspace/autotest-nightly/iscsi-vg-autotest_77435/build.log 01:04:45.045 + local build_log job_name start_pattern end_pattern backtraces 01:04:45.045 + build_log=/var/jenkins/workspace/autotest-nightly/iscsi-vg-autotest_77435/build.log 01:04:45.045 +++ dirname /var/jenkins/workspace/autotest-nightly/iscsi-vg-autotest_77435/build.log 01:04:45.045 ++ basename /var/jenkins/workspace/autotest-nightly/iscsi-vg-autotest_77435 01:04:45.045 + job_name=iscsi-vg-autotest_77435 01:04:45.045 + start_pattern='Backtrace start' 01:04:45.045 + end_pattern='Backtrace end' 01:04:45.045 + [[ -f /var/jenkins/workspace/autotest-nightly/iscsi-vg-autotest_77435/build.log ]] 01:04:45.045 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-nightly/iscsi-vg-autotest_77435/build.log 01:04:45.045 + backtraces= 01:04:45.045 + [[ -n '' ]] 01:04:45.045 + for build in "${build_log_list[@]}" 01:04:45.045 + create_errtrace_file /var/jenkins/workspace/autotest-nightly/nvmf-tcp-uring-vg-autotest_77322/build.log 01:04:45.045 + local build_log job_name start_pattern end_pattern backtraces 01:04:45.045 + build_log=/var/jenkins/workspace/autotest-nightly/nvmf-tcp-uring-vg-autotest_77322/build.log 01:04:45.045 +++ dirname /var/jenkins/workspace/autotest-nightly/nvmf-tcp-uring-vg-autotest_77322/build.log 01:04:45.045 ++ basename /var/jenkins/workspace/autotest-nightly/nvmf-tcp-uring-vg-autotest_77322 01:04:45.045 + job_name=nvmf-tcp-uring-vg-autotest_77322 01:04:45.045 + start_pattern='Backtrace start' 01:04:45.045 + end_pattern='Backtrace end' 01:04:45.045 + [[ -f /var/jenkins/workspace/autotest-nightly/nvmf-tcp-uring-vg-autotest_77322/build.log ]] 01:04:45.045 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-nightly/nvmf-tcp-uring-vg-autotest_77322/build.log 01:04:45.045 + backtraces= 01:04:45.045 + [[ -n '' ]] 01:04:45.045 + for build in "${build_log_list[@]}" 01:04:45.045 + create_errtrace_file /var/jenkins/workspace/autotest-nightly/BlobFS-phy-autotest_26123/build.log 01:04:45.045 + local build_log job_name start_pattern end_pattern backtraces 01:04:45.045 + build_log=/var/jenkins/workspace/autotest-nightly/BlobFS-phy-autotest_26123/build.log 01:04:45.045 +++ dirname /var/jenkins/workspace/autotest-nightly/BlobFS-phy-autotest_26123/build.log 01:04:45.045 ++ basename /var/jenkins/workspace/autotest-nightly/BlobFS-phy-autotest_26123 01:04:45.045 + job_name=BlobFS-phy-autotest_26123 01:04:45.045 + start_pattern='Backtrace start' 01:04:45.045 + end_pattern='Backtrace end' 01:04:45.045 + [[ -f /var/jenkins/workspace/autotest-nightly/BlobFS-phy-autotest_26123/build.log ]] 01:04:45.045 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-nightly/BlobFS-phy-autotest_26123/build.log 01:04:45.045 + backtraces= 01:04:45.045 + [[ -n '' ]] 01:04:45.045 + for build in "${build_log_list[@]}" 01:04:45.045 + create_errtrace_file /var/jenkins/workspace/autotest-nightly/zns-vg-autotest_76503/build.log 01:04:45.045 + local build_log job_name start_pattern end_pattern backtraces 01:04:45.045 + build_log=/var/jenkins/workspace/autotest-nightly/zns-vg-autotest_76503/build.log 01:04:45.045 +++ dirname /var/jenkins/workspace/autotest-nightly/zns-vg-autotest_76503/build.log 01:04:45.045 ++ basename /var/jenkins/workspace/autotest-nightly/zns-vg-autotest_76503 01:04:45.045 + job_name=zns-vg-autotest_76503 01:04:45.045 + start_pattern='Backtrace start' 01:04:45.045 + end_pattern='Backtrace end' 01:04:45.045 + [[ -f /var/jenkins/workspace/autotest-nightly/zns-vg-autotest_76503/build.log ]] 01:04:45.045 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-nightly/zns-vg-autotest_76503/build.log 01:04:45.045 + backtraces= 01:04:45.045 + [[ -n '' ]] 01:04:45.045 + for build in "${build_log_list[@]}" 01:04:45.045 + create_errtrace_file /var/jenkins/workspace/autotest-nightly/dsa-phy-autotest_4817/build.log 01:04:45.045 + local build_log job_name start_pattern end_pattern backtraces 01:04:45.045 + build_log=/var/jenkins/workspace/autotest-nightly/dsa-phy-autotest_4817/build.log 01:04:45.045 +++ dirname /var/jenkins/workspace/autotest-nightly/dsa-phy-autotest_4817/build.log 01:04:45.045 ++ basename /var/jenkins/workspace/autotest-nightly/dsa-phy-autotest_4817 01:04:45.045 + job_name=dsa-phy-autotest_4817 01:04:45.045 + start_pattern='Backtrace start' 01:04:45.045 + end_pattern='Backtrace end' 01:04:45.045 + [[ -f /var/jenkins/workspace/autotest-nightly/dsa-phy-autotest_4817/build.log ]] 01:04:45.045 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-nightly/dsa-phy-autotest_4817/build.log 01:04:45.045 + backtraces= 01:04:45.045 + [[ -n '' ]] 01:04:45.045 + for build in "${build_log_list[@]}" 01:04:45.045 + create_errtrace_file /var/jenkins/workspace/autotest-nightly/nvmf-tcp-phy-autotest_72248/build.log 01:04:45.045 + local build_log job_name start_pattern end_pattern backtraces 01:04:45.045 + build_log=/var/jenkins/workspace/autotest-nightly/nvmf-tcp-phy-autotest_72248/build.log 01:04:45.045 +++ dirname /var/jenkins/workspace/autotest-nightly/nvmf-tcp-phy-autotest_72248/build.log 01:04:45.045 ++ basename /var/jenkins/workspace/autotest-nightly/nvmf-tcp-phy-autotest_72248 01:04:45.045 + job_name=nvmf-tcp-phy-autotest_72248 01:04:45.045 + start_pattern='Backtrace start' 01:04:45.045 + end_pattern='Backtrace end' 01:04:45.045 + [[ -f /var/jenkins/workspace/autotest-nightly/nvmf-tcp-phy-autotest_72248/build.log ]] 01:04:45.046 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-nightly/nvmf-tcp-phy-autotest_72248/build.log 01:04:45.046 + backtraces= 01:04:45.046 + [[ -n '' ]] 01:04:45.046 + for build in "${build_log_list[@]}" 01:04:45.046 + create_errtrace_file /var/jenkins/workspace/autotest-nightly/nvme-phy-autotest_72289/build.log 01:04:45.046 + local build_log job_name start_pattern end_pattern backtraces 01:04:45.046 + build_log=/var/jenkins/workspace/autotest-nightly/nvme-phy-autotest_72289/build.log 01:04:45.046 +++ dirname /var/jenkins/workspace/autotest-nightly/nvme-phy-autotest_72289/build.log 01:04:45.306 ++ basename /var/jenkins/workspace/autotest-nightly/nvme-phy-autotest_72289 01:04:45.306 + job_name=nvme-phy-autotest_72289 01:04:45.306 + start_pattern='Backtrace start' 01:04:45.306 + end_pattern='Backtrace end' 01:04:45.306 + [[ -f /var/jenkins/workspace/autotest-nightly/nvme-phy-autotest_72289/build.log ]] 01:04:45.306 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-nightly/nvme-phy-autotest_72289/build.log 01:04:45.306 + backtraces= 01:04:45.306 + [[ -n '' ]] 01:04:45.306 + for build in "${build_log_list[@]}" 01:04:45.306 + create_errtrace_file /var/jenkins/workspace/autotest-nightly/ubuntu20-vg-autotest_73716/build.log 01:04:45.306 + local build_log job_name start_pattern end_pattern backtraces 01:04:45.306 + build_log=/var/jenkins/workspace/autotest-nightly/ubuntu20-vg-autotest_73716/build.log 01:04:45.306 +++ dirname /var/jenkins/workspace/autotest-nightly/ubuntu20-vg-autotest_73716/build.log 01:04:45.306 ++ basename /var/jenkins/workspace/autotest-nightly/ubuntu20-vg-autotest_73716 01:04:45.306 + job_name=ubuntu20-vg-autotest_73716 01:04:45.306 + start_pattern='Backtrace start' 01:04:45.306 + end_pattern='Backtrace end' 01:04:45.306 + [[ -f /var/jenkins/workspace/autotest-nightly/ubuntu20-vg-autotest_73716/build.log ]] 01:04:45.306 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-nightly/ubuntu20-vg-autotest_73716/build.log 01:04:45.306 + backtraces='00:48:32.007 21:18:01 sw_hotplug -- common/autotest_common.sh@715 -- # time='\''========== Backtrace start: ========== 01:04:45.306 00:48:32.007 01:04:45.306 00:48:32.007 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:04:45.306 00:48:32.007 ... 01:04:45.306 00:48:32.007 710 01:04:45.306 00:48:32.007 711 # We redirect cmd'\''\'\'''\''s std{out,err} to a separate fd dup'\''\'\'''\''ed to stdin'\''\'\'''\''s device (or /dev/null) to 01:04:45.306 00:48:32.007 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 01:04:45.306 00:48:32.007 713 # but $() will return just the time'\''\'\'''\''s data, hence making it possible to just do: 01:04:45.306 00:48:32.007 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:04:45.306 00:48:32.007 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:04:45.306 00:48:32.007 716 01:04:45.306 00:48:32.007 717 echo "$time" 01:04:45.306 00:48:32.007 718 ) 01:04:45.306 00:48:32.007 719 01:04:45.306 00:48:32.007 720 function timing_enter() { 01:04:45.306 00:48:32.007 ... 01:04:45.306 00:48:32.007 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:04:45.307 00:48:32.007 ... 01:04:45.307 00:48:32.007 11 # Pci bus hotplug 01:04:45.307 00:48:32.007 12 # Helper function to remove/attach cotrollers 01:04:45.307 00:48:32.007 13 debug_remove_attach_helper() { 01:04:45.307 00:48:32.007 14 local helper_time=0 01:04:45.307 00:48:32.007 15 01:04:45.307 00:48:32.007 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:04:45.307 00:48:32.008 17 printf '\''\'\'''\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\''\'\'''\'' \ 01:04:45.307 00:48:32.008 18 "$helper_time" "$nvme_count" >&2 01:04:45.307 00:48:32.008 19 } 01:04:45.307 00:48:32.008 20 01:04:45.307 00:48:32.008 21 remove_attach_helper() { 01:04:45.307 00:48:32.008 ... 01:04:45.307 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:04:45.307 00:48:32.008 ... 01:04:45.307 00:48:32.008 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:04:45.307 00:48:32.008 106 done 01:04:45.307 00:48:32.008 107 01:04:45.307 00:48:32.008 108 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.307 00:48:32.008 109 01:04:45.307 00:48:32.008 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.307 00:48:32.008 111 # Verify reregistering hotplug poller 01:04:45.307 00:48:32.008 112 rpc_cmd bdev_nvme_set_hotplug -d 01:04:45.307 00:48:32.008 113 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.307 00:48:32.008 114 01:04:45.307 00:48:32.008 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.307 00:48:32.008 ... 01:04:45.307 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:04:45.307 00:48:32.008 ... 01:04:45.307 00:48:32.008 133 01:04:45.307 00:48:32.008 134 # Run pci bus hotplug test 01:04:45.307 00:48:32.008 135 run_hotplug 01:04:45.307 00:48:32.008 136 01:04:45.307 00:48:32.008 137 # Run SPDK target based hotplug 01:04:45.307 00:48:32.008 => 138 tgt_run_hotplug 01:04:45.307 00:48:32.008 ... 01:04:45.307 00:48:32.008 01:04:45.307 00:48:32.008 ========== Backtrace end ========== 01:04:45.307 00:48:32.008 ========== Backtrace start: ========== 01:04:45.307 00:48:32.008 01:04:45.307 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:04:45.307 00:48:32.008 ... 01:04:45.307 00:48:32.008 710 01:04:45.307 00:48:32.008 711 # We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to 01:04:45.307 00:48:32.008 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 01:04:45.307 00:48:32.008 713 # but $() will return just the time'\''s data, hence making it possible to just do: 01:04:45.307 00:48:32.008 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:04:45.307 00:48:32.008 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:04:45.307 00:48:32.008 716 01:04:45.307 00:48:32.008 717 echo "$time" 01:04:45.307 00:48:32.008 718 ) 01:04:45.307 00:48:32.008 719 01:04:45.307 00:48:32.008 720 function timing_enter() { 01:04:45.307 00:48:32.008 ... 01:04:45.307 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:04:45.307 00:48:32.008 ... 01:04:45.307 00:48:32.008 11 # Pci bus hotplug 01:04:45.307 00:48:32.008 12 # Helper function to remove/attach cotrollers 01:04:45.307 00:48:32.008 13 debug_remove_attach_helper() { 01:04:45.307 00:48:32.008 14 local helper_time=0 01:04:45.307 00:48:32.008 15 01:04:45.307 00:48:32.008 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:04:45.307 00:48:32.008 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:04:45.307 00:48:32.008 18 "$helper_time" "$nvme_count" >&2 01:04:45.307 00:48:32.008 19 } 01:04:45.307 00:48:32.008 20 01:04:45.307 00:48:32.008 21 remove_attach_helper() { 01:04:45.307 00:48:32.008 ... 01:04:45.307 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:04:45.307 00:48:32.008 ... 01:04:45.307 00:48:32.008 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:04:45.307 00:48:32.008 106 done 01:04:45.307 00:48:32.008 107 01:04:45.307 00:48:32.008 108 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.307 00:48:32.008 109 01:04:45.307 00:48:32.008 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.307 00:48:32.008 111 # Verify reregistering hotplug poller 01:04:45.307 00:48:32.008 112 rpc_cmd bdev_nvme_set_hotplug -d 01:04:45.307 00:48:32.008 113 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.307 00:48:32.008 114 01:04:45.307 00:48:32.008 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.307 00:48:32.008 ... 01:04:45.307 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:04:45.307 00:48:32.008 ... 01:04:45.307 00:48:32.008 133 01:04:45.307 00:48:32.008 134 # Run pci bus hotplug test 01:04:45.307 00:48:32.008 135 run_hotplug 01:04:45.307 00:48:32.008 136 01:04:45.307 00:48:32.008 137 # Run SPDK target based hotplug 01:04:45.307 00:48:32.008 => 138 tgt_run_hotplug 01:04:45.307 00:48:32.008 ... 01:04:45.307 00:48:32.008 01:04:45.307 00:48:32.008 ========== Backtrace end ========== 01:04:45.307 00:48:32.008 ========== Backtrace start: ========== 01:04:45.307 00:48:32.008 01:04:45.307 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:04:45.307 00:48:32.008 ... 01:04:45.307 00:48:32.008 713 # but $() will return just the time'\''s data, hence making it possible to just do: 01:04:45.307 00:48:32.008 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:04:45.307 00:48:32.008 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:04:45.307 00:48:32.008 716 01:04:45.307 00:48:32.008 717 echo "$time" 01:04:45.307 00:48:32.008 => 718 ) 01:04:45.307 00:48:32.008 719 01:04:45.307 00:48:32.008 720 function timing_enter() { 01:04:45.307 00:48:32.008 721 xtrace_disable 01:04:45.307 00:48:32.008 722 timing "enter" "$1" 01:04:45.307 00:48:32.008 723 xtrace_restore 01:04:45.307 00:48:32.008 ... 01:04:45.307 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:04:45.307 00:48:32.008 ... 01:04:45.307 00:48:32.008 11 # Pci bus hotplug 01:04:45.307 00:48:32.008 12 # Helper function to remove/attach cotrollers 01:04:45.307 00:48:32.008 13 debug_remove_attach_helper() { 01:04:45.307 00:48:32.008 14 local helper_time=0 01:04:45.307 00:48:32.008 15 01:04:45.307 00:48:32.008 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:04:45.307 00:48:32.008 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:04:45.307 00:48:32.008 18 "$helper_time" "$nvme_count" >&2 01:04:45.307 00:48:32.008 19 } 01:04:45.307 00:48:32.008 20 01:04:45.307 00:48:32.008 21 remove_attach_helper() { 01:04:45.307 00:48:32.008 ... 01:04:45.307 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:04:45.307 00:48:32.008 ... 01:04:45.307 00:48:32.008 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:04:45.307 00:48:32.008 106 done 01:04:45.307 00:48:32.008 107 01:04:45.307 00:48:32.008 108 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.307 00:48:32.008 109 01:04:45.307 00:48:32.008 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.307 00:48:32.008 111 # Verify reregistering hotplug poller 01:04:45.307 00:48:32.008 112 rpc_cmd bdev_nvme_set_hotplug -d 01:04:45.307 00:48:32.008 113 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.307 00:48:32.008 114 01:04:45.307 00:48:32.008 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.307 00:48:32.008 ... 01:04:45.307 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:04:45.307 00:48:32.008 ... 01:04:45.307 00:48:32.008 133 01:04:45.307 00:48:32.008 134 # Run pci bus hotplug test 01:04:45.307 00:48:32.008 135 run_hotplug 01:04:45.307 00:48:32.008 136 01:04:45.307 00:48:32.008 137 # Run SPDK target based hotplug 01:04:45.307 00:48:32.008 => 138 tgt_run_hotplug 01:04:45.307 00:48:32.008 ... 01:04:45.307 00:48:32.008 01:04:45.307 00:48:32.008 ========== Backtrace end ========== 01:04:45.307 00:48:32.008 ========== Backtrace start: ========== 01:04:45.307 00:48:32.008 01:04:45.307 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:04:45.307 00:48:32.008 ... 01:04:45.307 00:48:32.008 11 # Pci bus hotplug 01:04:45.307 00:48:32.008 12 # Helper function to remove/attach cotrollers 01:04:45.307 00:48:32.008 13 debug_remove_attach_helper() { 01:04:45.307 00:48:32.008 14 local helper_time=0 01:04:45.307 00:48:32.008 15 01:04:45.307 00:48:32.008 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:04:45.307 00:48:32.008 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:04:45.307 00:48:32.008 18 "$helper_time" "$nvme_count" >&2 01:04:45.307 00:48:32.008 19 } 01:04:45.307 00:48:32.008 20 01:04:45.307 00:48:32.008 21 remove_attach_helper() { 01:04:45.307 00:48:32.008 ... 01:04:45.307 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:04:45.307 00:48:32.008 ... 01:04:45.307 00:48:32.008 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:04:45.307 00:48:32.008 106 done 01:04:45.307 00:48:32.008 107 01:04:45.307 00:48:32.008 108 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.307 00:48:32.008 109 01:04:45.307 00:48:32.008 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.307 00:48:32.008 111 # Verify reregistering hotplug poller 01:04:45.307 00:48:32.008 112 rpc_cmd bdev_nvme_set_hotplug -d 01:04:45.307 00:48:32.008 113 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.307 00:48:32.008 114 01:04:45.307 00:48:32.008 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.307 00:48:32.008 ... 01:04:45.307 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:04:45.307 00:48:32.008 ... 01:04:45.307 00:48:32.008 133 01:04:45.307 00:48:32.008 134 # Run pci bus hotplug test 01:04:45.307 00:48:32.008 135 run_hotplug 01:04:45.307 00:48:32.008 136 01:04:45.307 00:48:32.008 137 # Run SPDK target based hotplug 01:04:45.307 00:48:32.008 => 138 tgt_run_hotplug 01:04:45.307 00:48:32.008 ... 01:04:45.307 00:48:32.008 01:04:45.307 00:48:32.008 ========== Backtrace end ========== 01:04:45.307 00:48:33.973 ========== Backtrace start: ========== 01:04:45.307 00:48:33.973 01:04:45.308 00:48:33.973 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh"]) 01:04:45.308 00:48:33.973 ... 01:04:45.308 00:48:33.973 1117 timing_enter $test_name 01:04:45.308 00:48:33.973 1118 echo "************************************" 01:04:45.308 00:48:33.973 1119 echo "START TEST $test_name" 01:04:45.308 00:48:33.973 1120 echo "************************************" 01:04:45.308 00:48:33.973 1121 xtrace_restore 01:04:45.308 00:48:33.973 1122 time "$@" 01:04:45.308 00:48:33.973 1123 xtrace_disable 01:04:45.308 00:48:33.973 1124 echo "************************************" 01:04:45.308 00:48:33.973 1125 echo "END TEST $test_name" 01:04:45.308 00:48:33.973 1126 echo "************************************" 01:04:45.308 00:48:33.973 1127 timing_exit $test_name 01:04:45.308 00:48:33.973 ... 01:04:45.308 00:48:33.973 in /home/vagrant/spdk_repo/spdk/autotest.sh:240 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 01:04:45.308 00:48:33.973 ... 01:04:45.308 00:48:33.973 235 01:04:45.308 00:48:33.973 236 run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh 01:04:45.308 00:48:33.973 237 run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh 01:04:45.308 00:48:33.973 238 01:04:45.308 00:48:33.973 239 if [ $(uname -s) = Linux ]; then 01:04:45.308 00:48:33.973 => 240 run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh 01:04:45.308 00:48:33.973 241 fi 01:04:45.308 00:48:33.973 242 01:04:45.308 00:48:33.973 243 if [[ $SPDK_TEST_XNVME -eq 1 ]]; then 01:04:45.308 00:48:33.973 244 run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh 01:04:45.308 00:48:33.973 245 run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme" 01:04:45.308 00:48:33.973 ... 01:04:45.308 00:48:33.974 01:04:45.308 00:48:33.974 ========== Backtrace end ==========' 01:04:45.308 + [[ -n 00:48:32.007 21:18:01 sw_hotplug -- common/autotest_common.sh@715 -- # time='========== Backtrace start: ========== 01:04:45.308 00:48:32.007 01:04:45.308 00:48:32.007 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:04:45.308 00:48:32.007 ... 01:04:45.308 00:48:32.007 710 01:04:45.308 00:48:32.007 711 # We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to 01:04:45.308 00:48:32.007 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 01:04:45.308 00:48:32.007 713 # but $() will return just the time'\''s data, hence making it possible to just do: 01:04:45.308 00:48:32.007 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:04:45.308 00:48:32.007 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:04:45.308 00:48:32.007 716 01:04:45.308 00:48:32.007 717 echo "$time" 01:04:45.308 00:48:32.007 718 ) 01:04:45.308 00:48:32.007 719 01:04:45.308 00:48:32.007 720 function timing_enter() { 01:04:45.308 00:48:32.007 ... 01:04:45.308 00:48:32.007 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:04:45.308 00:48:32.007 ... 01:04:45.308 00:48:32.007 11 # Pci bus hotplug 01:04:45.308 00:48:32.007 12 # Helper function to remove/attach cotrollers 01:04:45.308 00:48:32.007 13 debug_remove_attach_helper() { 01:04:45.308 00:48:32.007 14 local helper_time=0 01:04:45.308 00:48:32.007 15 01:04:45.308 00:48:32.007 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:04:45.308 00:48:32.008 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:04:45.308 00:48:32.008 18 "$helper_time" "$nvme_count" >&2 01:04:45.308 00:48:32.008 19 } 01:04:45.308 00:48:32.008 20 01:04:45.308 00:48:32.008 21 remove_attach_helper() { 01:04:45.308 00:48:32.008 ... 01:04:45.308 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:04:45.308 00:48:32.008 ... 01:04:45.308 00:48:32.008 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:04:45.308 00:48:32.008 106 done 01:04:45.308 00:48:32.008 107 01:04:45.308 00:48:32.008 108 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.308 00:48:32.008 109 01:04:45.308 00:48:32.008 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.308 00:48:32.008 111 # Verify reregistering hotplug poller 01:04:45.308 00:48:32.008 112 rpc_cmd bdev_nvme_set_hotplug -d 01:04:45.308 00:48:32.008 113 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.308 00:48:32.008 114 01:04:45.308 00:48:32.008 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.308 00:48:32.008 ... 01:04:45.308 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:04:45.308 00:48:32.008 ... 01:04:45.308 00:48:32.008 133 01:04:45.308 00:48:32.008 134 # Run pci bus hotplug test 01:04:45.308 00:48:32.008 135 run_hotplug 01:04:45.308 00:48:32.008 136 01:04:45.308 00:48:32.008 137 # Run SPDK target based hotplug 01:04:45.308 00:48:32.008 => 138 tgt_run_hotplug 01:04:45.308 00:48:32.008 ... 01:04:45.308 00:48:32.008 01:04:45.308 00:48:32.008 ========== Backtrace end ========== 01:04:45.308 00:48:32.008 ========== Backtrace start: ========== 01:04:45.308 00:48:32.008 01:04:45.308 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:04:45.308 00:48:32.008 ... 01:04:45.308 00:48:32.008 710 01:04:45.308 00:48:32.008 711 # We redirect cmd's std{out,err} to a separate fd dup'ed to stdin's device (or /dev/null) to 01:04:45.308 00:48:32.008 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 01:04:45.308 00:48:32.008 713 # but $() will return just the time's data, hence making it possible to just do: 01:04:45.308 00:48:32.008 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:04:45.308 00:48:32.008 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:04:45.308 00:48:32.008 716 01:04:45.308 00:48:32.008 717 echo "$time" 01:04:45.308 00:48:32.008 718 ) 01:04:45.308 00:48:32.008 719 01:04:45.308 00:48:32.008 720 function timing_enter() { 01:04:45.308 00:48:32.008 ... 01:04:45.308 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:04:45.308 00:48:32.008 ... 01:04:45.308 00:48:32.008 11 # Pci bus hotplug 01:04:45.308 00:48:32.008 12 # Helper function to remove/attach cotrollers 01:04:45.308 00:48:32.008 13 debug_remove_attach_helper() { 01:04:45.308 00:48:32.008 14 local helper_time=0 01:04:45.308 00:48:32.008 15 01:04:45.308 00:48:32.008 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:04:45.308 00:48:32.008 17 printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \ 01:04:45.308 00:48:32.008 18 "$helper_time" "$nvme_count" >&2 01:04:45.308 00:48:32.008 19 } 01:04:45.308 00:48:32.008 20 01:04:45.308 00:48:32.008 21 remove_attach_helper() { 01:04:45.308 00:48:32.008 ... 01:04:45.308 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:04:45.308 00:48:32.008 ... 01:04:45.308 00:48:32.008 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:04:45.308 00:48:32.008 106 done 01:04:45.308 00:48:32.008 107 01:04:45.308 00:48:32.008 108 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.308 00:48:32.008 109 01:04:45.308 00:48:32.008 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.308 00:48:32.008 111 # Verify reregistering hotplug poller 01:04:45.308 00:48:32.008 112 rpc_cmd bdev_nvme_set_hotplug -d 01:04:45.308 00:48:32.008 113 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.308 00:48:32.008 114 01:04:45.308 00:48:32.008 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.308 00:48:32.008 ... 01:04:45.308 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:04:45.308 00:48:32.008 ... 01:04:45.308 00:48:32.008 133 01:04:45.308 00:48:32.008 134 # Run pci bus hotplug test 01:04:45.308 00:48:32.008 135 run_hotplug 01:04:45.308 00:48:32.008 136 01:04:45.308 00:48:32.008 137 # Run SPDK target based hotplug 01:04:45.308 00:48:32.008 => 138 tgt_run_hotplug 01:04:45.308 00:48:32.008 ... 01:04:45.308 00:48:32.008 01:04:45.308 00:48:32.008 ========== Backtrace end ========== 01:04:45.308 00:48:32.008 ========== Backtrace start: ========== 01:04:45.308 00:48:32.008 01:04:45.308 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:04:45.308 00:48:32.008 ... 01:04:45.308 00:48:32.008 713 # but $() will return just the time's data, hence making it possible to just do: 01:04:45.308 00:48:32.008 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:04:45.308 00:48:32.008 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:04:45.308 00:48:32.008 716 01:04:45.308 00:48:32.008 717 echo "$time" 01:04:45.308 00:48:32.008 => 718 ) 01:04:45.308 00:48:32.008 719 01:04:45.308 00:48:32.008 720 function timing_enter() { 01:04:45.308 00:48:32.008 721 xtrace_disable 01:04:45.308 00:48:32.008 722 timing "enter" "$1" 01:04:45.308 00:48:32.008 723 xtrace_restore 01:04:45.308 00:48:32.008 ... 01:04:45.308 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:04:45.308 00:48:32.008 ... 01:04:45.308 00:48:32.008 11 # Pci bus hotplug 01:04:45.308 00:48:32.008 12 # Helper function to remove/attach cotrollers 01:04:45.308 00:48:32.008 13 debug_remove_attach_helper() { 01:04:45.308 00:48:32.008 14 local helper_time=0 01:04:45.308 00:48:32.008 15 01:04:45.308 00:48:32.008 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:04:45.308 00:48:32.008 17 printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \ 01:04:45.308 00:48:32.008 18 "$helper_time" "$nvme_count" >&2 01:04:45.308 00:48:32.008 19 } 01:04:45.308 00:48:32.008 20 01:04:45.308 00:48:32.008 21 remove_attach_helper() { 01:04:45.308 00:48:32.008 ... 01:04:45.308 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:04:45.308 00:48:32.008 ... 01:04:45.308 00:48:32.008 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:04:45.308 00:48:32.008 106 done 01:04:45.308 00:48:32.008 107 01:04:45.308 00:48:32.008 108 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.308 00:48:32.008 109 01:04:45.308 00:48:32.008 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.308 00:48:32.008 111 # Verify reregistering hotplug poller 01:04:45.308 00:48:32.008 112 rpc_cmd bdev_nvme_set_hotplug -d 01:04:45.308 00:48:32.008 113 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.308 00:48:32.008 114 01:04:45.308 00:48:32.008 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.308 00:48:32.008 ... 01:04:45.308 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:04:45.309 00:48:32.008 ... 01:04:45.309 00:48:32.008 133 01:04:45.309 00:48:32.008 134 # Run pci bus hotplug test 01:04:45.309 00:48:32.008 135 run_hotplug 01:04:45.309 00:48:32.008 136 01:04:45.309 00:48:32.008 137 # Run SPDK target based hotplug 01:04:45.309 00:48:32.008 => 138 tgt_run_hotplug 01:04:45.309 00:48:32.008 ... 01:04:45.309 00:48:32.008 01:04:45.309 00:48:32.008 ========== Backtrace end ========== 01:04:45.309 00:48:32.008 ========== Backtrace start: ========== 01:04:45.309 00:48:32.008 01:04:45.309 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:04:45.309 00:48:32.008 ... 01:04:45.309 00:48:32.008 11 # Pci bus hotplug 01:04:45.309 00:48:32.008 12 # Helper function to remove/attach cotrollers 01:04:45.309 00:48:32.008 13 debug_remove_attach_helper() { 01:04:45.309 00:48:32.008 14 local helper_time=0 01:04:45.309 00:48:32.008 15 01:04:45.309 00:48:32.008 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:04:45.309 00:48:32.008 17 printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \ 01:04:45.309 00:48:32.008 18 "$helper_time" "$nvme_count" >&2 01:04:45.309 00:48:32.008 19 } 01:04:45.309 00:48:32.008 20 01:04:45.309 00:48:32.008 21 remove_attach_helper() { 01:04:45.309 00:48:32.008 ... 01:04:45.309 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:04:45.309 00:48:32.008 ... 01:04:45.309 00:48:32.008 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:04:45.309 00:48:32.008 106 done 01:04:45.309 00:48:32.008 107 01:04:45.309 00:48:32.008 108 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.309 00:48:32.008 109 01:04:45.309 00:48:32.008 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.309 00:48:32.008 111 # Verify reregistering hotplug poller 01:04:45.309 00:48:32.008 112 rpc_cmd bdev_nvme_set_hotplug -d 01:04:45.309 00:48:32.008 113 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.309 00:48:32.008 114 01:04:45.309 00:48:32.008 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.309 00:48:32.008 ... 01:04:45.309 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:04:45.309 00:48:32.008 ... 01:04:45.309 00:48:32.008 133 01:04:45.309 00:48:32.008 134 # Run pci bus hotplug test 01:04:45.309 00:48:32.008 135 run_hotplug 01:04:45.309 00:48:32.008 136 01:04:45.309 00:48:32.008 137 # Run SPDK target based hotplug 01:04:45.309 00:48:32.008 => 138 tgt_run_hotplug 01:04:45.309 00:48:32.008 ... 01:04:45.309 00:48:32.008 01:04:45.309 00:48:32.008 ========== Backtrace end ========== 01:04:45.309 00:48:33.973 ========== Backtrace start: ========== 01:04:45.309 00:48:33.973 01:04:45.309 00:48:33.973 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh"]) 01:04:45.309 00:48:33.973 ... 01:04:45.309 00:48:33.973 1117 timing_enter $test_name 01:04:45.309 00:48:33.973 1118 echo "************************************" 01:04:45.309 00:48:33.973 1119 echo "START TEST $test_name" 01:04:45.309 00:48:33.973 1120 echo "************************************" 01:04:45.309 00:48:33.973 1121 xtrace_restore 01:04:45.309 00:48:33.973 1122 time "$@" 01:04:45.309 00:48:33.973 1123 xtrace_disable 01:04:45.309 00:48:33.973 1124 echo "************************************" 01:04:45.309 00:48:33.973 1125 echo "END TEST $test_name" 01:04:45.309 00:48:33.973 1126 echo "************************************" 01:04:45.309 00:48:33.973 1127 timing_exit $test_name 01:04:45.309 00:48:33.973 ... 01:04:45.309 00:48:33.973 in /home/vagrant/spdk_repo/spdk/autotest.sh:240 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 01:04:45.309 00:48:33.973 ... 01:04:45.309 00:48:33.973 235 01:04:45.309 00:48:33.973 236 run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh 01:04:45.309 00:48:33.973 237 run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh 01:04:45.309 00:48:33.973 238 01:04:45.309 00:48:33.973 239 if [ $(uname -s) = Linux ]; then 01:04:45.309 00:48:33.973 => 240 run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh 01:04:45.309 00:48:33.973 241 fi 01:04:45.309 00:48:33.973 242 01:04:45.309 00:48:33.973 243 if [[ $SPDK_TEST_XNVME -eq 1 ]]; then 01:04:45.309 00:48:33.973 244 run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh 01:04:45.309 00:48:33.973 245 run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme" 01:04:45.309 00:48:33.973 ... 01:04:45.309 00:48:33.974 01:04:45.309 00:48:33.974 ========== Backtrace end ========== ]] 01:04:45.309 + echo '00:48:32.007 21:18:01 sw_hotplug -- common/autotest_common.sh@715 -- # time='\''========== Backtrace start: ========== 01:04:45.309 00:48:32.007 01:04:45.309 00:48:32.007 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:04:45.309 00:48:32.007 ... 01:04:45.309 00:48:32.007 710 01:04:45.309 00:48:32.007 711 # We redirect cmd'\''\'\'''\''s std{out,err} to a separate fd dup'\''\'\'''\''ed to stdin'\''\'\'''\''s device (or /dev/null) to 01:04:45.309 00:48:32.007 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 01:04:45.309 00:48:32.007 713 # but $() will return just the time'\''\'\'''\''s data, hence making it possible to just do: 01:04:45.309 00:48:32.007 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:04:45.309 00:48:32.007 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:04:45.309 00:48:32.007 716 01:04:45.309 00:48:32.007 717 echo "$time" 01:04:45.309 00:48:32.007 718 ) 01:04:45.309 00:48:32.007 719 01:04:45.309 00:48:32.007 720 function timing_enter() { 01:04:45.309 00:48:32.007 ... 01:04:45.309 00:48:32.007 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:04:45.309 00:48:32.007 ... 01:04:45.309 00:48:32.007 11 # Pci bus hotplug 01:04:45.309 00:48:32.007 12 # Helper function to remove/attach cotrollers 01:04:45.309 00:48:32.007 13 debug_remove_attach_helper() { 01:04:45.309 00:48:32.007 14 local helper_time=0 01:04:45.309 00:48:32.007 15 01:04:45.309 00:48:32.007 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:04:45.309 00:48:32.008 17 printf '\''\'\'''\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\''\'\'''\'' \ 01:04:45.309 00:48:32.008 18 "$helper_time" "$nvme_count" >&2 01:04:45.309 00:48:32.008 19 } 01:04:45.309 00:48:32.008 20 01:04:45.309 00:48:32.008 21 remove_attach_helper() { 01:04:45.309 00:48:32.008 ... 01:04:45.309 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:04:45.309 00:48:32.008 ... 01:04:45.309 00:48:32.008 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:04:45.309 00:48:32.008 106 done 01:04:45.309 00:48:32.008 107 01:04:45.309 00:48:32.008 108 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.309 00:48:32.008 109 01:04:45.309 00:48:32.008 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.309 00:48:32.008 111 # Verify reregistering hotplug poller 01:04:45.309 00:48:32.008 112 rpc_cmd bdev_nvme_set_hotplug -d 01:04:45.309 00:48:32.008 113 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.309 00:48:32.008 114 01:04:45.309 00:48:32.008 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.309 00:48:32.008 ... 01:04:45.309 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:04:45.309 00:48:32.008 ... 01:04:45.309 00:48:32.008 133 01:04:45.309 00:48:32.008 134 # Run pci bus hotplug test 01:04:45.309 00:48:32.008 135 run_hotplug 01:04:45.309 00:48:32.008 136 01:04:45.309 00:48:32.008 137 # Run SPDK target based hotplug 01:04:45.309 00:48:32.008 => 138 tgt_run_hotplug 01:04:45.309 00:48:32.008 ... 01:04:45.309 00:48:32.008 01:04:45.309 00:48:32.008 ========== Backtrace end ========== 01:04:45.309 00:48:32.008 ========== Backtrace start: ========== 01:04:45.309 00:48:32.008 01:04:45.309 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:04:45.309 00:48:32.008 ... 01:04:45.309 00:48:32.008 710 01:04:45.309 00:48:32.008 711 # We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to 01:04:45.309 00:48:32.008 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 01:04:45.309 00:48:32.008 713 # but $() will return just the time'\''s data, hence making it possible to just do: 01:04:45.309 00:48:32.008 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:04:45.309 00:48:32.008 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:04:45.309 00:48:32.008 716 01:04:45.309 00:48:32.008 717 echo "$time" 01:04:45.309 00:48:32.008 718 ) 01:04:45.309 00:48:32.008 719 01:04:45.309 00:48:32.008 720 function timing_enter() { 01:04:45.309 00:48:32.008 ... 01:04:45.309 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:04:45.309 00:48:32.008 ... 01:04:45.309 00:48:32.008 11 # Pci bus hotplug 01:04:45.309 00:48:32.008 12 # Helper function to remove/attach cotrollers 01:04:45.309 00:48:32.008 13 debug_remove_attach_helper() { 01:04:45.309 00:48:32.008 14 local helper_time=0 01:04:45.309 00:48:32.008 15 01:04:45.309 00:48:32.008 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:04:45.309 00:48:32.008 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:04:45.309 00:48:32.008 18 "$helper_time" "$nvme_count" >&2 01:04:45.309 00:48:32.008 19 } 01:04:45.309 00:48:32.008 20 01:04:45.309 00:48:32.008 21 remove_attach_helper() { 01:04:45.309 00:48:32.008 ... 01:04:45.309 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:04:45.309 00:48:32.008 ... 01:04:45.309 00:48:32.008 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:04:45.309 00:48:32.008 106 done 01:04:45.309 00:48:32.008 107 01:04:45.309 00:48:32.008 108 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.309 00:48:32.008 109 01:04:45.309 00:48:32.008 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.309 00:48:32.008 111 # Verify reregistering hotplug poller 01:04:45.309 00:48:32.008 112 rpc_cmd bdev_nvme_set_hotplug -d 01:04:45.309 00:48:32.008 113 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.309 00:48:32.008 114 01:04:45.309 00:48:32.008 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.309 00:48:32.008 ... 01:04:45.309 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:04:45.309 00:48:32.008 ... 01:04:45.309 00:48:32.008 133 01:04:45.309 00:48:32.008 134 # Run pci bus hotplug test 01:04:45.309 00:48:32.008 135 run_hotplug 01:04:45.310 00:48:32.008 136 01:04:45.310 00:48:32.008 137 # Run SPDK target based hotplug 01:04:45.310 00:48:32.008 => 138 tgt_run_hotplug 01:04:45.310 00:48:32.008 ... 01:04:45.310 00:48:32.008 01:04:45.310 00:48:32.008 ========== Backtrace end ========== 01:04:45.310 00:48:32.008 ========== Backtrace start: ========== 01:04:45.310 00:48:32.008 01:04:45.310 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:04:45.310 00:48:32.008 ... 01:04:45.310 00:48:32.008 713 # but $() will return just the time'\''s data, hence making it possible to just do: 01:04:45.310 00:48:32.008 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:04:45.310 00:48:32.008 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:04:45.310 00:48:32.008 716 01:04:45.310 00:48:32.008 717 echo "$time" 01:04:45.310 00:48:32.008 => 718 ) 01:04:45.310 00:48:32.008 719 01:04:45.310 00:48:32.008 720 function timing_enter() { 01:04:45.310 00:48:32.008 721 xtrace_disable 01:04:45.310 00:48:32.008 722 timing "enter" "$1" 01:04:45.310 00:48:32.008 723 xtrace_restore 01:04:45.310 00:48:32.008 ... 01:04:45.310 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:04:45.310 00:48:32.008 ... 01:04:45.310 00:48:32.008 11 # Pci bus hotplug 01:04:45.310 00:48:32.008 12 # Helper function to remove/attach cotrollers 01:04:45.310 00:48:32.008 13 debug_remove_attach_helper() { 01:04:45.310 00:48:32.008 14 local helper_time=0 01:04:45.310 00:48:32.008 15 01:04:45.310 00:48:32.008 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:04:45.310 00:48:32.008 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:04:45.310 00:48:32.008 18 "$helper_time" "$nvme_count" >&2 01:04:45.310 00:48:32.008 19 } 01:04:45.310 00:48:32.008 20 01:04:45.310 00:48:32.008 21 remove_attach_helper() { 01:04:45.310 00:48:32.008 ... 01:04:45.310 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:04:45.310 00:48:32.008 ... 01:04:45.310 00:48:32.008 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:04:45.310 00:48:32.008 106 done 01:04:45.310 00:48:32.008 107 01:04:45.310 00:48:32.008 108 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.310 00:48:32.008 109 01:04:45.310 00:48:32.008 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.310 00:48:32.008 111 # Verify reregistering hotplug poller 01:04:45.310 00:48:32.008 112 rpc_cmd bdev_nvme_set_hotplug -d 01:04:45.310 00:48:32.008 113 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.310 00:48:32.008 114 01:04:45.310 00:48:32.008 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.310 00:48:32.008 ... 01:04:45.310 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:04:45.310 00:48:32.008 ... 01:04:45.310 00:48:32.008 133 01:04:45.310 00:48:32.008 134 # Run pci bus hotplug test 01:04:45.310 00:48:32.008 135 run_hotplug 01:04:45.310 00:48:32.008 136 01:04:45.310 00:48:32.008 137 # Run SPDK target based hotplug 01:04:45.310 00:48:32.008 => 138 tgt_run_hotplug 01:04:45.310 00:48:32.008 ... 01:04:45.310 00:48:32.008 01:04:45.310 00:48:32.008 ========== Backtrace end ========== 01:04:45.310 00:48:32.008 ========== Backtrace start: ========== 01:04:45.310 00:48:32.008 01:04:45.310 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:04:45.310 00:48:32.008 ... 01:04:45.310 00:48:32.008 11 # Pci bus hotplug 01:04:45.310 00:48:32.008 12 # Helper function to remove/attach cotrollers 01:04:45.310 00:48:32.008 13 debug_remove_attach_helper() { 01:04:45.310 00:48:32.008 14 local helper_time=0 01:04:45.310 00:48:32.008 15 01:04:45.310 00:48:32.008 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:04:45.310 00:48:32.008 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:04:45.310 00:48:32.008 18 "$helper_time" "$nvme_count" >&2 01:04:45.310 00:48:32.008 19 } 01:04:45.310 00:48:32.008 20 01:04:45.310 00:48:32.008 21 remove_attach_helper() { 01:04:45.310 00:48:32.008 ... 01:04:45.310 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:04:45.310 00:48:32.008 ... 01:04:45.310 00:48:32.008 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:04:45.310 00:48:32.008 106 done 01:04:45.310 00:48:32.008 107 01:04:45.310 00:48:32.008 108 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.310 00:48:32.008 109 01:04:45.310 00:48:32.008 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.310 00:48:32.008 111 # Verify reregistering hotplug poller 01:04:45.310 00:48:32.008 112 rpc_cmd bdev_nvme_set_hotplug -d 01:04:45.310 00:48:32.008 113 rpc_cmd bdev_nvme_set_hotplug -e 01:04:45.310 00:48:32.008 114 01:04:45.310 00:48:32.008 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:04:45.310 00:48:32.008 ... 01:04:45.310 00:48:32.008 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:04:45.310 00:48:32.008 ... 01:04:45.310 00:48:32.008 133 01:04:45.310 00:48:32.008 134 # Run pci bus hotplug test 01:04:45.310 00:48:32.008 135 run_hotplug 01:04:45.310 00:48:32.008 136 01:04:45.310 00:48:32.008 137 # Run SPDK target based hotplug 01:04:45.310 00:48:32.008 => 138 tgt_run_hotplug 01:04:45.310 00:48:32.008 ... 01:04:45.310 00:48:32.008 01:04:45.310 00:48:32.008 ========== Backtrace end ========== 01:04:45.310 00:48:33.973 ========== Backtrace start: ========== 01:04:45.310 00:48:33.973 01:04:45.310 00:48:33.973 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh"]) 01:04:45.310 00:48:33.973 ... 01:04:45.310 00:48:33.973 1117 timing_enter $test_name 01:04:45.310 00:48:33.973 1118 echo "************************************" 01:04:45.310 00:48:33.973 1119 echo "START TEST $test_name" 01:04:45.310 00:48:33.973 1120 echo "************************************" 01:04:45.310 00:48:33.973 1121 xtrace_restore 01:04:45.310 00:48:33.973 1122 time "$@" 01:04:45.310 00:48:33.973 1123 xtrace_disable 01:04:45.310 00:48:33.973 1124 echo "************************************" 01:04:45.310 00:48:33.973 1125 echo "END TEST $test_name" 01:04:45.310 00:48:33.973 1126 echo "************************************" 01:04:45.310 00:48:33.973 1127 timing_exit $test_name 01:04:45.310 00:48:33.973 ... 01:04:45.310 00:48:33.973 in /home/vagrant/spdk_repo/spdk/autotest.sh:240 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 01:04:45.310 00:48:33.973 ... 01:04:45.310 00:48:33.973 235 01:04:45.310 00:48:33.973 236 run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh 01:04:45.310 00:48:33.973 237 run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh 01:04:45.310 00:48:33.973 238 01:04:45.310 00:48:33.973 239 if [ $(uname -s) = Linux ]; then 01:04:45.310 00:48:33.973 => 240 run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh 01:04:45.310 00:48:33.973 241 fi 01:04:45.310 00:48:33.973 242 01:04:45.310 00:48:33.973 243 if [[ $SPDK_TEST_XNVME -eq 1 ]]; then 01:04:45.310 00:48:33.973 244 run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh 01:04:45.310 00:48:33.973 245 run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme" 01:04:45.310 00:48:33.973 ... 01:04:45.310 00:48:33.974 01:04:45.310 00:48:33.974 ========== Backtrace end ==========' 01:04:45.310 + for build in "${build_log_list[@]}" 01:04:45.310 + create_errtrace_file /var/jenkins/workspace/autotest-nightly/vfio-user-phy-autotest_26125/build.log 01:04:45.310 + local build_log job_name start_pattern end_pattern backtraces 01:04:45.310 + build_log=/var/jenkins/workspace/autotest-nightly/vfio-user-phy-autotest_26125/build.log 01:04:45.310 +++ dirname /var/jenkins/workspace/autotest-nightly/vfio-user-phy-autotest_26125/build.log 01:04:45.310 ++ basename /var/jenkins/workspace/autotest-nightly/vfio-user-phy-autotest_26125 01:04:45.310 + job_name=vfio-user-phy-autotest_26125 01:04:45.310 + start_pattern='Backtrace start' 01:04:45.310 + end_pattern='Backtrace end' 01:04:45.310 + [[ -f /var/jenkins/workspace/autotest-nightly/vfio-user-phy-autotest_26125/build.log ]] 01:04:45.310 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-nightly/vfio-user-phy-autotest_26125/build.log 01:04:45.310 + backtraces= 01:04:45.310 + [[ -n '' ]] 01:04:45.310 + for build in "${build_log_list[@]}" 01:04:45.310 + create_errtrace_file /var/jenkins/workspace/autotest-nightly/rocky9-vg-autotest_16007/build.log 01:04:45.310 + local build_log job_name start_pattern end_pattern backtraces 01:04:45.310 + build_log=/var/jenkins/workspace/autotest-nightly/rocky9-vg-autotest_16007/build.log 01:04:45.310 +++ dirname /var/jenkins/workspace/autotest-nightly/rocky9-vg-autotest_16007/build.log 01:04:45.310 ++ basename /var/jenkins/workspace/autotest-nightly/rocky9-vg-autotest_16007 01:04:45.310 + job_name=rocky9-vg-autotest_16007 01:04:45.310 + start_pattern='Backtrace start' 01:04:45.310 + end_pattern='Backtrace end' 01:04:45.310 + [[ -f /var/jenkins/workspace/autotest-nightly/rocky9-vg-autotest_16007/build.log ]] 01:04:45.310 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-nightly/rocky9-vg-autotest_16007/build.log 01:04:45.310 + backtraces= 01:04:45.310 + [[ -n '' ]] 01:04:45.310 + for build in "${build_log_list[@]}" 01:04:45.310 + create_errtrace_file /var/jenkins/workspace/autotest-nightly/nvmf-tcp-vg-autotest_77388/build.log 01:04:45.310 + local build_log job_name start_pattern end_pattern backtraces 01:04:45.310 + build_log=/var/jenkins/workspace/autotest-nightly/nvmf-tcp-vg-autotest_77388/build.log 01:04:45.310 +++ dirname /var/jenkins/workspace/autotest-nightly/nvmf-tcp-vg-autotest_77388/build.log 01:04:45.310 ++ basename /var/jenkins/workspace/autotest-nightly/nvmf-tcp-vg-autotest_77388 01:04:45.310 + job_name=nvmf-tcp-vg-autotest_77388 01:04:45.310 + start_pattern='Backtrace start' 01:04:45.310 + end_pattern='Backtrace end' 01:04:45.310 + [[ -f /var/jenkins/workspace/autotest-nightly/nvmf-tcp-vg-autotest_77388/build.log ]] 01:04:45.310 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-nightly/nvmf-tcp-vg-autotest_77388/build.log 01:04:45.310 + backtraces= 01:04:45.310 + [[ -n '' ]] 01:04:45.310 + run_flamegraph 01:04:45.310 + create_timing_file 01:04:45.310 + local array file 01:04:45.310 + array=($(find $WORKSPACE -type f -name 'timing.txt')) 01:04:45.310 ++ find /var/jenkins/workspace/autotest-nightly -type f -name timing.txt 01:04:45.310 + timing_dir=/var/jenkins/workspace/autotest-nightly/post_process 01:04:45.310 + mkdir -p /var/jenkins/workspace/autotest-nightly/post_process 01:04:45.310 + timing_file=/var/jenkins/workspace/autotest-nightly/post_process/total_timing.txt 01:04:45.310 + for file in "${array[@]}" 01:04:45.310 + add_sub_job_timing /var/jenkins/workspace/autotest-nightly/centos7-vg-autotest_73576/timing.txt 01:04:45.310 + local job_file job_name 01:04:45.310 + job_file=/var/jenkins/workspace/autotest-nightly/centos7-vg-autotest_73576/timing.txt 01:04:45.311 +++ dirname /var/jenkins/workspace/autotest-nightly/centos7-vg-autotest_73576/timing.txt 01:04:45.311 ++ basename /var/jenkins/workspace/autotest-nightly/centos7-vg-autotest_73576 01:04:45.311 + job_name=centos7-vg-autotest_73576 01:04:45.311 + sed 's/^/centos7-vg-autotest_73576;autorun;/' /var/jenkins/workspace/autotest-nightly/centos7-vg-autotest_73576/timing.txt 01:04:45.311 + for file in "${array[@]}" 01:04:45.311 + add_sub_job_timing /var/jenkins/workspace/autotest-nightly/freebsd-vg-autotest_59050/timing.txt 01:04:45.311 + local job_file job_name 01:04:45.311 + job_file=/var/jenkins/workspace/autotest-nightly/freebsd-vg-autotest_59050/timing.txt 01:04:45.311 +++ dirname /var/jenkins/workspace/autotest-nightly/freebsd-vg-autotest_59050/timing.txt 01:04:45.311 ++ basename /var/jenkins/workspace/autotest-nightly/freebsd-vg-autotest_59050 01:04:45.311 + job_name=freebsd-vg-autotest_59050 01:04:45.311 + sed 's/^/freebsd-vg-autotest_59050;autorun;/' /var/jenkins/workspace/autotest-nightly/freebsd-vg-autotest_59050/timing.txt 01:04:45.311 + for file in "${array[@]}" 01:04:45.311 + add_sub_job_timing /var/jenkins/workspace/autotest-nightly/iscsi-uring-vg-autotest_77302/timing.txt 01:04:45.311 + local job_file job_name 01:04:45.311 + job_file=/var/jenkins/workspace/autotest-nightly/iscsi-uring-vg-autotest_77302/timing.txt 01:04:45.311 +++ dirname /var/jenkins/workspace/autotest-nightly/iscsi-uring-vg-autotest_77302/timing.txt 01:04:45.311 ++ basename /var/jenkins/workspace/autotest-nightly/iscsi-uring-vg-autotest_77302 01:04:45.311 + job_name=iscsi-uring-vg-autotest_77302 01:04:45.311 + sed 's/^/iscsi-uring-vg-autotest_77302;autorun;/' /var/jenkins/workspace/autotest-nightly/iscsi-uring-vg-autotest_77302/timing.txt 01:04:45.311 + for file in "${array[@]}" 01:04:45.311 + add_sub_job_timing /var/jenkins/workspace/autotest-nightly/vmd-phy-autotest_2611/timing.txt 01:04:45.311 + local job_file job_name 01:04:45.311 + job_file=/var/jenkins/workspace/autotest-nightly/vmd-phy-autotest_2611/timing.txt 01:04:45.311 +++ dirname /var/jenkins/workspace/autotest-nightly/vmd-phy-autotest_2611/timing.txt 01:04:45.311 ++ basename /var/jenkins/workspace/autotest-nightly/vmd-phy-autotest_2611 01:04:45.311 + job_name=vmd-phy-autotest_2611 01:04:45.311 + sed 's/^/vmd-phy-autotest_2611;autorun;/' /var/jenkins/workspace/autotest-nightly/vmd-phy-autotest_2611/timing.txt 01:04:45.311 + for file in "${array[@]}" 01:04:45.311 + add_sub_job_timing /var/jenkins/workspace/autotest-nightly/vhost-phy-autotest_26142/timing.txt 01:04:45.311 + local job_file job_name 01:04:45.311 + job_file=/var/jenkins/workspace/autotest-nightly/vhost-phy-autotest_26142/timing.txt 01:04:45.311 +++ dirname /var/jenkins/workspace/autotest-nightly/vhost-phy-autotest_26142/timing.txt 01:04:45.311 ++ basename /var/jenkins/workspace/autotest-nightly/vhost-phy-autotest_26142 01:04:45.311 + job_name=vhost-phy-autotest_26142 01:04:45.311 + sed 's/^/vhost-phy-autotest_26142;autorun;/' /var/jenkins/workspace/autotest-nightly/vhost-phy-autotest_26142/timing.txt 01:04:45.311 + for file in "${array[@]}" 01:04:45.311 + add_sub_job_timing /var/jenkins/workspace/autotest-nightly/short-fuzz-phy-autotest_26114/timing.txt 01:04:45.311 + local job_file job_name 01:04:45.311 + job_file=/var/jenkins/workspace/autotest-nightly/short-fuzz-phy-autotest_26114/timing.txt 01:04:45.311 +++ dirname /var/jenkins/workspace/autotest-nightly/short-fuzz-phy-autotest_26114/timing.txt 01:04:45.311 ++ basename /var/jenkins/workspace/autotest-nightly/short-fuzz-phy-autotest_26114 01:04:45.311 + job_name=short-fuzz-phy-autotest_26114 01:04:45.311 + sed 's/^/short-fuzz-phy-autotest_26114;autorun;/' /var/jenkins/workspace/autotest-nightly/short-fuzz-phy-autotest_26114/timing.txt 01:04:45.311 + for file in "${array[@]}" 01:04:45.311 + add_sub_job_timing /var/jenkins/workspace/autotest-nightly/check-format-docker-autotest_22071/timing.txt 01:04:45.311 + local job_file job_name 01:04:45.311 + job_file=/var/jenkins/workspace/autotest-nightly/check-format-docker-autotest_22071/timing.txt 01:04:45.311 +++ dirname /var/jenkins/workspace/autotest-nightly/check-format-docker-autotest_22071/timing.txt 01:04:45.311 ++ basename /var/jenkins/workspace/autotest-nightly/check-format-docker-autotest_22071 01:04:45.311 + job_name=check-format-docker-autotest_22071 01:04:45.311 + sed 's/^/check-format-docker-autotest_22071;autorun;/' /var/jenkins/workspace/autotest-nightly/check-format-docker-autotest_22071/timing.txt 01:04:45.311 + for file in "${array[@]}" 01:04:45.311 + add_sub_job_timing /var/jenkins/workspace/autotest-nightly/vhost-initiator-vg-autotest_77417/timing.txt 01:04:45.311 + local job_file job_name 01:04:45.311 + job_file=/var/jenkins/workspace/autotest-nightly/vhost-initiator-vg-autotest_77417/timing.txt 01:04:45.311 +++ dirname /var/jenkins/workspace/autotest-nightly/vhost-initiator-vg-autotest_77417/timing.txt 01:04:45.311 ++ basename /var/jenkins/workspace/autotest-nightly/vhost-initiator-vg-autotest_77417 01:04:45.311 + job_name=vhost-initiator-vg-autotest_77417 01:04:45.311 + sed 's/^/vhost-initiator-vg-autotest_77417;autorun;/' /var/jenkins/workspace/autotest-nightly/vhost-initiator-vg-autotest_77417/timing.txt 01:04:45.311 + for file in "${array[@]}" 01:04:45.311 + add_sub_job_timing /var/jenkins/workspace/autotest-nightly/check-so-deps-docker-autotest_22084/timing.txt 01:04:45.311 + local job_file job_name 01:04:45.311 + job_file=/var/jenkins/workspace/autotest-nightly/check-so-deps-docker-autotest_22084/timing.txt 01:04:45.311 +++ dirname /var/jenkins/workspace/autotest-nightly/check-so-deps-docker-autotest_22084/timing.txt 01:04:45.311 ++ basename /var/jenkins/workspace/autotest-nightly/check-so-deps-docker-autotest_22084 01:04:45.311 + job_name=check-so-deps-docker-autotest_22084 01:04:45.311 + sed 's/^/check-so-deps-docker-autotest_22084;autorun;/' /var/jenkins/workspace/autotest-nightly/check-so-deps-docker-autotest_22084/timing.txt 01:04:45.311 + for file in "${array[@]}" 01:04:45.311 + add_sub_job_timing /var/jenkins/workspace/autotest-nightly/nvme-cmb-pmr-vg-autotest_78520/timing.txt 01:04:45.311 + local job_file job_name 01:04:45.311 + job_file=/var/jenkins/workspace/autotest-nightly/nvme-cmb-pmr-vg-autotest_78520/timing.txt 01:04:45.311 +++ dirname /var/jenkins/workspace/autotest-nightly/nvme-cmb-pmr-vg-autotest_78520/timing.txt 01:04:45.311 ++ basename /var/jenkins/workspace/autotest-nightly/nvme-cmb-pmr-vg-autotest_78520 01:04:45.311 + job_name=nvme-cmb-pmr-vg-autotest_78520 01:04:45.311 + sed 's/^/nvme-cmb-pmr-vg-autotest_78520;autorun;/' /var/jenkins/workspace/autotest-nightly/nvme-cmb-pmr-vg-autotest_78520/timing.txt 01:04:45.311 + for file in "${array[@]}" 01:04:45.311 + add_sub_job_timing /var/jenkins/workspace/autotest-nightly/packaging-docker-autotest_19789/timing.txt 01:04:45.311 + local job_file job_name 01:04:45.311 + job_file=/var/jenkins/workspace/autotest-nightly/packaging-docker-autotest_19789/timing.txt 01:04:45.311 +++ dirname /var/jenkins/workspace/autotest-nightly/packaging-docker-autotest_19789/timing.txt 01:04:45.311 ++ basename /var/jenkins/workspace/autotest-nightly/packaging-docker-autotest_19789 01:04:45.311 + job_name=packaging-docker-autotest_19789 01:04:45.311 + sed 's/^/packaging-docker-autotest_19789;autorun;/' /var/jenkins/workspace/autotest-nightly/packaging-docker-autotest_19789/timing.txt 01:04:45.311 + for file in "${array[@]}" 01:04:45.311 + add_sub_job_timing /var/jenkins/workspace/autotest-nightly/unittest-clang-docker-autotest_19787/timing.txt 01:04:45.311 + local job_file job_name 01:04:45.311 + job_file=/var/jenkins/workspace/autotest-nightly/unittest-clang-docker-autotest_19787/timing.txt 01:04:45.311 +++ dirname /var/jenkins/workspace/autotest-nightly/unittest-clang-docker-autotest_19787/timing.txt 01:04:45.311 ++ basename /var/jenkins/workspace/autotest-nightly/unittest-clang-docker-autotest_19787 01:04:45.311 + job_name=unittest-clang-docker-autotest_19787 01:04:45.311 + sed 's/^/unittest-clang-docker-autotest_19787;autorun;/' /var/jenkins/workspace/autotest-nightly/unittest-clang-docker-autotest_19787/timing.txt 01:04:45.311 + for file in "${array[@]}" 01:04:45.311 + add_sub_job_timing /var/jenkins/workspace/autotest-nightly/lvol-vg-autotest_77346/timing.txt 01:04:45.311 + local job_file job_name 01:04:45.311 + job_file=/var/jenkins/workspace/autotest-nightly/lvol-vg-autotest_77346/timing.txt 01:04:45.311 +++ dirname /var/jenkins/workspace/autotest-nightly/lvol-vg-autotest_77346/timing.txt 01:04:45.311 ++ basename /var/jenkins/workspace/autotest-nightly/lvol-vg-autotest_77346 01:04:45.311 + job_name=lvol-vg-autotest_77346 01:04:45.311 + sed 's/^/lvol-vg-autotest_77346;autorun;/' /var/jenkins/workspace/autotest-nightly/lvol-vg-autotest_77346/timing.txt 01:04:45.311 + for file in "${array[@]}" 01:04:45.311 + add_sub_job_timing /var/jenkins/workspace/autotest-nightly/nvmf-cvl-phy-autotest_3013/timing.txt 01:04:45.311 + local job_file job_name 01:04:45.311 + job_file=/var/jenkins/workspace/autotest-nightly/nvmf-cvl-phy-autotest_3013/timing.txt 01:04:45.311 +++ dirname /var/jenkins/workspace/autotest-nightly/nvmf-cvl-phy-autotest_3013/timing.txt 01:04:45.311 ++ basename /var/jenkins/workspace/autotest-nightly/nvmf-cvl-phy-autotest_3013 01:04:45.311 + job_name=nvmf-cvl-phy-autotest_3013 01:04:45.311 + sed 's/^/nvmf-cvl-phy-autotest_3013;autorun;/' /var/jenkins/workspace/autotest-nightly/nvmf-cvl-phy-autotest_3013/timing.txt 01:04:45.311 + for file in "${array[@]}" 01:04:45.311 + add_sub_job_timing /var/jenkins/workspace/autotest-nightly/unittest-valgrind-docker-autotest_19791/timing.txt 01:04:45.311 + local job_file job_name 01:04:45.311 + job_file=/var/jenkins/workspace/autotest-nightly/unittest-valgrind-docker-autotest_19791/timing.txt 01:04:45.311 +++ dirname /var/jenkins/workspace/autotest-nightly/unittest-valgrind-docker-autotest_19791/timing.txt 01:04:45.311 ++ basename /var/jenkins/workspace/autotest-nightly/unittest-valgrind-docker-autotest_19791 01:04:45.311 + job_name=unittest-valgrind-docker-autotest_19791 01:04:45.311 + sed 's/^/unittest-valgrind-docker-autotest_19791;autorun;/' /var/jenkins/workspace/autotest-nightly/unittest-valgrind-docker-autotest_19791/timing.txt 01:04:45.311 + for file in "${array[@]}" 01:04:45.312 + add_sub_job_timing /var/jenkins/workspace/autotest-nightly/crypto-phy-autotest_26117/timing.txt 01:04:45.312 + local job_file job_name 01:04:45.312 + job_file=/var/jenkins/workspace/autotest-nightly/crypto-phy-autotest_26117/timing.txt 01:04:45.312 +++ dirname /var/jenkins/workspace/autotest-nightly/crypto-phy-autotest_26117/timing.txt 01:04:45.312 ++ basename /var/jenkins/workspace/autotest-nightly/crypto-phy-autotest_26117 01:04:45.312 + job_name=crypto-phy-autotest_26117 01:04:45.312 + sed 's/^/crypto-phy-autotest_26117;autorun;/' /var/jenkins/workspace/autotest-nightly/crypto-phy-autotest_26117/timing.txt 01:04:45.312 + for file in "${array[@]}" 01:04:45.312 + add_sub_job_timing /var/jenkins/workspace/autotest-nightly/scan-build-docker-autotest_19790/timing.txt 01:04:45.312 + local job_file job_name 01:04:45.312 + job_file=/var/jenkins/workspace/autotest-nightly/scan-build-docker-autotest_19790/timing.txt 01:04:45.312 +++ dirname /var/jenkins/workspace/autotest-nightly/scan-build-docker-autotest_19790/timing.txt 01:04:45.312 ++ basename /var/jenkins/workspace/autotest-nightly/scan-build-docker-autotest_19790 01:04:45.312 + job_name=scan-build-docker-autotest_19790 01:04:45.312 + sed 's/^/scan-build-docker-autotest_19790;autorun;/' /var/jenkins/workspace/autotest-nightly/scan-build-docker-autotest_19790/timing.txt 01:04:45.312 + for file in "${array[@]}" 01:04:45.312 + add_sub_job_timing /var/jenkins/workspace/autotest-nightly/ubuntu22-vg-autotest_37730/timing.txt 01:04:45.312 + local job_file job_name 01:04:45.312 + job_file=/var/jenkins/workspace/autotest-nightly/ubuntu22-vg-autotest_37730/timing.txt 01:04:45.312 +++ dirname /var/jenkins/workspace/autotest-nightly/ubuntu22-vg-autotest_37730/timing.txt 01:04:45.312 ++ basename /var/jenkins/workspace/autotest-nightly/ubuntu22-vg-autotest_37730 01:04:45.312 + job_name=ubuntu22-vg-autotest_37730 01:04:45.312 + sed 's/^/ubuntu22-vg-autotest_37730;autorun;/' /var/jenkins/workspace/autotest-nightly/ubuntu22-vg-autotest_37730/timing.txt 01:04:45.312 + for file in "${array[@]}" 01:04:45.312 + add_sub_job_timing /var/jenkins/workspace/autotest-nightly/unittest-main-docker-autotest_19788/timing.txt 01:04:45.312 + local job_file job_name 01:04:45.312 + job_file=/var/jenkins/workspace/autotest-nightly/unittest-main-docker-autotest_19788/timing.txt 01:04:45.312 +++ dirname /var/jenkins/workspace/autotest-nightly/unittest-main-docker-autotest_19788/timing.txt 01:04:45.312 ++ basename /var/jenkins/workspace/autotest-nightly/unittest-main-docker-autotest_19788 01:04:45.312 + job_name=unittest-main-docker-autotest_19788 01:04:45.312 + sed 's/^/unittest-main-docker-autotest_19788;autorun;/' /var/jenkins/workspace/autotest-nightly/unittest-main-docker-autotest_19788/timing.txt 01:04:45.312 + for file in "${array[@]}" 01:04:45.312 + add_sub_job_timing /var/jenkins/workspace/autotest-nightly/nvme-vg-autotest_77397/timing.txt 01:04:45.312 + local job_file job_name 01:04:45.312 + job_file=/var/jenkins/workspace/autotest-nightly/nvme-vg-autotest_77397/timing.txt 01:04:45.312 +++ dirname /var/jenkins/workspace/autotest-nightly/nvme-vg-autotest_77397/timing.txt 01:04:45.312 ++ basename /var/jenkins/workspace/autotest-nightly/nvme-vg-autotest_77397 01:04:45.312 + job_name=nvme-vg-autotest_77397 01:04:45.312 + sed 's/^/nvme-vg-autotest_77397;autorun;/' /var/jenkins/workspace/autotest-nightly/nvme-vg-autotest_77397/timing.txt 01:04:45.312 + for file in "${array[@]}" 01:04:45.312 + add_sub_job_timing /var/jenkins/workspace/autotest-nightly/autobuild-external-vg-autotest_19750/timing.txt 01:04:45.312 + local job_file job_name 01:04:45.312 + job_file=/var/jenkins/workspace/autotest-nightly/autobuild-external-vg-autotest_19750/timing.txt 01:04:45.312 +++ dirname /var/jenkins/workspace/autotest-nightly/autobuild-external-vg-autotest_19750/timing.txt 01:04:45.312 ++ basename /var/jenkins/workspace/autotest-nightly/autobuild-external-vg-autotest_19750 01:04:45.312 + job_name=autobuild-external-vg-autotest_19750 01:04:45.312 + sed 's/^/autobuild-external-vg-autotest_19750;autorun;/' /var/jenkins/workspace/autotest-nightly/autobuild-external-vg-autotest_19750/timing.txt 01:04:45.312 + for file in "${array[@]}" 01:04:45.312 + add_sub_job_timing /var/jenkins/workspace/autotest-nightly/doc-docker-autotest_22251/timing.txt 01:04:45.312 + local job_file job_name 01:04:45.312 + job_file=/var/jenkins/workspace/autotest-nightly/doc-docker-autotest_22251/timing.txt 01:04:45.312 +++ dirname /var/jenkins/workspace/autotest-nightly/doc-docker-autotest_22251/timing.txt 01:04:45.312 ++ basename /var/jenkins/workspace/autotest-nightly/doc-docker-autotest_22251 01:04:45.312 + job_name=doc-docker-autotest_22251 01:04:45.312 + sed 's/^/doc-docker-autotest_22251;autorun;/' /var/jenkins/workspace/autotest-nightly/doc-docker-autotest_22251/timing.txt 01:04:45.312 + for file in "${array[@]}" 01:04:45.312 + add_sub_job_timing /var/jenkins/workspace/autotest-nightly/nvmf-phy-autotest_72361/timing.txt 01:04:45.312 + local job_file job_name 01:04:45.312 + job_file=/var/jenkins/workspace/autotest-nightly/nvmf-phy-autotest_72361/timing.txt 01:04:45.312 +++ dirname /var/jenkins/workspace/autotest-nightly/nvmf-phy-autotest_72361/timing.txt 01:04:45.312 ++ basename /var/jenkins/workspace/autotest-nightly/nvmf-phy-autotest_72361 01:04:45.312 + job_name=nvmf-phy-autotest_72361 01:04:45.312 + sed 's/^/nvmf-phy-autotest_72361;autorun;/' /var/jenkins/workspace/autotest-nightly/nvmf-phy-autotest_72361/timing.txt 01:04:45.312 + for file in "${array[@]}" 01:04:45.312 + add_sub_job_timing /var/jenkins/workspace/autotest-nightly/build-files-docker-autotest_22060/timing.txt 01:04:45.312 + local job_file job_name 01:04:45.312 + job_file=/var/jenkins/workspace/autotest-nightly/build-files-docker-autotest_22060/timing.txt 01:04:45.312 +++ dirname /var/jenkins/workspace/autotest-nightly/build-files-docker-autotest_22060/timing.txt 01:04:45.312 ++ basename /var/jenkins/workspace/autotest-nightly/build-files-docker-autotest_22060 01:04:45.312 + job_name=build-files-docker-autotest_22060 01:04:45.312 + sed 's/^/build-files-docker-autotest_22060;autorun;/' /var/jenkins/workspace/autotest-nightly/build-files-docker-autotest_22060/timing.txt 01:04:45.312 + for file in "${array[@]}" 01:04:45.312 + add_sub_job_timing /var/jenkins/workspace/autotest-nightly/iscsi-vg-autotest_77435/timing.txt 01:04:45.312 + local job_file job_name 01:04:45.312 + job_file=/var/jenkins/workspace/autotest-nightly/iscsi-vg-autotest_77435/timing.txt 01:04:45.312 +++ dirname /var/jenkins/workspace/autotest-nightly/iscsi-vg-autotest_77435/timing.txt 01:04:45.312 ++ basename /var/jenkins/workspace/autotest-nightly/iscsi-vg-autotest_77435 01:04:45.312 + job_name=iscsi-vg-autotest_77435 01:04:45.312 + sed 's/^/iscsi-vg-autotest_77435;autorun;/' /var/jenkins/workspace/autotest-nightly/iscsi-vg-autotest_77435/timing.txt 01:04:45.312 + for file in "${array[@]}" 01:04:45.312 + add_sub_job_timing /var/jenkins/workspace/autotest-nightly/nvmf-tcp-uring-vg-autotest_77322/timing.txt 01:04:45.312 + local job_file job_name 01:04:45.312 + job_file=/var/jenkins/workspace/autotest-nightly/nvmf-tcp-uring-vg-autotest_77322/timing.txt 01:04:45.312 +++ dirname /var/jenkins/workspace/autotest-nightly/nvmf-tcp-uring-vg-autotest_77322/timing.txt 01:04:45.312 ++ basename /var/jenkins/workspace/autotest-nightly/nvmf-tcp-uring-vg-autotest_77322 01:04:45.312 + job_name=nvmf-tcp-uring-vg-autotest_77322 01:04:45.312 + sed 's/^/nvmf-tcp-uring-vg-autotest_77322;autorun;/' /var/jenkins/workspace/autotest-nightly/nvmf-tcp-uring-vg-autotest_77322/timing.txt 01:04:45.312 + for file in "${array[@]}" 01:04:45.312 + add_sub_job_timing /var/jenkins/workspace/autotest-nightly/BlobFS-phy-autotest_26123/timing.txt 01:04:45.312 + local job_file job_name 01:04:45.312 + job_file=/var/jenkins/workspace/autotest-nightly/BlobFS-phy-autotest_26123/timing.txt 01:04:45.312 +++ dirname /var/jenkins/workspace/autotest-nightly/BlobFS-phy-autotest_26123/timing.txt 01:04:45.312 ++ basename /var/jenkins/workspace/autotest-nightly/BlobFS-phy-autotest_26123 01:04:45.312 + job_name=BlobFS-phy-autotest_26123 01:04:45.312 + sed 's/^/BlobFS-phy-autotest_26123;autorun;/' /var/jenkins/workspace/autotest-nightly/BlobFS-phy-autotest_26123/timing.txt 01:04:45.312 + for file in "${array[@]}" 01:04:45.312 + add_sub_job_timing /var/jenkins/workspace/autotest-nightly/zns-vg-autotest_76503/timing.txt 01:04:45.312 + local job_file job_name 01:04:45.312 + job_file=/var/jenkins/workspace/autotest-nightly/zns-vg-autotest_76503/timing.txt 01:04:45.312 +++ dirname /var/jenkins/workspace/autotest-nightly/zns-vg-autotest_76503/timing.txt 01:04:45.312 ++ basename /var/jenkins/workspace/autotest-nightly/zns-vg-autotest_76503 01:04:45.312 + job_name=zns-vg-autotest_76503 01:04:45.312 + sed 's/^/zns-vg-autotest_76503;autorun;/' /var/jenkins/workspace/autotest-nightly/zns-vg-autotest_76503/timing.txt 01:04:45.312 + for file in "${array[@]}" 01:04:45.312 + add_sub_job_timing /var/jenkins/workspace/autotest-nightly/dsa-phy-autotest_4817/timing.txt 01:04:45.312 + local job_file job_name 01:04:45.312 + job_file=/var/jenkins/workspace/autotest-nightly/dsa-phy-autotest_4817/timing.txt 01:04:45.312 +++ dirname /var/jenkins/workspace/autotest-nightly/dsa-phy-autotest_4817/timing.txt 01:04:45.312 ++ basename /var/jenkins/workspace/autotest-nightly/dsa-phy-autotest_4817 01:04:45.312 + job_name=dsa-phy-autotest_4817 01:04:45.312 + sed 's/^/dsa-phy-autotest_4817;autorun;/' /var/jenkins/workspace/autotest-nightly/dsa-phy-autotest_4817/timing.txt 01:04:45.312 + for file in "${array[@]}" 01:04:45.312 + add_sub_job_timing /var/jenkins/workspace/autotest-nightly/nvmf-tcp-phy-autotest_72248/timing.txt 01:04:45.312 + local job_file job_name 01:04:45.312 + job_file=/var/jenkins/workspace/autotest-nightly/nvmf-tcp-phy-autotest_72248/timing.txt 01:04:45.312 +++ dirname /var/jenkins/workspace/autotest-nightly/nvmf-tcp-phy-autotest_72248/timing.txt 01:04:45.312 ++ basename /var/jenkins/workspace/autotest-nightly/nvmf-tcp-phy-autotest_72248 01:04:45.312 + job_name=nvmf-tcp-phy-autotest_72248 01:04:45.312 + sed 's/^/nvmf-tcp-phy-autotest_72248;autorun;/' /var/jenkins/workspace/autotest-nightly/nvmf-tcp-phy-autotest_72248/timing.txt 01:04:45.312 + for file in "${array[@]}" 01:04:45.312 + add_sub_job_timing /var/jenkins/workspace/autotest-nightly/nvme-phy-autotest_72289/timing.txt 01:04:45.312 + local job_file job_name 01:04:45.312 + job_file=/var/jenkins/workspace/autotest-nightly/nvme-phy-autotest_72289/timing.txt 01:04:45.312 +++ dirname /var/jenkins/workspace/autotest-nightly/nvme-phy-autotest_72289/timing.txt 01:04:45.312 ++ basename /var/jenkins/workspace/autotest-nightly/nvme-phy-autotest_72289 01:04:45.312 + job_name=nvme-phy-autotest_72289 01:04:45.312 + sed 's/^/nvme-phy-autotest_72289;autorun;/' /var/jenkins/workspace/autotest-nightly/nvme-phy-autotest_72289/timing.txt 01:04:45.312 + for file in "${array[@]}" 01:04:45.312 + add_sub_job_timing /var/jenkins/workspace/autotest-nightly/ubuntu20-vg-autotest_73716/timing.txt 01:04:45.312 + local job_file job_name 01:04:45.312 + job_file=/var/jenkins/workspace/autotest-nightly/ubuntu20-vg-autotest_73716/timing.txt 01:04:45.312 +++ dirname /var/jenkins/workspace/autotest-nightly/ubuntu20-vg-autotest_73716/timing.txt 01:04:45.312 ++ basename /var/jenkins/workspace/autotest-nightly/ubuntu20-vg-autotest_73716 01:04:45.312 + job_name=ubuntu20-vg-autotest_73716 01:04:45.312 + sed 's/^/ubuntu20-vg-autotest_73716;autorun;/' /var/jenkins/workspace/autotest-nightly/ubuntu20-vg-autotest_73716/timing.txt 01:04:45.312 + for file in "${array[@]}" 01:04:45.312 + add_sub_job_timing /var/jenkins/workspace/autotest-nightly/vfio-user-phy-autotest_26125/timing.txt 01:04:45.312 + local job_file job_name 01:04:45.312 + job_file=/var/jenkins/workspace/autotest-nightly/vfio-user-phy-autotest_26125/timing.txt 01:04:45.312 +++ dirname /var/jenkins/workspace/autotest-nightly/vfio-user-phy-autotest_26125/timing.txt 01:04:45.312 ++ basename /var/jenkins/workspace/autotest-nightly/vfio-user-phy-autotest_26125 01:04:45.312 + job_name=vfio-user-phy-autotest_26125 01:04:45.312 + sed 's/^/vfio-user-phy-autotest_26125;autorun;/' /var/jenkins/workspace/autotest-nightly/vfio-user-phy-autotest_26125/timing.txt 01:04:45.312 + for file in "${array[@]}" 01:04:45.312 + add_sub_job_timing /var/jenkins/workspace/autotest-nightly/rocky9-vg-autotest_16007/timing.txt 01:04:45.312 + local job_file job_name 01:04:45.312 + job_file=/var/jenkins/workspace/autotest-nightly/rocky9-vg-autotest_16007/timing.txt 01:04:45.312 +++ dirname /var/jenkins/workspace/autotest-nightly/rocky9-vg-autotest_16007/timing.txt 01:04:45.312 ++ basename /var/jenkins/workspace/autotest-nightly/rocky9-vg-autotest_16007 01:04:45.313 + job_name=rocky9-vg-autotest_16007 01:04:45.313 + sed 's/^/rocky9-vg-autotest_16007;autorun;/' /var/jenkins/workspace/autotest-nightly/rocky9-vg-autotest_16007/timing.txt 01:04:45.313 + for file in "${array[@]}" 01:04:45.313 + add_sub_job_timing /var/jenkins/workspace/autotest-nightly/nvmf-tcp-vg-autotest_77388/timing.txt 01:04:45.313 + local job_file job_name 01:04:45.313 + job_file=/var/jenkins/workspace/autotest-nightly/nvmf-tcp-vg-autotest_77388/timing.txt 01:04:45.313 +++ dirname /var/jenkins/workspace/autotest-nightly/nvmf-tcp-vg-autotest_77388/timing.txt 01:04:45.313 ++ basename /var/jenkins/workspace/autotest-nightly/nvmf-tcp-vg-autotest_77388 01:04:45.313 + job_name=nvmf-tcp-vg-autotest_77388 01:04:45.313 + sed 's/^/nvmf-tcp-vg-autotest_77388;autorun;/' /var/jenkins/workspace/autotest-nightly/nvmf-tcp-vg-autotest_77388/timing.txt 01:04:45.313 + /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/autotest-nightly/post_process/total_timing.txt 01:04:45.570 + run_autorun_post 01:04:45.570 + s_opt= 01:04:45.570 + [[ '' == true ]] 01:04:45.570 + spdk/autorun_post.py -d ./ -r ./spdk 01:04:48.850 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc64.c:13 01:04:48.850 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc32c.c:13 01:04:49.106 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/xor.c:93 01:04:49.106 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:17 01:04:49.106 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:23 01:04:50.999 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:23 01:04:51.000 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:17 01:04:51.000 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/xor.c:93 01:04:51.563 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc32c.c:13 01:04:51.563 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc64.c:13 01:04:53.457 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc64.c:13 01:04:53.457 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc32c.c:13 01:04:53.457 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/xor.c:93 01:04:53.714 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:23 01:04:53.714 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:17 01:04:55.608 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc64.c:13 01:04:55.608 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc32c.c:13 01:04:56.171 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:23 01:04:56.172 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:17 01:04:56.172 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/xor.c:93 01:04:57.543 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/xor.c:93 01:04:57.800 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:17 01:04:57.800 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:23 01:04:59.172 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc64.c:13 01:04:59.172 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc32c.c:13 01:05:01.067 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:23 01:05:01.067 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:17 01:05:01.067 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/xor.c:93 01:05:01.324 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc64.c:13 01:05:01.581 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc32c.c:13 01:05:03.475 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc64.c:13 01:05:03.732 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc32c.c:13 01:05:04.296 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:23 01:05:04.296 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:17 01:05:04.296 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/xor.c:93 01:05:06.822 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc64.c:13 01:05:06.822 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc32c.c:13 01:05:06.822 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/xor.c:93 01:05:07.079 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:17 01:05:07.079 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:23 01:05:10.354 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/xor.c:93 01:05:10.354 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:23 01:05:10.354 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:17 01:05:10.612 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc32c.c:13 01:05:10.612 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc64.c:13 01:05:13.888 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/xor.c:93 01:05:13.888 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:17 01:05:13.888 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:23 01:05:13.888 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc32c.c:13 01:05:14.145 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc64.c:13 01:05:17.421 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:23 01:05:17.421 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:17 01:05:17.421 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/xor.c:93 01:05:17.421 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc32c.c:13 01:05:17.421 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc64.c:13 01:05:20.717 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc32c.c:13 01:05:20.717 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc64.c:13 01:05:20.717 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/xor.c:93 01:05:20.975 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:23 01:05:20.975 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:17 01:05:21.232 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/module/blobfs/bdev/blobfs_bdev.c:254 01:05:23.125 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc64.c:13 01:05:23.125 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc32c.c:13 01:05:24.056 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/xor.c:93 01:05:24.313 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:17 01:05:24.314 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:23 01:05:26.836 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:23 01:05:26.836 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:17 01:05:26.836 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/xor.c:93 01:05:27.094 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc64.c:13 01:05:27.351 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc32c.c:13 01:05:30.627 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc32c.c:13 01:05:30.627 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc64.c:13 01:05:30.884 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:17 01:05:30.884 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:23 01:05:31.141 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/xor.c:93 01:05:33.667 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:23 01:05:33.667 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:17 01:05:33.667 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/xor.c:93 01:05:35.038 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc32c.c:13 01:05:35.038 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc64.c:13 01:05:37.563 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:23 01:05:37.563 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:17 01:05:37.563 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/xor.c:93 01:05:38.493 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc32c.c:13 01:05:38.750 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc64.c:13 01:05:40.648 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/xor.c:93 01:05:40.648 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:17 01:05:40.648 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:23 01:05:42.544 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc64.c:13 01:05:42.802 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc32c.c:13 01:05:44.698 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/module/bdev/nvme/bdev_mdns_client.c:613 01:05:44.698 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/module/bdev/nvme/bdev_mdns_client.c:456 01:05:44.698 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/module/bdev/nvme/bdev_mdns_client.c:561 01:05:44.698 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/module/bdev/nvme/bdev_mdns_client.c:582 01:05:45.264 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/xor.c:93 01:05:45.522 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:23 01:05:45.522 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc16.c:17 01:05:46.086 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc32c.c:13 01:05:46.343 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-nightly/spdk/lib/util/crc64.c:13 01:06:04.398 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-nightly/spdk/util.h! 01:06:04.398 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-nightly/spdk/nvme.h! 01:06:04.398 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-nightly/spdk/mmio.h! 01:06:04.398 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-nightly/spdk/endian.h! 01:06:04.398 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-nightly/spdk/trace.h! 01:06:04.398 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-nightly/spdk/base64.h! 01:06:04.398 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-nightly/spdk/thread.h! 01:06:04.398 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-nightly/spdk/bdev_module.h! 01:06:04.398 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-nightly/spdk/histogram_data.h! 01:06:04.398 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-nightly/spdk/nvmf_transport.h! 01:06:04.398 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-nightly/spdk/nvme_spec.h! 01:06:04.655 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-nightly/spdk/histogram_data.h/histogram_ut.c! 01:06:06.551 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-nightly/spdk/lib/env_ocf/include/ocf/ocf_io.h! 01:06:06.551 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-nightly/spdk/lib/env_ocf/include/ocf/ocf_core.h! 01:06:06.551 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-nightly/spdk/lib/env_ocf/include/ocf/ocf_mngt.h! 01:06:21.407 -----Begin Post Process Script------ 01:06:21.407 /var/jenkins/workspace/autotest-nightly/centos7-vg-autotest_73576/cov_total.info 01:06:21.407 /var/jenkins/workspace/autotest-nightly/iscsi-uring-vg-autotest_77302/cov_total.info 01:06:21.407 /var/jenkins/workspace/autotest-nightly/vmd-phy-autotest_2611/cov_total.info 01:06:21.407 /var/jenkins/workspace/autotest-nightly/vhost-phy-autotest_26142/cov_total.info 01:06:21.407 /var/jenkins/workspace/autotest-nightly/vhost-initiator-vg-autotest_77417/cov_total.info 01:06:21.407 /var/jenkins/workspace/autotest-nightly/nvme-cmb-pmr-vg-autotest_78520/cov_total.info 01:06:21.407 /var/jenkins/workspace/autotest-nightly/lvol-vg-autotest_77346/cov_total.info 01:06:21.407 /var/jenkins/workspace/autotest-nightly/nvmf-cvl-phy-autotest_3013/cov_total.info 01:06:21.407 /var/jenkins/workspace/autotest-nightly/crypto-phy-autotest_26117/cov_total.info 01:06:21.407 /var/jenkins/workspace/autotest-nightly/ubuntu22-vg-autotest_37730/cov_total.info 01:06:21.407 /var/jenkins/workspace/autotest-nightly/iscsi-vg-autotest_77435/cov_total.info 01:06:21.407 /var/jenkins/workspace/autotest-nightly/nvmf-tcp-uring-vg-autotest_77322/cov_total.info 01:06:21.407 /var/jenkins/workspace/autotest-nightly/BlobFS-phy-autotest_26123/cov_total.info 01:06:21.407 /var/jenkins/workspace/autotest-nightly/zns-vg-autotest_76503/cov_total.info 01:06:21.407 /var/jenkins/workspace/autotest-nightly/dsa-phy-autotest_4817/cov_total.info 01:06:21.407 /var/jenkins/workspace/autotest-nightly/nvmf-tcp-phy-autotest_72248/cov_total.info 01:06:21.407 /var/jenkins/workspace/autotest-nightly/nvme-phy-autotest_72289/cov_total.info 01:06:21.407 /var/jenkins/workspace/autotest-nightly/vfio-user-phy-autotest_26125/cov_total.info 01:06:21.407 /var/jenkins/workspace/autotest-nightly/rocky9-vg-autotest_16007/cov_total.info 01:06:21.407 /var/jenkins/workspace/autotest-nightly/nvmf-tcp-vg-autotest_77388/cov_total.info 01:06:21.407 01:06:21.407 01:06:21.407 -----Tests Executed in Build------ 01:06:21.407 accel 01:06:21.407 accel_assign_opcode 01:06:21.407 accel_cdev_comp 01:06:21.407 accel_cdev_decmop_full 01:06:21.407 accel_cdev_decomp 01:06:21.407 accel_cdev_decomp_full_mcore 01:06:21.407 accel_cdev_decomp_full_mthread 01:06:21.407 accel_cdev_decomp_mcore 01:06:21.407 accel_cdev_decomp_mthread 01:06:21.407 accel_comp 01:06:21.407 accel_compare 01:06:21.407 accel_compress_verify 01:06:21.407 accel_copy 01:06:21.407 accel_copy_crc32c 01:06:21.407 accel_copy_crc32c_C2 01:06:21.407 accel_crc32c 01:06:21.407 accel_crc32c_C2 01:06:21.407 accel_decmop_full 01:06:21.407 accel_decomp 01:06:21.407 accel_decomp_full_mcore 01:06:21.407 accel_decomp_full_mthread 01:06:21.407 accel_decomp_mcore 01:06:21.407 accel_decomp_mthread 01:06:21.407 accel_dif_functional_tests 01:06:21.407 accel_dif_generate 01:06:21.407 accel_dif_generate_copy 01:06:21.407 accel_dif_verify 01:06:21.407 accel_dualcast 01:06:21.407 accel_fill 01:06:21.407 accel_help 01:06:21.407 accel_missing_filename 01:06:21.407 accel_negative_buffers 01:06:21.407 accel_rpc 01:06:21.407 accel_scan_dsa_modules 01:06:21.407 accel_scan_iaa_modules 01:06:21.407 accel_wrong_workload 01:06:21.407 accel_xor 01:06:21.407 acl 01:06:21.407 alias_rpc 01:06:21.407 allowed 01:06:21.407 app_cmdline 01:06:21.407 app_repeat 01:06:21.407 asan 01:06:21.407 autobuild 01:06:21.407 autobuild_build_doc 01:06:21.407 autobuild_check_dpdk_pci_api 01:06:21.407 autobuild_check_format 01:06:21.407 autobuild_check_so_deps 01:06:21.407 autobuild_external_code 01:06:21.407 autobuild_generated_files_check 01:06:21.407 autobuild_generated_files_check_post_clean 01:06:21.407 autobuild_header_dependency_check 01:06:21.407 autobuild_llvm_precompile 01:06:21.407 autobuild_make_install 01:06:21.407 autobuild_make_uninstall 01:06:21.407 autobuild_ocf_precompile 01:06:21.408 bdev_bounds 01:06:21.408 bdev_crypto_enomem 01:06:21.408 bdev_error 01:06:21.408 bdev_fio 01:06:21.408 bdev_fio_rw_verify 01:06:21.408 bdev_fio_trim 01:06:21.408 bdev_gpt_uuid 01:06:21.408 bdev_hello_world 01:06:21.408 bdev_json_nonarray 01:06:21.408 bdev_json_nonenclosed 01:06:21.408 bdev_nbd 01:06:21.408 bdev_nvme_reset_stuck_adm_cmd 01:06:21.408 bdev_qd_sampling 01:06:21.408 bdev_qos 01:06:21.408 bdev_qos_bw 01:06:21.408 bdev_qos_iops 01:06:21.408 bdev_qos_ro_bw 01:06:21.408 bdev_raid 01:06:21.408 bdev_stat 01:06:21.408 bdev_verify 01:06:21.408 bdev_verify_big_io 01:06:21.408 bdev_write_zeroes 01:06:21.408 bdevperf_config 01:06:21.408 blob_io_wait 01:06:21.408 blobfs 01:06:21.408 blobfs_mkfs 01:06:21.408 blobstore 01:06:21.408 blobstore_grow 01:06:21.408 blockdev_crypto_aesni 01:06:21.408 blockdev_crypto_qat 01:06:21.408 blockdev_crypto_sw 01:06:21.408 blockdev_general 01:06:21.408 blockdev_nvme 01:06:21.408 blockdev_nvme_gpt 01:06:21.408 blockdev_raid5f 01:06:21.408 blockdev_rbd 01:06:21.408 build_rpm_from_gen_spec 01:06:21.408 build_shared_rpm 01:06:21.408 build_shared_rpm_with_rpmed_dpdk 01:06:21.408 chaining 01:06:21.408 check_header_filenames 01:06:21.408 cmb_copy 01:06:21.408 compress_compdev 01:06:21.408 compress_isal 01:06:21.408 confirm_abi_deps 01:06:21.408 confirm_makefile_deps 01:06:21.408 cpu_locks 01:06:21.408 custom_alloc 01:06:21.408 dd_bs_lt_native_bs 01:06:21.408 dd_copy_to_out_bdev 01:06:21.408 dd_double_input 01:06:21.408 dd_double_output 01:06:21.408 dd_flag_append 01:06:21.408 dd_flag_append_forced_aio 01:06:21.408 dd_flag_directory 01:06:21.408 dd_flag_directory_forced_aio 01:06:21.408 dd_flag_noatime 01:06:21.408 dd_flag_noatime_forced_aio 01:06:21.408 dd_flag_nofollow 01:06:21.408 dd_flag_nofollow_forced_aio 01:06:21.408 dd_flags_misc 01:06:21.408 dd_flags_misc_forced_aio 01:06:21.408 dd_inflate_file 01:06:21.408 dd_invalid_arguments 01:06:21.408 dd_invalid_count 01:06:21.408 dd_invalid_iflag 01:06:21.408 dd_invalid_json 01:06:21.408 dd_invalid_oflag 01:06:21.408 dd_malloc_copy 01:06:21.408 dd_no_input 01:06:21.408 dd_no_output 01:06:21.408 dd_offset_magic 01:06:21.408 dd_rw 01:06:21.408 dd_rw_offset 01:06:21.408 dd_smaller_blocksize 01:06:21.408 dd_sparse_bdev_to_file 01:06:21.408 dd_sparse_file_to_bdev 01:06:21.408 dd_sparse_file_to_file 01:06:21.408 dd_unknown_flag 01:06:21.408 dd_uring_copy 01:06:21.408 dd_wrong_blocksize 01:06:21.408 default_locks 01:06:21.408 default_locks_via_rpc 01:06:21.408 default_setup 01:06:21.408 denied 01:06:21.408 devices 01:06:21.408 dm_mount 01:06:21.408 dma 01:06:21.408 dpdk_governor 01:06:21.408 dpdk_mem_utility 01:06:21.408 driver 01:06:21.408 env 01:06:21.408 env_dpdk_post_init 01:06:21.408 env_mem_callbacks 01:06:21.408 env_memory 01:06:21.408 env_pci 01:06:21.408 env_vtophys 01:06:21.408 even_2G_alloc 01:06:21.408 event 01:06:21.408 event_perf 01:06:21.408 event_reactor 01:06:21.408 event_reactor_perf 01:06:21.408 event_scheduler 01:06:21.408 exit_on_failed_rpc_init 01:06:21.408 external_make_accel_driver_shared 01:06:21.408 external_make_accel_driver_static 01:06:21.408 external_make_accel_module_shared 01:06:21.408 external_make_accel_module_static 01:06:21.408 external_make_hello_bdev_shared_combo 01:06:21.408 external_make_hello_bdev_shared_iso 01:06:21.408 external_make_hello_bdev_static 01:06:21.408 external_make_hello_no_bdev_shared_combo 01:06:21.408 external_make_hello_no_bdev_shared_iso 01:06:21.408 external_make_hello_no_bdev_static 01:06:21.408 external_make_nvme_shared 01:06:21.408 external_make_nvme_static 01:06:21.408 external_run_accel_driver_shared 01:06:21.408 external_run_accel_driver_static 01:06:21.408 external_run_accel_module_shared 01:06:21.408 external_run_accel_module_static 01:06:21.408 external_run_hello_bdev_shared_combo 01:06:21.408 external_run_hello_bdev_shared_iso 01:06:21.408 external_run_hello_bdev_static 01:06:21.408 external_run_hello_no_bdev_shared_combo 01:06:21.408 external_run_hello_no_bdev_shared_iso 01:06:21.408 external_run_hello_no_bdev_static 01:06:21.408 external_run_nvme_shared 01:06:21.408 external_run_nvme_static 01:06:21.408 filesystem_btrfs 01:06:21.408 filesystem_ext4 01:06:21.408 filesystem_in_capsule_btrfs 01:06:21.408 filesystem_in_capsule_ext4 01:06:21.408 filesystem_in_capsule_xfs 01:06:21.408 filesystem_xfs 01:06:21.408 fio_dif_1_default 01:06:21.408 fio_dif_1_multi_subsystems 01:06:21.408 fio_dif_digest 01:06:21.408 fio_dif_rand_params 01:06:21.408 go_rpc 01:06:21.408 guess_driver 01:06:21.408 hello_blob 01:06:21.408 hugepages 01:06:21.408 idle 01:06:21.408 interrupt_mode 01:06:21.408 ioat 01:06:21.408 ioat_perf 01:06:21.408 ioat_verify 01:06:21.408 is_zoned 01:06:21.408 iscsi_tgt 01:06:21.408 iscsi_tgt_bdev_io_wait 01:06:21.408 iscsi_tgt_calsoft 01:06:21.408 iscsi_tgt_digest 01:06:21.408 iscsi_tgt_digests 01:06:21.408 iscsi_tgt_ext4test 01:06:21.408 iscsi_tgt_filesystem 01:06:21.408 iscsi_tgt_filesystem_btrfs 01:06:21.408 iscsi_tgt_filesystem_ext4 01:06:21.408 iscsi_tgt_filesystem_xfs 01:06:21.408 iscsi_tgt_fio 01:06:21.408 iscsi_tgt_fuzz 01:06:21.408 iscsi_tgt_initiator 01:06:21.408 iscsi_tgt_ip_migration 01:06:21.408 iscsi_tgt_iscsi_lvol 01:06:21.408 iscsi_tgt_login_redirection 01:06:21.408 iscsi_tgt_multiconnection 01:06:21.408 iscsi_tgt_qos 01:06:21.408 iscsi_tgt_rbd 01:06:21.408 iscsi_tgt_reset 01:06:21.408 iscsi_tgt_resize 01:06:21.408 iscsi_tgt_rpc_config 01:06:21.408 iscsi_tgt_sock 01:06:21.408 iscsi_tgt_trace_record 01:06:21.408 json_config 01:06:21.408 json_config_extra_key 01:06:21.408 kernel_target_abort 01:06:21.408 keyring_file 01:06:21.408 llvm_fuzz 01:06:21.408 locking_app_on_locked_coremask 01:06:21.408 locking_app_on_unlocked_coremask 01:06:21.408 locking_overlapped_coremask 01:06:21.408 locking_overlapped_coremask_via_rpc 01:06:21.408 lvol 01:06:21.408 lvol_basic 01:06:21.408 lvol_esnap 01:06:21.408 lvol_external_copy 01:06:21.408 lvol_external_snapshot 01:06:21.408 lvol_hotremove 01:06:21.408 lvol_provisioning 01:06:21.408 lvol_rename 01:06:21.408 lvol_resize 01:06:21.408 lvol_snapshot_clone 01:06:21.408 lvol_tasting 01:06:21.408 lvs_grow_clean 01:06:21.408 lvs_grow_dirty 01:06:21.408 make 01:06:21.408 no_shrink_alloc 01:06:21.408 non_locking_app_on_locked_coremask 01:06:21.408 nvme 01:06:21.408 nvme_arbitration 01:06:21.408 nvme_cli_cuse 01:06:21.408 nvme_cli_plugin 01:06:21.408 nvme_cmb 01:06:21.408 nvme_cuse 01:06:21.408 nvme_cuse_app 01:06:21.408 nvme_cuse_rpc 01:06:21.408 nvme_doorbell_aers 01:06:21.408 nvme_e2edp 01:06:21.408 nvme_err_injection 01:06:21.408 nvme_fdp 01:06:21.408 nvme_fio 01:06:21.408 nvme_flexible_data_placement 01:06:21.408 nvme_hello_world 01:06:21.408 nvme_identify 01:06:21.408 nvme_mount 01:06:21.408 nvme_multi_aen 01:06:21.408 nvme_multi_secondary 01:06:21.408 nvme_ns_manage_cuse 01:06:21.408 nvme_overhead 01:06:21.408 nvme_perf 01:06:21.408 nvme_pmr 01:06:21.408 nvme_pmr_persistence 01:06:21.408 nvme_reserve 01:06:21.408 nvme_reset 01:06:21.408 nvme_rpc 01:06:21.408 nvme_rpc_timeouts 01:06:21.408 nvme_scc 01:06:21.408 nvme_sgl 01:06:21.408 nvme_simple_copy 01:06:21.408 nvme_single_aen 01:06:21.408 nvme_smartctl_cuse 01:06:21.408 nvme_startup 01:06:21.408 nvme_zns 01:06:21.408 nvmf_abort 01:06:21.408 nvmf_abort_qd_sizes 01:06:21.408 nvmf_aer 01:06:21.408 nvmf_async_init 01:06:21.408 nvmf_auth_host 01:06:21.408 nvmf_auth_target 01:06:21.408 nvmf_bdev_io_wait 01:06:21.408 nvmf_bdevio 01:06:21.408 nvmf_bdevio_no_huge 01:06:21.408 nvmf_bdevperf 01:06:21.408 nvmf_connect_disconnect 01:06:21.408 nvmf_connect_stress 01:06:21.408 nvmf_delete_subsystem 01:06:21.408 nvmf_device_removal 01:06:21.408 nvmf_device_removal_pci_remove 01:06:21.408 nvmf_device_removal_pci_remove_no_srq 01:06:21.408 nvmf_dif 01:06:21.408 nvmf_digest 01:06:21.408 nvmf_digest_clean 01:06:21.408 nvmf_digest_dsa_initiator 01:06:21.408 nvmf_digest_dsa_target 01:06:21.408 nvmf_digest_error 01:06:21.408 nvmf_discovery_remove_ifc 01:06:21.408 nvmf_example 01:06:21.408 nvmf_failover 01:06:21.408 nvmf_filesystem 01:06:21.408 nvmf_filesystem_in_capsule 01:06:21.408 nvmf_filesystem_no_in_capsule 01:06:21.408 nvmf_fio_host 01:06:21.408 nvmf_fio_target 01:06:21.408 nvmf_fips 01:06:21.408 nvmf_fused_ordering 01:06:21.408 nvmf_fuzz 01:06:21.408 nvmf_host_discovery 01:06:21.408 nvmf_host_management 01:06:21.408 nvmf_host_multipath 01:06:21.408 nvmf_host_multipath_status 01:06:21.408 nvmf_identify 01:06:21.408 nvmf_identify_kernel_target 01:06:21.408 nvmf_identify_passthru 01:06:21.408 nvmf_initiator_timeout 01:06:21.408 nvmf_invalid 01:06:21.408 nvmf_lvol 01:06:21.408 nvmf_lvs_grow 01:06:21.408 nvmf_mdns_discovery 01:06:21.408 nvmf_multiconnection 01:06:21.408 nvmf_multicontroller 01:06:21.408 nvmf_multitarget 01:06:21.408 nvmf_nmic 01:06:21.408 nvmf_ns_hotplug_stress 01:06:21.408 nvmf_ns_masking 01:06:21.408 nvmf_nvme_cli 01:06:21.408 nvmf_perf 01:06:21.408 nvmf_perf_adq 01:06:21.408 nvmf_queue_depth 01:06:21.408 nvmf_rdma 01:06:21.408 nvmf_referrals 01:06:21.408 nvmf_rpc 01:06:21.408 nvmf_shutdown 01:06:21.408 nvmf_shutdown_tc1 01:06:21.408 nvmf_shutdown_tc2 01:06:21.408 nvmf_shutdown_tc3 01:06:21.408 nvmf_srq_overwhelm 01:06:21.408 nvmf_target_disconnect 01:06:21.408 nvmf_target_disconnect_tc1 01:06:21.408 nvmf_target_disconnect_tc2 01:06:21.408 nvmf_target_disconnect_tc3 01:06:21.409 nvmf_target_discovery 01:06:21.409 nvmf_target_multipath 01:06:21.409 nvmf_tcp 01:06:21.409 nvmf_timeout 01:06:21.409 nvmf_tls 01:06:21.409 nvmf_vfio_user 01:06:21.409 nvmf_vfio_user_fuzz 01:06:21.409 nvmf_vfio_user_nvme_compliance 01:06:21.409 nvmf_vhost 01:06:21.409 nvmf_zcopy 01:06:21.409 ocf 01:06:21.409 ocf_bdevperf_iotypes 01:06:21.409 ocf_configuration_change 01:06:21.409 ocf_create_destruct 01:06:21.409 ocf_fio_modes 01:06:21.409 ocf_flush 01:06:21.409 ocf_multicore 01:06:21.409 ocf_remove 01:06:21.409 ocf_stats 01:06:21.409 odd_alloc 01:06:21.409 packaging 01:06:21.409 per_node_1G_alloc 01:06:21.409 raid0_resize_test 01:06:21.409 raid5f_rebuild_test 01:06:21.409 raid5f_rebuild_test_sb 01:06:21.409 raid5f_state_function_test 01:06:21.409 raid5f_state_function_test_sb 01:06:21.409 raid5f_superblock_test 01:06:21.409 raid_function_test_concat 01:06:21.409 raid_function_test_raid0 01:06:21.409 raid_rebuild_test 01:06:21.409 raid_rebuild_test_io 01:06:21.409 raid_rebuild_test_sb 01:06:21.409 raid_rebuild_test_sb_4k 01:06:21.409 raid_rebuild_test_sb_io 01:06:21.409 raid_rebuild_test_sb_md_interleaved 01:06:21.409 raid_rebuild_test_sb_md_separate 01:06:21.409 raid_state_function_test 01:06:21.409 raid_state_function_test_sb 01:06:21.409 raid_state_function_test_sb_4k 01:06:21.409 raid_state_function_test_sb_md_interleaved 01:06:21.409 raid_state_function_test_sb_md_separate 01:06:21.409 raid_superblock_test 01:06:21.409 raid_superblock_test_4k 01:06:21.409 raid_superblock_test_md_interleaved 01:06:21.409 raid_superblock_test_md_separate 01:06:21.409 reactor_set_interrupt 01:06:21.409 reap_unregistered_poller 01:06:21.409 rocksdb 01:06:21.409 rocksdb_insert 01:06:21.409 rocksdb_overwrite 01:06:21.409 rocksdb_randread 01:06:21.409 rocksdb_readwrite 01:06:21.409 rocksdb_writesync 01:06:21.409 rpc 01:06:21.409 rpc_client 01:06:21.409 rpc_daemon_integrity 01:06:21.409 rpc_integrity 01:06:21.409 rpc_plugins 01:06:21.409 rpc_trace_cmd_test 01:06:21.409 rpm_packaging 01:06:21.409 scanbuild_make 01:06:21.409 scheduler 01:06:21.409 scheduler_create_thread 01:06:21.409 setup.sh 01:06:21.409 skip_rpc 01:06:21.409 skip_rpc_with_delay 01:06:21.409 skip_rpc_with_json 01:06:21.409 sma 01:06:21.409 sma_crypto 01:06:21.409 sma_discovery 01:06:21.409 sma_nvmf_tcp 01:06:21.409 sma_plugins 01:06:21.409 sma_qos 01:06:21.409 sma_vfiouser_qemu 01:06:21.409 sma_vhost 01:06:21.409 spdk_dd 01:06:21.409 spdk_dd_basic_rw 01:06:21.409 spdk_dd_bdev_to_bdev 01:06:21.409 spdk_dd_malloc 01:06:21.409 spdk_dd_negative 01:06:21.409 spdk_dd_posix 01:06:21.409 spdk_dd_sparse 01:06:21.409 spdk_dd_uring 01:06:21.409 spdk_target_abort 01:06:21.409 spdkcli_iscsi 01:06:21.409 spdkcli_nvmf_rdma 01:06:21.409 spdkcli_nvmf_tcp 01:06:21.409 spdkcli_raid 01:06:21.409 spdkcli_rbd 01:06:21.409 spdkcli_tcp 01:06:21.409 spdkcli_vhost 01:06:21.409 spdkcli_virtio 01:06:21.409 sw_hotplug 01:06:21.409 test_bdev_lvol_delete_lvstore_with_clones 01:06:21.409 test_bdev_lvol_delete_ordering 01:06:21.409 test_clone_decouple_parent 01:06:21.409 test_clone_inflate 01:06:21.409 test_clone_snapshot_relations 01:06:21.409 test_construct_lvol 01:06:21.409 test_construct_lvol_alias_conflict 01:06:21.409 test_construct_lvol_fio_clear_method_none 01:06:21.409 test_construct_lvol_fio_clear_method_unmap 01:06:21.409 test_construct_lvol_full_lvs 01:06:21.409 test_construct_lvol_inexistent_lvs 01:06:21.409 test_construct_lvols_conflict_alias 01:06:21.409 test_construct_lvs 01:06:21.409 test_construct_lvs_clear_methods 01:06:21.409 test_construct_lvs_conflict_alias 01:06:21.409 test_construct_lvs_different_cluster_size 01:06:21.409 test_construct_lvs_nonexistent_bdev 01:06:21.409 test_construct_multi_lvols 01:06:21.409 test_construct_nested_lvol 01:06:21.409 test_construct_two_lvs_on_the_same_bdev 01:06:21.409 test_create_snapshot_of_snapshot 01:06:21.409 test_create_snapshot_with_io 01:06:21.409 test_delete_lvol_store_persistent_positive 01:06:21.409 test_delete_snapshot_with_clone 01:06:21.409 test_delete_snapshot_with_snapshot 01:06:21.409 test_destroy_after_bdev_lvol_resize_positive 01:06:21.409 test_esnap_clones 01:06:21.409 test_esnap_late_arrival 01:06:21.409 test_esnap_reload 01:06:21.409 test_esnap_remove_degraded 01:06:21.409 test_hotremove_lvol_store 01:06:21.409 test_hotremove_lvol_store_base 01:06:21.409 test_hotremove_lvol_store_base_with_lvols 01:06:21.409 test_hotremove_lvol_store_multiple_lvols 01:06:21.409 test_lvol_bdev_readonly 01:06:21.409 test_lvol_list 01:06:21.409 test_lvol_rename_negative 01:06:21.409 test_rename_lvs_negative 01:06:21.409 test_rename_positive 01:06:21.409 test_resize_lvol 01:06:21.409 test_resize_lvol_negative 01:06:21.409 test_resize_lvol_with_io_traffic 01:06:21.409 test_shallow_copy_compare 01:06:21.409 test_sigterm 01:06:21.409 test_snapshot_compare_with_lvol_bdev 01:06:21.409 test_tasting 01:06:21.409 test_thin_lvol_check_integrity 01:06:21.409 test_thin_lvol_check_space 01:06:21.409 test_thin_lvol_check_zeroes 01:06:21.409 test_thin_lvol_resize 01:06:21.409 test_thin_overprovisioning 01:06:21.409 test_unregister_lvol_bdev 01:06:21.409 thread 01:06:21.409 thread_poller_perf 01:06:21.409 thread_spdk_lock 01:06:21.409 ubsan 01:06:21.409 unittest 01:06:21.409 unittest_accel 01:06:21.409 unittest_bdev 01:06:21.409 unittest_bdev_compress 01:06:21.409 unittest_bdev_crypto 01:06:21.409 unittest_bdev_raid5f 01:06:21.409 unittest_blob_blobfs 01:06:21.409 unittest_build 01:06:21.409 unittest_dma 01:06:21.409 unittest_dpdk_compressdev 01:06:21.409 unittest_event 01:06:21.409 unittest_ftl 01:06:21.409 unittest_idxd_user 01:06:21.409 unittest_include 01:06:21.409 unittest_init 01:06:21.409 unittest_ioat 01:06:21.409 unittest_iobuf 01:06:21.409 unittest_iscsi 01:06:21.409 unittest_json 01:06:21.409 unittest_keyring 01:06:21.409 unittest_lib_reduce 01:06:21.409 unittest_log 01:06:21.409 unittest_lvol 01:06:21.409 unittest_notify 01:06:21.409 unittest_nvme 01:06:21.409 unittest_nvme_cuse 01:06:21.409 unittest_nvme_rdma 01:06:21.409 unittest_nvmf 01:06:21.409 unittest_nvmf_rdma 01:06:21.409 unittest_nvmf_transport 01:06:21.409 unittest_nvmf_vfio_user 01:06:21.409 unittest_pci_event 01:06:21.409 unittest_rdma 01:06:21.409 unittest_rpc 01:06:21.409 unittest_scsi 01:06:21.409 unittest_sock 01:06:21.409 unittest_thread 01:06:21.409 unittest_util 01:06:21.409 unittest_vhost 01:06:21.409 valgrind 01:06:21.409 version 01:06:21.409 vfio_fuzz 01:06:21.409 vfio_user_nvme_fio 01:06:21.409 vfio_user_nvme_restart_vm 01:06:21.409 vfio_user_qemu 01:06:21.409 vfio_user_virtio_bdevperf 01:06:21.409 vfio_user_virtio_blk_restart_vm 01:06:21.409 vfio_user_virtio_scsi_restart_vm 01:06:21.409 vhost 01:06:21.409 vhost_blk_cores_2ctrl 01:06:21.409 vhost_blk_fs_integrity 01:06:21.409 vhost_blk_integrity 01:06:21.409 vhost_blk_lvol_integrity 01:06:21.409 vhost_blk_packed_ring_integrity 01:06:21.409 vhost_blockdev 01:06:21.409 vhost_boot 01:06:21.409 vhost_fuzz 01:06:21.409 vhost_migration 01:06:21.409 vhost_migration_tc1 01:06:21.409 vhost_migration_tc2 01:06:21.409 vhost_negative 01:06:21.409 vhost_readonly 01:06:21.409 vhost_scsi_cores_2ctrl 01:06:21.409 vhost_scsi_fs_integrity 01:06:21.409 vhost_scsi_integrity 01:06:21.409 vhost_scsi_lvol_integrity 01:06:21.409 vhost_shared 01:06:21.409 vmd 01:06:21.409 vmd_bdev_svc 01:06:21.409 vmd_fio 01:06:21.409 vmd_hello_world 01:06:21.409 vmd_identify 01:06:21.409 vmd_perf 01:06:21.409 zoned_fio 01:06:21.409 01:06:21.409 01:06:21.409 -----Tests Missing From Build------ 01:06:21.409 balanced 01:06:21.409 blockdev_xnvme 01:06:21.409 build_native_dpdk 01:06:21.409 build_shared_native_dpdk_rpm 01:06:21.409 busy 01:06:21.409 core_load 01:06:21.409 ftl 01:06:21.409 ftl_bdevperf 01:06:21.409 ftl_dirty_shutdown 01:06:21.409 ftl_fio_basic 01:06:21.409 ftl_restore 01:06:21.409 ftl_restore_fast 01:06:21.409 ftl_trim 01:06:21.409 ftl_upgrade_shutdown 01:06:21.409 iscsi_tgt_data_digest 01:06:21.409 keyring_linux 01:06:21.409 nvme_boot_partition 01:06:21.409 nvme_bp 01:06:21.409 nvme_opal 01:06:21.409 nvme_opal_bdevio 01:06:21.409 nvme_opal_bdevperf 01:06:21.409 nvme_opal_spdk_tgt 01:06:21.409 nvme_xnvme 01:06:21.409 nvmf_fc 01:06:21.409 spdkcli_nvmf_fc 01:06:21.409 test_create_multi_ublk 01:06:21.409 test_create_ublk 01:06:21.409 test_save_ublk_config 01:06:21.409 ublk 01:06:21.409 ublk_recovery 01:06:21.409 unittest_nvmf_fc 01:06:21.409 unittest_nvmf_fc_ls 01:06:21.409 vhost_blk_hot_remove 01:06:21.409 vhost_hotplug 01:06:21.409 vhost_scsi_hot_remove 01:06:21.409 xnvme_bdevperf 01:06:21.409 xnvme_to_malloc_dd_copy 01:06:21.409 01:06:21.409 01:06:21.409 -----Tests Missing ASAN------ 01:06:21.409 accel_cdev_comp 01:06:21.409 accel_cdev_decmop_full 01:06:21.409 accel_cdev_decomp 01:06:21.409 accel_cdev_decomp_full_mcore 01:06:21.409 accel_cdev_decomp_full_mthread 01:06:21.409 accel_cdev_decomp_mcore 01:06:21.409 accel_cdev_decomp_mthread 01:06:21.409 autobuild 01:06:21.409 autobuild_build_doc 01:06:21.409 autobuild_check_dpdk_pci_api 01:06:21.409 autobuild_check_format 01:06:21.409 autobuild_check_so_deps 01:06:21.409 autobuild_external_code 01:06:21.409 autobuild_generated_files_check 01:06:21.409 autobuild_generated_files_check_post_clean 01:06:21.409 autobuild_header_dependency_check 01:06:21.409 autobuild_llvm_precompile 01:06:21.409 autobuild_make_install 01:06:21.409 autobuild_make_uninstall 01:06:21.409 autobuild_ocf_precompile 01:06:21.409 balanced 01:06:21.409 bdev_crypto_enomem 01:06:21.409 blockdev_crypto_aesni 01:06:21.409 blockdev_crypto_qat 01:06:21.409 blockdev_crypto_sw 01:06:21.410 blockdev_rbd 01:06:21.410 blockdev_xnvme 01:06:21.410 build_native_dpdk 01:06:21.410 build_shared_native_dpdk_rpm 01:06:21.410 busy 01:06:21.410 chaining 01:06:21.410 check_header_filenames 01:06:21.410 cmb_copy 01:06:21.410 compress_compdev 01:06:21.410 compress_isal 01:06:21.410 confirm_abi_deps 01:06:21.410 confirm_makefile_deps 01:06:21.410 core_load 01:06:21.410 dd_uring_copy 01:06:21.410 dpdk_governor 01:06:21.410 external_make_accel_driver_shared 01:06:21.410 external_make_accel_driver_static 01:06:21.410 external_make_accel_module_shared 01:06:21.410 external_make_accel_module_static 01:06:21.410 external_make_hello_bdev_shared_combo 01:06:21.410 external_make_hello_bdev_shared_iso 01:06:21.410 external_make_hello_bdev_static 01:06:21.410 external_make_hello_no_bdev_shared_combo 01:06:21.410 external_make_hello_no_bdev_shared_iso 01:06:21.410 external_make_hello_no_bdev_static 01:06:21.410 external_make_nvme_shared 01:06:21.410 external_make_nvme_static 01:06:21.410 external_run_accel_driver_shared 01:06:21.410 external_run_accel_driver_static 01:06:21.410 external_run_accel_module_shared 01:06:21.410 external_run_accel_module_static 01:06:21.410 external_run_hello_bdev_shared_combo 01:06:21.410 external_run_hello_bdev_shared_iso 01:06:21.410 external_run_hello_bdev_static 01:06:21.410 external_run_hello_no_bdev_shared_combo 01:06:21.410 external_run_hello_no_bdev_shared_iso 01:06:21.410 external_run_hello_no_bdev_static 01:06:21.410 external_run_nvme_shared 01:06:21.410 external_run_nvme_static 01:06:21.410 ftl 01:06:21.410 ftl_bdevperf 01:06:21.410 ftl_dirty_shutdown 01:06:21.410 ftl_fio_basic 01:06:21.410 ftl_restore 01:06:21.410 ftl_restore_fast 01:06:21.410 ftl_trim 01:06:21.410 ftl_upgrade_shutdown 01:06:21.410 go_rpc 01:06:21.410 idle 01:06:21.410 interrupt_mode 01:06:21.410 ioat 01:06:21.410 ioat_perf 01:06:21.410 ioat_verify 01:06:21.410 is_zoned 01:06:21.410 iscsi_tgt 01:06:21.410 iscsi_tgt_bdev_io_wait 01:06:21.410 iscsi_tgt_calsoft 01:06:21.410 iscsi_tgt_data_digest 01:06:21.410 iscsi_tgt_digest 01:06:21.410 iscsi_tgt_digests 01:06:21.410 iscsi_tgt_ext4test 01:06:21.410 iscsi_tgt_filesystem 01:06:21.410 iscsi_tgt_filesystem_btrfs 01:06:21.410 iscsi_tgt_filesystem_ext4 01:06:21.410 iscsi_tgt_filesystem_xfs 01:06:21.410 iscsi_tgt_fio 01:06:21.410 iscsi_tgt_fuzz 01:06:21.410 iscsi_tgt_initiator 01:06:21.410 iscsi_tgt_ip_migration 01:06:21.410 iscsi_tgt_iscsi_lvol 01:06:21.410 iscsi_tgt_login_redirection 01:06:21.410 iscsi_tgt_multiconnection 01:06:21.410 iscsi_tgt_qos 01:06:21.410 iscsi_tgt_rbd 01:06:21.410 iscsi_tgt_reset 01:06:21.410 iscsi_tgt_resize 01:06:21.410 iscsi_tgt_rpc_config 01:06:21.410 iscsi_tgt_sock 01:06:21.410 iscsi_tgt_trace_record 01:06:21.410 keyring_linux 01:06:21.410 llvm_fuzz 01:06:21.410 nvme_boot_partition 01:06:21.410 nvme_bp 01:06:21.410 nvme_cli_cuse 01:06:21.410 nvme_cli_plugin 01:06:21.410 nvme_cmb 01:06:21.410 nvme_cuse 01:06:21.410 nvme_cuse_app 01:06:21.410 nvme_cuse_rpc 01:06:21.410 nvme_ns_manage_cuse 01:06:21.410 nvme_opal 01:06:21.410 nvme_opal_bdevio 01:06:21.410 nvme_opal_bdevperf 01:06:21.410 nvme_opal_spdk_tgt 01:06:21.410 nvme_pmr 01:06:21.410 nvme_pmr_persistence 01:06:21.410 nvme_smartctl_cuse 01:06:21.410 nvme_xnvme 01:06:21.410 nvme_zns 01:06:21.410 nvmf_bdevperf 01:06:21.410 nvmf_device_removal 01:06:21.410 nvmf_device_removal_pci_remove 01:06:21.410 nvmf_device_removal_pci_remove_no_srq 01:06:21.410 nvmf_digest_clean 01:06:21.410 nvmf_fc 01:06:21.410 nvmf_host_multipath 01:06:21.410 nvmf_mdns_discovery 01:06:21.410 nvmf_nvme_cli 01:06:21.410 nvmf_perf_adq 01:06:21.410 nvmf_rdma 01:06:21.410 nvmf_shutdown 01:06:21.410 nvmf_shutdown_tc1 01:06:21.410 nvmf_shutdown_tc2 01:06:21.410 nvmf_shutdown_tc3 01:06:21.410 nvmf_srq_overwhelm 01:06:21.410 nvmf_target_disconnect 01:06:21.410 nvmf_target_disconnect_tc1 01:06:21.410 nvmf_target_disconnect_tc2 01:06:21.410 nvmf_target_disconnect_tc3 01:06:21.410 nvmf_timeout 01:06:21.410 nvmf_vfio_user 01:06:21.410 nvmf_vfio_user_fuzz 01:06:21.975 nvmf_vfio_user_nvme_compliance 01:06:21.975 ocf 01:06:21.975 ocf_bdevperf_iotypes 01:06:21.975 ocf_configuration_change 01:06:21.975 ocf_create_destruct 01:06:21.975 ocf_fio_modes 01:06:21.975 ocf_flush 01:06:21.975 ocf_multicore 01:06:21.975 ocf_remove 01:06:21.975 ocf_stats 01:06:21.975 scanbuild_make 01:06:21.975 scheduler 01:06:21.975 spdk_dd_uring 01:06:21.975 spdkcli_iscsi 01:06:21.975 spdkcli_nvmf_fc 01:06:21.975 spdkcli_nvmf_rdma 01:06:21.975 spdkcli_raid 01:06:21.975 spdkcli_rbd 01:06:21.975 spdkcli_virtio 01:06:21.975 test_create_multi_ublk 01:06:21.975 test_create_ublk 01:06:21.975 test_save_ublk_config 01:06:21.975 ublk 01:06:21.975 ublk_recovery 01:06:21.975 unittest_bdev_compress 01:06:21.975 unittest_bdev_crypto 01:06:21.975 unittest_dpdk_compressdev 01:06:21.975 unittest_lib_reduce 01:06:21.975 unittest_nvmf_fc 01:06:21.975 unittest_nvmf_fc_ls 01:06:21.975 unittest_nvmf_vfio_user 01:06:21.975 valgrind 01:06:21.975 vfio_fuzz 01:06:21.975 vhost_blk_hot_remove 01:06:21.975 vhost_blockdev 01:06:21.975 vhost_fuzz 01:06:21.975 vhost_hotplug 01:06:21.975 vhost_scsi_hot_remove 01:06:21.975 vhost_shared 01:06:21.975 xnvme_bdevperf 01:06:21.975 xnvme_to_malloc_dd_copy 01:06:21.975 zoned_fio 01:06:21.975 01:06:21.975 01:06:21.975 -----Tests Missing UBSAN------ 01:06:21.975 autobuild 01:06:21.975 autobuild_build_doc 01:06:21.975 autobuild_check_dpdk_pci_api 01:06:21.975 autobuild_check_format 01:06:21.975 autobuild_check_so_deps 01:06:21.975 autobuild_external_code 01:06:21.975 autobuild_generated_files_check 01:06:21.975 autobuild_generated_files_check_post_clean 01:06:21.975 autobuild_header_dependency_check 01:06:21.975 autobuild_make_install 01:06:21.975 autobuild_make_uninstall 01:06:21.975 balanced 01:06:21.975 blockdev_xnvme 01:06:21.975 build_native_dpdk 01:06:21.975 build_rpm_from_gen_spec 01:06:21.975 build_shared_native_dpdk_rpm 01:06:21.975 build_shared_rpm 01:06:21.975 build_shared_rpm_with_rpmed_dpdk 01:06:21.975 busy 01:06:21.975 check_header_filenames 01:06:21.975 cmb_copy 01:06:21.975 confirm_abi_deps 01:06:21.975 confirm_makefile_deps 01:06:21.975 core_load 01:06:21.975 external_make_accel_driver_shared 01:06:21.975 external_make_accel_driver_static 01:06:21.975 external_make_accel_module_shared 01:06:21.975 external_make_accel_module_static 01:06:21.975 external_make_hello_bdev_shared_combo 01:06:21.975 external_make_hello_bdev_shared_iso 01:06:21.975 external_make_hello_bdev_static 01:06:21.975 external_make_hello_no_bdev_shared_combo 01:06:21.975 external_make_hello_no_bdev_shared_iso 01:06:21.975 external_make_hello_no_bdev_static 01:06:21.975 external_make_nvme_shared 01:06:21.975 external_make_nvme_static 01:06:21.975 external_run_accel_driver_shared 01:06:21.975 external_run_accel_driver_static 01:06:21.975 external_run_accel_module_shared 01:06:21.975 external_run_accel_module_static 01:06:21.975 external_run_hello_bdev_shared_combo 01:06:21.975 external_run_hello_bdev_shared_iso 01:06:21.975 external_run_hello_bdev_static 01:06:21.975 external_run_hello_no_bdev_shared_combo 01:06:21.975 external_run_hello_no_bdev_shared_iso 01:06:21.975 external_run_hello_no_bdev_static 01:06:21.975 external_run_nvme_shared 01:06:21.975 external_run_nvme_static 01:06:21.975 ftl 01:06:21.975 ftl_bdevperf 01:06:21.975 ftl_dirty_shutdown 01:06:21.975 ftl_fio_basic 01:06:21.975 ftl_restore 01:06:21.975 ftl_restore_fast 01:06:21.975 ftl_trim 01:06:21.975 ftl_upgrade_shutdown 01:06:21.975 is_zoned 01:06:21.975 iscsi_tgt_data_digest 01:06:21.975 keyring_linux 01:06:21.975 nvme_boot_partition 01:06:21.975 nvme_bp 01:06:21.975 nvme_cmb 01:06:21.975 nvme_opal 01:06:21.975 nvme_opal_bdevio 01:06:21.975 nvme_opal_bdevperf 01:06:21.975 nvme_opal_spdk_tgt 01:06:21.975 nvme_pmr 01:06:21.975 nvme_pmr_persistence 01:06:21.975 nvme_xnvme 01:06:21.975 nvme_zns 01:06:21.975 nvmf_fc 01:06:21.975 packaging 01:06:21.975 rpm_packaging 01:06:21.975 scanbuild_make 01:06:21.975 spdkcli_nvmf_fc 01:06:21.975 test_create_multi_ublk 01:06:21.975 test_create_ublk 01:06:21.975 test_save_ublk_config 01:06:21.975 ublk 01:06:21.975 ublk_recovery 01:06:21.975 unittest_bdev_compress 01:06:21.975 unittest_bdev_crypto 01:06:21.975 unittest_dpdk_compressdev 01:06:21.975 unittest_lib_reduce 01:06:21.975 unittest_nvmf_fc 01:06:21.975 unittest_nvmf_fc_ls 01:06:21.975 unittest_nvmf_vfio_user 01:06:21.975 valgrind 01:06:21.975 vhost_blk_hot_remove 01:06:21.975 vhost_hotplug 01:06:21.975 vhost_scsi_hot_remove 01:06:21.975 xnvme_bdevperf 01:06:21.975 xnvme_to_malloc_dd_copy 01:06:21.975 zoned_fio 01:06:21.975 Not all tests were run. Failing the build. 01:06:21.975 ['blockdev_xnvme', 'ftl', 'ftl_bdevperf', 'ftl_dirty_shutdown', 'ftl_fio_basic', 'ftl_restore', 'ftl_trim', 'ftl_upgrade_shutdown', 'nvme_xnvme', 'test_create_multi_ublk', 'test_create_ublk', 'test_save_ublk_config', 'ublk', 'ublk_recovery', 'xnvme_bdevperf', 'xnvme_to_malloc_dd_copy'] 01:06:22.233 + compress_coverage_and_docs 01:06:22.233 + echo 'Start compress coverage and docs' 01:06:22.233 Start compress coverage and docs 01:06:22.233 + tar -C coverage -czf coverage_autotest-nightly_3705.tar.gz ./ --remove-files 01:06:23.165 + tar -C ut_coverage -czf ut_coverage_autotest-nightly_3705.tar.gz ./ --remove-files 01:06:24.096 + tar -C doc -czf doc_autotest-nightly_3705.tar.gz ./ --remove-files 01:06:24.355 + [[ -d llvm ]] 01:06:24.355 + true 01:06:24.355 + echo 'End compress coverage and docs' 01:06:24.355 End compress coverage and docs 01:06:24.355 + remove_partial_coverage_files 01:06:24.355 + find . -name 'cov_*.info' -delete 01:06:24.355 + echo 'End stage post_gen_coverage.sh' 01:06:24.355 End stage post_gen_coverage.sh 01:06:24.367 [Pipeline] } 01:06:24.370 ERROR: script returned exit code 1 01:06:24.394 [Pipeline] // catchError 01:06:24.402 [Pipeline] catchError 01:06:24.403 [Pipeline] { 01:06:24.419 [Pipeline] dir 01:06:24.420 Running in /var/jenkins/workspace/autotest-nightly/post_process 01:06:24.421 [Pipeline] {