00:00:00.000 Started by user sys_sgci 00:00:00.009 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/autotest-per-patch_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-upstream/autotest.groovy 00:00:00.010 The recommended git tool is: git 00:00:00.010 using credential 00000000-0000-0000-0000-000000000002 00:00:00.012 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/autotest-per-patch_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.026 Fetching changes from the remote Git repository 00:00:00.027 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.039 Using shallow fetch with depth 1 00:00:00.039 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.039 > git --version # timeout=10 00:00:00.048 > git --version # 'git version 2.39.2' 00:00:00.048 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.049 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.049 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:02.354 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:02.366 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:02.378 Checking out Revision 10da8f6d99838e411e4e94523ded0bfebf3e7100 (FETCH_HEAD) 00:00:02.378 > git config core.sparsecheckout # timeout=10 00:00:02.389 > git read-tree -mu HEAD # timeout=10 00:00:02.405 > git checkout -f 10da8f6d99838e411e4e94523ded0bfebf3e7100 # timeout=5 00:00:02.423 Commit message: "scripts/create_git_mirror: Update path to xnvme submodule" 00:00:02.423 > git rev-list --no-walk 10da8f6d99838e411e4e94523ded0bfebf3e7100 # timeout=10 00:00:02.877 [Pipeline] Start of Pipeline 00:00:02.892 [Pipeline] library 00:00:02.894 Loading library shm_lib@master 00:00:02.894 Library shm_lib@master is cached. Copying from home. 00:00:02.933 [Pipeline] node 00:00:02.970 Running on ME2 in /var/jenkins/workspace/autotest-per-patch_5 00:00:02.971 [Pipeline] { 00:00:02.985 [Pipeline] cleanWs 00:00:02.993 [WS-CLEANUP] Deleting project workspace... 00:00:02.993 [WS-CLEANUP] Deferred wipeout is used... 00:00:02.998 [WS-CLEANUP] done 00:00:03.002 [Pipeline] stage 00:00:03.005 [Pipeline] { (Prologue) 00:00:03.115 [Pipeline] withCredentials 00:00:03.125 > git --version # timeout=10 00:00:03.136 > git --version # 'git version 2.39.2' 00:00:03.154 Masking supported pattern matches of $GIT_USERNAME or $GIT_PASSWORD or $GIT_ASKPASS 00:00:03.157 [Pipeline] { 00:00:03.165 [Pipeline] retry 00:00:03.166 [Pipeline] { 00:00:03.460 [Pipeline] sh 00:00:03.739 + git ls-remote https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master 00:00:05.666 [Pipeline] } 00:00:05.694 [Pipeline] // retry 00:00:05.699 [Pipeline] } 00:00:05.721 [Pipeline] // withCredentials 00:00:05.731 [Pipeline] nodesByLabel 00:00:05.733 Found a total of 1 nodes with the 'sorcerer' label 00:00:05.744 [Pipeline] httpRequest 00:00:05.749 HttpMethod: GET 00:00:05.750 URL: http://10.211.164.101/packages/jbp_10da8f6d99838e411e4e94523ded0bfebf3e7100.tar.gz 00:00:05.751 Sending request to url: http://10.211.164.101/packages/jbp_10da8f6d99838e411e4e94523ded0bfebf3e7100.tar.gz 00:00:05.752 Response Code: HTTP/1.1 200 OK 00:00:05.753 Success: Status code 200 is in the accepted range: 200,404 00:00:05.754 Saving response body to /var/jenkins/workspace/autotest-per-patch_5/jbp_10da8f6d99838e411e4e94523ded0bfebf3e7100.tar.gz 00:00:05.892 [Pipeline] sh 00:00:06.174 + tar --no-same-owner -xf jbp_10da8f6d99838e411e4e94523ded0bfebf3e7100.tar.gz 00:00:06.200 [Pipeline] httpRequest 00:00:06.205 HttpMethod: GET 00:00:06.205 URL: http://10.211.164.101/packages/spdk_4506c0c368f63ba9b9b013ecff216cef6ee8d0a4.tar.gz 00:00:06.206 Sending request to url: http://10.211.164.101/packages/spdk_4506c0c368f63ba9b9b013ecff216cef6ee8d0a4.tar.gz 00:00:06.206 Response Code: HTTP/1.1 200 OK 00:00:06.207 Success: Status code 200 is in the accepted range: 200,404 00:00:06.207 Saving response body to /var/jenkins/workspace/autotest-per-patch_5/spdk_4506c0c368f63ba9b9b013ecff216cef6ee8d0a4.tar.gz 00:00:08.331 [Pipeline] sh 00:00:08.613 + tar --no-same-owner -xf spdk_4506c0c368f63ba9b9b013ecff216cef6ee8d0a4.tar.gz 00:00:10.524 [Pipeline] sh 00:00:10.851 + git -C spdk log --oneline -n5 00:00:10.851 4506c0c36 test/common: Enable inherit_errexit 00:00:10.851 b24df7cfa test: Drop superfluous calls to print_backtrace() 00:00:10.851 7b52e4c17 test/scheduler: Meassure utime of $spdk_pid threads as a fallback 00:00:10.851 1dc065205 test/scheduler: Calculate median of the cpu load samples 00:00:10.851 b22f1b34d test/scheduler: Enhance lookup of the $old_cgroup in move_proc() 00:00:10.870 [Pipeline] setCustomBuildProperty 00:00:10.879 [Pipeline] setCustomBuildProperty 00:00:10.889 [Pipeline] catchError 00:00:10.891 [Pipeline] { 00:00:10.911 [Pipeline] sh 00:00:11.192 + git -C spdk describe --tags --abbrev=0 origin/master 00:00:11.205 [Pipeline] sh 00:00:11.481 + git -C spdk describe --tags --abbrev=0 --exclude=LTS HEAD 00:00:11.494 [Pipeline] echo 00:00:11.495 Branch: master 00:00:11.499 [Pipeline] fileExists 00:00:11.516 [Pipeline] readJSON 00:00:11.530 [Pipeline] } 00:00:11.557 [Pipeline] // catchError 00:00:11.562 [Pipeline] } 00:00:11.588 [Pipeline] // stage 00:00:11.608 [Pipeline] catchError 00:00:11.610 [Pipeline] { 00:00:11.631 [Pipeline] stage 00:00:11.633 [Pipeline] { (Pre tests) 00:00:11.688 [Pipeline] parallel 00:00:11.701 [Pipeline] { (Branch: check-format-docker-autotest) 00:00:11.703 [Pipeline] { (Branch: check-so-deps-docker-autotest) 00:00:11.705 [Pipeline] { (Branch: doc-docker-autotest) 00:00:11.706 [Pipeline] { (Branch: build-files-docker-autotest) 00:00:11.731 [Pipeline] retry 00:00:11.733 [Pipeline] { 00:00:11.739 [Pipeline] retry 00:00:11.740 [Pipeline] { 00:00:11.745 [Pipeline] retry 00:00:11.747 [Pipeline] { 00:00:11.752 [Pipeline] retry 00:00:11.754 [Pipeline] { 00:00:11.777 [Pipeline] build 00:00:11.780 Scheduling project: check-format-docker-autotest 00:00:11.787 [Pipeline] build 00:00:11.790 Scheduling project: check-so-deps-docker-autotest 00:00:11.797 [Pipeline] build 00:00:11.800 Scheduling project: doc-docker-autotest 00:00:11.806 [Pipeline] build 00:00:11.809 Scheduling project: build-files-docker-autotest 00:00:18.893 Starting building: check-format-docker-autotest #22120 00:00:18.895 Starting building: build-files-docker-autotest #22109 00:00:18.898 Starting building: check-so-deps-docker-autotest #22133 00:00:18.902 Starting building: doc-docker-autotest #22300 00:00:51.663 Build doc-docker-autotest #22300 completed: SUCCESS 00:00:51.665 [Pipeline] } 00:00:51.701 [Pipeline] // retry 00:00:51.707 [Pipeline] } 00:01:07.609 Build check-format-docker-autotest #22120 completed: SUCCESS 00:01:07.611 [Pipeline] } 00:01:07.647 [Pipeline] // retry 00:01:07.652 [Pipeline] } 00:02:34.366 Build build-files-docker-autotest #22109 completed: SUCCESS 00:02:34.369 [Pipeline] } 00:02:34.402 [Pipeline] // retry 00:02:34.407 [Pipeline] } 00:03:07.471 Build check-so-deps-docker-autotest #22133 completed: SUCCESS 00:03:07.474 [Pipeline] } 00:03:07.500 [Pipeline] // retry 00:03:07.503 [Pipeline] } 00:03:07.554 [Pipeline] // parallel 00:03:07.560 [Pipeline] } 00:03:07.592 [Pipeline] // stage 00:03:07.596 [Pipeline] } 00:03:07.622 [Pipeline] // catchError 00:03:07.629 [Pipeline] catchError 00:03:07.630 [Pipeline] { 00:03:07.647 [Pipeline] stage 00:03:07.648 [Pipeline] { (Tests) 00:03:07.792 [Pipeline] parallel 00:03:07.858 [Pipeline] { (Branch: unittest-clang-docker-autotest) 00:03:07.859 [Pipeline] { (Branch: unittest-main-docker-autotest) 00:03:07.860 [Pipeline] { (Branch: autobuild-external-vg-autotest) 00:03:07.861 [Pipeline] { (Branch: scan-build-docker-autotest) 00:03:07.862 [Pipeline] { (Branch: unittest-valgrind-docker-autotest) 00:03:07.864 [Pipeline] { (Branch: lvol-vg-autotest) 00:03:07.865 [Pipeline] { (Branch: vhost-initiator-vg-autotest) 00:03:07.865 [Pipeline] { (Branch: nvmf-tcp-vg-autotest) 00:03:07.866 [Pipeline] { (Branch: nvmf-tcp-uring-vg-autotest) 00:03:07.867 [Pipeline] { (Branch: nvme-vg-autotest) 00:03:07.868 [Pipeline] { (Branch: centos7-vg-autotest) 00:03:07.869 [Pipeline] { (Branch: rocky9-vg-autotest) 00:03:07.870 [Pipeline] { (Branch: ubuntu20-vg-autotest) 00:03:07.871 [Pipeline] { (Branch: ubuntu22-vg-autotest) 00:03:07.872 [Pipeline] { (Branch: freebsd-vg-autotest) 00:03:07.873 [Pipeline] { (Branch: iscsi-vg-autotest) 00:03:07.874 [Pipeline] { (Branch: iscsi-uring-vg-autotest) 00:03:07.875 [Pipeline] { (Branch: zns-vg-autotest) 00:03:07.875 [Pipeline] { (Branch: nvme-cmb-pmr-vg-autotest) 00:03:07.876 [Pipeline] { (Branch: BlobFS-phy-autotest) 00:03:07.877 [Pipeline] { (Branch: crypto-phy-autotest) 00:03:07.878 [Pipeline] { (Branch: vhost-phy-autotest) 00:03:07.879 [Pipeline] { (Branch: nvmf-phy-autotest) 00:03:07.880 [Pipeline] { (Branch: nvmf-tcp-phy-autotest) 00:03:07.881 [Pipeline] { (Branch: nvme-phy-autotest) 00:03:07.882 [Pipeline] { (Branch: vfio-user-phy-autotest) 00:03:07.883 [Pipeline] { (Branch: short-fuzz-phy-autotest) 00:03:07.884 [Pipeline] { (Branch: dsa-phy-autotest) 00:03:07.885 [Pipeline] { (Branch: packaging-docker-autotest) 00:03:07.909 [Pipeline] retry 00:03:07.911 [Pipeline] { 00:03:07.913 [Pipeline] retry 00:03:07.914 [Pipeline] { 00:03:07.916 [Pipeline] retry 00:03:07.917 [Pipeline] { 00:03:07.920 [Pipeline] retry 00:03:07.921 [Pipeline] { 00:03:07.924 [Pipeline] retry 00:03:07.925 [Pipeline] { 00:03:07.928 [Pipeline] retry 00:03:07.929 [Pipeline] { 00:03:07.931 [Pipeline] retry 00:03:07.932 [Pipeline] { 00:03:07.935 [Pipeline] retry 00:03:07.936 [Pipeline] { 00:03:07.939 [Pipeline] retry 00:03:07.940 [Pipeline] { 00:03:07.943 [Pipeline] retry 00:03:07.944 [Pipeline] { 00:03:07.946 [Pipeline] retry 00:03:07.947 [Pipeline] { 00:03:07.950 [Pipeline] retry 00:03:07.951 [Pipeline] { 00:03:07.954 [Pipeline] retry 00:03:07.955 [Pipeline] { 00:03:07.958 [Pipeline] retry 00:03:07.959 [Pipeline] { 00:03:07.963 [Pipeline] retry 00:03:07.964 [Pipeline] { 00:03:07.967 [Pipeline] retry 00:03:07.968 [Pipeline] { 00:03:07.971 [Pipeline] retry 00:03:07.972 [Pipeline] { 00:03:07.975 [Pipeline] retry 00:03:07.976 [Pipeline] { 00:03:07.978 [Pipeline] retry 00:03:07.979 [Pipeline] { 00:03:07.983 [Pipeline] retry 00:03:07.984 [Pipeline] { 00:03:07.987 [Pipeline] retry 00:03:07.988 [Pipeline] { 00:03:07.991 [Pipeline] retry 00:03:07.992 [Pipeline] { 00:03:07.995 [Pipeline] retry 00:03:07.996 [Pipeline] { 00:03:07.999 [Pipeline] retry 00:03:08.000 [Pipeline] { 00:03:08.002 [Pipeline] retry 00:03:08.003 [Pipeline] { 00:03:08.006 [Pipeline] retry 00:03:08.007 [Pipeline] { 00:03:08.010 [Pipeline] retry 00:03:08.012 [Pipeline] { 00:03:08.014 [Pipeline] retry 00:03:08.016 [Pipeline] { 00:03:08.019 [Pipeline] retry 00:03:08.020 [Pipeline] { 00:03:08.043 [Pipeline] build 00:03:08.046 Scheduling project: unittest-clang-docker-autotest 00:03:08.052 [Pipeline] build 00:03:08.055 Scheduling project: unittest-main-docker-autotest 00:03:08.061 [Pipeline] build 00:03:08.064 Scheduling project: autobuild-external-vg-autotest 00:03:08.071 [Pipeline] build 00:03:08.073 Scheduling project: scan-build-docker-autotest 00:03:08.079 [Pipeline] build 00:03:08.082 Scheduling project: unittest-valgrind-docker-autotest 00:03:08.088 [Pipeline] build 00:03:08.091 Scheduling project: lvol-vg-autotest 00:03:08.097 [Pipeline] build 00:03:08.099 Scheduling project: vhost-initiator-vg-autotest 00:03:08.104 [Pipeline] build 00:03:08.106 Scheduling project: nvmf-tcp-vg-autotest 00:03:08.110 [Pipeline] build 00:03:08.112 Scheduling project: nvmf-tcp-uring-vg-autotest 00:03:08.116 [Pipeline] build 00:03:08.118 Scheduling project: nvme-vg-autotest 00:03:08.122 [Pipeline] build 00:03:08.124 Scheduling project: centos7-vg-autotest 00:03:08.128 [Pipeline] build 00:03:08.130 Scheduling project: rocky9-vg-autotest 00:03:08.134 [Pipeline] build 00:03:08.136 Scheduling project: ubuntu20-vg-autotest 00:03:08.140 [Pipeline] build 00:03:08.142 Scheduling project: ubuntu22-vg-autotest 00:03:08.146 [Pipeline] build 00:03:08.148 Scheduling project: freebsd-vg-autotest 00:03:08.153 [Pipeline] build 00:03:08.200 Scheduling project: iscsi-vg-autotest 00:03:08.207 [Pipeline] build 00:03:08.209 Scheduling project: iscsi-uring-vg-autotest 00:03:08.214 [Pipeline] build 00:03:08.216 Scheduling project: zns-vg-autotest 00:03:08.220 [Pipeline] build 00:03:08.222 Scheduling project: nvme-cmb-pmr-vg-autotest 00:03:08.227 [Pipeline] build 00:03:08.228 Scheduling project: BlobFS-phy-autotest 00:03:08.232 [Pipeline] build 00:03:08.234 Scheduling project: crypto-phy-autotest 00:03:08.238 [Pipeline] build 00:03:08.240 Scheduling project: vhost-phy-autotest 00:03:08.245 [Pipeline] build 00:03:08.246 Scheduling project: nvmf-phy-autotest 00:03:08.251 [Pipeline] build 00:03:08.253 Scheduling project: nvmf-tcp-phy-autotest 00:03:08.257 [Pipeline] build 00:03:08.259 Scheduling project: nvme-phy-autotest 00:03:08.264 [Pipeline] build 00:03:08.266 Scheduling project: vfio-user-phy-autotest 00:03:08.271 [Pipeline] build 00:03:08.273 Scheduling project: short-fuzz-phy-autotest 00:03:08.277 [Pipeline] build 00:03:08.279 Scheduling project: dsa-phy-autotest 00:03:08.284 [Pipeline] build 00:03:08.285 Scheduling project: packaging-docker-autotest 00:03:15.444 Starting building: dsa-phy-autotest #4872 00:03:15.450 Starting building: short-fuzz-phy-autotest #26169 00:03:15.452 Starting building: rocky9-vg-autotest #16062 00:03:15.458 Starting building: BlobFS-phy-autotest #26178 00:03:15.460 Starting building: unittest-main-docker-autotest #19838 00:03:15.470 Starting building: unittest-clang-docker-autotest #19837 00:03:15.473 Starting building: unittest-valgrind-docker-autotest #19841 00:03:15.476 Starting building: vhost-phy-autotest #26197 00:03:15.479 Starting building: autobuild-external-vg-autotest #19800 00:03:15.483 Starting building: packaging-docker-autotest #19839 00:03:15.486 Starting building: zns-vg-autotest #76558 00:03:15.489 Starting building: ubuntu22-vg-autotest #37785 00:03:15.491 Starting building: nvme-phy-autotest #72344 00:03:15.497 Starting building: vhost-initiator-vg-autotest #77472 00:03:15.500 Starting building: nvme-cmb-pmr-vg-autotest #78575 00:03:15.507 Starting building: nvmf-tcp-phy-autotest #72303 00:03:15.511 Starting building: freebsd-vg-autotest #59100 00:03:15.515 Starting building: scan-build-docker-autotest #19840 00:03:15.517 Starting building: vfio-user-phy-autotest #26180 00:03:15.521 Starting building: crypto-phy-autotest #26172 00:03:15.527 Starting building: nvmf-tcp-vg-autotest #77443 00:03:15.530 Starting building: nvmf-phy-autotest #72416 00:03:15.536 Starting building: nvmf-tcp-uring-vg-autotest #77377 00:03:15.539 Starting building: iscsi-vg-autotest #77490 00:03:15.542 Starting building: centos7-vg-autotest #73631 00:03:15.544 Starting building: lvol-vg-autotest #77401 00:03:15.547 Starting building: iscsi-uring-vg-autotest #77357 00:03:15.550 Starting building: ubuntu20-vg-autotest #73771 00:03:15.552 Starting building: nvme-vg-autotest #77452 00:06:38.240 Build unittest-clang-docker-autotest #19837 completed: SUCCESS 00:06:38.244 [Pipeline] } 00:06:38.304 [Pipeline] // retry 00:06:38.310 [Pipeline] } 00:06:59.205 Build packaging-docker-autotest #19839 completed: SUCCESS 00:06:59.207 [Pipeline] } 00:06:59.242 [Pipeline] // retry 00:06:59.245 [Pipeline] } 00:07:49.919 Build scan-build-docker-autotest #19840 completed: SUCCESS 00:07:49.922 [Pipeline] } 00:07:49.966 [Pipeline] // retry 00:07:49.973 [Pipeline] } 00:08:49.778 Build unittest-main-docker-autotest #19838 completed: SUCCESS 00:08:49.781 [Pipeline] } 00:08:49.828 [Pipeline] // retry 00:08:49.834 [Pipeline] } 00:11:02.920 Build short-fuzz-phy-autotest #26169 completed: SUCCESS 00:11:02.923 [Pipeline] } 00:11:02.966 [Pipeline] // retry 00:11:02.971 [Pipeline] } 00:12:38.741 Build unittest-valgrind-docker-autotest #19841 completed: SUCCESS 00:12:38.744 [Pipeline] } 00:12:38.768 [Pipeline] // retry 00:12:38.771 [Pipeline] } 00:15:59.382 Build autobuild-external-vg-autotest #19800 completed: SUCCESS 00:15:59.384 [Pipeline] } 00:15:59.420 [Pipeline] // retry 00:15:59.426 [Pipeline] } 00:17:46.350 Build vhost-phy-autotest #26197 completed: SUCCESS 00:17:46.353 [Pipeline] } 00:17:46.397 [Pipeline] // retry 00:17:46.403 [Pipeline] } 00:19:50.253 Build zns-vg-autotest #76558 completed: SUCCESS 00:19:50.255 [Pipeline] } 00:19:50.298 [Pipeline] // retry 00:19:50.304 [Pipeline] } 00:20:53.924 Build BlobFS-phy-autotest #26178 completed: SUCCESS 00:20:53.930 [Pipeline] } 00:20:53.974 [Pipeline] // retry 00:20:53.980 [Pipeline] } 00:21:19.371 Build vhost-initiator-vg-autotest #77472 completed: SUCCESS 00:21:19.373 [Pipeline] } 00:21:19.417 [Pipeline] // retry 00:21:19.423 [Pipeline] } 00:23:02.762 Build vfio-user-phy-autotest #26180 completed: SUCCESS 00:23:02.766 [Pipeline] } 00:23:02.808 [Pipeline] // retry 00:23:02.816 [Pipeline] } 00:26:53.251 Build nvme-cmb-pmr-vg-autotest #78575 completed: SUCCESS 00:26:53.254 [Pipeline] } 00:26:53.305 [Pipeline] // retry 00:26:53.312 [Pipeline] } 00:27:10.908 Build nvme-phy-autotest #72344 completed: SUCCESS 00:27:10.911 [Pipeline] } 00:27:10.952 [Pipeline] // retry 00:27:10.957 [Pipeline] } 00:27:22.122 Build lvol-vg-autotest #77401 completed: SUCCESS 00:27:22.126 [Pipeline] } 00:27:22.171 [Pipeline] // retry 00:27:22.178 [Pipeline] } 00:27:27.424 Build iscsi-vg-autotest #77490 completed: SUCCESS 00:27:27.428 [Pipeline] } 00:27:27.472 [Pipeline] // retry 00:27:27.478 [Pipeline] } 00:29:29.046 Build freebsd-vg-autotest #59100 completed: SUCCESS 00:29:29.048 [Pipeline] } 00:29:29.085 [Pipeline] // retry 00:29:29.091 [Pipeline] } 00:29:56.007 Build nvme-vg-autotest #77452 completed: FAILURE 00:29:56.765 [Pipeline] echo 00:29:56.766 No retry patterns found. 00:29:56.767 [Pipeline] } 00:29:56.800 [Pipeline] // retry 00:29:56.810 [Pipeline] error 00:29:56.815 [Pipeline] } 00:29:56.821 Failed in branch nvme-vg-autotest 00:30:06.739 Build iscsi-uring-vg-autotest #77357 completed: SUCCESS 00:30:06.743 [Pipeline] } 00:30:06.793 [Pipeline] // retry 00:30:06.801 [Pipeline] } 00:30:20.251 Build nvmf-phy-autotest #72416 completed: SUCCESS 00:30:20.255 [Pipeline] } 00:30:20.283 [Pipeline] // retry 00:30:20.288 [Pipeline] } 00:32:13.809 Build crypto-phy-autotest #26172 completed: SUCCESS 00:32:13.811 [Pipeline] } 00:32:13.845 [Pipeline] // retry 00:32:13.848 [Pipeline] } 00:33:49.962 Build nvmf-tcp-phy-autotest #72303 completed: SUCCESS 00:33:49.965 [Pipeline] } 00:33:50.014 [Pipeline] // retry 00:33:50.020 [Pipeline] } 00:35:44.162 Build dsa-phy-autotest #4872 completed: SUCCESS 00:35:44.166 [Pipeline] } 00:35:44.216 [Pipeline] // retry 00:35:44.222 [Pipeline] } 00:38:06.884 Build nvmf-tcp-uring-vg-autotest #77377 completed: SUCCESS 00:38:06.889 [Pipeline] } 00:38:06.942 [Pipeline] // retry 00:38:06.948 [Pipeline] } 00:40:28.577 Build nvmf-tcp-vg-autotest #77443 completed: SUCCESS 00:40:28.580 [Pipeline] } 00:40:28.632 [Pipeline] // retry 00:40:28.639 [Pipeline] } 00:41:22.075 Build centos7-vg-autotest #73631 completed: SUCCESS 00:41:22.079 [Pipeline] } 00:41:22.126 [Pipeline] // retry 00:41:22.133 [Pipeline] } 00:52:20.694 Build rocky9-vg-autotest #16062 completed: SUCCESS 00:52:20.696 [Pipeline] } 00:52:20.722 [Pipeline] // retry 00:52:20.727 [Pipeline] } 00:57:40.796 Build ubuntu20-vg-autotest #73771 completed: FAILURE 00:57:43.192 [Pipeline] echo 00:57:43.193 No retry patterns found. 00:57:43.194 [Pipeline] } 00:57:43.236 [Pipeline] // retry 00:57:43.243 [Pipeline] error 00:57:43.249 [Pipeline] } 00:57:43.254 Failed in branch ubuntu20-vg-autotest 00:59:28.046 Build ubuntu22-vg-autotest #37785 completed: SUCCESS 00:59:28.048 [Pipeline] } 00:59:28.088 [Pipeline] // retry 00:59:28.093 [Pipeline] } 00:59:28.295 [Pipeline] // parallel 00:59:28.304 [Pipeline] } 00:59:28.337 [Pipeline] // stage 00:59:28.346 [Pipeline] } 00:59:28.355 ERROR: Build nvme-vg-autotest #77452 failed 00:59:28.391 [Pipeline] // catchError 00:59:28.402 [Pipeline] stage 00:59:28.404 [Pipeline] { (Autorun Post and Coverage) 00:59:28.441 [Pipeline] setCustomBuildProperty 00:59:28.469 [Pipeline] dir 00:59:28.469 Running in /var/jenkins/workspace/autotest-per-patch_5/doc-docker-autotest_22300 00:59:28.471 [Pipeline] { 00:59:28.501 [Pipeline] copyArtifacts 00:59:28.778 Copied 6 artifacts from "doc-docker-autotest" build number 22300 00:59:28.783 [Pipeline] writeFile 00:59:28.806 [Pipeline] } 00:59:28.838 [Pipeline] // dir 00:59:28.854 [Pipeline] dir 00:59:28.855 Running in /var/jenkins/workspace/autotest-per-patch_5/check-format-docker-autotest_22120 00:59:28.856 [Pipeline] { 00:59:28.880 [Pipeline] copyArtifacts 00:59:28.942 Copied 5 artifacts from "check-format-docker-autotest" build number 22120 00:59:28.947 [Pipeline] writeFile 00:59:28.970 [Pipeline] } 00:59:29.003 [Pipeline] // dir 00:59:29.088 [Pipeline] dir 00:59:29.088 Running in /var/jenkins/workspace/autotest-per-patch_5/build-files-docker-autotest_22109 00:59:29.089 [Pipeline] { 00:59:29.112 [Pipeline] copyArtifacts 00:59:29.279 Copied 5 artifacts from "build-files-docker-autotest" build number 22109 00:59:29.283 [Pipeline] writeFile 00:59:29.335 [Pipeline] } 00:59:29.377 [Pipeline] // dir 00:59:29.440 [Pipeline] dir 00:59:29.441 Running in /var/jenkins/workspace/autotest-per-patch_5/check-so-deps-docker-autotest_22133 00:59:29.442 [Pipeline] { 00:59:29.466 [Pipeline] copyArtifacts 00:59:29.535 Copied 5 artifacts from "check-so-deps-docker-autotest" build number 22133 00:59:29.539 [Pipeline] writeFile 00:59:29.571 [Pipeline] } 00:59:29.606 [Pipeline] // dir 00:59:29.749 [Pipeline] dir 00:59:29.749 Running in /var/jenkins/workspace/autotest-per-patch_5/unittest-clang-docker-autotest_19837 00:59:29.750 [Pipeline] { 00:59:29.779 [Pipeline] copyArtifacts 00:59:29.851 Copied 5 artifacts from "unittest-clang-docker-autotest" build number 19837 00:59:29.854 [Pipeline] writeFile 00:59:29.950 [Pipeline] } 00:59:29.996 [Pipeline] // dir 00:59:30.365 [Pipeline] dir 00:59:30.365 Running in /var/jenkins/workspace/autotest-per-patch_5/packaging-docker-autotest_19839 00:59:30.366 [Pipeline] { 00:59:30.408 [Pipeline] copyArtifacts 00:59:30.472 Copied 5 artifacts from "packaging-docker-autotest" build number 19839 00:59:30.476 [Pipeline] writeFile 00:59:30.635 [Pipeline] } 00:59:30.712 [Pipeline] // dir 00:59:30.743 [Pipeline] dir 00:59:30.744 Running in /var/jenkins/workspace/autotest-per-patch_5/scan-build-docker-autotest_19840 00:59:30.745 [Pipeline] { 00:59:30.774 [Pipeline] copyArtifacts 00:59:30.868 Copied 9 artifacts from "scan-build-docker-autotest" build number 19840 00:59:30.872 [Pipeline] writeFile 00:59:30.897 [Pipeline] } 00:59:30.928 [Pipeline] // dir 00:59:31.071 [Pipeline] dir 00:59:31.071 Running in /var/jenkins/workspace/autotest-per-patch_5/unittest-main-docker-autotest_19838 00:59:31.072 [Pipeline] { 00:59:31.099 [Pipeline] copyArtifacts 00:59:31.499 Copied 6 artifacts from "unittest-main-docker-autotest" build number 19838 00:59:31.503 [Pipeline] writeFile 00:59:31.552 [Pipeline] } 00:59:31.605 [Pipeline] // dir 00:59:31.899 [Pipeline] dir 00:59:31.899 Running in /var/jenkins/workspace/autotest-per-patch_5/short-fuzz-phy-autotest_26169 00:59:31.900 [Pipeline] { 00:59:31.938 [Pipeline] copyArtifacts 00:59:32.031 Copied 10 artifacts from "short-fuzz-phy-autotest" build number 26169 00:59:32.035 [Pipeline] writeFile 00:59:32.198 [Pipeline] } 00:59:32.311 [Pipeline] // dir 00:59:32.635 [Pipeline] dir 00:59:32.636 Running in /var/jenkins/workspace/autotest-per-patch_5/unittest-valgrind-docker-autotest_19841 00:59:32.637 [Pipeline] { 00:59:32.674 [Pipeline] copyArtifacts 00:59:32.969 Copied 6 artifacts from "unittest-valgrind-docker-autotest" build number 19841 00:59:32.973 [Pipeline] writeFile 00:59:33.106 [Pipeline] } 00:59:33.189 [Pipeline] // dir 00:59:33.316 [Pipeline] dir 00:59:33.316 Running in /var/jenkins/workspace/autotest-per-patch_5/autobuild-external-vg-autotest_19800 00:59:33.317 [Pipeline] { 00:59:33.347 [Pipeline] copyArtifacts 00:59:33.448 Copied 8 artifacts from "autobuild-external-vg-autotest" build number 19800 00:59:33.452 [Pipeline] writeFile 00:59:33.508 [Pipeline] } 00:59:33.541 [Pipeline] // dir 00:59:33.909 [Pipeline] dir 00:59:33.909 Running in /var/jenkins/workspace/autotest-per-patch_5/vhost-phy-autotest_26197 00:59:33.911 [Pipeline] { 00:59:33.955 [Pipeline] copyArtifacts 00:59:34.202 Copied 12 artifacts from "vhost-phy-autotest" build number 26197 00:59:34.206 [Pipeline] writeFile 00:59:34.382 [Pipeline] } 00:59:34.467 [Pipeline] // dir 00:59:34.760 [Pipeline] dir 00:59:34.760 Running in /var/jenkins/workspace/autotest-per-patch_5/zns-vg-autotest_76558 00:59:34.761 [Pipeline] { 00:59:34.798 [Pipeline] copyArtifacts 00:59:34.989 Copied 12 artifacts from "zns-vg-autotest" build number 76558 00:59:34.993 [Pipeline] writeFile 00:59:35.139 [Pipeline] } 00:59:35.242 [Pipeline] // dir 00:59:35.520 [Pipeline] dir 00:59:35.521 Running in /var/jenkins/workspace/autotest-per-patch_5/BlobFS-phy-autotest_26178 00:59:35.522 [Pipeline] { 00:59:35.557 [Pipeline] copyArtifacts 00:59:35.974 Copied 28 artifacts from "BlobFS-phy-autotest" build number 26178 00:59:35.978 [Pipeline] writeFile 00:59:36.120 [Pipeline] } 00:59:36.210 [Pipeline] // dir 00:59:36.526 [Pipeline] dir 00:59:36.527 Running in /var/jenkins/workspace/autotest-per-patch_5/vhost-initiator-vg-autotest_77472 00:59:36.528 [Pipeline] { 00:59:36.565 [Pipeline] copyArtifacts 00:59:36.847 Copied 15 artifacts from "vhost-initiator-vg-autotest" build number 77472 00:59:36.852 [Pipeline] writeFile 00:59:36.994 [Pipeline] } 00:59:37.098 [Pipeline] // dir 00:59:37.594 [Pipeline] dir 00:59:37.595 Running in /var/jenkins/workspace/autotest-per-patch_5/vfio-user-phy-autotest_26180 00:59:37.596 [Pipeline] { 00:59:37.648 [Pipeline] copyArtifacts 00:59:37.863 Copied 12 artifacts from "vfio-user-phy-autotest" build number 26180 00:59:37.868 [Pipeline] writeFile 00:59:38.085 [Pipeline] } 00:59:38.226 [Pipeline] // dir 00:59:38.544 [Pipeline] dir 00:59:38.544 Running in /var/jenkins/workspace/autotest-per-patch_5/nvme-cmb-pmr-vg-autotest_78575 00:59:38.545 [Pipeline] { 00:59:38.578 [Pipeline] copyArtifacts 00:59:38.805 Copied 12 artifacts from "nvme-cmb-pmr-vg-autotest" build number 78575 00:59:38.809 [Pipeline] writeFile 00:59:38.970 [Pipeline] } 00:59:39.073 [Pipeline] // dir 00:59:39.709 [Pipeline] dir 00:59:39.709 Running in /var/jenkins/workspace/autotest-per-patch_5/nvme-phy-autotest_72344 00:59:39.710 [Pipeline] { 00:59:39.764 [Pipeline] copyArtifacts 00:59:40.013 Copied 12 artifacts from "nvme-phy-autotest" build number 72344 00:59:40.017 [Pipeline] writeFile 00:59:40.295 [Pipeline] } 00:59:40.461 [Pipeline] // dir 00:59:41.011 [Pipeline] dir 00:59:41.011 Running in /var/jenkins/workspace/autotest-per-patch_5/lvol-vg-autotest_77401 00:59:41.012 [Pipeline] { 00:59:41.063 [Pipeline] copyArtifacts 00:59:41.279 Copied 13 artifacts from "lvol-vg-autotest" build number 77401 00:59:41.282 [Pipeline] writeFile 00:59:41.543 [Pipeline] } 00:59:41.668 [Pipeline] // dir 00:59:43.710 [Pipeline] dir 00:59:43.710 Running in /var/jenkins/workspace/autotest-per-patch_5/iscsi-vg-autotest_77490 00:59:43.711 [Pipeline] { 00:59:43.911 [Pipeline] copyArtifacts 00:59:46.361 Copied 16 artifacts from "iscsi-vg-autotest" build number 77490 00:59:46.365 [Pipeline] writeFile 00:59:47.438 [Pipeline] } 00:59:47.881 [Pipeline] // dir 00:59:48.587 [Pipeline] dir 00:59:48.587 Running in /var/jenkins/workspace/autotest-per-patch_5/freebsd-vg-autotest_59100 00:59:48.588 [Pipeline] { 00:59:48.641 [Pipeline] copyArtifacts 00:59:48.753 Copied 7 artifacts from "freebsd-vg-autotest" build number 59100 00:59:48.756 [Pipeline] writeFile 00:59:49.027 [Pipeline] } 00:59:49.185 [Pipeline] // dir 00:59:49.577 [Pipeline] dir 00:59:49.577 Running in /var/jenkins/workspace/autotest-per-patch_5/nvme-vg-autotest_77452 00:59:49.578 [Pipeline] { 00:59:49.616 [Pipeline] copyArtifacts 00:59:49.848 Copied 11 artifacts from "nvme-vg-autotest" build number 77452 00:59:49.852 [Pipeline] writeFile 00:59:50.021 [Pipeline] } 00:59:50.145 [Pipeline] // dir 00:59:52.315 [Pipeline] dir 00:59:52.315 Running in /var/jenkins/workspace/autotest-per-patch_5/iscsi-uring-vg-autotest_77357 00:59:52.316 [Pipeline] { 00:59:52.527 [Pipeline] copyArtifacts 00:59:54.911 Copied 16 artifacts from "iscsi-uring-vg-autotest" build number 77357 00:59:54.916 [Pipeline] writeFile 00:59:56.045 [Pipeline] } 00:59:56.476 [Pipeline] // dir 00:59:57.238 [Pipeline] dir 00:59:57.239 Running in /var/jenkins/workspace/autotest-per-patch_5/nvmf-phy-autotest_72416 00:59:57.240 [Pipeline] { 00:59:57.338 [Pipeline] copyArtifacts 00:59:57.585 Copied 13 artifacts from "nvmf-phy-autotest" build number 72416 00:59:57.589 [Pipeline] writeFile 00:59:57.951 [Pipeline] } 00:59:58.116 [Pipeline] // dir 00:59:59.532 [Pipeline] dir 00:59:59.532 Running in /var/jenkins/workspace/autotest-per-patch_5/crypto-phy-autotest_26172 00:59:59.533 [Pipeline] { 00:59:59.628 [Pipeline] copyArtifacts 00:59:59.884 Copied 12 artifacts from "crypto-phy-autotest" build number 26172 00:59:59.904 [Pipeline] writeFile 01:00:00.535 [Pipeline] } 01:00:00.796 [Pipeline] // dir 01:00:02.312 [Pipeline] dir 01:00:02.313 Running in /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-phy-autotest_72303 01:00:02.314 [Pipeline] { 01:00:02.436 [Pipeline] copyArtifacts 01:00:02.667 Copied 13 artifacts from "nvmf-tcp-phy-autotest" build number 72303 01:00:02.671 [Pipeline] writeFile 01:00:03.405 [Pipeline] } 01:00:03.758 [Pipeline] // dir 01:00:04.545 [Pipeline] dir 01:00:04.545 Running in /var/jenkins/workspace/autotest-per-patch_5/dsa-phy-autotest_4872 01:00:04.546 [Pipeline] { 01:00:04.607 [Pipeline] copyArtifacts 01:00:04.854 Copied 13 artifacts from "dsa-phy-autotest" build number 4872 01:00:04.858 [Pipeline] writeFile 01:00:05.239 [Pipeline] } 01:00:05.503 [Pipeline] // dir 01:00:06.220 [Pipeline] dir 01:00:06.221 Running in /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-uring-vg-autotest_77377 01:00:06.221 [Pipeline] { 01:00:06.285 [Pipeline] copyArtifacts 01:00:06.464 Copied 13 artifacts from "nvmf-tcp-uring-vg-autotest" build number 77377 01:00:06.468 [Pipeline] writeFile 01:00:06.810 [Pipeline] } 01:00:07.020 [Pipeline] // dir 01:00:07.723 [Pipeline] dir 01:00:07.724 Running in /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-vg-autotest_77443 01:00:07.725 [Pipeline] { 01:00:07.795 [Pipeline] copyArtifacts 01:00:08.009 Copied 13 artifacts from "nvmf-tcp-vg-autotest" build number 77443 01:00:08.013 [Pipeline] writeFile 01:00:08.442 [Pipeline] } 01:00:08.711 [Pipeline] // dir 01:00:09.540 [Pipeline] dir 01:00:09.541 Running in /var/jenkins/workspace/autotest-per-patch_5/centos7-vg-autotest_73631 01:00:09.542 [Pipeline] { 01:00:09.611 [Pipeline] copyArtifacts 01:00:09.936 Copied 13 artifacts from "centos7-vg-autotest" build number 73631 01:00:09.940 [Pipeline] writeFile 01:00:10.257 [Pipeline] } 01:00:10.410 [Pipeline] // dir 01:00:11.730 [Pipeline] dir 01:00:11.731 Running in /var/jenkins/workspace/autotest-per-patch_5/rocky9-vg-autotest_16062 01:00:11.732 [Pipeline] { 01:00:11.816 [Pipeline] copyArtifacts 01:00:12.187 Copied 13 artifacts from "rocky9-vg-autotest" build number 16062 01:00:12.191 [Pipeline] writeFile 01:00:12.686 [Pipeline] } 01:00:12.951 [Pipeline] // dir 01:00:14.369 [Pipeline] dir 01:00:14.369 Running in /var/jenkins/workspace/autotest-per-patch_5/ubuntu20-vg-autotest_73771 01:00:14.370 [Pipeline] { 01:00:14.466 [Pipeline] copyArtifacts 01:00:15.194 Copied 12 artifacts from "ubuntu20-vg-autotest" build number 73771 01:00:15.198 [Pipeline] writeFile 01:00:15.696 [Pipeline] } 01:00:15.902 [Pipeline] // dir 01:00:17.082 [Pipeline] dir 01:00:17.082 Running in /var/jenkins/workspace/autotest-per-patch_5/ubuntu22-vg-autotest_37785 01:00:17.083 [Pipeline] { 01:00:17.162 [Pipeline] copyArtifacts 01:00:17.548 Copied 13 artifacts from "ubuntu22-vg-autotest" build number 37785 01:00:17.553 [Pipeline] writeFile 01:00:18.038 [Pipeline] } 01:00:18.260 [Pipeline] // dir 01:00:18.270 [Pipeline] catchError 01:00:18.272 [Pipeline] { 01:00:18.293 [Pipeline] sh 01:00:18.566 + jbp/jenkins/jjb-config/jobs/scripts/post_gen_coverage.sh 01:00:18.566 + shopt -s globstar nullglob 01:00:18.566 + echo 'Start stage post_gen_coverage.sh' 01:00:18.566 Start stage post_gen_coverage.sh 01:00:18.566 + cd /var/jenkins/workspace/autotest-per-patch_5 01:00:18.566 + rm -rf /var/jenkins/workspace/autotest-per-patch_5/spdk/doc 01:00:18.566 + trap 'compress_coverage_and_docs; remove_partial_coverage_files && echo '\''End stage post_gen_coverage.sh'\''' EXIT 01:00:18.566 + move_artifacts 01:00:18.566 + local out_dirs 01:00:18.566 + out_dirs=(./**/output/) 01:00:18.566 + for dir in "${out_dirs[@]}" 01:00:18.566 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.566 + [[ -f ./autobuild-external-vg-autotest_19800/output//doc.tar.xz ]] 01:00:18.566 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.566 + [[ -f ./autobuild-external-vg-autotest_19800/output//ut_coverage.tar.xz ]] 01:00:18.566 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.566 + [[ -f ./autobuild-external-vg-autotest_19800/output//llvm.tar.xz ]] 01:00:18.566 + mv ./autobuild-external-vg-autotest_19800/output//build-pkg-manifest.txt ./autobuild-external-vg-autotest_19800/output//build-repo-manifest.txt ./autobuild-external-vg-autotest_19800/output//dmesg.init.log ./autobuild-external-vg-autotest_19800/output//dmesg.log ./autobuild-external-vg-autotest_19800/output//power.tar.xz ./autobuild-external-vg-autotest_19800/output//test_completions.txt ./autobuild-external-vg-autotest_19800/output//timing.svg ./autobuild-external-vg-autotest_19800/output//timing.txt ./autobuild-external-vg-autotest_19800/output//.. 01:00:18.566 + rmdir ./autobuild-external-vg-autotest_19800/output/ 01:00:18.566 + for dir in "${out_dirs[@]}" 01:00:18.566 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.566 + [[ -f ./BlobFS-phy-autotest_26178/output//doc.tar.xz ]] 01:00:18.566 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.566 + [[ -f ./BlobFS-phy-autotest_26178/output//ut_coverage.tar.xz ]] 01:00:18.566 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.566 + [[ -f ./BlobFS-phy-autotest_26178/output//llvm.tar.xz ]] 01:00:18.566 + mv ./BlobFS-phy-autotest_26178/output//all_tests.txt ./BlobFS-phy-autotest_26178/output//build-pkg-manifest.txt ./BlobFS-phy-autotest_26178/output//build-repo-manifest.txt ./BlobFS-phy-autotest_26178/output//cov_base.info.xz ./BlobFS-phy-autotest_26178/output//cov_test.info.xz ./BlobFS-phy-autotest_26178/output//cov_total.info.xz ./BlobFS-phy-autotest_26178/output//dmesg.init.log ./BlobFS-phy-autotest_26178/output//dmesg.log ./BlobFS-phy-autotest_26178/output//power.tar.xz ./BlobFS-phy-autotest_26178/output//rocksdb ./BlobFS-phy-autotest_26178/output//test_completions.txt ./BlobFS-phy-autotest_26178/output//timing.svg ./BlobFS-phy-autotest_26178/output//timing.txt ./BlobFS-phy-autotest_26178/output//.. 01:00:18.566 + rmdir ./BlobFS-phy-autotest_26178/output/ 01:00:18.566 + for dir in "${out_dirs[@]}" 01:00:18.566 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.566 + [[ -f ./build-files-docker-autotest_22109/output//doc.tar.xz ]] 01:00:18.566 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.566 + [[ -f ./build-files-docker-autotest_22109/output//ut_coverage.tar.xz ]] 01:00:18.566 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.566 + [[ -f ./build-files-docker-autotest_22109/output//llvm.tar.xz ]] 01:00:18.566 + mv ./build-files-docker-autotest_22109/output//build-pkg-manifest.txt ./build-files-docker-autotest_22109/output//build-repo-manifest.txt ./build-files-docker-autotest_22109/output//power.tar.xz ./build-files-docker-autotest_22109/output//test_completions.txt ./build-files-docker-autotest_22109/output//timing.txt ./build-files-docker-autotest_22109/output//.. 01:00:18.566 + rmdir ./build-files-docker-autotest_22109/output/ 01:00:18.566 + for dir in "${out_dirs[@]}" 01:00:18.566 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.566 + [[ -f ./centos7-vg-autotest_73631/output//doc.tar.xz ]] 01:00:18.566 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.566 + [[ -f ./centos7-vg-autotest_73631/output//ut_coverage.tar.xz ]] 01:00:18.566 + tar -C ./centos7-vg-autotest_73631/output/ -xf ./centos7-vg-autotest_73631/output//ut_coverage.tar.xz 01:00:18.824 + rm ./centos7-vg-autotest_73631/output//ut_coverage.tar.xz 01:00:18.824 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.824 + [[ -f ./centos7-vg-autotest_73631/output//llvm.tar.xz ]] 01:00:18.824 + mv ./centos7-vg-autotest_73631/output//all_tests.txt ./centos7-vg-autotest_73631/output//build-pkg-manifest.txt ./centos7-vg-autotest_73631/output//build-repo-manifest.txt ./centos7-vg-autotest_73631/output//cov_base.info.xz ./centos7-vg-autotest_73631/output//cov_test.info.xz ./centos7-vg-autotest_73631/output//cov_total.info.xz ./centos7-vg-autotest_73631/output//dmesg.init.log ./centos7-vg-autotest_73631/output//dmesg.log ./centos7-vg-autotest_73631/output//power.tar.xz ./centos7-vg-autotest_73631/output//test_completions.txt ./centos7-vg-autotest_73631/output//timing.svg ./centos7-vg-autotest_73631/output//timing.txt ./centos7-vg-autotest_73631/output//ut_coverage ./centos7-vg-autotest_73631/output//.. 01:00:18.824 + rmdir ./centos7-vg-autotest_73631/output/ 01:00:18.824 + for dir in "${out_dirs[@]}" 01:00:18.824 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.824 + [[ -f ./check-format-docker-autotest_22120/output//doc.tar.xz ]] 01:00:18.824 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.824 + [[ -f ./check-format-docker-autotest_22120/output//ut_coverage.tar.xz ]] 01:00:18.824 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.824 + [[ -f ./check-format-docker-autotest_22120/output//llvm.tar.xz ]] 01:00:18.824 + mv ./check-format-docker-autotest_22120/output//build-pkg-manifest.txt ./check-format-docker-autotest_22120/output//build-repo-manifest.txt ./check-format-docker-autotest_22120/output//power.tar.xz ./check-format-docker-autotest_22120/output//test_completions.txt ./check-format-docker-autotest_22120/output//timing.txt ./check-format-docker-autotest_22120/output//.. 01:00:18.824 + rmdir ./check-format-docker-autotest_22120/output/ 01:00:18.824 + for dir in "${out_dirs[@]}" 01:00:18.824 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.824 + [[ -f ./check-so-deps-docker-autotest_22133/output//doc.tar.xz ]] 01:00:18.824 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.824 + [[ -f ./check-so-deps-docker-autotest_22133/output//ut_coverage.tar.xz ]] 01:00:18.824 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.824 + [[ -f ./check-so-deps-docker-autotest_22133/output//llvm.tar.xz ]] 01:00:18.824 + mv ./check-so-deps-docker-autotest_22133/output//build-pkg-manifest.txt ./check-so-deps-docker-autotest_22133/output//build-repo-manifest.txt ./check-so-deps-docker-autotest_22133/output//power.tar.xz ./check-so-deps-docker-autotest_22133/output//test_completions.txt ./check-so-deps-docker-autotest_22133/output//timing.txt ./check-so-deps-docker-autotest_22133/output//.. 01:00:18.824 + rmdir ./check-so-deps-docker-autotest_22133/output/ 01:00:18.824 + for dir in "${out_dirs[@]}" 01:00:18.824 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.824 + [[ -f ./crypto-phy-autotest_26172/output//doc.tar.xz ]] 01:00:18.824 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.824 + [[ -f ./crypto-phy-autotest_26172/output//ut_coverage.tar.xz ]] 01:00:18.824 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.824 + [[ -f ./crypto-phy-autotest_26172/output//llvm.tar.xz ]] 01:00:18.825 + mv ./crypto-phy-autotest_26172/output//all_tests.txt ./crypto-phy-autotest_26172/output//build-pkg-manifest.txt ./crypto-phy-autotest_26172/output//build-repo-manifest.txt ./crypto-phy-autotest_26172/output//cov_base.info.xz ./crypto-phy-autotest_26172/output//cov_test.info.xz ./crypto-phy-autotest_26172/output//cov_total.info.xz ./crypto-phy-autotest_26172/output//dmesg.init.log ./crypto-phy-autotest_26172/output//dmesg.log ./crypto-phy-autotest_26172/output//power.tar.xz ./crypto-phy-autotest_26172/output//test_completions.txt ./crypto-phy-autotest_26172/output//timing.svg ./crypto-phy-autotest_26172/output//timing.txt ./crypto-phy-autotest_26172/output//.. 01:00:18.825 + rmdir ./crypto-phy-autotest_26172/output/ 01:00:18.825 + for dir in "${out_dirs[@]}" 01:00:18.825 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.825 + [[ -f ./doc-docker-autotest_22300/output//doc.tar.xz ]] 01:00:18.825 + tar -C ./doc-docker-autotest_22300/output/ -xf ./doc-docker-autotest_22300/output//doc.tar.xz 01:00:18.825 + rm ./doc-docker-autotest_22300/output//doc.tar.xz 01:00:18.825 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.825 + [[ -f ./doc-docker-autotest_22300/output//ut_coverage.tar.xz ]] 01:00:18.825 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.825 + [[ -f ./doc-docker-autotest_22300/output//llvm.tar.xz ]] 01:00:18.825 + mv ./doc-docker-autotest_22300/output//build-pkg-manifest.txt ./doc-docker-autotest_22300/output//build-repo-manifest.txt ./doc-docker-autotest_22300/output//doc ./doc-docker-autotest_22300/output//power.tar.xz ./doc-docker-autotest_22300/output//test_completions.txt ./doc-docker-autotest_22300/output//timing.txt ./doc-docker-autotest_22300/output//.. 01:00:18.825 + rmdir ./doc-docker-autotest_22300/output/ 01:00:18.825 + for dir in "${out_dirs[@]}" 01:00:18.825 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.825 + [[ -f ./dsa-phy-autotest_4872/output//doc.tar.xz ]] 01:00:18.825 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.825 + [[ -f ./dsa-phy-autotest_4872/output//ut_coverage.tar.xz ]] 01:00:18.825 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.825 + [[ -f ./dsa-phy-autotest_4872/output//llvm.tar.xz ]] 01:00:18.825 + mv ./dsa-phy-autotest_4872/output//all_tests.txt ./dsa-phy-autotest_4872/output//build-pkg-manifest.txt ./dsa-phy-autotest_4872/output//build-repo-manifest.txt ./dsa-phy-autotest_4872/output//cov_base.info.xz ./dsa-phy-autotest_4872/output//cov_test.info.xz ./dsa-phy-autotest_4872/output//cov_total.info.xz ./dsa-phy-autotest_4872/output//dmesg.init.log ./dsa-phy-autotest_4872/output//dmesg.log ./dsa-phy-autotest_4872/output//nvmf_trace.0_shm.tar.gz ./dsa-phy-autotest_4872/output//power.tar.xz ./dsa-phy-autotest_4872/output//test_completions.txt ./dsa-phy-autotest_4872/output//timing.svg ./dsa-phy-autotest_4872/output//timing.txt ./dsa-phy-autotest_4872/output//.. 01:00:18.825 + rmdir ./dsa-phy-autotest_4872/output/ 01:00:18.825 + for dir in "${out_dirs[@]}" 01:00:18.825 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.825 + [[ -f ./freebsd-vg-autotest_59100/output//doc.tar.xz ]] 01:00:18.825 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.825 + [[ -f ./freebsd-vg-autotest_59100/output//ut_coverage.tar.xz ]] 01:00:18.825 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.825 + [[ -f ./freebsd-vg-autotest_59100/output//llvm.tar.xz ]] 01:00:18.825 + mv ./freebsd-vg-autotest_59100/output//all_tests.txt ./freebsd-vg-autotest_59100/output//build-pkg-manifest.txt ./freebsd-vg-autotest_59100/output//build-repo-manifest.txt ./freebsd-vg-autotest_59100/output//messages ./freebsd-vg-autotest_59100/output//power.tar.xz ./freebsd-vg-autotest_59100/output//test_completions.txt ./freebsd-vg-autotest_59100/output//timing.txt ./freebsd-vg-autotest_59100/output//.. 01:00:18.825 + rmdir ./freebsd-vg-autotest_59100/output/ 01:00:18.825 + for dir in "${out_dirs[@]}" 01:00:18.825 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.825 + [[ -f ./iscsi-uring-vg-autotest_77357/output//doc.tar.xz ]] 01:00:18.825 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.825 + [[ -f ./iscsi-uring-vg-autotest_77357/output//ut_coverage.tar.xz ]] 01:00:18.825 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.825 + [[ -f ./iscsi-uring-vg-autotest_77357/output//llvm.tar.xz ]] 01:00:18.825 + mv ./iscsi-uring-vg-autotest_77357/output//all_tests.txt ./iscsi-uring-vg-autotest_77357/output//build-pkg-manifest.txt ./iscsi-uring-vg-autotest_77357/output//build-repo-manifest.txt ./iscsi-uring-vg-autotest_77357/output//calsoft.json ./iscsi-uring-vg-autotest_77357/output//calsoft.tar.xz ./iscsi-uring-vg-autotest_77357/output//cov_base.info.xz ./iscsi-uring-vg-autotest_77357/output//cov_test.info.xz ./iscsi-uring-vg-autotest_77357/output//cov_total.info.xz ./iscsi-uring-vg-autotest_77357/output//dmesg.init.log ./iscsi-uring-vg-autotest_77357/output//dmesg.log ./iscsi-uring-vg-autotest_77357/output//iscsi_autofuzz_logs.txt ./iscsi-uring-vg-autotest_77357/output//iscsi_autofuzz_tgt_output.txt ./iscsi-uring-vg-autotest_77357/output//power.tar.xz ./iscsi-uring-vg-autotest_77357/output//test_completions.txt ./iscsi-uring-vg-autotest_77357/output//timing.svg ./iscsi-uring-vg-autotest_77357/output//timing.txt ./iscsi-uring-vg-autotest_77357/output//.. 01:00:18.825 + rmdir ./iscsi-uring-vg-autotest_77357/output/ 01:00:18.825 + for dir in "${out_dirs[@]}" 01:00:18.825 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.825 + [[ -f ./iscsi-vg-autotest_77490/output//doc.tar.xz ]] 01:00:18.825 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.825 + [[ -f ./iscsi-vg-autotest_77490/output//ut_coverage.tar.xz ]] 01:00:18.825 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.825 + [[ -f ./iscsi-vg-autotest_77490/output//llvm.tar.xz ]] 01:00:18.825 + mv ./iscsi-vg-autotest_77490/output//all_tests.txt ./iscsi-vg-autotest_77490/output//build-pkg-manifest.txt ./iscsi-vg-autotest_77490/output//build-repo-manifest.txt ./iscsi-vg-autotest_77490/output//calsoft.json ./iscsi-vg-autotest_77490/output//calsoft.tar.xz ./iscsi-vg-autotest_77490/output//cov_base.info.xz ./iscsi-vg-autotest_77490/output//cov_test.info.xz ./iscsi-vg-autotest_77490/output//cov_total.info.xz ./iscsi-vg-autotest_77490/output//dmesg.init.log ./iscsi-vg-autotest_77490/output//dmesg.log ./iscsi-vg-autotest_77490/output//iscsi_autofuzz_logs.txt ./iscsi-vg-autotest_77490/output//iscsi_autofuzz_tgt_output.txt ./iscsi-vg-autotest_77490/output//power.tar.xz ./iscsi-vg-autotest_77490/output//test_completions.txt ./iscsi-vg-autotest_77490/output//timing.svg ./iscsi-vg-autotest_77490/output//timing.txt ./iscsi-vg-autotest_77490/output//.. 01:00:18.825 + rmdir ./iscsi-vg-autotest_77490/output/ 01:00:18.825 + for dir in "${out_dirs[@]}" 01:00:18.825 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.825 + [[ -f ./lvol-vg-autotest_77401/output//doc.tar.xz ]] 01:00:18.825 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.825 + [[ -f ./lvol-vg-autotest_77401/output//ut_coverage.tar.xz ]] 01:00:18.825 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:18.825 + [[ -f ./lvol-vg-autotest_77401/output//llvm.tar.xz ]] 01:00:18.825 + mv ./lvol-vg-autotest_77401/output//all_tests.txt ./lvol-vg-autotest_77401/output//build-kernel-manifest.txt ./lvol-vg-autotest_77401/output//build-pkg-manifest.txt ./lvol-vg-autotest_77401/output//build-repo-manifest.txt ./lvol-vg-autotest_77401/output//cov_base.info.xz ./lvol-vg-autotest_77401/output//cov_test.info.xz ./lvol-vg-autotest_77401/output//cov_total.info.xz ./lvol-vg-autotest_77401/output//dmesg.init.log ./lvol-vg-autotest_77401/output//dmesg.log ./lvol-vg-autotest_77401/output//power.tar.xz ./lvol-vg-autotest_77401/output//test_completions.txt ./lvol-vg-autotest_77401/output//timing.svg ./lvol-vg-autotest_77401/output//timing.txt ./lvol-vg-autotest_77401/output//.. 01:00:19.083 + rmdir ./lvol-vg-autotest_77401/output/ 01:00:19.083 + for dir in "${out_dirs[@]}" 01:00:19.083 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.083 + [[ -f ./nvme-cmb-pmr-vg-autotest_78575/output//doc.tar.xz ]] 01:00:19.083 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.083 + [[ -f ./nvme-cmb-pmr-vg-autotest_78575/output//ut_coverage.tar.xz ]] 01:00:19.083 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.083 + [[ -f ./nvme-cmb-pmr-vg-autotest_78575/output//llvm.tar.xz ]] 01:00:19.083 + mv ./nvme-cmb-pmr-vg-autotest_78575/output//all_tests.txt ./nvme-cmb-pmr-vg-autotest_78575/output//build-pkg-manifest.txt ./nvme-cmb-pmr-vg-autotest_78575/output//build-repo-manifest.txt ./nvme-cmb-pmr-vg-autotest_78575/output//cov_base.info.xz ./nvme-cmb-pmr-vg-autotest_78575/output//cov_test.info.xz ./nvme-cmb-pmr-vg-autotest_78575/output//cov_total.info.xz ./nvme-cmb-pmr-vg-autotest_78575/output//dmesg.init.log ./nvme-cmb-pmr-vg-autotest_78575/output//dmesg.log ./nvme-cmb-pmr-vg-autotest_78575/output//power.tar.xz ./nvme-cmb-pmr-vg-autotest_78575/output//test_completions.txt ./nvme-cmb-pmr-vg-autotest_78575/output//timing.svg ./nvme-cmb-pmr-vg-autotest_78575/output//timing.txt ./nvme-cmb-pmr-vg-autotest_78575/output//.. 01:00:19.083 + rmdir ./nvme-cmb-pmr-vg-autotest_78575/output/ 01:00:19.083 + for dir in "${out_dirs[@]}" 01:00:19.083 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.083 + [[ -f ./nvme-phy-autotest_72344/output//doc.tar.xz ]] 01:00:19.083 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.084 + [[ -f ./nvme-phy-autotest_72344/output//ut_coverage.tar.xz ]] 01:00:19.084 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.084 + [[ -f ./nvme-phy-autotest_72344/output//llvm.tar.xz ]] 01:00:19.084 + mv ./nvme-phy-autotest_72344/output//all_tests.txt ./nvme-phy-autotest_72344/output//build-pkg-manifest.txt ./nvme-phy-autotest_72344/output//build-repo-manifest.txt ./nvme-phy-autotest_72344/output//cov_base.info.xz ./nvme-phy-autotest_72344/output//cov_test.info.xz ./nvme-phy-autotest_72344/output//cov_total.info.xz ./nvme-phy-autotest_72344/output//dmesg.init.log ./nvme-phy-autotest_72344/output//dmesg.log ./nvme-phy-autotest_72344/output//power.tar.xz ./nvme-phy-autotest_72344/output//test_completions.txt ./nvme-phy-autotest_72344/output//timing.svg ./nvme-phy-autotest_72344/output//timing.txt ./nvme-phy-autotest_72344/output//.. 01:00:19.084 + rmdir ./nvme-phy-autotest_72344/output/ 01:00:19.084 + for dir in "${out_dirs[@]}" 01:00:19.084 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.084 + [[ -f ./nvme-vg-autotest_77452/output//doc.tar.xz ]] 01:00:19.084 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.084 + [[ -f ./nvme-vg-autotest_77452/output//ut_coverage.tar.xz ]] 01:00:19.084 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.084 + [[ -f ./nvme-vg-autotest_77452/output//llvm.tar.xz ]] 01:00:19.084 + mv ./nvme-vg-autotest_77452/output//all_tests.txt ./nvme-vg-autotest_77452/output//build-pkg-manifest.txt ./nvme-vg-autotest_77452/output//build-repo-manifest.txt ./nvme-vg-autotest_77452/output//cov_base.info.xz ./nvme-vg-autotest_77452/output//dmesg.init.log ./nvme-vg-autotest_77452/output//dmesg.log ./nvme-vg-autotest_77452/output//power.tar.xz ./nvme-vg-autotest_77452/output//proc_list.txt ./nvme-vg-autotest_77452/output//test_completions.txt ./nvme-vg-autotest_77452/output//timing.txt ./nvme-vg-autotest_77452/output//udev.log ./nvme-vg-autotest_77452/output//.. 01:00:19.084 + rmdir ./nvme-vg-autotest_77452/output/ 01:00:19.084 + for dir in "${out_dirs[@]}" 01:00:19.084 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.084 + [[ -f ./nvmf-phy-autotest_72416/output//doc.tar.xz ]] 01:00:19.084 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.084 + [[ -f ./nvmf-phy-autotest_72416/output//ut_coverage.tar.xz ]] 01:00:19.084 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.084 + [[ -f ./nvmf-phy-autotest_72416/output//llvm.tar.xz ]] 01:00:19.084 + mv ./nvmf-phy-autotest_72416/output//all_tests.txt ./nvmf-phy-autotest_72416/output//build-pkg-manifest.txt ./nvmf-phy-autotest_72416/output//build-repo-manifest.txt ./nvmf-phy-autotest_72416/output//cov_base.info.xz ./nvmf-phy-autotest_72416/output//cov_test.info.xz ./nvmf-phy-autotest_72416/output//cov_total.info.xz ./nvmf-phy-autotest_72416/output//dmesg.init.log ./nvmf-phy-autotest_72416/output//dmesg.log ./nvmf-phy-autotest_72416/output//nvmf_trace.0_shm.tar.gz ./nvmf-phy-autotest_72416/output//power.tar.xz ./nvmf-phy-autotest_72416/output//test_completions.txt ./nvmf-phy-autotest_72416/output//timing.svg ./nvmf-phy-autotest_72416/output//timing.txt ./nvmf-phy-autotest_72416/output//.. 01:00:19.084 + rmdir ./nvmf-phy-autotest_72416/output/ 01:00:19.084 + for dir in "${out_dirs[@]}" 01:00:19.084 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.084 + [[ -f ./nvmf-tcp-phy-autotest_72303/output//doc.tar.xz ]] 01:00:19.084 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.084 + [[ -f ./nvmf-tcp-phy-autotest_72303/output//ut_coverage.tar.xz ]] 01:00:19.084 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.084 + [[ -f ./nvmf-tcp-phy-autotest_72303/output//llvm.tar.xz ]] 01:00:19.084 + mv ./nvmf-tcp-phy-autotest_72303/output//all_tests.txt ./nvmf-tcp-phy-autotest_72303/output//build-pkg-manifest.txt ./nvmf-tcp-phy-autotest_72303/output//build-repo-manifest.txt ./nvmf-tcp-phy-autotest_72303/output//cov_base.info.xz ./nvmf-tcp-phy-autotest_72303/output//cov_test.info.xz ./nvmf-tcp-phy-autotest_72303/output//cov_total.info.xz ./nvmf-tcp-phy-autotest_72303/output//dmesg.init.log ./nvmf-tcp-phy-autotest_72303/output//dmesg.log ./nvmf-tcp-phy-autotest_72303/output//nvmf_trace.0_shm.tar.gz ./nvmf-tcp-phy-autotest_72303/output//power.tar.xz ./nvmf-tcp-phy-autotest_72303/output//test_completions.txt ./nvmf-tcp-phy-autotest_72303/output//timing.svg ./nvmf-tcp-phy-autotest_72303/output//timing.txt ./nvmf-tcp-phy-autotest_72303/output//.. 01:00:19.084 + rmdir ./nvmf-tcp-phy-autotest_72303/output/ 01:00:19.084 + for dir in "${out_dirs[@]}" 01:00:19.084 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.084 + [[ -f ./nvmf-tcp-uring-vg-autotest_77377/output//doc.tar.xz ]] 01:00:19.084 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.084 + [[ -f ./nvmf-tcp-uring-vg-autotest_77377/output//ut_coverage.tar.xz ]] 01:00:19.084 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.084 + [[ -f ./nvmf-tcp-uring-vg-autotest_77377/output//llvm.tar.xz ]] 01:00:19.084 + mv ./nvmf-tcp-uring-vg-autotest_77377/output//all_tests.txt ./nvmf-tcp-uring-vg-autotest_77377/output//build-pkg-manifest.txt ./nvmf-tcp-uring-vg-autotest_77377/output//build-repo-manifest.txt ./nvmf-tcp-uring-vg-autotest_77377/output//cov_base.info.xz ./nvmf-tcp-uring-vg-autotest_77377/output//cov_test.info.xz ./nvmf-tcp-uring-vg-autotest_77377/output//cov_total.info.xz ./nvmf-tcp-uring-vg-autotest_77377/output//dmesg.init.log ./nvmf-tcp-uring-vg-autotest_77377/output//dmesg.log ./nvmf-tcp-uring-vg-autotest_77377/output//nvmf_trace.0_shm.tar.gz ./nvmf-tcp-uring-vg-autotest_77377/output//power.tar.xz ./nvmf-tcp-uring-vg-autotest_77377/output//test_completions.txt ./nvmf-tcp-uring-vg-autotest_77377/output//timing.svg ./nvmf-tcp-uring-vg-autotest_77377/output//timing.txt ./nvmf-tcp-uring-vg-autotest_77377/output//.. 01:00:19.084 + rmdir ./nvmf-tcp-uring-vg-autotest_77377/output/ 01:00:19.084 + for dir in "${out_dirs[@]}" 01:00:19.084 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.084 + [[ -f ./nvmf-tcp-vg-autotest_77443/output//doc.tar.xz ]] 01:00:19.084 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.084 + [[ -f ./nvmf-tcp-vg-autotest_77443/output//ut_coverage.tar.xz ]] 01:00:19.084 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.084 + [[ -f ./nvmf-tcp-vg-autotest_77443/output//llvm.tar.xz ]] 01:00:19.084 + mv ./nvmf-tcp-vg-autotest_77443/output//all_tests.txt ./nvmf-tcp-vg-autotest_77443/output//build-pkg-manifest.txt ./nvmf-tcp-vg-autotest_77443/output//build-repo-manifest.txt ./nvmf-tcp-vg-autotest_77443/output//cov_base.info.xz ./nvmf-tcp-vg-autotest_77443/output//cov_test.info.xz ./nvmf-tcp-vg-autotest_77443/output//cov_total.info.xz ./nvmf-tcp-vg-autotest_77443/output//dmesg.init.log ./nvmf-tcp-vg-autotest_77443/output//dmesg.log ./nvmf-tcp-vg-autotest_77443/output//nvmf_trace.0_shm.tar.gz ./nvmf-tcp-vg-autotest_77443/output//power.tar.xz ./nvmf-tcp-vg-autotest_77443/output//test_completions.txt ./nvmf-tcp-vg-autotest_77443/output//timing.svg ./nvmf-tcp-vg-autotest_77443/output//timing.txt ./nvmf-tcp-vg-autotest_77443/output//.. 01:00:19.084 + rmdir ./nvmf-tcp-vg-autotest_77443/output/ 01:00:19.084 + for dir in "${out_dirs[@]}" 01:00:19.084 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.084 + [[ -f ./packaging-docker-autotest_19839/output//doc.tar.xz ]] 01:00:19.084 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.084 + [[ -f ./packaging-docker-autotest_19839/output//ut_coverage.tar.xz ]] 01:00:19.084 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.084 + [[ -f ./packaging-docker-autotest_19839/output//llvm.tar.xz ]] 01:00:19.084 + mv ./packaging-docker-autotest_19839/output//build-pkg-manifest.txt ./packaging-docker-autotest_19839/output//build-repo-manifest.txt ./packaging-docker-autotest_19839/output//power.tar.xz ./packaging-docker-autotest_19839/output//test_completions.txt ./packaging-docker-autotest_19839/output//timing.txt ./packaging-docker-autotest_19839/output//.. 01:00:19.084 + rmdir ./packaging-docker-autotest_19839/output/ 01:00:19.084 + for dir in "${out_dirs[@]}" 01:00:19.084 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.084 + [[ -f ./rocky9-vg-autotest_16062/output//doc.tar.xz ]] 01:00:19.084 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.084 + [[ -f ./rocky9-vg-autotest_16062/output//ut_coverage.tar.xz ]] 01:00:19.084 + tar -C ./rocky9-vg-autotest_16062/output/ -xf ./rocky9-vg-autotest_16062/output//ut_coverage.tar.xz 01:00:19.084 + rm ./rocky9-vg-autotest_16062/output//ut_coverage.tar.xz 01:00:19.084 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.084 + [[ -f ./rocky9-vg-autotest_16062/output//llvm.tar.xz ]] 01:00:19.084 + mv ./rocky9-vg-autotest_16062/output//all_tests.txt ./rocky9-vg-autotest_16062/output//build-pkg-manifest.txt ./rocky9-vg-autotest_16062/output//build-repo-manifest.txt ./rocky9-vg-autotest_16062/output//cov_base.info.xz ./rocky9-vg-autotest_16062/output//cov_test.info.xz ./rocky9-vg-autotest_16062/output//cov_total.info.xz ./rocky9-vg-autotest_16062/output//dmesg.init.log ./rocky9-vg-autotest_16062/output//dmesg.log ./rocky9-vg-autotest_16062/output//power.tar.xz ./rocky9-vg-autotest_16062/output//test_completions.txt ./rocky9-vg-autotest_16062/output//timing.svg ./rocky9-vg-autotest_16062/output//timing.txt ./rocky9-vg-autotest_16062/output//ut_coverage ./rocky9-vg-autotest_16062/output//.. 01:00:19.084 + rmdir ./rocky9-vg-autotest_16062/output/ 01:00:19.084 + for dir in "${out_dirs[@]}" 01:00:19.084 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.084 + [[ -f ./scan-build-docker-autotest_19840/output//doc.tar.xz ]] 01:00:19.084 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.084 + [[ -f ./scan-build-docker-autotest_19840/output//ut_coverage.tar.xz ]] 01:00:19.084 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.084 + [[ -f ./scan-build-docker-autotest_19840/output//llvm.tar.xz ]] 01:00:19.084 + mv ./scan-build-docker-autotest_19840/output//all_c_files.txt ./scan-build-docker-autotest_19840/output//build_output.txt ./scan-build-docker-autotest_19840/output//build-pkg-manifest.txt ./scan-build-docker-autotest_19840/output//build-repo-manifest.txt ./scan-build-docker-autotest_19840/output//built_c_files.txt ./scan-build-docker-autotest_19840/output//power.tar.xz ./scan-build-docker-autotest_19840/output//test_completions.txt ./scan-build-docker-autotest_19840/output//timing.txt ./scan-build-docker-autotest_19840/output//unbuilt_c_files.txt ./scan-build-docker-autotest_19840/output//.. 01:00:19.084 + rmdir ./scan-build-docker-autotest_19840/output/ 01:00:19.084 + for dir in "${out_dirs[@]}" 01:00:19.084 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.084 + [[ -f ./short-fuzz-phy-autotest_26169/output//doc.tar.xz ]] 01:00:19.084 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.084 + [[ -f ./short-fuzz-phy-autotest_26169/output//ut_coverage.tar.xz ]] 01:00:19.084 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.084 + [[ -f ./short-fuzz-phy-autotest_26169/output//llvm.tar.xz ]] 01:00:19.084 + tar -C ./short-fuzz-phy-autotest_26169/output/ -xf ./short-fuzz-phy-autotest_26169/output//llvm.tar.xz 01:00:19.084 + rm ./short-fuzz-phy-autotest_26169/output//llvm.tar.xz 01:00:19.084 + mv ./short-fuzz-phy-autotest_26169/output//all_tests.txt ./short-fuzz-phy-autotest_26169/output//build-pkg-manifest.txt ./short-fuzz-phy-autotest_26169/output//build-repo-manifest.txt ./short-fuzz-phy-autotest_26169/output//dmesg.init.log ./short-fuzz-phy-autotest_26169/output//dmesg.log ./short-fuzz-phy-autotest_26169/output//llvm ./short-fuzz-phy-autotest_26169/output//power.tar.xz ./short-fuzz-phy-autotest_26169/output//test_completions.txt ./short-fuzz-phy-autotest_26169/output//timing.svg ./short-fuzz-phy-autotest_26169/output//timing.txt ./short-fuzz-phy-autotest_26169/output//.. 01:00:19.084 + rmdir ./short-fuzz-phy-autotest_26169/output/ 01:00:19.084 + for dir in "${out_dirs[@]}" 01:00:19.084 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.084 + [[ -f ./ubuntu20-vg-autotest_73771/output//doc.tar.xz ]] 01:00:19.084 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.084 + [[ -f ./ubuntu20-vg-autotest_73771/output//ut_coverage.tar.xz ]] 01:00:19.084 + tar -C ./ubuntu20-vg-autotest_73771/output/ -xf ./ubuntu20-vg-autotest_73771/output//ut_coverage.tar.xz 01:00:19.343 + rm ./ubuntu20-vg-autotest_73771/output//ut_coverage.tar.xz 01:00:19.343 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.343 + [[ -f ./ubuntu20-vg-autotest_73771/output//llvm.tar.xz ]] 01:00:19.343 + mv ./ubuntu20-vg-autotest_73771/output//all_tests.txt ./ubuntu20-vg-autotest_73771/output//build-pkg-manifest.txt ./ubuntu20-vg-autotest_73771/output//build-repo-manifest.txt ./ubuntu20-vg-autotest_73771/output//cov_base.info.xz ./ubuntu20-vg-autotest_73771/output//dmesg.init.log ./ubuntu20-vg-autotest_73771/output//dmesg.log ./ubuntu20-vg-autotest_73771/output//power.tar.xz ./ubuntu20-vg-autotest_73771/output//proc_list.txt ./ubuntu20-vg-autotest_73771/output//test_completions.txt ./ubuntu20-vg-autotest_73771/output//timing.txt ./ubuntu20-vg-autotest_73771/output//udev.log ./ubuntu20-vg-autotest_73771/output//ut_coverage ./ubuntu20-vg-autotest_73771/output//.. 01:00:19.343 + rmdir ./ubuntu20-vg-autotest_73771/output/ 01:00:19.343 + for dir in "${out_dirs[@]}" 01:00:19.343 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.343 + [[ -f ./ubuntu22-vg-autotest_37785/output//doc.tar.xz ]] 01:00:19.343 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.343 + [[ -f ./ubuntu22-vg-autotest_37785/output//ut_coverage.tar.xz ]] 01:00:19.343 + tar -C ./ubuntu22-vg-autotest_37785/output/ -xf ./ubuntu22-vg-autotest_37785/output//ut_coverage.tar.xz 01:00:19.601 + rm ./ubuntu22-vg-autotest_37785/output//ut_coverage.tar.xz 01:00:19.601 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.601 + [[ -f ./ubuntu22-vg-autotest_37785/output//llvm.tar.xz ]] 01:00:19.601 + mv ./ubuntu22-vg-autotest_37785/output//all_tests.txt ./ubuntu22-vg-autotest_37785/output//build-pkg-manifest.txt ./ubuntu22-vg-autotest_37785/output//build-repo-manifest.txt ./ubuntu22-vg-autotest_37785/output//cov_base.info.xz ./ubuntu22-vg-autotest_37785/output//cov_test.info.xz ./ubuntu22-vg-autotest_37785/output//cov_total.info.xz ./ubuntu22-vg-autotest_37785/output//dmesg.init.log ./ubuntu22-vg-autotest_37785/output//dmesg.log ./ubuntu22-vg-autotest_37785/output//power.tar.xz ./ubuntu22-vg-autotest_37785/output//test_completions.txt ./ubuntu22-vg-autotest_37785/output//timing.svg ./ubuntu22-vg-autotest_37785/output//timing.txt ./ubuntu22-vg-autotest_37785/output//ut_coverage ./ubuntu22-vg-autotest_37785/output//.. 01:00:19.601 + rmdir ./ubuntu22-vg-autotest_37785/output/ 01:00:19.601 + for dir in "${out_dirs[@]}" 01:00:19.601 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.601 + [[ -f ./unittest-clang-docker-autotest_19837/output//doc.tar.xz ]] 01:00:19.601 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.601 + [[ -f ./unittest-clang-docker-autotest_19837/output//ut_coverage.tar.xz ]] 01:00:19.601 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.601 + [[ -f ./unittest-clang-docker-autotest_19837/output//llvm.tar.xz ]] 01:00:19.601 + mv ./unittest-clang-docker-autotest_19837/output//build-pkg-manifest.txt ./unittest-clang-docker-autotest_19837/output//build-repo-manifest.txt ./unittest-clang-docker-autotest_19837/output//power.tar.xz ./unittest-clang-docker-autotest_19837/output//test_completions.txt ./unittest-clang-docker-autotest_19837/output//timing.txt ./unittest-clang-docker-autotest_19837/output//.. 01:00:19.601 + rmdir ./unittest-clang-docker-autotest_19837/output/ 01:00:19.601 + for dir in "${out_dirs[@]}" 01:00:19.601 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.601 + [[ -f ./unittest-main-docker-autotest_19838/output//doc.tar.xz ]] 01:00:19.601 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.601 + [[ -f ./unittest-main-docker-autotest_19838/output//ut_coverage.tar.xz ]] 01:00:19.601 + tar -C ./unittest-main-docker-autotest_19838/output/ -xf ./unittest-main-docker-autotest_19838/output//ut_coverage.tar.xz 01:00:19.858 + rm ./unittest-main-docker-autotest_19838/output//ut_coverage.tar.xz 01:00:19.858 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.858 + [[ -f ./unittest-main-docker-autotest_19838/output//llvm.tar.xz ]] 01:00:19.858 + mv ./unittest-main-docker-autotest_19838/output//build-pkg-manifest.txt ./unittest-main-docker-autotest_19838/output//build-repo-manifest.txt ./unittest-main-docker-autotest_19838/output//power.tar.xz ./unittest-main-docker-autotest_19838/output//test_completions.txt ./unittest-main-docker-autotest_19838/output//timing.txt ./unittest-main-docker-autotest_19838/output//ut_coverage ./unittest-main-docker-autotest_19838/output//.. 01:00:19.858 + rmdir ./unittest-main-docker-autotest_19838/output/ 01:00:19.858 + for dir in "${out_dirs[@]}" 01:00:19.858 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.858 + [[ -f ./unittest-valgrind-docker-autotest_19841/output//doc.tar.xz ]] 01:00:19.858 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:19.858 + [[ -f ./unittest-valgrind-docker-autotest_19841/output//ut_coverage.tar.xz ]] 01:00:19.858 + tar -C ./unittest-valgrind-docker-autotest_19841/output/ -xf ./unittest-valgrind-docker-autotest_19841/output//ut_coverage.tar.xz 01:00:20.116 + rm ./unittest-valgrind-docker-autotest_19841/output//ut_coverage.tar.xz 01:00:20.116 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:20.116 + [[ -f ./unittest-valgrind-docker-autotest_19841/output//llvm.tar.xz ]] 01:00:20.116 + mv ./unittest-valgrind-docker-autotest_19841/output//build-pkg-manifest.txt ./unittest-valgrind-docker-autotest_19841/output//build-repo-manifest.txt ./unittest-valgrind-docker-autotest_19841/output//power.tar.xz ./unittest-valgrind-docker-autotest_19841/output//test_completions.txt ./unittest-valgrind-docker-autotest_19841/output//timing.txt ./unittest-valgrind-docker-autotest_19841/output//ut_coverage ./unittest-valgrind-docker-autotest_19841/output//.. 01:00:20.116 + rmdir ./unittest-valgrind-docker-autotest_19841/output/ 01:00:20.116 + for dir in "${out_dirs[@]}" 01:00:20.116 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:20.116 + [[ -f ./vfio-user-phy-autotest_26180/output//doc.tar.xz ]] 01:00:20.116 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:20.116 + [[ -f ./vfio-user-phy-autotest_26180/output//ut_coverage.tar.xz ]] 01:00:20.116 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:20.116 + [[ -f ./vfio-user-phy-autotest_26180/output//llvm.tar.xz ]] 01:00:20.116 + mv ./vfio-user-phy-autotest_26180/output//all_tests.txt ./vfio-user-phy-autotest_26180/output//build-pkg-manifest.txt ./vfio-user-phy-autotest_26180/output//build-repo-manifest.txt ./vfio-user-phy-autotest_26180/output//cov_base.info.xz ./vfio-user-phy-autotest_26180/output//cov_test.info.xz ./vfio-user-phy-autotest_26180/output//cov_total.info.xz ./vfio-user-phy-autotest_26180/output//dmesg.init.log ./vfio-user-phy-autotest_26180/output//dmesg.log ./vfio-user-phy-autotest_26180/output//power.tar.xz ./vfio-user-phy-autotest_26180/output//test_completions.txt ./vfio-user-phy-autotest_26180/output//timing.svg ./vfio-user-phy-autotest_26180/output//timing.txt ./vfio-user-phy-autotest_26180/output//.. 01:00:20.116 + rmdir ./vfio-user-phy-autotest_26180/output/ 01:00:20.116 + for dir in "${out_dirs[@]}" 01:00:20.116 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:20.116 + [[ -f ./vhost-initiator-vg-autotest_77472/output//doc.tar.xz ]] 01:00:20.116 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:20.116 + [[ -f ./vhost-initiator-vg-autotest_77472/output//ut_coverage.tar.xz ]] 01:00:20.116 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:20.116 + [[ -f ./vhost-initiator-vg-autotest_77472/output//llvm.tar.xz ]] 01:00:20.117 + mv ./vhost-initiator-vg-autotest_77472/output//all_tests.txt ./vhost-initiator-vg-autotest_77472/output//build-pkg-manifest.txt ./vhost-initiator-vg-autotest_77472/output//build-repo-manifest.txt ./vhost-initiator-vg-autotest_77472/output//cov_base.info.xz ./vhost-initiator-vg-autotest_77472/output//cov_test.info.xz ./vhost-initiator-vg-autotest_77472/output//cov_total.info.xz ./vhost-initiator-vg-autotest_77472/output//dmesg.init.log ./vhost-initiator-vg-autotest_77472/output//dmesg.log ./vhost-initiator-vg-autotest_77472/output//power.tar.xz ./vhost-initiator-vg-autotest_77472/output//test_completions.txt ./vhost-initiator-vg-autotest_77472/output//timing.svg ./vhost-initiator-vg-autotest_77472/output//timing.txt ./vhost-initiator-vg-autotest_77472/output//vhost_fuzz_output1.txt.xz ./vhost-initiator-vg-autotest_77472/output//vhost_fuzz_output2.txt.xz ./vhost-initiator-vg-autotest_77472/output//vhost_fuzz_tgt_output.txt.xz ./vhost-initiator-vg-autotest_77472/output//.. 01:00:20.117 + rmdir ./vhost-initiator-vg-autotest_77472/output/ 01:00:20.117 + for dir in "${out_dirs[@]}" 01:00:20.117 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:20.117 + [[ -f ./vhost-phy-autotest_26197/output//doc.tar.xz ]] 01:00:20.117 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:20.117 + [[ -f ./vhost-phy-autotest_26197/output//ut_coverage.tar.xz ]] 01:00:20.117 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:20.117 + [[ -f ./vhost-phy-autotest_26197/output//llvm.tar.xz ]] 01:00:20.117 + mv ./vhost-phy-autotest_26197/output//all_tests.txt ./vhost-phy-autotest_26197/output//build-pkg-manifest.txt ./vhost-phy-autotest_26197/output//build-repo-manifest.txt ./vhost-phy-autotest_26197/output//cov_base.info.xz ./vhost-phy-autotest_26197/output//cov_test.info.xz ./vhost-phy-autotest_26197/output//cov_total.info.xz ./vhost-phy-autotest_26197/output//dmesg.init.log ./vhost-phy-autotest_26197/output//dmesg.log ./vhost-phy-autotest_26197/output//power.tar.xz ./vhost-phy-autotest_26197/output//test_completions.txt ./vhost-phy-autotest_26197/output//timing.svg ./vhost-phy-autotest_26197/output//timing.txt ./vhost-phy-autotest_26197/output//.. 01:00:20.117 + rmdir ./vhost-phy-autotest_26197/output/ 01:00:20.117 + for dir in "${out_dirs[@]}" 01:00:20.117 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:20.117 + [[ -f ./zns-vg-autotest_76558/output//doc.tar.xz ]] 01:00:20.117 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:20.117 + [[ -f ./zns-vg-autotest_76558/output//ut_coverage.tar.xz ]] 01:00:20.117 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:00:20.117 + [[ -f ./zns-vg-autotest_76558/output//llvm.tar.xz ]] 01:00:20.117 + mv ./zns-vg-autotest_76558/output//all_tests.txt ./zns-vg-autotest_76558/output//build-pkg-manifest.txt ./zns-vg-autotest_76558/output//build-repo-manifest.txt ./zns-vg-autotest_76558/output//cov_base.info.xz ./zns-vg-autotest_76558/output//cov_test.info.xz ./zns-vg-autotest_76558/output//cov_total.info.xz ./zns-vg-autotest_76558/output//dmesg.init.log ./zns-vg-autotest_76558/output//dmesg.log ./zns-vg-autotest_76558/output//power.tar.xz ./zns-vg-autotest_76558/output//test_completions.txt ./zns-vg-autotest_76558/output//timing.svg ./zns-vg-autotest_76558/output//timing.txt ./zns-vg-autotest_76558/output//.. 01:00:20.117 + rmdir ./zns-vg-autotest_76558/output/ 01:00:20.117 + unpack_cov_files 01:00:20.117 + local info_files 01:00:20.117 + info_files=(*/cov_*.info.xz) 01:00:20.117 + xargs -P0 -r -n1 xz -d 01:00:20.117 + printf '%s\n' BlobFS-phy-autotest_26178/cov_base.info.xz BlobFS-phy-autotest_26178/cov_test.info.xz BlobFS-phy-autotest_26178/cov_total.info.xz centos7-vg-autotest_73631/cov_base.info.xz centos7-vg-autotest_73631/cov_test.info.xz centos7-vg-autotest_73631/cov_total.info.xz crypto-phy-autotest_26172/cov_base.info.xz crypto-phy-autotest_26172/cov_test.info.xz crypto-phy-autotest_26172/cov_total.info.xz dsa-phy-autotest_4872/cov_base.info.xz dsa-phy-autotest_4872/cov_test.info.xz dsa-phy-autotest_4872/cov_total.info.xz iscsi-uring-vg-autotest_77357/cov_base.info.xz iscsi-uring-vg-autotest_77357/cov_test.info.xz iscsi-uring-vg-autotest_77357/cov_total.info.xz iscsi-vg-autotest_77490/cov_base.info.xz iscsi-vg-autotest_77490/cov_test.info.xz iscsi-vg-autotest_77490/cov_total.info.xz lvol-vg-autotest_77401/cov_base.info.xz lvol-vg-autotest_77401/cov_test.info.xz lvol-vg-autotest_77401/cov_total.info.xz nvme-cmb-pmr-vg-autotest_78575/cov_base.info.xz nvme-cmb-pmr-vg-autotest_78575/cov_test.info.xz nvme-cmb-pmr-vg-autotest_78575/cov_total.info.xz nvme-phy-autotest_72344/cov_base.info.xz nvme-phy-autotest_72344/cov_test.info.xz nvme-phy-autotest_72344/cov_total.info.xz nvme-vg-autotest_77452/cov_base.info.xz nvmf-phy-autotest_72416/cov_base.info.xz nvmf-phy-autotest_72416/cov_test.info.xz nvmf-phy-autotest_72416/cov_total.info.xz nvmf-tcp-phy-autotest_72303/cov_base.info.xz nvmf-tcp-phy-autotest_72303/cov_test.info.xz nvmf-tcp-phy-autotest_72303/cov_total.info.xz nvmf-tcp-uring-vg-autotest_77377/cov_base.info.xz nvmf-tcp-uring-vg-autotest_77377/cov_test.info.xz nvmf-tcp-uring-vg-autotest_77377/cov_total.info.xz nvmf-tcp-vg-autotest_77443/cov_base.info.xz nvmf-tcp-vg-autotest_77443/cov_test.info.xz nvmf-tcp-vg-autotest_77443/cov_total.info.xz rocky9-vg-autotest_16062/cov_base.info.xz rocky9-vg-autotest_16062/cov_test.info.xz rocky9-vg-autotest_16062/cov_total.info.xz ubuntu20-vg-autotest_73771/cov_base.info.xz ubuntu22-vg-autotest_37785/cov_base.info.xz ubuntu22-vg-autotest_37785/cov_test.info.xz ubuntu22-vg-autotest_37785/cov_total.info.xz vfio-user-phy-autotest_26180/cov_base.info.xz vfio-user-phy-autotest_26180/cov_test.info.xz vfio-user-phy-autotest_26180/cov_total.info.xz vhost-initiator-vg-autotest_77472/cov_base.info.xz vhost-initiator-vg-autotest_77472/cov_test.info.xz vhost-initiator-vg-autotest_77472/cov_total.info.xz vhost-phy-autotest_26197/cov_base.info.xz vhost-phy-autotest_26197/cov_test.info.xz vhost-phy-autotest_26197/cov_total.info.xz zns-vg-autotest_76558/cov_base.info.xz zns-vg-autotest_76558/cov_test.info.xz zns-vg-autotest_76558/cov_total.info.xz 01:00:20.682 + fix_downstream_job_paths 01:00:20.682 + sed -i -e 's#^SF:/.\+/spdk/#SF:/var/jenkins/workspace/autotest-per-patch_5/spdk/#g' BlobFS-phy-autotest_26178/cov_total.info centos7-vg-autotest_73631/cov_total.info crypto-phy-autotest_26172/cov_total.info dsa-phy-autotest_4872/cov_total.info iscsi-uring-vg-autotest_77357/cov_total.info iscsi-vg-autotest_77490/cov_total.info lvol-vg-autotest_77401/cov_total.info nvme-cmb-pmr-vg-autotest_78575/cov_total.info nvme-phy-autotest_72344/cov_total.info nvmf-phy-autotest_72416/cov_total.info nvmf-tcp-phy-autotest_72303/cov_total.info nvmf-tcp-uring-vg-autotest_77377/cov_total.info nvmf-tcp-vg-autotest_77443/cov_total.info rocky9-vg-autotest_16062/cov_total.info ubuntu22-vg-autotest_37785/cov_total.info vfio-user-phy-autotest_26180/cov_total.info vhost-initiator-vg-autotest_77472/cov_total.info vhost-phy-autotest_26197/cov_total.info zns-vg-autotest_76558/cov_total.info 01:00:21.620 + ignore_ocf_headers 01:00:21.620 + sed -i 's#--show-details#--show-details --ignore-errors source#g' spdk/autorun_post.py 01:00:21.620 + create_errtrace_files_for_all_builds 01:00:21.620 + local build_log_list 01:00:21.620 + build_log_list=($(find "$WORKSPACE" -type f -name 'build.log')) 01:00:21.620 ++ find /var/jenkins/workspace/autotest-per-patch_5 -type f -name build.log 01:00:21.620 + for build in "${build_log_list[@]}" 01:00:21.620 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/autobuild-external-vg-autotest_19800/build.log 01:00:21.620 + local build_log job_name start_pattern end_pattern backtraces 01:00:21.620 + build_log=/var/jenkins/workspace/autotest-per-patch_5/autobuild-external-vg-autotest_19800/build.log 01:00:21.620 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/autobuild-external-vg-autotest_19800/build.log 01:00:21.620 ++ basename /var/jenkins/workspace/autotest-per-patch_5/autobuild-external-vg-autotest_19800 01:00:21.620 + job_name=autobuild-external-vg-autotest_19800 01:00:21.620 + start_pattern='Backtrace start' 01:00:21.620 + end_pattern='Backtrace end' 01:00:21.620 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/autobuild-external-vg-autotest_19800/build.log ]] 01:00:21.620 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/autobuild-external-vg-autotest_19800/build.log 01:00:21.620 + backtraces= 01:00:21.620 + [[ -n '' ]] 01:00:21.620 + for build in "${build_log_list[@]}" 01:00:21.620 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/centos7-vg-autotest_73631/build.log 01:00:21.620 + local build_log job_name start_pattern end_pattern backtraces 01:00:21.620 + build_log=/var/jenkins/workspace/autotest-per-patch_5/centos7-vg-autotest_73631/build.log 01:00:21.620 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/centos7-vg-autotest_73631/build.log 01:00:21.620 ++ basename /var/jenkins/workspace/autotest-per-patch_5/centos7-vg-autotest_73631 01:00:21.620 + job_name=centos7-vg-autotest_73631 01:00:21.620 + start_pattern='Backtrace start' 01:00:21.620 + end_pattern='Backtrace end' 01:00:21.620 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/centos7-vg-autotest_73631/build.log ]] 01:00:21.620 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/centos7-vg-autotest_73631/build.log 01:00:21.620 + backtraces= 01:00:21.620 + [[ -n '' ]] 01:00:21.620 + for build in "${build_log_list[@]}" 01:00:21.620 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/zns-vg-autotest_76558/build.log 01:00:21.620 + local build_log job_name start_pattern end_pattern backtraces 01:00:21.620 + build_log=/var/jenkins/workspace/autotest-per-patch_5/zns-vg-autotest_76558/build.log 01:00:21.620 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/zns-vg-autotest_76558/build.log 01:00:21.620 ++ basename /var/jenkins/workspace/autotest-per-patch_5/zns-vg-autotest_76558 01:00:21.620 + job_name=zns-vg-autotest_76558 01:00:21.620 + start_pattern='Backtrace start' 01:00:21.620 + end_pattern='Backtrace end' 01:00:21.620 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/zns-vg-autotest_76558/build.log ]] 01:00:21.620 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/zns-vg-autotest_76558/build.log 01:00:21.620 + backtraces= 01:00:21.620 + [[ -n '' ]] 01:00:21.620 + for build in "${build_log_list[@]}" 01:00:21.620 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/iscsi-uring-vg-autotest_77357/build.log 01:00:21.620 + local build_log job_name start_pattern end_pattern backtraces 01:00:21.620 + build_log=/var/jenkins/workspace/autotest-per-patch_5/iscsi-uring-vg-autotest_77357/build.log 01:00:21.620 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/iscsi-uring-vg-autotest_77357/build.log 01:00:21.620 ++ basename /var/jenkins/workspace/autotest-per-patch_5/iscsi-uring-vg-autotest_77357 01:00:21.620 + job_name=iscsi-uring-vg-autotest_77357 01:00:21.620 + start_pattern='Backtrace start' 01:00:21.620 + end_pattern='Backtrace end' 01:00:21.620 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/iscsi-uring-vg-autotest_77357/build.log ]] 01:00:21.620 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/iscsi-uring-vg-autotest_77357/build.log 01:00:21.620 + backtraces= 01:00:21.620 + [[ -n '' ]] 01:00:21.620 + for build in "${build_log_list[@]}" 01:00:21.620 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/vhost-phy-autotest_26197/build.log 01:00:21.620 + local build_log job_name start_pattern end_pattern backtraces 01:00:21.620 + build_log=/var/jenkins/workspace/autotest-per-patch_5/vhost-phy-autotest_26197/build.log 01:00:21.620 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/vhost-phy-autotest_26197/build.log 01:00:21.620 ++ basename /var/jenkins/workspace/autotest-per-patch_5/vhost-phy-autotest_26197 01:00:21.620 + job_name=vhost-phy-autotest_26197 01:00:21.620 + start_pattern='Backtrace start' 01:00:21.620 + end_pattern='Backtrace end' 01:00:21.620 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/vhost-phy-autotest_26197/build.log ]] 01:00:21.620 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/vhost-phy-autotest_26197/build.log 01:00:21.620 + backtraces= 01:00:21.620 + [[ -n '' ]] 01:00:21.620 + for build in "${build_log_list[@]}" 01:00:21.620 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/nvme-vg-autotest_77452/build.log 01:00:21.620 + local build_log job_name start_pattern end_pattern backtraces 01:00:21.620 + build_log=/var/jenkins/workspace/autotest-per-patch_5/nvme-vg-autotest_77452/build.log 01:00:21.620 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/nvme-vg-autotest_77452/build.log 01:00:21.620 ++ basename /var/jenkins/workspace/autotest-per-patch_5/nvme-vg-autotest_77452 01:00:21.620 + job_name=nvme-vg-autotest_77452 01:00:21.620 + start_pattern='Backtrace start' 01:00:21.620 + end_pattern='Backtrace end' 01:00:21.620 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/nvme-vg-autotest_77452/build.log ]] 01:00:21.620 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/nvme-vg-autotest_77452/build.log 01:00:21.620 + backtraces='00:25:53.747 03:17:58 sw_hotplug -- common/autotest_common.sh@715 -- # time='\''========== Backtrace start: ========== 01:00:21.620 00:25:53.747 01:00:21.620 00:25:53.747 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:00:21.620 00:25:53.747 ... 01:00:21.620 00:25:53.747 710 01:00:21.620 00:25:53.747 711 # We redirect cmd'\''\'\'''\''s std{out,err} to a separate fd dup'\''\'\'''\''ed to stdin'\''\'\'''\''s device (or /dev/null) to 01:00:21.620 00:25:53.747 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 01:00:21.620 00:25:53.747 713 # but $() will return just the time'\''\'\'''\''s data, hence making it possible to just do: 01:00:21.620 00:25:53.747 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:00:21.620 00:25:53.747 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:00:21.620 00:25:53.747 716 01:00:21.620 00:25:53.747 717 echo "$time" 01:00:21.620 00:25:53.747 718 ) 01:00:21.620 00:25:53.747 719 01:00:21.620 00:25:53.747 720 function timing_enter() { 01:00:21.620 00:25:53.747 ... 01:00:21.620 00:25:53.747 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:00:21.620 00:25:53.747 ... 01:00:21.620 00:25:53.747 11 # Pci bus hotplug 01:00:21.620 00:25:53.747 12 # Helper function to remove/attach cotrollers 01:00:21.620 00:25:53.747 13 debug_remove_attach_helper() { 01:00:21.620 00:25:53.747 14 local helper_time=0 01:00:21.620 00:25:53.747 15 01:00:21.620 00:25:53.747 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:00:21.620 00:25:53.747 17 printf '\''\'\'''\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\''\'\'''\'' \ 01:00:21.620 00:25:53.747 18 "$helper_time" "$nvme_count" >&2 01:00:21.620 00:25:53.747 19 } 01:00:21.620 00:25:53.747 20 01:00:21.620 00:25:53.747 21 remove_attach_helper() { 01:00:21.620 00:25:53.748 ... 01:00:21.620 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:00:21.620 00:25:53.748 ... 01:00:21.620 00:25:53.748 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:00:21.620 00:25:53.748 106 done 01:00:21.620 00:25:53.748 107 01:00:21.620 00:25:53.748 108 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.620 00:25:53.748 109 01:00:21.620 00:25:53.748 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.621 00:25:53.748 111 # Verify reregistering hotplug poller 01:00:21.621 00:25:53.748 112 rpc_cmd bdev_nvme_set_hotplug -d 01:00:21.621 00:25:53.748 113 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.621 00:25:53.748 114 01:00:21.621 00:25:53.748 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.621 00:25:53.748 ... 01:00:21.621 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:00:21.621 00:25:53.748 ... 01:00:21.621 00:25:53.748 133 01:00:21.621 00:25:53.748 134 # Run pci bus hotplug test 01:00:21.621 00:25:53.748 135 run_hotplug 01:00:21.621 00:25:53.748 136 01:00:21.621 00:25:53.748 137 # Run SPDK target based hotplug 01:00:21.621 00:25:53.748 => 138 tgt_run_hotplug 01:00:21.621 00:25:53.748 ... 01:00:21.621 00:25:53.748 01:00:21.621 00:25:53.748 ========== Backtrace end =========='\'' 01:00:21.621 00:25:53.748 ========== Backtrace start: ========== 01:00:21.621 00:25:53.748 01:00:21.621 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:00:21.621 00:25:53.748 ... 01:00:21.621 00:25:53.748 710 01:00:21.621 00:25:53.748 711 # We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to 01:00:21.621 00:25:53.748 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 01:00:21.621 00:25:53.748 713 # but $() will return just the time'\''s data, hence making it possible to just do: 01:00:21.621 00:25:53.748 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:00:21.621 00:25:53.748 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:00:21.621 00:25:53.748 716 01:00:21.621 00:25:53.748 717 echo "$time" 01:00:21.621 00:25:53.748 718 ) 01:00:21.621 00:25:53.748 719 01:00:21.621 00:25:53.748 720 function timing_enter() { 01:00:21.621 00:25:53.748 ... 01:00:21.621 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:00:21.621 00:25:53.748 ... 01:00:21.621 00:25:53.748 11 # Pci bus hotplug 01:00:21.621 00:25:53.748 12 # Helper function to remove/attach cotrollers 01:00:21.621 00:25:53.748 13 debug_remove_attach_helper() { 01:00:21.621 00:25:53.748 14 local helper_time=0 01:00:21.621 00:25:53.748 15 01:00:21.621 00:25:53.748 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:00:21.621 00:25:53.748 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:00:21.621 00:25:53.748 18 "$helper_time" "$nvme_count" >&2 01:00:21.621 00:25:53.748 19 } 01:00:21.621 00:25:53.748 20 01:00:21.621 00:25:53.748 21 remove_attach_helper() { 01:00:21.621 00:25:53.748 ... 01:00:21.621 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:00:21.621 00:25:53.748 ... 01:00:21.621 00:25:53.748 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:00:21.621 00:25:53.748 106 done 01:00:21.621 00:25:53.748 107 01:00:21.621 00:25:53.748 108 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.621 00:25:53.748 109 01:00:21.621 00:25:53.748 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.621 00:25:53.748 111 # Verify reregistering hotplug poller 01:00:21.621 00:25:53.748 112 rpc_cmd bdev_nvme_set_hotplug -d 01:00:21.621 00:25:53.748 113 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.621 00:25:53.748 114 01:00:21.621 00:25:53.748 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.621 00:25:53.748 ... 01:00:21.621 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:00:21.621 00:25:53.748 ... 01:00:21.621 00:25:53.748 133 01:00:21.621 00:25:53.748 134 # Run pci bus hotplug test 01:00:21.621 00:25:53.748 135 run_hotplug 01:00:21.621 00:25:53.748 136 01:00:21.621 00:25:53.748 137 # Run SPDK target based hotplug 01:00:21.621 00:25:53.748 => 138 tgt_run_hotplug 01:00:21.621 00:25:53.748 ... 01:00:21.621 00:25:53.748 01:00:21.621 00:25:53.748 ========== Backtrace end ========== 01:00:21.621 00:25:53.748 ========== Backtrace start: ========== 01:00:21.621 00:25:53.748 01:00:21.621 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:00:21.621 00:25:53.748 ... 01:00:21.621 00:25:53.748 713 # but $() will return just the time'\''s data, hence making it possible to just do: 01:00:21.621 00:25:53.748 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:00:21.621 00:25:53.748 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:00:21.621 00:25:53.748 716 01:00:21.621 00:25:53.748 717 echo "$time" 01:00:21.621 00:25:53.748 => 718 ) 01:00:21.621 00:25:53.748 719 01:00:21.621 00:25:53.748 720 function timing_enter() { 01:00:21.621 00:25:53.748 721 xtrace_disable 01:00:21.621 00:25:53.748 722 timing "enter" "$1" 01:00:21.621 00:25:53.748 723 xtrace_restore 01:00:21.621 00:25:53.748 ... 01:00:21.621 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:00:21.621 00:25:53.748 ... 01:00:21.621 00:25:53.748 11 # Pci bus hotplug 01:00:21.621 00:25:53.748 12 # Helper function to remove/attach cotrollers 01:00:21.621 00:25:53.748 13 debug_remove_attach_helper() { 01:00:21.621 00:25:53.748 14 local helper_time=0 01:00:21.621 00:25:53.748 15 01:00:21.621 00:25:53.748 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:00:21.621 00:25:53.748 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:00:21.621 00:25:53.748 18 "$helper_time" "$nvme_count" >&2 01:00:21.621 00:25:53.748 19 } 01:00:21.621 00:25:53.748 20 01:00:21.621 00:25:53.748 21 remove_attach_helper() { 01:00:21.621 00:25:53.748 ... 01:00:21.621 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:00:21.621 00:25:53.748 ... 01:00:21.621 00:25:53.748 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:00:21.621 00:25:53.748 106 done 01:00:21.621 00:25:53.748 107 01:00:21.621 00:25:53.748 108 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.621 00:25:53.748 109 01:00:21.621 00:25:53.748 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.621 00:25:53.748 111 # Verify reregistering hotplug poller 01:00:21.621 00:25:53.748 112 rpc_cmd bdev_nvme_set_hotplug -d 01:00:21.621 00:25:53.748 113 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.621 00:25:53.748 114 01:00:21.621 00:25:53.748 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.621 00:25:53.748 ... 01:00:21.621 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:00:21.621 00:25:53.748 ... 01:00:21.621 00:25:53.748 133 01:00:21.621 00:25:53.748 134 # Run pci bus hotplug test 01:00:21.621 00:25:53.748 135 run_hotplug 01:00:21.621 00:25:53.748 136 01:00:21.621 00:25:53.748 137 # Run SPDK target based hotplug 01:00:21.621 00:25:53.748 => 138 tgt_run_hotplug 01:00:21.621 00:25:53.748 ... 01:00:21.621 00:25:53.748 01:00:21.621 00:25:53.748 ========== Backtrace end ========== 01:00:21.621 00:25:53.748 ========== Backtrace start: ========== 01:00:21.621 00:25:53.748 01:00:21.621 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:00:21.621 00:25:53.748 ... 01:00:21.621 00:25:53.748 11 # Pci bus hotplug 01:00:21.621 00:25:53.748 12 # Helper function to remove/attach cotrollers 01:00:21.621 00:25:53.748 13 debug_remove_attach_helper() { 01:00:21.621 00:25:53.748 14 local helper_time=0 01:00:21.621 00:25:53.748 15 01:00:21.621 00:25:53.748 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:00:21.621 00:25:53.748 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:00:21.621 00:25:53.748 18 "$helper_time" "$nvme_count" >&2 01:00:21.621 00:25:53.748 19 } 01:00:21.621 00:25:53.748 20 01:00:21.621 00:25:53.748 21 remove_attach_helper() { 01:00:21.621 00:25:53.748 ... 01:00:21.621 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:00:21.621 00:25:53.748 ... 01:00:21.621 00:25:53.748 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:00:21.621 00:25:53.748 106 done 01:00:21.621 00:25:53.748 107 01:00:21.621 00:25:53.748 108 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.621 00:25:53.748 109 01:00:21.621 00:25:53.748 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.621 00:25:53.748 111 # Verify reregistering hotplug poller 01:00:21.621 00:25:53.748 112 rpc_cmd bdev_nvme_set_hotplug -d 01:00:21.621 00:25:53.748 113 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.621 00:25:53.748 114 01:00:21.621 00:25:53.748 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.621 00:25:53.748 ... 01:00:21.621 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:00:21.621 00:25:53.748 ... 01:00:21.621 00:25:53.748 133 01:00:21.621 00:25:53.748 134 # Run pci bus hotplug test 01:00:21.621 00:25:53.748 135 run_hotplug 01:00:21.621 00:25:53.748 136 01:00:21.621 00:25:53.748 137 # Run SPDK target based hotplug 01:00:21.621 00:25:53.748 => 138 tgt_run_hotplug 01:00:21.622 00:25:53.748 ... 01:00:21.622 00:25:53.749 01:00:21.622 00:25:53.749 ========== Backtrace end ========== 01:00:21.622 00:25:56.280 ========== Backtrace start: ========== 01:00:21.622 00:25:56.280 01:00:21.622 00:25:56.280 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh"]) 01:00:21.622 00:25:56.280 ... 01:00:21.622 00:25:56.280 1117 timing_enter $test_name 01:00:21.622 00:25:56.280 1118 echo "************************************" 01:00:21.622 00:25:56.280 1119 echo "START TEST $test_name" 01:00:21.622 00:25:56.280 1120 echo "************************************" 01:00:21.622 00:25:56.280 1121 xtrace_restore 01:00:21.622 00:25:56.280 1122 time "$@" 01:00:21.622 00:25:56.280 1123 xtrace_disable 01:00:21.622 00:25:56.280 1124 echo "************************************" 01:00:21.622 00:25:56.280 1125 echo "END TEST $test_name" 01:00:21.622 00:25:56.280 1126 echo "************************************" 01:00:21.622 00:25:56.280 1127 timing_exit $test_name 01:00:21.622 00:25:56.280 ... 01:00:21.622 00:25:56.280 in /home/vagrant/spdk_repo/spdk/autotest.sh:240 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 01:00:21.622 00:25:56.280 ... 01:00:21.622 00:25:56.280 235 01:00:21.622 00:25:56.280 236 run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh 01:00:21.622 00:25:56.280 237 run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh 01:00:21.622 00:25:56.280 238 01:00:21.622 00:25:56.280 239 if [ $(uname -s) = Linux ]; then 01:00:21.622 00:25:56.280 => 240 run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh 01:00:21.622 00:25:56.280 241 fi 01:00:21.622 00:25:56.280 242 01:00:21.622 00:25:56.280 243 if [[ $SPDK_TEST_XNVME -eq 1 ]]; then 01:00:21.622 00:25:56.280 244 run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh 01:00:21.622 00:25:56.280 245 run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme" 01:00:21.622 00:25:56.280 ... 01:00:21.622 00:25:56.280 01:00:21.622 00:25:56.281 ========== Backtrace end ==========' 01:00:21.622 + [[ -n 00:25:53.747 03:17:58 sw_hotplug -- common/autotest_common.sh@715 -- # time='========== Backtrace start: ========== 01:00:21.622 00:25:53.747 01:00:21.622 00:25:53.747 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:00:21.622 00:25:53.747 ... 01:00:21.622 00:25:53.747 710 01:00:21.622 00:25:53.747 711 # We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to 01:00:21.622 00:25:53.747 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 01:00:21.622 00:25:53.747 713 # but $() will return just the time'\''s data, hence making it possible to just do: 01:00:21.622 00:25:53.747 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:00:21.622 00:25:53.747 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:00:21.622 00:25:53.747 716 01:00:21.622 00:25:53.747 717 echo "$time" 01:00:21.622 00:25:53.747 718 ) 01:00:21.622 00:25:53.747 719 01:00:21.622 00:25:53.747 720 function timing_enter() { 01:00:21.622 00:25:53.747 ... 01:00:21.622 00:25:53.747 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:00:21.622 00:25:53.747 ... 01:00:21.622 00:25:53.747 11 # Pci bus hotplug 01:00:21.622 00:25:53.747 12 # Helper function to remove/attach cotrollers 01:00:21.622 00:25:53.747 13 debug_remove_attach_helper() { 01:00:21.622 00:25:53.747 14 local helper_time=0 01:00:21.622 00:25:53.747 15 01:00:21.622 00:25:53.747 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:00:21.622 00:25:53.747 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:00:21.622 00:25:53.747 18 "$helper_time" "$nvme_count" >&2 01:00:21.622 00:25:53.747 19 } 01:00:21.622 00:25:53.747 20 01:00:21.622 00:25:53.747 21 remove_attach_helper() { 01:00:21.622 00:25:53.748 ... 01:00:21.622 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:00:21.622 00:25:53.748 ... 01:00:21.622 00:25:53.748 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:00:21.622 00:25:53.748 106 done 01:00:21.622 00:25:53.748 107 01:00:21.622 00:25:53.748 108 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.622 00:25:53.748 109 01:00:21.622 00:25:53.748 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.622 00:25:53.748 111 # Verify reregistering hotplug poller 01:00:21.622 00:25:53.748 112 rpc_cmd bdev_nvme_set_hotplug -d 01:00:21.622 00:25:53.748 113 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.622 00:25:53.748 114 01:00:21.622 00:25:53.748 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.622 00:25:53.748 ... 01:00:21.622 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:00:21.622 00:25:53.748 ... 01:00:21.622 00:25:53.748 133 01:00:21.622 00:25:53.748 134 # Run pci bus hotplug test 01:00:21.622 00:25:53.748 135 run_hotplug 01:00:21.622 00:25:53.748 136 01:00:21.622 00:25:53.748 137 # Run SPDK target based hotplug 01:00:21.622 00:25:53.748 => 138 tgt_run_hotplug 01:00:21.622 00:25:53.748 ... 01:00:21.622 00:25:53.748 01:00:21.622 00:25:53.748 ========== Backtrace end ==========' 01:00:21.622 00:25:53.748 ========== Backtrace start: ========== 01:00:21.622 00:25:53.748 01:00:21.622 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:00:21.622 00:25:53.748 ... 01:00:21.622 00:25:53.748 710 01:00:21.622 00:25:53.748 711 # We redirect cmd's std{out,err} to a separate fd dup'ed to stdin's device (or /dev/null) to 01:00:21.622 00:25:53.748 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 01:00:21.622 00:25:53.748 713 # but $() will return just the time's data, hence making it possible to just do: 01:00:21.622 00:25:53.748 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:00:21.622 00:25:53.748 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:00:21.622 00:25:53.748 716 01:00:21.622 00:25:53.748 717 echo "$time" 01:00:21.622 00:25:53.748 718 ) 01:00:21.622 00:25:53.748 719 01:00:21.622 00:25:53.748 720 function timing_enter() { 01:00:21.622 00:25:53.748 ... 01:00:21.622 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:00:21.622 00:25:53.748 ... 01:00:21.622 00:25:53.748 11 # Pci bus hotplug 01:00:21.622 00:25:53.748 12 # Helper function to remove/attach cotrollers 01:00:21.622 00:25:53.748 13 debug_remove_attach_helper() { 01:00:21.622 00:25:53.748 14 local helper_time=0 01:00:21.622 00:25:53.748 15 01:00:21.622 00:25:53.748 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:00:21.622 00:25:53.748 17 printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \ 01:00:21.622 00:25:53.748 18 "$helper_time" "$nvme_count" >&2 01:00:21.622 00:25:53.748 19 } 01:00:21.622 00:25:53.748 20 01:00:21.622 00:25:53.748 21 remove_attach_helper() { 01:00:21.622 00:25:53.748 ... 01:00:21.622 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:00:21.622 00:25:53.748 ... 01:00:21.622 00:25:53.748 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:00:21.622 00:25:53.748 106 done 01:00:21.622 00:25:53.748 107 01:00:21.622 00:25:53.748 108 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.622 00:25:53.748 109 01:00:21.622 00:25:53.748 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.622 00:25:53.748 111 # Verify reregistering hotplug poller 01:00:21.622 00:25:53.748 112 rpc_cmd bdev_nvme_set_hotplug -d 01:00:21.622 00:25:53.748 113 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.622 00:25:53.748 114 01:00:21.622 00:25:53.748 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.622 00:25:53.748 ... 01:00:21.622 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:00:21.622 00:25:53.748 ... 01:00:21.622 00:25:53.748 133 01:00:21.622 00:25:53.748 134 # Run pci bus hotplug test 01:00:21.622 00:25:53.748 135 run_hotplug 01:00:21.622 00:25:53.748 136 01:00:21.622 00:25:53.748 137 # Run SPDK target based hotplug 01:00:21.622 00:25:53.748 => 138 tgt_run_hotplug 01:00:21.622 00:25:53.748 ... 01:00:21.622 00:25:53.748 01:00:21.622 00:25:53.748 ========== Backtrace end ========== 01:00:21.622 00:25:53.748 ========== Backtrace start: ========== 01:00:21.622 00:25:53.748 01:00:21.622 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:00:21.622 00:25:53.748 ... 01:00:21.622 00:25:53.748 713 # but $() will return just the time's data, hence making it possible to just do: 01:00:21.622 00:25:53.748 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:00:21.622 00:25:53.748 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:00:21.622 00:25:53.748 716 01:00:21.622 00:25:53.748 717 echo "$time" 01:00:21.622 00:25:53.748 => 718 ) 01:00:21.622 00:25:53.748 719 01:00:21.622 00:25:53.748 720 function timing_enter() { 01:00:21.622 00:25:53.748 721 xtrace_disable 01:00:21.622 00:25:53.748 722 timing "enter" "$1" 01:00:21.622 00:25:53.748 723 xtrace_restore 01:00:21.622 00:25:53.748 ... 01:00:21.622 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:00:21.622 00:25:53.748 ... 01:00:21.622 00:25:53.748 11 # Pci bus hotplug 01:00:21.622 00:25:53.748 12 # Helper function to remove/attach cotrollers 01:00:21.622 00:25:53.748 13 debug_remove_attach_helper() { 01:00:21.622 00:25:53.748 14 local helper_time=0 01:00:21.622 00:25:53.748 15 01:00:21.622 00:25:53.748 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:00:21.622 00:25:53.748 17 printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \ 01:00:21.622 00:25:53.748 18 "$helper_time" "$nvme_count" >&2 01:00:21.622 00:25:53.748 19 } 01:00:21.622 00:25:53.748 20 01:00:21.622 00:25:53.748 21 remove_attach_helper() { 01:00:21.622 00:25:53.748 ... 01:00:21.622 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:00:21.622 00:25:53.748 ... 01:00:21.622 00:25:53.748 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:00:21.622 00:25:53.748 106 done 01:00:21.622 00:25:53.748 107 01:00:21.622 00:25:53.748 108 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.623 00:25:53.748 109 01:00:21.623 00:25:53.748 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.623 00:25:53.748 111 # Verify reregistering hotplug poller 01:00:21.623 00:25:53.748 112 rpc_cmd bdev_nvme_set_hotplug -d 01:00:21.623 00:25:53.748 113 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.623 00:25:53.748 114 01:00:21.623 00:25:53.748 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.623 00:25:53.748 ... 01:00:21.623 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:00:21.623 00:25:53.748 ... 01:00:21.623 00:25:53.748 133 01:00:21.623 00:25:53.748 134 # Run pci bus hotplug test 01:00:21.623 00:25:53.748 135 run_hotplug 01:00:21.623 00:25:53.748 136 01:00:21.623 00:25:53.748 137 # Run SPDK target based hotplug 01:00:21.623 00:25:53.748 => 138 tgt_run_hotplug 01:00:21.623 00:25:53.748 ... 01:00:21.623 00:25:53.748 01:00:21.623 00:25:53.748 ========== Backtrace end ========== 01:00:21.623 00:25:53.748 ========== Backtrace start: ========== 01:00:21.623 00:25:53.748 01:00:21.623 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:00:21.623 00:25:53.748 ... 01:00:21.623 00:25:53.748 11 # Pci bus hotplug 01:00:21.623 00:25:53.748 12 # Helper function to remove/attach cotrollers 01:00:21.623 00:25:53.748 13 debug_remove_attach_helper() { 01:00:21.623 00:25:53.748 14 local helper_time=0 01:00:21.623 00:25:53.748 15 01:00:21.623 00:25:53.748 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:00:21.623 00:25:53.748 17 printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \ 01:00:21.623 00:25:53.748 18 "$helper_time" "$nvme_count" >&2 01:00:21.623 00:25:53.748 19 } 01:00:21.623 00:25:53.748 20 01:00:21.623 00:25:53.748 21 remove_attach_helper() { 01:00:21.623 00:25:53.748 ... 01:00:21.623 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:00:21.623 00:25:53.748 ... 01:00:21.623 00:25:53.748 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:00:21.623 00:25:53.748 106 done 01:00:21.623 00:25:53.748 107 01:00:21.623 00:25:53.748 108 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.623 00:25:53.748 109 01:00:21.623 00:25:53.748 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.623 00:25:53.748 111 # Verify reregistering hotplug poller 01:00:21.623 00:25:53.748 112 rpc_cmd bdev_nvme_set_hotplug -d 01:00:21.623 00:25:53.748 113 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.623 00:25:53.748 114 01:00:21.623 00:25:53.748 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.623 00:25:53.748 ... 01:00:21.623 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:00:21.623 00:25:53.748 ... 01:00:21.623 00:25:53.748 133 01:00:21.623 00:25:53.748 134 # Run pci bus hotplug test 01:00:21.623 00:25:53.748 135 run_hotplug 01:00:21.623 00:25:53.748 136 01:00:21.623 00:25:53.748 137 # Run SPDK target based hotplug 01:00:21.623 00:25:53.748 => 138 tgt_run_hotplug 01:00:21.623 00:25:53.748 ... 01:00:21.623 00:25:53.749 01:00:21.623 00:25:53.749 ========== Backtrace end ========== 01:00:21.623 00:25:56.280 ========== Backtrace start: ========== 01:00:21.623 00:25:56.280 01:00:21.623 00:25:56.280 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh"]) 01:00:21.623 00:25:56.280 ... 01:00:21.623 00:25:56.280 1117 timing_enter $test_name 01:00:21.623 00:25:56.280 1118 echo "************************************" 01:00:21.623 00:25:56.280 1119 echo "START TEST $test_name" 01:00:21.623 00:25:56.280 1120 echo "************************************" 01:00:21.623 00:25:56.280 1121 xtrace_restore 01:00:21.623 00:25:56.280 1122 time "$@" 01:00:21.623 00:25:56.280 1123 xtrace_disable 01:00:21.623 00:25:56.280 1124 echo "************************************" 01:00:21.623 00:25:56.280 1125 echo "END TEST $test_name" 01:00:21.623 00:25:56.280 1126 echo "************************************" 01:00:21.623 00:25:56.280 1127 timing_exit $test_name 01:00:21.623 00:25:56.280 ... 01:00:21.623 00:25:56.280 in /home/vagrant/spdk_repo/spdk/autotest.sh:240 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 01:00:21.623 00:25:56.280 ... 01:00:21.623 00:25:56.280 235 01:00:21.623 00:25:56.280 236 run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh 01:00:21.623 00:25:56.280 237 run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh 01:00:21.623 00:25:56.280 238 01:00:21.623 00:25:56.280 239 if [ $(uname -s) = Linux ]; then 01:00:21.623 00:25:56.280 => 240 run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh 01:00:21.623 00:25:56.280 241 fi 01:00:21.623 00:25:56.280 242 01:00:21.623 00:25:56.280 243 if [[ $SPDK_TEST_XNVME -eq 1 ]]; then 01:00:21.623 00:25:56.280 244 run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh 01:00:21.623 00:25:56.280 245 run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme" 01:00:21.623 00:25:56.280 ... 01:00:21.623 00:25:56.280 01:00:21.623 00:25:56.281 ========== Backtrace end ========== ]] 01:00:21.623 + echo '00:25:53.747 03:17:58 sw_hotplug -- common/autotest_common.sh@715 -- # time='\''========== Backtrace start: ========== 01:00:21.623 00:25:53.747 01:00:21.623 00:25:53.747 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:00:21.623 00:25:53.747 ... 01:00:21.623 00:25:53.747 710 01:00:21.623 00:25:53.747 711 # We redirect cmd'\''\'\'''\''s std{out,err} to a separate fd dup'\''\'\'''\''ed to stdin'\''\'\'''\''s device (or /dev/null) to 01:00:21.623 00:25:53.747 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 01:00:21.623 00:25:53.747 713 # but $() will return just the time'\''\'\'''\''s data, hence making it possible to just do: 01:00:21.623 00:25:53.747 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:00:21.623 00:25:53.747 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:00:21.623 00:25:53.747 716 01:00:21.623 00:25:53.747 717 echo "$time" 01:00:21.623 00:25:53.747 718 ) 01:00:21.623 00:25:53.747 719 01:00:21.623 00:25:53.747 720 function timing_enter() { 01:00:21.623 00:25:53.747 ... 01:00:21.623 00:25:53.747 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:00:21.623 00:25:53.747 ... 01:00:21.623 00:25:53.747 11 # Pci bus hotplug 01:00:21.623 00:25:53.747 12 # Helper function to remove/attach cotrollers 01:00:21.623 00:25:53.747 13 debug_remove_attach_helper() { 01:00:21.623 00:25:53.747 14 local helper_time=0 01:00:21.623 00:25:53.747 15 01:00:21.623 00:25:53.747 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:00:21.623 00:25:53.747 17 printf '\''\'\'''\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\''\'\'''\'' \ 01:00:21.623 00:25:53.747 18 "$helper_time" "$nvme_count" >&2 01:00:21.623 00:25:53.747 19 } 01:00:21.623 00:25:53.747 20 01:00:21.623 00:25:53.747 21 remove_attach_helper() { 01:00:21.623 00:25:53.748 ... 01:00:21.623 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:00:21.623 00:25:53.748 ... 01:00:21.623 00:25:53.748 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:00:21.623 00:25:53.748 106 done 01:00:21.623 00:25:53.748 107 01:00:21.623 00:25:53.748 108 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.623 00:25:53.748 109 01:00:21.623 00:25:53.748 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.623 00:25:53.748 111 # Verify reregistering hotplug poller 01:00:21.623 00:25:53.748 112 rpc_cmd bdev_nvme_set_hotplug -d 01:00:21.623 00:25:53.748 113 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.623 00:25:53.748 114 01:00:21.623 00:25:53.748 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.623 00:25:53.748 ... 01:00:21.623 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:00:21.623 00:25:53.748 ... 01:00:21.623 00:25:53.748 133 01:00:21.623 00:25:53.748 134 # Run pci bus hotplug test 01:00:21.623 00:25:53.748 135 run_hotplug 01:00:21.623 00:25:53.748 136 01:00:21.623 00:25:53.748 137 # Run SPDK target based hotplug 01:00:21.623 00:25:53.748 => 138 tgt_run_hotplug 01:00:21.623 00:25:53.748 ... 01:00:21.623 00:25:53.748 01:00:21.623 00:25:53.748 ========== Backtrace end =========='\'' 01:00:21.623 00:25:53.748 ========== Backtrace start: ========== 01:00:21.623 00:25:53.748 01:00:21.623 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:00:21.623 00:25:53.748 ... 01:00:21.623 00:25:53.748 710 01:00:21.623 00:25:53.748 711 # We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to 01:00:21.623 00:25:53.748 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 01:00:21.623 00:25:53.748 713 # but $() will return just the time'\''s data, hence making it possible to just do: 01:00:21.623 00:25:53.748 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:00:21.623 00:25:53.748 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:00:21.623 00:25:53.748 716 01:00:21.623 00:25:53.748 717 echo "$time" 01:00:21.623 00:25:53.748 718 ) 01:00:21.623 00:25:53.748 719 01:00:21.623 00:25:53.748 720 function timing_enter() { 01:00:21.623 00:25:53.748 ... 01:00:21.623 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:00:21.623 00:25:53.748 ... 01:00:21.623 00:25:53.748 11 # Pci bus hotplug 01:00:21.623 00:25:53.748 12 # Helper function to remove/attach cotrollers 01:00:21.623 00:25:53.748 13 debug_remove_attach_helper() { 01:00:21.623 00:25:53.748 14 local helper_time=0 01:00:21.623 00:25:53.748 15 01:00:21.623 00:25:53.748 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:00:21.623 00:25:53.748 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:00:21.623 00:25:53.748 18 "$helper_time" "$nvme_count" >&2 01:00:21.623 00:25:53.748 19 } 01:00:21.623 00:25:53.748 20 01:00:21.623 00:25:53.748 21 remove_attach_helper() { 01:00:21.623 00:25:53.748 ... 01:00:21.623 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:00:21.623 00:25:53.748 ... 01:00:21.623 00:25:53.748 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:00:21.623 00:25:53.748 106 done 01:00:21.623 00:25:53.748 107 01:00:21.623 00:25:53.748 108 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.624 00:25:53.748 109 01:00:21.624 00:25:53.748 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.624 00:25:53.748 111 # Verify reregistering hotplug poller 01:00:21.624 00:25:53.748 112 rpc_cmd bdev_nvme_set_hotplug -d 01:00:21.624 00:25:53.748 113 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.624 00:25:53.748 114 01:00:21.624 00:25:53.748 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.624 00:25:53.748 ... 01:00:21.624 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:00:21.624 00:25:53.748 ... 01:00:21.624 00:25:53.748 133 01:00:21.624 00:25:53.748 134 # Run pci bus hotplug test 01:00:21.624 00:25:53.748 135 run_hotplug 01:00:21.624 00:25:53.748 136 01:00:21.624 00:25:53.748 137 # Run SPDK target based hotplug 01:00:21.624 00:25:53.748 => 138 tgt_run_hotplug 01:00:21.624 00:25:53.748 ... 01:00:21.624 00:25:53.748 01:00:21.624 00:25:53.748 ========== Backtrace end ========== 01:00:21.624 00:25:53.748 ========== Backtrace start: ========== 01:00:21.624 00:25:53.748 01:00:21.624 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:00:21.624 00:25:53.748 ... 01:00:21.624 00:25:53.748 713 # but $() will return just the time'\''s data, hence making it possible to just do: 01:00:21.624 00:25:53.748 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:00:21.624 00:25:53.748 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:00:21.624 00:25:53.748 716 01:00:21.624 00:25:53.748 717 echo "$time" 01:00:21.624 00:25:53.748 => 718 ) 01:00:21.624 00:25:53.748 719 01:00:21.624 00:25:53.748 720 function timing_enter() { 01:00:21.624 00:25:53.748 721 xtrace_disable 01:00:21.624 00:25:53.748 722 timing "enter" "$1" 01:00:21.624 00:25:53.748 723 xtrace_restore 01:00:21.624 00:25:53.748 ... 01:00:21.624 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:00:21.624 00:25:53.748 ... 01:00:21.624 00:25:53.748 11 # Pci bus hotplug 01:00:21.624 00:25:53.748 12 # Helper function to remove/attach cotrollers 01:00:21.624 00:25:53.748 13 debug_remove_attach_helper() { 01:00:21.624 00:25:53.748 14 local helper_time=0 01:00:21.624 00:25:53.748 15 01:00:21.624 00:25:53.748 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:00:21.624 00:25:53.748 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:00:21.624 00:25:53.748 18 "$helper_time" "$nvme_count" >&2 01:00:21.624 00:25:53.748 19 } 01:00:21.624 00:25:53.748 20 01:00:21.624 00:25:53.748 21 remove_attach_helper() { 01:00:21.624 00:25:53.748 ... 01:00:21.624 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:00:21.624 00:25:53.748 ... 01:00:21.624 00:25:53.748 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:00:21.624 00:25:53.748 106 done 01:00:21.624 00:25:53.748 107 01:00:21.624 00:25:53.748 108 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.624 00:25:53.748 109 01:00:21.624 00:25:53.748 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.624 00:25:53.748 111 # Verify reregistering hotplug poller 01:00:21.624 00:25:53.748 112 rpc_cmd bdev_nvme_set_hotplug -d 01:00:21.624 00:25:53.748 113 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.624 00:25:53.748 114 01:00:21.624 00:25:53.748 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.624 00:25:53.748 ... 01:00:21.624 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:00:21.624 00:25:53.748 ... 01:00:21.624 00:25:53.748 133 01:00:21.624 00:25:53.748 134 # Run pci bus hotplug test 01:00:21.624 00:25:53.748 135 run_hotplug 01:00:21.624 00:25:53.748 136 01:00:21.624 00:25:53.748 137 # Run SPDK target based hotplug 01:00:21.624 00:25:53.748 => 138 tgt_run_hotplug 01:00:21.624 00:25:53.748 ... 01:00:21.624 00:25:53.748 01:00:21.624 00:25:53.748 ========== Backtrace end ========== 01:00:21.624 00:25:53.748 ========== Backtrace start: ========== 01:00:21.624 00:25:53.748 01:00:21.624 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:00:21.624 00:25:53.748 ... 01:00:21.624 00:25:53.748 11 # Pci bus hotplug 01:00:21.624 00:25:53.748 12 # Helper function to remove/attach cotrollers 01:00:21.624 00:25:53.748 13 debug_remove_attach_helper() { 01:00:21.624 00:25:53.748 14 local helper_time=0 01:00:21.624 00:25:53.748 15 01:00:21.624 00:25:53.748 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:00:21.624 00:25:53.748 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:00:21.624 00:25:53.748 18 "$helper_time" "$nvme_count" >&2 01:00:21.624 00:25:53.748 19 } 01:00:21.624 00:25:53.748 20 01:00:21.624 00:25:53.748 21 remove_attach_helper() { 01:00:21.624 00:25:53.748 ... 01:00:21.624 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:00:21.624 00:25:53.748 ... 01:00:21.624 00:25:53.748 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:00:21.624 00:25:53.748 106 done 01:00:21.624 00:25:53.748 107 01:00:21.624 00:25:53.748 108 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.624 00:25:53.748 109 01:00:21.624 00:25:53.748 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.624 00:25:53.748 111 # Verify reregistering hotplug poller 01:00:21.624 00:25:53.748 112 rpc_cmd bdev_nvme_set_hotplug -d 01:00:21.624 00:25:53.748 113 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.624 00:25:53.748 114 01:00:21.624 00:25:53.748 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.624 00:25:53.748 ... 01:00:21.624 00:25:53.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:00:21.624 00:25:53.748 ... 01:00:21.624 00:25:53.748 133 01:00:21.624 00:25:53.748 134 # Run pci bus hotplug test 01:00:21.624 00:25:53.748 135 run_hotplug 01:00:21.624 00:25:53.748 136 01:00:21.624 00:25:53.748 137 # Run SPDK target based hotplug 01:00:21.624 00:25:53.748 => 138 tgt_run_hotplug 01:00:21.624 00:25:53.748 ... 01:00:21.624 00:25:53.749 01:00:21.624 00:25:53.749 ========== Backtrace end ========== 01:00:21.624 00:25:56.280 ========== Backtrace start: ========== 01:00:21.624 00:25:56.280 01:00:21.624 00:25:56.280 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh"]) 01:00:21.624 00:25:56.280 ... 01:00:21.624 00:25:56.280 1117 timing_enter $test_name 01:00:21.624 00:25:56.280 1118 echo "************************************" 01:00:21.624 00:25:56.280 1119 echo "START TEST $test_name" 01:00:21.624 00:25:56.280 1120 echo "************************************" 01:00:21.624 00:25:56.280 1121 xtrace_restore 01:00:21.624 00:25:56.280 1122 time "$@" 01:00:21.624 00:25:56.280 1123 xtrace_disable 01:00:21.624 00:25:56.280 1124 echo "************************************" 01:00:21.624 00:25:56.280 1125 echo "END TEST $test_name" 01:00:21.624 00:25:56.280 1126 echo "************************************" 01:00:21.624 00:25:56.280 1127 timing_exit $test_name 01:00:21.624 00:25:56.280 ... 01:00:21.624 00:25:56.280 in /home/vagrant/spdk_repo/spdk/autotest.sh:240 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 01:00:21.624 00:25:56.280 ... 01:00:21.624 00:25:56.280 235 01:00:21.624 00:25:56.280 236 run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh 01:00:21.624 00:25:56.280 237 run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh 01:00:21.624 00:25:56.280 238 01:00:21.624 00:25:56.280 239 if [ $(uname -s) = Linux ]; then 01:00:21.624 00:25:56.280 => 240 run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh 01:00:21.624 00:25:56.280 241 fi 01:00:21.624 00:25:56.280 242 01:00:21.624 00:25:56.280 243 if [[ $SPDK_TEST_XNVME -eq 1 ]]; then 01:00:21.624 00:25:56.280 244 run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh 01:00:21.624 00:25:56.280 245 run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme" 01:00:21.624 00:25:56.280 ... 01:00:21.624 00:25:56.280 01:00:21.624 00:25:56.281 ========== Backtrace end ==========' 01:00:21.624 + for build in "${build_log_list[@]}" 01:00:21.624 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/vhost-initiator-vg-autotest_77472/build.log 01:00:21.624 + local build_log job_name start_pattern end_pattern backtraces 01:00:21.624 + build_log=/var/jenkins/workspace/autotest-per-patch_5/vhost-initiator-vg-autotest_77472/build.log 01:00:21.624 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/vhost-initiator-vg-autotest_77472/build.log 01:00:21.624 ++ basename /var/jenkins/workspace/autotest-per-patch_5/vhost-initiator-vg-autotest_77472 01:00:21.624 + job_name=vhost-initiator-vg-autotest_77472 01:00:21.624 + start_pattern='Backtrace start' 01:00:21.624 + end_pattern='Backtrace end' 01:00:21.624 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/vhost-initiator-vg-autotest_77472/build.log ]] 01:00:21.624 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/vhost-initiator-vg-autotest_77472/build.log 01:00:21.624 + backtraces= 01:00:21.624 + [[ -n '' ]] 01:00:21.624 + for build in "${build_log_list[@]}" 01:00:21.624 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/dsa-phy-autotest_4872/build.log 01:00:21.624 + local build_log job_name start_pattern end_pattern backtraces 01:00:21.624 + build_log=/var/jenkins/workspace/autotest-per-patch_5/dsa-phy-autotest_4872/build.log 01:00:21.624 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/dsa-phy-autotest_4872/build.log 01:00:21.624 ++ basename /var/jenkins/workspace/autotest-per-patch_5/dsa-phy-autotest_4872 01:00:21.624 + job_name=dsa-phy-autotest_4872 01:00:21.624 + start_pattern='Backtrace start' 01:00:21.624 + end_pattern='Backtrace end' 01:00:21.624 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/dsa-phy-autotest_4872/build.log ]] 01:00:21.624 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/dsa-phy-autotest_4872/build.log 01:00:21.624 + backtraces= 01:00:21.624 + [[ -n '' ]] 01:00:21.624 + for build in "${build_log_list[@]}" 01:00:21.624 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/unittest-main-docker-autotest_19838/build.log 01:00:21.624 + local build_log job_name start_pattern end_pattern backtraces 01:00:21.624 + build_log=/var/jenkins/workspace/autotest-per-patch_5/unittest-main-docker-autotest_19838/build.log 01:00:21.625 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/unittest-main-docker-autotest_19838/build.log 01:00:21.625 ++ basename /var/jenkins/workspace/autotest-per-patch_5/unittest-main-docker-autotest_19838 01:00:21.625 + job_name=unittest-main-docker-autotest_19838 01:00:21.625 + start_pattern='Backtrace start' 01:00:21.625 + end_pattern='Backtrace end' 01:00:21.625 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/unittest-main-docker-autotest_19838/build.log ]] 01:00:21.625 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/unittest-main-docker-autotest_19838/build.log 01:00:21.625 + backtraces= 01:00:21.625 + [[ -n '' ]] 01:00:21.625 + for build in "${build_log_list[@]}" 01:00:21.625 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/iscsi-vg-autotest_77490/build.log 01:00:21.625 + local build_log job_name start_pattern end_pattern backtraces 01:00:21.625 + build_log=/var/jenkins/workspace/autotest-per-patch_5/iscsi-vg-autotest_77490/build.log 01:00:21.625 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/iscsi-vg-autotest_77490/build.log 01:00:21.625 ++ basename /var/jenkins/workspace/autotest-per-patch_5/iscsi-vg-autotest_77490 01:00:21.625 + job_name=iscsi-vg-autotest_77490 01:00:21.625 + start_pattern='Backtrace start' 01:00:21.625 + end_pattern='Backtrace end' 01:00:21.625 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/iscsi-vg-autotest_77490/build.log ]] 01:00:21.625 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/iscsi-vg-autotest_77490/build.log 01:00:21.625 + backtraces= 01:00:21.625 + [[ -n '' ]] 01:00:21.625 + for build in "${build_log_list[@]}" 01:00:21.625 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/ubuntu20-vg-autotest_73771/build.log 01:00:21.625 + local build_log job_name start_pattern end_pattern backtraces 01:00:21.625 + build_log=/var/jenkins/workspace/autotest-per-patch_5/ubuntu20-vg-autotest_73771/build.log 01:00:21.625 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/ubuntu20-vg-autotest_73771/build.log 01:00:21.625 ++ basename /var/jenkins/workspace/autotest-per-patch_5/ubuntu20-vg-autotest_73771 01:00:21.625 + job_name=ubuntu20-vg-autotest_73771 01:00:21.625 + start_pattern='Backtrace start' 01:00:21.625 + end_pattern='Backtrace end' 01:00:21.625 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/ubuntu20-vg-autotest_73771/build.log ]] 01:00:21.625 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/ubuntu20-vg-autotest_73771/build.log 01:00:21.625 + backtraces='00:53:35.005 03:45:39 sw_hotplug -- common/autotest_common.sh@715 -- # time='\''========== Backtrace start: ========== 01:00:21.625 00:53:35.005 01:00:21.625 00:53:35.005 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:00:21.625 00:53:35.005 ... 01:00:21.625 00:53:35.005 710 01:00:21.625 00:53:35.005 711 # We redirect cmd'\''\'\'''\''s std{out,err} to a separate fd dup'\''\'\'''\''ed to stdin'\''\'\'''\''s device (or /dev/null) to 01:00:21.625 00:53:35.005 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 01:00:21.625 00:53:35.005 713 # but $() will return just the time'\''\'\'''\''s data, hence making it possible to just do: 01:00:21.625 00:53:35.005 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:00:21.625 00:53:35.005 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:00:21.625 00:53:35.005 716 01:00:21.625 00:53:35.005 717 echo "$time" 01:00:21.625 00:53:35.005 718 ) 01:00:21.625 00:53:35.005 719 01:00:21.625 00:53:35.005 720 function timing_enter() { 01:00:21.625 00:53:35.005 ... 01:00:21.625 00:53:35.005 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:00:21.625 00:53:35.005 ... 01:00:21.625 00:53:35.005 11 # Pci bus hotplug 01:00:21.625 00:53:35.005 12 # Helper function to remove/attach cotrollers 01:00:21.625 00:53:35.005 13 debug_remove_attach_helper() { 01:00:21.625 00:53:35.005 14 local helper_time=0 01:00:21.625 00:53:35.005 15 01:00:21.625 00:53:35.005 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:00:21.625 00:53:35.005 17 printf '\''\'\'''\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\''\'\'''\'' \ 01:00:21.625 00:53:35.005 18 "$helper_time" "$nvme_count" >&2 01:00:21.625 00:53:35.005 19 } 01:00:21.625 00:53:35.005 20 01:00:21.625 00:53:35.005 21 remove_attach_helper() { 01:00:21.625 00:53:35.005 ... 01:00:21.625 00:53:35.005 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:00:21.625 00:53:35.005 ... 01:00:21.625 00:53:35.005 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:00:21.625 00:53:35.005 106 done 01:00:21.625 00:53:35.005 107 01:00:21.625 00:53:35.005 108 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.625 00:53:35.005 109 01:00:21.625 00:53:35.005 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.625 00:53:35.005 111 # Verify reregistering hotplug poller 01:00:21.625 00:53:35.005 112 rpc_cmd bdev_nvme_set_hotplug -d 01:00:21.625 00:53:35.005 113 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.625 00:53:35.005 114 01:00:21.625 00:53:35.005 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.625 00:53:35.005 ... 01:00:21.625 00:53:35.005 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:00:21.625 00:53:35.005 ... 01:00:21.625 00:53:35.005 133 01:00:21.625 00:53:35.005 134 # Run pci bus hotplug test 01:00:21.625 00:53:35.005 135 run_hotplug 01:00:21.625 00:53:35.005 136 01:00:21.625 00:53:35.005 137 # Run SPDK target based hotplug 01:00:21.625 00:53:35.005 => 138 tgt_run_hotplug 01:00:21.625 00:53:35.005 ... 01:00:21.625 00:53:35.005 01:00:21.625 00:53:35.005 ========== Backtrace end ========== 01:00:21.625 00:53:35.005 ========== Backtrace start: ========== 01:00:21.625 00:53:35.005 01:00:21.625 00:53:35.006 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:00:21.625 00:53:35.006 ... 01:00:21.625 00:53:35.006 710 01:00:21.625 00:53:35.006 711 # We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to 01:00:21.625 00:53:35.006 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 01:00:21.625 00:53:35.006 713 # but $() will return just the time'\''s data, hence making it possible to just do: 01:00:21.625 00:53:35.006 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:00:21.625 00:53:35.006 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:00:21.625 00:53:35.006 716 01:00:21.625 00:53:35.006 717 echo "$time" 01:00:21.625 00:53:35.006 718 ) 01:00:21.625 00:53:35.006 719 01:00:21.625 00:53:35.006 720 function timing_enter() { 01:00:21.625 00:53:35.006 ... 01:00:21.625 00:53:35.006 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:00:21.625 00:53:35.006 ... 01:00:21.625 00:53:35.006 11 # Pci bus hotplug 01:00:21.625 00:53:35.006 12 # Helper function to remove/attach cotrollers 01:00:21.625 00:53:35.006 13 debug_remove_attach_helper() { 01:00:21.625 00:53:35.006 14 local helper_time=0 01:00:21.625 00:53:35.006 15 01:00:21.625 00:53:35.006 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:00:21.625 00:53:35.006 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:00:21.625 00:53:35.006 18 "$helper_time" "$nvme_count" >&2 01:00:21.625 00:53:35.006 19 } 01:00:21.625 00:53:35.006 20 01:00:21.625 00:53:35.006 21 remove_attach_helper() { 01:00:21.625 00:53:35.006 ... 01:00:21.625 00:53:35.006 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:00:21.625 00:53:35.006 ... 01:00:21.625 00:53:35.006 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:00:21.625 00:53:35.006 106 done 01:00:21.625 00:53:35.006 107 01:00:21.625 00:53:35.006 108 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.625 00:53:35.006 109 01:00:21.625 00:53:35.006 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.625 00:53:35.006 111 # Verify reregistering hotplug poller 01:00:21.625 00:53:35.006 112 rpc_cmd bdev_nvme_set_hotplug -d 01:00:21.625 00:53:35.006 113 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.625 00:53:35.006 114 01:00:21.625 00:53:35.006 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.625 00:53:35.006 ... 01:00:21.625 00:53:35.006 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:00:21.625 00:53:35.006 ... 01:00:21.625 00:53:35.006 133 01:00:21.625 00:53:35.006 134 # Run pci bus hotplug test 01:00:21.625 00:53:35.006 135 run_hotplug 01:00:21.625 00:53:35.006 136 01:00:21.625 00:53:35.006 137 # Run SPDK target based hotplug 01:00:21.625 00:53:35.006 => 138 tgt_run_hotplug 01:00:21.625 00:53:35.006 ... 01:00:21.625 00:53:35.006 01:00:21.625 00:53:35.006 ========== Backtrace end ========== 01:00:21.625 00:53:35.006 ========== Backtrace start: ========== 01:00:21.625 00:53:35.006 01:00:21.626 00:53:35.006 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:00:21.626 00:53:35.006 ... 01:00:21.626 00:53:35.006 713 # but $() will return just the time'\''s data, hence making it possible to just do: 01:00:21.626 00:53:35.006 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:00:21.626 00:53:35.006 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:00:21.626 00:53:35.006 716 01:00:21.626 00:53:35.006 717 echo "$time" 01:00:21.626 00:53:35.006 => 718 ) 01:00:21.626 00:53:35.006 719 01:00:21.626 00:53:35.006 720 function timing_enter() { 01:00:21.626 00:53:35.006 721 xtrace_disable 01:00:21.626 00:53:35.006 722 timing "enter" "$1" 01:00:21.626 00:53:35.006 723 xtrace_restore 01:00:21.626 00:53:35.006 ... 01:00:21.626 00:53:35.006 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:00:21.626 00:53:35.006 ... 01:00:21.626 00:53:35.006 11 # Pci bus hotplug 01:00:21.626 00:53:35.006 12 # Helper function to remove/attach cotrollers 01:00:21.626 00:53:35.006 13 debug_remove_attach_helper() { 01:00:21.626 00:53:35.006 14 local helper_time=0 01:00:21.626 00:53:35.006 15 01:00:21.626 00:53:35.006 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:00:21.626 00:53:35.006 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:00:21.626 00:53:35.006 18 "$helper_time" "$nvme_count" >&2 01:00:21.626 00:53:35.006 19 } 01:00:21.626 00:53:35.006 20 01:00:21.626 00:53:35.006 21 remove_attach_helper() { 01:00:21.626 00:53:35.006 ... 01:00:21.626 00:53:35.006 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:00:21.626 00:53:35.006 ... 01:00:21.626 00:53:35.006 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:00:21.626 00:53:35.006 106 done 01:00:21.626 00:53:35.006 107 01:00:21.626 00:53:35.006 108 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.626 00:53:35.006 109 01:00:21.626 00:53:35.006 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.626 00:53:35.006 111 # Verify reregistering hotplug poller 01:00:21.626 00:53:35.006 112 rpc_cmd bdev_nvme_set_hotplug -d 01:00:21.626 00:53:35.006 113 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.626 00:53:35.006 114 01:00:21.626 00:53:35.006 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.626 00:53:35.006 ... 01:00:21.626 00:53:35.006 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:00:21.626 00:53:35.006 ... 01:00:21.626 00:53:35.006 133 01:00:21.626 00:53:35.006 134 # Run pci bus hotplug test 01:00:21.626 00:53:35.006 135 run_hotplug 01:00:21.626 00:53:35.006 136 01:00:21.626 00:53:35.006 137 # Run SPDK target based hotplug 01:00:21.626 00:53:35.006 => 138 tgt_run_hotplug 01:00:21.626 00:53:35.006 ... 01:00:21.626 00:53:35.006 01:00:21.626 00:53:35.006 ========== Backtrace end ========== 01:00:21.626 00:53:35.006 ========== Backtrace start: ========== 01:00:21.626 00:53:35.006 01:00:21.626 00:53:35.006 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:00:21.626 00:53:35.006 ... 01:00:21.626 00:53:35.006 11 # Pci bus hotplug 01:00:21.626 00:53:35.006 12 # Helper function to remove/attach cotrollers 01:00:21.626 00:53:35.006 13 debug_remove_attach_helper() { 01:00:21.626 00:53:35.006 14 local helper_time=0 01:00:21.626 00:53:35.006 15 01:00:21.626 00:53:35.006 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:00:21.626 00:53:35.006 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:00:21.626 00:53:35.006 18 "$helper_time" "$nvme_count" >&2 01:00:21.626 00:53:35.006 19 } 01:00:21.626 00:53:35.006 20 01:00:21.626 00:53:35.006 21 remove_attach_helper() { 01:00:21.626 00:53:35.006 ... 01:00:21.626 00:53:35.006 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:00:21.626 00:53:35.006 ... 01:00:21.626 00:53:35.006 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:00:21.626 00:53:35.006 106 done 01:00:21.626 00:53:35.006 107 01:00:21.626 00:53:35.006 108 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.626 00:53:35.006 109 01:00:21.626 00:53:35.006 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.626 00:53:35.006 111 # Verify reregistering hotplug poller 01:00:21.626 00:53:35.006 112 rpc_cmd bdev_nvme_set_hotplug -d 01:00:21.626 00:53:35.006 113 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.626 00:53:35.006 114 01:00:21.626 00:53:35.006 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.626 00:53:35.006 ... 01:00:21.626 00:53:35.006 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:00:21.626 00:53:35.006 ... 01:00:21.626 00:53:35.006 133 01:00:21.626 00:53:35.006 134 # Run pci bus hotplug test 01:00:21.626 00:53:35.006 135 run_hotplug 01:00:21.626 00:53:35.006 136 01:00:21.626 00:53:35.006 137 # Run SPDK target based hotplug 01:00:21.626 00:53:35.006 => 138 tgt_run_hotplug 01:00:21.626 00:53:35.006 ... 01:00:21.626 00:53:35.006 01:00:21.626 00:53:35.006 ========== Backtrace end ========== 01:00:21.626 00:53:36.506 ========== Backtrace start: ========== 01:00:21.626 00:53:36.506 01:00:21.626 00:53:36.506 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh"]) 01:00:21.626 00:53:36.506 ... 01:00:21.626 00:53:36.506 1117 timing_enter $test_name 01:00:21.626 00:53:36.506 1118 echo "************************************" 01:00:21.626 00:53:36.506 1119 echo "START TEST $test_name" 01:00:21.626 00:53:36.506 1120 echo "************************************" 01:00:21.626 00:53:36.506 1121 xtrace_restore 01:00:21.626 00:53:36.506 1122 time "$@" 01:00:21.626 00:53:36.506 1123 xtrace_disable 01:00:21.626 00:53:36.506 1124 echo "************************************" 01:00:21.626 00:53:36.506 1125 echo "END TEST $test_name" 01:00:21.626 00:53:36.506 1126 echo "************************************" 01:00:21.626 00:53:36.506 1127 timing_exit $test_name 01:00:21.626 00:53:36.506 ... 01:00:21.626 00:53:36.506 in /home/vagrant/spdk_repo/spdk/autotest.sh:240 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 01:00:21.626 00:53:36.506 ... 01:00:21.626 00:53:36.506 235 01:00:21.626 00:53:36.506 236 run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh 01:00:21.626 00:53:36.506 237 run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh 01:00:21.626 00:53:36.506 238 01:00:21.626 00:53:36.506 239 if [ $(uname -s) = Linux ]; then 01:00:21.626 00:53:36.506 => 240 run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh 01:00:21.626 00:53:36.506 241 fi 01:00:21.626 00:53:36.506 242 01:00:21.626 00:53:36.506 243 if [[ $SPDK_TEST_XNVME -eq 1 ]]; then 01:00:21.626 00:53:36.506 244 run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh 01:00:21.626 00:53:36.506 245 run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme" 01:00:21.626 00:53:36.506 ... 01:00:21.626 00:53:36.506 01:00:21.626 00:53:36.506 ========== Backtrace end ==========' 01:00:21.626 + [[ -n 00:53:35.005 03:45:39 sw_hotplug -- common/autotest_common.sh@715 -- # time='========== Backtrace start: ========== 01:00:21.626 00:53:35.005 01:00:21.626 00:53:35.005 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:00:21.626 00:53:35.005 ... 01:00:21.626 00:53:35.005 710 01:00:21.626 00:53:35.005 711 # We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to 01:00:21.626 00:53:35.005 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 01:00:21.626 00:53:35.005 713 # but $() will return just the time'\''s data, hence making it possible to just do: 01:00:21.626 00:53:35.005 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:00:21.626 00:53:35.005 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:00:21.626 00:53:35.005 716 01:00:21.626 00:53:35.005 717 echo "$time" 01:00:21.626 00:53:35.005 718 ) 01:00:21.626 00:53:35.005 719 01:00:21.626 00:53:35.005 720 function timing_enter() { 01:00:21.626 00:53:35.005 ... 01:00:21.626 00:53:35.005 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:00:21.626 00:53:35.005 ... 01:00:21.626 00:53:35.005 11 # Pci bus hotplug 01:00:21.626 00:53:35.005 12 # Helper function to remove/attach cotrollers 01:00:21.626 00:53:35.005 13 debug_remove_attach_helper() { 01:00:21.626 00:53:35.005 14 local helper_time=0 01:00:21.626 00:53:35.005 15 01:00:21.626 00:53:35.005 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:00:21.626 00:53:35.005 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:00:21.626 00:53:35.005 18 "$helper_time" "$nvme_count" >&2 01:00:21.626 00:53:35.005 19 } 01:00:21.626 00:53:35.005 20 01:00:21.626 00:53:35.005 21 remove_attach_helper() { 01:00:21.626 00:53:35.005 ... 01:00:21.626 00:53:35.005 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:00:21.626 00:53:35.005 ... 01:00:21.626 00:53:35.005 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:00:21.626 00:53:35.005 106 done 01:00:21.626 00:53:35.005 107 01:00:21.626 00:53:35.005 108 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.626 00:53:35.005 109 01:00:21.626 00:53:35.005 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.626 00:53:35.005 111 # Verify reregistering hotplug poller 01:00:21.626 00:53:35.005 112 rpc_cmd bdev_nvme_set_hotplug -d 01:00:21.626 00:53:35.005 113 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.626 00:53:35.005 114 01:00:21.626 00:53:35.005 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.626 00:53:35.005 ... 01:00:21.626 00:53:35.005 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:00:21.626 00:53:35.005 ... 01:00:21.626 00:53:35.005 133 01:00:21.626 00:53:35.005 134 # Run pci bus hotplug test 01:00:21.626 00:53:35.005 135 run_hotplug 01:00:21.626 00:53:35.005 136 01:00:21.626 00:53:35.005 137 # Run SPDK target based hotplug 01:00:21.626 00:53:35.005 => 138 tgt_run_hotplug 01:00:21.626 00:53:35.005 ... 01:00:21.626 00:53:35.005 01:00:21.626 00:53:35.005 ========== Backtrace end ========== 01:00:21.626 00:53:35.005 ========== Backtrace start: ========== 01:00:21.626 00:53:35.005 01:00:21.626 00:53:35.006 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:00:21.626 00:53:35.006 ... 01:00:21.626 00:53:35.006 710 01:00:21.626 00:53:35.006 711 # We redirect cmd's std{out,err} to a separate fd dup'ed to stdin's device (or /dev/null) to 01:00:21.627 00:53:35.006 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 01:00:21.627 00:53:35.006 713 # but $() will return just the time's data, hence making it possible to just do: 01:00:21.627 00:53:35.006 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:00:21.627 00:53:35.006 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:00:21.627 00:53:35.006 716 01:00:21.627 00:53:35.006 717 echo "$time" 01:00:21.627 00:53:35.006 718 ) 01:00:21.627 00:53:35.006 719 01:00:21.627 00:53:35.006 720 function timing_enter() { 01:00:21.627 00:53:35.006 ... 01:00:21.627 00:53:35.006 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:00:21.627 00:53:35.006 ... 01:00:21.627 00:53:35.006 11 # Pci bus hotplug 01:00:21.627 00:53:35.006 12 # Helper function to remove/attach cotrollers 01:00:21.627 00:53:35.006 13 debug_remove_attach_helper() { 01:00:21.627 00:53:35.006 14 local helper_time=0 01:00:21.627 00:53:35.006 15 01:00:21.627 00:53:35.006 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:00:21.627 00:53:35.006 17 printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \ 01:00:21.627 00:53:35.006 18 "$helper_time" "$nvme_count" >&2 01:00:21.627 00:53:35.006 19 } 01:00:21.627 00:53:35.006 20 01:00:21.627 00:53:35.006 21 remove_attach_helper() { 01:00:21.627 00:53:35.006 ... 01:00:21.627 00:53:35.006 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:00:21.627 00:53:35.006 ... 01:00:21.627 00:53:35.006 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:00:21.627 00:53:35.006 106 done 01:00:21.627 00:53:35.006 107 01:00:21.627 00:53:35.006 108 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.627 00:53:35.006 109 01:00:21.627 00:53:35.006 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.627 00:53:35.006 111 # Verify reregistering hotplug poller 01:00:21.627 00:53:35.006 112 rpc_cmd bdev_nvme_set_hotplug -d 01:00:21.627 00:53:35.006 113 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.627 00:53:35.006 114 01:00:21.627 00:53:35.006 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.627 00:53:35.006 ... 01:00:21.627 00:53:35.006 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:00:21.627 00:53:35.006 ... 01:00:21.627 00:53:35.006 133 01:00:21.627 00:53:35.006 134 # Run pci bus hotplug test 01:00:21.627 00:53:35.006 135 run_hotplug 01:00:21.627 00:53:35.006 136 01:00:21.627 00:53:35.006 137 # Run SPDK target based hotplug 01:00:21.627 00:53:35.006 => 138 tgt_run_hotplug 01:00:21.627 00:53:35.006 ... 01:00:21.627 00:53:35.006 01:00:21.627 00:53:35.006 ========== Backtrace end ========== 01:00:21.627 00:53:35.006 ========== Backtrace start: ========== 01:00:21.627 00:53:35.006 01:00:21.627 00:53:35.006 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:00:21.627 00:53:35.006 ... 01:00:21.627 00:53:35.006 713 # but $() will return just the time's data, hence making it possible to just do: 01:00:21.627 00:53:35.006 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:00:21.627 00:53:35.006 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:00:21.627 00:53:35.006 716 01:00:21.627 00:53:35.006 717 echo "$time" 01:00:21.627 00:53:35.006 => 718 ) 01:00:21.627 00:53:35.006 719 01:00:21.627 00:53:35.006 720 function timing_enter() { 01:00:21.627 00:53:35.006 721 xtrace_disable 01:00:21.627 00:53:35.006 722 timing "enter" "$1" 01:00:21.627 00:53:35.006 723 xtrace_restore 01:00:21.627 00:53:35.006 ... 01:00:21.627 00:53:35.006 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:00:21.627 00:53:35.006 ... 01:00:21.627 00:53:35.006 11 # Pci bus hotplug 01:00:21.627 00:53:35.006 12 # Helper function to remove/attach cotrollers 01:00:21.627 00:53:35.006 13 debug_remove_attach_helper() { 01:00:21.627 00:53:35.006 14 local helper_time=0 01:00:21.627 00:53:35.006 15 01:00:21.627 00:53:35.006 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:00:21.627 00:53:35.006 17 printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \ 01:00:21.627 00:53:35.006 18 "$helper_time" "$nvme_count" >&2 01:00:21.627 00:53:35.006 19 } 01:00:21.627 00:53:35.006 20 01:00:21.627 00:53:35.006 21 remove_attach_helper() { 01:00:21.627 00:53:35.006 ... 01:00:21.627 00:53:35.006 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:00:21.627 00:53:35.006 ... 01:00:21.627 00:53:35.006 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:00:21.627 00:53:35.006 106 done 01:00:21.627 00:53:35.006 107 01:00:21.627 00:53:35.006 108 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.627 00:53:35.006 109 01:00:21.627 00:53:35.006 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.627 00:53:35.006 111 # Verify reregistering hotplug poller 01:00:21.627 00:53:35.006 112 rpc_cmd bdev_nvme_set_hotplug -d 01:00:21.627 00:53:35.006 113 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.627 00:53:35.006 114 01:00:21.627 00:53:35.006 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.627 00:53:35.006 ... 01:00:21.627 00:53:35.006 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:00:21.627 00:53:35.006 ... 01:00:21.627 00:53:35.006 133 01:00:21.627 00:53:35.006 134 # Run pci bus hotplug test 01:00:21.627 00:53:35.006 135 run_hotplug 01:00:21.627 00:53:35.006 136 01:00:21.627 00:53:35.006 137 # Run SPDK target based hotplug 01:00:21.627 00:53:35.006 => 138 tgt_run_hotplug 01:00:21.627 00:53:35.006 ... 01:00:21.627 00:53:35.006 01:00:21.627 00:53:35.006 ========== Backtrace end ========== 01:00:21.627 00:53:35.006 ========== Backtrace start: ========== 01:00:21.627 00:53:35.006 01:00:21.627 00:53:35.006 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:00:21.627 00:53:35.006 ... 01:00:21.627 00:53:35.006 11 # Pci bus hotplug 01:00:21.627 00:53:35.006 12 # Helper function to remove/attach cotrollers 01:00:21.627 00:53:35.006 13 debug_remove_attach_helper() { 01:00:21.627 00:53:35.006 14 local helper_time=0 01:00:21.627 00:53:35.006 15 01:00:21.627 00:53:35.006 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:00:21.627 00:53:35.006 17 printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \ 01:00:21.627 00:53:35.006 18 "$helper_time" "$nvme_count" >&2 01:00:21.627 00:53:35.006 19 } 01:00:21.627 00:53:35.006 20 01:00:21.627 00:53:35.006 21 remove_attach_helper() { 01:00:21.627 00:53:35.006 ... 01:00:21.627 00:53:35.006 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:00:21.627 00:53:35.006 ... 01:00:21.627 00:53:35.006 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:00:21.627 00:53:35.006 106 done 01:00:21.627 00:53:35.006 107 01:00:21.627 00:53:35.006 108 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.627 00:53:35.006 109 01:00:21.627 00:53:35.006 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.627 00:53:35.006 111 # Verify reregistering hotplug poller 01:00:21.627 00:53:35.006 112 rpc_cmd bdev_nvme_set_hotplug -d 01:00:21.627 00:53:35.006 113 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.627 00:53:35.006 114 01:00:21.627 00:53:35.006 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.627 00:53:35.006 ... 01:00:21.627 00:53:35.006 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:00:21.627 00:53:35.006 ... 01:00:21.627 00:53:35.006 133 01:00:21.627 00:53:35.006 134 # Run pci bus hotplug test 01:00:21.627 00:53:35.006 135 run_hotplug 01:00:21.627 00:53:35.006 136 01:00:21.627 00:53:35.006 137 # Run SPDK target based hotplug 01:00:21.627 00:53:35.006 => 138 tgt_run_hotplug 01:00:21.627 00:53:35.006 ... 01:00:21.627 00:53:35.006 01:00:21.627 00:53:35.006 ========== Backtrace end ========== 01:00:21.627 00:53:36.506 ========== Backtrace start: ========== 01:00:21.627 00:53:36.506 01:00:21.627 00:53:36.506 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh"]) 01:00:21.627 00:53:36.506 ... 01:00:21.627 00:53:36.506 1117 timing_enter $test_name 01:00:21.627 00:53:36.506 1118 echo "************************************" 01:00:21.627 00:53:36.506 1119 echo "START TEST $test_name" 01:00:21.627 00:53:36.506 1120 echo "************************************" 01:00:21.627 00:53:36.506 1121 xtrace_restore 01:00:21.627 00:53:36.506 1122 time "$@" 01:00:21.627 00:53:36.506 1123 xtrace_disable 01:00:21.627 00:53:36.506 1124 echo "************************************" 01:00:21.627 00:53:36.506 1125 echo "END TEST $test_name" 01:00:21.627 00:53:36.506 1126 echo "************************************" 01:00:21.627 00:53:36.506 1127 timing_exit $test_name 01:00:21.627 00:53:36.506 ... 01:00:21.627 00:53:36.506 in /home/vagrant/spdk_repo/spdk/autotest.sh:240 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 01:00:21.627 00:53:36.506 ... 01:00:21.627 00:53:36.506 235 01:00:21.627 00:53:36.506 236 run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh 01:00:21.627 00:53:36.506 237 run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh 01:00:21.627 00:53:36.506 238 01:00:21.627 00:53:36.506 239 if [ $(uname -s) = Linux ]; then 01:00:21.627 00:53:36.506 => 240 run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh 01:00:21.627 00:53:36.506 241 fi 01:00:21.627 00:53:36.506 242 01:00:21.627 00:53:36.506 243 if [[ $SPDK_TEST_XNVME -eq 1 ]]; then 01:00:21.627 00:53:36.506 244 run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh 01:00:21.627 00:53:36.506 245 run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme" 01:00:21.627 00:53:36.506 ... 01:00:21.627 00:53:36.506 01:00:21.627 00:53:36.506 ========== Backtrace end ========== ]] 01:00:21.627 + echo '00:53:35.005 03:45:39 sw_hotplug -- common/autotest_common.sh@715 -- # time='\''========== Backtrace start: ========== 01:00:21.627 00:53:35.005 01:00:21.627 00:53:35.005 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:00:21.627 00:53:35.005 ... 01:00:21.627 00:53:35.005 710 01:00:21.627 00:53:35.005 711 # We redirect cmd'\''\'\'''\''s std{out,err} to a separate fd dup'\''\'\'''\''ed to stdin'\''\'\'''\''s device (or /dev/null) to 01:00:21.627 00:53:35.005 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 01:00:21.627 00:53:35.005 713 # but $() will return just the time'\''\'\'''\''s data, hence making it possible to just do: 01:00:21.627 00:53:35.005 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:00:21.628 00:53:35.005 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:00:21.628 00:53:35.005 716 01:00:21.628 00:53:35.005 717 echo "$time" 01:00:21.628 00:53:35.005 718 ) 01:00:21.628 00:53:35.005 719 01:00:21.628 00:53:35.005 720 function timing_enter() { 01:00:21.628 00:53:35.005 ... 01:00:21.628 00:53:35.005 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:00:21.628 00:53:35.005 ... 01:00:21.628 00:53:35.005 11 # Pci bus hotplug 01:00:21.628 00:53:35.005 12 # Helper function to remove/attach cotrollers 01:00:21.628 00:53:35.005 13 debug_remove_attach_helper() { 01:00:21.628 00:53:35.005 14 local helper_time=0 01:00:21.628 00:53:35.005 15 01:00:21.628 00:53:35.005 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:00:21.628 00:53:35.005 17 printf '\''\'\'''\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\''\'\'''\'' \ 01:00:21.628 00:53:35.005 18 "$helper_time" "$nvme_count" >&2 01:00:21.628 00:53:35.005 19 } 01:00:21.628 00:53:35.005 20 01:00:21.628 00:53:35.005 21 remove_attach_helper() { 01:00:21.628 00:53:35.005 ... 01:00:21.628 00:53:35.005 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:00:21.628 00:53:35.005 ... 01:00:21.628 00:53:35.005 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:00:21.628 00:53:35.005 106 done 01:00:21.628 00:53:35.005 107 01:00:21.628 00:53:35.005 108 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.628 00:53:35.005 109 01:00:21.628 00:53:35.005 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.628 00:53:35.005 111 # Verify reregistering hotplug poller 01:00:21.628 00:53:35.005 112 rpc_cmd bdev_nvme_set_hotplug -d 01:00:21.628 00:53:35.005 113 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.628 00:53:35.005 114 01:00:21.628 00:53:35.005 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.628 00:53:35.005 ... 01:00:21.628 00:53:35.005 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:00:21.628 00:53:35.005 ... 01:00:21.628 00:53:35.005 133 01:00:21.628 00:53:35.005 134 # Run pci bus hotplug test 01:00:21.628 00:53:35.005 135 run_hotplug 01:00:21.628 00:53:35.005 136 01:00:21.628 00:53:35.005 137 # Run SPDK target based hotplug 01:00:21.628 00:53:35.005 => 138 tgt_run_hotplug 01:00:21.628 00:53:35.005 ... 01:00:21.628 00:53:35.005 01:00:21.628 00:53:35.005 ========== Backtrace end ========== 01:00:21.628 00:53:35.005 ========== Backtrace start: ========== 01:00:21.628 00:53:35.005 01:00:21.628 00:53:35.006 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:00:21.628 00:53:35.006 ... 01:00:21.628 00:53:35.006 710 01:00:21.628 00:53:35.006 711 # We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to 01:00:21.628 00:53:35.006 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 01:00:21.628 00:53:35.006 713 # but $() will return just the time'\''s data, hence making it possible to just do: 01:00:21.628 00:53:35.006 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:00:21.628 00:53:35.006 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:00:21.628 00:53:35.006 716 01:00:21.628 00:53:35.006 717 echo "$time" 01:00:21.628 00:53:35.006 718 ) 01:00:21.628 00:53:35.006 719 01:00:21.628 00:53:35.006 720 function timing_enter() { 01:00:21.628 00:53:35.006 ... 01:00:21.628 00:53:35.006 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:00:21.628 00:53:35.006 ... 01:00:21.628 00:53:35.006 11 # Pci bus hotplug 01:00:21.628 00:53:35.006 12 # Helper function to remove/attach cotrollers 01:00:21.628 00:53:35.006 13 debug_remove_attach_helper() { 01:00:21.628 00:53:35.006 14 local helper_time=0 01:00:21.628 00:53:35.006 15 01:00:21.628 00:53:35.006 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:00:21.628 00:53:35.006 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:00:21.628 00:53:35.006 18 "$helper_time" "$nvme_count" >&2 01:00:21.628 00:53:35.006 19 } 01:00:21.628 00:53:35.006 20 01:00:21.628 00:53:35.006 21 remove_attach_helper() { 01:00:21.628 00:53:35.006 ... 01:00:21.628 00:53:35.006 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:00:21.628 00:53:35.006 ... 01:00:21.628 00:53:35.006 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:00:21.628 00:53:35.006 106 done 01:00:21.628 00:53:35.006 107 01:00:21.628 00:53:35.006 108 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.628 00:53:35.006 109 01:00:21.628 00:53:35.006 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.628 00:53:35.006 111 # Verify reregistering hotplug poller 01:00:21.628 00:53:35.006 112 rpc_cmd bdev_nvme_set_hotplug -d 01:00:21.628 00:53:35.006 113 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.628 00:53:35.006 114 01:00:21.628 00:53:35.006 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.628 00:53:35.006 ... 01:00:21.628 00:53:35.006 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:00:21.628 00:53:35.006 ... 01:00:21.628 00:53:35.006 133 01:00:21.628 00:53:35.006 134 # Run pci bus hotplug test 01:00:21.628 00:53:35.006 135 run_hotplug 01:00:21.628 00:53:35.006 136 01:00:21.628 00:53:35.006 137 # Run SPDK target based hotplug 01:00:21.628 00:53:35.006 => 138 tgt_run_hotplug 01:00:21.628 00:53:35.006 ... 01:00:21.628 00:53:35.006 01:00:21.628 00:53:35.006 ========== Backtrace end ========== 01:00:21.628 00:53:35.006 ========== Backtrace start: ========== 01:00:21.628 00:53:35.006 01:00:21.628 00:53:35.006 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:00:21.628 00:53:35.006 ... 01:00:21.628 00:53:35.006 713 # but $() will return just the time'\''s data, hence making it possible to just do: 01:00:21.628 00:53:35.006 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:00:21.628 00:53:35.006 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:00:21.628 00:53:35.006 716 01:00:21.628 00:53:35.006 717 echo "$time" 01:00:21.628 00:53:35.006 => 718 ) 01:00:21.628 00:53:35.006 719 01:00:21.628 00:53:35.006 720 function timing_enter() { 01:00:21.628 00:53:35.006 721 xtrace_disable 01:00:21.628 00:53:35.006 722 timing "enter" "$1" 01:00:21.628 00:53:35.006 723 xtrace_restore 01:00:21.628 00:53:35.006 ... 01:00:21.628 00:53:35.006 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:00:21.628 00:53:35.006 ... 01:00:21.628 00:53:35.006 11 # Pci bus hotplug 01:00:21.628 00:53:35.006 12 # Helper function to remove/attach cotrollers 01:00:21.628 00:53:35.006 13 debug_remove_attach_helper() { 01:00:21.628 00:53:35.006 14 local helper_time=0 01:00:21.628 00:53:35.006 15 01:00:21.628 00:53:35.006 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:00:21.628 00:53:35.006 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:00:21.628 00:53:35.006 18 "$helper_time" "$nvme_count" >&2 01:00:21.628 00:53:35.006 19 } 01:00:21.628 00:53:35.006 20 01:00:21.628 00:53:35.006 21 remove_attach_helper() { 01:00:21.628 00:53:35.006 ... 01:00:21.628 00:53:35.006 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:00:21.628 00:53:35.006 ... 01:00:21.628 00:53:35.006 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:00:21.628 00:53:35.006 106 done 01:00:21.628 00:53:35.006 107 01:00:21.628 00:53:35.006 108 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.628 00:53:35.006 109 01:00:21.628 00:53:35.006 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.628 00:53:35.006 111 # Verify reregistering hotplug poller 01:00:21.628 00:53:35.006 112 rpc_cmd bdev_nvme_set_hotplug -d 01:00:21.628 00:53:35.006 113 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.628 00:53:35.006 114 01:00:21.628 00:53:35.006 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.628 00:53:35.006 ... 01:00:21.628 00:53:35.006 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:00:21.628 00:53:35.006 ... 01:00:21.628 00:53:35.006 133 01:00:21.628 00:53:35.006 134 # Run pci bus hotplug test 01:00:21.628 00:53:35.006 135 run_hotplug 01:00:21.628 00:53:35.006 136 01:00:21.628 00:53:35.006 137 # Run SPDK target based hotplug 01:00:21.628 00:53:35.006 => 138 tgt_run_hotplug 01:00:21.628 00:53:35.006 ... 01:00:21.628 00:53:35.006 01:00:21.628 00:53:35.006 ========== Backtrace end ========== 01:00:21.628 00:53:35.006 ========== Backtrace start: ========== 01:00:21.628 00:53:35.006 01:00:21.628 00:53:35.006 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:00:21.628 00:53:35.006 ... 01:00:21.628 00:53:35.006 11 # Pci bus hotplug 01:00:21.628 00:53:35.006 12 # Helper function to remove/attach cotrollers 01:00:21.628 00:53:35.006 13 debug_remove_attach_helper() { 01:00:21.628 00:53:35.006 14 local helper_time=0 01:00:21.628 00:53:35.006 15 01:00:21.628 00:53:35.006 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:00:21.628 00:53:35.006 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:00:21.628 00:53:35.006 18 "$helper_time" "$nvme_count" >&2 01:00:21.628 00:53:35.006 19 } 01:00:21.628 00:53:35.006 20 01:00:21.628 00:53:35.006 21 remove_attach_helper() { 01:00:21.628 00:53:35.006 ... 01:00:21.628 00:53:35.006 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:00:21.628 00:53:35.006 ... 01:00:21.628 00:53:35.006 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:00:21.628 00:53:35.006 106 done 01:00:21.628 00:53:35.006 107 01:00:21.628 00:53:35.006 108 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.628 00:53:35.006 109 01:00:21.628 00:53:35.006 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.628 00:53:35.006 111 # Verify reregistering hotplug poller 01:00:21.628 00:53:35.006 112 rpc_cmd bdev_nvme_set_hotplug -d 01:00:21.628 00:53:35.006 113 rpc_cmd bdev_nvme_set_hotplug -e 01:00:21.628 00:53:35.006 114 01:00:21.628 00:53:35.006 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:00:21.628 00:53:35.006 ... 01:00:21.628 00:53:35.006 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:00:21.628 00:53:35.006 ... 01:00:21.628 00:53:35.006 133 01:00:21.628 00:53:35.006 134 # Run pci bus hotplug test 01:00:21.628 00:53:35.006 135 run_hotplug 01:00:21.628 00:53:35.006 136 01:00:21.629 00:53:35.006 137 # Run SPDK target based hotplug 01:00:21.629 00:53:35.006 => 138 tgt_run_hotplug 01:00:21.629 00:53:35.006 ... 01:00:21.629 00:53:35.006 01:00:21.629 00:53:35.006 ========== Backtrace end ========== 01:00:21.629 00:53:36.506 ========== Backtrace start: ========== 01:00:21.629 00:53:36.506 01:00:21.629 00:53:36.506 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh"]) 01:00:21.629 00:53:36.506 ... 01:00:21.629 00:53:36.506 1117 timing_enter $test_name 01:00:21.629 00:53:36.506 1118 echo "************************************" 01:00:21.629 00:53:36.506 1119 echo "START TEST $test_name" 01:00:21.629 00:53:36.506 1120 echo "************************************" 01:00:21.629 00:53:36.506 1121 xtrace_restore 01:00:21.629 00:53:36.506 1122 time "$@" 01:00:21.629 00:53:36.506 1123 xtrace_disable 01:00:21.629 00:53:36.506 1124 echo "************************************" 01:00:21.629 00:53:36.506 1125 echo "END TEST $test_name" 01:00:21.629 00:53:36.506 1126 echo "************************************" 01:00:21.629 00:53:36.506 1127 timing_exit $test_name 01:00:21.629 00:53:36.506 ... 01:00:21.629 00:53:36.506 in /home/vagrant/spdk_repo/spdk/autotest.sh:240 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 01:00:21.629 00:53:36.506 ... 01:00:21.629 00:53:36.506 235 01:00:21.629 00:53:36.506 236 run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh 01:00:21.629 00:53:36.506 237 run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh 01:00:21.629 00:53:36.506 238 01:00:21.629 00:53:36.506 239 if [ $(uname -s) = Linux ]; then 01:00:21.629 00:53:36.506 => 240 run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh 01:00:21.629 00:53:36.506 241 fi 01:00:21.629 00:53:36.506 242 01:00:21.629 00:53:36.506 243 if [[ $SPDK_TEST_XNVME -eq 1 ]]; then 01:00:21.629 00:53:36.506 244 run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh 01:00:21.629 00:53:36.506 245 run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme" 01:00:21.629 00:53:36.506 ... 01:00:21.629 00:53:36.506 01:00:21.629 00:53:36.506 ========== Backtrace end ==========' 01:00:21.629 + for build in "${build_log_list[@]}" 01:00:21.629 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/unittest-valgrind-docker-autotest_19841/build.log 01:00:21.629 + local build_log job_name start_pattern end_pattern backtraces 01:00:21.629 + build_log=/var/jenkins/workspace/autotest-per-patch_5/unittest-valgrind-docker-autotest_19841/build.log 01:00:21.629 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/unittest-valgrind-docker-autotest_19841/build.log 01:00:21.629 ++ basename /var/jenkins/workspace/autotest-per-patch_5/unittest-valgrind-docker-autotest_19841 01:00:21.629 + job_name=unittest-valgrind-docker-autotest_19841 01:00:21.629 + start_pattern='Backtrace start' 01:00:21.629 + end_pattern='Backtrace end' 01:00:21.629 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/unittest-valgrind-docker-autotest_19841/build.log ]] 01:00:21.629 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/unittest-valgrind-docker-autotest_19841/build.log 01:00:21.629 + backtraces= 01:00:21.629 + [[ -n '' ]] 01:00:21.629 + for build in "${build_log_list[@]}" 01:00:21.629 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/lvol-vg-autotest_77401/build.log 01:00:21.629 + local build_log job_name start_pattern end_pattern backtraces 01:00:21.629 + build_log=/var/jenkins/workspace/autotest-per-patch_5/lvol-vg-autotest_77401/build.log 01:00:21.629 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/lvol-vg-autotest_77401/build.log 01:00:21.629 ++ basename /var/jenkins/workspace/autotest-per-patch_5/lvol-vg-autotest_77401 01:00:21.629 + job_name=lvol-vg-autotest_77401 01:00:21.629 + start_pattern='Backtrace start' 01:00:21.629 + end_pattern='Backtrace end' 01:00:21.629 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/lvol-vg-autotest_77401/build.log ]] 01:00:21.629 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/lvol-vg-autotest_77401/build.log 01:00:21.629 + backtraces= 01:00:21.629 + [[ -n '' ]] 01:00:21.629 + for build in "${build_log_list[@]}" 01:00:21.629 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/packaging-docker-autotest_19839/build.log 01:00:21.629 + local build_log job_name start_pattern end_pattern backtraces 01:00:21.629 + build_log=/var/jenkins/workspace/autotest-per-patch_5/packaging-docker-autotest_19839/build.log 01:00:21.629 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/packaging-docker-autotest_19839/build.log 01:00:21.629 ++ basename /var/jenkins/workspace/autotest-per-patch_5/packaging-docker-autotest_19839 01:00:21.629 + job_name=packaging-docker-autotest_19839 01:00:21.629 + start_pattern='Backtrace start' 01:00:21.629 + end_pattern='Backtrace end' 01:00:21.629 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/packaging-docker-autotest_19839/build.log ]] 01:00:21.629 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/packaging-docker-autotest_19839/build.log 01:00:21.629 + backtraces= 01:00:21.629 + [[ -n '' ]] 01:00:21.629 + for build in "${build_log_list[@]}" 01:00:21.629 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/check-so-deps-docker-autotest_22133/build.log 01:00:21.629 + local build_log job_name start_pattern end_pattern backtraces 01:00:21.629 + build_log=/var/jenkins/workspace/autotest-per-patch_5/check-so-deps-docker-autotest_22133/build.log 01:00:21.629 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/check-so-deps-docker-autotest_22133/build.log 01:00:21.629 ++ basename /var/jenkins/workspace/autotest-per-patch_5/check-so-deps-docker-autotest_22133 01:00:21.629 + job_name=check-so-deps-docker-autotest_22133 01:00:21.629 + start_pattern='Backtrace start' 01:00:21.629 + end_pattern='Backtrace end' 01:00:21.629 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/check-so-deps-docker-autotest_22133/build.log ]] 01:00:21.629 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/check-so-deps-docker-autotest_22133/build.log 01:00:21.629 + backtraces= 01:00:21.629 + [[ -n '' ]] 01:00:21.629 + for build in "${build_log_list[@]}" 01:00:21.629 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/BlobFS-phy-autotest_26178/build.log 01:00:21.629 + local build_log job_name start_pattern end_pattern backtraces 01:00:21.629 + build_log=/var/jenkins/workspace/autotest-per-patch_5/BlobFS-phy-autotest_26178/build.log 01:00:21.629 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/BlobFS-phy-autotest_26178/build.log 01:00:21.629 ++ basename /var/jenkins/workspace/autotest-per-patch_5/BlobFS-phy-autotest_26178 01:00:21.629 + job_name=BlobFS-phy-autotest_26178 01:00:21.629 + start_pattern='Backtrace start' 01:00:21.629 + end_pattern='Backtrace end' 01:00:21.629 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/BlobFS-phy-autotest_26178/build.log ]] 01:00:21.629 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/BlobFS-phy-autotest_26178/build.log 01:00:21.629 + backtraces= 01:00:21.629 + [[ -n '' ]] 01:00:21.629 + for build in "${build_log_list[@]}" 01:00:21.629 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/build-files-docker-autotest_22109/build.log 01:00:21.629 + local build_log job_name start_pattern end_pattern backtraces 01:00:21.629 + build_log=/var/jenkins/workspace/autotest-per-patch_5/build-files-docker-autotest_22109/build.log 01:00:21.629 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/build-files-docker-autotest_22109/build.log 01:00:21.629 ++ basename /var/jenkins/workspace/autotest-per-patch_5/build-files-docker-autotest_22109 01:00:21.629 + job_name=build-files-docker-autotest_22109 01:00:21.629 + start_pattern='Backtrace start' 01:00:21.629 + end_pattern='Backtrace end' 01:00:21.629 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/build-files-docker-autotest_22109/build.log ]] 01:00:21.629 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/build-files-docker-autotest_22109/build.log 01:00:21.629 + backtraces= 01:00:21.629 + [[ -n '' ]] 01:00:21.629 + for build in "${build_log_list[@]}" 01:00:21.629 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/nvmf-phy-autotest_72416/build.log 01:00:21.629 + local build_log job_name start_pattern end_pattern backtraces 01:00:21.629 + build_log=/var/jenkins/workspace/autotest-per-patch_5/nvmf-phy-autotest_72416/build.log 01:00:21.629 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/nvmf-phy-autotest_72416/build.log 01:00:21.629 ++ basename /var/jenkins/workspace/autotest-per-patch_5/nvmf-phy-autotest_72416 01:00:21.629 + job_name=nvmf-phy-autotest_72416 01:00:21.629 + start_pattern='Backtrace start' 01:00:21.629 + end_pattern='Backtrace end' 01:00:21.629 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/nvmf-phy-autotest_72416/build.log ]] 01:00:21.629 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/nvmf-phy-autotest_72416/build.log 01:00:21.629 + backtraces= 01:00:21.629 + [[ -n '' ]] 01:00:21.629 + for build in "${build_log_list[@]}" 01:00:21.629 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/freebsd-vg-autotest_59100/build.log 01:00:21.629 + local build_log job_name start_pattern end_pattern backtraces 01:00:21.629 + build_log=/var/jenkins/workspace/autotest-per-patch_5/freebsd-vg-autotest_59100/build.log 01:00:21.629 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/freebsd-vg-autotest_59100/build.log 01:00:21.629 ++ basename /var/jenkins/workspace/autotest-per-patch_5/freebsd-vg-autotest_59100 01:00:21.629 + job_name=freebsd-vg-autotest_59100 01:00:21.629 + start_pattern='Backtrace start' 01:00:21.629 + end_pattern='Backtrace end' 01:00:21.629 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/freebsd-vg-autotest_59100/build.log ]] 01:00:21.629 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/freebsd-vg-autotest_59100/build.log 01:00:21.629 + backtraces= 01:00:21.630 + [[ -n '' ]] 01:00:21.630 + for build in "${build_log_list[@]}" 01:00:21.630 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/nvme-phy-autotest_72344/build.log 01:00:21.630 + local build_log job_name start_pattern end_pattern backtraces 01:00:21.630 + build_log=/var/jenkins/workspace/autotest-per-patch_5/nvme-phy-autotest_72344/build.log 01:00:21.630 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/nvme-phy-autotest_72344/build.log 01:00:21.630 ++ basename /var/jenkins/workspace/autotest-per-patch_5/nvme-phy-autotest_72344 01:00:21.630 + job_name=nvme-phy-autotest_72344 01:00:21.630 + start_pattern='Backtrace start' 01:00:21.630 + end_pattern='Backtrace end' 01:00:21.630 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/nvme-phy-autotest_72344/build.log ]] 01:00:21.630 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/nvme-phy-autotest_72344/build.log 01:00:21.630 + backtraces= 01:00:21.630 + [[ -n '' ]] 01:00:21.630 + for build in "${build_log_list[@]}" 01:00:21.630 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-phy-autotest_72303/build.log 01:00:21.630 + local build_log job_name start_pattern end_pattern backtraces 01:00:21.630 + build_log=/var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-phy-autotest_72303/build.log 01:00:21.630 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-phy-autotest_72303/build.log 01:00:21.630 ++ basename /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-phy-autotest_72303 01:00:21.630 + job_name=nvmf-tcp-phy-autotest_72303 01:00:21.630 + start_pattern='Backtrace start' 01:00:21.630 + end_pattern='Backtrace end' 01:00:21.630 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-phy-autotest_72303/build.log ]] 01:00:21.630 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-phy-autotest_72303/build.log 01:00:21.630 + backtraces= 01:00:21.630 + [[ -n '' ]] 01:00:21.630 + for build in "${build_log_list[@]}" 01:00:21.630 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/nvme-cmb-pmr-vg-autotest_78575/build.log 01:00:21.630 + local build_log job_name start_pattern end_pattern backtraces 01:00:21.630 + build_log=/var/jenkins/workspace/autotest-per-patch_5/nvme-cmb-pmr-vg-autotest_78575/build.log 01:00:21.630 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/nvme-cmb-pmr-vg-autotest_78575/build.log 01:00:21.630 ++ basename /var/jenkins/workspace/autotest-per-patch_5/nvme-cmb-pmr-vg-autotest_78575 01:00:21.630 + job_name=nvme-cmb-pmr-vg-autotest_78575 01:00:21.630 + start_pattern='Backtrace start' 01:00:21.630 + end_pattern='Backtrace end' 01:00:21.630 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/nvme-cmb-pmr-vg-autotest_78575/build.log ]] 01:00:21.630 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/nvme-cmb-pmr-vg-autotest_78575/build.log 01:00:21.630 + backtraces= 01:00:21.630 + [[ -n '' ]] 01:00:21.630 + for build in "${build_log_list[@]}" 01:00:21.630 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/rocky9-vg-autotest_16062/build.log 01:00:21.630 + local build_log job_name start_pattern end_pattern backtraces 01:00:21.630 + build_log=/var/jenkins/workspace/autotest-per-patch_5/rocky9-vg-autotest_16062/build.log 01:00:21.630 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/rocky9-vg-autotest_16062/build.log 01:00:21.630 ++ basename /var/jenkins/workspace/autotest-per-patch_5/rocky9-vg-autotest_16062 01:00:21.630 + job_name=rocky9-vg-autotest_16062 01:00:21.630 + start_pattern='Backtrace start' 01:00:21.630 + end_pattern='Backtrace end' 01:00:21.630 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/rocky9-vg-autotest_16062/build.log ]] 01:00:21.630 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/rocky9-vg-autotest_16062/build.log 01:00:21.630 + backtraces= 01:00:21.630 + [[ -n '' ]] 01:00:21.630 + for build in "${build_log_list[@]}" 01:00:21.630 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/ubuntu22-vg-autotest_37785/build.log 01:00:21.630 + local build_log job_name start_pattern end_pattern backtraces 01:00:21.630 + build_log=/var/jenkins/workspace/autotest-per-patch_5/ubuntu22-vg-autotest_37785/build.log 01:00:21.630 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/ubuntu22-vg-autotest_37785/build.log 01:00:21.630 ++ basename /var/jenkins/workspace/autotest-per-patch_5/ubuntu22-vg-autotest_37785 01:00:21.630 + job_name=ubuntu22-vg-autotest_37785 01:00:21.630 + start_pattern='Backtrace start' 01:00:21.630 + end_pattern='Backtrace end' 01:00:21.630 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/ubuntu22-vg-autotest_37785/build.log ]] 01:00:21.630 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/ubuntu22-vg-autotest_37785/build.log 01:00:21.630 + backtraces= 01:00:21.630 + [[ -n '' ]] 01:00:21.630 + for build in "${build_log_list[@]}" 01:00:21.630 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/scan-build-docker-autotest_19840/build.log 01:00:21.630 + local build_log job_name start_pattern end_pattern backtraces 01:00:21.630 + build_log=/var/jenkins/workspace/autotest-per-patch_5/scan-build-docker-autotest_19840/build.log 01:00:21.630 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/scan-build-docker-autotest_19840/build.log 01:00:21.630 ++ basename /var/jenkins/workspace/autotest-per-patch_5/scan-build-docker-autotest_19840 01:00:21.630 + job_name=scan-build-docker-autotest_19840 01:00:21.630 + start_pattern='Backtrace start' 01:00:21.630 + end_pattern='Backtrace end' 01:00:21.630 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/scan-build-docker-autotest_19840/build.log ]] 01:00:21.630 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/scan-build-docker-autotest_19840/build.log 01:00:21.630 + backtraces= 01:00:21.630 + [[ -n '' ]] 01:00:21.630 + for build in "${build_log_list[@]}" 01:00:21.630 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/unittest-clang-docker-autotest_19837/build.log 01:00:21.630 + local build_log job_name start_pattern end_pattern backtraces 01:00:21.630 + build_log=/var/jenkins/workspace/autotest-per-patch_5/unittest-clang-docker-autotest_19837/build.log 01:00:21.630 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/unittest-clang-docker-autotest_19837/build.log 01:00:21.630 ++ basename /var/jenkins/workspace/autotest-per-patch_5/unittest-clang-docker-autotest_19837 01:00:21.890 + job_name=unittest-clang-docker-autotest_19837 01:00:21.890 + start_pattern='Backtrace start' 01:00:21.890 + end_pattern='Backtrace end' 01:00:21.890 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/unittest-clang-docker-autotest_19837/build.log ]] 01:00:21.890 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/unittest-clang-docker-autotest_19837/build.log 01:00:21.890 + backtraces= 01:00:21.890 + [[ -n '' ]] 01:00:21.890 + for build in "${build_log_list[@]}" 01:00:21.890 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/crypto-phy-autotest_26172/build.log 01:00:21.890 + local build_log job_name start_pattern end_pattern backtraces 01:00:21.890 + build_log=/var/jenkins/workspace/autotest-per-patch_5/crypto-phy-autotest_26172/build.log 01:00:21.890 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/crypto-phy-autotest_26172/build.log 01:00:21.890 ++ basename /var/jenkins/workspace/autotest-per-patch_5/crypto-phy-autotest_26172 01:00:21.890 + job_name=crypto-phy-autotest_26172 01:00:21.890 + start_pattern='Backtrace start' 01:00:21.890 + end_pattern='Backtrace end' 01:00:21.890 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/crypto-phy-autotest_26172/build.log ]] 01:00:21.890 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/crypto-phy-autotest_26172/build.log 01:00:21.890 + backtraces= 01:00:21.890 + [[ -n '' ]] 01:00:21.890 + for build in "${build_log_list[@]}" 01:00:21.890 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/doc-docker-autotest_22300/build.log 01:00:21.890 + local build_log job_name start_pattern end_pattern backtraces 01:00:21.890 + build_log=/var/jenkins/workspace/autotest-per-patch_5/doc-docker-autotest_22300/build.log 01:00:21.890 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/doc-docker-autotest_22300/build.log 01:00:21.890 ++ basename /var/jenkins/workspace/autotest-per-patch_5/doc-docker-autotest_22300 01:00:21.890 + job_name=doc-docker-autotest_22300 01:00:21.890 + start_pattern='Backtrace start' 01:00:21.890 + end_pattern='Backtrace end' 01:00:21.890 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/doc-docker-autotest_22300/build.log ]] 01:00:21.890 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/doc-docker-autotest_22300/build.log 01:00:21.890 + backtraces= 01:00:21.890 + [[ -n '' ]] 01:00:21.890 + for build in "${build_log_list[@]}" 01:00:21.890 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-uring-vg-autotest_77377/build.log 01:00:21.890 + local build_log job_name start_pattern end_pattern backtraces 01:00:21.890 + build_log=/var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-uring-vg-autotest_77377/build.log 01:00:21.891 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-uring-vg-autotest_77377/build.log 01:00:21.891 ++ basename /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-uring-vg-autotest_77377 01:00:21.891 + job_name=nvmf-tcp-uring-vg-autotest_77377 01:00:21.891 + start_pattern='Backtrace start' 01:00:21.891 + end_pattern='Backtrace end' 01:00:21.891 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-uring-vg-autotest_77377/build.log ]] 01:00:21.891 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-uring-vg-autotest_77377/build.log 01:00:21.891 + backtraces= 01:00:21.891 + [[ -n '' ]] 01:00:21.891 + for build in "${build_log_list[@]}" 01:00:21.891 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/vfio-user-phy-autotest_26180/build.log 01:00:21.891 + local build_log job_name start_pattern end_pattern backtraces 01:00:21.891 + build_log=/var/jenkins/workspace/autotest-per-patch_5/vfio-user-phy-autotest_26180/build.log 01:00:21.891 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/vfio-user-phy-autotest_26180/build.log 01:00:21.891 ++ basename /var/jenkins/workspace/autotest-per-patch_5/vfio-user-phy-autotest_26180 01:00:21.891 + job_name=vfio-user-phy-autotest_26180 01:00:21.891 + start_pattern='Backtrace start' 01:00:21.891 + end_pattern='Backtrace end' 01:00:21.891 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/vfio-user-phy-autotest_26180/build.log ]] 01:00:21.891 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/vfio-user-phy-autotest_26180/build.log 01:00:21.891 + backtraces= 01:00:21.891 + [[ -n '' ]] 01:00:21.891 + for build in "${build_log_list[@]}" 01:00:21.891 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/short-fuzz-phy-autotest_26169/build.log 01:00:21.891 + local build_log job_name start_pattern end_pattern backtraces 01:00:21.891 + build_log=/var/jenkins/workspace/autotest-per-patch_5/short-fuzz-phy-autotest_26169/build.log 01:00:21.891 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/short-fuzz-phy-autotest_26169/build.log 01:00:21.891 ++ basename /var/jenkins/workspace/autotest-per-patch_5/short-fuzz-phy-autotest_26169 01:00:21.891 + job_name=short-fuzz-phy-autotest_26169 01:00:21.891 + start_pattern='Backtrace start' 01:00:21.891 + end_pattern='Backtrace end' 01:00:21.891 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/short-fuzz-phy-autotest_26169/build.log ]] 01:00:21.891 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/short-fuzz-phy-autotest_26169/build.log 01:00:21.891 + backtraces= 01:00:21.891 + [[ -n '' ]] 01:00:21.891 + for build in "${build_log_list[@]}" 01:00:21.891 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-vg-autotest_77443/build.log 01:00:21.891 + local build_log job_name start_pattern end_pattern backtraces 01:00:21.891 + build_log=/var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-vg-autotest_77443/build.log 01:00:21.891 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-vg-autotest_77443/build.log 01:00:21.891 ++ basename /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-vg-autotest_77443 01:00:21.891 + job_name=nvmf-tcp-vg-autotest_77443 01:00:21.891 + start_pattern='Backtrace start' 01:00:21.891 + end_pattern='Backtrace end' 01:00:21.891 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-vg-autotest_77443/build.log ]] 01:00:21.891 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-vg-autotest_77443/build.log 01:00:21.891 + backtraces= 01:00:21.891 + [[ -n '' ]] 01:00:21.891 + for build in "${build_log_list[@]}" 01:00:21.891 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/check-format-docker-autotest_22120/build.log 01:00:21.891 + local build_log job_name start_pattern end_pattern backtraces 01:00:21.891 + build_log=/var/jenkins/workspace/autotest-per-patch_5/check-format-docker-autotest_22120/build.log 01:00:21.891 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/check-format-docker-autotest_22120/build.log 01:00:21.891 ++ basename /var/jenkins/workspace/autotest-per-patch_5/check-format-docker-autotest_22120 01:00:21.891 + job_name=check-format-docker-autotest_22120 01:00:21.891 + start_pattern='Backtrace start' 01:00:21.891 + end_pattern='Backtrace end' 01:00:21.891 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/check-format-docker-autotest_22120/build.log ]] 01:00:21.891 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/check-format-docker-autotest_22120/build.log 01:00:21.891 + backtraces= 01:00:21.891 + [[ -n '' ]] 01:00:21.891 + run_flamegraph 01:00:21.891 + create_timing_file 01:00:21.891 + local array file 01:00:21.891 + array=($(find $WORKSPACE -type f -name 'timing.txt')) 01:00:21.891 ++ find /var/jenkins/workspace/autotest-per-patch_5 -type f -name timing.txt 01:00:21.891 + timing_dir=/var/jenkins/workspace/autotest-per-patch_5/post_process 01:00:21.891 + mkdir -p /var/jenkins/workspace/autotest-per-patch_5/post_process 01:00:21.891 + timing_file=/var/jenkins/workspace/autotest-per-patch_5/post_process/total_timing.txt 01:00:21.891 + for file in "${array[@]}" 01:00:21.891 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/autobuild-external-vg-autotest_19800/timing.txt 01:00:21.891 + local job_file job_name 01:00:21.891 + job_file=/var/jenkins/workspace/autotest-per-patch_5/autobuild-external-vg-autotest_19800/timing.txt 01:00:21.891 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/autobuild-external-vg-autotest_19800/timing.txt 01:00:21.891 ++ basename /var/jenkins/workspace/autotest-per-patch_5/autobuild-external-vg-autotest_19800 01:00:21.891 + job_name=autobuild-external-vg-autotest_19800 01:00:21.891 + sed 's/^/autobuild-external-vg-autotest_19800;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/autobuild-external-vg-autotest_19800/timing.txt 01:00:21.891 + for file in "${array[@]}" 01:00:21.891 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/centos7-vg-autotest_73631/timing.txt 01:00:21.891 + local job_file job_name 01:00:21.891 + job_file=/var/jenkins/workspace/autotest-per-patch_5/centos7-vg-autotest_73631/timing.txt 01:00:21.891 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/centos7-vg-autotest_73631/timing.txt 01:00:21.891 ++ basename /var/jenkins/workspace/autotest-per-patch_5/centos7-vg-autotest_73631 01:00:21.891 + job_name=centos7-vg-autotest_73631 01:00:21.891 + sed 's/^/centos7-vg-autotest_73631;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/centos7-vg-autotest_73631/timing.txt 01:00:21.891 + for file in "${array[@]}" 01:00:21.891 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/zns-vg-autotest_76558/timing.txt 01:00:21.891 + local job_file job_name 01:00:21.891 + job_file=/var/jenkins/workspace/autotest-per-patch_5/zns-vg-autotest_76558/timing.txt 01:00:21.891 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/zns-vg-autotest_76558/timing.txt 01:00:21.891 ++ basename /var/jenkins/workspace/autotest-per-patch_5/zns-vg-autotest_76558 01:00:21.891 + job_name=zns-vg-autotest_76558 01:00:21.891 + sed 's/^/zns-vg-autotest_76558;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/zns-vg-autotest_76558/timing.txt 01:00:21.891 + for file in "${array[@]}" 01:00:21.891 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/iscsi-uring-vg-autotest_77357/timing.txt 01:00:21.891 + local job_file job_name 01:00:21.891 + job_file=/var/jenkins/workspace/autotest-per-patch_5/iscsi-uring-vg-autotest_77357/timing.txt 01:00:21.891 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/iscsi-uring-vg-autotest_77357/timing.txt 01:00:21.891 ++ basename /var/jenkins/workspace/autotest-per-patch_5/iscsi-uring-vg-autotest_77357 01:00:21.891 + job_name=iscsi-uring-vg-autotest_77357 01:00:21.891 + sed 's/^/iscsi-uring-vg-autotest_77357;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/iscsi-uring-vg-autotest_77357/timing.txt 01:00:21.891 + for file in "${array[@]}" 01:00:21.891 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/vhost-phy-autotest_26197/timing.txt 01:00:21.891 + local job_file job_name 01:00:21.891 + job_file=/var/jenkins/workspace/autotest-per-patch_5/vhost-phy-autotest_26197/timing.txt 01:00:21.891 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/vhost-phy-autotest_26197/timing.txt 01:00:21.891 ++ basename /var/jenkins/workspace/autotest-per-patch_5/vhost-phy-autotest_26197 01:00:21.891 + job_name=vhost-phy-autotest_26197 01:00:21.891 + sed 's/^/vhost-phy-autotest_26197;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/vhost-phy-autotest_26197/timing.txt 01:00:21.891 + for file in "${array[@]}" 01:00:21.891 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/nvme-vg-autotest_77452/timing.txt 01:00:21.891 + local job_file job_name 01:00:21.891 + job_file=/var/jenkins/workspace/autotest-per-patch_5/nvme-vg-autotest_77452/timing.txt 01:00:21.891 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/nvme-vg-autotest_77452/timing.txt 01:00:21.891 ++ basename /var/jenkins/workspace/autotest-per-patch_5/nvme-vg-autotest_77452 01:00:21.891 + job_name=nvme-vg-autotest_77452 01:00:21.891 + sed 's/^/nvme-vg-autotest_77452;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/nvme-vg-autotest_77452/timing.txt 01:00:21.891 + for file in "${array[@]}" 01:00:21.891 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/vhost-initiator-vg-autotest_77472/timing.txt 01:00:21.891 + local job_file job_name 01:00:21.891 + job_file=/var/jenkins/workspace/autotest-per-patch_5/vhost-initiator-vg-autotest_77472/timing.txt 01:00:21.891 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/vhost-initiator-vg-autotest_77472/timing.txt 01:00:21.891 ++ basename /var/jenkins/workspace/autotest-per-patch_5/vhost-initiator-vg-autotest_77472 01:00:21.891 + job_name=vhost-initiator-vg-autotest_77472 01:00:21.891 + sed 's/^/vhost-initiator-vg-autotest_77472;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/vhost-initiator-vg-autotest_77472/timing.txt 01:00:21.891 + for file in "${array[@]}" 01:00:21.891 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/dsa-phy-autotest_4872/timing.txt 01:00:21.891 + local job_file job_name 01:00:21.891 + job_file=/var/jenkins/workspace/autotest-per-patch_5/dsa-phy-autotest_4872/timing.txt 01:00:21.891 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/dsa-phy-autotest_4872/timing.txt 01:00:21.891 ++ basename /var/jenkins/workspace/autotest-per-patch_5/dsa-phy-autotest_4872 01:00:21.891 + job_name=dsa-phy-autotest_4872 01:00:21.891 + sed 's/^/dsa-phy-autotest_4872;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/dsa-phy-autotest_4872/timing.txt 01:00:21.891 + for file in "${array[@]}" 01:00:21.891 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/unittest-main-docker-autotest_19838/timing.txt 01:00:21.891 + local job_file job_name 01:00:21.891 + job_file=/var/jenkins/workspace/autotest-per-patch_5/unittest-main-docker-autotest_19838/timing.txt 01:00:21.891 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/unittest-main-docker-autotest_19838/timing.txt 01:00:21.891 ++ basename /var/jenkins/workspace/autotest-per-patch_5/unittest-main-docker-autotest_19838 01:00:21.891 + job_name=unittest-main-docker-autotest_19838 01:00:21.891 + sed 's/^/unittest-main-docker-autotest_19838;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/unittest-main-docker-autotest_19838/timing.txt 01:00:21.891 + for file in "${array[@]}" 01:00:21.891 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/iscsi-vg-autotest_77490/timing.txt 01:00:21.891 + local job_file job_name 01:00:21.891 + job_file=/var/jenkins/workspace/autotest-per-patch_5/iscsi-vg-autotest_77490/timing.txt 01:00:21.891 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/iscsi-vg-autotest_77490/timing.txt 01:00:21.891 ++ basename /var/jenkins/workspace/autotest-per-patch_5/iscsi-vg-autotest_77490 01:00:21.891 + job_name=iscsi-vg-autotest_77490 01:00:21.891 + sed 's/^/iscsi-vg-autotest_77490;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/iscsi-vg-autotest_77490/timing.txt 01:00:21.891 + for file in "${array[@]}" 01:00:21.891 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/ubuntu20-vg-autotest_73771/timing.txt 01:00:21.891 + local job_file job_name 01:00:21.891 + job_file=/var/jenkins/workspace/autotest-per-patch_5/ubuntu20-vg-autotest_73771/timing.txt 01:00:21.892 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/ubuntu20-vg-autotest_73771/timing.txt 01:00:21.892 ++ basename /var/jenkins/workspace/autotest-per-patch_5/ubuntu20-vg-autotest_73771 01:00:21.892 + job_name=ubuntu20-vg-autotest_73771 01:00:21.892 + sed 's/^/ubuntu20-vg-autotest_73771;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/ubuntu20-vg-autotest_73771/timing.txt 01:00:21.892 + for file in "${array[@]}" 01:00:21.892 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/unittest-valgrind-docker-autotest_19841/timing.txt 01:00:21.892 + local job_file job_name 01:00:21.892 + job_file=/var/jenkins/workspace/autotest-per-patch_5/unittest-valgrind-docker-autotest_19841/timing.txt 01:00:21.892 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/unittest-valgrind-docker-autotest_19841/timing.txt 01:00:21.892 ++ basename /var/jenkins/workspace/autotest-per-patch_5/unittest-valgrind-docker-autotest_19841 01:00:21.892 + job_name=unittest-valgrind-docker-autotest_19841 01:00:21.892 + sed 's/^/unittest-valgrind-docker-autotest_19841;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/unittest-valgrind-docker-autotest_19841/timing.txt 01:00:21.892 + for file in "${array[@]}" 01:00:21.892 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/lvol-vg-autotest_77401/timing.txt 01:00:21.892 + local job_file job_name 01:00:21.892 + job_file=/var/jenkins/workspace/autotest-per-patch_5/lvol-vg-autotest_77401/timing.txt 01:00:21.892 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/lvol-vg-autotest_77401/timing.txt 01:00:21.892 ++ basename /var/jenkins/workspace/autotest-per-patch_5/lvol-vg-autotest_77401 01:00:21.892 + job_name=lvol-vg-autotest_77401 01:00:21.892 + sed 's/^/lvol-vg-autotest_77401;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/lvol-vg-autotest_77401/timing.txt 01:00:21.892 + for file in "${array[@]}" 01:00:21.892 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/packaging-docker-autotest_19839/timing.txt 01:00:21.892 + local job_file job_name 01:00:21.892 + job_file=/var/jenkins/workspace/autotest-per-patch_5/packaging-docker-autotest_19839/timing.txt 01:00:21.892 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/packaging-docker-autotest_19839/timing.txt 01:00:21.892 ++ basename /var/jenkins/workspace/autotest-per-patch_5/packaging-docker-autotest_19839 01:00:21.892 + job_name=packaging-docker-autotest_19839 01:00:21.892 + sed 's/^/packaging-docker-autotest_19839;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/packaging-docker-autotest_19839/timing.txt 01:00:21.892 + for file in "${array[@]}" 01:00:21.892 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/check-so-deps-docker-autotest_22133/timing.txt 01:00:21.892 + local job_file job_name 01:00:21.892 + job_file=/var/jenkins/workspace/autotest-per-patch_5/check-so-deps-docker-autotest_22133/timing.txt 01:00:21.892 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/check-so-deps-docker-autotest_22133/timing.txt 01:00:21.892 ++ basename /var/jenkins/workspace/autotest-per-patch_5/check-so-deps-docker-autotest_22133 01:00:21.892 + job_name=check-so-deps-docker-autotest_22133 01:00:21.892 + sed 's/^/check-so-deps-docker-autotest_22133;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/check-so-deps-docker-autotest_22133/timing.txt 01:00:21.892 + for file in "${array[@]}" 01:00:21.892 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/BlobFS-phy-autotest_26178/timing.txt 01:00:21.892 + local job_file job_name 01:00:21.892 + job_file=/var/jenkins/workspace/autotest-per-patch_5/BlobFS-phy-autotest_26178/timing.txt 01:00:21.892 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/BlobFS-phy-autotest_26178/timing.txt 01:00:21.892 ++ basename /var/jenkins/workspace/autotest-per-patch_5/BlobFS-phy-autotest_26178 01:00:21.892 + job_name=BlobFS-phy-autotest_26178 01:00:21.892 + sed 's/^/BlobFS-phy-autotest_26178;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/BlobFS-phy-autotest_26178/timing.txt 01:00:21.892 + for file in "${array[@]}" 01:00:21.892 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/build-files-docker-autotest_22109/timing.txt 01:00:21.892 + local job_file job_name 01:00:21.892 + job_file=/var/jenkins/workspace/autotest-per-patch_5/build-files-docker-autotest_22109/timing.txt 01:00:21.892 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/build-files-docker-autotest_22109/timing.txt 01:00:21.892 ++ basename /var/jenkins/workspace/autotest-per-patch_5/build-files-docker-autotest_22109 01:00:21.892 + job_name=build-files-docker-autotest_22109 01:00:21.892 + sed 's/^/build-files-docker-autotest_22109;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/build-files-docker-autotest_22109/timing.txt 01:00:21.892 + for file in "${array[@]}" 01:00:21.892 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/nvmf-phy-autotest_72416/timing.txt 01:00:21.892 + local job_file job_name 01:00:21.892 + job_file=/var/jenkins/workspace/autotest-per-patch_5/nvmf-phy-autotest_72416/timing.txt 01:00:21.892 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/nvmf-phy-autotest_72416/timing.txt 01:00:21.892 ++ basename /var/jenkins/workspace/autotest-per-patch_5/nvmf-phy-autotest_72416 01:00:21.892 + job_name=nvmf-phy-autotest_72416 01:00:21.892 + sed 's/^/nvmf-phy-autotest_72416;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/nvmf-phy-autotest_72416/timing.txt 01:00:21.892 + for file in "${array[@]}" 01:00:21.892 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/freebsd-vg-autotest_59100/timing.txt 01:00:21.892 + local job_file job_name 01:00:21.892 + job_file=/var/jenkins/workspace/autotest-per-patch_5/freebsd-vg-autotest_59100/timing.txt 01:00:21.892 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/freebsd-vg-autotest_59100/timing.txt 01:00:21.892 ++ basename /var/jenkins/workspace/autotest-per-patch_5/freebsd-vg-autotest_59100 01:00:21.892 + job_name=freebsd-vg-autotest_59100 01:00:21.892 + sed 's/^/freebsd-vg-autotest_59100;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/freebsd-vg-autotest_59100/timing.txt 01:00:21.892 + for file in "${array[@]}" 01:00:21.892 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/nvme-phy-autotest_72344/timing.txt 01:00:21.892 + local job_file job_name 01:00:21.892 + job_file=/var/jenkins/workspace/autotest-per-patch_5/nvme-phy-autotest_72344/timing.txt 01:00:21.892 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/nvme-phy-autotest_72344/timing.txt 01:00:21.892 ++ basename /var/jenkins/workspace/autotest-per-patch_5/nvme-phy-autotest_72344 01:00:21.892 + job_name=nvme-phy-autotest_72344 01:00:21.892 + sed 's/^/nvme-phy-autotest_72344;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/nvme-phy-autotest_72344/timing.txt 01:00:21.892 + for file in "${array[@]}" 01:00:21.892 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-phy-autotest_72303/timing.txt 01:00:21.892 + local job_file job_name 01:00:21.892 + job_file=/var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-phy-autotest_72303/timing.txt 01:00:21.892 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-phy-autotest_72303/timing.txt 01:00:21.892 ++ basename /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-phy-autotest_72303 01:00:21.892 + job_name=nvmf-tcp-phy-autotest_72303 01:00:21.892 + sed 's/^/nvmf-tcp-phy-autotest_72303;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-phy-autotest_72303/timing.txt 01:00:21.892 + for file in "${array[@]}" 01:00:21.892 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/nvme-cmb-pmr-vg-autotest_78575/timing.txt 01:00:21.892 + local job_file job_name 01:00:21.892 + job_file=/var/jenkins/workspace/autotest-per-patch_5/nvme-cmb-pmr-vg-autotest_78575/timing.txt 01:00:21.892 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/nvme-cmb-pmr-vg-autotest_78575/timing.txt 01:00:21.892 ++ basename /var/jenkins/workspace/autotest-per-patch_5/nvme-cmb-pmr-vg-autotest_78575 01:00:21.892 + job_name=nvme-cmb-pmr-vg-autotest_78575 01:00:21.892 + sed 's/^/nvme-cmb-pmr-vg-autotest_78575;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/nvme-cmb-pmr-vg-autotest_78575/timing.txt 01:00:21.892 + for file in "${array[@]}" 01:00:21.892 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/rocky9-vg-autotest_16062/timing.txt 01:00:21.892 + local job_file job_name 01:00:21.892 + job_file=/var/jenkins/workspace/autotest-per-patch_5/rocky9-vg-autotest_16062/timing.txt 01:00:21.892 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/rocky9-vg-autotest_16062/timing.txt 01:00:21.892 ++ basename /var/jenkins/workspace/autotest-per-patch_5/rocky9-vg-autotest_16062 01:00:21.892 + job_name=rocky9-vg-autotest_16062 01:00:21.892 + sed 's/^/rocky9-vg-autotest_16062;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/rocky9-vg-autotest_16062/timing.txt 01:00:21.892 + for file in "${array[@]}" 01:00:21.892 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/ubuntu22-vg-autotest_37785/timing.txt 01:00:21.892 + local job_file job_name 01:00:21.892 + job_file=/var/jenkins/workspace/autotest-per-patch_5/ubuntu22-vg-autotest_37785/timing.txt 01:00:21.892 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/ubuntu22-vg-autotest_37785/timing.txt 01:00:21.892 ++ basename /var/jenkins/workspace/autotest-per-patch_5/ubuntu22-vg-autotest_37785 01:00:21.892 + job_name=ubuntu22-vg-autotest_37785 01:00:21.892 + sed 's/^/ubuntu22-vg-autotest_37785;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/ubuntu22-vg-autotest_37785/timing.txt 01:00:21.892 + for file in "${array[@]}" 01:00:21.892 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/scan-build-docker-autotest_19840/timing.txt 01:00:21.892 + local job_file job_name 01:00:21.892 + job_file=/var/jenkins/workspace/autotest-per-patch_5/scan-build-docker-autotest_19840/timing.txt 01:00:21.892 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/scan-build-docker-autotest_19840/timing.txt 01:00:21.892 ++ basename /var/jenkins/workspace/autotest-per-patch_5/scan-build-docker-autotest_19840 01:00:21.892 + job_name=scan-build-docker-autotest_19840 01:00:21.892 + sed 's/^/scan-build-docker-autotest_19840;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/scan-build-docker-autotest_19840/timing.txt 01:00:21.892 + for file in "${array[@]}" 01:00:21.892 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/unittest-clang-docker-autotest_19837/timing.txt 01:00:21.892 + local job_file job_name 01:00:21.892 + job_file=/var/jenkins/workspace/autotest-per-patch_5/unittest-clang-docker-autotest_19837/timing.txt 01:00:21.892 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/unittest-clang-docker-autotest_19837/timing.txt 01:00:21.892 ++ basename /var/jenkins/workspace/autotest-per-patch_5/unittest-clang-docker-autotest_19837 01:00:21.892 + job_name=unittest-clang-docker-autotest_19837 01:00:21.892 + sed 's/^/unittest-clang-docker-autotest_19837;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/unittest-clang-docker-autotest_19837/timing.txt 01:00:21.892 + for file in "${array[@]}" 01:00:21.892 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/crypto-phy-autotest_26172/timing.txt 01:00:21.892 + local job_file job_name 01:00:21.892 + job_file=/var/jenkins/workspace/autotest-per-patch_5/crypto-phy-autotest_26172/timing.txt 01:00:21.893 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/crypto-phy-autotest_26172/timing.txt 01:00:21.893 ++ basename /var/jenkins/workspace/autotest-per-patch_5/crypto-phy-autotest_26172 01:00:21.893 + job_name=crypto-phy-autotest_26172 01:00:21.893 + sed 's/^/crypto-phy-autotest_26172;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/crypto-phy-autotest_26172/timing.txt 01:00:21.893 + for file in "${array[@]}" 01:00:21.893 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/doc-docker-autotest_22300/timing.txt 01:00:21.893 + local job_file job_name 01:00:21.893 + job_file=/var/jenkins/workspace/autotest-per-patch_5/doc-docker-autotest_22300/timing.txt 01:00:21.893 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/doc-docker-autotest_22300/timing.txt 01:00:21.893 ++ basename /var/jenkins/workspace/autotest-per-patch_5/doc-docker-autotest_22300 01:00:21.893 + job_name=doc-docker-autotest_22300 01:00:21.893 + sed 's/^/doc-docker-autotest_22300;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/doc-docker-autotest_22300/timing.txt 01:00:21.893 + for file in "${array[@]}" 01:00:21.893 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-uring-vg-autotest_77377/timing.txt 01:00:21.893 + local job_file job_name 01:00:21.893 + job_file=/var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-uring-vg-autotest_77377/timing.txt 01:00:21.893 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-uring-vg-autotest_77377/timing.txt 01:00:21.893 ++ basename /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-uring-vg-autotest_77377 01:00:21.893 + job_name=nvmf-tcp-uring-vg-autotest_77377 01:00:21.893 + sed 's/^/nvmf-tcp-uring-vg-autotest_77377;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-uring-vg-autotest_77377/timing.txt 01:00:21.893 + for file in "${array[@]}" 01:00:21.893 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/vfio-user-phy-autotest_26180/timing.txt 01:00:21.893 + local job_file job_name 01:00:21.893 + job_file=/var/jenkins/workspace/autotest-per-patch_5/vfio-user-phy-autotest_26180/timing.txt 01:00:21.893 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/vfio-user-phy-autotest_26180/timing.txt 01:00:21.893 ++ basename /var/jenkins/workspace/autotest-per-patch_5/vfio-user-phy-autotest_26180 01:00:21.893 + job_name=vfio-user-phy-autotest_26180 01:00:21.893 + sed 's/^/vfio-user-phy-autotest_26180;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/vfio-user-phy-autotest_26180/timing.txt 01:00:21.893 + for file in "${array[@]}" 01:00:21.893 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/short-fuzz-phy-autotest_26169/timing.txt 01:00:21.893 + local job_file job_name 01:00:21.893 + job_file=/var/jenkins/workspace/autotest-per-patch_5/short-fuzz-phy-autotest_26169/timing.txt 01:00:21.893 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/short-fuzz-phy-autotest_26169/timing.txt 01:00:21.893 ++ basename /var/jenkins/workspace/autotest-per-patch_5/short-fuzz-phy-autotest_26169 01:00:21.893 + job_name=short-fuzz-phy-autotest_26169 01:00:21.893 + sed 's/^/short-fuzz-phy-autotest_26169;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/short-fuzz-phy-autotest_26169/timing.txt 01:00:21.893 + for file in "${array[@]}" 01:00:21.893 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-vg-autotest_77443/timing.txt 01:00:21.893 + local job_file job_name 01:00:21.893 + job_file=/var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-vg-autotest_77443/timing.txt 01:00:21.893 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-vg-autotest_77443/timing.txt 01:00:21.893 ++ basename /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-vg-autotest_77443 01:00:21.893 + job_name=nvmf-tcp-vg-autotest_77443 01:00:21.893 + sed 's/^/nvmf-tcp-vg-autotest_77443;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-vg-autotest_77443/timing.txt 01:00:21.893 + for file in "${array[@]}" 01:00:21.893 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/check-format-docker-autotest_22120/timing.txt 01:00:21.893 + local job_file job_name 01:00:21.893 + job_file=/var/jenkins/workspace/autotest-per-patch_5/check-format-docker-autotest_22120/timing.txt 01:00:21.893 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/check-format-docker-autotest_22120/timing.txt 01:00:21.893 ++ basename /var/jenkins/workspace/autotest-per-patch_5/check-format-docker-autotest_22120 01:00:21.893 + job_name=check-format-docker-autotest_22120 01:00:21.893 + sed 's/^/check-format-docker-autotest_22120;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/check-format-docker-autotest_22120/timing.txt 01:00:21.893 + /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/autotest-per-patch_5/post_process/total_timing.txt 01:00:22.151 + run_autorun_post 01:00:22.151 + s_opt= 01:00:22.151 + [[ '' == true ]] 01:00:22.151 + spdk/autorun_post.py -d ./ -r ./spdk 01:00:25.427 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:23 01:00:25.427 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:17 01:00:25.427 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc64.c:13 01:00:25.427 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/xor.c:93 01:00:25.427 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc32c.c:13 01:00:27.955 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc64.c:13 01:00:27.955 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:23 01:00:27.955 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:17 01:00:27.955 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/xor.c:93 01:00:27.955 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc32c.c:13 01:00:29.327 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/xor.c:93 01:00:29.586 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc32c.c:13 01:00:29.844 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:23 01:00:29.844 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:17 01:00:29.844 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc64.c:13 01:00:32.374 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc64.c:13 01:00:32.632 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:23 01:00:32.632 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:17 01:00:32.632 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/xor.c:93 01:00:32.889 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc32c.c:13 01:00:34.786 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:23 01:00:34.786 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:17 01:00:34.786 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc64.c:13 01:00:34.786 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc32c.c:13 01:00:35.043 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/xor.c:93 01:00:38.316 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/xor.c:93 01:00:38.316 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc32c.c:13 01:00:38.316 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc64.c:13 01:00:38.316 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:17 01:00:38.316 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:23 01:00:39.687 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/xor.c:93 01:00:40.250 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc32c.c:13 01:00:40.250 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc64.c:13 01:00:40.507 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:17 01:00:40.507 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:23 01:00:43.782 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc32c.c:13 01:00:43.782 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/module/blobfs/bdev/blobfs_bdev.c:254 01:00:43.782 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/xor.c:93 01:00:43.782 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc64.c:13 01:00:43.782 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:17 01:00:43.782 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:23 01:00:45.678 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc32c.c:13 01:00:45.935 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/xor.c:93 01:00:45.935 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc64.c:13 01:00:46.192 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:17 01:00:46.192 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:23 01:00:49.468 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc32c.c:13 01:00:49.468 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/xor.c:93 01:00:50.034 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc64.c:13 01:00:50.034 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:23 01:00:50.034 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:17 01:00:53.313 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:23 01:00:53.313 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:17 01:00:53.313 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc64.c:13 01:00:53.313 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc32c.c:13 01:00:53.313 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/xor.c:93 01:00:54.684 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/xor.c:93 01:00:55.250 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc32c.c:13 01:00:55.508 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc64.c:13 01:00:55.508 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:23 01:00:55.508 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:17 01:00:58.786 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/xor.c:93 01:00:58.786 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc32c.c:13 01:00:58.786 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:17 01:00:58.786 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:23 01:00:58.786 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc64.c:13 01:01:02.061 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc64.c:13 01:01:02.061 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:23 01:01:02.061 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:17 01:01:02.318 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/xor.c:93 01:01:02.881 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc32c.c:13 01:01:06.156 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc32c.c:13 01:01:06.156 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/xor.c:93 01:01:06.413 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc64.c:13 01:01:06.413 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:23 01:01:06.413 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:17 01:01:10.599 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:23 01:01:10.599 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:17 01:01:10.599 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc64.c:13 01:01:11.163 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/xor.c:93 01:01:11.163 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc32c.c:13 01:01:13.065 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc64.c:13 01:01:13.065 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:23 01:01:13.065 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:17 01:01:13.322 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc32c.c:13 01:01:13.322 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/xor.c:93 01:01:16.598 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/xor.c:93 01:01:16.855 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/module/bdev/nvme/bdev_mdns_client.c:456 01:01:16.855 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/module/bdev/nvme/bdev_mdns_client.c:613 01:01:16.855 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/module/bdev/nvme/bdev_mdns_client.c:582 01:01:16.855 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/module/bdev/nvme/bdev_mdns_client.c:561 01:01:17.112 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc32c.c:13 01:01:17.369 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc64.c:13 01:01:17.369 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:23 01:01:17.369 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:17 01:01:35.433 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_5/spdk/endian.h! 01:01:35.433 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_5/spdk/mmio.h! 01:01:35.433 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_5/spdk/base64.h! 01:01:35.433 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_5/spdk/trace.h! 01:01:35.433 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_5/spdk/bdev_module.h! 01:01:35.433 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_5/spdk/nvmf_transport.h! 01:01:35.433 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_5/spdk/nvme.h! 01:01:35.433 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_5/spdk/histogram_data.h! 01:01:35.433 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_5/spdk/util.h! 01:01:35.433 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_5/spdk/thread.h! 01:01:35.433 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_5/spdk/nvme_spec.h! 01:01:35.433 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_5/spdk/histogram_data.h/histogram_ut.c! 01:01:37.330 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/env_ocf/include/ocf/ocf_mngt.h! 01:01:37.330 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/env_ocf/include/ocf/ocf_io.h! 01:01:37.330 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/env_ocf/include/ocf/ocf_core.h! 01:01:52.193 -----Begin Post Process Script------ 01:01:52.193 /var/jenkins/workspace/autotest-per-patch_5/centos7-vg-autotest_73631/cov_total.info 01:01:52.193 /var/jenkins/workspace/autotest-per-patch_5/zns-vg-autotest_76558/cov_total.info 01:01:52.193 /var/jenkins/workspace/autotest-per-patch_5/iscsi-uring-vg-autotest_77357/cov_total.info 01:01:52.193 /var/jenkins/workspace/autotest-per-patch_5/vhost-phy-autotest_26197/cov_total.info 01:01:52.193 /var/jenkins/workspace/autotest-per-patch_5/vhost-initiator-vg-autotest_77472/cov_total.info 01:01:52.193 /var/jenkins/workspace/autotest-per-patch_5/dsa-phy-autotest_4872/cov_total.info 01:01:52.193 /var/jenkins/workspace/autotest-per-patch_5/iscsi-vg-autotest_77490/cov_total.info 01:01:52.193 /var/jenkins/workspace/autotest-per-patch_5/lvol-vg-autotest_77401/cov_total.info 01:01:52.193 /var/jenkins/workspace/autotest-per-patch_5/BlobFS-phy-autotest_26178/cov_total.info 01:01:52.193 /var/jenkins/workspace/autotest-per-patch_5/nvmf-phy-autotest_72416/cov_total.info 01:01:52.193 /var/jenkins/workspace/autotest-per-patch_5/nvme-phy-autotest_72344/cov_total.info 01:01:52.193 /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-phy-autotest_72303/cov_total.info 01:01:52.193 /var/jenkins/workspace/autotest-per-patch_5/nvme-cmb-pmr-vg-autotest_78575/cov_total.info 01:01:52.193 /var/jenkins/workspace/autotest-per-patch_5/rocky9-vg-autotest_16062/cov_total.info 01:01:52.193 /var/jenkins/workspace/autotest-per-patch_5/ubuntu22-vg-autotest_37785/cov_total.info 01:01:52.193 /var/jenkins/workspace/autotest-per-patch_5/crypto-phy-autotest_26172/cov_total.info 01:01:52.193 /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-uring-vg-autotest_77377/cov_total.info 01:01:52.193 /var/jenkins/workspace/autotest-per-patch_5/vfio-user-phy-autotest_26180/cov_total.info 01:01:52.193 /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-vg-autotest_77443/cov_total.info 01:01:52.193 01:01:52.193 01:01:52.193 -----Tests Executed in Build------ 01:01:52.193 accel 01:01:52.193 accel_assign_opcode 01:01:52.193 accel_cdev_comp 01:01:52.193 accel_cdev_decmop_full 01:01:52.193 accel_cdev_decomp 01:01:52.193 accel_cdev_decomp_full_mcore 01:01:52.193 accel_cdev_decomp_full_mthread 01:01:52.193 accel_cdev_decomp_mcore 01:01:52.193 accel_cdev_decomp_mthread 01:01:52.193 accel_comp 01:01:52.193 accel_compare 01:01:52.193 accel_compress_verify 01:01:52.193 accel_copy 01:01:52.193 accel_copy_crc32c 01:01:52.193 accel_copy_crc32c_C2 01:01:52.193 accel_crc32c 01:01:52.193 accel_crc32c_C2 01:01:52.193 accel_decmop_full 01:01:52.193 accel_decomp 01:01:52.193 accel_decomp_full_mcore 01:01:52.193 accel_decomp_full_mthread 01:01:52.193 accel_decomp_mcore 01:01:52.193 accel_decomp_mthread 01:01:52.193 accel_dif_functional_tests 01:01:52.193 accel_dif_generate 01:01:52.193 accel_dif_generate_copy 01:01:52.193 accel_dif_verify 01:01:52.193 accel_dualcast 01:01:52.193 accel_fill 01:01:52.193 accel_help 01:01:52.193 accel_missing_filename 01:01:52.193 accel_negative_buffers 01:01:52.193 accel_rpc 01:01:52.193 accel_scan_dsa_modules 01:01:52.193 accel_scan_iaa_modules 01:01:52.193 accel_wrong_workload 01:01:52.193 accel_xor 01:01:52.193 acl 01:01:52.193 alias_rpc 01:01:52.193 allowed 01:01:52.193 app_cmdline 01:01:52.193 app_repeat 01:01:52.193 asan 01:01:52.193 autobuild 01:01:52.193 autobuild_build_doc 01:01:52.193 autobuild_check_dpdk_pci_api 01:01:52.193 autobuild_check_format 01:01:52.193 autobuild_check_so_deps 01:01:52.193 autobuild_external_code 01:01:52.193 autobuild_generated_files_check 01:01:52.193 autobuild_generated_files_check_post_clean 01:01:52.193 autobuild_header_dependency_check 01:01:52.193 autobuild_llvm_precompile 01:01:52.193 autobuild_make_install 01:01:52.193 autobuild_make_uninstall 01:01:52.193 autobuild_ocf_precompile 01:01:52.193 bdev_bounds 01:01:52.193 bdev_crypto_enomem 01:01:52.193 bdev_error 01:01:52.193 bdev_fio 01:01:52.193 bdev_fio_rw_verify 01:01:52.193 bdev_fio_trim 01:01:52.193 bdev_gpt_uuid 01:01:52.193 bdev_hello_world 01:01:52.193 bdev_json_nonarray 01:01:52.193 bdev_json_nonenclosed 01:01:52.193 bdev_nbd 01:01:52.193 bdev_nvme_reset_stuck_adm_cmd 01:01:52.193 bdev_qd_sampling 01:01:52.193 bdev_qos 01:01:52.193 bdev_qos_bw 01:01:52.193 bdev_qos_iops 01:01:52.193 bdev_qos_ro_bw 01:01:52.193 bdev_raid 01:01:52.193 bdev_stat 01:01:52.193 bdev_verify 01:01:52.193 bdev_verify_big_io 01:01:52.193 bdev_write_zeroes 01:01:52.193 bdevperf_config 01:01:52.193 blob_io_wait 01:01:52.193 blobfs 01:01:52.193 blobfs_mkfs 01:01:52.193 blobstore 01:01:52.194 blobstore_grow 01:01:52.194 blockdev_crypto_aesni 01:01:52.194 blockdev_crypto_qat 01:01:52.194 blockdev_crypto_sw 01:01:52.194 blockdev_general 01:01:52.194 blockdev_nvme 01:01:52.194 blockdev_nvme_gpt 01:01:52.194 blockdev_raid5f 01:01:52.194 blockdev_rbd 01:01:52.194 build_rpm_from_gen_spec 01:01:52.194 build_shared_rpm 01:01:52.194 chaining 01:01:52.194 check_header_filenames 01:01:52.194 cmb_copy 01:01:52.194 compress_compdev 01:01:52.194 compress_isal 01:01:52.194 confirm_abi_deps 01:01:52.194 confirm_makefile_deps 01:01:52.194 cpu_locks 01:01:52.194 custom_alloc 01:01:52.194 dd_bs_lt_native_bs 01:01:52.194 dd_copy_to_out_bdev 01:01:52.194 dd_double_input 01:01:52.194 dd_double_output 01:01:52.194 dd_flag_append 01:01:52.194 dd_flag_append_forced_aio 01:01:52.194 dd_flag_directory 01:01:52.194 dd_flag_directory_forced_aio 01:01:52.194 dd_flag_noatime 01:01:52.194 dd_flag_noatime_forced_aio 01:01:52.194 dd_flag_nofollow 01:01:52.194 dd_flag_nofollow_forced_aio 01:01:52.194 dd_flags_misc 01:01:52.194 dd_flags_misc_forced_aio 01:01:52.194 dd_inflate_file 01:01:52.194 dd_invalid_arguments 01:01:52.194 dd_invalid_count 01:01:52.194 dd_invalid_iflag 01:01:52.194 dd_invalid_json 01:01:52.194 dd_invalid_oflag 01:01:52.194 dd_malloc_copy 01:01:52.194 dd_no_input 01:01:52.194 dd_no_output 01:01:52.194 dd_offset_magic 01:01:52.194 dd_rw 01:01:52.194 dd_rw_offset 01:01:52.194 dd_smaller_blocksize 01:01:52.194 dd_sparse_bdev_to_file 01:01:52.194 dd_sparse_file_to_bdev 01:01:52.194 dd_sparse_file_to_file 01:01:52.194 dd_unknown_flag 01:01:52.194 dd_uring_copy 01:01:52.194 dd_wrong_blocksize 01:01:52.194 default_locks 01:01:52.194 default_locks_via_rpc 01:01:52.194 default_setup 01:01:52.194 denied 01:01:52.194 devices 01:01:52.194 dm_mount 01:01:52.194 dma 01:01:52.194 dpdk_governor 01:01:52.194 dpdk_mem_utility 01:01:52.194 driver 01:01:52.194 env 01:01:52.194 env_dpdk_post_init 01:01:52.194 env_mem_callbacks 01:01:52.194 env_memory 01:01:52.194 env_pci 01:01:52.194 env_vtophys 01:01:52.194 even_2G_alloc 01:01:52.194 event 01:01:52.194 event_perf 01:01:52.194 event_reactor 01:01:52.194 event_reactor_perf 01:01:52.194 event_scheduler 01:01:52.194 exit_on_failed_rpc_init 01:01:52.194 external_make_accel_driver_shared 01:01:52.194 external_make_accel_driver_static 01:01:52.194 external_make_accel_module_shared 01:01:52.194 external_make_accel_module_static 01:01:52.194 external_make_hello_bdev_shared_combo 01:01:52.194 external_make_hello_bdev_shared_iso 01:01:52.194 external_make_hello_bdev_static 01:01:52.194 external_make_hello_no_bdev_shared_combo 01:01:52.194 external_make_hello_no_bdev_shared_iso 01:01:52.194 external_make_hello_no_bdev_static 01:01:52.194 external_make_nvme_shared 01:01:52.194 external_make_nvme_static 01:01:52.194 external_run_accel_driver_shared 01:01:52.194 external_run_accel_driver_static 01:01:52.194 external_run_accel_module_shared 01:01:52.194 external_run_accel_module_static 01:01:52.194 external_run_hello_bdev_shared_combo 01:01:52.194 external_run_hello_bdev_shared_iso 01:01:52.194 external_run_hello_bdev_static 01:01:52.194 external_run_hello_no_bdev_shared_combo 01:01:52.194 external_run_hello_no_bdev_shared_iso 01:01:52.194 external_run_hello_no_bdev_static 01:01:52.194 external_run_nvme_shared 01:01:52.194 external_run_nvme_static 01:01:52.194 filesystem_btrfs 01:01:52.194 filesystem_ext4 01:01:52.194 filesystem_in_capsule_btrfs 01:01:52.194 filesystem_in_capsule_ext4 01:01:52.194 filesystem_in_capsule_xfs 01:01:52.194 filesystem_xfs 01:01:52.194 fio_dif_1_default 01:01:52.194 fio_dif_1_multi_subsystems 01:01:52.194 fio_dif_digest 01:01:52.194 fio_dif_rand_params 01:01:52.194 go_rpc 01:01:52.194 guess_driver 01:01:52.194 hello_blob 01:01:52.194 hugepages 01:01:52.194 idle 01:01:52.194 interrupt_mode 01:01:52.194 ioat 01:01:52.194 ioat_perf 01:01:52.194 ioat_verify 01:01:52.194 is_zoned 01:01:52.194 iscsi_tgt 01:01:52.194 iscsi_tgt_bdev_io_wait 01:01:52.194 iscsi_tgt_calsoft 01:01:52.194 iscsi_tgt_digest 01:01:52.194 iscsi_tgt_digests 01:01:52.194 iscsi_tgt_filesystem 01:01:52.194 iscsi_tgt_filesystem_btrfs 01:01:52.194 iscsi_tgt_filesystem_ext4 01:01:52.194 iscsi_tgt_filesystem_xfs 01:01:52.194 iscsi_tgt_fio 01:01:52.194 iscsi_tgt_fuzz 01:01:52.194 iscsi_tgt_initiator 01:01:52.194 iscsi_tgt_ip_migration 01:01:52.194 iscsi_tgt_iscsi_lvol 01:01:52.194 iscsi_tgt_login_redirection 01:01:52.194 iscsi_tgt_multiconnection 01:01:52.194 iscsi_tgt_qos 01:01:52.194 iscsi_tgt_rbd 01:01:52.194 iscsi_tgt_reset 01:01:52.194 iscsi_tgt_resize 01:01:52.194 iscsi_tgt_rpc_config 01:01:52.194 iscsi_tgt_sock 01:01:52.194 iscsi_tgt_trace_record 01:01:52.194 json_config 01:01:52.194 json_config_extra_key 01:01:52.194 kernel_target_abort 01:01:52.194 keyring_file 01:01:52.194 llvm_fuzz 01:01:52.194 locking_app_on_locked_coremask 01:01:52.194 locking_app_on_unlocked_coremask 01:01:52.194 locking_overlapped_coremask 01:01:52.194 locking_overlapped_coremask_via_rpc 01:01:52.194 lvol 01:01:52.194 lvol_basic 01:01:52.194 lvol_esnap 01:01:52.194 lvol_external_copy 01:01:52.194 lvol_external_snapshot 01:01:52.194 lvol_hotremove 01:01:52.194 lvol_provisioning 01:01:52.194 lvol_rename 01:01:52.194 lvol_resize 01:01:52.194 lvol_snapshot_clone 01:01:52.194 lvol_tasting 01:01:52.194 lvs_grow_clean 01:01:52.194 lvs_grow_dirty 01:01:52.194 make 01:01:52.194 no_shrink_alloc 01:01:52.194 non_locking_app_on_locked_coremask 01:01:52.194 nvme 01:01:52.194 nvme_arbitration 01:01:52.194 nvme_cli_cuse 01:01:52.194 nvme_cli_plugin 01:01:52.194 nvme_cmb 01:01:52.194 nvme_cuse 01:01:52.194 nvme_cuse_app 01:01:52.194 nvme_cuse_rpc 01:01:52.194 nvme_doorbell_aers 01:01:52.194 nvme_e2edp 01:01:52.194 nvme_err_injection 01:01:52.194 nvme_fdp 01:01:52.194 nvme_fio 01:01:52.194 nvme_flexible_data_placement 01:01:52.194 nvme_hello_world 01:01:52.194 nvme_identify 01:01:52.194 nvme_mount 01:01:52.194 nvme_multi_aen 01:01:52.194 nvme_multi_secondary 01:01:52.194 nvme_ns_manage_cuse 01:01:52.194 nvme_overhead 01:01:52.194 nvme_perf 01:01:52.194 nvme_pmr 01:01:52.194 nvme_pmr_persistence 01:01:52.194 nvme_reserve 01:01:52.194 nvme_reset 01:01:52.194 nvme_rpc 01:01:52.194 nvme_rpc_timeouts 01:01:52.194 nvme_scc 01:01:52.194 nvme_sgl 01:01:52.194 nvme_simple_copy 01:01:52.194 nvme_single_aen 01:01:52.194 nvme_smartctl_cuse 01:01:52.194 nvme_startup 01:01:52.194 nvme_zns 01:01:52.194 nvmf_abort 01:01:52.194 nvmf_abort_qd_sizes 01:01:52.194 nvmf_aer 01:01:52.194 nvmf_async_init 01:01:52.194 nvmf_auth_host 01:01:52.194 nvmf_auth_target 01:01:52.194 nvmf_bdev_io_wait 01:01:52.194 nvmf_bdevio 01:01:52.194 nvmf_bdevio_no_huge 01:01:52.194 nvmf_bdevperf 01:01:52.194 nvmf_connect_disconnect 01:01:52.194 nvmf_connect_stress 01:01:52.194 nvmf_delete_subsystem 01:01:52.194 nvmf_device_removal 01:01:52.194 nvmf_device_removal_pci_remove 01:01:52.194 nvmf_device_removal_pci_remove_no_srq 01:01:52.194 nvmf_dif 01:01:52.194 nvmf_digest 01:01:52.194 nvmf_digest_clean 01:01:52.194 nvmf_digest_dsa_initiator 01:01:52.194 nvmf_digest_dsa_target 01:01:52.194 nvmf_digest_error 01:01:52.194 nvmf_discovery_remove_ifc 01:01:52.194 nvmf_example 01:01:52.194 nvmf_failover 01:01:52.194 nvmf_filesystem 01:01:52.194 nvmf_filesystem_in_capsule 01:01:52.194 nvmf_filesystem_no_in_capsule 01:01:52.194 nvmf_fio_host 01:01:52.194 nvmf_fio_target 01:01:52.194 nvmf_fips 01:01:52.194 nvmf_fused_ordering 01:01:52.194 nvmf_fuzz 01:01:52.194 nvmf_host_discovery 01:01:52.194 nvmf_host_management 01:01:52.194 nvmf_host_multipath 01:01:52.194 nvmf_host_multipath_status 01:01:52.194 nvmf_identify 01:01:52.194 nvmf_identify_kernel_target 01:01:52.194 nvmf_identify_passthru 01:01:52.194 nvmf_invalid 01:01:52.194 nvmf_lvol 01:01:52.194 nvmf_lvs_grow 01:01:52.194 nvmf_mdns_discovery 01:01:52.194 nvmf_multicontroller 01:01:52.194 nvmf_multitarget 01:01:52.194 nvmf_nmic 01:01:52.194 nvmf_ns_hotplug_stress 01:01:52.194 nvmf_ns_masking 01:01:52.194 nvmf_nvme_cli 01:01:52.194 nvmf_perf 01:01:52.194 nvmf_perf_adq 01:01:52.194 nvmf_queue_depth 01:01:52.194 nvmf_rdma 01:01:52.194 nvmf_referrals 01:01:52.194 nvmf_rpc 01:01:52.194 nvmf_shutdown 01:01:52.194 nvmf_shutdown_tc1 01:01:52.194 nvmf_shutdown_tc2 01:01:52.194 nvmf_shutdown_tc3 01:01:52.194 nvmf_srq_overwhelm 01:01:52.194 nvmf_target_disconnect 01:01:52.194 nvmf_target_disconnect_tc1 01:01:52.194 nvmf_target_disconnect_tc2 01:01:52.194 nvmf_target_disconnect_tc3 01:01:52.194 nvmf_target_discovery 01:01:52.194 nvmf_target_multipath 01:01:52.194 nvmf_tcp 01:01:52.194 nvmf_timeout 01:01:52.194 nvmf_tls 01:01:52.194 nvmf_vfio_user 01:01:52.194 nvmf_vfio_user_fuzz 01:01:52.194 nvmf_vfio_user_nvme_compliance 01:01:52.194 nvmf_vhost 01:01:52.194 nvmf_zcopy 01:01:52.194 ocf 01:01:52.194 ocf_bdevperf_iotypes 01:01:52.194 ocf_configuration_change 01:01:52.194 ocf_create_destruct 01:01:52.194 ocf_fio_modes 01:01:52.194 ocf_flush 01:01:52.194 ocf_multicore 01:01:52.194 ocf_remove 01:01:52.194 ocf_stats 01:01:52.194 odd_alloc 01:01:52.195 packaging 01:01:52.195 per_node_1G_alloc 01:01:52.195 raid0_resize_test 01:01:52.195 raid5f_rebuild_test 01:01:52.195 raid5f_rebuild_test_sb 01:01:52.195 raid5f_state_function_test 01:01:52.195 raid5f_state_function_test_sb 01:01:52.195 raid5f_superblock_test 01:01:52.195 raid_function_test_concat 01:01:52.195 raid_function_test_raid0 01:01:52.195 raid_rebuild_test 01:01:52.195 raid_rebuild_test_io 01:01:52.195 raid_rebuild_test_sb 01:01:52.195 raid_rebuild_test_sb_4k 01:01:52.195 raid_rebuild_test_sb_io 01:01:52.195 raid_rebuild_test_sb_md_interleaved 01:01:52.195 raid_rebuild_test_sb_md_separate 01:01:52.195 raid_state_function_test 01:01:52.195 raid_state_function_test_sb 01:01:52.195 raid_state_function_test_sb_4k 01:01:52.195 raid_state_function_test_sb_md_interleaved 01:01:52.195 raid_state_function_test_sb_md_separate 01:01:52.195 raid_superblock_test 01:01:52.195 raid_superblock_test_4k 01:01:52.195 raid_superblock_test_md_interleaved 01:01:52.195 raid_superblock_test_md_separate 01:01:52.195 reactor_set_interrupt 01:01:52.195 reap_unregistered_poller 01:01:52.195 rocksdb 01:01:52.195 rocksdb_insert 01:01:52.195 rocksdb_overwrite 01:01:52.195 rocksdb_randread 01:01:52.195 rocksdb_readwrite 01:01:52.195 rocksdb_writesync 01:01:52.195 rpc 01:01:52.195 rpc_client 01:01:52.195 rpc_daemon_integrity 01:01:52.195 rpc_integrity 01:01:52.195 rpc_plugins 01:01:52.195 rpc_trace_cmd_test 01:01:52.195 rpm_packaging 01:01:52.195 scanbuild_make 01:01:52.195 scheduler 01:01:52.195 scheduler_create_thread 01:01:52.195 setup.sh 01:01:52.195 skip_rpc 01:01:52.195 skip_rpc_with_delay 01:01:52.195 skip_rpc_with_json 01:01:52.195 sma 01:01:52.195 sma_crypto 01:01:52.195 sma_discovery 01:01:52.195 sma_nvmf_tcp 01:01:52.195 sma_plugins 01:01:52.195 sma_qos 01:01:52.195 sma_vfiouser_qemu 01:01:52.195 sma_vhost 01:01:52.195 spdk_dd 01:01:52.195 spdk_dd_basic_rw 01:01:52.195 spdk_dd_bdev_to_bdev 01:01:52.195 spdk_dd_malloc 01:01:52.195 spdk_dd_negative 01:01:52.195 spdk_dd_posix 01:01:52.195 spdk_dd_sparse 01:01:52.195 spdk_dd_uring 01:01:52.195 spdk_target_abort 01:01:52.195 spdkcli_iscsi 01:01:52.195 spdkcli_nvmf_rdma 01:01:52.195 spdkcli_nvmf_tcp 01:01:52.195 spdkcli_raid 01:01:52.195 spdkcli_rbd 01:01:52.195 spdkcli_tcp 01:01:52.195 spdkcli_vhost 01:01:52.195 spdkcli_virtio 01:01:52.195 sw_hotplug 01:01:52.195 test_bdev_lvol_delete_lvstore_with_clones 01:01:52.195 test_bdev_lvol_delete_ordering 01:01:52.195 test_clone_decouple_parent 01:01:52.195 test_clone_inflate 01:01:52.195 test_clone_snapshot_relations 01:01:52.195 test_construct_lvol 01:01:52.195 test_construct_lvol_alias_conflict 01:01:52.195 test_construct_lvol_fio_clear_method_none 01:01:52.195 test_construct_lvol_fio_clear_method_unmap 01:01:52.195 test_construct_lvol_full_lvs 01:01:52.195 test_construct_lvol_inexistent_lvs 01:01:52.195 test_construct_lvols_conflict_alias 01:01:52.195 test_construct_lvs 01:01:52.195 test_construct_lvs_clear_methods 01:01:52.195 test_construct_lvs_conflict_alias 01:01:52.195 test_construct_lvs_different_cluster_size 01:01:52.195 test_construct_lvs_nonexistent_bdev 01:01:52.195 test_construct_multi_lvols 01:01:52.195 test_construct_nested_lvol 01:01:52.195 test_construct_two_lvs_on_the_same_bdev 01:01:52.195 test_create_snapshot_of_snapshot 01:01:52.195 test_create_snapshot_with_io 01:01:52.195 test_delete_lvol_store_persistent_positive 01:01:52.195 test_delete_snapshot_with_clone 01:01:52.195 test_delete_snapshot_with_snapshot 01:01:52.195 test_destroy_after_bdev_lvol_resize_positive 01:01:52.195 test_esnap_clones 01:01:52.195 test_esnap_late_arrival 01:01:52.195 test_esnap_reload 01:01:52.195 test_esnap_remove_degraded 01:01:52.195 test_hotremove_lvol_store 01:01:52.195 test_hotremove_lvol_store_base 01:01:52.195 test_hotremove_lvol_store_base_with_lvols 01:01:52.195 test_hotremove_lvol_store_multiple_lvols 01:01:52.195 test_lvol_bdev_readonly 01:01:52.195 test_lvol_list 01:01:52.195 test_lvol_rename_negative 01:01:52.195 test_rename_lvs_negative 01:01:52.195 test_rename_positive 01:01:52.195 test_resize_lvol 01:01:52.195 test_resize_lvol_negative 01:01:52.195 test_resize_lvol_with_io_traffic 01:01:52.195 test_shallow_copy_compare 01:01:52.195 test_sigterm 01:01:52.195 test_snapshot_compare_with_lvol_bdev 01:01:52.195 test_tasting 01:01:52.195 test_thin_lvol_check_integrity 01:01:52.195 test_thin_lvol_check_space 01:01:52.195 test_thin_lvol_check_zeroes 01:01:52.195 test_thin_lvol_resize 01:01:52.195 test_thin_overprovisioning 01:01:52.195 test_unregister_lvol_bdev 01:01:52.195 thread 01:01:52.195 thread_poller_perf 01:01:52.195 thread_spdk_lock 01:01:52.195 ubsan 01:01:52.195 unittest 01:01:52.195 unittest_accel 01:01:52.195 unittest_bdev 01:01:52.195 unittest_bdev_compress 01:01:52.195 unittest_bdev_crypto 01:01:52.195 unittest_bdev_raid5f 01:01:52.195 unittest_blob_blobfs 01:01:52.195 unittest_build 01:01:52.195 unittest_dma 01:01:52.195 unittest_dpdk_compressdev 01:01:52.195 unittest_event 01:01:52.195 unittest_ftl 01:01:52.195 unittest_idxd_user 01:01:52.195 unittest_include 01:01:52.195 unittest_init 01:01:52.195 unittest_ioat 01:01:52.195 unittest_iobuf 01:01:52.195 unittest_iscsi 01:01:52.195 unittest_json 01:01:52.195 unittest_keyring 01:01:52.195 unittest_lib_reduce 01:01:52.195 unittest_log 01:01:52.195 unittest_lvol 01:01:52.195 unittest_notify 01:01:52.195 unittest_nvme 01:01:52.195 unittest_nvme_cuse 01:01:52.195 unittest_nvme_rdma 01:01:52.195 unittest_nvmf 01:01:52.195 unittest_nvmf_rdma 01:01:52.195 unittest_nvmf_transport 01:01:52.195 unittest_nvmf_vfio_user 01:01:52.195 unittest_pci_event 01:01:52.195 unittest_rdma 01:01:52.195 unittest_rpc 01:01:52.195 unittest_scsi 01:01:52.195 unittest_sock 01:01:52.195 unittest_thread 01:01:52.195 unittest_util 01:01:52.195 unittest_vhost 01:01:52.195 valgrind 01:01:52.195 version 01:01:52.195 vfio_fuzz 01:01:52.195 vfio_user_nvme_fio 01:01:52.195 vfio_user_nvme_restart_vm 01:01:52.195 vfio_user_qemu 01:01:52.195 vfio_user_virtio_bdevperf 01:01:52.195 vfio_user_virtio_blk_restart_vm 01:01:52.195 vfio_user_virtio_scsi_restart_vm 01:01:52.195 vhost 01:01:52.195 vhost_blk_lvol_integrity 01:01:52.195 vhost_blk_packed_ring_integrity 01:01:52.195 vhost_blockdev 01:01:52.195 vhost_boot 01:01:52.195 vhost_fuzz 01:01:52.195 vhost_negative 01:01:52.195 vhost_scsi_lvol_integrity 01:01:52.195 vhost_shared 01:01:52.195 zoned_fio 01:01:52.195 01:01:52.195 01:01:52.195 -----Tests Missing From Build------ 01:01:52.195 balanced 01:01:52.195 blockdev_xnvme 01:01:52.195 build_native_dpdk 01:01:52.195 build_shared_native_dpdk_rpm 01:01:52.195 build_shared_rpm_with_rpmed_dpdk 01:01:52.195 busy 01:01:52.195 core_load 01:01:52.195 ftl 01:01:52.195 ftl_bdevperf 01:01:52.195 ftl_dirty_shutdown 01:01:52.195 ftl_fio_basic 01:01:52.195 ftl_restore 01:01:52.195 ftl_restore_fast 01:01:52.195 ftl_trim 01:01:52.195 ftl_upgrade_shutdown 01:01:52.195 iscsi_tgt_data_digest 01:01:52.195 iscsi_tgt_ext4test 01:01:52.195 keyring_linux 01:01:52.195 nvme_boot_partition 01:01:52.195 nvme_bp 01:01:52.195 nvme_opal 01:01:52.195 nvme_opal_bdevio 01:01:52.195 nvme_opal_bdevperf 01:01:52.195 nvme_opal_spdk_tgt 01:01:52.195 nvme_xnvme 01:01:52.195 nvmf_fc 01:01:52.195 nvmf_initiator_timeout 01:01:52.195 nvmf_multiconnection 01:01:52.195 spdkcli_nvmf_fc 01:01:52.195 test_create_multi_ublk 01:01:52.195 test_create_ublk 01:01:52.195 test_save_ublk_config 01:01:52.195 ublk 01:01:52.195 ublk_recovery 01:01:52.195 unittest_nvmf_fc 01:01:52.195 unittest_nvmf_fc_ls 01:01:52.195 vhost_blk_cores_2ctrl 01:01:52.195 vhost_blk_fs_integrity 01:01:52.195 vhost_blk_hot_remove 01:01:52.195 vhost_blk_integrity 01:01:52.195 vhost_hotplug 01:01:52.195 vhost_migration 01:01:52.195 vhost_migration_tc1 01:01:52.195 vhost_migration_tc2 01:01:52.195 vhost_readonly 01:01:52.195 vhost_scsi_cores_2ctrl 01:01:52.195 vhost_scsi_fs_integrity 01:01:52.195 vhost_scsi_hot_remove 01:01:52.195 vhost_scsi_integrity 01:01:52.195 vmd 01:01:52.195 vmd_bdev_svc 01:01:52.195 vmd_fio 01:01:52.195 vmd_hello_world 01:01:52.195 vmd_identify 01:01:52.195 vmd_perf 01:01:52.195 xnvme_bdevperf 01:01:52.195 xnvme_to_malloc_dd_copy 01:01:52.195 01:01:52.195 01:01:52.195 -----Tests Missing ASAN------ 01:01:52.195 accel_cdev_comp 01:01:52.195 accel_cdev_decmop_full 01:01:52.195 accel_cdev_decomp 01:01:52.195 accel_cdev_decomp_full_mcore 01:01:52.195 accel_cdev_decomp_full_mthread 01:01:52.195 accel_cdev_decomp_mcore 01:01:52.195 accel_cdev_decomp_mthread 01:01:52.195 autobuild 01:01:52.195 autobuild_build_doc 01:01:52.195 autobuild_check_dpdk_pci_api 01:01:52.195 autobuild_check_format 01:01:52.195 autobuild_check_so_deps 01:01:52.195 autobuild_external_code 01:01:52.195 autobuild_generated_files_check 01:01:52.195 autobuild_generated_files_check_post_clean 01:01:52.195 autobuild_header_dependency_check 01:01:52.195 autobuild_llvm_precompile 01:01:52.195 autobuild_make_install 01:01:52.195 autobuild_make_uninstall 01:01:52.195 autobuild_ocf_precompile 01:01:52.195 balanced 01:01:52.195 bdev_crypto_enomem 01:01:52.195 blockdev_crypto_aesni 01:01:52.195 blockdev_crypto_qat 01:01:52.195 blockdev_crypto_sw 01:01:52.195 blockdev_rbd 01:01:52.195 blockdev_xnvme 01:01:52.196 build_native_dpdk 01:01:52.196 build_shared_native_dpdk_rpm 01:01:52.196 build_shared_rpm_with_rpmed_dpdk 01:01:52.196 busy 01:01:52.196 chaining 01:01:52.196 check_header_filenames 01:01:52.196 cmb_copy 01:01:52.196 compress_compdev 01:01:52.196 compress_isal 01:01:52.196 confirm_abi_deps 01:01:52.196 confirm_makefile_deps 01:01:52.196 core_load 01:01:52.196 dd_uring_copy 01:01:52.196 dpdk_governor 01:01:52.196 external_make_accel_driver_shared 01:01:52.196 external_make_accel_driver_static 01:01:52.196 external_make_accel_module_shared 01:01:52.196 external_make_accel_module_static 01:01:52.196 external_make_hello_bdev_shared_combo 01:01:52.196 external_make_hello_bdev_shared_iso 01:01:52.196 external_make_hello_bdev_static 01:01:52.196 external_make_hello_no_bdev_shared_combo 01:01:52.196 external_make_hello_no_bdev_shared_iso 01:01:52.196 external_make_hello_no_bdev_static 01:01:52.196 external_make_nvme_shared 01:01:52.196 external_make_nvme_static 01:01:52.196 external_run_accel_driver_shared 01:01:52.196 external_run_accel_driver_static 01:01:52.196 external_run_accel_module_shared 01:01:52.196 external_run_accel_module_static 01:01:52.196 external_run_hello_bdev_shared_combo 01:01:52.196 external_run_hello_bdev_shared_iso 01:01:52.196 external_run_hello_bdev_static 01:01:52.196 external_run_hello_no_bdev_shared_combo 01:01:52.196 external_run_hello_no_bdev_shared_iso 01:01:52.196 external_run_hello_no_bdev_static 01:01:52.196 external_run_nvme_shared 01:01:52.196 external_run_nvme_static 01:01:52.196 ftl 01:01:52.196 ftl_bdevperf 01:01:52.196 ftl_dirty_shutdown 01:01:52.196 ftl_fio_basic 01:01:52.196 ftl_restore 01:01:52.196 ftl_restore_fast 01:01:52.196 ftl_trim 01:01:52.196 ftl_upgrade_shutdown 01:01:52.196 go_rpc 01:01:52.196 idle 01:01:52.196 interrupt_mode 01:01:52.196 ioat 01:01:52.196 ioat_perf 01:01:52.196 ioat_verify 01:01:52.196 is_zoned 01:01:52.196 iscsi_tgt 01:01:52.196 iscsi_tgt_bdev_io_wait 01:01:52.196 iscsi_tgt_calsoft 01:01:52.196 iscsi_tgt_data_digest 01:01:52.196 iscsi_tgt_digest 01:01:52.196 iscsi_tgt_digests 01:01:52.196 iscsi_tgt_ext4test 01:01:52.196 iscsi_tgt_filesystem 01:01:52.196 iscsi_tgt_filesystem_btrfs 01:01:52.196 iscsi_tgt_filesystem_ext4 01:01:52.196 iscsi_tgt_filesystem_xfs 01:01:52.196 iscsi_tgt_fio 01:01:52.196 iscsi_tgt_fuzz 01:01:52.196 iscsi_tgt_initiator 01:01:52.196 iscsi_tgt_ip_migration 01:01:52.196 iscsi_tgt_iscsi_lvol 01:01:52.196 iscsi_tgt_login_redirection 01:01:52.196 iscsi_tgt_multiconnection 01:01:52.196 iscsi_tgt_qos 01:01:52.196 iscsi_tgt_rbd 01:01:52.196 iscsi_tgt_reset 01:01:52.196 iscsi_tgt_resize 01:01:52.196 iscsi_tgt_rpc_config 01:01:52.196 iscsi_tgt_sock 01:01:52.196 iscsi_tgt_trace_record 01:01:52.196 keyring_linux 01:01:52.196 llvm_fuzz 01:01:52.196 nvme_boot_partition 01:01:52.196 nvme_bp 01:01:52.196 nvme_cli_cuse 01:01:52.196 nvme_cli_plugin 01:01:52.196 nvme_cmb 01:01:52.196 nvme_cuse 01:01:52.196 nvme_cuse_app 01:01:52.196 nvme_cuse_rpc 01:01:52.196 nvme_ns_manage_cuse 01:01:52.196 nvme_opal 01:01:52.196 nvme_opal_bdevio 01:01:52.196 nvme_opal_bdevperf 01:01:52.196 nvme_opal_spdk_tgt 01:01:52.196 nvme_pmr 01:01:52.196 nvme_pmr_persistence 01:01:52.196 nvme_smartctl_cuse 01:01:52.196 nvme_xnvme 01:01:52.196 nvme_zns 01:01:52.196 nvmf_bdevperf 01:01:52.196 nvmf_device_removal 01:01:52.196 nvmf_device_removal_pci_remove 01:01:52.196 nvmf_device_removal_pci_remove_no_srq 01:01:52.196 nvmf_digest_clean 01:01:52.196 nvmf_fc 01:01:52.196 nvmf_fuzz 01:01:52.196 nvmf_host_multipath 01:01:52.196 nvmf_initiator_timeout 01:01:52.196 nvmf_mdns_discovery 01:01:52.196 nvmf_multiconnection 01:01:52.196 nvmf_nvme_cli 01:01:52.196 nvmf_perf_adq 01:01:52.196 nvmf_rdma 01:01:52.196 nvmf_shutdown 01:01:52.196 nvmf_shutdown_tc1 01:01:52.196 nvmf_shutdown_tc2 01:01:52.196 nvmf_shutdown_tc3 01:01:52.196 nvmf_srq_overwhelm 01:01:52.196 nvmf_target_disconnect 01:01:52.196 nvmf_target_disconnect_tc1 01:01:52.454 nvmf_target_disconnect_tc2 01:01:52.454 nvmf_target_disconnect_tc3 01:01:52.454 nvmf_timeout 01:01:52.454 nvmf_vfio_user 01:01:52.454 nvmf_vfio_user_fuzz 01:01:52.454 nvmf_vfio_user_nvme_compliance 01:01:52.454 ocf 01:01:52.454 ocf_bdevperf_iotypes 01:01:52.454 ocf_configuration_change 01:01:52.454 ocf_create_destruct 01:01:52.454 ocf_fio_modes 01:01:52.454 ocf_flush 01:01:52.454 ocf_multicore 01:01:52.454 ocf_remove 01:01:52.454 ocf_stats 01:01:52.454 scanbuild_make 01:01:52.454 scheduler 01:01:52.454 spdk_dd_uring 01:01:52.454 spdkcli_iscsi 01:01:52.454 spdkcli_nvmf_fc 01:01:52.454 spdkcli_nvmf_rdma 01:01:52.454 spdkcli_raid 01:01:52.454 spdkcli_rbd 01:01:52.454 spdkcli_virtio 01:01:52.454 test_create_multi_ublk 01:01:52.454 test_create_ublk 01:01:52.454 test_save_ublk_config 01:01:52.454 ublk 01:01:52.454 ublk_recovery 01:01:52.454 unittest_bdev_compress 01:01:52.454 unittest_bdev_crypto 01:01:52.454 unittest_dpdk_compressdev 01:01:52.454 unittest_lib_reduce 01:01:52.454 unittest_nvmf_fc 01:01:52.454 unittest_nvmf_fc_ls 01:01:52.454 unittest_nvmf_vfio_user 01:01:52.454 valgrind 01:01:52.454 vfio_fuzz 01:01:52.454 vhost_blk_cores_2ctrl 01:01:52.454 vhost_blk_fs_integrity 01:01:52.454 vhost_blk_hot_remove 01:01:52.454 vhost_blk_integrity 01:01:52.454 vhost_blockdev 01:01:52.454 vhost_fuzz 01:01:52.454 vhost_hotplug 01:01:52.454 vhost_migration 01:01:52.454 vhost_migration_tc1 01:01:52.454 vhost_migration_tc2 01:01:52.454 vhost_readonly 01:01:52.454 vhost_scsi_cores_2ctrl 01:01:52.454 vhost_scsi_fs_integrity 01:01:52.454 vhost_scsi_hot_remove 01:01:52.454 vhost_scsi_integrity 01:01:52.454 vhost_shared 01:01:52.454 vmd 01:01:52.454 vmd_bdev_svc 01:01:52.454 vmd_fio 01:01:52.454 vmd_hello_world 01:01:52.454 vmd_identify 01:01:52.454 vmd_perf 01:01:52.454 xnvme_bdevperf 01:01:52.454 xnvme_to_malloc_dd_copy 01:01:52.454 zoned_fio 01:01:52.454 01:01:52.454 01:01:52.454 -----Tests Missing UBSAN------ 01:01:52.454 autobuild 01:01:52.454 autobuild_build_doc 01:01:52.454 autobuild_check_dpdk_pci_api 01:01:52.454 autobuild_check_format 01:01:52.454 autobuild_check_so_deps 01:01:52.454 autobuild_external_code 01:01:52.454 autobuild_generated_files_check 01:01:52.454 autobuild_generated_files_check_post_clean 01:01:52.454 autobuild_header_dependency_check 01:01:52.454 autobuild_make_install 01:01:52.454 autobuild_make_uninstall 01:01:52.454 balanced 01:01:52.454 blockdev_xnvme 01:01:52.454 build_native_dpdk 01:01:52.454 build_rpm_from_gen_spec 01:01:52.454 build_shared_native_dpdk_rpm 01:01:52.454 build_shared_rpm 01:01:52.454 build_shared_rpm_with_rpmed_dpdk 01:01:52.454 busy 01:01:52.454 check_header_filenames 01:01:52.454 cmb_copy 01:01:52.454 confirm_abi_deps 01:01:52.454 confirm_makefile_deps 01:01:52.454 core_load 01:01:52.454 external_make_accel_driver_shared 01:01:52.454 external_make_accel_driver_static 01:01:52.454 external_make_accel_module_shared 01:01:52.454 external_make_accel_module_static 01:01:52.454 external_make_hello_bdev_shared_combo 01:01:52.454 external_make_hello_bdev_shared_iso 01:01:52.454 external_make_hello_bdev_static 01:01:52.454 external_make_hello_no_bdev_shared_combo 01:01:52.454 external_make_hello_no_bdev_shared_iso 01:01:52.454 external_make_hello_no_bdev_static 01:01:52.454 external_make_nvme_shared 01:01:52.454 external_make_nvme_static 01:01:52.454 external_run_accel_driver_shared 01:01:52.454 external_run_accel_driver_static 01:01:52.454 external_run_accel_module_shared 01:01:52.454 external_run_accel_module_static 01:01:52.454 external_run_hello_bdev_shared_combo 01:01:52.454 external_run_hello_bdev_shared_iso 01:01:52.454 external_run_hello_bdev_static 01:01:52.454 external_run_hello_no_bdev_shared_combo 01:01:52.454 external_run_hello_no_bdev_shared_iso 01:01:52.454 external_run_hello_no_bdev_static 01:01:52.454 external_run_nvme_shared 01:01:52.454 external_run_nvme_static 01:01:52.454 ftl 01:01:52.454 ftl_bdevperf 01:01:52.454 ftl_dirty_shutdown 01:01:52.454 ftl_fio_basic 01:01:52.454 ftl_restore 01:01:52.454 ftl_restore_fast 01:01:52.454 ftl_trim 01:01:52.454 ftl_upgrade_shutdown 01:01:52.454 is_zoned 01:01:52.454 iscsi_tgt_data_digest 01:01:52.454 iscsi_tgt_ext4test 01:01:52.454 keyring_linux 01:01:52.454 nvme_boot_partition 01:01:52.454 nvme_bp 01:01:52.454 nvme_cmb 01:01:52.454 nvme_opal 01:01:52.454 nvme_opal_bdevio 01:01:52.454 nvme_opal_bdevperf 01:01:52.454 nvme_opal_spdk_tgt 01:01:52.454 nvme_pmr 01:01:52.454 nvme_pmr_persistence 01:01:52.454 nvme_xnvme 01:01:52.454 nvme_zns 01:01:52.454 nvmf_fc 01:01:52.454 nvmf_initiator_timeout 01:01:52.454 nvmf_multiconnection 01:01:52.454 packaging 01:01:52.454 rpm_packaging 01:01:52.454 scanbuild_make 01:01:52.454 spdkcli_nvmf_fc 01:01:52.454 test_create_multi_ublk 01:01:52.454 test_create_ublk 01:01:52.454 test_save_ublk_config 01:01:52.454 ublk 01:01:52.454 ublk_recovery 01:01:52.454 unittest_bdev_compress 01:01:52.454 unittest_bdev_crypto 01:01:52.454 unittest_dpdk_compressdev 01:01:52.454 unittest_lib_reduce 01:01:52.454 unittest_nvmf_fc 01:01:52.454 unittest_nvmf_fc_ls 01:01:52.454 unittest_nvmf_vfio_user 01:01:52.454 valgrind 01:01:52.454 vhost_blk_cores_2ctrl 01:01:52.454 vhost_blk_fs_integrity 01:01:52.454 vhost_blk_hot_remove 01:01:52.454 vhost_blk_integrity 01:01:52.454 vhost_hotplug 01:01:52.454 vhost_migration 01:01:52.454 vhost_migration_tc1 01:01:52.454 vhost_migration_tc2 01:01:52.454 vhost_readonly 01:01:52.454 vhost_scsi_cores_2ctrl 01:01:52.454 vhost_scsi_fs_integrity 01:01:52.454 vhost_scsi_hot_remove 01:01:52.454 vhost_scsi_integrity 01:01:52.454 vmd 01:01:52.454 vmd_bdev_svc 01:01:52.454 vmd_fio 01:01:52.454 vmd_hello_world 01:01:52.454 vmd_identify 01:01:52.454 vmd_perf 01:01:52.454 xnvme_bdevperf 01:01:52.454 xnvme_to_malloc_dd_copy 01:01:52.454 zoned_fio 01:01:52.454 Not all tests were run. Failing the build. 01:01:52.454 ['blockdev_xnvme', 'ftl', 'ftl_bdevperf', 'ftl_dirty_shutdown', 'ftl_fio_basic', 'ftl_restore', 'ftl_trim', 'ftl_upgrade_shutdown', 'nvme_xnvme', 'test_create_multi_ublk', 'test_create_ublk', 'test_save_ublk_config', 'ublk', 'ublk_recovery', 'xnvme_bdevperf', 'xnvme_to_malloc_dd_copy'] 01:01:52.454 + compress_coverage_and_docs 01:01:52.454 + echo 'Start compress coverage and docs' 01:01:52.454 Start compress coverage and docs 01:01:52.454 + tar -C coverage -czf coverage_autotest-per-patch_122852.tar.gz ./ --remove-files 01:01:53.402 + tar -C ut_coverage -czf ut_coverage_autotest-per-patch_122852.tar.gz ./ --remove-files 01:01:54.337 + tar -C doc -czf doc_autotest-per-patch_122852.tar.gz ./ --remove-files 01:01:54.594 + [[ -d llvm ]] 01:01:54.594 + true 01:01:54.594 + echo 'End compress coverage and docs' 01:01:54.594 End compress coverage and docs 01:01:54.594 + remove_partial_coverage_files 01:01:54.594 + find . -name 'cov_*.info' -delete 01:01:54.594 + echo 'End stage post_gen_coverage.sh' 01:01:54.594 End stage post_gen_coverage.sh 01:01:54.609 [Pipeline] } 01:01:54.613 ERROR: script returned exit code 1 01:01:54.642 [Pipeline] // catchError 01:01:54.651 [Pipeline] catchError 01:01:54.653 [Pipeline] { 01:01:54.672 [Pipeline] dir 01:01:54.673 Running in /var/jenkins/workspace/autotest-per-patch_5/post_process 01:01:54.674 [Pipeline] {