00:00:00.001 Started by user sys_sgci 00:00:00.007 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/autotest-per-patch_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-upstream/autotest.groovy 00:00:00.008 The recommended git tool is: git 00:00:00.008 using credential 00000000-0000-0000-0000-000000000002 00:00:00.009 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/autotest-per-patch_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.019 Fetching changes from the remote Git repository 00:00:00.020 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.030 Using shallow fetch with depth 1 00:00:00.030 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.030 > git --version # timeout=10 00:00:00.038 > git --version # 'git version 2.39.2' 00:00:00.038 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.039 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.039 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:02.297 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:02.308 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:02.319 Checking out Revision c7986954d8037b9c61764d44ed2af24625b251c6 (FETCH_HEAD) 00:00:02.319 > git config core.sparsecheckout # timeout=10 00:00:02.328 > git read-tree -mu HEAD # timeout=10 00:00:02.343 > git checkout -f c7986954d8037b9c61764d44ed2af24625b251c6 # timeout=5 00:00:02.360 Commit message: "inventory/dev: add missing long names" 00:00:02.360 > git rev-list --no-walk c7986954d8037b9c61764d44ed2af24625b251c6 # timeout=10 00:00:02.899 [Pipeline] Start of Pipeline 00:00:02.915 [Pipeline] library 00:00:02.917 Loading library shm_lib@master 00:00:02.917 Library shm_lib@master is cached. Copying from home. 00:00:02.944 [Pipeline] node 00:00:02.950 Running on ME2 in /var/jenkins/workspace/autotest-per-patch_6 00:00:02.956 [Pipeline] { 00:00:02.973 [Pipeline] cleanWs 00:00:02.988 [WS-CLEANUP] Deleting project workspace... 00:00:02.988 [WS-CLEANUP] Deferred wipeout is used... 00:00:02.993 [WS-CLEANUP] done 00:00:02.998 [Pipeline] stage 00:00:03.002 [Pipeline] { (Prologue) 00:00:03.100 [Pipeline] withCredentials 00:00:03.108 > git --version # timeout=10 00:00:03.122 > git --version # 'git version 2.39.2' 00:00:03.134 Masking supported pattern matches of $GIT_USERNAME or $GIT_PASSWORD or $GIT_ASKPASS 00:00:03.136 [Pipeline] { 00:00:03.147 [Pipeline] retry 00:00:03.149 [Pipeline] { 00:00:03.316 [Pipeline] sh 00:00:03.587 + git ls-remote https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master 00:00:05.503 [Pipeline] } 00:00:05.530 [Pipeline] // retry 00:00:05.536 [Pipeline] } 00:00:05.557 [Pipeline] // withCredentials 00:00:05.566 [Pipeline] nodesByLabel 00:00:05.567 Found a total of 1 nodes with the 'sorcerer' label 00:00:05.579 [Pipeline] httpRequest 00:00:05.583 HttpMethod: GET 00:00:05.583 URL: http://10.211.164.101/packages/jbp_c7986954d8037b9c61764d44ed2af24625b251c6.tar.gz 00:00:05.584 Sending request to url: http://10.211.164.101/packages/jbp_c7986954d8037b9c61764d44ed2af24625b251c6.tar.gz 00:00:05.585 Response Code: HTTP/1.1 200 OK 00:00:05.585 Success: Status code 200 is in the accepted range: 200,404 00:00:05.586 Saving response body to /var/jenkins/workspace/autotest-per-patch_6/jbp_c7986954d8037b9c61764d44ed2af24625b251c6.tar.gz 00:00:05.725 [Pipeline] sh 00:00:06.000 + tar --no-same-owner -xf jbp_c7986954d8037b9c61764d44ed2af24625b251c6.tar.gz 00:00:06.021 [Pipeline] httpRequest 00:00:06.025 HttpMethod: GET 00:00:06.026 URL: http://10.211.164.101/packages/spdk_95a28e5018021aee444e964fedde3d40ced5d653.tar.gz 00:00:06.027 Sending request to url: http://10.211.164.101/packages/spdk_95a28e5018021aee444e964fedde3d40ced5d653.tar.gz 00:00:06.027 Response Code: HTTP/1.1 404 Not Found 00:00:06.028 Success: Status code 404 is in the accepted range: 200,404 00:00:06.028 Saving response body to /var/jenkins/workspace/autotest-per-patch_6/spdk_95a28e5018021aee444e964fedde3d40ced5d653.tar.gz 00:00:06.039 [Pipeline] sh 00:00:06.310 + rm -f spdk_95a28e5018021aee444e964fedde3d40ced5d653.tar.gz 00:00:06.326 [Pipeline] node 00:00:06.333 Running on GP10 in /var/jenkins/workspace/autotest-per-patch 00:00:06.342 [Pipeline] { 00:00:06.362 [Pipeline] cleanWs 00:00:06.374 [WS-CLEANUP] Deleting project workspace... 00:00:06.374 [WS-CLEANUP] Deferred wipeout is used... 00:00:06.381 [WS-CLEANUP] done 00:00:06.386 [Pipeline] sh 00:00:06.676 + find /storage/packages/ -type f -mtime +34 -print -delete 00:00:06.695 [Pipeline] retry 00:00:06.697 [Pipeline] { 00:00:06.724 [Pipeline] checkout 00:00:06.731 The recommended git tool is: NONE 00:00:06.745 using credential 00000000-0000-0000-0000-000000000002 00:00:06.750 Cloning the remote Git repository 00:00:06.754 Honoring refspec on initial clone 00:00:06.758 Cloning repository https://review.spdk.io/gerrit/a/spdk/spdk 00:00:06.759 > git init /var/jenkins/workspace/autotest-per-patch/spdk # timeout=10 00:00:06.766 Using reference repository: /var/ci_repos/spdk_multi 00:00:06.766 Fetching upstream changes from https://review.spdk.io/gerrit/a/spdk/spdk 00:00:06.766 > git --version # timeout=10 00:00:06.770 > git --version # 'git version 2.42.0' 00:00:06.770 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:06.771 Setting http proxy: proxy-dmz.intel.com:911 00:00:06.771 > git fetch --tags --force --progress -- https://review.spdk.io/gerrit/a/spdk/spdk refs/changes/90/21690/15 +refs/heads/master:refs/remotes/origin/master # timeout=10 00:00:24.340 Avoid second fetch 00:00:24.354 Checking out Revision 95a28e5018021aee444e964fedde3d40ced5d653 (FETCH_HEAD) 00:00:24.322 > git config remote.origin.url https://review.spdk.io/gerrit/a/spdk/spdk # timeout=10 00:00:24.326 > git config --add remote.origin.fetch refs/changes/90/21690/15 # timeout=10 00:00:24.330 > git config --add remote.origin.fetch +refs/heads/master:refs/remotes/origin/master # timeout=10 00:00:24.343 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:24.350 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:24.357 > git config core.sparsecheckout # timeout=10 00:00:24.361 > git checkout -f 95a28e5018021aee444e964fedde3d40ced5d653 # timeout=10 00:00:24.661 Commit message: "lvol: add lvol set external parent" 00:00:24.669 First time build. Skipping changelog. 00:00:24.664 > git rev-list --no-walk 62bc4f069f41d8a2292e9ce21f92cfbb075a44cf # timeout=10 00:00:24.675 > git remote # timeout=10 00:00:24.679 > git submodule init # timeout=10 00:00:24.727 > git submodule sync # timeout=10 00:00:24.773 > git config --get remote.origin.url # timeout=10 00:00:24.780 > git submodule init # timeout=10 00:00:24.824 > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10 00:00:24.827 > git config --get submodule.dpdk.url # timeout=10 00:00:24.831 > git remote # timeout=10 00:00:24.834 > git config --get remote.origin.url # timeout=10 00:00:24.838 > git config -f .gitmodules --get submodule.dpdk.path # timeout=10 00:00:24.841 > git config --get submodule.intel-ipsec-mb.url # timeout=10 00:00:24.845 > git remote # timeout=10 00:00:24.848 > git config --get remote.origin.url # timeout=10 00:00:24.852 > git config -f .gitmodules --get submodule.intel-ipsec-mb.path # timeout=10 00:00:24.855 > git config --get submodule.isa-l.url # timeout=10 00:00:24.859 > git remote # timeout=10 00:00:24.862 > git config --get remote.origin.url # timeout=10 00:00:24.866 > git config -f .gitmodules --get submodule.isa-l.path # timeout=10 00:00:24.869 > git config --get submodule.ocf.url # timeout=10 00:00:24.873 > git remote # timeout=10 00:00:24.876 > git config --get remote.origin.url # timeout=10 00:00:24.879 > git config -f .gitmodules --get submodule.ocf.path # timeout=10 00:00:24.883 > git config --get submodule.libvfio-user.url # timeout=10 00:00:24.886 > git remote # timeout=10 00:00:24.890 > git config --get remote.origin.url # timeout=10 00:00:24.893 > git config -f .gitmodules --get submodule.libvfio-user.path # timeout=10 00:00:24.896 > git config --get submodule.xnvme.url # timeout=10 00:00:24.900 > git remote # timeout=10 00:00:24.903 > git config --get remote.origin.url # timeout=10 00:00:24.907 > git config -f .gitmodules --get submodule.xnvme.path # timeout=10 00:00:24.910 > git config --get submodule.isa-l-crypto.url # timeout=10 00:00:24.914 > git remote # timeout=10 00:00:24.918 > git config --get remote.origin.url # timeout=10 00:00:24.921 > git config -f .gitmodules --get submodule.isa-l-crypto.path # timeout=10 00:00:24.925 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:24.925 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:24.925 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:24.925 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:24.926 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:24.926 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:24.926 Setting http proxy: proxy-dmz.intel.com:911 00:00:24.926 Setting http proxy: proxy-dmz.intel.com:911 00:00:24.926 > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi intel-ipsec-mb # timeout=10 00:00:24.926 > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi dpdk # timeout=10 00:00:24.926 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:24.926 Setting http proxy: proxy-dmz.intel.com:911 00:00:24.926 > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi isa-l # timeout=10 00:00:24.926 Setting http proxy: proxy-dmz.intel.com:911 00:00:24.926 Setting http proxy: proxy-dmz.intel.com:911 00:00:24.926 > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi ocf # timeout=10 00:00:24.926 Setting http proxy: proxy-dmz.intel.com:911 00:00:24.926 > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi xnvme # timeout=10 00:00:24.926 > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi libvfio-user # timeout=10 00:00:24.926 Setting http proxy: proxy-dmz.intel.com:911 00:00:24.926 > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi isa-l-crypto # timeout=10 00:00:35.382 [Pipeline] dir 00:00:35.382 Running in /var/jenkins/workspace/autotest-per-patch/spdk 00:00:35.384 [Pipeline] { 00:00:35.404 [Pipeline] sh 00:00:35.693 ++ nproc 00:00:35.693 + threads=48 00:00:35.693 + git repack -a -d --threads=48 00:00:43.836 + git submodule foreach git repack -a -d --threads=48 00:00:43.836 Entering 'dpdk' 00:00:48.043 Entering 'intel-ipsec-mb' 00:00:48.043 Entering 'isa-l' 00:00:48.043 Entering 'isa-l-crypto' 00:00:48.304 Entering 'libvfio-user' 00:00:48.304 Entering 'ocf' 00:00:48.564 Entering 'xnvme' 00:00:48.825 + find .git -type f -name alternates -print -delete 00:00:48.825 .git/modules/libvfio-user/objects/info/alternates 00:00:48.825 .git/modules/dpdk/objects/info/alternates 00:00:48.825 .git/modules/ocf/objects/info/alternates 00:00:48.825 .git/modules/intel-ipsec-mb/objects/info/alternates 00:00:48.825 .git/modules/isa-l/objects/info/alternates 00:00:48.825 .git/modules/xnvme/objects/info/alternates 00:00:48.825 .git/modules/isa-l-crypto/objects/info/alternates 00:00:48.825 .git/objects/info/alternates 00:00:48.837 [Pipeline] } 00:00:48.857 [Pipeline] // dir 00:00:48.862 [Pipeline] } 00:00:48.879 [Pipeline] // retry 00:00:48.887 [Pipeline] sh 00:00:49.169 + tar -cf spdk_95a28e5018021aee444e964fedde3d40ced5d653.tar.gz -I pigz spdk 00:00:49.751 [Pipeline] httpRequest 00:00:49.757 HttpMethod: PUT 00:00:49.757 URL: http://10.211.164.101/cgi-bin/sorcerer.py?group=packages&filename=spdk_95a28e5018021aee444e964fedde3d40ced5d653.tar.gz 00:00:49.758 Sending request to url: http://10.211.164.101/cgi-bin/sorcerer.py?group=packages&filename=spdk_95a28e5018021aee444e964fedde3d40ced5d653.tar.gz 00:00:50.586 Response Code: HTTP/1.1 200 OK 00:00:50.591 Success: Status code 200 is in the accepted range: 200 00:00:50.595 [Pipeline] echo 00:00:50.597 00:00:50.597 Locking 00:00:50.597 Waited 0s for lock 00:00:50.597 Everything Fine. Saved: /storage/packages/spdk_95a28e5018021aee444e964fedde3d40ced5d653.tar.gz 00:00:50.597 00:00:50.602 [Pipeline] cleanWs 00:00:50.610 [WS-CLEANUP] Deleting project workspace... 00:00:50.610 [WS-CLEANUP] Deferred wipeout is used... 00:00:50.617 [WS-CLEANUP] done 00:00:50.620 [Pipeline] } 00:00:50.650 [Pipeline] // node 00:00:50.658 [Pipeline] retry 00:00:50.660 [Pipeline] { 00:00:50.678 [Pipeline] httpRequest 00:00:50.681 HttpMethod: GET 00:00:50.682 URL: http://10.211.164.101/packages/spdk_95a28e5018021aee444e964fedde3d40ced5d653.tar.gz 00:00:50.682 Sending request to url: http://10.211.164.101/packages/spdk_95a28e5018021aee444e964fedde3d40ced5d653.tar.gz 00:00:50.683 Response Code: HTTP/1.1 200 OK 00:00:50.683 Success: Status code 200 is in the accepted range: 200,404 00:00:50.684 Saving response body to /var/jenkins/workspace/autotest-per-patch_6/spdk_95a28e5018021aee444e964fedde3d40ced5d653.tar.gz 00:00:52.899 [Pipeline] } 00:00:52.919 [Pipeline] // retry 00:00:52.929 [Pipeline] sh 00:00:53.203 + tar --no-same-owner -xf spdk_95a28e5018021aee444e964fedde3d40ced5d653.tar.gz 00:00:55.741 [Pipeline] sh 00:00:56.016 + git -C spdk log --oneline -n5 00:00:56.016 95a28e501 lvol: add lvol set external parent 00:00:56.016 3216253e6 lvol: add lvol set parent 00:00:56.016 567565736 blob: add blob set external parent 00:00:56.016 0e4f7fc9b blob: add blob set parent 00:00:56.016 4506c0c36 test/common: Enable inherit_errexit 00:00:56.033 [Pipeline] setCustomBuildProperty 00:00:56.042 [Pipeline] setCustomBuildProperty 00:00:56.051 [Pipeline] catchError 00:00:56.052 [Pipeline] { 00:00:56.072 [Pipeline] sh 00:00:56.348 + git -C spdk describe --tags --abbrev=0 origin/master 00:00:56.362 [Pipeline] sh 00:00:56.636 + git -C spdk describe --tags --abbrev=0 --exclude=LTS HEAD 00:00:56.650 [Pipeline] echo 00:00:56.653 Branch: master 00:00:56.658 [Pipeline] fileExists 00:00:56.678 [Pipeline] readJSON 00:00:56.692 [Pipeline] } 00:00:56.719 [Pipeline] // catchError 00:00:56.724 [Pipeline] } 00:00:56.750 [Pipeline] // stage 00:00:56.770 [Pipeline] catchError 00:00:56.772 [Pipeline] { 00:00:56.797 [Pipeline] stage 00:00:56.799 [Pipeline] { (Pre tests) 00:00:56.852 [Pipeline] parallel 00:00:56.865 [Pipeline] { (Branch: check-format-docker-autotest) 00:00:56.866 [Pipeline] { (Branch: check-so-deps-docker-autotest) 00:00:56.867 [Pipeline] { (Branch: doc-docker-autotest) 00:00:56.869 [Pipeline] { (Branch: build-files-docker-autotest) 00:00:56.888 [Pipeline] retry 00:00:56.890 [Pipeline] { 00:00:56.895 [Pipeline] retry 00:00:56.897 [Pipeline] { 00:00:56.902 [Pipeline] retry 00:00:56.904 [Pipeline] { 00:00:56.909 [Pipeline] retry 00:00:56.911 [Pipeline] { 00:00:56.935 [Pipeline] build 00:00:56.938 Scheduling project: check-format-docker-autotest 00:00:56.946 [Pipeline] build 00:00:56.949 Scheduling project: check-so-deps-docker-autotest 00:00:56.957 [Pipeline] build 00:00:56.960 Scheduling project: doc-docker-autotest 00:00:56.968 [Pipeline] build 00:00:56.971 Scheduling project: build-files-docker-autotest 00:01:06.463 Starting building: check-format-docker-autotest #22160 00:01:06.466 Starting building: build-files-docker-autotest #22149 00:01:06.470 Starting building: check-so-deps-docker-autotest #22173 00:01:06.473 Starting building: doc-docker-autotest #22340 00:01:43.777 Build doc-docker-autotest #22340 completed: SUCCESS 00:01:43.780 [Pipeline] } 00:01:43.819 [Pipeline] // retry 00:01:43.825 [Pipeline] } 00:01:53.983 Build check-format-docker-autotest #22160 completed: SUCCESS 00:01:53.986 [Pipeline] } 00:01:54.024 [Pipeline] // retry 00:01:54.030 [Pipeline] } 00:03:24.454 Build build-files-docker-autotest #22149 completed: SUCCESS 00:03:24.456 [Pipeline] } 00:03:24.495 [Pipeline] // retry 00:03:24.510 [Pipeline] } 00:03:57.881 Build check-so-deps-docker-autotest #22173 completed: SUCCESS 00:03:57.883 [Pipeline] } 00:03:57.926 [Pipeline] // retry 00:03:57.932 [Pipeline] } 00:03:57.991 [Pipeline] // parallel 00:03:57.997 [Pipeline] } 00:03:58.026 [Pipeline] // stage 00:03:58.033 [Pipeline] } 00:03:58.062 [Pipeline] // catchError 00:03:58.073 [Pipeline] catchError 00:03:58.075 [Pipeline] { 00:03:58.098 [Pipeline] stage 00:03:58.101 [Pipeline] { (Tests) 00:03:58.304 [Pipeline] parallel 00:03:58.408 [Pipeline] { (Branch: unittest-clang-docker-autotest) 00:03:58.409 [Pipeline] { (Branch: unittest-main-docker-autotest) 00:03:58.410 [Pipeline] { (Branch: autobuild-external-vg-autotest) 00:03:58.412 [Pipeline] { (Branch: scan-build-docker-autotest) 00:03:58.413 [Pipeline] { (Branch: unittest-valgrind-docker-autotest) 00:03:58.414 [Pipeline] { (Branch: lvol-vg-autotest) 00:03:58.415 [Pipeline] { (Branch: vhost-initiator-vg-autotest) 00:03:58.417 [Pipeline] { (Branch: nvmf-tcp-vg-autotest) 00:03:58.418 [Pipeline] { (Branch: nvmf-tcp-uring-vg-autotest) 00:03:58.419 [Pipeline] { (Branch: nvme-vg-autotest) 00:03:58.420 [Pipeline] { (Branch: centos7-vg-autotest) 00:03:58.422 [Pipeline] { (Branch: rocky9-vg-autotest) 00:03:58.423 [Pipeline] { (Branch: ubuntu20-vg-autotest) 00:03:58.424 [Pipeline] { (Branch: ubuntu22-vg-autotest) 00:03:58.425 [Pipeline] { (Branch: freebsd-vg-autotest) 00:03:58.426 [Pipeline] { (Branch: iscsi-vg-autotest) 00:03:58.427 [Pipeline] { (Branch: iscsi-uring-vg-autotest) 00:03:58.428 [Pipeline] { (Branch: zns-vg-autotest) 00:03:58.429 [Pipeline] { (Branch: nvme-cmb-pmr-vg-autotest) 00:03:58.430 [Pipeline] { (Branch: BlobFS-phy-autotest) 00:03:58.432 [Pipeline] { (Branch: crypto-phy-autotest) 00:03:58.433 [Pipeline] { (Branch: vhost-phy-autotest) 00:03:58.434 [Pipeline] { (Branch: nvmf-phy-autotest) 00:03:58.435 [Pipeline] { (Branch: nvmf-tcp-phy-autotest) 00:03:58.436 [Pipeline] { (Branch: nvme-phy-autotest) 00:03:58.437 [Pipeline] { (Branch: vfio-user-phy-autotest) 00:03:58.438 [Pipeline] { (Branch: short-fuzz-phy-autotest) 00:03:58.439 [Pipeline] { (Branch: dsa-phy-autotest) 00:03:58.440 [Pipeline] { (Branch: packaging-docker-autotest) 00:03:58.471 [Pipeline] retry 00:03:58.474 [Pipeline] { 00:03:58.479 [Pipeline] retry 00:03:58.481 [Pipeline] { 00:03:58.486 [Pipeline] retry 00:03:58.488 [Pipeline] { 00:03:58.493 [Pipeline] retry 00:03:58.495 [Pipeline] { 00:03:58.500 [Pipeline] retry 00:03:58.501 [Pipeline] { 00:03:58.507 [Pipeline] retry 00:03:58.509 [Pipeline] { 00:03:58.514 [Pipeline] retry 00:03:58.515 [Pipeline] { 00:03:58.520 [Pipeline] retry 00:03:58.522 [Pipeline] { 00:03:58.527 [Pipeline] retry 00:03:58.529 [Pipeline] { 00:03:58.534 [Pipeline] retry 00:03:58.535 [Pipeline] { 00:03:58.541 [Pipeline] retry 00:03:58.544 [Pipeline] { 00:03:58.549 [Pipeline] retry 00:03:58.551 [Pipeline] { 00:03:58.557 [Pipeline] retry 00:03:58.559 [Pipeline] { 00:03:58.565 [Pipeline] retry 00:03:58.566 [Pipeline] { 00:03:58.572 [Pipeline] retry 00:03:58.573 [Pipeline] { 00:03:58.579 [Pipeline] retry 00:03:58.580 [Pipeline] { 00:03:58.585 [Pipeline] retry 00:03:58.587 [Pipeline] { 00:03:58.591 [Pipeline] retry 00:03:58.593 [Pipeline] { 00:03:58.596 [Pipeline] retry 00:03:58.598 [Pipeline] { 00:03:58.601 [Pipeline] retry 00:03:58.603 [Pipeline] { 00:03:58.607 [Pipeline] retry 00:03:58.608 [Pipeline] { 00:03:58.611 [Pipeline] retry 00:03:58.613 [Pipeline] { 00:03:58.616 [Pipeline] retry 00:03:58.618 [Pipeline] { 00:03:58.621 [Pipeline] retry 00:03:58.623 [Pipeline] { 00:03:58.626 [Pipeline] retry 00:03:58.628 [Pipeline] { 00:03:58.631 [Pipeline] retry 00:03:58.632 [Pipeline] { 00:03:58.637 [Pipeline] retry 00:03:58.638 [Pipeline] { 00:03:58.642 [Pipeline] retry 00:03:58.643 [Pipeline] { 00:03:58.647 [Pipeline] retry 00:03:58.648 [Pipeline] { 00:03:58.671 [Pipeline] build 00:03:58.673 Scheduling project: unittest-clang-docker-autotest 00:03:58.679 [Pipeline] build 00:03:58.681 Scheduling project: unittest-main-docker-autotest 00:03:58.686 [Pipeline] build 00:03:58.688 Scheduling project: autobuild-external-vg-autotest 00:03:58.693 [Pipeline] build 00:03:58.695 Scheduling project: scan-build-docker-autotest 00:03:58.700 [Pipeline] build 00:03:58.702 Scheduling project: unittest-valgrind-docker-autotest 00:03:58.708 [Pipeline] build 00:03:58.710 Scheduling project: lvol-vg-autotest 00:03:58.715 [Pipeline] build 00:03:58.717 Scheduling project: vhost-initiator-vg-autotest 00:03:58.722 [Pipeline] build 00:03:58.724 Scheduling project: nvmf-tcp-vg-autotest 00:03:58.729 [Pipeline] build 00:03:58.731 Scheduling project: nvmf-tcp-uring-vg-autotest 00:03:58.736 [Pipeline] build 00:03:58.738 Scheduling project: nvme-vg-autotest 00:03:58.743 [Pipeline] build 00:03:58.745 Scheduling project: centos7-vg-autotest 00:03:58.751 [Pipeline] build 00:03:58.753 Scheduling project: rocky9-vg-autotest 00:03:58.758 [Pipeline] build 00:03:58.760 Scheduling project: ubuntu20-vg-autotest 00:03:58.765 [Pipeline] build 00:03:58.766 Scheduling project: ubuntu22-vg-autotest 00:03:58.771 [Pipeline] build 00:03:58.773 Scheduling project: freebsd-vg-autotest 00:03:58.778 [Pipeline] build 00:03:58.780 Scheduling project: iscsi-vg-autotest 00:03:58.785 [Pipeline] build 00:03:58.787 Scheduling project: iscsi-uring-vg-autotest 00:03:58.792 [Pipeline] build 00:03:58.794 Scheduling project: zns-vg-autotest 00:03:58.799 [Pipeline] build 00:03:58.801 Scheduling project: nvme-cmb-pmr-vg-autotest 00:03:58.806 [Pipeline] build 00:03:58.808 Scheduling project: BlobFS-phy-autotest 00:03:58.813 [Pipeline] build 00:03:58.815 Scheduling project: crypto-phy-autotest 00:03:58.820 [Pipeline] build 00:03:58.822 Scheduling project: vhost-phy-autotest 00:03:58.828 [Pipeline] build 00:03:58.830 Scheduling project: nvmf-phy-autotest 00:03:58.835 [Pipeline] build 00:03:58.837 Scheduling project: nvmf-tcp-phy-autotest 00:03:58.842 [Pipeline] build 00:03:58.844 Scheduling project: nvme-phy-autotest 00:03:58.849 [Pipeline] build 00:03:58.851 Scheduling project: vfio-user-phy-autotest 00:03:58.856 [Pipeline] build 00:03:58.859 Scheduling project: short-fuzz-phy-autotest 00:03:58.864 [Pipeline] build 00:03:58.866 Scheduling project: dsa-phy-autotest 00:03:58.871 [Pipeline] build 00:03:58.873 Scheduling project: packaging-docker-autotest 00:04:04.697 Starting building: packaging-docker-autotest #19879 00:04:04.700 Starting building: unittest-main-docker-autotest #19878 00:04:04.702 Starting building: rocky9-vg-autotest #16107 00:04:04.705 Starting building: autobuild-external-vg-autotest #19840 00:04:04.708 Starting building: unittest-valgrind-docker-autotest #19881 00:04:04.711 Starting building: crypto-phy-autotest #26217 00:04:04.714 Starting building: BlobFS-phy-autotest #26223 00:04:04.717 Starting building: unittest-clang-docker-autotest #19877 00:04:04.720 Starting building: scan-build-docker-autotest #19880 00:04:04.724 Starting building: vfio-user-phy-autotest #26225 00:04:04.727 Starting building: centos7-vg-autotest #73676 00:04:04.738 Starting building: vhost-initiator-vg-autotest #77517 00:04:04.742 Starting building: nvmf-tcp-uring-vg-autotest #77422 00:04:04.745 Starting building: lvol-vg-autotest #77446 00:04:04.748 Starting building: iscsi-vg-autotest #77535 00:04:04.751 Starting building: freebsd-vg-autotest #59140 00:04:04.756 Starting building: short-fuzz-phy-autotest #26214 00:04:04.759 Starting building: vhost-phy-autotest #26242 00:04:04.762 Starting building: dsa-phy-autotest #4917 00:04:04.765 Starting building: nvmf-tcp-vg-autotest #77488 00:04:04.768 Starting building: nvmf-tcp-phy-autotest #72348 00:04:04.770 Starting building: ubuntu22-vg-autotest #37830 00:04:04.773 Starting building: ubuntu20-vg-autotest #73816 00:04:04.776 Starting building: iscsi-uring-vg-autotest #77402 00:04:04.780 Starting building: nvme-vg-autotest #77497 00:04:04.783 Starting building: nvme-cmb-pmr-vg-autotest #78620 00:04:04.786 Starting building: zns-vg-autotest #76603 00:04:04.789 Starting building: nvme-phy-autotest #72389 00:04:04.793 Starting building: nvmf-phy-autotest #72461 00:07:06.943 Build unittest-clang-docker-autotest #19877 completed: SUCCESS 00:07:06.945 [Pipeline] } 00:07:06.996 [Pipeline] // retry 00:07:07.003 [Pipeline] } 00:08:02.302 Build packaging-docker-autotest #19879 completed: SUCCESS 00:08:02.304 [Pipeline] } 00:08:02.357 [Pipeline] // retry 00:08:02.365 [Pipeline] } 00:08:43.758 Build scan-build-docker-autotest #19880 completed: SUCCESS 00:08:43.762 [Pipeline] } 00:08:43.806 [Pipeline] // retry 00:08:43.814 [Pipeline] } 00:09:53.450 Build unittest-main-docker-autotest #19878 completed: SUCCESS 00:09:53.452 [Pipeline] } 00:09:53.478 [Pipeline] // retry 00:09:53.482 [Pipeline] } 00:12:02.054 Build short-fuzz-phy-autotest #26214 completed: SUCCESS 00:12:02.057 [Pipeline] } 00:12:02.105 [Pipeline] // retry 00:12:02.111 [Pipeline] } 00:12:17.893 Build autobuild-external-vg-autotest #19840 completed: SUCCESS 00:12:17.895 [Pipeline] } 00:12:17.936 [Pipeline] // retry 00:12:17.941 [Pipeline] } 00:13:20.643 Build unittest-valgrind-docker-autotest #19881 completed: SUCCESS 00:13:20.648 [Pipeline] } 00:13:20.687 [Pipeline] // retry 00:13:20.694 [Pipeline] } 00:14:40.009 Build vhost-initiator-vg-autotest #77517 completed: SUCCESS 00:14:40.011 [Pipeline] } 00:14:40.049 [Pipeline] // retry 00:14:40.055 [Pipeline] } 00:18:50.016 Build vhost-phy-autotest #26242 completed: SUCCESS 00:18:50.018 [Pipeline] } 00:18:50.057 [Pipeline] // retry 00:18:50.063 [Pipeline] } 00:19:58.717 Build lvol-vg-autotest #77446 completed: SUCCESS 00:19:58.719 [Pipeline] } 00:19:58.756 [Pipeline] // retry 00:19:58.764 [Pipeline] } 00:20:12.990 Build zns-vg-autotest #76603 completed: SUCCESS 00:20:12.992 [Pipeline] } 00:20:13.029 [Pipeline] // retry 00:20:13.036 [Pipeline] } 00:22:00.635 Build nvme-cmb-pmr-vg-autotest #78620 completed: SUCCESS 00:22:00.638 [Pipeline] } 00:22:00.681 [Pipeline] // retry 00:22:00.688 [Pipeline] } 00:22:18.255 Build BlobFS-phy-autotest #26223 completed: SUCCESS 00:22:18.258 [Pipeline] } 00:22:18.304 [Pipeline] // retry 00:22:18.311 [Pipeline] } 00:23:21.977 Build iscsi-uring-vg-autotest #77402 completed: SUCCESS 00:23:21.979 [Pipeline] } 00:23:22.021 [Pipeline] // retry 00:23:22.027 [Pipeline] } 00:23:40.991 Build vfio-user-phy-autotest #26225 completed: SUCCESS 00:23:40.994 [Pipeline] } 00:23:41.038 [Pipeline] // retry 00:23:41.045 [Pipeline] } 00:23:44.618 Build iscsi-vg-autotest #77535 completed: SUCCESS 00:23:44.620 [Pipeline] } 00:23:44.664 [Pipeline] // retry 00:23:44.671 [Pipeline] } 00:25:24.246 Build nvme-phy-autotest #72389 completed: SUCCESS 00:25:24.249 [Pipeline] } 00:25:24.291 [Pipeline] // retry 00:25:24.299 [Pipeline] } 00:26:16.060 Build nvme-vg-autotest #77497 completed: FAILURE 00:26:16.931 [Pipeline] echo 00:26:16.933 No retry patterns found. 00:26:16.934 [Pipeline] } 00:26:16.970 [Pipeline] // retry 00:26:16.977 [Pipeline] error 00:26:16.981 [Pipeline] } 00:26:16.984 Failed in branch nvme-vg-autotest 00:27:05.888 Build freebsd-vg-autotest #59140 completed: SUCCESS 00:27:05.890 [Pipeline] } 00:27:05.935 [Pipeline] // retry 00:27:05.942 [Pipeline] } 00:27:34.831 Build nvmf-tcp-uring-vg-autotest #77422 completed: SUCCESS 00:27:34.833 [Pipeline] } 00:27:34.860 [Pipeline] // retry 00:27:34.868 [Pipeline] } 00:30:50.037 Build nvmf-phy-autotest #72461 completed: SUCCESS 00:30:50.041 [Pipeline] } 00:30:50.082 [Pipeline] // retry 00:30:50.086 [Pipeline] } 00:32:43.476 Build crypto-phy-autotest #26217 completed: SUCCESS 00:32:43.478 [Pipeline] } 00:32:43.498 [Pipeline] // retry 00:32:43.502 [Pipeline] } 00:33:14.830 Build nvmf-tcp-vg-autotest #77488 completed: SUCCESS 00:33:14.834 [Pipeline] } 00:33:14.879 [Pipeline] // retry 00:33:14.888 [Pipeline] } 00:33:32.559 Build nvmf-tcp-phy-autotest #72348 completed: SUCCESS 00:33:32.563 [Pipeline] } 00:33:32.607 [Pipeline] // retry 00:33:32.615 [Pipeline] } 00:36:32.630 Build centos7-vg-autotest #73676 completed: SUCCESS 00:36:32.632 [Pipeline] } 00:36:32.692 [Pipeline] // retry 00:36:32.701 [Pipeline] } 00:37:29.183 Build dsa-phy-autotest #4917 completed: SUCCESS 00:37:29.186 [Pipeline] } 00:37:29.258 [Pipeline] // retry 00:37:29.266 [Pipeline] } 00:49:50.965 Build rocky9-vg-autotest #16107 completed: SUCCESS 00:49:50.966 [Pipeline] } 00:49:51.008 [Pipeline] // retry 00:49:51.015 [Pipeline] } 00:58:08.635 Build ubuntu20-vg-autotest #73816 completed: FAILURE 00:58:10.964 [Pipeline] echo 00:58:10.966 No retry patterns found. 00:58:10.967 [Pipeline] } 00:58:11.001 [Pipeline] // retry 00:58:11.009 [Pipeline] error 00:58:11.012 [Pipeline] } 00:58:11.014 Failed in branch ubuntu20-vg-autotest 01:02:03.467 Build ubuntu22-vg-autotest #37830 completed: SUCCESS 01:02:03.470 [Pipeline] } 01:02:03.514 [Pipeline] // retry 01:02:03.520 [Pipeline] } 01:02:03.753 [Pipeline] // parallel 01:02:03.762 [Pipeline] } 01:02:03.790 [Pipeline] // stage 01:02:03.800 [Pipeline] } 01:02:03.804 ERROR: Build nvme-vg-autotest #77497 failed 01:02:03.822 [Pipeline] // catchError 01:02:03.829 [Pipeline] stage 01:02:03.830 [Pipeline] { (Autorun Post and Coverage) 01:02:03.847 [Pipeline] setCustomBuildProperty 01:02:03.870 [Pipeline] dir 01:02:03.870 Running in /var/jenkins/workspace/autotest-per-patch_6/doc-docker-autotest_22340 01:02:03.872 [Pipeline] { 01:02:03.891 [Pipeline] copyArtifacts 01:02:04.145 Copied 6 artifacts from "doc-docker-autotest" build number 22340 01:02:04.149 [Pipeline] writeFile 01:02:04.174 [Pipeline] } 01:02:04.207 [Pipeline] // dir 01:02:04.226 [Pipeline] dir 01:02:04.227 Running in /var/jenkins/workspace/autotest-per-patch_6/check-format-docker-autotest_22160 01:02:04.229 [Pipeline] { 01:02:04.254 [Pipeline] copyArtifacts 01:02:04.388 Copied 5 artifacts from "check-format-docker-autotest" build number 22160 01:02:04.392 [Pipeline] writeFile 01:02:04.417 [Pipeline] } 01:02:04.457 [Pipeline] // dir 01:02:04.541 [Pipeline] dir 01:02:04.541 Running in /var/jenkins/workspace/autotest-per-patch_6/build-files-docker-autotest_22149 01:02:04.542 [Pipeline] { 01:02:04.566 [Pipeline] copyArtifacts 01:02:04.629 Copied 5 artifacts from "build-files-docker-autotest" build number 22149 01:02:04.633 [Pipeline] writeFile 01:02:04.683 [Pipeline] } 01:02:04.717 [Pipeline] // dir 01:02:04.756 [Pipeline] dir 01:02:04.756 Running in /var/jenkins/workspace/autotest-per-patch_6/check-so-deps-docker-autotest_22173 01:02:04.757 [Pipeline] { 01:02:04.777 [Pipeline] copyArtifacts 01:02:04.847 Copied 5 artifacts from "check-so-deps-docker-autotest" build number 22173 01:02:04.851 [Pipeline] writeFile 01:02:04.879 [Pipeline] } 01:02:04.915 [Pipeline] // dir 01:02:05.102 [Pipeline] dir 01:02:05.103 Running in /var/jenkins/workspace/autotest-per-patch_6/unittest-clang-docker-autotest_19877 01:02:05.104 [Pipeline] { 01:02:05.126 [Pipeline] copyArtifacts 01:02:05.191 Copied 5 artifacts from "unittest-clang-docker-autotest" build number 19877 01:02:05.196 [Pipeline] writeFile 01:02:05.264 [Pipeline] } 01:02:05.321 [Pipeline] // dir 01:02:05.623 [Pipeline] dir 01:02:05.623 Running in /var/jenkins/workspace/autotest-per-patch_6/packaging-docker-autotest_19879 01:02:05.624 [Pipeline] { 01:02:05.665 [Pipeline] copyArtifacts 01:02:05.727 Copied 5 artifacts from "packaging-docker-autotest" build number 19879 01:02:05.732 [Pipeline] writeFile 01:02:05.887 [Pipeline] } 01:02:05.980 [Pipeline] // dir 01:02:06.005 [Pipeline] dir 01:02:06.005 Running in /var/jenkins/workspace/autotest-per-patch_6/scan-build-docker-autotest_19880 01:02:06.006 [Pipeline] { 01:02:06.029 [Pipeline] copyArtifacts 01:02:06.125 Copied 9 artifacts from "scan-build-docker-autotest" build number 19880 01:02:06.129 [Pipeline] writeFile 01:02:06.154 [Pipeline] } 01:02:06.181 [Pipeline] // dir 01:02:06.318 [Pipeline] dir 01:02:06.319 Running in /var/jenkins/workspace/autotest-per-patch_6/unittest-main-docker-autotest_19878 01:02:06.320 [Pipeline] { 01:02:06.350 [Pipeline] copyArtifacts 01:02:06.722 Copied 6 artifacts from "unittest-main-docker-autotest" build number 19878 01:02:06.726 [Pipeline] writeFile 01:02:06.778 [Pipeline] } 01:02:06.822 [Pipeline] // dir 01:02:07.172 [Pipeline] dir 01:02:07.172 Running in /var/jenkins/workspace/autotest-per-patch_6/short-fuzz-phy-autotest_26214 01:02:07.173 [Pipeline] { 01:02:07.217 [Pipeline] copyArtifacts 01:02:07.327 Copied 10 artifacts from "short-fuzz-phy-autotest" build number 26214 01:02:07.332 [Pipeline] writeFile 01:02:07.531 [Pipeline] } 01:02:07.648 [Pipeline] // dir 01:02:07.759 [Pipeline] dir 01:02:07.759 Running in /var/jenkins/workspace/autotest-per-patch_6/autobuild-external-vg-autotest_19840 01:02:07.760 [Pipeline] { 01:02:07.787 [Pipeline] copyArtifacts 01:02:07.891 Copied 8 artifacts from "autobuild-external-vg-autotest" build number 19840 01:02:07.894 [Pipeline] writeFile 01:02:07.969 [Pipeline] } 01:02:08.030 [Pipeline] // dir 01:02:08.357 [Pipeline] dir 01:02:08.357 Running in /var/jenkins/workspace/autotest-per-patch_6/unittest-valgrind-docker-autotest_19881 01:02:08.358 [Pipeline] { 01:02:08.397 [Pipeline] copyArtifacts 01:02:08.723 Copied 6 artifacts from "unittest-valgrind-docker-autotest" build number 19881 01:02:08.727 [Pipeline] writeFile 01:02:08.901 [Pipeline] } 01:02:09.004 [Pipeline] // dir 01:02:09.306 [Pipeline] dir 01:02:09.306 Running in /var/jenkins/workspace/autotest-per-patch_6/vhost-initiator-vg-autotest_77517 01:02:09.307 [Pipeline] { 01:02:09.347 [Pipeline] copyArtifacts 01:02:09.688 Copied 16 artifacts from "vhost-initiator-vg-autotest" build number 77517 01:02:09.693 [Pipeline] writeFile 01:02:09.825 [Pipeline] } 01:02:09.902 [Pipeline] // dir 01:02:10.253 [Pipeline] dir 01:02:10.253 Running in /var/jenkins/workspace/autotest-per-patch_6/vhost-phy-autotest_26242 01:02:10.254 [Pipeline] { 01:02:10.295 [Pipeline] copyArtifacts 01:02:10.531 Copied 12 artifacts from "vhost-phy-autotest" build number 26242 01:02:10.535 [Pipeline] writeFile 01:02:10.716 [Pipeline] } 01:02:10.828 [Pipeline] // dir 01:02:11.366 [Pipeline] dir 01:02:11.366 Running in /var/jenkins/workspace/autotest-per-patch_6/lvol-vg-autotest_77446 01:02:11.367 [Pipeline] { 01:02:11.415 [Pipeline] copyArtifacts 01:02:11.640 Copied 12 artifacts from "lvol-vg-autotest" build number 77446 01:02:11.645 [Pipeline] writeFile 01:02:11.899 [Pipeline] } 01:02:12.063 [Pipeline] // dir 01:02:12.393 [Pipeline] dir 01:02:12.393 Running in /var/jenkins/workspace/autotest-per-patch_6/zns-vg-autotest_76603 01:02:12.394 [Pipeline] { 01:02:12.434 [Pipeline] copyArtifacts 01:02:12.666 Copied 12 artifacts from "zns-vg-autotest" build number 76603 01:02:12.671 [Pipeline] writeFile 01:02:12.831 [Pipeline] } 01:02:12.938 [Pipeline] // dir 01:02:13.281 [Pipeline] dir 01:02:13.281 Running in /var/jenkins/workspace/autotest-per-patch_6/nvme-cmb-pmr-vg-autotest_78620 01:02:13.282 [Pipeline] { 01:02:13.324 [Pipeline] copyArtifacts 01:02:13.520 Copied 12 artifacts from "nvme-cmb-pmr-vg-autotest" build number 78620 01:02:13.524 [Pipeline] writeFile 01:02:13.690 [Pipeline] } 01:02:13.787 [Pipeline] // dir 01:02:14.071 [Pipeline] dir 01:02:14.071 Running in /var/jenkins/workspace/autotest-per-patch_6/BlobFS-phy-autotest_26223 01:02:14.073 [Pipeline] { 01:02:14.110 [Pipeline] copyArtifacts 01:02:14.537 Copied 28 artifacts from "BlobFS-phy-autotest" build number 26223 01:02:14.542 [Pipeline] writeFile 01:02:14.683 [Pipeline] } 01:02:14.777 [Pipeline] // dir 01:02:16.381 [Pipeline] dir 01:02:16.381 Running in /var/jenkins/workspace/autotest-per-patch_6/iscsi-uring-vg-autotest_77402 01:02:16.382 [Pipeline] { 01:02:16.554 [Pipeline] copyArtifacts 01:02:19.677 Copied 16 artifacts from "iscsi-uring-vg-autotest" build number 77402 01:02:19.682 [Pipeline] writeFile 01:02:20.701 [Pipeline] } 01:02:21.117 [Pipeline] // dir 01:02:21.554 [Pipeline] dir 01:02:21.554 Running in /var/jenkins/workspace/autotest-per-patch_6/vfio-user-phy-autotest_26225 01:02:21.556 [Pipeline] { 01:02:21.608 [Pipeline] copyArtifacts 01:02:21.858 Copied 12 artifacts from "vfio-user-phy-autotest" build number 26225 01:02:21.862 [Pipeline] writeFile 01:02:22.091 [Pipeline] } 01:02:22.233 [Pipeline] // dir 01:02:24.364 [Pipeline] dir 01:02:24.364 Running in /var/jenkins/workspace/autotest-per-patch_6/iscsi-vg-autotest_77535 01:02:24.366 [Pipeline] { 01:02:24.588 [Pipeline] copyArtifacts 01:02:27.695 Copied 17 artifacts from "iscsi-vg-autotest" build number 77535 01:02:27.699 [Pipeline] writeFile 01:02:28.873 [Pipeline] } 01:02:29.397 [Pipeline] // dir 01:02:29.959 [Pipeline] dir 01:02:29.959 Running in /var/jenkins/workspace/autotest-per-patch_6/nvme-phy-autotest_72389 01:02:29.960 [Pipeline] { 01:02:30.018 [Pipeline] copyArtifacts 01:02:30.239 Copied 12 artifacts from "nvme-phy-autotest" build number 72389 01:02:30.244 [Pipeline] writeFile 01:02:30.507 [Pipeline] } 01:02:30.637 [Pipeline] // dir 01:02:31.075 [Pipeline] dir 01:02:31.075 Running in /var/jenkins/workspace/autotest-per-patch_6/nvme-vg-autotest_77497 01:02:31.076 [Pipeline] { 01:02:31.120 [Pipeline] copyArtifacts 01:02:31.281 Copied 12 artifacts from "nvme-vg-autotest" build number 77497 01:02:31.285 [Pipeline] writeFile 01:02:31.448 [Pipeline] } 01:02:31.568 [Pipeline] // dir 01:02:32.322 [Pipeline] dir 01:02:32.322 Running in /var/jenkins/workspace/autotest-per-patch_6/freebsd-vg-autotest_59140 01:02:32.323 [Pipeline] { 01:02:32.382 [Pipeline] copyArtifacts 01:02:32.490 Copied 7 artifacts from "freebsd-vg-autotest" build number 59140 01:02:32.493 [Pipeline] writeFile 01:02:32.777 [Pipeline] } 01:02:32.933 [Pipeline] // dir 01:02:33.663 [Pipeline] dir 01:02:33.663 Running in /var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-uring-vg-autotest_77422 01:02:33.664 [Pipeline] { 01:02:33.736 [Pipeline] copyArtifacts 01:02:33.973 Copied 13 artifacts from "nvmf-tcp-uring-vg-autotest" build number 77422 01:02:33.979 [Pipeline] writeFile 01:02:34.354 [Pipeline] } 01:02:34.510 [Pipeline] // dir 01:02:35.215 [Pipeline] dir 01:02:35.215 Running in /var/jenkins/workspace/autotest-per-patch_6/nvmf-phy-autotest_72461 01:02:35.217 [Pipeline] { 01:02:35.309 [Pipeline] copyArtifacts 01:02:35.585 Copied 13 artifacts from "nvmf-phy-autotest" build number 72461 01:02:35.588 [Pipeline] writeFile 01:02:35.952 [Pipeline] } 01:02:36.124 [Pipeline] // dir 01:02:37.564 [Pipeline] dir 01:02:37.564 Running in /var/jenkins/workspace/autotest-per-patch_6/crypto-phy-autotest_26217 01:02:37.565 [Pipeline] { 01:02:37.673 [Pipeline] copyArtifacts 01:02:37.901 Copied 12 artifacts from "crypto-phy-autotest" build number 26217 01:02:37.905 [Pipeline] writeFile 01:02:38.525 [Pipeline] } 01:02:38.787 [Pipeline] // dir 01:02:39.705 [Pipeline] dir 01:02:39.705 Running in /var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-vg-autotest_77488 01:02:39.706 [Pipeline] { 01:02:39.779 [Pipeline] copyArtifacts 01:02:39.997 Copied 14 artifacts from "nvmf-tcp-vg-autotest" build number 77488 01:02:40.001 [Pipeline] writeFile 01:02:40.470 [Pipeline] } 01:02:40.695 [Pipeline] // dir 01:02:41.865 [Pipeline] dir 01:02:41.866 Running in /var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-phy-autotest_72348 01:02:41.867 [Pipeline] { 01:02:41.961 [Pipeline] copyArtifacts 01:02:42.202 Copied 13 artifacts from "nvmf-tcp-phy-autotest" build number 72348 01:02:42.206 [Pipeline] writeFile 01:02:42.755 [Pipeline] } 01:02:42.982 [Pipeline] // dir 01:02:43.763 [Pipeline] dir 01:02:43.764 Running in /var/jenkins/workspace/autotest-per-patch_6/centos7-vg-autotest_73676 01:02:43.765 [Pipeline] { 01:02:43.837 [Pipeline] copyArtifacts 01:02:44.190 Copied 13 artifacts from "centos7-vg-autotest" build number 73676 01:02:44.194 [Pipeline] writeFile 01:02:44.492 [Pipeline] } 01:02:44.655 [Pipeline] // dir 01:02:45.412 [Pipeline] dir 01:02:45.413 Running in /var/jenkins/workspace/autotest-per-patch_6/dsa-phy-autotest_4917 01:02:45.414 [Pipeline] { 01:02:45.486 [Pipeline] copyArtifacts 01:02:45.743 Copied 13 artifacts from "dsa-phy-autotest" build number 4917 01:02:45.747 [Pipeline] writeFile 01:02:46.096 [Pipeline] } 01:02:46.275 [Pipeline] // dir 01:02:47.439 [Pipeline] dir 01:02:47.439 Running in /var/jenkins/workspace/autotest-per-patch_6/rocky9-vg-autotest_16107 01:02:47.440 [Pipeline] { 01:02:47.523 [Pipeline] copyArtifacts 01:02:47.903 Copied 13 artifacts from "rocky9-vg-autotest" build number 16107 01:02:47.907 [Pipeline] writeFile 01:02:48.465 [Pipeline] } 01:02:48.730 [Pipeline] // dir 01:02:49.957 [Pipeline] dir 01:02:49.958 Running in /var/jenkins/workspace/autotest-per-patch_6/ubuntu20-vg-autotest_73816 01:02:49.959 [Pipeline] { 01:02:50.041 [Pipeline] copyArtifacts 01:02:50.606 Copied 12 artifacts from "ubuntu20-vg-autotest" build number 73816 01:02:50.610 [Pipeline] writeFile 01:02:51.041 [Pipeline] } 01:02:51.295 [Pipeline] // dir 01:02:52.461 [Pipeline] dir 01:02:52.462 Running in /var/jenkins/workspace/autotest-per-patch_6/ubuntu22-vg-autotest_37830 01:02:52.463 [Pipeline] { 01:02:52.541 [Pipeline] copyArtifacts 01:02:52.922 Copied 13 artifacts from "ubuntu22-vg-autotest" build number 37830 01:02:52.927 [Pipeline] writeFile 01:02:53.412 [Pipeline] } 01:02:53.630 [Pipeline] // dir 01:02:53.641 [Pipeline] catchError 01:02:53.642 [Pipeline] { 01:02:53.668 [Pipeline] sh 01:02:53.944 + jbp/jenkins/jjb-config/jobs/scripts/post_gen_coverage.sh 01:02:53.944 + shopt -s globstar nullglob 01:02:53.944 + echo 'Start stage post_gen_coverage.sh' 01:02:53.944 Start stage post_gen_coverage.sh 01:02:53.944 + cd /var/jenkins/workspace/autotest-per-patch_6 01:02:53.944 + rm -rf /var/jenkins/workspace/autotest-per-patch_6/spdk/doc 01:02:53.944 + trap 'compress_coverage_and_docs; remove_partial_coverage_files && echo '\''End stage post_gen_coverage.sh'\''' EXIT 01:02:53.944 + move_artifacts 01:02:53.944 + local out_dirs 01:02:53.944 + out_dirs=(./**/output/) 01:02:53.944 + for dir in "${out_dirs[@]}" 01:02:53.944 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:53.944 + [[ -f ./autobuild-external-vg-autotest_19840/output//doc.tar.xz ]] 01:02:53.944 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:53.944 + [[ -f ./autobuild-external-vg-autotest_19840/output//ut_coverage.tar.xz ]] 01:02:53.944 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:53.944 + [[ -f ./autobuild-external-vg-autotest_19840/output//llvm.tar.xz ]] 01:02:53.944 + mv ./autobuild-external-vg-autotest_19840/output//build-pkg-manifest.txt ./autobuild-external-vg-autotest_19840/output//build-repo-manifest.txt ./autobuild-external-vg-autotest_19840/output//dmesg.init.log ./autobuild-external-vg-autotest_19840/output//dmesg.log ./autobuild-external-vg-autotest_19840/output//power.tar.xz ./autobuild-external-vg-autotest_19840/output//test_completions.txt ./autobuild-external-vg-autotest_19840/output//timing.svg ./autobuild-external-vg-autotest_19840/output//timing.txt ./autobuild-external-vg-autotest_19840/output//.. 01:02:53.944 + rmdir ./autobuild-external-vg-autotest_19840/output/ 01:02:53.944 + for dir in "${out_dirs[@]}" 01:02:53.944 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:53.944 + [[ -f ./BlobFS-phy-autotest_26223/output//doc.tar.xz ]] 01:02:53.944 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:53.944 + [[ -f ./BlobFS-phy-autotest_26223/output//ut_coverage.tar.xz ]] 01:02:53.944 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:53.944 + [[ -f ./BlobFS-phy-autotest_26223/output//llvm.tar.xz ]] 01:02:53.944 + mv ./BlobFS-phy-autotest_26223/output//all_tests.txt ./BlobFS-phy-autotest_26223/output//build-pkg-manifest.txt ./BlobFS-phy-autotest_26223/output//build-repo-manifest.txt ./BlobFS-phy-autotest_26223/output//cov_base.info.xz ./BlobFS-phy-autotest_26223/output//cov_test.info.xz ./BlobFS-phy-autotest_26223/output//cov_total.info.xz ./BlobFS-phy-autotest_26223/output//dmesg.init.log ./BlobFS-phy-autotest_26223/output//dmesg.log ./BlobFS-phy-autotest_26223/output//power.tar.xz ./BlobFS-phy-autotest_26223/output//rocksdb ./BlobFS-phy-autotest_26223/output//test_completions.txt ./BlobFS-phy-autotest_26223/output//timing.svg ./BlobFS-phy-autotest_26223/output//timing.txt ./BlobFS-phy-autotest_26223/output//.. 01:02:53.944 + rmdir ./BlobFS-phy-autotest_26223/output/ 01:02:53.944 + for dir in "${out_dirs[@]}" 01:02:53.944 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:53.944 + [[ -f ./build-files-docker-autotest_22149/output//doc.tar.xz ]] 01:02:53.944 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:53.944 + [[ -f ./build-files-docker-autotest_22149/output//ut_coverage.tar.xz ]] 01:02:53.944 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:53.944 + [[ -f ./build-files-docker-autotest_22149/output//llvm.tar.xz ]] 01:02:53.944 + mv ./build-files-docker-autotest_22149/output//build-pkg-manifest.txt ./build-files-docker-autotest_22149/output//build-repo-manifest.txt ./build-files-docker-autotest_22149/output//power.tar.xz ./build-files-docker-autotest_22149/output//test_completions.txt ./build-files-docker-autotest_22149/output//timing.txt ./build-files-docker-autotest_22149/output//.. 01:02:53.944 + rmdir ./build-files-docker-autotest_22149/output/ 01:02:53.944 + for dir in "${out_dirs[@]}" 01:02:53.944 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:53.944 + [[ -f ./centos7-vg-autotest_73676/output//doc.tar.xz ]] 01:02:53.944 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:53.944 + [[ -f ./centos7-vg-autotest_73676/output//ut_coverage.tar.xz ]] 01:02:53.944 + tar -C ./centos7-vg-autotest_73676/output/ -xf ./centos7-vg-autotest_73676/output//ut_coverage.tar.xz 01:02:54.203 + rm ./centos7-vg-autotest_73676/output//ut_coverage.tar.xz 01:02:54.203 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.203 + [[ -f ./centos7-vg-autotest_73676/output//llvm.tar.xz ]] 01:02:54.203 + mv ./centos7-vg-autotest_73676/output//all_tests.txt ./centos7-vg-autotest_73676/output//build-pkg-manifest.txt ./centos7-vg-autotest_73676/output//build-repo-manifest.txt ./centos7-vg-autotest_73676/output//cov_base.info.xz ./centos7-vg-autotest_73676/output//cov_test.info.xz ./centos7-vg-autotest_73676/output//cov_total.info.xz ./centos7-vg-autotest_73676/output//dmesg.init.log ./centos7-vg-autotest_73676/output//dmesg.log ./centos7-vg-autotest_73676/output//power.tar.xz ./centos7-vg-autotest_73676/output//test_completions.txt ./centos7-vg-autotest_73676/output//timing.svg ./centos7-vg-autotest_73676/output//timing.txt ./centos7-vg-autotest_73676/output//ut_coverage ./centos7-vg-autotest_73676/output//.. 01:02:54.203 + rmdir ./centos7-vg-autotest_73676/output/ 01:02:54.203 + for dir in "${out_dirs[@]}" 01:02:54.203 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.203 + [[ -f ./check-format-docker-autotest_22160/output//doc.tar.xz ]] 01:02:54.203 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.203 + [[ -f ./check-format-docker-autotest_22160/output//ut_coverage.tar.xz ]] 01:02:54.203 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.203 + [[ -f ./check-format-docker-autotest_22160/output//llvm.tar.xz ]] 01:02:54.203 + mv ./check-format-docker-autotest_22160/output//build-pkg-manifest.txt ./check-format-docker-autotest_22160/output//build-repo-manifest.txt ./check-format-docker-autotest_22160/output//power.tar.xz ./check-format-docker-autotest_22160/output//test_completions.txt ./check-format-docker-autotest_22160/output//timing.txt ./check-format-docker-autotest_22160/output//.. 01:02:54.203 + rmdir ./check-format-docker-autotest_22160/output/ 01:02:54.203 + for dir in "${out_dirs[@]}" 01:02:54.203 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.203 + [[ -f ./check-so-deps-docker-autotest_22173/output//doc.tar.xz ]] 01:02:54.203 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.203 + [[ -f ./check-so-deps-docker-autotest_22173/output//ut_coverage.tar.xz ]] 01:02:54.203 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.203 + [[ -f ./check-so-deps-docker-autotest_22173/output//llvm.tar.xz ]] 01:02:54.203 + mv ./check-so-deps-docker-autotest_22173/output//build-pkg-manifest.txt ./check-so-deps-docker-autotest_22173/output//build-repo-manifest.txt ./check-so-deps-docker-autotest_22173/output//power.tar.xz ./check-so-deps-docker-autotest_22173/output//test_completions.txt ./check-so-deps-docker-autotest_22173/output//timing.txt ./check-so-deps-docker-autotest_22173/output//.. 01:02:54.203 + rmdir ./check-so-deps-docker-autotest_22173/output/ 01:02:54.203 + for dir in "${out_dirs[@]}" 01:02:54.203 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.203 + [[ -f ./crypto-phy-autotest_26217/output//doc.tar.xz ]] 01:02:54.203 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.203 + [[ -f ./crypto-phy-autotest_26217/output//ut_coverage.tar.xz ]] 01:02:54.203 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.203 + [[ -f ./crypto-phy-autotest_26217/output//llvm.tar.xz ]] 01:02:54.203 + mv ./crypto-phy-autotest_26217/output//all_tests.txt ./crypto-phy-autotest_26217/output//build-pkg-manifest.txt ./crypto-phy-autotest_26217/output//build-repo-manifest.txt ./crypto-phy-autotest_26217/output//cov_base.info.xz ./crypto-phy-autotest_26217/output//cov_test.info.xz ./crypto-phy-autotest_26217/output//cov_total.info.xz ./crypto-phy-autotest_26217/output//dmesg.init.log ./crypto-phy-autotest_26217/output//dmesg.log ./crypto-phy-autotest_26217/output//power.tar.xz ./crypto-phy-autotest_26217/output//test_completions.txt ./crypto-phy-autotest_26217/output//timing.svg ./crypto-phy-autotest_26217/output//timing.txt ./crypto-phy-autotest_26217/output//.. 01:02:54.203 + rmdir ./crypto-phy-autotest_26217/output/ 01:02:54.203 + for dir in "${out_dirs[@]}" 01:02:54.203 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.203 + [[ -f ./doc-docker-autotest_22340/output//doc.tar.xz ]] 01:02:54.203 + tar -C ./doc-docker-autotest_22340/output/ -xf ./doc-docker-autotest_22340/output//doc.tar.xz 01:02:54.203 + rm ./doc-docker-autotest_22340/output//doc.tar.xz 01:02:54.203 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.203 + [[ -f ./doc-docker-autotest_22340/output//ut_coverage.tar.xz ]] 01:02:54.203 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.203 + [[ -f ./doc-docker-autotest_22340/output//llvm.tar.xz ]] 01:02:54.203 + mv ./doc-docker-autotest_22340/output//build-pkg-manifest.txt ./doc-docker-autotest_22340/output//build-repo-manifest.txt ./doc-docker-autotest_22340/output//doc ./doc-docker-autotest_22340/output//power.tar.xz ./doc-docker-autotest_22340/output//test_completions.txt ./doc-docker-autotest_22340/output//timing.txt ./doc-docker-autotest_22340/output//.. 01:02:54.203 + rmdir ./doc-docker-autotest_22340/output/ 01:02:54.203 + for dir in "${out_dirs[@]}" 01:02:54.203 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.203 + [[ -f ./dsa-phy-autotest_4917/output//doc.tar.xz ]] 01:02:54.203 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.203 + [[ -f ./dsa-phy-autotest_4917/output//ut_coverage.tar.xz ]] 01:02:54.203 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.203 + [[ -f ./dsa-phy-autotest_4917/output//llvm.tar.xz ]] 01:02:54.204 + mv ./dsa-phy-autotest_4917/output//all_tests.txt ./dsa-phy-autotest_4917/output//build-pkg-manifest.txt ./dsa-phy-autotest_4917/output//build-repo-manifest.txt ./dsa-phy-autotest_4917/output//cov_base.info.xz ./dsa-phy-autotest_4917/output//cov_test.info.xz ./dsa-phy-autotest_4917/output//cov_total.info.xz ./dsa-phy-autotest_4917/output//dmesg.init.log ./dsa-phy-autotest_4917/output//dmesg.log ./dsa-phy-autotest_4917/output//nvmf_trace.0_shm.tar.gz ./dsa-phy-autotest_4917/output//power.tar.xz ./dsa-phy-autotest_4917/output//test_completions.txt ./dsa-phy-autotest_4917/output//timing.svg ./dsa-phy-autotest_4917/output//timing.txt ./dsa-phy-autotest_4917/output//.. 01:02:54.204 + rmdir ./dsa-phy-autotest_4917/output/ 01:02:54.204 + for dir in "${out_dirs[@]}" 01:02:54.204 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.204 + [[ -f ./freebsd-vg-autotest_59140/output//doc.tar.xz ]] 01:02:54.204 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.204 + [[ -f ./freebsd-vg-autotest_59140/output//ut_coverage.tar.xz ]] 01:02:54.204 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.204 + [[ -f ./freebsd-vg-autotest_59140/output//llvm.tar.xz ]] 01:02:54.204 + mv ./freebsd-vg-autotest_59140/output//all_tests.txt ./freebsd-vg-autotest_59140/output//build-pkg-manifest.txt ./freebsd-vg-autotest_59140/output//build-repo-manifest.txt ./freebsd-vg-autotest_59140/output//messages ./freebsd-vg-autotest_59140/output//power.tar.xz ./freebsd-vg-autotest_59140/output//test_completions.txt ./freebsd-vg-autotest_59140/output//timing.txt ./freebsd-vg-autotest_59140/output//.. 01:02:54.204 + rmdir ./freebsd-vg-autotest_59140/output/ 01:02:54.204 + for dir in "${out_dirs[@]}" 01:02:54.204 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.204 + [[ -f ./iscsi-uring-vg-autotest_77402/output//doc.tar.xz ]] 01:02:54.204 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.204 + [[ -f ./iscsi-uring-vg-autotest_77402/output//ut_coverage.tar.xz ]] 01:02:54.204 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.204 + [[ -f ./iscsi-uring-vg-autotest_77402/output//llvm.tar.xz ]] 01:02:54.204 + mv ./iscsi-uring-vg-autotest_77402/output//all_tests.txt ./iscsi-uring-vg-autotest_77402/output//build-pkg-manifest.txt ./iscsi-uring-vg-autotest_77402/output//build-repo-manifest.txt ./iscsi-uring-vg-autotest_77402/output//calsoft.json ./iscsi-uring-vg-autotest_77402/output//calsoft.tar.xz ./iscsi-uring-vg-autotest_77402/output//cov_base.info.xz ./iscsi-uring-vg-autotest_77402/output//cov_test.info.xz ./iscsi-uring-vg-autotest_77402/output//cov_total.info.xz ./iscsi-uring-vg-autotest_77402/output//dmesg.init.log ./iscsi-uring-vg-autotest_77402/output//dmesg.log ./iscsi-uring-vg-autotest_77402/output//iscsi_autofuzz_logs.txt ./iscsi-uring-vg-autotest_77402/output//iscsi_autofuzz_tgt_output.txt ./iscsi-uring-vg-autotest_77402/output//power.tar.xz ./iscsi-uring-vg-autotest_77402/output//test_completions.txt ./iscsi-uring-vg-autotest_77402/output//timing.svg ./iscsi-uring-vg-autotest_77402/output//timing.txt ./iscsi-uring-vg-autotest_77402/output//.. 01:02:54.204 + rmdir ./iscsi-uring-vg-autotest_77402/output/ 01:02:54.204 + for dir in "${out_dirs[@]}" 01:02:54.204 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.204 + [[ -f ./iscsi-vg-autotest_77535/output//doc.tar.xz ]] 01:02:54.204 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.204 + [[ -f ./iscsi-vg-autotest_77535/output//ut_coverage.tar.xz ]] 01:02:54.204 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.204 + [[ -f ./iscsi-vg-autotest_77535/output//llvm.tar.xz ]] 01:02:54.204 + mv ./iscsi-vg-autotest_77535/output//all_tests.txt ./iscsi-vg-autotest_77535/output//build-kernel-manifest.txt ./iscsi-vg-autotest_77535/output//build-pkg-manifest.txt ./iscsi-vg-autotest_77535/output//build-repo-manifest.txt ./iscsi-vg-autotest_77535/output//calsoft.json ./iscsi-vg-autotest_77535/output//calsoft.tar.xz ./iscsi-vg-autotest_77535/output//cov_base.info.xz ./iscsi-vg-autotest_77535/output//cov_test.info.xz ./iscsi-vg-autotest_77535/output//cov_total.info.xz ./iscsi-vg-autotest_77535/output//dmesg.init.log ./iscsi-vg-autotest_77535/output//dmesg.log ./iscsi-vg-autotest_77535/output//iscsi_autofuzz_logs.txt ./iscsi-vg-autotest_77535/output//iscsi_autofuzz_tgt_output.txt ./iscsi-vg-autotest_77535/output//power.tar.xz ./iscsi-vg-autotest_77535/output//test_completions.txt ./iscsi-vg-autotest_77535/output//timing.svg ./iscsi-vg-autotest_77535/output//timing.txt ./iscsi-vg-autotest_77535/output//.. 01:02:54.204 + rmdir ./iscsi-vg-autotest_77535/output/ 01:02:54.204 + for dir in "${out_dirs[@]}" 01:02:54.204 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.204 + [[ -f ./lvol-vg-autotest_77446/output//doc.tar.xz ]] 01:02:54.204 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.204 + [[ -f ./lvol-vg-autotest_77446/output//ut_coverage.tar.xz ]] 01:02:54.204 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.204 + [[ -f ./lvol-vg-autotest_77446/output//llvm.tar.xz ]] 01:02:54.204 + mv ./lvol-vg-autotest_77446/output//all_tests.txt ./lvol-vg-autotest_77446/output//build-pkg-manifest.txt ./lvol-vg-autotest_77446/output//build-repo-manifest.txt ./lvol-vg-autotest_77446/output//cov_base.info.xz ./lvol-vg-autotest_77446/output//cov_test.info.xz ./lvol-vg-autotest_77446/output//cov_total.info.xz ./lvol-vg-autotest_77446/output//dmesg.init.log ./lvol-vg-autotest_77446/output//dmesg.log ./lvol-vg-autotest_77446/output//power.tar.xz ./lvol-vg-autotest_77446/output//test_completions.txt ./lvol-vg-autotest_77446/output//timing.svg ./lvol-vg-autotest_77446/output//timing.txt ./lvol-vg-autotest_77446/output//.. 01:02:54.204 + rmdir ./lvol-vg-autotest_77446/output/ 01:02:54.204 + for dir in "${out_dirs[@]}" 01:02:54.204 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.204 + [[ -f ./nvme-cmb-pmr-vg-autotest_78620/output//doc.tar.xz ]] 01:02:54.204 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.204 + [[ -f ./nvme-cmb-pmr-vg-autotest_78620/output//ut_coverage.tar.xz ]] 01:02:54.204 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.204 + [[ -f ./nvme-cmb-pmr-vg-autotest_78620/output//llvm.tar.xz ]] 01:02:54.204 + mv ./nvme-cmb-pmr-vg-autotest_78620/output//all_tests.txt ./nvme-cmb-pmr-vg-autotest_78620/output//build-pkg-manifest.txt ./nvme-cmb-pmr-vg-autotest_78620/output//build-repo-manifest.txt ./nvme-cmb-pmr-vg-autotest_78620/output//cov_base.info.xz ./nvme-cmb-pmr-vg-autotest_78620/output//cov_test.info.xz ./nvme-cmb-pmr-vg-autotest_78620/output//cov_total.info.xz ./nvme-cmb-pmr-vg-autotest_78620/output//dmesg.init.log ./nvme-cmb-pmr-vg-autotest_78620/output//dmesg.log ./nvme-cmb-pmr-vg-autotest_78620/output//power.tar.xz ./nvme-cmb-pmr-vg-autotest_78620/output//test_completions.txt ./nvme-cmb-pmr-vg-autotest_78620/output//timing.svg ./nvme-cmb-pmr-vg-autotest_78620/output//timing.txt ./nvme-cmb-pmr-vg-autotest_78620/output//.. 01:02:54.204 + rmdir ./nvme-cmb-pmr-vg-autotest_78620/output/ 01:02:54.204 + for dir in "${out_dirs[@]}" 01:02:54.204 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.204 + [[ -f ./nvme-phy-autotest_72389/output//doc.tar.xz ]] 01:02:54.204 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.204 + [[ -f ./nvme-phy-autotest_72389/output//ut_coverage.tar.xz ]] 01:02:54.204 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.204 + [[ -f ./nvme-phy-autotest_72389/output//llvm.tar.xz ]] 01:02:54.204 + mv ./nvme-phy-autotest_72389/output//all_tests.txt ./nvme-phy-autotest_72389/output//build-pkg-manifest.txt ./nvme-phy-autotest_72389/output//build-repo-manifest.txt ./nvme-phy-autotest_72389/output//cov_base.info.xz ./nvme-phy-autotest_72389/output//cov_test.info.xz ./nvme-phy-autotest_72389/output//cov_total.info.xz ./nvme-phy-autotest_72389/output//dmesg.init.log ./nvme-phy-autotest_72389/output//dmesg.log ./nvme-phy-autotest_72389/output//power.tar.xz ./nvme-phy-autotest_72389/output//test_completions.txt ./nvme-phy-autotest_72389/output//timing.svg ./nvme-phy-autotest_72389/output//timing.txt ./nvme-phy-autotest_72389/output//.. 01:02:54.204 + rmdir ./nvme-phy-autotest_72389/output/ 01:02:54.204 + for dir in "${out_dirs[@]}" 01:02:54.204 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.204 + [[ -f ./nvme-vg-autotest_77497/output//doc.tar.xz ]] 01:02:54.204 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.204 + [[ -f ./nvme-vg-autotest_77497/output//ut_coverage.tar.xz ]] 01:02:54.204 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.204 + [[ -f ./nvme-vg-autotest_77497/output//llvm.tar.xz ]] 01:02:54.204 + mv ./nvme-vg-autotest_77497/output//all_tests.txt ./nvme-vg-autotest_77497/output//build-kernel-manifest.txt ./nvme-vg-autotest_77497/output//build-pkg-manifest.txt ./nvme-vg-autotest_77497/output//build-repo-manifest.txt ./nvme-vg-autotest_77497/output//cov_base.info.xz ./nvme-vg-autotest_77497/output//dmesg.init.log ./nvme-vg-autotest_77497/output//dmesg.log ./nvme-vg-autotest_77497/output//power.tar.xz ./nvme-vg-autotest_77497/output//proc_list.txt ./nvme-vg-autotest_77497/output//test_completions.txt ./nvme-vg-autotest_77497/output//timing.txt ./nvme-vg-autotest_77497/output//udev.log ./nvme-vg-autotest_77497/output//.. 01:02:54.204 + rmdir ./nvme-vg-autotest_77497/output/ 01:02:54.204 + for dir in "${out_dirs[@]}" 01:02:54.204 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.204 + [[ -f ./nvmf-phy-autotest_72461/output//doc.tar.xz ]] 01:02:54.204 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.204 + [[ -f ./nvmf-phy-autotest_72461/output//ut_coverage.tar.xz ]] 01:02:54.204 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.204 + [[ -f ./nvmf-phy-autotest_72461/output//llvm.tar.xz ]] 01:02:54.204 + mv ./nvmf-phy-autotest_72461/output//all_tests.txt ./nvmf-phy-autotest_72461/output//build-pkg-manifest.txt ./nvmf-phy-autotest_72461/output//build-repo-manifest.txt ./nvmf-phy-autotest_72461/output//cov_base.info.xz ./nvmf-phy-autotest_72461/output//cov_test.info.xz ./nvmf-phy-autotest_72461/output//cov_total.info.xz ./nvmf-phy-autotest_72461/output//dmesg.init.log ./nvmf-phy-autotest_72461/output//dmesg.log ./nvmf-phy-autotest_72461/output//nvmf_trace.0_shm.tar.gz ./nvmf-phy-autotest_72461/output//power.tar.xz ./nvmf-phy-autotest_72461/output//test_completions.txt ./nvmf-phy-autotest_72461/output//timing.svg ./nvmf-phy-autotest_72461/output//timing.txt ./nvmf-phy-autotest_72461/output//.. 01:02:54.204 + rmdir ./nvmf-phy-autotest_72461/output/ 01:02:54.204 + for dir in "${out_dirs[@]}" 01:02:54.204 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.204 + [[ -f ./nvmf-tcp-phy-autotest_72348/output//doc.tar.xz ]] 01:02:54.204 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.204 + [[ -f ./nvmf-tcp-phy-autotest_72348/output//ut_coverage.tar.xz ]] 01:02:54.204 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.204 + [[ -f ./nvmf-tcp-phy-autotest_72348/output//llvm.tar.xz ]] 01:02:54.204 + mv ./nvmf-tcp-phy-autotest_72348/output//all_tests.txt ./nvmf-tcp-phy-autotest_72348/output//build-pkg-manifest.txt ./nvmf-tcp-phy-autotest_72348/output//build-repo-manifest.txt ./nvmf-tcp-phy-autotest_72348/output//cov_base.info.xz ./nvmf-tcp-phy-autotest_72348/output//cov_test.info.xz ./nvmf-tcp-phy-autotest_72348/output//cov_total.info.xz ./nvmf-tcp-phy-autotest_72348/output//dmesg.init.log ./nvmf-tcp-phy-autotest_72348/output//dmesg.log ./nvmf-tcp-phy-autotest_72348/output//nvmf_trace.0_shm.tar.gz ./nvmf-tcp-phy-autotest_72348/output//power.tar.xz ./nvmf-tcp-phy-autotest_72348/output//test_completions.txt ./nvmf-tcp-phy-autotest_72348/output//timing.svg ./nvmf-tcp-phy-autotest_72348/output//timing.txt ./nvmf-tcp-phy-autotest_72348/output//.. 01:02:54.204 + rmdir ./nvmf-tcp-phy-autotest_72348/output/ 01:02:54.204 + for dir in "${out_dirs[@]}" 01:02:54.204 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.204 + [[ -f ./nvmf-tcp-uring-vg-autotest_77422/output//doc.tar.xz ]] 01:02:54.204 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.204 + [[ -f ./nvmf-tcp-uring-vg-autotest_77422/output//ut_coverage.tar.xz ]] 01:02:54.204 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.204 + [[ -f ./nvmf-tcp-uring-vg-autotest_77422/output//llvm.tar.xz ]] 01:02:54.204 + mv ./nvmf-tcp-uring-vg-autotest_77422/output//all_tests.txt ./nvmf-tcp-uring-vg-autotest_77422/output//build-pkg-manifest.txt ./nvmf-tcp-uring-vg-autotest_77422/output//build-repo-manifest.txt ./nvmf-tcp-uring-vg-autotest_77422/output//cov_base.info.xz ./nvmf-tcp-uring-vg-autotest_77422/output//cov_test.info.xz ./nvmf-tcp-uring-vg-autotest_77422/output//cov_total.info.xz ./nvmf-tcp-uring-vg-autotest_77422/output//dmesg.init.log ./nvmf-tcp-uring-vg-autotest_77422/output//dmesg.log ./nvmf-tcp-uring-vg-autotest_77422/output//nvmf_trace.0_shm.tar.gz ./nvmf-tcp-uring-vg-autotest_77422/output//power.tar.xz ./nvmf-tcp-uring-vg-autotest_77422/output//test_completions.txt ./nvmf-tcp-uring-vg-autotest_77422/output//timing.svg ./nvmf-tcp-uring-vg-autotest_77422/output//timing.txt ./nvmf-tcp-uring-vg-autotest_77422/output//.. 01:02:54.204 + rmdir ./nvmf-tcp-uring-vg-autotest_77422/output/ 01:02:54.204 + for dir in "${out_dirs[@]}" 01:02:54.204 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.204 + [[ -f ./nvmf-tcp-vg-autotest_77488/output//doc.tar.xz ]] 01:02:54.204 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.204 + [[ -f ./nvmf-tcp-vg-autotest_77488/output//ut_coverage.tar.xz ]] 01:02:54.204 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.204 + [[ -f ./nvmf-tcp-vg-autotest_77488/output//llvm.tar.xz ]] 01:02:54.205 + mv ./nvmf-tcp-vg-autotest_77488/output//all_tests.txt ./nvmf-tcp-vg-autotest_77488/output//build-kernel-manifest.txt ./nvmf-tcp-vg-autotest_77488/output//build-pkg-manifest.txt ./nvmf-tcp-vg-autotest_77488/output//build-repo-manifest.txt ./nvmf-tcp-vg-autotest_77488/output//cov_base.info.xz ./nvmf-tcp-vg-autotest_77488/output//cov_test.info.xz ./nvmf-tcp-vg-autotest_77488/output//cov_total.info.xz ./nvmf-tcp-vg-autotest_77488/output//dmesg.init.log ./nvmf-tcp-vg-autotest_77488/output//dmesg.log ./nvmf-tcp-vg-autotest_77488/output//nvmf_trace.0_shm.tar.gz ./nvmf-tcp-vg-autotest_77488/output//power.tar.xz ./nvmf-tcp-vg-autotest_77488/output//test_completions.txt ./nvmf-tcp-vg-autotest_77488/output//timing.svg ./nvmf-tcp-vg-autotest_77488/output//timing.txt ./nvmf-tcp-vg-autotest_77488/output//.. 01:02:54.205 + rmdir ./nvmf-tcp-vg-autotest_77488/output/ 01:02:54.205 + for dir in "${out_dirs[@]}" 01:02:54.205 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.205 + [[ -f ./packaging-docker-autotest_19879/output//doc.tar.xz ]] 01:02:54.205 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.205 + [[ -f ./packaging-docker-autotest_19879/output//ut_coverage.tar.xz ]] 01:02:54.205 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.205 + [[ -f ./packaging-docker-autotest_19879/output//llvm.tar.xz ]] 01:02:54.205 + mv ./packaging-docker-autotest_19879/output//build-pkg-manifest.txt ./packaging-docker-autotest_19879/output//build-repo-manifest.txt ./packaging-docker-autotest_19879/output//power.tar.xz ./packaging-docker-autotest_19879/output//test_completions.txt ./packaging-docker-autotest_19879/output//timing.txt ./packaging-docker-autotest_19879/output//.. 01:02:54.205 + rmdir ./packaging-docker-autotest_19879/output/ 01:02:54.205 + for dir in "${out_dirs[@]}" 01:02:54.205 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.205 + [[ -f ./rocky9-vg-autotest_16107/output//doc.tar.xz ]] 01:02:54.205 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.205 + [[ -f ./rocky9-vg-autotest_16107/output//ut_coverage.tar.xz ]] 01:02:54.205 + tar -C ./rocky9-vg-autotest_16107/output/ -xf ./rocky9-vg-autotest_16107/output//ut_coverage.tar.xz 01:02:54.463 + rm ./rocky9-vg-autotest_16107/output//ut_coverage.tar.xz 01:02:54.463 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.463 + [[ -f ./rocky9-vg-autotest_16107/output//llvm.tar.xz ]] 01:02:54.463 + mv ./rocky9-vg-autotest_16107/output//all_tests.txt ./rocky9-vg-autotest_16107/output//build-pkg-manifest.txt ./rocky9-vg-autotest_16107/output//build-repo-manifest.txt ./rocky9-vg-autotest_16107/output//cov_base.info.xz ./rocky9-vg-autotest_16107/output//cov_test.info.xz ./rocky9-vg-autotest_16107/output//cov_total.info.xz ./rocky9-vg-autotest_16107/output//dmesg.init.log ./rocky9-vg-autotest_16107/output//dmesg.log ./rocky9-vg-autotest_16107/output//power.tar.xz ./rocky9-vg-autotest_16107/output//test_completions.txt ./rocky9-vg-autotest_16107/output//timing.svg ./rocky9-vg-autotest_16107/output//timing.txt ./rocky9-vg-autotest_16107/output//ut_coverage ./rocky9-vg-autotest_16107/output//.. 01:02:54.463 + rmdir ./rocky9-vg-autotest_16107/output/ 01:02:54.463 + for dir in "${out_dirs[@]}" 01:02:54.463 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.463 + [[ -f ./scan-build-docker-autotest_19880/output//doc.tar.xz ]] 01:02:54.463 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.463 + [[ -f ./scan-build-docker-autotest_19880/output//ut_coverage.tar.xz ]] 01:02:54.463 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.463 + [[ -f ./scan-build-docker-autotest_19880/output//llvm.tar.xz ]] 01:02:54.463 + mv ./scan-build-docker-autotest_19880/output//all_c_files.txt ./scan-build-docker-autotest_19880/output//build_output.txt ./scan-build-docker-autotest_19880/output//build-pkg-manifest.txt ./scan-build-docker-autotest_19880/output//build-repo-manifest.txt ./scan-build-docker-autotest_19880/output//built_c_files.txt ./scan-build-docker-autotest_19880/output//power.tar.xz ./scan-build-docker-autotest_19880/output//test_completions.txt ./scan-build-docker-autotest_19880/output//timing.txt ./scan-build-docker-autotest_19880/output//unbuilt_c_files.txt ./scan-build-docker-autotest_19880/output//.. 01:02:54.463 + rmdir ./scan-build-docker-autotest_19880/output/ 01:02:54.463 + for dir in "${out_dirs[@]}" 01:02:54.463 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.463 + [[ -f ./short-fuzz-phy-autotest_26214/output//doc.tar.xz ]] 01:02:54.463 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.463 + [[ -f ./short-fuzz-phy-autotest_26214/output//ut_coverage.tar.xz ]] 01:02:54.463 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.463 + [[ -f ./short-fuzz-phy-autotest_26214/output//llvm.tar.xz ]] 01:02:54.463 + tar -C ./short-fuzz-phy-autotest_26214/output/ -xf ./short-fuzz-phy-autotest_26214/output//llvm.tar.xz 01:02:54.463 + rm ./short-fuzz-phy-autotest_26214/output//llvm.tar.xz 01:02:54.463 + mv ./short-fuzz-phy-autotest_26214/output//all_tests.txt ./short-fuzz-phy-autotest_26214/output//build-pkg-manifest.txt ./short-fuzz-phy-autotest_26214/output//build-repo-manifest.txt ./short-fuzz-phy-autotest_26214/output//dmesg.init.log ./short-fuzz-phy-autotest_26214/output//dmesg.log ./short-fuzz-phy-autotest_26214/output//llvm ./short-fuzz-phy-autotest_26214/output//power.tar.xz ./short-fuzz-phy-autotest_26214/output//test_completions.txt ./short-fuzz-phy-autotest_26214/output//timing.svg ./short-fuzz-phy-autotest_26214/output//timing.txt ./short-fuzz-phy-autotest_26214/output//.. 01:02:54.463 + rmdir ./short-fuzz-phy-autotest_26214/output/ 01:02:54.463 + for dir in "${out_dirs[@]}" 01:02:54.463 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.463 + [[ -f ./ubuntu20-vg-autotest_73816/output//doc.tar.xz ]] 01:02:54.463 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.463 + [[ -f ./ubuntu20-vg-autotest_73816/output//ut_coverage.tar.xz ]] 01:02:54.463 + tar -C ./ubuntu20-vg-autotest_73816/output/ -xf ./ubuntu20-vg-autotest_73816/output//ut_coverage.tar.xz 01:02:54.720 + rm ./ubuntu20-vg-autotest_73816/output//ut_coverage.tar.xz 01:02:54.720 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.720 + [[ -f ./ubuntu20-vg-autotest_73816/output//llvm.tar.xz ]] 01:02:54.720 + mv ./ubuntu20-vg-autotest_73816/output//all_tests.txt ./ubuntu20-vg-autotest_73816/output//build-pkg-manifest.txt ./ubuntu20-vg-autotest_73816/output//build-repo-manifest.txt ./ubuntu20-vg-autotest_73816/output//cov_base.info.xz ./ubuntu20-vg-autotest_73816/output//dmesg.init.log ./ubuntu20-vg-autotest_73816/output//dmesg.log ./ubuntu20-vg-autotest_73816/output//power.tar.xz ./ubuntu20-vg-autotest_73816/output//proc_list.txt ./ubuntu20-vg-autotest_73816/output//test_completions.txt ./ubuntu20-vg-autotest_73816/output//timing.txt ./ubuntu20-vg-autotest_73816/output//udev.log ./ubuntu20-vg-autotest_73816/output//ut_coverage ./ubuntu20-vg-autotest_73816/output//.. 01:02:54.720 + rmdir ./ubuntu20-vg-autotest_73816/output/ 01:02:54.720 + for dir in "${out_dirs[@]}" 01:02:54.720 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.720 + [[ -f ./ubuntu22-vg-autotest_37830/output//doc.tar.xz ]] 01:02:54.720 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.720 + [[ -f ./ubuntu22-vg-autotest_37830/output//ut_coverage.tar.xz ]] 01:02:54.720 + tar -C ./ubuntu22-vg-autotest_37830/output/ -xf ./ubuntu22-vg-autotest_37830/output//ut_coverage.tar.xz 01:02:54.977 + rm ./ubuntu22-vg-autotest_37830/output//ut_coverage.tar.xz 01:02:54.977 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.977 + [[ -f ./ubuntu22-vg-autotest_37830/output//llvm.tar.xz ]] 01:02:54.977 + mv ./ubuntu22-vg-autotest_37830/output//all_tests.txt ./ubuntu22-vg-autotest_37830/output//build-pkg-manifest.txt ./ubuntu22-vg-autotest_37830/output//build-repo-manifest.txt ./ubuntu22-vg-autotest_37830/output//cov_base.info.xz ./ubuntu22-vg-autotest_37830/output//cov_test.info.xz ./ubuntu22-vg-autotest_37830/output//cov_total.info.xz ./ubuntu22-vg-autotest_37830/output//dmesg.init.log ./ubuntu22-vg-autotest_37830/output//dmesg.log ./ubuntu22-vg-autotest_37830/output//power.tar.xz ./ubuntu22-vg-autotest_37830/output//test_completions.txt ./ubuntu22-vg-autotest_37830/output//timing.svg ./ubuntu22-vg-autotest_37830/output//timing.txt ./ubuntu22-vg-autotest_37830/output//ut_coverage ./ubuntu22-vg-autotest_37830/output//.. 01:02:54.977 + rmdir ./ubuntu22-vg-autotest_37830/output/ 01:02:54.977 + for dir in "${out_dirs[@]}" 01:02:54.977 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.977 + [[ -f ./unittest-clang-docker-autotest_19877/output//doc.tar.xz ]] 01:02:54.977 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.977 + [[ -f ./unittest-clang-docker-autotest_19877/output//ut_coverage.tar.xz ]] 01:02:54.977 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.977 + [[ -f ./unittest-clang-docker-autotest_19877/output//llvm.tar.xz ]] 01:02:54.977 + mv ./unittest-clang-docker-autotest_19877/output//build-pkg-manifest.txt ./unittest-clang-docker-autotest_19877/output//build-repo-manifest.txt ./unittest-clang-docker-autotest_19877/output//power.tar.xz ./unittest-clang-docker-autotest_19877/output//test_completions.txt ./unittest-clang-docker-autotest_19877/output//timing.txt ./unittest-clang-docker-autotest_19877/output//.. 01:02:54.977 + rmdir ./unittest-clang-docker-autotest_19877/output/ 01:02:54.977 + for dir in "${out_dirs[@]}" 01:02:54.977 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.977 + [[ -f ./unittest-main-docker-autotest_19878/output//doc.tar.xz ]] 01:02:54.977 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:54.977 + [[ -f ./unittest-main-docker-autotest_19878/output//ut_coverage.tar.xz ]] 01:02:54.977 + tar -C ./unittest-main-docker-autotest_19878/output/ -xf ./unittest-main-docker-autotest_19878/output//ut_coverage.tar.xz 01:02:55.234 + rm ./unittest-main-docker-autotest_19878/output//ut_coverage.tar.xz 01:02:55.234 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:55.234 + [[ -f ./unittest-main-docker-autotest_19878/output//llvm.tar.xz ]] 01:02:55.234 + mv ./unittest-main-docker-autotest_19878/output//build-pkg-manifest.txt ./unittest-main-docker-autotest_19878/output//build-repo-manifest.txt ./unittest-main-docker-autotest_19878/output//power.tar.xz ./unittest-main-docker-autotest_19878/output//test_completions.txt ./unittest-main-docker-autotest_19878/output//timing.txt ./unittest-main-docker-autotest_19878/output//ut_coverage ./unittest-main-docker-autotest_19878/output//.. 01:02:55.234 + rmdir ./unittest-main-docker-autotest_19878/output/ 01:02:55.234 + for dir in "${out_dirs[@]}" 01:02:55.234 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:55.234 + [[ -f ./unittest-valgrind-docker-autotest_19881/output//doc.tar.xz ]] 01:02:55.234 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:55.234 + [[ -f ./unittest-valgrind-docker-autotest_19881/output//ut_coverage.tar.xz ]] 01:02:55.234 + tar -C ./unittest-valgrind-docker-autotest_19881/output/ -xf ./unittest-valgrind-docker-autotest_19881/output//ut_coverage.tar.xz 01:02:55.492 + rm ./unittest-valgrind-docker-autotest_19881/output//ut_coverage.tar.xz 01:02:55.492 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:55.492 + [[ -f ./unittest-valgrind-docker-autotest_19881/output//llvm.tar.xz ]] 01:02:55.492 + mv ./unittest-valgrind-docker-autotest_19881/output//build-pkg-manifest.txt ./unittest-valgrind-docker-autotest_19881/output//build-repo-manifest.txt ./unittest-valgrind-docker-autotest_19881/output//power.tar.xz ./unittest-valgrind-docker-autotest_19881/output//test_completions.txt ./unittest-valgrind-docker-autotest_19881/output//timing.txt ./unittest-valgrind-docker-autotest_19881/output//ut_coverage ./unittest-valgrind-docker-autotest_19881/output//.. 01:02:55.492 + rmdir ./unittest-valgrind-docker-autotest_19881/output/ 01:02:55.492 + for dir in "${out_dirs[@]}" 01:02:55.492 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:55.492 + [[ -f ./vfio-user-phy-autotest_26225/output//doc.tar.xz ]] 01:02:55.492 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:55.492 + [[ -f ./vfio-user-phy-autotest_26225/output//ut_coverage.tar.xz ]] 01:02:55.492 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:55.492 + [[ -f ./vfio-user-phy-autotest_26225/output//llvm.tar.xz ]] 01:02:55.492 + mv ./vfio-user-phy-autotest_26225/output//all_tests.txt ./vfio-user-phy-autotest_26225/output//build-pkg-manifest.txt ./vfio-user-phy-autotest_26225/output//build-repo-manifest.txt ./vfio-user-phy-autotest_26225/output//cov_base.info.xz ./vfio-user-phy-autotest_26225/output//cov_test.info.xz ./vfio-user-phy-autotest_26225/output//cov_total.info.xz ./vfio-user-phy-autotest_26225/output//dmesg.init.log ./vfio-user-phy-autotest_26225/output//dmesg.log ./vfio-user-phy-autotest_26225/output//power.tar.xz ./vfio-user-phy-autotest_26225/output//test_completions.txt ./vfio-user-phy-autotest_26225/output//timing.svg ./vfio-user-phy-autotest_26225/output//timing.txt ./vfio-user-phy-autotest_26225/output//.. 01:02:55.492 + rmdir ./vfio-user-phy-autotest_26225/output/ 01:02:55.492 + for dir in "${out_dirs[@]}" 01:02:55.492 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:55.492 + [[ -f ./vhost-initiator-vg-autotest_77517/output//doc.tar.xz ]] 01:02:55.492 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:55.492 + [[ -f ./vhost-initiator-vg-autotest_77517/output//ut_coverage.tar.xz ]] 01:02:55.492 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:55.492 + [[ -f ./vhost-initiator-vg-autotest_77517/output//llvm.tar.xz ]] 01:02:55.492 + mv ./vhost-initiator-vg-autotest_77517/output//all_tests.txt ./vhost-initiator-vg-autotest_77517/output//build-kernel-manifest.txt ./vhost-initiator-vg-autotest_77517/output//build-pkg-manifest.txt ./vhost-initiator-vg-autotest_77517/output//build-repo-manifest.txt ./vhost-initiator-vg-autotest_77517/output//cov_base.info.xz ./vhost-initiator-vg-autotest_77517/output//cov_test.info.xz ./vhost-initiator-vg-autotest_77517/output//cov_total.info.xz ./vhost-initiator-vg-autotest_77517/output//dmesg.init.log ./vhost-initiator-vg-autotest_77517/output//dmesg.log ./vhost-initiator-vg-autotest_77517/output//power.tar.xz ./vhost-initiator-vg-autotest_77517/output//test_completions.txt ./vhost-initiator-vg-autotest_77517/output//timing.svg ./vhost-initiator-vg-autotest_77517/output//timing.txt ./vhost-initiator-vg-autotest_77517/output//vhost_fuzz_output1.txt.xz ./vhost-initiator-vg-autotest_77517/output//vhost_fuzz_output2.txt.xz ./vhost-initiator-vg-autotest_77517/output//vhost_fuzz_tgt_output.txt.xz ./vhost-initiator-vg-autotest_77517/output//.. 01:02:55.492 + rmdir ./vhost-initiator-vg-autotest_77517/output/ 01:02:55.492 + for dir in "${out_dirs[@]}" 01:02:55.492 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:55.492 + [[ -f ./vhost-phy-autotest_26242/output//doc.tar.xz ]] 01:02:55.492 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:55.492 + [[ -f ./vhost-phy-autotest_26242/output//ut_coverage.tar.xz ]] 01:02:55.492 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:55.492 + [[ -f ./vhost-phy-autotest_26242/output//llvm.tar.xz ]] 01:02:55.492 + mv ./vhost-phy-autotest_26242/output//all_tests.txt ./vhost-phy-autotest_26242/output//build-pkg-manifest.txt ./vhost-phy-autotest_26242/output//build-repo-manifest.txt ./vhost-phy-autotest_26242/output//cov_base.info.xz ./vhost-phy-autotest_26242/output//cov_test.info.xz ./vhost-phy-autotest_26242/output//cov_total.info.xz ./vhost-phy-autotest_26242/output//dmesg.init.log ./vhost-phy-autotest_26242/output//dmesg.log ./vhost-phy-autotest_26242/output//power.tar.xz ./vhost-phy-autotest_26242/output//test_completions.txt ./vhost-phy-autotest_26242/output//timing.svg ./vhost-phy-autotest_26242/output//timing.txt ./vhost-phy-autotest_26242/output//.. 01:02:55.492 + rmdir ./vhost-phy-autotest_26242/output/ 01:02:55.492 + for dir in "${out_dirs[@]}" 01:02:55.492 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:55.492 + [[ -f ./zns-vg-autotest_76603/output//doc.tar.xz ]] 01:02:55.492 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:55.492 + [[ -f ./zns-vg-autotest_76603/output//ut_coverage.tar.xz ]] 01:02:55.492 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 01:02:55.492 + [[ -f ./zns-vg-autotest_76603/output//llvm.tar.xz ]] 01:02:55.492 + mv ./zns-vg-autotest_76603/output//all_tests.txt ./zns-vg-autotest_76603/output//build-pkg-manifest.txt ./zns-vg-autotest_76603/output//build-repo-manifest.txt ./zns-vg-autotest_76603/output//cov_base.info.xz ./zns-vg-autotest_76603/output//cov_test.info.xz ./zns-vg-autotest_76603/output//cov_total.info.xz ./zns-vg-autotest_76603/output//dmesg.init.log ./zns-vg-autotest_76603/output//dmesg.log ./zns-vg-autotest_76603/output//power.tar.xz ./zns-vg-autotest_76603/output//test_completions.txt ./zns-vg-autotest_76603/output//timing.svg ./zns-vg-autotest_76603/output//timing.txt ./zns-vg-autotest_76603/output//.. 01:02:55.492 + rmdir ./zns-vg-autotest_76603/output/ 01:02:55.492 + unpack_cov_files 01:02:55.492 + local info_files 01:02:55.492 + info_files=(*/cov_*.info.xz) 01:02:55.492 + xargs -P0 -r -n1 xz -d 01:02:55.492 + printf '%s\n' BlobFS-phy-autotest_26223/cov_base.info.xz BlobFS-phy-autotest_26223/cov_test.info.xz BlobFS-phy-autotest_26223/cov_total.info.xz centos7-vg-autotest_73676/cov_base.info.xz centos7-vg-autotest_73676/cov_test.info.xz centos7-vg-autotest_73676/cov_total.info.xz crypto-phy-autotest_26217/cov_base.info.xz crypto-phy-autotest_26217/cov_test.info.xz crypto-phy-autotest_26217/cov_total.info.xz dsa-phy-autotest_4917/cov_base.info.xz dsa-phy-autotest_4917/cov_test.info.xz dsa-phy-autotest_4917/cov_total.info.xz iscsi-uring-vg-autotest_77402/cov_base.info.xz iscsi-uring-vg-autotest_77402/cov_test.info.xz iscsi-uring-vg-autotest_77402/cov_total.info.xz iscsi-vg-autotest_77535/cov_base.info.xz iscsi-vg-autotest_77535/cov_test.info.xz iscsi-vg-autotest_77535/cov_total.info.xz lvol-vg-autotest_77446/cov_base.info.xz lvol-vg-autotest_77446/cov_test.info.xz lvol-vg-autotest_77446/cov_total.info.xz nvme-cmb-pmr-vg-autotest_78620/cov_base.info.xz nvme-cmb-pmr-vg-autotest_78620/cov_test.info.xz nvme-cmb-pmr-vg-autotest_78620/cov_total.info.xz nvme-phy-autotest_72389/cov_base.info.xz nvme-phy-autotest_72389/cov_test.info.xz nvme-phy-autotest_72389/cov_total.info.xz nvme-vg-autotest_77497/cov_base.info.xz nvmf-phy-autotest_72461/cov_base.info.xz nvmf-phy-autotest_72461/cov_test.info.xz nvmf-phy-autotest_72461/cov_total.info.xz nvmf-tcp-phy-autotest_72348/cov_base.info.xz nvmf-tcp-phy-autotest_72348/cov_test.info.xz nvmf-tcp-phy-autotest_72348/cov_total.info.xz nvmf-tcp-uring-vg-autotest_77422/cov_base.info.xz nvmf-tcp-uring-vg-autotest_77422/cov_test.info.xz nvmf-tcp-uring-vg-autotest_77422/cov_total.info.xz nvmf-tcp-vg-autotest_77488/cov_base.info.xz nvmf-tcp-vg-autotest_77488/cov_test.info.xz nvmf-tcp-vg-autotest_77488/cov_total.info.xz rocky9-vg-autotest_16107/cov_base.info.xz rocky9-vg-autotest_16107/cov_test.info.xz rocky9-vg-autotest_16107/cov_total.info.xz ubuntu20-vg-autotest_73816/cov_base.info.xz ubuntu22-vg-autotest_37830/cov_base.info.xz ubuntu22-vg-autotest_37830/cov_test.info.xz ubuntu22-vg-autotest_37830/cov_total.info.xz vfio-user-phy-autotest_26225/cov_base.info.xz vfio-user-phy-autotest_26225/cov_test.info.xz vfio-user-phy-autotest_26225/cov_total.info.xz vhost-initiator-vg-autotest_77517/cov_base.info.xz vhost-initiator-vg-autotest_77517/cov_test.info.xz vhost-initiator-vg-autotest_77517/cov_total.info.xz vhost-phy-autotest_26242/cov_base.info.xz vhost-phy-autotest_26242/cov_test.info.xz vhost-phy-autotest_26242/cov_total.info.xz zns-vg-autotest_76603/cov_base.info.xz zns-vg-autotest_76603/cov_test.info.xz zns-vg-autotest_76603/cov_total.info.xz 01:02:55.749 + fix_downstream_job_paths 01:02:55.749 + sed -i -e 's#^SF:/.\+/spdk/#SF:/var/jenkins/workspace/autotest-per-patch_6/spdk/#g' BlobFS-phy-autotest_26223/cov_total.info centos7-vg-autotest_73676/cov_total.info crypto-phy-autotest_26217/cov_total.info dsa-phy-autotest_4917/cov_total.info iscsi-uring-vg-autotest_77402/cov_total.info iscsi-vg-autotest_77535/cov_total.info lvol-vg-autotest_77446/cov_total.info nvme-cmb-pmr-vg-autotest_78620/cov_total.info nvme-phy-autotest_72389/cov_total.info nvmf-phy-autotest_72461/cov_total.info nvmf-tcp-phy-autotest_72348/cov_total.info nvmf-tcp-uring-vg-autotest_77422/cov_total.info nvmf-tcp-vg-autotest_77488/cov_total.info rocky9-vg-autotest_16107/cov_total.info ubuntu22-vg-autotest_37830/cov_total.info vfio-user-phy-autotest_26225/cov_total.info vhost-initiator-vg-autotest_77517/cov_total.info vhost-phy-autotest_26242/cov_total.info zns-vg-autotest_76603/cov_total.info 01:02:56.682 + ignore_ocf_headers 01:02:56.682 + sed -i 's#--show-details#--show-details --ignore-errors source#g' spdk/autorun_post.py 01:02:56.682 + create_errtrace_files_for_all_builds 01:02:56.682 + local build_log_list 01:02:56.682 + build_log_list=($(find "$WORKSPACE" -type f -name 'build.log')) 01:02:56.682 ++ find /var/jenkins/workspace/autotest-per-patch_6 -type f -name build.log 01:02:56.682 + for build in "${build_log_list[@]}" 01:02:56.682 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_6/BlobFS-phy-autotest_26223/build.log 01:02:56.682 + local build_log job_name start_pattern end_pattern backtraces 01:02:56.682 + build_log=/var/jenkins/workspace/autotest-per-patch_6/BlobFS-phy-autotest_26223/build.log 01:02:56.682 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/BlobFS-phy-autotest_26223/build.log 01:02:56.682 ++ basename /var/jenkins/workspace/autotest-per-patch_6/BlobFS-phy-autotest_26223 01:02:56.682 + job_name=BlobFS-phy-autotest_26223 01:02:56.682 + start_pattern='Backtrace start' 01:02:56.682 + end_pattern='Backtrace end' 01:02:56.682 + [[ -f /var/jenkins/workspace/autotest-per-patch_6/BlobFS-phy-autotest_26223/build.log ]] 01:02:56.682 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_6/BlobFS-phy-autotest_26223/build.log 01:02:56.682 + backtraces= 01:02:56.682 + [[ -n '' ]] 01:02:56.682 + for build in "${build_log_list[@]}" 01:02:56.682 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_6/vhost-phy-autotest_26242/build.log 01:02:56.682 + local build_log job_name start_pattern end_pattern backtraces 01:02:56.682 + build_log=/var/jenkins/workspace/autotest-per-patch_6/vhost-phy-autotest_26242/build.log 01:02:56.682 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/vhost-phy-autotest_26242/build.log 01:02:56.682 ++ basename /var/jenkins/workspace/autotest-per-patch_6/vhost-phy-autotest_26242 01:02:56.682 + job_name=vhost-phy-autotest_26242 01:02:56.682 + start_pattern='Backtrace start' 01:02:56.682 + end_pattern='Backtrace end' 01:02:56.682 + [[ -f /var/jenkins/workspace/autotest-per-patch_6/vhost-phy-autotest_26242/build.log ]] 01:02:56.682 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_6/vhost-phy-autotest_26242/build.log 01:02:56.682 + backtraces= 01:02:56.682 + [[ -n '' ]] 01:02:56.682 + for build in "${build_log_list[@]}" 01:02:56.682 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_6/rocky9-vg-autotest_16107/build.log 01:02:56.682 + local build_log job_name start_pattern end_pattern backtraces 01:02:56.682 + build_log=/var/jenkins/workspace/autotest-per-patch_6/rocky9-vg-autotest_16107/build.log 01:02:56.682 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/rocky9-vg-autotest_16107/build.log 01:02:56.682 ++ basename /var/jenkins/workspace/autotest-per-patch_6/rocky9-vg-autotest_16107 01:02:56.682 + job_name=rocky9-vg-autotest_16107 01:02:56.682 + start_pattern='Backtrace start' 01:02:56.682 + end_pattern='Backtrace end' 01:02:56.682 + [[ -f /var/jenkins/workspace/autotest-per-patch_6/rocky9-vg-autotest_16107/build.log ]] 01:02:56.682 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_6/rocky9-vg-autotest_16107/build.log 01:02:56.682 + backtraces= 01:02:56.682 + [[ -n '' ]] 01:02:56.682 + for build in "${build_log_list[@]}" 01:02:56.682 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_6/doc-docker-autotest_22340/build.log 01:02:56.682 + local build_log job_name start_pattern end_pattern backtraces 01:02:56.682 + build_log=/var/jenkins/workspace/autotest-per-patch_6/doc-docker-autotest_22340/build.log 01:02:56.682 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/doc-docker-autotest_22340/build.log 01:02:56.682 ++ basename /var/jenkins/workspace/autotest-per-patch_6/doc-docker-autotest_22340 01:02:56.682 + job_name=doc-docker-autotest_22340 01:02:56.682 + start_pattern='Backtrace start' 01:02:56.682 + end_pattern='Backtrace end' 01:02:56.682 + [[ -f /var/jenkins/workspace/autotest-per-patch_6/doc-docker-autotest_22340/build.log ]] 01:02:56.682 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_6/doc-docker-autotest_22340/build.log 01:02:56.682 + backtraces= 01:02:56.682 + [[ -n '' ]] 01:02:56.682 + for build in "${build_log_list[@]}" 01:02:56.682 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_6/unittest-clang-docker-autotest_19877/build.log 01:02:56.682 + local build_log job_name start_pattern end_pattern backtraces 01:02:56.682 + build_log=/var/jenkins/workspace/autotest-per-patch_6/unittest-clang-docker-autotest_19877/build.log 01:02:56.682 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/unittest-clang-docker-autotest_19877/build.log 01:02:56.682 ++ basename /var/jenkins/workspace/autotest-per-patch_6/unittest-clang-docker-autotest_19877 01:02:56.682 + job_name=unittest-clang-docker-autotest_19877 01:02:56.682 + start_pattern='Backtrace start' 01:02:56.682 + end_pattern='Backtrace end' 01:02:56.682 + [[ -f /var/jenkins/workspace/autotest-per-patch_6/unittest-clang-docker-autotest_19877/build.log ]] 01:02:56.682 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_6/unittest-clang-docker-autotest_19877/build.log 01:02:56.682 + backtraces= 01:02:56.682 + [[ -n '' ]] 01:02:56.682 + for build in "${build_log_list[@]}" 01:02:56.682 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_6/crypto-phy-autotest_26217/build.log 01:02:56.682 + local build_log job_name start_pattern end_pattern backtraces 01:02:56.682 + build_log=/var/jenkins/workspace/autotest-per-patch_6/crypto-phy-autotest_26217/build.log 01:02:56.682 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/crypto-phy-autotest_26217/build.log 01:02:56.682 ++ basename /var/jenkins/workspace/autotest-per-patch_6/crypto-phy-autotest_26217 01:02:56.682 + job_name=crypto-phy-autotest_26217 01:02:56.682 + start_pattern='Backtrace start' 01:02:56.682 + end_pattern='Backtrace end' 01:02:56.682 + [[ -f /var/jenkins/workspace/autotest-per-patch_6/crypto-phy-autotest_26217/build.log ]] 01:02:56.682 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_6/crypto-phy-autotest_26217/build.log 01:02:56.945 + backtraces= 01:02:56.945 + [[ -n '' ]] 01:02:56.945 + for build in "${build_log_list[@]}" 01:02:56.945 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_6/iscsi-uring-vg-autotest_77402/build.log 01:02:56.945 + local build_log job_name start_pattern end_pattern backtraces 01:02:56.945 + build_log=/var/jenkins/workspace/autotest-per-patch_6/iscsi-uring-vg-autotest_77402/build.log 01:02:56.945 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/iscsi-uring-vg-autotest_77402/build.log 01:02:56.945 ++ basename /var/jenkins/workspace/autotest-per-patch_6/iscsi-uring-vg-autotest_77402 01:02:56.945 + job_name=iscsi-uring-vg-autotest_77402 01:02:56.945 + start_pattern='Backtrace start' 01:02:56.945 + end_pattern='Backtrace end' 01:02:56.945 + [[ -f /var/jenkins/workspace/autotest-per-patch_6/iscsi-uring-vg-autotest_77402/build.log ]] 01:02:56.945 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_6/iscsi-uring-vg-autotest_77402/build.log 01:02:56.945 + backtraces= 01:02:56.945 + [[ -n '' ]] 01:02:56.945 + for build in "${build_log_list[@]}" 01:02:56.945 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_6/iscsi-vg-autotest_77535/build.log 01:02:56.945 + local build_log job_name start_pattern end_pattern backtraces 01:02:56.945 + build_log=/var/jenkins/workspace/autotest-per-patch_6/iscsi-vg-autotest_77535/build.log 01:02:56.945 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/iscsi-vg-autotest_77535/build.log 01:02:56.945 ++ basename /var/jenkins/workspace/autotest-per-patch_6/iscsi-vg-autotest_77535 01:02:56.945 + job_name=iscsi-vg-autotest_77535 01:02:56.945 + start_pattern='Backtrace start' 01:02:56.945 + end_pattern='Backtrace end' 01:02:56.945 + [[ -f /var/jenkins/workspace/autotest-per-patch_6/iscsi-vg-autotest_77535/build.log ]] 01:02:56.945 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_6/iscsi-vg-autotest_77535/build.log 01:02:56.945 + backtraces= 01:02:56.945 + [[ -n '' ]] 01:02:56.945 + for build in "${build_log_list[@]}" 01:02:56.945 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_6/zns-vg-autotest_76603/build.log 01:02:56.945 + local build_log job_name start_pattern end_pattern backtraces 01:02:56.945 + build_log=/var/jenkins/workspace/autotest-per-patch_6/zns-vg-autotest_76603/build.log 01:02:56.945 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/zns-vg-autotest_76603/build.log 01:02:56.945 ++ basename /var/jenkins/workspace/autotest-per-patch_6/zns-vg-autotest_76603 01:02:56.945 + job_name=zns-vg-autotest_76603 01:02:56.945 + start_pattern='Backtrace start' 01:02:56.945 + end_pattern='Backtrace end' 01:02:56.945 + [[ -f /var/jenkins/workspace/autotest-per-patch_6/zns-vg-autotest_76603/build.log ]] 01:02:56.945 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_6/zns-vg-autotest_76603/build.log 01:02:56.945 + backtraces= 01:02:56.945 + [[ -n '' ]] 01:02:56.945 + for build in "${build_log_list[@]}" 01:02:56.945 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_6/check-so-deps-docker-autotest_22173/build.log 01:02:56.945 + local build_log job_name start_pattern end_pattern backtraces 01:02:56.945 + build_log=/var/jenkins/workspace/autotest-per-patch_6/check-so-deps-docker-autotest_22173/build.log 01:02:56.945 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/check-so-deps-docker-autotest_22173/build.log 01:02:56.945 ++ basename /var/jenkins/workspace/autotest-per-patch_6/check-so-deps-docker-autotest_22173 01:02:56.945 + job_name=check-so-deps-docker-autotest_22173 01:02:56.945 + start_pattern='Backtrace start' 01:02:56.945 + end_pattern='Backtrace end' 01:02:56.945 + [[ -f /var/jenkins/workspace/autotest-per-patch_6/check-so-deps-docker-autotest_22173/build.log ]] 01:02:56.945 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_6/check-so-deps-docker-autotest_22173/build.log 01:02:56.945 + backtraces= 01:02:56.945 + [[ -n '' ]] 01:02:56.945 + for build in "${build_log_list[@]}" 01:02:56.945 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_6/scan-build-docker-autotest_19880/build.log 01:02:56.945 + local build_log job_name start_pattern end_pattern backtraces 01:02:56.945 + build_log=/var/jenkins/workspace/autotest-per-patch_6/scan-build-docker-autotest_19880/build.log 01:02:56.945 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/scan-build-docker-autotest_19880/build.log 01:02:56.945 ++ basename /var/jenkins/workspace/autotest-per-patch_6/scan-build-docker-autotest_19880 01:02:56.945 + job_name=scan-build-docker-autotest_19880 01:02:56.945 + start_pattern='Backtrace start' 01:02:56.945 + end_pattern='Backtrace end' 01:02:56.945 + [[ -f /var/jenkins/workspace/autotest-per-patch_6/scan-build-docker-autotest_19880/build.log ]] 01:02:56.945 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_6/scan-build-docker-autotest_19880/build.log 01:02:56.945 + backtraces= 01:02:56.945 + [[ -n '' ]] 01:02:56.945 + for build in "${build_log_list[@]}" 01:02:56.945 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_6/check-format-docker-autotest_22160/build.log 01:02:56.945 + local build_log job_name start_pattern end_pattern backtraces 01:02:56.945 + build_log=/var/jenkins/workspace/autotest-per-patch_6/check-format-docker-autotest_22160/build.log 01:02:56.945 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/check-format-docker-autotest_22160/build.log 01:02:56.945 ++ basename /var/jenkins/workspace/autotest-per-patch_6/check-format-docker-autotest_22160 01:02:56.945 + job_name=check-format-docker-autotest_22160 01:02:56.945 + start_pattern='Backtrace start' 01:02:56.945 + end_pattern='Backtrace end' 01:02:56.945 + [[ -f /var/jenkins/workspace/autotest-per-patch_6/check-format-docker-autotest_22160/build.log ]] 01:02:56.945 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_6/check-format-docker-autotest_22160/build.log 01:02:56.945 + backtraces= 01:02:56.945 + [[ -n '' ]] 01:02:56.945 + for build in "${build_log_list[@]}" 01:02:56.945 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-vg-autotest_77488/build.log 01:02:56.945 + local build_log job_name start_pattern end_pattern backtraces 01:02:56.945 + build_log=/var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-vg-autotest_77488/build.log 01:02:56.945 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-vg-autotest_77488/build.log 01:02:56.945 ++ basename /var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-vg-autotest_77488 01:02:56.945 + job_name=nvmf-tcp-vg-autotest_77488 01:02:56.945 + start_pattern='Backtrace start' 01:02:56.945 + end_pattern='Backtrace end' 01:02:56.945 + [[ -f /var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-vg-autotest_77488/build.log ]] 01:02:56.945 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-vg-autotest_77488/build.log 01:02:56.945 + backtraces= 01:02:56.945 + [[ -n '' ]] 01:02:56.945 + for build in "${build_log_list[@]}" 01:02:56.945 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_6/nvme-phy-autotest_72389/build.log 01:02:56.945 + local build_log job_name start_pattern end_pattern backtraces 01:02:56.945 + build_log=/var/jenkins/workspace/autotest-per-patch_6/nvme-phy-autotest_72389/build.log 01:02:56.945 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/nvme-phy-autotest_72389/build.log 01:02:56.945 ++ basename /var/jenkins/workspace/autotest-per-patch_6/nvme-phy-autotest_72389 01:02:56.945 + job_name=nvme-phy-autotest_72389 01:02:56.945 + start_pattern='Backtrace start' 01:02:56.945 + end_pattern='Backtrace end' 01:02:56.945 + [[ -f /var/jenkins/workspace/autotest-per-patch_6/nvme-phy-autotest_72389/build.log ]] 01:02:56.945 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_6/nvme-phy-autotest_72389/build.log 01:02:56.945 + backtraces= 01:02:56.945 + [[ -n '' ]] 01:02:56.945 + for build in "${build_log_list[@]}" 01:02:56.945 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_6/freebsd-vg-autotest_59140/build.log 01:02:56.945 + local build_log job_name start_pattern end_pattern backtraces 01:02:56.945 + build_log=/var/jenkins/workspace/autotest-per-patch_6/freebsd-vg-autotest_59140/build.log 01:02:56.945 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/freebsd-vg-autotest_59140/build.log 01:02:56.945 ++ basename /var/jenkins/workspace/autotest-per-patch_6/freebsd-vg-autotest_59140 01:02:56.945 + job_name=freebsd-vg-autotest_59140 01:02:56.945 + start_pattern='Backtrace start' 01:02:56.945 + end_pattern='Backtrace end' 01:02:56.945 + [[ -f /var/jenkins/workspace/autotest-per-patch_6/freebsd-vg-autotest_59140/build.log ]] 01:02:56.945 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_6/freebsd-vg-autotest_59140/build.log 01:02:56.945 + backtraces= 01:02:56.945 + [[ -n '' ]] 01:02:56.945 + for build in "${build_log_list[@]}" 01:02:56.945 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-phy-autotest_72348/build.log 01:02:56.945 + local build_log job_name start_pattern end_pattern backtraces 01:02:56.945 + build_log=/var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-phy-autotest_72348/build.log 01:02:56.945 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-phy-autotest_72348/build.log 01:02:56.946 ++ basename /var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-phy-autotest_72348 01:02:56.946 + job_name=nvmf-tcp-phy-autotest_72348 01:02:56.946 + start_pattern='Backtrace start' 01:02:56.946 + end_pattern='Backtrace end' 01:02:56.946 + [[ -f /var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-phy-autotest_72348/build.log ]] 01:02:56.946 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-phy-autotest_72348/build.log 01:02:56.946 + backtraces= 01:02:56.946 + [[ -n '' ]] 01:02:56.946 + for build in "${build_log_list[@]}" 01:02:56.946 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_6/lvol-vg-autotest_77446/build.log 01:02:56.946 + local build_log job_name start_pattern end_pattern backtraces 01:02:56.946 + build_log=/var/jenkins/workspace/autotest-per-patch_6/lvol-vg-autotest_77446/build.log 01:02:56.946 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/lvol-vg-autotest_77446/build.log 01:02:56.946 ++ basename /var/jenkins/workspace/autotest-per-patch_6/lvol-vg-autotest_77446 01:02:56.946 + job_name=lvol-vg-autotest_77446 01:02:56.946 + start_pattern='Backtrace start' 01:02:56.946 + end_pattern='Backtrace end' 01:02:56.946 + [[ -f /var/jenkins/workspace/autotest-per-patch_6/lvol-vg-autotest_77446/build.log ]] 01:02:56.946 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_6/lvol-vg-autotest_77446/build.log 01:02:56.946 + backtraces= 01:02:56.946 + [[ -n '' ]] 01:02:56.946 + for build in "${build_log_list[@]}" 01:02:56.946 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_6/build-files-docker-autotest_22149/build.log 01:02:56.946 + local build_log job_name start_pattern end_pattern backtraces 01:02:56.946 + build_log=/var/jenkins/workspace/autotest-per-patch_6/build-files-docker-autotest_22149/build.log 01:02:56.946 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/build-files-docker-autotest_22149/build.log 01:02:56.946 ++ basename /var/jenkins/workspace/autotest-per-patch_6/build-files-docker-autotest_22149 01:02:56.946 + job_name=build-files-docker-autotest_22149 01:02:56.946 + start_pattern='Backtrace start' 01:02:56.946 + end_pattern='Backtrace end' 01:02:56.946 + [[ -f /var/jenkins/workspace/autotest-per-patch_6/build-files-docker-autotest_22149/build.log ]] 01:02:56.946 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_6/build-files-docker-autotest_22149/build.log 01:02:56.946 + backtraces= 01:02:56.946 + [[ -n '' ]] 01:02:56.946 + for build in "${build_log_list[@]}" 01:02:56.946 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_6/centos7-vg-autotest_73676/build.log 01:02:56.946 + local build_log job_name start_pattern end_pattern backtraces 01:02:56.946 + build_log=/var/jenkins/workspace/autotest-per-patch_6/centos7-vg-autotest_73676/build.log 01:02:56.946 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/centos7-vg-autotest_73676/build.log 01:02:56.946 ++ basename /var/jenkins/workspace/autotest-per-patch_6/centos7-vg-autotest_73676 01:02:56.946 + job_name=centos7-vg-autotest_73676 01:02:56.946 + start_pattern='Backtrace start' 01:02:56.946 + end_pattern='Backtrace end' 01:02:56.946 + [[ -f /var/jenkins/workspace/autotest-per-patch_6/centos7-vg-autotest_73676/build.log ]] 01:02:56.946 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_6/centos7-vg-autotest_73676/build.log 01:02:56.946 + backtraces= 01:02:56.946 + [[ -n '' ]] 01:02:56.946 + for build in "${build_log_list[@]}" 01:02:56.946 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_6/nvme-vg-autotest_77497/build.log 01:02:56.946 + local build_log job_name start_pattern end_pattern backtraces 01:02:56.946 + build_log=/var/jenkins/workspace/autotest-per-patch_6/nvme-vg-autotest_77497/build.log 01:02:56.946 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/nvme-vg-autotest_77497/build.log 01:02:56.946 ++ basename /var/jenkins/workspace/autotest-per-patch_6/nvme-vg-autotest_77497 01:02:56.946 + job_name=nvme-vg-autotest_77497 01:02:56.946 + start_pattern='Backtrace start' 01:02:56.946 + end_pattern='Backtrace end' 01:02:56.946 + [[ -f /var/jenkins/workspace/autotest-per-patch_6/nvme-vg-autotest_77497/build.log ]] 01:02:56.946 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_6/nvme-vg-autotest_77497/build.log 01:02:56.946 + backtraces='00:21:25.817 10:42:09 sw_hotplug -- common/autotest_common.sh@715 -- # time='\''========== Backtrace start: ========== 01:02:56.946 00:21:25.817 01:02:56.946 00:21:25.817 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:02:56.946 00:21:25.817 ... 01:02:56.946 00:21:25.817 710 01:02:56.946 00:21:25.817 711 # We redirect cmd'\''\'\'''\''s std{out,err} to a separate fd dup'\''\'\'''\''ed to stdin'\''\'\'''\''s device (or /dev/null) to 01:02:56.946 00:21:25.817 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 01:02:56.946 00:21:25.817 713 # but $() will return just the time'\''\'\'''\''s data, hence making it possible to just do: 01:02:56.946 00:21:25.817 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:02:56.946 00:21:25.817 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:02:56.946 00:21:25.817 716 01:02:56.946 00:21:25.817 717 echo "$time" 01:02:56.946 00:21:25.817 718 ) 01:02:56.946 00:21:25.817 719 01:02:56.946 00:21:25.817 720 function timing_enter() { 01:02:56.946 00:21:25.817 ... 01:02:56.946 00:21:25.817 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:02:56.946 00:21:25.817 ... 01:02:56.946 00:21:25.817 11 # Pci bus hotplug 01:02:56.946 00:21:25.817 12 # Helper function to remove/attach cotrollers 01:02:56.946 00:21:25.817 13 debug_remove_attach_helper() { 01:02:56.946 00:21:25.817 14 local helper_time=0 01:02:56.946 00:21:25.817 15 01:02:56.946 00:21:25.817 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:02:56.946 00:21:25.817 17 printf '\''\'\'''\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\''\'\'''\'' \ 01:02:56.946 00:21:25.817 18 "$helper_time" "$nvme_count" >&2 01:02:56.946 00:21:25.817 19 } 01:02:56.946 00:21:25.817 20 01:02:56.946 00:21:25.817 21 remove_attach_helper() { 01:02:56.946 00:21:25.817 ... 01:02:56.946 00:21:25.817 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:02:56.946 00:21:25.817 ... 01:02:56.946 00:21:25.817 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:02:56.946 00:21:25.817 106 done 01:02:56.946 00:21:25.817 107 01:02:56.946 00:21:25.817 108 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.946 00:21:25.817 109 01:02:56.946 00:21:25.817 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.946 00:21:25.817 111 # Verify reregistering hotplug poller 01:02:56.946 00:21:25.817 112 rpc_cmd bdev_nvme_set_hotplug -d 01:02:56.946 00:21:25.817 113 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.946 00:21:25.817 114 01:02:56.946 00:21:25.817 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.946 00:21:25.817 ... 01:02:56.946 00:21:25.817 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:02:56.946 00:21:25.817 ... 01:02:56.946 00:21:25.817 133 01:02:56.946 00:21:25.817 134 # Run pci bus hotplug test 01:02:56.946 00:21:25.817 135 run_hotplug 01:02:56.946 00:21:25.817 136 01:02:56.946 00:21:25.817 137 # Run SPDK target based hotplug 01:02:56.946 00:21:25.817 => 138 tgt_run_hotplug 01:02:56.946 00:21:25.817 ... 01:02:56.946 00:21:25.817 01:02:56.946 00:21:25.817 ========== Backtrace end =========='\'' 01:02:56.946 00:21:25.818 ========== Backtrace start: ========== 01:02:56.946 00:21:25.818 01:02:56.946 00:21:25.818 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:02:56.946 00:21:25.818 ... 01:02:56.946 00:21:25.818 710 01:02:56.946 00:21:25.818 711 # We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to 01:02:56.946 00:21:25.818 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 01:02:56.946 00:21:25.818 713 # but $() will return just the time'\''s data, hence making it possible to just do: 01:02:56.946 00:21:25.818 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:02:56.946 00:21:25.818 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:02:56.946 00:21:25.818 716 01:02:56.946 00:21:25.818 717 echo "$time" 01:02:56.946 00:21:25.818 718 ) 01:02:56.946 00:21:25.818 719 01:02:56.946 00:21:25.818 720 function timing_enter() { 01:02:56.946 00:21:25.818 ... 01:02:56.946 00:21:25.818 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:02:56.946 00:21:25.818 ... 01:02:56.946 00:21:25.818 11 # Pci bus hotplug 01:02:56.946 00:21:25.818 12 # Helper function to remove/attach cotrollers 01:02:56.946 00:21:25.818 13 debug_remove_attach_helper() { 01:02:56.946 00:21:25.818 14 local helper_time=0 01:02:56.946 00:21:25.818 15 01:02:56.946 00:21:25.818 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:02:56.946 00:21:25.818 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:02:56.946 00:21:25.818 18 "$helper_time" "$nvme_count" >&2 01:02:56.946 00:21:25.818 19 } 01:02:56.946 00:21:25.818 20 01:02:56.946 00:21:25.818 21 remove_attach_helper() { 01:02:56.946 00:21:25.818 ... 01:02:56.946 00:21:25.818 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:02:56.946 00:21:25.818 ... 01:02:56.946 00:21:25.818 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:02:56.946 00:21:25.818 106 done 01:02:56.946 00:21:25.818 107 01:02:56.946 00:21:25.818 108 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.946 00:21:25.818 109 01:02:56.946 00:21:25.818 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.946 00:21:25.818 111 # Verify reregistering hotplug poller 01:02:56.946 00:21:25.818 112 rpc_cmd bdev_nvme_set_hotplug -d 01:02:56.946 00:21:25.818 113 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.946 00:21:25.818 114 01:02:56.946 00:21:25.818 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.946 00:21:25.818 ... 01:02:56.946 00:21:25.818 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:02:56.946 00:21:25.818 ... 01:02:56.947 00:21:25.818 133 01:02:56.947 00:21:25.818 134 # Run pci bus hotplug test 01:02:56.947 00:21:25.818 135 run_hotplug 01:02:56.947 00:21:25.818 136 01:02:56.947 00:21:25.818 137 # Run SPDK target based hotplug 01:02:56.947 00:21:25.818 => 138 tgt_run_hotplug 01:02:56.947 00:21:25.818 ... 01:02:56.947 00:21:25.818 01:02:56.947 00:21:25.818 ========== Backtrace end ========== 01:02:56.947 00:21:25.818 ========== Backtrace start: ========== 01:02:56.947 00:21:25.818 01:02:56.947 00:21:25.818 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:02:56.947 00:21:25.818 ... 01:02:56.947 00:21:25.818 713 # but $() will return just the time'\''s data, hence making it possible to just do: 01:02:56.947 00:21:25.818 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:02:56.947 00:21:25.818 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:02:56.947 00:21:25.818 716 01:02:56.947 00:21:25.818 717 echo "$time" 01:02:56.947 00:21:25.818 => 718 ) 01:02:56.947 00:21:25.818 719 01:02:56.947 00:21:25.818 720 function timing_enter() { 01:02:56.947 00:21:25.818 721 xtrace_disable 01:02:56.947 00:21:25.818 722 timing "enter" "$1" 01:02:56.947 00:21:25.818 723 xtrace_restore 01:02:56.947 00:21:25.818 ... 01:02:56.947 00:21:25.818 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:02:56.947 00:21:25.818 ... 01:02:56.947 00:21:25.818 11 # Pci bus hotplug 01:02:56.947 00:21:25.818 12 # Helper function to remove/attach cotrollers 01:02:56.947 00:21:25.818 13 debug_remove_attach_helper() { 01:02:56.947 00:21:25.818 14 local helper_time=0 01:02:56.947 00:21:25.818 15 01:02:56.947 00:21:25.818 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:02:56.947 00:21:25.818 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:02:56.947 00:21:25.818 18 "$helper_time" "$nvme_count" >&2 01:02:56.947 00:21:25.818 19 } 01:02:56.947 00:21:25.818 20 01:02:56.947 00:21:25.818 21 remove_attach_helper() { 01:02:56.947 00:21:25.818 ... 01:02:56.947 00:21:25.818 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:02:56.947 00:21:25.818 ... 01:02:56.947 00:21:25.818 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:02:56.947 00:21:25.818 106 done 01:02:56.947 00:21:25.818 107 01:02:56.947 00:21:25.818 108 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.947 00:21:25.818 109 01:02:56.947 00:21:25.818 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.947 00:21:25.818 111 # Verify reregistering hotplug poller 01:02:56.947 00:21:25.818 112 rpc_cmd bdev_nvme_set_hotplug -d 01:02:56.947 00:21:25.818 113 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.947 00:21:25.818 114 01:02:56.947 00:21:25.818 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.947 00:21:25.818 ... 01:02:56.947 00:21:25.818 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:02:56.947 00:21:25.818 ... 01:02:56.947 00:21:25.818 133 01:02:56.947 00:21:25.818 134 # Run pci bus hotplug test 01:02:56.947 00:21:25.818 135 run_hotplug 01:02:56.947 00:21:25.818 136 01:02:56.947 00:21:25.818 137 # Run SPDK target based hotplug 01:02:56.947 00:21:25.818 => 138 tgt_run_hotplug 01:02:56.947 00:21:25.818 ... 01:02:56.947 00:21:25.818 01:02:56.947 00:21:25.818 ========== Backtrace end ========== 01:02:56.947 00:21:25.818 ========== Backtrace start: ========== 01:02:56.947 00:21:25.818 01:02:56.947 00:21:25.818 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:02:56.947 00:21:25.818 ... 01:02:56.947 00:21:25.818 11 # Pci bus hotplug 01:02:56.947 00:21:25.818 12 # Helper function to remove/attach cotrollers 01:02:56.947 00:21:25.818 13 debug_remove_attach_helper() { 01:02:56.947 00:21:25.818 14 local helper_time=0 01:02:56.947 00:21:25.818 15 01:02:56.947 00:21:25.818 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:02:56.947 00:21:25.818 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:02:56.947 00:21:25.818 18 "$helper_time" "$nvme_count" >&2 01:02:56.947 00:21:25.818 19 } 01:02:56.947 00:21:25.818 20 01:02:56.947 00:21:25.818 21 remove_attach_helper() { 01:02:56.947 00:21:25.818 ... 01:02:56.947 00:21:25.818 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:02:56.947 00:21:25.818 ... 01:02:56.947 00:21:25.818 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:02:56.947 00:21:25.818 106 done 01:02:56.947 00:21:25.818 107 01:02:56.947 00:21:25.818 108 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.947 00:21:25.818 109 01:02:56.947 00:21:25.818 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.947 00:21:25.818 111 # Verify reregistering hotplug poller 01:02:56.947 00:21:25.818 112 rpc_cmd bdev_nvme_set_hotplug -d 01:02:56.947 00:21:25.818 113 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.947 00:21:25.818 114 01:02:56.947 00:21:25.818 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.947 00:21:25.818 ... 01:02:56.947 00:21:25.818 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:02:56.947 00:21:25.818 ... 01:02:56.947 00:21:25.818 133 01:02:56.947 00:21:25.818 134 # Run pci bus hotplug test 01:02:56.947 00:21:25.818 135 run_hotplug 01:02:56.947 00:21:25.818 136 01:02:56.947 00:21:25.818 137 # Run SPDK target based hotplug 01:02:56.947 00:21:25.818 => 138 tgt_run_hotplug 01:02:56.947 00:21:25.818 ... 01:02:56.947 00:21:25.818 01:02:56.947 00:21:25.818 ========== Backtrace end ========== 01:02:56.947 00:21:27.976 ========== Backtrace start: ========== 01:02:56.947 00:21:27.976 01:02:56.947 00:21:27.976 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh"]) 01:02:56.947 00:21:27.976 ... 01:02:56.947 00:21:27.976 1117 timing_enter $test_name 01:02:56.947 00:21:27.976 1118 echo "************************************" 01:02:56.947 00:21:27.976 1119 echo "START TEST $test_name" 01:02:56.947 00:21:27.976 1120 echo "************************************" 01:02:56.947 00:21:27.976 1121 xtrace_restore 01:02:56.947 00:21:27.976 1122 time "$@" 01:02:56.947 00:21:27.976 1123 xtrace_disable 01:02:56.947 00:21:27.976 1124 echo "************************************" 01:02:56.947 00:21:27.976 1125 echo "END TEST $test_name" 01:02:56.947 00:21:27.976 1126 echo "************************************" 01:02:56.947 00:21:27.976 1127 timing_exit $test_name 01:02:56.947 00:21:27.976 ... 01:02:56.947 00:21:27.976 in /home/vagrant/spdk_repo/spdk/autotest.sh:240 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 01:02:56.947 00:21:27.976 ... 01:02:56.947 00:21:27.976 235 01:02:56.947 00:21:27.976 236 run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh 01:02:56.947 00:21:27.976 237 run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh 01:02:56.947 00:21:27.976 238 01:02:56.947 00:21:27.976 239 if [ $(uname -s) = Linux ]; then 01:02:56.947 00:21:27.976 => 240 run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh 01:02:56.947 00:21:27.976 241 fi 01:02:56.947 00:21:27.976 242 01:02:56.947 00:21:27.976 243 if [[ $SPDK_TEST_XNVME -eq 1 ]]; then 01:02:56.947 00:21:27.976 244 run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh 01:02:56.947 00:21:27.976 245 run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme" 01:02:56.947 00:21:27.976 ... 01:02:56.947 00:21:27.976 01:02:56.947 00:21:27.976 ========== Backtrace end ==========' 01:02:56.947 + [[ -n 00:21:25.817 10:42:09 sw_hotplug -- common/autotest_common.sh@715 -- # time='========== Backtrace start: ========== 01:02:56.947 00:21:25.817 01:02:56.947 00:21:25.817 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:02:56.947 00:21:25.817 ... 01:02:56.947 00:21:25.817 710 01:02:56.947 00:21:25.817 711 # We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to 01:02:56.947 00:21:25.817 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 01:02:56.947 00:21:25.817 713 # but $() will return just the time'\''s data, hence making it possible to just do: 01:02:56.947 00:21:25.817 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:02:56.947 00:21:25.817 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:02:56.947 00:21:25.817 716 01:02:56.947 00:21:25.817 717 echo "$time" 01:02:56.947 00:21:25.817 718 ) 01:02:56.947 00:21:25.817 719 01:02:56.947 00:21:25.817 720 function timing_enter() { 01:02:56.947 00:21:25.817 ... 01:02:56.947 00:21:25.817 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:02:56.947 00:21:25.817 ... 01:02:56.947 00:21:25.817 11 # Pci bus hotplug 01:02:56.947 00:21:25.817 12 # Helper function to remove/attach cotrollers 01:02:56.947 00:21:25.817 13 debug_remove_attach_helper() { 01:02:56.947 00:21:25.817 14 local helper_time=0 01:02:56.947 00:21:25.817 15 01:02:56.947 00:21:25.817 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:02:56.947 00:21:25.817 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:02:56.947 00:21:25.817 18 "$helper_time" "$nvme_count" >&2 01:02:56.947 00:21:25.817 19 } 01:02:56.947 00:21:25.817 20 01:02:56.947 00:21:25.817 21 remove_attach_helper() { 01:02:56.947 00:21:25.817 ... 01:02:56.947 00:21:25.817 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:02:56.947 00:21:25.817 ... 01:02:56.947 00:21:25.817 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:02:56.947 00:21:25.817 106 done 01:02:56.947 00:21:25.817 107 01:02:56.947 00:21:25.817 108 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.947 00:21:25.817 109 01:02:56.947 00:21:25.817 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.947 00:21:25.817 111 # Verify reregistering hotplug poller 01:02:56.947 00:21:25.817 112 rpc_cmd bdev_nvme_set_hotplug -d 01:02:56.947 00:21:25.817 113 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.947 00:21:25.817 114 01:02:56.947 00:21:25.817 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.947 00:21:25.817 ... 01:02:56.947 00:21:25.817 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:02:56.948 00:21:25.817 ... 01:02:56.948 00:21:25.817 133 01:02:56.948 00:21:25.817 134 # Run pci bus hotplug test 01:02:56.948 00:21:25.817 135 run_hotplug 01:02:56.948 00:21:25.817 136 01:02:56.948 00:21:25.817 137 # Run SPDK target based hotplug 01:02:56.948 00:21:25.817 => 138 tgt_run_hotplug 01:02:56.948 00:21:25.817 ... 01:02:56.948 00:21:25.817 01:02:56.948 00:21:25.817 ========== Backtrace end ==========' 01:02:56.948 00:21:25.818 ========== Backtrace start: ========== 01:02:56.948 00:21:25.818 01:02:56.948 00:21:25.818 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:02:56.948 00:21:25.818 ... 01:02:56.948 00:21:25.818 710 01:02:56.948 00:21:25.818 711 # We redirect cmd's std{out,err} to a separate fd dup'ed to stdin's device (or /dev/null) to 01:02:56.948 00:21:25.818 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 01:02:56.948 00:21:25.818 713 # but $() will return just the time's data, hence making it possible to just do: 01:02:56.948 00:21:25.818 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:02:56.948 00:21:25.818 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:02:56.948 00:21:25.818 716 01:02:56.948 00:21:25.818 717 echo "$time" 01:02:56.948 00:21:25.818 718 ) 01:02:56.948 00:21:25.818 719 01:02:56.948 00:21:25.818 720 function timing_enter() { 01:02:56.948 00:21:25.818 ... 01:02:56.948 00:21:25.818 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:02:56.948 00:21:25.818 ... 01:02:56.948 00:21:25.818 11 # Pci bus hotplug 01:02:56.948 00:21:25.818 12 # Helper function to remove/attach cotrollers 01:02:56.948 00:21:25.818 13 debug_remove_attach_helper() { 01:02:56.948 00:21:25.818 14 local helper_time=0 01:02:56.948 00:21:25.818 15 01:02:56.948 00:21:25.818 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:02:56.948 00:21:25.818 17 printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \ 01:02:56.948 00:21:25.818 18 "$helper_time" "$nvme_count" >&2 01:02:56.948 00:21:25.818 19 } 01:02:56.948 00:21:25.818 20 01:02:56.948 00:21:25.818 21 remove_attach_helper() { 01:02:56.948 00:21:25.818 ... 01:02:56.948 00:21:25.818 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:02:56.948 00:21:25.818 ... 01:02:56.948 00:21:25.818 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:02:56.948 00:21:25.818 106 done 01:02:56.948 00:21:25.818 107 01:02:56.948 00:21:25.818 108 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.948 00:21:25.818 109 01:02:56.948 00:21:25.818 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.948 00:21:25.818 111 # Verify reregistering hotplug poller 01:02:56.948 00:21:25.818 112 rpc_cmd bdev_nvme_set_hotplug -d 01:02:56.948 00:21:25.818 113 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.948 00:21:25.818 114 01:02:56.948 00:21:25.818 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.948 00:21:25.818 ... 01:02:56.948 00:21:25.818 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:02:56.948 00:21:25.818 ... 01:02:56.948 00:21:25.818 133 01:02:56.948 00:21:25.818 134 # Run pci bus hotplug test 01:02:56.948 00:21:25.818 135 run_hotplug 01:02:56.948 00:21:25.818 136 01:02:56.948 00:21:25.818 137 # Run SPDK target based hotplug 01:02:56.948 00:21:25.818 => 138 tgt_run_hotplug 01:02:56.948 00:21:25.818 ... 01:02:56.948 00:21:25.818 01:02:56.948 00:21:25.818 ========== Backtrace end ========== 01:02:56.948 00:21:25.818 ========== Backtrace start: ========== 01:02:56.948 00:21:25.818 01:02:56.948 00:21:25.818 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:02:56.948 00:21:25.818 ... 01:02:56.948 00:21:25.818 713 # but $() will return just the time's data, hence making it possible to just do: 01:02:56.948 00:21:25.818 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:02:56.948 00:21:25.818 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:02:56.948 00:21:25.818 716 01:02:56.948 00:21:25.818 717 echo "$time" 01:02:56.948 00:21:25.818 => 718 ) 01:02:56.948 00:21:25.818 719 01:02:56.948 00:21:25.818 720 function timing_enter() { 01:02:56.948 00:21:25.818 721 xtrace_disable 01:02:56.948 00:21:25.818 722 timing "enter" "$1" 01:02:56.948 00:21:25.818 723 xtrace_restore 01:02:56.948 00:21:25.818 ... 01:02:56.948 00:21:25.818 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:02:56.948 00:21:25.818 ... 01:02:56.948 00:21:25.818 11 # Pci bus hotplug 01:02:56.948 00:21:25.818 12 # Helper function to remove/attach cotrollers 01:02:56.948 00:21:25.818 13 debug_remove_attach_helper() { 01:02:56.948 00:21:25.818 14 local helper_time=0 01:02:56.948 00:21:25.818 15 01:02:56.948 00:21:25.818 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:02:56.948 00:21:25.818 17 printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \ 01:02:56.948 00:21:25.818 18 "$helper_time" "$nvme_count" >&2 01:02:56.948 00:21:25.818 19 } 01:02:56.948 00:21:25.818 20 01:02:56.948 00:21:25.818 21 remove_attach_helper() { 01:02:56.948 00:21:25.818 ... 01:02:56.948 00:21:25.818 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:02:56.948 00:21:25.818 ... 01:02:56.948 00:21:25.818 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:02:56.948 00:21:25.818 106 done 01:02:56.948 00:21:25.818 107 01:02:56.948 00:21:25.818 108 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.948 00:21:25.818 109 01:02:56.948 00:21:25.818 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.948 00:21:25.818 111 # Verify reregistering hotplug poller 01:02:56.948 00:21:25.818 112 rpc_cmd bdev_nvme_set_hotplug -d 01:02:56.948 00:21:25.818 113 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.948 00:21:25.818 114 01:02:56.948 00:21:25.818 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.948 00:21:25.818 ... 01:02:56.948 00:21:25.818 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:02:56.948 00:21:25.818 ... 01:02:56.948 00:21:25.818 133 01:02:56.948 00:21:25.818 134 # Run pci bus hotplug test 01:02:56.948 00:21:25.818 135 run_hotplug 01:02:56.948 00:21:25.818 136 01:02:56.948 00:21:25.818 137 # Run SPDK target based hotplug 01:02:56.948 00:21:25.818 => 138 tgt_run_hotplug 01:02:56.948 00:21:25.818 ... 01:02:56.948 00:21:25.818 01:02:56.948 00:21:25.818 ========== Backtrace end ========== 01:02:56.948 00:21:25.818 ========== Backtrace start: ========== 01:02:56.948 00:21:25.818 01:02:56.948 00:21:25.818 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:02:56.948 00:21:25.818 ... 01:02:56.948 00:21:25.818 11 # Pci bus hotplug 01:02:56.948 00:21:25.818 12 # Helper function to remove/attach cotrollers 01:02:56.948 00:21:25.818 13 debug_remove_attach_helper() { 01:02:56.948 00:21:25.818 14 local helper_time=0 01:02:56.948 00:21:25.818 15 01:02:56.948 00:21:25.818 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:02:56.948 00:21:25.818 17 printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \ 01:02:56.948 00:21:25.818 18 "$helper_time" "$nvme_count" >&2 01:02:56.948 00:21:25.818 19 } 01:02:56.948 00:21:25.818 20 01:02:56.948 00:21:25.818 21 remove_attach_helper() { 01:02:56.948 00:21:25.818 ... 01:02:56.948 00:21:25.818 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:02:56.948 00:21:25.818 ... 01:02:56.948 00:21:25.818 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:02:56.948 00:21:25.818 106 done 01:02:56.948 00:21:25.818 107 01:02:56.948 00:21:25.818 108 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.948 00:21:25.818 109 01:02:56.948 00:21:25.818 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.948 00:21:25.818 111 # Verify reregistering hotplug poller 01:02:56.948 00:21:25.818 112 rpc_cmd bdev_nvme_set_hotplug -d 01:02:56.948 00:21:25.818 113 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.948 00:21:25.818 114 01:02:56.948 00:21:25.818 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.948 00:21:25.818 ... 01:02:56.948 00:21:25.818 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:02:56.948 00:21:25.818 ... 01:02:56.948 00:21:25.818 133 01:02:56.948 00:21:25.818 134 # Run pci bus hotplug test 01:02:56.948 00:21:25.818 135 run_hotplug 01:02:56.948 00:21:25.818 136 01:02:56.948 00:21:25.818 137 # Run SPDK target based hotplug 01:02:56.948 00:21:25.818 => 138 tgt_run_hotplug 01:02:56.948 00:21:25.818 ... 01:02:56.948 00:21:25.818 01:02:56.948 00:21:25.818 ========== Backtrace end ========== 01:02:56.948 00:21:27.976 ========== Backtrace start: ========== 01:02:56.948 00:21:27.976 01:02:56.948 00:21:27.976 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh"]) 01:02:56.948 00:21:27.976 ... 01:02:56.948 00:21:27.976 1117 timing_enter $test_name 01:02:56.948 00:21:27.976 1118 echo "************************************" 01:02:56.948 00:21:27.976 1119 echo "START TEST $test_name" 01:02:56.948 00:21:27.976 1120 echo "************************************" 01:02:56.948 00:21:27.976 1121 xtrace_restore 01:02:56.948 00:21:27.976 1122 time "$@" 01:02:56.948 00:21:27.976 1123 xtrace_disable 01:02:56.948 00:21:27.976 1124 echo "************************************" 01:02:56.948 00:21:27.976 1125 echo "END TEST $test_name" 01:02:56.949 00:21:27.976 1126 echo "************************************" 01:02:56.949 00:21:27.976 1127 timing_exit $test_name 01:02:56.949 00:21:27.976 ... 01:02:56.949 00:21:27.976 in /home/vagrant/spdk_repo/spdk/autotest.sh:240 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 01:02:56.949 00:21:27.976 ... 01:02:56.949 00:21:27.976 235 01:02:56.949 00:21:27.976 236 run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh 01:02:56.949 00:21:27.976 237 run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh 01:02:56.949 00:21:27.976 238 01:02:56.949 00:21:27.976 239 if [ $(uname -s) = Linux ]; then 01:02:56.949 00:21:27.976 => 240 run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh 01:02:56.949 00:21:27.976 241 fi 01:02:56.949 00:21:27.976 242 01:02:56.949 00:21:27.976 243 if [[ $SPDK_TEST_XNVME -eq 1 ]]; then 01:02:56.949 00:21:27.976 244 run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh 01:02:56.949 00:21:27.976 245 run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme" 01:02:56.949 00:21:27.976 ... 01:02:56.949 00:21:27.976 01:02:56.949 00:21:27.976 ========== Backtrace end ========== ]] 01:02:56.949 + echo '00:21:25.817 10:42:09 sw_hotplug -- common/autotest_common.sh@715 -- # time='\''========== Backtrace start: ========== 01:02:56.949 00:21:25.817 01:02:56.949 00:21:25.817 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:02:56.949 00:21:25.817 ... 01:02:56.949 00:21:25.817 710 01:02:56.949 00:21:25.817 711 # We redirect cmd'\''\'\'''\''s std{out,err} to a separate fd dup'\''\'\'''\''ed to stdin'\''\'\'''\''s device (or /dev/null) to 01:02:56.949 00:21:25.817 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 01:02:56.949 00:21:25.817 713 # but $() will return just the time'\''\'\'''\''s data, hence making it possible to just do: 01:02:56.949 00:21:25.817 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:02:56.949 00:21:25.817 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:02:56.949 00:21:25.817 716 01:02:56.949 00:21:25.817 717 echo "$time" 01:02:56.949 00:21:25.817 718 ) 01:02:56.949 00:21:25.817 719 01:02:56.949 00:21:25.817 720 function timing_enter() { 01:02:56.949 00:21:25.817 ... 01:02:56.949 00:21:25.817 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:02:56.949 00:21:25.817 ... 01:02:56.949 00:21:25.817 11 # Pci bus hotplug 01:02:56.949 00:21:25.817 12 # Helper function to remove/attach cotrollers 01:02:56.949 00:21:25.817 13 debug_remove_attach_helper() { 01:02:56.949 00:21:25.817 14 local helper_time=0 01:02:56.949 00:21:25.817 15 01:02:56.949 00:21:25.817 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:02:56.949 00:21:25.817 17 printf '\''\'\'''\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\''\'\'''\'' \ 01:02:56.949 00:21:25.817 18 "$helper_time" "$nvme_count" >&2 01:02:56.949 00:21:25.817 19 } 01:02:56.949 00:21:25.817 20 01:02:56.949 00:21:25.817 21 remove_attach_helper() { 01:02:56.949 00:21:25.817 ... 01:02:56.949 00:21:25.817 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:02:56.949 00:21:25.817 ... 01:02:56.949 00:21:25.817 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:02:56.949 00:21:25.817 106 done 01:02:56.949 00:21:25.817 107 01:02:56.949 00:21:25.817 108 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.949 00:21:25.817 109 01:02:56.949 00:21:25.817 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.949 00:21:25.817 111 # Verify reregistering hotplug poller 01:02:56.949 00:21:25.817 112 rpc_cmd bdev_nvme_set_hotplug -d 01:02:56.949 00:21:25.817 113 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.949 00:21:25.817 114 01:02:56.949 00:21:25.817 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.949 00:21:25.817 ... 01:02:56.949 00:21:25.817 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:02:56.949 00:21:25.817 ... 01:02:56.949 00:21:25.817 133 01:02:56.949 00:21:25.817 134 # Run pci bus hotplug test 01:02:56.949 00:21:25.817 135 run_hotplug 01:02:56.949 00:21:25.817 136 01:02:56.949 00:21:25.817 137 # Run SPDK target based hotplug 01:02:56.949 00:21:25.817 => 138 tgt_run_hotplug 01:02:56.949 00:21:25.817 ... 01:02:56.949 00:21:25.817 01:02:56.949 00:21:25.817 ========== Backtrace end =========='\'' 01:02:56.949 00:21:25.818 ========== Backtrace start: ========== 01:02:56.949 00:21:25.818 01:02:56.949 00:21:25.818 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:02:56.949 00:21:25.818 ... 01:02:56.949 00:21:25.818 710 01:02:56.949 00:21:25.818 711 # We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to 01:02:56.949 00:21:25.818 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 01:02:56.949 00:21:25.818 713 # but $() will return just the time'\''s data, hence making it possible to just do: 01:02:56.949 00:21:25.818 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:02:56.949 00:21:25.818 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:02:56.949 00:21:25.818 716 01:02:56.949 00:21:25.818 717 echo "$time" 01:02:56.949 00:21:25.818 718 ) 01:02:56.949 00:21:25.818 719 01:02:56.949 00:21:25.818 720 function timing_enter() { 01:02:56.949 00:21:25.818 ... 01:02:56.949 00:21:25.818 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:02:56.949 00:21:25.818 ... 01:02:56.949 00:21:25.818 11 # Pci bus hotplug 01:02:56.949 00:21:25.818 12 # Helper function to remove/attach cotrollers 01:02:56.949 00:21:25.818 13 debug_remove_attach_helper() { 01:02:56.949 00:21:25.818 14 local helper_time=0 01:02:56.949 00:21:25.818 15 01:02:56.949 00:21:25.818 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:02:56.949 00:21:25.818 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:02:56.949 00:21:25.818 18 "$helper_time" "$nvme_count" >&2 01:02:56.949 00:21:25.818 19 } 01:02:56.949 00:21:25.818 20 01:02:56.949 00:21:25.818 21 remove_attach_helper() { 01:02:56.949 00:21:25.818 ... 01:02:56.949 00:21:25.818 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:02:56.949 00:21:25.818 ... 01:02:56.949 00:21:25.818 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:02:56.949 00:21:25.818 106 done 01:02:56.949 00:21:25.818 107 01:02:56.949 00:21:25.818 108 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.949 00:21:25.818 109 01:02:56.949 00:21:25.818 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.949 00:21:25.818 111 # Verify reregistering hotplug poller 01:02:56.949 00:21:25.818 112 rpc_cmd bdev_nvme_set_hotplug -d 01:02:56.949 00:21:25.818 113 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.949 00:21:25.818 114 01:02:56.949 00:21:25.818 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.949 00:21:25.818 ... 01:02:56.949 00:21:25.818 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:02:56.949 00:21:25.818 ... 01:02:56.949 00:21:25.818 133 01:02:56.949 00:21:25.818 134 # Run pci bus hotplug test 01:02:56.949 00:21:25.818 135 run_hotplug 01:02:56.949 00:21:25.818 136 01:02:56.949 00:21:25.818 137 # Run SPDK target based hotplug 01:02:56.949 00:21:25.818 => 138 tgt_run_hotplug 01:02:56.949 00:21:25.818 ... 01:02:56.949 00:21:25.818 01:02:56.949 00:21:25.818 ========== Backtrace end ========== 01:02:56.949 00:21:25.818 ========== Backtrace start: ========== 01:02:56.949 00:21:25.818 01:02:56.949 00:21:25.818 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:02:56.949 00:21:25.818 ... 01:02:56.949 00:21:25.818 713 # but $() will return just the time'\''s data, hence making it possible to just do: 01:02:56.949 00:21:25.818 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:02:56.949 00:21:25.818 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:02:56.949 00:21:25.818 716 01:02:56.949 00:21:25.818 717 echo "$time" 01:02:56.949 00:21:25.818 => 718 ) 01:02:56.949 00:21:25.818 719 01:02:56.949 00:21:25.818 720 function timing_enter() { 01:02:56.949 00:21:25.818 721 xtrace_disable 01:02:56.949 00:21:25.818 722 timing "enter" "$1" 01:02:56.949 00:21:25.818 723 xtrace_restore 01:02:56.949 00:21:25.818 ... 01:02:56.949 00:21:25.818 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:02:56.949 00:21:25.818 ... 01:02:56.949 00:21:25.818 11 # Pci bus hotplug 01:02:56.949 00:21:25.818 12 # Helper function to remove/attach cotrollers 01:02:56.949 00:21:25.818 13 debug_remove_attach_helper() { 01:02:56.949 00:21:25.818 14 local helper_time=0 01:02:56.949 00:21:25.818 15 01:02:56.949 00:21:25.818 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:02:56.949 00:21:25.818 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:02:56.949 00:21:25.818 18 "$helper_time" "$nvme_count" >&2 01:02:56.949 00:21:25.818 19 } 01:02:56.949 00:21:25.818 20 01:02:56.949 00:21:25.818 21 remove_attach_helper() { 01:02:56.949 00:21:25.818 ... 01:02:56.949 00:21:25.818 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:02:56.949 00:21:25.818 ... 01:02:56.949 00:21:25.818 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:02:56.949 00:21:25.818 106 done 01:02:56.949 00:21:25.818 107 01:02:56.949 00:21:25.818 108 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.949 00:21:25.818 109 01:02:56.949 00:21:25.818 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.949 00:21:25.818 111 # Verify reregistering hotplug poller 01:02:56.949 00:21:25.818 112 rpc_cmd bdev_nvme_set_hotplug -d 01:02:56.949 00:21:25.818 113 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.949 00:21:25.818 114 01:02:56.949 00:21:25.818 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.949 00:21:25.818 ... 01:02:56.950 00:21:25.818 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:02:56.950 00:21:25.818 ... 01:02:56.950 00:21:25.818 133 01:02:56.950 00:21:25.818 134 # Run pci bus hotplug test 01:02:56.950 00:21:25.818 135 run_hotplug 01:02:56.950 00:21:25.818 136 01:02:56.950 00:21:25.818 137 # Run SPDK target based hotplug 01:02:56.950 00:21:25.818 => 138 tgt_run_hotplug 01:02:56.950 00:21:25.818 ... 01:02:56.950 00:21:25.818 01:02:56.950 00:21:25.818 ========== Backtrace end ========== 01:02:56.950 00:21:25.818 ========== Backtrace start: ========== 01:02:56.950 00:21:25.818 01:02:56.950 00:21:25.818 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:02:56.950 00:21:25.818 ... 01:02:56.950 00:21:25.818 11 # Pci bus hotplug 01:02:56.950 00:21:25.818 12 # Helper function to remove/attach cotrollers 01:02:56.950 00:21:25.818 13 debug_remove_attach_helper() { 01:02:56.950 00:21:25.818 14 local helper_time=0 01:02:56.950 00:21:25.818 15 01:02:56.950 00:21:25.818 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:02:56.950 00:21:25.818 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:02:56.950 00:21:25.818 18 "$helper_time" "$nvme_count" >&2 01:02:56.950 00:21:25.818 19 } 01:02:56.950 00:21:25.818 20 01:02:56.950 00:21:25.818 21 remove_attach_helper() { 01:02:56.950 00:21:25.818 ... 01:02:56.950 00:21:25.818 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:02:56.950 00:21:25.818 ... 01:02:56.950 00:21:25.818 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:02:56.950 00:21:25.818 106 done 01:02:56.950 00:21:25.818 107 01:02:56.950 00:21:25.818 108 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.950 00:21:25.818 109 01:02:56.950 00:21:25.818 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.950 00:21:25.818 111 # Verify reregistering hotplug poller 01:02:56.950 00:21:25.818 112 rpc_cmd bdev_nvme_set_hotplug -d 01:02:56.950 00:21:25.818 113 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.950 00:21:25.818 114 01:02:56.950 00:21:25.818 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.950 00:21:25.818 ... 01:02:56.950 00:21:25.818 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:02:56.950 00:21:25.818 ... 01:02:56.950 00:21:25.818 133 01:02:56.950 00:21:25.818 134 # Run pci bus hotplug test 01:02:56.950 00:21:25.818 135 run_hotplug 01:02:56.950 00:21:25.818 136 01:02:56.950 00:21:25.818 137 # Run SPDK target based hotplug 01:02:56.950 00:21:25.818 => 138 tgt_run_hotplug 01:02:56.950 00:21:25.818 ... 01:02:56.950 00:21:25.818 01:02:56.950 00:21:25.818 ========== Backtrace end ========== 01:02:56.950 00:21:27.976 ========== Backtrace start: ========== 01:02:56.950 00:21:27.976 01:02:56.950 00:21:27.976 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh"]) 01:02:56.950 00:21:27.976 ... 01:02:56.950 00:21:27.976 1117 timing_enter $test_name 01:02:56.950 00:21:27.976 1118 echo "************************************" 01:02:56.950 00:21:27.976 1119 echo "START TEST $test_name" 01:02:56.950 00:21:27.976 1120 echo "************************************" 01:02:56.950 00:21:27.976 1121 xtrace_restore 01:02:56.950 00:21:27.976 1122 time "$@" 01:02:56.950 00:21:27.976 1123 xtrace_disable 01:02:56.950 00:21:27.976 1124 echo "************************************" 01:02:56.950 00:21:27.976 1125 echo "END TEST $test_name" 01:02:56.950 00:21:27.976 1126 echo "************************************" 01:02:56.950 00:21:27.976 1127 timing_exit $test_name 01:02:56.950 00:21:27.976 ... 01:02:56.950 00:21:27.976 in /home/vagrant/spdk_repo/spdk/autotest.sh:240 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 01:02:56.950 00:21:27.976 ... 01:02:56.950 00:21:27.976 235 01:02:56.950 00:21:27.976 236 run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh 01:02:56.950 00:21:27.976 237 run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh 01:02:56.950 00:21:27.976 238 01:02:56.950 00:21:27.976 239 if [ $(uname -s) = Linux ]; then 01:02:56.950 00:21:27.976 => 240 run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh 01:02:56.950 00:21:27.976 241 fi 01:02:56.950 00:21:27.976 242 01:02:56.950 00:21:27.976 243 if [[ $SPDK_TEST_XNVME -eq 1 ]]; then 01:02:56.950 00:21:27.976 244 run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh 01:02:56.950 00:21:27.976 245 run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme" 01:02:56.950 00:21:27.976 ... 01:02:56.950 00:21:27.976 01:02:56.950 00:21:27.976 ========== Backtrace end ==========' 01:02:56.950 + for build in "${build_log_list[@]}" 01:02:56.950 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_6/dsa-phy-autotest_4917/build.log 01:02:56.950 + local build_log job_name start_pattern end_pattern backtraces 01:02:56.950 + build_log=/var/jenkins/workspace/autotest-per-patch_6/dsa-phy-autotest_4917/build.log 01:02:56.950 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/dsa-phy-autotest_4917/build.log 01:02:56.950 ++ basename /var/jenkins/workspace/autotest-per-patch_6/dsa-phy-autotest_4917 01:02:56.950 + job_name=dsa-phy-autotest_4917 01:02:56.950 + start_pattern='Backtrace start' 01:02:56.950 + end_pattern='Backtrace end' 01:02:56.950 + [[ -f /var/jenkins/workspace/autotest-per-patch_6/dsa-phy-autotest_4917/build.log ]] 01:02:56.950 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_6/dsa-phy-autotest_4917/build.log 01:02:56.950 + backtraces= 01:02:56.950 + [[ -n '' ]] 01:02:56.950 + for build in "${build_log_list[@]}" 01:02:56.950 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_6/ubuntu22-vg-autotest_37830/build.log 01:02:56.950 + local build_log job_name start_pattern end_pattern backtraces 01:02:56.950 + build_log=/var/jenkins/workspace/autotest-per-patch_6/ubuntu22-vg-autotest_37830/build.log 01:02:56.950 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/ubuntu22-vg-autotest_37830/build.log 01:02:56.950 ++ basename /var/jenkins/workspace/autotest-per-patch_6/ubuntu22-vg-autotest_37830 01:02:56.950 + job_name=ubuntu22-vg-autotest_37830 01:02:56.950 + start_pattern='Backtrace start' 01:02:56.950 + end_pattern='Backtrace end' 01:02:56.950 + [[ -f /var/jenkins/workspace/autotest-per-patch_6/ubuntu22-vg-autotest_37830/build.log ]] 01:02:56.950 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_6/ubuntu22-vg-autotest_37830/build.log 01:02:56.950 + backtraces= 01:02:56.950 + [[ -n '' ]] 01:02:56.950 + for build in "${build_log_list[@]}" 01:02:56.950 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_6/ubuntu20-vg-autotest_73816/build.log 01:02:56.950 + local build_log job_name start_pattern end_pattern backtraces 01:02:56.950 + build_log=/var/jenkins/workspace/autotest-per-patch_6/ubuntu20-vg-autotest_73816/build.log 01:02:56.950 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/ubuntu20-vg-autotest_73816/build.log 01:02:56.950 ++ basename /var/jenkins/workspace/autotest-per-patch_6/ubuntu20-vg-autotest_73816 01:02:56.950 + job_name=ubuntu20-vg-autotest_73816 01:02:56.950 + start_pattern='Backtrace start' 01:02:56.950 + end_pattern='Backtrace end' 01:02:56.950 + [[ -f /var/jenkins/workspace/autotest-per-patch_6/ubuntu20-vg-autotest_73816/build.log ]] 01:02:56.950 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_6/ubuntu20-vg-autotest_73816/build.log 01:02:56.950 + backtraces='00:53:14.417 11:13:58 sw_hotplug -- common/autotest_common.sh@715 -- # time='\''========== Backtrace start: ========== 01:02:56.950 00:53:14.417 01:02:56.950 00:53:14.417 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:02:56.950 00:53:14.417 ... 01:02:56.950 00:53:14.417 710 01:02:56.950 00:53:14.417 711 # We redirect cmd'\''\'\'''\''s std{out,err} to a separate fd dup'\''\'\'''\''ed to stdin'\''\'\'''\''s device (or /dev/null) to 01:02:56.950 00:53:14.417 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 01:02:56.950 00:53:14.417 713 # but $() will return just the time'\''\'\'''\''s data, hence making it possible to just do: 01:02:56.950 00:53:14.417 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:02:56.950 00:53:14.417 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:02:56.950 00:53:14.417 716 01:02:56.950 00:53:14.417 717 echo "$time" 01:02:56.950 00:53:14.417 718 ) 01:02:56.950 00:53:14.417 719 01:02:56.951 00:53:14.417 720 function timing_enter() { 01:02:56.951 00:53:14.417 ... 01:02:56.951 00:53:14.417 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:02:56.951 00:53:14.417 ... 01:02:56.951 00:53:14.417 11 # Pci bus hotplug 01:02:56.951 00:53:14.417 12 # Helper function to remove/attach cotrollers 01:02:56.951 00:53:14.417 13 debug_remove_attach_helper() { 01:02:56.951 00:53:14.417 14 local helper_time=0 01:02:56.951 00:53:14.417 15 01:02:56.951 00:53:14.417 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:02:56.951 00:53:14.417 17 printf '\''\'\'''\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\''\'\'''\'' \ 01:02:56.951 00:53:14.417 18 "$helper_time" "$nvme_count" >&2 01:02:56.951 00:53:14.417 19 } 01:02:56.951 00:53:14.417 20 01:02:56.951 00:53:14.417 21 remove_attach_helper() { 01:02:56.951 00:53:14.417 ... 01:02:56.951 00:53:14.417 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:02:56.951 00:53:14.417 ... 01:02:56.951 00:53:14.417 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:02:56.951 00:53:14.417 106 done 01:02:56.951 00:53:14.417 107 01:02:56.951 00:53:14.417 108 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.951 00:53:14.417 109 01:02:56.951 00:53:14.417 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.951 00:53:14.417 111 # Verify reregistering hotplug poller 01:02:56.951 00:53:14.417 112 rpc_cmd bdev_nvme_set_hotplug -d 01:02:56.951 00:53:14.417 113 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.951 00:53:14.417 114 01:02:56.951 00:53:14.417 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.951 00:53:14.417 ... 01:02:56.951 00:53:14.417 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:02:56.951 00:53:14.417 ... 01:02:56.951 00:53:14.417 133 01:02:56.951 00:53:14.417 134 # Run pci bus hotplug test 01:02:56.951 00:53:14.417 135 run_hotplug 01:02:56.951 00:53:14.417 136 01:02:56.951 00:53:14.417 137 # Run SPDK target based hotplug 01:02:56.951 00:53:14.417 => 138 tgt_run_hotplug 01:02:56.951 00:53:14.417 ... 01:02:56.951 00:53:14.417 01:02:56.951 00:53:14.417 ========== Backtrace end ========== 01:02:56.951 00:53:14.417 ========== Backtrace start: ========== 01:02:56.951 00:53:14.417 01:02:56.951 00:53:14.417 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:02:56.951 00:53:14.417 ... 01:02:56.951 00:53:14.417 710 01:02:56.951 00:53:14.417 711 # We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to 01:02:56.951 00:53:14.417 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 01:02:56.951 00:53:14.417 713 # but $() will return just the time'\''s data, hence making it possible to just do: 01:02:56.951 00:53:14.417 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:02:56.951 00:53:14.417 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:02:56.951 00:53:14.417 716 01:02:56.951 00:53:14.418 717 echo "$time" 01:02:56.951 00:53:14.418 718 ) 01:02:56.951 00:53:14.418 719 01:02:56.951 00:53:14.418 720 function timing_enter() { 01:02:56.951 00:53:14.418 ... 01:02:56.951 00:53:14.418 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:02:56.951 00:53:14.418 ... 01:02:56.951 00:53:14.418 11 # Pci bus hotplug 01:02:56.951 00:53:14.418 12 # Helper function to remove/attach cotrollers 01:02:56.951 00:53:14.418 13 debug_remove_attach_helper() { 01:02:56.951 00:53:14.418 14 local helper_time=0 01:02:56.951 00:53:14.418 15 01:02:56.951 00:53:14.418 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:02:56.951 00:53:14.418 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:02:56.951 00:53:14.418 18 "$helper_time" "$nvme_count" >&2 01:02:56.951 00:53:14.418 19 } 01:02:56.951 00:53:14.418 20 01:02:56.951 00:53:14.418 21 remove_attach_helper() { 01:02:56.951 00:53:14.418 ... 01:02:56.951 00:53:14.418 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:02:56.951 00:53:14.418 ... 01:02:56.951 00:53:14.418 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:02:56.951 00:53:14.418 106 done 01:02:56.951 00:53:14.418 107 01:02:56.951 00:53:14.418 108 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.951 00:53:14.418 109 01:02:56.951 00:53:14.418 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.951 00:53:14.418 111 # Verify reregistering hotplug poller 01:02:56.951 00:53:14.418 112 rpc_cmd bdev_nvme_set_hotplug -d 01:02:56.951 00:53:14.418 113 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.951 00:53:14.418 114 01:02:56.951 00:53:14.418 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.951 00:53:14.418 ... 01:02:56.951 00:53:14.418 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:02:56.951 00:53:14.418 ... 01:02:56.951 00:53:14.418 133 01:02:56.951 00:53:14.418 134 # Run pci bus hotplug test 01:02:56.951 00:53:14.418 135 run_hotplug 01:02:56.951 00:53:14.418 136 01:02:56.951 00:53:14.418 137 # Run SPDK target based hotplug 01:02:56.951 00:53:14.418 => 138 tgt_run_hotplug 01:02:56.951 00:53:14.418 ... 01:02:56.951 00:53:14.418 01:02:56.951 00:53:14.418 ========== Backtrace end ========== 01:02:56.951 00:53:14.418 ========== Backtrace start: ========== 01:02:56.951 00:53:14.418 01:02:56.951 00:53:14.418 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:02:56.951 00:53:14.418 ... 01:02:56.951 00:53:14.418 713 # but $() will return just the time'\''s data, hence making it possible to just do: 01:02:56.951 00:53:14.418 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:02:56.951 00:53:14.418 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:02:56.951 00:53:14.418 716 01:02:56.951 00:53:14.418 717 echo "$time" 01:02:56.951 00:53:14.418 => 718 ) 01:02:56.951 00:53:14.418 719 01:02:56.951 00:53:14.418 720 function timing_enter() { 01:02:56.951 00:53:14.418 721 xtrace_disable 01:02:56.951 00:53:14.418 722 timing "enter" "$1" 01:02:56.951 00:53:14.418 723 xtrace_restore 01:02:56.951 00:53:14.418 ... 01:02:56.951 00:53:14.676 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:02:56.951 00:53:14.676 ... 01:02:56.951 00:53:14.676 11 # Pci bus hotplug 01:02:56.951 00:53:14.676 12 # Helper function to remove/attach cotrollers 01:02:56.951 00:53:14.676 13 debug_remove_attach_helper() { 01:02:56.951 00:53:14.676 14 local helper_time=0 01:02:56.951 00:53:14.676 15 01:02:56.951 00:53:14.676 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:02:56.951 00:53:14.676 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:02:56.951 00:53:14.677 18 "$helper_time" "$nvme_count" >&2 01:02:56.951 00:53:14.677 19 } 01:02:56.951 00:53:14.677 20 01:02:56.951 00:53:14.677 21 remove_attach_helper() { 01:02:56.951 00:53:14.677 ... 01:02:56.951 00:53:14.677 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:02:56.951 00:53:14.677 ... 01:02:56.951 00:53:14.677 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:02:56.951 00:53:14.677 106 done 01:02:56.951 00:53:14.677 107 01:02:56.951 00:53:14.677 108 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.951 00:53:14.677 109 01:02:56.951 00:53:14.677 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.951 00:53:14.677 111 # Verify reregistering hotplug poller 01:02:56.951 00:53:14.677 112 rpc_cmd bdev_nvme_set_hotplug -d 01:02:56.951 00:53:14.677 113 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.951 00:53:14.677 114 01:02:56.951 00:53:14.677 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.951 00:53:14.677 ... 01:02:56.951 00:53:14.677 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:02:56.951 00:53:14.677 ... 01:02:56.951 00:53:14.677 133 01:02:56.951 00:53:14.677 134 # Run pci bus hotplug test 01:02:56.951 00:53:14.677 135 run_hotplug 01:02:56.951 00:53:14.677 136 01:02:56.951 00:53:14.677 137 # Run SPDK target based hotplug 01:02:56.951 00:53:14.677 => 138 tgt_run_hotplug 01:02:56.951 00:53:14.677 ... 01:02:56.951 00:53:14.677 01:02:56.951 00:53:14.677 ========== Backtrace end ========== 01:02:56.951 00:53:14.677 ========== Backtrace start: ========== 01:02:56.951 00:53:14.677 01:02:56.951 00:53:14.677 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:02:56.951 00:53:14.677 ... 01:02:56.951 00:53:14.677 11 # Pci bus hotplug 01:02:56.951 00:53:14.677 12 # Helper function to remove/attach cotrollers 01:02:56.951 00:53:14.677 13 debug_remove_attach_helper() { 01:02:56.951 00:53:14.677 14 local helper_time=0 01:02:56.951 00:53:14.677 15 01:02:56.951 00:53:14.677 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:02:56.951 00:53:14.677 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:02:56.951 00:53:14.677 18 "$helper_time" "$nvme_count" >&2 01:02:56.951 00:53:14.677 19 } 01:02:56.951 00:53:14.677 20 01:02:56.951 00:53:14.677 21 remove_attach_helper() { 01:02:56.951 00:53:14.677 ... 01:02:56.951 00:53:14.677 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:02:56.951 00:53:14.677 ... 01:02:56.951 00:53:14.677 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:02:56.951 00:53:14.677 106 done 01:02:56.951 00:53:14.677 107 01:02:56.951 00:53:14.677 108 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.951 00:53:14.677 109 01:02:56.951 00:53:14.677 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.951 00:53:14.677 111 # Verify reregistering hotplug poller 01:02:56.951 00:53:14.677 112 rpc_cmd bdev_nvme_set_hotplug -d 01:02:56.951 00:53:14.677 113 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.951 00:53:14.677 114 01:02:56.951 00:53:14.677 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.951 00:53:14.677 ... 01:02:56.951 00:53:14.677 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:02:56.951 00:53:14.677 ... 01:02:56.951 00:53:14.677 133 01:02:56.951 00:53:14.677 134 # Run pci bus hotplug test 01:02:56.951 00:53:14.677 135 run_hotplug 01:02:56.951 00:53:14.677 136 01:02:56.951 00:53:14.677 137 # Run SPDK target based hotplug 01:02:56.951 00:53:14.677 => 138 tgt_run_hotplug 01:02:56.951 00:53:14.677 ... 01:02:56.951 00:53:14.677 01:02:56.952 00:53:14.677 ========== Backtrace end ========== 01:02:56.952 00:53:16.804 ========== Backtrace start: ========== 01:02:56.952 00:53:16.804 01:02:56.952 00:53:16.804 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh"]) 01:02:56.952 00:53:16.804 ... 01:02:56.952 00:53:16.804 1117 timing_enter $test_name 01:02:56.952 00:53:16.804 1118 echo "************************************" 01:02:56.952 00:53:16.805 1119 echo "START TEST $test_name" 01:02:56.952 00:53:16.805 1120 echo "************************************" 01:02:56.952 00:53:16.805 1121 xtrace_restore 01:02:56.952 00:53:16.805 1122 time "$@" 01:02:56.952 00:53:16.805 1123 xtrace_disable 01:02:56.952 00:53:16.805 1124 echo "************************************" 01:02:56.952 00:53:16.805 1125 echo "END TEST $test_name" 01:02:56.952 00:53:16.805 1126 echo "************************************" 01:02:56.952 00:53:16.805 1127 timing_exit $test_name 01:02:56.952 00:53:16.805 ... 01:02:56.952 00:53:16.805 in /home/vagrant/spdk_repo/spdk/autotest.sh:240 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 01:02:56.952 00:53:16.805 ... 01:02:56.952 00:53:16.805 235 01:02:56.952 00:53:16.805 236 run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh 01:02:56.952 00:53:16.805 237 run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh 01:02:56.952 00:53:16.805 238 01:02:56.952 00:53:16.805 239 if [ $(uname -s) = Linux ]; then 01:02:56.952 00:53:16.805 => 240 run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh 01:02:56.952 00:53:16.805 241 fi 01:02:56.952 00:53:16.805 242 01:02:56.952 00:53:16.805 243 if [[ $SPDK_TEST_XNVME -eq 1 ]]; then 01:02:56.952 00:53:16.805 244 run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh 01:02:56.952 00:53:16.805 245 run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme" 01:02:56.952 00:53:16.805 ... 01:02:56.952 00:53:16.805 01:02:56.952 00:53:16.805 ========== Backtrace end ==========' 01:02:56.952 + [[ -n 00:53:14.417 11:13:58 sw_hotplug -- common/autotest_common.sh@715 -- # time='========== Backtrace start: ========== 01:02:56.952 00:53:14.417 01:02:56.952 00:53:14.417 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:02:56.952 00:53:14.417 ... 01:02:56.952 00:53:14.417 710 01:02:56.952 00:53:14.417 711 # We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to 01:02:56.952 00:53:14.417 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 01:02:56.952 00:53:14.417 713 # but $() will return just the time'\''s data, hence making it possible to just do: 01:02:56.952 00:53:14.417 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:02:56.952 00:53:14.417 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:02:56.952 00:53:14.417 716 01:02:56.952 00:53:14.417 717 echo "$time" 01:02:56.952 00:53:14.417 718 ) 01:02:56.952 00:53:14.417 719 01:02:56.952 00:53:14.417 720 function timing_enter() { 01:02:56.952 00:53:14.417 ... 01:02:56.952 00:53:14.417 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:02:56.952 00:53:14.417 ... 01:02:56.952 00:53:14.417 11 # Pci bus hotplug 01:02:56.952 00:53:14.417 12 # Helper function to remove/attach cotrollers 01:02:56.952 00:53:14.417 13 debug_remove_attach_helper() { 01:02:56.952 00:53:14.417 14 local helper_time=0 01:02:56.952 00:53:14.417 15 01:02:56.952 00:53:14.417 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:02:56.952 00:53:14.417 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:02:56.952 00:53:14.417 18 "$helper_time" "$nvme_count" >&2 01:02:56.952 00:53:14.417 19 } 01:02:56.952 00:53:14.417 20 01:02:56.952 00:53:14.417 21 remove_attach_helper() { 01:02:56.952 00:53:14.417 ... 01:02:56.952 00:53:14.417 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:02:56.952 00:53:14.417 ... 01:02:56.952 00:53:14.417 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:02:56.952 00:53:14.417 106 done 01:02:56.952 00:53:14.417 107 01:02:56.952 00:53:14.417 108 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.952 00:53:14.417 109 01:02:56.952 00:53:14.417 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.952 00:53:14.417 111 # Verify reregistering hotplug poller 01:02:56.952 00:53:14.417 112 rpc_cmd bdev_nvme_set_hotplug -d 01:02:56.952 00:53:14.417 113 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.952 00:53:14.417 114 01:02:56.952 00:53:14.417 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.952 00:53:14.417 ... 01:02:56.952 00:53:14.417 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:02:56.952 00:53:14.417 ... 01:02:56.952 00:53:14.417 133 01:02:56.952 00:53:14.417 134 # Run pci bus hotplug test 01:02:56.952 00:53:14.417 135 run_hotplug 01:02:56.952 00:53:14.417 136 01:02:56.952 00:53:14.417 137 # Run SPDK target based hotplug 01:02:56.952 00:53:14.417 => 138 tgt_run_hotplug 01:02:56.952 00:53:14.417 ... 01:02:56.952 00:53:14.417 01:02:56.952 00:53:14.417 ========== Backtrace end ========== 01:02:56.952 00:53:14.417 ========== Backtrace start: ========== 01:02:56.952 00:53:14.417 01:02:56.952 00:53:14.417 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:02:56.952 00:53:14.417 ... 01:02:56.952 00:53:14.417 710 01:02:56.952 00:53:14.417 711 # We redirect cmd's std{out,err} to a separate fd dup'ed to stdin's device (or /dev/null) to 01:02:56.952 00:53:14.417 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 01:02:56.952 00:53:14.417 713 # but $() will return just the time's data, hence making it possible to just do: 01:02:56.952 00:53:14.417 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:02:56.952 00:53:14.417 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:02:56.952 00:53:14.417 716 01:02:56.952 00:53:14.418 717 echo "$time" 01:02:56.952 00:53:14.418 718 ) 01:02:56.952 00:53:14.418 719 01:02:56.952 00:53:14.418 720 function timing_enter() { 01:02:56.952 00:53:14.418 ... 01:02:56.952 00:53:14.418 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:02:56.952 00:53:14.418 ... 01:02:56.952 00:53:14.418 11 # Pci bus hotplug 01:02:56.952 00:53:14.418 12 # Helper function to remove/attach cotrollers 01:02:56.952 00:53:14.418 13 debug_remove_attach_helper() { 01:02:56.952 00:53:14.418 14 local helper_time=0 01:02:56.952 00:53:14.418 15 01:02:56.952 00:53:14.418 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:02:56.952 00:53:14.418 17 printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \ 01:02:56.952 00:53:14.418 18 "$helper_time" "$nvme_count" >&2 01:02:56.952 00:53:14.418 19 } 01:02:56.952 00:53:14.418 20 01:02:56.952 00:53:14.418 21 remove_attach_helper() { 01:02:56.952 00:53:14.418 ... 01:02:56.952 00:53:14.418 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:02:56.952 00:53:14.418 ... 01:02:56.952 00:53:14.418 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:02:56.952 00:53:14.418 106 done 01:02:56.952 00:53:14.418 107 01:02:56.952 00:53:14.418 108 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.952 00:53:14.418 109 01:02:56.952 00:53:14.418 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.952 00:53:14.418 111 # Verify reregistering hotplug poller 01:02:56.952 00:53:14.418 112 rpc_cmd bdev_nvme_set_hotplug -d 01:02:56.952 00:53:14.418 113 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.952 00:53:14.418 114 01:02:56.952 00:53:14.418 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.952 00:53:14.418 ... 01:02:56.952 00:53:14.418 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:02:56.952 00:53:14.418 ... 01:02:56.952 00:53:14.418 133 01:02:56.952 00:53:14.418 134 # Run pci bus hotplug test 01:02:56.952 00:53:14.418 135 run_hotplug 01:02:56.952 00:53:14.418 136 01:02:56.952 00:53:14.418 137 # Run SPDK target based hotplug 01:02:56.952 00:53:14.418 => 138 tgt_run_hotplug 01:02:56.952 00:53:14.418 ... 01:02:56.952 00:53:14.418 01:02:56.952 00:53:14.418 ========== Backtrace end ========== 01:02:56.952 00:53:14.418 ========== Backtrace start: ========== 01:02:56.952 00:53:14.418 01:02:56.952 00:53:14.418 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:02:56.952 00:53:14.418 ... 01:02:56.952 00:53:14.418 713 # but $() will return just the time's data, hence making it possible to just do: 01:02:56.952 00:53:14.418 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:02:56.952 00:53:14.418 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:02:56.952 00:53:14.418 716 01:02:56.952 00:53:14.418 717 echo "$time" 01:02:56.952 00:53:14.418 => 718 ) 01:02:56.952 00:53:14.418 719 01:02:56.952 00:53:14.418 720 function timing_enter() { 01:02:56.952 00:53:14.418 721 xtrace_disable 01:02:56.952 00:53:14.418 722 timing "enter" "$1" 01:02:56.952 00:53:14.418 723 xtrace_restore 01:02:56.952 00:53:14.418 ... 01:02:56.952 00:53:14.676 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:02:56.952 00:53:14.676 ... 01:02:56.952 00:53:14.676 11 # Pci bus hotplug 01:02:56.952 00:53:14.676 12 # Helper function to remove/attach cotrollers 01:02:56.952 00:53:14.676 13 debug_remove_attach_helper() { 01:02:56.952 00:53:14.676 14 local helper_time=0 01:02:56.952 00:53:14.676 15 01:02:56.952 00:53:14.676 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:02:56.952 00:53:14.676 17 printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \ 01:02:56.952 00:53:14.677 18 "$helper_time" "$nvme_count" >&2 01:02:56.952 00:53:14.677 19 } 01:02:56.952 00:53:14.677 20 01:02:56.952 00:53:14.677 21 remove_attach_helper() { 01:02:56.952 00:53:14.677 ... 01:02:56.952 00:53:14.677 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:02:56.952 00:53:14.677 ... 01:02:56.952 00:53:14.677 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:02:56.952 00:53:14.677 106 done 01:02:56.952 00:53:14.677 107 01:02:56.952 00:53:14.677 108 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.952 00:53:14.677 109 01:02:56.952 00:53:14.677 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.952 00:53:14.677 111 # Verify reregistering hotplug poller 01:02:56.952 00:53:14.677 112 rpc_cmd bdev_nvme_set_hotplug -d 01:02:56.952 00:53:14.677 113 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.952 00:53:14.677 114 01:02:56.953 00:53:14.677 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.953 00:53:14.677 ... 01:02:56.953 00:53:14.677 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:02:56.953 00:53:14.677 ... 01:02:56.953 00:53:14.677 133 01:02:56.953 00:53:14.677 134 # Run pci bus hotplug test 01:02:56.953 00:53:14.677 135 run_hotplug 01:02:56.953 00:53:14.677 136 01:02:56.953 00:53:14.677 137 # Run SPDK target based hotplug 01:02:56.953 00:53:14.677 => 138 tgt_run_hotplug 01:02:56.953 00:53:14.677 ... 01:02:56.953 00:53:14.677 01:02:56.953 00:53:14.677 ========== Backtrace end ========== 01:02:56.953 00:53:14.677 ========== Backtrace start: ========== 01:02:56.953 00:53:14.677 01:02:56.953 00:53:14.677 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:02:56.953 00:53:14.677 ... 01:02:56.953 00:53:14.677 11 # Pci bus hotplug 01:02:56.953 00:53:14.677 12 # Helper function to remove/attach cotrollers 01:02:56.953 00:53:14.677 13 debug_remove_attach_helper() { 01:02:56.953 00:53:14.677 14 local helper_time=0 01:02:56.953 00:53:14.677 15 01:02:56.953 00:53:14.677 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:02:56.953 00:53:14.677 17 printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \ 01:02:56.953 00:53:14.677 18 "$helper_time" "$nvme_count" >&2 01:02:56.953 00:53:14.677 19 } 01:02:56.953 00:53:14.677 20 01:02:56.953 00:53:14.677 21 remove_attach_helper() { 01:02:56.953 00:53:14.677 ... 01:02:56.953 00:53:14.677 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:02:56.953 00:53:14.677 ... 01:02:56.953 00:53:14.677 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:02:56.953 00:53:14.677 106 done 01:02:56.953 00:53:14.677 107 01:02:56.953 00:53:14.677 108 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.953 00:53:14.677 109 01:02:56.953 00:53:14.677 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.953 00:53:14.677 111 # Verify reregistering hotplug poller 01:02:56.953 00:53:14.677 112 rpc_cmd bdev_nvme_set_hotplug -d 01:02:56.953 00:53:14.677 113 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.953 00:53:14.677 114 01:02:56.953 00:53:14.677 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.953 00:53:14.677 ... 01:02:56.953 00:53:14.677 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:02:56.953 00:53:14.677 ... 01:02:56.953 00:53:14.677 133 01:02:56.953 00:53:14.677 134 # Run pci bus hotplug test 01:02:56.953 00:53:14.677 135 run_hotplug 01:02:56.953 00:53:14.677 136 01:02:56.953 00:53:14.677 137 # Run SPDK target based hotplug 01:02:56.953 00:53:14.677 => 138 tgt_run_hotplug 01:02:56.953 00:53:14.677 ... 01:02:56.953 00:53:14.677 01:02:56.953 00:53:14.677 ========== Backtrace end ========== 01:02:56.953 00:53:16.804 ========== Backtrace start: ========== 01:02:56.953 00:53:16.804 01:02:56.953 00:53:16.804 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh"]) 01:02:56.953 00:53:16.804 ... 01:02:56.953 00:53:16.804 1117 timing_enter $test_name 01:02:56.953 00:53:16.804 1118 echo "************************************" 01:02:56.953 00:53:16.805 1119 echo "START TEST $test_name" 01:02:56.953 00:53:16.805 1120 echo "************************************" 01:02:56.953 00:53:16.805 1121 xtrace_restore 01:02:56.953 00:53:16.805 1122 time "$@" 01:02:56.953 00:53:16.805 1123 xtrace_disable 01:02:56.953 00:53:16.805 1124 echo "************************************" 01:02:56.953 00:53:16.805 1125 echo "END TEST $test_name" 01:02:56.953 00:53:16.805 1126 echo "************************************" 01:02:56.953 00:53:16.805 1127 timing_exit $test_name 01:02:56.953 00:53:16.805 ... 01:02:56.953 00:53:16.805 in /home/vagrant/spdk_repo/spdk/autotest.sh:240 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 01:02:56.953 00:53:16.805 ... 01:02:56.953 00:53:16.805 235 01:02:56.953 00:53:16.805 236 run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh 01:02:56.953 00:53:16.805 237 run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh 01:02:56.953 00:53:16.805 238 01:02:56.953 00:53:16.805 239 if [ $(uname -s) = Linux ]; then 01:02:56.953 00:53:16.805 => 240 run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh 01:02:56.953 00:53:16.805 241 fi 01:02:56.953 00:53:16.805 242 01:02:56.953 00:53:16.805 243 if [[ $SPDK_TEST_XNVME -eq 1 ]]; then 01:02:56.953 00:53:16.805 244 run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh 01:02:56.953 00:53:16.805 245 run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme" 01:02:56.953 00:53:16.805 ... 01:02:56.953 00:53:16.805 01:02:56.953 00:53:16.805 ========== Backtrace end ========== ]] 01:02:56.953 + echo '00:53:14.417 11:13:58 sw_hotplug -- common/autotest_common.sh@715 -- # time='\''========== Backtrace start: ========== 01:02:56.953 00:53:14.417 01:02:56.953 00:53:14.417 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:02:56.953 00:53:14.417 ... 01:02:56.953 00:53:14.417 710 01:02:56.953 00:53:14.417 711 # We redirect cmd'\''\'\'''\''s std{out,err} to a separate fd dup'\''\'\'''\''ed to stdin'\''\'\'''\''s device (or /dev/null) to 01:02:56.953 00:53:14.417 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 01:02:56.953 00:53:14.417 713 # but $() will return just the time'\''\'\'''\''s data, hence making it possible to just do: 01:02:56.953 00:53:14.417 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:02:56.953 00:53:14.417 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:02:56.953 00:53:14.417 716 01:02:56.953 00:53:14.417 717 echo "$time" 01:02:56.953 00:53:14.417 718 ) 01:02:56.953 00:53:14.417 719 01:02:56.953 00:53:14.417 720 function timing_enter() { 01:02:56.953 00:53:14.417 ... 01:02:56.953 00:53:14.417 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:02:56.953 00:53:14.417 ... 01:02:56.953 00:53:14.417 11 # Pci bus hotplug 01:02:56.953 00:53:14.417 12 # Helper function to remove/attach cotrollers 01:02:56.953 00:53:14.417 13 debug_remove_attach_helper() { 01:02:56.953 00:53:14.417 14 local helper_time=0 01:02:56.953 00:53:14.417 15 01:02:56.953 00:53:14.417 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:02:56.953 00:53:14.417 17 printf '\''\'\'''\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\''\'\'''\'' \ 01:02:56.953 00:53:14.417 18 "$helper_time" "$nvme_count" >&2 01:02:56.953 00:53:14.417 19 } 01:02:56.953 00:53:14.417 20 01:02:56.953 00:53:14.417 21 remove_attach_helper() { 01:02:56.953 00:53:14.417 ... 01:02:56.953 00:53:14.417 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:02:56.953 00:53:14.417 ... 01:02:56.953 00:53:14.417 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:02:56.953 00:53:14.417 106 done 01:02:56.953 00:53:14.417 107 01:02:56.953 00:53:14.417 108 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.953 00:53:14.417 109 01:02:56.953 00:53:14.417 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.953 00:53:14.417 111 # Verify reregistering hotplug poller 01:02:56.953 00:53:14.417 112 rpc_cmd bdev_nvme_set_hotplug -d 01:02:56.953 00:53:14.417 113 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.953 00:53:14.417 114 01:02:56.953 00:53:14.417 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.953 00:53:14.417 ... 01:02:56.953 00:53:14.417 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:02:56.953 00:53:14.417 ... 01:02:56.953 00:53:14.417 133 01:02:56.953 00:53:14.417 134 # Run pci bus hotplug test 01:02:56.953 00:53:14.417 135 run_hotplug 01:02:56.953 00:53:14.417 136 01:02:56.953 00:53:14.417 137 # Run SPDK target based hotplug 01:02:56.953 00:53:14.417 => 138 tgt_run_hotplug 01:02:56.953 00:53:14.417 ... 01:02:56.953 00:53:14.417 01:02:56.953 00:53:14.417 ========== Backtrace end ========== 01:02:56.953 00:53:14.417 ========== Backtrace start: ========== 01:02:56.953 00:53:14.417 01:02:56.953 00:53:14.417 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:02:56.953 00:53:14.417 ... 01:02:56.953 00:53:14.417 710 01:02:56.953 00:53:14.417 711 # We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to 01:02:56.953 00:53:14.417 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 01:02:56.953 00:53:14.417 713 # but $() will return just the time'\''s data, hence making it possible to just do: 01:02:56.953 00:53:14.417 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:02:56.953 00:53:14.417 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:02:56.953 00:53:14.417 716 01:02:56.953 00:53:14.418 717 echo "$time" 01:02:56.953 00:53:14.418 718 ) 01:02:56.953 00:53:14.418 719 01:02:56.953 00:53:14.418 720 function timing_enter() { 01:02:56.953 00:53:14.418 ... 01:02:56.953 00:53:14.418 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:02:56.953 00:53:14.418 ... 01:02:56.953 00:53:14.418 11 # Pci bus hotplug 01:02:56.953 00:53:14.418 12 # Helper function to remove/attach cotrollers 01:02:56.953 00:53:14.418 13 debug_remove_attach_helper() { 01:02:56.953 00:53:14.418 14 local helper_time=0 01:02:56.953 00:53:14.418 15 01:02:56.953 00:53:14.418 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:02:56.953 00:53:14.418 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:02:56.953 00:53:14.418 18 "$helper_time" "$nvme_count" >&2 01:02:56.953 00:53:14.418 19 } 01:02:56.953 00:53:14.418 20 01:02:56.953 00:53:14.418 21 remove_attach_helper() { 01:02:56.953 00:53:14.418 ... 01:02:56.953 00:53:14.418 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:02:56.953 00:53:14.418 ... 01:02:56.953 00:53:14.418 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:02:56.953 00:53:14.418 106 done 01:02:56.953 00:53:14.418 107 01:02:56.953 00:53:14.418 108 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.953 00:53:14.418 109 01:02:56.953 00:53:14.418 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.953 00:53:14.418 111 # Verify reregistering hotplug poller 01:02:56.953 00:53:14.418 112 rpc_cmd bdev_nvme_set_hotplug -d 01:02:56.953 00:53:14.418 113 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.954 00:53:14.418 114 01:02:56.954 00:53:14.418 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.954 00:53:14.418 ... 01:02:56.954 00:53:14.418 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:02:56.954 00:53:14.418 ... 01:02:56.954 00:53:14.418 133 01:02:56.954 00:53:14.418 134 # Run pci bus hotplug test 01:02:56.954 00:53:14.418 135 run_hotplug 01:02:56.954 00:53:14.418 136 01:02:56.954 00:53:14.418 137 # Run SPDK target based hotplug 01:02:56.954 00:53:14.418 => 138 tgt_run_hotplug 01:02:56.954 00:53:14.418 ... 01:02:56.954 00:53:14.418 01:02:56.954 00:53:14.418 ========== Backtrace end ========== 01:02:56.954 00:53:14.418 ========== Backtrace start: ========== 01:02:56.954 00:53:14.418 01:02:56.954 00:53:14.418 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 01:02:56.954 00:53:14.418 ... 01:02:56.954 00:53:14.418 713 # but $() will return just the time'\''s data, hence making it possible to just do: 01:02:56.954 00:53:14.418 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 01:02:56.954 00:53:14.418 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 01:02:56.954 00:53:14.418 716 01:02:56.954 00:53:14.418 717 echo "$time" 01:02:56.954 00:53:14.418 => 718 ) 01:02:56.954 00:53:14.418 719 01:02:56.954 00:53:14.418 720 function timing_enter() { 01:02:56.954 00:53:14.418 721 xtrace_disable 01:02:56.954 00:53:14.418 722 timing "enter" "$1" 01:02:56.954 00:53:14.418 723 xtrace_restore 01:02:56.954 00:53:14.418 ... 01:02:56.954 00:53:14.676 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:02:56.954 00:53:14.676 ... 01:02:56.954 00:53:14.676 11 # Pci bus hotplug 01:02:56.954 00:53:14.676 12 # Helper function to remove/attach cotrollers 01:02:56.954 00:53:14.676 13 debug_remove_attach_helper() { 01:02:56.954 00:53:14.676 14 local helper_time=0 01:02:56.954 00:53:14.676 15 01:02:56.954 00:53:14.676 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:02:56.954 00:53:14.676 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:02:56.954 00:53:14.677 18 "$helper_time" "$nvme_count" >&2 01:02:56.954 00:53:14.677 19 } 01:02:56.954 00:53:14.677 20 01:02:56.954 00:53:14.677 21 remove_attach_helper() { 01:02:56.954 00:53:14.677 ... 01:02:56.954 00:53:14.677 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:02:56.954 00:53:14.677 ... 01:02:56.954 00:53:14.677 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:02:56.954 00:53:14.677 106 done 01:02:56.954 00:53:14.677 107 01:02:56.954 00:53:14.677 108 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.954 00:53:14.677 109 01:02:56.954 00:53:14.677 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.954 00:53:14.677 111 # Verify reregistering hotplug poller 01:02:56.954 00:53:14.677 112 rpc_cmd bdev_nvme_set_hotplug -d 01:02:56.954 00:53:14.677 113 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.954 00:53:14.677 114 01:02:56.954 00:53:14.677 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.954 00:53:14.677 ... 01:02:56.954 00:53:14.677 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:02:56.954 00:53:14.677 ... 01:02:56.954 00:53:14.677 133 01:02:56.954 00:53:14.677 134 # Run pci bus hotplug test 01:02:56.954 00:53:14.677 135 run_hotplug 01:02:56.954 00:53:14.677 136 01:02:56.954 00:53:14.677 137 # Run SPDK target based hotplug 01:02:56.954 00:53:14.677 => 138 tgt_run_hotplug 01:02:56.954 00:53:14.677 ... 01:02:56.954 00:53:14.677 01:02:56.954 00:53:14.677 ========== Backtrace end ========== 01:02:56.954 00:53:14.677 ========== Backtrace start: ========== 01:02:56.954 00:53:14.677 01:02:56.954 00:53:14.677 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 01:02:56.954 00:53:14.677 ... 01:02:56.954 00:53:14.677 11 # Pci bus hotplug 01:02:56.954 00:53:14.677 12 # Helper function to remove/attach cotrollers 01:02:56.954 00:53:14.677 13 debug_remove_attach_helper() { 01:02:56.954 00:53:14.677 14 local helper_time=0 01:02:56.954 00:53:14.677 15 01:02:56.954 00:53:14.677 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 01:02:56.954 00:53:14.677 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 01:02:56.954 00:53:14.677 18 "$helper_time" "$nvme_count" >&2 01:02:56.954 00:53:14.677 19 } 01:02:56.954 00:53:14.677 20 01:02:56.954 00:53:14.677 21 remove_attach_helper() { 01:02:56.954 00:53:14.677 ... 01:02:56.954 00:53:14.677 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 01:02:56.954 00:53:14.677 ... 01:02:56.954 00:53:14.677 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 01:02:56.954 00:53:14.677 106 done 01:02:56.954 00:53:14.677 107 01:02:56.954 00:53:14.677 108 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.954 00:53:14.677 109 01:02:56.954 00:53:14.677 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.954 00:53:14.677 111 # Verify reregistering hotplug poller 01:02:56.954 00:53:14.677 112 rpc_cmd bdev_nvme_set_hotplug -d 01:02:56.954 00:53:14.677 113 rpc_cmd bdev_nvme_set_hotplug -e 01:02:56.954 00:53:14.677 114 01:02:56.954 00:53:14.677 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 01:02:56.954 00:53:14.677 ... 01:02:56.954 00:53:14.677 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 01:02:56.954 00:53:14.677 ... 01:02:56.954 00:53:14.677 133 01:02:56.954 00:53:14.677 134 # Run pci bus hotplug test 01:02:56.954 00:53:14.677 135 run_hotplug 01:02:56.954 00:53:14.677 136 01:02:56.954 00:53:14.677 137 # Run SPDK target based hotplug 01:02:56.954 00:53:14.677 => 138 tgt_run_hotplug 01:02:56.954 00:53:14.677 ... 01:02:56.954 00:53:14.677 01:02:56.954 00:53:14.677 ========== Backtrace end ========== 01:02:56.954 00:53:16.804 ========== Backtrace start: ========== 01:02:56.954 00:53:16.804 01:02:56.954 00:53:16.804 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh"]) 01:02:56.954 00:53:16.804 ... 01:02:56.954 00:53:16.804 1117 timing_enter $test_name 01:02:56.954 00:53:16.804 1118 echo "************************************" 01:02:56.954 00:53:16.805 1119 echo "START TEST $test_name" 01:02:56.954 00:53:16.805 1120 echo "************************************" 01:02:56.954 00:53:16.805 1121 xtrace_restore 01:02:56.954 00:53:16.805 1122 time "$@" 01:02:56.954 00:53:16.805 1123 xtrace_disable 01:02:56.954 00:53:16.805 1124 echo "************************************" 01:02:56.954 00:53:16.805 1125 echo "END TEST $test_name" 01:02:56.954 00:53:16.805 1126 echo "************************************" 01:02:56.954 00:53:16.805 1127 timing_exit $test_name 01:02:56.954 00:53:16.805 ... 01:02:56.954 00:53:16.805 in /home/vagrant/spdk_repo/spdk/autotest.sh:240 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 01:02:56.954 00:53:16.805 ... 01:02:56.954 00:53:16.805 235 01:02:56.954 00:53:16.805 236 run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh 01:02:56.954 00:53:16.805 237 run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh 01:02:56.954 00:53:16.805 238 01:02:56.954 00:53:16.805 239 if [ $(uname -s) = Linux ]; then 01:02:56.954 00:53:16.805 => 240 run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh 01:02:56.954 00:53:16.805 241 fi 01:02:56.954 00:53:16.805 242 01:02:56.954 00:53:16.805 243 if [[ $SPDK_TEST_XNVME -eq 1 ]]; then 01:02:56.954 00:53:16.805 244 run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh 01:02:56.954 00:53:16.805 245 run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme" 01:02:56.954 00:53:16.805 ... 01:02:56.954 00:53:16.805 01:02:56.954 00:53:16.805 ========== Backtrace end ==========' 01:02:56.954 + for build in "${build_log_list[@]}" 01:02:56.954 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_6/nvmf-phy-autotest_72461/build.log 01:02:56.954 + local build_log job_name start_pattern end_pattern backtraces 01:02:56.954 + build_log=/var/jenkins/workspace/autotest-per-patch_6/nvmf-phy-autotest_72461/build.log 01:02:56.954 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/nvmf-phy-autotest_72461/build.log 01:02:56.954 ++ basename /var/jenkins/workspace/autotest-per-patch_6/nvmf-phy-autotest_72461 01:02:56.954 + job_name=nvmf-phy-autotest_72461 01:02:56.954 + start_pattern='Backtrace start' 01:02:56.954 + end_pattern='Backtrace end' 01:02:56.954 + [[ -f /var/jenkins/workspace/autotest-per-patch_6/nvmf-phy-autotest_72461/build.log ]] 01:02:56.954 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_6/nvmf-phy-autotest_72461/build.log 01:02:57.214 + backtraces= 01:02:57.214 + [[ -n '' ]] 01:02:57.214 + for build in "${build_log_list[@]}" 01:02:57.214 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_6/unittest-main-docker-autotest_19878/build.log 01:02:57.214 + local build_log job_name start_pattern end_pattern backtraces 01:02:57.214 + build_log=/var/jenkins/workspace/autotest-per-patch_6/unittest-main-docker-autotest_19878/build.log 01:02:57.214 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/unittest-main-docker-autotest_19878/build.log 01:02:57.214 ++ basename /var/jenkins/workspace/autotest-per-patch_6/unittest-main-docker-autotest_19878 01:02:57.214 + job_name=unittest-main-docker-autotest_19878 01:02:57.214 + start_pattern='Backtrace start' 01:02:57.214 + end_pattern='Backtrace end' 01:02:57.214 + [[ -f /var/jenkins/workspace/autotest-per-patch_6/unittest-main-docker-autotest_19878/build.log ]] 01:02:57.214 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_6/unittest-main-docker-autotest_19878/build.log 01:02:57.214 + backtraces= 01:02:57.214 + [[ -n '' ]] 01:02:57.214 + for build in "${build_log_list[@]}" 01:02:57.214 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_6/unittest-valgrind-docker-autotest_19881/build.log 01:02:57.214 + local build_log job_name start_pattern end_pattern backtraces 01:02:57.214 + build_log=/var/jenkins/workspace/autotest-per-patch_6/unittest-valgrind-docker-autotest_19881/build.log 01:02:57.214 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/unittest-valgrind-docker-autotest_19881/build.log 01:02:57.214 ++ basename /var/jenkins/workspace/autotest-per-patch_6/unittest-valgrind-docker-autotest_19881 01:02:57.214 + job_name=unittest-valgrind-docker-autotest_19881 01:02:57.214 + start_pattern='Backtrace start' 01:02:57.214 + end_pattern='Backtrace end' 01:02:57.214 + [[ -f /var/jenkins/workspace/autotest-per-patch_6/unittest-valgrind-docker-autotest_19881/build.log ]] 01:02:57.214 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_6/unittest-valgrind-docker-autotest_19881/build.log 01:02:57.214 + backtraces= 01:02:57.214 + [[ -n '' ]] 01:02:57.214 + for build in "${build_log_list[@]}" 01:02:57.214 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-uring-vg-autotest_77422/build.log 01:02:57.214 + local build_log job_name start_pattern end_pattern backtraces 01:02:57.214 + build_log=/var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-uring-vg-autotest_77422/build.log 01:02:57.214 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-uring-vg-autotest_77422/build.log 01:02:57.214 ++ basename /var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-uring-vg-autotest_77422 01:02:57.214 + job_name=nvmf-tcp-uring-vg-autotest_77422 01:02:57.214 + start_pattern='Backtrace start' 01:02:57.214 + end_pattern='Backtrace end' 01:02:57.214 + [[ -f /var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-uring-vg-autotest_77422/build.log ]] 01:02:57.214 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-uring-vg-autotest_77422/build.log 01:02:57.214 + backtraces= 01:02:57.214 + [[ -n '' ]] 01:02:57.214 + for build in "${build_log_list[@]}" 01:02:57.214 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_6/autobuild-external-vg-autotest_19840/build.log 01:02:57.214 + local build_log job_name start_pattern end_pattern backtraces 01:02:57.214 + build_log=/var/jenkins/workspace/autotest-per-patch_6/autobuild-external-vg-autotest_19840/build.log 01:02:57.214 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/autobuild-external-vg-autotest_19840/build.log 01:02:57.214 ++ basename /var/jenkins/workspace/autotest-per-patch_6/autobuild-external-vg-autotest_19840 01:02:57.214 + job_name=autobuild-external-vg-autotest_19840 01:02:57.214 + start_pattern='Backtrace start' 01:02:57.214 + end_pattern='Backtrace end' 01:02:57.214 + [[ -f /var/jenkins/workspace/autotest-per-patch_6/autobuild-external-vg-autotest_19840/build.log ]] 01:02:57.214 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_6/autobuild-external-vg-autotest_19840/build.log 01:02:57.214 + backtraces= 01:02:57.214 + [[ -n '' ]] 01:02:57.214 + for build in "${build_log_list[@]}" 01:02:57.214 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_6/packaging-docker-autotest_19879/build.log 01:02:57.214 + local build_log job_name start_pattern end_pattern backtraces 01:02:57.214 + build_log=/var/jenkins/workspace/autotest-per-patch_6/packaging-docker-autotest_19879/build.log 01:02:57.214 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/packaging-docker-autotest_19879/build.log 01:02:57.214 ++ basename /var/jenkins/workspace/autotest-per-patch_6/packaging-docker-autotest_19879 01:02:57.214 + job_name=packaging-docker-autotest_19879 01:02:57.214 + start_pattern='Backtrace start' 01:02:57.214 + end_pattern='Backtrace end' 01:02:57.214 + [[ -f /var/jenkins/workspace/autotest-per-patch_6/packaging-docker-autotest_19879/build.log ]] 01:02:57.214 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_6/packaging-docker-autotest_19879/build.log 01:02:57.214 + backtraces= 01:02:57.214 + [[ -n '' ]] 01:02:57.214 + for build in "${build_log_list[@]}" 01:02:57.214 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_6/vfio-user-phy-autotest_26225/build.log 01:02:57.214 + local build_log job_name start_pattern end_pattern backtraces 01:02:57.214 + build_log=/var/jenkins/workspace/autotest-per-patch_6/vfio-user-phy-autotest_26225/build.log 01:02:57.214 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/vfio-user-phy-autotest_26225/build.log 01:02:57.214 ++ basename /var/jenkins/workspace/autotest-per-patch_6/vfio-user-phy-autotest_26225 01:02:57.214 + job_name=vfio-user-phy-autotest_26225 01:02:57.214 + start_pattern='Backtrace start' 01:02:57.214 + end_pattern='Backtrace end' 01:02:57.214 + [[ -f /var/jenkins/workspace/autotest-per-patch_6/vfio-user-phy-autotest_26225/build.log ]] 01:02:57.214 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_6/vfio-user-phy-autotest_26225/build.log 01:02:57.214 + backtraces= 01:02:57.214 + [[ -n '' ]] 01:02:57.214 + for build in "${build_log_list[@]}" 01:02:57.214 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_6/vhost-initiator-vg-autotest_77517/build.log 01:02:57.214 + local build_log job_name start_pattern end_pattern backtraces 01:02:57.214 + build_log=/var/jenkins/workspace/autotest-per-patch_6/vhost-initiator-vg-autotest_77517/build.log 01:02:57.214 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/vhost-initiator-vg-autotest_77517/build.log 01:02:57.214 ++ basename /var/jenkins/workspace/autotest-per-patch_6/vhost-initiator-vg-autotest_77517 01:02:57.214 + job_name=vhost-initiator-vg-autotest_77517 01:02:57.214 + start_pattern='Backtrace start' 01:02:57.214 + end_pattern='Backtrace end' 01:02:57.215 + [[ -f /var/jenkins/workspace/autotest-per-patch_6/vhost-initiator-vg-autotest_77517/build.log ]] 01:02:57.215 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_6/vhost-initiator-vg-autotest_77517/build.log 01:02:57.215 + backtraces= 01:02:57.215 + [[ -n '' ]] 01:02:57.215 + for build in "${build_log_list[@]}" 01:02:57.215 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_6/nvme-cmb-pmr-vg-autotest_78620/build.log 01:02:57.215 + local build_log job_name start_pattern end_pattern backtraces 01:02:57.215 + build_log=/var/jenkins/workspace/autotest-per-patch_6/nvme-cmb-pmr-vg-autotest_78620/build.log 01:02:57.215 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/nvme-cmb-pmr-vg-autotest_78620/build.log 01:02:57.215 ++ basename /var/jenkins/workspace/autotest-per-patch_6/nvme-cmb-pmr-vg-autotest_78620 01:02:57.215 + job_name=nvme-cmb-pmr-vg-autotest_78620 01:02:57.215 + start_pattern='Backtrace start' 01:02:57.215 + end_pattern='Backtrace end' 01:02:57.215 + [[ -f /var/jenkins/workspace/autotest-per-patch_6/nvme-cmb-pmr-vg-autotest_78620/build.log ]] 01:02:57.215 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_6/nvme-cmb-pmr-vg-autotest_78620/build.log 01:02:57.215 + backtraces= 01:02:57.215 + [[ -n '' ]] 01:02:57.215 + for build in "${build_log_list[@]}" 01:02:57.215 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_6/short-fuzz-phy-autotest_26214/build.log 01:02:57.215 + local build_log job_name start_pattern end_pattern backtraces 01:02:57.215 + build_log=/var/jenkins/workspace/autotest-per-patch_6/short-fuzz-phy-autotest_26214/build.log 01:02:57.215 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/short-fuzz-phy-autotest_26214/build.log 01:02:57.215 ++ basename /var/jenkins/workspace/autotest-per-patch_6/short-fuzz-phy-autotest_26214 01:02:57.215 + job_name=short-fuzz-phy-autotest_26214 01:02:57.215 + start_pattern='Backtrace start' 01:02:57.215 + end_pattern='Backtrace end' 01:02:57.215 + [[ -f /var/jenkins/workspace/autotest-per-patch_6/short-fuzz-phy-autotest_26214/build.log ]] 01:02:57.215 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_6/short-fuzz-phy-autotest_26214/build.log 01:02:57.215 + backtraces= 01:02:57.215 + [[ -n '' ]] 01:02:57.215 + run_flamegraph 01:02:57.215 + create_timing_file 01:02:57.215 + local array file 01:02:57.215 + array=($(find $WORKSPACE -type f -name 'timing.txt')) 01:02:57.215 ++ find /var/jenkins/workspace/autotest-per-patch_6 -type f -name timing.txt 01:02:57.215 + timing_dir=/var/jenkins/workspace/autotest-per-patch_6/post_process 01:02:57.215 + mkdir -p /var/jenkins/workspace/autotest-per-patch_6/post_process 01:02:57.215 + timing_file=/var/jenkins/workspace/autotest-per-patch_6/post_process/total_timing.txt 01:02:57.215 + for file in "${array[@]}" 01:02:57.215 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_6/BlobFS-phy-autotest_26223/timing.txt 01:02:57.215 + local job_file job_name 01:02:57.215 + job_file=/var/jenkins/workspace/autotest-per-patch_6/BlobFS-phy-autotest_26223/timing.txt 01:02:57.215 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/BlobFS-phy-autotest_26223/timing.txt 01:02:57.215 ++ basename /var/jenkins/workspace/autotest-per-patch_6/BlobFS-phy-autotest_26223 01:02:57.215 + job_name=BlobFS-phy-autotest_26223 01:02:57.215 + sed 's/^/BlobFS-phy-autotest_26223;autorun;/' /var/jenkins/workspace/autotest-per-patch_6/BlobFS-phy-autotest_26223/timing.txt 01:02:57.215 + for file in "${array[@]}" 01:02:57.215 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_6/vhost-phy-autotest_26242/timing.txt 01:02:57.215 + local job_file job_name 01:02:57.215 + job_file=/var/jenkins/workspace/autotest-per-patch_6/vhost-phy-autotest_26242/timing.txt 01:02:57.215 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/vhost-phy-autotest_26242/timing.txt 01:02:57.215 ++ basename /var/jenkins/workspace/autotest-per-patch_6/vhost-phy-autotest_26242 01:02:57.215 + job_name=vhost-phy-autotest_26242 01:02:57.215 + sed 's/^/vhost-phy-autotest_26242;autorun;/' /var/jenkins/workspace/autotest-per-patch_6/vhost-phy-autotest_26242/timing.txt 01:02:57.215 + for file in "${array[@]}" 01:02:57.215 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_6/rocky9-vg-autotest_16107/timing.txt 01:02:57.215 + local job_file job_name 01:02:57.215 + job_file=/var/jenkins/workspace/autotest-per-patch_6/rocky9-vg-autotest_16107/timing.txt 01:02:57.215 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/rocky9-vg-autotest_16107/timing.txt 01:02:57.215 ++ basename /var/jenkins/workspace/autotest-per-patch_6/rocky9-vg-autotest_16107 01:02:57.215 + job_name=rocky9-vg-autotest_16107 01:02:57.215 + sed 's/^/rocky9-vg-autotest_16107;autorun;/' /var/jenkins/workspace/autotest-per-patch_6/rocky9-vg-autotest_16107/timing.txt 01:02:57.215 + for file in "${array[@]}" 01:02:57.215 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_6/doc-docker-autotest_22340/timing.txt 01:02:57.215 + local job_file job_name 01:02:57.215 + job_file=/var/jenkins/workspace/autotest-per-patch_6/doc-docker-autotest_22340/timing.txt 01:02:57.215 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/doc-docker-autotest_22340/timing.txt 01:02:57.215 ++ basename /var/jenkins/workspace/autotest-per-patch_6/doc-docker-autotest_22340 01:02:57.215 + job_name=doc-docker-autotest_22340 01:02:57.215 + sed 's/^/doc-docker-autotest_22340;autorun;/' /var/jenkins/workspace/autotest-per-patch_6/doc-docker-autotest_22340/timing.txt 01:02:57.215 + for file in "${array[@]}" 01:02:57.215 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_6/unittest-clang-docker-autotest_19877/timing.txt 01:02:57.215 + local job_file job_name 01:02:57.215 + job_file=/var/jenkins/workspace/autotest-per-patch_6/unittest-clang-docker-autotest_19877/timing.txt 01:02:57.215 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/unittest-clang-docker-autotest_19877/timing.txt 01:02:57.215 ++ basename /var/jenkins/workspace/autotest-per-patch_6/unittest-clang-docker-autotest_19877 01:02:57.215 + job_name=unittest-clang-docker-autotest_19877 01:02:57.215 + sed 's/^/unittest-clang-docker-autotest_19877;autorun;/' /var/jenkins/workspace/autotest-per-patch_6/unittest-clang-docker-autotest_19877/timing.txt 01:02:57.215 + for file in "${array[@]}" 01:02:57.215 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_6/crypto-phy-autotest_26217/timing.txt 01:02:57.215 + local job_file job_name 01:02:57.215 + job_file=/var/jenkins/workspace/autotest-per-patch_6/crypto-phy-autotest_26217/timing.txt 01:02:57.215 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/crypto-phy-autotest_26217/timing.txt 01:02:57.215 ++ basename /var/jenkins/workspace/autotest-per-patch_6/crypto-phy-autotest_26217 01:02:57.215 + job_name=crypto-phy-autotest_26217 01:02:57.215 + sed 's/^/crypto-phy-autotest_26217;autorun;/' /var/jenkins/workspace/autotest-per-patch_6/crypto-phy-autotest_26217/timing.txt 01:02:57.215 + for file in "${array[@]}" 01:02:57.215 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_6/iscsi-uring-vg-autotest_77402/timing.txt 01:02:57.215 + local job_file job_name 01:02:57.215 + job_file=/var/jenkins/workspace/autotest-per-patch_6/iscsi-uring-vg-autotest_77402/timing.txt 01:02:57.215 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/iscsi-uring-vg-autotest_77402/timing.txt 01:02:57.215 ++ basename /var/jenkins/workspace/autotest-per-patch_6/iscsi-uring-vg-autotest_77402 01:02:57.215 + job_name=iscsi-uring-vg-autotest_77402 01:02:57.215 + sed 's/^/iscsi-uring-vg-autotest_77402;autorun;/' /var/jenkins/workspace/autotest-per-patch_6/iscsi-uring-vg-autotest_77402/timing.txt 01:02:57.215 + for file in "${array[@]}" 01:02:57.215 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_6/iscsi-vg-autotest_77535/timing.txt 01:02:57.215 + local job_file job_name 01:02:57.215 + job_file=/var/jenkins/workspace/autotest-per-patch_6/iscsi-vg-autotest_77535/timing.txt 01:02:57.215 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/iscsi-vg-autotest_77535/timing.txt 01:02:57.215 ++ basename /var/jenkins/workspace/autotest-per-patch_6/iscsi-vg-autotest_77535 01:02:57.215 + job_name=iscsi-vg-autotest_77535 01:02:57.215 + sed 's/^/iscsi-vg-autotest_77535;autorun;/' /var/jenkins/workspace/autotest-per-patch_6/iscsi-vg-autotest_77535/timing.txt 01:02:57.215 + for file in "${array[@]}" 01:02:57.215 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_6/zns-vg-autotest_76603/timing.txt 01:02:57.215 + local job_file job_name 01:02:57.215 + job_file=/var/jenkins/workspace/autotest-per-patch_6/zns-vg-autotest_76603/timing.txt 01:02:57.215 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/zns-vg-autotest_76603/timing.txt 01:02:57.215 ++ basename /var/jenkins/workspace/autotest-per-patch_6/zns-vg-autotest_76603 01:02:57.215 + job_name=zns-vg-autotest_76603 01:02:57.215 + sed 's/^/zns-vg-autotest_76603;autorun;/' /var/jenkins/workspace/autotest-per-patch_6/zns-vg-autotest_76603/timing.txt 01:02:57.215 + for file in "${array[@]}" 01:02:57.215 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_6/check-so-deps-docker-autotest_22173/timing.txt 01:02:57.215 + local job_file job_name 01:02:57.215 + job_file=/var/jenkins/workspace/autotest-per-patch_6/check-so-deps-docker-autotest_22173/timing.txt 01:02:57.215 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/check-so-deps-docker-autotest_22173/timing.txt 01:02:57.215 ++ basename /var/jenkins/workspace/autotest-per-patch_6/check-so-deps-docker-autotest_22173 01:02:57.215 + job_name=check-so-deps-docker-autotest_22173 01:02:57.215 + sed 's/^/check-so-deps-docker-autotest_22173;autorun;/' /var/jenkins/workspace/autotest-per-patch_6/check-so-deps-docker-autotest_22173/timing.txt 01:02:57.215 + for file in "${array[@]}" 01:02:57.215 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_6/scan-build-docker-autotest_19880/timing.txt 01:02:57.215 + local job_file job_name 01:02:57.215 + job_file=/var/jenkins/workspace/autotest-per-patch_6/scan-build-docker-autotest_19880/timing.txt 01:02:57.215 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/scan-build-docker-autotest_19880/timing.txt 01:02:57.215 ++ basename /var/jenkins/workspace/autotest-per-patch_6/scan-build-docker-autotest_19880 01:02:57.215 + job_name=scan-build-docker-autotest_19880 01:02:57.215 + sed 's/^/scan-build-docker-autotest_19880;autorun;/' /var/jenkins/workspace/autotest-per-patch_6/scan-build-docker-autotest_19880/timing.txt 01:02:57.215 + for file in "${array[@]}" 01:02:57.215 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_6/check-format-docker-autotest_22160/timing.txt 01:02:57.215 + local job_file job_name 01:02:57.215 + job_file=/var/jenkins/workspace/autotest-per-patch_6/check-format-docker-autotest_22160/timing.txt 01:02:57.215 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/check-format-docker-autotest_22160/timing.txt 01:02:57.215 ++ basename /var/jenkins/workspace/autotest-per-patch_6/check-format-docker-autotest_22160 01:02:57.215 + job_name=check-format-docker-autotest_22160 01:02:57.215 + sed 's/^/check-format-docker-autotest_22160;autorun;/' /var/jenkins/workspace/autotest-per-patch_6/check-format-docker-autotest_22160/timing.txt 01:02:57.215 + for file in "${array[@]}" 01:02:57.215 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-vg-autotest_77488/timing.txt 01:02:57.215 + local job_file job_name 01:02:57.215 + job_file=/var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-vg-autotest_77488/timing.txt 01:02:57.215 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-vg-autotest_77488/timing.txt 01:02:57.215 ++ basename /var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-vg-autotest_77488 01:02:57.215 + job_name=nvmf-tcp-vg-autotest_77488 01:02:57.215 + sed 's/^/nvmf-tcp-vg-autotest_77488;autorun;/' /var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-vg-autotest_77488/timing.txt 01:02:57.215 + for file in "${array[@]}" 01:02:57.215 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_6/nvme-phy-autotest_72389/timing.txt 01:02:57.215 + local job_file job_name 01:02:57.215 + job_file=/var/jenkins/workspace/autotest-per-patch_6/nvme-phy-autotest_72389/timing.txt 01:02:57.215 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/nvme-phy-autotest_72389/timing.txt 01:02:57.215 ++ basename /var/jenkins/workspace/autotest-per-patch_6/nvme-phy-autotest_72389 01:02:57.215 + job_name=nvme-phy-autotest_72389 01:02:57.216 + sed 's/^/nvme-phy-autotest_72389;autorun;/' /var/jenkins/workspace/autotest-per-patch_6/nvme-phy-autotest_72389/timing.txt 01:02:57.216 + for file in "${array[@]}" 01:02:57.216 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_6/freebsd-vg-autotest_59140/timing.txt 01:02:57.216 + local job_file job_name 01:02:57.216 + job_file=/var/jenkins/workspace/autotest-per-patch_6/freebsd-vg-autotest_59140/timing.txt 01:02:57.216 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/freebsd-vg-autotest_59140/timing.txt 01:02:57.216 ++ basename /var/jenkins/workspace/autotest-per-patch_6/freebsd-vg-autotest_59140 01:02:57.216 + job_name=freebsd-vg-autotest_59140 01:02:57.216 + sed 's/^/freebsd-vg-autotest_59140;autorun;/' /var/jenkins/workspace/autotest-per-patch_6/freebsd-vg-autotest_59140/timing.txt 01:02:57.216 + for file in "${array[@]}" 01:02:57.216 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-phy-autotest_72348/timing.txt 01:02:57.216 + local job_file job_name 01:02:57.216 + job_file=/var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-phy-autotest_72348/timing.txt 01:02:57.216 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-phy-autotest_72348/timing.txt 01:02:57.216 ++ basename /var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-phy-autotest_72348 01:02:57.216 + job_name=nvmf-tcp-phy-autotest_72348 01:02:57.216 + sed 's/^/nvmf-tcp-phy-autotest_72348;autorun;/' /var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-phy-autotest_72348/timing.txt 01:02:57.216 + for file in "${array[@]}" 01:02:57.216 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_6/lvol-vg-autotest_77446/timing.txt 01:02:57.216 + local job_file job_name 01:02:57.216 + job_file=/var/jenkins/workspace/autotest-per-patch_6/lvol-vg-autotest_77446/timing.txt 01:02:57.216 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/lvol-vg-autotest_77446/timing.txt 01:02:57.216 ++ basename /var/jenkins/workspace/autotest-per-patch_6/lvol-vg-autotest_77446 01:02:57.216 + job_name=lvol-vg-autotest_77446 01:02:57.216 + sed 's/^/lvol-vg-autotest_77446;autorun;/' /var/jenkins/workspace/autotest-per-patch_6/lvol-vg-autotest_77446/timing.txt 01:02:57.216 + for file in "${array[@]}" 01:02:57.216 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_6/build-files-docker-autotest_22149/timing.txt 01:02:57.216 + local job_file job_name 01:02:57.216 + job_file=/var/jenkins/workspace/autotest-per-patch_6/build-files-docker-autotest_22149/timing.txt 01:02:57.216 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/build-files-docker-autotest_22149/timing.txt 01:02:57.216 ++ basename /var/jenkins/workspace/autotest-per-patch_6/build-files-docker-autotest_22149 01:02:57.216 + job_name=build-files-docker-autotest_22149 01:02:57.216 + sed 's/^/build-files-docker-autotest_22149;autorun;/' /var/jenkins/workspace/autotest-per-patch_6/build-files-docker-autotest_22149/timing.txt 01:02:57.216 + for file in "${array[@]}" 01:02:57.216 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_6/centos7-vg-autotest_73676/timing.txt 01:02:57.216 + local job_file job_name 01:02:57.216 + job_file=/var/jenkins/workspace/autotest-per-patch_6/centos7-vg-autotest_73676/timing.txt 01:02:57.216 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/centos7-vg-autotest_73676/timing.txt 01:02:57.216 ++ basename /var/jenkins/workspace/autotest-per-patch_6/centos7-vg-autotest_73676 01:02:57.216 + job_name=centos7-vg-autotest_73676 01:02:57.216 + sed 's/^/centos7-vg-autotest_73676;autorun;/' /var/jenkins/workspace/autotest-per-patch_6/centos7-vg-autotest_73676/timing.txt 01:02:57.216 + for file in "${array[@]}" 01:02:57.216 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_6/nvme-vg-autotest_77497/timing.txt 01:02:57.216 + local job_file job_name 01:02:57.216 + job_file=/var/jenkins/workspace/autotest-per-patch_6/nvme-vg-autotest_77497/timing.txt 01:02:57.216 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/nvme-vg-autotest_77497/timing.txt 01:02:57.216 ++ basename /var/jenkins/workspace/autotest-per-patch_6/nvme-vg-autotest_77497 01:02:57.216 + job_name=nvme-vg-autotest_77497 01:02:57.216 + sed 's/^/nvme-vg-autotest_77497;autorun;/' /var/jenkins/workspace/autotest-per-patch_6/nvme-vg-autotest_77497/timing.txt 01:02:57.216 + for file in "${array[@]}" 01:02:57.216 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_6/dsa-phy-autotest_4917/timing.txt 01:02:57.216 + local job_file job_name 01:02:57.216 + job_file=/var/jenkins/workspace/autotest-per-patch_6/dsa-phy-autotest_4917/timing.txt 01:02:57.216 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/dsa-phy-autotest_4917/timing.txt 01:02:57.216 ++ basename /var/jenkins/workspace/autotest-per-patch_6/dsa-phy-autotest_4917 01:02:57.216 + job_name=dsa-phy-autotest_4917 01:02:57.216 + sed 's/^/dsa-phy-autotest_4917;autorun;/' /var/jenkins/workspace/autotest-per-patch_6/dsa-phy-autotest_4917/timing.txt 01:02:57.216 + for file in "${array[@]}" 01:02:57.216 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_6/ubuntu22-vg-autotest_37830/timing.txt 01:02:57.216 + local job_file job_name 01:02:57.216 + job_file=/var/jenkins/workspace/autotest-per-patch_6/ubuntu22-vg-autotest_37830/timing.txt 01:02:57.216 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/ubuntu22-vg-autotest_37830/timing.txt 01:02:57.216 ++ basename /var/jenkins/workspace/autotest-per-patch_6/ubuntu22-vg-autotest_37830 01:02:57.216 + job_name=ubuntu22-vg-autotest_37830 01:02:57.216 + sed 's/^/ubuntu22-vg-autotest_37830;autorun;/' /var/jenkins/workspace/autotest-per-patch_6/ubuntu22-vg-autotest_37830/timing.txt 01:02:57.216 + for file in "${array[@]}" 01:02:57.216 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_6/ubuntu20-vg-autotest_73816/timing.txt 01:02:57.216 + local job_file job_name 01:02:57.216 + job_file=/var/jenkins/workspace/autotest-per-patch_6/ubuntu20-vg-autotest_73816/timing.txt 01:02:57.216 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/ubuntu20-vg-autotest_73816/timing.txt 01:02:57.216 ++ basename /var/jenkins/workspace/autotest-per-patch_6/ubuntu20-vg-autotest_73816 01:02:57.216 + job_name=ubuntu20-vg-autotest_73816 01:02:57.216 + sed 's/^/ubuntu20-vg-autotest_73816;autorun;/' /var/jenkins/workspace/autotest-per-patch_6/ubuntu20-vg-autotest_73816/timing.txt 01:02:57.216 + for file in "${array[@]}" 01:02:57.216 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_6/nvmf-phy-autotest_72461/timing.txt 01:02:57.216 + local job_file job_name 01:02:57.216 + job_file=/var/jenkins/workspace/autotest-per-patch_6/nvmf-phy-autotest_72461/timing.txt 01:02:57.216 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/nvmf-phy-autotest_72461/timing.txt 01:02:57.216 ++ basename /var/jenkins/workspace/autotest-per-patch_6/nvmf-phy-autotest_72461 01:02:57.216 + job_name=nvmf-phy-autotest_72461 01:02:57.216 + sed 's/^/nvmf-phy-autotest_72461;autorun;/' /var/jenkins/workspace/autotest-per-patch_6/nvmf-phy-autotest_72461/timing.txt 01:02:57.216 + for file in "${array[@]}" 01:02:57.216 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_6/unittest-main-docker-autotest_19878/timing.txt 01:02:57.216 + local job_file job_name 01:02:57.216 + job_file=/var/jenkins/workspace/autotest-per-patch_6/unittest-main-docker-autotest_19878/timing.txt 01:02:57.216 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/unittest-main-docker-autotest_19878/timing.txt 01:02:57.216 ++ basename /var/jenkins/workspace/autotest-per-patch_6/unittest-main-docker-autotest_19878 01:02:57.216 + job_name=unittest-main-docker-autotest_19878 01:02:57.216 + sed 's/^/unittest-main-docker-autotest_19878;autorun;/' /var/jenkins/workspace/autotest-per-patch_6/unittest-main-docker-autotest_19878/timing.txt 01:02:57.216 + for file in "${array[@]}" 01:02:57.216 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_6/unittest-valgrind-docker-autotest_19881/timing.txt 01:02:57.216 + local job_file job_name 01:02:57.216 + job_file=/var/jenkins/workspace/autotest-per-patch_6/unittest-valgrind-docker-autotest_19881/timing.txt 01:02:57.216 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/unittest-valgrind-docker-autotest_19881/timing.txt 01:02:57.216 ++ basename /var/jenkins/workspace/autotest-per-patch_6/unittest-valgrind-docker-autotest_19881 01:02:57.216 + job_name=unittest-valgrind-docker-autotest_19881 01:02:57.216 + sed 's/^/unittest-valgrind-docker-autotest_19881;autorun;/' /var/jenkins/workspace/autotest-per-patch_6/unittest-valgrind-docker-autotest_19881/timing.txt 01:02:57.216 + for file in "${array[@]}" 01:02:57.216 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-uring-vg-autotest_77422/timing.txt 01:02:57.216 + local job_file job_name 01:02:57.216 + job_file=/var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-uring-vg-autotest_77422/timing.txt 01:02:57.216 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-uring-vg-autotest_77422/timing.txt 01:02:57.216 ++ basename /var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-uring-vg-autotest_77422 01:02:57.216 + job_name=nvmf-tcp-uring-vg-autotest_77422 01:02:57.216 + sed 's/^/nvmf-tcp-uring-vg-autotest_77422;autorun;/' /var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-uring-vg-autotest_77422/timing.txt 01:02:57.216 + for file in "${array[@]}" 01:02:57.216 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_6/autobuild-external-vg-autotest_19840/timing.txt 01:02:57.216 + local job_file job_name 01:02:57.216 + job_file=/var/jenkins/workspace/autotest-per-patch_6/autobuild-external-vg-autotest_19840/timing.txt 01:02:57.216 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/autobuild-external-vg-autotest_19840/timing.txt 01:02:57.216 ++ basename /var/jenkins/workspace/autotest-per-patch_6/autobuild-external-vg-autotest_19840 01:02:57.216 + job_name=autobuild-external-vg-autotest_19840 01:02:57.216 + sed 's/^/autobuild-external-vg-autotest_19840;autorun;/' /var/jenkins/workspace/autotest-per-patch_6/autobuild-external-vg-autotest_19840/timing.txt 01:02:57.216 + for file in "${array[@]}" 01:02:57.216 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_6/packaging-docker-autotest_19879/timing.txt 01:02:57.216 + local job_file job_name 01:02:57.216 + job_file=/var/jenkins/workspace/autotest-per-patch_6/packaging-docker-autotest_19879/timing.txt 01:02:57.216 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/packaging-docker-autotest_19879/timing.txt 01:02:57.216 ++ basename /var/jenkins/workspace/autotest-per-patch_6/packaging-docker-autotest_19879 01:02:57.216 + job_name=packaging-docker-autotest_19879 01:02:57.216 + sed 's/^/packaging-docker-autotest_19879;autorun;/' /var/jenkins/workspace/autotest-per-patch_6/packaging-docker-autotest_19879/timing.txt 01:02:57.216 + for file in "${array[@]}" 01:02:57.216 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_6/vfio-user-phy-autotest_26225/timing.txt 01:02:57.216 + local job_file job_name 01:02:57.216 + job_file=/var/jenkins/workspace/autotest-per-patch_6/vfio-user-phy-autotest_26225/timing.txt 01:02:57.216 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/vfio-user-phy-autotest_26225/timing.txt 01:02:57.216 ++ basename /var/jenkins/workspace/autotest-per-patch_6/vfio-user-phy-autotest_26225 01:02:57.216 + job_name=vfio-user-phy-autotest_26225 01:02:57.216 + sed 's/^/vfio-user-phy-autotest_26225;autorun;/' /var/jenkins/workspace/autotest-per-patch_6/vfio-user-phy-autotest_26225/timing.txt 01:02:57.216 + for file in "${array[@]}" 01:02:57.216 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_6/vhost-initiator-vg-autotest_77517/timing.txt 01:02:57.216 + local job_file job_name 01:02:57.216 + job_file=/var/jenkins/workspace/autotest-per-patch_6/vhost-initiator-vg-autotest_77517/timing.txt 01:02:57.216 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/vhost-initiator-vg-autotest_77517/timing.txt 01:02:57.216 ++ basename /var/jenkins/workspace/autotest-per-patch_6/vhost-initiator-vg-autotest_77517 01:02:57.216 + job_name=vhost-initiator-vg-autotest_77517 01:02:57.216 + sed 's/^/vhost-initiator-vg-autotest_77517;autorun;/' /var/jenkins/workspace/autotest-per-patch_6/vhost-initiator-vg-autotest_77517/timing.txt 01:02:57.216 + for file in "${array[@]}" 01:02:57.216 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_6/nvme-cmb-pmr-vg-autotest_78620/timing.txt 01:02:57.216 + local job_file job_name 01:02:57.216 + job_file=/var/jenkins/workspace/autotest-per-patch_6/nvme-cmb-pmr-vg-autotest_78620/timing.txt 01:02:57.216 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/nvme-cmb-pmr-vg-autotest_78620/timing.txt 01:02:57.217 ++ basename /var/jenkins/workspace/autotest-per-patch_6/nvme-cmb-pmr-vg-autotest_78620 01:02:57.217 + job_name=nvme-cmb-pmr-vg-autotest_78620 01:02:57.217 + sed 's/^/nvme-cmb-pmr-vg-autotest_78620;autorun;/' /var/jenkins/workspace/autotest-per-patch_6/nvme-cmb-pmr-vg-autotest_78620/timing.txt 01:02:57.217 + for file in "${array[@]}" 01:02:57.217 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_6/short-fuzz-phy-autotest_26214/timing.txt 01:02:57.217 + local job_file job_name 01:02:57.217 + job_file=/var/jenkins/workspace/autotest-per-patch_6/short-fuzz-phy-autotest_26214/timing.txt 01:02:57.217 +++ dirname /var/jenkins/workspace/autotest-per-patch_6/short-fuzz-phy-autotest_26214/timing.txt 01:02:57.217 ++ basename /var/jenkins/workspace/autotest-per-patch_6/short-fuzz-phy-autotest_26214 01:02:57.217 + job_name=short-fuzz-phy-autotest_26214 01:02:57.217 + sed 's/^/short-fuzz-phy-autotest_26214;autorun;/' /var/jenkins/workspace/autotest-per-patch_6/short-fuzz-phy-autotest_26214/timing.txt 01:02:57.217 + /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/autotest-per-patch_6/post_process/total_timing.txt 01:02:57.474 + run_autorun_post 01:02:57.474 + s_opt= 01:02:57.474 + [[ '' == true ]] 01:02:57.474 + spdk/autorun_post.py -d ./ -r ./spdk 01:03:01.655 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_6/spdk/module/blobfs/bdev/blobfs_bdev.c:303 01:03:03.027 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_6/spdk/module/blobfs/bdev/blobfs_bdev.c:303 01:03:04.924 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_6/spdk/module/blobfs/bdev/blobfs_bdev.c:303 01:03:08.202 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_6/spdk/module/blobfs/bdev/blobfs_bdev.c:303 01:03:10.728 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_6/spdk/module/blobfs/bdev/blobfs_bdev.c:303 01:03:12.626 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_6/spdk/module/blobfs/bdev/blobfs_bdev.c:303 01:03:15.150 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_6/spdk/module/bdev/nvme/bdev_mdns_client.c:582 01:03:15.150 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_6/spdk/module/bdev/nvme/bdev_mdns_client.c:456 01:03:15.150 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_6/spdk/module/bdev/nvme/bdev_mdns_client.c:613 01:03:15.150 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_6/spdk/module/bdev/nvme/bdev_mdns_client.c:561 01:03:15.150 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_6/spdk/module/blobfs/bdev/blobfs_bdev.c:303 01:03:18.435 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_6/spdk/module/blobfs/bdev/blobfs_bdev.c:303 01:03:22.625 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_6/spdk/module/blobfs/bdev/blobfs_bdev.c:303 01:03:25.152 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_6/spdk/module/blobfs/bdev/blobfs_bdev.c:303 01:03:27.773 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_6/spdk/lib/util/xor.c:120 01:03:27.773 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_6/spdk/module/blobfs/bdev/blobfs_bdev.c:303 01:03:27.773 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_6/spdk/lib/util/crc16.c:628 01:03:27.773 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_6/spdk/lib/util/crc16.c:634 01:03:28.369 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_6/spdk/lib/util/crc64.c:165 01:03:29.300 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_6/spdk/lib/util/crc32c.c:21 01:03:31.217 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_6/spdk/module/blobfs/bdev/blobfs_bdev.c:303 01:03:35.481 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_6/spdk/module/blobfs/bdev/blobfs_bdev.c:303 01:03:39.438 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_6/spdk/module/blobfs/bdev/blobfs_bdev.c:303 01:03:44.705 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_6/spdk/module/blobfs/bdev/blobfs_bdev.c:303 01:03:48.164 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_6/spdk/module/blobfs/bdev/blobfs_bdev.c:303 01:03:52.905 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_6/spdk/module/blobfs/bdev/blobfs_bdev.c:303 01:03:54.179 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_6/spdk/module/blobfs/bdev/blobfs_bdev.c:303 01:04:12.551 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_6/spdk/endian.h! 01:04:12.551 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_6/spdk/nvme.h! 01:04:12.551 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_6/spdk/util.h! 01:04:12.551 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_6/spdk/nvmf_transport.h! 01:04:12.551 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_6/spdk/thread.h! 01:04:12.551 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_6/spdk/trace.h! 01:04:12.551 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_6/spdk/base64.h! 01:04:12.551 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_6/spdk/bdev_module.h! 01:04:12.551 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_6/spdk/nvme_spec.h! 01:04:12.551 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_6/spdk/mmio.h! 01:04:12.551 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_6/spdk/histogram_data.h! 01:04:14.447 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_6/spdk/histogram_data.h/histogram_ut.c! 01:04:16.343 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_6/spdk/lib/env_ocf/include/ocf/ocf_io.h! 01:04:16.343 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_6/spdk/lib/env_ocf/include/ocf/ocf_core.h! 01:04:16.343 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_6/spdk/lib/env_ocf/include/ocf/ocf_mngt.h! 01:04:31.217 -----Begin Post Process Script------ 01:04:31.217 /var/jenkins/workspace/autotest-per-patch_6/BlobFS-phy-autotest_26223/cov_total.info 01:04:31.217 /var/jenkins/workspace/autotest-per-patch_6/vhost-phy-autotest_26242/cov_total.info 01:04:31.217 /var/jenkins/workspace/autotest-per-patch_6/rocky9-vg-autotest_16107/cov_total.info 01:04:31.218 /var/jenkins/workspace/autotest-per-patch_6/crypto-phy-autotest_26217/cov_total.info 01:04:31.218 /var/jenkins/workspace/autotest-per-patch_6/iscsi-uring-vg-autotest_77402/cov_total.info 01:04:31.218 /var/jenkins/workspace/autotest-per-patch_6/iscsi-vg-autotest_77535/cov_total.info 01:04:31.218 /var/jenkins/workspace/autotest-per-patch_6/zns-vg-autotest_76603/cov_total.info 01:04:31.218 /var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-vg-autotest_77488/cov_total.info 01:04:31.218 /var/jenkins/workspace/autotest-per-patch_6/nvme-phy-autotest_72389/cov_total.info 01:04:31.218 /var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-phy-autotest_72348/cov_total.info 01:04:31.218 /var/jenkins/workspace/autotest-per-patch_6/lvol-vg-autotest_77446/cov_total.info 01:04:31.218 /var/jenkins/workspace/autotest-per-patch_6/centos7-vg-autotest_73676/cov_total.info 01:04:31.218 /var/jenkins/workspace/autotest-per-patch_6/dsa-phy-autotest_4917/cov_total.info 01:04:31.218 /var/jenkins/workspace/autotest-per-patch_6/ubuntu22-vg-autotest_37830/cov_total.info 01:04:31.218 /var/jenkins/workspace/autotest-per-patch_6/nvmf-phy-autotest_72461/cov_total.info 01:04:31.218 /var/jenkins/workspace/autotest-per-patch_6/nvmf-tcp-uring-vg-autotest_77422/cov_total.info 01:04:31.218 /var/jenkins/workspace/autotest-per-patch_6/vfio-user-phy-autotest_26225/cov_total.info 01:04:31.218 /var/jenkins/workspace/autotest-per-patch_6/vhost-initiator-vg-autotest_77517/cov_total.info 01:04:31.218 /var/jenkins/workspace/autotest-per-patch_6/nvme-cmb-pmr-vg-autotest_78620/cov_total.info 01:04:31.218 01:04:31.218 01:04:31.218 -----Tests Executed in Build------ 01:04:31.218 accel 01:04:31.218 accel_assign_opcode 01:04:31.218 accel_cdev_comp 01:04:31.218 accel_cdev_decmop_full 01:04:31.218 accel_cdev_decomp 01:04:31.218 accel_cdev_decomp_full_mcore 01:04:31.218 accel_cdev_decomp_full_mthread 01:04:31.218 accel_cdev_decomp_mcore 01:04:31.218 accel_cdev_decomp_mthread 01:04:31.218 accel_comp 01:04:31.218 accel_compare 01:04:31.218 accel_compress_verify 01:04:31.218 accel_copy 01:04:31.218 accel_copy_crc32c 01:04:31.218 accel_copy_crc32c_C2 01:04:31.218 accel_crc32c 01:04:31.218 accel_crc32c_C2 01:04:31.218 accel_decmop_full 01:04:31.218 accel_decomp 01:04:31.218 accel_decomp_full_mcore 01:04:31.218 accel_decomp_full_mthread 01:04:31.218 accel_decomp_mcore 01:04:31.218 accel_decomp_mthread 01:04:31.218 accel_dif_functional_tests 01:04:31.218 accel_dif_generate 01:04:31.218 accel_dif_generate_copy 01:04:31.218 accel_dif_verify 01:04:31.218 accel_dualcast 01:04:31.218 accel_fill 01:04:31.218 accel_help 01:04:31.218 accel_missing_filename 01:04:31.218 accel_negative_buffers 01:04:31.218 accel_rpc 01:04:31.218 accel_scan_dsa_modules 01:04:31.218 accel_scan_iaa_modules 01:04:31.218 accel_wrong_workload 01:04:31.218 accel_xor 01:04:31.218 acl 01:04:31.218 alias_rpc 01:04:31.218 allowed 01:04:31.218 app_cmdline 01:04:31.218 app_repeat 01:04:31.218 asan 01:04:31.218 autobuild 01:04:31.218 autobuild_build_doc 01:04:31.218 autobuild_check_dpdk_pci_api 01:04:31.218 autobuild_check_format 01:04:31.218 autobuild_check_so_deps 01:04:31.218 autobuild_external_code 01:04:31.218 autobuild_generated_files_check 01:04:31.218 autobuild_generated_files_check_post_clean 01:04:31.218 autobuild_header_dependency_check 01:04:31.218 autobuild_llvm_precompile 01:04:31.218 autobuild_make_install 01:04:31.218 autobuild_make_uninstall 01:04:31.218 autobuild_ocf_precompile 01:04:31.218 bdev_bounds 01:04:31.218 bdev_crypto_enomem 01:04:31.218 bdev_error 01:04:31.218 bdev_fio 01:04:31.218 bdev_fio_rw_verify 01:04:31.218 bdev_fio_trim 01:04:31.218 bdev_gpt_uuid 01:04:31.218 bdev_hello_world 01:04:31.218 bdev_json_nonarray 01:04:31.218 bdev_json_nonenclosed 01:04:31.218 bdev_nbd 01:04:31.218 bdev_nvme_reset_stuck_adm_cmd 01:04:31.218 bdev_qd_sampling 01:04:31.218 bdev_qos 01:04:31.218 bdev_qos_bw 01:04:31.218 bdev_qos_iops 01:04:31.218 bdev_qos_ro_bw 01:04:31.218 bdev_raid 01:04:31.218 bdev_stat 01:04:31.218 bdev_verify 01:04:31.218 bdev_verify_big_io 01:04:31.218 bdev_write_zeroes 01:04:31.218 bdevperf_config 01:04:31.218 blob_io_wait 01:04:31.218 blobfs 01:04:31.218 blobfs_mkfs 01:04:31.218 blobstore 01:04:31.218 blobstore_grow 01:04:31.218 blockdev_crypto_aesni 01:04:31.218 blockdev_crypto_qat 01:04:31.218 blockdev_crypto_sw 01:04:31.218 blockdev_general 01:04:31.218 blockdev_nvme 01:04:31.218 blockdev_nvme_gpt 01:04:31.218 blockdev_raid5f 01:04:31.218 blockdev_rbd 01:04:31.218 build_rpm_from_gen_spec 01:04:31.218 build_shared_rpm 01:04:31.218 chaining 01:04:31.218 check_header_filenames 01:04:31.218 cmb_copy 01:04:31.218 compress_compdev 01:04:31.218 compress_isal 01:04:31.218 confirm_abi_deps 01:04:31.218 confirm_makefile_deps 01:04:31.218 cpu_locks 01:04:31.218 custom_alloc 01:04:31.218 dd_bs_lt_native_bs 01:04:31.218 dd_copy_to_out_bdev 01:04:31.218 dd_double_input 01:04:31.218 dd_double_output 01:04:31.218 dd_flag_append 01:04:31.218 dd_flag_append_forced_aio 01:04:31.218 dd_flag_directory 01:04:31.218 dd_flag_directory_forced_aio 01:04:31.218 dd_flag_noatime 01:04:31.218 dd_flag_noatime_forced_aio 01:04:31.218 dd_flag_nofollow 01:04:31.218 dd_flag_nofollow_forced_aio 01:04:31.218 dd_flags_misc 01:04:31.218 dd_flags_misc_forced_aio 01:04:31.218 dd_inflate_file 01:04:31.218 dd_invalid_arguments 01:04:31.218 dd_invalid_count 01:04:31.218 dd_invalid_iflag 01:04:31.218 dd_invalid_json 01:04:31.218 dd_invalid_oflag 01:04:31.218 dd_malloc_copy 01:04:31.218 dd_no_input 01:04:31.218 dd_no_output 01:04:31.218 dd_offset_magic 01:04:31.218 dd_rw 01:04:31.218 dd_rw_offset 01:04:31.218 dd_smaller_blocksize 01:04:31.218 dd_sparse_bdev_to_file 01:04:31.218 dd_sparse_file_to_bdev 01:04:31.218 dd_sparse_file_to_file 01:04:31.218 dd_unknown_flag 01:04:31.218 dd_uring_copy 01:04:31.218 dd_wrong_blocksize 01:04:31.218 default_locks 01:04:31.218 default_locks_via_rpc 01:04:31.218 default_setup 01:04:31.218 denied 01:04:31.218 devices 01:04:31.218 dm_mount 01:04:31.218 dma 01:04:31.218 dpdk_governor 01:04:31.218 dpdk_mem_utility 01:04:31.218 driver 01:04:31.218 env 01:04:31.218 env_dpdk_post_init 01:04:31.218 env_mem_callbacks 01:04:31.218 env_memory 01:04:31.218 env_pci 01:04:31.218 env_vtophys 01:04:31.218 even_2G_alloc 01:04:31.218 event 01:04:31.218 event_perf 01:04:31.218 event_reactor 01:04:31.218 event_reactor_perf 01:04:31.218 event_scheduler 01:04:31.218 exit_on_failed_rpc_init 01:04:31.218 external_make_accel_driver_shared 01:04:31.218 external_make_accel_driver_static 01:04:31.218 external_make_accel_module_shared 01:04:31.218 external_make_accel_module_static 01:04:31.218 external_make_hello_bdev_shared_combo 01:04:31.218 external_make_hello_bdev_shared_iso 01:04:31.218 external_make_hello_bdev_static 01:04:31.218 external_make_hello_no_bdev_shared_combo 01:04:31.218 external_make_hello_no_bdev_shared_iso 01:04:31.218 external_make_hello_no_bdev_static 01:04:31.218 external_make_nvme_shared 01:04:31.218 external_make_nvme_static 01:04:31.218 external_run_accel_driver_shared 01:04:31.218 external_run_accel_driver_static 01:04:31.218 external_run_accel_module_shared 01:04:31.218 external_run_accel_module_static 01:04:31.218 external_run_hello_bdev_shared_combo 01:04:31.218 external_run_hello_bdev_shared_iso 01:04:31.218 external_run_hello_bdev_static 01:04:31.218 external_run_hello_no_bdev_shared_combo 01:04:31.218 external_run_hello_no_bdev_shared_iso 01:04:31.218 external_run_hello_no_bdev_static 01:04:31.218 external_run_nvme_shared 01:04:31.218 external_run_nvme_static 01:04:31.218 filesystem_btrfs 01:04:31.218 filesystem_ext4 01:04:31.218 filesystem_in_capsule_btrfs 01:04:31.218 filesystem_in_capsule_ext4 01:04:31.218 filesystem_in_capsule_xfs 01:04:31.218 filesystem_xfs 01:04:31.218 fio_dif_1_default 01:04:31.218 fio_dif_1_multi_subsystems 01:04:31.218 fio_dif_digest 01:04:31.218 fio_dif_rand_params 01:04:31.218 go_rpc 01:04:31.218 guess_driver 01:04:31.218 hello_blob 01:04:31.218 hugepages 01:04:31.218 idle 01:04:31.218 interrupt_mode 01:04:31.218 ioat 01:04:31.218 ioat_perf 01:04:31.219 ioat_verify 01:04:31.219 is_zoned 01:04:31.219 iscsi_tgt 01:04:31.219 iscsi_tgt_bdev_io_wait 01:04:31.219 iscsi_tgt_calsoft 01:04:31.219 iscsi_tgt_digest 01:04:31.219 iscsi_tgt_digests 01:04:31.219 iscsi_tgt_filesystem 01:04:31.219 iscsi_tgt_filesystem_btrfs 01:04:31.219 iscsi_tgt_filesystem_ext4 01:04:31.219 iscsi_tgt_filesystem_xfs 01:04:31.219 iscsi_tgt_fio 01:04:31.219 iscsi_tgt_fuzz 01:04:31.219 iscsi_tgt_initiator 01:04:31.219 iscsi_tgt_ip_migration 01:04:31.219 iscsi_tgt_iscsi_lvol 01:04:31.219 iscsi_tgt_login_redirection 01:04:31.219 iscsi_tgt_multiconnection 01:04:31.219 iscsi_tgt_qos 01:04:31.219 iscsi_tgt_rbd 01:04:31.219 iscsi_tgt_reset 01:04:31.219 iscsi_tgt_resize 01:04:31.219 iscsi_tgt_rpc_config 01:04:31.219 iscsi_tgt_sock 01:04:31.219 iscsi_tgt_trace_record 01:04:31.219 json_config 01:04:31.219 json_config_extra_key 01:04:31.219 kernel_target_abort 01:04:31.219 keyring_file 01:04:31.219 llvm_fuzz 01:04:31.219 locking_app_on_locked_coremask 01:04:31.219 locking_app_on_unlocked_coremask 01:04:31.219 locking_overlapped_coremask 01:04:31.219 locking_overlapped_coremask_via_rpc 01:04:31.219 lvol 01:04:31.219 lvol_basic 01:04:31.219 lvol_esnap 01:04:31.219 lvol_external_copy 01:04:31.219 lvol_external_snapshot 01:04:31.219 lvol_hotremove 01:04:31.219 lvol_provisioning 01:04:31.219 lvol_rename 01:04:31.219 lvol_resize 01:04:31.219 lvol_snapshot_clone 01:04:31.219 lvol_tasting 01:04:31.219 lvs_grow_clean 01:04:31.219 lvs_grow_dirty 01:04:31.219 make 01:04:31.219 no_shrink_alloc 01:04:31.219 non_locking_app_on_locked_coremask 01:04:31.219 nvme 01:04:31.219 nvme_arbitration 01:04:31.219 nvme_cli_cuse 01:04:31.219 nvme_cli_plugin 01:04:31.219 nvme_cmb 01:04:31.219 nvme_cuse 01:04:31.219 nvme_cuse_app 01:04:31.219 nvme_cuse_rpc 01:04:31.219 nvme_doorbell_aers 01:04:31.219 nvme_e2edp 01:04:31.219 nvme_err_injection 01:04:31.219 nvme_fdp 01:04:31.219 nvme_fio 01:04:31.219 nvme_flexible_data_placement 01:04:31.219 nvme_hello_world 01:04:31.219 nvme_identify 01:04:31.219 nvme_mount 01:04:31.219 nvme_multi_aen 01:04:31.219 nvme_multi_secondary 01:04:31.219 nvme_ns_manage_cuse 01:04:31.219 nvme_overhead 01:04:31.219 nvme_perf 01:04:31.219 nvme_pmr 01:04:31.219 nvme_pmr_persistence 01:04:31.219 nvme_reserve 01:04:31.219 nvme_reset 01:04:31.219 nvme_rpc 01:04:31.219 nvme_rpc_timeouts 01:04:31.219 nvme_scc 01:04:31.219 nvme_sgl 01:04:31.219 nvme_simple_copy 01:04:31.219 nvme_single_aen 01:04:31.219 nvme_smartctl_cuse 01:04:31.219 nvme_startup 01:04:31.219 nvme_zns 01:04:31.219 nvmf_abort 01:04:31.219 nvmf_abort_qd_sizes 01:04:31.219 nvmf_aer 01:04:31.219 nvmf_async_init 01:04:31.219 nvmf_auth_host 01:04:31.219 nvmf_auth_target 01:04:31.219 nvmf_bdev_io_wait 01:04:31.219 nvmf_bdevio 01:04:31.219 nvmf_bdevio_no_huge 01:04:31.219 nvmf_bdevperf 01:04:31.219 nvmf_connect_disconnect 01:04:31.219 nvmf_connect_stress 01:04:31.219 nvmf_delete_subsystem 01:04:31.219 nvmf_device_removal 01:04:31.219 nvmf_device_removal_pci_remove 01:04:31.219 nvmf_device_removal_pci_remove_no_srq 01:04:31.219 nvmf_dif 01:04:31.219 nvmf_digest 01:04:31.219 nvmf_digest_clean 01:04:31.219 nvmf_digest_dsa_initiator 01:04:31.219 nvmf_digest_dsa_target 01:04:31.219 nvmf_digest_error 01:04:31.219 nvmf_discovery_remove_ifc 01:04:31.219 nvmf_example 01:04:31.219 nvmf_failover 01:04:31.219 nvmf_filesystem 01:04:31.219 nvmf_filesystem_in_capsule 01:04:31.219 nvmf_filesystem_no_in_capsule 01:04:31.219 nvmf_fio_host 01:04:31.219 nvmf_fio_target 01:04:31.219 nvmf_fips 01:04:31.219 nvmf_fused_ordering 01:04:31.219 nvmf_fuzz 01:04:31.219 nvmf_host_discovery 01:04:31.219 nvmf_host_management 01:04:31.219 nvmf_host_multipath 01:04:31.219 nvmf_host_multipath_status 01:04:31.219 nvmf_identify 01:04:31.219 nvmf_identify_kernel_target 01:04:31.219 nvmf_identify_passthru 01:04:31.219 nvmf_invalid 01:04:31.219 nvmf_lvol 01:04:31.219 nvmf_lvs_grow 01:04:31.219 nvmf_mdns_discovery 01:04:31.219 nvmf_multicontroller 01:04:31.219 nvmf_multitarget 01:04:31.219 nvmf_nmic 01:04:31.219 nvmf_ns_hotplug_stress 01:04:31.219 nvmf_ns_masking 01:04:31.219 nvmf_nvme_cli 01:04:31.219 nvmf_perf 01:04:31.219 nvmf_perf_adq 01:04:31.219 nvmf_queue_depth 01:04:31.219 nvmf_rdma 01:04:31.219 nvmf_referrals 01:04:31.219 nvmf_rpc 01:04:31.219 nvmf_shutdown 01:04:31.219 nvmf_shutdown_tc1 01:04:31.219 nvmf_shutdown_tc2 01:04:31.219 nvmf_shutdown_tc3 01:04:31.219 nvmf_srq_overwhelm 01:04:31.219 nvmf_target_disconnect 01:04:31.219 nvmf_target_disconnect_tc1 01:04:31.219 nvmf_target_disconnect_tc2 01:04:31.219 nvmf_target_disconnect_tc3 01:04:31.219 nvmf_target_discovery 01:04:31.219 nvmf_target_multipath 01:04:31.219 nvmf_tcp 01:04:31.219 nvmf_timeout 01:04:31.219 nvmf_tls 01:04:31.219 nvmf_vfio_user 01:04:31.219 nvmf_vfio_user_fuzz 01:04:31.219 nvmf_vfio_user_nvme_compliance 01:04:31.219 nvmf_vhost 01:04:31.219 nvmf_zcopy 01:04:31.219 ocf 01:04:31.219 ocf_bdevperf_iotypes 01:04:31.219 ocf_configuration_change 01:04:31.219 ocf_create_destruct 01:04:31.219 ocf_fio_modes 01:04:31.219 ocf_flush 01:04:31.219 ocf_multicore 01:04:31.219 ocf_remove 01:04:31.219 ocf_stats 01:04:31.219 odd_alloc 01:04:31.219 packaging 01:04:31.219 per_node_1G_alloc 01:04:31.219 raid0_resize_test 01:04:31.219 raid5f_rebuild_test 01:04:31.219 raid5f_rebuild_test_sb 01:04:31.219 raid5f_state_function_test 01:04:31.219 raid5f_state_function_test_sb 01:04:31.219 raid5f_superblock_test 01:04:31.219 raid_function_test_concat 01:04:31.219 raid_function_test_raid0 01:04:31.219 raid_rebuild_test 01:04:31.219 raid_rebuild_test_io 01:04:31.219 raid_rebuild_test_sb 01:04:31.219 raid_rebuild_test_sb_4k 01:04:31.219 raid_rebuild_test_sb_io 01:04:31.219 raid_rebuild_test_sb_md_interleaved 01:04:31.219 raid_rebuild_test_sb_md_separate 01:04:31.219 raid_state_function_test 01:04:31.219 raid_state_function_test_sb 01:04:31.219 raid_state_function_test_sb_4k 01:04:31.219 raid_state_function_test_sb_md_interleaved 01:04:31.219 raid_state_function_test_sb_md_separate 01:04:31.219 raid_superblock_test 01:04:31.219 raid_superblock_test_4k 01:04:31.219 raid_superblock_test_md_interleaved 01:04:31.219 raid_superblock_test_md_separate 01:04:31.219 reactor_set_interrupt 01:04:31.219 reap_unregistered_poller 01:04:31.219 rocksdb 01:04:31.219 rocksdb_insert 01:04:31.219 rocksdb_overwrite 01:04:31.219 rocksdb_randread 01:04:31.219 rocksdb_readwrite 01:04:31.219 rocksdb_writesync 01:04:31.219 rpc 01:04:31.219 rpc_client 01:04:31.219 rpc_daemon_integrity 01:04:31.219 rpc_integrity 01:04:31.219 rpc_plugins 01:04:31.219 rpc_trace_cmd_test 01:04:31.219 rpm_packaging 01:04:31.219 scanbuild_make 01:04:31.219 scheduler 01:04:31.219 scheduler_create_thread 01:04:31.219 setup.sh 01:04:31.219 skip_rpc 01:04:31.219 skip_rpc_with_delay 01:04:31.219 skip_rpc_with_json 01:04:31.219 sma 01:04:31.219 sma_crypto 01:04:31.219 sma_discovery 01:04:31.219 sma_nvmf_tcp 01:04:31.219 sma_plugins 01:04:31.219 sma_qos 01:04:31.219 sma_vfiouser_qemu 01:04:31.219 sma_vhost 01:04:31.219 spdk_dd 01:04:31.219 spdk_dd_basic_rw 01:04:31.219 spdk_dd_bdev_to_bdev 01:04:31.219 spdk_dd_malloc 01:04:31.219 spdk_dd_negative 01:04:31.219 spdk_dd_posix 01:04:31.219 spdk_dd_sparse 01:04:31.219 spdk_dd_uring 01:04:31.219 spdk_target_abort 01:04:31.219 spdkcli_iscsi 01:04:31.219 spdkcli_nvmf_rdma 01:04:31.219 spdkcli_nvmf_tcp 01:04:31.219 spdkcli_raid 01:04:31.219 spdkcli_rbd 01:04:31.219 spdkcli_tcp 01:04:31.219 spdkcli_vhost 01:04:31.219 spdkcli_virtio 01:04:31.219 sw_hotplug 01:04:31.219 test_bdev_lvol_delete_lvstore_with_clones 01:04:31.219 test_bdev_lvol_delete_ordering 01:04:31.219 test_clone_decouple_parent 01:04:31.219 test_clone_inflate 01:04:31.219 test_clone_snapshot_relations 01:04:31.219 test_construct_lvol 01:04:31.219 test_construct_lvol_alias_conflict 01:04:31.219 test_construct_lvol_fio_clear_method_none 01:04:31.219 test_construct_lvol_fio_clear_method_unmap 01:04:31.219 test_construct_lvol_full_lvs 01:04:31.219 test_construct_lvol_inexistent_lvs 01:04:31.219 test_construct_lvols_conflict_alias 01:04:31.219 test_construct_lvs 01:04:31.219 test_construct_lvs_clear_methods 01:04:31.219 test_construct_lvs_conflict_alias 01:04:31.219 test_construct_lvs_different_cluster_size 01:04:31.219 test_construct_lvs_nonexistent_bdev 01:04:31.219 test_construct_multi_lvols 01:04:31.219 test_construct_nested_lvol 01:04:31.219 test_construct_two_lvs_on_the_same_bdev 01:04:31.219 test_create_snapshot_of_snapshot 01:04:31.219 test_create_snapshot_with_io 01:04:31.219 test_delete_lvol_store_persistent_positive 01:04:31.219 test_delete_snapshot_with_clone 01:04:31.219 test_delete_snapshot_with_snapshot 01:04:31.219 test_destroy_after_bdev_lvol_resize_positive 01:04:31.219 test_esnap_clones 01:04:31.219 test_esnap_late_arrival 01:04:31.219 test_esnap_reload 01:04:31.219 test_esnap_remove_degraded 01:04:31.219 test_hotremove_lvol_store 01:04:31.219 test_hotremove_lvol_store_base 01:04:31.219 test_hotremove_lvol_store_base_with_lvols 01:04:31.219 test_hotremove_lvol_store_multiple_lvols 01:04:31.219 test_lvol_bdev_readonly 01:04:31.219 test_lvol_list 01:04:31.219 test_lvol_rename_negative 01:04:31.219 test_rename_lvs_negative 01:04:31.219 test_rename_positive 01:04:31.220 test_resize_lvol 01:04:31.220 test_resize_lvol_negative 01:04:31.220 test_resize_lvol_with_io_traffic 01:04:31.220 test_shallow_copy_compare 01:04:31.220 test_sigterm 01:04:31.220 test_snapshot_compare_with_lvol_bdev 01:04:31.220 test_tasting 01:04:31.220 test_thin_lvol_check_integrity 01:04:31.220 test_thin_lvol_check_space 01:04:31.220 test_thin_lvol_check_zeroes 01:04:31.220 test_thin_lvol_resize 01:04:31.220 test_thin_overprovisioning 01:04:31.220 test_unregister_lvol_bdev 01:04:31.220 thread 01:04:31.220 thread_poller_perf 01:04:31.220 thread_spdk_lock 01:04:31.220 ubsan 01:04:31.220 unittest 01:04:31.220 unittest_accel 01:04:31.220 unittest_bdev 01:04:31.220 unittest_bdev_compress 01:04:31.220 unittest_bdev_crypto 01:04:31.220 unittest_bdev_raid5f 01:04:31.220 unittest_blob_blobfs 01:04:31.220 unittest_build 01:04:31.220 unittest_dma 01:04:31.220 unittest_dpdk_compressdev 01:04:31.220 unittest_event 01:04:31.220 unittest_ftl 01:04:31.220 unittest_idxd_user 01:04:31.220 unittest_include 01:04:31.220 unittest_init 01:04:31.220 unittest_ioat 01:04:31.220 unittest_iobuf 01:04:31.220 unittest_iscsi 01:04:31.220 unittest_json 01:04:31.220 unittest_keyring 01:04:31.220 unittest_lib_reduce 01:04:31.220 unittest_log 01:04:31.220 unittest_lvol 01:04:31.220 unittest_notify 01:04:31.220 unittest_nvme 01:04:31.220 unittest_nvme_cuse 01:04:31.220 unittest_nvme_rdma 01:04:31.220 unittest_nvmf 01:04:31.220 unittest_nvmf_rdma 01:04:31.220 unittest_nvmf_transport 01:04:31.220 unittest_nvmf_vfio_user 01:04:31.220 unittest_pci_event 01:04:31.220 unittest_rdma 01:04:31.220 unittest_rpc 01:04:31.220 unittest_scsi 01:04:31.220 unittest_sock 01:04:31.220 unittest_thread 01:04:31.220 unittest_util 01:04:31.220 unittest_vhost 01:04:31.220 valgrind 01:04:31.220 version 01:04:31.220 vfio_fuzz 01:04:31.220 vfio_user_nvme_fio 01:04:31.220 vfio_user_nvme_restart_vm 01:04:31.220 vfio_user_qemu 01:04:31.220 vfio_user_virtio_bdevperf 01:04:31.220 vfio_user_virtio_blk_restart_vm 01:04:31.220 vfio_user_virtio_scsi_restart_vm 01:04:31.220 vhost 01:04:31.220 vhost_blk_lvol_integrity 01:04:31.220 vhost_blk_packed_ring_integrity 01:04:31.220 vhost_blockdev 01:04:31.220 vhost_boot 01:04:31.220 vhost_fuzz 01:04:31.220 vhost_negative 01:04:31.220 vhost_scsi_lvol_integrity 01:04:31.220 vhost_shared 01:04:31.220 zoned_fio 01:04:31.220 01:04:31.220 01:04:31.220 -----Tests Missing From Build------ 01:04:31.220 balanced 01:04:31.220 blockdev_xnvme 01:04:31.220 build_native_dpdk 01:04:31.220 build_shared_native_dpdk_rpm 01:04:31.220 build_shared_rpm_with_rpmed_dpdk 01:04:31.220 busy 01:04:31.220 core_load 01:04:31.220 ftl 01:04:31.220 ftl_bdevperf 01:04:31.220 ftl_dirty_shutdown 01:04:31.220 ftl_fio_basic 01:04:31.220 ftl_restore 01:04:31.220 ftl_restore_fast 01:04:31.220 ftl_trim 01:04:31.220 ftl_upgrade_shutdown 01:04:31.220 iscsi_tgt_data_digest 01:04:31.220 iscsi_tgt_ext4test 01:04:31.220 keyring_linux 01:04:31.220 nvme_boot_partition 01:04:31.220 nvme_bp 01:04:31.220 nvme_opal 01:04:31.220 nvme_opal_bdevio 01:04:31.220 nvme_opal_bdevperf 01:04:31.220 nvme_opal_spdk_tgt 01:04:31.220 nvme_xnvme 01:04:31.220 nvmf_fc 01:04:31.220 nvmf_initiator_timeout 01:04:31.220 nvmf_multiconnection 01:04:31.220 spdkcli_nvmf_fc 01:04:31.220 test_create_multi_ublk 01:04:31.220 test_create_ublk 01:04:31.220 test_save_ublk_config 01:04:31.220 ublk 01:04:31.220 ublk_recovery 01:04:31.220 unittest_nvmf_fc 01:04:31.220 unittest_nvmf_fc_ls 01:04:31.220 vhost_blk_cores_2ctrl 01:04:31.220 vhost_blk_fs_integrity 01:04:31.220 vhost_blk_hot_remove 01:04:31.220 vhost_blk_integrity 01:04:31.220 vhost_hotplug 01:04:31.220 vhost_migration 01:04:31.220 vhost_migration_tc1 01:04:31.220 vhost_migration_tc2 01:04:31.220 vhost_readonly 01:04:31.220 vhost_scsi_cores_2ctrl 01:04:31.220 vhost_scsi_fs_integrity 01:04:31.220 vhost_scsi_hot_remove 01:04:31.220 vhost_scsi_integrity 01:04:31.220 vmd 01:04:31.220 vmd_bdev_svc 01:04:31.220 vmd_fio 01:04:31.220 vmd_hello_world 01:04:31.220 vmd_identify 01:04:31.220 vmd_perf 01:04:31.220 xnvme_bdevperf 01:04:31.220 xnvme_to_malloc_dd_copy 01:04:31.220 01:04:31.220 01:04:31.220 -----Tests Missing ASAN------ 01:04:31.220 accel_cdev_comp 01:04:31.220 accel_cdev_decmop_full 01:04:31.220 accel_cdev_decomp 01:04:31.220 accel_cdev_decomp_full_mcore 01:04:31.220 accel_cdev_decomp_full_mthread 01:04:31.220 accel_cdev_decomp_mcore 01:04:31.220 accel_cdev_decomp_mthread 01:04:31.220 autobuild 01:04:31.220 autobuild_build_doc 01:04:31.220 autobuild_check_dpdk_pci_api 01:04:31.220 autobuild_check_format 01:04:31.220 autobuild_check_so_deps 01:04:31.220 autobuild_external_code 01:04:31.220 autobuild_generated_files_check 01:04:31.220 autobuild_generated_files_check_post_clean 01:04:31.220 autobuild_header_dependency_check 01:04:31.220 autobuild_llvm_precompile 01:04:31.220 autobuild_make_install 01:04:31.220 autobuild_make_uninstall 01:04:31.220 autobuild_ocf_precompile 01:04:31.220 balanced 01:04:31.220 bdev_crypto_enomem 01:04:31.220 blockdev_crypto_aesni 01:04:31.220 blockdev_crypto_qat 01:04:31.220 blockdev_crypto_sw 01:04:31.220 blockdev_rbd 01:04:31.220 blockdev_xnvme 01:04:31.220 build_native_dpdk 01:04:31.220 build_shared_native_dpdk_rpm 01:04:31.220 build_shared_rpm_with_rpmed_dpdk 01:04:31.220 busy 01:04:31.220 chaining 01:04:31.220 check_header_filenames 01:04:31.220 cmb_copy 01:04:31.220 compress_compdev 01:04:31.220 compress_isal 01:04:31.220 confirm_abi_deps 01:04:31.220 confirm_makefile_deps 01:04:31.220 core_load 01:04:31.220 dd_uring_copy 01:04:31.220 dpdk_governor 01:04:31.220 external_make_accel_driver_shared 01:04:31.220 external_make_accel_driver_static 01:04:31.220 external_make_accel_module_shared 01:04:31.220 external_make_accel_module_static 01:04:31.220 external_make_hello_bdev_shared_combo 01:04:31.220 external_make_hello_bdev_shared_iso 01:04:31.220 external_make_hello_bdev_static 01:04:31.220 external_make_hello_no_bdev_shared_combo 01:04:31.220 external_make_hello_no_bdev_shared_iso 01:04:31.220 external_make_hello_no_bdev_static 01:04:31.220 external_make_nvme_shared 01:04:31.220 external_make_nvme_static 01:04:31.220 external_run_accel_driver_shared 01:04:31.220 external_run_accel_driver_static 01:04:31.220 external_run_accel_module_shared 01:04:31.220 external_run_accel_module_static 01:04:31.220 external_run_hello_bdev_shared_combo 01:04:31.220 external_run_hello_bdev_shared_iso 01:04:31.220 external_run_hello_bdev_static 01:04:31.220 external_run_hello_no_bdev_shared_combo 01:04:31.220 external_run_hello_no_bdev_shared_iso 01:04:31.220 external_run_hello_no_bdev_static 01:04:31.220 external_run_nvme_shared 01:04:31.220 external_run_nvme_static 01:04:31.220 ftl 01:04:31.220 ftl_bdevperf 01:04:31.220 ftl_dirty_shutdown 01:04:31.220 ftl_fio_basic 01:04:31.220 ftl_restore 01:04:31.220 ftl_restore_fast 01:04:31.220 ftl_trim 01:04:31.220 ftl_upgrade_shutdown 01:04:31.220 go_rpc 01:04:31.220 idle 01:04:31.220 interrupt_mode 01:04:31.220 ioat 01:04:31.220 ioat_perf 01:04:31.220 ioat_verify 01:04:31.220 is_zoned 01:04:31.220 iscsi_tgt 01:04:31.220 iscsi_tgt_bdev_io_wait 01:04:31.220 iscsi_tgt_calsoft 01:04:31.220 iscsi_tgt_data_digest 01:04:31.220 iscsi_tgt_digest 01:04:31.220 iscsi_tgt_digests 01:04:31.220 iscsi_tgt_ext4test 01:04:31.220 iscsi_tgt_filesystem 01:04:31.220 iscsi_tgt_filesystem_btrfs 01:04:31.220 iscsi_tgt_filesystem_ext4 01:04:31.220 iscsi_tgt_filesystem_xfs 01:04:31.220 iscsi_tgt_fio 01:04:31.220 iscsi_tgt_fuzz 01:04:31.220 iscsi_tgt_initiator 01:04:31.220 iscsi_tgt_ip_migration 01:04:31.220 iscsi_tgt_iscsi_lvol 01:04:31.220 iscsi_tgt_login_redirection 01:04:31.220 iscsi_tgt_multiconnection 01:04:31.220 iscsi_tgt_qos 01:04:31.220 iscsi_tgt_rbd 01:04:31.220 iscsi_tgt_reset 01:04:31.220 iscsi_tgt_resize 01:04:31.220 iscsi_tgt_rpc_config 01:04:31.220 iscsi_tgt_sock 01:04:31.220 iscsi_tgt_trace_record 01:04:31.221 keyring_linux 01:04:31.221 llvm_fuzz 01:04:31.221 nvme_boot_partition 01:04:31.221 nvme_bp 01:04:31.221 nvme_cli_cuse 01:04:31.221 nvme_cli_plugin 01:04:31.221 nvme_cmb 01:04:31.221 nvme_cuse 01:04:31.221 nvme_cuse_app 01:04:31.221 nvme_cuse_rpc 01:04:31.221 nvme_ns_manage_cuse 01:04:31.221 nvme_opal 01:04:31.221 nvme_opal_bdevio 01:04:31.221 nvme_opal_bdevperf 01:04:31.221 nvme_opal_spdk_tgt 01:04:31.221 nvme_pmr 01:04:31.221 nvme_pmr_persistence 01:04:31.221 nvme_smartctl_cuse 01:04:31.221 nvme_xnvme 01:04:31.221 nvme_zns 01:04:31.221 nvmf_bdevperf 01:04:31.221 nvmf_device_removal 01:04:31.221 nvmf_device_removal_pci_remove 01:04:31.221 nvmf_device_removal_pci_remove_no_srq 01:04:31.221 nvmf_digest_clean 01:04:31.221 nvmf_fc 01:04:31.221 nvmf_fuzz 01:04:31.221 nvmf_host_multipath 01:04:31.221 nvmf_initiator_timeout 01:04:31.221 nvmf_mdns_discovery 01:04:31.221 nvmf_multiconnection 01:04:31.221 nvmf_nvme_cli 01:04:31.221 nvmf_perf_adq 01:04:31.221 nvmf_rdma 01:04:31.221 nvmf_shutdown 01:04:31.221 nvmf_shutdown_tc1 01:04:31.221 nvmf_shutdown_tc2 01:04:31.221 nvmf_shutdown_tc3 01:04:31.221 nvmf_srq_overwhelm 01:04:31.221 nvmf_target_disconnect 01:04:31.221 nvmf_target_disconnect_tc1 01:04:31.221 nvmf_target_disconnect_tc2 01:04:31.221 nvmf_target_disconnect_tc3 01:04:31.221 nvmf_timeout 01:04:31.221 nvmf_vfio_user 01:04:31.221 nvmf_vfio_user_fuzz 01:04:31.221 nvmf_vfio_user_nvme_compliance 01:04:31.221 ocf 01:04:31.221 ocf_bdevperf_iotypes 01:04:31.221 ocf_configuration_change 01:04:31.221 ocf_create_destruct 01:04:31.221 ocf_fio_modes 01:04:31.221 ocf_flush 01:04:31.221 ocf_multicore 01:04:31.221 ocf_remove 01:04:31.221 ocf_stats 01:04:31.221 scanbuild_make 01:04:31.221 scheduler 01:04:31.221 spdk_dd_uring 01:04:31.221 spdkcli_iscsi 01:04:31.221 spdkcli_nvmf_fc 01:04:31.221 spdkcli_nvmf_rdma 01:04:31.221 spdkcli_raid 01:04:31.221 spdkcli_rbd 01:04:31.221 spdkcli_virtio 01:04:31.221 test_create_multi_ublk 01:04:31.221 test_create_ublk 01:04:31.221 test_save_ublk_config 01:04:31.221 ublk 01:04:31.221 ublk_recovery 01:04:31.221 unittest_bdev_compress 01:04:31.221 unittest_bdev_crypto 01:04:31.221 unittest_dpdk_compressdev 01:04:31.221 unittest_lib_reduce 01:04:31.221 unittest_nvmf_fc 01:04:31.221 unittest_nvmf_fc_ls 01:04:31.221 unittest_nvmf_vfio_user 01:04:31.221 valgrind 01:04:31.221 vfio_fuzz 01:04:31.221 vhost_blk_cores_2ctrl 01:04:31.221 vhost_blk_fs_integrity 01:04:31.221 vhost_blk_hot_remove 01:04:31.221 vhost_blk_integrity 01:04:31.221 vhost_blockdev 01:04:31.221 vhost_fuzz 01:04:31.221 vhost_hotplug 01:04:31.221 vhost_migration 01:04:31.221 vhost_migration_tc1 01:04:31.221 vhost_migration_tc2 01:04:31.221 vhost_readonly 01:04:31.221 vhost_scsi_cores_2ctrl 01:04:31.221 vhost_scsi_fs_integrity 01:04:31.221 vhost_scsi_hot_remove 01:04:31.221 vhost_scsi_integrity 01:04:31.221 vhost_shared 01:04:31.221 vmd 01:04:31.221 vmd_bdev_svc 01:04:31.221 vmd_fio 01:04:31.221 vmd_hello_world 01:04:31.221 vmd_identify 01:04:31.221 vmd_perf 01:04:31.221 xnvme_bdevperf 01:04:31.221 xnvme_to_malloc_dd_copy 01:04:31.221 zoned_fio 01:04:31.221 01:04:31.221 01:04:31.221 -----Tests Missing UBSAN------ 01:04:31.221 autobuild 01:04:31.221 autobuild_build_doc 01:04:31.221 autobuild_check_dpdk_pci_api 01:04:31.221 autobuild_check_format 01:04:31.221 autobuild_check_so_deps 01:04:31.221 autobuild_external_code 01:04:31.221 autobuild_generated_files_check 01:04:31.221 autobuild_generated_files_check_post_clean 01:04:31.221 autobuild_header_dependency_check 01:04:31.221 autobuild_make_install 01:04:31.221 autobuild_make_uninstall 01:04:31.221 balanced 01:04:31.221 blockdev_xnvme 01:04:31.221 build_native_dpdk 01:04:31.221 build_rpm_from_gen_spec 01:04:31.221 build_shared_native_dpdk_rpm 01:04:31.221 build_shared_rpm 01:04:31.221 build_shared_rpm_with_rpmed_dpdk 01:04:31.221 busy 01:04:31.221 check_header_filenames 01:04:31.221 cmb_copy 01:04:31.221 confirm_abi_deps 01:04:31.221 confirm_makefile_deps 01:04:31.221 core_load 01:04:31.221 external_make_accel_driver_shared 01:04:31.221 external_make_accel_driver_static 01:04:31.221 external_make_accel_module_shared 01:04:31.221 external_make_accel_module_static 01:04:31.221 external_make_hello_bdev_shared_combo 01:04:31.221 external_make_hello_bdev_shared_iso 01:04:31.221 external_make_hello_bdev_static 01:04:31.221 external_make_hello_no_bdev_shared_combo 01:04:31.221 external_make_hello_no_bdev_shared_iso 01:04:31.221 external_make_hello_no_bdev_static 01:04:31.221 external_make_nvme_shared 01:04:31.221 external_make_nvme_static 01:04:31.221 external_run_accel_driver_shared 01:04:31.221 external_run_accel_driver_static 01:04:31.221 external_run_accel_module_shared 01:04:31.221 external_run_accel_module_static 01:04:31.221 external_run_hello_bdev_shared_combo 01:04:31.221 external_run_hello_bdev_shared_iso 01:04:31.221 external_run_hello_bdev_static 01:04:31.221 external_run_hello_no_bdev_shared_combo 01:04:31.221 external_run_hello_no_bdev_shared_iso 01:04:31.221 external_run_hello_no_bdev_static 01:04:31.221 external_run_nvme_shared 01:04:31.221 external_run_nvme_static 01:04:31.221 ftl 01:04:31.221 ftl_bdevperf 01:04:31.221 ftl_dirty_shutdown 01:04:31.221 ftl_fio_basic 01:04:31.221 ftl_restore 01:04:31.221 ftl_restore_fast 01:04:31.221 ftl_trim 01:04:31.221 ftl_upgrade_shutdown 01:04:31.221 is_zoned 01:04:31.221 iscsi_tgt_data_digest 01:04:31.221 iscsi_tgt_ext4test 01:04:31.221 keyring_linux 01:04:31.221 nvme_boot_partition 01:04:31.221 nvme_bp 01:04:31.221 nvme_cmb 01:04:31.221 nvme_opal 01:04:31.221 nvme_opal_bdevio 01:04:31.221 nvme_opal_bdevperf 01:04:31.221 nvme_opal_spdk_tgt 01:04:31.221 nvme_pmr 01:04:31.221 nvme_pmr_persistence 01:04:31.221 nvme_xnvme 01:04:31.221 nvme_zns 01:04:31.221 nvmf_fc 01:04:31.221 nvmf_initiator_timeout 01:04:31.221 nvmf_multiconnection 01:04:31.221 packaging 01:04:31.221 rpm_packaging 01:04:31.221 scanbuild_make 01:04:31.221 spdkcli_nvmf_fc 01:04:31.221 test_create_multi_ublk 01:04:31.221 test_create_ublk 01:04:31.221 test_save_ublk_config 01:04:31.221 ublk 01:04:31.221 ublk_recovery 01:04:31.221 unittest_bdev_compress 01:04:31.221 unittest_bdev_crypto 01:04:31.221 unittest_dpdk_compressdev 01:04:31.221 unittest_lib_reduce 01:04:31.221 unittest_nvmf_fc 01:04:31.221 unittest_nvmf_fc_ls 01:04:31.221 unittest_nvmf_vfio_user 01:04:31.221 valgrind 01:04:31.221 vhost_blk_cores_2ctrl 01:04:31.221 vhost_blk_fs_integrity 01:04:31.221 vhost_blk_hot_remove 01:04:31.221 vhost_blk_integrity 01:04:31.221 vhost_hotplug 01:04:31.221 vhost_migration 01:04:31.221 vhost_migration_tc1 01:04:31.221 vhost_migration_tc2 01:04:31.221 vhost_readonly 01:04:31.221 vhost_scsi_cores_2ctrl 01:04:31.221 vhost_scsi_fs_integrity 01:04:31.221 vhost_scsi_hot_remove 01:04:31.221 vhost_scsi_integrity 01:04:31.221 vmd 01:04:31.221 vmd_bdev_svc 01:04:31.221 vmd_fio 01:04:31.221 vmd_hello_world 01:04:31.221 vmd_identify 01:04:31.221 vmd_perf 01:04:31.221 xnvme_bdevperf 01:04:31.221 xnvme_to_malloc_dd_copy 01:04:31.221 zoned_fio 01:04:31.221 Not all tests were run. Failing the build. 01:04:31.221 ['blockdev_xnvme', 'ftl', 'ftl_bdevperf', 'ftl_dirty_shutdown', 'ftl_fio_basic', 'ftl_restore', 'ftl_trim', 'ftl_upgrade_shutdown', 'nvme_xnvme', 'test_create_multi_ublk', 'test_create_ublk', 'test_save_ublk_config', 'ublk', 'ublk_recovery', 'xnvme_bdevperf', 'xnvme_to_malloc_dd_copy'] 01:04:31.221 + compress_coverage_and_docs 01:04:31.221 + echo 'Start compress coverage and docs' 01:04:31.221 Start compress coverage and docs 01:04:31.221 + tar -C coverage -czf coverage_autotest-per-patch_122890.tar.gz ./ --remove-files 01:04:32.154 + tar -C ut_coverage -czf ut_coverage_autotest-per-patch_122890.tar.gz ./ --remove-files 01:04:33.087 + tar -C doc -czf doc_autotest-per-patch_122890.tar.gz ./ --remove-files 01:04:33.345 + [[ -d llvm ]] 01:04:33.345 + true 01:04:33.345 + echo 'End compress coverage and docs' 01:04:33.345 End compress coverage and docs 01:04:33.345 + remove_partial_coverage_files 01:04:33.345 + find . -name 'cov_*.info' -delete 01:04:33.345 + echo 'End stage post_gen_coverage.sh' 01:04:33.345 End stage post_gen_coverage.sh 01:04:33.362 [Pipeline] } 01:04:33.366 ERROR: script returned exit code 1 01:04:33.399 [Pipeline] // catchError 01:04:33.417 [Pipeline] catchError 01:04:33.420 [Pipeline] { 01:04:33.459 [Pipeline] dir 01:04:33.459 Running in /var/jenkins/workspace/autotest-per-patch_6/post_process 01:04:33.461 [Pipeline] {