00:00:00.000 Started by user sys_sgci 00:00:00.009 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/autotest-per-patch_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-upstream/autotest.groovy 00:00:00.010 The recommended git tool is: git 00:00:00.010 using credential 00000000-0000-0000-0000-000000000002 00:00:00.012 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/autotest-per-patch_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.025 Fetching changes from the remote Git repository 00:00:00.027 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.041 Using shallow fetch with depth 1 00:00:00.041 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.041 > git --version # timeout=10 00:00:00.052 > git --version # 'git version 2.39.2' 00:00:00.052 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.053 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.053 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:02.406 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:02.422 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:02.434 Checking out Revision c7986954d8037b9c61764d44ed2af24625b251c6 (FETCH_HEAD) 00:00:02.435 > git config core.sparsecheckout # timeout=10 00:00:02.447 > git read-tree -mu HEAD # timeout=10 00:00:02.465 > git checkout -f c7986954d8037b9c61764d44ed2af24625b251c6 # timeout=5 00:00:02.484 Commit message: "inventory/dev: add missing long names" 00:00:02.484 > git rev-list --no-walk c7986954d8037b9c61764d44ed2af24625b251c6 # timeout=10 00:00:02.665 [Pipeline] Start of Pipeline 00:00:02.680 [Pipeline] library 00:00:02.682 Loading library shm_lib@master 00:00:02.682 Library shm_lib@master is cached. Copying from home. 00:00:02.710 [Pipeline] node 00:00:02.720 Running on ME2 in /var/jenkins/workspace/autotest-per-patch_5 00:00:02.725 [Pipeline] { 00:00:02.742 [Pipeline] cleanWs 00:00:02.752 [WS-CLEANUP] Deleting project workspace... 00:00:02.752 [WS-CLEANUP] Deferred wipeout is used... 00:00:02.758 [WS-CLEANUP] done 00:00:02.763 [Pipeline] stage 00:00:02.768 [Pipeline] { (Prologue) 00:00:02.870 [Pipeline] withCredentials 00:00:02.881 > git --version # timeout=10 00:00:02.893 > git --version # 'git version 2.39.2' 00:00:02.912 Masking supported pattern matches of $GIT_USERNAME or $GIT_PASSWORD or $GIT_ASKPASS 00:00:02.914 [Pipeline] { 00:00:02.923 [Pipeline] retry 00:00:02.925 [Pipeline] { 00:00:03.094 [Pipeline] sh 00:00:03.377 + git ls-remote https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master 00:00:05.300 [Pipeline] } 00:00:05.322 [Pipeline] // retry 00:00:05.327 [Pipeline] } 00:00:05.349 [Pipeline] // withCredentials 00:00:05.358 [Pipeline] nodesByLabel 00:00:05.360 Found a total of 1 nodes with the 'sorcerer' label 00:00:05.372 [Pipeline] httpRequest 00:00:05.377 HttpMethod: GET 00:00:05.377 URL: http://10.211.164.101/packages/jbp_c7986954d8037b9c61764d44ed2af24625b251c6.tar.gz 00:00:05.378 Sending request to url: http://10.211.164.101/packages/jbp_c7986954d8037b9c61764d44ed2af24625b251c6.tar.gz 00:00:05.380 Response Code: HTTP/1.1 200 OK 00:00:05.381 Success: Status code 200 is in the accepted range: 200,404 00:00:05.381 Saving response body to /var/jenkins/workspace/autotest-per-patch_5/jbp_c7986954d8037b9c61764d44ed2af24625b251c6.tar.gz 00:00:05.654 [Pipeline] sh 00:00:05.938 + tar --no-same-owner -xf jbp_c7986954d8037b9c61764d44ed2af24625b251c6.tar.gz 00:00:05.964 [Pipeline] httpRequest 00:00:05.969 HttpMethod: GET 00:00:05.970 URL: http://10.211.164.101/packages/spdk_01f10b8a3bf61d59422d8d60472346d8199e8eee.tar.gz 00:00:05.970 Sending request to url: http://10.211.164.101/packages/spdk_01f10b8a3bf61d59422d8d60472346d8199e8eee.tar.gz 00:00:05.973 Response Code: HTTP/1.1 404 Not Found 00:00:05.974 Success: Status code 404 is in the accepted range: 200,404 00:00:05.975 Saving response body to /var/jenkins/workspace/autotest-per-patch_5/spdk_01f10b8a3bf61d59422d8d60472346d8199e8eee.tar.gz 00:00:05.987 [Pipeline] sh 00:00:06.267 + rm -f spdk_01f10b8a3bf61d59422d8d60472346d8199e8eee.tar.gz 00:00:06.283 [Pipeline] node 00:00:06.293 Running on GP10 in /var/jenkins/workspace/autotest-per-patch 00:00:06.298 [Pipeline] { 00:00:06.317 [Pipeline] cleanWs 00:00:06.329 [WS-CLEANUP] Deleting project workspace... 00:00:06.329 [WS-CLEANUP] Deferred wipeout is used... 00:00:06.337 [WS-CLEANUP] done 00:00:06.341 [Pipeline] sh 00:00:06.631 + find /storage/packages/ -type f -mtime +34 -print -delete 00:00:06.650 [Pipeline] retry 00:00:06.653 [Pipeline] { 00:00:06.679 [Pipeline] checkout 00:00:06.687 The recommended git tool is: NONE 00:00:06.699 using credential 00000000-0000-0000-0000-000000000002 00:00:06.705 Cloning the remote Git repository 00:00:06.709 Honoring refspec on initial clone 00:00:06.714 Cloning repository https://review.spdk.io/gerrit/a/spdk/spdk 00:00:06.714 > git init /var/jenkins/workspace/autotest-per-patch/spdk # timeout=10 00:00:06.722 Using reference repository: /var/ci_repos/spdk_multi 00:00:06.722 Fetching upstream changes from https://review.spdk.io/gerrit/a/spdk/spdk 00:00:06.722 > git --version # timeout=10 00:00:06.725 > git --version # 'git version 2.42.0' 00:00:06.725 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:06.726 Setting http proxy: proxy-dmz.intel.com:911 00:00:06.726 > git fetch --tags --force --progress -- https://review.spdk.io/gerrit/a/spdk/spdk refs/changes/51/22751/12 +refs/heads/master:refs/remotes/origin/master # timeout=10 00:00:23.827 Avoid second fetch 00:00:23.841 Checking out Revision 01f10b8a3bf61d59422d8d60472346d8199e8eee (FETCH_HEAD) 00:00:24.148 Commit message: "raid: fix race between starting rebuild and creating io channel" 00:00:24.156 First time build. Skipping changelog. 00:00:23.810 > git config remote.origin.url https://review.spdk.io/gerrit/a/spdk/spdk # timeout=10 00:00:23.815 > git config --add remote.origin.fetch refs/changes/51/22751/12 # timeout=10 00:00:23.819 > git config --add remote.origin.fetch +refs/heads/master:refs/remotes/origin/master # timeout=10 00:00:23.830 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:23.837 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:23.844 > git config core.sparsecheckout # timeout=10 00:00:23.847 > git checkout -f 01f10b8a3bf61d59422d8d60472346d8199e8eee # timeout=10 00:00:24.152 > git rev-list --no-walk 7d4b198309e2cbb565c38250f14666192859554c # timeout=10 00:00:24.163 > git remote # timeout=10 00:00:24.167 > git submodule init # timeout=10 00:00:24.218 > git submodule sync # timeout=10 00:00:24.268 > git config --get remote.origin.url # timeout=10 00:00:24.275 > git submodule init # timeout=10 00:00:24.319 > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10 00:00:24.322 > git config --get submodule.dpdk.url # timeout=10 00:00:24.325 > git remote # timeout=10 00:00:24.329 > git config --get remote.origin.url # timeout=10 00:00:24.332 > git config -f .gitmodules --get submodule.dpdk.path # timeout=10 00:00:24.336 > git config --get submodule.intel-ipsec-mb.url # timeout=10 00:00:24.339 > git remote # timeout=10 00:00:24.343 > git config --get remote.origin.url # timeout=10 00:00:24.347 > git config -f .gitmodules --get submodule.intel-ipsec-mb.path # timeout=10 00:00:24.350 > git config --get submodule.isa-l.url # timeout=10 00:00:24.353 > git remote # timeout=10 00:00:24.357 > git config --get remote.origin.url # timeout=10 00:00:24.360 > git config -f .gitmodules --get submodule.isa-l.path # timeout=10 00:00:24.364 > git config --get submodule.ocf.url # timeout=10 00:00:24.367 > git remote # timeout=10 00:00:24.371 > git config --get remote.origin.url # timeout=10 00:00:24.375 > git config -f .gitmodules --get submodule.ocf.path # timeout=10 00:00:24.378 > git config --get submodule.libvfio-user.url # timeout=10 00:00:24.382 > git remote # timeout=10 00:00:24.386 > git config --get remote.origin.url # timeout=10 00:00:24.390 > git config -f .gitmodules --get submodule.libvfio-user.path # timeout=10 00:00:24.394 > git config --get submodule.xnvme.url # timeout=10 00:00:24.397 > git remote # timeout=10 00:00:24.401 > git config --get remote.origin.url # timeout=10 00:00:24.405 > git config -f .gitmodules --get submodule.xnvme.path # timeout=10 00:00:24.408 > git config --get submodule.isa-l-crypto.url # timeout=10 00:00:24.412 > git remote # timeout=10 00:00:24.416 > git config --get remote.origin.url # timeout=10 00:00:24.420 > git config -f .gitmodules --get submodule.isa-l-crypto.path # timeout=10 00:00:24.424 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:24.424 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:24.424 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:24.424 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:24.424 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:24.424 Setting http proxy: proxy-dmz.intel.com:911 00:00:24.424 > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi dpdk # timeout=10 00:00:24.424 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:24.424 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:24.425 Setting http proxy: proxy-dmz.intel.com:911 00:00:24.425 > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi intel-ipsec-mb # timeout=10 00:00:24.425 Setting http proxy: proxy-dmz.intel.com:911 00:00:24.425 Setting http proxy: proxy-dmz.intel.com:911 00:00:24.425 Setting http proxy: proxy-dmz.intel.com:911 00:00:24.425 > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi libvfio-user # timeout=10 00:00:24.425 > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi ocf # timeout=10 00:00:24.425 > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi isa-l # timeout=10 00:00:24.425 Setting http proxy: proxy-dmz.intel.com:911 00:00:24.425 > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi xnvme # timeout=10 00:00:24.425 Setting http proxy: proxy-dmz.intel.com:911 00:00:24.425 > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi isa-l-crypto # timeout=10 00:00:33.308 [Pipeline] dir 00:00:33.309 Running in /var/jenkins/workspace/autotest-per-patch/spdk 00:00:33.310 [Pipeline] { 00:00:33.329 [Pipeline] sh 00:00:33.618 ++ nproc 00:00:33.618 + threads=48 00:00:33.618 + git repack -a -d --threads=48 00:00:40.214 + git submodule foreach git repack -a -d --threads=48 00:00:40.214 Entering 'dpdk' 00:00:44.430 Entering 'intel-ipsec-mb' 00:00:44.430 Entering 'isa-l' 00:00:44.691 Entering 'isa-l-crypto' 00:00:44.691 Entering 'libvfio-user' 00:00:44.953 Entering 'ocf' 00:00:45.223 Entering 'xnvme' 00:00:45.486 + find .git -type f -name alternates -print -delete 00:00:45.486 .git/modules/libvfio-user/objects/info/alternates 00:00:45.486 .git/modules/dpdk/objects/info/alternates 00:00:45.486 .git/modules/ocf/objects/info/alternates 00:00:45.486 .git/modules/intel-ipsec-mb/objects/info/alternates 00:00:45.486 .git/modules/isa-l/objects/info/alternates 00:00:45.486 .git/modules/xnvme/objects/info/alternates 00:00:45.486 .git/modules/isa-l-crypto/objects/info/alternates 00:00:45.486 .git/objects/info/alternates 00:00:45.498 [Pipeline] } 00:00:45.524 [Pipeline] // dir 00:00:45.529 [Pipeline] } 00:00:45.551 [Pipeline] // retry 00:00:45.559 [Pipeline] sh 00:00:45.850 + tar -cf spdk_01f10b8a3bf61d59422d8d60472346d8199e8eee.tar.gz -I pigz spdk 00:00:46.437 [Pipeline] httpRequest 00:00:46.445 HttpMethod: PUT 00:00:46.446 URL: http://10.211.164.101/cgi-bin/sorcerer.py?group=packages&filename=spdk_01f10b8a3bf61d59422d8d60472346d8199e8eee.tar.gz 00:00:46.446 Sending request to url: http://10.211.164.101/cgi-bin/sorcerer.py?group=packages&filename=spdk_01f10b8a3bf61d59422d8d60472346d8199e8eee.tar.gz 00:00:47.292 Response Code: HTTP/1.1 200 OK 00:00:47.296 Success: Status code 200 is in the accepted range: 200 00:00:47.301 [Pipeline] echo 00:00:47.303 00:00:47.303 Locking 00:00:47.303 Waited 0s for lock 00:00:47.303 Everything Fine. Saved: /storage/packages/spdk_01f10b8a3bf61d59422d8d60472346d8199e8eee.tar.gz 00:00:47.303 00:00:47.308 [Pipeline] cleanWs 00:00:47.317 [WS-CLEANUP] Deleting project workspace... 00:00:47.317 [WS-CLEANUP] Deferred wipeout is used... 00:00:47.323 [WS-CLEANUP] done 00:00:47.326 [Pipeline] } 00:00:47.357 [Pipeline] // node 00:00:47.366 [Pipeline] retry 00:00:47.368 [Pipeline] { 00:00:47.387 [Pipeline] httpRequest 00:00:47.392 HttpMethod: GET 00:00:47.393 URL: http://10.211.164.101/packages/spdk_01f10b8a3bf61d59422d8d60472346d8199e8eee.tar.gz 00:00:47.393 Sending request to url: http://10.211.164.101/packages/spdk_01f10b8a3bf61d59422d8d60472346d8199e8eee.tar.gz 00:00:47.395 Response Code: HTTP/1.1 200 OK 00:00:47.395 Success: Status code 200 is in the accepted range: 200,404 00:00:47.396 Saving response body to /var/jenkins/workspace/autotest-per-patch_5/spdk_01f10b8a3bf61d59422d8d60472346d8199e8eee.tar.gz 00:00:49.790 [Pipeline] } 00:00:49.810 [Pipeline] // retry 00:00:49.819 [Pipeline] sh 00:00:50.106 + tar --no-same-owner -xf spdk_01f10b8a3bf61d59422d8d60472346d8199e8eee.tar.gz 00:00:52.010 [Pipeline] sh 00:00:52.285 + git -C spdk log --oneline -n5 00:00:52.285 01f10b8a3 raid: fix race between starting rebuild and creating io channel 00:00:52.285 4506c0c36 test/common: Enable inherit_errexit 00:00:52.285 b24df7cfa test: Drop superfluous calls to print_backtrace() 00:00:52.285 7b52e4c17 test/scheduler: Meassure utime of $spdk_pid threads as a fallback 00:00:52.285 1dc065205 test/scheduler: Calculate median of the cpu load samples 00:00:52.298 [Pipeline] setCustomBuildProperty 00:00:52.304 [Pipeline] setCustomBuildProperty 00:00:52.309 [Pipeline] catchError 00:00:52.310 [Pipeline] { 00:00:52.326 [Pipeline] sh 00:00:52.604 + git -C spdk describe --tags --abbrev=0 origin/master 00:00:52.619 [Pipeline] sh 00:00:52.905 + git -C spdk describe --tags --abbrev=0 --exclude=LTS HEAD 00:00:52.918 [Pipeline] echo 00:00:52.920 Branch: master 00:00:52.924 [Pipeline] fileExists 00:00:52.941 [Pipeline] readJSON 00:00:52.956 [Pipeline] } 00:00:52.989 [Pipeline] // catchError 00:00:52.995 [Pipeline] } 00:00:53.023 [Pipeline] // stage 00:00:53.045 [Pipeline] catchError 00:00:53.047 [Pipeline] { 00:00:53.068 [Pipeline] stage 00:00:53.070 [Pipeline] { (Pre tests) 00:00:53.117 [Pipeline] parallel 00:00:53.130 [Pipeline] { (Branch: check-format-docker-autotest) 00:00:53.131 [Pipeline] { (Branch: check-so-deps-docker-autotest) 00:00:53.133 [Pipeline] { (Branch: doc-docker-autotest) 00:00:53.134 [Pipeline] { (Branch: build-files-docker-autotest) 00:00:53.158 [Pipeline] retry 00:00:53.160 [Pipeline] { 00:00:53.164 [Pipeline] retry 00:00:53.166 [Pipeline] { 00:00:53.171 [Pipeline] retry 00:00:53.172 [Pipeline] { 00:00:53.177 [Pipeline] retry 00:00:53.178 [Pipeline] { 00:00:53.205 [Pipeline] build 00:00:53.209 Scheduling project: check-format-docker-autotest 00:00:53.220 [Pipeline] build 00:00:53.223 Scheduling project: check-so-deps-docker-autotest 00:00:53.231 [Pipeline] build 00:00:53.234 Scheduling project: doc-docker-autotest 00:00:53.241 [Pipeline] build 00:00:53.244 Scheduling project: build-files-docker-autotest 00:01:00.152 Starting building: check-format-docker-autotest #22150 00:01:00.155 Starting building: doc-docker-autotest #22330 00:01:00.158 Starting building: build-files-docker-autotest #22139 00:01:00.162 Starting building: check-so-deps-docker-autotest #22163 00:01:31.070 Build doc-docker-autotest #22330 completed: SUCCESS 00:01:31.073 [Pipeline] } 00:01:31.113 [Pipeline] // retry 00:01:31.118 [Pipeline] } 00:01:43.993 Build check-format-docker-autotest #22150 completed: SUCCESS 00:01:43.996 [Pipeline] } 00:01:44.030 [Pipeline] // retry 00:01:44.036 [Pipeline] } 00:03:29.598 Build build-files-docker-autotest #22139 completed: SUCCESS 00:03:29.602 [Pipeline] } 00:03:29.640 [Pipeline] // retry 00:03:29.647 [Pipeline] } 00:04:09.169 Build check-so-deps-docker-autotest #22163 completed: SUCCESS 00:04:09.172 [Pipeline] } 00:04:09.209 [Pipeline] // retry 00:04:09.216 [Pipeline] } 00:04:09.286 [Pipeline] // parallel 00:04:09.294 [Pipeline] } 00:04:09.327 [Pipeline] // stage 00:04:09.334 [Pipeline] } 00:04:09.367 [Pipeline] // catchError 00:04:09.380 [Pipeline] catchError 00:04:09.383 [Pipeline] { 00:04:09.407 [Pipeline] stage 00:04:09.410 [Pipeline] { (Tests) 00:04:09.637 [Pipeline] parallel 00:04:09.758 [Pipeline] { (Branch: unittest-clang-docker-autotest) 00:04:09.760 [Pipeline] { (Branch: unittest-main-docker-autotest) 00:04:09.762 [Pipeline] { (Branch: autobuild-external-vg-autotest) 00:04:09.763 [Pipeline] { (Branch: scan-build-docker-autotest) 00:04:09.765 [Pipeline] { (Branch: unittest-valgrind-docker-autotest) 00:04:09.766 [Pipeline] { (Branch: lvol-vg-autotest) 00:04:09.768 [Pipeline] { (Branch: vhost-initiator-vg-autotest) 00:04:09.770 [Pipeline] { (Branch: nvmf-tcp-vg-autotest) 00:04:09.771 [Pipeline] { (Branch: nvmf-tcp-uring-vg-autotest) 00:04:09.773 [Pipeline] { (Branch: nvme-vg-autotest) 00:04:09.774 [Pipeline] { (Branch: centos7-vg-autotest) 00:04:09.776 [Pipeline] { (Branch: rocky9-vg-autotest) 00:04:09.777 [Pipeline] { (Branch: ubuntu20-vg-autotest) 00:04:09.778 [Pipeline] { (Branch: ubuntu22-vg-autotest) 00:04:09.780 [Pipeline] { (Branch: freebsd-vg-autotest) 00:04:09.781 [Pipeline] { (Branch: iscsi-vg-autotest) 00:04:09.783 [Pipeline] { (Branch: iscsi-uring-vg-autotest) 00:04:09.784 [Pipeline] { (Branch: zns-vg-autotest) 00:04:09.786 [Pipeline] { (Branch: nvme-cmb-pmr-vg-autotest) 00:04:09.787 [Pipeline] { (Branch: BlobFS-phy-autotest) 00:04:09.789 [Pipeline] { (Branch: crypto-phy-autotest) 00:04:09.790 [Pipeline] { (Branch: vhost-phy-autotest) 00:04:09.792 [Pipeline] { (Branch: nvmf-phy-autotest) 00:04:09.793 [Pipeline] { (Branch: nvmf-tcp-phy-autotest) 00:04:09.795 [Pipeline] { (Branch: nvme-phy-autotest) 00:04:09.796 [Pipeline] { (Branch: vfio-user-phy-autotest) 00:04:09.798 [Pipeline] { (Branch: short-fuzz-phy-autotest) 00:04:09.799 [Pipeline] { (Branch: dsa-phy-autotest) 00:04:09.801 [Pipeline] { (Branch: packaging-docker-autotest) 00:04:09.844 [Pipeline] retry 00:04:09.847 [Pipeline] { 00:04:09.853 [Pipeline] retry 00:04:09.855 [Pipeline] { 00:04:09.861 [Pipeline] retry 00:04:09.863 [Pipeline] { 00:04:09.869 [Pipeline] retry 00:04:09.871 [Pipeline] { 00:04:09.877 [Pipeline] retry 00:04:09.879 [Pipeline] { 00:04:09.885 [Pipeline] retry 00:04:09.888 [Pipeline] { 00:04:09.894 [Pipeline] retry 00:04:09.896 [Pipeline] { 00:04:09.902 [Pipeline] retry 00:04:09.904 [Pipeline] { 00:04:09.910 [Pipeline] retry 00:04:09.912 [Pipeline] { 00:04:09.918 [Pipeline] retry 00:04:09.921 [Pipeline] { 00:04:09.926 [Pipeline] retry 00:04:09.929 [Pipeline] { 00:04:09.934 [Pipeline] retry 00:04:09.936 [Pipeline] { 00:04:09.940 [Pipeline] retry 00:04:09.941 [Pipeline] { 00:04:09.946 [Pipeline] retry 00:04:09.947 [Pipeline] { 00:04:09.952 [Pipeline] retry 00:04:09.954 [Pipeline] { 00:04:09.958 [Pipeline] retry 00:04:09.960 [Pipeline] { 00:04:09.964 [Pipeline] retry 00:04:09.966 [Pipeline] { 00:04:09.971 [Pipeline] retry 00:04:09.973 [Pipeline] { 00:04:09.977 [Pipeline] retry 00:04:09.979 [Pipeline] { 00:04:09.984 [Pipeline] retry 00:04:09.985 [Pipeline] { 00:04:09.990 [Pipeline] retry 00:04:09.992 [Pipeline] { 00:04:09.996 [Pipeline] retry 00:04:09.997 [Pipeline] { 00:04:10.001 [Pipeline] retry 00:04:10.002 [Pipeline] { 00:04:10.006 [Pipeline] retry 00:04:10.008 [Pipeline] { 00:04:10.011 [Pipeline] retry 00:04:10.013 [Pipeline] { 00:04:10.017 [Pipeline] retry 00:04:10.018 [Pipeline] { 00:04:10.022 [Pipeline] retry 00:04:10.024 [Pipeline] { 00:04:10.028 [Pipeline] retry 00:04:10.029 [Pipeline] { 00:04:10.033 [Pipeline] retry 00:04:10.034 [Pipeline] { 00:04:10.058 [Pipeline] build 00:04:10.061 Scheduling project: unittest-clang-docker-autotest 00:04:10.067 [Pipeline] build 00:04:10.069 Scheduling project: unittest-main-docker-autotest 00:04:10.075 [Pipeline] build 00:04:10.078 Scheduling project: autobuild-external-vg-autotest 00:04:10.084 [Pipeline] build 00:04:10.086 Scheduling project: scan-build-docker-autotest 00:04:10.092 [Pipeline] build 00:04:10.094 Scheduling project: unittest-valgrind-docker-autotest 00:04:10.100 [Pipeline] build 00:04:10.102 Scheduling project: lvol-vg-autotest 00:04:10.109 [Pipeline] build 00:04:10.111 Scheduling project: vhost-initiator-vg-autotest 00:04:10.118 [Pipeline] build 00:04:10.121 Scheduling project: nvmf-tcp-vg-autotest 00:04:10.127 [Pipeline] build 00:04:10.129 Scheduling project: nvmf-tcp-uring-vg-autotest 00:04:10.135 [Pipeline] build 00:04:10.138 Scheduling project: nvme-vg-autotest 00:04:10.144 [Pipeline] build 00:04:10.146 Scheduling project: centos7-vg-autotest 00:04:10.152 [Pipeline] build 00:04:10.155 Scheduling project: rocky9-vg-autotest 00:04:10.161 [Pipeline] build 00:04:10.163 Scheduling project: ubuntu20-vg-autotest 00:04:10.224 [Pipeline] build 00:04:10.226 Scheduling project: ubuntu22-vg-autotest 00:04:10.232 [Pipeline] build 00:04:10.234 Scheduling project: freebsd-vg-autotest 00:04:10.240 [Pipeline] build 00:04:10.241 Scheduling project: iscsi-vg-autotest 00:04:10.246 [Pipeline] build 00:04:10.248 Scheduling project: iscsi-uring-vg-autotest 00:04:10.254 [Pipeline] build 00:04:10.257 Scheduling project: zns-vg-autotest 00:04:10.263 [Pipeline] build 00:04:10.266 Scheduling project: nvme-cmb-pmr-vg-autotest 00:04:10.273 [Pipeline] build 00:04:10.275 Scheduling project: BlobFS-phy-autotest 00:04:10.281 [Pipeline] build 00:04:10.283 Scheduling project: crypto-phy-autotest 00:04:10.288 [Pipeline] build 00:04:10.290 Scheduling project: vhost-phy-autotest 00:04:10.294 [Pipeline] build 00:04:10.296 Scheduling project: nvmf-phy-autotest 00:04:10.301 [Pipeline] build 00:04:10.303 Scheduling project: nvmf-tcp-phy-autotest 00:04:10.308 [Pipeline] build 00:04:10.309 Scheduling project: nvme-phy-autotest 00:04:10.314 [Pipeline] build 00:04:10.316 Scheduling project: vfio-user-phy-autotest 00:04:10.320 [Pipeline] build 00:04:10.322 Scheduling project: short-fuzz-phy-autotest 00:04:10.327 [Pipeline] build 00:04:10.329 Scheduling project: dsa-phy-autotest 00:04:10.336 [Pipeline] build 00:04:10.338 Scheduling project: packaging-docker-autotest 00:04:15.472 Starting building: BlobFS-phy-autotest #26211 00:04:15.477 Starting building: dsa-phy-autotest #4905 00:04:15.480 Starting building: rocky9-vg-autotest #16095 00:04:15.484 Starting building: crypto-phy-autotest #26205 00:04:15.488 Starting building: vhost-phy-autotest #26230 00:04:15.491 Starting building: short-fuzz-phy-autotest #26202 00:04:15.495 Starting building: unittest-main-docker-autotest #19868 00:04:15.499 Starting building: scan-build-docker-autotest #19870 00:04:15.503 Starting building: autobuild-external-vg-autotest #19830 00:04:15.507 Starting building: unittest-valgrind-docker-autotest #19871 00:04:15.510 Starting building: packaging-docker-autotest #19869 00:04:15.517 Starting building: vfio-user-phy-autotest #26213 00:04:15.521 Starting building: unittest-clang-docker-autotest #19867 00:04:15.524 Starting building: zns-vg-autotest #76591 00:04:15.527 Starting building: ubuntu22-vg-autotest #37818 00:04:15.532 Starting building: nvme-cmb-pmr-vg-autotest #78608 00:04:15.535 Starting building: nvme-vg-autotest #77485 00:04:15.539 Starting building: nvme-phy-autotest #72377 00:04:15.542 Starting building: nvmf-tcp-vg-autotest #77476 00:04:15.545 Starting building: centos7-vg-autotest #73664 00:04:15.548 Starting building: iscsi-uring-vg-autotest #77390 00:04:15.551 Starting building: iscsi-vg-autotest #77523 00:04:15.554 Starting building: nvmf-tcp-uring-vg-autotest #77410 00:04:15.559 Starting building: nvmf-tcp-phy-autotest #72336 00:04:15.562 Starting building: freebsd-vg-autotest #59130 00:04:15.568 Starting building: ubuntu20-vg-autotest #73804 00:04:15.573 Starting building: lvol-vg-autotest #77434 00:04:15.576 Starting building: nvmf-phy-autotest #72449 00:04:15.578 Starting building: vhost-initiator-vg-autotest #77505 00:07:44.139 Build unittest-clang-docker-autotest #19867 completed: SUCCESS 00:07:44.142 [Pipeline] } 00:07:44.193 [Pipeline] // retry 00:07:44.203 [Pipeline] } 00:08:11.422 Build packaging-docker-autotest #19869 completed: SUCCESS 00:08:11.426 [Pipeline] } 00:08:11.480 [Pipeline] // retry 00:08:11.488 [Pipeline] } 00:08:54.970 Build scan-build-docker-autotest #19870 completed: SUCCESS 00:08:54.975 [Pipeline] } 00:08:55.029 [Pipeline] // retry 00:08:55.035 [Pipeline] } 00:09:51.753 Build unittest-main-docker-autotest #19868 completed: SUCCESS 00:09:51.755 [Pipeline] } 00:09:51.799 [Pipeline] // retry 00:09:51.806 [Pipeline] } 00:12:09.738 Build short-fuzz-phy-autotest #26202 completed: SUCCESS 00:12:09.741 [Pipeline] } 00:12:09.792 [Pipeline] // retry 00:12:09.799 [Pipeline] } 00:13:33.681 Build autobuild-external-vg-autotest #19830 completed: SUCCESS 00:13:33.683 [Pipeline] } 00:13:33.730 [Pipeline] // retry 00:13:33.739 [Pipeline] } 00:13:38.485 Build unittest-valgrind-docker-autotest #19871 completed: SUCCESS 00:13:38.488 [Pipeline] } 00:13:38.529 [Pipeline] // retry 00:13:38.534 [Pipeline] } 00:16:31.489 Build vhost-initiator-vg-autotest #77505 completed: SUCCESS 00:16:31.491 [Pipeline] } 00:16:31.522 [Pipeline] // retry 00:16:31.528 [Pipeline] } 00:17:34.967 Build zns-vg-autotest #76591 completed: SUCCESS 00:17:34.969 [Pipeline] } 00:17:35.008 [Pipeline] // retry 00:17:35.014 [Pipeline] } 00:20:45.962 Build nvme-phy-autotest #72377 completed: FAILURE 00:20:46.880 [Pipeline] echo 00:20:46.881 No retry patterns found. 00:20:46.882 [Pipeline] } 00:20:46.918 [Pipeline] // retry 00:20:46.924 [Pipeline] error 00:20:46.929 [Pipeline] } 00:20:46.933 Failed in branch nvme-phy-autotest 00:21:40.239 Build vhost-phy-autotest #26230 completed: SUCCESS 00:21:40.242 [Pipeline] } 00:21:40.279 [Pipeline] // retry 00:21:40.286 [Pipeline] } 00:22:00.436 Build nvme-vg-autotest #77485 completed: FAILURE 00:22:01.202 [Pipeline] echo 00:22:01.204 No retry patterns found. 00:22:01.205 [Pipeline] } 00:22:01.244 [Pipeline] // retry 00:22:01.253 [Pipeline] error 00:22:01.258 [Pipeline] } 00:22:01.263 Failed in branch nvme-vg-autotest 00:23:14.803 Build vfio-user-phy-autotest #26213 completed: SUCCESS 00:23:14.805 [Pipeline] } 00:23:14.854 [Pipeline] // retry 00:23:14.863 [Pipeline] } 00:25:10.994 Build nvme-cmb-pmr-vg-autotest #78608 completed: SUCCESS 00:25:10.998 [Pipeline] } 00:25:11.048 [Pipeline] // retry 00:25:11.056 [Pipeline] } 00:25:56.006 Build lvol-vg-autotest #77434 completed: SUCCESS 00:25:56.009 [Pipeline] } 00:25:56.055 [Pipeline] // retry 00:25:56.061 [Pipeline] } 00:26:07.928 Build BlobFS-phy-autotest #26211 completed: SUCCESS 00:26:07.931 [Pipeline] } 00:26:07.978 [Pipeline] // retry 00:26:07.985 [Pipeline] } 00:26:13.138 Build iscsi-uring-vg-autotest #77390 completed: SUCCESS 00:26:13.140 [Pipeline] } 00:26:13.184 [Pipeline] // retry 00:26:13.191 [Pipeline] } 00:26:23.573 Build nvmf-phy-autotest #72449 completed: FAILURE 00:26:24.514 [Pipeline] echo 00:26:24.515 No retry patterns found. 00:26:24.516 [Pipeline] } 00:26:24.551 [Pipeline] // retry 00:26:24.559 [Pipeline] error 00:26:24.562 [Pipeline] } 00:26:24.565 Failed in branch nvmf-phy-autotest 00:28:11.610 Build freebsd-vg-autotest #59130 completed: SUCCESS 00:28:11.612 [Pipeline] } 00:28:11.644 [Pipeline] // retry 00:28:11.648 [Pipeline] } 00:29:51.989 Build iscsi-vg-autotest #77523 completed: SUCCESS 00:29:51.991 [Pipeline] } 00:29:52.024 [Pipeline] // retry 00:29:52.028 [Pipeline] } 00:32:59.223 Build crypto-phy-autotest #26205 completed: SUCCESS 00:32:59.225 [Pipeline] } 00:32:59.274 [Pipeline] // retry 00:32:59.281 [Pipeline] } 00:34:37.207 Build nvmf-tcp-phy-autotest #72336 completed: SUCCESS 00:34:37.210 [Pipeline] } 00:34:37.258 [Pipeline] // retry 00:34:37.264 [Pipeline] } 00:34:54.023 Build dsa-phy-autotest #4905 completed: SUCCESS 00:34:54.026 [Pipeline] } 00:34:54.068 [Pipeline] // retry 00:34:54.075 [Pipeline] } 00:35:36.041 Build nvmf-tcp-uring-vg-autotest #77410 completed: SUCCESS 00:35:36.043 [Pipeline] } 00:35:36.080 [Pipeline] // retry 00:35:36.087 [Pipeline] } 00:36:26.351 Build nvmf-tcp-vg-autotest #77476 completed: SUCCESS 00:36:26.354 [Pipeline] } 00:36:26.390 [Pipeline] // retry 00:36:26.397 [Pipeline] } 00:39:09.036 Build centos7-vg-autotest #73664 completed: SUCCESS 00:39:09.038 [Pipeline] } 00:39:09.070 [Pipeline] // retry 00:39:09.074 [Pipeline] } 00:48:57.148 Build rocky9-vg-autotest #16095 completed: SUCCESS 00:48:57.150 [Pipeline] } 00:48:57.188 [Pipeline] // retry 00:48:57.195 [Pipeline] } 00:58:24.055 Build ubuntu20-vg-autotest #73804 completed: FAILURE 00:58:26.180 [Pipeline] echo 00:58:26.181 No retry patterns found. 00:58:26.182 [Pipeline] } 00:58:26.216 [Pipeline] // retry 00:58:26.223 [Pipeline] error 00:58:26.228 [Pipeline] } 00:58:26.233 Failed in branch ubuntu20-vg-autotest 00:58:49.590 Build ubuntu22-vg-autotest #37818 completed: SUCCESS 00:58:49.592 [Pipeline] } 00:58:49.629 [Pipeline] // retry 00:58:49.634 [Pipeline] } 00:58:49.899 [Pipeline] // parallel 00:58:49.910 [Pipeline] } 00:58:49.934 [Pipeline] // stage 00:58:49.945 [Pipeline] } 00:58:49.954 ERROR: Build nvme-phy-autotest #72377 failed 00:58:49.971 [Pipeline] // catchError 00:58:49.978 [Pipeline] stage 00:58:49.980 [Pipeline] { (Autorun Post and Coverage) 00:58:50.002 [Pipeline] setCustomBuildProperty 00:58:50.019 [Pipeline] dir 00:58:50.019 Running in /var/jenkins/workspace/autotest-per-patch_5/doc-docker-autotest_22330 00:58:50.020 [Pipeline] { 00:58:50.040 [Pipeline] copyArtifacts 00:58:50.307 Copied 6 artifacts from "doc-docker-autotest" build number 22330 00:58:50.311 [Pipeline] writeFile 00:58:50.338 [Pipeline] } 00:58:50.360 [Pipeline] // dir 00:58:50.377 [Pipeline] dir 00:58:50.378 Running in /var/jenkins/workspace/autotest-per-patch_5/check-format-docker-autotest_22150 00:58:50.380 [Pipeline] { 00:58:50.404 [Pipeline] copyArtifacts 00:58:50.472 Copied 5 artifacts from "check-format-docker-autotest" build number 22150 00:58:50.478 [Pipeline] writeFile 00:58:50.504 [Pipeline] } 00:58:50.531 [Pipeline] // dir 00:58:50.655 [Pipeline] dir 00:58:50.655 Running in /var/jenkins/workspace/autotest-per-patch_5/build-files-docker-autotest_22139 00:58:50.656 [Pipeline] { 00:58:50.679 [Pipeline] copyArtifacts 00:58:50.754 Copied 5 artifacts from "build-files-docker-autotest" build number 22139 00:58:50.760 [Pipeline] writeFile 00:58:50.814 [Pipeline] } 00:58:50.860 [Pipeline] // dir 00:58:50.908 [Pipeline] dir 00:58:50.908 Running in /var/jenkins/workspace/autotest-per-patch_5/check-so-deps-docker-autotest_22163 00:58:50.909 [Pipeline] { 00:58:50.930 [Pipeline] copyArtifacts 00:58:51.005 Copied 5 artifacts from "check-so-deps-docker-autotest" build number 22163 00:58:51.008 [Pipeline] writeFile 00:58:51.036 [Pipeline] } 00:58:51.068 [Pipeline] // dir 00:58:51.205 [Pipeline] dir 00:58:51.206 Running in /var/jenkins/workspace/autotest-per-patch_5/unittest-clang-docker-autotest_19867 00:58:51.207 [Pipeline] { 00:58:51.233 [Pipeline] copyArtifacts 00:58:51.315 Copied 5 artifacts from "unittest-clang-docker-autotest" build number 19867 00:58:51.320 [Pipeline] writeFile 00:58:51.403 [Pipeline] } 00:58:51.448 [Pipeline] // dir 00:58:51.822 [Pipeline] dir 00:58:51.823 Running in /var/jenkins/workspace/autotest-per-patch_5/packaging-docker-autotest_19869 00:58:51.824 [Pipeline] { 00:58:51.863 [Pipeline] copyArtifacts 00:58:51.950 Copied 5 artifacts from "packaging-docker-autotest" build number 19869 00:58:51.955 [Pipeline] writeFile 00:58:52.164 [Pipeline] } 00:58:52.248 [Pipeline] // dir 00:58:52.273 [Pipeline] dir 00:58:52.274 Running in /var/jenkins/workspace/autotest-per-patch_5/scan-build-docker-autotest_19870 00:58:52.275 [Pipeline] { 00:58:52.301 [Pipeline] copyArtifacts 00:58:52.423 Copied 9 artifacts from "scan-build-docker-autotest" build number 19870 00:58:52.428 [Pipeline] writeFile 00:58:52.452 [Pipeline] } 00:58:52.479 [Pipeline] // dir 00:58:52.620 [Pipeline] dir 00:58:52.620 Running in /var/jenkins/workspace/autotest-per-patch_5/unittest-main-docker-autotest_19868 00:58:52.621 [Pipeline] { 00:58:52.647 [Pipeline] copyArtifacts 00:58:53.026 Copied 6 artifacts from "unittest-main-docker-autotest" build number 19868 00:58:53.030 [Pipeline] writeFile 00:58:53.081 [Pipeline] } 00:58:53.134 [Pipeline] // dir 00:58:53.506 [Pipeline] dir 00:58:53.506 Running in /var/jenkins/workspace/autotest-per-patch_5/short-fuzz-phy-autotest_26202 00:58:53.507 [Pipeline] { 00:58:53.549 [Pipeline] copyArtifacts 00:58:53.680 Copied 10 artifacts from "short-fuzz-phy-autotest" build number 26202 00:58:53.684 [Pipeline] writeFile 00:58:53.858 [Pipeline] } 00:58:53.987 [Pipeline] // dir 00:58:54.109 [Pipeline] dir 00:58:54.109 Running in /var/jenkins/workspace/autotest-per-patch_5/autobuild-external-vg-autotest_19830 00:58:54.110 [Pipeline] { 00:58:54.140 [Pipeline] copyArtifacts 00:58:54.232 Copied 8 artifacts from "autobuild-external-vg-autotest" build number 19830 00:58:54.237 [Pipeline] writeFile 00:58:54.309 [Pipeline] } 00:58:54.371 [Pipeline] // dir 00:58:54.761 [Pipeline] dir 00:58:54.761 Running in /var/jenkins/workspace/autotest-per-patch_5/unittest-valgrind-docker-autotest_19871 00:58:54.762 [Pipeline] { 00:58:54.805 [Pipeline] copyArtifacts 00:58:55.051 Copied 6 artifacts from "unittest-valgrind-docker-autotest" build number 19871 00:58:55.055 [Pipeline] writeFile 00:58:55.205 [Pipeline] } 00:58:55.318 [Pipeline] // dir 00:58:55.619 [Pipeline] dir 00:58:55.619 Running in /var/jenkins/workspace/autotest-per-patch_5/vhost-initiator-vg-autotest_77505 00:58:55.620 [Pipeline] { 00:58:55.661 [Pipeline] copyArtifacts 00:58:55.930 Copied 16 artifacts from "vhost-initiator-vg-autotest" build number 77505 00:58:55.935 [Pipeline] writeFile 00:58:56.060 [Pipeline] } 00:58:56.150 [Pipeline] // dir 00:58:56.477 [Pipeline] dir 00:58:56.477 Running in /var/jenkins/workspace/autotest-per-patch_5/zns-vg-autotest_76591 00:58:56.478 [Pipeline] { 00:58:56.517 [Pipeline] copyArtifacts 00:58:56.758 Copied 13 artifacts from "zns-vg-autotest" build number 76591 00:58:56.763 [Pipeline] writeFile 00:58:56.919 [Pipeline] } 00:58:57.022 [Pipeline] // dir 00:58:57.593 [Pipeline] dir 00:58:57.593 Running in /var/jenkins/workspace/autotest-per-patch_5/nvme-phy-autotest_72377 00:58:57.595 [Pipeline] { 00:58:57.646 [Pipeline] copyArtifacts 00:58:58.041 Copied 11 artifacts from "nvme-phy-autotest" build number 72377 00:58:58.045 [Pipeline] writeFile 00:58:58.244 [Pipeline] } 00:58:58.380 [Pipeline] // dir 00:58:58.772 [Pipeline] dir 00:58:58.772 Running in /var/jenkins/workspace/autotest-per-patch_5/vhost-phy-autotest_26230 00:58:58.773 [Pipeline] { 00:58:58.819 [Pipeline] copyArtifacts 00:58:59.063 Copied 12 artifacts from "vhost-phy-autotest" build number 26230 00:58:59.090 [Pipeline] writeFile 00:58:59.305 [Pipeline] } 00:58:59.410 [Pipeline] // dir 00:58:59.888 [Pipeline] dir 00:58:59.888 Running in /var/jenkins/workspace/autotest-per-patch_5/nvme-vg-autotest_77485 00:58:59.889 [Pipeline] { 00:58:59.936 [Pipeline] copyArtifacts 00:59:00.189 Copied 12 artifacts from "nvme-vg-autotest" build number 77485 00:59:00.193 [Pipeline] writeFile 00:59:00.379 [Pipeline] } 00:59:00.495 [Pipeline] // dir 00:59:00.986 [Pipeline] dir 00:59:00.987 Running in /var/jenkins/workspace/autotest-per-patch_5/vfio-user-phy-autotest_26213 00:59:00.988 [Pipeline] { 00:59:01.036 [Pipeline] copyArtifacts 00:59:01.285 Copied 12 artifacts from "vfio-user-phy-autotest" build number 26213 00:59:01.289 [Pipeline] writeFile 00:59:01.523 [Pipeline] } 00:59:01.622 [Pipeline] // dir 00:59:01.945 [Pipeline] dir 00:59:01.946 Running in /var/jenkins/workspace/autotest-per-patch_5/nvme-cmb-pmr-vg-autotest_78608 00:59:01.947 [Pipeline] { 00:59:01.986 [Pipeline] copyArtifacts 00:59:02.200 Copied 12 artifacts from "nvme-cmb-pmr-vg-autotest" build number 78608 00:59:02.204 [Pipeline] writeFile 00:59:02.420 [Pipeline] } 00:59:02.536 [Pipeline] // dir 00:59:03.086 [Pipeline] dir 00:59:03.086 Running in /var/jenkins/workspace/autotest-per-patch_5/lvol-vg-autotest_77434 00:59:03.087 [Pipeline] { 00:59:03.136 [Pipeline] copyArtifacts 00:59:03.345 Copied 12 artifacts from "lvol-vg-autotest" build number 77434 00:59:03.349 [Pipeline] writeFile 00:59:03.655 [Pipeline] } 00:59:03.806 [Pipeline] // dir 00:59:04.067 [Pipeline] dir 00:59:04.067 Running in /var/jenkins/workspace/autotest-per-patch_5/BlobFS-phy-autotest_26211 00:59:04.068 [Pipeline] { 00:59:04.103 [Pipeline] copyArtifacts 00:59:04.476 Copied 28 artifacts from "BlobFS-phy-autotest" build number 26211 00:59:04.481 [Pipeline] writeFile 00:59:04.607 [Pipeline] } 00:59:04.678 [Pipeline] // dir 00:59:06.589 [Pipeline] dir 00:59:06.589 Running in /var/jenkins/workspace/autotest-per-patch_5/iscsi-uring-vg-autotest_77390 00:59:06.590 [Pipeline] { 00:59:06.768 [Pipeline] copyArtifacts 00:59:09.573 Copied 17 artifacts from "iscsi-uring-vg-autotest" build number 77390 00:59:09.579 [Pipeline] writeFile 00:59:11.015 [Pipeline] } 00:59:11.547 [Pipeline] // dir 00:59:12.128 [Pipeline] dir 00:59:12.128 Running in /var/jenkins/workspace/autotest-per-patch_5/nvmf-phy-autotest_72449 00:59:12.129 [Pipeline] { 00:59:12.182 [Pipeline] copyArtifacts 00:59:13.182 Copied 17 artifacts from "nvmf-phy-autotest" build number 72449 00:59:13.186 [Pipeline] writeFile 00:59:13.399 [Pipeline] } 00:59:13.532 [Pipeline] // dir 00:59:14.275 [Pipeline] dir 00:59:14.276 Running in /var/jenkins/workspace/autotest-per-patch_5/freebsd-vg-autotest_59130 00:59:14.277 [Pipeline] { 00:59:14.326 [Pipeline] copyArtifacts 00:59:14.414 Copied 7 artifacts from "freebsd-vg-autotest" build number 59130 00:59:14.418 [Pipeline] writeFile 00:59:14.712 [Pipeline] } 00:59:14.874 [Pipeline] // dir 00:59:16.773 [Pipeline] dir 00:59:16.773 Running in /var/jenkins/workspace/autotest-per-patch_5/iscsi-vg-autotest_77523 00:59:16.774 [Pipeline] { 00:59:16.941 [Pipeline] copyArtifacts 00:59:19.150 Copied 16 artifacts from "iscsi-vg-autotest" build number 77523 00:59:19.155 [Pipeline] writeFile 00:59:20.122 [Pipeline] } 00:59:20.544 [Pipeline] // dir 00:59:22.043 [Pipeline] dir 00:59:22.043 Running in /var/jenkins/workspace/autotest-per-patch_5/crypto-phy-autotest_26205 00:59:22.044 [Pipeline] { 00:59:22.143 [Pipeline] copyArtifacts 00:59:22.292 Copied 12 artifacts from "crypto-phy-autotest" build number 26205 00:59:22.297 [Pipeline] writeFile 00:59:22.801 [Pipeline] } 00:59:23.040 [Pipeline] // dir 00:59:24.558 [Pipeline] dir 00:59:24.559 Running in /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-phy-autotest_72336 00:59:24.559 [Pipeline] { 00:59:24.677 [Pipeline] copyArtifacts 00:59:24.873 Copied 13 artifacts from "nvmf-tcp-phy-autotest" build number 72336 00:59:24.876 [Pipeline] writeFile 00:59:25.701 [Pipeline] } 00:59:26.114 [Pipeline] // dir 00:59:27.036 [Pipeline] dir 00:59:27.036 Running in /var/jenkins/workspace/autotest-per-patch_5/dsa-phy-autotest_4905 00:59:27.037 [Pipeline] { 00:59:27.130 [Pipeline] copyArtifacts 00:59:27.395 Copied 13 artifacts from "dsa-phy-autotest" build number 4905 00:59:27.399 [Pipeline] writeFile 00:59:27.844 [Pipeline] } 00:59:28.036 [Pipeline] // dir 00:59:28.936 [Pipeline] dir 00:59:28.936 Running in /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-uring-vg-autotest_77410 00:59:28.937 [Pipeline] { 00:59:28.997 [Pipeline] copyArtifacts 00:59:29.230 Copied 13 artifacts from "nvmf-tcp-uring-vg-autotest" build number 77410 00:59:29.234 [Pipeline] writeFile 00:59:29.597 [Pipeline] } 00:59:29.796 [Pipeline] // dir 00:59:30.858 [Pipeline] dir 00:59:30.859 Running in /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-vg-autotest_77476 00:59:30.860 [Pipeline] { 00:59:30.944 [Pipeline] copyArtifacts 00:59:31.188 Copied 13 artifacts from "nvmf-tcp-vg-autotest" build number 77476 00:59:31.192 [Pipeline] writeFile 00:59:31.577 [Pipeline] } 00:59:31.751 [Pipeline] // dir 00:59:32.610 [Pipeline] dir 00:59:32.610 Running in /var/jenkins/workspace/autotest-per-patch_5/centos7-vg-autotest_73664 00:59:32.611 [Pipeline] { 00:59:32.690 [Pipeline] copyArtifacts 00:59:33.146 Copied 13 artifacts from "centos7-vg-autotest" build number 73664 00:59:33.150 [Pipeline] writeFile 00:59:33.486 [Pipeline] } 00:59:33.642 [Pipeline] // dir 00:59:34.795 [Pipeline] dir 00:59:34.795 Running in /var/jenkins/workspace/autotest-per-patch_5/rocky9-vg-autotest_16095 00:59:34.796 [Pipeline] { 00:59:34.891 [Pipeline] copyArtifacts 00:59:35.260 Copied 13 artifacts from "rocky9-vg-autotest" build number 16095 00:59:35.264 [Pipeline] writeFile 00:59:35.804 [Pipeline] } 00:59:36.039 [Pipeline] // dir 00:59:37.391 [Pipeline] dir 00:59:37.392 Running in /var/jenkins/workspace/autotest-per-patch_5/ubuntu20-vg-autotest_73804 00:59:37.393 [Pipeline] { 00:59:37.474 [Pipeline] copyArtifacts 00:59:38.249 Copied 12 artifacts from "ubuntu20-vg-autotest" build number 73804 00:59:38.252 [Pipeline] writeFile 00:59:38.703 [Pipeline] } 00:59:38.976 [Pipeline] // dir 00:59:40.090 [Pipeline] dir 00:59:40.091 Running in /var/jenkins/workspace/autotest-per-patch_5/ubuntu22-vg-autotest_37818 00:59:40.092 [Pipeline] { 00:59:40.218 [Pipeline] copyArtifacts 00:59:40.580 Copied 13 artifacts from "ubuntu22-vg-autotest" build number 37818 00:59:40.584 [Pipeline] writeFile 00:59:41.065 [Pipeline] } 00:59:41.318 [Pipeline] // dir 00:59:41.329 [Pipeline] catchError 00:59:41.331 [Pipeline] { 00:59:41.354 [Pipeline] sh 00:59:41.627 + jbp/jenkins/jjb-config/jobs/scripts/post_gen_coverage.sh 00:59:41.627 + shopt -s globstar nullglob 00:59:41.627 + echo 'Start stage post_gen_coverage.sh' 00:59:41.627 Start stage post_gen_coverage.sh 00:59:41.627 + cd /var/jenkins/workspace/autotest-per-patch_5 00:59:41.627 + rm -rf /var/jenkins/workspace/autotest-per-patch_5/spdk/doc 00:59:41.627 + trap 'compress_coverage_and_docs; remove_partial_coverage_files && echo '\''End stage post_gen_coverage.sh'\''' EXIT 00:59:41.627 + move_artifacts 00:59:41.627 + local out_dirs 00:59:41.627 + out_dirs=(./**/output/) 00:59:41.627 + for dir in "${out_dirs[@]}" 00:59:41.627 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.627 + [[ -f ./autobuild-external-vg-autotest_19830/output//doc.tar.xz ]] 00:59:41.627 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.627 + [[ -f ./autobuild-external-vg-autotest_19830/output//ut_coverage.tar.xz ]] 00:59:41.627 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.627 + [[ -f ./autobuild-external-vg-autotest_19830/output//llvm.tar.xz ]] 00:59:41.627 + mv ./autobuild-external-vg-autotest_19830/output//build-pkg-manifest.txt ./autobuild-external-vg-autotest_19830/output//build-repo-manifest.txt ./autobuild-external-vg-autotest_19830/output//dmesg.init.log ./autobuild-external-vg-autotest_19830/output//dmesg.log ./autobuild-external-vg-autotest_19830/output//power.tar.xz ./autobuild-external-vg-autotest_19830/output//test_completions.txt ./autobuild-external-vg-autotest_19830/output//timing.svg ./autobuild-external-vg-autotest_19830/output//timing.txt ./autobuild-external-vg-autotest_19830/output//.. 00:59:41.627 + rmdir ./autobuild-external-vg-autotest_19830/output/ 00:59:41.627 + for dir in "${out_dirs[@]}" 00:59:41.627 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.627 + [[ -f ./BlobFS-phy-autotest_26211/output//doc.tar.xz ]] 00:59:41.627 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.627 + [[ -f ./BlobFS-phy-autotest_26211/output//ut_coverage.tar.xz ]] 00:59:41.627 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.627 + [[ -f ./BlobFS-phy-autotest_26211/output//llvm.tar.xz ]] 00:59:41.627 + mv ./BlobFS-phy-autotest_26211/output//all_tests.txt ./BlobFS-phy-autotest_26211/output//build-pkg-manifest.txt ./BlobFS-phy-autotest_26211/output//build-repo-manifest.txt ./BlobFS-phy-autotest_26211/output//cov_base.info.xz ./BlobFS-phy-autotest_26211/output//cov_test.info.xz ./BlobFS-phy-autotest_26211/output//cov_total.info.xz ./BlobFS-phy-autotest_26211/output//dmesg.init.log ./BlobFS-phy-autotest_26211/output//dmesg.log ./BlobFS-phy-autotest_26211/output//power.tar.xz ./BlobFS-phy-autotest_26211/output//rocksdb ./BlobFS-phy-autotest_26211/output//test_completions.txt ./BlobFS-phy-autotest_26211/output//timing.svg ./BlobFS-phy-autotest_26211/output//timing.txt ./BlobFS-phy-autotest_26211/output//.. 00:59:41.627 + rmdir ./BlobFS-phy-autotest_26211/output/ 00:59:41.627 + for dir in "${out_dirs[@]}" 00:59:41.627 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.627 + [[ -f ./build-files-docker-autotest_22139/output//doc.tar.xz ]] 00:59:41.627 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.627 + [[ -f ./build-files-docker-autotest_22139/output//ut_coverage.tar.xz ]] 00:59:41.627 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.627 + [[ -f ./build-files-docker-autotest_22139/output//llvm.tar.xz ]] 00:59:41.627 + mv ./build-files-docker-autotest_22139/output//build-pkg-manifest.txt ./build-files-docker-autotest_22139/output//build-repo-manifest.txt ./build-files-docker-autotest_22139/output//power.tar.xz ./build-files-docker-autotest_22139/output//test_completions.txt ./build-files-docker-autotest_22139/output//timing.txt ./build-files-docker-autotest_22139/output//.. 00:59:41.627 + rmdir ./build-files-docker-autotest_22139/output/ 00:59:41.627 + for dir in "${out_dirs[@]}" 00:59:41.627 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.627 + [[ -f ./centos7-vg-autotest_73664/output//doc.tar.xz ]] 00:59:41.627 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.627 + [[ -f ./centos7-vg-autotest_73664/output//ut_coverage.tar.xz ]] 00:59:41.627 + tar -C ./centos7-vg-autotest_73664/output/ -xf ./centos7-vg-autotest_73664/output//ut_coverage.tar.xz 00:59:41.886 + rm ./centos7-vg-autotest_73664/output//ut_coverage.tar.xz 00:59:41.886 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.886 + [[ -f ./centos7-vg-autotest_73664/output//llvm.tar.xz ]] 00:59:41.886 + mv ./centos7-vg-autotest_73664/output//all_tests.txt ./centos7-vg-autotest_73664/output//build-pkg-manifest.txt ./centos7-vg-autotest_73664/output//build-repo-manifest.txt ./centos7-vg-autotest_73664/output//cov_base.info.xz ./centos7-vg-autotest_73664/output//cov_test.info.xz ./centos7-vg-autotest_73664/output//cov_total.info.xz ./centos7-vg-autotest_73664/output//dmesg.init.log ./centos7-vg-autotest_73664/output//dmesg.log ./centos7-vg-autotest_73664/output//power.tar.xz ./centos7-vg-autotest_73664/output//test_completions.txt ./centos7-vg-autotest_73664/output//timing.svg ./centos7-vg-autotest_73664/output//timing.txt ./centos7-vg-autotest_73664/output//ut_coverage ./centos7-vg-autotest_73664/output//.. 00:59:41.886 + rmdir ./centos7-vg-autotest_73664/output/ 00:59:41.886 + for dir in "${out_dirs[@]}" 00:59:41.886 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.886 + [[ -f ./check-format-docker-autotest_22150/output//doc.tar.xz ]] 00:59:41.886 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.886 + [[ -f ./check-format-docker-autotest_22150/output//ut_coverage.tar.xz ]] 00:59:41.886 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.886 + [[ -f ./check-format-docker-autotest_22150/output//llvm.tar.xz ]] 00:59:41.886 + mv ./check-format-docker-autotest_22150/output//build-pkg-manifest.txt ./check-format-docker-autotest_22150/output//build-repo-manifest.txt ./check-format-docker-autotest_22150/output//power.tar.xz ./check-format-docker-autotest_22150/output//test_completions.txt ./check-format-docker-autotest_22150/output//timing.txt ./check-format-docker-autotest_22150/output//.. 00:59:41.886 + rmdir ./check-format-docker-autotest_22150/output/ 00:59:41.886 + for dir in "${out_dirs[@]}" 00:59:41.886 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.886 + [[ -f ./check-so-deps-docker-autotest_22163/output//doc.tar.xz ]] 00:59:41.886 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.886 + [[ -f ./check-so-deps-docker-autotest_22163/output//ut_coverage.tar.xz ]] 00:59:41.886 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.886 + [[ -f ./check-so-deps-docker-autotest_22163/output//llvm.tar.xz ]] 00:59:41.886 + mv ./check-so-deps-docker-autotest_22163/output//build-pkg-manifest.txt ./check-so-deps-docker-autotest_22163/output//build-repo-manifest.txt ./check-so-deps-docker-autotest_22163/output//power.tar.xz ./check-so-deps-docker-autotest_22163/output//test_completions.txt ./check-so-deps-docker-autotest_22163/output//timing.txt ./check-so-deps-docker-autotest_22163/output//.. 00:59:41.886 + rmdir ./check-so-deps-docker-autotest_22163/output/ 00:59:41.886 + for dir in "${out_dirs[@]}" 00:59:41.886 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.886 + [[ -f ./crypto-phy-autotest_26205/output//doc.tar.xz ]] 00:59:41.886 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.886 + [[ -f ./crypto-phy-autotest_26205/output//ut_coverage.tar.xz ]] 00:59:41.886 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.886 + [[ -f ./crypto-phy-autotest_26205/output//llvm.tar.xz ]] 00:59:41.886 + mv ./crypto-phy-autotest_26205/output//all_tests.txt ./crypto-phy-autotest_26205/output//build-pkg-manifest.txt ./crypto-phy-autotest_26205/output//build-repo-manifest.txt ./crypto-phy-autotest_26205/output//cov_base.info.xz ./crypto-phy-autotest_26205/output//cov_test.info.xz ./crypto-phy-autotest_26205/output//cov_total.info.xz ./crypto-phy-autotest_26205/output//dmesg.init.log ./crypto-phy-autotest_26205/output//dmesg.log ./crypto-phy-autotest_26205/output//power.tar.xz ./crypto-phy-autotest_26205/output//test_completions.txt ./crypto-phy-autotest_26205/output//timing.svg ./crypto-phy-autotest_26205/output//timing.txt ./crypto-phy-autotest_26205/output//.. 00:59:41.886 + rmdir ./crypto-phy-autotest_26205/output/ 00:59:41.886 + for dir in "${out_dirs[@]}" 00:59:41.886 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.886 + [[ -f ./doc-docker-autotest_22330/output//doc.tar.xz ]] 00:59:41.886 + tar -C ./doc-docker-autotest_22330/output/ -xf ./doc-docker-autotest_22330/output//doc.tar.xz 00:59:41.886 + rm ./doc-docker-autotest_22330/output//doc.tar.xz 00:59:41.886 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.886 + [[ -f ./doc-docker-autotest_22330/output//ut_coverage.tar.xz ]] 00:59:41.886 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.886 + [[ -f ./doc-docker-autotest_22330/output//llvm.tar.xz ]] 00:59:41.886 + mv ./doc-docker-autotest_22330/output//build-pkg-manifest.txt ./doc-docker-autotest_22330/output//build-repo-manifest.txt ./doc-docker-autotest_22330/output//doc ./doc-docker-autotest_22330/output//power.tar.xz ./doc-docker-autotest_22330/output//test_completions.txt ./doc-docker-autotest_22330/output//timing.txt ./doc-docker-autotest_22330/output//.. 00:59:41.886 + rmdir ./doc-docker-autotest_22330/output/ 00:59:41.886 + for dir in "${out_dirs[@]}" 00:59:41.886 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.886 + [[ -f ./dsa-phy-autotest_4905/output//doc.tar.xz ]] 00:59:41.886 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.886 + [[ -f ./dsa-phy-autotest_4905/output//ut_coverage.tar.xz ]] 00:59:41.886 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.886 + [[ -f ./dsa-phy-autotest_4905/output//llvm.tar.xz ]] 00:59:41.886 + mv ./dsa-phy-autotest_4905/output//all_tests.txt ./dsa-phy-autotest_4905/output//build-pkg-manifest.txt ./dsa-phy-autotest_4905/output//build-repo-manifest.txt ./dsa-phy-autotest_4905/output//cov_base.info.xz ./dsa-phy-autotest_4905/output//cov_test.info.xz ./dsa-phy-autotest_4905/output//cov_total.info.xz ./dsa-phy-autotest_4905/output//dmesg.init.log ./dsa-phy-autotest_4905/output//dmesg.log ./dsa-phy-autotest_4905/output//nvmf_trace.0_shm.tar.gz ./dsa-phy-autotest_4905/output//power.tar.xz ./dsa-phy-autotest_4905/output//test_completions.txt ./dsa-phy-autotest_4905/output//timing.svg ./dsa-phy-autotest_4905/output//timing.txt ./dsa-phy-autotest_4905/output//.. 00:59:41.886 + rmdir ./dsa-phy-autotest_4905/output/ 00:59:41.886 + for dir in "${out_dirs[@]}" 00:59:41.886 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.886 + [[ -f ./freebsd-vg-autotest_59130/output//doc.tar.xz ]] 00:59:41.886 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.886 + [[ -f ./freebsd-vg-autotest_59130/output//ut_coverage.tar.xz ]] 00:59:41.886 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.886 + [[ -f ./freebsd-vg-autotest_59130/output//llvm.tar.xz ]] 00:59:41.886 + mv ./freebsd-vg-autotest_59130/output//all_tests.txt ./freebsd-vg-autotest_59130/output//build-pkg-manifest.txt ./freebsd-vg-autotest_59130/output//build-repo-manifest.txt ./freebsd-vg-autotest_59130/output//messages ./freebsd-vg-autotest_59130/output//power.tar.xz ./freebsd-vg-autotest_59130/output//test_completions.txt ./freebsd-vg-autotest_59130/output//timing.txt ./freebsd-vg-autotest_59130/output//.. 00:59:41.886 + rmdir ./freebsd-vg-autotest_59130/output/ 00:59:41.886 + for dir in "${out_dirs[@]}" 00:59:41.886 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.886 + [[ -f ./iscsi-uring-vg-autotest_77390/output//doc.tar.xz ]] 00:59:41.886 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.886 + [[ -f ./iscsi-uring-vg-autotest_77390/output//ut_coverage.tar.xz ]] 00:59:41.886 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.886 + [[ -f ./iscsi-uring-vg-autotest_77390/output//llvm.tar.xz ]] 00:59:41.886 + mv ./iscsi-uring-vg-autotest_77390/output//all_tests.txt ./iscsi-uring-vg-autotest_77390/output//build-kernel-manifest.txt ./iscsi-uring-vg-autotest_77390/output//build-pkg-manifest.txt ./iscsi-uring-vg-autotest_77390/output//build-repo-manifest.txt ./iscsi-uring-vg-autotest_77390/output//calsoft.json ./iscsi-uring-vg-autotest_77390/output//calsoft.tar.xz ./iscsi-uring-vg-autotest_77390/output//cov_base.info.xz ./iscsi-uring-vg-autotest_77390/output//cov_test.info.xz ./iscsi-uring-vg-autotest_77390/output//cov_total.info.xz ./iscsi-uring-vg-autotest_77390/output//dmesg.init.log ./iscsi-uring-vg-autotest_77390/output//dmesg.log ./iscsi-uring-vg-autotest_77390/output//iscsi_autofuzz_logs.txt ./iscsi-uring-vg-autotest_77390/output//iscsi_autofuzz_tgt_output.txt ./iscsi-uring-vg-autotest_77390/output//power.tar.xz ./iscsi-uring-vg-autotest_77390/output//test_completions.txt ./iscsi-uring-vg-autotest_77390/output//timing.svg ./iscsi-uring-vg-autotest_77390/output//timing.txt ./iscsi-uring-vg-autotest_77390/output//.. 00:59:41.886 + rmdir ./iscsi-uring-vg-autotest_77390/output/ 00:59:41.886 + for dir in "${out_dirs[@]}" 00:59:41.886 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.886 + [[ -f ./iscsi-vg-autotest_77523/output//doc.tar.xz ]] 00:59:41.886 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.886 + [[ -f ./iscsi-vg-autotest_77523/output//ut_coverage.tar.xz ]] 00:59:41.886 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.886 + [[ -f ./iscsi-vg-autotest_77523/output//llvm.tar.xz ]] 00:59:41.886 + mv ./iscsi-vg-autotest_77523/output//all_tests.txt ./iscsi-vg-autotest_77523/output//build-pkg-manifest.txt ./iscsi-vg-autotest_77523/output//build-repo-manifest.txt ./iscsi-vg-autotest_77523/output//calsoft.json ./iscsi-vg-autotest_77523/output//calsoft.tar.xz ./iscsi-vg-autotest_77523/output//cov_base.info.xz ./iscsi-vg-autotest_77523/output//cov_test.info.xz ./iscsi-vg-autotest_77523/output//cov_total.info.xz ./iscsi-vg-autotest_77523/output//dmesg.init.log ./iscsi-vg-autotest_77523/output//dmesg.log ./iscsi-vg-autotest_77523/output//iscsi_autofuzz_logs.txt ./iscsi-vg-autotest_77523/output//iscsi_autofuzz_tgt_output.txt ./iscsi-vg-autotest_77523/output//power.tar.xz ./iscsi-vg-autotest_77523/output//test_completions.txt ./iscsi-vg-autotest_77523/output//timing.svg ./iscsi-vg-autotest_77523/output//timing.txt ./iscsi-vg-autotest_77523/output//.. 00:59:41.886 + rmdir ./iscsi-vg-autotest_77523/output/ 00:59:41.886 + for dir in "${out_dirs[@]}" 00:59:41.886 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.886 + [[ -f ./lvol-vg-autotest_77434/output//doc.tar.xz ]] 00:59:41.886 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.886 + [[ -f ./lvol-vg-autotest_77434/output//ut_coverage.tar.xz ]] 00:59:41.886 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.886 + [[ -f ./lvol-vg-autotest_77434/output//llvm.tar.xz ]] 00:59:41.886 + mv ./lvol-vg-autotest_77434/output//all_tests.txt ./lvol-vg-autotest_77434/output//build-pkg-manifest.txt ./lvol-vg-autotest_77434/output//build-repo-manifest.txt ./lvol-vg-autotest_77434/output//cov_base.info.xz ./lvol-vg-autotest_77434/output//cov_test.info.xz ./lvol-vg-autotest_77434/output//cov_total.info.xz ./lvol-vg-autotest_77434/output//dmesg.init.log ./lvol-vg-autotest_77434/output//dmesg.log ./lvol-vg-autotest_77434/output//power.tar.xz ./lvol-vg-autotest_77434/output//test_completions.txt ./lvol-vg-autotest_77434/output//timing.svg ./lvol-vg-autotest_77434/output//timing.txt ./lvol-vg-autotest_77434/output//.. 00:59:41.886 + rmdir ./lvol-vg-autotest_77434/output/ 00:59:41.886 + for dir in "${out_dirs[@]}" 00:59:41.886 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.886 + [[ -f ./nvme-cmb-pmr-vg-autotest_78608/output//doc.tar.xz ]] 00:59:41.886 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.886 + [[ -f ./nvme-cmb-pmr-vg-autotest_78608/output//ut_coverage.tar.xz ]] 00:59:41.886 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.886 + [[ -f ./nvme-cmb-pmr-vg-autotest_78608/output//llvm.tar.xz ]] 00:59:41.886 + mv ./nvme-cmb-pmr-vg-autotest_78608/output//all_tests.txt ./nvme-cmb-pmr-vg-autotest_78608/output//build-pkg-manifest.txt ./nvme-cmb-pmr-vg-autotest_78608/output//build-repo-manifest.txt ./nvme-cmb-pmr-vg-autotest_78608/output//cov_base.info.xz ./nvme-cmb-pmr-vg-autotest_78608/output//cov_test.info.xz ./nvme-cmb-pmr-vg-autotest_78608/output//cov_total.info.xz ./nvme-cmb-pmr-vg-autotest_78608/output//dmesg.init.log ./nvme-cmb-pmr-vg-autotest_78608/output//dmesg.log ./nvme-cmb-pmr-vg-autotest_78608/output//power.tar.xz ./nvme-cmb-pmr-vg-autotest_78608/output//test_completions.txt ./nvme-cmb-pmr-vg-autotest_78608/output//timing.svg ./nvme-cmb-pmr-vg-autotest_78608/output//timing.txt ./nvme-cmb-pmr-vg-autotest_78608/output//.. 00:59:41.887 + rmdir ./nvme-cmb-pmr-vg-autotest_78608/output/ 00:59:41.887 + for dir in "${out_dirs[@]}" 00:59:41.887 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.887 + [[ -f ./nvme-phy-autotest_72377/output//doc.tar.xz ]] 00:59:41.887 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.887 + [[ -f ./nvme-phy-autotest_72377/output//ut_coverage.tar.xz ]] 00:59:41.887 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.887 + [[ -f ./nvme-phy-autotest_72377/output//llvm.tar.xz ]] 00:59:41.887 + mv ./nvme-phy-autotest_72377/output//all_tests.txt ./nvme-phy-autotest_72377/output//build-pkg-manifest.txt ./nvme-phy-autotest_72377/output//build-repo-manifest.txt ./nvme-phy-autotest_72377/output//cov_base.info.xz ./nvme-phy-autotest_72377/output//dmesg.init.log ./nvme-phy-autotest_72377/output//dmesg.log ./nvme-phy-autotest_72377/output//power.tar.xz ./nvme-phy-autotest_72377/output//proc_list.txt ./nvme-phy-autotest_72377/output//test_completions.txt ./nvme-phy-autotest_72377/output//timing.txt ./nvme-phy-autotest_72377/output//udev.log ./nvme-phy-autotest_72377/output//.. 00:59:41.887 + rmdir ./nvme-phy-autotest_72377/output/ 00:59:41.887 + for dir in "${out_dirs[@]}" 00:59:41.887 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.887 + [[ -f ./nvme-vg-autotest_77485/output//doc.tar.xz ]] 00:59:41.887 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.887 + [[ -f ./nvme-vg-autotest_77485/output//ut_coverage.tar.xz ]] 00:59:41.887 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:41.887 + [[ -f ./nvme-vg-autotest_77485/output//llvm.tar.xz ]] 00:59:41.887 + mv ./nvme-vg-autotest_77485/output//all_tests.txt ./nvme-vg-autotest_77485/output//build-kernel-manifest.txt ./nvme-vg-autotest_77485/output//build-pkg-manifest.txt ./nvme-vg-autotest_77485/output//build-repo-manifest.txt ./nvme-vg-autotest_77485/output//cov_base.info.xz ./nvme-vg-autotest_77485/output//dmesg.init.log ./nvme-vg-autotest_77485/output//dmesg.log ./nvme-vg-autotest_77485/output//power.tar.xz ./nvme-vg-autotest_77485/output//proc_list.txt ./nvme-vg-autotest_77485/output//test_completions.txt ./nvme-vg-autotest_77485/output//timing.txt ./nvme-vg-autotest_77485/output//udev.log ./nvme-vg-autotest_77485/output//.. 00:59:41.887 + rmdir ./nvme-vg-autotest_77485/output/ 00:59:42.146 + for dir in "${out_dirs[@]}" 00:59:42.146 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.146 + [[ -f ./nvmf-phy-autotest_72449/output//doc.tar.xz ]] 00:59:42.146 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.146 + [[ -f ./nvmf-phy-autotest_72449/output//ut_coverage.tar.xz ]] 00:59:42.146 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.146 + [[ -f ./nvmf-phy-autotest_72449/output//llvm.tar.xz ]] 00:59:42.146 + mv ./nvmf-phy-autotest_72449/output//all_tests.txt ./nvmf-phy-autotest_72449/output//build-pkg-manifest.txt ./nvmf-phy-autotest_72449/output//build-repo-manifest.txt ./nvmf-phy-autotest_72449/output//coredumps ./nvmf-phy-autotest_72449/output//cov_base.info.xz ./nvmf-phy-autotest_72449/output//dmesg.init.log ./nvmf-phy-autotest_72449/output//dmesg.log ./nvmf-phy-autotest_72449/output//nvmf_trace.0_shm.tar.gz ./nvmf-phy-autotest_72449/output//power.tar.xz ./nvmf-phy-autotest_72449/output//proc_list.txt ./nvmf-phy-autotest_72449/output//test_completions.txt ./nvmf-phy-autotest_72449/output//timing.txt ./nvmf-phy-autotest_72449/output//udev.log ./nvmf-phy-autotest_72449/output//.. 00:59:42.146 + rmdir ./nvmf-phy-autotest_72449/output/ 00:59:42.146 + for dir in "${out_dirs[@]}" 00:59:42.146 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.146 + [[ -f ./nvmf-tcp-phy-autotest_72336/output//doc.tar.xz ]] 00:59:42.146 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.146 + [[ -f ./nvmf-tcp-phy-autotest_72336/output//ut_coverage.tar.xz ]] 00:59:42.146 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.146 + [[ -f ./nvmf-tcp-phy-autotest_72336/output//llvm.tar.xz ]] 00:59:42.146 + mv ./nvmf-tcp-phy-autotest_72336/output//all_tests.txt ./nvmf-tcp-phy-autotest_72336/output//build-pkg-manifest.txt ./nvmf-tcp-phy-autotest_72336/output//build-repo-manifest.txt ./nvmf-tcp-phy-autotest_72336/output//cov_base.info.xz ./nvmf-tcp-phy-autotest_72336/output//cov_test.info.xz ./nvmf-tcp-phy-autotest_72336/output//cov_total.info.xz ./nvmf-tcp-phy-autotest_72336/output//dmesg.init.log ./nvmf-tcp-phy-autotest_72336/output//dmesg.log ./nvmf-tcp-phy-autotest_72336/output//nvmf_trace.0_shm.tar.gz ./nvmf-tcp-phy-autotest_72336/output//power.tar.xz ./nvmf-tcp-phy-autotest_72336/output//test_completions.txt ./nvmf-tcp-phy-autotest_72336/output//timing.svg ./nvmf-tcp-phy-autotest_72336/output//timing.txt ./nvmf-tcp-phy-autotest_72336/output//.. 00:59:42.146 + rmdir ./nvmf-tcp-phy-autotest_72336/output/ 00:59:42.146 + for dir in "${out_dirs[@]}" 00:59:42.146 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.146 + [[ -f ./nvmf-tcp-uring-vg-autotest_77410/output//doc.tar.xz ]] 00:59:42.146 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.146 + [[ -f ./nvmf-tcp-uring-vg-autotest_77410/output//ut_coverage.tar.xz ]] 00:59:42.146 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.146 + [[ -f ./nvmf-tcp-uring-vg-autotest_77410/output//llvm.tar.xz ]] 00:59:42.146 + mv ./nvmf-tcp-uring-vg-autotest_77410/output//all_tests.txt ./nvmf-tcp-uring-vg-autotest_77410/output//build-pkg-manifest.txt ./nvmf-tcp-uring-vg-autotest_77410/output//build-repo-manifest.txt ./nvmf-tcp-uring-vg-autotest_77410/output//cov_base.info.xz ./nvmf-tcp-uring-vg-autotest_77410/output//cov_test.info.xz ./nvmf-tcp-uring-vg-autotest_77410/output//cov_total.info.xz ./nvmf-tcp-uring-vg-autotest_77410/output//dmesg.init.log ./nvmf-tcp-uring-vg-autotest_77410/output//dmesg.log ./nvmf-tcp-uring-vg-autotest_77410/output//nvmf_trace.0_shm.tar.gz ./nvmf-tcp-uring-vg-autotest_77410/output//power.tar.xz ./nvmf-tcp-uring-vg-autotest_77410/output//test_completions.txt ./nvmf-tcp-uring-vg-autotest_77410/output//timing.svg ./nvmf-tcp-uring-vg-autotest_77410/output//timing.txt ./nvmf-tcp-uring-vg-autotest_77410/output//.. 00:59:42.146 + rmdir ./nvmf-tcp-uring-vg-autotest_77410/output/ 00:59:42.146 + for dir in "${out_dirs[@]}" 00:59:42.146 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.146 + [[ -f ./nvmf-tcp-vg-autotest_77476/output//doc.tar.xz ]] 00:59:42.146 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.146 + [[ -f ./nvmf-tcp-vg-autotest_77476/output//ut_coverage.tar.xz ]] 00:59:42.146 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.146 + [[ -f ./nvmf-tcp-vg-autotest_77476/output//llvm.tar.xz ]] 00:59:42.146 + mv ./nvmf-tcp-vg-autotest_77476/output//all_tests.txt ./nvmf-tcp-vg-autotest_77476/output//build-pkg-manifest.txt ./nvmf-tcp-vg-autotest_77476/output//build-repo-manifest.txt ./nvmf-tcp-vg-autotest_77476/output//cov_base.info.xz ./nvmf-tcp-vg-autotest_77476/output//cov_test.info.xz ./nvmf-tcp-vg-autotest_77476/output//cov_total.info.xz ./nvmf-tcp-vg-autotest_77476/output//dmesg.init.log ./nvmf-tcp-vg-autotest_77476/output//dmesg.log ./nvmf-tcp-vg-autotest_77476/output//nvmf_trace.0_shm.tar.gz ./nvmf-tcp-vg-autotest_77476/output//power.tar.xz ./nvmf-tcp-vg-autotest_77476/output//test_completions.txt ./nvmf-tcp-vg-autotest_77476/output//timing.svg ./nvmf-tcp-vg-autotest_77476/output//timing.txt ./nvmf-tcp-vg-autotest_77476/output//.. 00:59:42.146 + rmdir ./nvmf-tcp-vg-autotest_77476/output/ 00:59:42.146 + for dir in "${out_dirs[@]}" 00:59:42.146 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.146 + [[ -f ./packaging-docker-autotest_19869/output//doc.tar.xz ]] 00:59:42.146 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.146 + [[ -f ./packaging-docker-autotest_19869/output//ut_coverage.tar.xz ]] 00:59:42.146 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.146 + [[ -f ./packaging-docker-autotest_19869/output//llvm.tar.xz ]] 00:59:42.146 + mv ./packaging-docker-autotest_19869/output//build-pkg-manifest.txt ./packaging-docker-autotest_19869/output//build-repo-manifest.txt ./packaging-docker-autotest_19869/output//power.tar.xz ./packaging-docker-autotest_19869/output//test_completions.txt ./packaging-docker-autotest_19869/output//timing.txt ./packaging-docker-autotest_19869/output//.. 00:59:42.146 + rmdir ./packaging-docker-autotest_19869/output/ 00:59:42.146 + for dir in "${out_dirs[@]}" 00:59:42.146 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.146 + [[ -f ./rocky9-vg-autotest_16095/output//doc.tar.xz ]] 00:59:42.146 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.146 + [[ -f ./rocky9-vg-autotest_16095/output//ut_coverage.tar.xz ]] 00:59:42.146 + tar -C ./rocky9-vg-autotest_16095/output/ -xf ./rocky9-vg-autotest_16095/output//ut_coverage.tar.xz 00:59:42.146 + rm ./rocky9-vg-autotest_16095/output//ut_coverage.tar.xz 00:59:42.146 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.146 + [[ -f ./rocky9-vg-autotest_16095/output//llvm.tar.xz ]] 00:59:42.146 + mv ./rocky9-vg-autotest_16095/output//all_tests.txt ./rocky9-vg-autotest_16095/output//build-pkg-manifest.txt ./rocky9-vg-autotest_16095/output//build-repo-manifest.txt ./rocky9-vg-autotest_16095/output//cov_base.info.xz ./rocky9-vg-autotest_16095/output//cov_test.info.xz ./rocky9-vg-autotest_16095/output//cov_total.info.xz ./rocky9-vg-autotest_16095/output//dmesg.init.log ./rocky9-vg-autotest_16095/output//dmesg.log ./rocky9-vg-autotest_16095/output//power.tar.xz ./rocky9-vg-autotest_16095/output//test_completions.txt ./rocky9-vg-autotest_16095/output//timing.svg ./rocky9-vg-autotest_16095/output//timing.txt ./rocky9-vg-autotest_16095/output//ut_coverage ./rocky9-vg-autotest_16095/output//.. 00:59:42.146 + rmdir ./rocky9-vg-autotest_16095/output/ 00:59:42.146 + for dir in "${out_dirs[@]}" 00:59:42.146 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.146 + [[ -f ./scan-build-docker-autotest_19870/output//doc.tar.xz ]] 00:59:42.146 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.146 + [[ -f ./scan-build-docker-autotest_19870/output//ut_coverage.tar.xz ]] 00:59:42.146 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.146 + [[ -f ./scan-build-docker-autotest_19870/output//llvm.tar.xz ]] 00:59:42.146 + mv ./scan-build-docker-autotest_19870/output//all_c_files.txt ./scan-build-docker-autotest_19870/output//build_output.txt ./scan-build-docker-autotest_19870/output//build-pkg-manifest.txt ./scan-build-docker-autotest_19870/output//build-repo-manifest.txt ./scan-build-docker-autotest_19870/output//built_c_files.txt ./scan-build-docker-autotest_19870/output//power.tar.xz ./scan-build-docker-autotest_19870/output//test_completions.txt ./scan-build-docker-autotest_19870/output//timing.txt ./scan-build-docker-autotest_19870/output//unbuilt_c_files.txt ./scan-build-docker-autotest_19870/output//.. 00:59:42.146 + rmdir ./scan-build-docker-autotest_19870/output/ 00:59:42.146 + for dir in "${out_dirs[@]}" 00:59:42.146 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.146 + [[ -f ./short-fuzz-phy-autotest_26202/output//doc.tar.xz ]] 00:59:42.146 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.146 + [[ -f ./short-fuzz-phy-autotest_26202/output//ut_coverage.tar.xz ]] 00:59:42.146 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.146 + [[ -f ./short-fuzz-phy-autotest_26202/output//llvm.tar.xz ]] 00:59:42.146 + tar -C ./short-fuzz-phy-autotest_26202/output/ -xf ./short-fuzz-phy-autotest_26202/output//llvm.tar.xz 00:59:42.146 + rm ./short-fuzz-phy-autotest_26202/output//llvm.tar.xz 00:59:42.146 + mv ./short-fuzz-phy-autotest_26202/output//all_tests.txt ./short-fuzz-phy-autotest_26202/output//build-pkg-manifest.txt ./short-fuzz-phy-autotest_26202/output//build-repo-manifest.txt ./short-fuzz-phy-autotest_26202/output//dmesg.init.log ./short-fuzz-phy-autotest_26202/output//dmesg.log ./short-fuzz-phy-autotest_26202/output//llvm ./short-fuzz-phy-autotest_26202/output//power.tar.xz ./short-fuzz-phy-autotest_26202/output//test_completions.txt ./short-fuzz-phy-autotest_26202/output//timing.svg ./short-fuzz-phy-autotest_26202/output//timing.txt ./short-fuzz-phy-autotest_26202/output//.. 00:59:42.146 + rmdir ./short-fuzz-phy-autotest_26202/output/ 00:59:42.146 + for dir in "${out_dirs[@]}" 00:59:42.146 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.146 + [[ -f ./ubuntu20-vg-autotest_73804/output//doc.tar.xz ]] 00:59:42.146 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.146 + [[ -f ./ubuntu20-vg-autotest_73804/output//ut_coverage.tar.xz ]] 00:59:42.146 + tar -C ./ubuntu20-vg-autotest_73804/output/ -xf ./ubuntu20-vg-autotest_73804/output//ut_coverage.tar.xz 00:59:42.404 + rm ./ubuntu20-vg-autotest_73804/output//ut_coverage.tar.xz 00:59:42.404 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.404 + [[ -f ./ubuntu20-vg-autotest_73804/output//llvm.tar.xz ]] 00:59:42.404 + mv ./ubuntu20-vg-autotest_73804/output//all_tests.txt ./ubuntu20-vg-autotest_73804/output//build-pkg-manifest.txt ./ubuntu20-vg-autotest_73804/output//build-repo-manifest.txt ./ubuntu20-vg-autotest_73804/output//cov_base.info.xz ./ubuntu20-vg-autotest_73804/output//dmesg.init.log ./ubuntu20-vg-autotest_73804/output//dmesg.log ./ubuntu20-vg-autotest_73804/output//power.tar.xz ./ubuntu20-vg-autotest_73804/output//proc_list.txt ./ubuntu20-vg-autotest_73804/output//test_completions.txt ./ubuntu20-vg-autotest_73804/output//timing.txt ./ubuntu20-vg-autotest_73804/output//udev.log ./ubuntu20-vg-autotest_73804/output//ut_coverage ./ubuntu20-vg-autotest_73804/output//.. 00:59:42.404 + rmdir ./ubuntu20-vg-autotest_73804/output/ 00:59:42.404 + for dir in "${out_dirs[@]}" 00:59:42.404 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.404 + [[ -f ./ubuntu22-vg-autotest_37818/output//doc.tar.xz ]] 00:59:42.404 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.404 + [[ -f ./ubuntu22-vg-autotest_37818/output//ut_coverage.tar.xz ]] 00:59:42.404 + tar -C ./ubuntu22-vg-autotest_37818/output/ -xf ./ubuntu22-vg-autotest_37818/output//ut_coverage.tar.xz 00:59:42.661 + rm ./ubuntu22-vg-autotest_37818/output//ut_coverage.tar.xz 00:59:42.661 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.661 + [[ -f ./ubuntu22-vg-autotest_37818/output//llvm.tar.xz ]] 00:59:42.661 + mv ./ubuntu22-vg-autotest_37818/output//all_tests.txt ./ubuntu22-vg-autotest_37818/output//build-pkg-manifest.txt ./ubuntu22-vg-autotest_37818/output//build-repo-manifest.txt ./ubuntu22-vg-autotest_37818/output//cov_base.info.xz ./ubuntu22-vg-autotest_37818/output//cov_test.info.xz ./ubuntu22-vg-autotest_37818/output//cov_total.info.xz ./ubuntu22-vg-autotest_37818/output//dmesg.init.log ./ubuntu22-vg-autotest_37818/output//dmesg.log ./ubuntu22-vg-autotest_37818/output//power.tar.xz ./ubuntu22-vg-autotest_37818/output//test_completions.txt ./ubuntu22-vg-autotest_37818/output//timing.svg ./ubuntu22-vg-autotest_37818/output//timing.txt ./ubuntu22-vg-autotest_37818/output//ut_coverage ./ubuntu22-vg-autotest_37818/output//.. 00:59:42.661 + rmdir ./ubuntu22-vg-autotest_37818/output/ 00:59:42.661 + for dir in "${out_dirs[@]}" 00:59:42.661 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.661 + [[ -f ./unittest-clang-docker-autotest_19867/output//doc.tar.xz ]] 00:59:42.661 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.661 + [[ -f ./unittest-clang-docker-autotest_19867/output//ut_coverage.tar.xz ]] 00:59:42.661 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.661 + [[ -f ./unittest-clang-docker-autotest_19867/output//llvm.tar.xz ]] 00:59:42.661 + mv ./unittest-clang-docker-autotest_19867/output//build-pkg-manifest.txt ./unittest-clang-docker-autotest_19867/output//build-repo-manifest.txt ./unittest-clang-docker-autotest_19867/output//power.tar.xz ./unittest-clang-docker-autotest_19867/output//test_completions.txt ./unittest-clang-docker-autotest_19867/output//timing.txt ./unittest-clang-docker-autotest_19867/output//.. 00:59:42.661 + rmdir ./unittest-clang-docker-autotest_19867/output/ 00:59:42.661 + for dir in "${out_dirs[@]}" 00:59:42.661 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.661 + [[ -f ./unittest-main-docker-autotest_19868/output//doc.tar.xz ]] 00:59:42.661 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.661 + [[ -f ./unittest-main-docker-autotest_19868/output//ut_coverage.tar.xz ]] 00:59:42.661 + tar -C ./unittest-main-docker-autotest_19868/output/ -xf ./unittest-main-docker-autotest_19868/output//ut_coverage.tar.xz 00:59:42.919 + rm ./unittest-main-docker-autotest_19868/output//ut_coverage.tar.xz 00:59:42.919 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.919 + [[ -f ./unittest-main-docker-autotest_19868/output//llvm.tar.xz ]] 00:59:42.919 + mv ./unittest-main-docker-autotest_19868/output//build-pkg-manifest.txt ./unittest-main-docker-autotest_19868/output//build-repo-manifest.txt ./unittest-main-docker-autotest_19868/output//power.tar.xz ./unittest-main-docker-autotest_19868/output//test_completions.txt ./unittest-main-docker-autotest_19868/output//timing.txt ./unittest-main-docker-autotest_19868/output//ut_coverage ./unittest-main-docker-autotest_19868/output//.. 00:59:42.919 + rmdir ./unittest-main-docker-autotest_19868/output/ 00:59:42.919 + for dir in "${out_dirs[@]}" 00:59:42.919 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.919 + [[ -f ./unittest-valgrind-docker-autotest_19871/output//doc.tar.xz ]] 00:59:42.919 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:42.919 + [[ -f ./unittest-valgrind-docker-autotest_19871/output//ut_coverage.tar.xz ]] 00:59:42.919 + tar -C ./unittest-valgrind-docker-autotest_19871/output/ -xf ./unittest-valgrind-docker-autotest_19871/output//ut_coverage.tar.xz 00:59:43.176 + rm ./unittest-valgrind-docker-autotest_19871/output//ut_coverage.tar.xz 00:59:43.176 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:43.176 + [[ -f ./unittest-valgrind-docker-autotest_19871/output//llvm.tar.xz ]] 00:59:43.176 + mv ./unittest-valgrind-docker-autotest_19871/output//build-pkg-manifest.txt ./unittest-valgrind-docker-autotest_19871/output//build-repo-manifest.txt ./unittest-valgrind-docker-autotest_19871/output//power.tar.xz ./unittest-valgrind-docker-autotest_19871/output//test_completions.txt ./unittest-valgrind-docker-autotest_19871/output//timing.txt ./unittest-valgrind-docker-autotest_19871/output//ut_coverage ./unittest-valgrind-docker-autotest_19871/output//.. 00:59:43.176 + rmdir ./unittest-valgrind-docker-autotest_19871/output/ 00:59:43.176 + for dir in "${out_dirs[@]}" 00:59:43.176 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:43.176 + [[ -f ./vfio-user-phy-autotest_26213/output//doc.tar.xz ]] 00:59:43.176 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:43.176 + [[ -f ./vfio-user-phy-autotest_26213/output//ut_coverage.tar.xz ]] 00:59:43.176 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:43.176 + [[ -f ./vfio-user-phy-autotest_26213/output//llvm.tar.xz ]] 00:59:43.176 + mv ./vfio-user-phy-autotest_26213/output//all_tests.txt ./vfio-user-phy-autotest_26213/output//build-pkg-manifest.txt ./vfio-user-phy-autotest_26213/output//build-repo-manifest.txt ./vfio-user-phy-autotest_26213/output//cov_base.info.xz ./vfio-user-phy-autotest_26213/output//cov_test.info.xz ./vfio-user-phy-autotest_26213/output//cov_total.info.xz ./vfio-user-phy-autotest_26213/output//dmesg.init.log ./vfio-user-phy-autotest_26213/output//dmesg.log ./vfio-user-phy-autotest_26213/output//power.tar.xz ./vfio-user-phy-autotest_26213/output//test_completions.txt ./vfio-user-phy-autotest_26213/output//timing.svg ./vfio-user-phy-autotest_26213/output//timing.txt ./vfio-user-phy-autotest_26213/output//.. 00:59:43.176 + rmdir ./vfio-user-phy-autotest_26213/output/ 00:59:43.176 + for dir in "${out_dirs[@]}" 00:59:43.176 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:43.176 + [[ -f ./vhost-initiator-vg-autotest_77505/output//doc.tar.xz ]] 00:59:43.176 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:43.176 + [[ -f ./vhost-initiator-vg-autotest_77505/output//ut_coverage.tar.xz ]] 00:59:43.176 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:43.176 + [[ -f ./vhost-initiator-vg-autotest_77505/output//llvm.tar.xz ]] 00:59:43.176 + mv ./vhost-initiator-vg-autotest_77505/output//all_tests.txt ./vhost-initiator-vg-autotest_77505/output//build-kernel-manifest.txt ./vhost-initiator-vg-autotest_77505/output//build-pkg-manifest.txt ./vhost-initiator-vg-autotest_77505/output//build-repo-manifest.txt ./vhost-initiator-vg-autotest_77505/output//cov_base.info.xz ./vhost-initiator-vg-autotest_77505/output//cov_test.info.xz ./vhost-initiator-vg-autotest_77505/output//cov_total.info.xz ./vhost-initiator-vg-autotest_77505/output//dmesg.init.log ./vhost-initiator-vg-autotest_77505/output//dmesg.log ./vhost-initiator-vg-autotest_77505/output//power.tar.xz ./vhost-initiator-vg-autotest_77505/output//test_completions.txt ./vhost-initiator-vg-autotest_77505/output//timing.svg ./vhost-initiator-vg-autotest_77505/output//timing.txt ./vhost-initiator-vg-autotest_77505/output//vhost_fuzz_output1.txt.xz ./vhost-initiator-vg-autotest_77505/output//vhost_fuzz_output2.txt.xz ./vhost-initiator-vg-autotest_77505/output//vhost_fuzz_tgt_output.txt.xz ./vhost-initiator-vg-autotest_77505/output//.. 00:59:43.176 + rmdir ./vhost-initiator-vg-autotest_77505/output/ 00:59:43.176 + for dir in "${out_dirs[@]}" 00:59:43.176 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:43.176 + [[ -f ./vhost-phy-autotest_26230/output//doc.tar.xz ]] 00:59:43.176 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:43.176 + [[ -f ./vhost-phy-autotest_26230/output//ut_coverage.tar.xz ]] 00:59:43.176 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:43.177 + [[ -f ./vhost-phy-autotest_26230/output//llvm.tar.xz ]] 00:59:43.177 + mv ./vhost-phy-autotest_26230/output//all_tests.txt ./vhost-phy-autotest_26230/output//build-pkg-manifest.txt ./vhost-phy-autotest_26230/output//build-repo-manifest.txt ./vhost-phy-autotest_26230/output//cov_base.info.xz ./vhost-phy-autotest_26230/output//cov_test.info.xz ./vhost-phy-autotest_26230/output//cov_total.info.xz ./vhost-phy-autotest_26230/output//dmesg.init.log ./vhost-phy-autotest_26230/output//dmesg.log ./vhost-phy-autotest_26230/output//power.tar.xz ./vhost-phy-autotest_26230/output//test_completions.txt ./vhost-phy-autotest_26230/output//timing.svg ./vhost-phy-autotest_26230/output//timing.txt ./vhost-phy-autotest_26230/output//.. 00:59:43.177 + rmdir ./vhost-phy-autotest_26230/output/ 00:59:43.177 + for dir in "${out_dirs[@]}" 00:59:43.177 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:43.177 + [[ -f ./zns-vg-autotest_76591/output//doc.tar.xz ]] 00:59:43.177 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:43.177 + [[ -f ./zns-vg-autotest_76591/output//ut_coverage.tar.xz ]] 00:59:43.177 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:59:43.177 + [[ -f ./zns-vg-autotest_76591/output//llvm.tar.xz ]] 00:59:43.177 + mv ./zns-vg-autotest_76591/output//all_tests.txt ./zns-vg-autotest_76591/output//build-kernel-manifest.txt ./zns-vg-autotest_76591/output//build-pkg-manifest.txt ./zns-vg-autotest_76591/output//build-repo-manifest.txt ./zns-vg-autotest_76591/output//cov_base.info.xz ./zns-vg-autotest_76591/output//cov_test.info.xz ./zns-vg-autotest_76591/output//cov_total.info.xz ./zns-vg-autotest_76591/output//dmesg.init.log ./zns-vg-autotest_76591/output//dmesg.log ./zns-vg-autotest_76591/output//power.tar.xz ./zns-vg-autotest_76591/output//test_completions.txt ./zns-vg-autotest_76591/output//timing.svg ./zns-vg-autotest_76591/output//timing.txt ./zns-vg-autotest_76591/output//.. 00:59:43.177 + rmdir ./zns-vg-autotest_76591/output/ 00:59:43.177 + unpack_cov_files 00:59:43.177 + local info_files 00:59:43.177 + info_files=(*/cov_*.info.xz) 00:59:43.177 + xargs -P0 -r -n1 xz -d 00:59:43.177 + printf '%s\n' BlobFS-phy-autotest_26211/cov_base.info.xz BlobFS-phy-autotest_26211/cov_test.info.xz BlobFS-phy-autotest_26211/cov_total.info.xz centos7-vg-autotest_73664/cov_base.info.xz centos7-vg-autotest_73664/cov_test.info.xz centos7-vg-autotest_73664/cov_total.info.xz crypto-phy-autotest_26205/cov_base.info.xz crypto-phy-autotest_26205/cov_test.info.xz crypto-phy-autotest_26205/cov_total.info.xz dsa-phy-autotest_4905/cov_base.info.xz dsa-phy-autotest_4905/cov_test.info.xz dsa-phy-autotest_4905/cov_total.info.xz iscsi-uring-vg-autotest_77390/cov_base.info.xz iscsi-uring-vg-autotest_77390/cov_test.info.xz iscsi-uring-vg-autotest_77390/cov_total.info.xz iscsi-vg-autotest_77523/cov_base.info.xz iscsi-vg-autotest_77523/cov_test.info.xz iscsi-vg-autotest_77523/cov_total.info.xz lvol-vg-autotest_77434/cov_base.info.xz lvol-vg-autotest_77434/cov_test.info.xz lvol-vg-autotest_77434/cov_total.info.xz nvme-cmb-pmr-vg-autotest_78608/cov_base.info.xz nvme-cmb-pmr-vg-autotest_78608/cov_test.info.xz nvme-cmb-pmr-vg-autotest_78608/cov_total.info.xz nvme-phy-autotest_72377/cov_base.info.xz nvme-vg-autotest_77485/cov_base.info.xz nvmf-phy-autotest_72449/cov_base.info.xz nvmf-tcp-phy-autotest_72336/cov_base.info.xz nvmf-tcp-phy-autotest_72336/cov_test.info.xz nvmf-tcp-phy-autotest_72336/cov_total.info.xz nvmf-tcp-uring-vg-autotest_77410/cov_base.info.xz nvmf-tcp-uring-vg-autotest_77410/cov_test.info.xz nvmf-tcp-uring-vg-autotest_77410/cov_total.info.xz nvmf-tcp-vg-autotest_77476/cov_base.info.xz nvmf-tcp-vg-autotest_77476/cov_test.info.xz nvmf-tcp-vg-autotest_77476/cov_total.info.xz rocky9-vg-autotest_16095/cov_base.info.xz rocky9-vg-autotest_16095/cov_test.info.xz rocky9-vg-autotest_16095/cov_total.info.xz ubuntu20-vg-autotest_73804/cov_base.info.xz ubuntu22-vg-autotest_37818/cov_base.info.xz ubuntu22-vg-autotest_37818/cov_test.info.xz ubuntu22-vg-autotest_37818/cov_total.info.xz vfio-user-phy-autotest_26213/cov_base.info.xz vfio-user-phy-autotest_26213/cov_test.info.xz vfio-user-phy-autotest_26213/cov_total.info.xz vhost-initiator-vg-autotest_77505/cov_base.info.xz vhost-initiator-vg-autotest_77505/cov_test.info.xz vhost-initiator-vg-autotest_77505/cov_total.info.xz vhost-phy-autotest_26230/cov_base.info.xz vhost-phy-autotest_26230/cov_test.info.xz vhost-phy-autotest_26230/cov_total.info.xz zns-vg-autotest_76591/cov_base.info.xz zns-vg-autotest_76591/cov_test.info.xz zns-vg-autotest_76591/cov_total.info.xz 00:59:43.434 + fix_downstream_job_paths 00:59:43.434 + sed -i -e 's#^SF:/.\+/spdk/#SF:/var/jenkins/workspace/autotest-per-patch_5/spdk/#g' BlobFS-phy-autotest_26211/cov_total.info centos7-vg-autotest_73664/cov_total.info crypto-phy-autotest_26205/cov_total.info dsa-phy-autotest_4905/cov_total.info iscsi-uring-vg-autotest_77390/cov_total.info iscsi-vg-autotest_77523/cov_total.info lvol-vg-autotest_77434/cov_total.info nvme-cmb-pmr-vg-autotest_78608/cov_total.info nvmf-tcp-phy-autotest_72336/cov_total.info nvmf-tcp-uring-vg-autotest_77410/cov_total.info nvmf-tcp-vg-autotest_77476/cov_total.info rocky9-vg-autotest_16095/cov_total.info ubuntu22-vg-autotest_37818/cov_total.info vfio-user-phy-autotest_26213/cov_total.info vhost-initiator-vg-autotest_77505/cov_total.info vhost-phy-autotest_26230/cov_total.info zns-vg-autotest_76591/cov_total.info 00:59:44.371 + ignore_ocf_headers 00:59:44.371 + sed -i 's#--show-details#--show-details --ignore-errors source#g' spdk/autorun_post.py 00:59:44.371 + create_errtrace_files_for_all_builds 00:59:44.371 + local build_log_list 00:59:44.371 + build_log_list=($(find "$WORKSPACE" -type f -name 'build.log')) 00:59:44.371 ++ find /var/jenkins/workspace/autotest-per-patch_5 -type f -name build.log 00:59:44.371 + for build in "${build_log_list[@]}" 00:59:44.371 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/doc-docker-autotest_22330/build.log 00:59:44.371 + local build_log job_name start_pattern end_pattern backtraces 00:59:44.371 + build_log=/var/jenkins/workspace/autotest-per-patch_5/doc-docker-autotest_22330/build.log 00:59:44.371 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/doc-docker-autotest_22330/build.log 00:59:44.371 ++ basename /var/jenkins/workspace/autotest-per-patch_5/doc-docker-autotest_22330 00:59:44.371 + job_name=doc-docker-autotest_22330 00:59:44.371 + start_pattern='Backtrace start' 00:59:44.371 + end_pattern='Backtrace end' 00:59:44.371 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/doc-docker-autotest_22330/build.log ]] 00:59:44.371 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/doc-docker-autotest_22330/build.log 00:59:44.371 + backtraces= 00:59:44.371 + [[ -n '' ]] 00:59:44.371 + for build in "${build_log_list[@]}" 00:59:44.371 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/scan-build-docker-autotest_19870/build.log 00:59:44.371 + local build_log job_name start_pattern end_pattern backtraces 00:59:44.371 + build_log=/var/jenkins/workspace/autotest-per-patch_5/scan-build-docker-autotest_19870/build.log 00:59:44.371 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/scan-build-docker-autotest_19870/build.log 00:59:44.371 ++ basename /var/jenkins/workspace/autotest-per-patch_5/scan-build-docker-autotest_19870 00:59:44.371 + job_name=scan-build-docker-autotest_19870 00:59:44.371 + start_pattern='Backtrace start' 00:59:44.371 + end_pattern='Backtrace end' 00:59:44.371 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/scan-build-docker-autotest_19870/build.log ]] 00:59:44.371 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/scan-build-docker-autotest_19870/build.log 00:59:44.371 + backtraces= 00:59:44.371 + [[ -n '' ]] 00:59:44.371 + for build in "${build_log_list[@]}" 00:59:44.371 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/vhost-phy-autotest_26230/build.log 00:59:44.371 + local build_log job_name start_pattern end_pattern backtraces 00:59:44.371 + build_log=/var/jenkins/workspace/autotest-per-patch_5/vhost-phy-autotest_26230/build.log 00:59:44.371 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/vhost-phy-autotest_26230/build.log 00:59:44.371 ++ basename /var/jenkins/workspace/autotest-per-patch_5/vhost-phy-autotest_26230 00:59:44.371 + job_name=vhost-phy-autotest_26230 00:59:44.371 + start_pattern='Backtrace start' 00:59:44.371 + end_pattern='Backtrace end' 00:59:44.371 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/vhost-phy-autotest_26230/build.log ]] 00:59:44.371 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/vhost-phy-autotest_26230/build.log 00:59:44.371 + backtraces= 00:59:44.371 + [[ -n '' ]] 00:59:44.371 + for build in "${build_log_list[@]}" 00:59:44.371 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/dsa-phy-autotest_4905/build.log 00:59:44.371 + local build_log job_name start_pattern end_pattern backtraces 00:59:44.371 + build_log=/var/jenkins/workspace/autotest-per-patch_5/dsa-phy-autotest_4905/build.log 00:59:44.371 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/dsa-phy-autotest_4905/build.log 00:59:44.371 ++ basename /var/jenkins/workspace/autotest-per-patch_5/dsa-phy-autotest_4905 00:59:44.371 + job_name=dsa-phy-autotest_4905 00:59:44.371 + start_pattern='Backtrace start' 00:59:44.371 + end_pattern='Backtrace end' 00:59:44.371 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/dsa-phy-autotest_4905/build.log ]] 00:59:44.371 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/dsa-phy-autotest_4905/build.log 00:59:44.371 + backtraces= 00:59:44.371 + [[ -n '' ]] 00:59:44.371 + for build in "${build_log_list[@]}" 00:59:44.371 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/unittest-main-docker-autotest_19868/build.log 00:59:44.371 + local build_log job_name start_pattern end_pattern backtraces 00:59:44.371 + build_log=/var/jenkins/workspace/autotest-per-patch_5/unittest-main-docker-autotest_19868/build.log 00:59:44.371 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/unittest-main-docker-autotest_19868/build.log 00:59:44.371 ++ basename /var/jenkins/workspace/autotest-per-patch_5/unittest-main-docker-autotest_19868 00:59:44.371 + job_name=unittest-main-docker-autotest_19868 00:59:44.371 + start_pattern='Backtrace start' 00:59:44.371 + end_pattern='Backtrace end' 00:59:44.371 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/unittest-main-docker-autotest_19868/build.log ]] 00:59:44.371 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/unittest-main-docker-autotest_19868/build.log 00:59:44.371 + backtraces= 00:59:44.371 + [[ -n '' ]] 00:59:44.371 + for build in "${build_log_list[@]}" 00:59:44.371 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/nvme-phy-autotest_72377/build.log 00:59:44.371 + local build_log job_name start_pattern end_pattern backtraces 00:59:44.371 + build_log=/var/jenkins/workspace/autotest-per-patch_5/nvme-phy-autotest_72377/build.log 00:59:44.371 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/nvme-phy-autotest_72377/build.log 00:59:44.371 ++ basename /var/jenkins/workspace/autotest-per-patch_5/nvme-phy-autotest_72377 00:59:44.371 + job_name=nvme-phy-autotest_72377 00:59:44.371 + start_pattern='Backtrace start' 00:59:44.371 + end_pattern='Backtrace end' 00:59:44.371 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/nvme-phy-autotest_72377/build.log ]] 00:59:44.371 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/nvme-phy-autotest_72377/build.log 00:59:44.371 + backtraces='00:13:55.228 11:05:51 sw_hotplug -- common/autotest_common.sh@715 -- # time='\''========== Backtrace start: ========== 00:59:44.371 00:13:55.228 00:59:44.371 00:13:55.228 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:59:44.371 00:13:55.228 ... 00:59:44.371 00:13:55.228 710 00:59:44.372 00:13:55.228 711 # We redirect cmd'\''\'\'''\''s std{out,err} to a separate fd dup'\''\'\'''\''ed to stdin'\''\'\'''\''s device (or /dev/null) to 00:59:44.372 00:13:55.228 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 00:59:44.372 00:13:55.228 713 # but $() will return just the time'\''\'\'''\''s data, hence making it possible to just do: 00:59:44.372 00:13:55.228 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:59:44.372 00:13:55.228 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:59:44.372 00:13:55.228 716 00:59:44.372 00:13:55.228 717 echo "$time" 00:59:44.372 00:13:55.228 718 ) 00:59:44.372 00:13:55.228 719 00:59:44.372 00:13:55.228 720 function timing_enter() { 00:59:44.372 00:13:55.228 ... 00:59:44.372 00:13:55.228 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:59:44.372 00:13:55.228 ... 00:59:44.372 00:13:55.228 11 # Pci bus hotplug 00:59:44.372 00:13:55.228 12 # Helper function to remove/attach cotrollers 00:59:44.372 00:13:55.228 13 debug_remove_attach_helper() { 00:59:44.372 00:13:55.228 14 local helper_time=0 00:59:44.372 00:13:55.228 15 00:59:44.372 00:13:55.228 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:59:44.372 00:13:55.228 17 printf '\''\'\'''\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\''\'\'''\'' \ 00:59:44.372 00:13:55.228 18 "$helper_time" "$nvme_count" >&2 00:59:44.372 00:13:55.228 19 } 00:59:44.372 00:13:55.228 20 00:59:44.372 00:13:55.228 21 remove_attach_helper() { 00:59:44.372 00:13:55.228 ... 00:59:44.372 00:13:55.228 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:59:44.372 00:13:55.228 ... 00:59:44.372 00:13:55.228 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:59:44.372 00:13:55.228 106 done 00:59:44.372 00:13:55.228 107 00:59:44.372 00:13:55.228 108 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.372 00:13:55.228 109 00:59:44.372 00:13:55.228 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.372 00:13:55.228 111 # Verify reregistering hotplug poller 00:59:44.372 00:13:55.228 112 rpc_cmd bdev_nvme_set_hotplug -d 00:59:44.372 00:13:55.228 113 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.372 00:13:55.228 114 00:59:44.372 00:13:55.228 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.372 00:13:55.228 ... 00:59:44.372 00:13:55.228 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:59:44.372 00:13:55.228 ... 00:59:44.372 00:13:55.228 133 00:59:44.372 00:13:55.228 134 # Run pci bus hotplug test 00:59:44.372 00:13:55.228 135 run_hotplug 00:59:44.372 00:13:55.228 136 00:59:44.372 00:13:55.228 137 # Run SPDK target based hotplug 00:59:44.372 00:13:55.228 => 138 tgt_run_hotplug 00:59:44.372 00:13:55.228 ... 00:59:44.372 00:13:55.228 00:59:44.372 00:13:55.228 ========== Backtrace end =========='\'' 00:59:44.372 00:13:55.228 ========== Backtrace start: ========== 00:59:44.372 00:13:55.228 00:59:44.372 00:13:55.228 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:59:44.372 00:13:55.228 ... 00:59:44.372 00:13:55.228 710 00:59:44.372 00:13:55.228 711 # We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to 00:59:44.372 00:13:55.228 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 00:59:44.372 00:13:55.228 713 # but $() will return just the time'\''s data, hence making it possible to just do: 00:59:44.372 00:13:55.228 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:59:44.372 00:13:55.228 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:59:44.372 00:13:55.228 716 00:59:44.372 00:13:55.228 717 echo "$time" 00:59:44.372 00:13:55.228 718 ) 00:59:44.372 00:13:55.228 719 00:59:44.372 00:13:55.228 720 function timing_enter() { 00:59:44.372 00:13:55.228 ... 00:59:44.372 00:13:55.228 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:59:44.372 00:13:55.228 ... 00:59:44.372 00:13:55.228 11 # Pci bus hotplug 00:59:44.372 00:13:55.228 12 # Helper function to remove/attach cotrollers 00:59:44.372 00:13:55.228 13 debug_remove_attach_helper() { 00:59:44.372 00:13:55.228 14 local helper_time=0 00:59:44.372 00:13:55.228 15 00:59:44.372 00:13:55.228 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:59:44.372 00:13:55.228 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 00:59:44.372 00:13:55.228 18 "$helper_time" "$nvme_count" >&2 00:59:44.372 00:13:55.228 19 } 00:59:44.372 00:13:55.228 20 00:59:44.372 00:13:55.228 21 remove_attach_helper() { 00:59:44.372 00:13:55.228 ... 00:59:44.372 00:13:55.228 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:59:44.372 00:13:55.228 ... 00:59:44.372 00:13:55.228 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:59:44.372 00:13:55.228 106 done 00:59:44.372 00:13:55.228 107 00:59:44.372 00:13:55.228 108 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.372 00:13:55.228 109 00:59:44.372 00:13:55.228 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.372 00:13:55.228 111 # Verify reregistering hotplug poller 00:59:44.372 00:13:55.228 112 rpc_cmd bdev_nvme_set_hotplug -d 00:59:44.372 00:13:55.228 113 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.372 00:13:55.228 114 00:59:44.372 00:13:55.228 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.372 00:13:55.228 ... 00:59:44.372 00:13:55.228 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:59:44.372 00:13:55.228 ... 00:59:44.372 00:13:55.228 133 00:59:44.372 00:13:55.228 134 # Run pci bus hotplug test 00:59:44.372 00:13:55.228 135 run_hotplug 00:59:44.372 00:13:55.228 136 00:59:44.372 00:13:55.228 137 # Run SPDK target based hotplug 00:59:44.372 00:13:55.228 => 138 tgt_run_hotplug 00:59:44.372 00:13:55.228 ... 00:59:44.372 00:13:55.228 00:59:44.372 00:13:55.228 ========== Backtrace end ========== 00:59:44.372 00:13:55.229 ========== Backtrace start: ========== 00:59:44.372 00:13:55.229 00:59:44.372 00:13:55.229 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:59:44.372 00:13:55.229 ... 00:59:44.372 00:13:55.229 713 # but $() will return just the time'\''s data, hence making it possible to just do: 00:59:44.372 00:13:55.229 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:59:44.372 00:13:55.229 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:59:44.372 00:13:55.229 716 00:59:44.372 00:13:55.229 717 echo "$time" 00:59:44.372 00:13:55.229 => 718 ) 00:59:44.372 00:13:55.229 719 00:59:44.372 00:13:55.229 720 function timing_enter() { 00:59:44.372 00:13:55.229 721 xtrace_disable 00:59:44.372 00:13:55.229 722 timing "enter" "$1" 00:59:44.372 00:13:55.229 723 xtrace_restore 00:59:44.372 00:13:55.229 ... 00:59:44.372 00:13:55.229 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:59:44.372 00:13:55.229 ... 00:59:44.372 00:13:55.229 11 # Pci bus hotplug 00:59:44.372 00:13:55.229 12 # Helper function to remove/attach cotrollers 00:59:44.372 00:13:55.229 13 debug_remove_attach_helper() { 00:59:44.372 00:13:55.229 14 local helper_time=0 00:59:44.372 00:13:55.229 15 00:59:44.372 00:13:55.229 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:59:44.372 00:13:55.229 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 00:59:44.372 00:13:55.229 18 "$helper_time" "$nvme_count" >&2 00:59:44.372 00:13:55.229 19 } 00:59:44.372 00:13:55.229 20 00:59:44.372 00:13:55.229 21 remove_attach_helper() { 00:59:44.372 00:13:55.229 ... 00:59:44.372 00:13:55.229 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:59:44.372 00:13:55.229 ... 00:59:44.372 00:13:55.229 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:59:44.372 00:13:55.229 106 done 00:59:44.372 00:13:55.229 107 00:59:44.372 00:13:55.229 108 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.372 00:13:55.229 109 00:59:44.372 00:13:55.229 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.372 00:13:55.229 111 # Verify reregistering hotplug poller 00:59:44.372 00:13:55.229 112 rpc_cmd bdev_nvme_set_hotplug -d 00:59:44.372 00:13:55.229 113 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.372 00:13:55.229 114 00:59:44.372 00:13:55.229 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.372 00:13:55.229 ... 00:59:44.372 00:13:55.229 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:59:44.372 00:13:55.229 ... 00:59:44.372 00:13:55.229 133 00:59:44.372 00:13:55.229 134 # Run pci bus hotplug test 00:59:44.372 00:13:55.229 135 run_hotplug 00:59:44.372 00:13:55.229 136 00:59:44.372 00:13:55.229 137 # Run SPDK target based hotplug 00:59:44.372 00:13:55.229 => 138 tgt_run_hotplug 00:59:44.372 00:13:55.229 ... 00:59:44.372 00:13:55.229 00:59:44.372 00:13:55.229 ========== Backtrace end ========== 00:59:44.372 00:13:55.229 ========== Backtrace start: ========== 00:59:44.372 00:13:55.229 00:59:44.372 00:13:55.229 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:59:44.372 00:13:55.229 ... 00:59:44.372 00:13:55.229 11 # Pci bus hotplug 00:59:44.372 00:13:55.229 12 # Helper function to remove/attach cotrollers 00:59:44.372 00:13:55.229 13 debug_remove_attach_helper() { 00:59:44.372 00:13:55.229 14 local helper_time=0 00:59:44.372 00:13:55.229 15 00:59:44.372 00:13:55.229 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:59:44.372 00:13:55.229 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 00:59:44.372 00:13:55.229 18 "$helper_time" "$nvme_count" >&2 00:59:44.372 00:13:55.229 19 } 00:59:44.372 00:13:55.229 20 00:59:44.372 00:13:55.229 21 remove_attach_helper() { 00:59:44.372 00:13:55.229 ... 00:59:44.372 00:13:55.229 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:59:44.372 00:13:55.229 ... 00:59:44.372 00:13:55.229 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:59:44.372 00:13:55.229 106 done 00:59:44.372 00:13:55.229 107 00:59:44.372 00:13:55.229 108 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.373 00:13:55.229 109 00:59:44.373 00:13:55.229 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.373 00:13:55.229 111 # Verify reregistering hotplug poller 00:59:44.373 00:13:55.229 112 rpc_cmd bdev_nvme_set_hotplug -d 00:59:44.373 00:13:55.229 113 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.373 00:13:55.229 114 00:59:44.373 00:13:55.229 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.373 00:13:55.229 ... 00:59:44.373 00:13:55.229 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:59:44.373 00:13:55.229 ... 00:59:44.373 00:13:55.229 133 00:59:44.373 00:13:55.229 134 # Run pci bus hotplug test 00:59:44.373 00:13:55.229 135 run_hotplug 00:59:44.373 00:13:55.229 136 00:59:44.373 00:13:55.229 137 # Run SPDK target based hotplug 00:59:44.373 00:13:55.229 => 138 tgt_run_hotplug 00:59:44.373 00:13:55.229 ... 00:59:44.373 00:13:55.229 00:59:44.373 00:13:55.229 ========== Backtrace end ========== 00:59:44.373 00:13:55.488 ========== Backtrace start: ========== 00:59:44.373 00:13:55.488 00:59:44.373 00:13:55.488 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh"]) 00:59:44.373 00:13:55.488 ... 00:59:44.373 00:13:55.488 1117 timing_enter $test_name 00:59:44.373 00:13:55.488 1118 echo "************************************" 00:59:44.373 00:13:55.488 1119 echo "START TEST $test_name" 00:59:44.373 00:13:55.488 1120 echo "************************************" 00:59:44.373 00:13:55.488 1121 xtrace_restore 00:59:44.373 00:13:55.488 1122 time "$@" 00:59:44.373 00:13:55.488 1123 xtrace_disable 00:59:44.373 00:13:55.488 1124 echo "************************************" 00:59:44.373 00:13:55.488 1125 echo "END TEST $test_name" 00:59:44.373 00:13:55.488 1126 echo "************************************" 00:59:44.373 00:13:55.488 1127 timing_exit $test_name 00:59:44.373 00:13:55.488 ... 00:59:44.373 00:13:55.488 in /var/jenkins/workspace/nvme-phy-autotest/spdk/autotest.sh:240 -> main(["/var/jenkins/workspace/nvme-phy-autotest/autorun-spdk.conf"]) 00:59:44.373 00:13:55.488 ... 00:59:44.373 00:13:55.488 235 00:59:44.373 00:13:55.488 236 run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh 00:59:44.373 00:13:55.488 237 run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh 00:59:44.373 00:13:55.488 238 00:59:44.373 00:13:55.488 239 if [ $(uname -s) = Linux ]; then 00:59:44.373 00:13:55.488 => 240 run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh 00:59:44.373 00:13:55.488 241 fi 00:59:44.373 00:13:55.488 242 00:59:44.373 00:13:55.488 243 if [[ $SPDK_TEST_XNVME -eq 1 ]]; then 00:59:44.373 00:13:55.488 244 run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh 00:59:44.373 00:13:55.488 245 run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme" 00:59:44.373 00:13:55.488 ... 00:59:44.373 00:13:55.488 00:59:44.373 00:13:55.488 ========== Backtrace end ==========' 00:59:44.373 + [[ -n 00:13:55.228 11:05:51 sw_hotplug -- common/autotest_common.sh@715 -- # time='========== Backtrace start: ========== 00:59:44.373 00:13:55.228 00:59:44.373 00:13:55.228 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:59:44.373 00:13:55.228 ... 00:59:44.373 00:13:55.228 710 00:59:44.373 00:13:55.228 711 # We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to 00:59:44.373 00:13:55.228 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 00:59:44.373 00:13:55.228 713 # but $() will return just the time'\''s data, hence making it possible to just do: 00:59:44.373 00:13:55.228 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:59:44.373 00:13:55.228 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:59:44.373 00:13:55.228 716 00:59:44.373 00:13:55.228 717 echo "$time" 00:59:44.373 00:13:55.228 718 ) 00:59:44.373 00:13:55.228 719 00:59:44.373 00:13:55.228 720 function timing_enter() { 00:59:44.373 00:13:55.228 ... 00:59:44.373 00:13:55.228 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:59:44.373 00:13:55.228 ... 00:59:44.373 00:13:55.228 11 # Pci bus hotplug 00:59:44.373 00:13:55.228 12 # Helper function to remove/attach cotrollers 00:59:44.373 00:13:55.228 13 debug_remove_attach_helper() { 00:59:44.373 00:13:55.228 14 local helper_time=0 00:59:44.373 00:13:55.228 15 00:59:44.373 00:13:55.228 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:59:44.373 00:13:55.228 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 00:59:44.373 00:13:55.228 18 "$helper_time" "$nvme_count" >&2 00:59:44.373 00:13:55.228 19 } 00:59:44.373 00:13:55.228 20 00:59:44.373 00:13:55.228 21 remove_attach_helper() { 00:59:44.373 00:13:55.228 ... 00:59:44.373 00:13:55.228 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:59:44.373 00:13:55.228 ... 00:59:44.373 00:13:55.228 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:59:44.373 00:13:55.228 106 done 00:59:44.373 00:13:55.228 107 00:59:44.373 00:13:55.228 108 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.373 00:13:55.228 109 00:59:44.373 00:13:55.228 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.373 00:13:55.228 111 # Verify reregistering hotplug poller 00:59:44.373 00:13:55.228 112 rpc_cmd bdev_nvme_set_hotplug -d 00:59:44.373 00:13:55.228 113 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.373 00:13:55.228 114 00:59:44.373 00:13:55.228 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.373 00:13:55.228 ... 00:59:44.373 00:13:55.228 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:59:44.373 00:13:55.228 ... 00:59:44.373 00:13:55.228 133 00:59:44.373 00:13:55.228 134 # Run pci bus hotplug test 00:59:44.373 00:13:55.228 135 run_hotplug 00:59:44.373 00:13:55.228 136 00:59:44.373 00:13:55.228 137 # Run SPDK target based hotplug 00:59:44.373 00:13:55.228 => 138 tgt_run_hotplug 00:59:44.373 00:13:55.228 ... 00:59:44.373 00:13:55.228 00:59:44.373 00:13:55.228 ========== Backtrace end ==========' 00:59:44.373 00:13:55.228 ========== Backtrace start: ========== 00:59:44.373 00:13:55.228 00:59:44.373 00:13:55.228 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:59:44.373 00:13:55.228 ... 00:59:44.373 00:13:55.228 710 00:59:44.373 00:13:55.228 711 # We redirect cmd's std{out,err} to a separate fd dup'ed to stdin's device (or /dev/null) to 00:59:44.373 00:13:55.228 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 00:59:44.373 00:13:55.228 713 # but $() will return just the time's data, hence making it possible to just do: 00:59:44.373 00:13:55.228 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:59:44.373 00:13:55.228 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:59:44.373 00:13:55.228 716 00:59:44.373 00:13:55.228 717 echo "$time" 00:59:44.373 00:13:55.228 718 ) 00:59:44.373 00:13:55.228 719 00:59:44.373 00:13:55.228 720 function timing_enter() { 00:59:44.373 00:13:55.228 ... 00:59:44.373 00:13:55.228 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:59:44.373 00:13:55.228 ... 00:59:44.373 00:13:55.228 11 # Pci bus hotplug 00:59:44.373 00:13:55.228 12 # Helper function to remove/attach cotrollers 00:59:44.373 00:13:55.228 13 debug_remove_attach_helper() { 00:59:44.373 00:13:55.228 14 local helper_time=0 00:59:44.373 00:13:55.228 15 00:59:44.373 00:13:55.228 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:59:44.373 00:13:55.228 17 printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \ 00:59:44.373 00:13:55.228 18 "$helper_time" "$nvme_count" >&2 00:59:44.373 00:13:55.228 19 } 00:59:44.373 00:13:55.228 20 00:59:44.373 00:13:55.228 21 remove_attach_helper() { 00:59:44.373 00:13:55.228 ... 00:59:44.373 00:13:55.228 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:59:44.373 00:13:55.228 ... 00:59:44.373 00:13:55.228 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:59:44.373 00:13:55.228 106 done 00:59:44.373 00:13:55.228 107 00:59:44.373 00:13:55.228 108 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.373 00:13:55.228 109 00:59:44.373 00:13:55.228 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.373 00:13:55.228 111 # Verify reregistering hotplug poller 00:59:44.373 00:13:55.228 112 rpc_cmd bdev_nvme_set_hotplug -d 00:59:44.373 00:13:55.228 113 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.373 00:13:55.228 114 00:59:44.373 00:13:55.228 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.373 00:13:55.228 ... 00:59:44.373 00:13:55.228 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:59:44.373 00:13:55.228 ... 00:59:44.373 00:13:55.228 133 00:59:44.373 00:13:55.228 134 # Run pci bus hotplug test 00:59:44.373 00:13:55.228 135 run_hotplug 00:59:44.373 00:13:55.228 136 00:59:44.373 00:13:55.228 137 # Run SPDK target based hotplug 00:59:44.373 00:13:55.228 => 138 tgt_run_hotplug 00:59:44.373 00:13:55.228 ... 00:59:44.373 00:13:55.228 00:59:44.373 00:13:55.228 ========== Backtrace end ========== 00:59:44.373 00:13:55.229 ========== Backtrace start: ========== 00:59:44.373 00:13:55.229 00:59:44.373 00:13:55.229 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:59:44.373 00:13:55.229 ... 00:59:44.373 00:13:55.229 713 # but $() will return just the time's data, hence making it possible to just do: 00:59:44.373 00:13:55.229 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:59:44.373 00:13:55.229 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:59:44.373 00:13:55.229 716 00:59:44.373 00:13:55.229 717 echo "$time" 00:59:44.373 00:13:55.229 => 718 ) 00:59:44.373 00:13:55.229 719 00:59:44.373 00:13:55.229 720 function timing_enter() { 00:59:44.373 00:13:55.229 721 xtrace_disable 00:59:44.373 00:13:55.229 722 timing "enter" "$1" 00:59:44.374 00:13:55.229 723 xtrace_restore 00:59:44.374 00:13:55.229 ... 00:59:44.374 00:13:55.229 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:59:44.374 00:13:55.229 ... 00:59:44.374 00:13:55.229 11 # Pci bus hotplug 00:59:44.374 00:13:55.229 12 # Helper function to remove/attach cotrollers 00:59:44.374 00:13:55.229 13 debug_remove_attach_helper() { 00:59:44.374 00:13:55.229 14 local helper_time=0 00:59:44.374 00:13:55.229 15 00:59:44.374 00:13:55.229 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:59:44.374 00:13:55.229 17 printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \ 00:59:44.374 00:13:55.229 18 "$helper_time" "$nvme_count" >&2 00:59:44.374 00:13:55.229 19 } 00:59:44.374 00:13:55.229 20 00:59:44.374 00:13:55.229 21 remove_attach_helper() { 00:59:44.374 00:13:55.229 ... 00:59:44.374 00:13:55.229 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:59:44.374 00:13:55.229 ... 00:59:44.374 00:13:55.229 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:59:44.374 00:13:55.229 106 done 00:59:44.374 00:13:55.229 107 00:59:44.374 00:13:55.229 108 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.374 00:13:55.229 109 00:59:44.374 00:13:55.229 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.374 00:13:55.229 111 # Verify reregistering hotplug poller 00:59:44.374 00:13:55.229 112 rpc_cmd bdev_nvme_set_hotplug -d 00:59:44.374 00:13:55.229 113 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.374 00:13:55.229 114 00:59:44.374 00:13:55.229 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.374 00:13:55.229 ... 00:59:44.374 00:13:55.229 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:59:44.374 00:13:55.229 ... 00:59:44.374 00:13:55.229 133 00:59:44.374 00:13:55.229 134 # Run pci bus hotplug test 00:59:44.374 00:13:55.229 135 run_hotplug 00:59:44.374 00:13:55.229 136 00:59:44.374 00:13:55.229 137 # Run SPDK target based hotplug 00:59:44.374 00:13:55.229 => 138 tgt_run_hotplug 00:59:44.374 00:13:55.229 ... 00:59:44.374 00:13:55.229 00:59:44.374 00:13:55.229 ========== Backtrace end ========== 00:59:44.374 00:13:55.229 ========== Backtrace start: ========== 00:59:44.374 00:13:55.229 00:59:44.374 00:13:55.229 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:59:44.374 00:13:55.229 ... 00:59:44.374 00:13:55.229 11 # Pci bus hotplug 00:59:44.374 00:13:55.229 12 # Helper function to remove/attach cotrollers 00:59:44.374 00:13:55.229 13 debug_remove_attach_helper() { 00:59:44.374 00:13:55.229 14 local helper_time=0 00:59:44.374 00:13:55.229 15 00:59:44.374 00:13:55.229 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:59:44.374 00:13:55.229 17 printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \ 00:59:44.374 00:13:55.229 18 "$helper_time" "$nvme_count" >&2 00:59:44.374 00:13:55.229 19 } 00:59:44.374 00:13:55.229 20 00:59:44.374 00:13:55.229 21 remove_attach_helper() { 00:59:44.374 00:13:55.229 ... 00:59:44.374 00:13:55.229 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:59:44.374 00:13:55.229 ... 00:59:44.374 00:13:55.229 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:59:44.374 00:13:55.229 106 done 00:59:44.374 00:13:55.229 107 00:59:44.374 00:13:55.229 108 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.374 00:13:55.229 109 00:59:44.374 00:13:55.229 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.374 00:13:55.229 111 # Verify reregistering hotplug poller 00:59:44.374 00:13:55.229 112 rpc_cmd bdev_nvme_set_hotplug -d 00:59:44.374 00:13:55.229 113 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.374 00:13:55.229 114 00:59:44.374 00:13:55.229 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.374 00:13:55.229 ... 00:59:44.374 00:13:55.229 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:59:44.374 00:13:55.229 ... 00:59:44.374 00:13:55.229 133 00:59:44.374 00:13:55.229 134 # Run pci bus hotplug test 00:59:44.374 00:13:55.229 135 run_hotplug 00:59:44.374 00:13:55.229 136 00:59:44.374 00:13:55.229 137 # Run SPDK target based hotplug 00:59:44.374 00:13:55.229 => 138 tgt_run_hotplug 00:59:44.374 00:13:55.229 ... 00:59:44.374 00:13:55.229 00:59:44.374 00:13:55.229 ========== Backtrace end ========== 00:59:44.374 00:13:55.488 ========== Backtrace start: ========== 00:59:44.374 00:13:55.488 00:59:44.374 00:13:55.488 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh"]) 00:59:44.374 00:13:55.488 ... 00:59:44.374 00:13:55.488 1117 timing_enter $test_name 00:59:44.374 00:13:55.488 1118 echo "************************************" 00:59:44.374 00:13:55.488 1119 echo "START TEST $test_name" 00:59:44.374 00:13:55.488 1120 echo "************************************" 00:59:44.374 00:13:55.488 1121 xtrace_restore 00:59:44.374 00:13:55.488 1122 time "$@" 00:59:44.374 00:13:55.488 1123 xtrace_disable 00:59:44.374 00:13:55.488 1124 echo "************************************" 00:59:44.374 00:13:55.488 1125 echo "END TEST $test_name" 00:59:44.374 00:13:55.488 1126 echo "************************************" 00:59:44.374 00:13:55.488 1127 timing_exit $test_name 00:59:44.374 00:13:55.488 ... 00:59:44.374 00:13:55.488 in /var/jenkins/workspace/nvme-phy-autotest/spdk/autotest.sh:240 -> main(["/var/jenkins/workspace/nvme-phy-autotest/autorun-spdk.conf"]) 00:59:44.374 00:13:55.488 ... 00:59:44.374 00:13:55.488 235 00:59:44.374 00:13:55.488 236 run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh 00:59:44.374 00:13:55.488 237 run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh 00:59:44.374 00:13:55.488 238 00:59:44.374 00:13:55.488 239 if [ $(uname -s) = Linux ]; then 00:59:44.374 00:13:55.488 => 240 run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh 00:59:44.374 00:13:55.488 241 fi 00:59:44.374 00:13:55.488 242 00:59:44.374 00:13:55.488 243 if [[ $SPDK_TEST_XNVME -eq 1 ]]; then 00:59:44.374 00:13:55.488 244 run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh 00:59:44.374 00:13:55.488 245 run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme" 00:59:44.374 00:13:55.488 ... 00:59:44.374 00:13:55.488 00:59:44.374 00:13:55.488 ========== Backtrace end ========== ]] 00:59:44.374 + echo '00:13:55.228 11:05:51 sw_hotplug -- common/autotest_common.sh@715 -- # time='\''========== Backtrace start: ========== 00:59:44.374 00:13:55.228 00:59:44.374 00:13:55.228 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:59:44.374 00:13:55.228 ... 00:59:44.374 00:13:55.228 710 00:59:44.374 00:13:55.228 711 # We redirect cmd'\''\'\'''\''s std{out,err} to a separate fd dup'\''\'\'''\''ed to stdin'\''\'\'''\''s device (or /dev/null) to 00:59:44.374 00:13:55.228 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 00:59:44.374 00:13:55.228 713 # but $() will return just the time'\''\'\'''\''s data, hence making it possible to just do: 00:59:44.374 00:13:55.228 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:59:44.374 00:13:55.228 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:59:44.374 00:13:55.228 716 00:59:44.374 00:13:55.228 717 echo "$time" 00:59:44.374 00:13:55.228 718 ) 00:59:44.374 00:13:55.228 719 00:59:44.374 00:13:55.228 720 function timing_enter() { 00:59:44.374 00:13:55.228 ... 00:59:44.374 00:13:55.228 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:59:44.374 00:13:55.228 ... 00:59:44.374 00:13:55.228 11 # Pci bus hotplug 00:59:44.374 00:13:55.228 12 # Helper function to remove/attach cotrollers 00:59:44.374 00:13:55.228 13 debug_remove_attach_helper() { 00:59:44.374 00:13:55.228 14 local helper_time=0 00:59:44.374 00:13:55.228 15 00:59:44.374 00:13:55.228 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:59:44.374 00:13:55.228 17 printf '\''\'\'''\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\''\'\'''\'' \ 00:59:44.374 00:13:55.228 18 "$helper_time" "$nvme_count" >&2 00:59:44.374 00:13:55.228 19 } 00:59:44.374 00:13:55.228 20 00:59:44.374 00:13:55.228 21 remove_attach_helper() { 00:59:44.374 00:13:55.228 ... 00:59:44.374 00:13:55.228 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:59:44.374 00:13:55.228 ... 00:59:44.374 00:13:55.228 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:59:44.374 00:13:55.228 106 done 00:59:44.374 00:13:55.228 107 00:59:44.374 00:13:55.228 108 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.374 00:13:55.228 109 00:59:44.374 00:13:55.228 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.374 00:13:55.228 111 # Verify reregistering hotplug poller 00:59:44.374 00:13:55.228 112 rpc_cmd bdev_nvme_set_hotplug -d 00:59:44.374 00:13:55.228 113 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.374 00:13:55.228 114 00:59:44.374 00:13:55.228 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.374 00:13:55.228 ... 00:59:44.374 00:13:55.228 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:59:44.374 00:13:55.228 ... 00:59:44.374 00:13:55.228 133 00:59:44.374 00:13:55.228 134 # Run pci bus hotplug test 00:59:44.374 00:13:55.228 135 run_hotplug 00:59:44.374 00:13:55.228 136 00:59:44.374 00:13:55.228 137 # Run SPDK target based hotplug 00:59:44.374 00:13:55.228 => 138 tgt_run_hotplug 00:59:44.374 00:13:55.228 ... 00:59:44.374 00:13:55.228 00:59:44.374 00:13:55.228 ========== Backtrace end =========='\'' 00:59:44.374 00:13:55.228 ========== Backtrace start: ========== 00:59:44.374 00:13:55.228 00:59:44.374 00:13:55.228 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:59:44.374 00:13:55.228 ... 00:59:44.374 00:13:55.228 710 00:59:44.374 00:13:55.228 711 # We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to 00:59:44.374 00:13:55.228 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 00:59:44.374 00:13:55.228 713 # but $() will return just the time'\''s data, hence making it possible to just do: 00:59:44.375 00:13:55.228 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:59:44.375 00:13:55.228 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:59:44.375 00:13:55.228 716 00:59:44.375 00:13:55.228 717 echo "$time" 00:59:44.375 00:13:55.228 718 ) 00:59:44.375 00:13:55.228 719 00:59:44.375 00:13:55.228 720 function timing_enter() { 00:59:44.375 00:13:55.228 ... 00:59:44.375 00:13:55.228 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:59:44.375 00:13:55.228 ... 00:59:44.375 00:13:55.228 11 # Pci bus hotplug 00:59:44.375 00:13:55.228 12 # Helper function to remove/attach cotrollers 00:59:44.375 00:13:55.228 13 debug_remove_attach_helper() { 00:59:44.375 00:13:55.228 14 local helper_time=0 00:59:44.375 00:13:55.228 15 00:59:44.375 00:13:55.228 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:59:44.375 00:13:55.228 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 00:59:44.375 00:13:55.228 18 "$helper_time" "$nvme_count" >&2 00:59:44.375 00:13:55.228 19 } 00:59:44.375 00:13:55.228 20 00:59:44.375 00:13:55.228 21 remove_attach_helper() { 00:59:44.375 00:13:55.228 ... 00:59:44.375 00:13:55.228 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:59:44.375 00:13:55.228 ... 00:59:44.375 00:13:55.228 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:59:44.375 00:13:55.228 106 done 00:59:44.375 00:13:55.228 107 00:59:44.375 00:13:55.228 108 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.375 00:13:55.228 109 00:59:44.375 00:13:55.228 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.375 00:13:55.228 111 # Verify reregistering hotplug poller 00:59:44.375 00:13:55.228 112 rpc_cmd bdev_nvme_set_hotplug -d 00:59:44.375 00:13:55.228 113 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.375 00:13:55.228 114 00:59:44.375 00:13:55.228 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.375 00:13:55.228 ... 00:59:44.375 00:13:55.228 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:59:44.375 00:13:55.228 ... 00:59:44.375 00:13:55.228 133 00:59:44.375 00:13:55.228 134 # Run pci bus hotplug test 00:59:44.375 00:13:55.228 135 run_hotplug 00:59:44.375 00:13:55.228 136 00:59:44.375 00:13:55.228 137 # Run SPDK target based hotplug 00:59:44.375 00:13:55.228 => 138 tgt_run_hotplug 00:59:44.375 00:13:55.228 ... 00:59:44.375 00:13:55.228 00:59:44.375 00:13:55.228 ========== Backtrace end ========== 00:59:44.375 00:13:55.229 ========== Backtrace start: ========== 00:59:44.375 00:13:55.229 00:59:44.375 00:13:55.229 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:59:44.375 00:13:55.229 ... 00:59:44.375 00:13:55.229 713 # but $() will return just the time'\''s data, hence making it possible to just do: 00:59:44.375 00:13:55.229 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:59:44.375 00:13:55.229 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:59:44.375 00:13:55.229 716 00:59:44.375 00:13:55.229 717 echo "$time" 00:59:44.375 00:13:55.229 => 718 ) 00:59:44.375 00:13:55.229 719 00:59:44.375 00:13:55.229 720 function timing_enter() { 00:59:44.375 00:13:55.229 721 xtrace_disable 00:59:44.375 00:13:55.229 722 timing "enter" "$1" 00:59:44.375 00:13:55.229 723 xtrace_restore 00:59:44.375 00:13:55.229 ... 00:59:44.375 00:13:55.229 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:59:44.375 00:13:55.229 ... 00:59:44.375 00:13:55.229 11 # Pci bus hotplug 00:59:44.375 00:13:55.229 12 # Helper function to remove/attach cotrollers 00:59:44.375 00:13:55.229 13 debug_remove_attach_helper() { 00:59:44.375 00:13:55.229 14 local helper_time=0 00:59:44.375 00:13:55.229 15 00:59:44.375 00:13:55.229 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:59:44.375 00:13:55.229 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 00:59:44.375 00:13:55.229 18 "$helper_time" "$nvme_count" >&2 00:59:44.375 00:13:55.229 19 } 00:59:44.375 00:13:55.229 20 00:59:44.375 00:13:55.229 21 remove_attach_helper() { 00:59:44.375 00:13:55.229 ... 00:59:44.375 00:13:55.229 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:59:44.375 00:13:55.229 ... 00:59:44.375 00:13:55.229 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:59:44.375 00:13:55.229 106 done 00:59:44.375 00:13:55.229 107 00:59:44.375 00:13:55.229 108 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.375 00:13:55.229 109 00:59:44.375 00:13:55.229 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.375 00:13:55.229 111 # Verify reregistering hotplug poller 00:59:44.375 00:13:55.229 112 rpc_cmd bdev_nvme_set_hotplug -d 00:59:44.375 00:13:55.229 113 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.375 00:13:55.229 114 00:59:44.375 00:13:55.229 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.375 00:13:55.229 ... 00:59:44.375 00:13:55.229 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:59:44.375 00:13:55.229 ... 00:59:44.375 00:13:55.229 133 00:59:44.375 00:13:55.229 134 # Run pci bus hotplug test 00:59:44.375 00:13:55.229 135 run_hotplug 00:59:44.375 00:13:55.229 136 00:59:44.375 00:13:55.229 137 # Run SPDK target based hotplug 00:59:44.375 00:13:55.229 => 138 tgt_run_hotplug 00:59:44.375 00:13:55.229 ... 00:59:44.375 00:13:55.229 00:59:44.375 00:13:55.229 ========== Backtrace end ========== 00:59:44.375 00:13:55.229 ========== Backtrace start: ========== 00:59:44.375 00:13:55.229 00:59:44.375 00:13:55.229 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:59:44.375 00:13:55.229 ... 00:59:44.375 00:13:55.229 11 # Pci bus hotplug 00:59:44.375 00:13:55.229 12 # Helper function to remove/attach cotrollers 00:59:44.375 00:13:55.229 13 debug_remove_attach_helper() { 00:59:44.375 00:13:55.229 14 local helper_time=0 00:59:44.375 00:13:55.229 15 00:59:44.375 00:13:55.229 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:59:44.375 00:13:55.229 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 00:59:44.375 00:13:55.229 18 "$helper_time" "$nvme_count" >&2 00:59:44.375 00:13:55.229 19 } 00:59:44.375 00:13:55.229 20 00:59:44.375 00:13:55.229 21 remove_attach_helper() { 00:59:44.375 00:13:55.229 ... 00:59:44.375 00:13:55.229 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:59:44.375 00:13:55.229 ... 00:59:44.375 00:13:55.229 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:59:44.375 00:13:55.229 106 done 00:59:44.375 00:13:55.229 107 00:59:44.375 00:13:55.229 108 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.375 00:13:55.229 109 00:59:44.375 00:13:55.229 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.375 00:13:55.229 111 # Verify reregistering hotplug poller 00:59:44.375 00:13:55.229 112 rpc_cmd bdev_nvme_set_hotplug -d 00:59:44.375 00:13:55.229 113 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.375 00:13:55.229 114 00:59:44.375 00:13:55.229 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.375 00:13:55.229 ... 00:59:44.375 00:13:55.229 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:59:44.375 00:13:55.229 ... 00:59:44.375 00:13:55.229 133 00:59:44.375 00:13:55.229 134 # Run pci bus hotplug test 00:59:44.375 00:13:55.229 135 run_hotplug 00:59:44.375 00:13:55.229 136 00:59:44.375 00:13:55.229 137 # Run SPDK target based hotplug 00:59:44.375 00:13:55.229 => 138 tgt_run_hotplug 00:59:44.375 00:13:55.229 ... 00:59:44.375 00:13:55.229 00:59:44.375 00:13:55.229 ========== Backtrace end ========== 00:59:44.375 00:13:55.488 ========== Backtrace start: ========== 00:59:44.375 00:13:55.488 00:59:44.375 00:13:55.488 in /var/jenkins/workspace/nvme-phy-autotest/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/var/jenkins/workspace/nvme-phy-autotest/spdk/test/nvme/sw_hotplug.sh"]) 00:59:44.375 00:13:55.488 ... 00:59:44.375 00:13:55.488 1117 timing_enter $test_name 00:59:44.375 00:13:55.488 1118 echo "************************************" 00:59:44.375 00:13:55.488 1119 echo "START TEST $test_name" 00:59:44.375 00:13:55.488 1120 echo "************************************" 00:59:44.375 00:13:55.488 1121 xtrace_restore 00:59:44.375 00:13:55.488 1122 time "$@" 00:59:44.375 00:13:55.488 1123 xtrace_disable 00:59:44.375 00:13:55.488 1124 echo "************************************" 00:59:44.375 00:13:55.488 1125 echo "END TEST $test_name" 00:59:44.375 00:13:55.488 1126 echo "************************************" 00:59:44.375 00:13:55.488 1127 timing_exit $test_name 00:59:44.375 00:13:55.488 ... 00:59:44.375 00:13:55.488 in /var/jenkins/workspace/nvme-phy-autotest/spdk/autotest.sh:240 -> main(["/var/jenkins/workspace/nvme-phy-autotest/autorun-spdk.conf"]) 00:59:44.375 00:13:55.488 ... 00:59:44.375 00:13:55.488 235 00:59:44.375 00:13:55.488 236 run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh 00:59:44.375 00:13:55.488 237 run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh 00:59:44.375 00:13:55.488 238 00:59:44.375 00:13:55.488 239 if [ $(uname -s) = Linux ]; then 00:59:44.375 00:13:55.488 => 240 run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh 00:59:44.375 00:13:55.488 241 fi 00:59:44.375 00:13:55.488 242 00:59:44.375 00:13:55.488 243 if [[ $SPDK_TEST_XNVME -eq 1 ]]; then 00:59:44.375 00:13:55.488 244 run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh 00:59:44.375 00:13:55.488 245 run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme" 00:59:44.375 00:13:55.488 ... 00:59:44.375 00:13:55.488 00:59:44.375 00:13:55.488 ========== Backtrace end ==========' 00:59:44.375 + for build in "${build_log_list[@]}" 00:59:44.375 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/vhost-initiator-vg-autotest_77505/build.log 00:59:44.375 + local build_log job_name start_pattern end_pattern backtraces 00:59:44.375 + build_log=/var/jenkins/workspace/autotest-per-patch_5/vhost-initiator-vg-autotest_77505/build.log 00:59:44.375 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/vhost-initiator-vg-autotest_77505/build.log 00:59:44.375 ++ basename /var/jenkins/workspace/autotest-per-patch_5/vhost-initiator-vg-autotest_77505 00:59:44.375 + job_name=vhost-initiator-vg-autotest_77505 00:59:44.375 + start_pattern='Backtrace start' 00:59:44.375 + end_pattern='Backtrace end' 00:59:44.376 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/vhost-initiator-vg-autotest_77505/build.log ]] 00:59:44.376 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/vhost-initiator-vg-autotest_77505/build.log 00:59:44.376 + backtraces= 00:59:44.376 + [[ -n '' ]] 00:59:44.376 + for build in "${build_log_list[@]}" 00:59:44.376 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/crypto-phy-autotest_26205/build.log 00:59:44.376 + local build_log job_name start_pattern end_pattern backtraces 00:59:44.376 + build_log=/var/jenkins/workspace/autotest-per-patch_5/crypto-phy-autotest_26205/build.log 00:59:44.376 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/crypto-phy-autotest_26205/build.log 00:59:44.376 ++ basename /var/jenkins/workspace/autotest-per-patch_5/crypto-phy-autotest_26205 00:59:44.376 + job_name=crypto-phy-autotest_26205 00:59:44.376 + start_pattern='Backtrace start' 00:59:44.376 + end_pattern='Backtrace end' 00:59:44.376 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/crypto-phy-autotest_26205/build.log ]] 00:59:44.376 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/crypto-phy-autotest_26205/build.log 00:59:44.376 + backtraces= 00:59:44.376 + [[ -n '' ]] 00:59:44.376 + for build in "${build_log_list[@]}" 00:59:44.376 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/ubuntu20-vg-autotest_73804/build.log 00:59:44.376 + local build_log job_name start_pattern end_pattern backtraces 00:59:44.376 + build_log=/var/jenkins/workspace/autotest-per-patch_5/ubuntu20-vg-autotest_73804/build.log 00:59:44.376 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/ubuntu20-vg-autotest_73804/build.log 00:59:44.376 ++ basename /var/jenkins/workspace/autotest-per-patch_5/ubuntu20-vg-autotest_73804 00:59:44.376 + job_name=ubuntu20-vg-autotest_73804 00:59:44.376 + start_pattern='Backtrace start' 00:59:44.376 + end_pattern='Backtrace end' 00:59:44.376 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/ubuntu20-vg-autotest_73804/build.log ]] 00:59:44.376 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/ubuntu20-vg-autotest_73804/build.log 00:59:44.376 + backtraces='00:53:12.061 09:45:08 sw_hotplug -- common/autotest_common.sh@715 -- # time='\''========== Backtrace start: ========== 00:59:44.376 00:53:12.061 00:59:44.376 00:53:12.061 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:59:44.376 00:53:12.061 ... 00:59:44.376 00:53:12.061 710 00:59:44.376 00:53:12.061 711 # We redirect cmd'\''\'\'''\''s std{out,err} to a separate fd dup'\''\'\'''\''ed to stdin'\''\'\'''\''s device (or /dev/null) to 00:59:44.376 00:53:12.061 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 00:59:44.376 00:53:12.061 713 # but $() will return just the time'\''\'\'''\''s data, hence making it possible to just do: 00:59:44.376 00:53:12.061 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:59:44.376 00:53:12.061 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:59:44.376 00:53:12.061 716 00:59:44.376 00:53:12.061 717 echo "$time" 00:59:44.376 00:53:12.061 718 ) 00:59:44.376 00:53:12.061 719 00:59:44.376 00:53:12.061 720 function timing_enter() { 00:59:44.376 00:53:12.061 ... 00:59:44.376 00:53:12.061 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:59:44.376 00:53:12.061 ... 00:59:44.376 00:53:12.061 11 # Pci bus hotplug 00:59:44.376 00:53:12.061 12 # Helper function to remove/attach cotrollers 00:59:44.376 00:53:12.061 13 debug_remove_attach_helper() { 00:59:44.376 00:53:12.061 14 local helper_time=0 00:59:44.376 00:53:12.061 15 00:59:44.376 00:53:12.061 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:59:44.376 00:53:12.061 17 printf '\''\'\'''\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\''\'\'''\'' \ 00:59:44.376 00:53:12.061 18 "$helper_time" "$nvme_count" >&2 00:59:44.376 00:53:12.061 19 } 00:59:44.376 00:53:12.061 20 00:59:44.376 00:53:12.061 21 remove_attach_helper() { 00:59:44.376 00:53:12.061 ... 00:59:44.376 00:53:12.061 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:59:44.376 00:53:12.061 ... 00:59:44.376 00:53:12.061 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:59:44.376 00:53:12.061 106 done 00:59:44.376 00:53:12.061 107 00:59:44.376 00:53:12.061 108 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.376 00:53:12.061 109 00:59:44.376 00:53:12.061 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.376 00:53:12.061 111 # Verify reregistering hotplug poller 00:59:44.376 00:53:12.061 112 rpc_cmd bdev_nvme_set_hotplug -d 00:59:44.376 00:53:12.061 113 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.376 00:53:12.061 114 00:59:44.376 00:53:12.061 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.376 00:53:12.061 ... 00:59:44.376 00:53:12.061 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:59:44.376 00:53:12.061 ... 00:59:44.376 00:53:12.061 133 00:59:44.376 00:53:12.061 134 # Run pci bus hotplug test 00:59:44.376 00:53:12.061 135 run_hotplug 00:59:44.376 00:53:12.061 136 00:59:44.376 00:53:12.061 137 # Run SPDK target based hotplug 00:59:44.376 00:53:12.061 => 138 tgt_run_hotplug 00:59:44.376 00:53:12.061 ... 00:59:44.376 00:53:12.061 00:59:44.376 00:53:12.061 ========== Backtrace end ========== 00:59:44.376 00:53:12.061 ========== Backtrace start: ========== 00:59:44.376 00:53:12.061 00:59:44.376 00:53:12.061 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:59:44.376 00:53:12.061 ... 00:59:44.376 00:53:12.061 710 00:59:44.376 00:53:12.061 711 # We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to 00:59:44.376 00:53:12.061 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 00:59:44.376 00:53:12.061 713 # but $() will return just the time'\''s data, hence making it possible to just do: 00:59:44.376 00:53:12.061 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:59:44.376 00:53:12.061 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:59:44.376 00:53:12.061 716 00:59:44.376 00:53:12.061 717 echo "$time" 00:59:44.376 00:53:12.061 718 ) 00:59:44.376 00:53:12.061 719 00:59:44.376 00:53:12.061 720 function timing_enter() { 00:59:44.376 00:53:12.061 ... 00:59:44.376 00:53:12.061 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:59:44.376 00:53:12.061 ... 00:59:44.376 00:53:12.061 11 # Pci bus hotplug 00:59:44.376 00:53:12.061 12 # Helper function to remove/attach cotrollers 00:59:44.376 00:53:12.061 13 debug_remove_attach_helper() { 00:59:44.376 00:53:12.061 14 local helper_time=0 00:59:44.376 00:53:12.061 15 00:59:44.376 00:53:12.061 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:59:44.376 00:53:12.061 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 00:59:44.376 00:53:12.061 18 "$helper_time" "$nvme_count" >&2 00:59:44.376 00:53:12.061 19 } 00:59:44.376 00:53:12.061 20 00:59:44.376 00:53:12.061 21 remove_attach_helper() { 00:59:44.376 00:53:12.061 ... 00:59:44.376 00:53:12.061 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:59:44.376 00:53:12.061 ... 00:59:44.376 00:53:12.061 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:59:44.376 00:53:12.061 106 done 00:59:44.376 00:53:12.061 107 00:59:44.376 00:53:12.061 108 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.376 00:53:12.061 109 00:59:44.376 00:53:12.061 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.376 00:53:12.061 111 # Verify reregistering hotplug poller 00:59:44.376 00:53:12.061 112 rpc_cmd bdev_nvme_set_hotplug -d 00:59:44.376 00:53:12.061 113 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.376 00:53:12.061 114 00:59:44.376 00:53:12.061 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.376 00:53:12.061 ... 00:59:44.376 00:53:12.061 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:59:44.376 00:53:12.062 ... 00:59:44.376 00:53:12.062 133 00:59:44.376 00:53:12.062 134 # Run pci bus hotplug test 00:59:44.376 00:53:12.062 135 run_hotplug 00:59:44.376 00:53:12.062 136 00:59:44.376 00:53:12.062 137 # Run SPDK target based hotplug 00:59:44.376 00:53:12.062 => 138 tgt_run_hotplug 00:59:44.376 00:53:12.062 ... 00:59:44.376 00:53:12.062 00:59:44.376 00:53:12.062 ========== Backtrace end ========== 00:59:44.376 00:53:12.062 ========== Backtrace start: ========== 00:59:44.376 00:53:12.062 00:59:44.376 00:53:12.062 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:59:44.376 00:53:12.062 ... 00:59:44.377 00:53:12.062 713 # but $() will return just the time'\''s data, hence making it possible to just do: 00:59:44.377 00:53:12.062 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:59:44.377 00:53:12.062 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:59:44.377 00:53:12.062 716 00:59:44.377 00:53:12.062 717 echo "$time" 00:59:44.377 00:53:12.062 => 718 ) 00:59:44.377 00:53:12.062 719 00:59:44.377 00:53:12.062 720 function timing_enter() { 00:59:44.377 00:53:12.062 721 xtrace_disable 00:59:44.377 00:53:12.062 722 timing "enter" "$1" 00:59:44.377 00:53:12.062 723 xtrace_restore 00:59:44.377 00:53:12.062 ... 00:59:44.377 00:53:12.062 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:59:44.377 00:53:12.062 ... 00:59:44.377 00:53:12.062 11 # Pci bus hotplug 00:59:44.377 00:53:12.062 12 # Helper function to remove/attach cotrollers 00:59:44.377 00:53:12.062 13 debug_remove_attach_helper() { 00:59:44.377 00:53:12.062 14 local helper_time=0 00:59:44.377 00:53:12.062 15 00:59:44.377 00:53:12.062 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:59:44.377 00:53:12.062 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 00:59:44.377 00:53:12.062 18 "$helper_time" "$nvme_count" >&2 00:59:44.377 00:53:12.062 19 } 00:59:44.377 00:53:12.062 20 00:59:44.377 00:53:12.062 21 remove_attach_helper() { 00:59:44.377 00:53:12.062 ... 00:59:44.377 00:53:12.062 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:59:44.377 00:53:12.062 ... 00:59:44.377 00:53:12.062 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:59:44.377 00:53:12.062 106 done 00:59:44.377 00:53:12.062 107 00:59:44.377 00:53:12.062 108 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.377 00:53:12.062 109 00:59:44.377 00:53:12.062 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.377 00:53:12.062 111 # Verify reregistering hotplug poller 00:59:44.377 00:53:12.062 112 rpc_cmd bdev_nvme_set_hotplug -d 00:59:44.377 00:53:12.062 113 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.377 00:53:12.062 114 00:59:44.377 00:53:12.062 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.377 00:53:12.062 ... 00:59:44.377 00:53:12.062 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:59:44.377 00:53:12.062 ... 00:59:44.377 00:53:12.062 133 00:59:44.377 00:53:12.062 134 # Run pci bus hotplug test 00:59:44.377 00:53:12.062 135 run_hotplug 00:59:44.377 00:53:12.062 136 00:59:44.377 00:53:12.062 137 # Run SPDK target based hotplug 00:59:44.377 00:53:12.062 => 138 tgt_run_hotplug 00:59:44.377 00:53:12.062 ... 00:59:44.377 00:53:12.062 00:59:44.377 00:53:12.062 ========== Backtrace end ========== 00:59:44.377 00:53:12.062 ========== Backtrace start: ========== 00:59:44.377 00:53:12.062 00:59:44.377 00:53:12.062 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:59:44.377 00:53:12.062 ... 00:59:44.377 00:53:12.062 11 # Pci bus hotplug 00:59:44.377 00:53:12.062 12 # Helper function to remove/attach cotrollers 00:59:44.377 00:53:12.062 13 debug_remove_attach_helper() { 00:59:44.377 00:53:12.062 14 local helper_time=0 00:59:44.377 00:53:12.062 15 00:59:44.377 00:53:12.062 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:59:44.377 00:53:12.062 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 00:59:44.377 00:53:12.062 18 "$helper_time" "$nvme_count" >&2 00:59:44.377 00:53:12.062 19 } 00:59:44.377 00:53:12.062 20 00:59:44.377 00:53:12.062 21 remove_attach_helper() { 00:59:44.377 00:53:12.062 ... 00:59:44.377 00:53:12.062 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:59:44.377 00:53:12.062 ... 00:59:44.377 00:53:12.062 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:59:44.377 00:53:12.062 106 done 00:59:44.377 00:53:12.062 107 00:59:44.377 00:53:12.062 108 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.377 00:53:12.062 109 00:59:44.377 00:53:12.062 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.377 00:53:12.062 111 # Verify reregistering hotplug poller 00:59:44.377 00:53:12.062 112 rpc_cmd bdev_nvme_set_hotplug -d 00:59:44.377 00:53:12.062 113 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.377 00:53:12.062 114 00:59:44.377 00:53:12.062 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.377 00:53:12.062 ... 00:59:44.377 00:53:12.062 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:59:44.377 00:53:12.062 ... 00:59:44.377 00:53:12.062 133 00:59:44.377 00:53:12.062 134 # Run pci bus hotplug test 00:59:44.377 00:53:12.062 135 run_hotplug 00:59:44.377 00:53:12.062 136 00:59:44.377 00:53:12.062 137 # Run SPDK target based hotplug 00:59:44.377 00:53:12.062 => 138 tgt_run_hotplug 00:59:44.377 00:53:12.062 ... 00:59:44.377 00:53:12.062 00:59:44.377 00:53:12.062 ========== Backtrace end ========== 00:59:44.377 00:53:14.002 ========== Backtrace start: ========== 00:59:44.377 00:53:14.002 00:59:44.377 00:53:14.002 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh"]) 00:59:44.377 00:53:14.002 ... 00:59:44.377 00:53:14.002 1117 timing_enter $test_name 00:59:44.377 00:53:14.002 1118 echo "************************************" 00:59:44.377 00:53:14.002 1119 echo "START TEST $test_name" 00:59:44.377 00:53:14.002 1120 echo "************************************" 00:59:44.377 00:53:14.002 1121 xtrace_restore 00:59:44.377 00:53:14.002 1122 time "$@" 00:59:44.377 00:53:14.002 1123 xtrace_disable 00:59:44.377 00:53:14.002 1124 echo "************************************" 00:59:44.377 00:53:14.002 1125 echo "END TEST $test_name" 00:59:44.377 00:53:14.002 1126 echo "************************************" 00:59:44.377 00:53:14.002 1127 timing_exit $test_name 00:59:44.377 00:53:14.002 ... 00:59:44.377 00:53:14.002 in /home/vagrant/spdk_repo/spdk/autotest.sh:240 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 00:59:44.377 00:53:14.002 ... 00:59:44.377 00:53:14.002 235 00:59:44.377 00:53:14.002 236 run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh 00:59:44.377 00:53:14.002 237 run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh 00:59:44.377 00:53:14.002 238 00:59:44.377 00:53:14.002 239 if [ $(uname -s) = Linux ]; then 00:59:44.377 00:53:14.002 => 240 run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh 00:59:44.377 00:53:14.002 241 fi 00:59:44.377 00:53:14.002 242 00:59:44.377 00:53:14.002 243 if [[ $SPDK_TEST_XNVME -eq 1 ]]; then 00:59:44.377 00:53:14.002 244 run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh 00:59:44.377 00:53:14.002 245 run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme" 00:59:44.377 00:53:14.002 ... 00:59:44.377 00:53:14.002 00:59:44.377 00:53:14.002 ========== Backtrace end ==========' 00:59:44.377 + [[ -n 00:53:12.061 09:45:08 sw_hotplug -- common/autotest_common.sh@715 -- # time='========== Backtrace start: ========== 00:59:44.377 00:53:12.061 00:59:44.377 00:53:12.061 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:59:44.377 00:53:12.061 ... 00:59:44.377 00:53:12.061 710 00:59:44.377 00:53:12.061 711 # We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to 00:59:44.377 00:53:12.061 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 00:59:44.377 00:53:12.061 713 # but $() will return just the time'\''s data, hence making it possible to just do: 00:59:44.377 00:53:12.061 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:59:44.377 00:53:12.061 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:59:44.377 00:53:12.061 716 00:59:44.377 00:53:12.061 717 echo "$time" 00:59:44.377 00:53:12.061 718 ) 00:59:44.377 00:53:12.061 719 00:59:44.377 00:53:12.061 720 function timing_enter() { 00:59:44.377 00:53:12.061 ... 00:59:44.377 00:53:12.061 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:59:44.377 00:53:12.061 ... 00:59:44.377 00:53:12.061 11 # Pci bus hotplug 00:59:44.377 00:53:12.061 12 # Helper function to remove/attach cotrollers 00:59:44.377 00:53:12.061 13 debug_remove_attach_helper() { 00:59:44.377 00:53:12.061 14 local helper_time=0 00:59:44.377 00:53:12.061 15 00:59:44.377 00:53:12.061 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:59:44.377 00:53:12.061 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 00:59:44.377 00:53:12.061 18 "$helper_time" "$nvme_count" >&2 00:59:44.377 00:53:12.061 19 } 00:59:44.377 00:53:12.061 20 00:59:44.377 00:53:12.061 21 remove_attach_helper() { 00:59:44.377 00:53:12.061 ... 00:59:44.377 00:53:12.061 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:59:44.377 00:53:12.061 ... 00:59:44.377 00:53:12.061 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:59:44.377 00:53:12.061 106 done 00:59:44.377 00:53:12.061 107 00:59:44.377 00:53:12.061 108 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.377 00:53:12.061 109 00:59:44.377 00:53:12.061 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.377 00:53:12.061 111 # Verify reregistering hotplug poller 00:59:44.377 00:53:12.061 112 rpc_cmd bdev_nvme_set_hotplug -d 00:59:44.377 00:53:12.061 113 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.377 00:53:12.061 114 00:59:44.377 00:53:12.061 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.377 00:53:12.061 ... 00:59:44.377 00:53:12.061 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:59:44.377 00:53:12.061 ... 00:59:44.377 00:53:12.061 133 00:59:44.377 00:53:12.061 134 # Run pci bus hotplug test 00:59:44.377 00:53:12.061 135 run_hotplug 00:59:44.377 00:53:12.061 136 00:59:44.377 00:53:12.061 137 # Run SPDK target based hotplug 00:59:44.377 00:53:12.061 => 138 tgt_run_hotplug 00:59:44.377 00:53:12.061 ... 00:59:44.377 00:53:12.061 00:59:44.377 00:53:12.061 ========== Backtrace end ========== 00:59:44.377 00:53:12.061 ========== Backtrace start: ========== 00:59:44.377 00:53:12.061 00:59:44.377 00:53:12.061 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:59:44.377 00:53:12.061 ... 00:59:44.377 00:53:12.061 710 00:59:44.377 00:53:12.061 711 # We redirect cmd's std{out,err} to a separate fd dup'ed to stdin's device (or /dev/null) to 00:59:44.377 00:53:12.061 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 00:59:44.378 00:53:12.061 713 # but $() will return just the time's data, hence making it possible to just do: 00:59:44.378 00:53:12.061 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:59:44.378 00:53:12.061 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:59:44.378 00:53:12.061 716 00:59:44.378 00:53:12.061 717 echo "$time" 00:59:44.378 00:53:12.061 718 ) 00:59:44.378 00:53:12.061 719 00:59:44.378 00:53:12.061 720 function timing_enter() { 00:59:44.378 00:53:12.061 ... 00:59:44.378 00:53:12.061 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:59:44.378 00:53:12.061 ... 00:59:44.378 00:53:12.061 11 # Pci bus hotplug 00:59:44.378 00:53:12.061 12 # Helper function to remove/attach cotrollers 00:59:44.378 00:53:12.061 13 debug_remove_attach_helper() { 00:59:44.378 00:53:12.061 14 local helper_time=0 00:59:44.378 00:53:12.061 15 00:59:44.378 00:53:12.061 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:59:44.378 00:53:12.061 17 printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \ 00:59:44.378 00:53:12.061 18 "$helper_time" "$nvme_count" >&2 00:59:44.378 00:53:12.061 19 } 00:59:44.378 00:53:12.061 20 00:59:44.378 00:53:12.061 21 remove_attach_helper() { 00:59:44.378 00:53:12.061 ... 00:59:44.378 00:53:12.061 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:59:44.378 00:53:12.061 ... 00:59:44.378 00:53:12.061 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:59:44.378 00:53:12.061 106 done 00:59:44.378 00:53:12.061 107 00:59:44.378 00:53:12.061 108 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.378 00:53:12.061 109 00:59:44.378 00:53:12.061 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.378 00:53:12.061 111 # Verify reregistering hotplug poller 00:59:44.378 00:53:12.061 112 rpc_cmd bdev_nvme_set_hotplug -d 00:59:44.378 00:53:12.061 113 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.378 00:53:12.061 114 00:59:44.378 00:53:12.061 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.378 00:53:12.061 ... 00:59:44.378 00:53:12.061 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:59:44.378 00:53:12.062 ... 00:59:44.378 00:53:12.062 133 00:59:44.378 00:53:12.062 134 # Run pci bus hotplug test 00:59:44.378 00:53:12.062 135 run_hotplug 00:59:44.378 00:53:12.062 136 00:59:44.378 00:53:12.062 137 # Run SPDK target based hotplug 00:59:44.378 00:53:12.062 => 138 tgt_run_hotplug 00:59:44.378 00:53:12.062 ... 00:59:44.378 00:53:12.062 00:59:44.378 00:53:12.062 ========== Backtrace end ========== 00:59:44.378 00:53:12.062 ========== Backtrace start: ========== 00:59:44.378 00:53:12.062 00:59:44.378 00:53:12.062 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:59:44.378 00:53:12.062 ... 00:59:44.378 00:53:12.062 713 # but $() will return just the time's data, hence making it possible to just do: 00:59:44.378 00:53:12.062 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:59:44.378 00:53:12.062 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:59:44.378 00:53:12.062 716 00:59:44.378 00:53:12.062 717 echo "$time" 00:59:44.378 00:53:12.062 => 718 ) 00:59:44.378 00:53:12.062 719 00:59:44.378 00:53:12.062 720 function timing_enter() { 00:59:44.378 00:53:12.062 721 xtrace_disable 00:59:44.378 00:53:12.062 722 timing "enter" "$1" 00:59:44.378 00:53:12.062 723 xtrace_restore 00:59:44.378 00:53:12.062 ... 00:59:44.378 00:53:12.062 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:59:44.378 00:53:12.062 ... 00:59:44.378 00:53:12.062 11 # Pci bus hotplug 00:59:44.378 00:53:12.062 12 # Helper function to remove/attach cotrollers 00:59:44.378 00:53:12.062 13 debug_remove_attach_helper() { 00:59:44.378 00:53:12.062 14 local helper_time=0 00:59:44.378 00:53:12.062 15 00:59:44.378 00:53:12.062 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:59:44.378 00:53:12.062 17 printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \ 00:59:44.378 00:53:12.062 18 "$helper_time" "$nvme_count" >&2 00:59:44.378 00:53:12.062 19 } 00:59:44.378 00:53:12.062 20 00:59:44.378 00:53:12.062 21 remove_attach_helper() { 00:59:44.378 00:53:12.062 ... 00:59:44.378 00:53:12.062 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:59:44.378 00:53:12.062 ... 00:59:44.378 00:53:12.062 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:59:44.378 00:53:12.062 106 done 00:59:44.378 00:53:12.062 107 00:59:44.378 00:53:12.062 108 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.378 00:53:12.062 109 00:59:44.378 00:53:12.062 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.378 00:53:12.062 111 # Verify reregistering hotplug poller 00:59:44.378 00:53:12.062 112 rpc_cmd bdev_nvme_set_hotplug -d 00:59:44.378 00:53:12.062 113 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.378 00:53:12.062 114 00:59:44.378 00:53:12.062 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.378 00:53:12.062 ... 00:59:44.378 00:53:12.062 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:59:44.378 00:53:12.062 ... 00:59:44.378 00:53:12.062 133 00:59:44.378 00:53:12.062 134 # Run pci bus hotplug test 00:59:44.378 00:53:12.062 135 run_hotplug 00:59:44.378 00:53:12.062 136 00:59:44.378 00:53:12.062 137 # Run SPDK target based hotplug 00:59:44.378 00:53:12.062 => 138 tgt_run_hotplug 00:59:44.378 00:53:12.062 ... 00:59:44.378 00:53:12.062 00:59:44.378 00:53:12.062 ========== Backtrace end ========== 00:59:44.378 00:53:12.062 ========== Backtrace start: ========== 00:59:44.378 00:53:12.062 00:59:44.378 00:53:12.062 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:59:44.378 00:53:12.062 ... 00:59:44.378 00:53:12.062 11 # Pci bus hotplug 00:59:44.378 00:53:12.062 12 # Helper function to remove/attach cotrollers 00:59:44.378 00:53:12.062 13 debug_remove_attach_helper() { 00:59:44.378 00:53:12.062 14 local helper_time=0 00:59:44.378 00:53:12.062 15 00:59:44.378 00:53:12.062 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:59:44.378 00:53:12.062 17 printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \ 00:59:44.378 00:53:12.062 18 "$helper_time" "$nvme_count" >&2 00:59:44.378 00:53:12.062 19 } 00:59:44.378 00:53:12.062 20 00:59:44.378 00:53:12.062 21 remove_attach_helper() { 00:59:44.378 00:53:12.062 ... 00:59:44.378 00:53:12.062 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:59:44.378 00:53:12.062 ... 00:59:44.378 00:53:12.062 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:59:44.378 00:53:12.062 106 done 00:59:44.378 00:53:12.062 107 00:59:44.378 00:53:12.062 108 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.378 00:53:12.062 109 00:59:44.378 00:53:12.062 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.378 00:53:12.062 111 # Verify reregistering hotplug poller 00:59:44.378 00:53:12.062 112 rpc_cmd bdev_nvme_set_hotplug -d 00:59:44.378 00:53:12.062 113 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.378 00:53:12.062 114 00:59:44.378 00:53:12.062 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.378 00:53:12.062 ... 00:59:44.378 00:53:12.062 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:59:44.378 00:53:12.062 ... 00:59:44.378 00:53:12.062 133 00:59:44.378 00:53:12.062 134 # Run pci bus hotplug test 00:59:44.378 00:53:12.062 135 run_hotplug 00:59:44.378 00:53:12.062 136 00:59:44.378 00:53:12.062 137 # Run SPDK target based hotplug 00:59:44.378 00:53:12.062 => 138 tgt_run_hotplug 00:59:44.378 00:53:12.062 ... 00:59:44.378 00:53:12.062 00:59:44.378 00:53:12.062 ========== Backtrace end ========== 00:59:44.378 00:53:14.002 ========== Backtrace start: ========== 00:59:44.378 00:53:14.002 00:59:44.378 00:53:14.002 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh"]) 00:59:44.378 00:53:14.002 ... 00:59:44.378 00:53:14.002 1117 timing_enter $test_name 00:59:44.378 00:53:14.002 1118 echo "************************************" 00:59:44.378 00:53:14.002 1119 echo "START TEST $test_name" 00:59:44.378 00:53:14.002 1120 echo "************************************" 00:59:44.378 00:53:14.002 1121 xtrace_restore 00:59:44.378 00:53:14.002 1122 time "$@" 00:59:44.378 00:53:14.002 1123 xtrace_disable 00:59:44.378 00:53:14.002 1124 echo "************************************" 00:59:44.378 00:53:14.002 1125 echo "END TEST $test_name" 00:59:44.378 00:53:14.002 1126 echo "************************************" 00:59:44.378 00:53:14.002 1127 timing_exit $test_name 00:59:44.378 00:53:14.002 ... 00:59:44.378 00:53:14.002 in /home/vagrant/spdk_repo/spdk/autotest.sh:240 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 00:59:44.378 00:53:14.002 ... 00:59:44.378 00:53:14.002 235 00:59:44.378 00:53:14.002 236 run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh 00:59:44.378 00:53:14.002 237 run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh 00:59:44.378 00:53:14.002 238 00:59:44.378 00:53:14.002 239 if [ $(uname -s) = Linux ]; then 00:59:44.378 00:53:14.002 => 240 run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh 00:59:44.378 00:53:14.002 241 fi 00:59:44.378 00:53:14.002 242 00:59:44.378 00:53:14.002 243 if [[ $SPDK_TEST_XNVME -eq 1 ]]; then 00:59:44.378 00:53:14.002 244 run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh 00:59:44.378 00:53:14.002 245 run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme" 00:59:44.378 00:53:14.002 ... 00:59:44.378 00:53:14.002 00:59:44.378 00:53:14.002 ========== Backtrace end ========== ]] 00:59:44.378 + echo '00:53:12.061 09:45:08 sw_hotplug -- common/autotest_common.sh@715 -- # time='\''========== Backtrace start: ========== 00:59:44.378 00:53:12.061 00:59:44.378 00:53:12.061 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:59:44.378 00:53:12.061 ... 00:59:44.378 00:53:12.061 710 00:59:44.378 00:53:12.061 711 # We redirect cmd'\''\'\'''\''s std{out,err} to a separate fd dup'\''\'\'''\''ed to stdin'\''\'\'''\''s device (or /dev/null) to 00:59:44.378 00:53:12.061 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 00:59:44.378 00:53:12.061 713 # but $() will return just the time'\''\'\'''\''s data, hence making it possible to just do: 00:59:44.378 00:53:12.061 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:59:44.378 00:53:12.061 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:59:44.378 00:53:12.061 716 00:59:44.379 00:53:12.061 717 echo "$time" 00:59:44.379 00:53:12.061 718 ) 00:59:44.379 00:53:12.061 719 00:59:44.379 00:53:12.061 720 function timing_enter() { 00:59:44.379 00:53:12.061 ... 00:59:44.379 00:53:12.061 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:59:44.379 00:53:12.061 ... 00:59:44.379 00:53:12.061 11 # Pci bus hotplug 00:59:44.379 00:53:12.061 12 # Helper function to remove/attach cotrollers 00:59:44.379 00:53:12.061 13 debug_remove_attach_helper() { 00:59:44.379 00:53:12.061 14 local helper_time=0 00:59:44.379 00:53:12.061 15 00:59:44.379 00:53:12.061 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:59:44.379 00:53:12.061 17 printf '\''\'\'''\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\''\'\'''\'' \ 00:59:44.379 00:53:12.061 18 "$helper_time" "$nvme_count" >&2 00:59:44.379 00:53:12.061 19 } 00:59:44.379 00:53:12.061 20 00:59:44.379 00:53:12.061 21 remove_attach_helper() { 00:59:44.379 00:53:12.061 ... 00:59:44.379 00:53:12.061 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:59:44.379 00:53:12.061 ... 00:59:44.379 00:53:12.061 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:59:44.379 00:53:12.061 106 done 00:59:44.379 00:53:12.061 107 00:59:44.379 00:53:12.061 108 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.379 00:53:12.061 109 00:59:44.379 00:53:12.061 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.379 00:53:12.061 111 # Verify reregistering hotplug poller 00:59:44.379 00:53:12.061 112 rpc_cmd bdev_nvme_set_hotplug -d 00:59:44.379 00:53:12.061 113 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.379 00:53:12.061 114 00:59:44.379 00:53:12.061 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.379 00:53:12.061 ... 00:59:44.379 00:53:12.061 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:59:44.379 00:53:12.061 ... 00:59:44.379 00:53:12.061 133 00:59:44.379 00:53:12.061 134 # Run pci bus hotplug test 00:59:44.379 00:53:12.061 135 run_hotplug 00:59:44.379 00:53:12.061 136 00:59:44.379 00:53:12.061 137 # Run SPDK target based hotplug 00:59:44.379 00:53:12.061 => 138 tgt_run_hotplug 00:59:44.379 00:53:12.061 ... 00:59:44.379 00:53:12.061 00:59:44.379 00:53:12.061 ========== Backtrace end ========== 00:59:44.379 00:53:12.061 ========== Backtrace start: ========== 00:59:44.379 00:53:12.061 00:59:44.379 00:53:12.061 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:59:44.379 00:53:12.061 ... 00:59:44.379 00:53:12.061 710 00:59:44.379 00:53:12.061 711 # We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to 00:59:44.379 00:53:12.061 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 00:59:44.379 00:53:12.061 713 # but $() will return just the time'\''s data, hence making it possible to just do: 00:59:44.379 00:53:12.061 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:59:44.379 00:53:12.061 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:59:44.379 00:53:12.061 716 00:59:44.379 00:53:12.061 717 echo "$time" 00:59:44.379 00:53:12.061 718 ) 00:59:44.379 00:53:12.061 719 00:59:44.379 00:53:12.061 720 function timing_enter() { 00:59:44.379 00:53:12.061 ... 00:59:44.379 00:53:12.061 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:59:44.379 00:53:12.061 ... 00:59:44.379 00:53:12.061 11 # Pci bus hotplug 00:59:44.379 00:53:12.061 12 # Helper function to remove/attach cotrollers 00:59:44.379 00:53:12.061 13 debug_remove_attach_helper() { 00:59:44.379 00:53:12.061 14 local helper_time=0 00:59:44.379 00:53:12.061 15 00:59:44.379 00:53:12.061 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:59:44.379 00:53:12.061 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 00:59:44.379 00:53:12.061 18 "$helper_time" "$nvme_count" >&2 00:59:44.379 00:53:12.061 19 } 00:59:44.379 00:53:12.061 20 00:59:44.379 00:53:12.061 21 remove_attach_helper() { 00:59:44.379 00:53:12.061 ... 00:59:44.379 00:53:12.061 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:59:44.379 00:53:12.061 ... 00:59:44.379 00:53:12.061 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:59:44.379 00:53:12.061 106 done 00:59:44.379 00:53:12.061 107 00:59:44.379 00:53:12.061 108 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.379 00:53:12.061 109 00:59:44.379 00:53:12.061 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.379 00:53:12.061 111 # Verify reregistering hotplug poller 00:59:44.379 00:53:12.061 112 rpc_cmd bdev_nvme_set_hotplug -d 00:59:44.379 00:53:12.061 113 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.379 00:53:12.061 114 00:59:44.379 00:53:12.061 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.379 00:53:12.061 ... 00:59:44.379 00:53:12.061 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:59:44.379 00:53:12.062 ... 00:59:44.379 00:53:12.062 133 00:59:44.379 00:53:12.062 134 # Run pci bus hotplug test 00:59:44.379 00:53:12.062 135 run_hotplug 00:59:44.379 00:53:12.062 136 00:59:44.379 00:53:12.062 137 # Run SPDK target based hotplug 00:59:44.379 00:53:12.062 => 138 tgt_run_hotplug 00:59:44.379 00:53:12.062 ... 00:59:44.379 00:53:12.062 00:59:44.379 00:53:12.062 ========== Backtrace end ========== 00:59:44.379 00:53:12.062 ========== Backtrace start: ========== 00:59:44.379 00:53:12.062 00:59:44.379 00:53:12.062 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:59:44.379 00:53:12.062 ... 00:59:44.379 00:53:12.062 713 # but $() will return just the time'\''s data, hence making it possible to just do: 00:59:44.379 00:53:12.062 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:59:44.379 00:53:12.062 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:59:44.379 00:53:12.062 716 00:59:44.379 00:53:12.062 717 echo "$time" 00:59:44.379 00:53:12.062 => 718 ) 00:59:44.379 00:53:12.062 719 00:59:44.379 00:53:12.062 720 function timing_enter() { 00:59:44.379 00:53:12.062 721 xtrace_disable 00:59:44.379 00:53:12.062 722 timing "enter" "$1" 00:59:44.379 00:53:12.062 723 xtrace_restore 00:59:44.379 00:53:12.062 ... 00:59:44.379 00:53:12.062 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:59:44.379 00:53:12.062 ... 00:59:44.379 00:53:12.062 11 # Pci bus hotplug 00:59:44.379 00:53:12.062 12 # Helper function to remove/attach cotrollers 00:59:44.379 00:53:12.062 13 debug_remove_attach_helper() { 00:59:44.379 00:53:12.062 14 local helper_time=0 00:59:44.379 00:53:12.062 15 00:59:44.379 00:53:12.062 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:59:44.379 00:53:12.062 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 00:59:44.379 00:53:12.062 18 "$helper_time" "$nvme_count" >&2 00:59:44.379 00:53:12.062 19 } 00:59:44.379 00:53:12.062 20 00:59:44.379 00:53:12.062 21 remove_attach_helper() { 00:59:44.379 00:53:12.062 ... 00:59:44.379 00:53:12.062 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:59:44.379 00:53:12.062 ... 00:59:44.379 00:53:12.062 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:59:44.379 00:53:12.062 106 done 00:59:44.379 00:53:12.062 107 00:59:44.379 00:53:12.062 108 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.379 00:53:12.062 109 00:59:44.379 00:53:12.062 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.379 00:53:12.062 111 # Verify reregistering hotplug poller 00:59:44.379 00:53:12.062 112 rpc_cmd bdev_nvme_set_hotplug -d 00:59:44.379 00:53:12.062 113 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.379 00:53:12.062 114 00:59:44.379 00:53:12.062 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.379 00:53:12.062 ... 00:59:44.379 00:53:12.062 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:59:44.379 00:53:12.062 ... 00:59:44.379 00:53:12.062 133 00:59:44.379 00:53:12.062 134 # Run pci bus hotplug test 00:59:44.379 00:53:12.062 135 run_hotplug 00:59:44.379 00:53:12.062 136 00:59:44.379 00:53:12.062 137 # Run SPDK target based hotplug 00:59:44.379 00:53:12.062 => 138 tgt_run_hotplug 00:59:44.379 00:53:12.062 ... 00:59:44.379 00:53:12.062 00:59:44.379 00:53:12.062 ========== Backtrace end ========== 00:59:44.379 00:53:12.062 ========== Backtrace start: ========== 00:59:44.379 00:53:12.062 00:59:44.379 00:53:12.062 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:59:44.379 00:53:12.062 ... 00:59:44.379 00:53:12.062 11 # Pci bus hotplug 00:59:44.379 00:53:12.062 12 # Helper function to remove/attach cotrollers 00:59:44.379 00:53:12.062 13 debug_remove_attach_helper() { 00:59:44.379 00:53:12.062 14 local helper_time=0 00:59:44.379 00:53:12.062 15 00:59:44.379 00:53:12.062 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:59:44.379 00:53:12.062 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 00:59:44.379 00:53:12.062 18 "$helper_time" "$nvme_count" >&2 00:59:44.379 00:53:12.062 19 } 00:59:44.379 00:53:12.062 20 00:59:44.379 00:53:12.062 21 remove_attach_helper() { 00:59:44.379 00:53:12.062 ... 00:59:44.379 00:53:12.062 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:59:44.379 00:53:12.062 ... 00:59:44.379 00:53:12.062 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:59:44.379 00:53:12.062 106 done 00:59:44.379 00:53:12.062 107 00:59:44.379 00:53:12.062 108 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.379 00:53:12.062 109 00:59:44.379 00:53:12.062 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.379 00:53:12.062 111 # Verify reregistering hotplug poller 00:59:44.379 00:53:12.062 112 rpc_cmd bdev_nvme_set_hotplug -d 00:59:44.379 00:53:12.062 113 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.379 00:53:12.062 114 00:59:44.379 00:53:12.062 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.379 00:53:12.062 ... 00:59:44.379 00:53:12.062 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:59:44.379 00:53:12.062 ... 00:59:44.379 00:53:12.062 133 00:59:44.379 00:53:12.062 134 # Run pci bus hotplug test 00:59:44.379 00:53:12.062 135 run_hotplug 00:59:44.379 00:53:12.062 136 00:59:44.380 00:53:12.062 137 # Run SPDK target based hotplug 00:59:44.380 00:53:12.062 => 138 tgt_run_hotplug 00:59:44.380 00:53:12.062 ... 00:59:44.380 00:53:12.062 00:59:44.380 00:53:12.062 ========== Backtrace end ========== 00:59:44.380 00:53:14.002 ========== Backtrace start: ========== 00:59:44.380 00:53:14.002 00:59:44.380 00:53:14.002 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh"]) 00:59:44.380 00:53:14.002 ... 00:59:44.380 00:53:14.002 1117 timing_enter $test_name 00:59:44.380 00:53:14.002 1118 echo "************************************" 00:59:44.380 00:53:14.002 1119 echo "START TEST $test_name" 00:59:44.380 00:53:14.002 1120 echo "************************************" 00:59:44.380 00:53:14.002 1121 xtrace_restore 00:59:44.380 00:53:14.002 1122 time "$@" 00:59:44.380 00:53:14.002 1123 xtrace_disable 00:59:44.380 00:53:14.002 1124 echo "************************************" 00:59:44.380 00:53:14.002 1125 echo "END TEST $test_name" 00:59:44.380 00:53:14.002 1126 echo "************************************" 00:59:44.380 00:53:14.002 1127 timing_exit $test_name 00:59:44.380 00:53:14.002 ... 00:59:44.380 00:53:14.002 in /home/vagrant/spdk_repo/spdk/autotest.sh:240 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 00:59:44.380 00:53:14.002 ... 00:59:44.380 00:53:14.002 235 00:59:44.380 00:53:14.002 236 run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh 00:59:44.380 00:53:14.002 237 run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh 00:59:44.380 00:53:14.002 238 00:59:44.380 00:53:14.002 239 if [ $(uname -s) = Linux ]; then 00:59:44.380 00:53:14.002 => 240 run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh 00:59:44.380 00:53:14.002 241 fi 00:59:44.380 00:53:14.002 242 00:59:44.380 00:53:14.002 243 if [[ $SPDK_TEST_XNVME -eq 1 ]]; then 00:59:44.380 00:53:14.002 244 run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh 00:59:44.380 00:53:14.002 245 run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme" 00:59:44.380 00:53:14.002 ... 00:59:44.380 00:53:14.002 00:59:44.380 00:53:14.002 ========== Backtrace end ==========' 00:59:44.380 + for build in "${build_log_list[@]}" 00:59:44.380 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/vfio-user-phy-autotest_26213/build.log 00:59:44.380 + local build_log job_name start_pattern end_pattern backtraces 00:59:44.380 + build_log=/var/jenkins/workspace/autotest-per-patch_5/vfio-user-phy-autotest_26213/build.log 00:59:44.380 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/vfio-user-phy-autotest_26213/build.log 00:59:44.380 ++ basename /var/jenkins/workspace/autotest-per-patch_5/vfio-user-phy-autotest_26213 00:59:44.380 + job_name=vfio-user-phy-autotest_26213 00:59:44.380 + start_pattern='Backtrace start' 00:59:44.380 + end_pattern='Backtrace end' 00:59:44.380 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/vfio-user-phy-autotest_26213/build.log ]] 00:59:44.380 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/vfio-user-phy-autotest_26213/build.log 00:59:44.380 + backtraces= 00:59:44.380 + [[ -n '' ]] 00:59:44.380 + for build in "${build_log_list[@]}" 00:59:44.380 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/check-so-deps-docker-autotest_22163/build.log 00:59:44.380 + local build_log job_name start_pattern end_pattern backtraces 00:59:44.380 + build_log=/var/jenkins/workspace/autotest-per-patch_5/check-so-deps-docker-autotest_22163/build.log 00:59:44.380 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/check-so-deps-docker-autotest_22163/build.log 00:59:44.380 ++ basename /var/jenkins/workspace/autotest-per-patch_5/check-so-deps-docker-autotest_22163 00:59:44.380 + job_name=check-so-deps-docker-autotest_22163 00:59:44.380 + start_pattern='Backtrace start' 00:59:44.380 + end_pattern='Backtrace end' 00:59:44.380 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/check-so-deps-docker-autotest_22163/build.log ]] 00:59:44.380 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/check-so-deps-docker-autotest_22163/build.log 00:59:44.380 + backtraces= 00:59:44.380 + [[ -n '' ]] 00:59:44.380 + for build in "${build_log_list[@]}" 00:59:44.380 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-phy-autotest_72336/build.log 00:59:44.380 + local build_log job_name start_pattern end_pattern backtraces 00:59:44.380 + build_log=/var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-phy-autotest_72336/build.log 00:59:44.380 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-phy-autotest_72336/build.log 00:59:44.380 ++ basename /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-phy-autotest_72336 00:59:44.380 + job_name=nvmf-tcp-phy-autotest_72336 00:59:44.380 + start_pattern='Backtrace start' 00:59:44.380 + end_pattern='Backtrace end' 00:59:44.380 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-phy-autotest_72336/build.log ]] 00:59:44.380 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-phy-autotest_72336/build.log 00:59:44.380 + backtraces= 00:59:44.380 + [[ -n '' ]] 00:59:44.380 + for build in "${build_log_list[@]}" 00:59:44.380 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-uring-vg-autotest_77410/build.log 00:59:44.380 + local build_log job_name start_pattern end_pattern backtraces 00:59:44.380 + build_log=/var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-uring-vg-autotest_77410/build.log 00:59:44.380 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-uring-vg-autotest_77410/build.log 00:59:44.380 ++ basename /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-uring-vg-autotest_77410 00:59:44.380 + job_name=nvmf-tcp-uring-vg-autotest_77410 00:59:44.380 + start_pattern='Backtrace start' 00:59:44.380 + end_pattern='Backtrace end' 00:59:44.380 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-uring-vg-autotest_77410/build.log ]] 00:59:44.380 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-uring-vg-autotest_77410/build.log 00:59:44.380 + backtraces= 00:59:44.380 + [[ -n '' ]] 00:59:44.380 + for build in "${build_log_list[@]}" 00:59:44.380 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/iscsi-uring-vg-autotest_77390/build.log 00:59:44.380 + local build_log job_name start_pattern end_pattern backtraces 00:59:44.380 + build_log=/var/jenkins/workspace/autotest-per-patch_5/iscsi-uring-vg-autotest_77390/build.log 00:59:44.380 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/iscsi-uring-vg-autotest_77390/build.log 00:59:44.380 ++ basename /var/jenkins/workspace/autotest-per-patch_5/iscsi-uring-vg-autotest_77390 00:59:44.380 + job_name=iscsi-uring-vg-autotest_77390 00:59:44.380 + start_pattern='Backtrace start' 00:59:44.380 + end_pattern='Backtrace end' 00:59:44.380 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/iscsi-uring-vg-autotest_77390/build.log ]] 00:59:44.380 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/iscsi-uring-vg-autotest_77390/build.log 00:59:44.642 + backtraces= 00:59:44.642 + [[ -n '' ]] 00:59:44.642 + for build in "${build_log_list[@]}" 00:59:44.642 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/short-fuzz-phy-autotest_26202/build.log 00:59:44.642 + local build_log job_name start_pattern end_pattern backtraces 00:59:44.642 + build_log=/var/jenkins/workspace/autotest-per-patch_5/short-fuzz-phy-autotest_26202/build.log 00:59:44.642 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/short-fuzz-phy-autotest_26202/build.log 00:59:44.642 ++ basename /var/jenkins/workspace/autotest-per-patch_5/short-fuzz-phy-autotest_26202 00:59:44.642 + job_name=short-fuzz-phy-autotest_26202 00:59:44.642 + start_pattern='Backtrace start' 00:59:44.642 + end_pattern='Backtrace end' 00:59:44.642 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/short-fuzz-phy-autotest_26202/build.log ]] 00:59:44.642 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/short-fuzz-phy-autotest_26202/build.log 00:59:44.642 + backtraces= 00:59:44.642 + [[ -n '' ]] 00:59:44.642 + for build in "${build_log_list[@]}" 00:59:44.642 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/rocky9-vg-autotest_16095/build.log 00:59:44.642 + local build_log job_name start_pattern end_pattern backtraces 00:59:44.642 + build_log=/var/jenkins/workspace/autotest-per-patch_5/rocky9-vg-autotest_16095/build.log 00:59:44.642 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/rocky9-vg-autotest_16095/build.log 00:59:44.642 ++ basename /var/jenkins/workspace/autotest-per-patch_5/rocky9-vg-autotest_16095 00:59:44.642 + job_name=rocky9-vg-autotest_16095 00:59:44.642 + start_pattern='Backtrace start' 00:59:44.642 + end_pattern='Backtrace end' 00:59:44.642 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/rocky9-vg-autotest_16095/build.log ]] 00:59:44.642 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/rocky9-vg-autotest_16095/build.log 00:59:44.642 + backtraces= 00:59:44.642 + [[ -n '' ]] 00:59:44.642 + for build in "${build_log_list[@]}" 00:59:44.642 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/unittest-clang-docker-autotest_19867/build.log 00:59:44.642 + local build_log job_name start_pattern end_pattern backtraces 00:59:44.642 + build_log=/var/jenkins/workspace/autotest-per-patch_5/unittest-clang-docker-autotest_19867/build.log 00:59:44.642 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/unittest-clang-docker-autotest_19867/build.log 00:59:44.642 ++ basename /var/jenkins/workspace/autotest-per-patch_5/unittest-clang-docker-autotest_19867 00:59:44.642 + job_name=unittest-clang-docker-autotest_19867 00:59:44.642 + start_pattern='Backtrace start' 00:59:44.642 + end_pattern='Backtrace end' 00:59:44.642 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/unittest-clang-docker-autotest_19867/build.log ]] 00:59:44.642 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/unittest-clang-docker-autotest_19867/build.log 00:59:44.642 + backtraces= 00:59:44.642 + [[ -n '' ]] 00:59:44.642 + for build in "${build_log_list[@]}" 00:59:44.642 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/autobuild-external-vg-autotest_19830/build.log 00:59:44.642 + local build_log job_name start_pattern end_pattern backtraces 00:59:44.642 + build_log=/var/jenkins/workspace/autotest-per-patch_5/autobuild-external-vg-autotest_19830/build.log 00:59:44.642 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/autobuild-external-vg-autotest_19830/build.log 00:59:44.642 ++ basename /var/jenkins/workspace/autotest-per-patch_5/autobuild-external-vg-autotest_19830 00:59:44.642 + job_name=autobuild-external-vg-autotest_19830 00:59:44.642 + start_pattern='Backtrace start' 00:59:44.642 + end_pattern='Backtrace end' 00:59:44.642 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/autobuild-external-vg-autotest_19830/build.log ]] 00:59:44.642 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/autobuild-external-vg-autotest_19830/build.log 00:59:44.642 + backtraces= 00:59:44.642 + [[ -n '' ]] 00:59:44.642 + for build in "${build_log_list[@]}" 00:59:44.642 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/nvme-vg-autotest_77485/build.log 00:59:44.642 + local build_log job_name start_pattern end_pattern backtraces 00:59:44.642 + build_log=/var/jenkins/workspace/autotest-per-patch_5/nvme-vg-autotest_77485/build.log 00:59:44.642 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/nvme-vg-autotest_77485/build.log 00:59:44.642 ++ basename /var/jenkins/workspace/autotest-per-patch_5/nvme-vg-autotest_77485 00:59:44.642 + job_name=nvme-vg-autotest_77485 00:59:44.642 + start_pattern='Backtrace start' 00:59:44.642 + end_pattern='Backtrace end' 00:59:44.642 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/nvme-vg-autotest_77485/build.log ]] 00:59:44.643 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/nvme-vg-autotest_77485/build.log 00:59:44.643 + backtraces='00:16:58.747 09:08:55 sw_hotplug -- common/autotest_common.sh@715 -- # time='\''========== Backtrace start: ========== 00:59:44.643 00:16:58.747 00:59:44.643 00:16:58.747 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:59:44.643 00:16:58.747 ... 00:59:44.643 00:16:58.747 710 00:59:44.643 00:16:58.747 711 # We redirect cmd'\''\'\'''\''s std{out,err} to a separate fd dup'\''\'\'''\''ed to stdin'\''\'\'''\''s device (or /dev/null) to 00:59:44.643 00:16:58.747 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 00:59:44.643 00:16:58.747 713 # but $() will return just the time'\''\'\'''\''s data, hence making it possible to just do: 00:59:44.643 00:16:58.747 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:59:44.643 00:16:58.747 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:59:44.643 00:16:58.747 716 00:59:44.643 00:16:58.747 717 echo "$time" 00:59:44.643 00:16:58.747 718 ) 00:59:44.643 00:16:58.747 719 00:59:44.643 00:16:58.747 720 function timing_enter() { 00:59:44.643 00:16:58.747 ... 00:59:44.643 00:16:58.747 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:59:44.643 00:16:58.747 ... 00:59:44.643 00:16:58.747 11 # Pci bus hotplug 00:59:44.643 00:16:58.747 12 # Helper function to remove/attach cotrollers 00:59:44.643 00:16:58.747 13 debug_remove_attach_helper() { 00:59:44.643 00:16:58.747 14 local helper_time=0 00:59:44.643 00:16:58.747 15 00:59:44.643 00:16:58.747 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:59:44.643 00:16:58.747 17 printf '\''\'\'''\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\''\'\'''\'' \ 00:59:44.643 00:16:58.747 18 "$helper_time" "$nvme_count" >&2 00:59:44.643 00:16:58.747 19 } 00:59:44.643 00:16:58.747 20 00:59:44.643 00:16:58.747 21 remove_attach_helper() { 00:59:44.643 00:16:58.747 ... 00:59:44.643 00:16:58.747 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:59:44.643 00:16:58.747 ... 00:59:44.643 00:16:58.747 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:59:44.643 00:16:58.747 106 done 00:59:44.643 00:16:58.747 107 00:59:44.643 00:16:58.747 108 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.643 00:16:58.747 109 00:59:44.643 00:16:58.747 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.643 00:16:58.747 111 # Verify reregistering hotplug poller 00:59:44.643 00:16:58.747 112 rpc_cmd bdev_nvme_set_hotplug -d 00:59:44.643 00:16:58.747 113 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.643 00:16:58.747 114 00:59:44.643 00:16:58.747 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.643 00:16:58.747 ... 00:59:44.643 00:16:58.747 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:59:44.643 00:16:58.747 ... 00:59:44.643 00:16:58.747 133 00:59:44.643 00:16:58.747 134 # Run pci bus hotplug test 00:59:44.643 00:16:58.747 135 run_hotplug 00:59:44.643 00:16:58.747 136 00:59:44.643 00:16:58.747 137 # Run SPDK target based hotplug 00:59:44.643 00:16:58.747 => 138 tgt_run_hotplug 00:59:44.643 00:16:58.747 ... 00:59:44.643 00:16:58.747 00:59:44.643 00:16:58.747 ========== Backtrace end =========='\'' 00:59:44.643 00:16:58.747 ========== Backtrace start: ========== 00:59:44.643 00:16:58.747 00:59:44.643 00:16:58.747 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:59:44.643 00:16:58.747 ... 00:59:44.643 00:16:58.747 710 00:59:44.643 00:16:58.747 711 # We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to 00:59:44.643 00:16:58.747 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 00:59:44.643 00:16:58.747 713 # but $() will return just the time'\''s data, hence making it possible to just do: 00:59:44.643 00:16:58.747 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:59:44.643 00:16:58.747 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:59:44.643 00:16:58.747 716 00:59:44.643 00:16:58.747 717 echo "$time" 00:59:44.643 00:16:58.747 718 ) 00:59:44.643 00:16:58.747 719 00:59:44.643 00:16:58.747 720 function timing_enter() { 00:59:44.643 00:16:58.747 ... 00:59:44.643 00:16:58.747 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:59:44.643 00:16:58.747 ... 00:59:44.643 00:16:58.747 11 # Pci bus hotplug 00:59:44.643 00:16:58.747 12 # Helper function to remove/attach cotrollers 00:59:44.643 00:16:58.747 13 debug_remove_attach_helper() { 00:59:44.643 00:16:58.747 14 local helper_time=0 00:59:44.643 00:16:58.747 15 00:59:44.643 00:16:58.747 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:59:44.643 00:16:58.747 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 00:59:44.643 00:16:58.747 18 "$helper_time" "$nvme_count" >&2 00:59:44.643 00:16:58.747 19 } 00:59:44.643 00:16:58.747 20 00:59:44.643 00:16:58.747 21 remove_attach_helper() { 00:59:44.643 00:16:58.747 ... 00:59:44.643 00:16:58.747 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:59:44.643 00:16:58.747 ... 00:59:44.643 00:16:58.747 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:59:44.643 00:16:58.747 106 done 00:59:44.643 00:16:58.747 107 00:59:44.643 00:16:58.747 108 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.643 00:16:58.747 109 00:59:44.643 00:16:58.747 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.643 00:16:58.747 111 # Verify reregistering hotplug poller 00:59:44.643 00:16:58.747 112 rpc_cmd bdev_nvme_set_hotplug -d 00:59:44.643 00:16:58.747 113 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.643 00:16:58.747 114 00:59:44.643 00:16:58.747 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.643 00:16:58.747 ... 00:59:44.643 00:16:58.747 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:59:44.643 00:16:58.747 ... 00:59:44.643 00:16:58.747 133 00:59:44.643 00:16:58.747 134 # Run pci bus hotplug test 00:59:44.643 00:16:58.747 135 run_hotplug 00:59:44.643 00:16:58.747 136 00:59:44.643 00:16:58.747 137 # Run SPDK target based hotplug 00:59:44.643 00:16:58.747 => 138 tgt_run_hotplug 00:59:44.643 00:16:58.747 ... 00:59:44.643 00:16:58.747 00:59:44.643 00:16:58.747 ========== Backtrace end ========== 00:59:44.643 00:16:58.747 ========== Backtrace start: ========== 00:59:44.643 00:16:58.747 00:59:44.643 00:16:58.747 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:59:44.643 00:16:58.747 ... 00:59:44.643 00:16:58.747 713 # but $() will return just the time'\''s data, hence making it possible to just do: 00:59:44.643 00:16:58.747 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:59:44.643 00:16:58.747 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:59:44.643 00:16:58.747 716 00:59:44.643 00:16:58.747 717 echo "$time" 00:59:44.643 00:16:58.747 => 718 ) 00:59:44.643 00:16:58.747 719 00:59:44.643 00:16:58.747 720 function timing_enter() { 00:59:44.643 00:16:58.747 721 xtrace_disable 00:59:44.643 00:16:58.747 722 timing "enter" "$1" 00:59:44.643 00:16:58.747 723 xtrace_restore 00:59:44.643 00:16:58.747 ... 00:59:44.643 00:16:58.747 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:59:44.643 00:16:58.747 ... 00:59:44.643 00:16:58.747 11 # Pci bus hotplug 00:59:44.643 00:16:58.747 12 # Helper function to remove/attach cotrollers 00:59:44.643 00:16:58.747 13 debug_remove_attach_helper() { 00:59:44.643 00:16:58.747 14 local helper_time=0 00:59:44.643 00:16:58.747 15 00:59:44.643 00:16:58.747 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:59:44.643 00:16:58.747 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 00:59:44.643 00:16:58.747 18 "$helper_time" "$nvme_count" >&2 00:59:44.643 00:16:58.747 19 } 00:59:44.643 00:16:58.747 20 00:59:44.643 00:16:58.747 21 remove_attach_helper() { 00:59:44.643 00:16:58.747 ... 00:59:44.643 00:16:58.747 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:59:44.643 00:16:58.747 ... 00:59:44.643 00:16:58.747 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:59:44.643 00:16:58.748 106 done 00:59:44.643 00:16:58.748 107 00:59:44.643 00:16:58.748 108 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.643 00:16:58.748 109 00:59:44.643 00:16:58.748 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.643 00:16:58.748 111 # Verify reregistering hotplug poller 00:59:44.643 00:16:58.748 112 rpc_cmd bdev_nvme_set_hotplug -d 00:59:44.643 00:16:58.748 113 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.643 00:16:58.748 114 00:59:44.643 00:16:58.748 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.643 00:16:58.748 ... 00:59:44.643 00:16:58.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:59:44.643 00:16:58.748 ... 00:59:44.643 00:16:58.748 133 00:59:44.643 00:16:58.748 134 # Run pci bus hotplug test 00:59:44.643 00:16:58.748 135 run_hotplug 00:59:44.643 00:16:58.748 136 00:59:44.643 00:16:58.748 137 # Run SPDK target based hotplug 00:59:44.643 00:16:58.748 => 138 tgt_run_hotplug 00:59:44.643 00:16:58.748 ... 00:59:44.643 00:16:58.748 00:59:44.643 00:16:58.748 ========== Backtrace end ========== 00:59:44.643 00:16:58.748 ========== Backtrace start: ========== 00:59:44.643 00:16:58.748 00:59:44.643 00:16:58.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:59:44.643 00:16:58.748 ... 00:59:44.643 00:16:58.748 11 # Pci bus hotplug 00:59:44.643 00:16:58.748 12 # Helper function to remove/attach cotrollers 00:59:44.643 00:16:58.748 13 debug_remove_attach_helper() { 00:59:44.643 00:16:58.748 14 local helper_time=0 00:59:44.643 00:16:58.748 15 00:59:44.643 00:16:58.748 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:59:44.643 00:16:58.748 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 00:59:44.643 00:16:58.748 18 "$helper_time" "$nvme_count" >&2 00:59:44.643 00:16:58.748 19 } 00:59:44.643 00:16:58.748 20 00:59:44.643 00:16:58.748 21 remove_attach_helper() { 00:59:44.643 00:16:58.748 ... 00:59:44.643 00:16:58.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:59:44.643 00:16:58.748 ... 00:59:44.643 00:16:58.748 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:59:44.644 00:16:58.748 106 done 00:59:44.644 00:16:58.748 107 00:59:44.644 00:16:58.748 108 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.644 00:16:58.748 109 00:59:44.644 00:16:58.748 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.644 00:16:58.748 111 # Verify reregistering hotplug poller 00:59:44.644 00:16:58.748 112 rpc_cmd bdev_nvme_set_hotplug -d 00:59:44.644 00:16:58.748 113 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.644 00:16:58.748 114 00:59:44.644 00:16:58.748 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.644 00:16:58.748 ... 00:59:44.644 00:16:58.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:59:44.644 00:16:58.748 ... 00:59:44.644 00:16:58.748 133 00:59:44.644 00:16:58.748 134 # Run pci bus hotplug test 00:59:44.644 00:16:58.748 135 run_hotplug 00:59:44.644 00:16:58.748 136 00:59:44.644 00:16:58.748 137 # Run SPDK target based hotplug 00:59:44.644 00:16:58.748 => 138 tgt_run_hotplug 00:59:44.644 00:16:58.748 ... 00:59:44.644 00:16:58.748 00:59:44.644 00:16:58.748 ========== Backtrace end ========== 00:59:44.644 00:17:01.540 ========== Backtrace start: ========== 00:59:44.644 00:17:01.540 00:59:44.644 00:17:01.540 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh"]) 00:59:44.644 00:17:01.540 ... 00:59:44.644 00:17:01.540 1117 timing_enter $test_name 00:59:44.644 00:17:01.540 1118 echo "************************************" 00:59:44.644 00:17:01.540 1119 echo "START TEST $test_name" 00:59:44.644 00:17:01.540 1120 echo "************************************" 00:59:44.644 00:17:01.540 1121 xtrace_restore 00:59:44.644 00:17:01.540 1122 time "$@" 00:59:44.644 00:17:01.540 1123 xtrace_disable 00:59:44.644 00:17:01.540 1124 echo "************************************" 00:59:44.644 00:17:01.540 1125 echo "END TEST $test_name" 00:59:44.644 00:17:01.540 1126 echo "************************************" 00:59:44.644 00:17:01.540 1127 timing_exit $test_name 00:59:44.644 00:17:01.540 ... 00:59:44.644 00:17:01.540 in /home/vagrant/spdk_repo/spdk/autotest.sh:240 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 00:59:44.644 00:17:01.540 ... 00:59:44.644 00:17:01.540 235 00:59:44.644 00:17:01.540 236 run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh 00:59:44.644 00:17:01.540 237 run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh 00:59:44.644 00:17:01.540 238 00:59:44.644 00:17:01.540 239 if [ $(uname -s) = Linux ]; then 00:59:44.644 00:17:01.540 => 240 run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh 00:59:44.644 00:17:01.540 241 fi 00:59:44.644 00:17:01.540 242 00:59:44.644 00:17:01.540 243 if [[ $SPDK_TEST_XNVME -eq 1 ]]; then 00:59:44.644 00:17:01.540 244 run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh 00:59:44.644 00:17:01.540 245 run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme" 00:59:44.644 00:17:01.540 ... 00:59:44.644 00:17:01.540 00:59:44.644 00:17:01.540 ========== Backtrace end ==========' 00:59:44.644 + [[ -n 00:16:58.747 09:08:55 sw_hotplug -- common/autotest_common.sh@715 -- # time='========== Backtrace start: ========== 00:59:44.644 00:16:58.747 00:59:44.644 00:16:58.747 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:59:44.644 00:16:58.747 ... 00:59:44.644 00:16:58.747 710 00:59:44.644 00:16:58.747 711 # We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to 00:59:44.644 00:16:58.747 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 00:59:44.644 00:16:58.747 713 # but $() will return just the time'\''s data, hence making it possible to just do: 00:59:44.644 00:16:58.747 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:59:44.644 00:16:58.747 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:59:44.644 00:16:58.747 716 00:59:44.644 00:16:58.747 717 echo "$time" 00:59:44.644 00:16:58.747 718 ) 00:59:44.644 00:16:58.747 719 00:59:44.644 00:16:58.747 720 function timing_enter() { 00:59:44.644 00:16:58.747 ... 00:59:44.644 00:16:58.747 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:59:44.644 00:16:58.747 ... 00:59:44.644 00:16:58.747 11 # Pci bus hotplug 00:59:44.644 00:16:58.747 12 # Helper function to remove/attach cotrollers 00:59:44.644 00:16:58.747 13 debug_remove_attach_helper() { 00:59:44.644 00:16:58.747 14 local helper_time=0 00:59:44.644 00:16:58.747 15 00:59:44.644 00:16:58.747 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:59:44.644 00:16:58.747 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 00:59:44.644 00:16:58.747 18 "$helper_time" "$nvme_count" >&2 00:59:44.644 00:16:58.747 19 } 00:59:44.644 00:16:58.747 20 00:59:44.644 00:16:58.747 21 remove_attach_helper() { 00:59:44.644 00:16:58.747 ... 00:59:44.644 00:16:58.747 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:59:44.644 00:16:58.747 ... 00:59:44.644 00:16:58.747 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:59:44.644 00:16:58.747 106 done 00:59:44.644 00:16:58.747 107 00:59:44.644 00:16:58.747 108 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.644 00:16:58.747 109 00:59:44.644 00:16:58.747 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.644 00:16:58.747 111 # Verify reregistering hotplug poller 00:59:44.644 00:16:58.747 112 rpc_cmd bdev_nvme_set_hotplug -d 00:59:44.644 00:16:58.747 113 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.644 00:16:58.747 114 00:59:44.644 00:16:58.747 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.644 00:16:58.747 ... 00:59:44.644 00:16:58.747 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:59:44.644 00:16:58.747 ... 00:59:44.644 00:16:58.747 133 00:59:44.644 00:16:58.747 134 # Run pci bus hotplug test 00:59:44.644 00:16:58.747 135 run_hotplug 00:59:44.644 00:16:58.747 136 00:59:44.644 00:16:58.747 137 # Run SPDK target based hotplug 00:59:44.644 00:16:58.747 => 138 tgt_run_hotplug 00:59:44.644 00:16:58.747 ... 00:59:44.644 00:16:58.747 00:59:44.644 00:16:58.747 ========== Backtrace end ==========' 00:59:44.644 00:16:58.747 ========== Backtrace start: ========== 00:59:44.644 00:16:58.747 00:59:44.644 00:16:58.747 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:59:44.644 00:16:58.747 ... 00:59:44.644 00:16:58.747 710 00:59:44.644 00:16:58.747 711 # We redirect cmd's std{out,err} to a separate fd dup'ed to stdin's device (or /dev/null) to 00:59:44.644 00:16:58.747 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 00:59:44.644 00:16:58.747 713 # but $() will return just the time's data, hence making it possible to just do: 00:59:44.644 00:16:58.747 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:59:44.644 00:16:58.747 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:59:44.644 00:16:58.747 716 00:59:44.644 00:16:58.747 717 echo "$time" 00:59:44.644 00:16:58.747 718 ) 00:59:44.644 00:16:58.747 719 00:59:44.644 00:16:58.747 720 function timing_enter() { 00:59:44.644 00:16:58.747 ... 00:59:44.644 00:16:58.747 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:59:44.644 00:16:58.747 ... 00:59:44.644 00:16:58.747 11 # Pci bus hotplug 00:59:44.644 00:16:58.747 12 # Helper function to remove/attach cotrollers 00:59:44.644 00:16:58.747 13 debug_remove_attach_helper() { 00:59:44.644 00:16:58.747 14 local helper_time=0 00:59:44.644 00:16:58.747 15 00:59:44.644 00:16:58.747 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:59:44.644 00:16:58.747 17 printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \ 00:59:44.644 00:16:58.747 18 "$helper_time" "$nvme_count" >&2 00:59:44.644 00:16:58.747 19 } 00:59:44.644 00:16:58.747 20 00:59:44.644 00:16:58.747 21 remove_attach_helper() { 00:59:44.644 00:16:58.747 ... 00:59:44.644 00:16:58.747 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:59:44.644 00:16:58.747 ... 00:59:44.644 00:16:58.747 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:59:44.644 00:16:58.747 106 done 00:59:44.644 00:16:58.747 107 00:59:44.644 00:16:58.747 108 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.644 00:16:58.747 109 00:59:44.644 00:16:58.747 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.644 00:16:58.747 111 # Verify reregistering hotplug poller 00:59:44.644 00:16:58.747 112 rpc_cmd bdev_nvme_set_hotplug -d 00:59:44.644 00:16:58.747 113 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.644 00:16:58.747 114 00:59:44.644 00:16:58.747 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.644 00:16:58.747 ... 00:59:44.644 00:16:58.747 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:59:44.644 00:16:58.747 ... 00:59:44.644 00:16:58.747 133 00:59:44.644 00:16:58.747 134 # Run pci bus hotplug test 00:59:44.644 00:16:58.747 135 run_hotplug 00:59:44.644 00:16:58.747 136 00:59:44.644 00:16:58.747 137 # Run SPDK target based hotplug 00:59:44.644 00:16:58.747 => 138 tgt_run_hotplug 00:59:44.644 00:16:58.747 ... 00:59:44.644 00:16:58.747 00:59:44.644 00:16:58.747 ========== Backtrace end ========== 00:59:44.644 00:16:58.747 ========== Backtrace start: ========== 00:59:44.644 00:16:58.747 00:59:44.644 00:16:58.747 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:59:44.644 00:16:58.747 ... 00:59:44.644 00:16:58.747 713 # but $() will return just the time's data, hence making it possible to just do: 00:59:44.644 00:16:58.747 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:59:44.644 00:16:58.747 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:59:44.644 00:16:58.747 716 00:59:44.644 00:16:58.747 717 echo "$time" 00:59:44.644 00:16:58.747 => 718 ) 00:59:44.644 00:16:58.747 719 00:59:44.644 00:16:58.747 720 function timing_enter() { 00:59:44.644 00:16:58.747 721 xtrace_disable 00:59:44.644 00:16:58.747 722 timing "enter" "$1" 00:59:44.644 00:16:58.747 723 xtrace_restore 00:59:44.644 00:16:58.747 ... 00:59:44.644 00:16:58.747 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:59:44.644 00:16:58.747 ... 00:59:44.644 00:16:58.747 11 # Pci bus hotplug 00:59:44.644 00:16:58.747 12 # Helper function to remove/attach cotrollers 00:59:44.644 00:16:58.747 13 debug_remove_attach_helper() { 00:59:44.644 00:16:58.747 14 local helper_time=0 00:59:44.645 00:16:58.747 15 00:59:44.645 00:16:58.747 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:59:44.645 00:16:58.747 17 printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \ 00:59:44.645 00:16:58.747 18 "$helper_time" "$nvme_count" >&2 00:59:44.645 00:16:58.747 19 } 00:59:44.645 00:16:58.747 20 00:59:44.645 00:16:58.747 21 remove_attach_helper() { 00:59:44.645 00:16:58.747 ... 00:59:44.645 00:16:58.747 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:59:44.645 00:16:58.747 ... 00:59:44.645 00:16:58.747 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:59:44.645 00:16:58.748 106 done 00:59:44.645 00:16:58.748 107 00:59:44.645 00:16:58.748 108 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.645 00:16:58.748 109 00:59:44.645 00:16:58.748 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.645 00:16:58.748 111 # Verify reregistering hotplug poller 00:59:44.645 00:16:58.748 112 rpc_cmd bdev_nvme_set_hotplug -d 00:59:44.645 00:16:58.748 113 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.645 00:16:58.748 114 00:59:44.645 00:16:58.748 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.645 00:16:58.748 ... 00:59:44.645 00:16:58.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:59:44.645 00:16:58.748 ... 00:59:44.645 00:16:58.748 133 00:59:44.645 00:16:58.748 134 # Run pci bus hotplug test 00:59:44.645 00:16:58.748 135 run_hotplug 00:59:44.645 00:16:58.748 136 00:59:44.645 00:16:58.748 137 # Run SPDK target based hotplug 00:59:44.645 00:16:58.748 => 138 tgt_run_hotplug 00:59:44.645 00:16:58.748 ... 00:59:44.645 00:16:58.748 00:59:44.645 00:16:58.748 ========== Backtrace end ========== 00:59:44.645 00:16:58.748 ========== Backtrace start: ========== 00:59:44.645 00:16:58.748 00:59:44.645 00:16:58.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:59:44.645 00:16:58.748 ... 00:59:44.645 00:16:58.748 11 # Pci bus hotplug 00:59:44.645 00:16:58.748 12 # Helper function to remove/attach cotrollers 00:59:44.645 00:16:58.748 13 debug_remove_attach_helper() { 00:59:44.645 00:16:58.748 14 local helper_time=0 00:59:44.645 00:16:58.748 15 00:59:44.645 00:16:58.748 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:59:44.645 00:16:58.748 17 printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \ 00:59:44.645 00:16:58.748 18 "$helper_time" "$nvme_count" >&2 00:59:44.645 00:16:58.748 19 } 00:59:44.645 00:16:58.748 20 00:59:44.645 00:16:58.748 21 remove_attach_helper() { 00:59:44.645 00:16:58.748 ... 00:59:44.645 00:16:58.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:59:44.645 00:16:58.748 ... 00:59:44.645 00:16:58.748 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:59:44.645 00:16:58.748 106 done 00:59:44.645 00:16:58.748 107 00:59:44.645 00:16:58.748 108 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.645 00:16:58.748 109 00:59:44.645 00:16:58.748 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.645 00:16:58.748 111 # Verify reregistering hotplug poller 00:59:44.645 00:16:58.748 112 rpc_cmd bdev_nvme_set_hotplug -d 00:59:44.645 00:16:58.748 113 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.645 00:16:58.748 114 00:59:44.645 00:16:58.748 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.645 00:16:58.748 ... 00:59:44.645 00:16:58.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:59:44.645 00:16:58.748 ... 00:59:44.645 00:16:58.748 133 00:59:44.645 00:16:58.748 134 # Run pci bus hotplug test 00:59:44.645 00:16:58.748 135 run_hotplug 00:59:44.645 00:16:58.748 136 00:59:44.645 00:16:58.748 137 # Run SPDK target based hotplug 00:59:44.645 00:16:58.748 => 138 tgt_run_hotplug 00:59:44.645 00:16:58.748 ... 00:59:44.645 00:16:58.748 00:59:44.645 00:16:58.748 ========== Backtrace end ========== 00:59:44.645 00:17:01.540 ========== Backtrace start: ========== 00:59:44.645 00:17:01.540 00:59:44.645 00:17:01.540 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh"]) 00:59:44.645 00:17:01.540 ... 00:59:44.645 00:17:01.540 1117 timing_enter $test_name 00:59:44.645 00:17:01.540 1118 echo "************************************" 00:59:44.645 00:17:01.540 1119 echo "START TEST $test_name" 00:59:44.645 00:17:01.540 1120 echo "************************************" 00:59:44.645 00:17:01.540 1121 xtrace_restore 00:59:44.645 00:17:01.540 1122 time "$@" 00:59:44.645 00:17:01.540 1123 xtrace_disable 00:59:44.645 00:17:01.540 1124 echo "************************************" 00:59:44.645 00:17:01.540 1125 echo "END TEST $test_name" 00:59:44.645 00:17:01.540 1126 echo "************************************" 00:59:44.645 00:17:01.540 1127 timing_exit $test_name 00:59:44.645 00:17:01.540 ... 00:59:44.645 00:17:01.540 in /home/vagrant/spdk_repo/spdk/autotest.sh:240 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 00:59:44.645 00:17:01.540 ... 00:59:44.645 00:17:01.540 235 00:59:44.645 00:17:01.540 236 run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh 00:59:44.645 00:17:01.540 237 run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh 00:59:44.645 00:17:01.540 238 00:59:44.645 00:17:01.540 239 if [ $(uname -s) = Linux ]; then 00:59:44.645 00:17:01.540 => 240 run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh 00:59:44.645 00:17:01.540 241 fi 00:59:44.645 00:17:01.540 242 00:59:44.645 00:17:01.540 243 if [[ $SPDK_TEST_XNVME -eq 1 ]]; then 00:59:44.645 00:17:01.540 244 run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh 00:59:44.645 00:17:01.540 245 run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme" 00:59:44.645 00:17:01.540 ... 00:59:44.645 00:17:01.540 00:59:44.645 00:17:01.540 ========== Backtrace end ========== ]] 00:59:44.645 + echo '00:16:58.747 09:08:55 sw_hotplug -- common/autotest_common.sh@715 -- # time='\''========== Backtrace start: ========== 00:59:44.645 00:16:58.747 00:59:44.645 00:16:58.747 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:59:44.645 00:16:58.747 ... 00:59:44.645 00:16:58.747 710 00:59:44.645 00:16:58.747 711 # We redirect cmd'\''\'\'''\''s std{out,err} to a separate fd dup'\''\'\'''\''ed to stdin'\''\'\'''\''s device (or /dev/null) to 00:59:44.645 00:16:58.747 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 00:59:44.645 00:16:58.747 713 # but $() will return just the time'\''\'\'''\''s data, hence making it possible to just do: 00:59:44.645 00:16:58.747 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:59:44.645 00:16:58.747 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:59:44.645 00:16:58.747 716 00:59:44.645 00:16:58.747 717 echo "$time" 00:59:44.645 00:16:58.747 718 ) 00:59:44.645 00:16:58.747 719 00:59:44.645 00:16:58.747 720 function timing_enter() { 00:59:44.645 00:16:58.747 ... 00:59:44.645 00:16:58.747 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:59:44.645 00:16:58.747 ... 00:59:44.645 00:16:58.747 11 # Pci bus hotplug 00:59:44.645 00:16:58.747 12 # Helper function to remove/attach cotrollers 00:59:44.645 00:16:58.747 13 debug_remove_attach_helper() { 00:59:44.645 00:16:58.747 14 local helper_time=0 00:59:44.645 00:16:58.747 15 00:59:44.645 00:16:58.747 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:59:44.645 00:16:58.747 17 printf '\''\'\'''\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\''\'\'''\'' \ 00:59:44.645 00:16:58.747 18 "$helper_time" "$nvme_count" >&2 00:59:44.645 00:16:58.747 19 } 00:59:44.645 00:16:58.747 20 00:59:44.645 00:16:58.747 21 remove_attach_helper() { 00:59:44.645 00:16:58.747 ... 00:59:44.645 00:16:58.747 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:59:44.645 00:16:58.747 ... 00:59:44.645 00:16:58.747 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:59:44.645 00:16:58.747 106 done 00:59:44.645 00:16:58.747 107 00:59:44.645 00:16:58.747 108 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.645 00:16:58.747 109 00:59:44.645 00:16:58.747 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.645 00:16:58.747 111 # Verify reregistering hotplug poller 00:59:44.645 00:16:58.747 112 rpc_cmd bdev_nvme_set_hotplug -d 00:59:44.645 00:16:58.747 113 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.645 00:16:58.747 114 00:59:44.645 00:16:58.747 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.645 00:16:58.747 ... 00:59:44.645 00:16:58.747 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:59:44.645 00:16:58.747 ... 00:59:44.645 00:16:58.747 133 00:59:44.645 00:16:58.747 134 # Run pci bus hotplug test 00:59:44.645 00:16:58.747 135 run_hotplug 00:59:44.645 00:16:58.747 136 00:59:44.645 00:16:58.747 137 # Run SPDK target based hotplug 00:59:44.645 00:16:58.747 => 138 tgt_run_hotplug 00:59:44.645 00:16:58.747 ... 00:59:44.645 00:16:58.747 00:59:44.645 00:16:58.747 ========== Backtrace end =========='\'' 00:59:44.645 00:16:58.747 ========== Backtrace start: ========== 00:59:44.645 00:16:58.747 00:59:44.645 00:16:58.747 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:59:44.645 00:16:58.747 ... 00:59:44.645 00:16:58.747 710 00:59:44.645 00:16:58.747 711 # We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to 00:59:44.645 00:16:58.747 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 00:59:44.645 00:16:58.747 713 # but $() will return just the time'\''s data, hence making it possible to just do: 00:59:44.645 00:16:58.747 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:59:44.645 00:16:58.747 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:59:44.645 00:16:58.747 716 00:59:44.645 00:16:58.747 717 echo "$time" 00:59:44.645 00:16:58.747 718 ) 00:59:44.645 00:16:58.747 719 00:59:44.645 00:16:58.747 720 function timing_enter() { 00:59:44.645 00:16:58.747 ... 00:59:44.645 00:16:58.747 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:59:44.645 00:16:58.747 ... 00:59:44.645 00:16:58.747 11 # Pci bus hotplug 00:59:44.645 00:16:58.747 12 # Helper function to remove/attach cotrollers 00:59:44.645 00:16:58.747 13 debug_remove_attach_helper() { 00:59:44.645 00:16:58.747 14 local helper_time=0 00:59:44.645 00:16:58.747 15 00:59:44.645 00:16:58.747 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:59:44.645 00:16:58.747 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 00:59:44.646 00:16:58.747 18 "$helper_time" "$nvme_count" >&2 00:59:44.646 00:16:58.747 19 } 00:59:44.646 00:16:58.747 20 00:59:44.646 00:16:58.747 21 remove_attach_helper() { 00:59:44.646 00:16:58.747 ... 00:59:44.646 00:16:58.747 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:59:44.646 00:16:58.747 ... 00:59:44.646 00:16:58.747 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:59:44.646 00:16:58.747 106 done 00:59:44.646 00:16:58.747 107 00:59:44.646 00:16:58.747 108 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.646 00:16:58.747 109 00:59:44.646 00:16:58.747 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.646 00:16:58.747 111 # Verify reregistering hotplug poller 00:59:44.646 00:16:58.747 112 rpc_cmd bdev_nvme_set_hotplug -d 00:59:44.646 00:16:58.747 113 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.646 00:16:58.747 114 00:59:44.646 00:16:58.747 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.646 00:16:58.747 ... 00:59:44.646 00:16:58.747 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:59:44.646 00:16:58.747 ... 00:59:44.646 00:16:58.747 133 00:59:44.646 00:16:58.747 134 # Run pci bus hotplug test 00:59:44.646 00:16:58.747 135 run_hotplug 00:59:44.646 00:16:58.747 136 00:59:44.646 00:16:58.747 137 # Run SPDK target based hotplug 00:59:44.646 00:16:58.747 => 138 tgt_run_hotplug 00:59:44.646 00:16:58.747 ... 00:59:44.646 00:16:58.747 00:59:44.646 00:16:58.747 ========== Backtrace end ========== 00:59:44.646 00:16:58.747 ========== Backtrace start: ========== 00:59:44.646 00:16:58.747 00:59:44.646 00:16:58.747 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:59:44.646 00:16:58.747 ... 00:59:44.646 00:16:58.747 713 # but $() will return just the time'\''s data, hence making it possible to just do: 00:59:44.646 00:16:58.747 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:59:44.646 00:16:58.747 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:59:44.646 00:16:58.747 716 00:59:44.646 00:16:58.747 717 echo "$time" 00:59:44.646 00:16:58.747 => 718 ) 00:59:44.646 00:16:58.747 719 00:59:44.646 00:16:58.747 720 function timing_enter() { 00:59:44.646 00:16:58.747 721 xtrace_disable 00:59:44.646 00:16:58.747 722 timing "enter" "$1" 00:59:44.646 00:16:58.747 723 xtrace_restore 00:59:44.646 00:16:58.747 ... 00:59:44.646 00:16:58.747 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:59:44.646 00:16:58.747 ... 00:59:44.646 00:16:58.747 11 # Pci bus hotplug 00:59:44.646 00:16:58.747 12 # Helper function to remove/attach cotrollers 00:59:44.646 00:16:58.747 13 debug_remove_attach_helper() { 00:59:44.646 00:16:58.747 14 local helper_time=0 00:59:44.646 00:16:58.747 15 00:59:44.646 00:16:58.747 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:59:44.646 00:16:58.747 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 00:59:44.646 00:16:58.747 18 "$helper_time" "$nvme_count" >&2 00:59:44.646 00:16:58.747 19 } 00:59:44.646 00:16:58.747 20 00:59:44.646 00:16:58.747 21 remove_attach_helper() { 00:59:44.646 00:16:58.747 ... 00:59:44.646 00:16:58.747 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:59:44.646 00:16:58.747 ... 00:59:44.646 00:16:58.747 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:59:44.646 00:16:58.748 106 done 00:59:44.646 00:16:58.748 107 00:59:44.646 00:16:58.748 108 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.646 00:16:58.748 109 00:59:44.646 00:16:58.748 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.646 00:16:58.748 111 # Verify reregistering hotplug poller 00:59:44.646 00:16:58.748 112 rpc_cmd bdev_nvme_set_hotplug -d 00:59:44.646 00:16:58.748 113 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.646 00:16:58.748 114 00:59:44.646 00:16:58.748 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.646 00:16:58.748 ... 00:59:44.646 00:16:58.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:59:44.646 00:16:58.748 ... 00:59:44.646 00:16:58.748 133 00:59:44.646 00:16:58.748 134 # Run pci bus hotplug test 00:59:44.646 00:16:58.748 135 run_hotplug 00:59:44.646 00:16:58.748 136 00:59:44.646 00:16:58.748 137 # Run SPDK target based hotplug 00:59:44.646 00:16:58.748 => 138 tgt_run_hotplug 00:59:44.646 00:16:58.748 ... 00:59:44.646 00:16:58.748 00:59:44.646 00:16:58.748 ========== Backtrace end ========== 00:59:44.646 00:16:58.748 ========== Backtrace start: ========== 00:59:44.646 00:16:58.748 00:59:44.646 00:16:58.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:59:44.646 00:16:58.748 ... 00:59:44.646 00:16:58.748 11 # Pci bus hotplug 00:59:44.646 00:16:58.748 12 # Helper function to remove/attach cotrollers 00:59:44.646 00:16:58.748 13 debug_remove_attach_helper() { 00:59:44.646 00:16:58.748 14 local helper_time=0 00:59:44.646 00:16:58.748 15 00:59:44.646 00:16:58.748 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:59:44.646 00:16:58.748 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 00:59:44.646 00:16:58.748 18 "$helper_time" "$nvme_count" >&2 00:59:44.646 00:16:58.748 19 } 00:59:44.646 00:16:58.748 20 00:59:44.646 00:16:58.748 21 remove_attach_helper() { 00:59:44.646 00:16:58.748 ... 00:59:44.646 00:16:58.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:59:44.646 00:16:58.748 ... 00:59:44.646 00:16:58.748 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:59:44.646 00:16:58.748 106 done 00:59:44.646 00:16:58.748 107 00:59:44.646 00:16:58.748 108 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.646 00:16:58.748 109 00:59:44.646 00:16:58.748 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.646 00:16:58.748 111 # Verify reregistering hotplug poller 00:59:44.646 00:16:58.748 112 rpc_cmd bdev_nvme_set_hotplug -d 00:59:44.646 00:16:58.748 113 rpc_cmd bdev_nvme_set_hotplug -e 00:59:44.646 00:16:58.748 114 00:59:44.646 00:16:58.748 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:59:44.646 00:16:58.748 ... 00:59:44.646 00:16:58.748 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:59:44.646 00:16:58.748 ... 00:59:44.646 00:16:58.748 133 00:59:44.646 00:16:58.748 134 # Run pci bus hotplug test 00:59:44.646 00:16:58.748 135 run_hotplug 00:59:44.646 00:16:58.748 136 00:59:44.646 00:16:58.748 137 # Run SPDK target based hotplug 00:59:44.646 00:16:58.748 => 138 tgt_run_hotplug 00:59:44.646 00:16:58.748 ... 00:59:44.646 00:16:58.748 00:59:44.646 00:16:58.748 ========== Backtrace end ========== 00:59:44.646 00:17:01.540 ========== Backtrace start: ========== 00:59:44.646 00:17:01.540 00:59:44.646 00:17:01.540 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh"]) 00:59:44.646 00:17:01.540 ... 00:59:44.646 00:17:01.540 1117 timing_enter $test_name 00:59:44.646 00:17:01.540 1118 echo "************************************" 00:59:44.646 00:17:01.540 1119 echo "START TEST $test_name" 00:59:44.646 00:17:01.540 1120 echo "************************************" 00:59:44.646 00:17:01.540 1121 xtrace_restore 00:59:44.646 00:17:01.540 1122 time "$@" 00:59:44.646 00:17:01.540 1123 xtrace_disable 00:59:44.646 00:17:01.540 1124 echo "************************************" 00:59:44.646 00:17:01.540 1125 echo "END TEST $test_name" 00:59:44.646 00:17:01.540 1126 echo "************************************" 00:59:44.646 00:17:01.540 1127 timing_exit $test_name 00:59:44.646 00:17:01.540 ... 00:59:44.646 00:17:01.540 in /home/vagrant/spdk_repo/spdk/autotest.sh:240 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 00:59:44.646 00:17:01.540 ... 00:59:44.646 00:17:01.540 235 00:59:44.646 00:17:01.540 236 run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh 00:59:44.646 00:17:01.540 237 run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh 00:59:44.646 00:17:01.540 238 00:59:44.646 00:17:01.540 239 if [ $(uname -s) = Linux ]; then 00:59:44.646 00:17:01.540 => 240 run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh 00:59:44.646 00:17:01.540 241 fi 00:59:44.646 00:17:01.540 242 00:59:44.646 00:17:01.540 243 if [[ $SPDK_TEST_XNVME -eq 1 ]]; then 00:59:44.646 00:17:01.540 244 run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh 00:59:44.646 00:17:01.540 245 run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme" 00:59:44.646 00:17:01.540 ... 00:59:44.646 00:17:01.540 00:59:44.646 00:17:01.540 ========== Backtrace end ==========' 00:59:44.646 + for build in "${build_log_list[@]}" 00:59:44.646 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/unittest-valgrind-docker-autotest_19871/build.log 00:59:44.646 + local build_log job_name start_pattern end_pattern backtraces 00:59:44.646 + build_log=/var/jenkins/workspace/autotest-per-patch_5/unittest-valgrind-docker-autotest_19871/build.log 00:59:44.646 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/unittest-valgrind-docker-autotest_19871/build.log 00:59:44.646 ++ basename /var/jenkins/workspace/autotest-per-patch_5/unittest-valgrind-docker-autotest_19871 00:59:44.646 + job_name=unittest-valgrind-docker-autotest_19871 00:59:44.646 + start_pattern='Backtrace start' 00:59:44.646 + end_pattern='Backtrace end' 00:59:44.646 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/unittest-valgrind-docker-autotest_19871/build.log ]] 00:59:44.646 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/unittest-valgrind-docker-autotest_19871/build.log 00:59:44.646 + backtraces= 00:59:44.646 + [[ -n '' ]] 00:59:44.646 + for build in "${build_log_list[@]}" 00:59:44.646 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-vg-autotest_77476/build.log 00:59:44.646 + local build_log job_name start_pattern end_pattern backtraces 00:59:44.646 + build_log=/var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-vg-autotest_77476/build.log 00:59:44.646 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-vg-autotest_77476/build.log 00:59:44.646 ++ basename /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-vg-autotest_77476 00:59:44.646 + job_name=nvmf-tcp-vg-autotest_77476 00:59:44.646 + start_pattern='Backtrace start' 00:59:44.646 + end_pattern='Backtrace end' 00:59:44.646 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-vg-autotest_77476/build.log ]] 00:59:44.646 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-vg-autotest_77476/build.log 00:59:44.646 + backtraces= 00:59:44.646 + [[ -n '' ]] 00:59:44.646 + for build in "${build_log_list[@]}" 00:59:44.647 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/lvol-vg-autotest_77434/build.log 00:59:44.647 + local build_log job_name start_pattern end_pattern backtraces 00:59:44.647 + build_log=/var/jenkins/workspace/autotest-per-patch_5/lvol-vg-autotest_77434/build.log 00:59:44.647 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/lvol-vg-autotest_77434/build.log 00:59:44.647 ++ basename /var/jenkins/workspace/autotest-per-patch_5/lvol-vg-autotest_77434 00:59:44.647 + job_name=lvol-vg-autotest_77434 00:59:44.647 + start_pattern='Backtrace start' 00:59:44.647 + end_pattern='Backtrace end' 00:59:44.647 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/lvol-vg-autotest_77434/build.log ]] 00:59:44.647 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/lvol-vg-autotest_77434/build.log 00:59:44.647 + backtraces= 00:59:44.647 + [[ -n '' ]] 00:59:44.647 + for build in "${build_log_list[@]}" 00:59:44.647 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/BlobFS-phy-autotest_26211/build.log 00:59:44.647 + local build_log job_name start_pattern end_pattern backtraces 00:59:44.647 + build_log=/var/jenkins/workspace/autotest-per-patch_5/BlobFS-phy-autotest_26211/build.log 00:59:44.647 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/BlobFS-phy-autotest_26211/build.log 00:59:44.647 ++ basename /var/jenkins/workspace/autotest-per-patch_5/BlobFS-phy-autotest_26211 00:59:44.647 + job_name=BlobFS-phy-autotest_26211 00:59:44.647 + start_pattern='Backtrace start' 00:59:44.647 + end_pattern='Backtrace end' 00:59:44.647 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/BlobFS-phy-autotest_26211/build.log ]] 00:59:44.647 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/BlobFS-phy-autotest_26211/build.log 00:59:44.647 + backtraces= 00:59:44.647 + [[ -n '' ]] 00:59:44.647 + for build in "${build_log_list[@]}" 00:59:44.647 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/iscsi-vg-autotest_77523/build.log 00:59:44.647 + local build_log job_name start_pattern end_pattern backtraces 00:59:44.647 + build_log=/var/jenkins/workspace/autotest-per-patch_5/iscsi-vg-autotest_77523/build.log 00:59:44.647 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/iscsi-vg-autotest_77523/build.log 00:59:44.647 ++ basename /var/jenkins/workspace/autotest-per-patch_5/iscsi-vg-autotest_77523 00:59:44.647 + job_name=iscsi-vg-autotest_77523 00:59:44.647 + start_pattern='Backtrace start' 00:59:44.647 + end_pattern='Backtrace end' 00:59:44.647 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/iscsi-vg-autotest_77523/build.log ]] 00:59:44.647 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/iscsi-vg-autotest_77523/build.log 00:59:44.647 + backtraces= 00:59:44.647 + [[ -n '' ]] 00:59:44.647 + for build in "${build_log_list[@]}" 00:59:44.647 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/nvme-cmb-pmr-vg-autotest_78608/build.log 00:59:44.647 + local build_log job_name start_pattern end_pattern backtraces 00:59:44.647 + build_log=/var/jenkins/workspace/autotest-per-patch_5/nvme-cmb-pmr-vg-autotest_78608/build.log 00:59:44.647 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/nvme-cmb-pmr-vg-autotest_78608/build.log 00:59:44.647 ++ basename /var/jenkins/workspace/autotest-per-patch_5/nvme-cmb-pmr-vg-autotest_78608 00:59:44.647 + job_name=nvme-cmb-pmr-vg-autotest_78608 00:59:44.647 + start_pattern='Backtrace start' 00:59:44.647 + end_pattern='Backtrace end' 00:59:44.647 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/nvme-cmb-pmr-vg-autotest_78608/build.log ]] 00:59:44.647 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/nvme-cmb-pmr-vg-autotest_78608/build.log 00:59:44.647 + backtraces= 00:59:44.647 + [[ -n '' ]] 00:59:44.647 + for build in "${build_log_list[@]}" 00:59:44.647 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/build-files-docker-autotest_22139/build.log 00:59:44.647 + local build_log job_name start_pattern end_pattern backtraces 00:59:44.647 + build_log=/var/jenkins/workspace/autotest-per-patch_5/build-files-docker-autotest_22139/build.log 00:59:44.647 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/build-files-docker-autotest_22139/build.log 00:59:44.647 ++ basename /var/jenkins/workspace/autotest-per-patch_5/build-files-docker-autotest_22139 00:59:44.647 + job_name=build-files-docker-autotest_22139 00:59:44.647 + start_pattern='Backtrace start' 00:59:44.647 + end_pattern='Backtrace end' 00:59:44.647 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/build-files-docker-autotest_22139/build.log ]] 00:59:44.647 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/build-files-docker-autotest_22139/build.log 00:59:44.647 + backtraces= 00:59:44.647 + [[ -n '' ]] 00:59:44.647 + for build in "${build_log_list[@]}" 00:59:44.647 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/ubuntu22-vg-autotest_37818/build.log 00:59:44.647 + local build_log job_name start_pattern end_pattern backtraces 00:59:44.647 + build_log=/var/jenkins/workspace/autotest-per-patch_5/ubuntu22-vg-autotest_37818/build.log 00:59:44.647 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/ubuntu22-vg-autotest_37818/build.log 00:59:44.647 ++ basename /var/jenkins/workspace/autotest-per-patch_5/ubuntu22-vg-autotest_37818 00:59:44.647 + job_name=ubuntu22-vg-autotest_37818 00:59:44.647 + start_pattern='Backtrace start' 00:59:44.647 + end_pattern='Backtrace end' 00:59:44.647 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/ubuntu22-vg-autotest_37818/build.log ]] 00:59:44.647 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/ubuntu22-vg-autotest_37818/build.log 00:59:44.647 + backtraces= 00:59:44.647 + [[ -n '' ]] 00:59:44.647 + for build in "${build_log_list[@]}" 00:59:44.647 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/check-format-docker-autotest_22150/build.log 00:59:44.647 + local build_log job_name start_pattern end_pattern backtraces 00:59:44.647 + build_log=/var/jenkins/workspace/autotest-per-patch_5/check-format-docker-autotest_22150/build.log 00:59:44.647 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/check-format-docker-autotest_22150/build.log 00:59:44.647 ++ basename /var/jenkins/workspace/autotest-per-patch_5/check-format-docker-autotest_22150 00:59:44.647 + job_name=check-format-docker-autotest_22150 00:59:44.647 + start_pattern='Backtrace start' 00:59:44.647 + end_pattern='Backtrace end' 00:59:44.647 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/check-format-docker-autotest_22150/build.log ]] 00:59:44.647 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/check-format-docker-autotest_22150/build.log 00:59:44.647 + backtraces= 00:59:44.647 + [[ -n '' ]] 00:59:44.647 + for build in "${build_log_list[@]}" 00:59:44.647 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/freebsd-vg-autotest_59130/build.log 00:59:44.647 + local build_log job_name start_pattern end_pattern backtraces 00:59:44.647 + build_log=/var/jenkins/workspace/autotest-per-patch_5/freebsd-vg-autotest_59130/build.log 00:59:44.647 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/freebsd-vg-autotest_59130/build.log 00:59:44.647 ++ basename /var/jenkins/workspace/autotest-per-patch_5/freebsd-vg-autotest_59130 00:59:44.647 + job_name=freebsd-vg-autotest_59130 00:59:44.647 + start_pattern='Backtrace start' 00:59:44.647 + end_pattern='Backtrace end' 00:59:44.647 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/freebsd-vg-autotest_59130/build.log ]] 00:59:44.647 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/freebsd-vg-autotest_59130/build.log 00:59:44.647 + backtraces= 00:59:44.647 + [[ -n '' ]] 00:59:44.647 + for build in "${build_log_list[@]}" 00:59:44.647 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/nvmf-phy-autotest_72449/build.log 00:59:44.647 + local build_log job_name start_pattern end_pattern backtraces 00:59:44.647 + build_log=/var/jenkins/workspace/autotest-per-patch_5/nvmf-phy-autotest_72449/build.log 00:59:44.647 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/nvmf-phy-autotest_72449/build.log 00:59:44.647 ++ basename /var/jenkins/workspace/autotest-per-patch_5/nvmf-phy-autotest_72449 00:59:44.647 + job_name=nvmf-phy-autotest_72449 00:59:44.647 + start_pattern='Backtrace start' 00:59:44.647 + end_pattern='Backtrace end' 00:59:44.647 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/nvmf-phy-autotest_72449/build.log ]] 00:59:44.647 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/nvmf-phy-autotest_72449/build.log 00:59:44.647 + backtraces='00:19:28.255 ========== Backtrace start: ========== 00:59:44.647 00:19:28.255 00:59:44.647 00:19:28.255 in test/nvmf/target/device_removal.sh:116 -> stop_bdevperf([]) 00:59:44.647 00:19:28.255 ... 00:59:44.647 00:19:28.255 111 00:59:44.647 00:19:28.255 112 sleep 5 00:59:44.647 00:19:28.255 113 } 00:59:44.647 00:19:28.255 114 00:59:44.647 00:19:28.255 115 function stop_bdevperf() { 00:59:44.647 00:19:28.255 => 116 wait $bdevperf_rpc_pid 00:59:44.647 00:19:28.255 117 00:59:44.647 00:19:28.255 118 killprocess $bdevperf_pid 00:59:44.647 00:19:28.255 119 bdevperf_pid= 00:59:44.647 00:19:28.255 120 00:59:44.647 00:19:28.255 121 cat $testdir/try.txt 00:59:44.647 00:19:28.255 ... 00:59:44.647 00:19:28.255 in test/nvmf/target/device_removal.sh:200 -> test_remove_and_rescan([]) 00:59:44.647 00:19:28.255 ... 00:59:44.647 00:19:28.255 195 fi 00:59:44.647 00:19:28.255 196 sleep 2 00:59:44.647 00:19:28.255 197 done 00:59:44.648 00:19:28.255 198 done 00:59:44.648 00:19:28.255 199 00:59:44.648 00:19:28.255 => 200 stop_bdevperf 00:59:44.648 00:19:28.255 201 00:59:44.648 00:19:28.256 202 killprocess $nvmfpid 00:59:44.648 00:19:28.256 203 nvmfpid= 00:59:44.648 00:19:28.256 204 00:59:44.648 00:19:28.256 205 return 0 00:59:44.648 00:19:28.256 ... 00:59:44.648 00:19:28.256 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:1122 -> run_test(["nvmf_device_removal_pci_remove"],["test_remove_and_rescan"]) 00:59:44.648 00:19:28.256 ... 00:59:44.648 00:19:28.256 1117 timing_enter $test_name 00:59:44.648 00:19:28.256 1118 echo "************************************" 00:59:44.648 00:19:28.256 1119 echo "START TEST $test_name" 00:59:44.648 00:19:28.256 1120 echo "************************************" 00:59:44.648 00:19:28.256 1121 xtrace_restore 00:59:44.648 00:19:28.256 1122 time "$@" 00:59:44.648 00:19:28.256 1123 xtrace_disable 00:59:44.648 00:19:28.256 1124 echo "************************************" 00:59:44.648 00:19:28.256 1125 echo "END TEST $test_name" 00:59:44.648 00:19:28.256 1126 echo "************************************" 00:59:44.648 00:19:28.256 1127 timing_exit $test_name 00:59:44.648 00:19:28.256 ... 00:59:44.648 00:19:28.256 in test/nvmf/target/device_removal.sh:312 -> main(["--transport=rdma"]) 00:59:44.648 00:19:28.256 ... 00:59:44.648 00:19:28.256 307 fi 00:59:44.648 00:19:28.256 308 test_bonding_slaves_on_nics "${target_nics[@]}" 00:59:44.648 00:19:28.256 309 } 00:59:44.648 00:19:28.256 310 00:59:44.648 00:19:28.256 311 run_test "nvmf_device_removal_pci_remove_no_srq" test_remove_and_rescan --no-srq 00:59:44.648 00:19:28.256 => 312 run_test "nvmf_device_removal_pci_remove" test_remove_and_rescan 00:59:44.648 00:19:28.256 313 # bond slaves case needs lag_master & vport_manager are enabled by mlxconfig 00:59:44.648 00:19:28.256 314 # and not work on CI machine currently. 00:59:44.648 00:19:28.256 315 # run_test "nvmf_device_removal_bond_slaves" test_bond_slaves 00:59:44.648 00:19:28.256 316 00:59:44.648 00:19:28.256 317 nvmftestfini 00:59:44.648 00:19:28.256 ... 00:59:44.648 00:19:28.256 00:59:44.648 00:19:28.256 ========== Backtrace end ========== 00:59:44.648 00:19:28.266 ========== Backtrace start: ========== 00:59:44.648 00:19:28.266 00:59:44.648 00:19:28.266 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:1122 -> run_test(["nvmf_device_removal"],["test/nvmf/target/device_removal.sh"],["--transport=rdma"]) 00:59:44.648 00:19:28.266 ... 00:59:44.648 00:19:28.266 1117 timing_enter $test_name 00:59:44.648 00:19:28.266 1118 echo "************************************" 00:59:44.648 00:19:28.266 1119 echo "START TEST $test_name" 00:59:44.648 00:19:28.266 1120 echo "************************************" 00:59:44.648 00:19:28.266 1121 xtrace_restore 00:59:44.648 00:19:28.266 1122 time "$@" 00:59:44.648 00:19:28.266 1123 xtrace_disable 00:59:44.648 00:19:28.266 1124 echo "************************************" 00:59:44.648 00:19:28.266 1125 echo "END TEST $test_name" 00:59:44.648 00:19:28.266 1126 echo "************************************" 00:59:44.648 00:19:28.266 1127 timing_exit $test_name 00:59:44.648 00:19:28.266 ... 00:59:44.648 00:19:28.266 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh:79 -> main(["--transport=rdma"]) 00:59:44.648 00:19:28.266 ... 00:59:44.648 00:19:28.266 74 TCP_INTERFACE_LIST=("${net_devs[@]}") 00:59:44.648 00:19:28.266 75 if ((${#TCP_INTERFACE_LIST[@]} > 0)); then 00:59:44.648 00:19:28.266 76 run_test "nvmf_perf_adq" $rootdir/test/nvmf/target/perf_adq.sh "${TEST_ARGS[@]}" 00:59:44.648 00:19:28.266 77 fi 00:59:44.648 00:19:28.266 78 elif [[ $SPDK_TEST_NVMF_TRANSPORT == "rdma" ]]; then 00:59:44.648 00:19:28.266 => 79 run_test "nvmf_device_removal" test/nvmf/target/device_removal.sh "${TEST_ARGS[@]}" 00:59:44.648 00:19:28.266 80 run_test "nvmf_srq_overwhelm" "$rootdir/test/nvmf/target/srq_overwhelm.sh" "${TEST_ARGS[@]}" 00:59:44.648 00:19:28.266 81 fi 00:59:44.648 00:19:28.266 82 run_test "nvmf_shutdown" $rootdir/test/nvmf/target/shutdown.sh "${TEST_ARGS[@]}" 00:59:44.648 00:19:28.266 83 fi 00:59:44.648 00:19:28.266 84 00:59:44.648 00:19:28.266 ... 00:59:44.648 00:19:28.266 00:59:44.648 00:19:28.266 ========== Backtrace end ========== 00:59:44.648 00:19:28.266 ========== Backtrace start: ========== 00:59:44.648 00:19:28.266 00:59:44.648 00:19:28.266 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:1122 -> run_test(["nvmf_rdma"],["/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh"],["--transport=rdma"]) 00:59:44.648 00:19:28.266 ... 00:59:44.648 00:19:28.266 1117 timing_enter $test_name 00:59:44.648 00:19:28.266 1118 echo "************************************" 00:59:44.648 00:19:28.266 1119 echo "START TEST $test_name" 00:59:44.648 00:19:28.266 1120 echo "************************************" 00:59:44.648 00:19:28.266 1121 xtrace_restore 00:59:44.648 00:19:28.266 1122 time "$@" 00:59:44.648 00:19:28.266 1123 xtrace_disable 00:59:44.648 00:19:28.266 1124 echo "************************************" 00:59:44.648 00:19:28.266 1125 echo "END TEST $test_name" 00:59:44.648 00:19:28.266 1126 echo "************************************" 00:59:44.648 00:19:28.266 1127 timing_exit $test_name 00:59:44.648 00:19:28.266 ... 00:59:44.648 00:19:28.266 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/autotest.sh:280 -> main(["/var/jenkins/workspace/nvmf-phy-autotest/autorun-spdk.conf"]) 00:59:44.648 00:19:28.266 ... 00:59:44.648 00:19:28.266 275 if [ $SPDK_TEST_NVMF -eq 1 ]; then 00:59:44.648 00:19:28.266 276 export NET_TYPE 00:59:44.648 00:19:28.266 277 # The NVMe-oF run test cases are split out like this so that the parser that compiles the 00:59:44.648 00:19:28.266 278 # list of all tests can properly differentiate them. Please do not merge them into one line. 00:59:44.648 00:19:28.266 279 if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then 00:59:44.648 00:19:28.266 => 280 run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:59:44.648 00:19:28.267 281 run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:59:44.648 00:19:28.267 282 elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then 00:59:44.648 00:19:28.267 283 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:59:44.648 00:19:28.267 284 if [[ $SPDK_TEST_URING -eq 0 ]]; then 00:59:44.648 00:19:28.267 285 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:59:44.648 00:19:28.267 ... 00:59:44.648 00:19:28.267 00:59:44.648 00:19:28.267 ========== Backtrace end ==========' 00:59:44.648 + [[ -n 00:19:28.255 ========== Backtrace start: ========== 00:59:44.648 00:19:28.255 00:59:44.648 00:19:28.255 in test/nvmf/target/device_removal.sh:116 -> stop_bdevperf([]) 00:59:44.648 00:19:28.255 ... 00:59:44.648 00:19:28.255 111 00:59:44.648 00:19:28.255 112 sleep 5 00:59:44.648 00:19:28.255 113 } 00:59:44.648 00:19:28.255 114 00:59:44.648 00:19:28.255 115 function stop_bdevperf() { 00:59:44.648 00:19:28.255 => 116 wait $bdevperf_rpc_pid 00:59:44.648 00:19:28.255 117 00:59:44.648 00:19:28.255 118 killprocess $bdevperf_pid 00:59:44.648 00:19:28.255 119 bdevperf_pid= 00:59:44.648 00:19:28.255 120 00:59:44.648 00:19:28.255 121 cat $testdir/try.txt 00:59:44.648 00:19:28.255 ... 00:59:44.648 00:19:28.255 in test/nvmf/target/device_removal.sh:200 -> test_remove_and_rescan([]) 00:59:44.648 00:19:28.255 ... 00:59:44.648 00:19:28.255 195 fi 00:59:44.648 00:19:28.255 196 sleep 2 00:59:44.648 00:19:28.255 197 done 00:59:44.648 00:19:28.255 198 done 00:59:44.648 00:19:28.255 199 00:59:44.648 00:19:28.255 => 200 stop_bdevperf 00:59:44.648 00:19:28.255 201 00:59:44.648 00:19:28.256 202 killprocess $nvmfpid 00:59:44.648 00:19:28.256 203 nvmfpid= 00:59:44.648 00:19:28.256 204 00:59:44.648 00:19:28.256 205 return 0 00:59:44.648 00:19:28.256 ... 00:59:44.648 00:19:28.256 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:1122 -> run_test(["nvmf_device_removal_pci_remove"],["test_remove_and_rescan"]) 00:59:44.648 00:19:28.256 ... 00:59:44.648 00:19:28.256 1117 timing_enter $test_name 00:59:44.648 00:19:28.256 1118 echo "************************************" 00:59:44.648 00:19:28.256 1119 echo "START TEST $test_name" 00:59:44.648 00:19:28.256 1120 echo "************************************" 00:59:44.648 00:19:28.256 1121 xtrace_restore 00:59:44.648 00:19:28.256 1122 time "$@" 00:59:44.648 00:19:28.256 1123 xtrace_disable 00:59:44.648 00:19:28.256 1124 echo "************************************" 00:59:44.648 00:19:28.256 1125 echo "END TEST $test_name" 00:59:44.648 00:19:28.256 1126 echo "************************************" 00:59:44.648 00:19:28.256 1127 timing_exit $test_name 00:59:44.648 00:19:28.256 ... 00:59:44.648 00:19:28.256 in test/nvmf/target/device_removal.sh:312 -> main(["--transport=rdma"]) 00:59:44.648 00:19:28.256 ... 00:59:44.648 00:19:28.256 307 fi 00:59:44.648 00:19:28.256 308 test_bonding_slaves_on_nics "${target_nics[@]}" 00:59:44.648 00:19:28.256 309 } 00:59:44.648 00:19:28.256 310 00:59:44.648 00:19:28.256 311 run_test "nvmf_device_removal_pci_remove_no_srq" test_remove_and_rescan --no-srq 00:59:44.648 00:19:28.256 => 312 run_test "nvmf_device_removal_pci_remove" test_remove_and_rescan 00:59:44.648 00:19:28.256 313 # bond slaves case needs lag_master & vport_manager are enabled by mlxconfig 00:59:44.648 00:19:28.256 314 # and not work on CI machine currently. 00:59:44.648 00:19:28.256 315 # run_test "nvmf_device_removal_bond_slaves" test_bond_slaves 00:59:44.648 00:19:28.256 316 00:59:44.648 00:19:28.256 317 nvmftestfini 00:59:44.648 00:19:28.256 ... 00:59:44.648 00:19:28.256 00:59:44.648 00:19:28.256 ========== Backtrace end ========== 00:59:44.648 00:19:28.266 ========== Backtrace start: ========== 00:59:44.648 00:19:28.266 00:59:44.648 00:19:28.266 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:1122 -> run_test(["nvmf_device_removal"],["test/nvmf/target/device_removal.sh"],["--transport=rdma"]) 00:59:44.648 00:19:28.266 ... 00:59:44.648 00:19:28.266 1117 timing_enter $test_name 00:59:44.648 00:19:28.266 1118 echo "************************************" 00:59:44.648 00:19:28.266 1119 echo "START TEST $test_name" 00:59:44.648 00:19:28.266 1120 echo "************************************" 00:59:44.648 00:19:28.266 1121 xtrace_restore 00:59:44.648 00:19:28.266 1122 time "$@" 00:59:44.648 00:19:28.266 1123 xtrace_disable 00:59:44.648 00:19:28.266 1124 echo "************************************" 00:59:44.648 00:19:28.266 1125 echo "END TEST $test_name" 00:59:44.648 00:19:28.266 1126 echo "************************************" 00:59:44.648 00:19:28.266 1127 timing_exit $test_name 00:59:44.648 00:19:28.266 ... 00:59:44.648 00:19:28.266 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh:79 -> main(["--transport=rdma"]) 00:59:44.648 00:19:28.266 ... 00:59:44.648 00:19:28.266 74 TCP_INTERFACE_LIST=("${net_devs[@]}") 00:59:44.649 00:19:28.266 75 if ((${#TCP_INTERFACE_LIST[@]} > 0)); then 00:59:44.649 00:19:28.266 76 run_test "nvmf_perf_adq" $rootdir/test/nvmf/target/perf_adq.sh "${TEST_ARGS[@]}" 00:59:44.649 00:19:28.266 77 fi 00:59:44.649 00:19:28.266 78 elif [[ $SPDK_TEST_NVMF_TRANSPORT == "rdma" ]]; then 00:59:44.649 00:19:28.266 => 79 run_test "nvmf_device_removal" test/nvmf/target/device_removal.sh "${TEST_ARGS[@]}" 00:59:44.649 00:19:28.266 80 run_test "nvmf_srq_overwhelm" "$rootdir/test/nvmf/target/srq_overwhelm.sh" "${TEST_ARGS[@]}" 00:59:44.649 00:19:28.266 81 fi 00:59:44.649 00:19:28.266 82 run_test "nvmf_shutdown" $rootdir/test/nvmf/target/shutdown.sh "${TEST_ARGS[@]}" 00:59:44.649 00:19:28.266 83 fi 00:59:44.649 00:19:28.266 84 00:59:44.649 00:19:28.266 ... 00:59:44.649 00:19:28.266 00:59:44.649 00:19:28.266 ========== Backtrace end ========== 00:59:44.649 00:19:28.266 ========== Backtrace start: ========== 00:59:44.649 00:19:28.266 00:59:44.649 00:19:28.266 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:1122 -> run_test(["nvmf_rdma"],["/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh"],["--transport=rdma"]) 00:59:44.649 00:19:28.266 ... 00:59:44.649 00:19:28.266 1117 timing_enter $test_name 00:59:44.649 00:19:28.266 1118 echo "************************************" 00:59:44.649 00:19:28.266 1119 echo "START TEST $test_name" 00:59:44.649 00:19:28.266 1120 echo "************************************" 00:59:44.649 00:19:28.266 1121 xtrace_restore 00:59:44.649 00:19:28.266 1122 time "$@" 00:59:44.649 00:19:28.266 1123 xtrace_disable 00:59:44.649 00:19:28.266 1124 echo "************************************" 00:59:44.649 00:19:28.266 1125 echo "END TEST $test_name" 00:59:44.649 00:19:28.266 1126 echo "************************************" 00:59:44.649 00:19:28.266 1127 timing_exit $test_name 00:59:44.649 00:19:28.266 ... 00:59:44.649 00:19:28.266 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/autotest.sh:280 -> main(["/var/jenkins/workspace/nvmf-phy-autotest/autorun-spdk.conf"]) 00:59:44.649 00:19:28.266 ... 00:59:44.649 00:19:28.266 275 if [ $SPDK_TEST_NVMF -eq 1 ]; then 00:59:44.649 00:19:28.266 276 export NET_TYPE 00:59:44.649 00:19:28.266 277 # The NVMe-oF run test cases are split out like this so that the parser that compiles the 00:59:44.649 00:19:28.266 278 # list of all tests can properly differentiate them. Please do not merge them into one line. 00:59:44.649 00:19:28.266 279 if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then 00:59:44.649 00:19:28.266 => 280 run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:59:44.649 00:19:28.267 281 run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:59:44.649 00:19:28.267 282 elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then 00:59:44.649 00:19:28.267 283 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:59:44.649 00:19:28.267 284 if [[ $SPDK_TEST_URING -eq 0 ]]; then 00:59:44.649 00:19:28.267 285 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:59:44.649 00:19:28.267 ... 00:59:44.649 00:19:28.267 00:59:44.649 00:19:28.267 ========== Backtrace end ========== ]] 00:59:44.649 + echo '00:19:28.255 ========== Backtrace start: ========== 00:59:44.649 00:19:28.255 00:59:44.649 00:19:28.255 in test/nvmf/target/device_removal.sh:116 -> stop_bdevperf([]) 00:59:44.649 00:19:28.255 ... 00:59:44.649 00:19:28.255 111 00:59:44.649 00:19:28.255 112 sleep 5 00:59:44.649 00:19:28.255 113 } 00:59:44.649 00:19:28.255 114 00:59:44.649 00:19:28.255 115 function stop_bdevperf() { 00:59:44.649 00:19:28.255 => 116 wait $bdevperf_rpc_pid 00:59:44.649 00:19:28.255 117 00:59:44.649 00:19:28.255 118 killprocess $bdevperf_pid 00:59:44.649 00:19:28.255 119 bdevperf_pid= 00:59:44.649 00:19:28.255 120 00:59:44.649 00:19:28.255 121 cat $testdir/try.txt 00:59:44.649 00:19:28.255 ... 00:59:44.649 00:19:28.255 in test/nvmf/target/device_removal.sh:200 -> test_remove_and_rescan([]) 00:59:44.649 00:19:28.255 ... 00:59:44.649 00:19:28.255 195 fi 00:59:44.649 00:19:28.255 196 sleep 2 00:59:44.649 00:19:28.255 197 done 00:59:44.649 00:19:28.255 198 done 00:59:44.649 00:19:28.255 199 00:59:44.649 00:19:28.255 => 200 stop_bdevperf 00:59:44.649 00:19:28.255 201 00:59:44.649 00:19:28.256 202 killprocess $nvmfpid 00:59:44.649 00:19:28.256 203 nvmfpid= 00:59:44.649 00:19:28.256 204 00:59:44.649 00:19:28.256 205 return 0 00:59:44.649 00:19:28.256 ... 00:59:44.649 00:19:28.256 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:1122 -> run_test(["nvmf_device_removal_pci_remove"],["test_remove_and_rescan"]) 00:59:44.649 00:19:28.256 ... 00:59:44.649 00:19:28.256 1117 timing_enter $test_name 00:59:44.649 00:19:28.256 1118 echo "************************************" 00:59:44.649 00:19:28.256 1119 echo "START TEST $test_name" 00:59:44.649 00:19:28.256 1120 echo "************************************" 00:59:44.649 00:19:28.256 1121 xtrace_restore 00:59:44.649 00:19:28.256 1122 time "$@" 00:59:44.649 00:19:28.256 1123 xtrace_disable 00:59:44.649 00:19:28.256 1124 echo "************************************" 00:59:44.649 00:19:28.256 1125 echo "END TEST $test_name" 00:59:44.649 00:19:28.256 1126 echo "************************************" 00:59:44.649 00:19:28.256 1127 timing_exit $test_name 00:59:44.649 00:19:28.256 ... 00:59:44.649 00:19:28.256 in test/nvmf/target/device_removal.sh:312 -> main(["--transport=rdma"]) 00:59:44.649 00:19:28.256 ... 00:59:44.649 00:19:28.256 307 fi 00:59:44.649 00:19:28.256 308 test_bonding_slaves_on_nics "${target_nics[@]}" 00:59:44.649 00:19:28.256 309 } 00:59:44.649 00:19:28.256 310 00:59:44.649 00:19:28.256 311 run_test "nvmf_device_removal_pci_remove_no_srq" test_remove_and_rescan --no-srq 00:59:44.649 00:19:28.256 => 312 run_test "nvmf_device_removal_pci_remove" test_remove_and_rescan 00:59:44.649 00:19:28.256 313 # bond slaves case needs lag_master & vport_manager are enabled by mlxconfig 00:59:44.649 00:19:28.256 314 # and not work on CI machine currently. 00:59:44.649 00:19:28.256 315 # run_test "nvmf_device_removal_bond_slaves" test_bond_slaves 00:59:44.649 00:19:28.256 316 00:59:44.649 00:19:28.256 317 nvmftestfini 00:59:44.649 00:19:28.256 ... 00:59:44.649 00:19:28.256 00:59:44.649 00:19:28.256 ========== Backtrace end ========== 00:59:44.649 00:19:28.266 ========== Backtrace start: ========== 00:59:44.649 00:19:28.266 00:59:44.649 00:19:28.266 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:1122 -> run_test(["nvmf_device_removal"],["test/nvmf/target/device_removal.sh"],["--transport=rdma"]) 00:59:44.649 00:19:28.266 ... 00:59:44.649 00:19:28.266 1117 timing_enter $test_name 00:59:44.649 00:19:28.266 1118 echo "************************************" 00:59:44.649 00:19:28.266 1119 echo "START TEST $test_name" 00:59:44.649 00:19:28.266 1120 echo "************************************" 00:59:44.649 00:19:28.266 1121 xtrace_restore 00:59:44.649 00:19:28.266 1122 time "$@" 00:59:44.649 00:19:28.266 1123 xtrace_disable 00:59:44.649 00:19:28.266 1124 echo "************************************" 00:59:44.649 00:19:28.266 1125 echo "END TEST $test_name" 00:59:44.649 00:19:28.266 1126 echo "************************************" 00:59:44.649 00:19:28.266 1127 timing_exit $test_name 00:59:44.649 00:19:28.266 ... 00:59:44.649 00:19:28.266 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh:79 -> main(["--transport=rdma"]) 00:59:44.649 00:19:28.266 ... 00:59:44.649 00:19:28.266 74 TCP_INTERFACE_LIST=("${net_devs[@]}") 00:59:44.649 00:19:28.266 75 if ((${#TCP_INTERFACE_LIST[@]} > 0)); then 00:59:44.649 00:19:28.266 76 run_test "nvmf_perf_adq" $rootdir/test/nvmf/target/perf_adq.sh "${TEST_ARGS[@]}" 00:59:44.649 00:19:28.266 77 fi 00:59:44.649 00:19:28.266 78 elif [[ $SPDK_TEST_NVMF_TRANSPORT == "rdma" ]]; then 00:59:44.649 00:19:28.266 => 79 run_test "nvmf_device_removal" test/nvmf/target/device_removal.sh "${TEST_ARGS[@]}" 00:59:44.649 00:19:28.266 80 run_test "nvmf_srq_overwhelm" "$rootdir/test/nvmf/target/srq_overwhelm.sh" "${TEST_ARGS[@]}" 00:59:44.649 00:19:28.266 81 fi 00:59:44.649 00:19:28.266 82 run_test "nvmf_shutdown" $rootdir/test/nvmf/target/shutdown.sh "${TEST_ARGS[@]}" 00:59:44.649 00:19:28.266 83 fi 00:59:44.649 00:19:28.266 84 00:59:44.649 00:19:28.266 ... 00:59:44.649 00:19:28.266 00:59:44.649 00:19:28.266 ========== Backtrace end ========== 00:59:44.649 00:19:28.266 ========== Backtrace start: ========== 00:59:44.649 00:19:28.266 00:59:44.649 00:19:28.266 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:1122 -> run_test(["nvmf_rdma"],["/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh"],["--transport=rdma"]) 00:59:44.649 00:19:28.266 ... 00:59:44.649 00:19:28.266 1117 timing_enter $test_name 00:59:44.649 00:19:28.266 1118 echo "************************************" 00:59:44.649 00:19:28.266 1119 echo "START TEST $test_name" 00:59:44.649 00:19:28.266 1120 echo "************************************" 00:59:44.649 00:19:28.266 1121 xtrace_restore 00:59:44.649 00:19:28.266 1122 time "$@" 00:59:44.649 00:19:28.266 1123 xtrace_disable 00:59:44.649 00:19:28.266 1124 echo "************************************" 00:59:44.649 00:19:28.266 1125 echo "END TEST $test_name" 00:59:44.649 00:19:28.266 1126 echo "************************************" 00:59:44.649 00:19:28.266 1127 timing_exit $test_name 00:59:44.649 00:19:28.266 ... 00:59:44.649 00:19:28.266 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/autotest.sh:280 -> main(["/var/jenkins/workspace/nvmf-phy-autotest/autorun-spdk.conf"]) 00:59:44.649 00:19:28.266 ... 00:59:44.649 00:19:28.266 275 if [ $SPDK_TEST_NVMF -eq 1 ]; then 00:59:44.649 00:19:28.266 276 export NET_TYPE 00:59:44.649 00:19:28.266 277 # The NVMe-oF run test cases are split out like this so that the parser that compiles the 00:59:44.649 00:19:28.266 278 # list of all tests can properly differentiate them. Please do not merge them into one line. 00:59:44.649 00:19:28.266 279 if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then 00:59:44.649 00:19:28.266 => 280 run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:59:44.649 00:19:28.267 281 run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:59:44.649 00:19:28.267 282 elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then 00:59:44.649 00:19:28.267 283 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:59:44.649 00:19:28.267 284 if [[ $SPDK_TEST_URING -eq 0 ]]; then 00:59:44.649 00:19:28.267 285 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:59:44.649 00:19:28.267 ... 00:59:44.649 00:19:28.267 00:59:44.649 00:19:28.267 ========== Backtrace end ==========' 00:59:44.649 + for build in "${build_log_list[@]}" 00:59:44.650 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/packaging-docker-autotest_19869/build.log 00:59:44.650 + local build_log job_name start_pattern end_pattern backtraces 00:59:44.650 + build_log=/var/jenkins/workspace/autotest-per-patch_5/packaging-docker-autotest_19869/build.log 00:59:44.650 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/packaging-docker-autotest_19869/build.log 00:59:44.650 ++ basename /var/jenkins/workspace/autotest-per-patch_5/packaging-docker-autotest_19869 00:59:44.650 + job_name=packaging-docker-autotest_19869 00:59:44.650 + start_pattern='Backtrace start' 00:59:44.650 + end_pattern='Backtrace end' 00:59:44.650 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/packaging-docker-autotest_19869/build.log ]] 00:59:44.650 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/packaging-docker-autotest_19869/build.log 00:59:44.650 + backtraces= 00:59:44.650 + [[ -n '' ]] 00:59:44.650 + for build in "${build_log_list[@]}" 00:59:44.650 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/zns-vg-autotest_76591/build.log 00:59:44.650 + local build_log job_name start_pattern end_pattern backtraces 00:59:44.650 + build_log=/var/jenkins/workspace/autotest-per-patch_5/zns-vg-autotest_76591/build.log 00:59:44.650 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/zns-vg-autotest_76591/build.log 00:59:44.650 ++ basename /var/jenkins/workspace/autotest-per-patch_5/zns-vg-autotest_76591 00:59:44.650 + job_name=zns-vg-autotest_76591 00:59:44.650 + start_pattern='Backtrace start' 00:59:44.650 + end_pattern='Backtrace end' 00:59:44.650 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/zns-vg-autotest_76591/build.log ]] 00:59:44.650 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/zns-vg-autotest_76591/build.log 00:59:44.650 + backtraces= 00:59:44.650 + [[ -n '' ]] 00:59:44.650 + for build in "${build_log_list[@]}" 00:59:44.650 + create_errtrace_file /var/jenkins/workspace/autotest-per-patch_5/centos7-vg-autotest_73664/build.log 00:59:44.650 + local build_log job_name start_pattern end_pattern backtraces 00:59:44.650 + build_log=/var/jenkins/workspace/autotest-per-patch_5/centos7-vg-autotest_73664/build.log 00:59:44.650 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/centos7-vg-autotest_73664/build.log 00:59:44.650 ++ basename /var/jenkins/workspace/autotest-per-patch_5/centos7-vg-autotest_73664 00:59:44.650 + job_name=centos7-vg-autotest_73664 00:59:44.650 + start_pattern='Backtrace start' 00:59:44.650 + end_pattern='Backtrace end' 00:59:44.650 + [[ -f /var/jenkins/workspace/autotest-per-patch_5/centos7-vg-autotest_73664/build.log ]] 00:59:44.650 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch_5/centos7-vg-autotest_73664/build.log 00:59:44.650 + backtraces= 00:59:44.650 + [[ -n '' ]] 00:59:44.650 + run_flamegraph 00:59:44.650 + create_timing_file 00:59:44.650 + local array file 00:59:44.650 + array=($(find $WORKSPACE -type f -name 'timing.txt')) 00:59:44.650 ++ find /var/jenkins/workspace/autotest-per-patch_5 -type f -name timing.txt 00:59:44.650 + timing_dir=/var/jenkins/workspace/autotest-per-patch_5/post_process 00:59:44.650 + mkdir -p /var/jenkins/workspace/autotest-per-patch_5/post_process 00:59:44.650 + timing_file=/var/jenkins/workspace/autotest-per-patch_5/post_process/total_timing.txt 00:59:44.650 + for file in "${array[@]}" 00:59:44.650 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/doc-docker-autotest_22330/timing.txt 00:59:44.650 + local job_file job_name 00:59:44.650 + job_file=/var/jenkins/workspace/autotest-per-patch_5/doc-docker-autotest_22330/timing.txt 00:59:44.650 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/doc-docker-autotest_22330/timing.txt 00:59:44.650 ++ basename /var/jenkins/workspace/autotest-per-patch_5/doc-docker-autotest_22330 00:59:44.650 + job_name=doc-docker-autotest_22330 00:59:44.650 + sed 's/^/doc-docker-autotest_22330;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/doc-docker-autotest_22330/timing.txt 00:59:44.650 + for file in "${array[@]}" 00:59:44.650 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/scan-build-docker-autotest_19870/timing.txt 00:59:44.650 + local job_file job_name 00:59:44.650 + job_file=/var/jenkins/workspace/autotest-per-patch_5/scan-build-docker-autotest_19870/timing.txt 00:59:44.650 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/scan-build-docker-autotest_19870/timing.txt 00:59:44.650 ++ basename /var/jenkins/workspace/autotest-per-patch_5/scan-build-docker-autotest_19870 00:59:44.650 + job_name=scan-build-docker-autotest_19870 00:59:44.650 + sed 's/^/scan-build-docker-autotest_19870;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/scan-build-docker-autotest_19870/timing.txt 00:59:44.650 + for file in "${array[@]}" 00:59:44.650 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/vhost-phy-autotest_26230/timing.txt 00:59:44.650 + local job_file job_name 00:59:44.650 + job_file=/var/jenkins/workspace/autotest-per-patch_5/vhost-phy-autotest_26230/timing.txt 00:59:44.650 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/vhost-phy-autotest_26230/timing.txt 00:59:44.650 ++ basename /var/jenkins/workspace/autotest-per-patch_5/vhost-phy-autotest_26230 00:59:44.650 + job_name=vhost-phy-autotest_26230 00:59:44.650 + sed 's/^/vhost-phy-autotest_26230;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/vhost-phy-autotest_26230/timing.txt 00:59:44.650 + for file in "${array[@]}" 00:59:44.650 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/dsa-phy-autotest_4905/timing.txt 00:59:44.650 + local job_file job_name 00:59:44.650 + job_file=/var/jenkins/workspace/autotest-per-patch_5/dsa-phy-autotest_4905/timing.txt 00:59:44.650 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/dsa-phy-autotest_4905/timing.txt 00:59:44.650 ++ basename /var/jenkins/workspace/autotest-per-patch_5/dsa-phy-autotest_4905 00:59:44.650 + job_name=dsa-phy-autotest_4905 00:59:44.650 + sed 's/^/dsa-phy-autotest_4905;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/dsa-phy-autotest_4905/timing.txt 00:59:44.650 + for file in "${array[@]}" 00:59:44.650 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/unittest-main-docker-autotest_19868/timing.txt 00:59:44.650 + local job_file job_name 00:59:44.650 + job_file=/var/jenkins/workspace/autotest-per-patch_5/unittest-main-docker-autotest_19868/timing.txt 00:59:44.650 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/unittest-main-docker-autotest_19868/timing.txt 00:59:44.650 ++ basename /var/jenkins/workspace/autotest-per-patch_5/unittest-main-docker-autotest_19868 00:59:44.650 + job_name=unittest-main-docker-autotest_19868 00:59:44.650 + sed 's/^/unittest-main-docker-autotest_19868;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/unittest-main-docker-autotest_19868/timing.txt 00:59:44.650 + for file in "${array[@]}" 00:59:44.650 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/nvme-phy-autotest_72377/timing.txt 00:59:44.650 + local job_file job_name 00:59:44.650 + job_file=/var/jenkins/workspace/autotest-per-patch_5/nvme-phy-autotest_72377/timing.txt 00:59:44.650 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/nvme-phy-autotest_72377/timing.txt 00:59:44.650 ++ basename /var/jenkins/workspace/autotest-per-patch_5/nvme-phy-autotest_72377 00:59:44.650 + job_name=nvme-phy-autotest_72377 00:59:44.650 + sed 's/^/nvme-phy-autotest_72377;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/nvme-phy-autotest_72377/timing.txt 00:59:44.650 + for file in "${array[@]}" 00:59:44.650 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/vhost-initiator-vg-autotest_77505/timing.txt 00:59:44.650 + local job_file job_name 00:59:44.650 + job_file=/var/jenkins/workspace/autotest-per-patch_5/vhost-initiator-vg-autotest_77505/timing.txt 00:59:44.650 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/vhost-initiator-vg-autotest_77505/timing.txt 00:59:44.909 ++ basename /var/jenkins/workspace/autotest-per-patch_5/vhost-initiator-vg-autotest_77505 00:59:44.909 + job_name=vhost-initiator-vg-autotest_77505 00:59:44.909 + sed 's/^/vhost-initiator-vg-autotest_77505;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/vhost-initiator-vg-autotest_77505/timing.txt 00:59:44.909 + for file in "${array[@]}" 00:59:44.909 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/crypto-phy-autotest_26205/timing.txt 00:59:44.909 + local job_file job_name 00:59:44.909 + job_file=/var/jenkins/workspace/autotest-per-patch_5/crypto-phy-autotest_26205/timing.txt 00:59:44.909 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/crypto-phy-autotest_26205/timing.txt 00:59:44.909 ++ basename /var/jenkins/workspace/autotest-per-patch_5/crypto-phy-autotest_26205 00:59:44.909 + job_name=crypto-phy-autotest_26205 00:59:44.909 + sed 's/^/crypto-phy-autotest_26205;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/crypto-phy-autotest_26205/timing.txt 00:59:44.909 + for file in "${array[@]}" 00:59:44.909 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/ubuntu20-vg-autotest_73804/timing.txt 00:59:44.909 + local job_file job_name 00:59:44.909 + job_file=/var/jenkins/workspace/autotest-per-patch_5/ubuntu20-vg-autotest_73804/timing.txt 00:59:44.909 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/ubuntu20-vg-autotest_73804/timing.txt 00:59:44.909 ++ basename /var/jenkins/workspace/autotest-per-patch_5/ubuntu20-vg-autotest_73804 00:59:44.909 + job_name=ubuntu20-vg-autotest_73804 00:59:44.909 + sed 's/^/ubuntu20-vg-autotest_73804;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/ubuntu20-vg-autotest_73804/timing.txt 00:59:44.909 + for file in "${array[@]}" 00:59:44.909 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/vfio-user-phy-autotest_26213/timing.txt 00:59:44.909 + local job_file job_name 00:59:44.909 + job_file=/var/jenkins/workspace/autotest-per-patch_5/vfio-user-phy-autotest_26213/timing.txt 00:59:44.909 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/vfio-user-phy-autotest_26213/timing.txt 00:59:44.909 ++ basename /var/jenkins/workspace/autotest-per-patch_5/vfio-user-phy-autotest_26213 00:59:44.909 + job_name=vfio-user-phy-autotest_26213 00:59:44.909 + sed 's/^/vfio-user-phy-autotest_26213;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/vfio-user-phy-autotest_26213/timing.txt 00:59:44.909 + for file in "${array[@]}" 00:59:44.909 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/check-so-deps-docker-autotest_22163/timing.txt 00:59:44.909 + local job_file job_name 00:59:44.909 + job_file=/var/jenkins/workspace/autotest-per-patch_5/check-so-deps-docker-autotest_22163/timing.txt 00:59:44.909 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/check-so-deps-docker-autotest_22163/timing.txt 00:59:44.909 ++ basename /var/jenkins/workspace/autotest-per-patch_5/check-so-deps-docker-autotest_22163 00:59:44.909 + job_name=check-so-deps-docker-autotest_22163 00:59:44.909 + sed 's/^/check-so-deps-docker-autotest_22163;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/check-so-deps-docker-autotest_22163/timing.txt 00:59:44.909 + for file in "${array[@]}" 00:59:44.909 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-phy-autotest_72336/timing.txt 00:59:44.909 + local job_file job_name 00:59:44.909 + job_file=/var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-phy-autotest_72336/timing.txt 00:59:44.909 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-phy-autotest_72336/timing.txt 00:59:44.909 ++ basename /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-phy-autotest_72336 00:59:44.909 + job_name=nvmf-tcp-phy-autotest_72336 00:59:44.909 + sed 's/^/nvmf-tcp-phy-autotest_72336;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-phy-autotest_72336/timing.txt 00:59:44.909 + for file in "${array[@]}" 00:59:44.909 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-uring-vg-autotest_77410/timing.txt 00:59:44.909 + local job_file job_name 00:59:44.909 + job_file=/var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-uring-vg-autotest_77410/timing.txt 00:59:44.909 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-uring-vg-autotest_77410/timing.txt 00:59:44.909 ++ basename /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-uring-vg-autotest_77410 00:59:44.909 + job_name=nvmf-tcp-uring-vg-autotest_77410 00:59:44.909 + sed 's/^/nvmf-tcp-uring-vg-autotest_77410;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-uring-vg-autotest_77410/timing.txt 00:59:44.909 + for file in "${array[@]}" 00:59:44.909 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/iscsi-uring-vg-autotest_77390/timing.txt 00:59:44.909 + local job_file job_name 00:59:44.909 + job_file=/var/jenkins/workspace/autotest-per-patch_5/iscsi-uring-vg-autotest_77390/timing.txt 00:59:44.909 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/iscsi-uring-vg-autotest_77390/timing.txt 00:59:44.909 ++ basename /var/jenkins/workspace/autotest-per-patch_5/iscsi-uring-vg-autotest_77390 00:59:44.909 + job_name=iscsi-uring-vg-autotest_77390 00:59:44.909 + sed 's/^/iscsi-uring-vg-autotest_77390;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/iscsi-uring-vg-autotest_77390/timing.txt 00:59:44.909 + for file in "${array[@]}" 00:59:44.909 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/short-fuzz-phy-autotest_26202/timing.txt 00:59:44.909 + local job_file job_name 00:59:44.909 + job_file=/var/jenkins/workspace/autotest-per-patch_5/short-fuzz-phy-autotest_26202/timing.txt 00:59:44.909 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/short-fuzz-phy-autotest_26202/timing.txt 00:59:44.909 ++ basename /var/jenkins/workspace/autotest-per-patch_5/short-fuzz-phy-autotest_26202 00:59:44.909 + job_name=short-fuzz-phy-autotest_26202 00:59:44.909 + sed 's/^/short-fuzz-phy-autotest_26202;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/short-fuzz-phy-autotest_26202/timing.txt 00:59:44.909 + for file in "${array[@]}" 00:59:44.909 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/rocky9-vg-autotest_16095/timing.txt 00:59:44.909 + local job_file job_name 00:59:44.909 + job_file=/var/jenkins/workspace/autotest-per-patch_5/rocky9-vg-autotest_16095/timing.txt 00:59:44.909 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/rocky9-vg-autotest_16095/timing.txt 00:59:44.909 ++ basename /var/jenkins/workspace/autotest-per-patch_5/rocky9-vg-autotest_16095 00:59:44.909 + job_name=rocky9-vg-autotest_16095 00:59:44.909 + sed 's/^/rocky9-vg-autotest_16095;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/rocky9-vg-autotest_16095/timing.txt 00:59:44.909 + for file in "${array[@]}" 00:59:44.909 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/unittest-clang-docker-autotest_19867/timing.txt 00:59:44.909 + local job_file job_name 00:59:44.909 + job_file=/var/jenkins/workspace/autotest-per-patch_5/unittest-clang-docker-autotest_19867/timing.txt 00:59:44.909 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/unittest-clang-docker-autotest_19867/timing.txt 00:59:44.909 ++ basename /var/jenkins/workspace/autotest-per-patch_5/unittest-clang-docker-autotest_19867 00:59:44.909 + job_name=unittest-clang-docker-autotest_19867 00:59:44.909 + sed 's/^/unittest-clang-docker-autotest_19867;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/unittest-clang-docker-autotest_19867/timing.txt 00:59:44.909 + for file in "${array[@]}" 00:59:44.909 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/autobuild-external-vg-autotest_19830/timing.txt 00:59:44.910 + local job_file job_name 00:59:44.910 + job_file=/var/jenkins/workspace/autotest-per-patch_5/autobuild-external-vg-autotest_19830/timing.txt 00:59:44.910 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/autobuild-external-vg-autotest_19830/timing.txt 00:59:44.910 ++ basename /var/jenkins/workspace/autotest-per-patch_5/autobuild-external-vg-autotest_19830 00:59:44.910 + job_name=autobuild-external-vg-autotest_19830 00:59:44.910 + sed 's/^/autobuild-external-vg-autotest_19830;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/autobuild-external-vg-autotest_19830/timing.txt 00:59:44.910 + for file in "${array[@]}" 00:59:44.910 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/nvme-vg-autotest_77485/timing.txt 00:59:44.910 + local job_file job_name 00:59:44.910 + job_file=/var/jenkins/workspace/autotest-per-patch_5/nvme-vg-autotest_77485/timing.txt 00:59:44.910 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/nvme-vg-autotest_77485/timing.txt 00:59:44.910 ++ basename /var/jenkins/workspace/autotest-per-patch_5/nvme-vg-autotest_77485 00:59:44.910 + job_name=nvme-vg-autotest_77485 00:59:44.910 + sed 's/^/nvme-vg-autotest_77485;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/nvme-vg-autotest_77485/timing.txt 00:59:44.910 + for file in "${array[@]}" 00:59:44.910 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/unittest-valgrind-docker-autotest_19871/timing.txt 00:59:44.910 + local job_file job_name 00:59:44.910 + job_file=/var/jenkins/workspace/autotest-per-patch_5/unittest-valgrind-docker-autotest_19871/timing.txt 00:59:44.910 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/unittest-valgrind-docker-autotest_19871/timing.txt 00:59:44.910 ++ basename /var/jenkins/workspace/autotest-per-patch_5/unittest-valgrind-docker-autotest_19871 00:59:44.910 + job_name=unittest-valgrind-docker-autotest_19871 00:59:44.910 + sed 's/^/unittest-valgrind-docker-autotest_19871;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/unittest-valgrind-docker-autotest_19871/timing.txt 00:59:44.910 + for file in "${array[@]}" 00:59:44.910 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-vg-autotest_77476/timing.txt 00:59:44.910 + local job_file job_name 00:59:44.910 + job_file=/var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-vg-autotest_77476/timing.txt 00:59:44.910 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-vg-autotest_77476/timing.txt 00:59:44.910 ++ basename /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-vg-autotest_77476 00:59:44.910 + job_name=nvmf-tcp-vg-autotest_77476 00:59:44.910 + sed 's/^/nvmf-tcp-vg-autotest_77476;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-vg-autotest_77476/timing.txt 00:59:44.910 + for file in "${array[@]}" 00:59:44.910 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/lvol-vg-autotest_77434/timing.txt 00:59:44.910 + local job_file job_name 00:59:44.910 + job_file=/var/jenkins/workspace/autotest-per-patch_5/lvol-vg-autotest_77434/timing.txt 00:59:44.910 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/lvol-vg-autotest_77434/timing.txt 00:59:44.910 ++ basename /var/jenkins/workspace/autotest-per-patch_5/lvol-vg-autotest_77434 00:59:44.910 + job_name=lvol-vg-autotest_77434 00:59:44.910 + sed 's/^/lvol-vg-autotest_77434;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/lvol-vg-autotest_77434/timing.txt 00:59:44.910 + for file in "${array[@]}" 00:59:44.910 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/BlobFS-phy-autotest_26211/timing.txt 00:59:44.910 + local job_file job_name 00:59:44.910 + job_file=/var/jenkins/workspace/autotest-per-patch_5/BlobFS-phy-autotest_26211/timing.txt 00:59:44.910 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/BlobFS-phy-autotest_26211/timing.txt 00:59:44.910 ++ basename /var/jenkins/workspace/autotest-per-patch_5/BlobFS-phy-autotest_26211 00:59:44.910 + job_name=BlobFS-phy-autotest_26211 00:59:44.910 + sed 's/^/BlobFS-phy-autotest_26211;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/BlobFS-phy-autotest_26211/timing.txt 00:59:44.910 + for file in "${array[@]}" 00:59:44.910 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/iscsi-vg-autotest_77523/timing.txt 00:59:44.910 + local job_file job_name 00:59:44.910 + job_file=/var/jenkins/workspace/autotest-per-patch_5/iscsi-vg-autotest_77523/timing.txt 00:59:44.910 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/iscsi-vg-autotest_77523/timing.txt 00:59:44.910 ++ basename /var/jenkins/workspace/autotest-per-patch_5/iscsi-vg-autotest_77523 00:59:44.910 + job_name=iscsi-vg-autotest_77523 00:59:44.910 + sed 's/^/iscsi-vg-autotest_77523;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/iscsi-vg-autotest_77523/timing.txt 00:59:44.910 + for file in "${array[@]}" 00:59:44.910 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/nvme-cmb-pmr-vg-autotest_78608/timing.txt 00:59:44.910 + local job_file job_name 00:59:44.910 + job_file=/var/jenkins/workspace/autotest-per-patch_5/nvme-cmb-pmr-vg-autotest_78608/timing.txt 00:59:44.910 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/nvme-cmb-pmr-vg-autotest_78608/timing.txt 00:59:44.910 ++ basename /var/jenkins/workspace/autotest-per-patch_5/nvme-cmb-pmr-vg-autotest_78608 00:59:44.910 + job_name=nvme-cmb-pmr-vg-autotest_78608 00:59:44.910 + sed 's/^/nvme-cmb-pmr-vg-autotest_78608;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/nvme-cmb-pmr-vg-autotest_78608/timing.txt 00:59:44.910 + for file in "${array[@]}" 00:59:44.910 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/build-files-docker-autotest_22139/timing.txt 00:59:44.910 + local job_file job_name 00:59:44.910 + job_file=/var/jenkins/workspace/autotest-per-patch_5/build-files-docker-autotest_22139/timing.txt 00:59:44.910 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/build-files-docker-autotest_22139/timing.txt 00:59:44.910 ++ basename /var/jenkins/workspace/autotest-per-patch_5/build-files-docker-autotest_22139 00:59:44.910 + job_name=build-files-docker-autotest_22139 00:59:44.910 + sed 's/^/build-files-docker-autotest_22139;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/build-files-docker-autotest_22139/timing.txt 00:59:44.910 + for file in "${array[@]}" 00:59:44.910 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/ubuntu22-vg-autotest_37818/timing.txt 00:59:44.910 + local job_file job_name 00:59:44.910 + job_file=/var/jenkins/workspace/autotest-per-patch_5/ubuntu22-vg-autotest_37818/timing.txt 00:59:44.910 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/ubuntu22-vg-autotest_37818/timing.txt 00:59:44.910 ++ basename /var/jenkins/workspace/autotest-per-patch_5/ubuntu22-vg-autotest_37818 00:59:44.910 + job_name=ubuntu22-vg-autotest_37818 00:59:44.910 + sed 's/^/ubuntu22-vg-autotest_37818;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/ubuntu22-vg-autotest_37818/timing.txt 00:59:44.910 + for file in "${array[@]}" 00:59:44.910 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/check-format-docker-autotest_22150/timing.txt 00:59:44.910 + local job_file job_name 00:59:44.910 + job_file=/var/jenkins/workspace/autotest-per-patch_5/check-format-docker-autotest_22150/timing.txt 00:59:44.910 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/check-format-docker-autotest_22150/timing.txt 00:59:44.910 ++ basename /var/jenkins/workspace/autotest-per-patch_5/check-format-docker-autotest_22150 00:59:44.910 + job_name=check-format-docker-autotest_22150 00:59:44.910 + sed 's/^/check-format-docker-autotest_22150;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/check-format-docker-autotest_22150/timing.txt 00:59:44.910 + for file in "${array[@]}" 00:59:44.910 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/freebsd-vg-autotest_59130/timing.txt 00:59:44.910 + local job_file job_name 00:59:44.910 + job_file=/var/jenkins/workspace/autotest-per-patch_5/freebsd-vg-autotest_59130/timing.txt 00:59:44.910 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/freebsd-vg-autotest_59130/timing.txt 00:59:44.910 ++ basename /var/jenkins/workspace/autotest-per-patch_5/freebsd-vg-autotest_59130 00:59:44.910 + job_name=freebsd-vg-autotest_59130 00:59:44.910 + sed 's/^/freebsd-vg-autotest_59130;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/freebsd-vg-autotest_59130/timing.txt 00:59:44.910 + for file in "${array[@]}" 00:59:44.910 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/nvmf-phy-autotest_72449/timing.txt 00:59:44.910 + local job_file job_name 00:59:44.910 + job_file=/var/jenkins/workspace/autotest-per-patch_5/nvmf-phy-autotest_72449/timing.txt 00:59:44.910 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/nvmf-phy-autotest_72449/timing.txt 00:59:44.910 ++ basename /var/jenkins/workspace/autotest-per-patch_5/nvmf-phy-autotest_72449 00:59:44.910 + job_name=nvmf-phy-autotest_72449 00:59:44.910 + sed 's/^/nvmf-phy-autotest_72449;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/nvmf-phy-autotest_72449/timing.txt 00:59:44.910 + for file in "${array[@]}" 00:59:44.910 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/packaging-docker-autotest_19869/timing.txt 00:59:44.910 + local job_file job_name 00:59:44.910 + job_file=/var/jenkins/workspace/autotest-per-patch_5/packaging-docker-autotest_19869/timing.txt 00:59:44.910 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/packaging-docker-autotest_19869/timing.txt 00:59:44.910 ++ basename /var/jenkins/workspace/autotest-per-patch_5/packaging-docker-autotest_19869 00:59:44.910 + job_name=packaging-docker-autotest_19869 00:59:44.910 + sed 's/^/packaging-docker-autotest_19869;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/packaging-docker-autotest_19869/timing.txt 00:59:44.910 + for file in "${array[@]}" 00:59:44.910 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/zns-vg-autotest_76591/timing.txt 00:59:44.910 + local job_file job_name 00:59:44.910 + job_file=/var/jenkins/workspace/autotest-per-patch_5/zns-vg-autotest_76591/timing.txt 00:59:44.910 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/zns-vg-autotest_76591/timing.txt 00:59:44.910 ++ basename /var/jenkins/workspace/autotest-per-patch_5/zns-vg-autotest_76591 00:59:44.910 + job_name=zns-vg-autotest_76591 00:59:44.910 + sed 's/^/zns-vg-autotest_76591;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/zns-vg-autotest_76591/timing.txt 00:59:44.910 + for file in "${array[@]}" 00:59:44.910 + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch_5/centos7-vg-autotest_73664/timing.txt 00:59:44.910 + local job_file job_name 00:59:44.910 + job_file=/var/jenkins/workspace/autotest-per-patch_5/centos7-vg-autotest_73664/timing.txt 00:59:44.910 +++ dirname /var/jenkins/workspace/autotest-per-patch_5/centos7-vg-autotest_73664/timing.txt 00:59:44.910 ++ basename /var/jenkins/workspace/autotest-per-patch_5/centos7-vg-autotest_73664 00:59:44.910 + job_name=centos7-vg-autotest_73664 00:59:44.910 + sed 's/^/centos7-vg-autotest_73664;autorun;/' /var/jenkins/workspace/autotest-per-patch_5/centos7-vg-autotest_73664/timing.txt 00:59:44.910 + /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/autotest-per-patch_5/post_process/total_timing.txt 00:59:44.910 + run_autorun_post 00:59:44.910 + s_opt= 00:59:44.910 + [[ '' == true ]] 00:59:44.910 + spdk/autorun_post.py -d ./ -r ./spdk 01:00:11.437 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/module/bdev/nvme/bdev_mdns_client.c:561 01:00:11.437 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/module/bdev/nvme/bdev_mdns_client.c:582 01:00:11.437 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/module/bdev/nvme/bdev_mdns_client.c:613 01:00:11.437 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/module/bdev/nvme/bdev_mdns_client.c:456 01:00:16.699 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/module/blobfs/bdev/blobfs_bdev.c:254 01:00:34.757 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/xor.c:120 01:00:34.757 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:628 01:00:34.757 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc16.c:634 01:00:34.757 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc32c.c:21 01:00:34.757 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch_5/spdk/lib/util/crc64.c:165 01:00:49.617 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_5/spdk/util.h! 01:00:49.617 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_5/spdk/nvme.h! 01:00:49.617 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_5/spdk/mmio.h! 01:00:49.617 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_5/spdk/histogram_data.h! 01:00:49.617 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_5/spdk/trace.h! 01:00:49.617 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_5/spdk/base64.h! 01:00:49.617 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_5/spdk/endian.h! 01:00:49.617 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_5/spdk/thread.h! 01:00:49.617 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_5/spdk/nvmf_transport.h! 01:00:49.617 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_5/spdk/nvme_spec.h! 01:00:49.617 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_5/spdk/bdev_module.h! 01:00:49.617 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch_5/spdk/histogram_data.h/histogram_ut.c! 01:01:04.483 -----Begin Post Process Script------ 01:01:04.483 /var/jenkins/workspace/autotest-per-patch_5/vhost-phy-autotest_26230/cov_total.info 01:01:04.483 /var/jenkins/workspace/autotest-per-patch_5/dsa-phy-autotest_4905/cov_total.info 01:01:04.483 /var/jenkins/workspace/autotest-per-patch_5/vhost-initiator-vg-autotest_77505/cov_total.info 01:01:04.483 /var/jenkins/workspace/autotest-per-patch_5/crypto-phy-autotest_26205/cov_total.info 01:01:04.483 /var/jenkins/workspace/autotest-per-patch_5/vfio-user-phy-autotest_26213/cov_total.info 01:01:04.483 /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-phy-autotest_72336/cov_total.info 01:01:04.483 /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-uring-vg-autotest_77410/cov_total.info 01:01:04.483 /var/jenkins/workspace/autotest-per-patch_5/iscsi-uring-vg-autotest_77390/cov_total.info 01:01:04.483 /var/jenkins/workspace/autotest-per-patch_5/rocky9-vg-autotest_16095/cov_total.info 01:01:04.483 /var/jenkins/workspace/autotest-per-patch_5/nvmf-tcp-vg-autotest_77476/cov_total.info 01:01:04.483 /var/jenkins/workspace/autotest-per-patch_5/lvol-vg-autotest_77434/cov_total.info 01:01:04.483 /var/jenkins/workspace/autotest-per-patch_5/BlobFS-phy-autotest_26211/cov_total.info 01:01:04.483 /var/jenkins/workspace/autotest-per-patch_5/iscsi-vg-autotest_77523/cov_total.info 01:01:04.483 /var/jenkins/workspace/autotest-per-patch_5/nvme-cmb-pmr-vg-autotest_78608/cov_total.info 01:01:04.483 /var/jenkins/workspace/autotest-per-patch_5/ubuntu22-vg-autotest_37818/cov_total.info 01:01:04.483 /var/jenkins/workspace/autotest-per-patch_5/zns-vg-autotest_76591/cov_total.info 01:01:04.483 /var/jenkins/workspace/autotest-per-patch_5/centos7-vg-autotest_73664/cov_total.info 01:01:04.483 01:01:04.483 01:01:04.483 -----Tests Executed in Build------ 01:01:04.483 accel 01:01:04.483 accel_assign_opcode 01:01:04.483 accel_cdev_comp 01:01:04.483 accel_cdev_decmop_full 01:01:04.483 accel_cdev_decomp 01:01:04.483 accel_cdev_decomp_full_mcore 01:01:04.483 accel_cdev_decomp_full_mthread 01:01:04.483 accel_cdev_decomp_mcore 01:01:04.483 accel_cdev_decomp_mthread 01:01:04.483 accel_comp 01:01:04.483 accel_compare 01:01:04.483 accel_compress_verify 01:01:04.483 accel_copy 01:01:04.483 accel_copy_crc32c 01:01:04.483 accel_copy_crc32c_C2 01:01:04.483 accel_crc32c 01:01:04.483 accel_crc32c_C2 01:01:04.483 accel_decmop_full 01:01:04.483 accel_decomp 01:01:04.483 accel_decomp_full_mcore 01:01:04.483 accel_decomp_full_mthread 01:01:04.483 accel_decomp_mcore 01:01:04.483 accel_decomp_mthread 01:01:04.483 accel_dif_functional_tests 01:01:04.483 accel_dif_generate 01:01:04.483 accel_dif_generate_copy 01:01:04.483 accel_dif_verify 01:01:04.483 accel_dualcast 01:01:04.483 accel_fill 01:01:04.483 accel_help 01:01:04.483 accel_missing_filename 01:01:04.483 accel_negative_buffers 01:01:04.483 accel_rpc 01:01:04.483 accel_scan_dsa_modules 01:01:04.483 accel_scan_iaa_modules 01:01:04.483 accel_wrong_workload 01:01:04.483 accel_xor 01:01:04.483 acl 01:01:04.483 alias_rpc 01:01:04.483 allowed 01:01:04.483 app_cmdline 01:01:04.483 app_repeat 01:01:04.483 asan 01:01:04.483 autobuild 01:01:04.483 autobuild_build_doc 01:01:04.483 autobuild_check_dpdk_pci_api 01:01:04.483 autobuild_check_format 01:01:04.483 autobuild_check_so_deps 01:01:04.483 autobuild_external_code 01:01:04.483 autobuild_generated_files_check 01:01:04.483 autobuild_generated_files_check_post_clean 01:01:04.483 autobuild_header_dependency_check 01:01:04.483 autobuild_llvm_precompile 01:01:04.483 autobuild_make_install 01:01:04.483 autobuild_make_uninstall 01:01:04.483 autobuild_ocf_precompile 01:01:04.483 bdev_bounds 01:01:04.483 bdev_crypto_enomem 01:01:04.483 bdev_error 01:01:04.483 bdev_fio 01:01:04.483 bdev_fio_rw_verify 01:01:04.483 bdev_fio_trim 01:01:04.483 bdev_gpt_uuid 01:01:04.483 bdev_hello_world 01:01:04.483 bdev_json_nonarray 01:01:04.483 bdev_json_nonenclosed 01:01:04.483 bdev_nbd 01:01:04.483 bdev_nvme_reset_stuck_adm_cmd 01:01:04.483 bdev_qd_sampling 01:01:04.483 bdev_qos 01:01:04.483 bdev_qos_bw 01:01:04.483 bdev_qos_iops 01:01:04.483 bdev_qos_ro_bw 01:01:04.483 bdev_raid 01:01:04.483 bdev_stat 01:01:04.483 bdev_verify 01:01:04.483 bdev_verify_big_io 01:01:04.483 bdev_write_zeroes 01:01:04.483 bdevperf_config 01:01:04.483 blob_io_wait 01:01:04.483 blobfs 01:01:04.483 blobfs_mkfs 01:01:04.483 blobstore 01:01:04.483 blobstore_grow 01:01:04.483 blockdev_crypto_aesni 01:01:04.483 blockdev_crypto_qat 01:01:04.483 blockdev_crypto_sw 01:01:04.483 blockdev_general 01:01:04.483 blockdev_nvme 01:01:04.483 blockdev_nvme_gpt 01:01:04.483 blockdev_raid5f 01:01:04.483 blockdev_rbd 01:01:04.483 build_rpm_from_gen_spec 01:01:04.483 build_shared_rpm 01:01:04.483 chaining 01:01:04.483 check_header_filenames 01:01:04.483 cmb_copy 01:01:04.483 compress_compdev 01:01:04.483 compress_isal 01:01:04.483 confirm_abi_deps 01:01:04.483 confirm_makefile_deps 01:01:04.483 cpu_locks 01:01:04.483 custom_alloc 01:01:04.483 dd_bs_lt_native_bs 01:01:04.483 dd_copy_to_out_bdev 01:01:04.483 dd_double_input 01:01:04.483 dd_double_output 01:01:04.483 dd_flag_append 01:01:04.483 dd_flag_append_forced_aio 01:01:04.484 dd_flag_directory 01:01:04.484 dd_flag_directory_forced_aio 01:01:04.484 dd_flag_noatime 01:01:04.484 dd_flag_noatime_forced_aio 01:01:04.484 dd_flag_nofollow 01:01:04.484 dd_flag_nofollow_forced_aio 01:01:04.484 dd_flags_misc 01:01:04.484 dd_flags_misc_forced_aio 01:01:04.484 dd_inflate_file 01:01:04.484 dd_invalid_arguments 01:01:04.484 dd_invalid_count 01:01:04.484 dd_invalid_iflag 01:01:04.484 dd_invalid_json 01:01:04.484 dd_invalid_oflag 01:01:04.484 dd_malloc_copy 01:01:04.484 dd_no_input 01:01:04.484 dd_no_output 01:01:04.484 dd_offset_magic 01:01:04.484 dd_rw 01:01:04.484 dd_rw_offset 01:01:04.484 dd_smaller_blocksize 01:01:04.484 dd_sparse_bdev_to_file 01:01:04.484 dd_sparse_file_to_bdev 01:01:04.484 dd_sparse_file_to_file 01:01:04.484 dd_unknown_flag 01:01:04.484 dd_uring_copy 01:01:04.484 dd_wrong_blocksize 01:01:04.484 default_locks 01:01:04.484 default_locks_via_rpc 01:01:04.484 default_setup 01:01:04.484 denied 01:01:04.484 devices 01:01:04.484 dm_mount 01:01:04.484 dma 01:01:04.484 dpdk_mem_utility 01:01:04.484 driver 01:01:04.484 env 01:01:04.484 env_dpdk_post_init 01:01:04.484 env_mem_callbacks 01:01:04.484 env_memory 01:01:04.484 env_pci 01:01:04.484 env_vtophys 01:01:04.484 even_2G_alloc 01:01:04.484 event 01:01:04.484 event_perf 01:01:04.484 event_reactor 01:01:04.484 event_reactor_perf 01:01:04.484 event_scheduler 01:01:04.484 exit_on_failed_rpc_init 01:01:04.484 external_make_accel_driver_shared 01:01:04.484 external_make_accel_driver_static 01:01:04.484 external_make_accel_module_shared 01:01:04.484 external_make_accel_module_static 01:01:04.484 external_make_hello_bdev_shared_combo 01:01:04.484 external_make_hello_bdev_shared_iso 01:01:04.484 external_make_hello_bdev_static 01:01:04.484 external_make_hello_no_bdev_shared_combo 01:01:04.484 external_make_hello_no_bdev_shared_iso 01:01:04.484 external_make_hello_no_bdev_static 01:01:04.484 external_make_nvme_shared 01:01:04.484 external_make_nvme_static 01:01:04.484 external_run_accel_driver_shared 01:01:04.484 external_run_accel_driver_static 01:01:04.484 external_run_accel_module_shared 01:01:04.484 external_run_accel_module_static 01:01:04.484 external_run_hello_bdev_shared_combo 01:01:04.484 external_run_hello_bdev_shared_iso 01:01:04.484 external_run_hello_bdev_static 01:01:04.484 external_run_hello_no_bdev_shared_combo 01:01:04.484 external_run_hello_no_bdev_shared_iso 01:01:04.484 external_run_hello_no_bdev_static 01:01:04.484 external_run_nvme_shared 01:01:04.484 external_run_nvme_static 01:01:04.484 filesystem_btrfs 01:01:04.484 filesystem_ext4 01:01:04.484 filesystem_in_capsule_btrfs 01:01:04.484 filesystem_in_capsule_ext4 01:01:04.484 filesystem_in_capsule_xfs 01:01:04.484 filesystem_xfs 01:01:04.484 fio_dif_1_default 01:01:04.484 fio_dif_1_multi_subsystems 01:01:04.484 fio_dif_digest 01:01:04.484 fio_dif_rand_params 01:01:04.484 go_rpc 01:01:04.484 guess_driver 01:01:04.484 hello_blob 01:01:04.484 hugepages 01:01:04.484 is_zoned 01:01:04.484 iscsi_tgt 01:01:04.484 iscsi_tgt_bdev_io_wait 01:01:04.484 iscsi_tgt_calsoft 01:01:04.484 iscsi_tgt_digest 01:01:04.484 iscsi_tgt_digests 01:01:04.484 iscsi_tgt_filesystem 01:01:04.484 iscsi_tgt_filesystem_btrfs 01:01:04.484 iscsi_tgt_filesystem_ext4 01:01:04.484 iscsi_tgt_filesystem_xfs 01:01:04.484 iscsi_tgt_fio 01:01:04.484 iscsi_tgt_fuzz 01:01:04.484 iscsi_tgt_initiator 01:01:04.484 iscsi_tgt_ip_migration 01:01:04.484 iscsi_tgt_iscsi_lvol 01:01:04.484 iscsi_tgt_login_redirection 01:01:04.484 iscsi_tgt_multiconnection 01:01:04.484 iscsi_tgt_qos 01:01:04.484 iscsi_tgt_rbd 01:01:04.484 iscsi_tgt_reset 01:01:04.484 iscsi_tgt_resize 01:01:04.484 iscsi_tgt_rpc_config 01:01:04.484 iscsi_tgt_sock 01:01:04.484 iscsi_tgt_trace_record 01:01:04.484 json_config 01:01:04.484 json_config_extra_key 01:01:04.484 kernel_target_abort 01:01:04.484 keyring_file 01:01:04.484 llvm_fuzz 01:01:04.484 locking_app_on_locked_coremask 01:01:04.484 locking_app_on_unlocked_coremask 01:01:04.484 locking_overlapped_coremask 01:01:04.484 locking_overlapped_coremask_via_rpc 01:01:04.484 lvol 01:01:04.484 lvol_basic 01:01:04.484 lvol_esnap 01:01:04.484 lvol_external_copy 01:01:04.484 lvol_external_snapshot 01:01:04.484 lvol_hotremove 01:01:04.484 lvol_provisioning 01:01:04.484 lvol_rename 01:01:04.484 lvol_resize 01:01:04.484 lvol_snapshot_clone 01:01:04.484 lvol_tasting 01:01:04.484 lvs_grow_clean 01:01:04.484 lvs_grow_dirty 01:01:04.484 make 01:01:04.484 no_shrink_alloc 01:01:04.484 non_locking_app_on_locked_coremask 01:01:04.484 nvme 01:01:04.484 nvme_arbitration 01:01:04.484 nvme_cli_cuse 01:01:04.484 nvme_cli_plugin 01:01:04.484 nvme_cmb 01:01:04.484 nvme_cuse 01:01:04.484 nvme_cuse_app 01:01:04.484 nvme_cuse_rpc 01:01:04.484 nvme_doorbell_aers 01:01:04.484 nvme_e2edp 01:01:04.484 nvme_err_injection 01:01:04.484 nvme_fdp 01:01:04.484 nvme_fio 01:01:04.484 nvme_flexible_data_placement 01:01:04.484 nvme_hello_world 01:01:04.484 nvme_identify 01:01:04.484 nvme_mount 01:01:04.484 nvme_multi_aen 01:01:04.484 nvme_multi_secondary 01:01:04.484 nvme_ns_manage_cuse 01:01:04.484 nvme_overhead 01:01:04.484 nvme_perf 01:01:04.484 nvme_pmr 01:01:04.484 nvme_pmr_persistence 01:01:04.484 nvme_reserve 01:01:04.484 nvme_reset 01:01:04.484 nvme_rpc 01:01:04.484 nvme_rpc_timeouts 01:01:04.484 nvme_scc 01:01:04.484 nvme_sgl 01:01:04.484 nvme_simple_copy 01:01:04.484 nvme_single_aen 01:01:04.484 nvme_smartctl_cuse 01:01:04.484 nvme_startup 01:01:04.484 nvme_zns 01:01:04.484 nvmf_abort 01:01:04.484 nvmf_abort_qd_sizes 01:01:04.484 nvmf_aer 01:01:04.484 nvmf_async_init 01:01:04.484 nvmf_auth_host 01:01:04.484 nvmf_auth_target 01:01:04.484 nvmf_bdev_io_wait 01:01:04.484 nvmf_bdevio 01:01:04.484 nvmf_bdevio_no_huge 01:01:04.484 nvmf_bdevperf 01:01:04.484 nvmf_connect_disconnect 01:01:04.484 nvmf_connect_stress 01:01:04.484 nvmf_delete_subsystem 01:01:04.484 nvmf_device_removal_pci_remove_no_srq 01:01:04.484 nvmf_dif 01:01:04.484 nvmf_digest 01:01:04.484 nvmf_digest_clean 01:01:04.485 nvmf_digest_dsa_initiator 01:01:04.485 nvmf_digest_dsa_target 01:01:04.485 nvmf_digest_error 01:01:04.485 nvmf_discovery_remove_ifc 01:01:04.485 nvmf_example 01:01:04.485 nvmf_failover 01:01:04.485 nvmf_filesystem 01:01:04.485 nvmf_filesystem_in_capsule 01:01:04.485 nvmf_filesystem_no_in_capsule 01:01:04.485 nvmf_fio_host 01:01:04.485 nvmf_fio_target 01:01:04.485 nvmf_fips 01:01:04.485 nvmf_fused_ordering 01:01:04.485 nvmf_fuzz 01:01:04.485 nvmf_host_discovery 01:01:04.485 nvmf_host_management 01:01:04.485 nvmf_host_multipath 01:01:04.485 nvmf_host_multipath_status 01:01:04.485 nvmf_identify 01:01:04.485 nvmf_identify_kernel_target 01:01:04.485 nvmf_identify_passthru 01:01:04.485 nvmf_invalid 01:01:04.485 nvmf_lvol 01:01:04.485 nvmf_lvs_grow 01:01:04.485 nvmf_mdns_discovery 01:01:04.485 nvmf_multicontroller 01:01:04.485 nvmf_multitarget 01:01:04.485 nvmf_nmic 01:01:04.485 nvmf_ns_hotplug_stress 01:01:04.485 nvmf_ns_masking 01:01:04.485 nvmf_nvme_cli 01:01:04.485 nvmf_perf 01:01:04.485 nvmf_perf_adq 01:01:04.485 nvmf_queue_depth 01:01:04.485 nvmf_referrals 01:01:04.485 nvmf_rpc 01:01:04.485 nvmf_shutdown 01:01:04.485 nvmf_shutdown_tc1 01:01:04.485 nvmf_shutdown_tc2 01:01:04.485 nvmf_shutdown_tc3 01:01:04.485 nvmf_target_disconnect 01:01:04.485 nvmf_target_disconnect_tc1 01:01:04.485 nvmf_target_disconnect_tc2 01:01:04.485 nvmf_target_discovery 01:01:04.485 nvmf_target_multipath 01:01:04.485 nvmf_tcp 01:01:04.485 nvmf_timeout 01:01:04.485 nvmf_tls 01:01:04.485 nvmf_vfio_user 01:01:04.485 nvmf_vfio_user_fuzz 01:01:04.485 nvmf_vfio_user_nvme_compliance 01:01:04.485 nvmf_vhost 01:01:04.485 nvmf_zcopy 01:01:04.485 odd_alloc 01:01:04.485 packaging 01:01:04.485 per_node_1G_alloc 01:01:04.485 raid0_resize_test 01:01:04.485 raid5f_rebuild_test 01:01:04.485 raid5f_rebuild_test_sb 01:01:04.485 raid5f_state_function_test 01:01:04.485 raid5f_state_function_test_sb 01:01:04.485 raid5f_superblock_test 01:01:04.485 raid_function_test_concat 01:01:04.485 raid_function_test_raid0 01:01:04.485 raid_rebuild_test 01:01:04.485 raid_rebuild_test_io 01:01:04.485 raid_rebuild_test_sb 01:01:04.485 raid_rebuild_test_sb_4k 01:01:04.485 raid_rebuild_test_sb_io 01:01:04.485 raid_rebuild_test_sb_md_interleaved 01:01:04.485 raid_rebuild_test_sb_md_separate 01:01:04.485 raid_state_function_test 01:01:04.485 raid_state_function_test_sb 01:01:04.485 raid_state_function_test_sb_4k 01:01:04.485 raid_state_function_test_sb_md_interleaved 01:01:04.485 raid_state_function_test_sb_md_separate 01:01:04.485 raid_superblock_test 01:01:04.485 raid_superblock_test_4k 01:01:04.485 raid_superblock_test_md_interleaved 01:01:04.485 raid_superblock_test_md_separate 01:01:04.485 reactor_set_interrupt 01:01:04.485 reap_unregistered_poller 01:01:04.485 rocksdb 01:01:04.485 rocksdb_insert 01:01:04.485 rocksdb_overwrite 01:01:04.485 rocksdb_randread 01:01:04.485 rocksdb_readwrite 01:01:04.485 rocksdb_writesync 01:01:04.485 rpc 01:01:04.485 rpc_client 01:01:04.485 rpc_daemon_integrity 01:01:04.485 rpc_integrity 01:01:04.485 rpc_plugins 01:01:04.485 rpc_trace_cmd_test 01:01:04.485 rpm_packaging 01:01:04.485 scanbuild_make 01:01:04.485 scheduler_create_thread 01:01:04.485 setup.sh 01:01:04.485 skip_rpc 01:01:04.485 skip_rpc_with_delay 01:01:04.485 skip_rpc_with_json 01:01:04.485 sma 01:01:04.485 sma_crypto 01:01:04.485 sma_discovery 01:01:04.485 sma_nvmf_tcp 01:01:04.485 sma_plugins 01:01:04.485 sma_qos 01:01:04.485 sma_vfiouser_qemu 01:01:04.485 sma_vhost 01:01:04.485 spdk_dd 01:01:04.485 spdk_dd_basic_rw 01:01:04.485 spdk_dd_bdev_to_bdev 01:01:04.485 spdk_dd_malloc 01:01:04.485 spdk_dd_negative 01:01:04.485 spdk_dd_posix 01:01:04.485 spdk_dd_sparse 01:01:04.485 spdk_dd_uring 01:01:04.485 spdk_target_abort 01:01:04.485 spdkcli_iscsi 01:01:04.485 spdkcli_nvmf_tcp 01:01:04.485 spdkcli_raid 01:01:04.485 spdkcli_rbd 01:01:04.485 spdkcli_tcp 01:01:04.485 spdkcli_vhost 01:01:04.485 spdkcli_virtio 01:01:04.485 sw_hotplug 01:01:04.485 test_bdev_lvol_delete_lvstore_with_clones 01:01:04.485 test_bdev_lvol_delete_ordering 01:01:04.485 test_clone_decouple_parent 01:01:04.485 test_clone_inflate 01:01:04.485 test_clone_snapshot_relations 01:01:04.485 test_construct_lvol 01:01:04.485 test_construct_lvol_alias_conflict 01:01:04.485 test_construct_lvol_fio_clear_method_none 01:01:04.485 test_construct_lvol_fio_clear_method_unmap 01:01:04.485 test_construct_lvol_full_lvs 01:01:04.485 test_construct_lvol_inexistent_lvs 01:01:04.485 test_construct_lvols_conflict_alias 01:01:04.485 test_construct_lvs 01:01:04.485 test_construct_lvs_clear_methods 01:01:04.485 test_construct_lvs_conflict_alias 01:01:04.485 test_construct_lvs_different_cluster_size 01:01:04.485 test_construct_lvs_nonexistent_bdev 01:01:04.485 test_construct_multi_lvols 01:01:04.485 test_construct_nested_lvol 01:01:04.485 test_construct_two_lvs_on_the_same_bdev 01:01:04.485 test_create_snapshot_of_snapshot 01:01:04.485 test_create_snapshot_with_io 01:01:04.485 test_delete_lvol_store_persistent_positive 01:01:04.485 test_delete_snapshot_with_clone 01:01:04.485 test_delete_snapshot_with_snapshot 01:01:04.485 test_destroy_after_bdev_lvol_resize_positive 01:01:04.485 test_esnap_clones 01:01:04.485 test_esnap_late_arrival 01:01:04.485 test_esnap_reload 01:01:04.485 test_esnap_remove_degraded 01:01:04.485 test_hotremove_lvol_store 01:01:04.485 test_hotremove_lvol_store_base 01:01:04.485 test_hotremove_lvol_store_base_with_lvols 01:01:04.485 test_hotremove_lvol_store_multiple_lvols 01:01:04.485 test_lvol_bdev_readonly 01:01:04.485 test_lvol_list 01:01:04.485 test_lvol_rename_negative 01:01:04.485 test_rename_lvs_negative 01:01:04.485 test_rename_positive 01:01:04.485 test_resize_lvol 01:01:04.485 test_resize_lvol_negative 01:01:04.485 test_resize_lvol_with_io_traffic 01:01:04.485 test_shallow_copy_compare 01:01:04.485 test_sigterm 01:01:04.485 test_snapshot_compare_with_lvol_bdev 01:01:04.485 test_tasting 01:01:04.485 test_thin_lvol_check_integrity 01:01:04.485 test_thin_lvol_check_space 01:01:04.485 test_thin_lvol_check_zeroes 01:01:04.485 test_thin_lvol_resize 01:01:04.485 test_thin_overprovisioning 01:01:04.485 test_unregister_lvol_bdev 01:01:04.485 thread 01:01:04.485 thread_poller_perf 01:01:04.485 thread_spdk_lock 01:01:04.485 ubsan 01:01:04.485 unittest 01:01:04.485 unittest_accel 01:01:04.485 unittest_bdev 01:01:04.485 unittest_bdev_compress 01:01:04.485 unittest_bdev_crypto 01:01:04.485 unittest_bdev_raid5f 01:01:04.485 unittest_blob_blobfs 01:01:04.485 unittest_build 01:01:04.485 unittest_dma 01:01:04.485 unittest_dpdk_compressdev 01:01:04.485 unittest_event 01:01:04.485 unittest_ftl 01:01:04.485 unittest_idxd_user 01:01:04.485 unittest_include 01:01:04.485 unittest_init 01:01:04.485 unittest_ioat 01:01:04.485 unittest_iobuf 01:01:04.485 unittest_iscsi 01:01:04.485 unittest_json 01:01:04.485 unittest_keyring 01:01:04.485 unittest_lib_reduce 01:01:04.485 unittest_log 01:01:04.485 unittest_lvol 01:01:04.485 unittest_notify 01:01:04.485 unittest_nvme 01:01:04.485 unittest_nvme_cuse 01:01:04.485 unittest_nvme_rdma 01:01:04.485 unittest_nvmf 01:01:04.485 unittest_nvmf_rdma 01:01:04.485 unittest_nvmf_transport 01:01:04.485 unittest_nvmf_vfio_user 01:01:04.485 unittest_pci_event 01:01:04.485 unittest_rdma 01:01:04.485 unittest_rpc 01:01:04.485 unittest_scsi 01:01:04.485 unittest_sock 01:01:04.485 unittest_thread 01:01:04.485 unittest_util 01:01:04.485 unittest_vhost 01:01:04.485 valgrind 01:01:04.485 version 01:01:04.485 vfio_fuzz 01:01:04.485 vfio_user_nvme_fio 01:01:04.485 vfio_user_nvme_restart_vm 01:01:04.485 vfio_user_qemu 01:01:04.485 vfio_user_virtio_bdevperf 01:01:04.485 vfio_user_virtio_blk_restart_vm 01:01:04.485 vfio_user_virtio_scsi_restart_vm 01:01:04.485 vhost 01:01:04.485 vhost_blk_lvol_integrity 01:01:04.485 vhost_blk_packed_ring_integrity 01:01:04.485 vhost_blockdev 01:01:04.485 vhost_boot 01:01:04.485 vhost_fuzz 01:01:04.485 vhost_negative 01:01:04.485 vhost_scsi_lvol_integrity 01:01:04.485 vhost_shared 01:01:04.485 zoned_fio 01:01:04.485 01:01:04.485 01:01:04.485 -----Tests Missing From Build------ 01:01:04.485 balanced 01:01:04.485 blockdev_xnvme 01:01:04.485 build_native_dpdk 01:01:04.485 build_shared_native_dpdk_rpm 01:01:04.485 build_shared_rpm_with_rpmed_dpdk 01:01:04.485 busy 01:01:04.485 core_load 01:01:04.485 dpdk_governor 01:01:04.485 ftl 01:01:04.485 ftl_bdevperf 01:01:04.485 ftl_dirty_shutdown 01:01:04.485 ftl_fio_basic 01:01:04.485 ftl_restore 01:01:04.485 ftl_restore_fast 01:01:04.485 ftl_trim 01:01:04.485 ftl_upgrade_shutdown 01:01:04.485 idle 01:01:04.485 interrupt_mode 01:01:04.485 ioat 01:01:04.485 ioat_perf 01:01:04.485 ioat_verify 01:01:04.485 iscsi_tgt_data_digest 01:01:04.485 iscsi_tgt_ext4test 01:01:04.485 keyring_linux 01:01:04.485 nvme_boot_partition 01:01:04.485 nvme_bp 01:01:04.485 nvme_opal 01:01:04.485 nvme_opal_bdevio 01:01:04.485 nvme_opal_bdevperf 01:01:04.485 nvme_opal_spdk_tgt 01:01:04.485 nvme_xnvme 01:01:04.485 nvmf_device_removal 01:01:04.485 nvmf_device_removal_pci_remove 01:01:04.485 nvmf_fc 01:01:04.485 nvmf_initiator_timeout 01:01:04.486 nvmf_multiconnection 01:01:04.486 nvmf_rdma 01:01:04.486 nvmf_srq_overwhelm 01:01:04.486 nvmf_target_disconnect_tc3 01:01:04.486 ocf 01:01:04.486 ocf_bdevperf_iotypes 01:01:04.486 ocf_configuration_change 01:01:04.486 ocf_create_destruct 01:01:04.486 ocf_fio_modes 01:01:04.486 ocf_flush 01:01:04.486 ocf_multicore 01:01:04.486 ocf_remove 01:01:04.486 ocf_stats 01:01:04.486 scheduler 01:01:04.486 spdkcli_nvmf_fc 01:01:04.486 spdkcli_nvmf_rdma 01:01:04.486 test_create_multi_ublk 01:01:04.486 test_create_ublk 01:01:04.486 test_save_ublk_config 01:01:04.486 ublk 01:01:04.486 ublk_recovery 01:01:04.486 unittest_nvmf_fc 01:01:04.486 unittest_nvmf_fc_ls 01:01:04.486 vhost_blk_cores_2ctrl 01:01:04.486 vhost_blk_fs_integrity 01:01:04.486 vhost_blk_hot_remove 01:01:04.486 vhost_blk_integrity 01:01:04.486 vhost_hotplug 01:01:04.486 vhost_migration 01:01:04.486 vhost_migration_tc1 01:01:04.486 vhost_migration_tc2 01:01:04.486 vhost_readonly 01:01:04.486 vhost_scsi_cores_2ctrl 01:01:04.486 vhost_scsi_fs_integrity 01:01:04.486 vhost_scsi_hot_remove 01:01:04.486 vhost_scsi_integrity 01:01:04.486 vmd 01:01:04.486 vmd_bdev_svc 01:01:04.486 vmd_fio 01:01:04.486 vmd_hello_world 01:01:04.486 vmd_identify 01:01:04.486 vmd_perf 01:01:04.486 xnvme_bdevperf 01:01:04.486 xnvme_to_malloc_dd_copy 01:01:04.486 01:01:04.486 01:01:04.486 -----Tests Missing ASAN------ 01:01:04.486 accel_cdev_comp 01:01:04.486 accel_cdev_decmop_full 01:01:04.486 accel_cdev_decomp 01:01:04.486 accel_cdev_decomp_full_mcore 01:01:04.486 accel_cdev_decomp_full_mthread 01:01:04.486 accel_cdev_decomp_mcore 01:01:04.486 accel_cdev_decomp_mthread 01:01:04.486 autobuild 01:01:04.486 autobuild_build_doc 01:01:04.486 autobuild_check_dpdk_pci_api 01:01:04.486 autobuild_check_format 01:01:04.486 autobuild_check_so_deps 01:01:04.486 autobuild_external_code 01:01:04.486 autobuild_generated_files_check 01:01:04.486 autobuild_generated_files_check_post_clean 01:01:04.486 autobuild_header_dependency_check 01:01:04.486 autobuild_llvm_precompile 01:01:04.486 autobuild_make_install 01:01:04.486 autobuild_make_uninstall 01:01:04.486 autobuild_ocf_precompile 01:01:04.486 balanced 01:01:04.486 bdev_crypto_enomem 01:01:04.486 blockdev_crypto_aesni 01:01:04.486 blockdev_crypto_qat 01:01:04.486 blockdev_crypto_sw 01:01:04.486 blockdev_rbd 01:01:04.486 blockdev_xnvme 01:01:04.486 build_native_dpdk 01:01:04.486 build_shared_native_dpdk_rpm 01:01:04.486 build_shared_rpm_with_rpmed_dpdk 01:01:04.486 busy 01:01:04.486 chaining 01:01:04.486 check_header_filenames 01:01:04.486 cmb_copy 01:01:04.486 compress_compdev 01:01:04.486 compress_isal 01:01:04.486 confirm_abi_deps 01:01:04.486 confirm_makefile_deps 01:01:04.486 core_load 01:01:04.486 dd_uring_copy 01:01:04.486 dpdk_governor 01:01:04.486 external_make_accel_driver_shared 01:01:04.486 external_make_accel_driver_static 01:01:04.486 external_make_accel_module_shared 01:01:04.486 external_make_accel_module_static 01:01:04.486 external_make_hello_bdev_shared_combo 01:01:04.486 external_make_hello_bdev_shared_iso 01:01:04.486 external_make_hello_bdev_static 01:01:04.486 external_make_hello_no_bdev_shared_combo 01:01:04.486 external_make_hello_no_bdev_shared_iso 01:01:04.486 external_make_hello_no_bdev_static 01:01:04.486 external_make_nvme_shared 01:01:04.486 external_make_nvme_static 01:01:04.486 external_run_accel_driver_shared 01:01:04.486 external_run_accel_driver_static 01:01:04.486 external_run_accel_module_shared 01:01:04.486 external_run_accel_module_static 01:01:04.486 external_run_hello_bdev_shared_combo 01:01:04.486 external_run_hello_bdev_shared_iso 01:01:04.486 external_run_hello_bdev_static 01:01:04.486 external_run_hello_no_bdev_shared_combo 01:01:04.486 external_run_hello_no_bdev_shared_iso 01:01:04.486 external_run_hello_no_bdev_static 01:01:04.486 external_run_nvme_shared 01:01:04.486 external_run_nvme_static 01:01:04.486 ftl 01:01:04.486 ftl_bdevperf 01:01:04.486 ftl_dirty_shutdown 01:01:04.486 ftl_fio_basic 01:01:04.486 ftl_restore 01:01:04.486 ftl_restore_fast 01:01:04.486 ftl_trim 01:01:04.486 ftl_upgrade_shutdown 01:01:04.486 go_rpc 01:01:04.486 idle 01:01:04.486 interrupt_mode 01:01:04.486 ioat 01:01:04.486 ioat_perf 01:01:04.486 ioat_verify 01:01:04.486 is_zoned 01:01:04.486 iscsi_tgt 01:01:04.486 iscsi_tgt_bdev_io_wait 01:01:04.486 iscsi_tgt_calsoft 01:01:04.486 iscsi_tgt_data_digest 01:01:04.486 iscsi_tgt_digest 01:01:04.486 iscsi_tgt_digests 01:01:04.486 iscsi_tgt_ext4test 01:01:04.486 iscsi_tgt_filesystem 01:01:04.486 iscsi_tgt_filesystem_btrfs 01:01:04.486 iscsi_tgt_filesystem_ext4 01:01:04.486 iscsi_tgt_filesystem_xfs 01:01:04.486 iscsi_tgt_fio 01:01:04.486 iscsi_tgt_fuzz 01:01:04.486 iscsi_tgt_initiator 01:01:04.486 iscsi_tgt_ip_migration 01:01:04.486 iscsi_tgt_iscsi_lvol 01:01:04.486 iscsi_tgt_login_redirection 01:01:04.486 iscsi_tgt_multiconnection 01:01:04.486 iscsi_tgt_qos 01:01:04.486 iscsi_tgt_rbd 01:01:04.486 iscsi_tgt_reset 01:01:04.486 iscsi_tgt_resize 01:01:04.486 iscsi_tgt_rpc_config 01:01:04.486 iscsi_tgt_sock 01:01:04.486 iscsi_tgt_trace_record 01:01:04.486 keyring_linux 01:01:04.486 llvm_fuzz 01:01:04.486 nvme_boot_partition 01:01:04.486 nvme_bp 01:01:04.486 nvme_cli_cuse 01:01:04.486 nvme_cli_plugin 01:01:04.486 nvme_cmb 01:01:04.486 nvme_cuse 01:01:04.486 nvme_cuse_app 01:01:04.486 nvme_cuse_rpc 01:01:04.486 nvme_ns_manage_cuse 01:01:04.486 nvme_opal 01:01:04.486 nvme_opal_bdevio 01:01:04.486 nvme_opal_bdevperf 01:01:04.486 nvme_opal_spdk_tgt 01:01:04.486 nvme_pmr 01:01:04.486 nvme_pmr_persistence 01:01:04.486 nvme_smartctl_cuse 01:01:04.486 nvme_xnvme 01:01:04.486 nvme_zns 01:01:04.486 nvmf_bdevperf 01:01:04.486 nvmf_device_removal 01:01:04.486 nvmf_device_removal_pci_remove 01:01:04.486 nvmf_device_removal_pci_remove_no_srq 01:01:04.486 nvmf_digest_clean 01:01:04.486 nvmf_fc 01:01:04.486 nvmf_fuzz 01:01:04.486 nvmf_host_multipath 01:01:04.486 nvmf_initiator_timeout 01:01:04.486 nvmf_mdns_discovery 01:01:04.486 nvmf_multiconnection 01:01:04.486 nvmf_nvme_cli 01:01:04.486 nvmf_perf_adq 01:01:04.486 nvmf_rdma 01:01:04.486 nvmf_shutdown 01:01:04.486 nvmf_shutdown_tc1 01:01:04.486 nvmf_shutdown_tc2 01:01:04.486 nvmf_shutdown_tc3 01:01:04.486 nvmf_srq_overwhelm 01:01:04.487 nvmf_target_disconnect 01:01:04.487 nvmf_target_disconnect_tc1 01:01:04.487 nvmf_target_disconnect_tc2 01:01:04.487 nvmf_target_disconnect_tc3 01:01:04.487 nvmf_timeout 01:01:04.487 nvmf_vfio_user 01:01:04.487 nvmf_vfio_user_fuzz 01:01:04.487 nvmf_vfio_user_nvme_compliance 01:01:04.487 ocf 01:01:04.487 ocf_bdevperf_iotypes 01:01:04.487 ocf_configuration_change 01:01:04.744 ocf_create_destruct 01:01:04.744 ocf_fio_modes 01:01:04.744 ocf_flush 01:01:04.744 ocf_multicore 01:01:04.744 ocf_remove 01:01:04.744 ocf_stats 01:01:04.744 scanbuild_make 01:01:04.744 scheduler 01:01:04.744 spdk_dd_uring 01:01:04.744 spdkcli_iscsi 01:01:04.744 spdkcli_nvmf_fc 01:01:04.744 spdkcli_nvmf_rdma 01:01:04.744 spdkcli_raid 01:01:04.744 spdkcli_rbd 01:01:04.744 spdkcli_virtio 01:01:04.744 test_create_multi_ublk 01:01:04.744 test_create_ublk 01:01:04.744 test_save_ublk_config 01:01:04.744 ublk 01:01:04.744 ublk_recovery 01:01:04.744 unittest_bdev_compress 01:01:04.744 unittest_bdev_crypto 01:01:04.744 unittest_dpdk_compressdev 01:01:04.744 unittest_lib_reduce 01:01:04.744 unittest_nvmf_fc 01:01:04.744 unittest_nvmf_fc_ls 01:01:04.744 unittest_nvmf_vfio_user 01:01:04.744 valgrind 01:01:04.744 vfio_fuzz 01:01:04.744 vhost_blk_cores_2ctrl 01:01:04.744 vhost_blk_fs_integrity 01:01:04.744 vhost_blk_hot_remove 01:01:04.744 vhost_blk_integrity 01:01:04.744 vhost_blockdev 01:01:04.744 vhost_fuzz 01:01:04.744 vhost_hotplug 01:01:04.744 vhost_migration 01:01:04.744 vhost_migration_tc1 01:01:04.744 vhost_migration_tc2 01:01:04.744 vhost_readonly 01:01:04.744 vhost_scsi_cores_2ctrl 01:01:04.744 vhost_scsi_fs_integrity 01:01:04.744 vhost_scsi_hot_remove 01:01:04.744 vhost_scsi_integrity 01:01:04.744 vhost_shared 01:01:04.744 vmd 01:01:04.744 vmd_bdev_svc 01:01:04.744 vmd_fio 01:01:04.744 vmd_hello_world 01:01:04.744 vmd_identify 01:01:04.744 vmd_perf 01:01:04.744 xnvme_bdevperf 01:01:04.744 xnvme_to_malloc_dd_copy 01:01:04.744 zoned_fio 01:01:04.744 01:01:04.744 01:01:04.744 -----Tests Missing UBSAN------ 01:01:04.744 autobuild 01:01:04.744 autobuild_build_doc 01:01:04.744 autobuild_check_dpdk_pci_api 01:01:04.744 autobuild_check_format 01:01:04.744 autobuild_check_so_deps 01:01:04.744 autobuild_external_code 01:01:04.744 autobuild_generated_files_check 01:01:04.744 autobuild_generated_files_check_post_clean 01:01:04.744 autobuild_header_dependency_check 01:01:04.744 autobuild_make_install 01:01:04.744 autobuild_make_uninstall 01:01:04.744 balanced 01:01:04.744 blockdev_xnvme 01:01:04.744 build_native_dpdk 01:01:04.744 build_rpm_from_gen_spec 01:01:04.744 build_shared_native_dpdk_rpm 01:01:04.744 build_shared_rpm 01:01:04.744 build_shared_rpm_with_rpmed_dpdk 01:01:04.744 busy 01:01:04.744 check_header_filenames 01:01:04.744 cmb_copy 01:01:04.744 confirm_abi_deps 01:01:04.744 confirm_makefile_deps 01:01:04.744 core_load 01:01:04.744 dpdk_governor 01:01:04.744 external_make_accel_driver_shared 01:01:04.744 external_make_accel_driver_static 01:01:04.744 external_make_accel_module_shared 01:01:04.744 external_make_accel_module_static 01:01:04.744 external_make_hello_bdev_shared_combo 01:01:04.744 external_make_hello_bdev_shared_iso 01:01:04.744 external_make_hello_bdev_static 01:01:04.744 external_make_hello_no_bdev_shared_combo 01:01:04.744 external_make_hello_no_bdev_shared_iso 01:01:04.744 external_make_hello_no_bdev_static 01:01:04.744 external_make_nvme_shared 01:01:04.744 external_make_nvme_static 01:01:04.744 external_run_accel_driver_shared 01:01:04.744 external_run_accel_driver_static 01:01:04.744 external_run_accel_module_shared 01:01:04.744 external_run_accel_module_static 01:01:04.744 external_run_hello_bdev_shared_combo 01:01:04.744 external_run_hello_bdev_shared_iso 01:01:04.744 external_run_hello_bdev_static 01:01:04.744 external_run_hello_no_bdev_shared_combo 01:01:04.744 external_run_hello_no_bdev_shared_iso 01:01:04.744 external_run_hello_no_bdev_static 01:01:04.744 external_run_nvme_shared 01:01:04.744 external_run_nvme_static 01:01:04.744 ftl 01:01:04.744 ftl_bdevperf 01:01:04.744 ftl_dirty_shutdown 01:01:04.744 ftl_fio_basic 01:01:04.744 ftl_restore 01:01:04.744 ftl_restore_fast 01:01:04.744 ftl_trim 01:01:04.744 ftl_upgrade_shutdown 01:01:04.744 idle 01:01:04.744 interrupt_mode 01:01:04.744 ioat 01:01:04.744 ioat_perf 01:01:04.744 ioat_verify 01:01:04.744 is_zoned 01:01:04.744 iscsi_tgt_data_digest 01:01:04.744 iscsi_tgt_ext4test 01:01:04.744 keyring_linux 01:01:04.744 nvme_boot_partition 01:01:04.744 nvme_bp 01:01:04.744 nvme_cmb 01:01:04.744 nvme_opal 01:01:04.744 nvme_opal_bdevio 01:01:04.744 nvme_opal_bdevperf 01:01:04.744 nvme_opal_spdk_tgt 01:01:04.744 nvme_pmr 01:01:04.744 nvme_pmr_persistence 01:01:04.744 nvme_xnvme 01:01:04.744 nvme_zns 01:01:04.744 nvmf_device_removal 01:01:04.744 nvmf_device_removal_pci_remove 01:01:04.744 nvmf_fc 01:01:04.745 nvmf_initiator_timeout 01:01:04.745 nvmf_multiconnection 01:01:04.745 nvmf_rdma 01:01:04.745 nvmf_srq_overwhelm 01:01:04.745 nvmf_target_disconnect_tc3 01:01:04.745 ocf 01:01:04.745 ocf_bdevperf_iotypes 01:01:04.745 ocf_configuration_change 01:01:04.745 ocf_create_destruct 01:01:04.745 ocf_fio_modes 01:01:04.745 ocf_flush 01:01:04.745 ocf_multicore 01:01:04.745 ocf_remove 01:01:04.745 ocf_stats 01:01:04.745 packaging 01:01:04.745 rpm_packaging 01:01:04.745 scanbuild_make 01:01:04.745 scheduler 01:01:04.745 spdkcli_nvmf_fc 01:01:04.745 spdkcli_nvmf_rdma 01:01:04.745 test_create_multi_ublk 01:01:04.745 test_create_ublk 01:01:04.745 test_save_ublk_config 01:01:04.745 ublk 01:01:04.745 ublk_recovery 01:01:04.745 unittest_bdev_compress 01:01:04.745 unittest_bdev_crypto 01:01:04.745 unittest_dpdk_compressdev 01:01:04.745 unittest_lib_reduce 01:01:04.745 unittest_nvmf_fc 01:01:04.745 unittest_nvmf_fc_ls 01:01:04.745 unittest_nvmf_vfio_user 01:01:04.745 valgrind 01:01:04.745 vhost_blk_cores_2ctrl 01:01:04.745 vhost_blk_fs_integrity 01:01:04.745 vhost_blk_hot_remove 01:01:04.745 vhost_blk_integrity 01:01:04.745 vhost_hotplug 01:01:04.745 vhost_migration 01:01:04.745 vhost_migration_tc1 01:01:04.745 vhost_migration_tc2 01:01:04.745 vhost_readonly 01:01:04.745 vhost_scsi_cores_2ctrl 01:01:04.745 vhost_scsi_fs_integrity 01:01:04.745 vhost_scsi_hot_remove 01:01:04.745 vhost_scsi_integrity 01:01:04.745 vmd 01:01:04.745 vmd_bdev_svc 01:01:04.745 vmd_fio 01:01:04.745 vmd_hello_world 01:01:04.745 vmd_identify 01:01:04.745 vmd_perf 01:01:04.745 xnvme_bdevperf 01:01:04.745 xnvme_to_malloc_dd_copy 01:01:04.745 zoned_fio 01:01:04.745 Not all tests were run. Failing the build. 01:01:04.745 ['blockdev_xnvme', 'dpdk_governor', 'ftl', 'ftl_bdevperf', 'ftl_dirty_shutdown', 'ftl_fio_basic', 'ftl_restore', 'ftl_trim', 'ftl_upgrade_shutdown', 'idle', 'interrupt_mode', 'ioat', 'ioat_perf', 'ioat_verify', 'nvme_xnvme', 'nvmf_device_removal', 'nvmf_device_removal_pci_remove', 'nvmf_rdma', 'nvmf_srq_overwhelm', 'nvmf_target_disconnect_tc3', 'ocf', 'ocf_bdevperf_iotypes', 'ocf_configuration_change', 'ocf_create_destruct', 'ocf_fio_modes', 'ocf_flush', 'ocf_multicore', 'ocf_remove', 'ocf_stats', 'scheduler', 'spdkcli_nvmf_rdma', 'test_create_multi_ublk', 'test_create_ublk', 'test_save_ublk_config', 'ublk', 'ublk_recovery', 'xnvme_bdevperf', 'xnvme_to_malloc_dd_copy'] 01:01:04.745 + compress_coverage_and_docs 01:01:04.745 + echo 'Start compress coverage and docs' 01:01:04.745 Start compress coverage and docs 01:01:04.745 + tar -C coverage -czf coverage_autotest-per-patch_122880.tar.gz ./ --remove-files 01:01:06.117 + tar -C ut_coverage -czf ut_coverage_autotest-per-patch_122880.tar.gz ./ --remove-files 01:01:06.681 + tar -C doc -czf doc_autotest-per-patch_122880.tar.gz ./ --remove-files 01:01:06.939 + [[ -d llvm ]] 01:01:06.939 + true 01:01:06.939 + echo 'End compress coverage and docs' 01:01:06.939 End compress coverage and docs 01:01:06.939 + remove_partial_coverage_files 01:01:06.939 + find . -name 'cov_*.info' -delete 01:01:06.939 + echo 'End stage post_gen_coverage.sh' 01:01:06.939 End stage post_gen_coverage.sh 01:01:06.954 [Pipeline] } 01:01:06.957 ERROR: script returned exit code 1 01:01:06.988 [Pipeline] // catchError 01:01:06.997 [Pipeline] catchError 01:01:06.999 [Pipeline] { 01:01:07.020 [Pipeline] dir 01:01:07.020 Running in /var/jenkins/workspace/autotest-per-patch_5/post_process 01:01:07.022 [Pipeline] {