00:00:00.001  Started by user sys_sgci
00:00:00.008  Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/autotest-per-patch_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-upstream/autotest.groovy
00:00:00.009  The recommended git tool is: git
00:00:00.009  using credential 00000000-0000-0000-0000-000000000002
00:00:00.011   > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/autotest-per-patch_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10
00:00:00.021  Fetching changes from the remote Git repository
00:00:00.023   > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10
00:00:00.033  Using shallow fetch with depth 1
00:00:00.033  Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool
00:00:00.033   > git --version # timeout=10
00:00:00.041   > git --version # 'git version 2.39.2'
00:00:00.041  using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials
00:00:00.042  Setting http proxy: proxy-dmz.intel.com:911
00:00:00.042   > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5
00:00:03.062   > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10
00:00:03.074   > git rev-parse FETCH_HEAD^{commit} # timeout=10
00:00:03.086  Checking out Revision 10da8f6d99838e411e4e94523ded0bfebf3e7100 (FETCH_HEAD)
00:00:03.086   > git config core.sparsecheckout # timeout=10
00:00:03.095   > git read-tree -mu HEAD # timeout=10
00:00:03.111   > git checkout -f 10da8f6d99838e411e4e94523ded0bfebf3e7100 # timeout=5
00:00:03.127  Commit message: "scripts/create_git_mirror: Update path to xnvme submodule"
00:00:03.127   > git rev-list --no-walk 10da8f6d99838e411e4e94523ded0bfebf3e7100 # timeout=10
00:00:03.277  [Pipeline] Start of Pipeline
00:00:03.291  [Pipeline] library
00:00:03.292  Loading library shm_lib@master
00:00:03.293  Library shm_lib@master is cached. Copying from home.
00:00:03.317  [Pipeline] node
00:00:03.324  Running on ME3 in /var/jenkins/workspace/autotest-per-patch
00:00:03.328  [Pipeline] {
00:00:03.346  [Pipeline] cleanWs
00:00:03.353  [WS-CLEANUP] Deleting project workspace...
00:00:03.353  [WS-CLEANUP] Deferred wipeout is used...
00:00:03.358  [WS-CLEANUP] done
00:00:03.365  [Pipeline] stage
00:00:03.368  [Pipeline] { (Prologue)
00:00:03.465  [Pipeline] withCredentials
00:00:03.474   > git --version # timeout=10
00:00:03.486   > git --version # 'git version 2.39.2'
00:00:03.498  Masking supported pattern matches of $GIT_USERNAME or $GIT_PASSWORD or $GIT_ASKPASS
00:00:03.501  [Pipeline] {
00:00:03.508  [Pipeline] retry
00:00:03.509  [Pipeline] {
00:00:03.668  [Pipeline] sh
00:00:03.943  + git ls-remote https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master
00:00:05.853  [Pipeline] }
00:00:05.876  [Pipeline] // retry
00:00:05.881  [Pipeline] }
00:00:05.901  [Pipeline] // withCredentials
00:00:05.909  [Pipeline] nodesByLabel
00:00:05.910  Found a total of 1 nodes with the 'sorcerer' label
00:00:05.920  [Pipeline] httpRequest
00:00:05.924  HttpMethod: GET
00:00:05.924  URL: http://10.211.164.101/packages/jbp_10da8f6d99838e411e4e94523ded0bfebf3e7100.tar.gz
00:00:05.925  Sending request to url: http://10.211.164.101/packages/jbp_10da8f6d99838e411e4e94523ded0bfebf3e7100.tar.gz
00:00:05.925  Response Code: HTTP/1.1 200 OK
00:00:05.926  Success: Status code 200 is in the accepted range: 200,404
00:00:05.926  Saving response body to /var/jenkins/workspace/autotest-per-patch/jbp_10da8f6d99838e411e4e94523ded0bfebf3e7100.tar.gz
00:00:06.065  [Pipeline] sh
00:00:06.343  + tar --no-same-owner -xf jbp_10da8f6d99838e411e4e94523ded0bfebf3e7100.tar.gz
00:00:06.366  [Pipeline] httpRequest
00:00:06.370  HttpMethod: GET
00:00:06.371  URL: http://10.211.164.101/packages/spdk_0e4f7fc9ba88308820bc4a1b6d388d42c1f4c5b0.tar.gz
00:00:06.371  Sending request to url: http://10.211.164.101/packages/spdk_0e4f7fc9ba88308820bc4a1b6d388d42c1f4c5b0.tar.gz
00:00:06.372  Response Code: HTTP/1.1 404 Not Found
00:00:06.372  Success: Status code 404 is in the accepted range: 200,404
00:00:06.373  Saving response body to /var/jenkins/workspace/autotest-per-patch/spdk_0e4f7fc9ba88308820bc4a1b6d388d42c1f4c5b0.tar.gz
00:00:06.388  [Pipeline] sh
00:00:06.666  + rm -f spdk_0e4f7fc9ba88308820bc4a1b6d388d42c1f4c5b0.tar.gz
00:00:06.680  [Pipeline] node
00:00:06.688  Running on GP10 in /var/jenkins/workspace/autotest-per-patch
00:00:06.695  [Pipeline] {
00:00:06.713  [Pipeline] cleanWs
00:00:06.723  [WS-CLEANUP] Deleting project workspace...
00:00:06.723  [WS-CLEANUP] Deferred wipeout is used...
00:00:06.731  [WS-CLEANUP] done
00:00:06.735  [Pipeline] sh
00:00:07.024  + find /storage/packages/ -type f -mtime +34 -print -delete
00:00:07.040  [Pipeline] retry
00:00:07.042  [Pipeline] {
00:00:07.066  [Pipeline] checkout
00:00:07.075  The recommended git tool is: NONE
00:00:07.088  using credential 00000000-0000-0000-0000-000000000002
00:00:07.094  Cloning the remote Git repository
00:00:07.098  Honoring refspec on initial clone
00:00:07.104  Cloning repository https://review.spdk.io/gerrit/a/spdk/spdk
00:00:07.104   > git init /var/jenkins/workspace/autotest-per-patch/spdk # timeout=10
00:00:07.111  Using reference repository: /var/ci_repos/spdk_multi
00:00:07.111  Fetching upstream changes from https://review.spdk.io/gerrit/a/spdk/spdk
00:00:07.111   > git --version # timeout=10
00:00:07.115   > git --version # 'git version 2.42.0'
00:00:07.115  using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials
00:00:07.116  Setting http proxy: proxy-dmz.intel.com:911
00:00:07.116   > git fetch --tags --force --progress -- https://review.spdk.io/gerrit/a/spdk/spdk refs/changes/04/19304/13 +refs/heads/master:refs/remotes/origin/master # timeout=10
00:00:23.769  Avoid second fetch
00:00:23.784  Checking out Revision 0e4f7fc9ba88308820bc4a1b6d388d42c1f4c5b0 (FETCH_HEAD)
00:00:24.091  Commit message: "blob: add blob set parent"
00:00:24.099  First time build. Skipping changelog.
00:00:23.754   > git config remote.origin.url https://review.spdk.io/gerrit/a/spdk/spdk # timeout=10
00:00:23.759   > git config --add remote.origin.fetch refs/changes/04/19304/13 # timeout=10
00:00:23.762   > git config --add remote.origin.fetch +refs/heads/master:refs/remotes/origin/master # timeout=10
00:00:23.774   > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10
00:00:23.782   > git rev-parse FETCH_HEAD^{commit} # timeout=10
00:00:23.789   > git config core.sparsecheckout # timeout=10
00:00:23.792   > git checkout -f 0e4f7fc9ba88308820bc4a1b6d388d42c1f4c5b0 # timeout=10
00:00:24.095   > git rev-list --no-walk ea11a808941e274888a8dada1110a2aef0b619ec # timeout=10
00:00:24.106   > git remote # timeout=10
00:00:24.109   > git submodule init # timeout=10
00:00:24.157   > git submodule sync # timeout=10
00:00:24.202   > git config --get remote.origin.url # timeout=10
00:00:24.208   > git submodule init # timeout=10
00:00:24.251   > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10
00:00:24.254   > git config --get submodule.dpdk.url # timeout=10
00:00:24.257   > git remote # timeout=10
00:00:24.261   > git config --get remote.origin.url # timeout=10
00:00:24.264   > git config -f .gitmodules --get submodule.dpdk.path # timeout=10
00:00:24.268   > git config --get submodule.intel-ipsec-mb.url # timeout=10
00:00:24.271   > git remote # timeout=10
00:00:24.275   > git config --get remote.origin.url # timeout=10
00:00:24.278   > git config -f .gitmodules --get submodule.intel-ipsec-mb.path # timeout=10
00:00:24.281   > git config --get submodule.isa-l.url # timeout=10
00:00:24.284   > git remote # timeout=10
00:00:24.288   > git config --get remote.origin.url # timeout=10
00:00:24.291   > git config -f .gitmodules --get submodule.isa-l.path # timeout=10
00:00:24.295   > git config --get submodule.ocf.url # timeout=10
00:00:24.298   > git remote # timeout=10
00:00:24.303   > git config --get remote.origin.url # timeout=10
00:00:24.306   > git config -f .gitmodules --get submodule.ocf.path # timeout=10
00:00:24.310   > git config --get submodule.libvfio-user.url # timeout=10
00:00:24.313   > git remote # timeout=10
00:00:24.316   > git config --get remote.origin.url # timeout=10
00:00:24.320   > git config -f .gitmodules --get submodule.libvfio-user.path # timeout=10
00:00:24.323   > git config --get submodule.xnvme.url # timeout=10
00:00:24.327   > git remote # timeout=10
00:00:24.331   > git config --get remote.origin.url # timeout=10
00:00:24.334   > git config -f .gitmodules --get submodule.xnvme.path # timeout=10
00:00:24.337   > git config --get submodule.isa-l-crypto.url # timeout=10
00:00:24.341   > git remote # timeout=10
00:00:24.344   > git config --get remote.origin.url # timeout=10
00:00:24.348   > git config -f .gitmodules --get submodule.isa-l-crypto.path # timeout=10
00:00:24.351  using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials
00:00:24.351  using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials
00:00:24.352  using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials
00:00:24.352  using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials
00:00:24.352  using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials
00:00:24.352  using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials
00:00:24.352  Setting http proxy: proxy-dmz.intel.com:911
00:00:24.352   > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi intel-ipsec-mb # timeout=10
00:00:24.352  using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials
00:00:24.352  Setting http proxy: proxy-dmz.intel.com:911
00:00:24.352   > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi isa-l # timeout=10
00:00:24.352  Setting http proxy: proxy-dmz.intel.com:911
00:00:24.352   > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi dpdk # timeout=10
00:00:24.352  Setting http proxy: proxy-dmz.intel.com:911
00:00:24.352   > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi ocf # timeout=10
00:00:24.352  Setting http proxy: proxy-dmz.intel.com:911
00:00:24.352  Setting http proxy: proxy-dmz.intel.com:911
00:00:24.352   > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi libvfio-user # timeout=10
00:00:24.352   > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi xnvme # timeout=10
00:00:24.353  Setting http proxy: proxy-dmz.intel.com:911
00:00:24.353   > git submodule update --init --recursive --reference /var/ci_repos/spdk_multi isa-l-crypto # timeout=10
00:00:34.047  [Pipeline] dir
00:00:34.047  Running in /var/jenkins/workspace/autotest-per-patch/spdk
00:00:34.049  [Pipeline] {
00:00:34.066  [Pipeline] sh
00:00:34.354  ++ nproc
00:00:34.354  + threads=48
00:00:34.354  + git repack -a -d --threads=48
00:00:41.162  + git submodule foreach git repack -a -d --threads=48
00:00:41.162  Entering 'dpdk'
00:00:46.440  Entering 'intel-ipsec-mb'
00:00:46.708  Entering 'isa-l'
00:00:46.967  Entering 'isa-l-crypto'
00:00:46.967  Entering 'libvfio-user'
00:00:47.226  Entering 'ocf'
00:00:47.486  Entering 'xnvme'
00:00:47.746  + find .git -type f -name alternates -print -delete
00:00:47.746  .git/modules/libvfio-user/objects/info/alternates
00:00:47.746  .git/modules/dpdk/objects/info/alternates
00:00:47.746  .git/modules/ocf/objects/info/alternates
00:00:47.746  .git/modules/intel-ipsec-mb/objects/info/alternates
00:00:47.746  .git/modules/isa-l/objects/info/alternates
00:00:47.746  .git/modules/xnvme/objects/info/alternates
00:00:47.746  .git/modules/isa-l-crypto/objects/info/alternates
00:00:47.746  .git/objects/info/alternates
00:00:47.757  [Pipeline] }
00:00:47.782  [Pipeline] // dir
00:00:47.788  [Pipeline] }
00:00:47.811  [Pipeline] // retry
00:00:47.817  [Pipeline] sh
00:00:48.102  + tar -cf spdk_0e4f7fc9ba88308820bc4a1b6d388d42c1f4c5b0.tar.gz -I pigz spdk
00:00:48.683  [Pipeline] httpRequest
00:00:48.690  HttpMethod: PUT
00:00:48.690  URL: http://10.211.164.101/cgi-bin/sorcerer.py?group=packages&filename=spdk_0e4f7fc9ba88308820bc4a1b6d388d42c1f4c5b0.tar.gz
00:00:48.691  Sending request to url: http://10.211.164.101/cgi-bin/sorcerer.py?group=packages&filename=spdk_0e4f7fc9ba88308820bc4a1b6d388d42c1f4c5b0.tar.gz
00:00:49.561  Response Code: HTTP/1.1 200 OK
00:00:49.565  Success: Status code 200 is in the accepted range: 200
00:00:49.570  [Pipeline] echo
00:00:49.572  
00:00:49.572  Locking
00:00:49.572  Waited 0s for lock
00:00:49.572  Everything Fine. Saved: /storage/packages/spdk_0e4f7fc9ba88308820bc4a1b6d388d42c1f4c5b0.tar.gz
00:00:49.572  
00:00:49.577  [Pipeline] cleanWs
00:00:49.585  [WS-CLEANUP] Deleting project workspace...
00:00:49.585  [WS-CLEANUP] Deferred wipeout is used...
00:00:49.591  [WS-CLEANUP] done
00:00:49.595  [Pipeline] }
00:00:49.626  [Pipeline] // node
00:00:49.633  [Pipeline] retry
00:00:49.634  [Pipeline] {
00:00:49.648  [Pipeline] httpRequest
00:00:49.653  HttpMethod: GET
00:00:49.654  URL: http://10.211.164.101/packages/spdk_0e4f7fc9ba88308820bc4a1b6d388d42c1f4c5b0.tar.gz
00:00:49.655  Sending request to url: http://10.211.164.101/packages/spdk_0e4f7fc9ba88308820bc4a1b6d388d42c1f4c5b0.tar.gz
00:00:49.656  Response Code: HTTP/1.1 200 OK
00:00:49.656  Success: Status code 200 is in the accepted range: 200,404
00:00:49.657  Saving response body to /var/jenkins/workspace/autotest-per-patch/spdk_0e4f7fc9ba88308820bc4a1b6d388d42c1f4c5b0.tar.gz
00:00:51.824  [Pipeline] }
00:00:51.840  [Pipeline] // retry
00:00:51.848  [Pipeline] sh
00:00:52.122  + tar --no-same-owner -xf spdk_0e4f7fc9ba88308820bc4a1b6d388d42c1f4c5b0.tar.gz
00:00:54.028  [Pipeline] sh
00:00:54.306  + git -C spdk log --oneline -n5
00:00:54.306  0e4f7fc9b blob: add blob set parent
00:00:54.306  4506c0c36 test/common: Enable inherit_errexit
00:00:54.306  b24df7cfa test: Drop superfluous calls to print_backtrace()
00:00:54.306  7b52e4c17 test/scheduler: Meassure utime of $spdk_pid threads as a fallback
00:00:54.306  1dc065205 test/scheduler: Calculate median of the cpu load samples
00:00:54.323  [Pipeline] setCustomBuildProperty
00:00:54.332  [Pipeline] setCustomBuildProperty
00:00:54.342  [Pipeline] catchError
00:00:54.343  [Pipeline] {
00:00:54.362  [Pipeline] sh
00:00:54.643  + git -C spdk describe --tags --abbrev=0 origin/master
00:00:54.659  [Pipeline] sh
00:00:54.936  + git -C spdk describe --tags --abbrev=0 --exclude=LTS HEAD
00:00:54.949  [Pipeline] echo
00:00:54.951  Branch: master
00:00:54.954  [Pipeline] fileExists
00:00:54.964  [Pipeline] readJSON
00:00:54.976  [Pipeline] }
00:00:54.994  [Pipeline] // catchError
00:00:54.998  [Pipeline] }
00:00:55.014  [Pipeline] // stage
00:00:55.024  [Pipeline] catchError
00:00:55.025  [Pipeline] {
00:00:55.036  [Pipeline] stage
00:00:55.037  [Pipeline] { (Pre tests)
00:00:55.070  [Pipeline] parallel
00:00:55.077  [Pipeline] { (Branch: check-format-docker-autotest)
00:00:55.078  [Pipeline] { (Branch: check-so-deps-docker-autotest)
00:00:55.079  [Pipeline] { (Branch: doc-docker-autotest)
00:00:55.080  [Pipeline] { (Branch: build-files-docker-autotest)
00:00:55.100  [Pipeline] retry
00:00:55.102  [Pipeline] {
00:00:55.107  [Pipeline] retry
00:00:55.109  [Pipeline] {
00:00:55.115  [Pipeline] retry
00:00:55.117  [Pipeline] {
00:00:55.123  [Pipeline] retry
00:00:55.125  [Pipeline] {
00:00:55.152  [Pipeline] build
00:00:55.155  Scheduling project: check-format-docker-autotest
00:00:55.164  [Pipeline] build
00:00:55.167  Scheduling project: check-so-deps-docker-autotest
00:00:55.176  [Pipeline] build
00:00:55.179  Scheduling project: doc-docker-autotest
00:00:55.187  [Pipeline] build
00:00:55.190  Scheduling project: build-files-docker-autotest
00:01:05.093  Starting building: check-format-docker-autotest #22145
00:01:05.096  Starting building: doc-docker-autotest #22325
00:01:05.099  Starting building: build-files-docker-autotest #22134
00:01:05.103  Starting building: check-so-deps-docker-autotest #22158
00:01:39.906  Build doc-docker-autotest #22325 completed: SUCCESS
00:01:39.908  [Pipeline] }
00:01:39.941  [Pipeline] // retry
00:01:39.945  [Pipeline] }
00:01:53.526  Build check-format-docker-autotest #22145 completed: SUCCESS
00:01:53.529  [Pipeline] }
00:01:53.562  [Pipeline] // retry
00:01:53.567  [Pipeline] }
00:03:17.893  Build build-files-docker-autotest #22134 completed: SUCCESS
00:03:17.895  [Pipeline] }
00:03:17.929  [Pipeline] // retry
00:03:17.935  [Pipeline] }
00:03:56.191  Build check-so-deps-docker-autotest #22158 completed: SUCCESS
00:03:56.194  [Pipeline] }
00:03:56.228  [Pipeline] // retry
00:03:56.234  [Pipeline] }
00:03:56.291  [Pipeline] // parallel
00:03:56.297  [Pipeline] }
00:03:56.325  [Pipeline] // stage
00:03:56.330  [Pipeline] }
00:03:56.352  [Pipeline] // catchError
00:03:56.361  [Pipeline] catchError
00:03:56.363  [Pipeline] {
00:03:56.386  [Pipeline] stage
00:03:56.389  [Pipeline] { (Tests)
00:03:56.561  [Pipeline] parallel
00:03:56.637  [Pipeline] { (Branch: unittest-clang-docker-autotest)
00:03:56.638  [Pipeline] { (Branch: unittest-main-docker-autotest)
00:03:56.639  [Pipeline] { (Branch: autobuild-external-vg-autotest)
00:03:56.639  [Pipeline] { (Branch: scan-build-docker-autotest)
00:03:56.641  [Pipeline] { (Branch: unittest-valgrind-docker-autotest)
00:03:56.642  [Pipeline] { (Branch: lvol-vg-autotest)
00:03:56.642  [Pipeline] { (Branch: vhost-initiator-vg-autotest)
00:03:56.643  [Pipeline] { (Branch: nvmf-tcp-vg-autotest)
00:03:56.644  [Pipeline] { (Branch: nvmf-tcp-uring-vg-autotest)
00:03:56.645  [Pipeline] { (Branch: nvme-vg-autotest)
00:03:56.646  [Pipeline] { (Branch: centos7-vg-autotest)
00:03:56.647  [Pipeline] { (Branch: rocky9-vg-autotest)
00:03:56.648  [Pipeline] { (Branch: ubuntu20-vg-autotest)
00:03:56.649  [Pipeline] { (Branch: ubuntu22-vg-autotest)
00:03:56.650  [Pipeline] { (Branch: freebsd-vg-autotest)
00:03:56.650  [Pipeline] { (Branch: iscsi-vg-autotest)
00:03:56.651  [Pipeline] { (Branch: iscsi-uring-vg-autotest)
00:03:56.652  [Pipeline] { (Branch: zns-vg-autotest)
00:03:56.653  [Pipeline] { (Branch: nvme-cmb-pmr-vg-autotest)
00:03:56.654  [Pipeline] { (Branch: BlobFS-phy-autotest)
00:03:56.655  [Pipeline] { (Branch: crypto-phy-autotest)
00:03:56.656  [Pipeline] { (Branch: vhost-phy-autotest)
00:03:56.656  [Pipeline] { (Branch: nvmf-phy-autotest)
00:03:56.657  [Pipeline] { (Branch: nvmf-tcp-phy-autotest)
00:03:56.658  [Pipeline] { (Branch: nvme-phy-autotest)
00:03:56.659  [Pipeline] { (Branch: vfio-user-phy-autotest)
00:03:56.660  [Pipeline] { (Branch: short-fuzz-phy-autotest)
00:03:56.661  [Pipeline] { (Branch: dsa-phy-autotest)
00:03:56.662  [Pipeline] { (Branch: packaging-docker-autotest)
00:03:56.696  [Pipeline] retry
00:03:56.700  [Pipeline] {
00:03:56.704  [Pipeline] retry
00:03:56.712  [Pipeline] {
00:03:56.734  [Pipeline] retry
00:03:56.736  [Pipeline] {
00:03:56.741  [Pipeline] retry
00:03:56.743  [Pipeline] {
00:03:56.747  [Pipeline] retry
00:03:56.749  [Pipeline] {
00:03:56.754  [Pipeline] retry
00:03:56.756  [Pipeline] {
00:03:56.761  [Pipeline] retry
00:03:56.763  [Pipeline] {
00:03:56.769  [Pipeline] retry
00:03:56.772  [Pipeline] {
00:03:56.778  [Pipeline] retry
00:03:56.780  [Pipeline] {
00:03:56.786  [Pipeline] retry
00:03:56.788  [Pipeline] {
00:03:56.792  [Pipeline] retry
00:03:56.794  [Pipeline] {
00:03:56.798  [Pipeline] retry
00:03:56.800  [Pipeline] {
00:03:56.805  [Pipeline] retry
00:03:56.807  [Pipeline] {
00:03:56.812  [Pipeline] retry
00:03:56.814  [Pipeline] {
00:03:56.819  [Pipeline] retry
00:03:56.821  [Pipeline] {
00:03:56.826  [Pipeline] retry
00:03:56.827  [Pipeline] {
00:03:56.832  [Pipeline] retry
00:03:56.834  [Pipeline] {
00:03:56.839  [Pipeline] retry
00:03:56.841  [Pipeline] {
00:03:56.846  [Pipeline] retry
00:03:56.847  [Pipeline] {
00:03:56.852  [Pipeline] retry
00:03:56.854  [Pipeline] {
00:03:56.859  [Pipeline] retry
00:03:56.861  [Pipeline] {
00:03:56.865  [Pipeline] retry
00:03:56.867  [Pipeline] {
00:03:56.872  [Pipeline] retry
00:03:56.874  [Pipeline] {
00:03:56.878  [Pipeline] retry
00:03:56.880  [Pipeline] {
00:03:56.885  [Pipeline] retry
00:03:56.886  [Pipeline] {
00:03:56.891  [Pipeline] retry
00:03:56.893  [Pipeline] {
00:03:56.897  [Pipeline] retry
00:03:56.899  [Pipeline] {
00:03:56.903  [Pipeline] retry
00:03:56.905  [Pipeline] {
00:03:56.909  [Pipeline] retry
00:03:56.911  [Pipeline] {
00:03:56.944  [Pipeline] build
00:03:56.948  Scheduling project: unittest-clang-docker-autotest
00:03:56.958  [Pipeline] build
00:03:56.962  Scheduling project: unittest-main-docker-autotest
00:03:56.970  [Pipeline] build
00:03:56.973  Scheduling project: autobuild-external-vg-autotest
00:03:56.982  [Pipeline] build
00:03:56.985  Scheduling project: scan-build-docker-autotest
00:03:56.994  [Pipeline] build
00:03:56.998  Scheduling project: unittest-valgrind-docker-autotest
00:03:57.006  [Pipeline] build
00:03:57.009  Scheduling project: lvol-vg-autotest
00:03:57.018  [Pipeline] build
00:03:57.021  Scheduling project: vhost-initiator-vg-autotest
00:03:57.030  [Pipeline] build
00:03:57.033  Scheduling project: nvmf-tcp-vg-autotest
00:03:57.039  [Pipeline] build
00:03:57.041  Scheduling project: nvmf-tcp-uring-vg-autotest
00:03:57.046  [Pipeline] build
00:03:57.048  Scheduling project: nvme-vg-autotest
00:03:57.053  [Pipeline] build
00:03:57.055  Scheduling project: centos7-vg-autotest
00:03:57.060  [Pipeline] build
00:03:57.061  Scheduling project: rocky9-vg-autotest
00:03:57.066  [Pipeline] build
00:03:57.068  Scheduling project: ubuntu20-vg-autotest
00:03:57.073  [Pipeline] build
00:03:57.075  Scheduling project: ubuntu22-vg-autotest
00:03:57.080  [Pipeline] build
00:03:57.082  Scheduling project: freebsd-vg-autotest
00:03:57.087  [Pipeline] build
00:03:57.089  Scheduling project: iscsi-vg-autotest
00:03:57.094  [Pipeline] build
00:03:57.096  Scheduling project: iscsi-uring-vg-autotest
00:03:57.101  [Pipeline] build
00:03:57.103  Scheduling project: zns-vg-autotest
00:03:57.107  [Pipeline] build
00:03:57.109  Scheduling project: nvme-cmb-pmr-vg-autotest
00:03:57.114  [Pipeline] build
00:03:57.116  Scheduling project: BlobFS-phy-autotest
00:03:57.122  [Pipeline] build
00:03:57.123  Scheduling project: crypto-phy-autotest
00:03:57.128  [Pipeline] build
00:03:57.130  Scheduling project: vhost-phy-autotest
00:03:57.134  [Pipeline] build
00:03:57.136  Scheduling project: nvmf-phy-autotest
00:03:57.141  [Pipeline] build
00:03:57.142  Scheduling project: nvmf-tcp-phy-autotest
00:03:57.147  [Pipeline] build
00:03:57.149  Scheduling project: nvme-phy-autotest
00:03:57.154  [Pipeline] build
00:03:57.156  Scheduling project: vfio-user-phy-autotest
00:03:57.160  [Pipeline] build
00:03:57.162  Scheduling project: short-fuzz-phy-autotest
00:03:57.167  [Pipeline] build
00:03:57.169  Scheduling project: dsa-phy-autotest
00:03:57.174  [Pipeline] build
00:03:57.176  Scheduling project: packaging-docker-autotest
00:04:02.299  Starting building: vfio-user-phy-autotest #26208
00:04:02.303  Starting building: crypto-phy-autotest #26200
00:04:02.306  Starting building: vhost-phy-autotest #26225
00:04:02.309  Starting building: unittest-main-docker-autotest #19863
00:04:02.312  Starting building: autobuild-external-vg-autotest #19825
00:04:02.315  Starting building: unittest-valgrind-docker-autotest #19866
00:04:02.319  Starting building: unittest-clang-docker-autotest #19862
00:04:02.321  Starting building: dsa-phy-autotest #4900
00:04:02.324  Starting building: nvmf-tcp-phy-autotest #72331
00:04:02.327  Starting building: vhost-initiator-vg-autotest #77500
00:04:02.330  Starting building: nvmf-tcp-uring-vg-autotest #77405
00:04:02.335  Starting building: nvme-vg-autotest #77480
00:04:02.339  Starting building: nvmf-tcp-vg-autotest #77471
00:04:02.341  Starting building: short-fuzz-phy-autotest #26197
00:04:02.344  Starting building: BlobFS-phy-autotest #26206
00:04:02.346  Starting building: packaging-docker-autotest #19864
00:04:02.349  Starting building: scan-build-docker-autotest #19865
00:04:02.351  Starting building: rocky9-vg-autotest #16090
00:04:02.354  Starting building: lvol-vg-autotest #77429
00:04:02.357  Starting building: ubuntu22-vg-autotest #37813
00:04:02.359  Starting building: nvme-phy-autotest #72372
00:04:02.362  Starting building: iscsi-uring-vg-autotest #77385
00:04:02.365  Starting building: ubuntu20-vg-autotest #73799
00:04:02.367  Starting building: centos7-vg-autotest #73659
00:04:02.370  Starting building: iscsi-vg-autotest #77518
00:04:02.372  Starting building: zns-vg-autotest #76586
00:04:02.375  Starting building: nvme-cmb-pmr-vg-autotest #78603
00:04:02.378  Starting building: freebsd-vg-autotest #59125
00:04:02.379  Starting building: nvmf-phy-autotest #72444
00:07:12.422  Build unittest-clang-docker-autotest #19862 completed: SUCCESS
00:07:12.424  [Pipeline] }
00:07:12.472  [Pipeline] // retry
00:07:12.479  [Pipeline] }
00:07:51.226  Build packaging-docker-autotest #19864 completed: SUCCESS
00:07:51.229  [Pipeline] }
00:07:51.277  [Pipeline] // retry
00:07:51.284  [Pipeline] }
00:08:37.142  Build scan-build-docker-autotest #19865 completed: SUCCESS
00:08:37.145  [Pipeline] }
00:08:37.191  [Pipeline] // retry
00:08:37.201  [Pipeline] }
00:09:35.706  Build unittest-main-docker-autotest #19863 completed: SUCCESS
00:09:35.709  [Pipeline] }
00:09:35.766  [Pipeline] // retry
00:09:35.773  [Pipeline] }
00:13:22.137  Build unittest-valgrind-docker-autotest #19866 completed: SUCCESS
00:13:22.143  [Pipeline] }
00:13:22.191  [Pipeline] // retry
00:13:22.200  [Pipeline] }
00:13:32.117  Build short-fuzz-phy-autotest #26197 completed: SUCCESS
00:13:32.120  [Pipeline] }
00:13:32.146  [Pipeline] // retry
00:13:32.152  [Pipeline] }
00:17:39.388  Build vhost-initiator-vg-autotest #77500 completed: SUCCESS
00:17:39.391  [Pipeline] }
00:17:39.429  [Pipeline] // retry
00:17:39.436  [Pipeline] }
00:17:47.308  Build autobuild-external-vg-autotest #19825 completed: SUCCESS
00:17:47.311  [Pipeline] }
00:17:47.356  [Pipeline] // retry
00:17:47.365  [Pipeline] }
00:17:48.187  Build nvme-cmb-pmr-vg-autotest #78603 completed: SUCCESS
00:17:48.189  [Pipeline] }
00:17:48.236  [Pipeline] // retry
00:17:48.243  [Pipeline] }
00:18:32.522  Build vhost-phy-autotest #26225 completed: SUCCESS
00:18:32.525  [Pipeline] }
00:18:32.574  [Pipeline] // retry
00:18:32.581  [Pipeline] }
00:18:40.464  Build BlobFS-phy-autotest #26206 completed: SUCCESS
00:18:40.466  [Pipeline] }
00:18:40.510  [Pipeline] // retry
00:18:40.517  [Pipeline] }
00:19:30.165  Build zns-vg-autotest #76586 completed: SUCCESS
00:19:30.168  [Pipeline] }
00:19:30.209  [Pipeline] // retry
00:19:30.218  [Pipeline] }
00:20:52.683  Build lvol-vg-autotest #77429 completed: SUCCESS
00:20:52.685  [Pipeline] }
00:20:52.736  [Pipeline] // retry
00:20:52.742  [Pipeline] }
00:24:05.413  Build nvme-vg-autotest #77480 completed: FAILURE
00:24:06.144  [Pipeline] echo
00:24:06.145  No retry patterns found.
00:24:06.146  [Pipeline] }
00:24:06.179  [Pipeline] // retry
00:24:06.188  [Pipeline] error
00:24:06.193  [Pipeline] }
00:24:06.198  Failed in branch nvme-vg-autotest
00:25:09.726  Build iscsi-uring-vg-autotest #77385 completed: SUCCESS
00:25:09.727  [Pipeline] }
00:25:09.754  [Pipeline] // retry
00:25:09.758  [Pipeline] }
00:26:17.371  Build iscsi-vg-autotest #77518 completed: SUCCESS
00:26:17.373  [Pipeline] }
00:26:17.410  [Pipeline] // retry
00:26:17.418  [Pipeline] }
00:27:41.319  Build nvmf-tcp-uring-vg-autotest #77405 completed: SUCCESS
00:27:41.321  [Pipeline] }
00:27:41.366  [Pipeline] // retry
00:27:41.372  [Pipeline] }
00:28:05.551  Build nvme-phy-autotest #72372 completed: SUCCESS
00:28:05.555  [Pipeline] }
00:28:05.599  [Pipeline] // retry
00:28:05.606  [Pipeline] }
00:28:43.998  Build vfio-user-phy-autotest #26208 completed: SUCCESS
00:28:44.000  [Pipeline] }
00:28:44.048  [Pipeline] // retry
00:28:44.060  [Pipeline] }
00:29:14.052  Build nvmf-tcp-vg-autotest #77471 completed: SUCCESS
00:29:14.055  [Pipeline] }
00:29:14.123  [Pipeline] // retry
00:29:14.130  [Pipeline] }
00:29:22.223  Build freebsd-vg-autotest #59125 completed: SUCCESS
00:29:22.226  [Pipeline] }
00:29:22.274  [Pipeline] // retry
00:29:22.281  [Pipeline] }
00:31:52.345  Build nvmf-phy-autotest #72444 completed: SUCCESS
00:31:52.350  [Pipeline] }
00:31:52.394  [Pipeline] // retry
00:31:52.400  [Pipeline] }
00:32:44.823  Build crypto-phy-autotest #26200 completed: SUCCESS
00:32:44.825  [Pipeline] }
00:32:44.875  [Pipeline] // retry
00:32:44.882  [Pipeline] }
00:34:16.833  Build nvmf-tcp-phy-autotest #72331 completed: SUCCESS
00:34:16.838  [Pipeline] }
00:34:16.884  [Pipeline] // retry
00:34:16.891  [Pipeline] }
00:35:05.325  Build dsa-phy-autotest #4900 completed: SUCCESS
00:35:05.327  [Pipeline] }
00:35:05.376  [Pipeline] // retry
00:35:05.382  [Pipeline] }
00:37:20.138  Build centos7-vg-autotest #73659 completed: SUCCESS
00:37:20.140  [Pipeline] }
00:37:20.185  [Pipeline] // retry
00:37:20.191  [Pipeline] }
00:49:04.112  Build rocky9-vg-autotest #16090 completed: SUCCESS
00:49:04.115  [Pipeline] }
00:49:04.169  [Pipeline] // retry
00:49:04.175  [Pipeline] }
00:56:51.788  Build ubuntu20-vg-autotest #73799 completed: FAILURE
00:56:53.815  [Pipeline] echo
00:56:53.815  No retry patterns found.
00:56:53.816  [Pipeline] }
00:56:53.849  [Pipeline] // retry
00:56:53.856  [Pipeline] error
00:56:53.862  [Pipeline] }
00:56:53.867  Failed in branch ubuntu20-vg-autotest
01:00:13.221  Build ubuntu22-vg-autotest #37813 completed: SUCCESS
01:00:13.224  [Pipeline] }
01:00:13.271  [Pipeline] // retry
01:00:13.282  [Pipeline] }
01:00:13.518  [Pipeline] // parallel
01:00:13.526  [Pipeline] }
01:00:13.561  [Pipeline] // stage
01:00:13.571  [Pipeline] }
01:00:13.579  ERROR: Build nvme-vg-autotest #77480 failed
01:00:13.606  [Pipeline] // catchError
01:00:13.616  [Pipeline] stage
01:00:13.619  [Pipeline] { (Autorun Post and Coverage)
01:00:13.651  [Pipeline] setCustomBuildProperty
01:00:13.675  [Pipeline] dir
01:00:13.676  Running in /var/jenkins/workspace/autotest-per-patch/doc-docker-autotest_22325
01:00:13.678  [Pipeline] {
01:00:13.704  [Pipeline] copyArtifacts
01:00:13.962  Copied 6 artifacts from "doc-docker-autotest" build number 22325
01:00:13.967  [Pipeline] writeFile
01:00:13.991  [Pipeline] }
01:00:14.023  [Pipeline] // dir
01:00:14.040  [Pipeline] dir
01:00:14.040  Running in /var/jenkins/workspace/autotest-per-patch/check-format-docker-autotest_22145
01:00:14.042  [Pipeline] {
01:00:14.067  [Pipeline] copyArtifacts
01:00:14.123  Copied 5 artifacts from "check-format-docker-autotest" build number 22145
01:00:14.128  [Pipeline] writeFile
01:00:14.152  [Pipeline] }
01:00:14.185  [Pipeline] // dir
01:00:14.279  [Pipeline] dir
01:00:14.279  Running in /var/jenkins/workspace/autotest-per-patch/build-files-docker-autotest_22134
01:00:14.280  [Pipeline] {
01:00:14.302  [Pipeline] copyArtifacts
01:00:14.359  Copied 5 artifacts from "build-files-docker-autotest" build number 22134
01:00:14.364  [Pipeline] writeFile
01:00:14.409  [Pipeline] }
01:00:14.445  [Pipeline] // dir
01:00:14.504  [Pipeline] dir
01:00:14.505  Running in /var/jenkins/workspace/autotest-per-patch/check-so-deps-docker-autotest_22158
01:00:14.506  [Pipeline] {
01:00:14.523  [Pipeline] copyArtifacts
01:00:14.581  Copied 5 artifacts from "check-so-deps-docker-autotest" build number 22158
01:00:14.584  [Pipeline] writeFile
01:00:14.609  [Pipeline] }
01:00:14.652  [Pipeline] // dir
01:00:14.782  [Pipeline] dir
01:00:14.782  Running in /var/jenkins/workspace/autotest-per-patch/unittest-clang-docker-autotest_19862
01:00:14.783  [Pipeline] {
01:00:14.808  [Pipeline] copyArtifacts
01:00:14.863  Copied 5 artifacts from "unittest-clang-docker-autotest" build number 19862
01:00:14.867  [Pipeline] writeFile
01:00:14.959  [Pipeline] }
01:00:15.002  [Pipeline] // dir
01:00:15.333  [Pipeline] dir
01:00:15.333  Running in /var/jenkins/workspace/autotest-per-patch/packaging-docker-autotest_19864
01:00:15.334  [Pipeline] {
01:00:15.398  [Pipeline] copyArtifacts
01:00:15.506  Copied 5 artifacts from "packaging-docker-autotest" build number 19864
01:00:15.510  [Pipeline] writeFile
01:00:15.665  [Pipeline] }
01:00:15.745  [Pipeline] // dir
01:00:15.763  [Pipeline] dir
01:00:15.763  Running in /var/jenkins/workspace/autotest-per-patch/scan-build-docker-autotest_19865
01:00:15.764  [Pipeline] {
01:00:15.785  [Pipeline] copyArtifacts
01:00:15.879  Copied 9 artifacts from "scan-build-docker-autotest" build number 19865
01:00:15.882  [Pipeline] writeFile
01:00:15.905  [Pipeline] }
01:00:15.932  [Pipeline] // dir
01:00:16.078  [Pipeline] dir
01:00:16.078  Running in /var/jenkins/workspace/autotest-per-patch/unittest-main-docker-autotest_19863
01:00:16.079  [Pipeline] {
01:00:16.102  [Pipeline] copyArtifacts
01:00:16.384  Copied 6 artifacts from "unittest-main-docker-autotest" build number 19863
01:00:16.389  [Pipeline] writeFile
01:00:16.429  [Pipeline] }
01:00:16.470  [Pipeline] // dir
01:00:16.811  [Pipeline] dir
01:00:16.811  Running in /var/jenkins/workspace/autotest-per-patch/unittest-valgrind-docker-autotest_19866
01:00:16.812  [Pipeline] {
01:00:16.850  [Pipeline] copyArtifacts
01:00:17.061  Copied 6 artifacts from "unittest-valgrind-docker-autotest" build number 19866
01:00:17.066  [Pipeline] writeFile
01:00:17.189  [Pipeline] }
01:00:17.265  [Pipeline] // dir
01:00:17.624  [Pipeline] dir
01:00:17.625  Running in /var/jenkins/workspace/autotest-per-patch/short-fuzz-phy-autotest_26197
01:00:17.626  [Pipeline] {
01:00:17.667  [Pipeline] copyArtifacts
01:00:17.831  Copied 10 artifacts from "short-fuzz-phy-autotest" build number 26197
01:00:17.835  [Pipeline] writeFile
01:00:17.971  [Pipeline] }
01:00:18.102  [Pipeline] // dir
01:00:18.454  [Pipeline] dir
01:00:18.454  Running in /var/jenkins/workspace/autotest-per-patch/vhost-initiator-vg-autotest_77500
01:00:18.455  [Pipeline] {
01:00:18.489  [Pipeline] copyArtifacts
01:00:18.730  Copied 15 artifacts from "vhost-initiator-vg-autotest" build number 77500
01:00:18.734  [Pipeline] writeFile
01:00:18.851  [Pipeline] }
01:00:18.955  [Pipeline] // dir
01:00:19.074  [Pipeline] dir
01:00:19.074  Running in /var/jenkins/workspace/autotest-per-patch/autobuild-external-vg-autotest_19825
01:00:19.075  [Pipeline] {
01:00:19.102  [Pipeline] copyArtifacts
01:00:19.189  Copied 8 artifacts from "autobuild-external-vg-autotest" build number 19825
01:00:19.193  [Pipeline] writeFile
01:00:19.266  [Pipeline] }
01:00:19.324  [Pipeline] // dir
01:00:19.669  [Pipeline] dir
01:00:19.670  Running in /var/jenkins/workspace/autotest-per-patch/nvme-cmb-pmr-vg-autotest_78603
01:00:19.671  [Pipeline] {
01:00:19.711  [Pipeline] copyArtifacts
01:00:19.909  Copied 13 artifacts from "nvme-cmb-pmr-vg-autotest" build number 78603
01:00:19.914  [Pipeline] writeFile
01:00:20.080  [Pipeline] }
01:00:20.186  [Pipeline] // dir
01:00:20.558  [Pipeline] dir
01:00:20.559  Running in /var/jenkins/workspace/autotest-per-patch/vhost-phy-autotest_26225
01:00:20.560  [Pipeline] {
01:00:20.604  [Pipeline] copyArtifacts
01:00:20.846  Copied 12 artifacts from "vhost-phy-autotest" build number 26225
01:00:20.850  [Pipeline] writeFile
01:00:21.009  [Pipeline] }
01:00:21.106  [Pipeline] // dir
01:00:21.433  [Pipeline] dir
01:00:21.434  Running in /var/jenkins/workspace/autotest-per-patch/BlobFS-phy-autotest_26206
01:00:21.435  [Pipeline] {
01:00:21.470  [Pipeline] copyArtifacts
01:00:21.821  Copied 28 artifacts from "BlobFS-phy-autotest" build number 26206
01:00:21.825  [Pipeline] writeFile
01:00:21.944  [Pipeline] }
01:00:22.033  [Pipeline] // dir
01:00:22.343  [Pipeline] dir
01:00:22.344  Running in /var/jenkins/workspace/autotest-per-patch/zns-vg-autotest_76586
01:00:22.345  [Pipeline] {
01:00:22.384  [Pipeline] copyArtifacts
01:00:22.543  Copied 12 artifacts from "zns-vg-autotest" build number 76586
01:00:22.547  [Pipeline] writeFile
01:00:22.706  [Pipeline] }
01:00:22.813  [Pipeline] // dir
01:00:23.400  [Pipeline] dir
01:00:23.400  Running in /var/jenkins/workspace/autotest-per-patch/lvol-vg-autotest_77429
01:00:23.402  [Pipeline] {
01:00:23.457  [Pipeline] copyArtifacts
01:00:23.648  Copied 12 artifacts from "lvol-vg-autotest" build number 77429
01:00:23.652  [Pipeline] writeFile
01:00:23.921  [Pipeline] }
01:00:24.018  [Pipeline] // dir
01:00:24.432  [Pipeline] dir
01:00:24.433  Running in /var/jenkins/workspace/autotest-per-patch/nvme-vg-autotest_77480
01:00:24.434  [Pipeline] {
01:00:24.479  [Pipeline] copyArtifacts
01:00:24.712  Copied 11 artifacts from "nvme-vg-autotest" build number 77480
01:00:24.716  [Pipeline] writeFile
01:00:24.873  [Pipeline] }
01:00:24.991  [Pipeline] // dir
01:00:26.794  [Pipeline] dir
01:00:26.794  Running in /var/jenkins/workspace/autotest-per-patch/iscsi-uring-vg-autotest_77385
01:00:26.795  [Pipeline] {
01:00:26.955  [Pipeline] copyArtifacts
01:00:29.609  Copied 16 artifacts from "iscsi-uring-vg-autotest" build number 77385
01:00:29.613  [Pipeline] writeFile
01:00:30.631  [Pipeline] }
01:00:31.048  [Pipeline] // dir
01:00:32.941  [Pipeline] dir
01:00:32.942  Running in /var/jenkins/workspace/autotest-per-patch/iscsi-vg-autotest_77518
01:00:32.943  [Pipeline] {
01:00:33.122  [Pipeline] copyArtifacts
01:00:35.706  Copied 16 artifacts from "iscsi-vg-autotest" build number 77518
01:00:35.711  [Pipeline] writeFile
01:00:36.723  [Pipeline] }
01:00:37.182  [Pipeline] // dir
01:00:37.854  [Pipeline] dir
01:00:37.854  Running in /var/jenkins/workspace/autotest-per-patch/nvmf-tcp-uring-vg-autotest_77405
01:00:37.855  [Pipeline] {
01:00:37.925  [Pipeline] copyArtifacts
01:00:38.143  Copied 13 artifacts from "nvmf-tcp-uring-vg-autotest" build number 77405
01:00:38.148  [Pipeline] writeFile
01:00:38.485  [Pipeline] }
01:00:38.699  [Pipeline] // dir
01:00:39.303  [Pipeline] dir
01:00:39.304  Running in /var/jenkins/workspace/autotest-per-patch/nvme-phy-autotest_72372
01:00:39.305  [Pipeline] {
01:00:39.347  [Pipeline] copyArtifacts
01:00:39.630  Copied 12 artifacts from "nvme-phy-autotest" build number 72372
01:00:39.635  [Pipeline] writeFile
01:00:39.908  [Pipeline] }
01:00:40.063  [Pipeline] // dir
01:00:40.511  [Pipeline] dir
01:00:40.511  Running in /var/jenkins/workspace/autotest-per-patch/vfio-user-phy-autotest_26208
01:00:40.513  [Pipeline] {
01:00:40.558  [Pipeline] copyArtifacts
01:00:40.779  Copied 12 artifacts from "vfio-user-phy-autotest" build number 26208
01:00:40.785  [Pipeline] writeFile
01:00:40.992  [Pipeline] }
01:00:41.114  [Pipeline] // dir
01:00:41.947  [Pipeline] dir
01:00:41.948  Running in /var/jenkins/workspace/autotest-per-patch/nvmf-tcp-vg-autotest_77471
01:00:41.949  [Pipeline] {
01:00:42.030  [Pipeline] copyArtifacts
01:00:42.255  Copied 13 artifacts from "nvmf-tcp-vg-autotest" build number 77471
01:00:42.259  [Pipeline] writeFile
01:00:42.679  [Pipeline] }
01:00:42.945  [Pipeline] // dir
01:00:43.716  [Pipeline] dir
01:00:43.717  Running in /var/jenkins/workspace/autotest-per-patch/freebsd-vg-autotest_59125
01:00:43.717  [Pipeline] {
01:00:43.770  [Pipeline] copyArtifacts
01:00:43.854  Copied 7 artifacts from "freebsd-vg-autotest" build number 59125
01:00:43.857  [Pipeline] writeFile
01:00:44.158  [Pipeline] }
01:00:44.291  [Pipeline] // dir
01:00:45.112  [Pipeline] dir
01:00:45.112  Running in /var/jenkins/workspace/autotest-per-patch/nvmf-phy-autotest_72444
01:00:45.113  [Pipeline] {
01:00:45.178  [Pipeline] copyArtifacts
01:00:45.392  Copied 13 artifacts from "nvmf-phy-autotest" build number 72444
01:00:45.397  [Pipeline] writeFile
01:00:45.741  [Pipeline] }
01:00:45.957  [Pipeline] // dir
01:00:47.319  [Pipeline] dir
01:00:47.319  Running in /var/jenkins/workspace/autotest-per-patch/crypto-phy-autotest_26200
01:00:47.320  [Pipeline] {
01:00:47.418  [Pipeline] copyArtifacts
01:00:47.659  Copied 12 artifacts from "crypto-phy-autotest" build number 26200
01:00:47.663  [Pipeline] writeFile
01:00:48.243  [Pipeline] }
01:00:48.486  [Pipeline] // dir
01:00:49.945  [Pipeline] dir
01:00:49.945  Running in /var/jenkins/workspace/autotest-per-patch/nvmf-tcp-phy-autotest_72331
01:00:49.946  [Pipeline] {
01:00:50.055  [Pipeline] copyArtifacts
01:00:50.278  Copied 13 artifacts from "nvmf-tcp-phy-autotest" build number 72331
01:00:50.281  [Pipeline] writeFile
01:00:51.006  [Pipeline] }
01:00:51.329  [Pipeline] // dir
01:00:52.179  [Pipeline] dir
01:00:52.179  Running in /var/jenkins/workspace/autotest-per-patch/dsa-phy-autotest_4900
01:00:52.180  [Pipeline] {
01:00:52.260  [Pipeline] copyArtifacts
01:00:52.480  Copied 13 artifacts from "dsa-phy-autotest" build number 4900
01:00:52.484  [Pipeline] writeFile
01:00:52.868  [Pipeline] }
01:00:53.045  [Pipeline] // dir
01:00:53.857  [Pipeline] dir
01:00:53.857  Running in /var/jenkins/workspace/autotest-per-patch/centos7-vg-autotest_73659
01:00:53.858  [Pipeline] {
01:00:53.924  [Pipeline] copyArtifacts
01:00:54.293  Copied 13 artifacts from "centos7-vg-autotest" build number 73659
01:00:54.298  [Pipeline] writeFile
01:00:54.654  [Pipeline] }
01:00:54.848  [Pipeline] // dir
01:00:56.086  [Pipeline] dir
01:00:56.086  Running in /var/jenkins/workspace/autotest-per-patch/rocky9-vg-autotest_16090
01:00:56.087  [Pipeline] {
01:00:56.178  [Pipeline] copyArtifacts
01:00:56.532  Copied 13 artifacts from "rocky9-vg-autotest" build number 16090
01:00:56.595  [Pipeline] writeFile
01:00:57.086  [Pipeline] }
01:00:57.369  [Pipeline] // dir
01:00:58.824  [Pipeline] dir
01:00:58.824  Running in /var/jenkins/workspace/autotest-per-patch/ubuntu20-vg-autotest_73799
01:00:58.825  [Pipeline] {
01:00:58.922  [Pipeline] copyArtifacts
01:00:59.603  Copied 12 artifacts from "ubuntu20-vg-autotest" build number 73799
01:00:59.609  [Pipeline] writeFile
01:01:00.103  [Pipeline] }
01:01:00.325  [Pipeline] // dir
01:01:01.494  [Pipeline] dir
01:01:01.494  Running in /var/jenkins/workspace/autotest-per-patch/ubuntu22-vg-autotest_37813
01:01:01.495  [Pipeline] {
01:01:01.577  [Pipeline] copyArtifacts
01:01:01.924  Copied 13 artifacts from "ubuntu22-vg-autotest" build number 37813
01:01:01.928  [Pipeline] writeFile
01:01:02.361  [Pipeline] }
01:01:02.610  [Pipeline] // dir
01:01:02.619  [Pipeline] catchError
01:01:02.621  [Pipeline] {
01:01:02.638  [Pipeline] sh
01:01:02.911  + jbp/jenkins/jjb-config/jobs/scripts/post_gen_coverage.sh
01:01:02.911  + shopt -s globstar nullglob
01:01:02.911  + echo 'Start stage post_gen_coverage.sh'
01:01:02.911  Start stage post_gen_coverage.sh
01:01:02.911  + cd /var/jenkins/workspace/autotest-per-patch
01:01:02.911  + rm -rf /var/jenkins/workspace/autotest-per-patch/spdk/doc
01:01:02.912  + trap 'compress_coverage_and_docs; remove_partial_coverage_files && echo '\''End stage post_gen_coverage.sh'\''' EXIT
01:01:02.912  + move_artifacts
01:01:02.912  + local out_dirs
01:01:02.912  + out_dirs=(./**/output/)
01:01:02.912  + for dir in "${out_dirs[@]}"
01:01:02.912  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:02.912  + [[ -f ./autobuild-external-vg-autotest_19825/output//doc.tar.xz ]]
01:01:02.912  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:02.912  + [[ -f ./autobuild-external-vg-autotest_19825/output//ut_coverage.tar.xz ]]
01:01:02.912  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:02.912  + [[ -f ./autobuild-external-vg-autotest_19825/output//llvm.tar.xz ]]
01:01:02.912  + mv ./autobuild-external-vg-autotest_19825/output//build-pkg-manifest.txt ./autobuild-external-vg-autotest_19825/output//build-repo-manifest.txt ./autobuild-external-vg-autotest_19825/output//dmesg.init.log ./autobuild-external-vg-autotest_19825/output//dmesg.log ./autobuild-external-vg-autotest_19825/output//power.tar.xz ./autobuild-external-vg-autotest_19825/output//test_completions.txt ./autobuild-external-vg-autotest_19825/output//timing.svg ./autobuild-external-vg-autotest_19825/output//timing.txt ./autobuild-external-vg-autotest_19825/output//..
01:01:02.912  + rmdir ./autobuild-external-vg-autotest_19825/output/
01:01:02.912  + for dir in "${out_dirs[@]}"
01:01:02.912  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:02.912  + [[ -f ./BlobFS-phy-autotest_26206/output//doc.tar.xz ]]
01:01:02.912  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:02.912  + [[ -f ./BlobFS-phy-autotest_26206/output//ut_coverage.tar.xz ]]
01:01:02.912  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:02.912  + [[ -f ./BlobFS-phy-autotest_26206/output//llvm.tar.xz ]]
01:01:02.912  + mv ./BlobFS-phy-autotest_26206/output//all_tests.txt ./BlobFS-phy-autotest_26206/output//build-pkg-manifest.txt ./BlobFS-phy-autotest_26206/output//build-repo-manifest.txt ./BlobFS-phy-autotest_26206/output//cov_base.info.xz ./BlobFS-phy-autotest_26206/output//cov_test.info.xz ./BlobFS-phy-autotest_26206/output//cov_total.info.xz ./BlobFS-phy-autotest_26206/output//dmesg.init.log ./BlobFS-phy-autotest_26206/output//dmesg.log ./BlobFS-phy-autotest_26206/output//power.tar.xz ./BlobFS-phy-autotest_26206/output//rocksdb ./BlobFS-phy-autotest_26206/output//test_completions.txt ./BlobFS-phy-autotest_26206/output//timing.svg ./BlobFS-phy-autotest_26206/output//timing.txt ./BlobFS-phy-autotest_26206/output//..
01:01:02.912  + rmdir ./BlobFS-phy-autotest_26206/output/
01:01:02.912  + for dir in "${out_dirs[@]}"
01:01:02.912  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:02.912  + [[ -f ./build-files-docker-autotest_22134/output//doc.tar.xz ]]
01:01:02.912  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:02.912  + [[ -f ./build-files-docker-autotest_22134/output//ut_coverage.tar.xz ]]
01:01:02.912  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:02.912  + [[ -f ./build-files-docker-autotest_22134/output//llvm.tar.xz ]]
01:01:02.912  + mv ./build-files-docker-autotest_22134/output//build-pkg-manifest.txt ./build-files-docker-autotest_22134/output//build-repo-manifest.txt ./build-files-docker-autotest_22134/output//power.tar.xz ./build-files-docker-autotest_22134/output//test_completions.txt ./build-files-docker-autotest_22134/output//timing.txt ./build-files-docker-autotest_22134/output//..
01:01:02.912  + rmdir ./build-files-docker-autotest_22134/output/
01:01:02.912  + for dir in "${out_dirs[@]}"
01:01:02.912  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:02.912  + [[ -f ./centos7-vg-autotest_73659/output//doc.tar.xz ]]
01:01:02.912  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:02.912  + [[ -f ./centos7-vg-autotest_73659/output//ut_coverage.tar.xz ]]
01:01:02.912  + tar -C ./centos7-vg-autotest_73659/output/ -xf ./centos7-vg-autotest_73659/output//ut_coverage.tar.xz
01:01:03.169  + rm ./centos7-vg-autotest_73659/output//ut_coverage.tar.xz
01:01:03.169  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.169  + [[ -f ./centos7-vg-autotest_73659/output//llvm.tar.xz ]]
01:01:03.169  + mv ./centos7-vg-autotest_73659/output//all_tests.txt ./centos7-vg-autotest_73659/output//build-pkg-manifest.txt ./centos7-vg-autotest_73659/output//build-repo-manifest.txt ./centos7-vg-autotest_73659/output//cov_base.info.xz ./centos7-vg-autotest_73659/output//cov_test.info.xz ./centos7-vg-autotest_73659/output//cov_total.info.xz ./centos7-vg-autotest_73659/output//dmesg.init.log ./centos7-vg-autotest_73659/output//dmesg.log ./centos7-vg-autotest_73659/output//power.tar.xz ./centos7-vg-autotest_73659/output//test_completions.txt ./centos7-vg-autotest_73659/output//timing.svg ./centos7-vg-autotest_73659/output//timing.txt ./centos7-vg-autotest_73659/output//ut_coverage ./centos7-vg-autotest_73659/output//..
01:01:03.169  + rmdir ./centos7-vg-autotest_73659/output/
01:01:03.169  + for dir in "${out_dirs[@]}"
01:01:03.169  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.169  + [[ -f ./check-format-docker-autotest_22145/output//doc.tar.xz ]]
01:01:03.169  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.169  + [[ -f ./check-format-docker-autotest_22145/output//ut_coverage.tar.xz ]]
01:01:03.169  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.169  + [[ -f ./check-format-docker-autotest_22145/output//llvm.tar.xz ]]
01:01:03.169  + mv ./check-format-docker-autotest_22145/output//build-pkg-manifest.txt ./check-format-docker-autotest_22145/output//build-repo-manifest.txt ./check-format-docker-autotest_22145/output//power.tar.xz ./check-format-docker-autotest_22145/output//test_completions.txt ./check-format-docker-autotest_22145/output//timing.txt ./check-format-docker-autotest_22145/output//..
01:01:03.169  + rmdir ./check-format-docker-autotest_22145/output/
01:01:03.169  + for dir in "${out_dirs[@]}"
01:01:03.169  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.169  + [[ -f ./check-so-deps-docker-autotest_22158/output//doc.tar.xz ]]
01:01:03.169  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.169  + [[ -f ./check-so-deps-docker-autotest_22158/output//ut_coverage.tar.xz ]]
01:01:03.169  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.169  + [[ -f ./check-so-deps-docker-autotest_22158/output//llvm.tar.xz ]]
01:01:03.169  + mv ./check-so-deps-docker-autotest_22158/output//build-pkg-manifest.txt ./check-so-deps-docker-autotest_22158/output//build-repo-manifest.txt ./check-so-deps-docker-autotest_22158/output//power.tar.xz ./check-so-deps-docker-autotest_22158/output//test_completions.txt ./check-so-deps-docker-autotest_22158/output//timing.txt ./check-so-deps-docker-autotest_22158/output//..
01:01:03.169  + rmdir ./check-so-deps-docker-autotest_22158/output/
01:01:03.169  + for dir in "${out_dirs[@]}"
01:01:03.169  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.169  + [[ -f ./crypto-phy-autotest_26200/output//doc.tar.xz ]]
01:01:03.169  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.169  + [[ -f ./crypto-phy-autotest_26200/output//ut_coverage.tar.xz ]]
01:01:03.169  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.169  + [[ -f ./crypto-phy-autotest_26200/output//llvm.tar.xz ]]
01:01:03.169  + mv ./crypto-phy-autotest_26200/output//all_tests.txt ./crypto-phy-autotest_26200/output//build-pkg-manifest.txt ./crypto-phy-autotest_26200/output//build-repo-manifest.txt ./crypto-phy-autotest_26200/output//cov_base.info.xz ./crypto-phy-autotest_26200/output//cov_test.info.xz ./crypto-phy-autotest_26200/output//cov_total.info.xz ./crypto-phy-autotest_26200/output//dmesg.init.log ./crypto-phy-autotest_26200/output//dmesg.log ./crypto-phy-autotest_26200/output//power.tar.xz ./crypto-phy-autotest_26200/output//test_completions.txt ./crypto-phy-autotest_26200/output//timing.svg ./crypto-phy-autotest_26200/output//timing.txt ./crypto-phy-autotest_26200/output//..
01:01:03.169  + rmdir ./crypto-phy-autotest_26200/output/
01:01:03.169  + for dir in "${out_dirs[@]}"
01:01:03.169  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.169  + [[ -f ./doc-docker-autotest_22325/output//doc.tar.xz ]]
01:01:03.169  + tar -C ./doc-docker-autotest_22325/output/ -xf ./doc-docker-autotest_22325/output//doc.tar.xz
01:01:03.169  + rm ./doc-docker-autotest_22325/output//doc.tar.xz
01:01:03.427  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.427  + [[ -f ./doc-docker-autotest_22325/output//ut_coverage.tar.xz ]]
01:01:03.427  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.427  + [[ -f ./doc-docker-autotest_22325/output//llvm.tar.xz ]]
01:01:03.427  + mv ./doc-docker-autotest_22325/output//build-pkg-manifest.txt ./doc-docker-autotest_22325/output//build-repo-manifest.txt ./doc-docker-autotest_22325/output//doc ./doc-docker-autotest_22325/output//power.tar.xz ./doc-docker-autotest_22325/output//test_completions.txt ./doc-docker-autotest_22325/output//timing.txt ./doc-docker-autotest_22325/output//..
01:01:03.427  + rmdir ./doc-docker-autotest_22325/output/
01:01:03.427  + for dir in "${out_dirs[@]}"
01:01:03.427  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.427  + [[ -f ./dsa-phy-autotest_4900/output//doc.tar.xz ]]
01:01:03.427  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.427  + [[ -f ./dsa-phy-autotest_4900/output//ut_coverage.tar.xz ]]
01:01:03.427  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.427  + [[ -f ./dsa-phy-autotest_4900/output//llvm.tar.xz ]]
01:01:03.427  + mv ./dsa-phy-autotest_4900/output//all_tests.txt ./dsa-phy-autotest_4900/output//build-pkg-manifest.txt ./dsa-phy-autotest_4900/output//build-repo-manifest.txt ./dsa-phy-autotest_4900/output//cov_base.info.xz ./dsa-phy-autotest_4900/output//cov_test.info.xz ./dsa-phy-autotest_4900/output//cov_total.info.xz ./dsa-phy-autotest_4900/output//dmesg.init.log ./dsa-phy-autotest_4900/output//dmesg.log ./dsa-phy-autotest_4900/output//nvmf_trace.0_shm.tar.gz ./dsa-phy-autotest_4900/output//power.tar.xz ./dsa-phy-autotest_4900/output//test_completions.txt ./dsa-phy-autotest_4900/output//timing.svg ./dsa-phy-autotest_4900/output//timing.txt ./dsa-phy-autotest_4900/output//..
01:01:03.427  + rmdir ./dsa-phy-autotest_4900/output/
01:01:03.427  + for dir in "${out_dirs[@]}"
01:01:03.427  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.427  + [[ -f ./freebsd-vg-autotest_59125/output//doc.tar.xz ]]
01:01:03.427  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.427  + [[ -f ./freebsd-vg-autotest_59125/output//ut_coverage.tar.xz ]]
01:01:03.427  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.427  + [[ -f ./freebsd-vg-autotest_59125/output//llvm.tar.xz ]]
01:01:03.427  + mv ./freebsd-vg-autotest_59125/output//all_tests.txt ./freebsd-vg-autotest_59125/output//build-pkg-manifest.txt ./freebsd-vg-autotest_59125/output//build-repo-manifest.txt ./freebsd-vg-autotest_59125/output//messages ./freebsd-vg-autotest_59125/output//power.tar.xz ./freebsd-vg-autotest_59125/output//test_completions.txt ./freebsd-vg-autotest_59125/output//timing.txt ./freebsd-vg-autotest_59125/output//..
01:01:03.427  + rmdir ./freebsd-vg-autotest_59125/output/
01:01:03.427  + for dir in "${out_dirs[@]}"
01:01:03.427  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.427  + [[ -f ./iscsi-uring-vg-autotest_77385/output//doc.tar.xz ]]
01:01:03.427  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.427  + [[ -f ./iscsi-uring-vg-autotest_77385/output//ut_coverage.tar.xz ]]
01:01:03.427  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.427  + [[ -f ./iscsi-uring-vg-autotest_77385/output//llvm.tar.xz ]]
01:01:03.427  + mv ./iscsi-uring-vg-autotest_77385/output//all_tests.txt ./iscsi-uring-vg-autotest_77385/output//build-pkg-manifest.txt ./iscsi-uring-vg-autotest_77385/output//build-repo-manifest.txt ./iscsi-uring-vg-autotest_77385/output//calsoft.json ./iscsi-uring-vg-autotest_77385/output//calsoft.tar.xz ./iscsi-uring-vg-autotest_77385/output//cov_base.info.xz ./iscsi-uring-vg-autotest_77385/output//cov_test.info.xz ./iscsi-uring-vg-autotest_77385/output//cov_total.info.xz ./iscsi-uring-vg-autotest_77385/output//dmesg.init.log ./iscsi-uring-vg-autotest_77385/output//dmesg.log ./iscsi-uring-vg-autotest_77385/output//iscsi_autofuzz_logs.txt ./iscsi-uring-vg-autotest_77385/output//iscsi_autofuzz_tgt_output.txt ./iscsi-uring-vg-autotest_77385/output//power.tar.xz ./iscsi-uring-vg-autotest_77385/output//test_completions.txt ./iscsi-uring-vg-autotest_77385/output//timing.svg ./iscsi-uring-vg-autotest_77385/output//timing.txt ./iscsi-uring-vg-autotest_77385/output//..
01:01:03.427  + rmdir ./iscsi-uring-vg-autotest_77385/output/
01:01:03.427  + for dir in "${out_dirs[@]}"
01:01:03.427  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.427  + [[ -f ./iscsi-vg-autotest_77518/output//doc.tar.xz ]]
01:01:03.427  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.427  + [[ -f ./iscsi-vg-autotest_77518/output//ut_coverage.tar.xz ]]
01:01:03.427  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.427  + [[ -f ./iscsi-vg-autotest_77518/output//llvm.tar.xz ]]
01:01:03.427  + mv ./iscsi-vg-autotest_77518/output//all_tests.txt ./iscsi-vg-autotest_77518/output//build-pkg-manifest.txt ./iscsi-vg-autotest_77518/output//build-repo-manifest.txt ./iscsi-vg-autotest_77518/output//calsoft.json ./iscsi-vg-autotest_77518/output//calsoft.tar.xz ./iscsi-vg-autotest_77518/output//cov_base.info.xz ./iscsi-vg-autotest_77518/output//cov_test.info.xz ./iscsi-vg-autotest_77518/output//cov_total.info.xz ./iscsi-vg-autotest_77518/output//dmesg.init.log ./iscsi-vg-autotest_77518/output//dmesg.log ./iscsi-vg-autotest_77518/output//iscsi_autofuzz_logs.txt ./iscsi-vg-autotest_77518/output//iscsi_autofuzz_tgt_output.txt ./iscsi-vg-autotest_77518/output//power.tar.xz ./iscsi-vg-autotest_77518/output//test_completions.txt ./iscsi-vg-autotest_77518/output//timing.svg ./iscsi-vg-autotest_77518/output//timing.txt ./iscsi-vg-autotest_77518/output//..
01:01:03.427  + rmdir ./iscsi-vg-autotest_77518/output/
01:01:03.427  + for dir in "${out_dirs[@]}"
01:01:03.427  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.427  + [[ -f ./lvol-vg-autotest_77429/output//doc.tar.xz ]]
01:01:03.427  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.427  + [[ -f ./lvol-vg-autotest_77429/output//ut_coverage.tar.xz ]]
01:01:03.427  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.427  + [[ -f ./lvol-vg-autotest_77429/output//llvm.tar.xz ]]
01:01:03.427  + mv ./lvol-vg-autotest_77429/output//all_tests.txt ./lvol-vg-autotest_77429/output//build-pkg-manifest.txt ./lvol-vg-autotest_77429/output//build-repo-manifest.txt ./lvol-vg-autotest_77429/output//cov_base.info.xz ./lvol-vg-autotest_77429/output//cov_test.info.xz ./lvol-vg-autotest_77429/output//cov_total.info.xz ./lvol-vg-autotest_77429/output//dmesg.init.log ./lvol-vg-autotest_77429/output//dmesg.log ./lvol-vg-autotest_77429/output//power.tar.xz ./lvol-vg-autotest_77429/output//test_completions.txt ./lvol-vg-autotest_77429/output//timing.svg ./lvol-vg-autotest_77429/output//timing.txt ./lvol-vg-autotest_77429/output//..
01:01:03.427  + rmdir ./lvol-vg-autotest_77429/output/
01:01:03.427  + for dir in "${out_dirs[@]}"
01:01:03.427  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.427  + [[ -f ./nvme-cmb-pmr-vg-autotest_78603/output//doc.tar.xz ]]
01:01:03.427  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.427  + [[ -f ./nvme-cmb-pmr-vg-autotest_78603/output//ut_coverage.tar.xz ]]
01:01:03.427  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.427  + [[ -f ./nvme-cmb-pmr-vg-autotest_78603/output//llvm.tar.xz ]]
01:01:03.427  + mv ./nvme-cmb-pmr-vg-autotest_78603/output//all_tests.txt ./nvme-cmb-pmr-vg-autotest_78603/output//build-kernel-manifest.txt ./nvme-cmb-pmr-vg-autotest_78603/output//build-pkg-manifest.txt ./nvme-cmb-pmr-vg-autotest_78603/output//build-repo-manifest.txt ./nvme-cmb-pmr-vg-autotest_78603/output//cov_base.info.xz ./nvme-cmb-pmr-vg-autotest_78603/output//cov_test.info.xz ./nvme-cmb-pmr-vg-autotest_78603/output//cov_total.info.xz ./nvme-cmb-pmr-vg-autotest_78603/output//dmesg.init.log ./nvme-cmb-pmr-vg-autotest_78603/output//dmesg.log ./nvme-cmb-pmr-vg-autotest_78603/output//power.tar.xz ./nvme-cmb-pmr-vg-autotest_78603/output//test_completions.txt ./nvme-cmb-pmr-vg-autotest_78603/output//timing.svg ./nvme-cmb-pmr-vg-autotest_78603/output//timing.txt ./nvme-cmb-pmr-vg-autotest_78603/output//..
01:01:03.427  + rmdir ./nvme-cmb-pmr-vg-autotest_78603/output/
01:01:03.427  + for dir in "${out_dirs[@]}"
01:01:03.427  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.427  + [[ -f ./nvme-phy-autotest_72372/output//doc.tar.xz ]]
01:01:03.427  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.427  + [[ -f ./nvme-phy-autotest_72372/output//ut_coverage.tar.xz ]]
01:01:03.427  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.427  + [[ -f ./nvme-phy-autotest_72372/output//llvm.tar.xz ]]
01:01:03.427  + mv ./nvme-phy-autotest_72372/output//all_tests.txt ./nvme-phy-autotest_72372/output//build-pkg-manifest.txt ./nvme-phy-autotest_72372/output//build-repo-manifest.txt ./nvme-phy-autotest_72372/output//cov_base.info.xz ./nvme-phy-autotest_72372/output//cov_test.info.xz ./nvme-phy-autotest_72372/output//cov_total.info.xz ./nvme-phy-autotest_72372/output//dmesg.init.log ./nvme-phy-autotest_72372/output//dmesg.log ./nvme-phy-autotest_72372/output//power.tar.xz ./nvme-phy-autotest_72372/output//test_completions.txt ./nvme-phy-autotest_72372/output//timing.svg ./nvme-phy-autotest_72372/output//timing.txt ./nvme-phy-autotest_72372/output//..
01:01:03.427  + rmdir ./nvme-phy-autotest_72372/output/
01:01:03.427  + for dir in "${out_dirs[@]}"
01:01:03.427  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.427  + [[ -f ./nvme-vg-autotest_77480/output//doc.tar.xz ]]
01:01:03.427  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.427  + [[ -f ./nvme-vg-autotest_77480/output//ut_coverage.tar.xz ]]
01:01:03.427  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.427  + [[ -f ./nvme-vg-autotest_77480/output//llvm.tar.xz ]]
01:01:03.428  + mv ./nvme-vg-autotest_77480/output//all_tests.txt ./nvme-vg-autotest_77480/output//build-pkg-manifest.txt ./nvme-vg-autotest_77480/output//build-repo-manifest.txt ./nvme-vg-autotest_77480/output//cov_base.info.xz ./nvme-vg-autotest_77480/output//dmesg.init.log ./nvme-vg-autotest_77480/output//dmesg.log ./nvme-vg-autotest_77480/output//power.tar.xz ./nvme-vg-autotest_77480/output//proc_list.txt ./nvme-vg-autotest_77480/output//test_completions.txt ./nvme-vg-autotest_77480/output//timing.txt ./nvme-vg-autotest_77480/output//udev.log ./nvme-vg-autotest_77480/output//..
01:01:03.428  + rmdir ./nvme-vg-autotest_77480/output/
01:01:03.428  + for dir in "${out_dirs[@]}"
01:01:03.428  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.428  + [[ -f ./nvmf-phy-autotest_72444/output//doc.tar.xz ]]
01:01:03.428  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.428  + [[ -f ./nvmf-phy-autotest_72444/output//ut_coverage.tar.xz ]]
01:01:03.428  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.428  + [[ -f ./nvmf-phy-autotest_72444/output//llvm.tar.xz ]]
01:01:03.428  + mv ./nvmf-phy-autotest_72444/output//all_tests.txt ./nvmf-phy-autotest_72444/output//build-pkg-manifest.txt ./nvmf-phy-autotest_72444/output//build-repo-manifest.txt ./nvmf-phy-autotest_72444/output//cov_base.info.xz ./nvmf-phy-autotest_72444/output//cov_test.info.xz ./nvmf-phy-autotest_72444/output//cov_total.info.xz ./nvmf-phy-autotest_72444/output//dmesg.init.log ./nvmf-phy-autotest_72444/output//dmesg.log ./nvmf-phy-autotest_72444/output//nvmf_trace.0_shm.tar.gz ./nvmf-phy-autotest_72444/output//power.tar.xz ./nvmf-phy-autotest_72444/output//test_completions.txt ./nvmf-phy-autotest_72444/output//timing.svg ./nvmf-phy-autotest_72444/output//timing.txt ./nvmf-phy-autotest_72444/output//..
01:01:03.428  + rmdir ./nvmf-phy-autotest_72444/output/
01:01:03.428  + for dir in "${out_dirs[@]}"
01:01:03.428  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.428  + [[ -f ./nvmf-tcp-phy-autotest_72331/output//doc.tar.xz ]]
01:01:03.428  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.428  + [[ -f ./nvmf-tcp-phy-autotest_72331/output//ut_coverage.tar.xz ]]
01:01:03.428  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.428  + [[ -f ./nvmf-tcp-phy-autotest_72331/output//llvm.tar.xz ]]
01:01:03.428  + mv ./nvmf-tcp-phy-autotest_72331/output//all_tests.txt ./nvmf-tcp-phy-autotest_72331/output//build-pkg-manifest.txt ./nvmf-tcp-phy-autotest_72331/output//build-repo-manifest.txt ./nvmf-tcp-phy-autotest_72331/output//cov_base.info.xz ./nvmf-tcp-phy-autotest_72331/output//cov_test.info.xz ./nvmf-tcp-phy-autotest_72331/output//cov_total.info.xz ./nvmf-tcp-phy-autotest_72331/output//dmesg.init.log ./nvmf-tcp-phy-autotest_72331/output//dmesg.log ./nvmf-tcp-phy-autotest_72331/output//nvmf_trace.0_shm.tar.gz ./nvmf-tcp-phy-autotest_72331/output//power.tar.xz ./nvmf-tcp-phy-autotest_72331/output//test_completions.txt ./nvmf-tcp-phy-autotest_72331/output//timing.svg ./nvmf-tcp-phy-autotest_72331/output//timing.txt ./nvmf-tcp-phy-autotest_72331/output//..
01:01:03.428  + rmdir ./nvmf-tcp-phy-autotest_72331/output/
01:01:03.428  + for dir in "${out_dirs[@]}"
01:01:03.428  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.428  + [[ -f ./nvmf-tcp-uring-vg-autotest_77405/output//doc.tar.xz ]]
01:01:03.428  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.428  + [[ -f ./nvmf-tcp-uring-vg-autotest_77405/output//ut_coverage.tar.xz ]]
01:01:03.428  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.428  + [[ -f ./nvmf-tcp-uring-vg-autotest_77405/output//llvm.tar.xz ]]
01:01:03.428  + mv ./nvmf-tcp-uring-vg-autotest_77405/output//all_tests.txt ./nvmf-tcp-uring-vg-autotest_77405/output//build-pkg-manifest.txt ./nvmf-tcp-uring-vg-autotest_77405/output//build-repo-manifest.txt ./nvmf-tcp-uring-vg-autotest_77405/output//cov_base.info.xz ./nvmf-tcp-uring-vg-autotest_77405/output//cov_test.info.xz ./nvmf-tcp-uring-vg-autotest_77405/output//cov_total.info.xz ./nvmf-tcp-uring-vg-autotest_77405/output//dmesg.init.log ./nvmf-tcp-uring-vg-autotest_77405/output//dmesg.log ./nvmf-tcp-uring-vg-autotest_77405/output//nvmf_trace.0_shm.tar.gz ./nvmf-tcp-uring-vg-autotest_77405/output//power.tar.xz ./nvmf-tcp-uring-vg-autotest_77405/output//test_completions.txt ./nvmf-tcp-uring-vg-autotest_77405/output//timing.svg ./nvmf-tcp-uring-vg-autotest_77405/output//timing.txt ./nvmf-tcp-uring-vg-autotest_77405/output//..
01:01:03.428  + rmdir ./nvmf-tcp-uring-vg-autotest_77405/output/
01:01:03.428  + for dir in "${out_dirs[@]}"
01:01:03.428  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.428  + [[ -f ./nvmf-tcp-vg-autotest_77471/output//doc.tar.xz ]]
01:01:03.428  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.428  + [[ -f ./nvmf-tcp-vg-autotest_77471/output//ut_coverage.tar.xz ]]
01:01:03.428  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.428  + [[ -f ./nvmf-tcp-vg-autotest_77471/output//llvm.tar.xz ]]
01:01:03.428  + mv ./nvmf-tcp-vg-autotest_77471/output//all_tests.txt ./nvmf-tcp-vg-autotest_77471/output//build-pkg-manifest.txt ./nvmf-tcp-vg-autotest_77471/output//build-repo-manifest.txt ./nvmf-tcp-vg-autotest_77471/output//cov_base.info.xz ./nvmf-tcp-vg-autotest_77471/output//cov_test.info.xz ./nvmf-tcp-vg-autotest_77471/output//cov_total.info.xz ./nvmf-tcp-vg-autotest_77471/output//dmesg.init.log ./nvmf-tcp-vg-autotest_77471/output//dmesg.log ./nvmf-tcp-vg-autotest_77471/output//nvmf_trace.0_shm.tar.gz ./nvmf-tcp-vg-autotest_77471/output//power.tar.xz ./nvmf-tcp-vg-autotest_77471/output//test_completions.txt ./nvmf-tcp-vg-autotest_77471/output//timing.svg ./nvmf-tcp-vg-autotest_77471/output//timing.txt ./nvmf-tcp-vg-autotest_77471/output//..
01:01:03.428  + rmdir ./nvmf-tcp-vg-autotest_77471/output/
01:01:03.428  + for dir in "${out_dirs[@]}"
01:01:03.428  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.428  + [[ -f ./packaging-docker-autotest_19864/output//doc.tar.xz ]]
01:01:03.428  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.428  + [[ -f ./packaging-docker-autotest_19864/output//ut_coverage.tar.xz ]]
01:01:03.428  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.428  + [[ -f ./packaging-docker-autotest_19864/output//llvm.tar.xz ]]
01:01:03.428  + mv ./packaging-docker-autotest_19864/output//build-pkg-manifest.txt ./packaging-docker-autotest_19864/output//build-repo-manifest.txt ./packaging-docker-autotest_19864/output//power.tar.xz ./packaging-docker-autotest_19864/output//test_completions.txt ./packaging-docker-autotest_19864/output//timing.txt ./packaging-docker-autotest_19864/output//..
01:01:03.428  + rmdir ./packaging-docker-autotest_19864/output/
01:01:03.428  + for dir in "${out_dirs[@]}"
01:01:03.428  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.428  + [[ -f ./rocky9-vg-autotest_16090/output//doc.tar.xz ]]
01:01:03.428  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.428  + [[ -f ./rocky9-vg-autotest_16090/output//ut_coverage.tar.xz ]]
01:01:03.428  + tar -C ./rocky9-vg-autotest_16090/output/ -xf ./rocky9-vg-autotest_16090/output//ut_coverage.tar.xz
01:01:03.685  + rm ./rocky9-vg-autotest_16090/output//ut_coverage.tar.xz
01:01:03.685  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.685  + [[ -f ./rocky9-vg-autotest_16090/output//llvm.tar.xz ]]
01:01:03.685  + mv ./rocky9-vg-autotest_16090/output//all_tests.txt ./rocky9-vg-autotest_16090/output//build-pkg-manifest.txt ./rocky9-vg-autotest_16090/output//build-repo-manifest.txt ./rocky9-vg-autotest_16090/output//cov_base.info.xz ./rocky9-vg-autotest_16090/output//cov_test.info.xz ./rocky9-vg-autotest_16090/output//cov_total.info.xz ./rocky9-vg-autotest_16090/output//dmesg.init.log ./rocky9-vg-autotest_16090/output//dmesg.log ./rocky9-vg-autotest_16090/output//power.tar.xz ./rocky9-vg-autotest_16090/output//test_completions.txt ./rocky9-vg-autotest_16090/output//timing.svg ./rocky9-vg-autotest_16090/output//timing.txt ./rocky9-vg-autotest_16090/output//ut_coverage ./rocky9-vg-autotest_16090/output//..
01:01:03.685  + rmdir ./rocky9-vg-autotest_16090/output/
01:01:03.685  + for dir in "${out_dirs[@]}"
01:01:03.685  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.685  + [[ -f ./scan-build-docker-autotest_19865/output//doc.tar.xz ]]
01:01:03.685  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.685  + [[ -f ./scan-build-docker-autotest_19865/output//ut_coverage.tar.xz ]]
01:01:03.685  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.685  + [[ -f ./scan-build-docker-autotest_19865/output//llvm.tar.xz ]]
01:01:03.686  + mv ./scan-build-docker-autotest_19865/output//all_c_files.txt ./scan-build-docker-autotest_19865/output//build_output.txt ./scan-build-docker-autotest_19865/output//build-pkg-manifest.txt ./scan-build-docker-autotest_19865/output//build-repo-manifest.txt ./scan-build-docker-autotest_19865/output//built_c_files.txt ./scan-build-docker-autotest_19865/output//power.tar.xz ./scan-build-docker-autotest_19865/output//test_completions.txt ./scan-build-docker-autotest_19865/output//timing.txt ./scan-build-docker-autotest_19865/output//unbuilt_c_files.txt ./scan-build-docker-autotest_19865/output//..
01:01:03.686  + rmdir ./scan-build-docker-autotest_19865/output/
01:01:03.686  + for dir in "${out_dirs[@]}"
01:01:03.686  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.686  + [[ -f ./short-fuzz-phy-autotest_26197/output//doc.tar.xz ]]
01:01:03.686  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.686  + [[ -f ./short-fuzz-phy-autotest_26197/output//ut_coverage.tar.xz ]]
01:01:03.686  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.686  + [[ -f ./short-fuzz-phy-autotest_26197/output//llvm.tar.xz ]]
01:01:03.686  + tar -C ./short-fuzz-phy-autotest_26197/output/ -xf ./short-fuzz-phy-autotest_26197/output//llvm.tar.xz
01:01:03.686  + rm ./short-fuzz-phy-autotest_26197/output//llvm.tar.xz
01:01:03.686  + mv ./short-fuzz-phy-autotest_26197/output//all_tests.txt ./short-fuzz-phy-autotest_26197/output//build-pkg-manifest.txt ./short-fuzz-phy-autotest_26197/output//build-repo-manifest.txt ./short-fuzz-phy-autotest_26197/output//dmesg.init.log ./short-fuzz-phy-autotest_26197/output//dmesg.log ./short-fuzz-phy-autotest_26197/output//llvm ./short-fuzz-phy-autotest_26197/output//power.tar.xz ./short-fuzz-phy-autotest_26197/output//test_completions.txt ./short-fuzz-phy-autotest_26197/output//timing.svg ./short-fuzz-phy-autotest_26197/output//timing.txt ./short-fuzz-phy-autotest_26197/output//..
01:01:03.686  + rmdir ./short-fuzz-phy-autotest_26197/output/
01:01:03.686  + for dir in "${out_dirs[@]}"
01:01:03.686  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.686  + [[ -f ./ubuntu20-vg-autotest_73799/output//doc.tar.xz ]]
01:01:03.686  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.686  + [[ -f ./ubuntu20-vg-autotest_73799/output//ut_coverage.tar.xz ]]
01:01:03.686  + tar -C ./ubuntu20-vg-autotest_73799/output/ -xf ./ubuntu20-vg-autotest_73799/output//ut_coverage.tar.xz
01:01:03.943  + rm ./ubuntu20-vg-autotest_73799/output//ut_coverage.tar.xz
01:01:03.943  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.943  + [[ -f ./ubuntu20-vg-autotest_73799/output//llvm.tar.xz ]]
01:01:03.943  + mv ./ubuntu20-vg-autotest_73799/output//all_tests.txt ./ubuntu20-vg-autotest_73799/output//build-pkg-manifest.txt ./ubuntu20-vg-autotest_73799/output//build-repo-manifest.txt ./ubuntu20-vg-autotest_73799/output//cov_base.info.xz ./ubuntu20-vg-autotest_73799/output//dmesg.init.log ./ubuntu20-vg-autotest_73799/output//dmesg.log ./ubuntu20-vg-autotest_73799/output//power.tar.xz ./ubuntu20-vg-autotest_73799/output//proc_list.txt ./ubuntu20-vg-autotest_73799/output//test_completions.txt ./ubuntu20-vg-autotest_73799/output//timing.txt ./ubuntu20-vg-autotest_73799/output//udev.log ./ubuntu20-vg-autotest_73799/output//ut_coverage ./ubuntu20-vg-autotest_73799/output//..
01:01:03.943  + rmdir ./ubuntu20-vg-autotest_73799/output/
01:01:03.943  + for dir in "${out_dirs[@]}"
01:01:03.943  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.943  + [[ -f ./ubuntu22-vg-autotest_37813/output//doc.tar.xz ]]
01:01:03.943  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:03.943  + [[ -f ./ubuntu22-vg-autotest_37813/output//ut_coverage.tar.xz ]]
01:01:03.943  + tar -C ./ubuntu22-vg-autotest_37813/output/ -xf ./ubuntu22-vg-autotest_37813/output//ut_coverage.tar.xz
01:01:04.200  + rm ./ubuntu22-vg-autotest_37813/output//ut_coverage.tar.xz
01:01:04.200  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:04.200  + [[ -f ./ubuntu22-vg-autotest_37813/output//llvm.tar.xz ]]
01:01:04.200  + mv ./ubuntu22-vg-autotest_37813/output//all_tests.txt ./ubuntu22-vg-autotest_37813/output//build-pkg-manifest.txt ./ubuntu22-vg-autotest_37813/output//build-repo-manifest.txt ./ubuntu22-vg-autotest_37813/output//cov_base.info.xz ./ubuntu22-vg-autotest_37813/output//cov_test.info.xz ./ubuntu22-vg-autotest_37813/output//cov_total.info.xz ./ubuntu22-vg-autotest_37813/output//dmesg.init.log ./ubuntu22-vg-autotest_37813/output//dmesg.log ./ubuntu22-vg-autotest_37813/output//power.tar.xz ./ubuntu22-vg-autotest_37813/output//test_completions.txt ./ubuntu22-vg-autotest_37813/output//timing.svg ./ubuntu22-vg-autotest_37813/output//timing.txt ./ubuntu22-vg-autotest_37813/output//ut_coverage ./ubuntu22-vg-autotest_37813/output//..
01:01:04.200  + rmdir ./ubuntu22-vg-autotest_37813/output/
01:01:04.200  + for dir in "${out_dirs[@]}"
01:01:04.200  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:04.200  + [[ -f ./unittest-clang-docker-autotest_19862/output//doc.tar.xz ]]
01:01:04.200  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:04.200  + [[ -f ./unittest-clang-docker-autotest_19862/output//ut_coverage.tar.xz ]]
01:01:04.200  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:04.200  + [[ -f ./unittest-clang-docker-autotest_19862/output//llvm.tar.xz ]]
01:01:04.200  + mv ./unittest-clang-docker-autotest_19862/output//build-pkg-manifest.txt ./unittest-clang-docker-autotest_19862/output//build-repo-manifest.txt ./unittest-clang-docker-autotest_19862/output//power.tar.xz ./unittest-clang-docker-autotest_19862/output//test_completions.txt ./unittest-clang-docker-autotest_19862/output//timing.txt ./unittest-clang-docker-autotest_19862/output//..
01:01:04.200  + rmdir ./unittest-clang-docker-autotest_19862/output/
01:01:04.200  + for dir in "${out_dirs[@]}"
01:01:04.200  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:04.200  + [[ -f ./unittest-main-docker-autotest_19863/output//doc.tar.xz ]]
01:01:04.200  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:04.200  + [[ -f ./unittest-main-docker-autotest_19863/output//ut_coverage.tar.xz ]]
01:01:04.200  + tar -C ./unittest-main-docker-autotest_19863/output/ -xf ./unittest-main-docker-autotest_19863/output//ut_coverage.tar.xz
01:01:04.457  + rm ./unittest-main-docker-autotest_19863/output//ut_coverage.tar.xz
01:01:04.457  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:04.457  + [[ -f ./unittest-main-docker-autotest_19863/output//llvm.tar.xz ]]
01:01:04.457  + mv ./unittest-main-docker-autotest_19863/output//build-pkg-manifest.txt ./unittest-main-docker-autotest_19863/output//build-repo-manifest.txt ./unittest-main-docker-autotest_19863/output//power.tar.xz ./unittest-main-docker-autotest_19863/output//test_completions.txt ./unittest-main-docker-autotest_19863/output//timing.txt ./unittest-main-docker-autotest_19863/output//ut_coverage ./unittest-main-docker-autotest_19863/output//..
01:01:04.457  + rmdir ./unittest-main-docker-autotest_19863/output/
01:01:04.457  + for dir in "${out_dirs[@]}"
01:01:04.457  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:04.457  + [[ -f ./unittest-valgrind-docker-autotest_19866/output//doc.tar.xz ]]
01:01:04.457  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:04.457  + [[ -f ./unittest-valgrind-docker-autotest_19866/output//ut_coverage.tar.xz ]]
01:01:04.457  + tar -C ./unittest-valgrind-docker-autotest_19866/output/ -xf ./unittest-valgrind-docker-autotest_19866/output//ut_coverage.tar.xz
01:01:04.714  + rm ./unittest-valgrind-docker-autotest_19866/output//ut_coverage.tar.xz
01:01:04.714  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:04.714  + [[ -f ./unittest-valgrind-docker-autotest_19866/output//llvm.tar.xz ]]
01:01:04.714  + mv ./unittest-valgrind-docker-autotest_19866/output//build-pkg-manifest.txt ./unittest-valgrind-docker-autotest_19866/output//build-repo-manifest.txt ./unittest-valgrind-docker-autotest_19866/output//power.tar.xz ./unittest-valgrind-docker-autotest_19866/output//test_completions.txt ./unittest-valgrind-docker-autotest_19866/output//timing.txt ./unittest-valgrind-docker-autotest_19866/output//ut_coverage ./unittest-valgrind-docker-autotest_19866/output//..
01:01:04.714  + rmdir ./unittest-valgrind-docker-autotest_19866/output/
01:01:04.714  + for dir in "${out_dirs[@]}"
01:01:04.714  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:04.714  + [[ -f ./vfio-user-phy-autotest_26208/output//doc.tar.xz ]]
01:01:04.714  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:04.714  + [[ -f ./vfio-user-phy-autotest_26208/output//ut_coverage.tar.xz ]]
01:01:04.714  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:04.714  + [[ -f ./vfio-user-phy-autotest_26208/output//llvm.tar.xz ]]
01:01:04.714  + mv ./vfio-user-phy-autotest_26208/output//all_tests.txt ./vfio-user-phy-autotest_26208/output//build-pkg-manifest.txt ./vfio-user-phy-autotest_26208/output//build-repo-manifest.txt ./vfio-user-phy-autotest_26208/output//cov_base.info.xz ./vfio-user-phy-autotest_26208/output//cov_test.info.xz ./vfio-user-phy-autotest_26208/output//cov_total.info.xz ./vfio-user-phy-autotest_26208/output//dmesg.init.log ./vfio-user-phy-autotest_26208/output//dmesg.log ./vfio-user-phy-autotest_26208/output//power.tar.xz ./vfio-user-phy-autotest_26208/output//test_completions.txt ./vfio-user-phy-autotest_26208/output//timing.svg ./vfio-user-phy-autotest_26208/output//timing.txt ./vfio-user-phy-autotest_26208/output//..
01:01:04.714  + rmdir ./vfio-user-phy-autotest_26208/output/
01:01:04.714  + for dir in "${out_dirs[@]}"
01:01:04.714  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:04.714  + [[ -f ./vhost-initiator-vg-autotest_77500/output//doc.tar.xz ]]
01:01:04.714  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:04.714  + [[ -f ./vhost-initiator-vg-autotest_77500/output//ut_coverage.tar.xz ]]
01:01:04.714  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:04.714  + [[ -f ./vhost-initiator-vg-autotest_77500/output//llvm.tar.xz ]]
01:01:04.714  + mv ./vhost-initiator-vg-autotest_77500/output//all_tests.txt ./vhost-initiator-vg-autotest_77500/output//build-pkg-manifest.txt ./vhost-initiator-vg-autotest_77500/output//build-repo-manifest.txt ./vhost-initiator-vg-autotest_77500/output//cov_base.info.xz ./vhost-initiator-vg-autotest_77500/output//cov_test.info.xz ./vhost-initiator-vg-autotest_77500/output//cov_total.info.xz ./vhost-initiator-vg-autotest_77500/output//dmesg.init.log ./vhost-initiator-vg-autotest_77500/output//dmesg.log ./vhost-initiator-vg-autotest_77500/output//power.tar.xz ./vhost-initiator-vg-autotest_77500/output//test_completions.txt ./vhost-initiator-vg-autotest_77500/output//timing.svg ./vhost-initiator-vg-autotest_77500/output//timing.txt ./vhost-initiator-vg-autotest_77500/output//vhost_fuzz_output1.txt.xz ./vhost-initiator-vg-autotest_77500/output//vhost_fuzz_output2.txt.xz ./vhost-initiator-vg-autotest_77500/output//vhost_fuzz_tgt_output.txt.xz ./vhost-initiator-vg-autotest_77500/output//..
01:01:04.714  + rmdir ./vhost-initiator-vg-autotest_77500/output/
01:01:04.714  + for dir in "${out_dirs[@]}"
01:01:04.714  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:04.714  + [[ -f ./vhost-phy-autotest_26225/output//doc.tar.xz ]]
01:01:04.714  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:04.714  + [[ -f ./vhost-phy-autotest_26225/output//ut_coverage.tar.xz ]]
01:01:04.714  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:04.714  + [[ -f ./vhost-phy-autotest_26225/output//llvm.tar.xz ]]
01:01:04.715  + mv ./vhost-phy-autotest_26225/output//all_tests.txt ./vhost-phy-autotest_26225/output//build-pkg-manifest.txt ./vhost-phy-autotest_26225/output//build-repo-manifest.txt ./vhost-phy-autotest_26225/output//cov_base.info.xz ./vhost-phy-autotest_26225/output//cov_test.info.xz ./vhost-phy-autotest_26225/output//cov_total.info.xz ./vhost-phy-autotest_26225/output//dmesg.init.log ./vhost-phy-autotest_26225/output//dmesg.log ./vhost-phy-autotest_26225/output//power.tar.xz ./vhost-phy-autotest_26225/output//test_completions.txt ./vhost-phy-autotest_26225/output//timing.svg ./vhost-phy-autotest_26225/output//timing.txt ./vhost-phy-autotest_26225/output//..
01:01:04.715  + rmdir ./vhost-phy-autotest_26225/output/
01:01:04.715  + for dir in "${out_dirs[@]}"
01:01:04.715  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:04.715  + [[ -f ./zns-vg-autotest_76586/output//doc.tar.xz ]]
01:01:04.715  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:04.715  + [[ -f ./zns-vg-autotest_76586/output//ut_coverage.tar.xz ]]
01:01:04.715  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
01:01:04.715  + [[ -f ./zns-vg-autotest_76586/output//llvm.tar.xz ]]
01:01:04.715  + mv ./zns-vg-autotest_76586/output//all_tests.txt ./zns-vg-autotest_76586/output//build-pkg-manifest.txt ./zns-vg-autotest_76586/output//build-repo-manifest.txt ./zns-vg-autotest_76586/output//cov_base.info.xz ./zns-vg-autotest_76586/output//cov_test.info.xz ./zns-vg-autotest_76586/output//cov_total.info.xz ./zns-vg-autotest_76586/output//dmesg.init.log ./zns-vg-autotest_76586/output//dmesg.log ./zns-vg-autotest_76586/output//power.tar.xz ./zns-vg-autotest_76586/output//test_completions.txt ./zns-vg-autotest_76586/output//timing.svg ./zns-vg-autotest_76586/output//timing.txt ./zns-vg-autotest_76586/output//..
01:01:04.715  + rmdir ./zns-vg-autotest_76586/output/
01:01:04.715  + unpack_cov_files
01:01:04.715  + local info_files
01:01:04.715  + info_files=(*/cov_*.info.xz)
01:01:04.715  + xargs -P0 -r -n1 xz -d
01:01:04.715  + printf '%s\n' BlobFS-phy-autotest_26206/cov_base.info.xz BlobFS-phy-autotest_26206/cov_test.info.xz BlobFS-phy-autotest_26206/cov_total.info.xz centos7-vg-autotest_73659/cov_base.info.xz centos7-vg-autotest_73659/cov_test.info.xz centos7-vg-autotest_73659/cov_total.info.xz crypto-phy-autotest_26200/cov_base.info.xz crypto-phy-autotest_26200/cov_test.info.xz crypto-phy-autotest_26200/cov_total.info.xz dsa-phy-autotest_4900/cov_base.info.xz dsa-phy-autotest_4900/cov_test.info.xz dsa-phy-autotest_4900/cov_total.info.xz iscsi-uring-vg-autotest_77385/cov_base.info.xz iscsi-uring-vg-autotest_77385/cov_test.info.xz iscsi-uring-vg-autotest_77385/cov_total.info.xz iscsi-vg-autotest_77518/cov_base.info.xz iscsi-vg-autotest_77518/cov_test.info.xz iscsi-vg-autotest_77518/cov_total.info.xz lvol-vg-autotest_77429/cov_base.info.xz lvol-vg-autotest_77429/cov_test.info.xz lvol-vg-autotest_77429/cov_total.info.xz nvme-cmb-pmr-vg-autotest_78603/cov_base.info.xz nvme-cmb-pmr-vg-autotest_78603/cov_test.info.xz nvme-cmb-pmr-vg-autotest_78603/cov_total.info.xz nvme-phy-autotest_72372/cov_base.info.xz nvme-phy-autotest_72372/cov_test.info.xz nvme-phy-autotest_72372/cov_total.info.xz nvme-vg-autotest_77480/cov_base.info.xz nvmf-phy-autotest_72444/cov_base.info.xz nvmf-phy-autotest_72444/cov_test.info.xz nvmf-phy-autotest_72444/cov_total.info.xz nvmf-tcp-phy-autotest_72331/cov_base.info.xz nvmf-tcp-phy-autotest_72331/cov_test.info.xz nvmf-tcp-phy-autotest_72331/cov_total.info.xz nvmf-tcp-uring-vg-autotest_77405/cov_base.info.xz nvmf-tcp-uring-vg-autotest_77405/cov_test.info.xz nvmf-tcp-uring-vg-autotest_77405/cov_total.info.xz nvmf-tcp-vg-autotest_77471/cov_base.info.xz nvmf-tcp-vg-autotest_77471/cov_test.info.xz nvmf-tcp-vg-autotest_77471/cov_total.info.xz rocky9-vg-autotest_16090/cov_base.info.xz rocky9-vg-autotest_16090/cov_test.info.xz rocky9-vg-autotest_16090/cov_total.info.xz ubuntu20-vg-autotest_73799/cov_base.info.xz ubuntu22-vg-autotest_37813/cov_base.info.xz ubuntu22-vg-autotest_37813/cov_test.info.xz ubuntu22-vg-autotest_37813/cov_total.info.xz vfio-user-phy-autotest_26208/cov_base.info.xz vfio-user-phy-autotest_26208/cov_test.info.xz vfio-user-phy-autotest_26208/cov_total.info.xz vhost-initiator-vg-autotest_77500/cov_base.info.xz vhost-initiator-vg-autotest_77500/cov_test.info.xz vhost-initiator-vg-autotest_77500/cov_total.info.xz vhost-phy-autotest_26225/cov_base.info.xz vhost-phy-autotest_26225/cov_test.info.xz vhost-phy-autotest_26225/cov_total.info.xz zns-vg-autotest_76586/cov_base.info.xz zns-vg-autotest_76586/cov_test.info.xz zns-vg-autotest_76586/cov_total.info.xz
01:01:04.973  + fix_downstream_job_paths
01:01:04.973  + sed -i -e 's#^SF:/.\+/spdk/#SF:/var/jenkins/workspace/autotest-per-patch/spdk/#g' BlobFS-phy-autotest_26206/cov_total.info centos7-vg-autotest_73659/cov_total.info crypto-phy-autotest_26200/cov_total.info dsa-phy-autotest_4900/cov_total.info iscsi-uring-vg-autotest_77385/cov_total.info iscsi-vg-autotest_77518/cov_total.info lvol-vg-autotest_77429/cov_total.info nvme-cmb-pmr-vg-autotest_78603/cov_total.info nvme-phy-autotest_72372/cov_total.info nvmf-phy-autotest_72444/cov_total.info nvmf-tcp-phy-autotest_72331/cov_total.info nvmf-tcp-uring-vg-autotest_77405/cov_total.info nvmf-tcp-vg-autotest_77471/cov_total.info rocky9-vg-autotest_16090/cov_total.info ubuntu22-vg-autotest_37813/cov_total.info vfio-user-phy-autotest_26208/cov_total.info vhost-initiator-vg-autotest_77500/cov_total.info vhost-phy-autotest_26225/cov_total.info zns-vg-autotest_76586/cov_total.info
01:01:06.350  + ignore_ocf_headers
01:01:06.350  + sed -i 's#--show-details#--show-details --ignore-errors source#g' spdk/autorun_post.py
01:01:06.350  + create_errtrace_files_for_all_builds
01:01:06.350  + local build_log_list
01:01:06.350  + build_log_list=($(find "$WORKSPACE" -type f -name 'build.log'))
01:01:06.350  ++ find /var/jenkins/workspace/autotest-per-patch -type f -name build.log
01:01:06.350  + for build in "${build_log_list[@]}"
01:01:06.350  + create_errtrace_file /var/jenkins/workspace/autotest-per-patch/unittest-clang-docker-autotest_19862/build.log
01:01:06.350  + local build_log job_name start_pattern end_pattern backtraces
01:01:06.350  + build_log=/var/jenkins/workspace/autotest-per-patch/unittest-clang-docker-autotest_19862/build.log
01:01:06.350  +++ dirname /var/jenkins/workspace/autotest-per-patch/unittest-clang-docker-autotest_19862/build.log
01:01:06.350  ++ basename /var/jenkins/workspace/autotest-per-patch/unittest-clang-docker-autotest_19862
01:01:06.350  + job_name=unittest-clang-docker-autotest_19862
01:01:06.350  + start_pattern='Backtrace start'
01:01:06.350  + end_pattern='Backtrace end'
01:01:06.350  + [[ -f /var/jenkins/workspace/autotest-per-patch/unittest-clang-docker-autotest_19862/build.log ]]
01:01:06.350  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch/unittest-clang-docker-autotest_19862/build.log
01:01:06.350  + backtraces=
01:01:06.350  + [[ -n '' ]]
01:01:06.350  + for build in "${build_log_list[@]}"
01:01:06.350  + create_errtrace_file /var/jenkins/workspace/autotest-per-patch/doc-docker-autotest_22325/build.log
01:01:06.350  + local build_log job_name start_pattern end_pattern backtraces
01:01:06.350  + build_log=/var/jenkins/workspace/autotest-per-patch/doc-docker-autotest_22325/build.log
01:01:06.350  +++ dirname /var/jenkins/workspace/autotest-per-patch/doc-docker-autotest_22325/build.log
01:01:06.350  ++ basename /var/jenkins/workspace/autotest-per-patch/doc-docker-autotest_22325
01:01:06.350  + job_name=doc-docker-autotest_22325
01:01:06.350  + start_pattern='Backtrace start'
01:01:06.350  + end_pattern='Backtrace end'
01:01:06.350  + [[ -f /var/jenkins/workspace/autotest-per-patch/doc-docker-autotest_22325/build.log ]]
01:01:06.350  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch/doc-docker-autotest_22325/build.log
01:01:06.350  + backtraces=
01:01:06.350  + [[ -n '' ]]
01:01:06.350  + for build in "${build_log_list[@]}"
01:01:06.350  + create_errtrace_file /var/jenkins/workspace/autotest-per-patch/zns-vg-autotest_76586/build.log
01:01:06.350  + local build_log job_name start_pattern end_pattern backtraces
01:01:06.350  + build_log=/var/jenkins/workspace/autotest-per-patch/zns-vg-autotest_76586/build.log
01:01:06.350  +++ dirname /var/jenkins/workspace/autotest-per-patch/zns-vg-autotest_76586/build.log
01:01:06.350  ++ basename /var/jenkins/workspace/autotest-per-patch/zns-vg-autotest_76586
01:01:06.350  + job_name=zns-vg-autotest_76586
01:01:06.350  + start_pattern='Backtrace start'
01:01:06.350  + end_pattern='Backtrace end'
01:01:06.350  + [[ -f /var/jenkins/workspace/autotest-per-patch/zns-vg-autotest_76586/build.log ]]
01:01:06.350  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch/zns-vg-autotest_76586/build.log
01:01:06.350  + backtraces=
01:01:06.350  + [[ -n '' ]]
01:01:06.350  + for build in "${build_log_list[@]}"
01:01:06.350  + create_errtrace_file /var/jenkins/workspace/autotest-per-patch/unittest-valgrind-docker-autotest_19866/build.log
01:01:06.350  + local build_log job_name start_pattern end_pattern backtraces
01:01:06.350  + build_log=/var/jenkins/workspace/autotest-per-patch/unittest-valgrind-docker-autotest_19866/build.log
01:01:06.350  +++ dirname /var/jenkins/workspace/autotest-per-patch/unittest-valgrind-docker-autotest_19866/build.log
01:01:06.350  ++ basename /var/jenkins/workspace/autotest-per-patch/unittest-valgrind-docker-autotest_19866
01:01:06.350  + job_name=unittest-valgrind-docker-autotest_19866
01:01:06.350  + start_pattern='Backtrace start'
01:01:06.350  + end_pattern='Backtrace end'
01:01:06.350  + [[ -f /var/jenkins/workspace/autotest-per-patch/unittest-valgrind-docker-autotest_19866/build.log ]]
01:01:06.350  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch/unittest-valgrind-docker-autotest_19866/build.log
01:01:06.350  + backtraces=
01:01:06.350  + [[ -n '' ]]
01:01:06.350  + for build in "${build_log_list[@]}"
01:01:06.350  + create_errtrace_file /var/jenkins/workspace/autotest-per-patch/nvmf-tcp-vg-autotest_77471/build.log
01:01:06.350  + local build_log job_name start_pattern end_pattern backtraces
01:01:06.350  + build_log=/var/jenkins/workspace/autotest-per-patch/nvmf-tcp-vg-autotest_77471/build.log
01:01:06.350  +++ dirname /var/jenkins/workspace/autotest-per-patch/nvmf-tcp-vg-autotest_77471/build.log
01:01:06.350  ++ basename /var/jenkins/workspace/autotest-per-patch/nvmf-tcp-vg-autotest_77471
01:01:06.350  + job_name=nvmf-tcp-vg-autotest_77471
01:01:06.350  + start_pattern='Backtrace start'
01:01:06.350  + end_pattern='Backtrace end'
01:01:06.350  + [[ -f /var/jenkins/workspace/autotest-per-patch/nvmf-tcp-vg-autotest_77471/build.log ]]
01:01:06.350  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch/nvmf-tcp-vg-autotest_77471/build.log
01:01:06.350  + backtraces=
01:01:06.350  + [[ -n '' ]]
01:01:06.350  + for build in "${build_log_list[@]}"
01:01:06.350  + create_errtrace_file /var/jenkins/workspace/autotest-per-patch/vhost-initiator-vg-autotest_77500/build.log
01:01:06.350  + local build_log job_name start_pattern end_pattern backtraces
01:01:06.350  + build_log=/var/jenkins/workspace/autotest-per-patch/vhost-initiator-vg-autotest_77500/build.log
01:01:06.350  +++ dirname /var/jenkins/workspace/autotest-per-patch/vhost-initiator-vg-autotest_77500/build.log
01:01:06.350  ++ basename /var/jenkins/workspace/autotest-per-patch/vhost-initiator-vg-autotest_77500
01:01:06.350  + job_name=vhost-initiator-vg-autotest_77500
01:01:06.350  + start_pattern='Backtrace start'
01:01:06.350  + end_pattern='Backtrace end'
01:01:06.350  + [[ -f /var/jenkins/workspace/autotest-per-patch/vhost-initiator-vg-autotest_77500/build.log ]]
01:01:06.350  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch/vhost-initiator-vg-autotest_77500/build.log
01:01:06.350  + backtraces=
01:01:06.350  + [[ -n '' ]]
01:01:06.350  + for build in "${build_log_list[@]}"
01:01:06.350  + create_errtrace_file /var/jenkins/workspace/autotest-per-patch/scan-build-docker-autotest_19865/build.log
01:01:06.350  + local build_log job_name start_pattern end_pattern backtraces
01:01:06.350  + build_log=/var/jenkins/workspace/autotest-per-patch/scan-build-docker-autotest_19865/build.log
01:01:06.350  +++ dirname /var/jenkins/workspace/autotest-per-patch/scan-build-docker-autotest_19865/build.log
01:01:06.350  ++ basename /var/jenkins/workspace/autotest-per-patch/scan-build-docker-autotest_19865
01:01:06.350  + job_name=scan-build-docker-autotest_19865
01:01:06.350  + start_pattern='Backtrace start'
01:01:06.350  + end_pattern='Backtrace end'
01:01:06.350  + [[ -f /var/jenkins/workspace/autotest-per-patch/scan-build-docker-autotest_19865/build.log ]]
01:01:06.350  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch/scan-build-docker-autotest_19865/build.log
01:01:06.350  + backtraces=
01:01:06.350  + [[ -n '' ]]
01:01:06.350  + for build in "${build_log_list[@]}"
01:01:06.350  + create_errtrace_file /var/jenkins/workspace/autotest-per-patch/check-format-docker-autotest_22145/build.log
01:01:06.350  + local build_log job_name start_pattern end_pattern backtraces
01:01:06.350  + build_log=/var/jenkins/workspace/autotest-per-patch/check-format-docker-autotest_22145/build.log
01:01:06.350  +++ dirname /var/jenkins/workspace/autotest-per-patch/check-format-docker-autotest_22145/build.log
01:01:06.350  ++ basename /var/jenkins/workspace/autotest-per-patch/check-format-docker-autotest_22145
01:01:06.350  + job_name=check-format-docker-autotest_22145
01:01:06.350  + start_pattern='Backtrace start'
01:01:06.350  + end_pattern='Backtrace end'
01:01:06.350  + [[ -f /var/jenkins/workspace/autotest-per-patch/check-format-docker-autotest_22145/build.log ]]
01:01:06.350  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch/check-format-docker-autotest_22145/build.log
01:01:06.350  + backtraces=
01:01:06.350  + [[ -n '' ]]
01:01:06.350  + for build in "${build_log_list[@]}"
01:01:06.350  + create_errtrace_file /var/jenkins/workspace/autotest-per-patch/lvol-vg-autotest_77429/build.log
01:01:06.350  + local build_log job_name start_pattern end_pattern backtraces
01:01:06.350  + build_log=/var/jenkins/workspace/autotest-per-patch/lvol-vg-autotest_77429/build.log
01:01:06.350  +++ dirname /var/jenkins/workspace/autotest-per-patch/lvol-vg-autotest_77429/build.log
01:01:06.350  ++ basename /var/jenkins/workspace/autotest-per-patch/lvol-vg-autotest_77429
01:01:06.350  + job_name=lvol-vg-autotest_77429
01:01:06.350  + start_pattern='Backtrace start'
01:01:06.350  + end_pattern='Backtrace end'
01:01:06.350  + [[ -f /var/jenkins/workspace/autotest-per-patch/lvol-vg-autotest_77429/build.log ]]
01:01:06.350  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch/lvol-vg-autotest_77429/build.log
01:01:06.350  + backtraces=
01:01:06.350  + [[ -n '' ]]
01:01:06.350  + for build in "${build_log_list[@]}"
01:01:06.350  + create_errtrace_file /var/jenkins/workspace/autotest-per-patch/iscsi-uring-vg-autotest_77385/build.log
01:01:06.350  + local build_log job_name start_pattern end_pattern backtraces
01:01:06.350  + build_log=/var/jenkins/workspace/autotest-per-patch/iscsi-uring-vg-autotest_77385/build.log
01:01:06.350  +++ dirname /var/jenkins/workspace/autotest-per-patch/iscsi-uring-vg-autotest_77385/build.log
01:01:06.350  ++ basename /var/jenkins/workspace/autotest-per-patch/iscsi-uring-vg-autotest_77385
01:01:06.350  + job_name=iscsi-uring-vg-autotest_77385
01:01:06.350  + start_pattern='Backtrace start'
01:01:06.350  + end_pattern='Backtrace end'
01:01:06.350  + [[ -f /var/jenkins/workspace/autotest-per-patch/iscsi-uring-vg-autotest_77385/build.log ]]
01:01:06.350  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch/iscsi-uring-vg-autotest_77385/build.log
01:01:06.351  + backtraces=
01:01:06.351  + [[ -n '' ]]
01:01:06.351  + for build in "${build_log_list[@]}"
01:01:06.351  + create_errtrace_file /var/jenkins/workspace/autotest-per-patch/nvmf-phy-autotest_72444/build.log
01:01:06.351  + local build_log job_name start_pattern end_pattern backtraces
01:01:06.351  + build_log=/var/jenkins/workspace/autotest-per-patch/nvmf-phy-autotest_72444/build.log
01:01:06.351  +++ dirname /var/jenkins/workspace/autotest-per-patch/nvmf-phy-autotest_72444/build.log
01:01:06.351  ++ basename /var/jenkins/workspace/autotest-per-patch/nvmf-phy-autotest_72444
01:01:06.351  + job_name=nvmf-phy-autotest_72444
01:01:06.351  + start_pattern='Backtrace start'
01:01:06.351  + end_pattern='Backtrace end'
01:01:06.351  + [[ -f /var/jenkins/workspace/autotest-per-patch/nvmf-phy-autotest_72444/build.log ]]
01:01:06.351  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch/nvmf-phy-autotest_72444/build.log
01:01:06.351  + backtraces=
01:01:06.351  + [[ -n '' ]]
01:01:06.351  + for build in "${build_log_list[@]}"
01:01:06.351  + create_errtrace_file /var/jenkins/workspace/autotest-per-patch/crypto-phy-autotest_26200/build.log
01:01:06.351  + local build_log job_name start_pattern end_pattern backtraces
01:01:06.351  + build_log=/var/jenkins/workspace/autotest-per-patch/crypto-phy-autotest_26200/build.log
01:01:06.351  +++ dirname /var/jenkins/workspace/autotest-per-patch/crypto-phy-autotest_26200/build.log
01:01:06.351  ++ basename /var/jenkins/workspace/autotest-per-patch/crypto-phy-autotest_26200
01:01:06.351  + job_name=crypto-phy-autotest_26200
01:01:06.351  + start_pattern='Backtrace start'
01:01:06.351  + end_pattern='Backtrace end'
01:01:06.351  + [[ -f /var/jenkins/workspace/autotest-per-patch/crypto-phy-autotest_26200/build.log ]]
01:01:06.351  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch/crypto-phy-autotest_26200/build.log
01:01:06.351  + backtraces=
01:01:06.351  + [[ -n '' ]]
01:01:06.351  + for build in "${build_log_list[@]}"
01:01:06.351  + create_errtrace_file /var/jenkins/workspace/autotest-per-patch/centos7-vg-autotest_73659/build.log
01:01:06.351  + local build_log job_name start_pattern end_pattern backtraces
01:01:06.351  + build_log=/var/jenkins/workspace/autotest-per-patch/centos7-vg-autotest_73659/build.log
01:01:06.351  +++ dirname /var/jenkins/workspace/autotest-per-patch/centos7-vg-autotest_73659/build.log
01:01:06.351  ++ basename /var/jenkins/workspace/autotest-per-patch/centos7-vg-autotest_73659
01:01:06.351  + job_name=centos7-vg-autotest_73659
01:01:06.351  + start_pattern='Backtrace start'
01:01:06.351  + end_pattern='Backtrace end'
01:01:06.351  + [[ -f /var/jenkins/workspace/autotest-per-patch/centos7-vg-autotest_73659/build.log ]]
01:01:06.351  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch/centos7-vg-autotest_73659/build.log
01:01:06.351  + backtraces=
01:01:06.351  + [[ -n '' ]]
01:01:06.351  + for build in "${build_log_list[@]}"
01:01:06.351  + create_errtrace_file /var/jenkins/workspace/autotest-per-patch/nvme-vg-autotest_77480/build.log
01:01:06.351  + local build_log job_name start_pattern end_pattern backtraces
01:01:06.351  + build_log=/var/jenkins/workspace/autotest-per-patch/nvme-vg-autotest_77480/build.log
01:01:06.351  +++ dirname /var/jenkins/workspace/autotest-per-patch/nvme-vg-autotest_77480/build.log
01:01:06.351  ++ basename /var/jenkins/workspace/autotest-per-patch/nvme-vg-autotest_77480
01:01:06.351  + job_name=nvme-vg-autotest_77480
01:01:06.351  + start_pattern='Backtrace start'
01:01:06.351  + end_pattern='Backtrace end'
01:01:06.351  + [[ -f /var/jenkins/workspace/autotest-per-patch/nvme-vg-autotest_77480/build.log ]]
01:01:06.351  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch/nvme-vg-autotest_77480/build.log
01:01:06.351  + backtraces='00:19:21.691    08:38:36 sw_hotplug -- common/autotest_common.sh@715 -- # time='\''========== Backtrace start: ==========
01:01:06.351  00:19:21.691  
01:01:06.351  00:19:21.691  in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"])
01:01:06.351  00:19:21.691       ...
01:01:06.351  00:19:21.691     710 	
01:01:06.351  00:19:21.691     711 		# We redirect cmd'\''\'\'''\''s std{out,err} to a separate fd dup'\''\'\'''\''ed to stdin'\''\'\'''\''s device (or /dev/null) to
01:01:06.351  00:19:21.691     712 		# catch only output from the time builtin - output from the actual cmd would be still visible,
01:01:06.351  00:19:21.691     713 		# but $() will return just the time'\''\'\'''\''s data, hence making it possible to just do:
01:01:06.351  00:19:21.691     714 		#  time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd)
01:01:06.351  00:19:21.691  => 715 		time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1)
01:01:06.351  00:19:21.691     716 	
01:01:06.351  00:19:21.692     717 		echo "$time"
01:01:06.351  00:19:21.692     718 	)
01:01:06.351  00:19:21.692     719 	
01:01:06.351  00:19:21.692     720 	function timing_enter() {
01:01:06.351  00:19:21.692       ...
01:01:06.351  00:19:21.692  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"])
01:01:06.351  00:19:21.692       ...
01:01:06.351  00:19:21.692     11  	# Pci bus hotplug
01:01:06.351  00:19:21.692     12  	# Helper function to remove/attach cotrollers
01:01:06.351  00:19:21.692     13  	debug_remove_attach_helper() {
01:01:06.351  00:19:21.692     14  		local helper_time=0
01:01:06.351  00:19:21.692     15  	
01:01:06.351  00:19:21.692  => 16  		helper_time=$(timing_cmd remove_attach_helper "$@")
01:01:06.351  00:19:21.692     17  		printf '\''\'\'''\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\''\'\'''\'' \
01:01:06.351  00:19:21.692     18  			"$helper_time" "$nvme_count" >&2
01:01:06.351  00:19:21.692     19  	}
01:01:06.351  00:19:21.692     20  	
01:01:06.351  00:19:21.692     21  	remove_attach_helper() {
01:01:06.351  00:19:21.692       ...
01:01:06.351  00:19:21.692  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([])
01:01:06.351  00:19:21.692       ...
01:01:06.351  00:19:21.692     105 			waitforbdev "Nvme0${dev}n1" "$hotplug_wait"
01:01:06.351  00:19:21.692     106 		done
01:01:06.351  00:19:21.692     107 	
01:01:06.351  00:19:21.692     108 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.351  00:19:21.692     109 	
01:01:06.351  00:19:21.692  => 110 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.351  00:19:21.692     111 		# Verify reregistering hotplug poller
01:01:06.351  00:19:21.692     112 		rpc_cmd bdev_nvme_set_hotplug -d
01:01:06.351  00:19:21.692     113 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.351  00:19:21.692     114 	
01:01:06.351  00:19:21.692     115 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.351  00:19:21.692       ...
01:01:06.351  00:19:21.692  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([])
01:01:06.351  00:19:21.692       ...
01:01:06.351  00:19:21.692     133 	
01:01:06.351  00:19:21.692     134 	# Run pci bus hotplug test
01:01:06.351  00:19:21.692     135 	run_hotplug
01:01:06.351  00:19:21.692     136 	
01:01:06.351  00:19:21.692     137 	# Run SPDK target based hotplug
01:01:06.351  00:19:21.692  => 138 	tgt_run_hotplug
01:01:06.351  00:19:21.692       ...
01:01:06.351  00:19:21.692  
01:01:06.351  00:19:21.692  ========== Backtrace end =========='\''
01:01:06.351  00:19:21.692  ========== Backtrace start: ==========
01:01:06.351  00:19:21.692  
01:01:06.351  00:19:21.692  in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"])
01:01:06.351  00:19:21.692       ...
01:01:06.351  00:19:21.692     710 	
01:01:06.351  00:19:21.692     711 		# We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to
01:01:06.351  00:19:21.692     712 		# catch only output from the time builtin - output from the actual cmd would be still visible,
01:01:06.351  00:19:21.692     713 		# but $() will return just the time'\''s data, hence making it possible to just do:
01:01:06.351  00:19:21.692     714 		#  time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd)
01:01:06.351  00:19:21.692  => 715 		time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1)
01:01:06.351  00:19:21.692     716 	
01:01:06.351  00:19:21.692     717 		echo "$time"
01:01:06.351  00:19:21.692     718 	)
01:01:06.351  00:19:21.692     719 	
01:01:06.351  00:19:21.692     720 	function timing_enter() {
01:01:06.351  00:19:21.692       ...
01:01:06.351  00:19:21.692  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"])
01:01:06.351  00:19:21.692       ...
01:01:06.351  00:19:21.692     11  	# Pci bus hotplug
01:01:06.351  00:19:21.692     12  	# Helper function to remove/attach cotrollers
01:01:06.351  00:19:21.692     13  	debug_remove_attach_helper() {
01:01:06.351  00:19:21.692     14  		local helper_time=0
01:01:06.351  00:19:21.692     15  	
01:01:06.351  00:19:21.692  => 16  		helper_time=$(timing_cmd remove_attach_helper "$@")
01:01:06.351  00:19:21.692     17  		printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \
01:01:06.351  00:19:21.692     18  			"$helper_time" "$nvme_count" >&2
01:01:06.351  00:19:21.692     19  	}
01:01:06.351  00:19:21.692     20  	
01:01:06.351  00:19:21.692     21  	remove_attach_helper() {
01:01:06.351  00:19:21.692       ...
01:01:06.351  00:19:21.692  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([])
01:01:06.351  00:19:21.692       ...
01:01:06.351  00:19:21.692     105 			waitforbdev "Nvme0${dev}n1" "$hotplug_wait"
01:01:06.351  00:19:21.692     106 		done
01:01:06.351  00:19:21.692     107 	
01:01:06.351  00:19:21.692     108 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.351  00:19:21.692     109 	
01:01:06.351  00:19:21.692  => 110 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.351  00:19:21.692     111 		# Verify reregistering hotplug poller
01:01:06.351  00:19:21.692     112 		rpc_cmd bdev_nvme_set_hotplug -d
01:01:06.351  00:19:21.692     113 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.351  00:19:21.692     114 	
01:01:06.351  00:19:21.692     115 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.351  00:19:21.692       ...
01:01:06.351  00:19:21.692  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([])
01:01:06.351  00:19:21.692       ...
01:01:06.351  00:19:21.692     133 	
01:01:06.351  00:19:21.692     134 	# Run pci bus hotplug test
01:01:06.351  00:19:21.692     135 	run_hotplug
01:01:06.351  00:19:21.692     136 	
01:01:06.352  00:19:21.692     137 	# Run SPDK target based hotplug
01:01:06.352  00:19:21.692  => 138 	tgt_run_hotplug
01:01:06.352  00:19:21.692       ...
01:01:06.352  00:19:21.692  
01:01:06.352  00:19:21.692  ========== Backtrace end ==========
01:01:06.352  00:19:21.692  ========== Backtrace start: ==========
01:01:06.352  00:19:21.692  
01:01:06.352  00:19:21.692  in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"])
01:01:06.352  00:19:21.692       ...
01:01:06.352  00:19:21.692     713 		# but $() will return just the time'\''s data, hence making it possible to just do:
01:01:06.352  00:19:21.692     714 		#  time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd)
01:01:06.352  00:19:21.692     715 		time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1)
01:01:06.352  00:19:21.692     716 	
01:01:06.352  00:19:21.692     717 		echo "$time"
01:01:06.352  00:19:21.692  => 718 	)
01:01:06.352  00:19:21.692     719 	
01:01:06.352  00:19:21.692     720 	function timing_enter() {
01:01:06.352  00:19:21.692     721 		xtrace_disable
01:01:06.352  00:19:21.692     722 		timing "enter" "$1"
01:01:06.352  00:19:21.692     723 		xtrace_restore
01:01:06.352  00:19:21.692       ...
01:01:06.352  00:19:21.692  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"])
01:01:06.352  00:19:21.692       ...
01:01:06.352  00:19:21.692     11  	# Pci bus hotplug
01:01:06.352  00:19:21.692     12  	# Helper function to remove/attach cotrollers
01:01:06.352  00:19:21.692     13  	debug_remove_attach_helper() {
01:01:06.352  00:19:21.692     14  		local helper_time=0
01:01:06.352  00:19:21.692     15  	
01:01:06.352  00:19:21.692  => 16  		helper_time=$(timing_cmd remove_attach_helper "$@")
01:01:06.352  00:19:21.692     17  		printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \
01:01:06.352  00:19:21.692     18  			"$helper_time" "$nvme_count" >&2
01:01:06.352  00:19:21.692     19  	}
01:01:06.352  00:19:21.692     20  	
01:01:06.352  00:19:21.692     21  	remove_attach_helper() {
01:01:06.352  00:19:21.692       ...
01:01:06.352  00:19:21.692  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([])
01:01:06.352  00:19:21.692       ...
01:01:06.352  00:19:21.692     105 			waitforbdev "Nvme0${dev}n1" "$hotplug_wait"
01:01:06.352  00:19:21.692     106 		done
01:01:06.352  00:19:21.692     107 	
01:01:06.352  00:19:21.692     108 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.352  00:19:21.692     109 	
01:01:06.352  00:19:21.692  => 110 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.352  00:19:21.692     111 		# Verify reregistering hotplug poller
01:01:06.352  00:19:21.692     112 		rpc_cmd bdev_nvme_set_hotplug -d
01:01:06.352  00:19:21.692     113 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.352  00:19:21.692     114 	
01:01:06.352  00:19:21.692     115 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.352  00:19:21.692       ...
01:01:06.352  00:19:21.692  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([])
01:01:06.352  00:19:21.692       ...
01:01:06.352  00:19:21.692     133 	
01:01:06.352  00:19:21.692     134 	# Run pci bus hotplug test
01:01:06.352  00:19:21.692     135 	run_hotplug
01:01:06.352  00:19:21.692     136 	
01:01:06.352  00:19:21.692     137 	# Run SPDK target based hotplug
01:01:06.352  00:19:21.692  => 138 	tgt_run_hotplug
01:01:06.352  00:19:21.692       ...
01:01:06.352  00:19:21.692  
01:01:06.352  00:19:21.692  ========== Backtrace end ==========
01:01:06.352  00:19:21.692  ========== Backtrace start: ==========
01:01:06.352  00:19:21.692  
01:01:06.352  00:19:21.692  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"])
01:01:06.352  00:19:21.692       ...
01:01:06.352  00:19:21.692     11  	# Pci bus hotplug
01:01:06.352  00:19:21.692     12  	# Helper function to remove/attach cotrollers
01:01:06.352  00:19:21.692     13  	debug_remove_attach_helper() {
01:01:06.352  00:19:21.692     14  		local helper_time=0
01:01:06.352  00:19:21.692     15  	
01:01:06.352  00:19:21.692  => 16  		helper_time=$(timing_cmd remove_attach_helper "$@")
01:01:06.352  00:19:21.692     17  		printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \
01:01:06.352  00:19:21.692     18  			"$helper_time" "$nvme_count" >&2
01:01:06.352  00:19:21.692     19  	}
01:01:06.352  00:19:21.692     20  	
01:01:06.352  00:19:21.692     21  	remove_attach_helper() {
01:01:06.352  00:19:21.692       ...
01:01:06.352  00:19:21.693  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([])
01:01:06.352  00:19:21.693       ...
01:01:06.352  00:19:21.693     105 			waitforbdev "Nvme0${dev}n1" "$hotplug_wait"
01:01:06.352  00:19:21.693     106 		done
01:01:06.352  00:19:21.693     107 	
01:01:06.352  00:19:21.693     108 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.352  00:19:21.693     109 	
01:01:06.352  00:19:21.693  => 110 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.352  00:19:21.693     111 		# Verify reregistering hotplug poller
01:01:06.352  00:19:21.693     112 		rpc_cmd bdev_nvme_set_hotplug -d
01:01:06.352  00:19:21.693     113 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.352  00:19:21.693     114 	
01:01:06.352  00:19:21.693     115 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.352  00:19:21.693       ...
01:01:06.352  00:19:21.693  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([])
01:01:06.352  00:19:21.693       ...
01:01:06.352  00:19:21.693     133 	
01:01:06.352  00:19:21.693     134 	# Run pci bus hotplug test
01:01:06.352  00:19:21.693     135 	run_hotplug
01:01:06.352  00:19:21.693     136 	
01:01:06.352  00:19:21.693     137 	# Run SPDK target based hotplug
01:01:06.352  00:19:21.693  => 138 	tgt_run_hotplug
01:01:06.352  00:19:21.693       ...
01:01:06.352  00:19:21.693  
01:01:06.352  00:19:21.693  ========== Backtrace end ==========
01:01:06.352  00:19:23.665  ========== Backtrace start: ==========
01:01:06.352  00:19:23.665  
01:01:06.352  00:19:23.665  in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh"])
01:01:06.352  00:19:23.665       ...
01:01:06.352  00:19:23.665     1117		timing_enter $test_name
01:01:06.352  00:19:23.665     1118		echo "************************************"
01:01:06.352  00:19:23.665     1119		echo "START TEST $test_name"
01:01:06.352  00:19:23.665     1120		echo "************************************"
01:01:06.352  00:19:23.665     1121		xtrace_restore
01:01:06.352  00:19:23.665     1122		time "$@"
01:01:06.352  00:19:23.665     1123		xtrace_disable
01:01:06.352  00:19:23.665     1124		echo "************************************"
01:01:06.352  00:19:23.665     1125		echo "END TEST $test_name"
01:01:06.352  00:19:23.665     1126		echo "************************************"
01:01:06.352  00:19:23.665     1127		timing_exit $test_name
01:01:06.352  00:19:23.665       ...
01:01:06.352  00:19:23.665  in /home/vagrant/spdk_repo/spdk/autotest.sh:240 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"])
01:01:06.352  00:19:23.665       ...
01:01:06.352  00:19:23.665     235 	
01:01:06.352  00:19:23.665     236 			run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh
01:01:06.352  00:19:23.665     237 			run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh
01:01:06.352  00:19:23.665     238 	
01:01:06.352  00:19:23.665     239 			if [ $(uname -s) = Linux ]; then
01:01:06.352  00:19:23.665  => 240 				run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh
01:01:06.352  00:19:23.665     241 			fi
01:01:06.352  00:19:23.665     242 	
01:01:06.352  00:19:23.665     243 			if [[ $SPDK_TEST_XNVME -eq 1 ]]; then
01:01:06.352  00:19:23.665     244 				run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh
01:01:06.352  00:19:23.665     245 				run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme"
01:01:06.352  00:19:23.665       ...
01:01:06.352  00:19:23.665  
01:01:06.352  00:19:23.665  ========== Backtrace end =========='
01:01:06.352  + [[ -n 00:19:21.691    08:38:36 sw_hotplug -- common/autotest_common.sh@715 -- # time='========== Backtrace start: ==========
01:01:06.352  00:19:21.691  
01:01:06.352  00:19:21.691  in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"])
01:01:06.352  00:19:21.691       ...
01:01:06.352  00:19:21.691     710 	
01:01:06.352  00:19:21.691     711 		# We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to
01:01:06.352  00:19:21.691     712 		# catch only output from the time builtin - output from the actual cmd would be still visible,
01:01:06.352  00:19:21.691     713 		# but $() will return just the time'\''s data, hence making it possible to just do:
01:01:06.352  00:19:21.691     714 		#  time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd)
01:01:06.352  00:19:21.691  => 715 		time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1)
01:01:06.352  00:19:21.691     716 	
01:01:06.352  00:19:21.692     717 		echo "$time"
01:01:06.352  00:19:21.692     718 	)
01:01:06.352  00:19:21.692     719 	
01:01:06.352  00:19:21.692     720 	function timing_enter() {
01:01:06.352  00:19:21.692       ...
01:01:06.352  00:19:21.692  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"])
01:01:06.352  00:19:21.692       ...
01:01:06.352  00:19:21.692     11  	# Pci bus hotplug
01:01:06.352  00:19:21.692     12  	# Helper function to remove/attach cotrollers
01:01:06.352  00:19:21.692     13  	debug_remove_attach_helper() {
01:01:06.352  00:19:21.692     14  		local helper_time=0
01:01:06.352  00:19:21.692     15  	
01:01:06.352  00:19:21.692  => 16  		helper_time=$(timing_cmd remove_attach_helper "$@")
01:01:06.352  00:19:21.692     17  		printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \
01:01:06.352  00:19:21.692     18  			"$helper_time" "$nvme_count" >&2
01:01:06.352  00:19:21.692     19  	}
01:01:06.352  00:19:21.692     20  	
01:01:06.352  00:19:21.692     21  	remove_attach_helper() {
01:01:06.352  00:19:21.692       ...
01:01:06.352  00:19:21.692  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([])
01:01:06.352  00:19:21.692       ...
01:01:06.352  00:19:21.692     105 			waitforbdev "Nvme0${dev}n1" "$hotplug_wait"
01:01:06.352  00:19:21.692     106 		done
01:01:06.352  00:19:21.692     107 	
01:01:06.352  00:19:21.692     108 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.352  00:19:21.692     109 	
01:01:06.352  00:19:21.692  => 110 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.352  00:19:21.692     111 		# Verify reregistering hotplug poller
01:01:06.352  00:19:21.692     112 		rpc_cmd bdev_nvme_set_hotplug -d
01:01:06.352  00:19:21.692     113 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.352  00:19:21.692     114 	
01:01:06.352  00:19:21.692     115 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.352  00:19:21.692       ...
01:01:06.352  00:19:21.692  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([])
01:01:06.352  00:19:21.692       ...
01:01:06.352  00:19:21.692     133 	
01:01:06.352  00:19:21.692     134 	# Run pci bus hotplug test
01:01:06.352  00:19:21.692     135 	run_hotplug
01:01:06.352  00:19:21.692     136 	
01:01:06.352  00:19:21.692     137 	# Run SPDK target based hotplug
01:01:06.352  00:19:21.692  => 138 	tgt_run_hotplug
01:01:06.353  00:19:21.692       ...
01:01:06.353  00:19:21.692  
01:01:06.353  00:19:21.692  ========== Backtrace end =========='
01:01:06.353  00:19:21.692  ========== Backtrace start: ==========
01:01:06.353  00:19:21.692  
01:01:06.353  00:19:21.692  in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"])
01:01:06.353  00:19:21.692       ...
01:01:06.353  00:19:21.692     710 	
01:01:06.353  00:19:21.692     711 		# We redirect cmd's std{out,err} to a separate fd dup'ed to stdin's device (or /dev/null) to
01:01:06.353  00:19:21.692     712 		# catch only output from the time builtin - output from the actual cmd would be still visible,
01:01:06.353  00:19:21.692     713 		# but $() will return just the time's data, hence making it possible to just do:
01:01:06.353  00:19:21.692     714 		#  time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd)
01:01:06.353  00:19:21.692  => 715 		time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1)
01:01:06.353  00:19:21.692     716 	
01:01:06.353  00:19:21.692     717 		echo "$time"
01:01:06.353  00:19:21.692     718 	)
01:01:06.353  00:19:21.692     719 	
01:01:06.353  00:19:21.692     720 	function timing_enter() {
01:01:06.353  00:19:21.692       ...
01:01:06.353  00:19:21.692  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"])
01:01:06.353  00:19:21.692       ...
01:01:06.353  00:19:21.692     11  	# Pci bus hotplug
01:01:06.353  00:19:21.692     12  	# Helper function to remove/attach cotrollers
01:01:06.353  00:19:21.692     13  	debug_remove_attach_helper() {
01:01:06.353  00:19:21.692     14  		local helper_time=0
01:01:06.353  00:19:21.692     15  	
01:01:06.353  00:19:21.692  => 16  		helper_time=$(timing_cmd remove_attach_helper "$@")
01:01:06.353  00:19:21.692     17  		printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \
01:01:06.353  00:19:21.692     18  			"$helper_time" "$nvme_count" >&2
01:01:06.353  00:19:21.692     19  	}
01:01:06.353  00:19:21.692     20  	
01:01:06.353  00:19:21.692     21  	remove_attach_helper() {
01:01:06.353  00:19:21.692       ...
01:01:06.353  00:19:21.692  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([])
01:01:06.353  00:19:21.692       ...
01:01:06.353  00:19:21.692     105 			waitforbdev "Nvme0${dev}n1" "$hotplug_wait"
01:01:06.353  00:19:21.692     106 		done
01:01:06.353  00:19:21.692     107 	
01:01:06.353  00:19:21.692     108 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.353  00:19:21.692     109 	
01:01:06.353  00:19:21.692  => 110 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.353  00:19:21.692     111 		# Verify reregistering hotplug poller
01:01:06.353  00:19:21.692     112 		rpc_cmd bdev_nvme_set_hotplug -d
01:01:06.353  00:19:21.692     113 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.353  00:19:21.692     114 	
01:01:06.353  00:19:21.692     115 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.353  00:19:21.692       ...
01:01:06.353  00:19:21.692  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([])
01:01:06.353  00:19:21.692       ...
01:01:06.353  00:19:21.692     133 	
01:01:06.353  00:19:21.692     134 	# Run pci bus hotplug test
01:01:06.353  00:19:21.692     135 	run_hotplug
01:01:06.353  00:19:21.692     136 	
01:01:06.353  00:19:21.692     137 	# Run SPDK target based hotplug
01:01:06.353  00:19:21.692  => 138 	tgt_run_hotplug
01:01:06.353  00:19:21.692       ...
01:01:06.353  00:19:21.692  
01:01:06.353  00:19:21.692  ========== Backtrace end ==========
01:01:06.353  00:19:21.692  ========== Backtrace start: ==========
01:01:06.353  00:19:21.692  
01:01:06.353  00:19:21.692  in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"])
01:01:06.353  00:19:21.692       ...
01:01:06.353  00:19:21.692     713 		# but $() will return just the time's data, hence making it possible to just do:
01:01:06.353  00:19:21.692     714 		#  time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd)
01:01:06.353  00:19:21.692     715 		time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1)
01:01:06.353  00:19:21.692     716 	
01:01:06.353  00:19:21.692     717 		echo "$time"
01:01:06.353  00:19:21.692  => 718 	)
01:01:06.353  00:19:21.692     719 	
01:01:06.353  00:19:21.692     720 	function timing_enter() {
01:01:06.353  00:19:21.692     721 		xtrace_disable
01:01:06.353  00:19:21.692     722 		timing "enter" "$1"
01:01:06.353  00:19:21.692     723 		xtrace_restore
01:01:06.353  00:19:21.692       ...
01:01:06.353  00:19:21.692  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"])
01:01:06.353  00:19:21.692       ...
01:01:06.353  00:19:21.692     11  	# Pci bus hotplug
01:01:06.353  00:19:21.692     12  	# Helper function to remove/attach cotrollers
01:01:06.353  00:19:21.692     13  	debug_remove_attach_helper() {
01:01:06.353  00:19:21.692     14  		local helper_time=0
01:01:06.353  00:19:21.692     15  	
01:01:06.353  00:19:21.692  => 16  		helper_time=$(timing_cmd remove_attach_helper "$@")
01:01:06.353  00:19:21.692     17  		printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \
01:01:06.353  00:19:21.692     18  			"$helper_time" "$nvme_count" >&2
01:01:06.353  00:19:21.692     19  	}
01:01:06.353  00:19:21.692     20  	
01:01:06.353  00:19:21.692     21  	remove_attach_helper() {
01:01:06.353  00:19:21.692       ...
01:01:06.353  00:19:21.692  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([])
01:01:06.353  00:19:21.692       ...
01:01:06.353  00:19:21.692     105 			waitforbdev "Nvme0${dev}n1" "$hotplug_wait"
01:01:06.353  00:19:21.692     106 		done
01:01:06.353  00:19:21.692     107 	
01:01:06.353  00:19:21.692     108 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.353  00:19:21.692     109 	
01:01:06.353  00:19:21.692  => 110 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.353  00:19:21.692     111 		# Verify reregistering hotplug poller
01:01:06.353  00:19:21.692     112 		rpc_cmd bdev_nvme_set_hotplug -d
01:01:06.353  00:19:21.692     113 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.353  00:19:21.692     114 	
01:01:06.353  00:19:21.692     115 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.353  00:19:21.692       ...
01:01:06.353  00:19:21.692  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([])
01:01:06.353  00:19:21.692       ...
01:01:06.353  00:19:21.692     133 	
01:01:06.353  00:19:21.692     134 	# Run pci bus hotplug test
01:01:06.353  00:19:21.692     135 	run_hotplug
01:01:06.353  00:19:21.692     136 	
01:01:06.353  00:19:21.692     137 	# Run SPDK target based hotplug
01:01:06.353  00:19:21.692  => 138 	tgt_run_hotplug
01:01:06.353  00:19:21.692       ...
01:01:06.353  00:19:21.692  
01:01:06.353  00:19:21.692  ========== Backtrace end ==========
01:01:06.353  00:19:21.692  ========== Backtrace start: ==========
01:01:06.353  00:19:21.692  
01:01:06.353  00:19:21.692  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"])
01:01:06.353  00:19:21.692       ...
01:01:06.353  00:19:21.692     11  	# Pci bus hotplug
01:01:06.353  00:19:21.692     12  	# Helper function to remove/attach cotrollers
01:01:06.353  00:19:21.692     13  	debug_remove_attach_helper() {
01:01:06.353  00:19:21.692     14  		local helper_time=0
01:01:06.353  00:19:21.692     15  	
01:01:06.353  00:19:21.692  => 16  		helper_time=$(timing_cmd remove_attach_helper "$@")
01:01:06.353  00:19:21.692     17  		printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \
01:01:06.353  00:19:21.692     18  			"$helper_time" "$nvme_count" >&2
01:01:06.353  00:19:21.692     19  	}
01:01:06.353  00:19:21.692     20  	
01:01:06.353  00:19:21.692     21  	remove_attach_helper() {
01:01:06.353  00:19:21.692       ...
01:01:06.353  00:19:21.693  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([])
01:01:06.353  00:19:21.693       ...
01:01:06.353  00:19:21.693     105 			waitforbdev "Nvme0${dev}n1" "$hotplug_wait"
01:01:06.353  00:19:21.693     106 		done
01:01:06.353  00:19:21.693     107 	
01:01:06.353  00:19:21.693     108 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.353  00:19:21.693     109 	
01:01:06.353  00:19:21.693  => 110 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.353  00:19:21.693     111 		# Verify reregistering hotplug poller
01:01:06.353  00:19:21.693     112 		rpc_cmd bdev_nvme_set_hotplug -d
01:01:06.353  00:19:21.693     113 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.353  00:19:21.693     114 	
01:01:06.353  00:19:21.693     115 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.353  00:19:21.693       ...
01:01:06.353  00:19:21.693  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([])
01:01:06.353  00:19:21.693       ...
01:01:06.353  00:19:21.693     133 	
01:01:06.353  00:19:21.693     134 	# Run pci bus hotplug test
01:01:06.353  00:19:21.693     135 	run_hotplug
01:01:06.353  00:19:21.693     136 	
01:01:06.353  00:19:21.693     137 	# Run SPDK target based hotplug
01:01:06.353  00:19:21.693  => 138 	tgt_run_hotplug
01:01:06.353  00:19:21.693       ...
01:01:06.353  00:19:21.693  
01:01:06.353  00:19:21.693  ========== Backtrace end ==========
01:01:06.353  00:19:23.665  ========== Backtrace start: ==========
01:01:06.353  00:19:23.665  
01:01:06.353  00:19:23.665  in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh"])
01:01:06.353  00:19:23.665       ...
01:01:06.353  00:19:23.665     1117		timing_enter $test_name
01:01:06.353  00:19:23.665     1118		echo "************************************"
01:01:06.353  00:19:23.665     1119		echo "START TEST $test_name"
01:01:06.354  00:19:23.665     1120		echo "************************************"
01:01:06.354  00:19:23.665     1121		xtrace_restore
01:01:06.354  00:19:23.665     1122		time "$@"
01:01:06.354  00:19:23.665     1123		xtrace_disable
01:01:06.354  00:19:23.665     1124		echo "************************************"
01:01:06.354  00:19:23.665     1125		echo "END TEST $test_name"
01:01:06.354  00:19:23.665     1126		echo "************************************"
01:01:06.354  00:19:23.665     1127		timing_exit $test_name
01:01:06.354  00:19:23.665       ...
01:01:06.354  00:19:23.665  in /home/vagrant/spdk_repo/spdk/autotest.sh:240 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"])
01:01:06.354  00:19:23.665       ...
01:01:06.354  00:19:23.665     235 	
01:01:06.354  00:19:23.665     236 			run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh
01:01:06.354  00:19:23.665     237 			run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh
01:01:06.354  00:19:23.665     238 	
01:01:06.354  00:19:23.665     239 			if [ $(uname -s) = Linux ]; then
01:01:06.354  00:19:23.665  => 240 				run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh
01:01:06.354  00:19:23.665     241 			fi
01:01:06.354  00:19:23.665     242 	
01:01:06.354  00:19:23.665     243 			if [[ $SPDK_TEST_XNVME -eq 1 ]]; then
01:01:06.354  00:19:23.665     244 				run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh
01:01:06.354  00:19:23.665     245 				run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme"
01:01:06.354  00:19:23.665       ...
01:01:06.354  00:19:23.665  
01:01:06.354  00:19:23.665  ========== Backtrace end ========== ]]
01:01:06.354  + echo '00:19:21.691    08:38:36 sw_hotplug -- common/autotest_common.sh@715 -- # time='\''========== Backtrace start: ==========
01:01:06.354  00:19:21.691  
01:01:06.354  00:19:21.691  in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"])
01:01:06.354  00:19:21.691       ...
01:01:06.354  00:19:21.691     710 	
01:01:06.354  00:19:21.691     711 		# We redirect cmd'\''\'\'''\''s std{out,err} to a separate fd dup'\''\'\'''\''ed to stdin'\''\'\'''\''s device (or /dev/null) to
01:01:06.354  00:19:21.691     712 		# catch only output from the time builtin - output from the actual cmd would be still visible,
01:01:06.354  00:19:21.691     713 		# but $() will return just the time'\''\'\'''\''s data, hence making it possible to just do:
01:01:06.354  00:19:21.691     714 		#  time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd)
01:01:06.354  00:19:21.691  => 715 		time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1)
01:01:06.354  00:19:21.691     716 	
01:01:06.354  00:19:21.692     717 		echo "$time"
01:01:06.354  00:19:21.692     718 	)
01:01:06.354  00:19:21.692     719 	
01:01:06.354  00:19:21.692     720 	function timing_enter() {
01:01:06.354  00:19:21.692       ...
01:01:06.354  00:19:21.692  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"])
01:01:06.354  00:19:21.692       ...
01:01:06.354  00:19:21.692     11  	# Pci bus hotplug
01:01:06.354  00:19:21.692     12  	# Helper function to remove/attach cotrollers
01:01:06.354  00:19:21.692     13  	debug_remove_attach_helper() {
01:01:06.354  00:19:21.692     14  		local helper_time=0
01:01:06.354  00:19:21.692     15  	
01:01:06.354  00:19:21.692  => 16  		helper_time=$(timing_cmd remove_attach_helper "$@")
01:01:06.354  00:19:21.692     17  		printf '\''\'\'''\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\''\'\'''\'' \
01:01:06.354  00:19:21.692     18  			"$helper_time" "$nvme_count" >&2
01:01:06.354  00:19:21.692     19  	}
01:01:06.354  00:19:21.692     20  	
01:01:06.354  00:19:21.692     21  	remove_attach_helper() {
01:01:06.354  00:19:21.692       ...
01:01:06.354  00:19:21.692  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([])
01:01:06.354  00:19:21.692       ...
01:01:06.354  00:19:21.692     105 			waitforbdev "Nvme0${dev}n1" "$hotplug_wait"
01:01:06.354  00:19:21.692     106 		done
01:01:06.354  00:19:21.692     107 	
01:01:06.354  00:19:21.692     108 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.354  00:19:21.692     109 	
01:01:06.354  00:19:21.692  => 110 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.354  00:19:21.692     111 		# Verify reregistering hotplug poller
01:01:06.354  00:19:21.692     112 		rpc_cmd bdev_nvme_set_hotplug -d
01:01:06.354  00:19:21.692     113 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.354  00:19:21.692     114 	
01:01:06.354  00:19:21.692     115 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.354  00:19:21.692       ...
01:01:06.354  00:19:21.692  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([])
01:01:06.354  00:19:21.692       ...
01:01:06.354  00:19:21.692     133 	
01:01:06.354  00:19:21.692     134 	# Run pci bus hotplug test
01:01:06.354  00:19:21.692     135 	run_hotplug
01:01:06.354  00:19:21.692     136 	
01:01:06.354  00:19:21.692     137 	# Run SPDK target based hotplug
01:01:06.354  00:19:21.692  => 138 	tgt_run_hotplug
01:01:06.354  00:19:21.692       ...
01:01:06.354  00:19:21.692  
01:01:06.354  00:19:21.692  ========== Backtrace end =========='\''
01:01:06.354  00:19:21.692  ========== Backtrace start: ==========
01:01:06.354  00:19:21.692  
01:01:06.354  00:19:21.692  in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"])
01:01:06.354  00:19:21.692       ...
01:01:06.354  00:19:21.692     710 	
01:01:06.354  00:19:21.692     711 		# We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to
01:01:06.354  00:19:21.692     712 		# catch only output from the time builtin - output from the actual cmd would be still visible,
01:01:06.354  00:19:21.692     713 		# but $() will return just the time'\''s data, hence making it possible to just do:
01:01:06.354  00:19:21.692     714 		#  time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd)
01:01:06.354  00:19:21.692  => 715 		time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1)
01:01:06.354  00:19:21.692     716 	
01:01:06.354  00:19:21.692     717 		echo "$time"
01:01:06.354  00:19:21.692     718 	)
01:01:06.354  00:19:21.692     719 	
01:01:06.354  00:19:21.692     720 	function timing_enter() {
01:01:06.354  00:19:21.692       ...
01:01:06.354  00:19:21.692  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"])
01:01:06.354  00:19:21.692       ...
01:01:06.354  00:19:21.692     11  	# Pci bus hotplug
01:01:06.354  00:19:21.692     12  	# Helper function to remove/attach cotrollers
01:01:06.354  00:19:21.692     13  	debug_remove_attach_helper() {
01:01:06.354  00:19:21.692     14  		local helper_time=0
01:01:06.354  00:19:21.692     15  	
01:01:06.354  00:19:21.692  => 16  		helper_time=$(timing_cmd remove_attach_helper "$@")
01:01:06.354  00:19:21.692     17  		printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \
01:01:06.354  00:19:21.692     18  			"$helper_time" "$nvme_count" >&2
01:01:06.354  00:19:21.692     19  	}
01:01:06.354  00:19:21.692     20  	
01:01:06.354  00:19:21.692     21  	remove_attach_helper() {
01:01:06.354  00:19:21.692       ...
01:01:06.354  00:19:21.692  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([])
01:01:06.354  00:19:21.692       ...
01:01:06.354  00:19:21.692     105 			waitforbdev "Nvme0${dev}n1" "$hotplug_wait"
01:01:06.354  00:19:21.692     106 		done
01:01:06.354  00:19:21.692     107 	
01:01:06.354  00:19:21.692     108 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.354  00:19:21.692     109 	
01:01:06.354  00:19:21.692  => 110 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.354  00:19:21.692     111 		# Verify reregistering hotplug poller
01:01:06.354  00:19:21.692     112 		rpc_cmd bdev_nvme_set_hotplug -d
01:01:06.354  00:19:21.692     113 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.354  00:19:21.692     114 	
01:01:06.354  00:19:21.692     115 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.354  00:19:21.692       ...
01:01:06.354  00:19:21.692  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([])
01:01:06.354  00:19:21.692       ...
01:01:06.354  00:19:21.692     133 	
01:01:06.354  00:19:21.692     134 	# Run pci bus hotplug test
01:01:06.354  00:19:21.692     135 	run_hotplug
01:01:06.354  00:19:21.692     136 	
01:01:06.354  00:19:21.692     137 	# Run SPDK target based hotplug
01:01:06.354  00:19:21.692  => 138 	tgt_run_hotplug
01:01:06.354  00:19:21.692       ...
01:01:06.354  00:19:21.692  
01:01:06.354  00:19:21.692  ========== Backtrace end ==========
01:01:06.354  00:19:21.692  ========== Backtrace start: ==========
01:01:06.354  00:19:21.692  
01:01:06.354  00:19:21.692  in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"])
01:01:06.354  00:19:21.692       ...
01:01:06.354  00:19:21.692     713 		# but $() will return just the time'\''s data, hence making it possible to just do:
01:01:06.354  00:19:21.692     714 		#  time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd)
01:01:06.354  00:19:21.692     715 		time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1)
01:01:06.354  00:19:21.692     716 	
01:01:06.354  00:19:21.692     717 		echo "$time"
01:01:06.354  00:19:21.692  => 718 	)
01:01:06.354  00:19:21.692     719 	
01:01:06.354  00:19:21.692     720 	function timing_enter() {
01:01:06.354  00:19:21.692     721 		xtrace_disable
01:01:06.354  00:19:21.692     722 		timing "enter" "$1"
01:01:06.354  00:19:21.692     723 		xtrace_restore
01:01:06.354  00:19:21.692       ...
01:01:06.354  00:19:21.692  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"])
01:01:06.354  00:19:21.692       ...
01:01:06.354  00:19:21.692     11  	# Pci bus hotplug
01:01:06.354  00:19:21.692     12  	# Helper function to remove/attach cotrollers
01:01:06.354  00:19:21.692     13  	debug_remove_attach_helper() {
01:01:06.354  00:19:21.692     14  		local helper_time=0
01:01:06.354  00:19:21.692     15  	
01:01:06.354  00:19:21.692  => 16  		helper_time=$(timing_cmd remove_attach_helper "$@")
01:01:06.354  00:19:21.692     17  		printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \
01:01:06.354  00:19:21.692     18  			"$helper_time" "$nvme_count" >&2
01:01:06.354  00:19:21.692     19  	}
01:01:06.354  00:19:21.692     20  	
01:01:06.354  00:19:21.692     21  	remove_attach_helper() {
01:01:06.354  00:19:21.692       ...
01:01:06.354  00:19:21.692  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([])
01:01:06.354  00:19:21.692       ...
01:01:06.354  00:19:21.692     105 			waitforbdev "Nvme0${dev}n1" "$hotplug_wait"
01:01:06.354  00:19:21.692     106 		done
01:01:06.354  00:19:21.692     107 	
01:01:06.354  00:19:21.692     108 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.354  00:19:21.692     109 	
01:01:06.354  00:19:21.692  => 110 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.354  00:19:21.692     111 		# Verify reregistering hotplug poller
01:01:06.354  00:19:21.692     112 		rpc_cmd bdev_nvme_set_hotplug -d
01:01:06.355  00:19:21.692     113 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.355  00:19:21.692     114 	
01:01:06.355  00:19:21.692     115 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.355  00:19:21.692       ...
01:01:06.355  00:19:21.692  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([])
01:01:06.355  00:19:21.692       ...
01:01:06.355  00:19:21.692     133 	
01:01:06.355  00:19:21.692     134 	# Run pci bus hotplug test
01:01:06.355  00:19:21.692     135 	run_hotplug
01:01:06.355  00:19:21.692     136 	
01:01:06.355  00:19:21.692     137 	# Run SPDK target based hotplug
01:01:06.355  00:19:21.692  => 138 	tgt_run_hotplug
01:01:06.355  00:19:21.692       ...
01:01:06.355  00:19:21.692  
01:01:06.355  00:19:21.692  ========== Backtrace end ==========
01:01:06.355  00:19:21.692  ========== Backtrace start: ==========
01:01:06.355  00:19:21.692  
01:01:06.355  00:19:21.692  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"])
01:01:06.355  00:19:21.692       ...
01:01:06.355  00:19:21.692     11  	# Pci bus hotplug
01:01:06.355  00:19:21.692     12  	# Helper function to remove/attach cotrollers
01:01:06.355  00:19:21.692     13  	debug_remove_attach_helper() {
01:01:06.355  00:19:21.692     14  		local helper_time=0
01:01:06.355  00:19:21.692     15  	
01:01:06.355  00:19:21.692  => 16  		helper_time=$(timing_cmd remove_attach_helper "$@")
01:01:06.355  00:19:21.692     17  		printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \
01:01:06.355  00:19:21.692     18  			"$helper_time" "$nvme_count" >&2
01:01:06.355  00:19:21.692     19  	}
01:01:06.355  00:19:21.692     20  	
01:01:06.355  00:19:21.692     21  	remove_attach_helper() {
01:01:06.355  00:19:21.692       ...
01:01:06.355  00:19:21.693  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([])
01:01:06.355  00:19:21.693       ...
01:01:06.355  00:19:21.693     105 			waitforbdev "Nvme0${dev}n1" "$hotplug_wait"
01:01:06.355  00:19:21.693     106 		done
01:01:06.355  00:19:21.693     107 	
01:01:06.355  00:19:21.693     108 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.355  00:19:21.693     109 	
01:01:06.355  00:19:21.693  => 110 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.355  00:19:21.693     111 		# Verify reregistering hotplug poller
01:01:06.355  00:19:21.693     112 		rpc_cmd bdev_nvme_set_hotplug -d
01:01:06.355  00:19:21.693     113 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.355  00:19:21.693     114 	
01:01:06.355  00:19:21.693     115 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.355  00:19:21.693       ...
01:01:06.355  00:19:21.693  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([])
01:01:06.355  00:19:21.693       ...
01:01:06.355  00:19:21.693     133 	
01:01:06.355  00:19:21.693     134 	# Run pci bus hotplug test
01:01:06.355  00:19:21.693     135 	run_hotplug
01:01:06.355  00:19:21.693     136 	
01:01:06.355  00:19:21.693     137 	# Run SPDK target based hotplug
01:01:06.355  00:19:21.693  => 138 	tgt_run_hotplug
01:01:06.355  00:19:21.693       ...
01:01:06.355  00:19:21.693  
01:01:06.355  00:19:21.693  ========== Backtrace end ==========
01:01:06.355  00:19:23.665  ========== Backtrace start: ==========
01:01:06.355  00:19:23.665  
01:01:06.355  00:19:23.665  in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh"])
01:01:06.355  00:19:23.665       ...
01:01:06.355  00:19:23.665     1117		timing_enter $test_name
01:01:06.355  00:19:23.665     1118		echo "************************************"
01:01:06.355  00:19:23.665     1119		echo "START TEST $test_name"
01:01:06.355  00:19:23.665     1120		echo "************************************"
01:01:06.355  00:19:23.665     1121		xtrace_restore
01:01:06.355  00:19:23.665     1122		time "$@"
01:01:06.355  00:19:23.665     1123		xtrace_disable
01:01:06.355  00:19:23.665     1124		echo "************************************"
01:01:06.355  00:19:23.665     1125		echo "END TEST $test_name"
01:01:06.355  00:19:23.665     1126		echo "************************************"
01:01:06.355  00:19:23.665     1127		timing_exit $test_name
01:01:06.355  00:19:23.665       ...
01:01:06.355  00:19:23.665  in /home/vagrant/spdk_repo/spdk/autotest.sh:240 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"])
01:01:06.355  00:19:23.665       ...
01:01:06.355  00:19:23.665     235 	
01:01:06.355  00:19:23.665     236 			run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh
01:01:06.355  00:19:23.665     237 			run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh
01:01:06.355  00:19:23.665     238 	
01:01:06.355  00:19:23.665     239 			if [ $(uname -s) = Linux ]; then
01:01:06.355  00:19:23.665  => 240 				run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh
01:01:06.355  00:19:23.665     241 			fi
01:01:06.355  00:19:23.665     242 	
01:01:06.355  00:19:23.665     243 			if [[ $SPDK_TEST_XNVME -eq 1 ]]; then
01:01:06.355  00:19:23.665     244 				run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh
01:01:06.355  00:19:23.665     245 				run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme"
01:01:06.355  00:19:23.665       ...
01:01:06.355  00:19:23.665  
01:01:06.355  00:19:23.665  ========== Backtrace end =========='
01:01:06.355  + for build in "${build_log_list[@]}"
01:01:06.355  + create_errtrace_file /var/jenkins/workspace/autotest-per-patch/BlobFS-phy-autotest_26206/build.log
01:01:06.355  + local build_log job_name start_pattern end_pattern backtraces
01:01:06.355  + build_log=/var/jenkins/workspace/autotest-per-patch/BlobFS-phy-autotest_26206/build.log
01:01:06.355  +++ dirname /var/jenkins/workspace/autotest-per-patch/BlobFS-phy-autotest_26206/build.log
01:01:06.355  ++ basename /var/jenkins/workspace/autotest-per-patch/BlobFS-phy-autotest_26206
01:01:06.355  + job_name=BlobFS-phy-autotest_26206
01:01:06.355  + start_pattern='Backtrace start'
01:01:06.355  + end_pattern='Backtrace end'
01:01:06.355  + [[ -f /var/jenkins/workspace/autotest-per-patch/BlobFS-phy-autotest_26206/build.log ]]
01:01:06.355  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch/BlobFS-phy-autotest_26206/build.log
01:01:06.355  + backtraces=
01:01:06.355  + [[ -n '' ]]
01:01:06.355  + for build in "${build_log_list[@]}"
01:01:06.355  + create_errtrace_file /var/jenkins/workspace/autotest-per-patch/unittest-main-docker-autotest_19863/build.log
01:01:06.355  + local build_log job_name start_pattern end_pattern backtraces
01:01:06.355  + build_log=/var/jenkins/workspace/autotest-per-patch/unittest-main-docker-autotest_19863/build.log
01:01:06.355  +++ dirname /var/jenkins/workspace/autotest-per-patch/unittest-main-docker-autotest_19863/build.log
01:01:06.355  ++ basename /var/jenkins/workspace/autotest-per-patch/unittest-main-docker-autotest_19863
01:01:06.355  + job_name=unittest-main-docker-autotest_19863
01:01:06.355  + start_pattern='Backtrace start'
01:01:06.355  + end_pattern='Backtrace end'
01:01:06.355  + [[ -f /var/jenkins/workspace/autotest-per-patch/unittest-main-docker-autotest_19863/build.log ]]
01:01:06.355  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch/unittest-main-docker-autotest_19863/build.log
01:01:06.355  + backtraces=
01:01:06.355  + [[ -n '' ]]
01:01:06.355  + for build in "${build_log_list[@]}"
01:01:06.355  + create_errtrace_file /var/jenkins/workspace/autotest-per-patch/short-fuzz-phy-autotest_26197/build.log
01:01:06.355  + local build_log job_name start_pattern end_pattern backtraces
01:01:06.355  + build_log=/var/jenkins/workspace/autotest-per-patch/short-fuzz-phy-autotest_26197/build.log
01:01:06.355  +++ dirname /var/jenkins/workspace/autotest-per-patch/short-fuzz-phy-autotest_26197/build.log
01:01:06.355  ++ basename /var/jenkins/workspace/autotest-per-patch/short-fuzz-phy-autotest_26197
01:01:06.355  + job_name=short-fuzz-phy-autotest_26197
01:01:06.355  + start_pattern='Backtrace start'
01:01:06.355  + end_pattern='Backtrace end'
01:01:06.355  + [[ -f /var/jenkins/workspace/autotest-per-patch/short-fuzz-phy-autotest_26197/build.log ]]
01:01:06.355  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch/short-fuzz-phy-autotest_26197/build.log
01:01:06.355  + backtraces=
01:01:06.355  + [[ -n '' ]]
01:01:06.355  + for build in "${build_log_list[@]}"
01:01:06.355  + create_errtrace_file /var/jenkins/workspace/autotest-per-patch/dsa-phy-autotest_4900/build.log
01:01:06.356  + local build_log job_name start_pattern end_pattern backtraces
01:01:06.356  + build_log=/var/jenkins/workspace/autotest-per-patch/dsa-phy-autotest_4900/build.log
01:01:06.356  +++ dirname /var/jenkins/workspace/autotest-per-patch/dsa-phy-autotest_4900/build.log
01:01:06.356  ++ basename /var/jenkins/workspace/autotest-per-patch/dsa-phy-autotest_4900
01:01:06.356  + job_name=dsa-phy-autotest_4900
01:01:06.356  + start_pattern='Backtrace start'
01:01:06.356  + end_pattern='Backtrace end'
01:01:06.356  + [[ -f /var/jenkins/workspace/autotest-per-patch/dsa-phy-autotest_4900/build.log ]]
01:01:06.356  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch/dsa-phy-autotest_4900/build.log
01:01:06.356  + backtraces=
01:01:06.356  + [[ -n '' ]]
01:01:06.356  + for build in "${build_log_list[@]}"
01:01:06.356  + create_errtrace_file /var/jenkins/workspace/autotest-per-patch/vhost-phy-autotest_26225/build.log
01:01:06.356  + local build_log job_name start_pattern end_pattern backtraces
01:01:06.356  + build_log=/var/jenkins/workspace/autotest-per-patch/vhost-phy-autotest_26225/build.log
01:01:06.356  +++ dirname /var/jenkins/workspace/autotest-per-patch/vhost-phy-autotest_26225/build.log
01:01:06.356  ++ basename /var/jenkins/workspace/autotest-per-patch/vhost-phy-autotest_26225
01:01:06.356  + job_name=vhost-phy-autotest_26225
01:01:06.356  + start_pattern='Backtrace start'
01:01:06.356  + end_pattern='Backtrace end'
01:01:06.356  + [[ -f /var/jenkins/workspace/autotest-per-patch/vhost-phy-autotest_26225/build.log ]]
01:01:06.356  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch/vhost-phy-autotest_26225/build.log
01:01:06.356  + backtraces=
01:01:06.356  + [[ -n '' ]]
01:01:06.356  + for build in "${build_log_list[@]}"
01:01:06.356  + create_errtrace_file /var/jenkins/workspace/autotest-per-patch/check-so-deps-docker-autotest_22158/build.log
01:01:06.356  + local build_log job_name start_pattern end_pattern backtraces
01:01:06.356  + build_log=/var/jenkins/workspace/autotest-per-patch/check-so-deps-docker-autotest_22158/build.log
01:01:06.356  +++ dirname /var/jenkins/workspace/autotest-per-patch/check-so-deps-docker-autotest_22158/build.log
01:01:06.356  ++ basename /var/jenkins/workspace/autotest-per-patch/check-so-deps-docker-autotest_22158
01:01:06.356  + job_name=check-so-deps-docker-autotest_22158
01:01:06.356  + start_pattern='Backtrace start'
01:01:06.356  + end_pattern='Backtrace end'
01:01:06.356  + [[ -f /var/jenkins/workspace/autotest-per-patch/check-so-deps-docker-autotest_22158/build.log ]]
01:01:06.356  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch/check-so-deps-docker-autotest_22158/build.log
01:01:06.356  + backtraces=
01:01:06.356  + [[ -n '' ]]
01:01:06.356  + for build in "${build_log_list[@]}"
01:01:06.356  + create_errtrace_file /var/jenkins/workspace/autotest-per-patch/rocky9-vg-autotest_16090/build.log
01:01:06.356  + local build_log job_name start_pattern end_pattern backtraces
01:01:06.356  + build_log=/var/jenkins/workspace/autotest-per-patch/rocky9-vg-autotest_16090/build.log
01:01:06.356  +++ dirname /var/jenkins/workspace/autotest-per-patch/rocky9-vg-autotest_16090/build.log
01:01:06.356  ++ basename /var/jenkins/workspace/autotest-per-patch/rocky9-vg-autotest_16090
01:01:06.356  + job_name=rocky9-vg-autotest_16090
01:01:06.356  + start_pattern='Backtrace start'
01:01:06.356  + end_pattern='Backtrace end'
01:01:06.356  + [[ -f /var/jenkins/workspace/autotest-per-patch/rocky9-vg-autotest_16090/build.log ]]
01:01:06.356  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch/rocky9-vg-autotest_16090/build.log
01:01:06.356  + backtraces=
01:01:06.356  + [[ -n '' ]]
01:01:06.356  + for build in "${build_log_list[@]}"
01:01:06.356  + create_errtrace_file /var/jenkins/workspace/autotest-per-patch/packaging-docker-autotest_19864/build.log
01:01:06.356  + local build_log job_name start_pattern end_pattern backtraces
01:01:06.356  + build_log=/var/jenkins/workspace/autotest-per-patch/packaging-docker-autotest_19864/build.log
01:01:06.356  +++ dirname /var/jenkins/workspace/autotest-per-patch/packaging-docker-autotest_19864/build.log
01:01:06.356  ++ basename /var/jenkins/workspace/autotest-per-patch/packaging-docker-autotest_19864
01:01:06.356  + job_name=packaging-docker-autotest_19864
01:01:06.356  + start_pattern='Backtrace start'
01:01:06.356  + end_pattern='Backtrace end'
01:01:06.356  + [[ -f /var/jenkins/workspace/autotest-per-patch/packaging-docker-autotest_19864/build.log ]]
01:01:06.356  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch/packaging-docker-autotest_19864/build.log
01:01:06.356  + backtraces=
01:01:06.356  + [[ -n '' ]]
01:01:06.356  + for build in "${build_log_list[@]}"
01:01:06.356  + create_errtrace_file /var/jenkins/workspace/autotest-per-patch/autobuild-external-vg-autotest_19825/build.log
01:01:06.356  + local build_log job_name start_pattern end_pattern backtraces
01:01:06.356  + build_log=/var/jenkins/workspace/autotest-per-patch/autobuild-external-vg-autotest_19825/build.log
01:01:06.356  +++ dirname /var/jenkins/workspace/autotest-per-patch/autobuild-external-vg-autotest_19825/build.log
01:01:06.356  ++ basename /var/jenkins/workspace/autotest-per-patch/autobuild-external-vg-autotest_19825
01:01:06.356  + job_name=autobuild-external-vg-autotest_19825
01:01:06.356  + start_pattern='Backtrace start'
01:01:06.356  + end_pattern='Backtrace end'
01:01:06.356  + [[ -f /var/jenkins/workspace/autotest-per-patch/autobuild-external-vg-autotest_19825/build.log ]]
01:01:06.356  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch/autobuild-external-vg-autotest_19825/build.log
01:01:06.356  + backtraces=
01:01:06.356  + [[ -n '' ]]
01:01:06.356  + for build in "${build_log_list[@]}"
01:01:06.356  + create_errtrace_file /var/jenkins/workspace/autotest-per-patch/nvmf-tcp-uring-vg-autotest_77405/build.log
01:01:06.356  + local build_log job_name start_pattern end_pattern backtraces
01:01:06.356  + build_log=/var/jenkins/workspace/autotest-per-patch/nvmf-tcp-uring-vg-autotest_77405/build.log
01:01:06.356  +++ dirname /var/jenkins/workspace/autotest-per-patch/nvmf-tcp-uring-vg-autotest_77405/build.log
01:01:06.356  ++ basename /var/jenkins/workspace/autotest-per-patch/nvmf-tcp-uring-vg-autotest_77405
01:01:06.356  + job_name=nvmf-tcp-uring-vg-autotest_77405
01:01:06.356  + start_pattern='Backtrace start'
01:01:06.356  + end_pattern='Backtrace end'
01:01:06.356  + [[ -f /var/jenkins/workspace/autotest-per-patch/nvmf-tcp-uring-vg-autotest_77405/build.log ]]
01:01:06.356  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch/nvmf-tcp-uring-vg-autotest_77405/build.log
01:01:06.356  + backtraces=
01:01:06.356  + [[ -n '' ]]
01:01:06.356  + for build in "${build_log_list[@]}"
01:01:06.356  + create_errtrace_file /var/jenkins/workspace/autotest-per-patch/nvme-phy-autotest_72372/build.log
01:01:06.356  + local build_log job_name start_pattern end_pattern backtraces
01:01:06.356  + build_log=/var/jenkins/workspace/autotest-per-patch/nvme-phy-autotest_72372/build.log
01:01:06.356  +++ dirname /var/jenkins/workspace/autotest-per-patch/nvme-phy-autotest_72372/build.log
01:01:06.356  ++ basename /var/jenkins/workspace/autotest-per-patch/nvme-phy-autotest_72372
01:01:06.356  + job_name=nvme-phy-autotest_72372
01:01:06.356  + start_pattern='Backtrace start'
01:01:06.356  + end_pattern='Backtrace end'
01:01:06.356  + [[ -f /var/jenkins/workspace/autotest-per-patch/nvme-phy-autotest_72372/build.log ]]
01:01:06.356  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch/nvme-phy-autotest_72372/build.log
01:01:06.356  + backtraces=
01:01:06.356  + [[ -n '' ]]
01:01:06.356  + for build in "${build_log_list[@]}"
01:01:06.356  + create_errtrace_file /var/jenkins/workspace/autotest-per-patch/freebsd-vg-autotest_59125/build.log
01:01:06.356  + local build_log job_name start_pattern end_pattern backtraces
01:01:06.356  + build_log=/var/jenkins/workspace/autotest-per-patch/freebsd-vg-autotest_59125/build.log
01:01:06.356  +++ dirname /var/jenkins/workspace/autotest-per-patch/freebsd-vg-autotest_59125/build.log
01:01:06.356  ++ basename /var/jenkins/workspace/autotest-per-patch/freebsd-vg-autotest_59125
01:01:06.356  + job_name=freebsd-vg-autotest_59125
01:01:06.356  + start_pattern='Backtrace start'
01:01:06.356  + end_pattern='Backtrace end'
01:01:06.356  + [[ -f /var/jenkins/workspace/autotest-per-patch/freebsd-vg-autotest_59125/build.log ]]
01:01:06.356  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch/freebsd-vg-autotest_59125/build.log
01:01:06.356  + backtraces=
01:01:06.356  + [[ -n '' ]]
01:01:06.356  + for build in "${build_log_list[@]}"
01:01:06.356  + create_errtrace_file /var/jenkins/workspace/autotest-per-patch/nvmf-tcp-phy-autotest_72331/build.log
01:01:06.356  + local build_log job_name start_pattern end_pattern backtraces
01:01:06.356  + build_log=/var/jenkins/workspace/autotest-per-patch/nvmf-tcp-phy-autotest_72331/build.log
01:01:06.356  +++ dirname /var/jenkins/workspace/autotest-per-patch/nvmf-tcp-phy-autotest_72331/build.log
01:01:06.356  ++ basename /var/jenkins/workspace/autotest-per-patch/nvmf-tcp-phy-autotest_72331
01:01:06.356  + job_name=nvmf-tcp-phy-autotest_72331
01:01:06.356  + start_pattern='Backtrace start'
01:01:06.356  + end_pattern='Backtrace end'
01:01:06.356  + [[ -f /var/jenkins/workspace/autotest-per-patch/nvmf-tcp-phy-autotest_72331/build.log ]]
01:01:06.356  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch/nvmf-tcp-phy-autotest_72331/build.log
01:01:06.356  + backtraces=
01:01:06.356  + [[ -n '' ]]
01:01:06.356  + for build in "${build_log_list[@]}"
01:01:06.356  + create_errtrace_file /var/jenkins/workspace/autotest-per-patch/build-files-docker-autotest_22134/build.log
01:01:06.356  + local build_log job_name start_pattern end_pattern backtraces
01:01:06.356  + build_log=/var/jenkins/workspace/autotest-per-patch/build-files-docker-autotest_22134/build.log
01:01:06.356  +++ dirname /var/jenkins/workspace/autotest-per-patch/build-files-docker-autotest_22134/build.log
01:01:06.356  ++ basename /var/jenkins/workspace/autotest-per-patch/build-files-docker-autotest_22134
01:01:06.356  + job_name=build-files-docker-autotest_22134
01:01:06.356  + start_pattern='Backtrace start'
01:01:06.356  + end_pattern='Backtrace end'
01:01:06.356  + [[ -f /var/jenkins/workspace/autotest-per-patch/build-files-docker-autotest_22134/build.log ]]
01:01:06.356  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch/build-files-docker-autotest_22134/build.log
01:01:06.356  + backtraces=
01:01:06.356  + [[ -n '' ]]
01:01:06.356  + for build in "${build_log_list[@]}"
01:01:06.356  + create_errtrace_file /var/jenkins/workspace/autotest-per-patch/nvme-cmb-pmr-vg-autotest_78603/build.log
01:01:06.356  + local build_log job_name start_pattern end_pattern backtraces
01:01:06.356  + build_log=/var/jenkins/workspace/autotest-per-patch/nvme-cmb-pmr-vg-autotest_78603/build.log
01:01:06.356  +++ dirname /var/jenkins/workspace/autotest-per-patch/nvme-cmb-pmr-vg-autotest_78603/build.log
01:01:06.356  ++ basename /var/jenkins/workspace/autotest-per-patch/nvme-cmb-pmr-vg-autotest_78603
01:01:06.356  + job_name=nvme-cmb-pmr-vg-autotest_78603
01:01:06.356  + start_pattern='Backtrace start'
01:01:06.356  + end_pattern='Backtrace end'
01:01:06.356  + [[ -f /var/jenkins/workspace/autotest-per-patch/nvme-cmb-pmr-vg-autotest_78603/build.log ]]
01:01:06.356  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch/nvme-cmb-pmr-vg-autotest_78603/build.log
01:01:06.356  + backtraces=
01:01:06.356  + [[ -n '' ]]
01:01:06.356  + for build in "${build_log_list[@]}"
01:01:06.356  + create_errtrace_file /var/jenkins/workspace/autotest-per-patch/ubuntu20-vg-autotest_73799/build.log
01:01:06.356  + local build_log job_name start_pattern end_pattern backtraces
01:01:06.356  + build_log=/var/jenkins/workspace/autotest-per-patch/ubuntu20-vg-autotest_73799/build.log
01:01:06.356  +++ dirname /var/jenkins/workspace/autotest-per-patch/ubuntu20-vg-autotest_73799/build.log
01:01:06.356  ++ basename /var/jenkins/workspace/autotest-per-patch/ubuntu20-vg-autotest_73799
01:01:06.356  + job_name=ubuntu20-vg-autotest_73799
01:01:06.356  + start_pattern='Backtrace start'
01:01:06.356  + end_pattern='Backtrace end'
01:01:06.357  + [[ -f /var/jenkins/workspace/autotest-per-patch/ubuntu20-vg-autotest_73799/build.log ]]
01:01:06.357  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch/ubuntu20-vg-autotest_73799/build.log
01:01:06.357  + backtraces='00:51:58.963    09:11:13 sw_hotplug -- common/autotest_common.sh@715 -- # time='\''========== Backtrace start: ==========
01:01:06.357  00:51:58.963  
01:01:06.357  00:51:58.963  in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"])
01:01:06.357  00:51:58.963       ...
01:01:06.357  00:51:58.963     710 	
01:01:06.357  00:51:58.963     711 		# We redirect cmd'\''\'\'''\''s std{out,err} to a separate fd dup'\''\'\'''\''ed to stdin'\''\'\'''\''s device (or /dev/null) to
01:01:06.357  00:51:58.963     712 		# catch only output from the time builtin - output from the actual cmd would be still visible,
01:01:06.357  00:51:58.963     713 		# but $() will return just the time'\''\'\'''\''s data, hence making it possible to just do:
01:01:06.357  00:51:58.963     714 		#  time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd)
01:01:06.357  00:51:58.963  => 715 		time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1)
01:01:06.357  00:51:58.963     716 	
01:01:06.357  00:51:58.963     717 		echo "$time"
01:01:06.357  00:51:58.963     718 	)
01:01:06.357  00:51:58.963     719 	
01:01:06.357  00:51:58.963     720 	function timing_enter() {
01:01:06.357  00:51:58.963       ...
01:01:06.357  00:51:58.963  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"])
01:01:06.357  00:51:58.963       ...
01:01:06.357  00:51:58.963     11  	# Pci bus hotplug
01:01:06.357  00:51:58.963     12  	# Helper function to remove/attach cotrollers
01:01:06.357  00:51:58.963     13  	debug_remove_attach_helper() {
01:01:06.357  00:51:58.963     14  		local helper_time=0
01:01:06.357  00:51:58.963     15  	
01:01:06.357  00:51:58.963  => 16  		helper_time=$(timing_cmd remove_attach_helper "$@")
01:01:06.357  00:51:58.963     17  		printf '\''\'\'''\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\''\'\'''\'' \
01:01:06.357  00:51:58.963     18  			"$helper_time" "$nvme_count" >&2
01:01:06.357  00:51:58.963     19  	}
01:01:06.357  00:51:58.963     20  	
01:01:06.357  00:51:58.963     21  	remove_attach_helper() {
01:01:06.357  00:51:58.963       ...
01:01:06.357  00:51:58.963  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([])
01:01:06.357  00:51:58.963       ...
01:01:06.357  00:51:58.963     105 			waitforbdev "Nvme0${dev}n1" "$hotplug_wait"
01:01:06.357  00:51:58.963     106 		done
01:01:06.357  00:51:58.963     107 	
01:01:06.357  00:51:58.963     108 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.357  00:51:58.963     109 	
01:01:06.357  00:51:58.963  => 110 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.357  00:51:58.963     111 		# Verify reregistering hotplug poller
01:01:06.357  00:51:58.963     112 		rpc_cmd bdev_nvme_set_hotplug -d
01:01:06.357  00:51:58.963     113 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.357  00:51:58.963     114 	
01:01:06.357  00:51:58.963     115 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.357  00:51:58.963       ...
01:01:06.357  00:51:58.963  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([])
01:01:06.357  00:51:58.963       ...
01:01:06.357  00:51:58.963     133 	
01:01:06.357  00:51:58.963     134 	# Run pci bus hotplug test
01:01:06.357  00:51:58.963     135 	run_hotplug
01:01:06.357  00:51:58.963     136 	
01:01:06.357  00:51:58.963     137 	# Run SPDK target based hotplug
01:01:06.357  00:51:58.963  => 138 	tgt_run_hotplug
01:01:06.357  00:51:58.963       ...
01:01:06.357  00:51:58.963  
01:01:06.357  00:51:58.963  ========== Backtrace end ==========
01:01:06.357  00:51:58.963  ========== Backtrace start: ==========
01:01:06.357  00:51:58.963  
01:01:06.357  00:51:58.963  in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"])
01:01:06.357  00:51:58.963       ...
01:01:06.357  00:51:58.963     710 	
01:01:06.357  00:51:58.963     711 		# We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to
01:01:06.357  00:51:58.963     712 		# catch only output from the time builtin - output from the actual cmd would be still visible,
01:01:06.357  00:51:58.963     713 		# but $() will return just the time'\''s data, hence making it possible to just do:
01:01:06.357  00:51:58.963     714 		#  time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd)
01:01:06.357  00:51:58.964  => 715 		time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1)
01:01:06.357  00:51:58.964     716 	
01:01:06.357  00:51:58.964     717 		echo "$time"
01:01:06.357  00:51:58.964     718 	)
01:01:06.357  00:51:58.964     719 	
01:01:06.357  00:51:58.964     720 	function timing_enter() {
01:01:06.357  00:51:58.964       ...
01:01:06.357  00:51:58.964  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"])
01:01:06.357  00:51:58.964       ...
01:01:06.357  00:51:58.964     11  	# Pci bus hotplug
01:01:06.357  00:51:58.964     12  	# Helper function to remove/attach cotrollers
01:01:06.357  00:51:58.964     13  	debug_remove_attach_helper() {
01:01:06.357  00:51:58.964     14  		local helper_time=0
01:01:06.357  00:51:58.964     15  	
01:01:06.357  00:51:58.964  => 16  		helper_time=$(timing_cmd remove_attach_helper "$@")
01:01:06.357  00:51:58.964     17  		printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \
01:01:06.357  00:51:58.964     18  			"$helper_time" "$nvme_count" >&2
01:01:06.357  00:51:58.964     19  	}
01:01:06.357  00:51:58.964     20  	
01:01:06.357  00:51:58.964     21  	remove_attach_helper() {
01:01:06.357  00:51:58.964       ...
01:01:06.357  00:51:58.964  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([])
01:01:06.357  00:51:58.964       ...
01:01:06.357  00:51:58.964     105 			waitforbdev "Nvme0${dev}n1" "$hotplug_wait"
01:01:06.357  00:51:58.964     106 		done
01:01:06.357  00:51:58.964     107 	
01:01:06.357  00:51:58.964     108 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.357  00:51:58.964     109 	
01:01:06.357  00:51:58.964  => 110 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.357  00:51:58.964     111 		# Verify reregistering hotplug poller
01:01:06.357  00:51:58.964     112 		rpc_cmd bdev_nvme_set_hotplug -d
01:01:06.357  00:51:58.964     113 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.357  00:51:58.964     114 	
01:01:06.357  00:51:58.964     115 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.357  00:51:58.964       ...
01:01:06.357  00:51:58.964  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([])
01:01:06.357  00:51:58.964       ...
01:01:06.357  00:51:58.964     133 	
01:01:06.357  00:51:58.964     134 	# Run pci bus hotplug test
01:01:06.357  00:51:58.964     135 	run_hotplug
01:01:06.357  00:51:58.964     136 	
01:01:06.357  00:51:58.964     137 	# Run SPDK target based hotplug
01:01:06.357  00:51:58.964  => 138 	tgt_run_hotplug
01:01:06.357  00:51:58.964       ...
01:01:06.357  00:51:58.964  
01:01:06.357  00:51:58.964  ========== Backtrace end ==========
01:01:06.357  00:51:58.964  ========== Backtrace start: ==========
01:01:06.357  00:51:58.964  
01:01:06.357  00:51:58.964  in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"])
01:01:06.357  00:51:58.964       ...
01:01:06.357  00:51:58.964     713 		# but $() will return just the time'\''s data, hence making it possible to just do:
01:01:06.357  00:51:58.964     714 		#  time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd)
01:01:06.357  00:51:58.964     715 		time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1)
01:01:06.357  00:51:58.964     716 	
01:01:06.357  00:51:58.964     717 		echo "$time"
01:01:06.357  00:51:58.964  => 718 	)
01:01:06.357  00:51:58.964     719 	
01:01:06.357  00:51:58.964     720 	function timing_enter() {
01:01:06.357  00:51:58.964     721 		xtrace_disable
01:01:06.357  00:51:58.964     722 		timing "enter" "$1"
01:01:06.357  00:51:58.964     723 		xtrace_restore
01:01:06.357  00:51:58.964       ...
01:01:06.357  00:51:58.964  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"])
01:01:06.357  00:51:58.964       ...
01:01:06.357  00:51:58.964     11  	# Pci bus hotplug
01:01:06.357  00:51:58.964     12  	# Helper function to remove/attach cotrollers
01:01:06.357  00:51:58.964     13  	debug_remove_attach_helper() {
01:01:06.357  00:51:58.964     14  		local helper_time=0
01:01:06.357  00:51:58.964     15  	
01:01:06.357  00:51:58.964  => 16  		helper_time=$(timing_cmd remove_attach_helper "$@")
01:01:06.357  00:51:58.964     17  		printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \
01:01:06.357  00:51:58.964     18  			"$helper_time" "$nvme_count" >&2
01:01:06.357  00:51:58.964     19  	}
01:01:06.357  00:51:58.964     20  	
01:01:06.357  00:51:58.964     21  	remove_attach_helper() {
01:01:06.357  00:51:58.964       ...
01:01:06.357  00:51:58.964  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([])
01:01:06.357  00:51:58.964       ...
01:01:06.357  00:51:58.964     105 			waitforbdev "Nvme0${dev}n1" "$hotplug_wait"
01:01:06.357  00:51:58.964     106 		done
01:01:06.357  00:51:58.964     107 	
01:01:06.357  00:51:58.964     108 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.357  00:51:58.964     109 	
01:01:06.357  00:51:58.964  => 110 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.357  00:51:58.964     111 		# Verify reregistering hotplug poller
01:01:06.357  00:51:58.964     112 		rpc_cmd bdev_nvme_set_hotplug -d
01:01:06.357  00:51:58.964     113 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.357  00:51:58.964     114 	
01:01:06.357  00:51:58.964     115 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.357  00:51:58.964       ...
01:01:06.357  00:51:58.964  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([])
01:01:06.357  00:51:58.964       ...
01:01:06.357  00:51:58.964     133 	
01:01:06.357  00:51:58.964     134 	# Run pci bus hotplug test
01:01:06.357  00:51:58.964     135 	run_hotplug
01:01:06.357  00:51:58.964     136 	
01:01:06.357  00:51:58.964     137 	# Run SPDK target based hotplug
01:01:06.357  00:51:58.964  => 138 	tgt_run_hotplug
01:01:06.357  00:51:58.964       ...
01:01:06.357  00:51:58.964  
01:01:06.357  00:51:58.964  ========== Backtrace end ==========
01:01:06.357  00:51:58.964  ========== Backtrace start: ==========
01:01:06.357  00:51:58.964  
01:01:06.357  00:51:58.964  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"])
01:01:06.357  00:51:58.964       ...
01:01:06.357  00:51:58.964     11  	# Pci bus hotplug
01:01:06.357  00:51:58.964     12  	# Helper function to remove/attach cotrollers
01:01:06.357  00:51:58.964     13  	debug_remove_attach_helper() {
01:01:06.357  00:51:58.964     14  		local helper_time=0
01:01:06.357  00:51:58.964     15  	
01:01:06.357  00:51:58.964  => 16  		helper_time=$(timing_cmd remove_attach_helper "$@")
01:01:06.357  00:51:58.964     17  		printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \
01:01:06.357  00:51:58.964     18  			"$helper_time" "$nvme_count" >&2
01:01:06.357  00:51:58.964     19  	}
01:01:06.357  00:51:58.964     20  	
01:01:06.357  00:51:58.964     21  	remove_attach_helper() {
01:01:06.357  00:51:58.964       ...
01:01:06.357  00:51:58.964  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([])
01:01:06.357  00:51:58.964       ...
01:01:06.358  00:51:58.964     105 			waitforbdev "Nvme0${dev}n1" "$hotplug_wait"
01:01:06.358  00:51:58.964     106 		done
01:01:06.358  00:51:58.964     107 	
01:01:06.358  00:51:58.964     108 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.358  00:51:58.964     109 	
01:01:06.358  00:51:58.964  => 110 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.358  00:51:58.964     111 		# Verify reregistering hotplug poller
01:01:06.358  00:51:58.964     112 		rpc_cmd bdev_nvme_set_hotplug -d
01:01:06.358  00:51:58.964     113 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.358  00:51:58.964     114 	
01:01:06.358  00:51:58.964     115 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.358  00:51:58.964       ...
01:01:06.358  00:51:58.964  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([])
01:01:06.358  00:51:58.964       ...
01:01:06.358  00:51:58.964     133 	
01:01:06.358  00:51:58.964     134 	# Run pci bus hotplug test
01:01:06.358  00:51:58.964     135 	run_hotplug
01:01:06.358  00:51:58.964     136 	
01:01:06.358  00:51:58.964     137 	# Run SPDK target based hotplug
01:01:06.358  00:51:58.964  => 138 	tgt_run_hotplug
01:01:06.358  00:51:58.964       ...
01:01:06.358  00:51:58.964  
01:01:06.358  00:51:58.964  ========== Backtrace end ==========
01:01:06.358  00:52:01.500  ========== Backtrace start: ==========
01:01:06.358  00:52:01.500  
01:01:06.358  00:52:01.500  in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh"])
01:01:06.358  00:52:01.500       ...
01:01:06.358  00:52:01.500     1117		timing_enter $test_name
01:01:06.358  00:52:01.500     1118		echo "************************************"
01:01:06.358  00:52:01.500     1119		echo "START TEST $test_name"
01:01:06.358  00:52:01.500     1120		echo "************************************"
01:01:06.358  00:52:01.500     1121		xtrace_restore
01:01:06.358  00:52:01.500     1122		time "$@"
01:01:06.358  00:52:01.500     1123		xtrace_disable
01:01:06.358  00:52:01.500     1124		echo "************************************"
01:01:06.358  00:52:01.500     1125		echo "END TEST $test_name"
01:01:06.358  00:52:01.500     1126		echo "************************************"
01:01:06.358  00:52:01.500     1127		timing_exit $test_name
01:01:06.358  00:52:01.500       ...
01:01:06.358  00:52:01.500  in /home/vagrant/spdk_repo/spdk/autotest.sh:240 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"])
01:01:06.358  00:52:01.500       ...
01:01:06.358  00:52:01.500     235 	
01:01:06.358  00:52:01.500     236 			run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh
01:01:06.358  00:52:01.500     237 			run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh
01:01:06.358  00:52:01.500     238 	
01:01:06.358  00:52:01.500     239 			if [ $(uname -s) = Linux ]; then
01:01:06.358  00:52:01.500  => 240 				run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh
01:01:06.358  00:52:01.500     241 			fi
01:01:06.358  00:52:01.500     242 	
01:01:06.358  00:52:01.500     243 			if [[ $SPDK_TEST_XNVME -eq 1 ]]; then
01:01:06.358  00:52:01.500     244 				run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh
01:01:06.358  00:52:01.500     245 				run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme"
01:01:06.358  00:52:01.500       ...
01:01:06.358  00:52:01.500  
01:01:06.358  00:52:01.500  ========== Backtrace end =========='
01:01:06.358  + [[ -n 00:51:58.963    09:11:13 sw_hotplug -- common/autotest_common.sh@715 -- # time='========== Backtrace start: ==========
01:01:06.358  00:51:58.963  
01:01:06.358  00:51:58.963  in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"])
01:01:06.358  00:51:58.963       ...
01:01:06.358  00:51:58.963     710 	
01:01:06.358  00:51:58.963     711 		# We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to
01:01:06.358  00:51:58.963     712 		# catch only output from the time builtin - output from the actual cmd would be still visible,
01:01:06.358  00:51:58.963     713 		# but $() will return just the time'\''s data, hence making it possible to just do:
01:01:06.358  00:51:58.963     714 		#  time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd)
01:01:06.358  00:51:58.963  => 715 		time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1)
01:01:06.358  00:51:58.963     716 	
01:01:06.358  00:51:58.963     717 		echo "$time"
01:01:06.358  00:51:58.963     718 	)
01:01:06.358  00:51:58.963     719 	
01:01:06.358  00:51:58.963     720 	function timing_enter() {
01:01:06.358  00:51:58.963       ...
01:01:06.358  00:51:58.963  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"])
01:01:06.358  00:51:58.963       ...
01:01:06.358  00:51:58.963     11  	# Pci bus hotplug
01:01:06.358  00:51:58.963     12  	# Helper function to remove/attach cotrollers
01:01:06.358  00:51:58.963     13  	debug_remove_attach_helper() {
01:01:06.358  00:51:58.963     14  		local helper_time=0
01:01:06.358  00:51:58.963     15  	
01:01:06.358  00:51:58.963  => 16  		helper_time=$(timing_cmd remove_attach_helper "$@")
01:01:06.358  00:51:58.963     17  		printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \
01:01:06.358  00:51:58.963     18  			"$helper_time" "$nvme_count" >&2
01:01:06.358  00:51:58.963     19  	}
01:01:06.358  00:51:58.963     20  	
01:01:06.358  00:51:58.963     21  	remove_attach_helper() {
01:01:06.358  00:51:58.963       ...
01:01:06.358  00:51:58.963  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([])
01:01:06.358  00:51:58.963       ...
01:01:06.358  00:51:58.963     105 			waitforbdev "Nvme0${dev}n1" "$hotplug_wait"
01:01:06.358  00:51:58.963     106 		done
01:01:06.358  00:51:58.963     107 	
01:01:06.358  00:51:58.963     108 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.358  00:51:58.963     109 	
01:01:06.358  00:51:58.963  => 110 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.358  00:51:58.963     111 		# Verify reregistering hotplug poller
01:01:06.358  00:51:58.963     112 		rpc_cmd bdev_nvme_set_hotplug -d
01:01:06.358  00:51:58.963     113 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.358  00:51:58.963     114 	
01:01:06.358  00:51:58.963     115 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.358  00:51:58.963       ...
01:01:06.358  00:51:58.963  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([])
01:01:06.358  00:51:58.963       ...
01:01:06.358  00:51:58.963     133 	
01:01:06.358  00:51:58.963     134 	# Run pci bus hotplug test
01:01:06.358  00:51:58.963     135 	run_hotplug
01:01:06.358  00:51:58.963     136 	
01:01:06.358  00:51:58.963     137 	# Run SPDK target based hotplug
01:01:06.358  00:51:58.963  => 138 	tgt_run_hotplug
01:01:06.358  00:51:58.963       ...
01:01:06.358  00:51:58.963  
01:01:06.358  00:51:58.963  ========== Backtrace end ==========
01:01:06.358  00:51:58.963  ========== Backtrace start: ==========
01:01:06.358  00:51:58.963  
01:01:06.358  00:51:58.963  in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"])
01:01:06.358  00:51:58.963       ...
01:01:06.358  00:51:58.963     710 	
01:01:06.358  00:51:58.963     711 		# We redirect cmd's std{out,err} to a separate fd dup'ed to stdin's device (or /dev/null) to
01:01:06.358  00:51:58.963     712 		# catch only output from the time builtin - output from the actual cmd would be still visible,
01:01:06.358  00:51:58.963     713 		# but $() will return just the time's data, hence making it possible to just do:
01:01:06.358  00:51:58.963     714 		#  time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd)
01:01:06.358  00:51:58.964  => 715 		time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1)
01:01:06.358  00:51:58.964     716 	
01:01:06.358  00:51:58.964     717 		echo "$time"
01:01:06.358  00:51:58.964     718 	)
01:01:06.358  00:51:58.964     719 	
01:01:06.358  00:51:58.964     720 	function timing_enter() {
01:01:06.358  00:51:58.964       ...
01:01:06.358  00:51:58.964  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"])
01:01:06.358  00:51:58.964       ...
01:01:06.358  00:51:58.964     11  	# Pci bus hotplug
01:01:06.358  00:51:58.964     12  	# Helper function to remove/attach cotrollers
01:01:06.358  00:51:58.964     13  	debug_remove_attach_helper() {
01:01:06.358  00:51:58.964     14  		local helper_time=0
01:01:06.358  00:51:58.964     15  	
01:01:06.358  00:51:58.964  => 16  		helper_time=$(timing_cmd remove_attach_helper "$@")
01:01:06.358  00:51:58.964     17  		printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \
01:01:06.358  00:51:58.964     18  			"$helper_time" "$nvme_count" >&2
01:01:06.358  00:51:58.964     19  	}
01:01:06.358  00:51:58.964     20  	
01:01:06.358  00:51:58.964     21  	remove_attach_helper() {
01:01:06.358  00:51:58.964       ...
01:01:06.358  00:51:58.964  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([])
01:01:06.358  00:51:58.964       ...
01:01:06.358  00:51:58.964     105 			waitforbdev "Nvme0${dev}n1" "$hotplug_wait"
01:01:06.358  00:51:58.964     106 		done
01:01:06.358  00:51:58.964     107 	
01:01:06.358  00:51:58.964     108 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.358  00:51:58.964     109 	
01:01:06.358  00:51:58.964  => 110 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.358  00:51:58.964     111 		# Verify reregistering hotplug poller
01:01:06.358  00:51:58.964     112 		rpc_cmd bdev_nvme_set_hotplug -d
01:01:06.358  00:51:58.964     113 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.358  00:51:58.964     114 	
01:01:06.358  00:51:58.964     115 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.358  00:51:58.964       ...
01:01:06.358  00:51:58.964  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([])
01:01:06.358  00:51:58.964       ...
01:01:06.358  00:51:58.964     133 	
01:01:06.358  00:51:58.964     134 	# Run pci bus hotplug test
01:01:06.358  00:51:58.964     135 	run_hotplug
01:01:06.358  00:51:58.964     136 	
01:01:06.358  00:51:58.964     137 	# Run SPDK target based hotplug
01:01:06.358  00:51:58.964  => 138 	tgt_run_hotplug
01:01:06.358  00:51:58.964       ...
01:01:06.358  00:51:58.964  
01:01:06.358  00:51:58.964  ========== Backtrace end ==========
01:01:06.358  00:51:58.964  ========== Backtrace start: ==========
01:01:06.358  00:51:58.964  
01:01:06.358  00:51:58.964  in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"])
01:01:06.358  00:51:58.964       ...
01:01:06.358  00:51:58.964     713 		# but $() will return just the time's data, hence making it possible to just do:
01:01:06.358  00:51:58.964     714 		#  time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd)
01:01:06.358  00:51:58.964     715 		time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1)
01:01:06.358  00:51:58.964     716 	
01:01:06.358  00:51:58.964     717 		echo "$time"
01:01:06.358  00:51:58.964  => 718 	)
01:01:06.358  00:51:58.964     719 	
01:01:06.358  00:51:58.964     720 	function timing_enter() {
01:01:06.358  00:51:58.964     721 		xtrace_disable
01:01:06.358  00:51:58.964     722 		timing "enter" "$1"
01:01:06.358  00:51:58.964     723 		xtrace_restore
01:01:06.358  00:51:58.964       ...
01:01:06.358  00:51:58.964  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"])
01:01:06.358  00:51:58.964       ...
01:01:06.358  00:51:58.964     11  	# Pci bus hotplug
01:01:06.359  00:51:58.964     12  	# Helper function to remove/attach cotrollers
01:01:06.359  00:51:58.964     13  	debug_remove_attach_helper() {
01:01:06.359  00:51:58.964     14  		local helper_time=0
01:01:06.359  00:51:58.964     15  	
01:01:06.359  00:51:58.964  => 16  		helper_time=$(timing_cmd remove_attach_helper "$@")
01:01:06.359  00:51:58.964     17  		printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \
01:01:06.359  00:51:58.964     18  			"$helper_time" "$nvme_count" >&2
01:01:06.359  00:51:58.964     19  	}
01:01:06.359  00:51:58.964     20  	
01:01:06.359  00:51:58.964     21  	remove_attach_helper() {
01:01:06.359  00:51:58.964       ...
01:01:06.359  00:51:58.964  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([])
01:01:06.359  00:51:58.964       ...
01:01:06.359  00:51:58.964     105 			waitforbdev "Nvme0${dev}n1" "$hotplug_wait"
01:01:06.359  00:51:58.964     106 		done
01:01:06.359  00:51:58.964     107 	
01:01:06.359  00:51:58.964     108 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.359  00:51:58.964     109 	
01:01:06.359  00:51:58.964  => 110 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.359  00:51:58.964     111 		# Verify reregistering hotplug poller
01:01:06.359  00:51:58.964     112 		rpc_cmd bdev_nvme_set_hotplug -d
01:01:06.359  00:51:58.964     113 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.359  00:51:58.964     114 	
01:01:06.359  00:51:58.964     115 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.359  00:51:58.964       ...
01:01:06.359  00:51:58.964  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([])
01:01:06.359  00:51:58.964       ...
01:01:06.359  00:51:58.964     133 	
01:01:06.359  00:51:58.964     134 	# Run pci bus hotplug test
01:01:06.359  00:51:58.964     135 	run_hotplug
01:01:06.359  00:51:58.964     136 	
01:01:06.359  00:51:58.964     137 	# Run SPDK target based hotplug
01:01:06.359  00:51:58.964  => 138 	tgt_run_hotplug
01:01:06.359  00:51:58.964       ...
01:01:06.359  00:51:58.964  
01:01:06.359  00:51:58.964  ========== Backtrace end ==========
01:01:06.359  00:51:58.964  ========== Backtrace start: ==========
01:01:06.359  00:51:58.964  
01:01:06.359  00:51:58.964  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"])
01:01:06.359  00:51:58.964       ...
01:01:06.359  00:51:58.964     11  	# Pci bus hotplug
01:01:06.359  00:51:58.964     12  	# Helper function to remove/attach cotrollers
01:01:06.359  00:51:58.964     13  	debug_remove_attach_helper() {
01:01:06.359  00:51:58.964     14  		local helper_time=0
01:01:06.359  00:51:58.964     15  	
01:01:06.359  00:51:58.964  => 16  		helper_time=$(timing_cmd remove_attach_helper "$@")
01:01:06.359  00:51:58.964     17  		printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \
01:01:06.359  00:51:58.964     18  			"$helper_time" "$nvme_count" >&2
01:01:06.359  00:51:58.964     19  	}
01:01:06.359  00:51:58.964     20  	
01:01:06.359  00:51:58.964     21  	remove_attach_helper() {
01:01:06.359  00:51:58.964       ...
01:01:06.359  00:51:58.964  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([])
01:01:06.359  00:51:58.964       ...
01:01:06.359  00:51:58.964     105 			waitforbdev "Nvme0${dev}n1" "$hotplug_wait"
01:01:06.359  00:51:58.964     106 		done
01:01:06.359  00:51:58.964     107 	
01:01:06.359  00:51:58.964     108 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.359  00:51:58.964     109 	
01:01:06.359  00:51:58.964  => 110 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.359  00:51:58.964     111 		# Verify reregistering hotplug poller
01:01:06.359  00:51:58.964     112 		rpc_cmd bdev_nvme_set_hotplug -d
01:01:06.359  00:51:58.964     113 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.359  00:51:58.964     114 	
01:01:06.359  00:51:58.964     115 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.359  00:51:58.964       ...
01:01:06.359  00:51:58.964  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([])
01:01:06.359  00:51:58.964       ...
01:01:06.359  00:51:58.964     133 	
01:01:06.359  00:51:58.964     134 	# Run pci bus hotplug test
01:01:06.359  00:51:58.964     135 	run_hotplug
01:01:06.359  00:51:58.964     136 	
01:01:06.359  00:51:58.964     137 	# Run SPDK target based hotplug
01:01:06.359  00:51:58.964  => 138 	tgt_run_hotplug
01:01:06.359  00:51:58.964       ...
01:01:06.359  00:51:58.964  
01:01:06.359  00:51:58.964  ========== Backtrace end ==========
01:01:06.359  00:52:01.500  ========== Backtrace start: ==========
01:01:06.359  00:52:01.500  
01:01:06.359  00:52:01.500  in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh"])
01:01:06.359  00:52:01.500       ...
01:01:06.359  00:52:01.500     1117		timing_enter $test_name
01:01:06.359  00:52:01.500     1118		echo "************************************"
01:01:06.359  00:52:01.500     1119		echo "START TEST $test_name"
01:01:06.359  00:52:01.500     1120		echo "************************************"
01:01:06.359  00:52:01.500     1121		xtrace_restore
01:01:06.359  00:52:01.500     1122		time "$@"
01:01:06.359  00:52:01.500     1123		xtrace_disable
01:01:06.359  00:52:01.500     1124		echo "************************************"
01:01:06.359  00:52:01.500     1125		echo "END TEST $test_name"
01:01:06.359  00:52:01.500     1126		echo "************************************"
01:01:06.359  00:52:01.500     1127		timing_exit $test_name
01:01:06.359  00:52:01.500       ...
01:01:06.359  00:52:01.500  in /home/vagrant/spdk_repo/spdk/autotest.sh:240 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"])
01:01:06.359  00:52:01.500       ...
01:01:06.359  00:52:01.500     235 	
01:01:06.359  00:52:01.500     236 			run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh
01:01:06.359  00:52:01.500     237 			run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh
01:01:06.359  00:52:01.500     238 	
01:01:06.359  00:52:01.500     239 			if [ $(uname -s) = Linux ]; then
01:01:06.359  00:52:01.500  => 240 				run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh
01:01:06.359  00:52:01.500     241 			fi
01:01:06.359  00:52:01.500     242 	
01:01:06.359  00:52:01.500     243 			if [[ $SPDK_TEST_XNVME -eq 1 ]]; then
01:01:06.359  00:52:01.500     244 				run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh
01:01:06.359  00:52:01.500     245 				run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme"
01:01:06.359  00:52:01.500       ...
01:01:06.359  00:52:01.500  
01:01:06.359  00:52:01.500  ========== Backtrace end ========== ]]
01:01:06.359  + echo '00:51:58.963    09:11:13 sw_hotplug -- common/autotest_common.sh@715 -- # time='\''========== Backtrace start: ==========
01:01:06.359  00:51:58.963  
01:01:06.359  00:51:58.963  in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"])
01:01:06.359  00:51:58.963       ...
01:01:06.359  00:51:58.963     710 	
01:01:06.359  00:51:58.963     711 		# We redirect cmd'\''\'\'''\''s std{out,err} to a separate fd dup'\''\'\'''\''ed to stdin'\''\'\'''\''s device (or /dev/null) to
01:01:06.359  00:51:58.963     712 		# catch only output from the time builtin - output from the actual cmd would be still visible,
01:01:06.359  00:51:58.963     713 		# but $() will return just the time'\''\'\'''\''s data, hence making it possible to just do:
01:01:06.359  00:51:58.963     714 		#  time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd)
01:01:06.359  00:51:58.963  => 715 		time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1)
01:01:06.359  00:51:58.963     716 	
01:01:06.359  00:51:58.963     717 		echo "$time"
01:01:06.359  00:51:58.963     718 	)
01:01:06.359  00:51:58.963     719 	
01:01:06.359  00:51:58.963     720 	function timing_enter() {
01:01:06.359  00:51:58.963       ...
01:01:06.359  00:51:58.963  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"])
01:01:06.359  00:51:58.963       ...
01:01:06.359  00:51:58.963     11  	# Pci bus hotplug
01:01:06.359  00:51:58.963     12  	# Helper function to remove/attach cotrollers
01:01:06.359  00:51:58.963     13  	debug_remove_attach_helper() {
01:01:06.359  00:51:58.963     14  		local helper_time=0
01:01:06.359  00:51:58.963     15  	
01:01:06.359  00:51:58.963  => 16  		helper_time=$(timing_cmd remove_attach_helper "$@")
01:01:06.359  00:51:58.963     17  		printf '\''\'\'''\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\''\'\'''\'' \
01:01:06.359  00:51:58.963     18  			"$helper_time" "$nvme_count" >&2
01:01:06.359  00:51:58.963     19  	}
01:01:06.359  00:51:58.963     20  	
01:01:06.359  00:51:58.963     21  	remove_attach_helper() {
01:01:06.359  00:51:58.963       ...
01:01:06.359  00:51:58.963  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([])
01:01:06.359  00:51:58.963       ...
01:01:06.359  00:51:58.963     105 			waitforbdev "Nvme0${dev}n1" "$hotplug_wait"
01:01:06.359  00:51:58.963     106 		done
01:01:06.359  00:51:58.963     107 	
01:01:06.359  00:51:58.963     108 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.359  00:51:58.963     109 	
01:01:06.359  00:51:58.963  => 110 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.360  00:51:58.963     111 		# Verify reregistering hotplug poller
01:01:06.360  00:51:58.963     112 		rpc_cmd bdev_nvme_set_hotplug -d
01:01:06.360  00:51:58.963     113 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.360  00:51:58.963     114 	
01:01:06.360  00:51:58.963     115 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.360  00:51:58.963       ...
01:01:06.360  00:51:58.963  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([])
01:01:06.360  00:51:58.963       ...
01:01:06.360  00:51:58.963     133 	
01:01:06.360  00:51:58.963     134 	# Run pci bus hotplug test
01:01:06.360  00:51:58.963     135 	run_hotplug
01:01:06.360  00:51:58.963     136 	
01:01:06.360  00:51:58.963     137 	# Run SPDK target based hotplug
01:01:06.360  00:51:58.963  => 138 	tgt_run_hotplug
01:01:06.360  00:51:58.963       ...
01:01:06.360  00:51:58.963  
01:01:06.360  00:51:58.963  ========== Backtrace end ==========
01:01:06.360  00:51:58.963  ========== Backtrace start: ==========
01:01:06.360  00:51:58.963  
01:01:06.360  00:51:58.963  in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"])
01:01:06.360  00:51:58.963       ...
01:01:06.360  00:51:58.963     710 	
01:01:06.360  00:51:58.963     711 		# We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to
01:01:06.360  00:51:58.963     712 		# catch only output from the time builtin - output from the actual cmd would be still visible,
01:01:06.360  00:51:58.963     713 		# but $() will return just the time'\''s data, hence making it possible to just do:
01:01:06.360  00:51:58.963     714 		#  time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd)
01:01:06.360  00:51:58.964  => 715 		time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1)
01:01:06.360  00:51:58.964     716 	
01:01:06.360  00:51:58.964     717 		echo "$time"
01:01:06.360  00:51:58.964     718 	)
01:01:06.360  00:51:58.964     719 	
01:01:06.360  00:51:58.964     720 	function timing_enter() {
01:01:06.360  00:51:58.964       ...
01:01:06.360  00:51:58.964  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"])
01:01:06.360  00:51:58.964       ...
01:01:06.360  00:51:58.964     11  	# Pci bus hotplug
01:01:06.360  00:51:58.964     12  	# Helper function to remove/attach cotrollers
01:01:06.360  00:51:58.964     13  	debug_remove_attach_helper() {
01:01:06.360  00:51:58.964     14  		local helper_time=0
01:01:06.360  00:51:58.964     15  	
01:01:06.360  00:51:58.964  => 16  		helper_time=$(timing_cmd remove_attach_helper "$@")
01:01:06.360  00:51:58.964     17  		printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \
01:01:06.360  00:51:58.964     18  			"$helper_time" "$nvme_count" >&2
01:01:06.360  00:51:58.964     19  	}
01:01:06.360  00:51:58.964     20  	
01:01:06.360  00:51:58.964     21  	remove_attach_helper() {
01:01:06.360  00:51:58.964       ...
01:01:06.360  00:51:58.964  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([])
01:01:06.360  00:51:58.964       ...
01:01:06.360  00:51:58.964     105 			waitforbdev "Nvme0${dev}n1" "$hotplug_wait"
01:01:06.360  00:51:58.964     106 		done
01:01:06.360  00:51:58.964     107 	
01:01:06.360  00:51:58.964     108 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.360  00:51:58.964     109 	
01:01:06.360  00:51:58.964  => 110 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.360  00:51:58.964     111 		# Verify reregistering hotplug poller
01:01:06.360  00:51:58.964     112 		rpc_cmd bdev_nvme_set_hotplug -d
01:01:06.360  00:51:58.964     113 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.360  00:51:58.964     114 	
01:01:06.360  00:51:58.964     115 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.360  00:51:58.964       ...
01:01:06.360  00:51:58.964  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([])
01:01:06.360  00:51:58.964       ...
01:01:06.360  00:51:58.964     133 	
01:01:06.360  00:51:58.964     134 	# Run pci bus hotplug test
01:01:06.360  00:51:58.964     135 	run_hotplug
01:01:06.360  00:51:58.964     136 	
01:01:06.360  00:51:58.964     137 	# Run SPDK target based hotplug
01:01:06.360  00:51:58.964  => 138 	tgt_run_hotplug
01:01:06.360  00:51:58.964       ...
01:01:06.360  00:51:58.964  
01:01:06.360  00:51:58.964  ========== Backtrace end ==========
01:01:06.360  00:51:58.964  ========== Backtrace start: ==========
01:01:06.360  00:51:58.964  
01:01:06.360  00:51:58.964  in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"])
01:01:06.360  00:51:58.964       ...
01:01:06.360  00:51:58.964     713 		# but $() will return just the time'\''s data, hence making it possible to just do:
01:01:06.360  00:51:58.964     714 		#  time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd)
01:01:06.360  00:51:58.964     715 		time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1)
01:01:06.360  00:51:58.964     716 	
01:01:06.360  00:51:58.964     717 		echo "$time"
01:01:06.360  00:51:58.964  => 718 	)
01:01:06.360  00:51:58.964     719 	
01:01:06.360  00:51:58.964     720 	function timing_enter() {
01:01:06.360  00:51:58.964     721 		xtrace_disable
01:01:06.360  00:51:58.964     722 		timing "enter" "$1"
01:01:06.360  00:51:58.964     723 		xtrace_restore
01:01:06.360  00:51:58.964       ...
01:01:06.360  00:51:58.964  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"])
01:01:06.360  00:51:58.964       ...
01:01:06.360  00:51:58.964     11  	# Pci bus hotplug
01:01:06.360  00:51:58.964     12  	# Helper function to remove/attach cotrollers
01:01:06.360  00:51:58.964     13  	debug_remove_attach_helper() {
01:01:06.360  00:51:58.964     14  		local helper_time=0
01:01:06.360  00:51:58.964     15  	
01:01:06.360  00:51:58.964  => 16  		helper_time=$(timing_cmd remove_attach_helper "$@")
01:01:06.360  00:51:58.964     17  		printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \
01:01:06.360  00:51:58.964     18  			"$helper_time" "$nvme_count" >&2
01:01:06.360  00:51:58.964     19  	}
01:01:06.360  00:51:58.964     20  	
01:01:06.360  00:51:58.964     21  	remove_attach_helper() {
01:01:06.360  00:51:58.964       ...
01:01:06.360  00:51:58.964  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([])
01:01:06.360  00:51:58.964       ...
01:01:06.360  00:51:58.964     105 			waitforbdev "Nvme0${dev}n1" "$hotplug_wait"
01:01:06.360  00:51:58.964     106 		done
01:01:06.360  00:51:58.964     107 	
01:01:06.360  00:51:58.964     108 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.360  00:51:58.964     109 	
01:01:06.360  00:51:58.964  => 110 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.360  00:51:58.964     111 		# Verify reregistering hotplug poller
01:01:06.360  00:51:58.964     112 		rpc_cmd bdev_nvme_set_hotplug -d
01:01:06.360  00:51:58.964     113 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.360  00:51:58.964     114 	
01:01:06.360  00:51:58.964     115 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.360  00:51:58.964       ...
01:01:06.360  00:51:58.964  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([])
01:01:06.360  00:51:58.964       ...
01:01:06.360  00:51:58.964     133 	
01:01:06.360  00:51:58.964     134 	# Run pci bus hotplug test
01:01:06.360  00:51:58.964     135 	run_hotplug
01:01:06.360  00:51:58.964     136 	
01:01:06.360  00:51:58.964     137 	# Run SPDK target based hotplug
01:01:06.360  00:51:58.964  => 138 	tgt_run_hotplug
01:01:06.360  00:51:58.964       ...
01:01:06.360  00:51:58.964  
01:01:06.360  00:51:58.964  ========== Backtrace end ==========
01:01:06.360  00:51:58.964  ========== Backtrace start: ==========
01:01:06.360  00:51:58.964  
01:01:06.360  00:51:58.964  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"])
01:01:06.360  00:51:58.964       ...
01:01:06.360  00:51:58.964     11  	# Pci bus hotplug
01:01:06.360  00:51:58.964     12  	# Helper function to remove/attach cotrollers
01:01:06.360  00:51:58.964     13  	debug_remove_attach_helper() {
01:01:06.360  00:51:58.964     14  		local helper_time=0
01:01:06.360  00:51:58.964     15  	
01:01:06.360  00:51:58.964  => 16  		helper_time=$(timing_cmd remove_attach_helper "$@")
01:01:06.360  00:51:58.964     17  		printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \
01:01:06.360  00:51:58.964     18  			"$helper_time" "$nvme_count" >&2
01:01:06.360  00:51:58.964     19  	}
01:01:06.360  00:51:58.964     20  	
01:01:06.360  00:51:58.964     21  	remove_attach_helper() {
01:01:06.360  00:51:58.964       ...
01:01:06.360  00:51:58.964  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([])
01:01:06.360  00:51:58.964       ...
01:01:06.360  00:51:58.964     105 			waitforbdev "Nvme0${dev}n1" "$hotplug_wait"
01:01:06.360  00:51:58.964     106 		done
01:01:06.360  00:51:58.964     107 	
01:01:06.360  00:51:58.964     108 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.360  00:51:58.964     109 	
01:01:06.360  00:51:58.964  => 110 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.360  00:51:58.964     111 		# Verify reregistering hotplug poller
01:01:06.360  00:51:58.964     112 		rpc_cmd bdev_nvme_set_hotplug -d
01:01:06.360  00:51:58.964     113 		rpc_cmd bdev_nvme_set_hotplug -e
01:01:06.360  00:51:58.964     114 	
01:01:06.360  00:51:58.964     115 		debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true
01:01:06.360  00:51:58.964       ...
01:01:06.360  00:51:58.964  in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([])
01:01:06.361  00:51:58.964       ...
01:01:06.361  00:51:58.964     133 	
01:01:06.361  00:51:58.964     134 	# Run pci bus hotplug test
01:01:06.361  00:51:58.964     135 	run_hotplug
01:01:06.361  00:51:58.964     136 	
01:01:06.361  00:51:58.964     137 	# Run SPDK target based hotplug
01:01:06.361  00:51:58.964  => 138 	tgt_run_hotplug
01:01:06.361  00:51:58.964       ...
01:01:06.361  00:51:58.964  
01:01:06.361  00:51:58.964  ========== Backtrace end ==========
01:01:06.361  00:52:01.500  ========== Backtrace start: ==========
01:01:06.361  00:52:01.500  
01:01:06.361  00:52:01.500  in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh"])
01:01:06.361  00:52:01.500       ...
01:01:06.361  00:52:01.500     1117		timing_enter $test_name
01:01:06.361  00:52:01.500     1118		echo "************************************"
01:01:06.361  00:52:01.500     1119		echo "START TEST $test_name"
01:01:06.361  00:52:01.500     1120		echo "************************************"
01:01:06.361  00:52:01.500     1121		xtrace_restore
01:01:06.361  00:52:01.500     1122		time "$@"
01:01:06.361  00:52:01.500     1123		xtrace_disable
01:01:06.361  00:52:01.500     1124		echo "************************************"
01:01:06.361  00:52:01.500     1125		echo "END TEST $test_name"
01:01:06.361  00:52:01.500     1126		echo "************************************"
01:01:06.361  00:52:01.500     1127		timing_exit $test_name
01:01:06.361  00:52:01.500       ...
01:01:06.361  00:52:01.500  in /home/vagrant/spdk_repo/spdk/autotest.sh:240 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"])
01:01:06.361  00:52:01.500       ...
01:01:06.361  00:52:01.500     235 	
01:01:06.361  00:52:01.500     236 			run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh
01:01:06.361  00:52:01.500     237 			run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh
01:01:06.361  00:52:01.500     238 	
01:01:06.361  00:52:01.500     239 			if [ $(uname -s) = Linux ]; then
01:01:06.361  00:52:01.500  => 240 				run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh
01:01:06.361  00:52:01.500     241 			fi
01:01:06.361  00:52:01.500     242 	
01:01:06.361  00:52:01.500     243 			if [[ $SPDK_TEST_XNVME -eq 1 ]]; then
01:01:06.361  00:52:01.500     244 				run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh
01:01:06.361  00:52:01.500     245 				run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme"
01:01:06.361  00:52:01.500       ...
01:01:06.361  00:52:01.500  
01:01:06.361  00:52:01.500  ========== Backtrace end =========='
01:01:06.361  + for build in "${build_log_list[@]}"
01:01:06.361  + create_errtrace_file /var/jenkins/workspace/autotest-per-patch/vfio-user-phy-autotest_26208/build.log
01:01:06.361  + local build_log job_name start_pattern end_pattern backtraces
01:01:06.361  + build_log=/var/jenkins/workspace/autotest-per-patch/vfio-user-phy-autotest_26208/build.log
01:01:06.361  +++ dirname /var/jenkins/workspace/autotest-per-patch/vfio-user-phy-autotest_26208/build.log
01:01:06.361  ++ basename /var/jenkins/workspace/autotest-per-patch/vfio-user-phy-autotest_26208
01:01:06.361  + job_name=vfio-user-phy-autotest_26208
01:01:06.361  + start_pattern='Backtrace start'
01:01:06.361  + end_pattern='Backtrace end'
01:01:06.361  + [[ -f /var/jenkins/workspace/autotest-per-patch/vfio-user-phy-autotest_26208/build.log ]]
01:01:06.361  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch/vfio-user-phy-autotest_26208/build.log
01:01:06.361  + backtraces=
01:01:06.361  + [[ -n '' ]]
01:01:06.361  + for build in "${build_log_list[@]}"
01:01:06.361  + create_errtrace_file /var/jenkins/workspace/autotest-per-patch/iscsi-vg-autotest_77518/build.log
01:01:06.361  + local build_log job_name start_pattern end_pattern backtraces
01:01:06.361  + build_log=/var/jenkins/workspace/autotest-per-patch/iscsi-vg-autotest_77518/build.log
01:01:06.361  +++ dirname /var/jenkins/workspace/autotest-per-patch/iscsi-vg-autotest_77518/build.log
01:01:06.361  ++ basename /var/jenkins/workspace/autotest-per-patch/iscsi-vg-autotest_77518
01:01:06.361  + job_name=iscsi-vg-autotest_77518
01:01:06.361  + start_pattern='Backtrace start'
01:01:06.361  + end_pattern='Backtrace end'
01:01:06.361  + [[ -f /var/jenkins/workspace/autotest-per-patch/iscsi-vg-autotest_77518/build.log ]]
01:01:06.361  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch/iscsi-vg-autotest_77518/build.log
01:01:06.361  + backtraces=
01:01:06.361  + [[ -n '' ]]
01:01:06.361  + for build in "${build_log_list[@]}"
01:01:06.361  + create_errtrace_file /var/jenkins/workspace/autotest-per-patch/ubuntu22-vg-autotest_37813/build.log
01:01:06.361  + local build_log job_name start_pattern end_pattern backtraces
01:01:06.361  + build_log=/var/jenkins/workspace/autotest-per-patch/ubuntu22-vg-autotest_37813/build.log
01:01:06.361  +++ dirname /var/jenkins/workspace/autotest-per-patch/ubuntu22-vg-autotest_37813/build.log
01:01:06.361  ++ basename /var/jenkins/workspace/autotest-per-patch/ubuntu22-vg-autotest_37813
01:01:06.361  + job_name=ubuntu22-vg-autotest_37813
01:01:06.361  + start_pattern='Backtrace start'
01:01:06.361  + end_pattern='Backtrace end'
01:01:06.361  + [[ -f /var/jenkins/workspace/autotest-per-patch/ubuntu22-vg-autotest_37813/build.log ]]
01:01:06.361  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-per-patch/ubuntu22-vg-autotest_37813/build.log
01:01:06.361  + backtraces=
01:01:06.361  + [[ -n '' ]]
01:01:06.361  + run_flamegraph
01:01:06.361  + create_timing_file
01:01:06.361  + local array file
01:01:06.361  + array=($(find $WORKSPACE -type f -name 'timing.txt'))
01:01:06.361  ++ find /var/jenkins/workspace/autotest-per-patch -type f -name timing.txt
01:01:06.621  + timing_dir=/var/jenkins/workspace/autotest-per-patch/post_process
01:01:06.621  + mkdir -p /var/jenkins/workspace/autotest-per-patch/post_process
01:01:06.621  + timing_file=/var/jenkins/workspace/autotest-per-patch/post_process/total_timing.txt
01:01:06.621  + for file in "${array[@]}"
01:01:06.621  + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch/unittest-clang-docker-autotest_19862/timing.txt
01:01:06.621  + local job_file job_name
01:01:06.621  + job_file=/var/jenkins/workspace/autotest-per-patch/unittest-clang-docker-autotest_19862/timing.txt
01:01:06.621  +++ dirname /var/jenkins/workspace/autotest-per-patch/unittest-clang-docker-autotest_19862/timing.txt
01:01:06.621  ++ basename /var/jenkins/workspace/autotest-per-patch/unittest-clang-docker-autotest_19862
01:01:06.621  + job_name=unittest-clang-docker-autotest_19862
01:01:06.621  + sed 's/^/unittest-clang-docker-autotest_19862;autorun;/' /var/jenkins/workspace/autotest-per-patch/unittest-clang-docker-autotest_19862/timing.txt
01:01:06.621  + for file in "${array[@]}"
01:01:06.621  + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch/doc-docker-autotest_22325/timing.txt
01:01:06.621  + local job_file job_name
01:01:06.621  + job_file=/var/jenkins/workspace/autotest-per-patch/doc-docker-autotest_22325/timing.txt
01:01:06.621  +++ dirname /var/jenkins/workspace/autotest-per-patch/doc-docker-autotest_22325/timing.txt
01:01:06.621  ++ basename /var/jenkins/workspace/autotest-per-patch/doc-docker-autotest_22325
01:01:06.621  + job_name=doc-docker-autotest_22325
01:01:06.621  + sed 's/^/doc-docker-autotest_22325;autorun;/' /var/jenkins/workspace/autotest-per-patch/doc-docker-autotest_22325/timing.txt
01:01:06.621  + for file in "${array[@]}"
01:01:06.621  + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch/zns-vg-autotest_76586/timing.txt
01:01:06.621  + local job_file job_name
01:01:06.621  + job_file=/var/jenkins/workspace/autotest-per-patch/zns-vg-autotest_76586/timing.txt
01:01:06.621  +++ dirname /var/jenkins/workspace/autotest-per-patch/zns-vg-autotest_76586/timing.txt
01:01:06.621  ++ basename /var/jenkins/workspace/autotest-per-patch/zns-vg-autotest_76586
01:01:06.621  + job_name=zns-vg-autotest_76586
01:01:06.621  + sed 's/^/zns-vg-autotest_76586;autorun;/' /var/jenkins/workspace/autotest-per-patch/zns-vg-autotest_76586/timing.txt
01:01:06.621  + for file in "${array[@]}"
01:01:06.621  + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch/unittest-valgrind-docker-autotest_19866/timing.txt
01:01:06.621  + local job_file job_name
01:01:06.621  + job_file=/var/jenkins/workspace/autotest-per-patch/unittest-valgrind-docker-autotest_19866/timing.txt
01:01:06.621  +++ dirname /var/jenkins/workspace/autotest-per-patch/unittest-valgrind-docker-autotest_19866/timing.txt
01:01:06.621  ++ basename /var/jenkins/workspace/autotest-per-patch/unittest-valgrind-docker-autotest_19866
01:01:06.621  + job_name=unittest-valgrind-docker-autotest_19866
01:01:06.621  + sed 's/^/unittest-valgrind-docker-autotest_19866;autorun;/' /var/jenkins/workspace/autotest-per-patch/unittest-valgrind-docker-autotest_19866/timing.txt
01:01:06.621  + for file in "${array[@]}"
01:01:06.621  + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch/nvmf-tcp-vg-autotest_77471/timing.txt
01:01:06.621  + local job_file job_name
01:01:06.621  + job_file=/var/jenkins/workspace/autotest-per-patch/nvmf-tcp-vg-autotest_77471/timing.txt
01:01:06.621  +++ dirname /var/jenkins/workspace/autotest-per-patch/nvmf-tcp-vg-autotest_77471/timing.txt
01:01:06.621  ++ basename /var/jenkins/workspace/autotest-per-patch/nvmf-tcp-vg-autotest_77471
01:01:06.621  + job_name=nvmf-tcp-vg-autotest_77471
01:01:06.621  + sed 's/^/nvmf-tcp-vg-autotest_77471;autorun;/' /var/jenkins/workspace/autotest-per-patch/nvmf-tcp-vg-autotest_77471/timing.txt
01:01:06.621  + for file in "${array[@]}"
01:01:06.621  + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch/vhost-initiator-vg-autotest_77500/timing.txt
01:01:06.621  + local job_file job_name
01:01:06.621  + job_file=/var/jenkins/workspace/autotest-per-patch/vhost-initiator-vg-autotest_77500/timing.txt
01:01:06.621  +++ dirname /var/jenkins/workspace/autotest-per-patch/vhost-initiator-vg-autotest_77500/timing.txt
01:01:06.621  ++ basename /var/jenkins/workspace/autotest-per-patch/vhost-initiator-vg-autotest_77500
01:01:06.621  + job_name=vhost-initiator-vg-autotest_77500
01:01:06.621  + sed 's/^/vhost-initiator-vg-autotest_77500;autorun;/' /var/jenkins/workspace/autotest-per-patch/vhost-initiator-vg-autotest_77500/timing.txt
01:01:06.621  + for file in "${array[@]}"
01:01:06.621  + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch/scan-build-docker-autotest_19865/timing.txt
01:01:06.621  + local job_file job_name
01:01:06.621  + job_file=/var/jenkins/workspace/autotest-per-patch/scan-build-docker-autotest_19865/timing.txt
01:01:06.621  +++ dirname /var/jenkins/workspace/autotest-per-patch/scan-build-docker-autotest_19865/timing.txt
01:01:06.621  ++ basename /var/jenkins/workspace/autotest-per-patch/scan-build-docker-autotest_19865
01:01:06.621  + job_name=scan-build-docker-autotest_19865
01:01:06.621  + sed 's/^/scan-build-docker-autotest_19865;autorun;/' /var/jenkins/workspace/autotest-per-patch/scan-build-docker-autotest_19865/timing.txt
01:01:06.621  + for file in "${array[@]}"
01:01:06.621  + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch/check-format-docker-autotest_22145/timing.txt
01:01:06.621  + local job_file job_name
01:01:06.621  + job_file=/var/jenkins/workspace/autotest-per-patch/check-format-docker-autotest_22145/timing.txt
01:01:06.621  +++ dirname /var/jenkins/workspace/autotest-per-patch/check-format-docker-autotest_22145/timing.txt
01:01:06.621  ++ basename /var/jenkins/workspace/autotest-per-patch/check-format-docker-autotest_22145
01:01:06.621  + job_name=check-format-docker-autotest_22145
01:01:06.621  + sed 's/^/check-format-docker-autotest_22145;autorun;/' /var/jenkins/workspace/autotest-per-patch/check-format-docker-autotest_22145/timing.txt
01:01:06.621  + for file in "${array[@]}"
01:01:06.621  + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch/lvol-vg-autotest_77429/timing.txt
01:01:06.621  + local job_file job_name
01:01:06.621  + job_file=/var/jenkins/workspace/autotest-per-patch/lvol-vg-autotest_77429/timing.txt
01:01:06.621  +++ dirname /var/jenkins/workspace/autotest-per-patch/lvol-vg-autotest_77429/timing.txt
01:01:06.621  ++ basename /var/jenkins/workspace/autotest-per-patch/lvol-vg-autotest_77429
01:01:06.621  + job_name=lvol-vg-autotest_77429
01:01:06.621  + sed 's/^/lvol-vg-autotest_77429;autorun;/' /var/jenkins/workspace/autotest-per-patch/lvol-vg-autotest_77429/timing.txt
01:01:06.621  + for file in "${array[@]}"
01:01:06.621  + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch/iscsi-uring-vg-autotest_77385/timing.txt
01:01:06.622  + local job_file job_name
01:01:06.622  + job_file=/var/jenkins/workspace/autotest-per-patch/iscsi-uring-vg-autotest_77385/timing.txt
01:01:06.622  +++ dirname /var/jenkins/workspace/autotest-per-patch/iscsi-uring-vg-autotest_77385/timing.txt
01:01:06.622  ++ basename /var/jenkins/workspace/autotest-per-patch/iscsi-uring-vg-autotest_77385
01:01:06.622  + job_name=iscsi-uring-vg-autotest_77385
01:01:06.622  + sed 's/^/iscsi-uring-vg-autotest_77385;autorun;/' /var/jenkins/workspace/autotest-per-patch/iscsi-uring-vg-autotest_77385/timing.txt
01:01:06.622  + for file in "${array[@]}"
01:01:06.622  + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch/nvmf-phy-autotest_72444/timing.txt
01:01:06.622  + local job_file job_name
01:01:06.622  + job_file=/var/jenkins/workspace/autotest-per-patch/nvmf-phy-autotest_72444/timing.txt
01:01:06.622  +++ dirname /var/jenkins/workspace/autotest-per-patch/nvmf-phy-autotest_72444/timing.txt
01:01:06.622  ++ basename /var/jenkins/workspace/autotest-per-patch/nvmf-phy-autotest_72444
01:01:06.622  + job_name=nvmf-phy-autotest_72444
01:01:06.622  + sed 's/^/nvmf-phy-autotest_72444;autorun;/' /var/jenkins/workspace/autotest-per-patch/nvmf-phy-autotest_72444/timing.txt
01:01:06.622  + for file in "${array[@]}"
01:01:06.622  + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch/crypto-phy-autotest_26200/timing.txt
01:01:06.622  + local job_file job_name
01:01:06.622  + job_file=/var/jenkins/workspace/autotest-per-patch/crypto-phy-autotest_26200/timing.txt
01:01:06.622  +++ dirname /var/jenkins/workspace/autotest-per-patch/crypto-phy-autotest_26200/timing.txt
01:01:06.622  ++ basename /var/jenkins/workspace/autotest-per-patch/crypto-phy-autotest_26200
01:01:06.622  + job_name=crypto-phy-autotest_26200
01:01:06.622  + sed 's/^/crypto-phy-autotest_26200;autorun;/' /var/jenkins/workspace/autotest-per-patch/crypto-phy-autotest_26200/timing.txt
01:01:06.622  + for file in "${array[@]}"
01:01:06.622  + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch/centos7-vg-autotest_73659/timing.txt
01:01:06.622  + local job_file job_name
01:01:06.622  + job_file=/var/jenkins/workspace/autotest-per-patch/centos7-vg-autotest_73659/timing.txt
01:01:06.622  +++ dirname /var/jenkins/workspace/autotest-per-patch/centos7-vg-autotest_73659/timing.txt
01:01:06.622  ++ basename /var/jenkins/workspace/autotest-per-patch/centos7-vg-autotest_73659
01:01:06.622  + job_name=centos7-vg-autotest_73659
01:01:06.622  + sed 's/^/centos7-vg-autotest_73659;autorun;/' /var/jenkins/workspace/autotest-per-patch/centos7-vg-autotest_73659/timing.txt
01:01:06.622  + for file in "${array[@]}"
01:01:06.622  + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch/nvme-vg-autotest_77480/timing.txt
01:01:06.622  + local job_file job_name
01:01:06.622  + job_file=/var/jenkins/workspace/autotest-per-patch/nvme-vg-autotest_77480/timing.txt
01:01:06.622  +++ dirname /var/jenkins/workspace/autotest-per-patch/nvme-vg-autotest_77480/timing.txt
01:01:06.622  ++ basename /var/jenkins/workspace/autotest-per-patch/nvme-vg-autotest_77480
01:01:06.622  + job_name=nvme-vg-autotest_77480
01:01:06.622  + sed 's/^/nvme-vg-autotest_77480;autorun;/' /var/jenkins/workspace/autotest-per-patch/nvme-vg-autotest_77480/timing.txt
01:01:06.622  + for file in "${array[@]}"
01:01:06.622  + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch/BlobFS-phy-autotest_26206/timing.txt
01:01:06.622  + local job_file job_name
01:01:06.622  + job_file=/var/jenkins/workspace/autotest-per-patch/BlobFS-phy-autotest_26206/timing.txt
01:01:06.622  +++ dirname /var/jenkins/workspace/autotest-per-patch/BlobFS-phy-autotest_26206/timing.txt
01:01:06.622  ++ basename /var/jenkins/workspace/autotest-per-patch/BlobFS-phy-autotest_26206
01:01:06.622  + job_name=BlobFS-phy-autotest_26206
01:01:06.622  + sed 's/^/BlobFS-phy-autotest_26206;autorun;/' /var/jenkins/workspace/autotest-per-patch/BlobFS-phy-autotest_26206/timing.txt
01:01:06.622  + for file in "${array[@]}"
01:01:06.622  + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch/unittest-main-docker-autotest_19863/timing.txt
01:01:06.622  + local job_file job_name
01:01:06.622  + job_file=/var/jenkins/workspace/autotest-per-patch/unittest-main-docker-autotest_19863/timing.txt
01:01:06.622  +++ dirname /var/jenkins/workspace/autotest-per-patch/unittest-main-docker-autotest_19863/timing.txt
01:01:06.622  ++ basename /var/jenkins/workspace/autotest-per-patch/unittest-main-docker-autotest_19863
01:01:06.622  + job_name=unittest-main-docker-autotest_19863
01:01:06.622  + sed 's/^/unittest-main-docker-autotest_19863;autorun;/' /var/jenkins/workspace/autotest-per-patch/unittest-main-docker-autotest_19863/timing.txt
01:01:06.622  + for file in "${array[@]}"
01:01:06.622  + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch/short-fuzz-phy-autotest_26197/timing.txt
01:01:06.622  + local job_file job_name
01:01:06.622  + job_file=/var/jenkins/workspace/autotest-per-patch/short-fuzz-phy-autotest_26197/timing.txt
01:01:06.622  +++ dirname /var/jenkins/workspace/autotest-per-patch/short-fuzz-phy-autotest_26197/timing.txt
01:01:06.622  ++ basename /var/jenkins/workspace/autotest-per-patch/short-fuzz-phy-autotest_26197
01:01:06.622  + job_name=short-fuzz-phy-autotest_26197
01:01:06.622  + sed 's/^/short-fuzz-phy-autotest_26197;autorun;/' /var/jenkins/workspace/autotest-per-patch/short-fuzz-phy-autotest_26197/timing.txt
01:01:06.622  + for file in "${array[@]}"
01:01:06.622  + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch/dsa-phy-autotest_4900/timing.txt
01:01:06.622  + local job_file job_name
01:01:06.622  + job_file=/var/jenkins/workspace/autotest-per-patch/dsa-phy-autotest_4900/timing.txt
01:01:06.622  +++ dirname /var/jenkins/workspace/autotest-per-patch/dsa-phy-autotest_4900/timing.txt
01:01:06.622  ++ basename /var/jenkins/workspace/autotest-per-patch/dsa-phy-autotest_4900
01:01:06.622  + job_name=dsa-phy-autotest_4900
01:01:06.622  + sed 's/^/dsa-phy-autotest_4900;autorun;/' /var/jenkins/workspace/autotest-per-patch/dsa-phy-autotest_4900/timing.txt
01:01:06.622  + for file in "${array[@]}"
01:01:06.622  + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch/vhost-phy-autotest_26225/timing.txt
01:01:06.622  + local job_file job_name
01:01:06.622  + job_file=/var/jenkins/workspace/autotest-per-patch/vhost-phy-autotest_26225/timing.txt
01:01:06.622  +++ dirname /var/jenkins/workspace/autotest-per-patch/vhost-phy-autotest_26225/timing.txt
01:01:06.622  ++ basename /var/jenkins/workspace/autotest-per-patch/vhost-phy-autotest_26225
01:01:06.622  + job_name=vhost-phy-autotest_26225
01:01:06.622  + sed 's/^/vhost-phy-autotest_26225;autorun;/' /var/jenkins/workspace/autotest-per-patch/vhost-phy-autotest_26225/timing.txt
01:01:06.622  + for file in "${array[@]}"
01:01:06.622  + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch/check-so-deps-docker-autotest_22158/timing.txt
01:01:06.622  + local job_file job_name
01:01:06.622  + job_file=/var/jenkins/workspace/autotest-per-patch/check-so-deps-docker-autotest_22158/timing.txt
01:01:06.622  +++ dirname /var/jenkins/workspace/autotest-per-patch/check-so-deps-docker-autotest_22158/timing.txt
01:01:06.622  ++ basename /var/jenkins/workspace/autotest-per-patch/check-so-deps-docker-autotest_22158
01:01:06.622  + job_name=check-so-deps-docker-autotest_22158
01:01:06.622  + sed 's/^/check-so-deps-docker-autotest_22158;autorun;/' /var/jenkins/workspace/autotest-per-patch/check-so-deps-docker-autotest_22158/timing.txt
01:01:06.622  + for file in "${array[@]}"
01:01:06.622  + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch/rocky9-vg-autotest_16090/timing.txt
01:01:06.622  + local job_file job_name
01:01:06.622  + job_file=/var/jenkins/workspace/autotest-per-patch/rocky9-vg-autotest_16090/timing.txt
01:01:06.622  +++ dirname /var/jenkins/workspace/autotest-per-patch/rocky9-vg-autotest_16090/timing.txt
01:01:06.622  ++ basename /var/jenkins/workspace/autotest-per-patch/rocky9-vg-autotest_16090
01:01:06.622  + job_name=rocky9-vg-autotest_16090
01:01:06.622  + sed 's/^/rocky9-vg-autotest_16090;autorun;/' /var/jenkins/workspace/autotest-per-patch/rocky9-vg-autotest_16090/timing.txt
01:01:06.622  + for file in "${array[@]}"
01:01:06.622  + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch/packaging-docker-autotest_19864/timing.txt
01:01:06.622  + local job_file job_name
01:01:06.622  + job_file=/var/jenkins/workspace/autotest-per-patch/packaging-docker-autotest_19864/timing.txt
01:01:06.622  +++ dirname /var/jenkins/workspace/autotest-per-patch/packaging-docker-autotest_19864/timing.txt
01:01:06.622  ++ basename /var/jenkins/workspace/autotest-per-patch/packaging-docker-autotest_19864
01:01:06.622  + job_name=packaging-docker-autotest_19864
01:01:06.622  + sed 's/^/packaging-docker-autotest_19864;autorun;/' /var/jenkins/workspace/autotest-per-patch/packaging-docker-autotest_19864/timing.txt
01:01:06.622  + for file in "${array[@]}"
01:01:06.622  + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch/autobuild-external-vg-autotest_19825/timing.txt
01:01:06.622  + local job_file job_name
01:01:06.622  + job_file=/var/jenkins/workspace/autotest-per-patch/autobuild-external-vg-autotest_19825/timing.txt
01:01:06.622  +++ dirname /var/jenkins/workspace/autotest-per-patch/autobuild-external-vg-autotest_19825/timing.txt
01:01:06.622  ++ basename /var/jenkins/workspace/autotest-per-patch/autobuild-external-vg-autotest_19825
01:01:06.622  + job_name=autobuild-external-vg-autotest_19825
01:01:06.622  + sed 's/^/autobuild-external-vg-autotest_19825;autorun;/' /var/jenkins/workspace/autotest-per-patch/autobuild-external-vg-autotest_19825/timing.txt
01:01:06.622  + for file in "${array[@]}"
01:01:06.622  + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch/nvmf-tcp-uring-vg-autotest_77405/timing.txt
01:01:06.622  + local job_file job_name
01:01:06.622  + job_file=/var/jenkins/workspace/autotest-per-patch/nvmf-tcp-uring-vg-autotest_77405/timing.txt
01:01:06.622  +++ dirname /var/jenkins/workspace/autotest-per-patch/nvmf-tcp-uring-vg-autotest_77405/timing.txt
01:01:06.622  ++ basename /var/jenkins/workspace/autotest-per-patch/nvmf-tcp-uring-vg-autotest_77405
01:01:06.622  + job_name=nvmf-tcp-uring-vg-autotest_77405
01:01:06.622  + sed 's/^/nvmf-tcp-uring-vg-autotest_77405;autorun;/' /var/jenkins/workspace/autotest-per-patch/nvmf-tcp-uring-vg-autotest_77405/timing.txt
01:01:06.622  + for file in "${array[@]}"
01:01:06.622  + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch/nvme-phy-autotest_72372/timing.txt
01:01:06.622  + local job_file job_name
01:01:06.622  + job_file=/var/jenkins/workspace/autotest-per-patch/nvme-phy-autotest_72372/timing.txt
01:01:06.622  +++ dirname /var/jenkins/workspace/autotest-per-patch/nvme-phy-autotest_72372/timing.txt
01:01:06.622  ++ basename /var/jenkins/workspace/autotest-per-patch/nvme-phy-autotest_72372
01:01:06.622  + job_name=nvme-phy-autotest_72372
01:01:06.622  + sed 's/^/nvme-phy-autotest_72372;autorun;/' /var/jenkins/workspace/autotest-per-patch/nvme-phy-autotest_72372/timing.txt
01:01:06.622  + for file in "${array[@]}"
01:01:06.622  + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch/freebsd-vg-autotest_59125/timing.txt
01:01:06.622  + local job_file job_name
01:01:06.622  + job_file=/var/jenkins/workspace/autotest-per-patch/freebsd-vg-autotest_59125/timing.txt
01:01:06.622  +++ dirname /var/jenkins/workspace/autotest-per-patch/freebsd-vg-autotest_59125/timing.txt
01:01:06.622  ++ basename /var/jenkins/workspace/autotest-per-patch/freebsd-vg-autotest_59125
01:01:06.622  + job_name=freebsd-vg-autotest_59125
01:01:06.622  + sed 's/^/freebsd-vg-autotest_59125;autorun;/' /var/jenkins/workspace/autotest-per-patch/freebsd-vg-autotest_59125/timing.txt
01:01:06.622  + for file in "${array[@]}"
01:01:06.622  + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch/nvmf-tcp-phy-autotest_72331/timing.txt
01:01:06.622  + local job_file job_name
01:01:06.622  + job_file=/var/jenkins/workspace/autotest-per-patch/nvmf-tcp-phy-autotest_72331/timing.txt
01:01:06.622  +++ dirname /var/jenkins/workspace/autotest-per-patch/nvmf-tcp-phy-autotest_72331/timing.txt
01:01:06.622  ++ basename /var/jenkins/workspace/autotest-per-patch/nvmf-tcp-phy-autotest_72331
01:01:06.622  + job_name=nvmf-tcp-phy-autotest_72331
01:01:06.622  + sed 's/^/nvmf-tcp-phy-autotest_72331;autorun;/' /var/jenkins/workspace/autotest-per-patch/nvmf-tcp-phy-autotest_72331/timing.txt
01:01:06.622  + for file in "${array[@]}"
01:01:06.622  + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch/build-files-docker-autotest_22134/timing.txt
01:01:06.622  + local job_file job_name
01:01:06.622  + job_file=/var/jenkins/workspace/autotest-per-patch/build-files-docker-autotest_22134/timing.txt
01:01:06.623  +++ dirname /var/jenkins/workspace/autotest-per-patch/build-files-docker-autotest_22134/timing.txt
01:01:06.623  ++ basename /var/jenkins/workspace/autotest-per-patch/build-files-docker-autotest_22134
01:01:06.623  + job_name=build-files-docker-autotest_22134
01:01:06.623  + sed 's/^/build-files-docker-autotest_22134;autorun;/' /var/jenkins/workspace/autotest-per-patch/build-files-docker-autotest_22134/timing.txt
01:01:06.623  + for file in "${array[@]}"
01:01:06.623  + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch/nvme-cmb-pmr-vg-autotest_78603/timing.txt
01:01:06.623  + local job_file job_name
01:01:06.623  + job_file=/var/jenkins/workspace/autotest-per-patch/nvme-cmb-pmr-vg-autotest_78603/timing.txt
01:01:06.623  +++ dirname /var/jenkins/workspace/autotest-per-patch/nvme-cmb-pmr-vg-autotest_78603/timing.txt
01:01:06.623  ++ basename /var/jenkins/workspace/autotest-per-patch/nvme-cmb-pmr-vg-autotest_78603
01:01:06.623  + job_name=nvme-cmb-pmr-vg-autotest_78603
01:01:06.623  + sed 's/^/nvme-cmb-pmr-vg-autotest_78603;autorun;/' /var/jenkins/workspace/autotest-per-patch/nvme-cmb-pmr-vg-autotest_78603/timing.txt
01:01:06.623  + for file in "${array[@]}"
01:01:06.623  + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch/ubuntu20-vg-autotest_73799/timing.txt
01:01:06.623  + local job_file job_name
01:01:06.623  + job_file=/var/jenkins/workspace/autotest-per-patch/ubuntu20-vg-autotest_73799/timing.txt
01:01:06.623  +++ dirname /var/jenkins/workspace/autotest-per-patch/ubuntu20-vg-autotest_73799/timing.txt
01:01:06.623  ++ basename /var/jenkins/workspace/autotest-per-patch/ubuntu20-vg-autotest_73799
01:01:06.623  + job_name=ubuntu20-vg-autotest_73799
01:01:06.623  + sed 's/^/ubuntu20-vg-autotest_73799;autorun;/' /var/jenkins/workspace/autotest-per-patch/ubuntu20-vg-autotest_73799/timing.txt
01:01:06.623  + for file in "${array[@]}"
01:01:06.623  + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch/vfio-user-phy-autotest_26208/timing.txt
01:01:06.623  + local job_file job_name
01:01:06.623  + job_file=/var/jenkins/workspace/autotest-per-patch/vfio-user-phy-autotest_26208/timing.txt
01:01:06.623  +++ dirname /var/jenkins/workspace/autotest-per-patch/vfio-user-phy-autotest_26208/timing.txt
01:01:06.623  ++ basename /var/jenkins/workspace/autotest-per-patch/vfio-user-phy-autotest_26208
01:01:06.623  + job_name=vfio-user-phy-autotest_26208
01:01:06.623  + sed 's/^/vfio-user-phy-autotest_26208;autorun;/' /var/jenkins/workspace/autotest-per-patch/vfio-user-phy-autotest_26208/timing.txt
01:01:06.623  + for file in "${array[@]}"
01:01:06.623  + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch/iscsi-vg-autotest_77518/timing.txt
01:01:06.623  + local job_file job_name
01:01:06.623  + job_file=/var/jenkins/workspace/autotest-per-patch/iscsi-vg-autotest_77518/timing.txt
01:01:06.623  +++ dirname /var/jenkins/workspace/autotest-per-patch/iscsi-vg-autotest_77518/timing.txt
01:01:06.623  ++ basename /var/jenkins/workspace/autotest-per-patch/iscsi-vg-autotest_77518
01:01:06.623  + job_name=iscsi-vg-autotest_77518
01:01:06.623  + sed 's/^/iscsi-vg-autotest_77518;autorun;/' /var/jenkins/workspace/autotest-per-patch/iscsi-vg-autotest_77518/timing.txt
01:01:06.623  + for file in "${array[@]}"
01:01:06.623  + add_sub_job_timing /var/jenkins/workspace/autotest-per-patch/ubuntu22-vg-autotest_37813/timing.txt
01:01:06.623  + local job_file job_name
01:01:06.623  + job_file=/var/jenkins/workspace/autotest-per-patch/ubuntu22-vg-autotest_37813/timing.txt
01:01:06.623  +++ dirname /var/jenkins/workspace/autotest-per-patch/ubuntu22-vg-autotest_37813/timing.txt
01:01:06.623  ++ basename /var/jenkins/workspace/autotest-per-patch/ubuntu22-vg-autotest_37813
01:01:06.623  + job_name=ubuntu22-vg-autotest_37813
01:01:06.623  + sed 's/^/ubuntu22-vg-autotest_37813;autorun;/' /var/jenkins/workspace/autotest-per-patch/ubuntu22-vg-autotest_37813/timing.txt
01:01:06.623  + /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/autotest-per-patch/post_process/total_timing.txt
01:01:06.880  + run_autorun_post
01:01:06.880  + s_opt=
01:01:06.880  + [[ '' == true ]]
01:01:06.880  + spdk/autorun_post.py -d ./ -r ./spdk
01:01:10.156  lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch/spdk/module/bdev/nvme/bdev_mdns_client.c:613
01:01:10.156  lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch/spdk/module/bdev/nvme/bdev_mdns_client.c:561
01:01:10.156  lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch/spdk/module/bdev/nvme/bdev_mdns_client.c:456
01:01:10.156  lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch/spdk/module/bdev/nvme/bdev_mdns_client.c:582
01:01:25.017  lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch/spdk/lib/util/crc64.c:165
01:01:25.275  lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch/spdk/lib/util/crc32c.c:21
01:01:25.532  lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch/spdk/lib/util/crc16.c:628
01:01:25.532  lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch/spdk/lib/util/crc16.c:634
01:01:26.096  lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch/spdk/lib/util/xor.c:120
01:01:28.619  lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-per-patch/spdk/module/blobfs/bdev/blobfs_bdev.c:254
01:02:24.815  genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch/spdk/thread.h!
01:02:24.815  genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch/spdk/base64.h!
01:02:24.815  genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch/spdk/mmio.h!
01:02:24.815  genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch/spdk/nvme_spec.h!
01:02:24.815  genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch/spdk/nvmf_transport.h!
01:02:24.815  genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch/spdk/util.h!
01:02:24.815  genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch/spdk/bdev_module.h!
01:02:24.815  genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch/spdk/nvme.h!
01:02:24.815  genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch/spdk/histogram_data.h!
01:02:24.815  genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch/spdk/trace.h!
01:02:24.815  genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch/spdk/endian.h!
01:02:24.815  genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch/spdk/histogram_data.h/histogram_ut.c!
01:02:24.815  genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch/spdk/lib/env_ocf/include/ocf/ocf_core.h!
01:02:24.815  genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch/spdk/lib/env_ocf/include/ocf/ocf_mngt.h!
01:02:24.815  genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-per-patch/spdk/lib/env_ocf/include/ocf/ocf_io.h!
01:02:37.004  -----Begin Post Process Script------
01:02:37.004  /var/jenkins/workspace/autotest-per-patch/zns-vg-autotest_76586/cov_total.info
01:02:37.004  /var/jenkins/workspace/autotest-per-patch/nvmf-tcp-vg-autotest_77471/cov_total.info
01:02:37.004  /var/jenkins/workspace/autotest-per-patch/vhost-initiator-vg-autotest_77500/cov_total.info
01:02:37.004  /var/jenkins/workspace/autotest-per-patch/lvol-vg-autotest_77429/cov_total.info
01:02:37.004  /var/jenkins/workspace/autotest-per-patch/iscsi-uring-vg-autotest_77385/cov_total.info
01:02:37.004  /var/jenkins/workspace/autotest-per-patch/nvmf-phy-autotest_72444/cov_total.info
01:02:37.004  /var/jenkins/workspace/autotest-per-patch/crypto-phy-autotest_26200/cov_total.info
01:02:37.004  /var/jenkins/workspace/autotest-per-patch/centos7-vg-autotest_73659/cov_total.info
01:02:37.004  /var/jenkins/workspace/autotest-per-patch/BlobFS-phy-autotest_26206/cov_total.info
01:02:37.004  /var/jenkins/workspace/autotest-per-patch/dsa-phy-autotest_4900/cov_total.info
01:02:37.004  /var/jenkins/workspace/autotest-per-patch/vhost-phy-autotest_26225/cov_total.info
01:02:37.004  /var/jenkins/workspace/autotest-per-patch/rocky9-vg-autotest_16090/cov_total.info
01:02:37.004  /var/jenkins/workspace/autotest-per-patch/nvmf-tcp-uring-vg-autotest_77405/cov_total.info
01:02:37.004  /var/jenkins/workspace/autotest-per-patch/nvme-phy-autotest_72372/cov_total.info
01:02:37.004  /var/jenkins/workspace/autotest-per-patch/nvmf-tcp-phy-autotest_72331/cov_total.info
01:02:37.004  /var/jenkins/workspace/autotest-per-patch/nvme-cmb-pmr-vg-autotest_78603/cov_total.info
01:02:37.004  /var/jenkins/workspace/autotest-per-patch/vfio-user-phy-autotest_26208/cov_total.info
01:02:37.004  /var/jenkins/workspace/autotest-per-patch/iscsi-vg-autotest_77518/cov_total.info
01:02:37.004  /var/jenkins/workspace/autotest-per-patch/ubuntu22-vg-autotest_37813/cov_total.info
01:02:37.004  
01:02:37.004  
01:02:37.004  -----Tests Executed in Build------
01:02:37.004  accel
01:02:37.004  accel_assign_opcode
01:02:37.004  accel_cdev_comp
01:02:37.004  accel_cdev_decmop_full
01:02:37.004  accel_cdev_decomp
01:02:37.004  accel_cdev_decomp_full_mcore
01:02:37.004  accel_cdev_decomp_full_mthread
01:02:37.004  accel_cdev_decomp_mcore
01:02:37.004  accel_cdev_decomp_mthread
01:02:37.004  accel_comp
01:02:37.004  accel_compare
01:02:37.004  accel_compress_verify
01:02:37.004  accel_copy
01:02:37.004  accel_copy_crc32c
01:02:37.004  accel_copy_crc32c_C2
01:02:37.004  accel_crc32c
01:02:37.004  accel_crc32c_C2
01:02:37.004  accel_decmop_full
01:02:37.004  accel_decomp
01:02:37.004  accel_decomp_full_mcore
01:02:37.004  accel_decomp_full_mthread
01:02:37.004  accel_decomp_mcore
01:02:37.004  accel_decomp_mthread
01:02:37.004  accel_dif_functional_tests
01:02:37.004  accel_dif_generate
01:02:37.004  accel_dif_generate_copy
01:02:37.004  accel_dif_verify
01:02:37.004  accel_dualcast
01:02:37.004  accel_fill
01:02:37.004  accel_help
01:02:37.004  accel_missing_filename
01:02:37.004  accel_negative_buffers
01:02:37.004  accel_rpc
01:02:37.004  accel_scan_dsa_modules
01:02:37.004  accel_scan_iaa_modules
01:02:37.004  accel_wrong_workload
01:02:37.004  accel_xor
01:02:37.004  acl
01:02:37.004  alias_rpc
01:02:37.004  allowed
01:02:37.004  app_cmdline
01:02:37.004  app_repeat
01:02:37.004  asan
01:02:37.004  autobuild
01:02:37.004  autobuild_build_doc
01:02:37.004  autobuild_check_dpdk_pci_api
01:02:37.004  autobuild_check_format
01:02:37.004  autobuild_check_so_deps
01:02:37.004  autobuild_external_code
01:02:37.004  autobuild_generated_files_check
01:02:37.004  autobuild_generated_files_check_post_clean
01:02:37.004  autobuild_header_dependency_check
01:02:37.004  autobuild_llvm_precompile
01:02:37.004  autobuild_make_install
01:02:37.004  autobuild_make_uninstall
01:02:37.004  autobuild_ocf_precompile
01:02:37.004  bdev_bounds
01:02:37.004  bdev_crypto_enomem
01:02:37.004  bdev_error
01:02:37.004  bdev_fio
01:02:37.004  bdev_fio_rw_verify
01:02:37.004  bdev_fio_trim
01:02:37.004  bdev_gpt_uuid
01:02:37.004  bdev_hello_world
01:02:37.004  bdev_json_nonarray
01:02:37.004  bdev_json_nonenclosed
01:02:37.004  bdev_nbd
01:02:37.004  bdev_nvme_reset_stuck_adm_cmd
01:02:37.004  bdev_qd_sampling
01:02:37.004  bdev_qos
01:02:37.004  bdev_qos_bw
01:02:37.004  bdev_qos_iops
01:02:37.004  bdev_qos_ro_bw
01:02:37.004  bdev_raid
01:02:37.004  bdev_stat
01:02:37.004  bdev_verify
01:02:37.004  bdev_verify_big_io
01:02:37.004  bdev_write_zeroes
01:02:37.004  bdevperf_config
01:02:37.004  blob_io_wait
01:02:37.004  blobfs
01:02:37.004  blobfs_mkfs
01:02:37.004  blobstore
01:02:37.004  blobstore_grow
01:02:37.004  blockdev_crypto_aesni
01:02:37.004  blockdev_crypto_qat
01:02:37.004  blockdev_crypto_sw
01:02:37.004  blockdev_general
01:02:37.004  blockdev_nvme
01:02:37.004  blockdev_nvme_gpt
01:02:37.004  blockdev_raid5f
01:02:37.004  blockdev_rbd
01:02:37.004  build_rpm_from_gen_spec
01:02:37.004  build_shared_rpm
01:02:37.004  chaining
01:02:37.004  check_header_filenames
01:02:37.004  cmb_copy
01:02:37.004  compress_compdev
01:02:37.004  compress_isal
01:02:37.004  confirm_abi_deps
01:02:37.004  confirm_makefile_deps
01:02:37.004  cpu_locks
01:02:37.004  custom_alloc
01:02:37.004  dd_bs_lt_native_bs
01:02:37.004  dd_copy_to_out_bdev
01:02:37.004  dd_double_input
01:02:37.004  dd_double_output
01:02:37.004  dd_flag_append
01:02:37.004  dd_flag_append_forced_aio
01:02:37.004  dd_flag_directory
01:02:37.004  dd_flag_directory_forced_aio
01:02:37.004  dd_flag_noatime
01:02:37.004  dd_flag_noatime_forced_aio
01:02:37.004  dd_flag_nofollow
01:02:37.004  dd_flag_nofollow_forced_aio
01:02:37.004  dd_flags_misc
01:02:37.004  dd_flags_misc_forced_aio
01:02:37.004  dd_inflate_file
01:02:37.004  dd_invalid_arguments
01:02:37.004  dd_invalid_count
01:02:37.004  dd_invalid_iflag
01:02:37.004  dd_invalid_json
01:02:37.004  dd_invalid_oflag
01:02:37.004  dd_malloc_copy
01:02:37.004  dd_no_input
01:02:37.004  dd_no_output
01:02:37.004  dd_offset_magic
01:02:37.004  dd_rw
01:02:37.004  dd_rw_offset
01:02:37.004  dd_smaller_blocksize
01:02:37.004  dd_sparse_bdev_to_file
01:02:37.004  dd_sparse_file_to_bdev
01:02:37.004  dd_sparse_file_to_file
01:02:37.004  dd_unknown_flag
01:02:37.004  dd_uring_copy
01:02:37.004  dd_wrong_blocksize
01:02:37.004  default_locks
01:02:37.004  default_locks_via_rpc
01:02:37.004  default_setup
01:02:37.004  denied
01:02:37.004  devices
01:02:37.004  dm_mount
01:02:37.004  dma
01:02:37.004  dpdk_governor
01:02:37.004  dpdk_mem_utility
01:02:37.004  driver
01:02:37.004  env
01:02:37.004  env_dpdk_post_init
01:02:37.004  env_mem_callbacks
01:02:37.004  env_memory
01:02:37.004  env_pci
01:02:37.004  env_vtophys
01:02:37.004  even_2G_alloc
01:02:37.004  event
01:02:37.004  event_perf
01:02:37.004  event_reactor
01:02:37.004  event_reactor_perf
01:02:37.004  event_scheduler
01:02:37.004  exit_on_failed_rpc_init
01:02:37.004  external_make_accel_driver_shared
01:02:37.004  external_make_accel_driver_static
01:02:37.004  external_make_accel_module_shared
01:02:37.004  external_make_accel_module_static
01:02:37.004  external_make_hello_bdev_shared_combo
01:02:37.004  external_make_hello_bdev_shared_iso
01:02:37.004  external_make_hello_bdev_static
01:02:37.004  external_make_hello_no_bdev_shared_combo
01:02:37.004  external_make_hello_no_bdev_shared_iso
01:02:37.004  external_make_hello_no_bdev_static
01:02:37.004  external_make_nvme_shared
01:02:37.004  external_make_nvme_static
01:02:37.004  external_run_accel_driver_shared
01:02:37.004  external_run_accel_driver_static
01:02:37.004  external_run_accel_module_shared
01:02:37.004  external_run_accel_module_static
01:02:37.005  external_run_hello_bdev_shared_combo
01:02:37.005  external_run_hello_bdev_shared_iso
01:02:37.005  external_run_hello_bdev_static
01:02:37.005  external_run_hello_no_bdev_shared_combo
01:02:37.005  external_run_hello_no_bdev_shared_iso
01:02:37.005  external_run_hello_no_bdev_static
01:02:37.005  external_run_nvme_shared
01:02:37.005  external_run_nvme_static
01:02:37.005  filesystem_btrfs
01:02:37.005  filesystem_ext4
01:02:37.005  filesystem_in_capsule_btrfs
01:02:37.005  filesystem_in_capsule_ext4
01:02:37.005  filesystem_in_capsule_xfs
01:02:37.005  filesystem_xfs
01:02:37.005  fio_dif_1_default
01:02:37.005  fio_dif_1_multi_subsystems
01:02:37.005  fio_dif_digest
01:02:37.005  fio_dif_rand_params
01:02:37.005  go_rpc
01:02:37.005  guess_driver
01:02:37.005  hello_blob
01:02:37.005  hugepages
01:02:37.005  idle
01:02:37.005  interrupt_mode
01:02:37.005  ioat
01:02:37.005  ioat_perf
01:02:37.005  ioat_verify
01:02:37.005  is_zoned
01:02:37.005  iscsi_tgt
01:02:37.005  iscsi_tgt_bdev_io_wait
01:02:37.005  iscsi_tgt_calsoft
01:02:37.005  iscsi_tgt_digest
01:02:37.005  iscsi_tgt_digests
01:02:37.005  iscsi_tgt_filesystem
01:02:37.005  iscsi_tgt_filesystem_btrfs
01:02:37.005  iscsi_tgt_filesystem_ext4
01:02:37.005  iscsi_tgt_filesystem_xfs
01:02:37.005  iscsi_tgt_fio
01:02:37.005  iscsi_tgt_fuzz
01:02:37.005  iscsi_tgt_initiator
01:02:37.005  iscsi_tgt_ip_migration
01:02:37.005  iscsi_tgt_iscsi_lvol
01:02:37.005  iscsi_tgt_login_redirection
01:02:37.005  iscsi_tgt_multiconnection
01:02:37.005  iscsi_tgt_qos
01:02:37.005  iscsi_tgt_rbd
01:02:37.005  iscsi_tgt_reset
01:02:37.005  iscsi_tgt_resize
01:02:37.005  iscsi_tgt_rpc_config
01:02:37.005  iscsi_tgt_sock
01:02:37.005  iscsi_tgt_trace_record
01:02:37.005  json_config
01:02:37.005  json_config_extra_key
01:02:37.005  kernel_target_abort
01:02:37.005  keyring_file
01:02:37.005  llvm_fuzz
01:02:37.005  locking_app_on_locked_coremask
01:02:37.005  locking_app_on_unlocked_coremask
01:02:37.005  locking_overlapped_coremask
01:02:37.005  locking_overlapped_coremask_via_rpc
01:02:37.005  lvol
01:02:37.005  lvol_basic
01:02:37.005  lvol_esnap
01:02:37.005  lvol_external_copy
01:02:37.005  lvol_external_snapshot
01:02:37.005  lvol_hotremove
01:02:37.005  lvol_provisioning
01:02:37.005  lvol_rename
01:02:37.005  lvol_resize
01:02:37.005  lvol_snapshot_clone
01:02:37.005  lvol_tasting
01:02:37.005  lvs_grow_clean
01:02:37.005  lvs_grow_dirty
01:02:37.005  make
01:02:37.005  no_shrink_alloc
01:02:37.005  non_locking_app_on_locked_coremask
01:02:37.005  nvme
01:02:37.005  nvme_arbitration
01:02:37.005  nvme_cli_cuse
01:02:37.005  nvme_cli_plugin
01:02:37.005  nvme_cmb
01:02:37.005  nvme_cuse
01:02:37.005  nvme_cuse_app
01:02:37.005  nvme_cuse_rpc
01:02:37.005  nvme_doorbell_aers
01:02:37.005  nvme_e2edp
01:02:37.005  nvme_err_injection
01:02:37.005  nvme_fdp
01:02:37.005  nvme_fio
01:02:37.005  nvme_flexible_data_placement
01:02:37.005  nvme_hello_world
01:02:37.005  nvme_identify
01:02:37.005  nvme_mount
01:02:37.005  nvme_multi_aen
01:02:37.005  nvme_multi_secondary
01:02:37.005  nvme_ns_manage_cuse
01:02:37.005  nvme_overhead
01:02:37.005  nvme_perf
01:02:37.005  nvme_pmr
01:02:37.005  nvme_pmr_persistence
01:02:37.005  nvme_reserve
01:02:37.005  nvme_reset
01:02:37.005  nvme_rpc
01:02:37.005  nvme_rpc_timeouts
01:02:37.005  nvme_scc
01:02:37.005  nvme_sgl
01:02:37.005  nvme_simple_copy
01:02:37.005  nvme_single_aen
01:02:37.005  nvme_smartctl_cuse
01:02:37.005  nvme_startup
01:02:37.005  nvme_zns
01:02:37.005  nvmf_abort
01:02:37.005  nvmf_abort_qd_sizes
01:02:37.005  nvmf_aer
01:02:37.005  nvmf_async_init
01:02:37.005  nvmf_auth_host
01:02:37.005  nvmf_auth_target
01:02:37.005  nvmf_bdev_io_wait
01:02:37.005  nvmf_bdevio
01:02:37.005  nvmf_bdevio_no_huge
01:02:37.005  nvmf_bdevperf
01:02:37.005  nvmf_connect_disconnect
01:02:37.005  nvmf_connect_stress
01:02:37.005  nvmf_delete_subsystem
01:02:37.005  nvmf_device_removal
01:02:37.005  nvmf_device_removal_pci_remove
01:02:37.005  nvmf_device_removal_pci_remove_no_srq
01:02:37.005  nvmf_dif
01:02:37.005  nvmf_digest
01:02:37.005  nvmf_digest_clean
01:02:37.005  nvmf_digest_dsa_initiator
01:02:37.005  nvmf_digest_dsa_target
01:02:37.005  nvmf_digest_error
01:02:37.005  nvmf_discovery_remove_ifc
01:02:37.005  nvmf_example
01:02:37.005  nvmf_failover
01:02:37.005  nvmf_filesystem
01:02:37.005  nvmf_filesystem_in_capsule
01:02:37.005  nvmf_filesystem_no_in_capsule
01:02:37.005  nvmf_fio_host
01:02:37.005  nvmf_fio_target
01:02:37.005  nvmf_fips
01:02:37.005  nvmf_fused_ordering
01:02:37.005  nvmf_fuzz
01:02:37.005  nvmf_host_discovery
01:02:37.005  nvmf_host_management
01:02:37.005  nvmf_host_multipath
01:02:37.005  nvmf_host_multipath_status
01:02:37.005  nvmf_identify
01:02:37.005  nvmf_identify_kernel_target
01:02:37.005  nvmf_identify_passthru
01:02:37.005  nvmf_invalid
01:02:37.005  nvmf_lvol
01:02:37.005  nvmf_lvs_grow
01:02:37.005  nvmf_mdns_discovery
01:02:37.005  nvmf_multicontroller
01:02:37.005  nvmf_multitarget
01:02:37.005  nvmf_nmic
01:02:37.005  nvmf_ns_hotplug_stress
01:02:37.005  nvmf_ns_masking
01:02:37.005  nvmf_nvme_cli
01:02:37.005  nvmf_perf
01:02:37.005  nvmf_perf_adq
01:02:37.005  nvmf_queue_depth
01:02:37.005  nvmf_rdma
01:02:37.005  nvmf_referrals
01:02:37.005  nvmf_rpc
01:02:37.005  nvmf_shutdown
01:02:37.005  nvmf_shutdown_tc1
01:02:37.005  nvmf_shutdown_tc2
01:02:37.005  nvmf_shutdown_tc3
01:02:37.005  nvmf_srq_overwhelm
01:02:37.005  nvmf_target_disconnect
01:02:37.005  nvmf_target_disconnect_tc1
01:02:37.005  nvmf_target_disconnect_tc2
01:02:37.005  nvmf_target_disconnect_tc3
01:02:37.005  nvmf_target_discovery
01:02:37.005  nvmf_target_multipath
01:02:37.005  nvmf_tcp
01:02:37.005  nvmf_timeout
01:02:37.005  nvmf_tls
01:02:37.005  nvmf_vfio_user
01:02:37.005  nvmf_vfio_user_fuzz
01:02:37.005  nvmf_vfio_user_nvme_compliance
01:02:37.005  nvmf_vhost
01:02:37.005  nvmf_zcopy
01:02:37.005  ocf
01:02:37.005  ocf_bdevperf_iotypes
01:02:37.005  ocf_configuration_change
01:02:37.005  ocf_create_destruct
01:02:37.005  ocf_fio_modes
01:02:37.005  ocf_flush
01:02:37.005  ocf_multicore
01:02:37.005  ocf_remove
01:02:37.005  ocf_stats
01:02:37.005  odd_alloc
01:02:37.005  packaging
01:02:37.005  per_node_1G_alloc
01:02:37.005  raid0_resize_test
01:02:37.005  raid5f_rebuild_test
01:02:37.005  raid5f_rebuild_test_sb
01:02:37.005  raid5f_state_function_test
01:02:37.005  raid5f_state_function_test_sb
01:02:37.005  raid5f_superblock_test
01:02:37.005  raid_function_test_concat
01:02:37.005  raid_function_test_raid0
01:02:37.005  raid_rebuild_test
01:02:37.005  raid_rebuild_test_io
01:02:37.005  raid_rebuild_test_sb
01:02:37.005  raid_rebuild_test_sb_4k
01:02:37.005  raid_rebuild_test_sb_io
01:02:37.005  raid_rebuild_test_sb_md_interleaved
01:02:37.005  raid_rebuild_test_sb_md_separate
01:02:37.005  raid_state_function_test
01:02:37.005  raid_state_function_test_sb
01:02:37.005  raid_state_function_test_sb_4k
01:02:37.005  raid_state_function_test_sb_md_interleaved
01:02:37.005  raid_state_function_test_sb_md_separate
01:02:37.005  raid_superblock_test
01:02:37.005  raid_superblock_test_4k
01:02:37.005  raid_superblock_test_md_interleaved
01:02:37.005  raid_superblock_test_md_separate
01:02:37.005  reactor_set_interrupt
01:02:37.005  reap_unregistered_poller
01:02:37.005  rocksdb
01:02:37.005  rocksdb_insert
01:02:37.005  rocksdb_overwrite
01:02:37.005  rocksdb_randread
01:02:37.005  rocksdb_readwrite
01:02:37.005  rocksdb_writesync
01:02:37.005  rpc
01:02:37.005  rpc_client
01:02:37.005  rpc_daemon_integrity
01:02:37.005  rpc_integrity
01:02:37.005  rpc_plugins
01:02:37.005  rpc_trace_cmd_test
01:02:37.005  rpm_packaging
01:02:37.005  scanbuild_make
01:02:37.005  scheduler
01:02:37.005  scheduler_create_thread
01:02:37.005  setup.sh
01:02:37.005  skip_rpc
01:02:37.005  skip_rpc_with_delay
01:02:37.005  skip_rpc_with_json
01:02:37.005  sma
01:02:37.005  sma_crypto
01:02:37.005  sma_discovery
01:02:37.005  sma_nvmf_tcp
01:02:37.005  sma_plugins
01:02:37.005  sma_qos
01:02:37.005  sma_vfiouser_qemu
01:02:37.005  sma_vhost
01:02:37.005  spdk_dd
01:02:37.005  spdk_dd_basic_rw
01:02:37.005  spdk_dd_bdev_to_bdev
01:02:37.005  spdk_dd_malloc
01:02:37.005  spdk_dd_negative
01:02:37.005  spdk_dd_posix
01:02:37.005  spdk_dd_sparse
01:02:37.005  spdk_dd_uring
01:02:37.005  spdk_target_abort
01:02:37.005  spdkcli_iscsi
01:02:37.005  spdkcli_nvmf_rdma
01:02:37.005  spdkcli_nvmf_tcp
01:02:37.005  spdkcli_raid
01:02:37.005  spdkcli_rbd
01:02:37.005  spdkcli_tcp
01:02:37.005  spdkcli_vhost
01:02:37.005  spdkcli_virtio
01:02:37.005  sw_hotplug
01:02:37.005  test_bdev_lvol_delete_lvstore_with_clones
01:02:37.005  test_bdev_lvol_delete_ordering
01:02:37.005  test_clone_decouple_parent
01:02:37.005  test_clone_inflate
01:02:37.005  test_clone_snapshot_relations
01:02:37.005  test_construct_lvol
01:02:37.005  test_construct_lvol_alias_conflict
01:02:37.005  test_construct_lvol_fio_clear_method_none
01:02:37.005  test_construct_lvol_fio_clear_method_unmap
01:02:37.005  test_construct_lvol_full_lvs
01:02:37.005  test_construct_lvol_inexistent_lvs
01:02:37.005  test_construct_lvols_conflict_alias
01:02:37.005  test_construct_lvs
01:02:37.005  test_construct_lvs_clear_methods
01:02:37.005  test_construct_lvs_conflict_alias
01:02:37.005  test_construct_lvs_different_cluster_size
01:02:37.005  test_construct_lvs_nonexistent_bdev
01:02:37.005  test_construct_multi_lvols
01:02:37.005  test_construct_nested_lvol
01:02:37.005  test_construct_two_lvs_on_the_same_bdev
01:02:37.006  test_create_snapshot_of_snapshot
01:02:37.006  test_create_snapshot_with_io
01:02:37.006  test_delete_lvol_store_persistent_positive
01:02:37.006  test_delete_snapshot_with_clone
01:02:37.006  test_delete_snapshot_with_snapshot
01:02:37.006  test_destroy_after_bdev_lvol_resize_positive
01:02:37.006  test_esnap_clones
01:02:37.006  test_esnap_late_arrival
01:02:37.006  test_esnap_reload
01:02:37.006  test_esnap_remove_degraded
01:02:37.006  test_hotremove_lvol_store
01:02:37.006  test_hotremove_lvol_store_base
01:02:37.006  test_hotremove_lvol_store_base_with_lvols
01:02:37.006  test_hotremove_lvol_store_multiple_lvols
01:02:37.006  test_lvol_bdev_readonly
01:02:37.006  test_lvol_list
01:02:37.006  test_lvol_rename_negative
01:02:37.006  test_rename_lvs_negative
01:02:37.006  test_rename_positive
01:02:37.006  test_resize_lvol
01:02:37.006  test_resize_lvol_negative
01:02:37.006  test_resize_lvol_with_io_traffic
01:02:37.006  test_shallow_copy_compare
01:02:37.006  test_sigterm
01:02:37.006  test_snapshot_compare_with_lvol_bdev
01:02:37.006  test_tasting
01:02:37.006  test_thin_lvol_check_integrity
01:02:37.006  test_thin_lvol_check_space
01:02:37.006  test_thin_lvol_check_zeroes
01:02:37.006  test_thin_lvol_resize
01:02:37.006  test_thin_overprovisioning
01:02:37.006  test_unregister_lvol_bdev
01:02:37.006  thread
01:02:37.006  thread_poller_perf
01:02:37.006  thread_spdk_lock
01:02:37.006  ubsan
01:02:37.006  unittest
01:02:37.006  unittest_accel
01:02:37.006  unittest_bdev
01:02:37.006  unittest_bdev_compress
01:02:37.006  unittest_bdev_crypto
01:02:37.006  unittest_bdev_raid5f
01:02:37.006  unittest_blob_blobfs
01:02:37.006  unittest_build
01:02:37.006  unittest_dma
01:02:37.006  unittest_dpdk_compressdev
01:02:37.006  unittest_event
01:02:37.006  unittest_ftl
01:02:37.006  unittest_idxd_user
01:02:37.006  unittest_include
01:02:37.006  unittest_init
01:02:37.006  unittest_ioat
01:02:37.006  unittest_iobuf
01:02:37.006  unittest_iscsi
01:02:37.006  unittest_json
01:02:37.006  unittest_keyring
01:02:37.006  unittest_lib_reduce
01:02:37.006  unittest_log
01:02:37.006  unittest_lvol
01:02:37.006  unittest_notify
01:02:37.006  unittest_nvme
01:02:37.006  unittest_nvme_cuse
01:02:37.006  unittest_nvme_rdma
01:02:37.006  unittest_nvmf
01:02:37.006  unittest_nvmf_rdma
01:02:37.006  unittest_nvmf_transport
01:02:37.006  unittest_nvmf_vfio_user
01:02:37.006  unittest_pci_event
01:02:37.006  unittest_rdma
01:02:37.006  unittest_rpc
01:02:37.006  unittest_scsi
01:02:37.006  unittest_sock
01:02:37.006  unittest_thread
01:02:37.006  unittest_util
01:02:37.006  unittest_vhost
01:02:37.006  valgrind
01:02:37.006  version
01:02:37.006  vfio_fuzz
01:02:37.006  vfio_user_nvme_fio
01:02:37.006  vfio_user_nvme_restart_vm
01:02:37.006  vfio_user_qemu
01:02:37.006  vfio_user_virtio_bdevperf
01:02:37.006  vfio_user_virtio_blk_restart_vm
01:02:37.006  vfio_user_virtio_scsi_restart_vm
01:02:37.006  vhost
01:02:37.006  vhost_blk_lvol_integrity
01:02:37.006  vhost_blk_packed_ring_integrity
01:02:37.006  vhost_blockdev
01:02:37.006  vhost_boot
01:02:37.006  vhost_fuzz
01:02:37.006  vhost_negative
01:02:37.006  vhost_scsi_lvol_integrity
01:02:37.006  vhost_shared
01:02:37.006  zoned_fio
01:02:37.006  
01:02:37.006  
01:02:37.006  -----Tests Missing From Build------
01:02:37.006  balanced
01:02:37.006  blockdev_xnvme
01:02:37.006  build_native_dpdk
01:02:37.006  build_shared_native_dpdk_rpm
01:02:37.006  build_shared_rpm_with_rpmed_dpdk
01:02:37.006  busy
01:02:37.006  core_load
01:02:37.006  ftl
01:02:37.006  ftl_bdevperf
01:02:37.006  ftl_dirty_shutdown
01:02:37.006  ftl_fio_basic
01:02:37.006  ftl_restore
01:02:37.006  ftl_restore_fast
01:02:37.006  ftl_trim
01:02:37.006  ftl_upgrade_shutdown
01:02:37.006  iscsi_tgt_data_digest
01:02:37.006  iscsi_tgt_ext4test
01:02:37.006  keyring_linux
01:02:37.006  nvme_boot_partition
01:02:37.006  nvme_bp
01:02:37.006  nvme_opal
01:02:37.006  nvme_opal_bdevio
01:02:37.006  nvme_opal_bdevperf
01:02:37.006  nvme_opal_spdk_tgt
01:02:37.006  nvme_xnvme
01:02:37.006  nvmf_fc
01:02:37.006  nvmf_initiator_timeout
01:02:37.006  nvmf_multiconnection
01:02:37.006  spdkcli_nvmf_fc
01:02:37.006  test_create_multi_ublk
01:02:37.006  test_create_ublk
01:02:37.006  test_save_ublk_config
01:02:37.006  ublk
01:02:37.006  ublk_recovery
01:02:37.006  unittest_nvmf_fc
01:02:37.006  unittest_nvmf_fc_ls
01:02:37.006  vhost_blk_cores_2ctrl
01:02:37.006  vhost_blk_fs_integrity
01:02:37.006  vhost_blk_hot_remove
01:02:37.006  vhost_blk_integrity
01:02:37.006  vhost_hotplug
01:02:37.006  vhost_migration
01:02:37.006  vhost_migration_tc1
01:02:37.006  vhost_migration_tc2
01:02:37.006  vhost_readonly
01:02:37.006  vhost_scsi_cores_2ctrl
01:02:37.006  vhost_scsi_fs_integrity
01:02:37.006  vhost_scsi_hot_remove
01:02:37.006  vhost_scsi_integrity
01:02:37.006  vmd
01:02:37.006  vmd_bdev_svc
01:02:37.006  vmd_fio
01:02:37.006  vmd_hello_world
01:02:37.006  vmd_identify
01:02:37.006  vmd_perf
01:02:37.006  xnvme_bdevperf
01:02:37.006  xnvme_to_malloc_dd_copy
01:02:37.006  
01:02:37.006  
01:02:37.006  -----Tests Missing ASAN------
01:02:37.006  accel_cdev_comp
01:02:37.006  accel_cdev_decmop_full
01:02:37.006  accel_cdev_decomp
01:02:37.006  accel_cdev_decomp_full_mcore
01:02:37.006  accel_cdev_decomp_full_mthread
01:02:37.006  accel_cdev_decomp_mcore
01:02:37.006  accel_cdev_decomp_mthread
01:02:37.006  autobuild
01:02:37.006  autobuild_build_doc
01:02:37.006  autobuild_check_dpdk_pci_api
01:02:37.006  autobuild_check_format
01:02:37.006  autobuild_check_so_deps
01:02:37.006  autobuild_external_code
01:02:37.006  autobuild_generated_files_check
01:02:37.006  autobuild_generated_files_check_post_clean
01:02:37.006  autobuild_header_dependency_check
01:02:37.006  autobuild_llvm_precompile
01:02:37.006  autobuild_make_install
01:02:37.006  autobuild_make_uninstall
01:02:37.006  autobuild_ocf_precompile
01:02:37.006  balanced
01:02:37.006  bdev_crypto_enomem
01:02:37.006  blockdev_crypto_aesni
01:02:37.006  blockdev_crypto_qat
01:02:37.006  blockdev_crypto_sw
01:02:37.006  blockdev_rbd
01:02:37.006  blockdev_xnvme
01:02:37.006  build_native_dpdk
01:02:37.006  build_shared_native_dpdk_rpm
01:02:37.006  build_shared_rpm_with_rpmed_dpdk
01:02:37.006  busy
01:02:37.006  chaining
01:02:37.006  check_header_filenames
01:02:37.006  cmb_copy
01:02:37.006  compress_compdev
01:02:37.006  compress_isal
01:02:37.006  confirm_abi_deps
01:02:37.006  confirm_makefile_deps
01:02:37.006  core_load
01:02:37.006  dd_uring_copy
01:02:37.006  dpdk_governor
01:02:37.006  external_make_accel_driver_shared
01:02:37.006  external_make_accel_driver_static
01:02:37.006  external_make_accel_module_shared
01:02:37.006  external_make_accel_module_static
01:02:37.006  external_make_hello_bdev_shared_combo
01:02:37.006  external_make_hello_bdev_shared_iso
01:02:37.006  external_make_hello_bdev_static
01:02:37.006  external_make_hello_no_bdev_shared_combo
01:02:37.006  external_make_hello_no_bdev_shared_iso
01:02:37.006  external_make_hello_no_bdev_static
01:02:37.006  external_make_nvme_shared
01:02:37.006  external_make_nvme_static
01:02:37.006  external_run_accel_driver_shared
01:02:37.006  external_run_accel_driver_static
01:02:37.006  external_run_accel_module_shared
01:02:37.006  external_run_accel_module_static
01:02:37.006  external_run_hello_bdev_shared_combo
01:02:37.006  external_run_hello_bdev_shared_iso
01:02:37.006  external_run_hello_bdev_static
01:02:37.006  external_run_hello_no_bdev_shared_combo
01:02:37.006  external_run_hello_no_bdev_shared_iso
01:02:37.006  external_run_hello_no_bdev_static
01:02:37.006  external_run_nvme_shared
01:02:37.006  external_run_nvme_static
01:02:37.006  ftl
01:02:37.006  ftl_bdevperf
01:02:37.006  ftl_dirty_shutdown
01:02:37.006  ftl_fio_basic
01:02:37.006  ftl_restore
01:02:37.006  ftl_restore_fast
01:02:37.006  ftl_trim
01:02:37.006  ftl_upgrade_shutdown
01:02:37.006  go_rpc
01:02:37.006  idle
01:02:37.006  interrupt_mode
01:02:37.006  ioat
01:02:37.006  ioat_perf
01:02:37.006  ioat_verify
01:02:37.006  is_zoned
01:02:37.006  iscsi_tgt
01:02:37.006  iscsi_tgt_bdev_io_wait
01:02:37.006  iscsi_tgt_calsoft
01:02:37.007  iscsi_tgt_data_digest
01:02:37.007  iscsi_tgt_digest
01:02:37.007  iscsi_tgt_digests
01:02:37.007  iscsi_tgt_ext4test
01:02:37.007  iscsi_tgt_filesystem
01:02:37.007  iscsi_tgt_filesystem_btrfs
01:02:37.007  iscsi_tgt_filesystem_ext4
01:02:37.007  iscsi_tgt_filesystem_xfs
01:02:37.007  iscsi_tgt_fio
01:02:37.007  iscsi_tgt_fuzz
01:02:37.007  iscsi_tgt_initiator
01:02:37.007  iscsi_tgt_ip_migration
01:02:37.007  iscsi_tgt_iscsi_lvol
01:02:37.007  iscsi_tgt_login_redirection
01:02:37.007  iscsi_tgt_multiconnection
01:02:37.007  iscsi_tgt_qos
01:02:37.007  iscsi_tgt_rbd
01:02:37.007  iscsi_tgt_reset
01:02:37.007  iscsi_tgt_resize
01:02:37.007  iscsi_tgt_rpc_config
01:02:37.007  iscsi_tgt_sock
01:02:37.007  iscsi_tgt_trace_record
01:02:37.007  keyring_linux
01:02:37.007  llvm_fuzz
01:02:37.007  nvme_boot_partition
01:02:37.007  nvme_bp
01:02:37.007  nvme_cli_cuse
01:02:37.007  nvme_cli_plugin
01:02:37.007  nvme_cmb
01:02:37.007  nvme_cuse
01:02:37.007  nvme_cuse_app
01:02:37.007  nvme_cuse_rpc
01:02:37.007  nvme_ns_manage_cuse
01:02:37.007  nvme_opal
01:02:37.007  nvme_opal_bdevio
01:02:37.007  nvme_opal_bdevperf
01:02:37.007  nvme_opal_spdk_tgt
01:02:37.007  nvme_pmr
01:02:37.007  nvme_pmr_persistence
01:02:37.007  nvme_smartctl_cuse
01:02:37.007  nvme_xnvme
01:02:37.007  nvme_zns
01:02:37.007  nvmf_bdevperf
01:02:37.007  nvmf_device_removal
01:02:37.007  nvmf_device_removal_pci_remove
01:02:37.007  nvmf_device_removal_pci_remove_no_srq
01:02:37.007  nvmf_digest_clean
01:02:37.007  nvmf_fc
01:02:37.007  nvmf_fuzz
01:02:37.007  nvmf_host_multipath
01:02:37.007  nvmf_initiator_timeout
01:02:37.007  nvmf_mdns_discovery
01:02:37.007  nvmf_multiconnection
01:02:37.007  nvmf_nvme_cli
01:02:37.007  nvmf_perf_adq
01:02:37.007  nvmf_rdma
01:02:37.007  nvmf_shutdown
01:02:37.007  nvmf_shutdown_tc1
01:02:37.007  nvmf_shutdown_tc2
01:02:37.007  nvmf_shutdown_tc3
01:02:37.007  nvmf_srq_overwhelm
01:02:37.007  nvmf_target_disconnect
01:02:37.007  nvmf_target_disconnect_tc1
01:02:37.007  nvmf_target_disconnect_tc2
01:02:37.572  nvmf_target_disconnect_tc3
01:02:37.572  nvmf_timeout
01:02:37.572  nvmf_vfio_user
01:02:37.572  nvmf_vfio_user_fuzz
01:02:37.572  nvmf_vfio_user_nvme_compliance
01:02:37.572  ocf
01:02:37.572  ocf_bdevperf_iotypes
01:02:37.572  ocf_configuration_change
01:02:37.572  ocf_create_destruct
01:02:37.572  ocf_fio_modes
01:02:37.572  ocf_flush
01:02:37.572  ocf_multicore
01:02:37.572  ocf_remove
01:02:37.572  ocf_stats
01:02:37.572  scanbuild_make
01:02:37.572  scheduler
01:02:37.572  spdk_dd_uring
01:02:37.572  spdkcli_iscsi
01:02:37.572  spdkcli_nvmf_fc
01:02:37.572  spdkcli_nvmf_rdma
01:02:37.572  spdkcli_raid
01:02:37.572  spdkcli_rbd
01:02:37.572  spdkcli_virtio
01:02:37.572  test_create_multi_ublk
01:02:37.572  test_create_ublk
01:02:37.572  test_save_ublk_config
01:02:37.572  ublk
01:02:37.572  ublk_recovery
01:02:37.572  unittest_bdev_compress
01:02:37.572  unittest_bdev_crypto
01:02:37.572  unittest_dpdk_compressdev
01:02:37.572  unittest_lib_reduce
01:02:37.572  unittest_nvmf_fc
01:02:37.572  unittest_nvmf_fc_ls
01:02:37.572  unittest_nvmf_vfio_user
01:02:37.572  valgrind
01:02:37.572  vfio_fuzz
01:02:37.572  vhost_blk_cores_2ctrl
01:02:37.572  vhost_blk_fs_integrity
01:02:37.572  vhost_blk_hot_remove
01:02:37.572  vhost_blk_integrity
01:02:37.572  vhost_blockdev
01:02:37.572  vhost_fuzz
01:02:37.572  vhost_hotplug
01:02:37.572  vhost_migration
01:02:37.572  vhost_migration_tc1
01:02:37.572  vhost_migration_tc2
01:02:37.572  vhost_readonly
01:02:37.572  vhost_scsi_cores_2ctrl
01:02:37.572  vhost_scsi_fs_integrity
01:02:37.572  vhost_scsi_hot_remove
01:02:37.572  vhost_scsi_integrity
01:02:37.572  vhost_shared
01:02:37.572  vmd
01:02:37.572  vmd_bdev_svc
01:02:37.572  vmd_fio
01:02:37.572  vmd_hello_world
01:02:37.572  vmd_identify
01:02:37.572  vmd_perf
01:02:37.572  xnvme_bdevperf
01:02:37.572  xnvme_to_malloc_dd_copy
01:02:37.572  zoned_fio
01:02:37.572  
01:02:37.572  
01:02:37.572  -----Tests Missing UBSAN------
01:02:37.572  autobuild
01:02:37.572  autobuild_build_doc
01:02:37.572  autobuild_check_dpdk_pci_api
01:02:37.572  autobuild_check_format
01:02:37.572  autobuild_check_so_deps
01:02:37.572  autobuild_external_code
01:02:37.572  autobuild_generated_files_check
01:02:37.572  autobuild_generated_files_check_post_clean
01:02:37.572  autobuild_header_dependency_check
01:02:37.572  autobuild_make_install
01:02:37.572  autobuild_make_uninstall
01:02:37.572  balanced
01:02:37.572  blockdev_xnvme
01:02:37.572  build_native_dpdk
01:02:37.572  build_rpm_from_gen_spec
01:02:37.572  build_shared_native_dpdk_rpm
01:02:37.572  build_shared_rpm
01:02:37.572  build_shared_rpm_with_rpmed_dpdk
01:02:37.572  busy
01:02:37.572  check_header_filenames
01:02:37.572  cmb_copy
01:02:37.572  confirm_abi_deps
01:02:37.572  confirm_makefile_deps
01:02:37.572  core_load
01:02:37.572  external_make_accel_driver_shared
01:02:37.572  external_make_accel_driver_static
01:02:37.572  external_make_accel_module_shared
01:02:37.572  external_make_accel_module_static
01:02:37.572  external_make_hello_bdev_shared_combo
01:02:37.572  external_make_hello_bdev_shared_iso
01:02:37.572  external_make_hello_bdev_static
01:02:37.572  external_make_hello_no_bdev_shared_combo
01:02:37.572  external_make_hello_no_bdev_shared_iso
01:02:37.572  external_make_hello_no_bdev_static
01:02:37.572  external_make_nvme_shared
01:02:37.572  external_make_nvme_static
01:02:37.572  external_run_accel_driver_shared
01:02:37.572  external_run_accel_driver_static
01:02:37.572  external_run_accel_module_shared
01:02:37.572  external_run_accel_module_static
01:02:37.572  external_run_hello_bdev_shared_combo
01:02:37.572  external_run_hello_bdev_shared_iso
01:02:37.572  external_run_hello_bdev_static
01:02:37.572  external_run_hello_no_bdev_shared_combo
01:02:37.572  external_run_hello_no_bdev_shared_iso
01:02:37.572  external_run_hello_no_bdev_static
01:02:37.572  external_run_nvme_shared
01:02:37.572  external_run_nvme_static
01:02:37.572  ftl
01:02:37.572  ftl_bdevperf
01:02:37.572  ftl_dirty_shutdown
01:02:37.572  ftl_fio_basic
01:02:37.572  ftl_restore
01:02:37.572  ftl_restore_fast
01:02:37.572  ftl_trim
01:02:37.572  ftl_upgrade_shutdown
01:02:37.572  is_zoned
01:02:37.572  iscsi_tgt_data_digest
01:02:37.572  iscsi_tgt_ext4test
01:02:37.572  keyring_linux
01:02:37.572  nvme_boot_partition
01:02:37.572  nvme_bp
01:02:37.572  nvme_cmb
01:02:37.572  nvme_opal
01:02:37.572  nvme_opal_bdevio
01:02:37.572  nvme_opal_bdevperf
01:02:37.572  nvme_opal_spdk_tgt
01:02:37.572  nvme_pmr
01:02:37.572  nvme_pmr_persistence
01:02:37.572  nvme_xnvme
01:02:37.572  nvme_zns
01:02:37.572  nvmf_fc
01:02:37.572  nvmf_initiator_timeout
01:02:37.572  nvmf_multiconnection
01:02:37.572  packaging
01:02:37.572  rpm_packaging
01:02:37.572  scanbuild_make
01:02:37.572  spdkcli_nvmf_fc
01:02:37.572  test_create_multi_ublk
01:02:37.572  test_create_ublk
01:02:37.572  test_save_ublk_config
01:02:37.572  ublk
01:02:37.572  ublk_recovery
01:02:37.572  unittest_bdev_compress
01:02:37.572  unittest_bdev_crypto
01:02:37.572  unittest_dpdk_compressdev
01:02:37.572  unittest_lib_reduce
01:02:37.572  unittest_nvmf_fc
01:02:37.572  unittest_nvmf_fc_ls
01:02:37.572  unittest_nvmf_vfio_user
01:02:37.572  valgrind
01:02:37.572  vhost_blk_cores_2ctrl
01:02:37.572  vhost_blk_fs_integrity
01:02:37.572  vhost_blk_hot_remove
01:02:37.572  vhost_blk_integrity
01:02:37.572  vhost_hotplug
01:02:37.572  vhost_migration
01:02:37.572  vhost_migration_tc1
01:02:37.572  vhost_migration_tc2
01:02:37.572  vhost_readonly
01:02:37.572  vhost_scsi_cores_2ctrl
01:02:37.572  vhost_scsi_fs_integrity
01:02:37.572  vhost_scsi_hot_remove
01:02:37.572  vhost_scsi_integrity
01:02:37.572  vmd
01:02:37.572  vmd_bdev_svc
01:02:37.572  vmd_fio
01:02:37.572  vmd_hello_world
01:02:37.572  vmd_identify
01:02:37.572  vmd_perf
01:02:37.572  xnvme_bdevperf
01:02:37.572  xnvme_to_malloc_dd_copy
01:02:37.572  zoned_fio
01:02:37.572  Not all tests were run. Failing the build.
01:02:37.572  ['blockdev_xnvme', 'ftl', 'ftl_bdevperf', 'ftl_dirty_shutdown', 'ftl_fio_basic', 'ftl_restore', 'ftl_trim', 'ftl_upgrade_shutdown', 'nvme_xnvme', 'test_create_multi_ublk', 'test_create_ublk', 'test_save_ublk_config', 'ublk', 'ublk_recovery', 'xnvme_bdevperf', 'xnvme_to_malloc_dd_copy']
01:02:37.572  + compress_coverage_and_docs
01:02:37.572  + echo 'Start compress coverage and docs'
01:02:37.572  Start compress coverage and docs
01:02:37.572  + tar -C coverage -czf coverage_autotest-per-patch_122875.tar.gz ./ --remove-files
01:02:38.944  + tar -C ut_coverage -czf ut_coverage_autotest-per-patch_122875.tar.gz ./ --remove-files
01:02:39.508  + tar -C doc -czf doc_autotest-per-patch_122875.tar.gz ./ --remove-files
01:02:39.765  + [[ -d llvm ]]
01:02:39.765  + true
01:02:39.765  + echo 'End compress coverage and docs'
01:02:39.765  End compress coverage and docs
01:02:39.765  + remove_partial_coverage_files
01:02:39.765  + find . -name 'cov_*.info' -delete
01:02:39.765  + echo 'End stage post_gen_coverage.sh'
01:02:39.765  End stage post_gen_coverage.sh
01:02:39.779  [Pipeline] }
01:02:39.782  ERROR: script returned exit code 1
01:02:39.811  [Pipeline] // catchError
01:02:39.822  [Pipeline] catchError
01:02:39.823  [Pipeline] {
01:02:39.843  [Pipeline] dir
01:02:39.844  Running in /var/jenkins/workspace/autotest-per-patch/post_process
01:02:39.845  [Pipeline] {