00:00:00.000  Started by upstream project "nightly-trigger" build number 3586
00:00:00.000  originally caused by:
00:00:00.000   Started by timer
00:00:00.000   Started by timer
00:00:00.007  Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/autotest-spdk-master-vs-dpdk-v23.11_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-upstream/autotest.groovy
00:00:00.007  The recommended git tool is: git
00:00:00.008  using credential 00000000-0000-0000-0000-000000000002
00:00:00.010   > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/autotest-spdk-master-vs-dpdk-v23.11_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10
00:00:00.021  Fetching changes from the remote Git repository
00:00:00.024   > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10
00:00:00.034  Using shallow fetch with depth 1
00:00:00.034  Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool
00:00:00.034   > git --version # timeout=10
00:00:00.044   > git --version # 'git version 2.39.2'
00:00:00.044  using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials
00:00:00.055  Setting http proxy: proxy-dmz.intel.com:911
00:00:00.055   > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5
00:00:02.127   > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10
00:00:02.137   > git rev-parse FETCH_HEAD^{commit} # timeout=10
00:00:02.148  Checking out Revision 44e7d6069a399ee2647233b387d68a938882e7b7 (FETCH_HEAD)
00:00:02.148   > git config core.sparsecheckout # timeout=10
00:00:02.157   > git read-tree -mu HEAD # timeout=10
00:00:02.171   > git checkout -f 44e7d6069a399ee2647233b387d68a938882e7b7 # timeout=5
00:00:02.190  Commit message: "scripts/bmc: Rework Get NIC Info cmd parser"
00:00:02.190   > git rev-list --no-walk 44e7d6069a399ee2647233b387d68a938882e7b7 # timeout=10
00:00:02.770  [Pipeline] Start of Pipeline
00:00:02.784  [Pipeline] library
00:00:02.786  Loading library shm_lib@master
00:00:02.786  Library shm_lib@master is due for a refresh after 30 minutes, clearing.
00:00:02.787  Caching library shm_lib@master
00:00:02.788  Attempting to resolve master from remote references...
00:00:02.788   > git --version # timeout=10
00:00:02.799   > git --version # 'git version 2.39.2'
00:00:02.799  using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials
00:00:02.810  Setting http proxy: proxy-dmz.intel.com:911
00:00:02.810   > git ls-remote -- https://review.spdk.io/gerrit/a/build_pool/shm_lib # timeout=10
00:00:03.921  Found match: refs/heads/master revision fa9b922cb39dd3ae66a527ed92492856a7cced22
00:00:03.923  Selected Git installation does not exist. Using Default
00:00:03.923  The recommended git tool is: NONE
00:00:03.923  using credential 00000000-0000-0000-0000-000000000002
00:00:03.926   > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/autotest-spdk-master-vs-dpdk-v23.11_libs/6e27998ca6b735f457f1bf0490b425345ba4637a91de7f2498f417cb3d899827/.git # timeout=10
00:00:03.937  Fetching changes from the remote Git repository
00:00:03.942   > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/shm_lib # timeout=10
00:00:03.953  Fetching without tags
00:00:03.953  Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/shm_lib
00:00:03.953   > git --version # timeout=10
00:00:03.964   > git --version # 'git version 2.39.2'
00:00:03.964  using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials
00:00:03.974  Setting http proxy: proxy-dmz.intel.com:911
00:00:03.974   > git fetch --no-tags --force --progress -- https://review.spdk.io/gerrit/a/build_pool/shm_lib +refs/heads/*:refs/remotes/origin/* # timeout=10
00:00:04.702  Checking out Revision fa9b922cb39dd3ae66a527ed92492856a7cced22 (master)
00:00:04.702   > git config core.sparsecheckout # timeout=10
00:00:04.713   > git checkout -f fa9b922cb39dd3ae66a527ed92492856a7cced22 # timeout=10
00:00:04.730  Commit message: "vars/lib: Allow to pass log level while sending build details"
00:00:04.730   > git rev-list --no-walk fa9b922cb39dd3ae66a527ed92492856a7cced22 # timeout=10
00:00:04.827  [Pipeline] node
00:00:04.833  Running on ME1 in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11
00:00:04.837  [Pipeline] {
00:00:04.848  [Pipeline] cleanWs
00:00:04.855  [WS-CLEANUP] Deleting project workspace...
00:00:04.855  [WS-CLEANUP] Deferred wipeout is used...
00:00:04.861  [WS-CLEANUP] done
00:00:04.865  [Pipeline] stage
00:00:04.869  [Pipeline] { (Prologue)
00:00:04.994  [Pipeline] withCredentials
00:00:05.004   > git --version # timeout=10
00:00:05.015   > git --version # 'git version 2.39.2'
00:00:05.037  Masking supported pattern matches of $GIT_USERNAME or $GIT_PASSWORD or $GIT_ASKPASS
00:00:05.039  [Pipeline] {
00:00:05.049  [Pipeline] retry
00:00:05.052  [Pipeline] {
00:00:05.343  [Pipeline] sh
00:00:05.625  + git ls-remote https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master
00:00:07.556  [Pipeline] }
00:00:07.582  [Pipeline] // retry
00:00:07.588  [Pipeline] }
00:00:07.611  [Pipeline] // withCredentials
00:00:07.624  [Pipeline] httpRequest
00:00:08.028  [Pipeline] echo
00:00:08.030  Sorcerer 10.211.164.101 is alive
00:00:08.042  [Pipeline] retry
00:00:08.044  [Pipeline] {
00:00:08.062  [Pipeline] httpRequest
00:00:08.068  HttpMethod: GET
00:00:08.068  URL: http://10.211.164.101/packages/jbp_44e7d6069a399ee2647233b387d68a938882e7b7.tar.gz
00:00:08.069  Sending request to url: http://10.211.164.101/packages/jbp_44e7d6069a399ee2647233b387d68a938882e7b7.tar.gz
00:00:08.071  Response Code: HTTP/1.1 200 OK
00:00:08.071  Success: Status code 200 is in the accepted range: 200,404
00:00:08.071  Saving response body to /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/jbp_44e7d6069a399ee2647233b387d68a938882e7b7.tar.gz
00:00:08.217  [Pipeline] }
00:00:08.236  [Pipeline] // retry
00:00:08.244  [Pipeline] sh
00:00:08.529  + tar --no-same-owner -xf jbp_44e7d6069a399ee2647233b387d68a938882e7b7.tar.gz
00:00:08.554  [Pipeline] withCredentials
00:00:08.566   > git --version # timeout=10
00:00:08.581   > git --version # 'git version 2.39.2'
00:00:08.601  Masking supported pattern matches of $GIT_USERNAME or $GIT_PASSWORD or $GIT_ASKPASS
00:00:08.603  [Pipeline] {
00:00:08.616  [Pipeline] retry
00:00:08.619  [Pipeline] {
00:00:08.641  [Pipeline] sh
00:00:08.928  + git ls-remote https://review.spdk.io/gerrit/a/spdk/spdk refs/heads/master
00:00:12.239  [Pipeline] }
00:00:12.256  [Pipeline] // retry
00:00:12.260  [Pipeline] }
00:00:12.272  [Pipeline] // withCredentials
00:00:12.279  [Pipeline] httpRequest
00:00:12.676  [Pipeline] echo
00:00:12.678  Sorcerer 10.211.164.101 is alive
00:00:12.685  [Pipeline] retry
00:00:12.687  [Pipeline] {
00:00:12.698  [Pipeline] httpRequest
00:00:12.702  HttpMethod: GET
00:00:12.702  URL: http://10.211.164.101/packages/spdk_12fc2abf1e54ef44d6ae9091ab879722d4e15e60.tar.gz
00:00:12.703  Sending request to url: http://10.211.164.101/packages/spdk_12fc2abf1e54ef44d6ae9091ab879722d4e15e60.tar.gz
00:00:12.704  Response Code: HTTP/1.1 200 OK
00:00:12.705  Success: Status code 200 is in the accepted range: 200,404
00:00:12.705  Saving response body to /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk_12fc2abf1e54ef44d6ae9091ab879722d4e15e60.tar.gz
00:00:14.996  [Pipeline] }
00:00:15.022  [Pipeline] // retry
00:00:15.031  [Pipeline] sh
00:00:15.327  + tar --no-same-owner -xf spdk_12fc2abf1e54ef44d6ae9091ab879722d4e15e60.tar.gz
00:00:17.869  [Pipeline] sh
00:00:18.152  + git -C spdk log --oneline -n5
00:00:18.153  12fc2abf1 test: Remove autopackage.sh
00:00:18.153  83ba90867 fio/bdev: fix typo in README
00:00:18.153  45379ed84 module/compress: Cleanup vol data, when claim fails
00:00:18.153  0afe95a3a bdev/nvme: use bdev_nvme linker script
00:00:18.153  1cbacb58f test/nvmf: Clarify comment about lack of support for iWARP in tests
00:00:18.168  [Pipeline] sh
00:00:18.451  + git -C spdk show -s --format=%s 12fc2abf1e54ef44d6ae9091ab879722d4e15e60
00:00:18.469  [Pipeline] setCustomBuildProperty
00:00:18.478  [Pipeline] setCustomBuildProperty
00:00:18.499  [Pipeline] withCredentials
00:00:18.511   > git --version # timeout=10
00:00:18.526   > git --version # 'git version 2.39.2'
00:00:18.547  Masking supported pattern matches of $GIT_PASSWORD or $GIT_ASKPASS
00:00:18.550  [Pipeline] {
00:00:18.559  [Pipeline] retry
00:00:18.561  [Pipeline] {
00:00:18.577  [Pipeline] sh
00:00:18.862  + git ls-remote http://dpdk.org/git/dpdk-stable v23.11
00:00:19.137  [Pipeline] }
00:00:19.157  [Pipeline] // retry
00:00:19.162  [Pipeline] }
00:00:19.179  [Pipeline] // withCredentials
00:00:19.189  [Pipeline] httpRequest
00:00:19.590  [Pipeline] echo
00:00:19.592  Sorcerer 10.211.164.101 is alive
00:00:19.603  [Pipeline] retry
00:00:19.605  [Pipeline] {
00:00:19.620  [Pipeline] httpRequest
00:00:19.625  HttpMethod: GET
00:00:19.626  URL: http://10.211.164.101/packages/dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz
00:00:19.627  Sending request to url: http://10.211.164.101/packages/dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz
00:00:19.629  Response Code: HTTP/1.1 200 OK
00:00:19.630  Success: Status code 200 is in the accepted range: 200,404
00:00:19.630  Saving response body to /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz
00:00:20.857  [Pipeline] }
00:00:20.877  [Pipeline] // retry
00:00:20.885  [Pipeline] sh
00:00:21.164  + tar --no-same-owner -xf dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz
00:00:22.556  [Pipeline] sh
00:00:22.841  + git -C dpdk log --oneline -n5
00:00:22.842  eeb0605f11 version: 23.11.0
00:00:22.842  238778122a doc: update release notes for 23.11
00:00:22.842  46aa6b3cfc doc: fix description of RSS features
00:00:22.842  dd88f51a57 devtools: forbid DPDK API in cnxk base driver
00:00:22.842  7e421ae345 devtools: support skipping forbid rule check
00:00:22.855  [Pipeline] catchError
00:00:22.857  [Pipeline] {
00:00:22.876  [Pipeline] readJSON
00:00:22.899  [Pipeline] }
00:00:22.922  [Pipeline] // catchError
00:00:22.933  [Pipeline] sh
00:00:23.218  + /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/jbp/jenkins/jjb-config/jobs/scripts/get-pkgdep-jobs.sh /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk
00:00:23.236  [Pipeline] }
00:00:23.258  [Pipeline] // stage
00:00:23.277  [Pipeline] catchError
00:00:23.279  [Pipeline] {
00:00:23.298  [Pipeline] stage
00:00:23.300  [Pipeline] { (Tests)
00:00:23.499  [Pipeline] parallel
00:00:23.603  [Pipeline] { (Branch: check-format-docker-autotest)
00:00:23.605  [Pipeline] { (Branch: check-so-deps-docker-autotest)
00:00:23.606  [Pipeline] { (Branch: doc-docker-autotest)
00:00:23.607  [Pipeline] { (Branch: build-files-docker-autotest)
00:00:23.608  [Pipeline] { (Branch: unittest-clang-docker-autotest)
00:00:23.610  [Pipeline] { (Branch: unittest-main-docker-autotest)
00:00:23.611  [Pipeline] { (Branch: unittest-valgrind-docker-autotest)
00:00:23.612  [Pipeline] { (Branch: scan-build-docker-autotest)
00:00:23.614  [Pipeline] { (Branch: packaging-docker-autotest)
00:00:23.615  [Pipeline] { (Branch: autobuild-external-vg-autotest)
00:00:23.616  [Pipeline] { (Branch: lvol-vg-autotest)
00:00:23.618  [Pipeline] { (Branch: vhost-initiator-vg-autotest)
00:00:23.619  [Pipeline] { (Branch: nvmf-tcp-vg-autotest)
00:00:23.620  [Pipeline] { (Branch: nvmf-tcp-uring-vg-autotest)
00:00:23.622  [Pipeline] { (Branch: nvme-vg-autotest)
00:00:23.623  [Pipeline] { (Branch: rocky9-vg-autotest)
00:00:23.624  [Pipeline] { (Branch: ubuntu22-vg-autotest)
00:00:23.625  [Pipeline] { (Branch: ubuntu24-vg-autotest)
00:00:23.627  [Pipeline] { (Branch: iscsi-vg-autotest)
00:00:23.628  [Pipeline] { (Branch: iscsi-uring-vg-autotest)
00:00:23.629  [Pipeline] { (Branch: zns-vg-autotest)
00:00:23.631  [Pipeline] { (Branch: nvme-cmb-pmr-vg-autotest)
00:00:23.632  [Pipeline] { (Branch: raid-vg-autotest)
00:00:23.634  [Pipeline] { (Branch: BlobFS-phy-autotest)
00:00:23.636  [Pipeline] { (Branch: crypto-phy-autotest)
00:00:23.638  [Pipeline] { (Branch: vhost-phy-autotest)
00:00:23.639  [Pipeline] { (Branch: nvmf-phy-autotest)
00:00:23.641  [Pipeline] { (Branch: nvmf-tcp-phy-autotest)
00:00:23.642  [Pipeline] { (Branch: nvme-phy-autotest)
00:00:23.644  [Pipeline] { (Branch: vfio-user-phy-autotest)
00:00:23.645  [Pipeline] { (Branch: short-fuzz-phy-autotest)
00:00:23.647  [Pipeline] { (Branch: vmd-phy-autotest)
00:00:23.648  [Pipeline] { (Branch: release-build-main-docker-autotest)
00:00:23.650  [Pipeline] { (Branch: release-build-clang-docker-autotest)
00:00:23.680  [Pipeline] retry
00:00:23.682  [Pipeline] {
00:00:23.688  [Pipeline] retry
00:00:23.690  [Pipeline] {
00:00:23.695  [Pipeline] retry
00:00:23.697  [Pipeline] {
00:00:23.703  [Pipeline] retry
00:00:23.705  [Pipeline] {
00:00:23.710  [Pipeline] retry
00:00:23.712  [Pipeline] {
00:00:23.718  [Pipeline] retry
00:00:23.720  [Pipeline] {
00:00:23.725  [Pipeline] retry
00:00:23.727  [Pipeline] {
00:00:23.732  [Pipeline] retry
00:00:23.734  [Pipeline] {
00:00:23.739  [Pipeline] retry
00:00:23.741  [Pipeline] {
00:00:23.746  [Pipeline] retry
00:00:23.748  [Pipeline] {
00:00:23.753  [Pipeline] retry
00:00:23.755  [Pipeline] {
00:00:23.760  [Pipeline] retry
00:00:23.762  [Pipeline] {
00:00:23.767  [Pipeline] retry
00:00:23.769  [Pipeline] {
00:00:23.774  [Pipeline] retry
00:00:23.776  [Pipeline] {
00:00:23.781  [Pipeline] retry
00:00:23.783  [Pipeline] {
00:00:23.788  [Pipeline] retry
00:00:23.790  [Pipeline] {
00:00:23.796  [Pipeline] retry
00:00:23.798  [Pipeline] {
00:00:23.803  [Pipeline] retry
00:00:23.805  [Pipeline] {
00:00:23.810  [Pipeline] retry
00:00:23.812  [Pipeline] {
00:00:23.818  [Pipeline] retry
00:00:23.820  [Pipeline] {
00:00:23.825  [Pipeline] retry
00:00:23.827  [Pipeline] {
00:00:23.833  [Pipeline] retry
00:00:23.835  [Pipeline] {
00:00:23.840  [Pipeline] retry
00:00:23.842  [Pipeline] {
00:00:23.848  [Pipeline] retry
00:00:23.850  [Pipeline] {
00:00:23.855  [Pipeline] retry
00:00:23.857  [Pipeline] {
00:00:23.863  [Pipeline] retry
00:00:23.865  [Pipeline] {
00:00:23.870  [Pipeline] retry
00:00:23.872  [Pipeline] {
00:00:23.878  [Pipeline] retry
00:00:23.880  [Pipeline] {
00:00:23.885  [Pipeline] retry
00:00:23.887  [Pipeline] {
00:00:23.892  [Pipeline] retry
00:00:23.894  [Pipeline] {
00:00:23.900  [Pipeline] retry
00:00:23.902  [Pipeline] {
00:00:23.907  [Pipeline] retry
00:00:23.909  [Pipeline] {
00:00:23.914  [Pipeline] retry
00:00:23.916  [Pipeline] {
00:00:23.921  [Pipeline] retry
00:00:23.923  [Pipeline] {
00:00:23.949  [Pipeline] build
00:00:23.952  Scheduling project: check-format-docker-autotest
00:00:23.959  [Pipeline] build
00:00:23.961  Scheduling project: check-so-deps-docker-autotest
00:00:23.967  [Pipeline] build
00:00:23.970  Scheduling project: doc-docker-autotest
00:00:23.976  [Pipeline] build
00:00:23.979  Scheduling project: build-files-docker-autotest
00:00:23.986  [Pipeline] build
00:00:23.988  Scheduling project: unittest-clang-docker-autotest
00:00:23.995  [Pipeline] build
00:00:23.997  Scheduling project: unittest-main-docker-autotest
00:00:24.003  [Pipeline] build
00:00:24.006  Scheduling project: unittest-valgrind-docker-autotest
00:00:24.013  [Pipeline] build
00:00:24.015  Scheduling project: scan-build-docker-autotest
00:00:24.021  [Pipeline] build
00:00:24.024  Scheduling project: packaging-docker-autotest
00:00:24.030  [Pipeline] build
00:00:24.032  Scheduling project: autobuild-external-vg-autotest
00:00:24.039  [Pipeline] build
00:00:24.041  Scheduling project: lvol-vg-autotest
00:00:24.047  [Pipeline] build
00:00:24.049  Scheduling project: vhost-initiator-vg-autotest
00:00:24.055  [Pipeline] build
00:00:24.058  Scheduling project: nvmf-tcp-vg-autotest
00:00:24.064  [Pipeline] build
00:00:24.066  Scheduling project: nvmf-tcp-uring-vg-autotest
00:00:24.073  [Pipeline] build
00:00:24.075  Scheduling project: nvme-vg-autotest
00:00:24.081  [Pipeline] build
00:00:24.083  Scheduling project: rocky9-vg-autotest
00:00:24.089  [Pipeline] build
00:00:24.091  Scheduling project: ubuntu22-vg-autotest
00:00:24.097  [Pipeline] build
00:00:24.099  Scheduling project: ubuntu24-vg-autotest
00:00:24.105  [Pipeline] build
00:00:24.107  Scheduling project: iscsi-vg-autotest
00:00:24.113  [Pipeline] build
00:00:24.115  Scheduling project: iscsi-uring-vg-autotest
00:00:24.122  [Pipeline] build
00:00:24.124  Scheduling project: zns-vg-autotest
00:00:24.130  [Pipeline] build
00:00:24.132  Scheduling project: nvme-cmb-pmr-vg-autotest
00:00:24.137  [Pipeline] build
00:00:24.139  Scheduling project: raid-vg-autotest
00:00:24.145  [Pipeline] build
00:00:24.147  Scheduling project: BlobFS-phy-autotest
00:00:24.153  [Pipeline] build
00:00:24.155  Scheduling project: crypto-phy-autotest
00:00:24.161  [Pipeline] build
00:00:24.164  Scheduling project: vhost-phy-autotest
00:00:24.169  [Pipeline] build
00:00:24.172  Scheduling project: nvmf-phy-autotest
00:00:24.177  [Pipeline] build
00:00:24.180  Scheduling project: nvmf-tcp-phy-autotest
00:00:24.186  [Pipeline] build
00:00:24.188  Scheduling project: nvme-phy-autotest
00:00:24.194  [Pipeline] build
00:00:24.196  Scheduling project: vfio-user-phy-autotest
00:00:24.202  [Pipeline] build
00:00:24.204  Scheduling project: short-fuzz-phy-autotest
00:00:24.210  [Pipeline] build
00:00:24.212  Scheduling project: vmd-phy-autotest
00:00:24.218  [Pipeline] build
00:00:24.220  Scheduling project: release-build-main-docker-autotest
00:00:24.227  [Pipeline] build
00:00:24.229  Scheduling project: release-build-clang-docker-autotest
00:00:30.531  Starting building: vmd-phy-autotest #6438
00:00:30.536  Starting building: release-build-main-docker-autotest #4752
00:00:30.542  Starting building: raid-vg-autotest #6908
00:00:30.547  Starting building: nvmf-tcp-vg-autotest #92494
00:00:30.552  Starting building: rocky9-vg-autotest #29599
00:00:30.557  Starting building: release-build-clang-docker-autotest #4751
00:00:30.564  Starting building: unittest-main-docker-autotest #31648
00:00:30.569  Starting building: vfio-user-phy-autotest #40093
00:00:30.575  Starting building: BlobFS-phy-autotest #40100
00:00:30.578  Starting building: scan-build-docker-autotest #31656
00:00:30.582  Starting building: ubuntu24-vg-autotest #8796
00:00:30.589  Starting building: packaging-docker-autotest #31644
00:00:30.593  Starting building: autobuild-external-vg-autotest #32291
00:00:30.600  Starting building: ubuntu22-vg-autotest #51254
00:00:30.608  Starting building: nvmf-tcp-phy-autotest #86218
00:00:30.612  Starting building: doc-docker-autotest #35310
00:00:30.619  Starting building: check-format-docker-autotest #34995
00:00:30.622  Starting building: nvme-vg-autotest #92517
00:00:30.626  Starting building: short-fuzz-phy-autotest #40089
00:00:30.629  Starting building: crypto-phy-autotest #40095
00:00:30.633  Starting building: vhost-phy-autotest #40159
00:00:30.636  Starting building: build-files-docker-autotest #34970
00:00:30.639  Starting building: unittest-valgrind-docker-autotest #31648
00:00:30.643  Starting building: check-so-deps-docker-autotest #35218
00:00:30.647  Starting building: unittest-clang-docker-autotest #31645
00:00:30.651  Starting building: iscsi-uring-vg-autotest #92417
00:00:30.655  Starting building: zns-vg-autotest #91612
00:00:30.659  Starting building: iscsi-vg-autotest #92552
00:00:30.662  Starting building: lvol-vg-autotest #92462
00:00:30.664  Starting building: vhost-initiator-vg-autotest #92539
00:00:30.668  Starting building: nvmf-tcp-uring-vg-autotest #92459
00:00:30.671  Starting building: nvme-cmb-pmr-vg-autotest #93642
00:00:30.674  Starting building: nvmf-phy-autotest #86336
00:00:30.676  Starting building: nvme-phy-autotest #86277
00:02:53.358  Build doc-docker-autotest #35310 completed: SUCCESS
00:02:53.361  [Pipeline] }
00:02:53.403  [Pipeline] // retry
00:02:53.409  [Pipeline] }
00:03:05.365  Build check-format-docker-autotest #34995 completed: SUCCESS
00:03:05.368  [Pipeline] }
00:03:05.410  [Pipeline] // retry
00:03:05.417  [Pipeline] }
00:05:59.117  Build build-files-docker-autotest #34970 completed: SUCCESS
00:05:59.120  [Pipeline] }
00:05:59.162  [Pipeline] // retry
00:05:59.169  [Pipeline] }
00:06:29.683  Build release-build-main-docker-autotest #4752 completed: SUCCESS
00:06:29.686  [Pipeline] }
00:06:29.721  [Pipeline] // retry
00:06:29.727  [Pipeline] }
00:07:01.394  Build check-so-deps-docker-autotest #35218 completed: SUCCESS
00:07:01.396  [Pipeline] }
00:07:01.438  [Pipeline] // retry
00:07:01.445  [Pipeline] }
00:07:16.723  Build release-build-clang-docker-autotest #4751 completed: SUCCESS
00:07:16.730  [Pipeline] }
00:07:16.770  [Pipeline] // retry
00:07:16.780  [Pipeline] }
00:07:43.418  Build unittest-clang-docker-autotest #31645 completed: SUCCESS
00:07:43.420  [Pipeline] }
00:07:43.461  [Pipeline] // retry
00:07:43.468  [Pipeline] }
00:08:29.592  Build scan-build-docker-autotest #31656 completed: SUCCESS
00:08:29.594  [Pipeline] }
00:08:29.637  [Pipeline] // retry
00:08:29.647  [Pipeline] }
00:08:44.494  Build vmd-phy-autotest #6438 completed: SUCCESS
00:08:44.497  [Pipeline] }
00:08:44.539  [Pipeline] // retry
00:08:44.546  [Pipeline] }
00:09:09.124  Build unittest-main-docker-autotest #31648 completed: SUCCESS
00:09:09.126  [Pipeline] }
00:09:09.162  [Pipeline] // retry
00:09:09.168  [Pipeline] }
00:09:49.848  Build vhost-initiator-vg-autotest #92539 completed: SUCCESS
00:09:49.850  [Pipeline] }
00:09:49.885  [Pipeline] // retry
00:09:49.892  [Pipeline] }
00:10:09.230  Build packaging-docker-autotest #31644 completed: SUCCESS
00:10:09.232  [Pipeline] }
00:10:09.282  [Pipeline] // retry
00:10:09.289  [Pipeline] }
00:10:52.409  Build short-fuzz-phy-autotest #40089 completed: SUCCESS
00:10:52.411  [Pipeline] }
00:10:52.449  [Pipeline] // retry
00:10:52.457  [Pipeline] }
00:11:05.299  Build zns-vg-autotest #91612 completed: SUCCESS
00:11:05.302  [Pipeline] }
00:11:05.340  [Pipeline] // retry
00:11:05.349  [Pipeline] }
00:11:16.455  Build autobuild-external-vg-autotest #32291 completed: SUCCESS
00:11:16.457  [Pipeline] }
00:11:16.484  [Pipeline] // retry
00:11:16.489  [Pipeline] }
00:12:53.112  Build nvme-cmb-pmr-vg-autotest #93642 completed: SUCCESS
00:12:53.114  [Pipeline] }
00:12:53.149  [Pipeline] // retry
00:12:53.153  [Pipeline] }
00:13:04.280  Build lvol-vg-autotest #92462 completed: SUCCESS
00:13:04.282  [Pipeline] }
00:13:04.320  [Pipeline] // retry
00:13:04.326  [Pipeline] }
00:13:55.314  Build unittest-valgrind-docker-autotest #31648 completed: SUCCESS
00:13:55.316  [Pipeline] }
00:13:55.354  [Pipeline] // retry
00:13:55.360  [Pipeline] }
00:14:41.711  Build rocky9-vg-autotest #29599 completed: SUCCESS
00:14:41.714  [Pipeline] }
00:14:41.756  [Pipeline] // retry
00:14:41.765  [Pipeline] }
00:18:19.534  Build BlobFS-phy-autotest #40100 completed: SUCCESS
00:18:19.536  [Pipeline] }
00:18:19.574  [Pipeline] // retry
00:18:19.580  [Pipeline] }
00:19:05.688  Build vfio-user-phy-autotest #40093 completed: SUCCESS
00:19:05.691  [Pipeline] }
00:19:05.727  [Pipeline] // retry
00:19:05.733  [Pipeline] }
00:19:24.999  Build ubuntu22-vg-autotest #51254 completed: SUCCESS
00:19:25.001  [Pipeline] }
00:19:25.035  [Pipeline] // retry
00:19:25.041  [Pipeline] }
00:19:31.857  Build raid-vg-autotest #6908 completed: SUCCESS
00:19:31.859  [Pipeline] }
00:19:31.897  [Pipeline] // retry
00:19:31.905  [Pipeline] }
00:19:45.103  Build ubuntu24-vg-autotest #8796 completed: SUCCESS
00:19:45.105  [Pipeline] }
00:19:45.138  [Pipeline] // retry
00:19:45.145  [Pipeline] }
00:23:32.959  Build crypto-phy-autotest #40095 completed: SUCCESS
00:23:32.962  [Pipeline] }
00:23:33.012  [Pipeline] // retry
00:23:33.019  [Pipeline] }
00:24:29.422  Build nvme-phy-autotest #86277 completed: SUCCESS
00:24:29.425  [Pipeline] }
00:24:29.461  [Pipeline] // retry
00:24:29.467  [Pipeline] }
00:24:56.362  Build nvmf-tcp-uring-vg-autotest #92459 completed: FAILURE
00:24:57.485  [Pipeline] echo
00:24:57.486  No retry patterns found.
00:24:57.487  [Pipeline] }
00:24:57.513  [Pipeline] // retry
00:24:57.518  [Pipeline] error
00:24:57.524  [Pipeline] }
00:24:57.529  Failed in branch nvmf-tcp-uring-vg-autotest
00:28:45.642  Build vhost-phy-autotest #40159 completed: SUCCESS
00:28:45.645  [Pipeline] }
00:28:45.681  [Pipeline] // retry
00:28:45.688  [Pipeline] }
00:28:56.739  Build iscsi-uring-vg-autotest #92417 completed: SUCCESS
00:28:56.741  [Pipeline] }
00:28:56.773  [Pipeline] // retry
00:28:56.781  [Pipeline] }
00:31:00.827  Build nvmf-tcp-phy-autotest #86218 completed: FAILURE
00:31:01.881  [Pipeline] echo
00:31:01.883  No retry patterns found.
00:31:01.884  [Pipeline] }
00:31:01.913  [Pipeline] // retry
00:31:01.921  [Pipeline] error
00:31:01.924  [Pipeline] }
00:31:01.928  Failed in branch nvmf-tcp-phy-autotest
00:33:39.549  Build iscsi-vg-autotest #92552 completed: SUCCESS
00:33:39.552  [Pipeline] }
00:33:39.590  [Pipeline] // retry
00:33:39.596  [Pipeline] }
00:34:41.014  Build nvme-vg-autotest #92517 completed: SUCCESS
00:34:41.016  [Pipeline] }
00:34:41.054  [Pipeline] // retry
00:34:41.061  [Pipeline] }
00:36:23.372  Build nvmf-phy-autotest #86336 completed: SUCCESS
00:36:23.375  [Pipeline] }
00:36:23.409  [Pipeline] // retry
00:36:23.415  [Pipeline] }
00:37:58.101  Build nvmf-tcp-vg-autotest #92494 completed: SUCCESS
00:37:58.104  [Pipeline] }
00:37:58.128  [Pipeline] // retry
00:37:58.135  [Pipeline] }
00:37:58.405  [Pipeline] // parallel
00:37:58.412  [Pipeline] }
00:37:58.433  [Pipeline] // stage
00:37:58.440  [Pipeline] }
00:37:58.446  ERROR: Build nvmf-tcp-uring-vg-autotest #92459 failed
00:37:58.446  Setting overall build result to FAILURE
00:37:58.463  [Pipeline] // catchError
00:37:58.471  [Pipeline] stage
00:37:58.472  [Pipeline] { (Autorun Post and Coverage)
00:37:58.491  [Pipeline] setCustomBuildProperty
00:37:58.512  [Pipeline] dir
00:37:58.512  Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/doc-docker-autotest_35310
00:37:58.514  [Pipeline] {
00:37:58.532  [Pipeline] copyArtifacts
00:37:58.847  Copied 6 artifacts from "doc-docker-autotest" build number 35310
00:37:58.851  [Pipeline] writeFile
00:37:58.873  [Pipeline] }
00:37:58.899  [Pipeline] // dir
00:37:58.920  [Pipeline] dir
00:37:58.920  Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/check-format-docker-autotest_34995
00:37:58.922  [Pipeline] {
00:37:58.940  [Pipeline] copyArtifacts
00:37:59.003  Copied 5 artifacts from "check-format-docker-autotest" build number 34995
00:37:59.009  [Pipeline] writeFile
00:37:59.038  [Pipeline] }
00:37:59.072  [Pipeline] // dir
00:37:59.242  [Pipeline] dir
00:37:59.243  Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/build-files-docker-autotest_34970
00:37:59.244  [Pipeline] {
00:37:59.268  [Pipeline] copyArtifacts
00:37:59.331  Copied 5 artifacts from "build-files-docker-autotest" build number 34970
00:37:59.334  [Pipeline] writeFile
00:37:59.411  [Pipeline] }
00:37:59.451  [Pipeline] // dir
00:37:59.549  [Pipeline] dir
00:37:59.550  Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/release-build-main-docker-autotest_4752
00:37:59.551  [Pipeline] {
00:37:59.575  [Pipeline] copyArtifacts
00:37:59.706  Copied 5 artifacts from "release-build-main-docker-autotest" build number 4752
00:37:59.711  [Pipeline] writeFile
00:37:59.776  [Pipeline] }
00:37:59.820  [Pipeline] // dir
00:37:59.923  [Pipeline] dir
00:37:59.924  Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/check-so-deps-docker-autotest_35218
00:37:59.925  [Pipeline] {
00:37:59.950  [Pipeline] copyArtifacts
00:38:00.016  Copied 5 artifacts from "check-so-deps-docker-autotest" build number 35218
00:38:00.020  [Pipeline] writeFile
00:38:00.086  [Pipeline] }
00:38:00.134  [Pipeline] // dir
00:38:00.235  [Pipeline] dir
00:38:00.236  Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/release-build-clang-docker-autotest_4751
00:38:00.237  [Pipeline] {
00:38:00.261  [Pipeline] copyArtifacts
00:38:00.325  Copied 5 artifacts from "release-build-clang-docker-autotest" build number 4751
00:38:00.330  [Pipeline] writeFile
00:38:00.401  [Pipeline] }
00:38:00.441  [Pipeline] // dir
00:38:00.678  [Pipeline] dir
00:38:00.679  Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-clang-docker-autotest_31645
00:38:00.680  [Pipeline] {
00:38:00.710  [Pipeline] copyArtifacts
00:38:01.075  Copied 6 artifacts from "unittest-clang-docker-autotest" build number 31645
00:38:01.080  [Pipeline] writeFile
00:38:01.157  [Pipeline] }
00:38:01.210  [Pipeline] // dir
00:38:01.303  [Pipeline] dir
00:38:01.303  Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/scan-build-docker-autotest_31656
00:38:01.304  [Pipeline] {
00:38:01.328  [Pipeline] copyArtifacts
00:38:01.433  Copied 9 artifacts from "scan-build-docker-autotest" build number 31656
00:38:01.437  [Pipeline] writeFile
00:38:01.498  [Pipeline] }
00:38:01.535  [Pipeline] // dir
00:38:01.700  [Pipeline] dir
00:38:01.701  Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vmd-phy-autotest_6438
00:38:01.702  [Pipeline] {
00:38:01.728  [Pipeline] copyArtifacts
00:38:01.968  Copied 13 artifacts from "vmd-phy-autotest" build number 6438
00:38:01.973  [Pipeline] writeFile
00:38:02.051  [Pipeline] }
00:38:02.094  [Pipeline] // dir
00:38:02.293  [Pipeline] dir
00:38:02.293  Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-main-docker-autotest_31648
00:38:02.294  [Pipeline] {
00:38:02.323  [Pipeline] copyArtifacts
00:38:02.628  Copied 6 artifacts from "unittest-main-docker-autotest" build number 31648
00:38:02.634  [Pipeline] writeFile
00:38:02.707  [Pipeline] }
00:38:02.760  [Pipeline] // dir
00:38:03.076  [Pipeline] dir
00:38:03.077  Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-initiator-vg-autotest_92539
00:38:03.078  [Pipeline] {
00:38:03.114  [Pipeline] copyArtifacts
00:38:03.424  Copied 16 artifacts from "vhost-initiator-vg-autotest" build number 92539
00:38:03.428  [Pipeline] writeFile
00:38:03.563  [Pipeline] }
00:38:03.653  [Pipeline] // dir
00:38:04.047  [Pipeline] dir
00:38:04.047  Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/packaging-docker-autotest_31644
00:38:04.048  [Pipeline] {
00:38:04.094  [Pipeline] copyArtifacts
00:38:04.164  Copied 5 artifacts from "packaging-docker-autotest" build number 31644
00:38:04.167  [Pipeline] writeFile
00:38:04.361  [Pipeline] }
00:38:04.469  [Pipeline] // dir
00:38:04.867  [Pipeline] dir
00:38:04.867  Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/short-fuzz-phy-autotest_40089
00:38:04.868  [Pipeline] {
00:38:04.901  [Pipeline] copyArtifacts
00:38:05.166  Copied 14 artifacts from "short-fuzz-phy-autotest" build number 40089
00:38:05.170  [Pipeline] writeFile
00:38:05.334  [Pipeline] }
00:38:05.416  [Pipeline] // dir
00:38:05.581  [Pipeline] dir
00:38:05.581  Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/zns-vg-autotest_91612
00:38:05.582  [Pipeline] {
00:38:05.607  [Pipeline] copyArtifacts
00:38:05.841  Copied 13 artifacts from "zns-vg-autotest" build number 91612
00:38:05.845  [Pipeline] writeFile
00:38:05.952  [Pipeline] }
00:38:06.018  [Pipeline] // dir
00:38:06.120  [Pipeline] dir
00:38:06.120  Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/autobuild-external-vg-autotest_32291
00:38:06.121  [Pipeline] {
00:38:06.141  [Pipeline] copyArtifacts
00:38:06.258  Copied 9 artifacts from "autobuild-external-vg-autotest" build number 32291
00:38:06.261  [Pipeline] writeFile
00:38:06.323  [Pipeline] }
00:38:06.351  [Pipeline] // dir
00:38:06.624  [Pipeline] dir
00:38:06.624  Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-cmb-pmr-vg-autotest_93642
00:38:06.625  [Pipeline] {
00:38:06.656  [Pipeline] copyArtifacts
00:38:06.894  Copied 13 artifacts from "nvme-cmb-pmr-vg-autotest" build number 93642
00:38:06.898  [Pipeline] writeFile
00:38:07.020  [Pipeline] }
00:38:07.073  [Pipeline] // dir
00:38:07.544  [Pipeline] dir
00:38:07.545  Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/lvol-vg-autotest_92462
00:38:07.546  [Pipeline] {
00:38:07.587  [Pipeline] copyArtifacts
00:38:07.822  Copied 13 artifacts from "lvol-vg-autotest" build number 92462
00:38:07.826  [Pipeline] writeFile
00:38:08.108  [Pipeline] }
00:38:08.224  [Pipeline] // dir
00:38:08.626  [Pipeline] dir
00:38:08.627  Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-valgrind-docker-autotest_31648
00:38:08.628  [Pipeline] {
00:38:08.675  [Pipeline] copyArtifacts
00:38:08.923  Copied 6 artifacts from "unittest-valgrind-docker-autotest" build number 31648
00:38:08.927  [Pipeline] writeFile
00:38:09.066  [Pipeline] }
00:38:09.178  [Pipeline] // dir
00:38:09.546  [Pipeline] dir
00:38:09.546  Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/rocky9-vg-autotest_29599
00:38:09.547  [Pipeline] {
00:38:09.586  [Pipeline] copyArtifacts
00:38:10.021  Copied 13 artifacts from "rocky9-vg-autotest" build number 29599
00:38:10.025  [Pipeline] writeFile
00:38:10.143  [Pipeline] }
00:38:10.225  [Pipeline] // dir
00:38:10.394  [Pipeline] dir
00:38:10.395  Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/BlobFS-phy-autotest_40100
00:38:10.396  [Pipeline] {
00:38:10.448  [Pipeline] copyArtifacts
00:38:10.910  Copied 29 artifacts from "BlobFS-phy-autotest" build number 40100
00:38:10.916  [Pipeline] writeFile
00:38:10.994  [Pipeline] }
00:38:11.041  [Pipeline] // dir
00:38:11.448  [Pipeline] dir
00:38:11.448  Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vfio-user-phy-autotest_40093
00:38:11.450  [Pipeline] {
00:38:11.487  [Pipeline] copyArtifacts
00:38:11.724  Copied 13 artifacts from "vfio-user-phy-autotest" build number 40093
00:38:11.729  [Pipeline] writeFile
00:38:11.885  [Pipeline] }
00:38:11.962  [Pipeline] // dir
00:38:12.452  [Pipeline] dir
00:38:12.453  Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu22-vg-autotest_51254
00:38:12.453  [Pipeline] {
00:38:12.498  [Pipeline] copyArtifacts
00:38:12.969  Copied 13 artifacts from "ubuntu22-vg-autotest" build number 51254
00:38:12.973  [Pipeline] writeFile
00:38:13.128  [Pipeline] }
00:38:13.235  [Pipeline] // dir
00:38:14.268  [Pipeline] dir
00:38:14.268  Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/raid-vg-autotest_6908
00:38:14.269  [Pipeline] {
00:38:14.329  [Pipeline] copyArtifacts
00:38:14.564  Copied 13 artifacts from "raid-vg-autotest" build number 6908
00:38:14.568  [Pipeline] writeFile
00:38:15.017  [Pipeline] }
00:38:15.175  [Pipeline] // dir
00:38:15.516  [Pipeline] dir
00:38:15.516  Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu24-vg-autotest_8796
00:38:15.517  [Pipeline] {
00:38:15.554  [Pipeline] copyArtifacts
00:38:15.978  Copied 13 artifacts from "ubuntu24-vg-autotest" build number 8796
00:38:15.982  [Pipeline] writeFile
00:38:16.152  [Pipeline] }
00:38:16.245  [Pipeline] // dir
00:38:16.923  [Pipeline] dir
00:38:16.923  Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/crypto-phy-autotest_40095
00:38:16.924  [Pipeline] {
00:38:16.984  [Pipeline] copyArtifacts
00:38:17.243  Copied 13 artifacts from "crypto-phy-autotest" build number 40095
00:38:17.247  [Pipeline] writeFile
00:38:17.617  [Pipeline] }
00:38:17.789  [Pipeline] // dir
00:38:18.336  [Pipeline] dir
00:38:18.336  Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-phy-autotest_86277
00:38:18.337  [Pipeline] {
00:38:18.382  [Pipeline] copyArtifacts
00:38:18.668  Copied 13 artifacts from "nvme-phy-autotest" build number 86277
00:38:18.673  [Pipeline] writeFile
00:38:18.894  [Pipeline] }
00:38:19.021  [Pipeline] // dir
00:38:19.878  [Pipeline] dir
00:38:19.878  Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-uring-vg-autotest_92459
00:38:19.879  [Pipeline] {
00:38:19.949  [Pipeline] copyArtifacts
00:38:20.515  Copied 15 artifacts from "nvmf-tcp-uring-vg-autotest" build number 92459
00:38:20.518  [Pipeline] writeFile
00:38:20.832  [Pipeline] }
00:38:21.002  [Pipeline] // dir
00:38:21.537  [Pipeline] dir
00:38:21.537  Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-phy-autotest_40159
00:38:21.538  [Pipeline] {
00:38:21.587  [Pipeline] copyArtifacts
00:38:21.894  Copied 14 artifacts from "vhost-phy-autotest" build number 40159
00:38:21.899  [Pipeline] writeFile
00:38:22.114  [Pipeline] }
00:38:22.239  [Pipeline] // dir
00:38:22.685  [Pipeline] dir
00:38:22.686  Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-uring-vg-autotest_92417
00:38:22.687  [Pipeline] {
00:38:22.731  [Pipeline] copyArtifacts
00:38:25.546  Copied 17 artifacts from "iscsi-uring-vg-autotest" build number 92417
00:38:25.551  [Pipeline] writeFile
00:38:25.720  [Pipeline] }
00:38:25.812  [Pipeline] // dir
00:38:26.507  [Pipeline] dir
00:38:26.507  Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-phy-autotest_86218
00:38:26.508  [Pipeline] {
00:38:26.560  [Pipeline] copyArtifacts
00:38:27.562  Copied 20 artifacts from "nvmf-tcp-phy-autotest" build number 86218
00:38:27.567  [Pipeline] writeFile
00:38:27.841  [Pipeline] }
00:38:27.988  [Pipeline] // dir
00:38:28.399  [Pipeline] dir
00:38:28.399  Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-vg-autotest_92552
00:38:28.401  [Pipeline] {
00:38:28.439  [Pipeline] copyArtifacts
00:38:31.301  Copied 17 artifacts from "iscsi-vg-autotest" build number 92552
00:38:31.306  [Pipeline] writeFile
00:38:31.436  [Pipeline] }
00:38:31.539  [Pipeline] // dir
00:38:32.241  [Pipeline] dir
00:38:32.242  Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-vg-autotest_92517
00:38:32.243  [Pipeline] {
00:38:32.293  [Pipeline] copyArtifacts
00:38:32.535  Copied 13 artifacts from "nvme-vg-autotest" build number 92517
00:38:32.539  [Pipeline] writeFile
00:38:32.781  [Pipeline] }
00:38:32.879  [Pipeline] // dir
00:38:33.750  [Pipeline] dir
00:38:33.750  Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-phy-autotest_86336
00:38:33.752  [Pipeline] {
00:38:33.819  [Pipeline] copyArtifacts
00:38:34.316  Copied 15 artifacts from "nvmf-phy-autotest" build number 86336
00:38:34.321  [Pipeline] writeFile
00:38:34.638  [Pipeline] }
00:38:34.841  [Pipeline] // dir
00:38:36.104  [Pipeline] dir
00:38:36.104  Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-vg-autotest_92494
00:38:36.105  [Pipeline] {
00:38:36.197  [Pipeline] copyArtifacts
00:38:36.469  Copied 15 artifacts from "nvmf-tcp-vg-autotest" build number 92494
00:38:36.474  [Pipeline] writeFile
00:38:36.927  [Pipeline] }
00:38:37.150  [Pipeline] // dir
00:38:37.159  [Pipeline] catchError
00:38:37.160  [Pipeline] {
00:38:37.175  [Pipeline] sh
00:38:37.456  + jbp/jenkins/jjb-config/jobs/scripts/post_gen_coverage.sh
00:38:37.456  + shopt -s globstar nullglob
00:38:37.456  + echo 'Start stage post_gen_coverage.sh'
00:38:37.456  Start stage post_gen_coverage.sh
00:38:37.456  + cd /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11
00:38:37.456  + rm -rf /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/doc
00:38:37.456  + trap 'compress_coverage_and_docs; remove_partial_coverage_files && echo '\''End stage post_gen_coverage.sh'\''' EXIT
00:38:37.456  + move_artifacts
00:38:37.456  + local out_dirs
00:38:37.456  + out_dirs=(./**/output/)
00:38:37.456  + for dir in "${out_dirs[@]}"
00:38:37.456  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.456  + [[ -f ./autobuild-external-vg-autotest_32291/output//doc.tar.xz ]]
00:38:37.456  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.456  + [[ -f ./autobuild-external-vg-autotest_32291/output//ut_coverage.tar.xz ]]
00:38:37.456  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.456  + [[ -f ./autobuild-external-vg-autotest_32291/output//llvm.tar.xz ]]
00:38:37.456  + mv ./autobuild-external-vg-autotest_32291/output//build-kernel-manifest.txt ./autobuild-external-vg-autotest_32291/output//build-pkg-manifest.txt ./autobuild-external-vg-autotest_32291/output//build-repo-manifest.txt ./autobuild-external-vg-autotest_32291/output//dmesg.init.log ./autobuild-external-vg-autotest_32291/output//dmesg.log ./autobuild-external-vg-autotest_32291/output//power.tar.xz ./autobuild-external-vg-autotest_32291/output//test_completions.txt ./autobuild-external-vg-autotest_32291/output//timing.svg ./autobuild-external-vg-autotest_32291/output//timing.txt ./autobuild-external-vg-autotest_32291/output//..
00:38:37.456  + rmdir ./autobuild-external-vg-autotest_32291/output/
00:38:37.456  + for dir in "${out_dirs[@]}"
00:38:37.456  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.456  + [[ -f ./BlobFS-phy-autotest_40100/output//doc.tar.xz ]]
00:38:37.456  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.456  + [[ -f ./BlobFS-phy-autotest_40100/output//ut_coverage.tar.xz ]]
00:38:37.456  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.456  + [[ -f ./BlobFS-phy-autotest_40100/output//llvm.tar.xz ]]
00:38:37.456  + mv ./BlobFS-phy-autotest_40100/output//all_tests.txt ./BlobFS-phy-autotest_40100/output//build-kernel-manifest.txt ./BlobFS-phy-autotest_40100/output//build-pkg-manifest.txt ./BlobFS-phy-autotest_40100/output//build-repo-manifest.txt ./BlobFS-phy-autotest_40100/output//cov_base.info.xz ./BlobFS-phy-autotest_40100/output//cov_test.info.xz ./BlobFS-phy-autotest_40100/output//cov_total.info.xz ./BlobFS-phy-autotest_40100/output//dmesg.init.log ./BlobFS-phy-autotest_40100/output//dmesg.log ./BlobFS-phy-autotest_40100/output//power.tar.xz ./BlobFS-phy-autotest_40100/output//rocksdb ./BlobFS-phy-autotest_40100/output//test_completions.txt ./BlobFS-phy-autotest_40100/output//timing.svg ./BlobFS-phy-autotest_40100/output//timing.txt ./BlobFS-phy-autotest_40100/output//..
00:38:37.456  + rmdir ./BlobFS-phy-autotest_40100/output/
00:38:37.456  + for dir in "${out_dirs[@]}"
00:38:37.456  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.456  + [[ -f ./build-files-docker-autotest_34970/output//doc.tar.xz ]]
00:38:37.456  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.456  + [[ -f ./build-files-docker-autotest_34970/output//ut_coverage.tar.xz ]]
00:38:37.456  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.456  + [[ -f ./build-files-docker-autotest_34970/output//llvm.tar.xz ]]
00:38:37.456  + mv ./build-files-docker-autotest_34970/output//build-repo-manifest.txt ./build-files-docker-autotest_34970/output//power.tar.xz ./build-files-docker-autotest_34970/output//test_completions.txt ./build-files-docker-autotest_34970/output//timing.svg ./build-files-docker-autotest_34970/output//timing.txt ./build-files-docker-autotest_34970/output//..
00:38:37.456  + rmdir ./build-files-docker-autotest_34970/output/
00:38:37.456  + for dir in "${out_dirs[@]}"
00:38:37.456  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.456  + [[ -f ./check-format-docker-autotest_34995/output//doc.tar.xz ]]
00:38:37.456  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.456  + [[ -f ./check-format-docker-autotest_34995/output//ut_coverage.tar.xz ]]
00:38:37.456  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.456  + [[ -f ./check-format-docker-autotest_34995/output//llvm.tar.xz ]]
00:38:37.456  + mv ./check-format-docker-autotest_34995/output//build-repo-manifest.txt ./check-format-docker-autotest_34995/output//power.tar.xz ./check-format-docker-autotest_34995/output//test_completions.txt ./check-format-docker-autotest_34995/output//timing.svg ./check-format-docker-autotest_34995/output//timing.txt ./check-format-docker-autotest_34995/output//..
00:38:37.456  + rmdir ./check-format-docker-autotest_34995/output/
00:38:37.456  + for dir in "${out_dirs[@]}"
00:38:37.456  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.456  + [[ -f ./check-so-deps-docker-autotest_35218/output//doc.tar.xz ]]
00:38:37.456  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.456  + [[ -f ./check-so-deps-docker-autotest_35218/output//ut_coverage.tar.xz ]]
00:38:37.456  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.456  + [[ -f ./check-so-deps-docker-autotest_35218/output//llvm.tar.xz ]]
00:38:37.456  + mv ./check-so-deps-docker-autotest_35218/output//build-repo-manifest.txt ./check-so-deps-docker-autotest_35218/output//power.tar.xz ./check-so-deps-docker-autotest_35218/output//test_completions.txt ./check-so-deps-docker-autotest_35218/output//timing.svg ./check-so-deps-docker-autotest_35218/output//timing.txt ./check-so-deps-docker-autotest_35218/output//..
00:38:37.456  + rmdir ./check-so-deps-docker-autotest_35218/output/
00:38:37.456  + for dir in "${out_dirs[@]}"
00:38:37.456  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.456  + [[ -f ./crypto-phy-autotest_40095/output//doc.tar.xz ]]
00:38:37.456  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.456  + [[ -f ./crypto-phy-autotest_40095/output//ut_coverage.tar.xz ]]
00:38:37.456  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.456  + [[ -f ./crypto-phy-autotest_40095/output//llvm.tar.xz ]]
00:38:37.456  + mv ./crypto-phy-autotest_40095/output//all_tests.txt ./crypto-phy-autotest_40095/output//build-kernel-manifest.txt ./crypto-phy-autotest_40095/output//build-pkg-manifest.txt ./crypto-phy-autotest_40095/output//build-repo-manifest.txt ./crypto-phy-autotest_40095/output//cov_base.info.xz ./crypto-phy-autotest_40095/output//cov_test.info.xz ./crypto-phy-autotest_40095/output//cov_total.info.xz ./crypto-phy-autotest_40095/output//dmesg.init.log ./crypto-phy-autotest_40095/output//dmesg.log ./crypto-phy-autotest_40095/output//power.tar.xz ./crypto-phy-autotest_40095/output//test_completions.txt ./crypto-phy-autotest_40095/output//timing.svg ./crypto-phy-autotest_40095/output//timing.txt ./crypto-phy-autotest_40095/output//..
00:38:37.456  + rmdir ./crypto-phy-autotest_40095/output/
00:38:37.456  + for dir in "${out_dirs[@]}"
00:38:37.456  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.456  + [[ -f ./doc-docker-autotest_35310/output//doc.tar.xz ]]
00:38:37.456  + tar -C ./doc-docker-autotest_35310/output/ -xf ./doc-docker-autotest_35310/output//doc.tar.xz
00:38:37.715  + rm ./doc-docker-autotest_35310/output//doc.tar.xz
00:38:37.715  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.715  + [[ -f ./doc-docker-autotest_35310/output//ut_coverage.tar.xz ]]
00:38:37.715  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.715  + [[ -f ./doc-docker-autotest_35310/output//llvm.tar.xz ]]
00:38:37.715  + mv ./doc-docker-autotest_35310/output//build-repo-manifest.txt ./doc-docker-autotest_35310/output//doc ./doc-docker-autotest_35310/output//power.tar.xz ./doc-docker-autotest_35310/output//test_completions.txt ./doc-docker-autotest_35310/output//timing.svg ./doc-docker-autotest_35310/output//timing.txt ./doc-docker-autotest_35310/output//..
00:38:37.715  + rmdir ./doc-docker-autotest_35310/output/
00:38:37.715  + for dir in "${out_dirs[@]}"
00:38:37.715  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.715  + [[ -f ./iscsi-uring-vg-autotest_92417/output//doc.tar.xz ]]
00:38:37.715  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.715  + [[ -f ./iscsi-uring-vg-autotest_92417/output//ut_coverage.tar.xz ]]
00:38:37.715  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.715  + [[ -f ./iscsi-uring-vg-autotest_92417/output//llvm.tar.xz ]]
00:38:37.716  + mv ./iscsi-uring-vg-autotest_92417/output//all_tests.txt ./iscsi-uring-vg-autotest_92417/output//build-kernel-manifest.txt ./iscsi-uring-vg-autotest_92417/output//build-pkg-manifest.txt ./iscsi-uring-vg-autotest_92417/output//build-repo-manifest.txt ./iscsi-uring-vg-autotest_92417/output//calsoft.json ./iscsi-uring-vg-autotest_92417/output//calsoft.tar.xz ./iscsi-uring-vg-autotest_92417/output//cov_base.info.xz ./iscsi-uring-vg-autotest_92417/output//cov_test.info.xz ./iscsi-uring-vg-autotest_92417/output//cov_total.info.xz ./iscsi-uring-vg-autotest_92417/output//dmesg.init.log ./iscsi-uring-vg-autotest_92417/output//dmesg.log ./iscsi-uring-vg-autotest_92417/output//iscsi_autofuzz_logs.txt ./iscsi-uring-vg-autotest_92417/output//iscsi_autofuzz_tgt_output.txt ./iscsi-uring-vg-autotest_92417/output//power.tar.xz ./iscsi-uring-vg-autotest_92417/output//test_completions.txt ./iscsi-uring-vg-autotest_92417/output//timing.svg ./iscsi-uring-vg-autotest_92417/output//timing.txt ./iscsi-uring-vg-autotest_92417/output//..
00:38:37.716  + rmdir ./iscsi-uring-vg-autotest_92417/output/
00:38:37.716  + for dir in "${out_dirs[@]}"
00:38:37.716  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.716  + [[ -f ./iscsi-vg-autotest_92552/output//doc.tar.xz ]]
00:38:37.716  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.716  + [[ -f ./iscsi-vg-autotest_92552/output//ut_coverage.tar.xz ]]
00:38:37.716  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.716  + [[ -f ./iscsi-vg-autotest_92552/output//llvm.tar.xz ]]
00:38:37.716  + mv ./iscsi-vg-autotest_92552/output//all_tests.txt ./iscsi-vg-autotest_92552/output//build-kernel-manifest.txt ./iscsi-vg-autotest_92552/output//build-pkg-manifest.txt ./iscsi-vg-autotest_92552/output//build-repo-manifest.txt ./iscsi-vg-autotest_92552/output//calsoft.json ./iscsi-vg-autotest_92552/output//calsoft.tar.xz ./iscsi-vg-autotest_92552/output//cov_base.info.xz ./iscsi-vg-autotest_92552/output//cov_test.info.xz ./iscsi-vg-autotest_92552/output//cov_total.info.xz ./iscsi-vg-autotest_92552/output//dmesg.init.log ./iscsi-vg-autotest_92552/output//dmesg.log ./iscsi-vg-autotest_92552/output//iscsi_autofuzz_logs.txt ./iscsi-vg-autotest_92552/output//iscsi_autofuzz_tgt_output.txt ./iscsi-vg-autotest_92552/output//power.tar.xz ./iscsi-vg-autotest_92552/output//test_completions.txt ./iscsi-vg-autotest_92552/output//timing.svg ./iscsi-vg-autotest_92552/output//timing.txt ./iscsi-vg-autotest_92552/output//..
00:38:37.716  + rmdir ./iscsi-vg-autotest_92552/output/
00:38:37.716  + for dir in "${out_dirs[@]}"
00:38:37.716  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.716  + [[ -f ./lvol-vg-autotest_92462/output//doc.tar.xz ]]
00:38:37.716  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.716  + [[ -f ./lvol-vg-autotest_92462/output//ut_coverage.tar.xz ]]
00:38:37.716  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.716  + [[ -f ./lvol-vg-autotest_92462/output//llvm.tar.xz ]]
00:38:37.716  + mv ./lvol-vg-autotest_92462/output//all_tests.txt ./lvol-vg-autotest_92462/output//build-kernel-manifest.txt ./lvol-vg-autotest_92462/output//build-pkg-manifest.txt ./lvol-vg-autotest_92462/output//build-repo-manifest.txt ./lvol-vg-autotest_92462/output//cov_base.info.xz ./lvol-vg-autotest_92462/output//cov_test.info.xz ./lvol-vg-autotest_92462/output//cov_total.info.xz ./lvol-vg-autotest_92462/output//dmesg.init.log ./lvol-vg-autotest_92462/output//dmesg.log ./lvol-vg-autotest_92462/output//power.tar.xz ./lvol-vg-autotest_92462/output//test_completions.txt ./lvol-vg-autotest_92462/output//timing.svg ./lvol-vg-autotest_92462/output//timing.txt ./lvol-vg-autotest_92462/output//..
00:38:37.716  + rmdir ./lvol-vg-autotest_92462/output/
00:38:37.716  + for dir in "${out_dirs[@]}"
00:38:37.716  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.716  + [[ -f ./nvme-cmb-pmr-vg-autotest_93642/output//doc.tar.xz ]]
00:38:37.716  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.716  + [[ -f ./nvme-cmb-pmr-vg-autotest_93642/output//ut_coverage.tar.xz ]]
00:38:37.716  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.716  + [[ -f ./nvme-cmb-pmr-vg-autotest_93642/output//llvm.tar.xz ]]
00:38:37.716  + mv ./nvme-cmb-pmr-vg-autotest_93642/output//all_tests.txt ./nvme-cmb-pmr-vg-autotest_93642/output//build-kernel-manifest.txt ./nvme-cmb-pmr-vg-autotest_93642/output//build-pkg-manifest.txt ./nvme-cmb-pmr-vg-autotest_93642/output//build-repo-manifest.txt ./nvme-cmb-pmr-vg-autotest_93642/output//cov_base.info.xz ./nvme-cmb-pmr-vg-autotest_93642/output//cov_test.info.xz ./nvme-cmb-pmr-vg-autotest_93642/output//cov_total.info.xz ./nvme-cmb-pmr-vg-autotest_93642/output//dmesg.init.log ./nvme-cmb-pmr-vg-autotest_93642/output//dmesg.log ./nvme-cmb-pmr-vg-autotest_93642/output//power.tar.xz ./nvme-cmb-pmr-vg-autotest_93642/output//test_completions.txt ./nvme-cmb-pmr-vg-autotest_93642/output//timing.svg ./nvme-cmb-pmr-vg-autotest_93642/output//timing.txt ./nvme-cmb-pmr-vg-autotest_93642/output//..
00:38:37.716  + rmdir ./nvme-cmb-pmr-vg-autotest_93642/output/
00:38:37.716  + for dir in "${out_dirs[@]}"
00:38:37.716  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.716  + [[ -f ./nvme-phy-autotest_86277/output//doc.tar.xz ]]
00:38:37.716  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.716  + [[ -f ./nvme-phy-autotest_86277/output//ut_coverage.tar.xz ]]
00:38:37.716  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.716  + [[ -f ./nvme-phy-autotest_86277/output//llvm.tar.xz ]]
00:38:37.716  + mv ./nvme-phy-autotest_86277/output//all_tests.txt ./nvme-phy-autotest_86277/output//build-kernel-manifest.txt ./nvme-phy-autotest_86277/output//build-pkg-manifest.txt ./nvme-phy-autotest_86277/output//build-repo-manifest.txt ./nvme-phy-autotest_86277/output//cov_base.info.xz ./nvme-phy-autotest_86277/output//cov_test.info.xz ./nvme-phy-autotest_86277/output//cov_total.info.xz ./nvme-phy-autotest_86277/output//dmesg.init.log ./nvme-phy-autotest_86277/output//dmesg.log ./nvme-phy-autotest_86277/output//power.tar.xz ./nvme-phy-autotest_86277/output//test_completions.txt ./nvme-phy-autotest_86277/output//timing.svg ./nvme-phy-autotest_86277/output//timing.txt ./nvme-phy-autotest_86277/output//..
00:38:37.716  + rmdir ./nvme-phy-autotest_86277/output/
00:38:37.716  + for dir in "${out_dirs[@]}"
00:38:37.716  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.716  + [[ -f ./nvme-vg-autotest_92517/output//doc.tar.xz ]]
00:38:37.716  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.716  + [[ -f ./nvme-vg-autotest_92517/output//ut_coverage.tar.xz ]]
00:38:37.716  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.716  + [[ -f ./nvme-vg-autotest_92517/output//llvm.tar.xz ]]
00:38:37.716  + mv ./nvme-vg-autotest_92517/output//all_tests.txt ./nvme-vg-autotest_92517/output//build-kernel-manifest.txt ./nvme-vg-autotest_92517/output//build-pkg-manifest.txt ./nvme-vg-autotest_92517/output//build-repo-manifest.txt ./nvme-vg-autotest_92517/output//cov_base.info.xz ./nvme-vg-autotest_92517/output//cov_test.info.xz ./nvme-vg-autotest_92517/output//cov_total.info.xz ./nvme-vg-autotest_92517/output//dmesg.init.log ./nvme-vg-autotest_92517/output//dmesg.log ./nvme-vg-autotest_92517/output//power.tar.xz ./nvme-vg-autotest_92517/output//test_completions.txt ./nvme-vg-autotest_92517/output//timing.svg ./nvme-vg-autotest_92517/output//timing.txt ./nvme-vg-autotest_92517/output//..
00:38:37.716  + rmdir ./nvme-vg-autotest_92517/output/
00:38:37.716  + for dir in "${out_dirs[@]}"
00:38:37.716  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.716  + [[ -f ./nvmf-phy-autotest_86336/output//doc.tar.xz ]]
00:38:37.716  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.716  + [[ -f ./nvmf-phy-autotest_86336/output//ut_coverage.tar.xz ]]
00:38:37.716  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.716  + [[ -f ./nvmf-phy-autotest_86336/output//llvm.tar.xz ]]
00:38:37.716  + mv ./nvmf-phy-autotest_86336/output//all_tests.txt ./nvmf-phy-autotest_86336/output//build-kernel-manifest.txt ./nvmf-phy-autotest_86336/output//build-pkg-manifest.txt ./nvmf-phy-autotest_86336/output//build-repo-manifest.txt ./nvmf-phy-autotest_86336/output//cov_base.info.xz ./nvmf-phy-autotest_86336/output//cov_test.info.xz ./nvmf-phy-autotest_86336/output//cov_total.info.xz ./nvmf-phy-autotest_86336/output//dmesg.init.log ./nvmf-phy-autotest_86336/output//dmesg.log ./nvmf-phy-autotest_86336/output//nvmf_fuzz_tgt_output.txt ./nvmf-phy-autotest_86336/output//nvmf_trace.0_shm.tar.gz ./nvmf-phy-autotest_86336/output//power.tar.xz ./nvmf-phy-autotest_86336/output//test_completions.txt ./nvmf-phy-autotest_86336/output//timing.svg ./nvmf-phy-autotest_86336/output//timing.txt ./nvmf-phy-autotest_86336/output//..
00:38:37.716  + rmdir ./nvmf-phy-autotest_86336/output/
00:38:37.716  + for dir in "${out_dirs[@]}"
00:38:37.716  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.716  + [[ -f ./nvmf-tcp-phy-autotest_86218/output//doc.tar.xz ]]
00:38:37.716  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.716  + [[ -f ./nvmf-tcp-phy-autotest_86218/output//ut_coverage.tar.xz ]]
00:38:37.716  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.716  + [[ -f ./nvmf-tcp-phy-autotest_86218/output//llvm.tar.xz ]]
00:38:37.716  + mv ./nvmf-tcp-phy-autotest_86218/output//all_tests.txt ./nvmf-tcp-phy-autotest_86218/output//build-kernel-manifest.txt ./nvmf-tcp-phy-autotest_86218/output//build-pkg-manifest.txt ./nvmf-tcp-phy-autotest_86218/output//build-repo-manifest.txt ./nvmf-tcp-phy-autotest_86218/output//coredumps ./nvmf-tcp-phy-autotest_86218/output//cov_base.info.xz ./nvmf-tcp-phy-autotest_86218/output//dmesg.init.log ./nvmf-tcp-phy-autotest_86218/output//dmesg.log ./nvmf-tcp-phy-autotest_86218/output//nvmf_fuzz_tgt_output.txt ./nvmf-tcp-phy-autotest_86218/output//nvmf_trace.0_shm.tar.gz ./nvmf-tcp-phy-autotest_86218/output//power.tar.xz ./nvmf-tcp-phy-autotest_86218/output//proc_list.txt ./nvmf-tcp-phy-autotest_86218/output//test_completions.txt ./nvmf-tcp-phy-autotest_86218/output//timing.svg ./nvmf-tcp-phy-autotest_86218/output//timing.txt ./nvmf-tcp-phy-autotest_86218/output//udev.log ./nvmf-tcp-phy-autotest_86218/output//..
00:38:37.716  + rmdir ./nvmf-tcp-phy-autotest_86218/output/
00:38:37.716  + for dir in "${out_dirs[@]}"
00:38:37.716  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.716  + [[ -f ./nvmf-tcp-uring-vg-autotest_92459/output//doc.tar.xz ]]
00:38:37.716  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.716  + [[ -f ./nvmf-tcp-uring-vg-autotest_92459/output//ut_coverage.tar.xz ]]
00:38:37.716  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.716  + [[ -f ./nvmf-tcp-uring-vg-autotest_92459/output//llvm.tar.xz ]]
00:38:37.716  + mv ./nvmf-tcp-uring-vg-autotest_92459/output//all_tests.txt ./nvmf-tcp-uring-vg-autotest_92459/output//build-kernel-manifest.txt ./nvmf-tcp-uring-vg-autotest_92459/output//build-pkg-manifest.txt ./nvmf-tcp-uring-vg-autotest_92459/output//build-repo-manifest.txt ./nvmf-tcp-uring-vg-autotest_92459/output//cov_base.info.xz ./nvmf-tcp-uring-vg-autotest_92459/output//dmesg.init.log ./nvmf-tcp-uring-vg-autotest_92459/output//dmesg.log ./nvmf-tcp-uring-vg-autotest_92459/output//nvmf_fuzz_tgt_output.txt ./nvmf-tcp-uring-vg-autotest_92459/output//nvmf_trace.0_shm.tar.gz ./nvmf-tcp-uring-vg-autotest_92459/output//power.tar.xz ./nvmf-tcp-uring-vg-autotest_92459/output//proc_list.txt ./nvmf-tcp-uring-vg-autotest_92459/output//test_completions.txt ./nvmf-tcp-uring-vg-autotest_92459/output//timing.svg ./nvmf-tcp-uring-vg-autotest_92459/output//timing.txt ./nvmf-tcp-uring-vg-autotest_92459/output//udev.log ./nvmf-tcp-uring-vg-autotest_92459/output//..
00:38:37.716  + rmdir ./nvmf-tcp-uring-vg-autotest_92459/output/
00:38:37.716  + for dir in "${out_dirs[@]}"
00:38:37.716  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.716  + [[ -f ./nvmf-tcp-vg-autotest_92494/output//doc.tar.xz ]]
00:38:37.716  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.716  + [[ -f ./nvmf-tcp-vg-autotest_92494/output//ut_coverage.tar.xz ]]
00:38:37.716  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.716  + [[ -f ./nvmf-tcp-vg-autotest_92494/output//llvm.tar.xz ]]
00:38:37.716  + mv ./nvmf-tcp-vg-autotest_92494/output//all_tests.txt ./nvmf-tcp-vg-autotest_92494/output//build-kernel-manifest.txt ./nvmf-tcp-vg-autotest_92494/output//build-pkg-manifest.txt ./nvmf-tcp-vg-autotest_92494/output//build-repo-manifest.txt ./nvmf-tcp-vg-autotest_92494/output//cov_base.info.xz ./nvmf-tcp-vg-autotest_92494/output//cov_test.info.xz ./nvmf-tcp-vg-autotest_92494/output//cov_total.info.xz ./nvmf-tcp-vg-autotest_92494/output//dmesg.init.log ./nvmf-tcp-vg-autotest_92494/output//dmesg.log ./nvmf-tcp-vg-autotest_92494/output//nvmf_fuzz_tgt_output.txt ./nvmf-tcp-vg-autotest_92494/output//nvmf_trace.0_shm.tar.gz ./nvmf-tcp-vg-autotest_92494/output//power.tar.xz ./nvmf-tcp-vg-autotest_92494/output//test_completions.txt ./nvmf-tcp-vg-autotest_92494/output//timing.svg ./nvmf-tcp-vg-autotest_92494/output//timing.txt ./nvmf-tcp-vg-autotest_92494/output//..
00:38:37.716  + rmdir ./nvmf-tcp-vg-autotest_92494/output/
00:38:37.716  + for dir in "${out_dirs[@]}"
00:38:37.716  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.716  + [[ -f ./packaging-docker-autotest_31644/output//doc.tar.xz ]]
00:38:37.716  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.716  + [[ -f ./packaging-docker-autotest_31644/output//ut_coverage.tar.xz ]]
00:38:37.717  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.717  + [[ -f ./packaging-docker-autotest_31644/output//llvm.tar.xz ]]
00:38:37.717  + mv ./packaging-docker-autotest_31644/output//build-repo-manifest.txt ./packaging-docker-autotest_31644/output//power.tar.xz ./packaging-docker-autotest_31644/output//test_completions.txt ./packaging-docker-autotest_31644/output//timing.svg ./packaging-docker-autotest_31644/output//timing.txt ./packaging-docker-autotest_31644/output//..
00:38:37.717  + rmdir ./packaging-docker-autotest_31644/output/
00:38:37.717  + for dir in "${out_dirs[@]}"
00:38:37.717  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.717  + [[ -f ./raid-vg-autotest_6908/output//doc.tar.xz ]]
00:38:37.717  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.717  + [[ -f ./raid-vg-autotest_6908/output//ut_coverage.tar.xz ]]
00:38:37.717  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.717  + [[ -f ./raid-vg-autotest_6908/output//llvm.tar.xz ]]
00:38:37.717  + mv ./raid-vg-autotest_6908/output//all_tests.txt ./raid-vg-autotest_6908/output//build-kernel-manifest.txt ./raid-vg-autotest_6908/output//build-pkg-manifest.txt ./raid-vg-autotest_6908/output//build-repo-manifest.txt ./raid-vg-autotest_6908/output//cov_base.info.xz ./raid-vg-autotest_6908/output//cov_test.info.xz ./raid-vg-autotest_6908/output//cov_total.info.xz ./raid-vg-autotest_6908/output//dmesg.init.log ./raid-vg-autotest_6908/output//dmesg.log ./raid-vg-autotest_6908/output//power.tar.xz ./raid-vg-autotest_6908/output//test_completions.txt ./raid-vg-autotest_6908/output//timing.svg ./raid-vg-autotest_6908/output//timing.txt ./raid-vg-autotest_6908/output//..
00:38:37.717  + rmdir ./raid-vg-autotest_6908/output/
00:38:37.717  + for dir in "${out_dirs[@]}"
00:38:37.717  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.717  + [[ -f ./release-build-clang-docker-autotest_4751/output//doc.tar.xz ]]
00:38:37.717  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.717  + [[ -f ./release-build-clang-docker-autotest_4751/output//ut_coverage.tar.xz ]]
00:38:37.717  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.717  + [[ -f ./release-build-clang-docker-autotest_4751/output//llvm.tar.xz ]]
00:38:37.717  + mv ./release-build-clang-docker-autotest_4751/output//build-repo-manifest.txt ./release-build-clang-docker-autotest_4751/output//power.tar.xz ./release-build-clang-docker-autotest_4751/output//test_completions.txt ./release-build-clang-docker-autotest_4751/output//timing.svg ./release-build-clang-docker-autotest_4751/output//timing.txt ./release-build-clang-docker-autotest_4751/output//..
00:38:37.717  + rmdir ./release-build-clang-docker-autotest_4751/output/
00:38:37.717  + for dir in "${out_dirs[@]}"
00:38:37.717  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.717  + [[ -f ./release-build-main-docker-autotest_4752/output//doc.tar.xz ]]
00:38:37.717  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.717  + [[ -f ./release-build-main-docker-autotest_4752/output//ut_coverage.tar.xz ]]
00:38:37.717  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.717  + [[ -f ./release-build-main-docker-autotest_4752/output//llvm.tar.xz ]]
00:38:37.717  + mv ./release-build-main-docker-autotest_4752/output//build-repo-manifest.txt ./release-build-main-docker-autotest_4752/output//power.tar.xz ./release-build-main-docker-autotest_4752/output//test_completions.txt ./release-build-main-docker-autotest_4752/output//timing.svg ./release-build-main-docker-autotest_4752/output//timing.txt ./release-build-main-docker-autotest_4752/output//..
00:38:37.717  + rmdir ./release-build-main-docker-autotest_4752/output/
00:38:37.717  + for dir in "${out_dirs[@]}"
00:38:37.717  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.717  + [[ -f ./rocky9-vg-autotest_29599/output//doc.tar.xz ]]
00:38:37.717  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.717  + [[ -f ./rocky9-vg-autotest_29599/output//ut_coverage.tar.xz ]]
00:38:37.717  + tar -C ./rocky9-vg-autotest_29599/output/ -xf ./rocky9-vg-autotest_29599/output//ut_coverage.tar.xz
00:38:37.975  + rm ./rocky9-vg-autotest_29599/output//ut_coverage.tar.xz
00:38:37.975  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.975  + [[ -f ./rocky9-vg-autotest_29599/output//llvm.tar.xz ]]
00:38:37.975  + mv ./rocky9-vg-autotest_29599/output//all_tests.txt ./rocky9-vg-autotest_29599/output//build-pkg-manifest.txt ./rocky9-vg-autotest_29599/output//build-repo-manifest.txt ./rocky9-vg-autotest_29599/output//cov_base.info.xz ./rocky9-vg-autotest_29599/output//cov_test.info.xz ./rocky9-vg-autotest_29599/output//cov_total.info.xz ./rocky9-vg-autotest_29599/output//dmesg.init.log ./rocky9-vg-autotest_29599/output//dmesg.log ./rocky9-vg-autotest_29599/output//power.tar.xz ./rocky9-vg-autotest_29599/output//test_completions.txt ./rocky9-vg-autotest_29599/output//timing.svg ./rocky9-vg-autotest_29599/output//timing.txt ./rocky9-vg-autotest_29599/output//ut_coverage ./rocky9-vg-autotest_29599/output//..
00:38:37.975  + rmdir ./rocky9-vg-autotest_29599/output/
00:38:37.975  + for dir in "${out_dirs[@]}"
00:38:37.975  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.975  + [[ -f ./scan-build-docker-autotest_31656/output//doc.tar.xz ]]
00:38:37.975  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.975  + [[ -f ./scan-build-docker-autotest_31656/output//ut_coverage.tar.xz ]]
00:38:37.975  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.975  + [[ -f ./scan-build-docker-autotest_31656/output//llvm.tar.xz ]]
00:38:37.975  + mv ./scan-build-docker-autotest_31656/output//all_c_files.txt ./scan-build-docker-autotest_31656/output//build_output.txt ./scan-build-docker-autotest_31656/output//build-repo-manifest.txt ./scan-build-docker-autotest_31656/output//built_c_files.txt ./scan-build-docker-autotest_31656/output//power.tar.xz ./scan-build-docker-autotest_31656/output//test_completions.txt ./scan-build-docker-autotest_31656/output//timing.svg ./scan-build-docker-autotest_31656/output//timing.txt ./scan-build-docker-autotest_31656/output//unbuilt_c_files.txt ./scan-build-docker-autotest_31656/output//..
00:38:37.975  + rmdir ./scan-build-docker-autotest_31656/output/
00:38:37.975  + for dir in "${out_dirs[@]}"
00:38:37.975  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.975  + [[ -f ./short-fuzz-phy-autotest_40089/output//doc.tar.xz ]]
00:38:37.975  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.975  + [[ -f ./short-fuzz-phy-autotest_40089/output//ut_coverage.tar.xz ]]
00:38:37.975  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.975  + [[ -f ./short-fuzz-phy-autotest_40089/output//llvm.tar.xz ]]
00:38:37.975  + tar -C ./short-fuzz-phy-autotest_40089/output/ -xf ./short-fuzz-phy-autotest_40089/output//llvm.tar.xz
00:38:37.975  + rm ./short-fuzz-phy-autotest_40089/output//llvm.tar.xz
00:38:37.976  + mv ./short-fuzz-phy-autotest_40089/output//all_tests.txt ./short-fuzz-phy-autotest_40089/output//build-kernel-manifest.txt ./short-fuzz-phy-autotest_40089/output//build-pkg-manifest.txt ./short-fuzz-phy-autotest_40089/output//build-repo-manifest.txt ./short-fuzz-phy-autotest_40089/output//cov_base.info.xz ./short-fuzz-phy-autotest_40089/output//cov_test.info.xz ./short-fuzz-phy-autotest_40089/output//cov_total.info.xz ./short-fuzz-phy-autotest_40089/output//dmesg.init.log ./short-fuzz-phy-autotest_40089/output//dmesg.log ./short-fuzz-phy-autotest_40089/output//llvm ./short-fuzz-phy-autotest_40089/output//power.tar.xz ./short-fuzz-phy-autotest_40089/output//test_completions.txt ./short-fuzz-phy-autotest_40089/output//timing.svg ./short-fuzz-phy-autotest_40089/output//timing.txt ./short-fuzz-phy-autotest_40089/output//..
00:38:37.976  + rmdir ./short-fuzz-phy-autotest_40089/output/
00:38:37.976  + for dir in "${out_dirs[@]}"
00:38:37.976  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.976  + [[ -f ./ubuntu22-vg-autotest_51254/output//doc.tar.xz ]]
00:38:37.976  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:37.976  + [[ -f ./ubuntu22-vg-autotest_51254/output//ut_coverage.tar.xz ]]
00:38:37.976  + tar -C ./ubuntu22-vg-autotest_51254/output/ -xf ./ubuntu22-vg-autotest_51254/output//ut_coverage.tar.xz
00:38:38.233  + rm ./ubuntu22-vg-autotest_51254/output//ut_coverage.tar.xz
00:38:38.233  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:38.233  + [[ -f ./ubuntu22-vg-autotest_51254/output//llvm.tar.xz ]]
00:38:38.233  + mv ./ubuntu22-vg-autotest_51254/output//all_tests.txt ./ubuntu22-vg-autotest_51254/output//build-pkg-manifest.txt ./ubuntu22-vg-autotest_51254/output//build-repo-manifest.txt ./ubuntu22-vg-autotest_51254/output//cov_base.info.xz ./ubuntu22-vg-autotest_51254/output//cov_test.info.xz ./ubuntu22-vg-autotest_51254/output//cov_total.info.xz ./ubuntu22-vg-autotest_51254/output//dmesg.init.log ./ubuntu22-vg-autotest_51254/output//dmesg.log ./ubuntu22-vg-autotest_51254/output//power.tar.xz ./ubuntu22-vg-autotest_51254/output//test_completions.txt ./ubuntu22-vg-autotest_51254/output//timing.svg ./ubuntu22-vg-autotest_51254/output//timing.txt ./ubuntu22-vg-autotest_51254/output//ut_coverage ./ubuntu22-vg-autotest_51254/output//..
00:38:38.233  + rmdir ./ubuntu22-vg-autotest_51254/output/
00:38:38.233  + for dir in "${out_dirs[@]}"
00:38:38.233  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:38.233  + [[ -f ./ubuntu24-vg-autotest_8796/output//doc.tar.xz ]]
00:38:38.233  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:38.233  + [[ -f ./ubuntu24-vg-autotest_8796/output//ut_coverage.tar.xz ]]
00:38:38.233  + tar -C ./ubuntu24-vg-autotest_8796/output/ -xf ./ubuntu24-vg-autotest_8796/output//ut_coverage.tar.xz
00:38:38.233  + rm ./ubuntu24-vg-autotest_8796/output//ut_coverage.tar.xz
00:38:38.233  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:38.233  + [[ -f ./ubuntu24-vg-autotest_8796/output//llvm.tar.xz ]]
00:38:38.234  + mv ./ubuntu24-vg-autotest_8796/output//all_tests.txt ./ubuntu24-vg-autotest_8796/output//build-pkg-manifest.txt ./ubuntu24-vg-autotest_8796/output//build-repo-manifest.txt ./ubuntu24-vg-autotest_8796/output//cov_base.info.xz ./ubuntu24-vg-autotest_8796/output//cov_test.info.xz ./ubuntu24-vg-autotest_8796/output//cov_total.info.xz ./ubuntu24-vg-autotest_8796/output//dmesg.init.log ./ubuntu24-vg-autotest_8796/output//dmesg.log ./ubuntu24-vg-autotest_8796/output//power.tar.xz ./ubuntu24-vg-autotest_8796/output//test_completions.txt ./ubuntu24-vg-autotest_8796/output//timing.svg ./ubuntu24-vg-autotest_8796/output//timing.txt ./ubuntu24-vg-autotest_8796/output//ut_coverage ./ubuntu24-vg-autotest_8796/output//..
00:38:38.234  + rmdir ./ubuntu24-vg-autotest_8796/output/
00:38:38.234  + for dir in "${out_dirs[@]}"
00:38:38.234  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:38.234  + [[ -f ./unittest-clang-docker-autotest_31645/output//doc.tar.xz ]]
00:38:38.234  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:38.234  + [[ -f ./unittest-clang-docker-autotest_31645/output//ut_coverage.tar.xz ]]
00:38:38.234  + tar -C ./unittest-clang-docker-autotest_31645/output/ -xf ./unittest-clang-docker-autotest_31645/output//ut_coverage.tar.xz
00:38:38.800  + rm ./unittest-clang-docker-autotest_31645/output//ut_coverage.tar.xz
00:38:38.800  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:38.800  + [[ -f ./unittest-clang-docker-autotest_31645/output//llvm.tar.xz ]]
00:38:38.800  + mv ./unittest-clang-docker-autotest_31645/output//build-repo-manifest.txt ./unittest-clang-docker-autotest_31645/output//power.tar.xz ./unittest-clang-docker-autotest_31645/output//test_completions.txt ./unittest-clang-docker-autotest_31645/output//timing.svg ./unittest-clang-docker-autotest_31645/output//timing.txt ./unittest-clang-docker-autotest_31645/output//ut_coverage ./unittest-clang-docker-autotest_31645/output//..
00:38:38.800  + rmdir ./unittest-clang-docker-autotest_31645/output/
00:38:38.800  + for dir in "${out_dirs[@]}"
00:38:38.800  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:38.800  + [[ -f ./unittest-main-docker-autotest_31648/output//doc.tar.xz ]]
00:38:38.800  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:38.800  + [[ -f ./unittest-main-docker-autotest_31648/output//ut_coverage.tar.xz ]]
00:38:38.800  + tar -C ./unittest-main-docker-autotest_31648/output/ -xf ./unittest-main-docker-autotest_31648/output//ut_coverage.tar.xz
00:38:39.057  + rm ./unittest-main-docker-autotest_31648/output//ut_coverage.tar.xz
00:38:39.057  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:39.057  + [[ -f ./unittest-main-docker-autotest_31648/output//llvm.tar.xz ]]
00:38:39.057  + mv ./unittest-main-docker-autotest_31648/output//build-repo-manifest.txt ./unittest-main-docker-autotest_31648/output//power.tar.xz ./unittest-main-docker-autotest_31648/output//test_completions.txt ./unittest-main-docker-autotest_31648/output//timing.svg ./unittest-main-docker-autotest_31648/output//timing.txt ./unittest-main-docker-autotest_31648/output//ut_coverage ./unittest-main-docker-autotest_31648/output//..
00:38:39.057  + rmdir ./unittest-main-docker-autotest_31648/output/
00:38:39.057  + for dir in "${out_dirs[@]}"
00:38:39.057  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:39.057  + [[ -f ./unittest-valgrind-docker-autotest_31648/output//doc.tar.xz ]]
00:38:39.057  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:39.057  + [[ -f ./unittest-valgrind-docker-autotest_31648/output//ut_coverage.tar.xz ]]
00:38:39.057  + tar -C ./unittest-valgrind-docker-autotest_31648/output/ -xf ./unittest-valgrind-docker-autotest_31648/output//ut_coverage.tar.xz
00:38:39.350  + rm ./unittest-valgrind-docker-autotest_31648/output//ut_coverage.tar.xz
00:38:39.350  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:39.350  + [[ -f ./unittest-valgrind-docker-autotest_31648/output//llvm.tar.xz ]]
00:38:39.350  + mv ./unittest-valgrind-docker-autotest_31648/output//build-repo-manifest.txt ./unittest-valgrind-docker-autotest_31648/output//power.tar.xz ./unittest-valgrind-docker-autotest_31648/output//test_completions.txt ./unittest-valgrind-docker-autotest_31648/output//timing.svg ./unittest-valgrind-docker-autotest_31648/output//timing.txt ./unittest-valgrind-docker-autotest_31648/output//ut_coverage ./unittest-valgrind-docker-autotest_31648/output//..
00:38:39.350  + rmdir ./unittest-valgrind-docker-autotest_31648/output/
00:38:39.350  + for dir in "${out_dirs[@]}"
00:38:39.350  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:39.350  + [[ -f ./vfio-user-phy-autotest_40093/output//doc.tar.xz ]]
00:38:39.350  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:39.350  + [[ -f ./vfio-user-phy-autotest_40093/output//ut_coverage.tar.xz ]]
00:38:39.350  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:39.350  + [[ -f ./vfio-user-phy-autotest_40093/output//llvm.tar.xz ]]
00:38:39.350  + mv ./vfio-user-phy-autotest_40093/output//all_tests.txt ./vfio-user-phy-autotest_40093/output//build-kernel-manifest.txt ./vfio-user-phy-autotest_40093/output//build-pkg-manifest.txt ./vfio-user-phy-autotest_40093/output//build-repo-manifest.txt ./vfio-user-phy-autotest_40093/output//cov_base.info.xz ./vfio-user-phy-autotest_40093/output//cov_test.info.xz ./vfio-user-phy-autotest_40093/output//cov_total.info.xz ./vfio-user-phy-autotest_40093/output//dmesg.init.log ./vfio-user-phy-autotest_40093/output//dmesg.log ./vfio-user-phy-autotest_40093/output//power.tar.xz ./vfio-user-phy-autotest_40093/output//test_completions.txt ./vfio-user-phy-autotest_40093/output//timing.svg ./vfio-user-phy-autotest_40093/output//timing.txt ./vfio-user-phy-autotest_40093/output//..
00:38:39.350  + rmdir ./vfio-user-phy-autotest_40093/output/
00:38:39.350  + for dir in "${out_dirs[@]}"
00:38:39.350  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:39.350  + [[ -f ./vhost-initiator-vg-autotest_92539/output//doc.tar.xz ]]
00:38:39.351  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:39.351  + [[ -f ./vhost-initiator-vg-autotest_92539/output//ut_coverage.tar.xz ]]
00:38:39.351  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:39.351  + [[ -f ./vhost-initiator-vg-autotest_92539/output//llvm.tar.xz ]]
00:38:39.351  + mv ./vhost-initiator-vg-autotest_92539/output//all_tests.txt ./vhost-initiator-vg-autotest_92539/output//build-kernel-manifest.txt ./vhost-initiator-vg-autotest_92539/output//build-pkg-manifest.txt ./vhost-initiator-vg-autotest_92539/output//build-repo-manifest.txt ./vhost-initiator-vg-autotest_92539/output//cov_base.info.xz ./vhost-initiator-vg-autotest_92539/output//cov_test.info.xz ./vhost-initiator-vg-autotest_92539/output//cov_total.info.xz ./vhost-initiator-vg-autotest_92539/output//dmesg.init.log ./vhost-initiator-vg-autotest_92539/output//dmesg.log ./vhost-initiator-vg-autotest_92539/output//power.tar.xz ./vhost-initiator-vg-autotest_92539/output//test_completions.txt ./vhost-initiator-vg-autotest_92539/output//timing.svg ./vhost-initiator-vg-autotest_92539/output//timing.txt ./vhost-initiator-vg-autotest_92539/output//vhost_fuzz_output1.txt.xz ./vhost-initiator-vg-autotest_92539/output//vhost_fuzz_output2.txt.xz ./vhost-initiator-vg-autotest_92539/output//vhost_fuzz_tgt_output.txt.xz ./vhost-initiator-vg-autotest_92539/output//..
00:38:39.351  + rmdir ./vhost-initiator-vg-autotest_92539/output/
00:38:39.351  + for dir in "${out_dirs[@]}"
00:38:39.351  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:39.351  + [[ -f ./vhost-phy-autotest_40159/output//doc.tar.xz ]]
00:38:39.351  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:39.351  + [[ -f ./vhost-phy-autotest_40159/output//ut_coverage.tar.xz ]]
00:38:39.351  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:39.351  + [[ -f ./vhost-phy-autotest_40159/output//llvm.tar.xz ]]
00:38:39.351  + mv ./vhost-phy-autotest_40159/output//all_tests.txt ./vhost-phy-autotest_40159/output//build-kernel-manifest.txt ./vhost-phy-autotest_40159/output//build-pkg-manifest.txt ./vhost-phy-autotest_40159/output//build-repo-manifest.txt ./vhost-phy-autotest_40159/output//cov_base.info.xz ./vhost-phy-autotest_40159/output//cov_test.info.xz ./vhost-phy-autotest_40159/output//cov_total.info.xz ./vhost-phy-autotest_40159/output//dmesg.init.log ./vhost-phy-autotest_40159/output//dmesg.log ./vhost-phy-autotest_40159/output//nvmf_trace.0_shm.tar.gz ./vhost-phy-autotest_40159/output//power.tar.xz ./vhost-phy-autotest_40159/output//test_completions.txt ./vhost-phy-autotest_40159/output//timing.svg ./vhost-phy-autotest_40159/output//timing.txt ./vhost-phy-autotest_40159/output//..
00:38:39.351  + rmdir ./vhost-phy-autotest_40159/output/
00:38:39.351  + for dir in "${out_dirs[@]}"
00:38:39.351  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:39.351  + [[ -f ./vmd-phy-autotest_6438/output//doc.tar.xz ]]
00:38:39.351  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:39.351  + [[ -f ./vmd-phy-autotest_6438/output//ut_coverage.tar.xz ]]
00:38:39.351  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:39.351  + [[ -f ./vmd-phy-autotest_6438/output//llvm.tar.xz ]]
00:38:39.351  + mv ./vmd-phy-autotest_6438/output//all_tests.txt ./vmd-phy-autotest_6438/output//build-kernel-manifest.txt ./vmd-phy-autotest_6438/output//build-pkg-manifest.txt ./vmd-phy-autotest_6438/output//build-repo-manifest.txt ./vmd-phy-autotest_6438/output//cov_base.info.xz ./vmd-phy-autotest_6438/output//cov_test.info.xz ./vmd-phy-autotest_6438/output//cov_total.info.xz ./vmd-phy-autotest_6438/output//dmesg.init.log ./vmd-phy-autotest_6438/output//dmesg.log ./vmd-phy-autotest_6438/output//power.tar.xz ./vmd-phy-autotest_6438/output//test_completions.txt ./vmd-phy-autotest_6438/output//timing.svg ./vmd-phy-autotest_6438/output//timing.txt ./vmd-phy-autotest_6438/output//..
00:38:39.351  + rmdir ./vmd-phy-autotest_6438/output/
00:38:39.351  + for dir in "${out_dirs[@]}"
00:38:39.351  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:39.351  + [[ -f ./zns-vg-autotest_91612/output//doc.tar.xz ]]
00:38:39.351  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:39.351  + [[ -f ./zns-vg-autotest_91612/output//ut_coverage.tar.xz ]]
00:38:39.351  + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz
00:38:39.351  + [[ -f ./zns-vg-autotest_91612/output//llvm.tar.xz ]]
00:38:39.351  + mv ./zns-vg-autotest_91612/output//all_tests.txt ./zns-vg-autotest_91612/output//build-kernel-manifest.txt ./zns-vg-autotest_91612/output//build-pkg-manifest.txt ./zns-vg-autotest_91612/output//build-repo-manifest.txt ./zns-vg-autotest_91612/output//cov_base.info.xz ./zns-vg-autotest_91612/output//cov_test.info.xz ./zns-vg-autotest_91612/output//cov_total.info.xz ./zns-vg-autotest_91612/output//dmesg.init.log ./zns-vg-autotest_91612/output//dmesg.log ./zns-vg-autotest_91612/output//power.tar.xz ./zns-vg-autotest_91612/output//test_completions.txt ./zns-vg-autotest_91612/output//timing.svg ./zns-vg-autotest_91612/output//timing.txt ./zns-vg-autotest_91612/output//..
00:38:39.351  + rmdir ./zns-vg-autotest_91612/output/
00:38:39.351  + unpack_cov_files
00:38:39.351  + local info_files
00:38:39.351  + info_files=(*/cov_*.info.xz)
00:38:39.351  + xargs -P0 -r -n1 xz -d
00:38:39.351  + printf '%s\n' BlobFS-phy-autotest_40100/cov_base.info.xz BlobFS-phy-autotest_40100/cov_test.info.xz BlobFS-phy-autotest_40100/cov_total.info.xz crypto-phy-autotest_40095/cov_base.info.xz crypto-phy-autotest_40095/cov_test.info.xz crypto-phy-autotest_40095/cov_total.info.xz iscsi-uring-vg-autotest_92417/cov_base.info.xz iscsi-uring-vg-autotest_92417/cov_test.info.xz iscsi-uring-vg-autotest_92417/cov_total.info.xz iscsi-vg-autotest_92552/cov_base.info.xz iscsi-vg-autotest_92552/cov_test.info.xz iscsi-vg-autotest_92552/cov_total.info.xz lvol-vg-autotest_92462/cov_base.info.xz lvol-vg-autotest_92462/cov_test.info.xz lvol-vg-autotest_92462/cov_total.info.xz nvme-cmb-pmr-vg-autotest_93642/cov_base.info.xz nvme-cmb-pmr-vg-autotest_93642/cov_test.info.xz nvme-cmb-pmr-vg-autotest_93642/cov_total.info.xz nvme-phy-autotest_86277/cov_base.info.xz nvme-phy-autotest_86277/cov_test.info.xz nvme-phy-autotest_86277/cov_total.info.xz nvme-vg-autotest_92517/cov_base.info.xz nvme-vg-autotest_92517/cov_test.info.xz nvme-vg-autotest_92517/cov_total.info.xz nvmf-phy-autotest_86336/cov_base.info.xz nvmf-phy-autotest_86336/cov_test.info.xz nvmf-phy-autotest_86336/cov_total.info.xz nvmf-tcp-phy-autotest_86218/cov_base.info.xz nvmf-tcp-uring-vg-autotest_92459/cov_base.info.xz nvmf-tcp-vg-autotest_92494/cov_base.info.xz nvmf-tcp-vg-autotest_92494/cov_test.info.xz nvmf-tcp-vg-autotest_92494/cov_total.info.xz raid-vg-autotest_6908/cov_base.info.xz raid-vg-autotest_6908/cov_test.info.xz raid-vg-autotest_6908/cov_total.info.xz rocky9-vg-autotest_29599/cov_base.info.xz rocky9-vg-autotest_29599/cov_test.info.xz rocky9-vg-autotest_29599/cov_total.info.xz short-fuzz-phy-autotest_40089/cov_base.info.xz short-fuzz-phy-autotest_40089/cov_test.info.xz short-fuzz-phy-autotest_40089/cov_total.info.xz ubuntu22-vg-autotest_51254/cov_base.info.xz ubuntu22-vg-autotest_51254/cov_test.info.xz ubuntu22-vg-autotest_51254/cov_total.info.xz ubuntu24-vg-autotest_8796/cov_base.info.xz ubuntu24-vg-autotest_8796/cov_test.info.xz ubuntu24-vg-autotest_8796/cov_total.info.xz vfio-user-phy-autotest_40093/cov_base.info.xz vfio-user-phy-autotest_40093/cov_test.info.xz vfio-user-phy-autotest_40093/cov_total.info.xz vhost-initiator-vg-autotest_92539/cov_base.info.xz vhost-initiator-vg-autotest_92539/cov_test.info.xz vhost-initiator-vg-autotest_92539/cov_total.info.xz vhost-phy-autotest_40159/cov_base.info.xz vhost-phy-autotest_40159/cov_test.info.xz vhost-phy-autotest_40159/cov_total.info.xz vmd-phy-autotest_6438/cov_base.info.xz vmd-phy-autotest_6438/cov_test.info.xz vmd-phy-autotest_6438/cov_total.info.xz zns-vg-autotest_91612/cov_base.info.xz zns-vg-autotest_91612/cov_test.info.xz zns-vg-autotest_91612/cov_total.info.xz
00:38:39.943  + fix_downstream_job_paths
00:38:39.943  + sed -i -e 's#^SF:/.\+/spdk/#SF:/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/#g' BlobFS-phy-autotest_40100/cov_total.info crypto-phy-autotest_40095/cov_total.info iscsi-uring-vg-autotest_92417/cov_total.info iscsi-vg-autotest_92552/cov_total.info lvol-vg-autotest_92462/cov_total.info nvme-cmb-pmr-vg-autotest_93642/cov_total.info nvme-phy-autotest_86277/cov_total.info nvme-vg-autotest_92517/cov_total.info nvmf-phy-autotest_86336/cov_total.info nvmf-tcp-vg-autotest_92494/cov_total.info raid-vg-autotest_6908/cov_total.info rocky9-vg-autotest_29599/cov_total.info short-fuzz-phy-autotest_40089/cov_total.info ubuntu22-vg-autotest_51254/cov_total.info ubuntu24-vg-autotest_8796/cov_total.info vfio-user-phy-autotest_40093/cov_total.info vhost-initiator-vg-autotest_92539/cov_total.info vhost-phy-autotest_40159/cov_total.info vmd-phy-autotest_6438/cov_total.info zns-vg-autotest_91612/cov_total.info
00:38:40.877  + ignore_ocf_headers
00:38:40.877  + sed -i 's#--show-details#--show-details --ignore-errors source#g' spdk/autorun_post.py
00:38:40.877  + create_errtrace_files_for_all_builds
00:38:40.877  + local build_log_list
00:38:40.877  + build_log_list=($(find "$WORKSPACE" -type f -name 'build.log'))
00:38:40.877  ++ find /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11 -type f -name build.log
00:38:41.138  + for build in "${build_log_list[@]}"
00:38:41.138  + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-phy-autotest_86277/build.log
00:38:41.138  + local build_log job_name start_pattern end_pattern backtraces
00:38:41.138  + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-phy-autotest_86277/build.log
00:38:41.138  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-phy-autotest_86277/build.log
00:38:41.138  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-phy-autotest_86277
00:38:41.138  + job_name=nvme-phy-autotest_86277
00:38:41.138  + start_pattern='Backtrace start'
00:38:41.138  + end_pattern='Backtrace end'
00:38:41.138  + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-phy-autotest_86277/build.log ]]
00:38:41.138  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-phy-autotest_86277/build.log
00:38:41.138  + backtraces=
00:38:41.138  + [[ -n '' ]]
00:38:41.138  + for build in "${build_log_list[@]}"
00:38:41.138  + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/crypto-phy-autotest_40095/build.log
00:38:41.138  + local build_log job_name start_pattern end_pattern backtraces
00:38:41.138  + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/crypto-phy-autotest_40095/build.log
00:38:41.138  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/crypto-phy-autotest_40095/build.log
00:38:41.138  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/crypto-phy-autotest_40095
00:38:41.138  + job_name=crypto-phy-autotest_40095
00:38:41.138  + start_pattern='Backtrace start'
00:38:41.138  + end_pattern='Backtrace end'
00:38:41.138  + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/crypto-phy-autotest_40095/build.log ]]
00:38:41.138  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/crypto-phy-autotest_40095/build.log
00:38:41.138  + backtraces=
00:38:41.138  + [[ -n '' ]]
00:38:41.138  + for build in "${build_log_list[@]}"
00:38:41.138  + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-vg-autotest_92517/build.log
00:38:41.138  + local build_log job_name start_pattern end_pattern backtraces
00:38:41.138  + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-vg-autotest_92517/build.log
00:38:41.138  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-vg-autotest_92517/build.log
00:38:41.138  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-vg-autotest_92517
00:38:41.138  + job_name=nvme-vg-autotest_92517
00:38:41.138  + start_pattern='Backtrace start'
00:38:41.138  + end_pattern='Backtrace end'
00:38:41.138  + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-vg-autotest_92517/build.log ]]
00:38:41.138  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-vg-autotest_92517/build.log
00:38:41.138  + backtraces=
00:38:41.138  + [[ -n '' ]]
00:38:41.138  + for build in "${build_log_list[@]}"
00:38:41.138  + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-valgrind-docker-autotest_31648/build.log
00:38:41.138  + local build_log job_name start_pattern end_pattern backtraces
00:38:41.138  + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-valgrind-docker-autotest_31648/build.log
00:38:41.138  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-valgrind-docker-autotest_31648/build.log
00:38:41.138  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-valgrind-docker-autotest_31648
00:38:41.138  + job_name=unittest-valgrind-docker-autotest_31648
00:38:41.138  + start_pattern='Backtrace start'
00:38:41.138  + end_pattern='Backtrace end'
00:38:41.138  + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-valgrind-docker-autotest_31648/build.log ]]
00:38:41.138  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-valgrind-docker-autotest_31648/build.log
00:38:41.138  + backtraces=
00:38:41.138  + [[ -n '' ]]
00:38:41.138  + for build in "${build_log_list[@]}"
00:38:41.138  + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/check-so-deps-docker-autotest_35218/build.log
00:38:41.138  + local build_log job_name start_pattern end_pattern backtraces
00:38:41.138  + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/check-so-deps-docker-autotest_35218/build.log
00:38:41.138  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/check-so-deps-docker-autotest_35218/build.log
00:38:41.138  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/check-so-deps-docker-autotest_35218
00:38:41.138  + job_name=check-so-deps-docker-autotest_35218
00:38:41.138  + start_pattern='Backtrace start'
00:38:41.138  + end_pattern='Backtrace end'
00:38:41.138  + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/check-so-deps-docker-autotest_35218/build.log ]]
00:38:41.138  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/check-so-deps-docker-autotest_35218/build.log
00:38:41.138  + backtraces=
00:38:41.138  + [[ -n '' ]]
00:38:41.138  + for build in "${build_log_list[@]}"
00:38:41.138  + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-uring-vg-autotest_92459/build.log
00:38:41.138  + local build_log job_name start_pattern end_pattern backtraces
00:38:41.138  + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-uring-vg-autotest_92459/build.log
00:38:41.138  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-uring-vg-autotest_92459/build.log
00:38:41.138  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-uring-vg-autotest_92459
00:38:41.138  + job_name=nvmf-tcp-uring-vg-autotest_92459
00:38:41.138  + start_pattern='Backtrace start'
00:38:41.138  + end_pattern='Backtrace end'
00:38:41.138  + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-uring-vg-autotest_92459/build.log ]]
00:38:41.138  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-uring-vg-autotest_92459/build.log
00:38:41.138  + backtraces='00:23:55.667  ========== Backtrace start: ==========
00:38:41.138  00:23:55.667  
00:38:41.138  00:23:55.667  in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1354 -> fio_plugin(["/home/vagrant/spdk_repo/spdk/build/fio/spdk_bdev"],["--ioengine=spdk_bdev"],["--spdk_json_conf"],["/dev/fd/62"],["/dev/fd/61"])
00:38:41.138  00:23:55.667       ...
00:38:41.138  00:23:55.667     1349				break
00:38:41.138  00:23:55.667     1350			fi
00:38:41.138  00:23:55.667     1351		done
00:38:41.138  00:23:55.667     1352	
00:38:41.138  00:23:55.667     1353		# Preload the sanitizer library to fio if fio_plugin was compiled with it
00:38:41.138  00:23:55.667     1354		LD_PRELOAD="$asan_lib $plugin" "$fio_dir"/fio "$@"
00:38:41.138  00:23:55.667     1355	}
00:38:41.138  00:23:55.667     1356	
00:38:41.138  00:23:55.667     1357	function fio_bdev() {
00:38:41.138  00:23:55.667     1358		fio_plugin "$rootdir/build/fio/spdk_bdev" "$@"
00:38:41.138  00:23:55.667     1359	}
00:38:41.138  00:23:55.667       ...
00:38:41.138  00:23:55.667  in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1358 -> fio_bdev(["--ioengine=spdk_bdev"],["--spdk_json_conf"],["/dev/fd/62"],["/dev/fd/61"])
00:38:41.138  00:23:55.667       ...
00:38:41.138  00:23:55.667     1353		# Preload the sanitizer library to fio if fio_plugin was compiled with it
00:38:41.138  00:23:55.667     1354		LD_PRELOAD="$asan_lib $plugin" "$fio_dir"/fio "$@"
00:38:41.138  00:23:55.667     1355	}
00:38:41.138  00:23:55.667     1356	
00:38:41.138  00:23:55.667     1357	function fio_bdev() {
00:38:41.138  00:23:55.667     1358		fio_plugin "$rootdir/build/fio/spdk_bdev" "$@"
00:38:41.138  00:23:55.667     1359	}
00:38:41.138  00:23:55.667     1360	
00:38:41.138  00:23:55.667     1361	function fio_nvme() {
00:38:41.138  00:23:55.667     1362		fio_plugin "$rootdir/build/fio/spdk_nvme" "$@"
00:38:41.138  00:23:55.667     1363	}
00:38:41.138  00:23:55.667       ...
00:38:41.138  00:23:55.667  in /home/vagrant/spdk_repo/spdk/test/nvmf/target/dif.sh:82 -> fio(["/dev/fd/62"])
00:38:41.138  00:23:55.667       ...
00:38:41.138  00:23:55.667     77  			FIO
00:38:41.138  00:23:55.667     78  		done
00:38:41.138  00:23:55.667     79  	}
00:38:41.138  00:23:55.667     80  	
00:38:41.138  00:23:55.667     81  	fio() {
00:38:41.138  00:23:55.667  => 82  		fio_bdev --ioengine=spdk_bdev --spdk_json_conf "$@" <(gen_fio_conf)
00:38:41.138  00:23:55.667     83  	}
00:38:41.138  00:23:55.667     84  	
00:38:41.138  00:23:55.667     85  	fio_dif_1() {
00:38:41.138  00:23:55.667     86  		create_subsystems 0
00:38:41.138  00:23:55.667     87  		fio <(create_json_sub_conf 0)
00:38:41.138  00:23:55.667       ...
00:38:41.138  00:23:55.667  in /home/vagrant/spdk_repo/spdk/test/nvmf/target/dif.sh:112 -> fio_dif_rand_params([])
00:38:41.138  00:23:55.667       ...
00:38:41.138  00:23:55.667     107 		destroy_subsystems 0
00:38:41.138  00:23:55.667     108 	
00:38:41.138  00:23:55.667     109 		NULL_DIF=2 bs=4k numjobs=8 iodepth=16 runtime="" files=2
00:38:41.138  00:23:55.667     110 	
00:38:41.138  00:23:55.667     111 		create_subsystems 0 1 2
00:38:41.138  00:23:55.667  => 112 		fio <(create_json_sub_conf 0 1 2)
00:38:41.138  00:23:55.667     113 		destroy_subsystems 0 1 2
00:38:41.138  00:23:55.667     114 	
00:38:41.138  00:23:55.667     115 		NULL_DIF=1 bs=8k,16k,128k numjobs=2 iodepth=8 runtime=5 files=1
00:38:41.138  00:23:55.667     116 	
00:38:41.138  00:23:55.667     117 		create_subsystems 0 1
00:38:41.138  00:23:55.667       ...
00:38:41.138  00:23:55.667  in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1127 -> run_test(["fio_dif_rand_params"],["fio_dif_rand_params"])
00:38:41.138  00:23:55.667       ...
00:38:41.138  00:23:55.667     1122		timing_enter $test_name
00:38:41.138  00:23:55.667     1123		echo "************************************"
00:38:41.138  00:23:55.667     1124		echo "START TEST $test_name"
00:38:41.138  00:23:55.667     1125		echo "************************************"
00:38:41.138  00:23:55.667     1126		xtrace_restore
00:38:41.138  00:23:55.667     1127		time "$@"
00:38:41.138  00:23:55.667     1128		xtrace_disable
00:38:41.138  00:23:55.667     1129		echo "************************************"
00:38:41.139  00:23:55.667     1130		echo "END TEST $test_name"
00:38:41.139  00:23:55.667     1131		echo "************************************"
00:38:41.139  00:23:55.667     1132		timing_exit $test_name
00:38:41.139  00:23:55.667       ...
00:38:41.139  00:23:55.667  in /home/vagrant/spdk_repo/spdk/test/nvmf/target/dif.sh:143 -> main(["--transport=tcp"],["--iso"])
00:38:41.139  00:23:55.667       ...
00:38:41.139  00:23:55.667     138 	
00:38:41.139  00:23:55.667     139 	create_transport
00:38:41.139  00:23:55.667     140 	
00:38:41.139  00:23:55.667     141 	run_test "fio_dif_1_default" fio_dif_1
00:38:41.139  00:23:55.667     142 	run_test "fio_dif_1_multi_subsystems" fio_dif_1_multi_subsystems
00:38:41.139  00:23:55.667  => 143 	run_test "fio_dif_rand_params" fio_dif_rand_params
00:38:41.139  00:23:55.667     144 	run_test "fio_dif_digest" fio_dif_digest
00:38:41.139  00:23:55.667     145 	
00:38:41.139  00:23:55.667     146 	trap - SIGINT SIGTERM EXIT
00:38:41.139  00:23:55.667     147 	nvmftestfini
00:38:41.139  00:23:55.667       ...
00:38:41.139  00:23:55.667  
00:38:41.139  00:23:55.667  ========== Backtrace end ==========
00:38:41.139  00:23:55.668  ========== Backtrace start: ==========
00:38:41.139  00:23:55.668  
00:38:41.139  00:23:55.668  in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1127 -> run_test(["nvmf_dif"],["/home/vagrant/spdk_repo/spdk/test/nvmf/target/dif.sh"])
00:38:41.139  00:23:55.668       ...
00:38:41.139  00:23:55.668     1122		timing_enter $test_name
00:38:41.139  00:23:55.668     1123		echo "************************************"
00:38:41.139  00:23:55.668     1124		echo "START TEST $test_name"
00:38:41.139  00:23:55.668     1125		echo "************************************"
00:38:41.139  00:23:55.668     1126		xtrace_restore
00:38:41.139  00:23:55.668     1127		time "$@"
00:38:41.139  00:23:55.668     1128		xtrace_disable
00:38:41.139  00:23:55.668     1129		echo "************************************"
00:38:41.139  00:23:55.668     1130		echo "END TEST $test_name"
00:38:41.139  00:23:55.668     1131		echo "************************************"
00:38:41.139  00:23:55.668     1132		timing_exit $test_name
00:38:41.139  00:23:55.668       ...
00:38:41.139  00:23:55.668  in /home/vagrant/spdk_repo/spdk/autotest.sh:285 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"])
00:38:41.139  00:23:55.668       ...
00:38:41.139  00:23:55.668     280 				run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT
00:38:41.139  00:23:55.668     281 				if [[ $SPDK_TEST_URING -eq 0 ]]; then
00:38:41.139  00:23:55.668     282 					run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT
00:38:41.139  00:23:55.668     283 					run_test "nvmf_identify_passthru" $rootdir/test/nvmf/target/identify_passthru.sh --transport=$SPDK_TEST_NVMF_TRANSPORT
00:38:41.139  00:23:55.668     284 				fi
00:38:41.139  00:23:55.668  => 285 				run_test "nvmf_dif" $rootdir/test/nvmf/target/dif.sh
00:38:41.139  00:23:55.668     286 				run_test "nvmf_abort_qd_sizes" $rootdir/test/nvmf/target/abort_qd_sizes.sh
00:38:41.139  00:23:55.668     287 				# The keyring tests utilize NVMe/TLS
00:38:41.139  00:23:55.668     288 				run_test "keyring_file" "$rootdir/test/keyring/file.sh"
00:38:41.139  00:23:55.668     289 				if [[ "$CONFIG_HAVE_KEYUTILS" == y ]]; then
00:38:41.139  00:23:55.668     290 					run_test "keyring_linux" "$rootdir/scripts/keyctl-session-wrapper" \
00:38:41.139  00:23:55.668       ...
00:38:41.139  00:23:55.668  
00:38:41.139  00:23:55.668  ========== Backtrace end ==========
00:38:41.139  00:24:09.482  ========== Backtrace start: ==========
00:38:41.139  00:24:09.482  
00:38:41.139  00:24:09.482  in spdk/autorun.sh:27 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"])
00:38:41.139  00:24:09.482       ...
00:38:41.139  00:24:09.482     22  	trap '\''timing_finish || exit 1'\'' EXIT
00:38:41.139  00:24:09.482     23  	
00:38:41.139  00:24:09.482     24  	# Runs agent scripts
00:38:41.139  00:24:09.482     25  	$rootdir/autobuild.sh "$conf"
00:38:41.139  00:24:09.482     26  	if ((SPDK_TEST_UNITTEST == 1 || SPDK_RUN_FUNCTIONAL_TEST == 1)); then
00:38:41.139  00:24:09.482  => 27  		sudo -E $rootdir/autotest.sh "$conf"
00:38:41.139  00:24:09.482     28  	fi
00:38:41.139  00:24:09.483       ...
00:38:41.139  00:24:09.483  
00:38:41.139  00:24:09.483  ========== Backtrace end =========='
00:38:41.139  + [[ -n 00:23:55.667  ========== Backtrace start: ==========
00:38:41.139  00:23:55.667  
00:38:41.139  00:23:55.667  in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1354 -> fio_plugin(["/home/vagrant/spdk_repo/spdk/build/fio/spdk_bdev"],["--ioengine=spdk_bdev"],["--spdk_json_conf"],["/dev/fd/62"],["/dev/fd/61"])
00:38:41.139  00:23:55.667       ...
00:38:41.139  00:23:55.667     1349				break
00:38:41.139  00:23:55.667     1350			fi
00:38:41.139  00:23:55.667     1351		done
00:38:41.139  00:23:55.667     1352	
00:38:41.139  00:23:55.667     1353		# Preload the sanitizer library to fio if fio_plugin was compiled with it
00:38:41.139  00:23:55.667     1354		LD_PRELOAD="$asan_lib $plugin" "$fio_dir"/fio "$@"
00:38:41.139  00:23:55.667     1355	}
00:38:41.139  00:23:55.667     1356	
00:38:41.139  00:23:55.667     1357	function fio_bdev() {
00:38:41.139  00:23:55.667     1358		fio_plugin "$rootdir/build/fio/spdk_bdev" "$@"
00:38:41.139  00:23:55.667     1359	}
00:38:41.139  00:23:55.667       ...
00:38:41.139  00:23:55.667  in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1358 -> fio_bdev(["--ioengine=spdk_bdev"],["--spdk_json_conf"],["/dev/fd/62"],["/dev/fd/61"])
00:38:41.139  00:23:55.667       ...
00:38:41.139  00:23:55.667     1353		# Preload the sanitizer library to fio if fio_plugin was compiled with it
00:38:41.139  00:23:55.667     1354		LD_PRELOAD="$asan_lib $plugin" "$fio_dir"/fio "$@"
00:38:41.139  00:23:55.667     1355	}
00:38:41.139  00:23:55.667     1356	
00:38:41.139  00:23:55.667     1357	function fio_bdev() {
00:38:41.139  00:23:55.667     1358		fio_plugin "$rootdir/build/fio/spdk_bdev" "$@"
00:38:41.139  00:23:55.667     1359	}
00:38:41.139  00:23:55.667     1360	
00:38:41.139  00:23:55.667     1361	function fio_nvme() {
00:38:41.139  00:23:55.667     1362		fio_plugin "$rootdir/build/fio/spdk_nvme" "$@"
00:38:41.139  00:23:55.667     1363	}
00:38:41.139  00:23:55.667       ...
00:38:41.139  00:23:55.667  in /home/vagrant/spdk_repo/spdk/test/nvmf/target/dif.sh:82 -> fio(["/dev/fd/62"])
00:38:41.139  00:23:55.667       ...
00:38:41.139  00:23:55.667     77  			FIO
00:38:41.139  00:23:55.667     78  		done
00:38:41.139  00:23:55.667     79  	}
00:38:41.139  00:23:55.667     80  	
00:38:41.139  00:23:55.667     81  	fio() {
00:38:41.139  00:23:55.667  => 82  		fio_bdev --ioengine=spdk_bdev --spdk_json_conf "$@" <(gen_fio_conf)
00:38:41.139  00:23:55.667     83  	}
00:38:41.139  00:23:55.667     84  	
00:38:41.139  00:23:55.667     85  	fio_dif_1() {
00:38:41.139  00:23:55.667     86  		create_subsystems 0
00:38:41.139  00:23:55.667     87  		fio <(create_json_sub_conf 0)
00:38:41.139  00:23:55.667       ...
00:38:41.139  00:23:55.667  in /home/vagrant/spdk_repo/spdk/test/nvmf/target/dif.sh:112 -> fio_dif_rand_params([])
00:38:41.139  00:23:55.667       ...
00:38:41.139  00:23:55.667     107 		destroy_subsystems 0
00:38:41.139  00:23:55.667     108 	
00:38:41.139  00:23:55.667     109 		NULL_DIF=2 bs=4k numjobs=8 iodepth=16 runtime="" files=2
00:38:41.139  00:23:55.667     110 	
00:38:41.139  00:23:55.667     111 		create_subsystems 0 1 2
00:38:41.139  00:23:55.667  => 112 		fio <(create_json_sub_conf 0 1 2)
00:38:41.139  00:23:55.667     113 		destroy_subsystems 0 1 2
00:38:41.139  00:23:55.667     114 	
00:38:41.139  00:23:55.667     115 		NULL_DIF=1 bs=8k,16k,128k numjobs=2 iodepth=8 runtime=5 files=1
00:38:41.139  00:23:55.667     116 	
00:38:41.139  00:23:55.667     117 		create_subsystems 0 1
00:38:41.139  00:23:55.667       ...
00:38:41.139  00:23:55.667  in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1127 -> run_test(["fio_dif_rand_params"],["fio_dif_rand_params"])
00:38:41.139  00:23:55.667       ...
00:38:41.139  00:23:55.667     1122		timing_enter $test_name
00:38:41.139  00:23:55.667     1123		echo "************************************"
00:38:41.139  00:23:55.667     1124		echo "START TEST $test_name"
00:38:41.139  00:23:55.667     1125		echo "************************************"
00:38:41.139  00:23:55.667     1126		xtrace_restore
00:38:41.139  00:23:55.667     1127		time "$@"
00:38:41.139  00:23:55.667     1128		xtrace_disable
00:38:41.139  00:23:55.667     1129		echo "************************************"
00:38:41.139  00:23:55.667     1130		echo "END TEST $test_name"
00:38:41.139  00:23:55.667     1131		echo "************************************"
00:38:41.139  00:23:55.667     1132		timing_exit $test_name
00:38:41.139  00:23:55.667       ...
00:38:41.139  00:23:55.667  in /home/vagrant/spdk_repo/spdk/test/nvmf/target/dif.sh:143 -> main(["--transport=tcp"],["--iso"])
00:38:41.139  00:23:55.667       ...
00:38:41.139  00:23:55.667     138 	
00:38:41.139  00:23:55.667     139 	create_transport
00:38:41.139  00:23:55.667     140 	
00:38:41.139  00:23:55.667     141 	run_test "fio_dif_1_default" fio_dif_1
00:38:41.139  00:23:55.667     142 	run_test "fio_dif_1_multi_subsystems" fio_dif_1_multi_subsystems
00:38:41.139  00:23:55.667  => 143 	run_test "fio_dif_rand_params" fio_dif_rand_params
00:38:41.139  00:23:55.667     144 	run_test "fio_dif_digest" fio_dif_digest
00:38:41.139  00:23:55.667     145 	
00:38:41.139  00:23:55.667     146 	trap - SIGINT SIGTERM EXIT
00:38:41.139  00:23:55.667     147 	nvmftestfini
00:38:41.139  00:23:55.667       ...
00:38:41.139  00:23:55.667  
00:38:41.139  00:23:55.667  ========== Backtrace end ==========
00:38:41.139  00:23:55.668  ========== Backtrace start: ==========
00:38:41.139  00:23:55.668  
00:38:41.139  00:23:55.668  in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1127 -> run_test(["nvmf_dif"],["/home/vagrant/spdk_repo/spdk/test/nvmf/target/dif.sh"])
00:38:41.139  00:23:55.668       ...
00:38:41.139  00:23:55.668     1122		timing_enter $test_name
00:38:41.139  00:23:55.668     1123		echo "************************************"
00:38:41.139  00:23:55.668     1124		echo "START TEST $test_name"
00:38:41.139  00:23:55.668     1125		echo "************************************"
00:38:41.139  00:23:55.668     1126		xtrace_restore
00:38:41.139  00:23:55.668     1127		time "$@"
00:38:41.139  00:23:55.668     1128		xtrace_disable
00:38:41.139  00:23:55.668     1129		echo "************************************"
00:38:41.139  00:23:55.668     1130		echo "END TEST $test_name"
00:38:41.139  00:23:55.668     1131		echo "************************************"
00:38:41.139  00:23:55.668     1132		timing_exit $test_name
00:38:41.139  00:23:55.668       ...
00:38:41.139  00:23:55.668  in /home/vagrant/spdk_repo/spdk/autotest.sh:285 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"])
00:38:41.139  00:23:55.668       ...
00:38:41.139  00:23:55.668     280 				run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT
00:38:41.139  00:23:55.668     281 				if [[ $SPDK_TEST_URING -eq 0 ]]; then
00:38:41.139  00:23:55.668     282 					run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT
00:38:41.139  00:23:55.668     283 					run_test "nvmf_identify_passthru" $rootdir/test/nvmf/target/identify_passthru.sh --transport=$SPDK_TEST_NVMF_TRANSPORT
00:38:41.139  00:23:55.668     284 				fi
00:38:41.139  00:23:55.668  => 285 				run_test "nvmf_dif" $rootdir/test/nvmf/target/dif.sh
00:38:41.139  00:23:55.668     286 				run_test "nvmf_abort_qd_sizes" $rootdir/test/nvmf/target/abort_qd_sizes.sh
00:38:41.139  00:23:55.668     287 				# The keyring tests utilize NVMe/TLS
00:38:41.139  00:23:55.668     288 				run_test "keyring_file" "$rootdir/test/keyring/file.sh"
00:38:41.140  00:23:55.668     289 				if [[ "$CONFIG_HAVE_KEYUTILS" == y ]]; then
00:38:41.140  00:23:55.668     290 					run_test "keyring_linux" "$rootdir/scripts/keyctl-session-wrapper" \
00:38:41.140  00:23:55.668       ...
00:38:41.140  00:23:55.668  
00:38:41.140  00:23:55.668  ========== Backtrace end ==========
00:38:41.140  00:24:09.482  ========== Backtrace start: ==========
00:38:41.140  00:24:09.482  
00:38:41.140  00:24:09.482  in spdk/autorun.sh:27 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"])
00:38:41.140  00:24:09.482       ...
00:38:41.140  00:24:09.482     22  	trap 'timing_finish || exit 1' EXIT
00:38:41.140  00:24:09.482     23  	
00:38:41.140  00:24:09.482     24  	# Runs agent scripts
00:38:41.140  00:24:09.482     25  	$rootdir/autobuild.sh "$conf"
00:38:41.140  00:24:09.482     26  	if ((SPDK_TEST_UNITTEST == 1 || SPDK_RUN_FUNCTIONAL_TEST == 1)); then
00:38:41.140  00:24:09.482  => 27  		sudo -E $rootdir/autotest.sh "$conf"
00:38:41.140  00:24:09.482     28  	fi
00:38:41.140  00:24:09.483       ...
00:38:41.140  00:24:09.483  
00:38:41.140  00:24:09.483  ========== Backtrace end ========== ]]
00:38:41.140  + echo '00:23:55.667  ========== Backtrace start: ==========
00:38:41.140  00:23:55.667  
00:38:41.140  00:23:55.667  in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1354 -> fio_plugin(["/home/vagrant/spdk_repo/spdk/build/fio/spdk_bdev"],["--ioengine=spdk_bdev"],["--spdk_json_conf"],["/dev/fd/62"],["/dev/fd/61"])
00:38:41.140  00:23:55.667       ...
00:38:41.140  00:23:55.667     1349				break
00:38:41.140  00:23:55.667     1350			fi
00:38:41.140  00:23:55.667     1351		done
00:38:41.140  00:23:55.667     1352	
00:38:41.140  00:23:55.667     1353		# Preload the sanitizer library to fio if fio_plugin was compiled with it
00:38:41.140  00:23:55.667     1354		LD_PRELOAD="$asan_lib $plugin" "$fio_dir"/fio "$@"
00:38:41.140  00:23:55.667     1355	}
00:38:41.140  00:23:55.667     1356	
00:38:41.140  00:23:55.667     1357	function fio_bdev() {
00:38:41.140  00:23:55.667     1358		fio_plugin "$rootdir/build/fio/spdk_bdev" "$@"
00:38:41.140  00:23:55.667     1359	}
00:38:41.140  00:23:55.667       ...
00:38:41.140  00:23:55.667  in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1358 -> fio_bdev(["--ioengine=spdk_bdev"],["--spdk_json_conf"],["/dev/fd/62"],["/dev/fd/61"])
00:38:41.140  00:23:55.667       ...
00:38:41.140  00:23:55.667     1353		# Preload the sanitizer library to fio if fio_plugin was compiled with it
00:38:41.140  00:23:55.667     1354		LD_PRELOAD="$asan_lib $plugin" "$fio_dir"/fio "$@"
00:38:41.140  00:23:55.667     1355	}
00:38:41.140  00:23:55.667     1356	
00:38:41.140  00:23:55.667     1357	function fio_bdev() {
00:38:41.140  00:23:55.667     1358		fio_plugin "$rootdir/build/fio/spdk_bdev" "$@"
00:38:41.140  00:23:55.667     1359	}
00:38:41.140  00:23:55.667     1360	
00:38:41.140  00:23:55.667     1361	function fio_nvme() {
00:38:41.140  00:23:55.667     1362		fio_plugin "$rootdir/build/fio/spdk_nvme" "$@"
00:38:41.140  00:23:55.667     1363	}
00:38:41.140  00:23:55.667       ...
00:38:41.140  00:23:55.667  in /home/vagrant/spdk_repo/spdk/test/nvmf/target/dif.sh:82 -> fio(["/dev/fd/62"])
00:38:41.140  00:23:55.667       ...
00:38:41.140  00:23:55.667     77  			FIO
00:38:41.140  00:23:55.667     78  		done
00:38:41.140  00:23:55.667     79  	}
00:38:41.140  00:23:55.667     80  	
00:38:41.140  00:23:55.667     81  	fio() {
00:38:41.140  00:23:55.667  => 82  		fio_bdev --ioengine=spdk_bdev --spdk_json_conf "$@" <(gen_fio_conf)
00:38:41.140  00:23:55.667     83  	}
00:38:41.140  00:23:55.667     84  	
00:38:41.140  00:23:55.667     85  	fio_dif_1() {
00:38:41.140  00:23:55.667     86  		create_subsystems 0
00:38:41.140  00:23:55.667     87  		fio <(create_json_sub_conf 0)
00:38:41.140  00:23:55.667       ...
00:38:41.140  00:23:55.667  in /home/vagrant/spdk_repo/spdk/test/nvmf/target/dif.sh:112 -> fio_dif_rand_params([])
00:38:41.140  00:23:55.667       ...
00:38:41.140  00:23:55.667     107 		destroy_subsystems 0
00:38:41.140  00:23:55.667     108 	
00:38:41.140  00:23:55.667     109 		NULL_DIF=2 bs=4k numjobs=8 iodepth=16 runtime="" files=2
00:38:41.140  00:23:55.667     110 	
00:38:41.140  00:23:55.667     111 		create_subsystems 0 1 2
00:38:41.140  00:23:55.667  => 112 		fio <(create_json_sub_conf 0 1 2)
00:38:41.140  00:23:55.667     113 		destroy_subsystems 0 1 2
00:38:41.140  00:23:55.667     114 	
00:38:41.140  00:23:55.667     115 		NULL_DIF=1 bs=8k,16k,128k numjobs=2 iodepth=8 runtime=5 files=1
00:38:41.140  00:23:55.667     116 	
00:38:41.140  00:23:55.667     117 		create_subsystems 0 1
00:38:41.140  00:23:55.667       ...
00:38:41.140  00:23:55.667  in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1127 -> run_test(["fio_dif_rand_params"],["fio_dif_rand_params"])
00:38:41.140  00:23:55.667       ...
00:38:41.140  00:23:55.667     1122		timing_enter $test_name
00:38:41.140  00:23:55.667     1123		echo "************************************"
00:38:41.140  00:23:55.667     1124		echo "START TEST $test_name"
00:38:41.140  00:23:55.667     1125		echo "************************************"
00:38:41.140  00:23:55.667     1126		xtrace_restore
00:38:41.140  00:23:55.667     1127		time "$@"
00:38:41.140  00:23:55.667     1128		xtrace_disable
00:38:41.140  00:23:55.667     1129		echo "************************************"
00:38:41.140  00:23:55.667     1130		echo "END TEST $test_name"
00:38:41.140  00:23:55.667     1131		echo "************************************"
00:38:41.140  00:23:55.667     1132		timing_exit $test_name
00:38:41.140  00:23:55.667       ...
00:38:41.140  00:23:55.667  in /home/vagrant/spdk_repo/spdk/test/nvmf/target/dif.sh:143 -> main(["--transport=tcp"],["--iso"])
00:38:41.140  00:23:55.667       ...
00:38:41.140  00:23:55.667     138 	
00:38:41.140  00:23:55.667     139 	create_transport
00:38:41.140  00:23:55.667     140 	
00:38:41.140  00:23:55.667     141 	run_test "fio_dif_1_default" fio_dif_1
00:38:41.140  00:23:55.667     142 	run_test "fio_dif_1_multi_subsystems" fio_dif_1_multi_subsystems
00:38:41.140  00:23:55.667  => 143 	run_test "fio_dif_rand_params" fio_dif_rand_params
00:38:41.140  00:23:55.667     144 	run_test "fio_dif_digest" fio_dif_digest
00:38:41.140  00:23:55.667     145 	
00:38:41.140  00:23:55.667     146 	trap - SIGINT SIGTERM EXIT
00:38:41.140  00:23:55.667     147 	nvmftestfini
00:38:41.140  00:23:55.667       ...
00:38:41.140  00:23:55.667  
00:38:41.140  00:23:55.667  ========== Backtrace end ==========
00:38:41.140  00:23:55.668  ========== Backtrace start: ==========
00:38:41.140  00:23:55.668  
00:38:41.140  00:23:55.668  in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1127 -> run_test(["nvmf_dif"],["/home/vagrant/spdk_repo/spdk/test/nvmf/target/dif.sh"])
00:38:41.140  00:23:55.668       ...
00:38:41.140  00:23:55.668     1122		timing_enter $test_name
00:38:41.140  00:23:55.668     1123		echo "************************************"
00:38:41.140  00:23:55.668     1124		echo "START TEST $test_name"
00:38:41.140  00:23:55.668     1125		echo "************************************"
00:38:41.140  00:23:55.668     1126		xtrace_restore
00:38:41.140  00:23:55.668     1127		time "$@"
00:38:41.140  00:23:55.668     1128		xtrace_disable
00:38:41.140  00:23:55.668     1129		echo "************************************"
00:38:41.140  00:23:55.668     1130		echo "END TEST $test_name"
00:38:41.140  00:23:55.668     1131		echo "************************************"
00:38:41.140  00:23:55.668     1132		timing_exit $test_name
00:38:41.140  00:23:55.668       ...
00:38:41.140  00:23:55.668  in /home/vagrant/spdk_repo/spdk/autotest.sh:285 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"])
00:38:41.140  00:23:55.668       ...
00:38:41.140  00:23:55.668     280 				run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT
00:38:41.140  00:23:55.668     281 				if [[ $SPDK_TEST_URING -eq 0 ]]; then
00:38:41.140  00:23:55.668     282 					run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT
00:38:41.140  00:23:55.668     283 					run_test "nvmf_identify_passthru" $rootdir/test/nvmf/target/identify_passthru.sh --transport=$SPDK_TEST_NVMF_TRANSPORT
00:38:41.140  00:23:55.668     284 				fi
00:38:41.140  00:23:55.668  => 285 				run_test "nvmf_dif" $rootdir/test/nvmf/target/dif.sh
00:38:41.140  00:23:55.668     286 				run_test "nvmf_abort_qd_sizes" $rootdir/test/nvmf/target/abort_qd_sizes.sh
00:38:41.140  00:23:55.668     287 				# The keyring tests utilize NVMe/TLS
00:38:41.140  00:23:55.668     288 				run_test "keyring_file" "$rootdir/test/keyring/file.sh"
00:38:41.140  00:23:55.668     289 				if [[ "$CONFIG_HAVE_KEYUTILS" == y ]]; then
00:38:41.140  00:23:55.668     290 					run_test "keyring_linux" "$rootdir/scripts/keyctl-session-wrapper" \
00:38:41.140  00:23:55.668       ...
00:38:41.140  00:23:55.668  
00:38:41.140  00:23:55.668  ========== Backtrace end ==========
00:38:41.140  00:24:09.482  ========== Backtrace start: ==========
00:38:41.140  00:24:09.482  
00:38:41.140  00:24:09.482  in spdk/autorun.sh:27 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"])
00:38:41.140  00:24:09.482       ...
00:38:41.140  00:24:09.482     22  	trap '\''timing_finish || exit 1'\'' EXIT
00:38:41.140  00:24:09.482     23  	
00:38:41.140  00:24:09.482     24  	# Runs agent scripts
00:38:41.140  00:24:09.482     25  	$rootdir/autobuild.sh "$conf"
00:38:41.140  00:24:09.482     26  	if ((SPDK_TEST_UNITTEST == 1 || SPDK_RUN_FUNCTIONAL_TEST == 1)); then
00:38:41.140  00:24:09.482  => 27  		sudo -E $rootdir/autotest.sh "$conf"
00:38:41.140  00:24:09.482     28  	fi
00:38:41.140  00:24:09.483       ...
00:38:41.140  00:24:09.483  
00:38:41.140  00:24:09.483  ========== Backtrace end =========='
00:38:41.140  + for build in "${build_log_list[@]}"
00:38:41.140  + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/short-fuzz-phy-autotest_40089/build.log
00:38:41.140  + local build_log job_name start_pattern end_pattern backtraces
00:38:41.140  + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/short-fuzz-phy-autotest_40089/build.log
00:38:41.140  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/short-fuzz-phy-autotest_40089/build.log
00:38:41.140  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/short-fuzz-phy-autotest_40089
00:38:41.140  + job_name=short-fuzz-phy-autotest_40089
00:38:41.140  + start_pattern='Backtrace start'
00:38:41.140  + end_pattern='Backtrace end'
00:38:41.140  + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/short-fuzz-phy-autotest_40089/build.log ]]
00:38:41.140  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/short-fuzz-phy-autotest_40089/build.log
00:38:41.140  + backtraces=
00:38:41.140  + [[ -n '' ]]
00:38:41.140  + for build in "${build_log_list[@]}"
00:38:41.140  + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vfio-user-phy-autotest_40093/build.log
00:38:41.140  + local build_log job_name start_pattern end_pattern backtraces
00:38:41.140  + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vfio-user-phy-autotest_40093/build.log
00:38:41.140  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vfio-user-phy-autotest_40093/build.log
00:38:41.140  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vfio-user-phy-autotest_40093
00:38:41.140  + job_name=vfio-user-phy-autotest_40093
00:38:41.140  + start_pattern='Backtrace start'
00:38:41.140  + end_pattern='Backtrace end'
00:38:41.140  + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vfio-user-phy-autotest_40093/build.log ]]
00:38:41.140  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vfio-user-phy-autotest_40093/build.log
00:38:41.140  + backtraces=
00:38:41.140  + [[ -n '' ]]
00:38:41.141  + for build in "${build_log_list[@]}"
00:38:41.141  + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-main-docker-autotest_31648/build.log
00:38:41.141  + local build_log job_name start_pattern end_pattern backtraces
00:38:41.141  + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-main-docker-autotest_31648/build.log
00:38:41.141  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-main-docker-autotest_31648/build.log
00:38:41.141  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-main-docker-autotest_31648
00:38:41.141  + job_name=unittest-main-docker-autotest_31648
00:38:41.141  + start_pattern='Backtrace start'
00:38:41.141  + end_pattern='Backtrace end'
00:38:41.141  + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-main-docker-autotest_31648/build.log ]]
00:38:41.141  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-main-docker-autotest_31648/build.log
00:38:41.141  + backtraces=
00:38:41.141  + [[ -n '' ]]
00:38:41.141  + for build in "${build_log_list[@]}"
00:38:41.141  + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-clang-docker-autotest_31645/build.log
00:38:41.141  + local build_log job_name start_pattern end_pattern backtraces
00:38:41.141  + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-clang-docker-autotest_31645/build.log
00:38:41.141  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-clang-docker-autotest_31645/build.log
00:38:41.141  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-clang-docker-autotest_31645
00:38:41.141  + job_name=unittest-clang-docker-autotest_31645
00:38:41.141  + start_pattern='Backtrace start'
00:38:41.141  + end_pattern='Backtrace end'
00:38:41.141  + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-clang-docker-autotest_31645/build.log ]]
00:38:41.141  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-clang-docker-autotest_31645/build.log
00:38:41.141  + backtraces=
00:38:41.141  + [[ -n '' ]]
00:38:41.141  + for build in "${build_log_list[@]}"
00:38:41.141  + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/doc-docker-autotest_35310/build.log
00:38:41.141  + local build_log job_name start_pattern end_pattern backtraces
00:38:41.141  + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/doc-docker-autotest_35310/build.log
00:38:41.141  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/doc-docker-autotest_35310/build.log
00:38:41.141  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/doc-docker-autotest_35310
00:38:41.141  + job_name=doc-docker-autotest_35310
00:38:41.141  + start_pattern='Backtrace start'
00:38:41.141  + end_pattern='Backtrace end'
00:38:41.141  + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/doc-docker-autotest_35310/build.log ]]
00:38:41.141  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/doc-docker-autotest_35310/build.log
00:38:41.141  + backtraces=
00:38:41.141  + [[ -n '' ]]
00:38:41.141  + for build in "${build_log_list[@]}"
00:38:41.141  + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/raid-vg-autotest_6908/build.log
00:38:41.141  + local build_log job_name start_pattern end_pattern backtraces
00:38:41.141  + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/raid-vg-autotest_6908/build.log
00:38:41.141  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/raid-vg-autotest_6908/build.log
00:38:41.141  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/raid-vg-autotest_6908
00:38:41.141  + job_name=raid-vg-autotest_6908
00:38:41.141  + start_pattern='Backtrace start'
00:38:41.141  + end_pattern='Backtrace end'
00:38:41.141  + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/raid-vg-autotest_6908/build.log ]]
00:38:41.141  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/raid-vg-autotest_6908/build.log
00:38:41.141  + backtraces=
00:38:41.141  + [[ -n '' ]]
00:38:41.141  + for build in "${build_log_list[@]}"
00:38:41.141  + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-vg-autotest_92552/build.log
00:38:41.141  + local build_log job_name start_pattern end_pattern backtraces
00:38:41.141  + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-vg-autotest_92552/build.log
00:38:41.141  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-vg-autotest_92552/build.log
00:38:41.141  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-vg-autotest_92552
00:38:41.141  + job_name=iscsi-vg-autotest_92552
00:38:41.141  + start_pattern='Backtrace start'
00:38:41.141  + end_pattern='Backtrace end'
00:38:41.141  + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-vg-autotest_92552/build.log ]]
00:38:41.141  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-vg-autotest_92552/build.log
00:38:41.141  + backtraces=
00:38:41.141  + [[ -n '' ]]
00:38:41.141  + for build in "${build_log_list[@]}"
00:38:41.141  + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-cmb-pmr-vg-autotest_93642/build.log
00:38:41.141  + local build_log job_name start_pattern end_pattern backtraces
00:38:41.141  + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-cmb-pmr-vg-autotest_93642/build.log
00:38:41.141  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-cmb-pmr-vg-autotest_93642/build.log
00:38:41.141  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-cmb-pmr-vg-autotest_93642
00:38:41.141  + job_name=nvme-cmb-pmr-vg-autotest_93642
00:38:41.141  + start_pattern='Backtrace start'
00:38:41.141  + end_pattern='Backtrace end'
00:38:41.141  + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-cmb-pmr-vg-autotest_93642/build.log ]]
00:38:41.141  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-cmb-pmr-vg-autotest_93642/build.log
00:38:41.141  + backtraces=
00:38:41.141  + [[ -n '' ]]
00:38:41.141  + for build in "${build_log_list[@]}"
00:38:41.141  + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/release-build-main-docker-autotest_4752/build.log
00:38:41.141  + local build_log job_name start_pattern end_pattern backtraces
00:38:41.141  + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/release-build-main-docker-autotest_4752/build.log
00:38:41.141  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/release-build-main-docker-autotest_4752/build.log
00:38:41.141  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/release-build-main-docker-autotest_4752
00:38:41.141  + job_name=release-build-main-docker-autotest_4752
00:38:41.141  + start_pattern='Backtrace start'
00:38:41.141  + end_pattern='Backtrace end'
00:38:41.141  + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/release-build-main-docker-autotest_4752/build.log ]]
00:38:41.141  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/release-build-main-docker-autotest_4752/build.log
00:38:41.141  + backtraces=
00:38:41.141  + [[ -n '' ]]
00:38:41.141  + for build in "${build_log_list[@]}"
00:38:41.141  + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/zns-vg-autotest_91612/build.log
00:38:41.141  + local build_log job_name start_pattern end_pattern backtraces
00:38:41.141  + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/zns-vg-autotest_91612/build.log
00:38:41.141  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/zns-vg-autotest_91612/build.log
00:38:41.141  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/zns-vg-autotest_91612
00:38:41.141  + job_name=zns-vg-autotest_91612
00:38:41.141  + start_pattern='Backtrace start'
00:38:41.141  + end_pattern='Backtrace end'
00:38:41.141  + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/zns-vg-autotest_91612/build.log ]]
00:38:41.141  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/zns-vg-autotest_91612/build.log
00:38:41.141  + backtraces=
00:38:41.141  + [[ -n '' ]]
00:38:41.141  + for build in "${build_log_list[@]}"
00:38:41.141  + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu24-vg-autotest_8796/build.log
00:38:41.141  + local build_log job_name start_pattern end_pattern backtraces
00:38:41.141  + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu24-vg-autotest_8796/build.log
00:38:41.141  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu24-vg-autotest_8796/build.log
00:38:41.141  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu24-vg-autotest_8796
00:38:41.141  + job_name=ubuntu24-vg-autotest_8796
00:38:41.141  + start_pattern='Backtrace start'
00:38:41.141  + end_pattern='Backtrace end'
00:38:41.141  + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu24-vg-autotest_8796/build.log ]]
00:38:41.141  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu24-vg-autotest_8796/build.log
00:38:41.141  + backtraces=
00:38:41.141  + [[ -n '' ]]
00:38:41.141  + for build in "${build_log_list[@]}"
00:38:41.141  + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/rocky9-vg-autotest_29599/build.log
00:38:41.141  + local build_log job_name start_pattern end_pattern backtraces
00:38:41.141  + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/rocky9-vg-autotest_29599/build.log
00:38:41.141  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/rocky9-vg-autotest_29599/build.log
00:38:41.141  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/rocky9-vg-autotest_29599
00:38:41.141  + job_name=rocky9-vg-autotest_29599
00:38:41.141  + start_pattern='Backtrace start'
00:38:41.141  + end_pattern='Backtrace end'
00:38:41.141  + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/rocky9-vg-autotest_29599/build.log ]]
00:38:41.141  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/rocky9-vg-autotest_29599/build.log
00:38:41.141  + backtraces=
00:38:41.141  + [[ -n '' ]]
00:38:41.141  + for build in "${build_log_list[@]}"
00:38:41.141  + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/lvol-vg-autotest_92462/build.log
00:38:41.141  + local build_log job_name start_pattern end_pattern backtraces
00:38:41.141  + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/lvol-vg-autotest_92462/build.log
00:38:41.141  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/lvol-vg-autotest_92462/build.log
00:38:41.141  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/lvol-vg-autotest_92462
00:38:41.141  + job_name=lvol-vg-autotest_92462
00:38:41.141  + start_pattern='Backtrace start'
00:38:41.141  + end_pattern='Backtrace end'
00:38:41.141  + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/lvol-vg-autotest_92462/build.log ]]
00:38:41.141  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/lvol-vg-autotest_92462/build.log
00:38:41.141  + backtraces=
00:38:41.141  + [[ -n '' ]]
00:38:41.141  + for build in "${build_log_list[@]}"
00:38:41.141  + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-initiator-vg-autotest_92539/build.log
00:38:41.141  + local build_log job_name start_pattern end_pattern backtraces
00:38:41.141  + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-initiator-vg-autotest_92539/build.log
00:38:41.141  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-initiator-vg-autotest_92539/build.log
00:38:41.141  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-initiator-vg-autotest_92539
00:38:41.141  + job_name=vhost-initiator-vg-autotest_92539
00:38:41.142  + start_pattern='Backtrace start'
00:38:41.142  + end_pattern='Backtrace end'
00:38:41.142  + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-initiator-vg-autotest_92539/build.log ]]
00:38:41.142  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-initiator-vg-autotest_92539/build.log
00:38:41.142  + backtraces=
00:38:41.142  + [[ -n '' ]]
00:38:41.142  + for build in "${build_log_list[@]}"
00:38:41.142  + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vmd-phy-autotest_6438/build.log
00:38:41.142  + local build_log job_name start_pattern end_pattern backtraces
00:38:41.142  + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vmd-phy-autotest_6438/build.log
00:38:41.142  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vmd-phy-autotest_6438/build.log
00:38:41.142  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vmd-phy-autotest_6438
00:38:41.142  + job_name=vmd-phy-autotest_6438
00:38:41.142  + start_pattern='Backtrace start'
00:38:41.142  + end_pattern='Backtrace end'
00:38:41.142  + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vmd-phy-autotest_6438/build.log ]]
00:38:41.142  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vmd-phy-autotest_6438/build.log
00:38:41.142  + backtraces=
00:38:41.142  + [[ -n '' ]]
00:38:41.142  + for build in "${build_log_list[@]}"
00:38:41.142  + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-uring-vg-autotest_92417/build.log
00:38:41.142  + local build_log job_name start_pattern end_pattern backtraces
00:38:41.142  + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-uring-vg-autotest_92417/build.log
00:38:41.142  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-uring-vg-autotest_92417/build.log
00:38:41.142  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-uring-vg-autotest_92417
00:38:41.142  + job_name=iscsi-uring-vg-autotest_92417
00:38:41.142  + start_pattern='Backtrace start'
00:38:41.142  + end_pattern='Backtrace end'
00:38:41.142  + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-uring-vg-autotest_92417/build.log ]]
00:38:41.142  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-uring-vg-autotest_92417/build.log
00:38:41.142  + backtraces=
00:38:41.142  + [[ -n '' ]]
00:38:41.142  + for build in "${build_log_list[@]}"
00:38:41.142  + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/scan-build-docker-autotest_31656/build.log
00:38:41.142  + local build_log job_name start_pattern end_pattern backtraces
00:38:41.142  + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/scan-build-docker-autotest_31656/build.log
00:38:41.142  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/scan-build-docker-autotest_31656/build.log
00:38:41.142  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/scan-build-docker-autotest_31656
00:38:41.142  + job_name=scan-build-docker-autotest_31656
00:38:41.142  + start_pattern='Backtrace start'
00:38:41.142  + end_pattern='Backtrace end'
00:38:41.142  + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/scan-build-docker-autotest_31656/build.log ]]
00:38:41.142  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/scan-build-docker-autotest_31656/build.log
00:38:41.142  + backtraces=
00:38:41.142  + [[ -n '' ]]
00:38:41.142  + for build in "${build_log_list[@]}"
00:38:41.142  + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/release-build-clang-docker-autotest_4751/build.log
00:38:41.142  + local build_log job_name start_pattern end_pattern backtraces
00:38:41.142  + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/release-build-clang-docker-autotest_4751/build.log
00:38:41.142  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/release-build-clang-docker-autotest_4751/build.log
00:38:41.142  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/release-build-clang-docker-autotest_4751
00:38:41.142  + job_name=release-build-clang-docker-autotest_4751
00:38:41.142  + start_pattern='Backtrace start'
00:38:41.142  + end_pattern='Backtrace end'
00:38:41.142  + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/release-build-clang-docker-autotest_4751/build.log ]]
00:38:41.142  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/release-build-clang-docker-autotest_4751/build.log
00:38:41.142  + backtraces=
00:38:41.142  + [[ -n '' ]]
00:38:41.142  + for build in "${build_log_list[@]}"
00:38:41.142  + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/packaging-docker-autotest_31644/build.log
00:38:41.142  + local build_log job_name start_pattern end_pattern backtraces
00:38:41.142  + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/packaging-docker-autotest_31644/build.log
00:38:41.142  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/packaging-docker-autotest_31644/build.log
00:38:41.142  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/packaging-docker-autotest_31644
00:38:41.142  + job_name=packaging-docker-autotest_31644
00:38:41.142  + start_pattern='Backtrace start'
00:38:41.142  + end_pattern='Backtrace end'
00:38:41.142  + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/packaging-docker-autotest_31644/build.log ]]
00:38:41.142  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/packaging-docker-autotest_31644/build.log
00:38:41.142  + backtraces=
00:38:41.142  + [[ -n '' ]]
00:38:41.142  + for build in "${build_log_list[@]}"
00:38:41.142  + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/check-format-docker-autotest_34995/build.log
00:38:41.142  + local build_log job_name start_pattern end_pattern backtraces
00:38:41.142  + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/check-format-docker-autotest_34995/build.log
00:38:41.142  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/check-format-docker-autotest_34995/build.log
00:38:41.142  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/check-format-docker-autotest_34995
00:38:41.142  + job_name=check-format-docker-autotest_34995
00:38:41.142  + start_pattern='Backtrace start'
00:38:41.142  + end_pattern='Backtrace end'
00:38:41.142  + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/check-format-docker-autotest_34995/build.log ]]
00:38:41.142  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/check-format-docker-autotest_34995/build.log
00:38:41.142  + backtraces=
00:38:41.142  + [[ -n '' ]]
00:38:41.142  + for build in "${build_log_list[@]}"
00:38:41.142  + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-vg-autotest_92494/build.log
00:38:41.142  + local build_log job_name start_pattern end_pattern backtraces
00:38:41.142  + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-vg-autotest_92494/build.log
00:38:41.142  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-vg-autotest_92494/build.log
00:38:41.142  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-vg-autotest_92494
00:38:41.142  + job_name=nvmf-tcp-vg-autotest_92494
00:38:41.142  + start_pattern='Backtrace start'
00:38:41.142  + end_pattern='Backtrace end'
00:38:41.142  + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-vg-autotest_92494/build.log ]]
00:38:41.142  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-vg-autotest_92494/build.log
00:38:41.404  + backtraces=
00:38:41.404  + [[ -n '' ]]
00:38:41.404  + for build in "${build_log_list[@]}"
00:38:41.404  + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/build-files-docker-autotest_34970/build.log
00:38:41.404  + local build_log job_name start_pattern end_pattern backtraces
00:38:41.404  + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/build-files-docker-autotest_34970/build.log
00:38:41.404  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/build-files-docker-autotest_34970/build.log
00:38:41.404  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/build-files-docker-autotest_34970
00:38:41.404  + job_name=build-files-docker-autotest_34970
00:38:41.404  + start_pattern='Backtrace start'
00:38:41.404  + end_pattern='Backtrace end'
00:38:41.404  + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/build-files-docker-autotest_34970/build.log ]]
00:38:41.404  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/build-files-docker-autotest_34970/build.log
00:38:41.404  + backtraces=
00:38:41.404  + [[ -n '' ]]
00:38:41.404  + for build in "${build_log_list[@]}"
00:38:41.404  + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/BlobFS-phy-autotest_40100/build.log
00:38:41.404  + local build_log job_name start_pattern end_pattern backtraces
00:38:41.404  + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/BlobFS-phy-autotest_40100/build.log
00:38:41.404  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/BlobFS-phy-autotest_40100/build.log
00:38:41.404  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/BlobFS-phy-autotest_40100
00:38:41.404  + job_name=BlobFS-phy-autotest_40100
00:38:41.404  + start_pattern='Backtrace start'
00:38:41.404  + end_pattern='Backtrace end'
00:38:41.404  + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/BlobFS-phy-autotest_40100/build.log ]]
00:38:41.405  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/BlobFS-phy-autotest_40100/build.log
00:38:41.405  + backtraces=
00:38:41.405  + [[ -n '' ]]
00:38:41.405  + for build in "${build_log_list[@]}"
00:38:41.405  + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu22-vg-autotest_51254/build.log
00:38:41.405  + local build_log job_name start_pattern end_pattern backtraces
00:38:41.405  + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu22-vg-autotest_51254/build.log
00:38:41.405  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu22-vg-autotest_51254/build.log
00:38:41.405  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu22-vg-autotest_51254
00:38:41.405  + job_name=ubuntu22-vg-autotest_51254
00:38:41.405  + start_pattern='Backtrace start'
00:38:41.405  + end_pattern='Backtrace end'
00:38:41.405  + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu22-vg-autotest_51254/build.log ]]
00:38:41.405  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu22-vg-autotest_51254/build.log
00:38:41.405  + backtraces=
00:38:41.405  + [[ -n '' ]]
00:38:41.405  + for build in "${build_log_list[@]}"
00:38:41.405  + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-phy-autotest_40159/build.log
00:38:41.405  + local build_log job_name start_pattern end_pattern backtraces
00:38:41.405  + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-phy-autotest_40159/build.log
00:38:41.405  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-phy-autotest_40159/build.log
00:38:41.405  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-phy-autotest_40159
00:38:41.405  + job_name=vhost-phy-autotest_40159
00:38:41.405  + start_pattern='Backtrace start'
00:38:41.405  + end_pattern='Backtrace end'
00:38:41.405  + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-phy-autotest_40159/build.log ]]
00:38:41.405  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-phy-autotest_40159/build.log
00:38:41.405  + backtraces=
00:38:41.405  + [[ -n '' ]]
00:38:41.405  + for build in "${build_log_list[@]}"
00:38:41.405  + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/autobuild-external-vg-autotest_32291/build.log
00:38:41.405  + local build_log job_name start_pattern end_pattern backtraces
00:38:41.405  + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/autobuild-external-vg-autotest_32291/build.log
00:38:41.405  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/autobuild-external-vg-autotest_32291/build.log
00:38:41.405  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/autobuild-external-vg-autotest_32291
00:38:41.405  + job_name=autobuild-external-vg-autotest_32291
00:38:41.405  + start_pattern='Backtrace start'
00:38:41.405  + end_pattern='Backtrace end'
00:38:41.405  + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/autobuild-external-vg-autotest_32291/build.log ]]
00:38:41.405  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/autobuild-external-vg-autotest_32291/build.log
00:38:41.405  + backtraces=
00:38:41.405  + [[ -n '' ]]
00:38:41.405  + for build in "${build_log_list[@]}"
00:38:41.405  + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-phy-autotest_86336/build.log
00:38:41.405  + local build_log job_name start_pattern end_pattern backtraces
00:38:41.405  + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-phy-autotest_86336/build.log
00:38:41.405  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-phy-autotest_86336/build.log
00:38:41.405  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-phy-autotest_86336
00:38:41.405  + job_name=nvmf-phy-autotest_86336
00:38:41.405  + start_pattern='Backtrace start'
00:38:41.405  + end_pattern='Backtrace end'
00:38:41.405  + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-phy-autotest_86336/build.log ]]
00:38:41.405  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-phy-autotest_86336/build.log
00:38:41.405  + backtraces=
00:38:41.405  + [[ -n '' ]]
00:38:41.405  + for build in "${build_log_list[@]}"
00:38:41.405  + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-phy-autotest_86218/build.log
00:38:41.405  + local build_log job_name start_pattern end_pattern backtraces
00:38:41.405  + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-phy-autotest_86218/build.log
00:38:41.405  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-phy-autotest_86218/build.log
00:38:41.405  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-phy-autotest_86218
00:38:41.405  + job_name=nvmf-tcp-phy-autotest_86218
00:38:41.405  + start_pattern='Backtrace start'
00:38:41.405  + end_pattern='Backtrace end'
00:38:41.405  + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-phy-autotest_86218/build.log ]]
00:38:41.405  ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-phy-autotest_86218/build.log
00:38:41.405  + backtraces='00:30:01.440  ========== Backtrace start: ==========
00:38:41.405  00:30:01.440  
00:38:41.405  00:30:01.440  in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:677 -> NOT(["wait"],["96914"])
00:38:41.405  00:30:01.440       ...
00:38:41.405  00:30:01.440     672 		elif [[ -n ${EXIT_STATUS:-} ]] && ((es != EXIT_STATUS)); then
00:38:41.405  00:30:01.440     673 			es=0
00:38:41.405  00:30:01.440     674 		fi
00:38:41.405  00:30:01.440     675 	
00:38:41.405  00:30:01.440     676 		# invert error code of any command and also trigger ERR on 0 (unlike bash ! prefix)
00:38:41.405  00:30:01.440  => 677 		((!es == 0))
00:38:41.405  00:30:01.440     678 	}
00:38:41.405  00:30:01.440     679 	
00:38:41.405  00:30:01.440     680 	function timing() {
00:38:41.405  00:30:01.440     681 		direction="$1"
00:38:41.405  00:30:01.440     682 		testname="$2"
00:38:41.405  00:30:01.440       ...
00:38:41.405  00:30:01.440  in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh:158 -> nvmf_shutdown_tc4([])
00:38:41.405  00:30:01.440       ...
00:38:41.405  00:30:01.440     153 	
00:38:41.405  00:30:01.440     154 		# Kill the target half way through
00:38:41.405  00:30:01.440     155 		killprocess $nvmfpid
00:38:41.405  00:30:01.440     156 		sleep 1
00:38:41.405  00:30:01.440     157 		# Due to IOs are completed with errors, perf exits with bad status
00:38:41.405  00:30:01.440  => 158 		NOT wait $perfpid
00:38:41.405  00:30:01.440     159 		stoptarget
00:38:41.405  00:30:01.440     160 	}
00:38:41.405  00:30:01.440     161 	
00:38:41.405  00:30:01.440     162 	run_test "nvmf_shutdown_tc1" nvmf_shutdown_tc1
00:38:41.405  00:30:01.440     163 	run_test "nvmf_shutdown_tc2" nvmf_shutdown_tc2
00:38:41.405  00:30:01.440       ...
00:38:41.405  00:30:01.440  in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:1127 -> run_test(["nvmf_shutdown_tc4"],["nvmf_shutdown_tc4"])
00:38:41.405  00:30:01.440       ...
00:38:41.405  00:30:01.440     1122		timing_enter $test_name
00:38:41.405  00:30:01.440     1123		echo "************************************"
00:38:41.405  00:30:01.440     1124		echo "START TEST $test_name"
00:38:41.405  00:30:01.440     1125		echo "************************************"
00:38:41.405  00:30:01.440     1126		xtrace_restore
00:38:41.405  00:30:01.440     1127		time "$@"
00:38:41.405  00:30:01.440     1128		xtrace_disable
00:38:41.405  00:30:01.440     1129		echo "************************************"
00:38:41.405  00:30:01.440     1130		echo "END TEST $test_name"
00:38:41.405  00:30:01.440     1131		echo "************************************"
00:38:41.405  00:30:01.440     1132		timing_exit $test_name
00:38:41.405  00:30:01.440       ...
00:38:41.405  00:30:01.440  in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh:167 -> main(["--transport=tcp"])
00:38:41.405  00:30:01.440       ...
00:38:41.405  00:30:01.440     162 	run_test "nvmf_shutdown_tc1" nvmf_shutdown_tc1
00:38:41.405  00:30:01.440     163 	run_test "nvmf_shutdown_tc2" nvmf_shutdown_tc2
00:38:41.405  00:30:01.440     164 	run_test "nvmf_shutdown_tc3" nvmf_shutdown_tc3
00:38:41.405  00:30:01.440     165 	# Temporarily disable on e810 due to issue #3523
00:38:41.405  00:30:01.440     166 	if ! [[ "$SPDK_TEST_NVMF_NICS" == "e810" && "$TEST_TRANSPORT" == "rdma" ]]; then
00:38:41.405  00:30:01.440  => 167 		run_test "nvmf_shutdown_tc4" nvmf_shutdown_tc4
00:38:41.405  00:30:01.440     168 	fi
00:38:41.405  00:30:01.440     169 	
00:38:41.405  00:30:01.440     170 	trap - SIGINT SIGTERM EXIT
00:38:41.405  00:30:01.440       ...
00:38:41.405  00:30:01.440  
00:38:41.405  00:30:01.440  ========== Backtrace end ==========
00:38:41.405  00:30:04.240  ========== Backtrace start: ==========
00:38:41.405  00:30:04.240  
00:38:41.405  00:30:04.240  in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:1127 -> run_test(["nvmf_shutdown"],["/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh"],["--transport=tcp"])
00:38:41.405  00:30:04.240       ...
00:38:41.405  00:30:04.240     1122		timing_enter $test_name
00:38:41.405  00:30:04.240     1123		echo "************************************"
00:38:41.405  00:30:04.240     1124		echo "START TEST $test_name"
00:38:41.405  00:30:04.240     1125		echo "************************************"
00:38:41.405  00:30:04.240     1126		xtrace_restore
00:38:41.405  00:30:04.240     1127		time "$@"
00:38:41.405  00:30:04.240     1128		xtrace_disable
00:38:41.405  00:30:04.240     1129		echo "************************************"
00:38:41.405  00:30:04.240     1130		echo "END TEST $test_name"
00:38:41.405  00:30:04.240     1131		echo "************************************"
00:38:41.405  00:30:04.240     1132		timing_exit $test_name
00:38:41.405  00:30:04.240       ...
00:38:41.405  00:30:04.240  in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf_target_extra.sh:65 -> main(["--transport=tcp"])
00:38:41.405  00:30:04.240       ...
00:38:41.405  00:30:04.240     60  		elif [[ $SPDK_TEST_NVMF_TRANSPORT == "rdma" ]]; then
00:38:41.405  00:30:04.240     61  			# Disabled due to https://github.com/spdk/spdk/issues/3345
00:38:41.405  00:30:04.240     62  			# run_test "nvmf_device_removal" test/nvmf/target/device_removal.sh "${TEST_ARGS[@]}"
00:38:41.405  00:30:04.240     63  			run_test "nvmf_srq_overwhelm" "$rootdir/test/nvmf/target/srq_overwhelm.sh" "${TEST_ARGS[@]}"
00:38:41.405  00:30:04.240     64  		fi
00:38:41.405  00:30:04.240  => 65  		run_test "nvmf_shutdown" $rootdir/test/nvmf/target/shutdown.sh "${TEST_ARGS[@]}"
00:38:41.405  00:30:04.240     66  	fi
00:38:41.405  00:30:04.240     67  	
00:38:41.405  00:30:04.240     68  	trap - SIGINT SIGTERM EXIT
00:38:41.405  00:30:04.240       ...
00:38:41.405  00:30:04.240  
00:38:41.405  00:30:04.240  ========== Backtrace end ==========
00:38:41.405  00:30:04.240  ========== Backtrace start: ==========
00:38:41.405  00:30:04.240  
00:38:41.405  00:30:04.240  in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:1127 -> run_test(["nvmf_target_extra"],["/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf_target_extra.sh"],["--transport=tcp"])
00:38:41.405  00:30:04.240       ...
00:38:41.405  00:30:04.240     1122		timing_enter $test_name
00:38:41.405  00:30:04.240     1123		echo "************************************"
00:38:41.405  00:30:04.240     1124		echo "START TEST $test_name"
00:38:41.405  00:30:04.240     1125		echo "************************************"
00:38:41.405  00:30:04.240     1126		xtrace_restore
00:38:41.405  00:30:04.240     1127		time "$@"
00:38:41.405  00:30:04.240     1128		xtrace_disable
00:38:41.405  00:30:04.240     1129		echo "************************************"
00:38:41.406  00:30:04.240     1130		echo "END TEST $test_name"
00:38:41.406  00:30:04.240     1131		echo "************************************"
00:38:41.406  00:30:04.240     1132		timing_exit $test_name
00:38:41.406  00:30:04.240       ...
00:38:41.406  00:30:04.240  in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh:15 -> main(["--transport=tcp"])
00:38:41.406  00:30:04.240       ...
00:38:41.406  00:30:04.240     10  	if [ ! $(uname -s) = Linux ]; then
00:38:41.406  00:30:04.240     11  		exit 0
00:38:41.406  00:30:04.240     12  	fi
00:38:41.406  00:30:04.240     13  	
00:38:41.406  00:30:04.240     14  	run_test "nvmf_target_core" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT
00:38:41.406  00:30:04.240  => 15  	run_test "nvmf_target_extra" $rootdir/test/nvmf/nvmf_target_extra.sh --transport=$SPDK_TEST_NVMF_TRANSPORT
00:38:41.406  00:30:04.240     16  	run_test "nvmf_host" $rootdir/test/nvmf/nvmf_host.sh --transport=$SPDK_TEST_NVMF_TRANSPORT
00:38:41.406  00:30:04.240     17  	
00:38:41.406  00:30:04.240     18  	# Interrupt mode for now is supported only on the target, with the TCP transport and posix or ssl socket implementations.
00:38:41.406  00:30:04.240     19  	if [[ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" && $SPDK_TEST_URING -eq 0 ]]; then
00:38:41.406  00:30:04.240     20  		run_test "nvmf_target_core_interrupt_mode" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT --interrupt-mode
00:38:41.406  00:30:04.240       ...
00:38:41.406  00:30:04.240  
00:38:41.406  00:30:04.240  ========== Backtrace end ==========
00:38:41.406  00:30:04.241  ========== Backtrace start: ==========
00:38:41.406  00:30:04.241  
00:38:41.406  00:30:04.241  in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:1127 -> run_test(["nvmf_tcp"],["/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh"],["--transport=tcp"])
00:38:41.406  00:30:04.241       ...
00:38:41.406  00:30:04.241     1122		timing_enter $test_name
00:38:41.406  00:30:04.241     1123		echo "************************************"
00:38:41.406  00:30:04.241     1124		echo "START TEST $test_name"
00:38:41.406  00:30:04.241     1125		echo "************************************"
00:38:41.406  00:30:04.241     1126		xtrace_restore
00:38:41.406  00:30:04.241     1127		time "$@"
00:38:41.406  00:30:04.241     1128		xtrace_disable
00:38:41.406  00:30:04.241     1129		echo "************************************"
00:38:41.406  00:30:04.241     1130		echo "END TEST $test_name"
00:38:41.406  00:30:04.241     1131		echo "************************************"
00:38:41.406  00:30:04.241     1132		timing_exit $test_name
00:38:41.406  00:30:04.241       ...
00:38:41.406  00:30:04.241  in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh:280 -> main(["/var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf"])
00:38:41.406  00:30:04.241       ...
00:38:41.406  00:30:04.241     275 			# list of all tests can properly differentiate them. Please do not merge them into one line.
00:38:41.406  00:30:04.241     276 			if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then
00:38:41.406  00:30:04.241     277 				run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT
00:38:41.406  00:30:04.241     278 				run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT
00:38:41.406  00:30:04.241     279 			elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then
00:38:41.406  00:30:04.241  => 280 				run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT
00:38:41.406  00:30:04.241     281 				if [[ $SPDK_TEST_URING -eq 0 ]]; then
00:38:41.406  00:30:04.241     282 					run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT
00:38:41.406  00:30:04.241     283 					run_test "nvmf_identify_passthru" $rootdir/test/nvmf/target/identify_passthru.sh --transport=$SPDK_TEST_NVMF_TRANSPORT
00:38:41.406  00:30:04.241     284 				fi
00:38:41.406  00:30:04.241     285 				run_test "nvmf_dif" $rootdir/test/nvmf/target/dif.sh
00:38:41.406  00:30:04.241       ...
00:38:41.406  00:30:04.241  
00:38:41.406  00:30:04.241  ========== Backtrace end ==========
00:38:41.406  00:30:22.174  ========== Backtrace start: ==========
00:38:41.406  00:30:22.174  
00:38:41.406  00:30:22.174  in spdk/autorun.sh:27 -> main(["/var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf"])
00:38:41.406  00:30:22.174       ...
00:38:41.406  00:30:22.174     22  	trap '\''timing_finish || exit 1'\'' EXIT
00:38:41.406  00:30:22.174     23  	
00:38:41.406  00:30:22.174     24  	# Runs agent scripts
00:38:41.406  00:30:22.174     25  	$rootdir/autobuild.sh "$conf"
00:38:41.406  00:30:22.174     26  	if ((SPDK_TEST_UNITTEST == 1 || SPDK_RUN_FUNCTIONAL_TEST == 1)); then
00:38:41.406  00:30:22.174  => 27  		sudo -E $rootdir/autotest.sh "$conf"
00:38:41.406  00:30:22.174     28  	fi
00:38:41.406  00:30:22.174       ...
00:38:41.406  00:30:22.174  
00:38:41.406  00:30:22.174  ========== Backtrace end =========='
00:38:41.406  + [[ -n 00:30:01.440  ========== Backtrace start: ==========
00:38:41.406  00:30:01.440  
00:38:41.406  00:30:01.440  in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:677 -> NOT(["wait"],["96914"])
00:38:41.406  00:30:01.440       ...
00:38:41.406  00:30:01.440     672 		elif [[ -n ${EXIT_STATUS:-} ]] && ((es != EXIT_STATUS)); then
00:38:41.406  00:30:01.440     673 			es=0
00:38:41.406  00:30:01.440     674 		fi
00:38:41.406  00:30:01.440     675 	
00:38:41.406  00:30:01.440     676 		# invert error code of any command and also trigger ERR on 0 (unlike bash ! prefix)
00:38:41.406  00:30:01.440  => 677 		((!es == 0))
00:38:41.406  00:30:01.440     678 	}
00:38:41.406  00:30:01.440     679 	
00:38:41.406  00:30:01.440     680 	function timing() {
00:38:41.406  00:30:01.440     681 		direction="$1"
00:38:41.406  00:30:01.440     682 		testname="$2"
00:38:41.406  00:30:01.440       ...
00:38:41.406  00:30:01.440  in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh:158 -> nvmf_shutdown_tc4([])
00:38:41.406  00:30:01.440       ...
00:38:41.406  00:30:01.440     153 	
00:38:41.406  00:30:01.440     154 		# Kill the target half way through
00:38:41.406  00:30:01.440     155 		killprocess $nvmfpid
00:38:41.406  00:30:01.440     156 		sleep 1
00:38:41.406  00:30:01.440     157 		# Due to IOs are completed with errors, perf exits with bad status
00:38:41.406  00:30:01.440  => 158 		NOT wait $perfpid
00:38:41.406  00:30:01.440     159 		stoptarget
00:38:41.406  00:30:01.440     160 	}
00:38:41.406  00:30:01.440     161 	
00:38:41.406  00:30:01.440     162 	run_test "nvmf_shutdown_tc1" nvmf_shutdown_tc1
00:38:41.406  00:30:01.440     163 	run_test "nvmf_shutdown_tc2" nvmf_shutdown_tc2
00:38:41.406  00:30:01.440       ...
00:38:41.406  00:30:01.440  in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:1127 -> run_test(["nvmf_shutdown_tc4"],["nvmf_shutdown_tc4"])
00:38:41.406  00:30:01.440       ...
00:38:41.406  00:30:01.440     1122		timing_enter $test_name
00:38:41.406  00:30:01.440     1123		echo "************************************"
00:38:41.406  00:30:01.440     1124		echo "START TEST $test_name"
00:38:41.406  00:30:01.440     1125		echo "************************************"
00:38:41.406  00:30:01.440     1126		xtrace_restore
00:38:41.406  00:30:01.440     1127		time "$@"
00:38:41.406  00:30:01.440     1128		xtrace_disable
00:38:41.406  00:30:01.440     1129		echo "************************************"
00:38:41.406  00:30:01.440     1130		echo "END TEST $test_name"
00:38:41.406  00:30:01.440     1131		echo "************************************"
00:38:41.406  00:30:01.440     1132		timing_exit $test_name
00:38:41.406  00:30:01.440       ...
00:38:41.406  00:30:01.440  in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh:167 -> main(["--transport=tcp"])
00:38:41.406  00:30:01.440       ...
00:38:41.406  00:30:01.440     162 	run_test "nvmf_shutdown_tc1" nvmf_shutdown_tc1
00:38:41.406  00:30:01.440     163 	run_test "nvmf_shutdown_tc2" nvmf_shutdown_tc2
00:38:41.406  00:30:01.440     164 	run_test "nvmf_shutdown_tc3" nvmf_shutdown_tc3
00:38:41.406  00:30:01.440     165 	# Temporarily disable on e810 due to issue #3523
00:38:41.406  00:30:01.440     166 	if ! [[ "$SPDK_TEST_NVMF_NICS" == "e810" && "$TEST_TRANSPORT" == "rdma" ]]; then
00:38:41.406  00:30:01.440  => 167 		run_test "nvmf_shutdown_tc4" nvmf_shutdown_tc4
00:38:41.406  00:30:01.440     168 	fi
00:38:41.406  00:30:01.440     169 	
00:38:41.406  00:30:01.440     170 	trap - SIGINT SIGTERM EXIT
00:38:41.406  00:30:01.440       ...
00:38:41.406  00:30:01.440  
00:38:41.406  00:30:01.440  ========== Backtrace end ==========
00:38:41.406  00:30:04.240  ========== Backtrace start: ==========
00:38:41.406  00:30:04.240  
00:38:41.406  00:30:04.240  in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:1127 -> run_test(["nvmf_shutdown"],["/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh"],["--transport=tcp"])
00:38:41.406  00:30:04.240       ...
00:38:41.406  00:30:04.240     1122		timing_enter $test_name
00:38:41.406  00:30:04.240     1123		echo "************************************"
00:38:41.406  00:30:04.240     1124		echo "START TEST $test_name"
00:38:41.406  00:30:04.240     1125		echo "************************************"
00:38:41.406  00:30:04.240     1126		xtrace_restore
00:38:41.406  00:30:04.240     1127		time "$@"
00:38:41.406  00:30:04.240     1128		xtrace_disable
00:38:41.406  00:30:04.240     1129		echo "************************************"
00:38:41.406  00:30:04.240     1130		echo "END TEST $test_name"
00:38:41.406  00:30:04.240     1131		echo "************************************"
00:38:41.406  00:30:04.240     1132		timing_exit $test_name
00:38:41.406  00:30:04.240       ...
00:38:41.406  00:30:04.240  in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf_target_extra.sh:65 -> main(["--transport=tcp"])
00:38:41.406  00:30:04.240       ...
00:38:41.406  00:30:04.240     60  		elif [[ $SPDK_TEST_NVMF_TRANSPORT == "rdma" ]]; then
00:38:41.406  00:30:04.240     61  			# Disabled due to https://github.com/spdk/spdk/issues/3345
00:38:41.406  00:30:04.240     62  			# run_test "nvmf_device_removal" test/nvmf/target/device_removal.sh "${TEST_ARGS[@]}"
00:38:41.406  00:30:04.240     63  			run_test "nvmf_srq_overwhelm" "$rootdir/test/nvmf/target/srq_overwhelm.sh" "${TEST_ARGS[@]}"
00:38:41.406  00:30:04.240     64  		fi
00:38:41.406  00:30:04.240  => 65  		run_test "nvmf_shutdown" $rootdir/test/nvmf/target/shutdown.sh "${TEST_ARGS[@]}"
00:38:41.406  00:30:04.240     66  	fi
00:38:41.406  00:30:04.240     67  	
00:38:41.406  00:30:04.240     68  	trap - SIGINT SIGTERM EXIT
00:38:41.406  00:30:04.240       ...
00:38:41.406  00:30:04.240  
00:38:41.406  00:30:04.240  ========== Backtrace end ==========
00:38:41.406  00:30:04.240  ========== Backtrace start: ==========
00:38:41.406  00:30:04.240  
00:38:41.406  00:30:04.240  in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:1127 -> run_test(["nvmf_target_extra"],["/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf_target_extra.sh"],["--transport=tcp"])
00:38:41.406  00:30:04.240       ...
00:38:41.406  00:30:04.240     1122		timing_enter $test_name
00:38:41.406  00:30:04.240     1123		echo "************************************"
00:38:41.406  00:30:04.240     1124		echo "START TEST $test_name"
00:38:41.406  00:30:04.240     1125		echo "************************************"
00:38:41.406  00:30:04.240     1126		xtrace_restore
00:38:41.406  00:30:04.240     1127		time "$@"
00:38:41.406  00:30:04.240     1128		xtrace_disable
00:38:41.406  00:30:04.240     1129		echo "************************************"
00:38:41.406  00:30:04.240     1130		echo "END TEST $test_name"
00:38:41.406  00:30:04.240     1131		echo "************************************"
00:38:41.406  00:30:04.240     1132		timing_exit $test_name
00:38:41.406  00:30:04.240       ...
00:38:41.406  00:30:04.240  in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh:15 -> main(["--transport=tcp"])
00:38:41.406  00:30:04.240       ...
00:38:41.406  00:30:04.240     10  	if [ ! $(uname -s) = Linux ]; then
00:38:41.407  00:30:04.240     11  		exit 0
00:38:41.407  00:30:04.240     12  	fi
00:38:41.407  00:30:04.240     13  	
00:38:41.407  00:30:04.240     14  	run_test "nvmf_target_core" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT
00:38:41.407  00:30:04.240  => 15  	run_test "nvmf_target_extra" $rootdir/test/nvmf/nvmf_target_extra.sh --transport=$SPDK_TEST_NVMF_TRANSPORT
00:38:41.407  00:30:04.240     16  	run_test "nvmf_host" $rootdir/test/nvmf/nvmf_host.sh --transport=$SPDK_TEST_NVMF_TRANSPORT
00:38:41.407  00:30:04.240     17  	
00:38:41.407  00:30:04.240     18  	# Interrupt mode for now is supported only on the target, with the TCP transport and posix or ssl socket implementations.
00:38:41.407  00:30:04.240     19  	if [[ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" && $SPDK_TEST_URING -eq 0 ]]; then
00:38:41.407  00:30:04.240     20  		run_test "nvmf_target_core_interrupt_mode" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT --interrupt-mode
00:38:41.407  00:30:04.240       ...
00:38:41.407  00:30:04.240  
00:38:41.407  00:30:04.240  ========== Backtrace end ==========
00:38:41.407  00:30:04.241  ========== Backtrace start: ==========
00:38:41.407  00:30:04.241  
00:38:41.407  00:30:04.241  in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:1127 -> run_test(["nvmf_tcp"],["/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh"],["--transport=tcp"])
00:38:41.407  00:30:04.241       ...
00:38:41.407  00:30:04.241     1122		timing_enter $test_name
00:38:41.407  00:30:04.241     1123		echo "************************************"
00:38:41.407  00:30:04.241     1124		echo "START TEST $test_name"
00:38:41.407  00:30:04.241     1125		echo "************************************"
00:38:41.407  00:30:04.241     1126		xtrace_restore
00:38:41.407  00:30:04.241     1127		time "$@"
00:38:41.407  00:30:04.241     1128		xtrace_disable
00:38:41.407  00:30:04.241     1129		echo "************************************"
00:38:41.407  00:30:04.241     1130		echo "END TEST $test_name"
00:38:41.407  00:30:04.241     1131		echo "************************************"
00:38:41.407  00:30:04.241     1132		timing_exit $test_name
00:38:41.407  00:30:04.241       ...
00:38:41.407  00:30:04.241  in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh:280 -> main(["/var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf"])
00:38:41.407  00:30:04.241       ...
00:38:41.407  00:30:04.241     275 			# list of all tests can properly differentiate them. Please do not merge them into one line.
00:38:41.407  00:30:04.241     276 			if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then
00:38:41.407  00:30:04.241     277 				run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT
00:38:41.407  00:30:04.241     278 				run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT
00:38:41.407  00:30:04.241     279 			elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then
00:38:41.407  00:30:04.241  => 280 				run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT
00:38:41.407  00:30:04.241     281 				if [[ $SPDK_TEST_URING -eq 0 ]]; then
00:38:41.407  00:30:04.241     282 					run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT
00:38:41.407  00:30:04.241     283 					run_test "nvmf_identify_passthru" $rootdir/test/nvmf/target/identify_passthru.sh --transport=$SPDK_TEST_NVMF_TRANSPORT
00:38:41.407  00:30:04.241     284 				fi
00:38:41.407  00:30:04.241     285 				run_test "nvmf_dif" $rootdir/test/nvmf/target/dif.sh
00:38:41.407  00:30:04.241       ...
00:38:41.407  00:30:04.241  
00:38:41.407  00:30:04.241  ========== Backtrace end ==========
00:38:41.407  00:30:22.174  ========== Backtrace start: ==========
00:38:41.407  00:30:22.174  
00:38:41.407  00:30:22.174  in spdk/autorun.sh:27 -> main(["/var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf"])
00:38:41.407  00:30:22.174       ...
00:38:41.407  00:30:22.174     22  	trap 'timing_finish || exit 1' EXIT
00:38:41.407  00:30:22.174     23  	
00:38:41.407  00:30:22.174     24  	# Runs agent scripts
00:38:41.407  00:30:22.174     25  	$rootdir/autobuild.sh "$conf"
00:38:41.407  00:30:22.174     26  	if ((SPDK_TEST_UNITTEST == 1 || SPDK_RUN_FUNCTIONAL_TEST == 1)); then
00:38:41.407  00:30:22.174  => 27  		sudo -E $rootdir/autotest.sh "$conf"
00:38:41.407  00:30:22.174     28  	fi
00:38:41.407  00:30:22.174       ...
00:38:41.407  00:30:22.174  
00:38:41.407  00:30:22.174  ========== Backtrace end ========== ]]
00:38:41.407  + echo '00:30:01.440  ========== Backtrace start: ==========
00:38:41.407  00:30:01.440  
00:38:41.407  00:30:01.440  in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:677 -> NOT(["wait"],["96914"])
00:38:41.407  00:30:01.440       ...
00:38:41.407  00:30:01.440     672 		elif [[ -n ${EXIT_STATUS:-} ]] && ((es != EXIT_STATUS)); then
00:38:41.407  00:30:01.440     673 			es=0
00:38:41.407  00:30:01.440     674 		fi
00:38:41.407  00:30:01.440     675 	
00:38:41.407  00:30:01.440     676 		# invert error code of any command and also trigger ERR on 0 (unlike bash ! prefix)
00:38:41.407  00:30:01.440  => 677 		((!es == 0))
00:38:41.407  00:30:01.440     678 	}
00:38:41.407  00:30:01.440     679 	
00:38:41.407  00:30:01.440     680 	function timing() {
00:38:41.407  00:30:01.440     681 		direction="$1"
00:38:41.407  00:30:01.440     682 		testname="$2"
00:38:41.407  00:30:01.440       ...
00:38:41.407  00:30:01.440  in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh:158 -> nvmf_shutdown_tc4([])
00:38:41.407  00:30:01.440       ...
00:38:41.407  00:30:01.440     153 	
00:38:41.407  00:30:01.440     154 		# Kill the target half way through
00:38:41.407  00:30:01.440     155 		killprocess $nvmfpid
00:38:41.407  00:30:01.440     156 		sleep 1
00:38:41.407  00:30:01.440     157 		# Due to IOs are completed with errors, perf exits with bad status
00:38:41.407  00:30:01.440  => 158 		NOT wait $perfpid
00:38:41.407  00:30:01.440     159 		stoptarget
00:38:41.407  00:30:01.440     160 	}
00:38:41.407  00:30:01.440     161 	
00:38:41.407  00:30:01.440     162 	run_test "nvmf_shutdown_tc1" nvmf_shutdown_tc1
00:38:41.407  00:30:01.440     163 	run_test "nvmf_shutdown_tc2" nvmf_shutdown_tc2
00:38:41.407  00:30:01.440       ...
00:38:41.407  00:30:01.440  in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:1127 -> run_test(["nvmf_shutdown_tc4"],["nvmf_shutdown_tc4"])
00:38:41.407  00:30:01.440       ...
00:38:41.407  00:30:01.440     1122		timing_enter $test_name
00:38:41.407  00:30:01.440     1123		echo "************************************"
00:38:41.407  00:30:01.440     1124		echo "START TEST $test_name"
00:38:41.407  00:30:01.440     1125		echo "************************************"
00:38:41.407  00:30:01.440     1126		xtrace_restore
00:38:41.407  00:30:01.440     1127		time "$@"
00:38:41.407  00:30:01.440     1128		xtrace_disable
00:38:41.407  00:30:01.440     1129		echo "************************************"
00:38:41.407  00:30:01.440     1130		echo "END TEST $test_name"
00:38:41.407  00:30:01.440     1131		echo "************************************"
00:38:41.407  00:30:01.440     1132		timing_exit $test_name
00:38:41.407  00:30:01.440       ...
00:38:41.407  00:30:01.440  in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh:167 -> main(["--transport=tcp"])
00:38:41.407  00:30:01.440       ...
00:38:41.407  00:30:01.440     162 	run_test "nvmf_shutdown_tc1" nvmf_shutdown_tc1
00:38:41.407  00:30:01.440     163 	run_test "nvmf_shutdown_tc2" nvmf_shutdown_tc2
00:38:41.407  00:30:01.440     164 	run_test "nvmf_shutdown_tc3" nvmf_shutdown_tc3
00:38:41.407  00:30:01.440     165 	# Temporarily disable on e810 due to issue #3523
00:38:41.407  00:30:01.440     166 	if ! [[ "$SPDK_TEST_NVMF_NICS" == "e810" && "$TEST_TRANSPORT" == "rdma" ]]; then
00:38:41.407  00:30:01.440  => 167 		run_test "nvmf_shutdown_tc4" nvmf_shutdown_tc4
00:38:41.407  00:30:01.440     168 	fi
00:38:41.407  00:30:01.440     169 	
00:38:41.407  00:30:01.440     170 	trap - SIGINT SIGTERM EXIT
00:38:41.407  00:30:01.440       ...
00:38:41.407  00:30:01.440  
00:38:41.407  00:30:01.440  ========== Backtrace end ==========
00:38:41.407  00:30:04.240  ========== Backtrace start: ==========
00:38:41.407  00:30:04.240  
00:38:41.407  00:30:04.240  in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:1127 -> run_test(["nvmf_shutdown"],["/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh"],["--transport=tcp"])
00:38:41.407  00:30:04.240       ...
00:38:41.407  00:30:04.240     1122		timing_enter $test_name
00:38:41.407  00:30:04.240     1123		echo "************************************"
00:38:41.407  00:30:04.240     1124		echo "START TEST $test_name"
00:38:41.407  00:30:04.240     1125		echo "************************************"
00:38:41.407  00:30:04.240     1126		xtrace_restore
00:38:41.407  00:30:04.240     1127		time "$@"
00:38:41.407  00:30:04.240     1128		xtrace_disable
00:38:41.407  00:30:04.240     1129		echo "************************************"
00:38:41.407  00:30:04.240     1130		echo "END TEST $test_name"
00:38:41.407  00:30:04.240     1131		echo "************************************"
00:38:41.407  00:30:04.240     1132		timing_exit $test_name
00:38:41.407  00:30:04.240       ...
00:38:41.407  00:30:04.240  in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf_target_extra.sh:65 -> main(["--transport=tcp"])
00:38:41.407  00:30:04.240       ...
00:38:41.407  00:30:04.240     60  		elif [[ $SPDK_TEST_NVMF_TRANSPORT == "rdma" ]]; then
00:38:41.407  00:30:04.240     61  			# Disabled due to https://github.com/spdk/spdk/issues/3345
00:38:41.407  00:30:04.240     62  			# run_test "nvmf_device_removal" test/nvmf/target/device_removal.sh "${TEST_ARGS[@]}"
00:38:41.407  00:30:04.240     63  			run_test "nvmf_srq_overwhelm" "$rootdir/test/nvmf/target/srq_overwhelm.sh" "${TEST_ARGS[@]}"
00:38:41.407  00:30:04.240     64  		fi
00:38:41.407  00:30:04.240  => 65  		run_test "nvmf_shutdown" $rootdir/test/nvmf/target/shutdown.sh "${TEST_ARGS[@]}"
00:38:41.407  00:30:04.240     66  	fi
00:38:41.407  00:30:04.240     67  	
00:38:41.407  00:30:04.240     68  	trap - SIGINT SIGTERM EXIT
00:38:41.407  00:30:04.240       ...
00:38:41.407  00:30:04.240  
00:38:41.407  00:30:04.240  ========== Backtrace end ==========
00:38:41.407  00:30:04.240  ========== Backtrace start: ==========
00:38:41.407  00:30:04.240  
00:38:41.407  00:30:04.240  in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:1127 -> run_test(["nvmf_target_extra"],["/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf_target_extra.sh"],["--transport=tcp"])
00:38:41.407  00:30:04.240       ...
00:38:41.407  00:30:04.240     1122		timing_enter $test_name
00:38:41.407  00:30:04.240     1123		echo "************************************"
00:38:41.407  00:30:04.240     1124		echo "START TEST $test_name"
00:38:41.407  00:30:04.240     1125		echo "************************************"
00:38:41.407  00:30:04.240     1126		xtrace_restore
00:38:41.407  00:30:04.240     1127		time "$@"
00:38:41.407  00:30:04.240     1128		xtrace_disable
00:38:41.407  00:30:04.240     1129		echo "************************************"
00:38:41.407  00:30:04.240     1130		echo "END TEST $test_name"
00:38:41.407  00:30:04.240     1131		echo "************************************"
00:38:41.407  00:30:04.240     1132		timing_exit $test_name
00:38:41.407  00:30:04.240       ...
00:38:41.407  00:30:04.240  in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh:15 -> main(["--transport=tcp"])
00:38:41.407  00:30:04.240       ...
00:38:41.407  00:30:04.240     10  	if [ ! $(uname -s) = Linux ]; then
00:38:41.407  00:30:04.240     11  		exit 0
00:38:41.407  00:30:04.240     12  	fi
00:38:41.407  00:30:04.240     13  	
00:38:41.407  00:30:04.240     14  	run_test "nvmf_target_core" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT
00:38:41.407  00:30:04.240  => 15  	run_test "nvmf_target_extra" $rootdir/test/nvmf/nvmf_target_extra.sh --transport=$SPDK_TEST_NVMF_TRANSPORT
00:38:41.407  00:30:04.240     16  	run_test "nvmf_host" $rootdir/test/nvmf/nvmf_host.sh --transport=$SPDK_TEST_NVMF_TRANSPORT
00:38:41.407  00:30:04.240     17  	
00:38:41.408  00:30:04.240     18  	# Interrupt mode for now is supported only on the target, with the TCP transport and posix or ssl socket implementations.
00:38:41.408  00:30:04.240     19  	if [[ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" && $SPDK_TEST_URING -eq 0 ]]; then
00:38:41.408  00:30:04.240     20  		run_test "nvmf_target_core_interrupt_mode" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT --interrupt-mode
00:38:41.408  00:30:04.240       ...
00:38:41.408  00:30:04.240  
00:38:41.408  00:30:04.240  ========== Backtrace end ==========
00:38:41.408  00:30:04.241  ========== Backtrace start: ==========
00:38:41.408  00:30:04.241  
00:38:41.408  00:30:04.241  in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh:1127 -> run_test(["nvmf_tcp"],["/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh"],["--transport=tcp"])
00:38:41.408  00:30:04.241       ...
00:38:41.408  00:30:04.241     1122		timing_enter $test_name
00:38:41.408  00:30:04.241     1123		echo "************************************"
00:38:41.408  00:30:04.241     1124		echo "START TEST $test_name"
00:38:41.408  00:30:04.241     1125		echo "************************************"
00:38:41.408  00:30:04.241     1126		xtrace_restore
00:38:41.408  00:30:04.241     1127		time "$@"
00:38:41.408  00:30:04.241     1128		xtrace_disable
00:38:41.408  00:30:04.241     1129		echo "************************************"
00:38:41.408  00:30:04.241     1130		echo "END TEST $test_name"
00:38:41.408  00:30:04.241     1131		echo "************************************"
00:38:41.408  00:30:04.241     1132		timing_exit $test_name
00:38:41.408  00:30:04.241       ...
00:38:41.408  00:30:04.241  in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh:280 -> main(["/var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf"])
00:38:41.408  00:30:04.241       ...
00:38:41.408  00:30:04.241     275 			# list of all tests can properly differentiate them. Please do not merge them into one line.
00:38:41.408  00:30:04.241     276 			if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then
00:38:41.408  00:30:04.241     277 				run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT
00:38:41.408  00:30:04.241     278 				run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT
00:38:41.408  00:30:04.241     279 			elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then
00:38:41.408  00:30:04.241  => 280 				run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT
00:38:41.408  00:30:04.241     281 				if [[ $SPDK_TEST_URING -eq 0 ]]; then
00:38:41.408  00:30:04.241     282 					run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT
00:38:41.408  00:30:04.241     283 					run_test "nvmf_identify_passthru" $rootdir/test/nvmf/target/identify_passthru.sh --transport=$SPDK_TEST_NVMF_TRANSPORT
00:38:41.408  00:30:04.241     284 				fi
00:38:41.408  00:30:04.241     285 				run_test "nvmf_dif" $rootdir/test/nvmf/target/dif.sh
00:38:41.408  00:30:04.241       ...
00:38:41.408  00:30:04.241  
00:38:41.408  00:30:04.241  ========== Backtrace end ==========
00:38:41.408  00:30:22.174  ========== Backtrace start: ==========
00:38:41.408  00:30:22.174  
00:38:41.408  00:30:22.174  in spdk/autorun.sh:27 -> main(["/var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf"])
00:38:41.408  00:30:22.174       ...
00:38:41.408  00:30:22.174     22  	trap '\''timing_finish || exit 1'\'' EXIT
00:38:41.408  00:30:22.174     23  	
00:38:41.408  00:30:22.174     24  	# Runs agent scripts
00:38:41.408  00:30:22.174     25  	$rootdir/autobuild.sh "$conf"
00:38:41.408  00:30:22.174     26  	if ((SPDK_TEST_UNITTEST == 1 || SPDK_RUN_FUNCTIONAL_TEST == 1)); then
00:38:41.408  00:30:22.174  => 27  		sudo -E $rootdir/autotest.sh "$conf"
00:38:41.408  00:30:22.174     28  	fi
00:38:41.408  00:30:22.174       ...
00:38:41.408  00:30:22.174  
00:38:41.408  00:30:22.174  ========== Backtrace end =========='
00:38:41.408  + run_flamegraph
00:38:41.408  + create_timing_file
00:38:41.408  + local array file
00:38:41.408  + array=($(find $WORKSPACE -type f -name 'timing.txt'))
00:38:41.408  ++ find /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11 -type f -name timing.txt
00:38:41.408  + timing_dir=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/post_process
00:38:41.408  + mkdir -p /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/post_process
00:38:41.408  + timing_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/post_process/total_timing.txt
00:38:41.408  + for file in "${array[@]}"
00:38:41.408  + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-phy-autotest_86277/timing.txt
00:38:41.408  + local job_file job_name
00:38:41.408  + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-phy-autotest_86277/timing.txt
00:38:41.408  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-phy-autotest_86277/timing.txt
00:38:41.408  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-phy-autotest_86277
00:38:41.408  + job_name=nvme-phy-autotest_86277
00:38:41.408  + sed 's/^/nvme-phy-autotest_86277;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-phy-autotest_86277/timing.txt
00:38:41.408  + for file in "${array[@]}"
00:38:41.408  + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/crypto-phy-autotest_40095/timing.txt
00:38:41.408  + local job_file job_name
00:38:41.408  + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/crypto-phy-autotest_40095/timing.txt
00:38:41.408  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/crypto-phy-autotest_40095/timing.txt
00:38:41.408  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/crypto-phy-autotest_40095
00:38:41.408  + job_name=crypto-phy-autotest_40095
00:38:41.408  + sed 's/^/crypto-phy-autotest_40095;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/crypto-phy-autotest_40095/timing.txt
00:38:41.408  + for file in "${array[@]}"
00:38:41.408  + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-vg-autotest_92517/timing.txt
00:38:41.408  + local job_file job_name
00:38:41.408  + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-vg-autotest_92517/timing.txt
00:38:41.408  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-vg-autotest_92517/timing.txt
00:38:41.408  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-vg-autotest_92517
00:38:41.408  + job_name=nvme-vg-autotest_92517
00:38:41.408  + sed 's/^/nvme-vg-autotest_92517;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-vg-autotest_92517/timing.txt
00:38:41.408  + for file in "${array[@]}"
00:38:41.408  + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-valgrind-docker-autotest_31648/timing.txt
00:38:41.408  + local job_file job_name
00:38:41.408  + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-valgrind-docker-autotest_31648/timing.txt
00:38:41.408  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-valgrind-docker-autotest_31648/timing.txt
00:38:41.408  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-valgrind-docker-autotest_31648
00:38:41.408  + job_name=unittest-valgrind-docker-autotest_31648
00:38:41.408  + sed 's/^/unittest-valgrind-docker-autotest_31648;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-valgrind-docker-autotest_31648/timing.txt
00:38:41.408  + for file in "${array[@]}"
00:38:41.408  + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/check-so-deps-docker-autotest_35218/timing.txt
00:38:41.408  + local job_file job_name
00:38:41.408  + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/check-so-deps-docker-autotest_35218/timing.txt
00:38:41.408  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/check-so-deps-docker-autotest_35218/timing.txt
00:38:41.408  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/check-so-deps-docker-autotest_35218
00:38:41.408  + job_name=check-so-deps-docker-autotest_35218
00:38:41.408  + sed 's/^/check-so-deps-docker-autotest_35218;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/check-so-deps-docker-autotest_35218/timing.txt
00:38:41.408  + for file in "${array[@]}"
00:38:41.408  + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-uring-vg-autotest_92459/timing.txt
00:38:41.408  + local job_file job_name
00:38:41.408  + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-uring-vg-autotest_92459/timing.txt
00:38:41.408  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-uring-vg-autotest_92459/timing.txt
00:38:41.408  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-uring-vg-autotest_92459
00:38:41.408  + job_name=nvmf-tcp-uring-vg-autotest_92459
00:38:41.408  + sed 's/^/nvmf-tcp-uring-vg-autotest_92459;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-uring-vg-autotest_92459/timing.txt
00:38:41.408  + for file in "${array[@]}"
00:38:41.408  + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/short-fuzz-phy-autotest_40089/timing.txt
00:38:41.408  + local job_file job_name
00:38:41.408  + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/short-fuzz-phy-autotest_40089/timing.txt
00:38:41.408  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/short-fuzz-phy-autotest_40089/timing.txt
00:38:41.408  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/short-fuzz-phy-autotest_40089
00:38:41.408  + job_name=short-fuzz-phy-autotest_40089
00:38:41.408  + sed 's/^/short-fuzz-phy-autotest_40089;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/short-fuzz-phy-autotest_40089/timing.txt
00:38:41.408  + for file in "${array[@]}"
00:38:41.408  + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vfio-user-phy-autotest_40093/timing.txt
00:38:41.408  + local job_file job_name
00:38:41.408  + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vfio-user-phy-autotest_40093/timing.txt
00:38:41.408  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vfio-user-phy-autotest_40093/timing.txt
00:38:41.408  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vfio-user-phy-autotest_40093
00:38:41.408  + job_name=vfio-user-phy-autotest_40093
00:38:41.408  + sed 's/^/vfio-user-phy-autotest_40093;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vfio-user-phy-autotest_40093/timing.txt
00:38:41.408  + for file in "${array[@]}"
00:38:41.408  + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-main-docker-autotest_31648/timing.txt
00:38:41.408  + local job_file job_name
00:38:41.408  + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-main-docker-autotest_31648/timing.txt
00:38:41.408  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-main-docker-autotest_31648/timing.txt
00:38:41.408  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-main-docker-autotest_31648
00:38:41.408  + job_name=unittest-main-docker-autotest_31648
00:38:41.408  + sed 's/^/unittest-main-docker-autotest_31648;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-main-docker-autotest_31648/timing.txt
00:38:41.408  + for file in "${array[@]}"
00:38:41.408  + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-clang-docker-autotest_31645/timing.txt
00:38:41.408  + local job_file job_name
00:38:41.408  + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-clang-docker-autotest_31645/timing.txt
00:38:41.408  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-clang-docker-autotest_31645/timing.txt
00:38:41.408  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-clang-docker-autotest_31645
00:38:41.408  + job_name=unittest-clang-docker-autotest_31645
00:38:41.408  + sed 's/^/unittest-clang-docker-autotest_31645;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-clang-docker-autotest_31645/timing.txt
00:38:41.408  + for file in "${array[@]}"
00:38:41.408  + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/doc-docker-autotest_35310/timing.txt
00:38:41.408  + local job_file job_name
00:38:41.408  + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/doc-docker-autotest_35310/timing.txt
00:38:41.408  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/doc-docker-autotest_35310/timing.txt
00:38:41.409  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/doc-docker-autotest_35310
00:38:41.409  + job_name=doc-docker-autotest_35310
00:38:41.409  + sed 's/^/doc-docker-autotest_35310;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/doc-docker-autotest_35310/timing.txt
00:38:41.409  + for file in "${array[@]}"
00:38:41.409  + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/raid-vg-autotest_6908/timing.txt
00:38:41.409  + local job_file job_name
00:38:41.409  + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/raid-vg-autotest_6908/timing.txt
00:38:41.409  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/raid-vg-autotest_6908/timing.txt
00:38:41.409  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/raid-vg-autotest_6908
00:38:41.409  + job_name=raid-vg-autotest_6908
00:38:41.409  + sed 's/^/raid-vg-autotest_6908;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/raid-vg-autotest_6908/timing.txt
00:38:41.409  + for file in "${array[@]}"
00:38:41.409  + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-vg-autotest_92552/timing.txt
00:38:41.409  + local job_file job_name
00:38:41.409  + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-vg-autotest_92552/timing.txt
00:38:41.409  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-vg-autotest_92552/timing.txt
00:38:41.409  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-vg-autotest_92552
00:38:41.409  + job_name=iscsi-vg-autotest_92552
00:38:41.409  + sed 's/^/iscsi-vg-autotest_92552;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-vg-autotest_92552/timing.txt
00:38:41.409  + for file in "${array[@]}"
00:38:41.409  + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-cmb-pmr-vg-autotest_93642/timing.txt
00:38:41.409  + local job_file job_name
00:38:41.409  + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-cmb-pmr-vg-autotest_93642/timing.txt
00:38:41.409  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-cmb-pmr-vg-autotest_93642/timing.txt
00:38:41.409  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-cmb-pmr-vg-autotest_93642
00:38:41.409  + job_name=nvme-cmb-pmr-vg-autotest_93642
00:38:41.409  + sed 's/^/nvme-cmb-pmr-vg-autotest_93642;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-cmb-pmr-vg-autotest_93642/timing.txt
00:38:41.409  + for file in "${array[@]}"
00:38:41.409  + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/release-build-main-docker-autotest_4752/timing.txt
00:38:41.409  + local job_file job_name
00:38:41.409  + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/release-build-main-docker-autotest_4752/timing.txt
00:38:41.409  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/release-build-main-docker-autotest_4752/timing.txt
00:38:41.409  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/release-build-main-docker-autotest_4752
00:38:41.409  + job_name=release-build-main-docker-autotest_4752
00:38:41.409  + sed 's/^/release-build-main-docker-autotest_4752;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/release-build-main-docker-autotest_4752/timing.txt
00:38:41.409  + for file in "${array[@]}"
00:38:41.409  + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/zns-vg-autotest_91612/timing.txt
00:38:41.409  + local job_file job_name
00:38:41.409  + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/zns-vg-autotest_91612/timing.txt
00:38:41.409  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/zns-vg-autotest_91612/timing.txt
00:38:41.409  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/zns-vg-autotest_91612
00:38:41.409  + job_name=zns-vg-autotest_91612
00:38:41.409  + sed 's/^/zns-vg-autotest_91612;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/zns-vg-autotest_91612/timing.txt
00:38:41.409  + for file in "${array[@]}"
00:38:41.409  + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu24-vg-autotest_8796/timing.txt
00:38:41.409  + local job_file job_name
00:38:41.409  + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu24-vg-autotest_8796/timing.txt
00:38:41.409  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu24-vg-autotest_8796/timing.txt
00:38:41.409  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu24-vg-autotest_8796
00:38:41.409  + job_name=ubuntu24-vg-autotest_8796
00:38:41.409  + sed 's/^/ubuntu24-vg-autotest_8796;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu24-vg-autotest_8796/timing.txt
00:38:41.409  + for file in "${array[@]}"
00:38:41.409  + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/rocky9-vg-autotest_29599/timing.txt
00:38:41.409  + local job_file job_name
00:38:41.409  + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/rocky9-vg-autotest_29599/timing.txt
00:38:41.409  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/rocky9-vg-autotest_29599/timing.txt
00:38:41.409  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/rocky9-vg-autotest_29599
00:38:41.409  + job_name=rocky9-vg-autotest_29599
00:38:41.409  + sed 's/^/rocky9-vg-autotest_29599;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/rocky9-vg-autotest_29599/timing.txt
00:38:41.409  + for file in "${array[@]}"
00:38:41.409  + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/lvol-vg-autotest_92462/timing.txt
00:38:41.409  + local job_file job_name
00:38:41.409  + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/lvol-vg-autotest_92462/timing.txt
00:38:41.409  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/lvol-vg-autotest_92462/timing.txt
00:38:41.409  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/lvol-vg-autotest_92462
00:38:41.409  + job_name=lvol-vg-autotest_92462
00:38:41.409  + sed 's/^/lvol-vg-autotest_92462;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/lvol-vg-autotest_92462/timing.txt
00:38:41.409  + for file in "${array[@]}"
00:38:41.409  + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-initiator-vg-autotest_92539/timing.txt
00:38:41.409  + local job_file job_name
00:38:41.409  + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-initiator-vg-autotest_92539/timing.txt
00:38:41.409  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-initiator-vg-autotest_92539/timing.txt
00:38:41.409  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-initiator-vg-autotest_92539
00:38:41.409  + job_name=vhost-initiator-vg-autotest_92539
00:38:41.409  + sed 's/^/vhost-initiator-vg-autotest_92539;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-initiator-vg-autotest_92539/timing.txt
00:38:41.409  + for file in "${array[@]}"
00:38:41.409  + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vmd-phy-autotest_6438/timing.txt
00:38:41.409  + local job_file job_name
00:38:41.409  + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vmd-phy-autotest_6438/timing.txt
00:38:41.409  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vmd-phy-autotest_6438/timing.txt
00:38:41.409  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vmd-phy-autotest_6438
00:38:41.409  + job_name=vmd-phy-autotest_6438
00:38:41.409  + sed 's/^/vmd-phy-autotest_6438;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vmd-phy-autotest_6438/timing.txt
00:38:41.409  + for file in "${array[@]}"
00:38:41.409  + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-uring-vg-autotest_92417/timing.txt
00:38:41.409  + local job_file job_name
00:38:41.409  + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-uring-vg-autotest_92417/timing.txt
00:38:41.409  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-uring-vg-autotest_92417/timing.txt
00:38:41.409  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-uring-vg-autotest_92417
00:38:41.409  + job_name=iscsi-uring-vg-autotest_92417
00:38:41.409  + sed 's/^/iscsi-uring-vg-autotest_92417;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-uring-vg-autotest_92417/timing.txt
00:38:41.409  + for file in "${array[@]}"
00:38:41.409  + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/scan-build-docker-autotest_31656/timing.txt
00:38:41.409  + local job_file job_name
00:38:41.409  + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/scan-build-docker-autotest_31656/timing.txt
00:38:41.409  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/scan-build-docker-autotest_31656/timing.txt
00:38:41.409  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/scan-build-docker-autotest_31656
00:38:41.409  + job_name=scan-build-docker-autotest_31656
00:38:41.409  + sed 's/^/scan-build-docker-autotest_31656;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/scan-build-docker-autotest_31656/timing.txt
00:38:41.409  + for file in "${array[@]}"
00:38:41.409  + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/release-build-clang-docker-autotest_4751/timing.txt
00:38:41.409  + local job_file job_name
00:38:41.409  + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/release-build-clang-docker-autotest_4751/timing.txt
00:38:41.409  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/release-build-clang-docker-autotest_4751/timing.txt
00:38:41.409  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/release-build-clang-docker-autotest_4751
00:38:41.409  + job_name=release-build-clang-docker-autotest_4751
00:38:41.409  + sed 's/^/release-build-clang-docker-autotest_4751;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/release-build-clang-docker-autotest_4751/timing.txt
00:38:41.409  + for file in "${array[@]}"
00:38:41.409  + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/packaging-docker-autotest_31644/timing.txt
00:38:41.409  + local job_file job_name
00:38:41.409  + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/packaging-docker-autotest_31644/timing.txt
00:38:41.409  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/packaging-docker-autotest_31644/timing.txt
00:38:41.409  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/packaging-docker-autotest_31644
00:38:41.409  + job_name=packaging-docker-autotest_31644
00:38:41.410  + sed 's/^/packaging-docker-autotest_31644;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/packaging-docker-autotest_31644/timing.txt
00:38:41.410  + for file in "${array[@]}"
00:38:41.410  + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/check-format-docker-autotest_34995/timing.txt
00:38:41.410  + local job_file job_name
00:38:41.410  + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/check-format-docker-autotest_34995/timing.txt
00:38:41.410  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/check-format-docker-autotest_34995/timing.txt
00:38:41.410  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/check-format-docker-autotest_34995
00:38:41.410  + job_name=check-format-docker-autotest_34995
00:38:41.410  + sed 's/^/check-format-docker-autotest_34995;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/check-format-docker-autotest_34995/timing.txt
00:38:41.410  + for file in "${array[@]}"
00:38:41.410  + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-vg-autotest_92494/timing.txt
00:38:41.410  + local job_file job_name
00:38:41.410  + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-vg-autotest_92494/timing.txt
00:38:41.410  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-vg-autotest_92494/timing.txt
00:38:41.410  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-vg-autotest_92494
00:38:41.410  + job_name=nvmf-tcp-vg-autotest_92494
00:38:41.410  + sed 's/^/nvmf-tcp-vg-autotest_92494;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-vg-autotest_92494/timing.txt
00:38:41.410  + for file in "${array[@]}"
00:38:41.410  + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/build-files-docker-autotest_34970/timing.txt
00:38:41.410  + local job_file job_name
00:38:41.410  + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/build-files-docker-autotest_34970/timing.txt
00:38:41.410  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/build-files-docker-autotest_34970/timing.txt
00:38:41.410  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/build-files-docker-autotest_34970
00:38:41.410  + job_name=build-files-docker-autotest_34970
00:38:41.410  + sed 's/^/build-files-docker-autotest_34970;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/build-files-docker-autotest_34970/timing.txt
00:38:41.410  + for file in "${array[@]}"
00:38:41.410  + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/BlobFS-phy-autotest_40100/timing.txt
00:38:41.410  + local job_file job_name
00:38:41.410  + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/BlobFS-phy-autotest_40100/timing.txt
00:38:41.410  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/BlobFS-phy-autotest_40100/timing.txt
00:38:41.410  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/BlobFS-phy-autotest_40100
00:38:41.410  + job_name=BlobFS-phy-autotest_40100
00:38:41.410  + sed 's/^/BlobFS-phy-autotest_40100;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/BlobFS-phy-autotest_40100/timing.txt
00:38:41.410  + for file in "${array[@]}"
00:38:41.410  + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu22-vg-autotest_51254/timing.txt
00:38:41.410  + local job_file job_name
00:38:41.410  + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu22-vg-autotest_51254/timing.txt
00:38:41.410  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu22-vg-autotest_51254/timing.txt
00:38:41.410  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu22-vg-autotest_51254
00:38:41.410  + job_name=ubuntu22-vg-autotest_51254
00:38:41.410  + sed 's/^/ubuntu22-vg-autotest_51254;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu22-vg-autotest_51254/timing.txt
00:38:41.410  + for file in "${array[@]}"
00:38:41.410  + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-phy-autotest_40159/timing.txt
00:38:41.410  + local job_file job_name
00:38:41.410  + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-phy-autotest_40159/timing.txt
00:38:41.410  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-phy-autotest_40159/timing.txt
00:38:41.410  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-phy-autotest_40159
00:38:41.410  + job_name=vhost-phy-autotest_40159
00:38:41.410  + sed 's/^/vhost-phy-autotest_40159;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-phy-autotest_40159/timing.txt
00:38:41.410  + for file in "${array[@]}"
00:38:41.410  + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/autobuild-external-vg-autotest_32291/timing.txt
00:38:41.410  + local job_file job_name
00:38:41.410  + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/autobuild-external-vg-autotest_32291/timing.txt
00:38:41.410  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/autobuild-external-vg-autotest_32291/timing.txt
00:38:41.410  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/autobuild-external-vg-autotest_32291
00:38:41.410  + job_name=autobuild-external-vg-autotest_32291
00:38:41.410  + sed 's/^/autobuild-external-vg-autotest_32291;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/autobuild-external-vg-autotest_32291/timing.txt
00:38:41.410  + for file in "${array[@]}"
00:38:41.410  + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-phy-autotest_86336/timing.txt
00:38:41.410  + local job_file job_name
00:38:41.410  + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-phy-autotest_86336/timing.txt
00:38:41.410  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-phy-autotest_86336/timing.txt
00:38:41.410  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-phy-autotest_86336
00:38:41.410  + job_name=nvmf-phy-autotest_86336
00:38:41.410  + sed 's/^/nvmf-phy-autotest_86336;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-phy-autotest_86336/timing.txt
00:38:41.410  + for file in "${array[@]}"
00:38:41.410  + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-phy-autotest_86218/timing.txt
00:38:41.410  + local job_file job_name
00:38:41.410  + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-phy-autotest_86218/timing.txt
00:38:41.410  +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-phy-autotest_86218/timing.txt
00:38:41.410  ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-phy-autotest_86218
00:38:41.410  + job_name=nvmf-tcp-phy-autotest_86218
00:38:41.410  + sed 's/^/nvmf-tcp-phy-autotest_86218;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-phy-autotest_86218/timing.txt
00:38:41.410  + /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/post_process/total_timing.txt
00:38:41.669  + run_autorun_post
00:38:41.669  + s_opt=
00:38:41.669  + [[ '' == true ]]
00:38:41.669  + spdk/autorun_post.py -d ./ -r ./spdk
00:40:03.091  lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/module/bdev/nvme/bdev_mdns_client.c:562
00:40:03.091  lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/module/bdev/nvme/bdev_mdns_client.c:457
00:40:03.091  lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/module/bdev/nvme/bdev_mdns_client.c:583
00:40:03.091  lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/module/bdev/nvme/bdev_mdns_client.c:614
00:40:03.091  lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/module/blobfs/bdev/blobfs_bdev.c:254
00:40:41.789  genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/fsdev_module.h!
00:40:41.789  genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/endian.h!
00:40:41.789  genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/util.h!
00:40:41.789  genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/mmio.h!
00:40:41.790  genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/histogram_data.h!
00:40:41.790  genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/bdev_module.h!
00:40:41.790  genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/base64.h!
00:40:41.790  genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/trace.h!
00:40:41.790  genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/nvmf_transport.h!
00:40:41.790  genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/thread.h!
00:40:41.790  genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/nvme_spec.h!
00:40:41.790  genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/nvme.h!
00:40:41.790  genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/histogram_data.h/histogram_ut.c!
00:40:41.790  genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/lib/env_ocf/include/ocf/ocf_mngt.h!
00:40:41.790  genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/lib/env_ocf/include/ocf/ocf_core.h!
00:40:41.790  genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/lib/env_ocf/include/ocf/ocf_io.h!
00:41:03.838  -----Begin Post Process Script------
00:41:03.838  /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-phy-autotest_86277/cov_total.info
00:41:03.838  /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/crypto-phy-autotest_40095/cov_total.info
00:41:03.838  /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-vg-autotest_92517/cov_total.info
00:41:03.838  /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/short-fuzz-phy-autotest_40089/cov_total.info
00:41:03.838  /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vfio-user-phy-autotest_40093/cov_total.info
00:41:03.838  /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/raid-vg-autotest_6908/cov_total.info
00:41:03.838  /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-vg-autotest_92552/cov_total.info
00:41:03.838  /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-cmb-pmr-vg-autotest_93642/cov_total.info
00:41:03.838  /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/zns-vg-autotest_91612/cov_total.info
00:41:03.838  /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu24-vg-autotest_8796/cov_total.info
00:41:03.838  /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/rocky9-vg-autotest_29599/cov_total.info
00:41:03.838  /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/lvol-vg-autotest_92462/cov_total.info
00:41:03.838  /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-initiator-vg-autotest_92539/cov_total.info
00:41:03.838  /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vmd-phy-autotest_6438/cov_total.info
00:41:03.838  /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-uring-vg-autotest_92417/cov_total.info
00:41:03.838  /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-vg-autotest_92494/cov_total.info
00:41:03.839  /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/BlobFS-phy-autotest_40100/cov_total.info
00:41:03.839  /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu22-vg-autotest_51254/cov_total.info
00:41:03.839  /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-phy-autotest_40159/cov_total.info
00:41:03.839  /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-phy-autotest_86336/cov_total.info
00:41:03.839  
00:41:03.839  
00:41:03.839  -----Tests Executed in Build------
00:41:03.839  accel
00:41:03.839  accel_assign_opcode
00:41:03.839  accel_cdev_comp
00:41:03.839  accel_cdev_decomp
00:41:03.839  accel_cdev_decomp_full
00:41:03.839  accel_cdev_decomp_full_mcore
00:41:03.839  accel_cdev_decomp_full_mthread
00:41:03.839  accel_cdev_decomp_mcore
00:41:03.839  accel_cdev_decomp_mthread
00:41:03.839  accel_comp
00:41:03.839  accel_compare
00:41:03.839  accel_compress_verify
00:41:03.839  accel_copy
00:41:03.839  accel_copy_crc32c
00:41:03.839  accel_copy_crc32c_C2
00:41:03.839  accel_crc32c
00:41:03.839  accel_crc32c_C2
00:41:03.839  accel_decomp
00:41:03.839  accel_decomp_full
00:41:03.839  accel_decomp_full_mcore
00:41:03.839  accel_decomp_full_mthread
00:41:03.839  accel_decomp_mcore
00:41:03.839  accel_decomp_mthread
00:41:03.839  accel_dif_functional_tests
00:41:03.839  accel_dif_generate
00:41:03.839  accel_dif_generate_copy
00:41:03.839  accel_dif_verify
00:41:03.839  accel_dix_generate
00:41:03.839  accel_dix_verify
00:41:03.839  accel_dualcast
00:41:03.839  accel_fill
00:41:03.839  accel_help
00:41:03.839  accel_missing_filename
00:41:03.839  accel_negative_buffers
00:41:03.839  accel_rpc
00:41:03.839  accel_wrong_workload
00:41:03.839  accel_xor
00:41:03.839  acl
00:41:03.839  alias_rpc
00:41:03.839  allowed
00:41:03.839  app_cmdline
00:41:03.839  app_repeat
00:41:03.839  asan
00:41:03.839  autobuild
00:41:03.839  autobuild_build_doc
00:41:03.839  autobuild_check_dpdk_pci_api
00:41:03.839  autobuild_check_format
00:41:03.839  autobuild_check_so_deps
00:41:03.839  autobuild_external_code
00:41:03.839  autobuild_generated_files_check
00:41:03.839  autobuild_generated_files_check_post_clean
00:41:03.839  autobuild_header_dependency_check
00:41:03.839  autobuild_llvm_precompile
00:41:03.839  autobuild_make_install
00:41:03.839  autobuild_make_uninstall
00:41:03.839  autobuild_ocf_precompile
00:41:03.839  bdev_bounds
00:41:03.839  bdev_crypto_enomem
00:41:03.839  bdev_error
00:41:03.839  bdev_fio
00:41:03.839  bdev_fio_rw_verify
00:41:03.839  bdev_fio_trim
00:41:03.839  bdev_gpt_uuid
00:41:03.839  bdev_hello_world
00:41:03.839  bdev_json_nonarray
00:41:03.839  bdev_json_nonenclosed
00:41:03.839  bdev_nbd
00:41:03.839  bdev_nvme_reset_stuck_adm_cmd
00:41:03.839  bdev_qd_sampling
00:41:03.839  bdev_qos
00:41:03.839  bdev_qos_bw
00:41:03.839  bdev_qos_iops
00:41:03.839  bdev_qos_ro_bw
00:41:03.839  bdev_raid
00:41:03.839  bdev_stat
00:41:03.839  bdev_verify
00:41:03.839  bdev_verify_big_io
00:41:03.839  bdev_write_zeroes
00:41:03.839  bdevperf_config
00:41:03.839  blob_io_wait
00:41:03.839  blobfs
00:41:03.839  blobfs_mkfs
00:41:03.839  blobstore
00:41:03.839  blobstore_grow
00:41:03.839  blockdev_crypto_aesni
00:41:03.839  blockdev_crypto_qat
00:41:03.839  blockdev_crypto_sw
00:41:03.839  blockdev_general
00:41:03.839  blockdev_nvme
00:41:03.839  blockdev_nvme_gpt
00:41:03.839  blockdev_raid5f
00:41:03.839  blockdev_rbd
00:41:03.839  blockdev_xnvme
00:41:03.839  build_native_dpdk
00:41:03.839  build_release
00:41:03.839  build_rpm_from_gen_spec
00:41:03.839  build_shared_native_dpdk_rpm
00:41:03.839  build_shared_rpm
00:41:03.839  build_shared_rpm_with_rpmed_dpdk
00:41:03.839  chaining
00:41:03.839  chap_during_discovery
00:41:03.839  chap_mutual_auth
00:41:03.839  check_header_filenames
00:41:03.839  cmb_copy
00:41:03.839  compress_compdev
00:41:03.839  compress_isal
00:41:03.839  confirm_abi_deps
00:41:03.839  confirm_makefile_deps
00:41:03.839  core_isolating
00:41:03.839  cpu_locks
00:41:03.839  custom_alloc
00:41:03.839  dd_bs_lt_native_bs
00:41:03.839  dd_bs_not_multiple
00:41:03.839  dd_copy_to_out_bdev
00:41:03.839  dd_double_input
00:41:03.839  dd_double_output
00:41:03.839  dd_flag_append
00:41:03.839  dd_flag_append_forced_aio
00:41:03.839  dd_flag_directory
00:41:03.839  dd_flag_directory_forced_aio
00:41:03.839  dd_flag_noatime
00:41:03.839  dd_flag_noatime_forced_aio
00:41:03.839  dd_flag_nofollow
00:41:03.839  dd_flag_nofollow_forced_aio
00:41:03.839  dd_flags_misc
00:41:03.839  dd_flags_misc_forced_aio
00:41:03.839  dd_inflate_file
00:41:03.839  dd_invalid_arguments
00:41:03.839  dd_invalid_count
00:41:03.839  dd_invalid_iflag
00:41:03.839  dd_invalid_input_count
00:41:03.839  dd_invalid_json
00:41:03.839  dd_invalid_oflag
00:41:03.839  dd_invalid_output_count
00:41:03.839  dd_invalid_seek
00:41:03.839  dd_invalid_skip
00:41:03.839  dd_malloc_copy
00:41:03.839  dd_no_input
00:41:03.839  dd_no_output
00:41:03.839  dd_offset_magic
00:41:03.839  dd_rw
00:41:03.839  dd_rw_offset
00:41:03.839  dd_smaller_blocksize
00:41:03.839  dd_sparse_bdev_to_file
00:41:03.839  dd_sparse_file_to_bdev
00:41:03.839  dd_sparse_file_to_file
00:41:03.839  dd_unknown_flag
00:41:03.839  dd_uring_copy
00:41:03.839  dd_wrong_blocksize
00:41:03.839  default_locks
00:41:03.839  default_locks_via_rpc
00:41:03.839  denied
00:41:03.839  devices
00:41:03.839  dm_mount
00:41:03.839  dma
00:41:03.839  dpdk_governor
00:41:03.839  dpdk_mem_utility
00:41:03.839  driver
00:41:03.839  env
00:41:03.839  env_dpdk_post_init
00:41:03.839  env_mem_callbacks
00:41:03.839  env_memory
00:41:03.839  env_pci
00:41:03.839  env_vtophys
00:41:03.839  even_2G_alloc
00:41:03.839  event
00:41:03.839  event_perf
00:41:03.839  event_reactor
00:41:03.839  event_reactor_perf
00:41:03.839  event_scheduler
00:41:03.839  exit_on_failed_rpc_init
00:41:03.839  external_make_accel_driver_shared
00:41:03.839  external_make_accel_driver_static
00:41:03.839  external_make_accel_module_shared
00:41:03.839  external_make_accel_module_static
00:41:03.839  external_make_hello_bdev_shared_combo
00:41:03.839  external_make_hello_bdev_shared_iso
00:41:03.839  external_make_hello_bdev_static
00:41:03.839  external_make_hello_no_bdev_shared_combo
00:41:03.839  external_make_hello_no_bdev_shared_iso
00:41:03.839  external_make_hello_no_bdev_static
00:41:03.839  external_make_nvme_shared
00:41:03.839  external_make_nvme_static
00:41:03.839  external_run_accel_driver_shared
00:41:03.840  external_run_accel_driver_static
00:41:03.840  external_run_accel_module_shared
00:41:03.840  external_run_accel_module_static
00:41:03.840  external_run_hello_bdev_shared_combo
00:41:03.840  external_run_hello_bdev_shared_iso
00:41:03.840  external_run_hello_bdev_static
00:41:03.840  external_run_hello_no_bdev_shared_combo
00:41:03.840  external_run_hello_no_bdev_shared_iso
00:41:03.840  external_run_hello_no_bdev_static
00:41:03.840  external_run_nvme_shared
00:41:03.840  external_run_nvme_static
00:41:03.840  filesystem_btrfs
00:41:03.840  filesystem_ext4
00:41:03.840  filesystem_in_capsule_btrfs
00:41:03.840  filesystem_in_capsule_ext4
00:41:03.840  filesystem_in_capsule_xfs
00:41:03.840  filesystem_xfs
00:41:03.840  fio_dif_1_default
00:41:03.840  fio_dif_1_multi_subsystems
00:41:03.840  fio_dif_digest
00:41:03.840  fio_dif_rand_params
00:41:03.840  framework_get_governor
00:41:03.840  ftl
00:41:03.840  ftl_bdevperf
00:41:03.840  ftl_dirty_shutdown
00:41:03.840  ftl_fio_basic
00:41:03.840  ftl_restore
00:41:03.840  ftl_restore_fast
00:41:03.840  ftl_trim
00:41:03.840  ftl_upgrade_shutdown
00:41:03.840  go_rpc
00:41:03.840  guess_driver
00:41:03.840  hello_blob
00:41:03.840  hugepages
00:41:03.840  idle
00:41:03.840  interrupt_mode
00:41:03.840  ioat
00:41:03.840  ioat_perf
00:41:03.840  ioat_verify
00:41:03.840  is_zoned
00:41:03.840  iscsi_tgt
00:41:03.840  iscsi_tgt_bdev_io_wait
00:41:03.840  iscsi_tgt_calsoft
00:41:03.840  iscsi_tgt_digest
00:41:03.840  iscsi_tgt_digests
00:41:03.840  iscsi_tgt_ext4test
00:41:03.840  iscsi_tgt_filesystem
00:41:03.840  iscsi_tgt_filesystem_btrfs
00:41:03.840  iscsi_tgt_filesystem_ext4
00:41:03.840  iscsi_tgt_filesystem_xfs
00:41:03.840  iscsi_tgt_fio
00:41:03.840  iscsi_tgt_fuzz
00:41:03.840  iscsi_tgt_initiator
00:41:03.840  iscsi_tgt_ip_migration
00:41:03.840  iscsi_tgt_iscsi_lvol
00:41:03.840  iscsi_tgt_login_redirection
00:41:03.840  iscsi_tgt_multiconnection
00:41:03.840  iscsi_tgt_qos
00:41:03.840  iscsi_tgt_rbd
00:41:03.840  iscsi_tgt_reset
00:41:03.840  iscsi_tgt_resize
00:41:03.840  iscsi_tgt_rpc_config
00:41:03.840  iscsi_tgt_sock
00:41:03.840  iscsi_tgt_trace_record
00:41:03.840  json_config
00:41:03.840  json_config_extra_key
00:41:03.840  kernel_target_abort
00:41:03.840  keyring_file
00:41:03.840  keyring_linux
00:41:03.840  llvm_fuzz
00:41:03.840  locking_app_on_locked_coremask
00:41:03.840  locking_app_on_unlocked_coremask
00:41:03.840  locking_overlapped_coremask
00:41:03.840  locking_overlapped_coremask_via_rpc
00:41:03.840  lvol
00:41:03.840  lvol_basic
00:41:03.840  lvol_esnap
00:41:03.840  lvol_external_copy
00:41:03.840  lvol_external_snapshot
00:41:03.840  lvol_hotremove
00:41:03.840  lvol_provisioning
00:41:03.840  lvol_rename
00:41:03.840  lvol_resize
00:41:03.840  lvol_snapshot_clone
00:41:03.840  lvol_tasting
00:41:03.840  lvs_grow_clean
00:41:03.840  lvs_grow_dirty
00:41:03.840  make
00:41:03.840  no_shrink_alloc
00:41:03.840  non_locking_app_on_locked_coremask
00:41:03.840  nvme
00:41:03.840  nvme_arbitration
00:41:03.840  nvme_cli_cuse
00:41:03.840  nvme_cli_plugin
00:41:03.840  nvme_cmb
00:41:03.840  nvme_cuse
00:41:03.840  nvme_cuse_app
00:41:03.840  nvme_cuse_rpc
00:41:03.840  nvme_doorbell_aers
00:41:03.840  nvme_e2edp
00:41:03.840  nvme_err_injection
00:41:03.840  nvme_fdp
00:41:03.840  nvme_fio
00:41:03.840  nvme_flexible_data_placement
00:41:03.840  nvme_hello_world
00:41:03.840  nvme_identify
00:41:03.840  nvme_mount
00:41:03.840  nvme_multi_aen
00:41:03.840  nvme_multi_secondary
00:41:03.840  nvme_ns_manage_cuse
00:41:03.840  nvme_overhead
00:41:03.840  nvme_perf
00:41:03.840  nvme_pmr
00:41:03.840  nvme_pmr_persistence
00:41:03.840  nvme_reserve
00:41:03.840  nvme_reset
00:41:03.840  nvme_rpc
00:41:03.840  nvme_rpc_timeouts
00:41:03.840  nvme_scc
00:41:03.840  nvme_sgl
00:41:03.840  nvme_simple_copy
00:41:03.840  nvme_single_aen
00:41:03.840  nvme_smartctl_cuse
00:41:03.840  nvme_startup
00:41:03.840  nvme_xnvme
00:41:03.840  nvme_zns
00:41:03.840  nvmf_abort
00:41:03.840  nvmf_abort_qd_sizes
00:41:03.840  nvmf_aer
00:41:03.840  nvmf_async_init
00:41:03.840  nvmf_auth_host
00:41:03.840  nvmf_auth_target
00:41:03.840  nvmf_bdev_io_wait
00:41:03.840  nvmf_bdevio
00:41:03.840  nvmf_bdevio_no_huge
00:41:03.840  nvmf_bdevperf
00:41:03.840  nvmf_connect_disconnect
00:41:03.840  nvmf_connect_stress
00:41:03.840  nvmf_control_msg_list
00:41:03.840  nvmf_delete_subsystem
00:41:03.840  nvmf_dif
00:41:03.840  nvmf_digest
00:41:03.840  nvmf_digest_clean
00:41:03.840  nvmf_digest_error
00:41:03.840  nvmf_discovery_remove_ifc
00:41:03.840  nvmf_example
00:41:03.840  nvmf_failover
00:41:03.840  nvmf_filesystem
00:41:03.840  nvmf_filesystem_in_capsule
00:41:03.840  nvmf_filesystem_no_in_capsule
00:41:03.840  nvmf_fio_host
00:41:03.840  nvmf_fio_target
00:41:03.840  nvmf_fips
00:41:03.840  nvmf_fused_ordering
00:41:03.840  nvmf_fuzz
00:41:03.840  nvmf_host
00:41:03.840  nvmf_host_discovery
00:41:03.840  nvmf_host_management
00:41:03.840  nvmf_host_multipath
00:41:03.840  nvmf_host_multipath_status
00:41:03.840  nvmf_identify
00:41:03.840  nvmf_identify_kernel_target
00:41:03.840  nvmf_identify_passthru
00:41:03.840  nvmf_initiator_timeout
00:41:03.840  nvmf_interrupt
00:41:03.840  nvmf_invalid
00:41:03.840  nvmf_llvm_fuzz
00:41:03.840  nvmf_lvol
00:41:03.840  nvmf_lvs_grow
00:41:03.840  nvmf_mdns_discovery
00:41:03.840  nvmf_multiconnection
00:41:03.840  nvmf_multicontroller
00:41:03.840  nvmf_multitarget
00:41:03.840  nvmf_nmic
00:41:03.840  nvmf_ns_hotplug_stress
00:41:03.840  nvmf_ns_masking
00:41:03.840  nvmf_nvme_cli
00:41:03.840  nvmf_perf
00:41:03.840  nvmf_perf_adq
00:41:03.840  nvmf_queue_depth
00:41:03.840  nvmf_rdma
00:41:03.840  nvmf_referrals
00:41:03.840  nvmf_rpc
00:41:03.840  nvmf_shutdown
00:41:03.840  nvmf_shutdown_tc1
00:41:03.840  nvmf_shutdown_tc2
00:41:03.840  nvmf_shutdown_tc3
00:41:03.840  nvmf_shutdown_tc4
00:41:03.840  nvmf_srq_overwhelm
00:41:03.840  nvmf_target_core
00:41:03.840  nvmf_target_core_interrupt_mode
00:41:03.840  nvmf_target_disconnect
00:41:03.840  nvmf_target_disconnect_tc1
00:41:03.840  nvmf_target_disconnect_tc2
00:41:03.840  nvmf_target_disconnect_tc3
00:41:03.840  nvmf_target_discovery
00:41:03.840  nvmf_target_extra
00:41:03.840  nvmf_target_multipath
00:41:03.840  nvmf_tcp
00:41:03.840  nvmf_timeout
00:41:03.840  nvmf_tls
00:41:03.840  nvmf_vfio_user
00:41:03.840  nvmf_vfio_user_fuzz
00:41:03.840  nvmf_vfio_user_nvme_compliance
00:41:03.840  nvmf_vhost
00:41:03.840  nvmf_wait_for_buf
00:41:03.840  nvmf_zcopy
00:41:03.840  ocf
00:41:03.840  ocf_bdevperf_iotypes
00:41:03.840  ocf_configuration_change
00:41:03.840  ocf_create_destruct
00:41:03.840  ocf_fio_modes
00:41:03.840  ocf_flush
00:41:03.840  ocf_multicore
00:41:03.840  ocf_remove
00:41:03.841  ocf_stats
00:41:03.841  odd_alloc
00:41:03.841  packaging
00:41:03.841  raid0_resize_superblock_test
00:41:03.841  raid0_resize_test
00:41:03.841  raid1_resize_data_offset_test
00:41:03.841  raid1_resize_superblock_test
00:41:03.841  raid1_resize_test
00:41:03.841  raid5f_rebuild_test
00:41:03.841  raid5f_rebuild_test_sb
00:41:03.841  raid5f_state_function_test
00:41:03.841  raid5f_state_function_test_sb
00:41:03.841  raid5f_superblock_test
00:41:03.841  raid_function_test_concat
00:41:03.841  raid_function_test_raid0
00:41:03.841  raid_read_error_test
00:41:03.841  raid_rebuild_test
00:41:03.841  raid_rebuild_test_io
00:41:03.841  raid_rebuild_test_sb
00:41:03.841  raid_rebuild_test_sb_4k
00:41:03.841  raid_rebuild_test_sb_io
00:41:03.841  raid_rebuild_test_sb_md_interleaved
00:41:03.841  raid_rebuild_test_sb_md_separate
00:41:03.841  raid_state_function_test
00:41:03.841  raid_state_function_test_sb
00:41:03.841  raid_state_function_test_sb_4k
00:41:03.841  raid_state_function_test_sb_md_interleaved
00:41:03.841  raid_state_function_test_sb_md_separate
00:41:03.841  raid_superblock_test
00:41:03.841  raid_superblock_test_4k
00:41:03.841  raid_superblock_test_md_interleaved
00:41:03.841  raid_superblock_test_md_separate
00:41:03.841  raid_write_error_test
00:41:03.841  reactor_set_interrupt
00:41:03.841  reap_unregistered_poller
00:41:03.841  rocksdb
00:41:03.841  rocksdb_insert
00:41:03.841  rocksdb_overwrite
00:41:03.841  rocksdb_randread
00:41:03.841  rocksdb_readwrite
00:41:03.841  rocksdb_writesync
00:41:03.841  rpc
00:41:03.841  rpc_client
00:41:03.841  rpc_daemon_integrity
00:41:03.841  rpc_integrity
00:41:03.841  rpc_plugins
00:41:03.841  rpc_trace_cmd_test
00:41:03.841  rpm_packaging
00:41:03.841  scanbuild_make
00:41:03.841  scheduler
00:41:03.841  scheduler_create_thread
00:41:03.841  scheduler_opts
00:41:03.841  scheduler_rpc
00:41:03.841  setup.sh
00:41:03.841  single_node_setup
00:41:03.841  skip_rpc
00:41:03.841  skip_rpc_with_delay
00:41:03.841  skip_rpc_with_json
00:41:03.841  sma
00:41:03.841  sma_crypto
00:41:03.841  sma_discovery
00:41:03.841  sma_nvmf_tcp
00:41:03.841  sma_plugins
00:41:03.841  sma_qos
00:41:03.841  sma_vfiouser_qemu
00:41:03.841  sma_vhost
00:41:03.841  spdk_dd
00:41:03.841  spdk_dd_basic_rw
00:41:03.841  spdk_dd_bdev_to_bdev
00:41:03.841  spdk_dd_malloc
00:41:03.841  spdk_dd_negative
00:41:03.841  spdk_dd_posix
00:41:03.841  spdk_dd_sparse
00:41:03.841  spdk_dd_uring
00:41:03.841  spdk_target_abort
00:41:03.841  spdkcli_iscsi
00:41:03.841  spdkcli_nvmf_rdma
00:41:03.841  spdkcli_nvmf_tcp
00:41:03.841  spdkcli_raid
00:41:03.841  spdkcli_rbd
00:41:03.841  spdkcli_tcp
00:41:03.841  spdkcli_vhost
00:41:03.841  spdkcli_virtio
00:41:03.841  static_as_default
00:41:03.841  sw_hotplug
00:41:03.841  test_bdev_lvol_delete_lvstore_with_clones
00:41:03.841  test_bdev_lvol_delete_ordering
00:41:03.841  test_clone_decouple_parent
00:41:03.841  test_clone_inflate
00:41:03.841  test_clone_snapshot_relations
00:41:03.841  test_construct_lvol
00:41:03.841  test_construct_lvol_alias_conflict
00:41:03.841  test_construct_lvol_fio_clear_method_none
00:41:03.841  test_construct_lvol_fio_clear_method_unmap
00:41:03.841  test_construct_lvol_full_lvs
00:41:03.841  test_construct_lvol_inexistent_lvs
00:41:03.841  test_construct_lvols_conflict_alias
00:41:03.841  test_construct_lvs
00:41:03.841  test_construct_lvs_clear_methods
00:41:03.841  test_construct_lvs_conflict_alias
00:41:03.841  test_construct_lvs_different_cluster_size
00:41:03.841  test_construct_lvs_nonexistent_bdev
00:41:03.841  test_construct_multi_lvols
00:41:03.841  test_construct_nested_lvol
00:41:03.841  test_construct_two_lvs_on_the_same_bdev
00:41:03.841  test_create_multi_ublk
00:41:03.841  test_create_snapshot_of_snapshot
00:41:03.841  test_create_snapshot_with_io
00:41:03.841  test_create_ublk
00:41:03.841  test_delete_lvol_store_persistent_positive
00:41:03.841  test_delete_snapshot_with_clone
00:41:03.841  test_delete_snapshot_with_snapshot
00:41:03.841  test_destroy_after_bdev_lvol_resize_positive
00:41:03.841  test_esnap_clones
00:41:03.841  test_esnap_late_arrival
00:41:03.841  test_esnap_reload
00:41:03.841  test_esnap_remove_degraded
00:41:03.841  test_hotremove_lvol_store
00:41:03.841  test_hotremove_lvol_store_base
00:41:03.841  test_hotremove_lvol_store_base_with_lvols
00:41:03.841  test_hotremove_lvol_store_multiple_lvols
00:41:03.841  test_lvol_bdev_readonly
00:41:03.841  test_lvol_list
00:41:03.841  test_lvol_rename_negative
00:41:03.841  test_lvol_set_parent_bdev_from_esnap
00:41:03.841  test_lvol_set_parent_bdev_from_none
00:41:03.841  test_lvol_set_parent_bdev_from_snapshot
00:41:03.841  test_lvol_set_parent_failed
00:41:03.841  test_lvol_set_parent_from_esnap
00:41:03.841  test_lvol_set_parent_from_none
00:41:03.841  test_lvol_set_parent_from_snapshot
00:41:03.841  test_rename_lvs_negative
00:41:03.841  test_rename_positive
00:41:03.841  test_resize_lvol
00:41:03.841  test_resize_lvol_negative
00:41:03.841  test_resize_lvol_with_io_traffic
00:41:03.841  test_save_ublk_config
00:41:03.841  test_shallow_copy_compare
00:41:03.841  test_sigterm
00:41:03.841  test_snapshot_compare_with_lvol_bdev
00:41:03.841  test_tasting
00:41:03.841  test_thin_lvol_check_integrity
00:41:03.841  test_thin_lvol_check_space
00:41:03.841  test_thin_lvol_check_zeroes
00:41:03.841  test_thin_lvol_resize
00:41:03.841  test_thin_overprovisioning
00:41:03.841  test_unregister_lvol_bdev
00:41:03.841  thread
00:41:03.841  thread_poller_perf
00:41:03.841  thread_spdk_lock
00:41:03.841  ublk
00:41:03.841  ublk_recovery
00:41:03.841  ubsan
00:41:03.841  unittest
00:41:03.841  unittest_accel
00:41:03.841  unittest_bdev
00:41:03.841  unittest_bdev_compress
00:41:03.841  unittest_bdev_crypto
00:41:03.841  unittest_bdev_raid5f
00:41:03.841  unittest_blob_blobfs
00:41:03.841  unittest_build
00:41:03.841  unittest_dma
00:41:03.841  unittest_dpdk_compressdev
00:41:03.841  unittest_event
00:41:03.841  unittest_fsdev
00:41:03.841  unittest_ftl
00:41:03.841  unittest_idxd_user
00:41:03.841  unittest_include
00:41:03.841  unittest_init
00:41:03.841  unittest_ioat
00:41:03.841  unittest_iobuf
00:41:03.841  unittest_iscsi
00:41:03.841  unittest_json
00:41:03.841  unittest_keyring
00:41:03.841  unittest_lib_reduce
00:41:03.841  unittest_log
00:41:03.841  unittest_lvol
00:41:03.841  unittest_notify
00:41:03.841  unittest_nvme
00:41:03.841  unittest_nvme_cuse
00:41:03.841  unittest_nvme_rdma
00:41:03.841  unittest_nvmf
00:41:03.841  unittest_nvmf_rdma
00:41:03.841  unittest_nvmf_transport
00:41:03.841  unittest_nvmf_vfio_user
00:41:03.841  unittest_pci_event
00:41:03.841  unittest_rdma
00:41:03.841  unittest_rpc
00:41:03.841  unittest_scsi
00:41:03.841  unittest_sock
00:41:03.841  unittest_thread
00:41:03.841  unittest_util
00:41:03.841  unittest_vhost
00:41:03.841  valgrind
00:41:03.841  version
00:41:03.841  vfio_llvm_fuzz
00:41:03.841  vfio_user_nvme_fio
00:41:03.842  vfio_user_nvme_restart_vm
00:41:03.842  vfio_user_qemu
00:41:03.842  vfio_user_virtio_bdevperf
00:41:03.842  vfio_user_virtio_blk_restart_vm
00:41:03.842  vfio_user_virtio_fs_fio
00:41:03.842  vfio_user_virtio_scsi_restart_vm
00:41:03.842  vhost
00:41:03.842  vhost_blk_cores_2ctrl
00:41:03.842  vhost_blk_fs_integrity
00:41:03.842  vhost_blk_integrity
00:41:03.842  vhost_blk_lvol_integrity
00:41:03.842  vhost_blk_packed_ring_integrity
00:41:03.842  vhost_blockdev
00:41:03.842  vhost_boot
00:41:03.842  vhost_fuzz
00:41:03.842  vhost_migration
00:41:03.842  vhost_migration_tc1
00:41:03.842  vhost_migration_tc2
00:41:03.842  vhost_negative
00:41:03.842  vhost_readonly
00:41:03.842  vhost_scsi_cores_2ctrl
00:41:03.842  vhost_scsi_fs_integrity
00:41:03.842  vhost_scsi_integrity
00:41:03.842  vhost_scsi_lvol_integrity
00:41:03.842  vhost_shared
00:41:03.842  vmd
00:41:03.842  vmd_bdev_svc
00:41:03.842  vmd_fio
00:41:03.842  vmd_hello_world
00:41:03.842  vmd_identify
00:41:03.842  vmd_perf
00:41:03.842  xnvme_bdevperf
00:41:03.842  xnvme_to_malloc_dd_copy
00:41:03.842  zoned_fio
00:41:03.842  
00:41:03.842  
00:41:03.842  -----Tests Missing From Build------
00:41:03.842  accel_mlx5_copy
00:41:03.842  accel_mlx5_crc32c
00:41:03.842  accel_mlx5_crypto
00:41:03.842  accel_scan_dsa_modules
00:41:03.842  accel_scan_iaa_modules
00:41:03.842  balanced
00:41:03.842  busy
00:41:03.842  core_load
00:41:03.842  iscsi_tgt_data_digest
00:41:03.842  nvme_boot_partition
00:41:03.842  nvme_bp
00:41:03.842  nvme_opal
00:41:03.842  nvme_opal_bdevio
00:41:03.842  nvme_opal_bdevperf
00:41:03.842  nvme_opal_spdk_tgt
00:41:03.842  nvmf_device_removal_pci_remove
00:41:03.842  nvmf_device_removal_pci_remove_no_srq
00:41:03.842  nvmf_digest_dsa_initiator
00:41:03.842  nvmf_digest_dsa_target
00:41:03.842  nvmf_fc
00:41:03.842  spdkcli_nvmf_fc
00:41:03.842  unittest_nvmf_fc
00:41:03.842  unittest_nvmf_fc_ls
00:41:03.842  vhost_blk_hot_remove
00:41:03.842  vhost_hotplug
00:41:03.842  vhost_scsi_hot_remove
00:41:03.842  
00:41:03.842  
00:41:03.842  -----Tests Missing ASAN------
00:41:03.842  accel_cdev_comp
00:41:03.842  accel_cdev_decomp
00:41:03.842  accel_cdev_decomp_full
00:41:03.842  accel_cdev_decomp_full_mcore
00:41:03.842  accel_cdev_decomp_full_mthread
00:41:03.842  accel_cdev_decomp_mcore
00:41:03.842  accel_cdev_decomp_mthread
00:41:03.842  accel_mlx5_copy
00:41:03.842  accel_mlx5_crc32c
00:41:03.842  accel_mlx5_crypto
00:41:03.842  accel_scan_dsa_modules
00:41:03.842  accel_scan_iaa_modules
00:41:03.842  acl
00:41:03.842  allowed
00:41:03.842  autobuild
00:41:03.842  autobuild_build_doc
00:41:03.842  autobuild_check_dpdk_pci_api
00:41:03.842  autobuild_check_format
00:41:03.842  autobuild_check_so_deps
00:41:03.842  autobuild_external_code
00:41:03.842  autobuild_generated_files_check
00:41:03.842  autobuild_generated_files_check_post_clean
00:41:03.842  autobuild_header_dependency_check
00:41:03.842  autobuild_llvm_precompile
00:41:03.842  autobuild_make_install
00:41:03.842  autobuild_make_uninstall
00:41:03.842  autobuild_ocf_precompile
00:41:03.842  balanced
00:41:03.842  bdev_crypto_enomem
00:41:03.842  blockdev_crypto_aesni
00:41:03.842  blockdev_crypto_qat
00:41:03.842  blockdev_crypto_sw
00:41:03.842  blockdev_rbd
00:41:03.842  build_release
00:41:03.842  build_rpm_from_gen_spec
00:41:03.842  build_shared_native_dpdk_rpm
00:41:03.842  build_shared_rpm
00:41:03.842  build_shared_rpm_with_rpmed_dpdk
00:41:03.842  busy
00:41:03.842  chaining
00:41:03.842  chap_during_discovery
00:41:03.842  chap_mutual_auth
00:41:03.842  check_header_filenames
00:41:03.842  cmb_copy
00:41:03.842  compress_compdev
00:41:03.842  compress_isal
00:41:03.842  confirm_abi_deps
00:41:03.842  confirm_makefile_deps
00:41:03.842  core_isolating
00:41:03.842  core_load
00:41:03.842  custom_alloc
00:41:03.842  dd_uring_copy
00:41:03.842  denied
00:41:03.842  devices
00:41:03.842  dm_mount
00:41:03.842  dma
00:41:03.842  dpdk_governor
00:41:03.842  driver
00:41:03.842  even_2G_alloc
00:41:03.842  external_make_accel_driver_shared
00:41:03.842  external_make_accel_driver_static
00:41:03.842  external_make_accel_module_shared
00:41:03.842  external_make_accel_module_static
00:41:03.842  external_make_hello_bdev_shared_combo
00:41:03.842  external_make_hello_bdev_shared_iso
00:41:03.842  external_make_hello_bdev_static
00:41:03.842  external_make_hello_no_bdev_shared_combo
00:41:03.842  external_make_hello_no_bdev_shared_iso
00:41:03.842  external_make_hello_no_bdev_static
00:41:03.842  external_make_nvme_shared
00:41:03.842  external_make_nvme_static
00:41:03.842  external_run_accel_driver_shared
00:41:03.842  external_run_accel_driver_static
00:41:03.842  external_run_accel_module_shared
00:41:03.842  external_run_accel_module_static
00:41:03.842  external_run_hello_bdev_shared_combo
00:41:03.842  external_run_hello_bdev_shared_iso
00:41:03.842  external_run_hello_bdev_static
00:41:03.842  external_run_hello_no_bdev_shared_combo
00:41:03.842  external_run_hello_no_bdev_shared_iso
00:41:03.842  external_run_hello_no_bdev_static
00:41:03.842  external_run_nvme_shared
00:41:03.842  external_run_nvme_static
00:41:03.842  filesystem_btrfs
00:41:03.842  filesystem_ext4
00:41:03.842  filesystem_in_capsule_btrfs
00:41:03.842  filesystem_in_capsule_ext4
00:41:03.842  filesystem_in_capsule_xfs
00:41:03.842  filesystem_xfs
00:41:03.842  fio_dif_1_default
00:41:03.842  fio_dif_1_multi_subsystems
00:41:03.842  fio_dif_digest
00:41:03.842  fio_dif_rand_params
00:41:03.842  framework_get_governor
00:41:03.842  go_rpc
00:41:03.842  guess_driver
00:41:03.842  hugepages
00:41:03.842  idle
00:41:03.842  interrupt_mode
00:41:03.842  ioat
00:41:03.842  ioat_perf
00:41:03.842  ioat_verify
00:41:03.842  is_zoned
00:41:03.842  iscsi_tgt
00:41:03.842  iscsi_tgt_bdev_io_wait
00:41:03.842  iscsi_tgt_calsoft
00:41:03.842  iscsi_tgt_data_digest
00:41:03.842  iscsi_tgt_digest
00:41:03.842  iscsi_tgt_digests
00:41:03.842  iscsi_tgt_ext4test
00:41:03.842  iscsi_tgt_filesystem
00:41:03.842  iscsi_tgt_filesystem_btrfs
00:41:03.842  iscsi_tgt_filesystem_ext4
00:41:03.842  iscsi_tgt_filesystem_xfs
00:41:03.842  iscsi_tgt_fio
00:41:03.842  iscsi_tgt_fuzz
00:41:03.842  iscsi_tgt_initiator
00:41:03.842  iscsi_tgt_ip_migration
00:41:03.842  iscsi_tgt_iscsi_lvol
00:41:03.842  iscsi_tgt_login_redirection
00:41:03.842  iscsi_tgt_multiconnection
00:41:03.842  iscsi_tgt_qos
00:41:03.842  iscsi_tgt_rbd
00:41:03.842  iscsi_tgt_reset
00:41:03.842  iscsi_tgt_resize
00:41:03.842  iscsi_tgt_rpc_config
00:41:03.842  iscsi_tgt_sock
00:41:03.842  iscsi_tgt_trace_record
00:41:03.842  kernel_target_abort
00:41:03.842  keyring_file
00:41:03.843  keyring_linux
00:41:03.843  llvm_fuzz
00:41:03.843  lvs_grow_clean
00:41:03.843  lvs_grow_dirty
00:41:03.843  no_shrink_alloc
00:41:03.843  nvme_boot_partition
00:41:03.843  nvme_bp
00:41:03.843  nvme_cli_cuse
00:41:03.843  nvme_cli_plugin
00:41:03.843  nvme_cmb
00:41:03.843  nvme_cuse
00:41:03.843  nvme_cuse_app
00:41:03.843  nvme_cuse_rpc
00:41:03.843  nvme_mount
00:41:03.843  nvme_ns_manage_cuse
00:41:03.843  nvme_opal
00:41:03.843  nvme_opal_bdevio
00:41:03.843  nvme_opal_bdevperf
00:41:03.843  nvme_opal_spdk_tgt
00:41:03.843  nvme_pmr
00:41:03.843  nvme_pmr_persistence
00:41:03.843  nvme_smartctl_cuse
00:41:03.843  nvme_zns
00:41:03.843  nvmf_abort
00:41:03.843  nvmf_abort_qd_sizes
00:41:03.843  nvmf_aer
00:41:03.843  nvmf_async_init
00:41:03.843  nvmf_auth_host
00:41:03.843  nvmf_auth_target
00:41:03.843  nvmf_bdev_io_wait
00:41:03.843  nvmf_bdevio
00:41:03.843  nvmf_bdevio_no_huge
00:41:03.843  nvmf_bdevperf
00:41:03.843  nvmf_connect_disconnect
00:41:03.843  nvmf_connect_stress
00:41:03.843  nvmf_control_msg_list
00:41:03.843  nvmf_delete_subsystem
00:41:03.843  nvmf_device_removal_pci_remove
00:41:03.843  nvmf_device_removal_pci_remove_no_srq
00:41:03.843  nvmf_dif
00:41:03.843  nvmf_digest
00:41:03.843  nvmf_digest_clean
00:41:03.843  nvmf_digest_dsa_initiator
00:41:03.843  nvmf_digest_dsa_target
00:41:03.843  nvmf_digest_error
00:41:03.843  nvmf_discovery_remove_ifc
00:41:03.843  nvmf_example
00:41:03.843  nvmf_failover
00:41:03.843  nvmf_fc
00:41:03.843  nvmf_filesystem
00:41:03.843  nvmf_filesystem_in_capsule
00:41:03.843  nvmf_filesystem_no_in_capsule
00:41:03.843  nvmf_fio_host
00:41:03.843  nvmf_fio_target
00:41:03.843  nvmf_fips
00:41:03.843  nvmf_fused_ordering
00:41:03.843  nvmf_fuzz
00:41:03.843  nvmf_host
00:41:03.843  nvmf_host_discovery
00:41:03.843  nvmf_host_management
00:41:03.843  nvmf_host_multipath
00:41:03.843  nvmf_host_multipath_status
00:41:03.843  nvmf_identify
00:41:03.843  nvmf_identify_kernel_target
00:41:03.843  nvmf_identify_passthru
00:41:03.843  nvmf_initiator_timeout
00:41:03.843  nvmf_interrupt
00:41:03.843  nvmf_invalid
00:41:03.843  nvmf_llvm_fuzz
00:41:03.843  nvmf_lvol
00:41:03.843  nvmf_lvs_grow
00:41:03.843  nvmf_mdns_discovery
00:41:03.843  nvmf_multiconnection
00:41:03.843  nvmf_multicontroller
00:41:03.843  nvmf_multitarget
00:41:03.843  nvmf_nmic
00:41:03.843  nvmf_ns_hotplug_stress
00:41:03.843  nvmf_ns_masking
00:41:03.843  nvmf_nvme_cli
00:41:03.843  nvmf_perf
00:41:03.843  nvmf_perf_adq
00:41:03.843  nvmf_queue_depth
00:41:03.843  nvmf_rdma
00:41:03.843  nvmf_referrals
00:41:03.843  nvmf_rpc
00:41:03.843  nvmf_shutdown
00:41:03.843  nvmf_shutdown_tc1
00:41:03.843  nvmf_shutdown_tc2
00:41:03.843  nvmf_shutdown_tc3
00:41:03.843  nvmf_shutdown_tc4
00:41:03.843  nvmf_srq_overwhelm
00:41:03.843  nvmf_target_core
00:41:03.843  nvmf_target_core_interrupt_mode
00:41:03.843  nvmf_target_disconnect
00:41:03.843  nvmf_target_disconnect_tc1
00:41:03.843  nvmf_target_disconnect_tc2
00:41:03.843  nvmf_target_disconnect_tc3
00:41:03.843  nvmf_target_discovery
00:41:03.843  nvmf_target_extra
00:41:03.843  nvmf_target_multipath
00:41:03.843  nvmf_tcp
00:41:03.843  nvmf_timeout
00:41:03.843  nvmf_tls
00:41:03.843  nvmf_vfio_user
00:41:03.843  nvmf_vfio_user_fuzz
00:41:03.843  nvmf_vfio_user_nvme_compliance
00:41:03.843  nvmf_wait_for_buf
00:41:03.843  nvmf_zcopy
00:41:03.843  ocf
00:41:03.843  ocf_bdevperf_iotypes
00:41:03.843  ocf_configuration_change
00:41:03.843  ocf_create_destruct
00:41:03.843  ocf_fio_modes
00:41:03.843  ocf_flush
00:41:03.843  ocf_multicore
00:41:03.843  ocf_remove
00:41:03.843  ocf_stats
00:41:03.843  odd_alloc
00:41:03.843  packaging
00:41:03.843  rpm_packaging
00:41:03.843  scanbuild_make
00:41:03.843  scheduler
00:41:03.843  scheduler_opts
00:41:03.843  scheduler_rpc
00:41:03.843  setup.sh
00:41:03.843  single_node_setup
00:41:03.843  spdk_dd_uring
00:41:03.843  spdk_target_abort
00:41:03.843  spdkcli_iscsi
00:41:03.843  spdkcli_nvmf_fc
00:41:03.843  spdkcli_nvmf_rdma
00:41:03.843  spdkcli_nvmf_tcp
00:41:03.843  spdkcli_rbd
00:41:03.843  spdkcli_virtio
00:41:03.843  static_as_default
00:41:03.843  unittest_bdev_compress
00:41:03.843  unittest_bdev_crypto
00:41:03.843  unittest_bdev_raid5f
00:41:03.843  unittest_dpdk_compressdev
00:41:03.843  unittest_lib_reduce
00:41:03.843  unittest_nvmf_fc
00:41:03.843  unittest_nvmf_fc_ls
00:41:03.843  unittest_nvmf_vfio_user
00:41:03.843  valgrind
00:41:03.843  vfio_llvm_fuzz
00:41:03.843  vhost_blk_hot_remove
00:41:03.843  vhost_blockdev
00:41:03.843  vhost_fuzz
00:41:03.843  vhost_hotplug
00:41:03.843  vhost_scsi_hot_remove
00:41:03.843  vhost_shared
00:41:03.843  zoned_fio
00:41:03.843  
00:41:03.843  
00:41:03.843  -----Tests Missing UBSAN------
00:41:03.843  accel_mlx5_copy
00:41:03.843  accel_mlx5_crc32c
00:41:03.843  accel_mlx5_crypto
00:41:03.843  accel_scan_dsa_modules
00:41:03.843  accel_scan_iaa_modules
00:41:03.843  autobuild
00:41:03.843  autobuild_build_doc
00:41:03.843  autobuild_check_dpdk_pci_api
00:41:03.843  autobuild_check_format
00:41:03.843  autobuild_check_so_deps
00:41:03.843  autobuild_external_code
00:41:03.843  autobuild_generated_files_check
00:41:03.843  autobuild_generated_files_check_post_clean
00:41:03.843  autobuild_header_dependency_check
00:41:03.843  autobuild_make_install
00:41:03.843  autobuild_make_uninstall
00:41:03.843  balanced
00:41:03.843  build_release
00:41:03.843  build_rpm_from_gen_spec
00:41:03.843  build_shared_native_dpdk_rpm
00:41:03.843  build_shared_rpm
00:41:03.843  build_shared_rpm_with_rpmed_dpdk
00:41:03.843  busy
00:41:03.843  check_header_filenames
00:41:03.843  cmb_copy
00:41:03.843  confirm_abi_deps
00:41:03.843  confirm_makefile_deps
00:41:03.843  core_load
00:41:03.843  external_make_accel_driver_shared
00:41:03.843  external_make_accel_driver_static
00:41:03.843  external_make_accel_module_shared
00:41:03.843  external_make_accel_module_static
00:41:03.843  external_make_hello_bdev_shared_combo
00:41:03.843  external_make_hello_bdev_shared_iso
00:41:03.843  external_make_hello_bdev_static
00:41:03.843  external_make_hello_no_bdev_shared_combo
00:41:03.843  external_make_hello_no_bdev_shared_iso
00:41:03.843  external_make_hello_no_bdev_static
00:41:03.843  external_make_nvme_shared
00:41:03.843  external_make_nvme_static
00:41:03.843  external_run_accel_driver_shared
00:41:03.843  external_run_accel_driver_static
00:41:03.843  external_run_accel_module_shared
00:41:03.843  external_run_accel_module_static
00:41:03.843  external_run_hello_bdev_shared_combo
00:41:03.843  external_run_hello_bdev_shared_iso
00:41:03.844  external_run_hello_bdev_static
00:41:03.844  external_run_hello_no_bdev_shared_combo
00:41:03.844  external_run_hello_no_bdev_shared_iso
00:41:03.844  external_run_hello_no_bdev_static
00:41:03.844  external_run_nvme_shared
00:41:03.844  external_run_nvme_static
00:41:03.844  is_zoned
00:41:03.844  iscsi_tgt_data_digest
00:41:03.844  nvme_boot_partition
00:41:03.844  nvme_bp
00:41:03.844  nvme_cmb
00:41:03.844  nvme_opal
00:41:03.844  nvme_opal_bdevio
00:41:03.844  nvme_opal_bdevperf
00:41:03.844  nvme_opal_spdk_tgt
00:41:03.844  nvme_pmr
00:41:03.844  nvme_pmr_persistence
00:41:03.844  nvme_zns
00:41:03.844  nvmf_device_removal_pci_remove
00:41:03.844  nvmf_device_removal_pci_remove_no_srq
00:41:03.844  nvmf_digest_dsa_initiator
00:41:03.844  nvmf_digest_dsa_target
00:41:03.844  nvmf_fc
00:41:03.844  packaging
00:41:03.844  rpm_packaging
00:41:03.844  scanbuild_make
00:41:03.844  spdkcli_nvmf_fc
00:41:03.844  unittest_bdev_compress
00:41:03.844  unittest_bdev_crypto
00:41:03.844  unittest_bdev_raid5f
00:41:03.844  unittest_dpdk_compressdev
00:41:03.844  unittest_lib_reduce
00:41:03.844  unittest_nvmf_fc
00:41:03.844  unittest_nvmf_fc_ls
00:41:03.844  unittest_nvmf_vfio_user
00:41:03.844  valgrind
00:41:03.844  vhost_blk_hot_remove
00:41:03.844  vhost_hotplug
00:41:03.844  vhost_scsi_hot_remove
00:41:03.844  zoned_fio
00:41:03.844  + compress_coverage_and_docs
00:41:03.844  + echo 'Start compress coverage and docs'
00:41:03.844  Start compress coverage and docs
00:41:03.844  + tar -C coverage -czf coverage_autotest-spdk-master-vs-dpdk-v23.11_925.tar.gz ./ --remove-files
00:41:03.844  + tar -C ut_coverage -czf ut_coverage_autotest-spdk-master-vs-dpdk-v23.11_925.tar.gz ./ --remove-files
00:41:04.102  + tar -C doc -czf doc_autotest-spdk-master-vs-dpdk-v23.11_925.tar.gz ./ --remove-files
00:41:04.360  + [[ -d llvm ]]
00:41:04.360  + true
00:41:04.360  + echo 'End compress coverage and docs'
00:41:04.360  End compress coverage and docs
00:41:04.360  + remove_partial_coverage_files
00:41:04.360  + find . -name 'cov_*.info' -delete
00:41:04.618  + echo 'End stage post_gen_coverage.sh'
00:41:04.618  End stage post_gen_coverage.sh
00:41:04.632  [Pipeline] }
00:41:04.658  [Pipeline] // catchError
00:41:04.670  [Pipeline] catchError
00:41:04.672  [Pipeline] {
00:41:04.693  [Pipeline] dir
00:41:04.693  Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/post_process
00:41:04.695  [Pipeline] {