00:00:00.001 Started by upstream project "nightly-trigger" build number 2977 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.005 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/autotest-spdk-master-vs-dpdk-v23.11_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-upstream/autotest.groovy 00:00:00.006 The recommended git tool is: git 00:00:00.006 using credential 00000000-0000-0000-0000-000000000002 00:00:00.008 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/autotest-spdk-master-vs-dpdk-v23.11_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.019 Fetching changes from the remote Git repository 00:00:00.021 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.031 Using shallow fetch with depth 1 00:00:00.031 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.031 > git --version # timeout=10 00:00:00.040 > git --version # 'git version 2.39.2' 00:00:00.040 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.041 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.041 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:02.155 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:02.165 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:02.176 Checking out Revision d55dd09e9e6d4661df5d1073790609767cbcb60c (FETCH_HEAD) 00:00:02.176 > git config core.sparsecheckout # timeout=10 00:00:02.184 > git read-tree -mu HEAD # timeout=10 00:00:02.198 > git checkout -f d55dd09e9e6d4661df5d1073790609767cbcb60c # timeout=5 00:00:02.215 Commit message: "ansible/roles/custom_facts: Add subsystem info to VMDs' nvmes" 00:00:02.216 > git rev-list --no-walk d55dd09e9e6d4661df5d1073790609767cbcb60c # timeout=10 00:00:02.856 [Pipeline] Start of Pipeline 00:00:02.869 [Pipeline] library 00:00:02.871 Loading library shm_lib@master 00:00:02.871 Library shm_lib@master is cached. Copying from home. 00:00:02.892 [Pipeline] node 00:00:02.898 Running on ME1 in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11 00:00:02.903 [Pipeline] { 00:00:02.918 [Pipeline] cleanWs 00:00:02.928 [WS-CLEANUP] Deleting project workspace... 00:00:02.928 [WS-CLEANUP] Deferred wipeout is used... 00:00:02.933 [WS-CLEANUP] done 00:00:02.937 [Pipeline] stage 00:00:02.941 [Pipeline] { (Prologue) 00:00:03.035 [Pipeline] withCredentials 00:00:03.044 > git --version # timeout=10 00:00:03.054 > git --version # 'git version 2.39.2' 00:00:03.072 Masking supported pattern matches of $GIT_USERNAME or $GIT_PASSWORD or $GIT_ASKPASS 00:00:03.074 [Pipeline] { 00:00:03.082 [Pipeline] retry 00:00:03.083 [Pipeline] { 00:00:03.222 [Pipeline] sh 00:00:03.506 + git ls-remote https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master 00:00:06.067 [Pipeline] } 00:00:06.082 [Pipeline] // retry 00:00:06.086 [Pipeline] } 00:00:06.099 [Pipeline] // withCredentials 00:00:06.105 [Pipeline] nodesByLabel 00:00:06.106 Found a total of 1 nodes with the 'sorcerer' label 00:00:06.115 [Pipeline] httpRequest 00:00:06.121 HttpMethod: GET 00:00:06.122 URL: http://10.211.164.101/packages/jbp_d55dd09e9e6d4661df5d1073790609767cbcb60c.tar.gz 00:00:06.123 Sending request to url: http://10.211.164.101/packages/jbp_d55dd09e9e6d4661df5d1073790609767cbcb60c.tar.gz 00:00:06.125 Response Code: HTTP/1.1 200 OK 00:00:06.126 Success: Status code 200 is in the accepted range: 200,404 00:00:06.126 Saving response body to /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/jbp_d55dd09e9e6d4661df5d1073790609767cbcb60c.tar.gz 00:00:06.264 [Pipeline] sh 00:00:06.542 + tar --no-same-owner -xf jbp_d55dd09e9e6d4661df5d1073790609767cbcb60c.tar.gz 00:00:06.560 [Pipeline] withCredentials 00:00:06.571 > git --version # timeout=10 00:00:06.581 > git --version # 'git version 2.39.2' 00:00:06.601 Masking supported pattern matches of $GIT_USERNAME or $GIT_PASSWORD or $GIT_ASKPASS 00:00:06.603 [Pipeline] { 00:00:06.619 [Pipeline] retry 00:00:06.623 [Pipeline] { 00:00:06.673 [Pipeline] sh 00:00:06.974 + git ls-remote https://review.spdk.io/gerrit/a/spdk/spdk refs/heads/master 00:00:11.193 [Pipeline] } 00:00:11.212 [Pipeline] // retry 00:00:11.216 [Pipeline] } 00:00:11.229 [Pipeline] // withCredentials 00:00:11.238 [Pipeline] httpRequest 00:00:11.242 HttpMethod: GET 00:00:11.243 URL: http://10.211.164.101/packages/spdk_9c9f7ddbbe5483ec0b43cb9e4b82cabcec1f320a.tar.gz 00:00:11.243 Sending request to url: http://10.211.164.101/packages/spdk_9c9f7ddbbe5483ec0b43cb9e4b82cabcec1f320a.tar.gz 00:00:11.245 Response Code: HTTP/1.1 200 OK 00:00:11.245 Success: Status code 200 is in the accepted range: 200,404 00:00:11.246 Saving response body to /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk_9c9f7ddbbe5483ec0b43cb9e4b82cabcec1f320a.tar.gz 00:00:13.406 [Pipeline] sh 00:00:13.688 + tar --no-same-owner -xf spdk_9c9f7ddbbe5483ec0b43cb9e4b82cabcec1f320a.tar.gz 00:00:15.598 [Pipeline] sh 00:00:15.878 + git -C spdk log --oneline -n5 00:00:15.878 9c9f7ddbb lib/event: make SPDK app exit upon RPC server launch failure 00:00:15.878 13481a596 test: ensure unique address for FIO plugin 00:00:15.878 a5fcb0302 spdk_trace: refactor output format handling 00:00:15.878 1b4773b8f dpdk/crypto: increase RTE_CRYPTO_MAX_DEVS to fit QAT SYM and ASYM VFs 00:00:15.878 bf8dcb56e rpc: add validation for timeout value 00:00:15.896 [Pipeline] sh 00:00:16.182 + git -C spdk show -s --format=%s 9c9f7ddbbe5483ec0b43cb9e4b82cabcec1f320a 00:00:16.201 [Pipeline] setCustomBuildProperty 00:00:16.210 [Pipeline] setCustomBuildProperty 00:00:16.231 [Pipeline] withCredentials 00:00:16.243 > git --version # timeout=10 00:00:16.258 > git --version # 'git version 2.39.2' 00:00:16.278 Masking supported pattern matches of $GIT_PASSWORD or $GIT_ASKPASS 00:00:16.280 [Pipeline] { 00:00:16.289 [Pipeline] retry 00:00:16.291 [Pipeline] { 00:00:16.308 [Pipeline] sh 00:00:16.595 + git ls-remote http://dpdk.org/git/dpdk-stable v23.11 00:00:20.830 [Pipeline] } 00:00:20.852 [Pipeline] // retry 00:00:20.856 [Pipeline] } 00:00:20.876 [Pipeline] // withCredentials 00:00:20.887 [Pipeline] httpRequest 00:00:20.891 HttpMethod: GET 00:00:20.892 URL: http://10.211.164.101/packages/dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:00:20.893 Sending request to url: http://10.211.164.101/packages/dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:00:20.895 Response Code: HTTP/1.1 200 OK 00:00:20.895 Success: Status code 200 is in the accepted range: 200,404 00:00:20.896 Saving response body to /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:00:22.125 [Pipeline] sh 00:00:22.408 + tar --no-same-owner -xf dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:00:23.798 [Pipeline] sh 00:00:24.084 + git -C dpdk log --oneline -n5 00:00:24.085 eeb0605f11 version: 23.11.0 00:00:24.085 238778122a doc: update release notes for 23.11 00:00:24.085 46aa6b3cfc doc: fix description of RSS features 00:00:24.085 dd88f51a57 devtools: forbid DPDK API in cnxk base driver 00:00:24.085 7e421ae345 devtools: support skipping forbid rule check 00:00:24.097 [Pipeline] catchError 00:00:24.099 [Pipeline] { 00:00:24.118 [Pipeline] readJSON 00:00:24.135 [Pipeline] } 00:00:24.159 [Pipeline] // catchError 00:00:24.163 [Pipeline] } 00:00:24.187 [Pipeline] // stage 00:00:24.204 [Pipeline] catchError 00:00:24.206 [Pipeline] { 00:00:24.225 [Pipeline] stage 00:00:24.227 [Pipeline] { (Tests) 00:00:24.408 [Pipeline] parallel 00:00:24.486 [Pipeline] { (Branch: unittest-vg-autotest) 00:00:24.487 [Pipeline] { (Branch: valgrind-vg-autotest) 00:00:24.488 [Pipeline] { (Branch: autobuild-vg-autotest) 00:00:24.490 [Pipeline] { (Branch: scanbuild-vg-autotest) 00:00:24.491 [Pipeline] { (Branch: lvol-vg-autotest) 00:00:24.492 [Pipeline] { (Branch: vhost-initiator-vg-autotest) 00:00:24.494 [Pipeline] { (Branch: nvmf-tcp-vg-autotest) 00:00:24.495 [Pipeline] { (Branch: nvmf-tcp-uring-vg-autotest) 00:00:24.496 [Pipeline] { (Branch: nvme-vg-autotest) 00:00:24.497 [Pipeline] { (Branch: centos7-vg-autotest) 00:00:24.499 [Pipeline] { (Branch: rocky9-vg-autotest) 00:00:24.500 [Pipeline] { (Branch: ubuntu20-vg-autotest) 00:00:24.502 [Pipeline] { (Branch: ubuntu22-vg-autotest) 00:00:24.503 [Pipeline] { (Branch: iscsi-vg-autotest) 00:00:24.504 [Pipeline] { (Branch: iscsi-uring-vg-autotest) 00:00:24.505 [Pipeline] { (Branch: zns-vg-autotest) 00:00:24.507 [Pipeline] { (Branch: clang-vg-autotest) 00:00:24.508 [Pipeline] { (Branch: nvme-cmb-pmr-vg-autotest) 00:00:24.509 [Pipeline] { (Branch: BlobFS-phy-autotest) 00:00:24.511 [Pipeline] { (Branch: crypto-phy-autotest) 00:00:24.512 [Pipeline] { (Branch: vhost-phy-autotest) 00:00:24.513 [Pipeline] { (Branch: nvmf-phy-autotest) 00:00:24.514 [Pipeline] { (Branch: nvmf-tcp-phy-autotest) 00:00:24.516 [Pipeline] { (Branch: nvme-phy-autotest) 00:00:24.517 [Pipeline] { (Branch: vfio-user-phy-autotest) 00:00:24.518 [Pipeline] { (Branch: short-fuzz-phy-autotest) 00:00:24.519 [Pipeline] { (Branch: dsa-phy-autotest) 00:00:24.520 [Pipeline] { (Branch: vmd-phy-autotest) 00:00:24.548 [Pipeline] retry 00:00:24.550 [Pipeline] { 00:00:24.554 [Pipeline] retry 00:00:24.556 [Pipeline] { 00:00:24.560 [Pipeline] retry 00:00:24.561 [Pipeline] { 00:00:24.566 [Pipeline] retry 00:00:24.567 [Pipeline] { 00:00:24.572 [Pipeline] retry 00:00:24.573 [Pipeline] { 00:00:24.578 [Pipeline] retry 00:00:24.579 [Pipeline] { 00:00:24.583 [Pipeline] retry 00:00:24.585 [Pipeline] { 00:00:24.589 [Pipeline] retry 00:00:24.591 [Pipeline] { 00:00:24.595 [Pipeline] retry 00:00:24.597 [Pipeline] { 00:00:24.601 [Pipeline] retry 00:00:24.602 [Pipeline] { 00:00:24.607 [Pipeline] retry 00:00:24.609 [Pipeline] { 00:00:24.613 [Pipeline] retry 00:00:24.614 [Pipeline] { 00:00:24.619 [Pipeline] retry 00:00:24.620 [Pipeline] { 00:00:24.625 [Pipeline] retry 00:00:24.626 [Pipeline] { 00:00:24.630 [Pipeline] retry 00:00:24.632 [Pipeline] { 00:00:24.636 [Pipeline] retry 00:00:24.638 [Pipeline] { 00:00:24.642 [Pipeline] retry 00:00:24.644 [Pipeline] { 00:00:24.648 [Pipeline] retry 00:00:24.649 [Pipeline] { 00:00:24.654 [Pipeline] retry 00:00:24.655 [Pipeline] { 00:00:24.660 [Pipeline] retry 00:00:24.661 [Pipeline] { 00:00:24.665 [Pipeline] retry 00:00:24.667 [Pipeline] { 00:00:24.671 [Pipeline] retry 00:00:24.672 [Pipeline] { 00:00:24.676 [Pipeline] retry 00:00:24.678 [Pipeline] { 00:00:24.682 [Pipeline] retry 00:00:24.683 [Pipeline] { 00:00:24.687 [Pipeline] retry 00:00:24.689 [Pipeline] { 00:00:24.693 [Pipeline] retry 00:00:24.694 [Pipeline] { 00:00:24.698 [Pipeline] retry 00:00:24.699 [Pipeline] { 00:00:24.704 [Pipeline] retry 00:00:24.705 [Pipeline] { 00:00:24.731 [Pipeline] build 00:00:24.733 Scheduling project: unittest-vg-autotest 00:00:24.738 [Pipeline] build 00:00:24.740 Scheduling project: valgrind-vg-autotest 00:00:24.746 [Pipeline] build 00:00:24.748 Scheduling project: autobuild-vg-autotest 00:00:24.753 [Pipeline] build 00:00:24.755 Scheduling project: scanbuild-vg-autotest 00:00:24.760 [Pipeline] build 00:00:24.762 Scheduling project: lvol-vg-autotest 00:00:24.768 [Pipeline] build 00:00:24.770 Scheduling project: vhost-initiator-vg-autotest 00:00:24.775 [Pipeline] build 00:00:24.777 Scheduling project: nvmf-tcp-vg-autotest 00:00:24.782 [Pipeline] build 00:00:24.784 Scheduling project: nvmf-tcp-uring-vg-autotest 00:00:24.789 [Pipeline] build 00:00:24.791 Scheduling project: nvme-vg-autotest 00:00:24.796 [Pipeline] build 00:00:24.798 Scheduling project: centos7-vg-autotest 00:00:24.803 [Pipeline] build 00:00:24.805 Scheduling project: rocky9-vg-autotest 00:00:24.810 [Pipeline] build 00:00:24.812 Scheduling project: ubuntu20-vg-autotest 00:00:24.817 [Pipeline] build 00:00:24.819 Scheduling project: ubuntu22-vg-autotest 00:00:24.824 [Pipeline] build 00:00:24.825 Scheduling project: iscsi-vg-autotest 00:00:24.830 [Pipeline] build 00:00:24.832 Scheduling project: iscsi-uring-vg-autotest 00:00:24.837 [Pipeline] build 00:00:24.839 Scheduling project: zns-vg-autotest 00:00:24.844 [Pipeline] build 00:00:24.846 Scheduling project: clang-vg-autotest 00:00:24.851 [Pipeline] build 00:00:24.853 Scheduling project: nvme-cmb-pmr-vg-autotest 00:00:24.857 [Pipeline] build 00:00:24.859 Scheduling project: BlobFS-phy-autotest 00:00:24.864 [Pipeline] build 00:00:24.865 Scheduling project: crypto-phy-autotest 00:00:24.870 [Pipeline] build 00:00:24.872 Scheduling project: vhost-phy-autotest 00:00:24.877 [Pipeline] build 00:00:24.879 Scheduling project: nvmf-phy-autotest 00:00:24.883 [Pipeline] build 00:00:24.885 Scheduling project: nvmf-tcp-phy-autotest 00:00:24.890 [Pipeline] build 00:00:24.892 Scheduling project: nvme-phy-autotest 00:00:24.896 [Pipeline] build 00:00:24.898 Scheduling project: vfio-user-phy-autotest 00:00:24.903 [Pipeline] build 00:00:24.904 Scheduling project: short-fuzz-phy-autotest 00:00:24.909 [Pipeline] build 00:00:24.910 Scheduling project: dsa-phy-autotest 00:00:24.915 [Pipeline] build 00:00:24.916 Scheduling project: vmd-phy-autotest 00:00:30.060 Starting building: vmd-phy-autotest #1958 00:00:30.064 Starting building: vhost-phy-autotest #23143 00:00:30.067 Starting building: rocky9-vg-autotest #13173 00:00:30.069 Starting building: BlobFS-phy-autotest #23122 00:00:30.073 Starting building: dsa-phy-autotest #2498 00:00:30.080 Starting building: short-fuzz-phy-autotest #23116 00:00:30.083 Starting building: crypto-phy-autotest #23120 00:00:30.085 Starting building: nvme-vg-autotest #74305 00:00:30.089 Starting building: vhost-initiator-vg-autotest #74326 00:00:30.092 Starting building: iscsi-vg-autotest #74342 00:00:30.095 Starting building: nvme-phy-autotest #69288 00:00:30.098 Starting building: nvme-cmb-pmr-vg-autotest #75427 00:00:30.101 Starting building: autobuild-vg-autotest #62867 00:00:30.104 Starting building: lvol-vg-autotest #74253 00:00:30.106 Starting building: centos7-vg-autotest #70801 00:00:30.108 Starting building: vfio-user-phy-autotest #23128 00:00:30.111 Starting building: ubuntu20-vg-autotest #70883 00:00:30.119 Starting building: nvmf-phy-autotest #69362 00:00:30.144 Starting building: nvmf-tcp-phy-autotest #69251 00:00:30.147 Starting building: ubuntu22-vg-autotest #34895 00:00:30.149 Starting building: nvmf-tcp-vg-autotest #74293 00:00:30.163 Starting building: zns-vg-autotest #73407 00:00:30.165 Starting building: scanbuild-vg-autotest #62825 00:00:30.168 Starting building: clang-vg-autotest #57073 00:00:30.171 Starting building: iscsi-uring-vg-autotest #74207 00:00:30.173 Starting building: unittest-vg-autotest #62827 00:00:30.175 Starting building: valgrind-vg-autotest #48637 00:00:30.180 Starting building: nvmf-tcp-uring-vg-autotest #74226 00:10:19.093 Build vhost-initiator-vg-autotest #74326 completed: SUCCESS 00:10:19.100 [Pipeline] } 00:10:19.146 [Pipeline] // retry 00:10:19.151 [Pipeline] } 00:10:26.589 Build short-fuzz-phy-autotest #23116 completed: SUCCESS 00:10:26.594 [Pipeline] } 00:10:26.635 [Pipeline] // retry 00:10:26.641 [Pipeline] } 00:10:45.094 Build dsa-phy-autotest #2498 completed: SUCCESS 00:10:45.097 [Pipeline] } 00:10:45.141 [Pipeline] // retry 00:10:45.147 [Pipeline] } 00:10:59.616 Build vmd-phy-autotest #1958 completed: SUCCESS 00:10:59.619 [Pipeline] } 00:10:59.663 [Pipeline] // retry 00:10:59.669 [Pipeline] } 00:12:07.594 Build lvol-vg-autotest #74253 completed: SUCCESS 00:12:07.598 [Pipeline] } 00:12:07.641 [Pipeline] // retry 00:12:07.647 [Pipeline] } 00:13:16.966 Build scanbuild-vg-autotest #62825 completed: SUCCESS 00:13:16.970 [Pipeline] } 00:13:17.013 [Pipeline] // retry 00:13:17.019 [Pipeline] } 00:13:28.458 Build zns-vg-autotest #73407 completed: SUCCESS 00:13:28.463 [Pipeline] } 00:13:28.506 [Pipeline] // retry 00:13:28.512 [Pipeline] } 00:14:41.886 Build nvme-cmb-pmr-vg-autotest #75427 completed: SUCCESS 00:14:41.895 [Pipeline] } 00:14:41.928 [Pipeline] // retry 00:14:41.933 [Pipeline] } 00:19:30.431 Build vfio-user-phy-autotest #23128 completed: SUCCESS 00:19:30.435 [Pipeline] } 00:19:30.473 [Pipeline] // retry 00:19:30.479 [Pipeline] } 00:21:32.377 Build centos7-vg-autotest #70801 completed: SUCCESS 00:21:32.386 [Pipeline] } 00:21:32.429 [Pipeline] // retry 00:21:32.436 [Pipeline] } 00:22:05.915 Build nvmf-tcp-uring-vg-autotest #74226 completed: FAILURE 00:22:06.899 [Pipeline] echo 00:22:06.900 No retry patterns found. 00:22:06.901 [Pipeline] } 00:22:06.934 [Pipeline] // retry 00:22:06.939 [Pipeline] error 00:22:06.943 [Pipeline] } 00:22:06.946 Failed in branch nvmf-tcp-uring-vg-autotest 00:22:53.139 Build BlobFS-phy-autotest #23122 completed: SUCCESS 00:22:53.142 [Pipeline] } 00:22:53.187 [Pipeline] // retry 00:22:53.193 [Pipeline] } 00:24:08.955 Build nvme-phy-autotest #69288 completed: SUCCESS 00:24:08.957 [Pipeline] } 00:24:08.999 [Pipeline] // retry 00:24:09.005 [Pipeline] } 00:25:19.594 Build autobuild-vg-autotest #62867 completed: SUCCESS 00:25:19.596 [Pipeline] } 00:25:19.640 [Pipeline] // retry 00:25:19.646 [Pipeline] } 00:26:15.659 Build nvme-vg-autotest #74305 completed: SUCCESS 00:26:15.662 [Pipeline] } 00:26:15.706 [Pipeline] // retry 00:26:15.712 [Pipeline] } 00:26:58.229 Build nvmf-phy-autotest #69362 completed: FAILURE 00:26:59.352 [Pipeline] echo 00:26:59.353 No retry patterns found. 00:26:59.354 [Pipeline] } 00:26:59.387 [Pipeline] // retry 00:26:59.393 [Pipeline] error 00:26:59.396 [Pipeline] } 00:26:59.398 Failed in branch nvmf-phy-autotest 00:28:18.236 Build crypto-phy-autotest #23120 completed: SUCCESS 00:28:18.242 [Pipeline] } 00:28:18.284 [Pipeline] // retry 00:28:18.291 [Pipeline] } 00:28:25.782 Build clang-vg-autotest #57073 completed: SUCCESS 00:28:25.785 [Pipeline] } 00:28:25.823 [Pipeline] // retry 00:28:25.828 [Pipeline] } 00:29:24.689 Build unittest-vg-autotest #62827 completed: SUCCESS 00:29:24.691 [Pipeline] } 00:29:24.739 [Pipeline] // retry 00:29:24.745 [Pipeline] } 00:29:59.720 Build nvmf-tcp-vg-autotest #74293 completed: SUCCESS 00:29:59.722 [Pipeline] } 00:29:59.756 [Pipeline] // retry 00:29:59.760 [Pipeline] } 00:30:01.051 Build iscsi-uring-vg-autotest #74207 completed: SUCCESS 00:30:01.054 [Pipeline] } 00:30:01.097 [Pipeline] // retry 00:30:01.103 [Pipeline] } 00:32:38.714 Build iscsi-vg-autotest #74342 completed: SUCCESS 00:32:38.716 [Pipeline] } 00:32:38.758 [Pipeline] // retry 00:32:38.763 [Pipeline] } 00:33:00.779 Build vhost-phy-autotest #23143 completed: SUCCESS 00:33:00.782 [Pipeline] } 00:33:00.819 [Pipeline] // retry 00:33:00.825 [Pipeline] } 00:34:54.591 Build nvmf-tcp-phy-autotest #69251 completed: SUCCESS 00:34:54.593 [Pipeline] } 00:34:54.632 [Pipeline] // retry 00:34:54.638 [Pipeline] } 00:39:21.969 Build ubuntu22-vg-autotest #34895 completed: SUCCESS 00:39:21.971 [Pipeline] } 00:39:22.011 [Pipeline] // retry 00:39:22.016 [Pipeline] } 00:39:37.098 Build valgrind-vg-autotest #48637 completed: SUCCESS 00:39:37.101 [Pipeline] } 00:39:37.140 [Pipeline] // retry 00:39:37.145 [Pipeline] } 00:40:34.434 Build rocky9-vg-autotest #13173 completed: SUCCESS 00:40:34.436 [Pipeline] } 00:40:34.462 [Pipeline] // retry 00:40:34.468 [Pipeline] } 00:41:51.746 Build ubuntu20-vg-autotest #70883 completed: SUCCESS 00:41:51.748 [Pipeline] } 00:41:51.786 [Pipeline] // retry 00:41:51.791 [Pipeline] } 00:41:51.962 [Pipeline] // parallel 00:41:51.969 [Pipeline] } 00:41:51.999 [Pipeline] // stage 00:41:52.010 [Pipeline] } 00:41:52.016 ERROR: Build nvmf-tcp-uring-vg-autotest #74226 failed 00:41:52.044 [Pipeline] // catchError 00:41:52.054 [Pipeline] stage 00:41:52.056 [Pipeline] { (Autorun Post and Coverage) 00:41:52.089 [Pipeline] setCustomBuildProperty 00:41:52.406 [Pipeline] dir 00:41:52.407 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-initiator-vg-autotest_74326 00:41:52.408 [Pipeline] { 00:41:52.443 [Pipeline] copyArtifacts 00:41:52.722 Copied 15 artifacts from "vhost-initiator-vg-autotest" build number 74326 00:41:52.726 [Pipeline] writeFile 00:41:52.838 [Pipeline] } 00:41:52.908 [Pipeline] // dir 00:41:53.316 [Pipeline] dir 00:41:53.317 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/short-fuzz-phy-autotest_23116 00:41:53.318 [Pipeline] { 00:41:53.360 [Pipeline] copyArtifacts 00:41:53.494 Copied 10 artifacts from "short-fuzz-phy-autotest" build number 23116 00:41:53.498 [Pipeline] writeFile 00:41:53.670 [Pipeline] } 00:41:53.769 [Pipeline] // dir 00:41:54.038 [Pipeline] dir 00:41:54.038 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/dsa-phy-autotest_2498 00:41:54.039 [Pipeline] { 00:41:54.073 [Pipeline] copyArtifacts 00:41:54.304 Copied 12 artifacts from "dsa-phy-autotest" build number 2498 00:41:54.308 [Pipeline] writeFile 00:41:54.433 [Pipeline] } 00:41:54.496 [Pipeline] // dir 00:41:54.789 [Pipeline] dir 00:41:54.789 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vmd-phy-autotest_1958 00:41:54.790 [Pipeline] { 00:41:54.823 [Pipeline] copyArtifacts 00:41:55.051 Copied 12 artifacts from "vmd-phy-autotest" build number 1958 00:41:55.054 [Pipeline] writeFile 00:41:55.174 [Pipeline] } 00:41:55.247 [Pipeline] // dir 00:41:55.783 [Pipeline] dir 00:41:55.784 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/lvol-vg-autotest_74253 00:41:55.785 [Pipeline] { 00:41:55.829 [Pipeline] copyArtifacts 00:41:56.061 Copied 12 artifacts from "lvol-vg-autotest" build number 74253 00:41:56.065 [Pipeline] writeFile 00:41:56.264 [Pipeline] } 00:41:56.360 [Pipeline] // dir 00:41:56.438 [Pipeline] dir 00:41:56.438 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/scanbuild-vg-autotest_62825 00:41:56.439 [Pipeline] { 00:41:56.464 [Pipeline] copyArtifacts 00:41:56.616 Copied 12 artifacts from "scanbuild-vg-autotest" build number 62825 00:41:56.619 [Pipeline] writeFile 00:41:56.688 [Pipeline] } 00:41:56.724 [Pipeline] // dir 00:41:57.027 [Pipeline] dir 00:41:57.027 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/zns-vg-autotest_73407 00:41:57.028 [Pipeline] { 00:41:57.056 [Pipeline] copyArtifacts 00:41:57.289 Copied 13 artifacts from "zns-vg-autotest" build number 73407 00:41:57.294 [Pipeline] writeFile 00:41:57.431 [Pipeline] } 00:41:57.490 [Pipeline] // dir 00:41:57.777 [Pipeline] dir 00:41:57.777 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-cmb-pmr-vg-autotest_75427 00:41:57.779 [Pipeline] { 00:41:57.810 [Pipeline] copyArtifacts 00:41:58.035 Copied 12 artifacts from "nvme-cmb-pmr-vg-autotest" build number 75427 00:41:58.039 [Pipeline] writeFile 00:41:58.192 [Pipeline] } 00:41:58.278 [Pipeline] // dir 00:41:58.731 [Pipeline] dir 00:41:58.731 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vfio-user-phy-autotest_23128 00:41:58.732 [Pipeline] { 00:41:58.783 [Pipeline] copyArtifacts 00:41:59.009 Copied 12 artifacts from "vfio-user-phy-autotest" build number 23128 00:41:59.013 [Pipeline] writeFile 00:41:59.215 [Pipeline] } 00:41:59.306 [Pipeline] // dir 00:41:59.926 [Pipeline] dir 00:41:59.927 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/centos7-vg-autotest_70801 00:41:59.928 [Pipeline] { 00:41:59.966 [Pipeline] copyArtifacts 00:42:00.355 Copied 13 artifacts from "centos7-vg-autotest" build number 70801 00:42:00.358 [Pipeline] writeFile 00:42:00.600 [Pipeline] } 00:42:00.708 [Pipeline] // dir 00:42:01.387 [Pipeline] dir 00:42:01.387 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-uring-vg-autotest_74226 00:42:01.388 [Pipeline] { 00:42:01.441 [Pipeline] copyArtifacts 00:42:01.854 Copied 13 artifacts from "nvmf-tcp-uring-vg-autotest" build number 74226 00:42:01.859 [Pipeline] writeFile 00:42:02.095 [Pipeline] } 00:42:02.227 [Pipeline] // dir 00:42:02.507 [Pipeline] dir 00:42:02.507 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/BlobFS-phy-autotest_23122 00:42:02.508 [Pipeline] { 00:42:02.546 [Pipeline] copyArtifacts 00:42:02.968 Copied 28 artifacts from "BlobFS-phy-autotest" build number 23122 00:42:02.972 [Pipeline] writeFile 00:42:03.096 [Pipeline] } 00:42:03.183 [Pipeline] // dir 00:42:03.739 [Pipeline] dir 00:42:03.739 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-phy-autotest_69288 00:42:03.740 [Pipeline] { 00:42:03.786 [Pipeline] copyArtifacts 00:42:04.049 Copied 12 artifacts from "nvme-phy-autotest" build number 69288 00:42:04.053 [Pipeline] writeFile 00:42:04.306 [Pipeline] } 00:42:04.408 [Pipeline] // dir 00:42:04.567 [Pipeline] dir 00:42:04.567 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/autobuild-vg-autotest_62867 00:42:04.569 [Pipeline] { 00:42:04.596 [Pipeline] copyArtifacts 00:42:04.884 Copied 9 artifacts from "autobuild-vg-autotest" build number 62867 00:42:04.887 [Pipeline] writeFile 00:42:04.960 [Pipeline] } 00:42:05.009 [Pipeline] // dir 00:42:05.510 [Pipeline] dir 00:42:05.511 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-vg-autotest_74305 00:42:05.512 [Pipeline] { 00:42:05.553 [Pipeline] copyArtifacts 00:42:05.777 Copied 12 artifacts from "nvme-vg-autotest" build number 74305 00:42:05.781 [Pipeline] writeFile 00:42:06.045 [Pipeline] } 00:42:06.155 [Pipeline] // dir 00:42:06.924 [Pipeline] dir 00:42:06.924 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-phy-autotest_69362 00:42:06.925 [Pipeline] { 00:42:06.985 [Pipeline] copyArtifacts 00:42:08.350 Copied 18 artifacts from "nvmf-phy-autotest" build number 69362 00:42:08.354 [Pipeline] writeFile 00:42:08.591 [Pipeline] } 00:42:08.739 [Pipeline] // dir 00:42:09.944 [Pipeline] dir 00:42:09.944 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/crypto-phy-autotest_23120 00:42:09.945 [Pipeline] { 00:42:10.024 [Pipeline] copyArtifacts 00:42:10.265 Copied 12 artifacts from "crypto-phy-autotest" build number 23120 00:42:10.268 [Pipeline] writeFile 00:42:10.824 [Pipeline] } 00:42:11.026 [Pipeline] // dir 00:42:11.286 [Pipeline] dir 00:42:11.286 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/clang-vg-autotest_57073 00:42:11.287 [Pipeline] { 00:42:11.324 [Pipeline] copyArtifacts 00:42:11.423 Copied 9 artifacts from "clang-vg-autotest" build number 57073 00:42:11.427 [Pipeline] writeFile 00:42:11.542 [Pipeline] } 00:42:11.619 [Pipeline] // dir 00:42:11.902 [Pipeline] dir 00:42:11.902 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-vg-autotest_62827 00:42:11.904 [Pipeline] { 00:42:11.939 [Pipeline] copyArtifacts 00:42:12.377 Copied 14 artifacts from "unittest-vg-autotest" build number 62827 00:42:12.381 [Pipeline] writeFile 00:42:12.507 [Pipeline] } 00:42:12.585 [Pipeline] // dir 00:42:13.424 [Pipeline] dir 00:42:13.424 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-vg-autotest_74293 00:42:13.425 [Pipeline] { 00:42:13.472 [Pipeline] copyArtifacts 00:42:13.739 Copied 14 artifacts from "nvmf-tcp-vg-autotest" build number 74293 00:42:13.742 [Pipeline] writeFile 00:42:14.094 [Pipeline] } 00:42:14.248 [Pipeline] // dir 00:42:17.029 [Pipeline] dir 00:42:17.030 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-uring-vg-autotest_74207 00:42:17.030 [Pipeline] { 00:42:17.238 [Pipeline] copyArtifacts 00:42:19.471 Copied 16 artifacts from "iscsi-uring-vg-autotest" build number 74207 00:42:19.475 [Pipeline] writeFile 00:42:20.777 [Pipeline] } 00:42:21.442 [Pipeline] // dir 00:42:23.754 [Pipeline] dir 00:42:23.755 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-vg-autotest_74342 00:42:23.756 [Pipeline] { 00:42:23.965 [Pipeline] copyArtifacts 00:42:25.688 Copied 15 artifacts from "iscsi-vg-autotest" build number 74342 00:42:25.692 [Pipeline] writeFile 00:42:26.834 [Pipeline] } 00:42:27.336 [Pipeline] // dir 00:42:27.840 [Pipeline] dir 00:42:27.841 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-phy-autotest_23143 00:42:27.841 [Pipeline] { 00:42:27.895 [Pipeline] copyArtifacts 00:42:28.130 Copied 13 artifacts from "vhost-phy-autotest" build number 23143 00:42:28.135 [Pipeline] writeFile 00:42:28.330 [Pipeline] } 00:42:28.448 [Pipeline] // dir 00:42:29.657 [Pipeline] dir 00:42:29.657 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-phy-autotest_69251 00:42:29.658 [Pipeline] { 00:42:29.741 [Pipeline] copyArtifacts 00:42:30.077 Copied 14 artifacts from "nvmf-tcp-phy-autotest" build number 69251 00:42:30.081 [Pipeline] writeFile 00:42:30.521 [Pipeline] } 00:42:30.720 [Pipeline] // dir 00:42:31.635 [Pipeline] dir 00:42:31.636 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu22-vg-autotest_34895 00:42:31.637 [Pipeline] { 00:42:31.697 [Pipeline] copyArtifacts 00:42:32.106 Copied 13 artifacts from "ubuntu22-vg-autotest" build number 34895 00:42:32.110 [Pipeline] writeFile 00:42:32.444 [Pipeline] } 00:42:32.562 [Pipeline] // dir 00:42:33.224 [Pipeline] dir 00:42:33.225 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/valgrind-vg-autotest_48637 00:42:33.226 [Pipeline] { 00:42:33.287 [Pipeline] copyArtifacts 00:42:33.712 Copied 13 artifacts from "valgrind-vg-autotest" build number 48637 00:42:33.717 [Pipeline] writeFile 00:42:34.063 [Pipeline] } 00:42:34.225 [Pipeline] // dir 00:42:35.250 [Pipeline] dir 00:42:35.250 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/rocky9-vg-autotest_13173 00:42:35.251 [Pipeline] { 00:42:35.320 [Pipeline] copyArtifacts 00:42:35.710 Copied 13 artifacts from "rocky9-vg-autotest" build number 13173 00:42:35.714 [Pipeline] writeFile 00:42:36.158 [Pipeline] } 00:42:36.365 [Pipeline] // dir 00:42:37.159 [Pipeline] dir 00:42:37.159 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu20-vg-autotest_70883 00:42:37.160 [Pipeline] { 00:42:37.215 [Pipeline] copyArtifacts 00:42:37.589 Copied 13 artifacts from "ubuntu20-vg-autotest" build number 70883 00:42:37.593 [Pipeline] writeFile 00:42:37.937 [Pipeline] } 00:42:38.100 [Pipeline] // dir 00:42:38.108 [Pipeline] catchError 00:42:38.110 [Pipeline] { 00:42:38.125 [Pipeline] sh 00:42:38.400 + jbp/jenkins/jjb-config/jobs/scripts/post_gen_coverage.sh 00:42:38.400 + shopt -s globstar nullglob 00:42:38.400 + echo 'Start stage post_gen_coverage.sh' 00:42:38.400 Start stage post_gen_coverage.sh 00:42:38.400 + cd /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11 00:42:38.400 + rm -rf /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/doc 00:42:38.400 + trap 'compress_coverage_and_docs; remove_partial_coverage_files && echo '\''End stage post_gen_coverage.sh'\''' EXIT 00:42:38.400 + move_artifacts 00:42:38.400 + local out_dirs 00:42:38.400 + out_dirs=(./**/output/) 00:42:38.400 + for dir in "${out_dirs[@]}" 00:42:38.400 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.400 + [[ -f ./autobuild-vg-autotest_62867/output//doc.tar.xz ]] 00:42:38.400 + tar -C ./autobuild-vg-autotest_62867/output/ -xf ./autobuild-vg-autotest_62867/output//doc.tar.xz 00:42:38.658 + rm ./autobuild-vg-autotest_62867/output//doc.tar.xz 00:42:38.658 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.658 + [[ -f ./autobuild-vg-autotest_62867/output//ut_coverage.tar.xz ]] 00:42:38.658 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.658 + [[ -f ./autobuild-vg-autotest_62867/output//llvm.tar.xz ]] 00:42:38.658 + mv ./autobuild-vg-autotest_62867/output//build-pkg-manifest.txt ./autobuild-vg-autotest_62867/output//build-repo-manifest.txt ./autobuild-vg-autotest_62867/output//dmesg.init.log ./autobuild-vg-autotest_62867/output//dmesg.log ./autobuild-vg-autotest_62867/output//doc ./autobuild-vg-autotest_62867/output//power.tar.xz ./autobuild-vg-autotest_62867/output//test_completions.txt ./autobuild-vg-autotest_62867/output//timing.svg ./autobuild-vg-autotest_62867/output//timing.txt ./autobuild-vg-autotest_62867/output//.. 00:42:38.658 + rmdir ./autobuild-vg-autotest_62867/output/ 00:42:38.658 + for dir in "${out_dirs[@]}" 00:42:38.658 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.658 + [[ -f ./BlobFS-phy-autotest_23122/output//doc.tar.xz ]] 00:42:38.658 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.658 + [[ -f ./BlobFS-phy-autotest_23122/output//ut_coverage.tar.xz ]] 00:42:38.658 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.658 + [[ -f ./BlobFS-phy-autotest_23122/output//llvm.tar.xz ]] 00:42:38.658 + mv ./BlobFS-phy-autotest_23122/output//all_tests.txt ./BlobFS-phy-autotest_23122/output//build-pkg-manifest.txt ./BlobFS-phy-autotest_23122/output//build-repo-manifest.txt ./BlobFS-phy-autotest_23122/output//cov_base.info.xz ./BlobFS-phy-autotest_23122/output//cov_test.info.xz ./BlobFS-phy-autotest_23122/output//cov_total.info.xz ./BlobFS-phy-autotest_23122/output//dmesg.init.log ./BlobFS-phy-autotest_23122/output//dmesg.log ./BlobFS-phy-autotest_23122/output//power.tar.xz ./BlobFS-phy-autotest_23122/output//rocksdb ./BlobFS-phy-autotest_23122/output//test_completions.txt ./BlobFS-phy-autotest_23122/output//timing.svg ./BlobFS-phy-autotest_23122/output//timing.txt ./BlobFS-phy-autotest_23122/output//.. 00:42:38.658 + rmdir ./BlobFS-phy-autotest_23122/output/ 00:42:38.658 + for dir in "${out_dirs[@]}" 00:42:38.658 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.658 + [[ -f ./centos7-vg-autotest_70801/output//doc.tar.xz ]] 00:42:38.658 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.658 + [[ -f ./centos7-vg-autotest_70801/output//ut_coverage.tar.xz ]] 00:42:38.658 + tar -C ./centos7-vg-autotest_70801/output/ -xf ./centos7-vg-autotest_70801/output//ut_coverage.tar.xz 00:42:38.658 + rm ./centos7-vg-autotest_70801/output//ut_coverage.tar.xz 00:42:38.658 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.658 + [[ -f ./centos7-vg-autotest_70801/output//llvm.tar.xz ]] 00:42:38.658 + mv ./centos7-vg-autotest_70801/output//all_tests.txt ./centos7-vg-autotest_70801/output//build-pkg-manifest.txt ./centos7-vg-autotest_70801/output//build-repo-manifest.txt ./centos7-vg-autotest_70801/output//cov_base.info.xz ./centos7-vg-autotest_70801/output//cov_test.info.xz ./centos7-vg-autotest_70801/output//cov_total.info.xz ./centos7-vg-autotest_70801/output//dmesg.init.log ./centos7-vg-autotest_70801/output//dmesg.log ./centos7-vg-autotest_70801/output//power.tar.xz ./centos7-vg-autotest_70801/output//test_completions.txt ./centos7-vg-autotest_70801/output//timing.svg ./centos7-vg-autotest_70801/output//timing.txt ./centos7-vg-autotest_70801/output//ut_coverage ./centos7-vg-autotest_70801/output//.. 00:42:38.658 + rmdir ./centos7-vg-autotest_70801/output/ 00:42:38.658 + for dir in "${out_dirs[@]}" 00:42:38.658 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.658 + [[ -f ./clang-vg-autotest_57073/output//doc.tar.xz ]] 00:42:38.658 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.658 + [[ -f ./clang-vg-autotest_57073/output//ut_coverage.tar.xz ]] 00:42:38.658 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.658 + [[ -f ./clang-vg-autotest_57073/output//llvm.tar.xz ]] 00:42:38.658 + mv ./clang-vg-autotest_57073/output//all_tests.txt ./clang-vg-autotest_57073/output//build-pkg-manifest.txt ./clang-vg-autotest_57073/output//build-repo-manifest.txt ./clang-vg-autotest_57073/output//dmesg.init.log ./clang-vg-autotest_57073/output//dmesg.log ./clang-vg-autotest_57073/output//power.tar.xz ./clang-vg-autotest_57073/output//test_completions.txt ./clang-vg-autotest_57073/output//timing.svg ./clang-vg-autotest_57073/output//timing.txt ./clang-vg-autotest_57073/output//.. 00:42:38.658 + rmdir ./clang-vg-autotest_57073/output/ 00:42:38.658 + for dir in "${out_dirs[@]}" 00:42:38.658 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.658 + [[ -f ./crypto-phy-autotest_23120/output//doc.tar.xz ]] 00:42:38.658 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.658 + [[ -f ./crypto-phy-autotest_23120/output//ut_coverage.tar.xz ]] 00:42:38.658 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.658 + [[ -f ./crypto-phy-autotest_23120/output//llvm.tar.xz ]] 00:42:38.658 + mv ./crypto-phy-autotest_23120/output//all_tests.txt ./crypto-phy-autotest_23120/output//build-pkg-manifest.txt ./crypto-phy-autotest_23120/output//build-repo-manifest.txt ./crypto-phy-autotest_23120/output//cov_base.info.xz ./crypto-phy-autotest_23120/output//cov_test.info.xz ./crypto-phy-autotest_23120/output//cov_total.info.xz ./crypto-phy-autotest_23120/output//dmesg.init.log ./crypto-phy-autotest_23120/output//dmesg.log ./crypto-phy-autotest_23120/output//power.tar.xz ./crypto-phy-autotest_23120/output//test_completions.txt ./crypto-phy-autotest_23120/output//timing.svg ./crypto-phy-autotest_23120/output//timing.txt ./crypto-phy-autotest_23120/output//.. 00:42:38.658 + rmdir ./crypto-phy-autotest_23120/output/ 00:42:38.917 + for dir in "${out_dirs[@]}" 00:42:38.917 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.917 + [[ -f ./dsa-phy-autotest_2498/output//doc.tar.xz ]] 00:42:38.917 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.917 + [[ -f ./dsa-phy-autotest_2498/output//ut_coverage.tar.xz ]] 00:42:38.917 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.917 + [[ -f ./dsa-phy-autotest_2498/output//llvm.tar.xz ]] 00:42:38.917 + mv ./dsa-phy-autotest_2498/output//all_tests.txt ./dsa-phy-autotest_2498/output//build-pkg-manifest.txt ./dsa-phy-autotest_2498/output//build-repo-manifest.txt ./dsa-phy-autotest_2498/output//cov_base.info.xz ./dsa-phy-autotest_2498/output//cov_test.info.xz ./dsa-phy-autotest_2498/output//cov_total.info.xz ./dsa-phy-autotest_2498/output//dmesg.init.log ./dsa-phy-autotest_2498/output//dmesg.log ./dsa-phy-autotest_2498/output//power.tar.xz ./dsa-phy-autotest_2498/output//test_completions.txt ./dsa-phy-autotest_2498/output//timing.svg ./dsa-phy-autotest_2498/output//timing.txt ./dsa-phy-autotest_2498/output//.. 00:42:38.917 + rmdir ./dsa-phy-autotest_2498/output/ 00:42:38.917 + for dir in "${out_dirs[@]}" 00:42:38.917 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.917 + [[ -f ./iscsi-uring-vg-autotest_74207/output//doc.tar.xz ]] 00:42:38.917 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.917 + [[ -f ./iscsi-uring-vg-autotest_74207/output//ut_coverage.tar.xz ]] 00:42:38.917 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.917 + [[ -f ./iscsi-uring-vg-autotest_74207/output//llvm.tar.xz ]] 00:42:38.917 + mv ./iscsi-uring-vg-autotest_74207/output//all_tests.txt ./iscsi-uring-vg-autotest_74207/output//build-kernel-manifest.txt ./iscsi-uring-vg-autotest_74207/output//build-pkg-manifest.txt ./iscsi-uring-vg-autotest_74207/output//build-repo-manifest.txt ./iscsi-uring-vg-autotest_74207/output//calsoft.json ./iscsi-uring-vg-autotest_74207/output//calsoft.tar.xz ./iscsi-uring-vg-autotest_74207/output//cov_base.info.xz ./iscsi-uring-vg-autotest_74207/output//cov_test.info.xz ./iscsi-uring-vg-autotest_74207/output//cov_total.info.xz ./iscsi-uring-vg-autotest_74207/output//dmesg.init.log ./iscsi-uring-vg-autotest_74207/output//dmesg.log ./iscsi-uring-vg-autotest_74207/output//iscsi_autofuzz_logs.txt ./iscsi-uring-vg-autotest_74207/output//power.tar.xz ./iscsi-uring-vg-autotest_74207/output//test_completions.txt ./iscsi-uring-vg-autotest_74207/output//timing.svg ./iscsi-uring-vg-autotest_74207/output//timing.txt ./iscsi-uring-vg-autotest_74207/output//.. 00:42:38.917 + rmdir ./iscsi-uring-vg-autotest_74207/output/ 00:42:38.917 + for dir in "${out_dirs[@]}" 00:42:38.917 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.917 + [[ -f ./iscsi-vg-autotest_74342/output//doc.tar.xz ]] 00:42:38.917 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.917 + [[ -f ./iscsi-vg-autotest_74342/output//ut_coverage.tar.xz ]] 00:42:38.917 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.917 + [[ -f ./iscsi-vg-autotest_74342/output//llvm.tar.xz ]] 00:42:38.918 + mv ./iscsi-vg-autotest_74342/output//all_tests.txt ./iscsi-vg-autotest_74342/output//build-pkg-manifest.txt ./iscsi-vg-autotest_74342/output//build-repo-manifest.txt ./iscsi-vg-autotest_74342/output//calsoft.json ./iscsi-vg-autotest_74342/output//calsoft.tar.xz ./iscsi-vg-autotest_74342/output//cov_base.info.xz ./iscsi-vg-autotest_74342/output//cov_test.info.xz ./iscsi-vg-autotest_74342/output//cov_total.info.xz ./iscsi-vg-autotest_74342/output//dmesg.init.log ./iscsi-vg-autotest_74342/output//dmesg.log ./iscsi-vg-autotest_74342/output//iscsi_autofuzz_logs.txt ./iscsi-vg-autotest_74342/output//power.tar.xz ./iscsi-vg-autotest_74342/output//test_completions.txt ./iscsi-vg-autotest_74342/output//timing.svg ./iscsi-vg-autotest_74342/output//timing.txt ./iscsi-vg-autotest_74342/output//.. 00:42:38.918 + rmdir ./iscsi-vg-autotest_74342/output/ 00:42:38.918 + for dir in "${out_dirs[@]}" 00:42:38.918 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.918 + [[ -f ./lvol-vg-autotest_74253/output//doc.tar.xz ]] 00:42:38.918 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.918 + [[ -f ./lvol-vg-autotest_74253/output//ut_coverage.tar.xz ]] 00:42:38.918 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.918 + [[ -f ./lvol-vg-autotest_74253/output//llvm.tar.xz ]] 00:42:38.918 + mv ./lvol-vg-autotest_74253/output//all_tests.txt ./lvol-vg-autotest_74253/output//build-pkg-manifest.txt ./lvol-vg-autotest_74253/output//build-repo-manifest.txt ./lvol-vg-autotest_74253/output//cov_base.info.xz ./lvol-vg-autotest_74253/output//cov_test.info.xz ./lvol-vg-autotest_74253/output//cov_total.info.xz ./lvol-vg-autotest_74253/output//dmesg.init.log ./lvol-vg-autotest_74253/output//dmesg.log ./lvol-vg-autotest_74253/output//power.tar.xz ./lvol-vg-autotest_74253/output//test_completions.txt ./lvol-vg-autotest_74253/output//timing.svg ./lvol-vg-autotest_74253/output//timing.txt ./lvol-vg-autotest_74253/output//.. 00:42:38.918 + rmdir ./lvol-vg-autotest_74253/output/ 00:42:38.918 + for dir in "${out_dirs[@]}" 00:42:38.918 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.918 + [[ -f ./nvme-cmb-pmr-vg-autotest_75427/output//doc.tar.xz ]] 00:42:38.918 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.918 + [[ -f ./nvme-cmb-pmr-vg-autotest_75427/output//ut_coverage.tar.xz ]] 00:42:38.918 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.918 + [[ -f ./nvme-cmb-pmr-vg-autotest_75427/output//llvm.tar.xz ]] 00:42:38.918 + mv ./nvme-cmb-pmr-vg-autotest_75427/output//all_tests.txt ./nvme-cmb-pmr-vg-autotest_75427/output//build-pkg-manifest.txt ./nvme-cmb-pmr-vg-autotest_75427/output//build-repo-manifest.txt ./nvme-cmb-pmr-vg-autotest_75427/output//cov_base.info.xz ./nvme-cmb-pmr-vg-autotest_75427/output//cov_test.info.xz ./nvme-cmb-pmr-vg-autotest_75427/output//cov_total.info.xz ./nvme-cmb-pmr-vg-autotest_75427/output//dmesg.init.log ./nvme-cmb-pmr-vg-autotest_75427/output//dmesg.log ./nvme-cmb-pmr-vg-autotest_75427/output//power.tar.xz ./nvme-cmb-pmr-vg-autotest_75427/output//test_completions.txt ./nvme-cmb-pmr-vg-autotest_75427/output//timing.svg ./nvme-cmb-pmr-vg-autotest_75427/output//timing.txt ./nvme-cmb-pmr-vg-autotest_75427/output//.. 00:42:38.918 + rmdir ./nvme-cmb-pmr-vg-autotest_75427/output/ 00:42:38.918 + for dir in "${out_dirs[@]}" 00:42:38.918 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.918 + [[ -f ./nvme-phy-autotest_69288/output//doc.tar.xz ]] 00:42:38.918 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.918 + [[ -f ./nvme-phy-autotest_69288/output//ut_coverage.tar.xz ]] 00:42:38.918 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.918 + [[ -f ./nvme-phy-autotest_69288/output//llvm.tar.xz ]] 00:42:38.918 + mv ./nvme-phy-autotest_69288/output//all_tests.txt ./nvme-phy-autotest_69288/output//build-pkg-manifest.txt ./nvme-phy-autotest_69288/output//build-repo-manifest.txt ./nvme-phy-autotest_69288/output//cov_base.info.xz ./nvme-phy-autotest_69288/output//cov_test.info.xz ./nvme-phy-autotest_69288/output//cov_total.info.xz ./nvme-phy-autotest_69288/output//dmesg.init.log ./nvme-phy-autotest_69288/output//dmesg.log ./nvme-phy-autotest_69288/output//power.tar.xz ./nvme-phy-autotest_69288/output//test_completions.txt ./nvme-phy-autotest_69288/output//timing.svg ./nvme-phy-autotest_69288/output//timing.txt ./nvme-phy-autotest_69288/output//.. 00:42:38.918 + rmdir ./nvme-phy-autotest_69288/output/ 00:42:38.918 + for dir in "${out_dirs[@]}" 00:42:38.918 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.918 + [[ -f ./nvme-vg-autotest_74305/output//doc.tar.xz ]] 00:42:38.918 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.918 + [[ -f ./nvme-vg-autotest_74305/output//ut_coverage.tar.xz ]] 00:42:38.918 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.918 + [[ -f ./nvme-vg-autotest_74305/output//llvm.tar.xz ]] 00:42:38.918 + mv ./nvme-vg-autotest_74305/output//all_tests.txt ./nvme-vg-autotest_74305/output//build-pkg-manifest.txt ./nvme-vg-autotest_74305/output//build-repo-manifest.txt ./nvme-vg-autotest_74305/output//cov_base.info.xz ./nvme-vg-autotest_74305/output//cov_test.info.xz ./nvme-vg-autotest_74305/output//cov_total.info.xz ./nvme-vg-autotest_74305/output//dmesg.init.log ./nvme-vg-autotest_74305/output//dmesg.log ./nvme-vg-autotest_74305/output//power.tar.xz ./nvme-vg-autotest_74305/output//test_completions.txt ./nvme-vg-autotest_74305/output//timing.svg ./nvme-vg-autotest_74305/output//timing.txt ./nvme-vg-autotest_74305/output//.. 00:42:38.918 + rmdir ./nvme-vg-autotest_74305/output/ 00:42:38.918 + for dir in "${out_dirs[@]}" 00:42:38.918 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.918 + [[ -f ./nvmf-phy-autotest_69362/output//doc.tar.xz ]] 00:42:38.918 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.918 + [[ -f ./nvmf-phy-autotest_69362/output//ut_coverage.tar.xz ]] 00:42:38.918 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.918 + [[ -f ./nvmf-phy-autotest_69362/output//llvm.tar.xz ]] 00:42:38.918 + mv ./nvmf-phy-autotest_69362/output//all_tests.txt ./nvmf-phy-autotest_69362/output//build-pkg-manifest.txt ./nvmf-phy-autotest_69362/output//build-repo-manifest.txt ./nvmf-phy-autotest_69362/output//coredumps ./nvmf-phy-autotest_69362/output//cov_base.info.xz ./nvmf-phy-autotest_69362/output//dmesg.init.log ./nvmf-phy-autotest_69362/output//dmesg.log ./nvmf-phy-autotest_69362/output//nvmf_fuzz_tgt_output.txt ./nvmf-phy-autotest_69362/output//nvmf_trace.0_shm.tar.gz ./nvmf-phy-autotest_69362/output//power.tar.xz ./nvmf-phy-autotest_69362/output//proc_list.txt ./nvmf-phy-autotest_69362/output//test_completions.txt ./nvmf-phy-autotest_69362/output//timing.txt ./nvmf-phy-autotest_69362/output//udev.log ./nvmf-phy-autotest_69362/output//.. 00:42:38.918 + rmdir ./nvmf-phy-autotest_69362/output/ 00:42:38.918 + for dir in "${out_dirs[@]}" 00:42:38.918 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.918 + [[ -f ./nvmf-tcp-phy-autotest_69251/output//doc.tar.xz ]] 00:42:38.918 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.918 + [[ -f ./nvmf-tcp-phy-autotest_69251/output//ut_coverage.tar.xz ]] 00:42:38.918 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.918 + [[ -f ./nvmf-tcp-phy-autotest_69251/output//llvm.tar.xz ]] 00:42:38.918 + mv ./nvmf-tcp-phy-autotest_69251/output//all_tests.txt ./nvmf-tcp-phy-autotest_69251/output//build-pkg-manifest.txt ./nvmf-tcp-phy-autotest_69251/output//build-repo-manifest.txt ./nvmf-tcp-phy-autotest_69251/output//cov_base.info.xz ./nvmf-tcp-phy-autotest_69251/output//cov_test.info.xz ./nvmf-tcp-phy-autotest_69251/output//cov_total.info.xz ./nvmf-tcp-phy-autotest_69251/output//dmesg.init.log ./nvmf-tcp-phy-autotest_69251/output//dmesg.log ./nvmf-tcp-phy-autotest_69251/output//nvmf_fuzz_tgt_output.txt ./nvmf-tcp-phy-autotest_69251/output//nvmf_trace.0_shm.tar.gz ./nvmf-tcp-phy-autotest_69251/output//power.tar.xz ./nvmf-tcp-phy-autotest_69251/output//test_completions.txt ./nvmf-tcp-phy-autotest_69251/output//timing.svg ./nvmf-tcp-phy-autotest_69251/output//timing.txt ./nvmf-tcp-phy-autotest_69251/output//.. 00:42:38.918 + rmdir ./nvmf-tcp-phy-autotest_69251/output/ 00:42:38.918 + for dir in "${out_dirs[@]}" 00:42:38.918 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.918 + [[ -f ./nvmf-tcp-uring-vg-autotest_74226/output//doc.tar.xz ]] 00:42:38.918 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.918 + [[ -f ./nvmf-tcp-uring-vg-autotest_74226/output//ut_coverage.tar.xz ]] 00:42:38.918 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.918 + [[ -f ./nvmf-tcp-uring-vg-autotest_74226/output//llvm.tar.xz ]] 00:42:38.918 + mv ./nvmf-tcp-uring-vg-autotest_74226/output//all_tests.txt ./nvmf-tcp-uring-vg-autotest_74226/output//build-pkg-manifest.txt ./nvmf-tcp-uring-vg-autotest_74226/output//build-repo-manifest.txt ./nvmf-tcp-uring-vg-autotest_74226/output//cov_base.info.xz ./nvmf-tcp-uring-vg-autotest_74226/output//dmesg.init.log ./nvmf-tcp-uring-vg-autotest_74226/output//dmesg.log ./nvmf-tcp-uring-vg-autotest_74226/output//nvmf_fuzz_tgt_output.txt ./nvmf-tcp-uring-vg-autotest_74226/output//nvmf_trace.0_shm.tar.gz ./nvmf-tcp-uring-vg-autotest_74226/output//power.tar.xz ./nvmf-tcp-uring-vg-autotest_74226/output//proc_list.txt ./nvmf-tcp-uring-vg-autotest_74226/output//test_completions.txt ./nvmf-tcp-uring-vg-autotest_74226/output//timing.txt ./nvmf-tcp-uring-vg-autotest_74226/output//udev.log ./nvmf-tcp-uring-vg-autotest_74226/output//.. 00:42:38.918 + rmdir ./nvmf-tcp-uring-vg-autotest_74226/output/ 00:42:38.918 + for dir in "${out_dirs[@]}" 00:42:38.918 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.918 + [[ -f ./nvmf-tcp-vg-autotest_74293/output//doc.tar.xz ]] 00:42:38.918 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.918 + [[ -f ./nvmf-tcp-vg-autotest_74293/output//ut_coverage.tar.xz ]] 00:42:38.918 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.918 + [[ -f ./nvmf-tcp-vg-autotest_74293/output//llvm.tar.xz ]] 00:42:38.918 + mv ./nvmf-tcp-vg-autotest_74293/output//all_tests.txt ./nvmf-tcp-vg-autotest_74293/output//build-pkg-manifest.txt ./nvmf-tcp-vg-autotest_74293/output//build-repo-manifest.txt ./nvmf-tcp-vg-autotest_74293/output//cov_base.info.xz ./nvmf-tcp-vg-autotest_74293/output//cov_test.info.xz ./nvmf-tcp-vg-autotest_74293/output//cov_total.info.xz ./nvmf-tcp-vg-autotest_74293/output//dmesg.init.log ./nvmf-tcp-vg-autotest_74293/output//dmesg.log ./nvmf-tcp-vg-autotest_74293/output//nvmf_fuzz_tgt_output.txt ./nvmf-tcp-vg-autotest_74293/output//nvmf_trace.0_shm.tar.gz ./nvmf-tcp-vg-autotest_74293/output//power.tar.xz ./nvmf-tcp-vg-autotest_74293/output//test_completions.txt ./nvmf-tcp-vg-autotest_74293/output//timing.svg ./nvmf-tcp-vg-autotest_74293/output//timing.txt ./nvmf-tcp-vg-autotest_74293/output//.. 00:42:38.918 + rmdir ./nvmf-tcp-vg-autotest_74293/output/ 00:42:38.918 + for dir in "${out_dirs[@]}" 00:42:38.918 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.918 + [[ -f ./rocky9-vg-autotest_13173/output//doc.tar.xz ]] 00:42:38.918 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.918 + [[ -f ./rocky9-vg-autotest_13173/output//ut_coverage.tar.xz ]] 00:42:38.918 + tar -C ./rocky9-vg-autotest_13173/output/ -xf ./rocky9-vg-autotest_13173/output//ut_coverage.tar.xz 00:42:38.918 + rm ./rocky9-vg-autotest_13173/output//ut_coverage.tar.xz 00:42:38.918 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.918 + [[ -f ./rocky9-vg-autotest_13173/output//llvm.tar.xz ]] 00:42:38.918 + mv ./rocky9-vg-autotest_13173/output//all_tests.txt ./rocky9-vg-autotest_13173/output//build-pkg-manifest.txt ./rocky9-vg-autotest_13173/output//build-repo-manifest.txt ./rocky9-vg-autotest_13173/output//cov_base.info.xz ./rocky9-vg-autotest_13173/output//cov_test.info.xz ./rocky9-vg-autotest_13173/output//cov_total.info.xz ./rocky9-vg-autotest_13173/output//dmesg.init.log ./rocky9-vg-autotest_13173/output//dmesg.log ./rocky9-vg-autotest_13173/output//power.tar.xz ./rocky9-vg-autotest_13173/output//test_completions.txt ./rocky9-vg-autotest_13173/output//timing.svg ./rocky9-vg-autotest_13173/output//timing.txt ./rocky9-vg-autotest_13173/output//ut_coverage ./rocky9-vg-autotest_13173/output//.. 00:42:38.918 + rmdir ./rocky9-vg-autotest_13173/output/ 00:42:38.918 + for dir in "${out_dirs[@]}" 00:42:38.918 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.918 + [[ -f ./scanbuild-vg-autotest_62825/output//doc.tar.xz ]] 00:42:38.918 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.918 + [[ -f ./scanbuild-vg-autotest_62825/output//ut_coverage.tar.xz ]] 00:42:38.918 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.918 + [[ -f ./scanbuild-vg-autotest_62825/output//llvm.tar.xz ]] 00:42:38.919 + mv ./scanbuild-vg-autotest_62825/output//all_c_files.txt ./scanbuild-vg-autotest_62825/output//build_output.txt ./scanbuild-vg-autotest_62825/output//build-pkg-manifest.txt ./scanbuild-vg-autotest_62825/output//build-repo-manifest.txt ./scanbuild-vg-autotest_62825/output//built_c_files.txt ./scanbuild-vg-autotest_62825/output//dmesg.init.log ./scanbuild-vg-autotest_62825/output//dmesg.log ./scanbuild-vg-autotest_62825/output//power.tar.xz ./scanbuild-vg-autotest_62825/output//test_completions.txt ./scanbuild-vg-autotest_62825/output//timing.svg ./scanbuild-vg-autotest_62825/output//timing.txt ./scanbuild-vg-autotest_62825/output//unbuilt_c_files.txt ./scanbuild-vg-autotest_62825/output//.. 00:42:38.919 + rmdir ./scanbuild-vg-autotest_62825/output/ 00:42:38.919 + for dir in "${out_dirs[@]}" 00:42:38.919 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.919 + [[ -f ./short-fuzz-phy-autotest_23116/output//doc.tar.xz ]] 00:42:38.919 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.919 + [[ -f ./short-fuzz-phy-autotest_23116/output//ut_coverage.tar.xz ]] 00:42:38.919 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.919 + [[ -f ./short-fuzz-phy-autotest_23116/output//llvm.tar.xz ]] 00:42:38.919 + tar -C ./short-fuzz-phy-autotest_23116/output/ -xf ./short-fuzz-phy-autotest_23116/output//llvm.tar.xz 00:42:38.919 + rm ./short-fuzz-phy-autotest_23116/output//llvm.tar.xz 00:42:38.919 + mv ./short-fuzz-phy-autotest_23116/output//all_tests.txt ./short-fuzz-phy-autotest_23116/output//build-pkg-manifest.txt ./short-fuzz-phy-autotest_23116/output//build-repo-manifest.txt ./short-fuzz-phy-autotest_23116/output//dmesg.init.log ./short-fuzz-phy-autotest_23116/output//dmesg.log ./short-fuzz-phy-autotest_23116/output//llvm ./short-fuzz-phy-autotest_23116/output//power.tar.xz ./short-fuzz-phy-autotest_23116/output//test_completions.txt ./short-fuzz-phy-autotest_23116/output//timing.svg ./short-fuzz-phy-autotest_23116/output//timing.txt ./short-fuzz-phy-autotest_23116/output//.. 00:42:38.919 + rmdir ./short-fuzz-phy-autotest_23116/output/ 00:42:38.919 + for dir in "${out_dirs[@]}" 00:42:38.919 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.919 + [[ -f ./ubuntu20-vg-autotest_70883/output//doc.tar.xz ]] 00:42:38.919 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:38.919 + [[ -f ./ubuntu20-vg-autotest_70883/output//ut_coverage.tar.xz ]] 00:42:38.919 + tar -C ./ubuntu20-vg-autotest_70883/output/ -xf ./ubuntu20-vg-autotest_70883/output//ut_coverage.tar.xz 00:42:39.177 + rm ./ubuntu20-vg-autotest_70883/output//ut_coverage.tar.xz 00:42:39.177 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:39.177 + [[ -f ./ubuntu20-vg-autotest_70883/output//llvm.tar.xz ]] 00:42:39.177 + mv ./ubuntu20-vg-autotest_70883/output//all_tests.txt ./ubuntu20-vg-autotest_70883/output//build-pkg-manifest.txt ./ubuntu20-vg-autotest_70883/output//build-repo-manifest.txt ./ubuntu20-vg-autotest_70883/output//cov_base.info.xz ./ubuntu20-vg-autotest_70883/output//cov_test.info.xz ./ubuntu20-vg-autotest_70883/output//cov_total.info.xz ./ubuntu20-vg-autotest_70883/output//dmesg.init.log ./ubuntu20-vg-autotest_70883/output//dmesg.log ./ubuntu20-vg-autotest_70883/output//power.tar.xz ./ubuntu20-vg-autotest_70883/output//test_completions.txt ./ubuntu20-vg-autotest_70883/output//timing.svg ./ubuntu20-vg-autotest_70883/output//timing.txt ./ubuntu20-vg-autotest_70883/output//ut_coverage ./ubuntu20-vg-autotest_70883/output//.. 00:42:39.177 + rmdir ./ubuntu20-vg-autotest_70883/output/ 00:42:39.177 + for dir in "${out_dirs[@]}" 00:42:39.177 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:39.177 + [[ -f ./ubuntu22-vg-autotest_34895/output//doc.tar.xz ]] 00:42:39.177 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:39.177 + [[ -f ./ubuntu22-vg-autotest_34895/output//ut_coverage.tar.xz ]] 00:42:39.177 + tar -C ./ubuntu22-vg-autotest_34895/output/ -xf ./ubuntu22-vg-autotest_34895/output//ut_coverage.tar.xz 00:42:39.435 + rm ./ubuntu22-vg-autotest_34895/output//ut_coverage.tar.xz 00:42:39.435 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:39.435 + [[ -f ./ubuntu22-vg-autotest_34895/output//llvm.tar.xz ]] 00:42:39.435 + mv ./ubuntu22-vg-autotest_34895/output//all_tests.txt ./ubuntu22-vg-autotest_34895/output//build-pkg-manifest.txt ./ubuntu22-vg-autotest_34895/output//build-repo-manifest.txt ./ubuntu22-vg-autotest_34895/output//cov_base.info.xz ./ubuntu22-vg-autotest_34895/output//cov_test.info.xz ./ubuntu22-vg-autotest_34895/output//cov_total.info.xz ./ubuntu22-vg-autotest_34895/output//dmesg.init.log ./ubuntu22-vg-autotest_34895/output//dmesg.log ./ubuntu22-vg-autotest_34895/output//power.tar.xz ./ubuntu22-vg-autotest_34895/output//test_completions.txt ./ubuntu22-vg-autotest_34895/output//timing.svg ./ubuntu22-vg-autotest_34895/output//timing.txt ./ubuntu22-vg-autotest_34895/output//ut_coverage ./ubuntu22-vg-autotest_34895/output//.. 00:42:39.435 + rmdir ./ubuntu22-vg-autotest_34895/output/ 00:42:39.435 + for dir in "${out_dirs[@]}" 00:42:39.435 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:39.435 + [[ -f ./unittest-vg-autotest_62827/output//doc.tar.xz ]] 00:42:39.435 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:39.435 + [[ -f ./unittest-vg-autotest_62827/output//ut_coverage.tar.xz ]] 00:42:39.435 + tar -C ./unittest-vg-autotest_62827/output/ -xf ./unittest-vg-autotest_62827/output//ut_coverage.tar.xz 00:42:39.693 + rm ./unittest-vg-autotest_62827/output//ut_coverage.tar.xz 00:42:39.693 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:39.693 + [[ -f ./unittest-vg-autotest_62827/output//llvm.tar.xz ]] 00:42:39.693 + mv ./unittest-vg-autotest_62827/output//all_tests.txt ./unittest-vg-autotest_62827/output//build-kernel-manifest.txt ./unittest-vg-autotest_62827/output//build-pkg-manifest.txt ./unittest-vg-autotest_62827/output//build-repo-manifest.txt ./unittest-vg-autotest_62827/output//cov_base.info.xz ./unittest-vg-autotest_62827/output//cov_test.info.xz ./unittest-vg-autotest_62827/output//cov_total.info.xz ./unittest-vg-autotest_62827/output//dmesg.init.log ./unittest-vg-autotest_62827/output//dmesg.log ./unittest-vg-autotest_62827/output//power.tar.xz ./unittest-vg-autotest_62827/output//test_completions.txt ./unittest-vg-autotest_62827/output//timing.svg ./unittest-vg-autotest_62827/output//timing.txt ./unittest-vg-autotest_62827/output//ut_coverage ./unittest-vg-autotest_62827/output//.. 00:42:39.693 + rmdir ./unittest-vg-autotest_62827/output/ 00:42:39.693 + for dir in "${out_dirs[@]}" 00:42:39.693 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:39.693 + [[ -f ./valgrind-vg-autotest_48637/output//doc.tar.xz ]] 00:42:39.693 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:39.693 + [[ -f ./valgrind-vg-autotest_48637/output//ut_coverage.tar.xz ]] 00:42:39.693 + tar -C ./valgrind-vg-autotest_48637/output/ -xf ./valgrind-vg-autotest_48637/output//ut_coverage.tar.xz 00:42:39.951 + rm ./valgrind-vg-autotest_48637/output//ut_coverage.tar.xz 00:42:39.951 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:39.951 + [[ -f ./valgrind-vg-autotest_48637/output//llvm.tar.xz ]] 00:42:39.951 + mv ./valgrind-vg-autotest_48637/output//all_tests.txt ./valgrind-vg-autotest_48637/output//build-pkg-manifest.txt ./valgrind-vg-autotest_48637/output//build-repo-manifest.txt ./valgrind-vg-autotest_48637/output//cov_base.info.xz ./valgrind-vg-autotest_48637/output//cov_test.info.xz ./valgrind-vg-autotest_48637/output//cov_total.info.xz ./valgrind-vg-autotest_48637/output//dmesg.init.log ./valgrind-vg-autotest_48637/output//dmesg.log ./valgrind-vg-autotest_48637/output//power.tar.xz ./valgrind-vg-autotest_48637/output//test_completions.txt ./valgrind-vg-autotest_48637/output//timing.svg ./valgrind-vg-autotest_48637/output//timing.txt ./valgrind-vg-autotest_48637/output//ut_coverage ./valgrind-vg-autotest_48637/output//.. 00:42:39.951 + rmdir ./valgrind-vg-autotest_48637/output/ 00:42:39.951 + for dir in "${out_dirs[@]}" 00:42:39.951 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:39.951 + [[ -f ./vfio-user-phy-autotest_23128/output//doc.tar.xz ]] 00:42:39.951 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:39.951 + [[ -f ./vfio-user-phy-autotest_23128/output//ut_coverage.tar.xz ]] 00:42:39.951 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:39.951 + [[ -f ./vfio-user-phy-autotest_23128/output//llvm.tar.xz ]] 00:42:39.951 + mv ./vfio-user-phy-autotest_23128/output//all_tests.txt ./vfio-user-phy-autotest_23128/output//build-pkg-manifest.txt ./vfio-user-phy-autotest_23128/output//build-repo-manifest.txt ./vfio-user-phy-autotest_23128/output//cov_base.info.xz ./vfio-user-phy-autotest_23128/output//cov_test.info.xz ./vfio-user-phy-autotest_23128/output//cov_total.info.xz ./vfio-user-phy-autotest_23128/output//dmesg.init.log ./vfio-user-phy-autotest_23128/output//dmesg.log ./vfio-user-phy-autotest_23128/output//power.tar.xz ./vfio-user-phy-autotest_23128/output//test_completions.txt ./vfio-user-phy-autotest_23128/output//timing.svg ./vfio-user-phy-autotest_23128/output//timing.txt ./vfio-user-phy-autotest_23128/output//.. 00:42:39.951 + rmdir ./vfio-user-phy-autotest_23128/output/ 00:42:39.951 + for dir in "${out_dirs[@]}" 00:42:39.951 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:39.951 + [[ -f ./vhost-initiator-vg-autotest_74326/output//doc.tar.xz ]] 00:42:39.951 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:39.951 + [[ -f ./vhost-initiator-vg-autotest_74326/output//ut_coverage.tar.xz ]] 00:42:39.951 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:39.951 + [[ -f ./vhost-initiator-vg-autotest_74326/output//llvm.tar.xz ]] 00:42:39.951 + mv ./vhost-initiator-vg-autotest_74326/output//all_tests.txt ./vhost-initiator-vg-autotest_74326/output//build-pkg-manifest.txt ./vhost-initiator-vg-autotest_74326/output//build-repo-manifest.txt ./vhost-initiator-vg-autotest_74326/output//cov_base.info.xz ./vhost-initiator-vg-autotest_74326/output//cov_test.info.xz ./vhost-initiator-vg-autotest_74326/output//cov_total.info.xz ./vhost-initiator-vg-autotest_74326/output//dmesg.init.log ./vhost-initiator-vg-autotest_74326/output//dmesg.log ./vhost-initiator-vg-autotest_74326/output//power.tar.xz ./vhost-initiator-vg-autotest_74326/output//test_completions.txt ./vhost-initiator-vg-autotest_74326/output//timing.svg ./vhost-initiator-vg-autotest_74326/output//timing.txt ./vhost-initiator-vg-autotest_74326/output//vhost_fuzz_output1.txt.xz ./vhost-initiator-vg-autotest_74326/output//vhost_fuzz_output2.txt.xz ./vhost-initiator-vg-autotest_74326/output//vhost_fuzz_tgt_output.txt.xz ./vhost-initiator-vg-autotest_74326/output//.. 00:42:39.951 + rmdir ./vhost-initiator-vg-autotest_74326/output/ 00:42:39.951 + for dir in "${out_dirs[@]}" 00:42:39.951 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:39.951 + [[ -f ./vhost-phy-autotest_23143/output//doc.tar.xz ]] 00:42:39.951 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:39.951 + [[ -f ./vhost-phy-autotest_23143/output//ut_coverage.tar.xz ]] 00:42:39.951 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:39.951 + [[ -f ./vhost-phy-autotest_23143/output//llvm.tar.xz ]] 00:42:39.952 + mv ./vhost-phy-autotest_23143/output//all_tests.txt ./vhost-phy-autotest_23143/output//build-pkg-manifest.txt ./vhost-phy-autotest_23143/output//build-repo-manifest.txt ./vhost-phy-autotest_23143/output//cov_base.info.xz ./vhost-phy-autotest_23143/output//cov_test.info.xz ./vhost-phy-autotest_23143/output//cov_total.info.xz ./vhost-phy-autotest_23143/output//dmesg.init.log ./vhost-phy-autotest_23143/output//dmesg.log ./vhost-phy-autotest_23143/output//nvmf_trace.0_shm.tar.gz ./vhost-phy-autotest_23143/output//power.tar.xz ./vhost-phy-autotest_23143/output//test_completions.txt ./vhost-phy-autotest_23143/output//timing.svg ./vhost-phy-autotest_23143/output//timing.txt ./vhost-phy-autotest_23143/output//.. 00:42:39.952 + rmdir ./vhost-phy-autotest_23143/output/ 00:42:39.952 + for dir in "${out_dirs[@]}" 00:42:39.952 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:39.952 + [[ -f ./vmd-phy-autotest_1958/output//doc.tar.xz ]] 00:42:39.952 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:39.952 + [[ -f ./vmd-phy-autotest_1958/output//ut_coverage.tar.xz ]] 00:42:39.952 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:39.952 + [[ -f ./vmd-phy-autotest_1958/output//llvm.tar.xz ]] 00:42:39.952 + mv ./vmd-phy-autotest_1958/output//all_tests.txt ./vmd-phy-autotest_1958/output//build-pkg-manifest.txt ./vmd-phy-autotest_1958/output//build-repo-manifest.txt ./vmd-phy-autotest_1958/output//cov_base.info.xz ./vmd-phy-autotest_1958/output//cov_test.info.xz ./vmd-phy-autotest_1958/output//cov_total.info.xz ./vmd-phy-autotest_1958/output//dmesg.init.log ./vmd-phy-autotest_1958/output//dmesg.log ./vmd-phy-autotest_1958/output//power.tar.xz ./vmd-phy-autotest_1958/output//test_completions.txt ./vmd-phy-autotest_1958/output//timing.svg ./vmd-phy-autotest_1958/output//timing.txt ./vmd-phy-autotest_1958/output//.. 00:42:39.952 + rmdir ./vmd-phy-autotest_1958/output/ 00:42:39.952 + for dir in "${out_dirs[@]}" 00:42:39.952 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:39.952 + [[ -f ./zns-vg-autotest_73407/output//doc.tar.xz ]] 00:42:39.952 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:39.952 + [[ -f ./zns-vg-autotest_73407/output//ut_coverage.tar.xz ]] 00:42:39.952 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:42:39.952 + [[ -f ./zns-vg-autotest_73407/output//llvm.tar.xz ]] 00:42:39.952 + mv ./zns-vg-autotest_73407/output//all_tests.txt ./zns-vg-autotest_73407/output//build-kernel-manifest.txt ./zns-vg-autotest_73407/output//build-pkg-manifest.txt ./zns-vg-autotest_73407/output//build-repo-manifest.txt ./zns-vg-autotest_73407/output//cov_base.info.xz ./zns-vg-autotest_73407/output//cov_test.info.xz ./zns-vg-autotest_73407/output//cov_total.info.xz ./zns-vg-autotest_73407/output//dmesg.init.log ./zns-vg-autotest_73407/output//dmesg.log ./zns-vg-autotest_73407/output//power.tar.xz ./zns-vg-autotest_73407/output//test_completions.txt ./zns-vg-autotest_73407/output//timing.svg ./zns-vg-autotest_73407/output//timing.txt ./zns-vg-autotest_73407/output//.. 00:42:39.952 + rmdir ./zns-vg-autotest_73407/output/ 00:42:39.952 + unpack_cov_files 00:42:39.952 + local info_files 00:42:39.952 + info_files=(*/cov_*.info.xz) 00:42:39.952 + xargs -P0 -r -n1 xz -d 00:42:39.952 + printf '%s\n' BlobFS-phy-autotest_23122/cov_base.info.xz BlobFS-phy-autotest_23122/cov_test.info.xz BlobFS-phy-autotest_23122/cov_total.info.xz centos7-vg-autotest_70801/cov_base.info.xz centos7-vg-autotest_70801/cov_test.info.xz centos7-vg-autotest_70801/cov_total.info.xz crypto-phy-autotest_23120/cov_base.info.xz crypto-phy-autotest_23120/cov_test.info.xz crypto-phy-autotest_23120/cov_total.info.xz dsa-phy-autotest_2498/cov_base.info.xz dsa-phy-autotest_2498/cov_test.info.xz dsa-phy-autotest_2498/cov_total.info.xz iscsi-uring-vg-autotest_74207/cov_base.info.xz iscsi-uring-vg-autotest_74207/cov_test.info.xz iscsi-uring-vg-autotest_74207/cov_total.info.xz iscsi-vg-autotest_74342/cov_base.info.xz iscsi-vg-autotest_74342/cov_test.info.xz iscsi-vg-autotest_74342/cov_total.info.xz lvol-vg-autotest_74253/cov_base.info.xz lvol-vg-autotest_74253/cov_test.info.xz lvol-vg-autotest_74253/cov_total.info.xz nvme-cmb-pmr-vg-autotest_75427/cov_base.info.xz nvme-cmb-pmr-vg-autotest_75427/cov_test.info.xz nvme-cmb-pmr-vg-autotest_75427/cov_total.info.xz nvme-phy-autotest_69288/cov_base.info.xz nvme-phy-autotest_69288/cov_test.info.xz nvme-phy-autotest_69288/cov_total.info.xz nvme-vg-autotest_74305/cov_base.info.xz nvme-vg-autotest_74305/cov_test.info.xz nvme-vg-autotest_74305/cov_total.info.xz nvmf-phy-autotest_69362/cov_base.info.xz nvmf-tcp-phy-autotest_69251/cov_base.info.xz nvmf-tcp-phy-autotest_69251/cov_test.info.xz nvmf-tcp-phy-autotest_69251/cov_total.info.xz nvmf-tcp-uring-vg-autotest_74226/cov_base.info.xz nvmf-tcp-vg-autotest_74293/cov_base.info.xz nvmf-tcp-vg-autotest_74293/cov_test.info.xz nvmf-tcp-vg-autotest_74293/cov_total.info.xz rocky9-vg-autotest_13173/cov_base.info.xz rocky9-vg-autotest_13173/cov_test.info.xz rocky9-vg-autotest_13173/cov_total.info.xz ubuntu20-vg-autotest_70883/cov_base.info.xz ubuntu20-vg-autotest_70883/cov_test.info.xz ubuntu20-vg-autotest_70883/cov_total.info.xz ubuntu22-vg-autotest_34895/cov_base.info.xz ubuntu22-vg-autotest_34895/cov_test.info.xz ubuntu22-vg-autotest_34895/cov_total.info.xz unittest-vg-autotest_62827/cov_base.info.xz unittest-vg-autotest_62827/cov_test.info.xz unittest-vg-autotest_62827/cov_total.info.xz valgrind-vg-autotest_48637/cov_base.info.xz valgrind-vg-autotest_48637/cov_test.info.xz valgrind-vg-autotest_48637/cov_total.info.xz vfio-user-phy-autotest_23128/cov_base.info.xz vfio-user-phy-autotest_23128/cov_test.info.xz vfio-user-phy-autotest_23128/cov_total.info.xz vhost-initiator-vg-autotest_74326/cov_base.info.xz vhost-initiator-vg-autotest_74326/cov_test.info.xz vhost-initiator-vg-autotest_74326/cov_total.info.xz vhost-phy-autotest_23143/cov_base.info.xz vhost-phy-autotest_23143/cov_test.info.xz vhost-phy-autotest_23143/cov_total.info.xz vmd-phy-autotest_1958/cov_base.info.xz vmd-phy-autotest_1958/cov_test.info.xz vmd-phy-autotest_1958/cov_total.info.xz zns-vg-autotest_73407/cov_base.info.xz zns-vg-autotest_73407/cov_test.info.xz zns-vg-autotest_73407/cov_total.info.xz 00:42:40.516 + fix_downstream_job_paths 00:42:40.516 + sed -i -e 's#^SF:/.\+/spdk/#SF:/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/#g' BlobFS-phy-autotest_23122/cov_total.info centos7-vg-autotest_70801/cov_total.info crypto-phy-autotest_23120/cov_total.info dsa-phy-autotest_2498/cov_total.info iscsi-uring-vg-autotest_74207/cov_total.info iscsi-vg-autotest_74342/cov_total.info lvol-vg-autotest_74253/cov_total.info nvme-cmb-pmr-vg-autotest_75427/cov_total.info nvme-phy-autotest_69288/cov_total.info nvme-vg-autotest_74305/cov_total.info nvmf-tcp-phy-autotest_69251/cov_total.info nvmf-tcp-vg-autotest_74293/cov_total.info rocky9-vg-autotest_13173/cov_total.info ubuntu20-vg-autotest_70883/cov_total.info ubuntu22-vg-autotest_34895/cov_total.info unittest-vg-autotest_62827/cov_total.info valgrind-vg-autotest_48637/cov_total.info vfio-user-phy-autotest_23128/cov_total.info vhost-initiator-vg-autotest_74326/cov_total.info vhost-phy-autotest_23143/cov_total.info vmd-phy-autotest_1958/cov_total.info zns-vg-autotest_73407/cov_total.info 00:42:41.892 + ignore_ocf_headers 00:42:41.892 + sed -i 's#--show-details#--show-details --ignore-errors source#g' spdk/autorun_post.py 00:42:41.892 + create_errtrace_files_for_all_builds 00:42:41.892 + local build_log_list 00:42:41.892 + build_log_list=($(find "$WORKSPACE" -type f -name 'build.log')) 00:42:41.892 ++ find /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11 -type f -name build.log 00:42:41.892 + for build in "${build_log_list[@]}" 00:42:41.892 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/rocky9-vg-autotest_13173/build.log 00:42:41.892 + local build_log job_name start_pattern end_pattern backtraces 00:42:41.892 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/rocky9-vg-autotest_13173/build.log 00:42:41.892 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/rocky9-vg-autotest_13173/build.log 00:42:41.892 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/rocky9-vg-autotest_13173 00:42:41.892 + job_name=rocky9-vg-autotest_13173 00:42:41.892 + start_pattern='Backtrace start' 00:42:41.892 + end_pattern='Backtrace end' 00:42:41.892 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/rocky9-vg-autotest_13173/build.log ]] 00:42:41.892 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/rocky9-vg-autotest_13173/build.log 00:42:41.892 + backtraces= 00:42:41.892 + [[ -n '' ]] 00:42:41.892 + for build in "${build_log_list[@]}" 00:42:41.892 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/dsa-phy-autotest_2498/build.log 00:42:41.892 + local build_log job_name start_pattern end_pattern backtraces 00:42:41.892 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/dsa-phy-autotest_2498/build.log 00:42:41.892 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/dsa-phy-autotest_2498/build.log 00:42:41.893 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/dsa-phy-autotest_2498 00:42:41.893 + job_name=dsa-phy-autotest_2498 00:42:41.893 + start_pattern='Backtrace start' 00:42:41.893 + end_pattern='Backtrace end' 00:42:41.893 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/dsa-phy-autotest_2498/build.log ]] 00:42:41.893 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/dsa-phy-autotest_2498/build.log 00:42:41.893 + backtraces= 00:42:41.893 + [[ -n '' ]] 00:42:41.893 + for build in "${build_log_list[@]}" 00:42:41.893 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-uring-vg-autotest_74207/build.log 00:42:41.893 + local build_log job_name start_pattern end_pattern backtraces 00:42:41.893 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-uring-vg-autotest_74207/build.log 00:42:41.893 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-uring-vg-autotest_74207/build.log 00:42:41.893 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-uring-vg-autotest_74207 00:42:41.893 + job_name=iscsi-uring-vg-autotest_74207 00:42:41.893 + start_pattern='Backtrace start' 00:42:41.893 + end_pattern='Backtrace end' 00:42:41.893 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-uring-vg-autotest_74207/build.log ]] 00:42:41.893 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-uring-vg-autotest_74207/build.log 00:42:41.893 + backtraces= 00:42:41.893 + [[ -n '' ]] 00:42:41.893 + for build in "${build_log_list[@]}" 00:42:41.893 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-vg-autotest_62827/build.log 00:42:41.893 + local build_log job_name start_pattern end_pattern backtraces 00:42:41.893 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-vg-autotest_62827/build.log 00:42:41.893 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-vg-autotest_62827/build.log 00:42:41.893 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-vg-autotest_62827 00:42:41.893 + job_name=unittest-vg-autotest_62827 00:42:41.893 + start_pattern='Backtrace start' 00:42:41.893 + end_pattern='Backtrace end' 00:42:41.893 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-vg-autotest_62827/build.log ]] 00:42:41.893 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-vg-autotest_62827/build.log 00:42:41.893 + backtraces= 00:42:41.893 + [[ -n '' ]] 00:42:41.893 + for build in "${build_log_list[@]}" 00:42:41.893 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/centos7-vg-autotest_70801/build.log 00:42:41.893 + local build_log job_name start_pattern end_pattern backtraces 00:42:41.893 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/centos7-vg-autotest_70801/build.log 00:42:41.893 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/centos7-vg-autotest_70801/build.log 00:42:41.893 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/centos7-vg-autotest_70801 00:42:41.893 + job_name=centos7-vg-autotest_70801 00:42:41.893 + start_pattern='Backtrace start' 00:42:41.893 + end_pattern='Backtrace end' 00:42:41.893 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/centos7-vg-autotest_70801/build.log ]] 00:42:41.893 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/centos7-vg-autotest_70801/build.log 00:42:41.893 + backtraces= 00:42:41.893 + [[ -n '' ]] 00:42:41.893 + for build in "${build_log_list[@]}" 00:42:41.893 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/lvol-vg-autotest_74253/build.log 00:42:41.893 + local build_log job_name start_pattern end_pattern backtraces 00:42:41.893 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/lvol-vg-autotest_74253/build.log 00:42:41.893 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/lvol-vg-autotest_74253/build.log 00:42:41.893 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/lvol-vg-autotest_74253 00:42:41.893 + job_name=lvol-vg-autotest_74253 00:42:41.893 + start_pattern='Backtrace start' 00:42:41.893 + end_pattern='Backtrace end' 00:42:41.893 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/lvol-vg-autotest_74253/build.log ]] 00:42:41.893 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/lvol-vg-autotest_74253/build.log 00:42:41.893 + backtraces= 00:42:41.893 + [[ -n '' ]] 00:42:41.893 + for build in "${build_log_list[@]}" 00:42:41.893 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/scanbuild-vg-autotest_62825/build.log 00:42:41.893 + local build_log job_name start_pattern end_pattern backtraces 00:42:41.893 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/scanbuild-vg-autotest_62825/build.log 00:42:41.893 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/scanbuild-vg-autotest_62825/build.log 00:42:41.893 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/scanbuild-vg-autotest_62825 00:42:41.893 + job_name=scanbuild-vg-autotest_62825 00:42:41.893 + start_pattern='Backtrace start' 00:42:41.893 + end_pattern='Backtrace end' 00:42:41.893 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/scanbuild-vg-autotest_62825/build.log ]] 00:42:41.893 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/scanbuild-vg-autotest_62825/build.log 00:42:41.893 + backtraces= 00:42:41.893 + [[ -n '' ]] 00:42:41.893 + for build in "${build_log_list[@]}" 00:42:41.893 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-phy-autotest_69288/build.log 00:42:41.893 + local build_log job_name start_pattern end_pattern backtraces 00:42:41.893 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-phy-autotest_69288/build.log 00:42:41.893 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-phy-autotest_69288/build.log 00:42:41.893 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-phy-autotest_69288 00:42:41.893 + job_name=nvme-phy-autotest_69288 00:42:41.893 + start_pattern='Backtrace start' 00:42:41.893 + end_pattern='Backtrace end' 00:42:41.893 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-phy-autotest_69288/build.log ]] 00:42:41.893 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-phy-autotest_69288/build.log 00:42:41.893 + backtraces= 00:42:41.893 + [[ -n '' ]] 00:42:41.893 + for build in "${build_log_list[@]}" 00:42:41.893 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu20-vg-autotest_70883/build.log 00:42:41.893 + local build_log job_name start_pattern end_pattern backtraces 00:42:41.893 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu20-vg-autotest_70883/build.log 00:42:41.893 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu20-vg-autotest_70883/build.log 00:42:41.893 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu20-vg-autotest_70883 00:42:41.893 + job_name=ubuntu20-vg-autotest_70883 00:42:41.893 + start_pattern='Backtrace start' 00:42:41.893 + end_pattern='Backtrace end' 00:42:41.893 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu20-vg-autotest_70883/build.log ]] 00:42:41.893 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu20-vg-autotest_70883/build.log 00:42:41.893 + backtraces= 00:42:41.893 + [[ -n '' ]] 00:42:41.893 + for build in "${build_log_list[@]}" 00:42:41.893 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-phy-autotest_23143/build.log 00:42:41.893 + local build_log job_name start_pattern end_pattern backtraces 00:42:41.893 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-phy-autotest_23143/build.log 00:42:41.893 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-phy-autotest_23143/build.log 00:42:41.893 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-phy-autotest_23143 00:42:41.893 + job_name=vhost-phy-autotest_23143 00:42:41.893 + start_pattern='Backtrace start' 00:42:41.893 + end_pattern='Backtrace end' 00:42:41.893 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-phy-autotest_23143/build.log ]] 00:42:41.893 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-phy-autotest_23143/build.log 00:42:41.893 + backtraces= 00:42:41.893 + [[ -n '' ]] 00:42:41.893 + for build in "${build_log_list[@]}" 00:42:41.893 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-phy-autotest_69251/build.log 00:42:41.893 + local build_log job_name start_pattern end_pattern backtraces 00:42:41.893 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-phy-autotest_69251/build.log 00:42:41.893 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-phy-autotest_69251/build.log 00:42:41.893 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-phy-autotest_69251 00:42:41.893 + job_name=nvmf-tcp-phy-autotest_69251 00:42:41.893 + start_pattern='Backtrace start' 00:42:41.893 + end_pattern='Backtrace end' 00:42:41.893 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-phy-autotest_69251/build.log ]] 00:42:41.893 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-phy-autotest_69251/build.log 00:42:41.893 + backtraces= 00:42:41.893 + [[ -n '' ]] 00:42:41.893 + for build in "${build_log_list[@]}" 00:42:41.893 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/BlobFS-phy-autotest_23122/build.log 00:42:41.893 + local build_log job_name start_pattern end_pattern backtraces 00:42:41.893 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/BlobFS-phy-autotest_23122/build.log 00:42:41.893 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/BlobFS-phy-autotest_23122/build.log 00:42:41.893 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/BlobFS-phy-autotest_23122 00:42:41.893 + job_name=BlobFS-phy-autotest_23122 00:42:41.893 + start_pattern='Backtrace start' 00:42:41.893 + end_pattern='Backtrace end' 00:42:41.893 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/BlobFS-phy-autotest_23122/build.log ]] 00:42:41.893 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/BlobFS-phy-autotest_23122/build.log 00:42:41.893 + backtraces= 00:42:41.893 + [[ -n '' ]] 00:42:41.893 + for build in "${build_log_list[@]}" 00:42:41.893 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/short-fuzz-phy-autotest_23116/build.log 00:42:41.893 + local build_log job_name start_pattern end_pattern backtraces 00:42:41.894 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/short-fuzz-phy-autotest_23116/build.log 00:42:41.894 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/short-fuzz-phy-autotest_23116/build.log 00:42:41.894 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/short-fuzz-phy-autotest_23116 00:42:41.894 + job_name=short-fuzz-phy-autotest_23116 00:42:41.894 + start_pattern='Backtrace start' 00:42:41.894 + end_pattern='Backtrace end' 00:42:41.894 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/short-fuzz-phy-autotest_23116/build.log ]] 00:42:41.894 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/short-fuzz-phy-autotest_23116/build.log 00:42:41.894 + backtraces= 00:42:41.894 + [[ -n '' ]] 00:42:41.894 + for build in "${build_log_list[@]}" 00:42:41.894 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/crypto-phy-autotest_23120/build.log 00:42:41.894 + local build_log job_name start_pattern end_pattern backtraces 00:42:41.894 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/crypto-phy-autotest_23120/build.log 00:42:41.894 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/crypto-phy-autotest_23120/build.log 00:42:41.894 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/crypto-phy-autotest_23120 00:42:41.894 + job_name=crypto-phy-autotest_23120 00:42:41.894 + start_pattern='Backtrace start' 00:42:41.894 + end_pattern='Backtrace end' 00:42:41.894 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/crypto-phy-autotest_23120/build.log ]] 00:42:41.894 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/crypto-phy-autotest_23120/build.log 00:42:41.894 + backtraces= 00:42:41.894 + [[ -n '' ]] 00:42:41.894 + for build in "${build_log_list[@]}" 00:42:41.894 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-phy-autotest_69362/build.log 00:42:41.894 + local build_log job_name start_pattern end_pattern backtraces 00:42:41.894 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-phy-autotest_69362/build.log 00:42:41.894 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-phy-autotest_69362/build.log 00:42:41.894 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-phy-autotest_69362 00:42:41.894 + job_name=nvmf-phy-autotest_69362 00:42:41.894 + start_pattern='Backtrace start' 00:42:41.894 + end_pattern='Backtrace end' 00:42:41.894 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-phy-autotest_69362/build.log ]] 00:42:41.894 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-phy-autotest_69362/build.log 00:42:41.894 + backtraces='00:23:04.727 ========== Backtrace start: ========== 00:42:41.894 00:23:04.727 00:42:41.894 00:23:04.727 in test/nvmf/target/device_removal.sh:116 -> stop_bdevperf([]) 00:42:41.894 00:23:04.727 ... 00:42:41.894 00:23:04.727 111 00:42:41.894 00:23:04.727 112 sleep 5 00:42:41.894 00:23:04.727 113 } 00:42:41.894 00:23:04.727 114 00:42:41.894 00:23:04.727 115 function stop_bdevperf() { 00:42:41.894 00:23:04.727 => 116 wait $bdevperf_rpc_pid 00:42:41.894 00:23:04.727 117 00:42:41.894 00:23:04.727 118 killprocess $bdevperf_pid 00:42:41.894 00:23:04.727 119 bdevperf_pid= 00:42:41.894 00:23:04.727 120 00:42:41.894 00:23:04.727 121 cat $testdir/try.txt 00:42:41.894 00:23:04.727 ... 00:42:41.894 00:23:04.727 in test/nvmf/target/device_removal.sh:200 -> test_remove_and_rescan(["--no-srq"]) 00:42:41.894 00:23:04.727 ... 00:42:41.894 00:23:04.727 195 fi 00:42:41.894 00:23:04.727 196 sleep 2 00:42:41.894 00:23:04.727 197 done 00:42:41.894 00:23:04.727 198 done 00:42:41.894 00:23:04.727 199 00:42:41.894 00:23:04.727 => 200 stop_bdevperf 00:42:41.894 00:23:04.727 201 00:42:41.894 00:23:04.727 202 killprocess $nvmfpid 00:42:41.894 00:23:04.727 203 nvmfpid= 00:42:41.894 00:23:04.727 204 00:42:41.894 00:23:04.727 205 return 0 00:42:41.894 00:23:04.727 ... 00:42:41.894 00:23:04.727 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:1111 -> run_test(["nvmf_device_removal_pci_remove_no_srq"],["test_remove_and_rescan"],["--no-srq"]) 00:42:41.894 00:23:04.727 ... 00:42:41.894 00:23:04.727 1106 timing_enter $test_name 00:42:41.894 00:23:04.727 1107 echo "************************************" 00:42:41.894 00:23:04.727 1108 echo "START TEST $test_name" 00:42:41.894 00:23:04.727 1109 echo "************************************" 00:42:41.894 00:23:04.727 1110 xtrace_restore 00:42:41.894 00:23:04.727 1111 time "$@" 00:42:41.894 00:23:04.727 1112 xtrace_disable 00:42:41.894 00:23:04.727 1113 echo "************************************" 00:42:41.894 00:23:04.727 1114 echo "END TEST $test_name" 00:42:41.894 00:23:04.727 1115 echo "************************************" 00:42:41.894 00:23:04.727 1116 timing_exit $test_name 00:42:41.894 00:23:04.727 ... 00:42:41.894 00:23:04.727 in test/nvmf/target/device_removal.sh:311 -> main(["--transport=rdma"]) 00:42:41.894 00:23:04.727 ... 00:42:41.894 00:23:04.727 306 exit 0 00:42:41.894 00:23:04.727 307 fi 00:42:41.894 00:23:04.727 308 test_bonding_slaves_on_nics "${target_nics[@]}" 00:42:41.894 00:23:04.727 309 } 00:42:41.894 00:23:04.727 310 00:42:41.894 00:23:04.727 => 311 run_test "nvmf_device_removal_pci_remove_no_srq" test_remove_and_rescan --no-srq 00:42:41.894 00:23:04.727 312 run_test "nvmf_device_removal_pci_remove" test_remove_and_rescan 00:42:41.894 00:23:04.727 313 # bond slaves case needs lag_master & vport_manager are enabled by mlxconfig 00:42:41.894 00:23:04.727 314 # and not work on CI machine currently. 00:42:41.894 00:23:04.727 315 # run_test "nvmf_device_removal_bond_slaves" test_bond_slaves 00:42:41.894 00:23:04.727 316 00:42:41.894 00:23:04.727 ... 00:42:41.894 00:23:04.727 00:42:41.894 00:23:04.727 ========== Backtrace end ========== 00:42:41.894 00:23:04.738 ========== Backtrace start: ========== 00:42:41.894 00:23:04.738 00:42:41.894 00:23:04.738 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:1111 -> run_test(["nvmf_device_removal"],["test/nvmf/target/device_removal.sh"],["--transport=rdma"]) 00:42:41.894 00:23:04.738 ... 00:42:41.894 00:23:04.738 1106 timing_enter $test_name 00:42:41.894 00:23:04.738 1107 echo "************************************" 00:42:41.894 00:23:04.738 1108 echo "START TEST $test_name" 00:42:41.894 00:23:04.738 1109 echo "************************************" 00:42:41.894 00:23:04.738 1110 xtrace_restore 00:42:41.894 00:23:04.738 1111 time "$@" 00:42:41.894 00:23:04.738 1112 xtrace_disable 00:42:41.894 00:23:04.738 1113 echo "************************************" 00:42:41.894 00:23:04.738 1114 echo "END TEST $test_name" 00:42:41.894 00:23:04.738 1115 echo "************************************" 00:42:41.894 00:23:04.738 1116 timing_exit $test_name 00:42:41.894 00:23:04.738 ... 00:42:41.894 00:23:04.738 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh:78 -> main(["--transport=rdma"]) 00:42:41.894 00:23:04.738 ... 00:42:41.894 00:23:04.738 73 TCP_INTERFACE_LIST=("${net_devs[@]}") 00:42:41.894 00:23:04.738 74 if ((${#TCP_INTERFACE_LIST[@]} > 0)); then 00:42:41.894 00:23:04.738 75 run_test "nvmf_perf_adq" $rootdir/test/nvmf/target/perf_adq.sh "${TEST_ARGS[@]}" 00:42:41.894 00:23:04.738 76 fi 00:42:41.894 00:23:04.738 77 elif [[ $SPDK_TEST_NVMF_TRANSPORT == "rdma" ]]; then 00:42:41.894 00:23:04.738 => 78 run_test "nvmf_device_removal" test/nvmf/target/device_removal.sh "${TEST_ARGS[@]}" 00:42:41.894 00:23:04.738 79 run_test "nvmf_srq_overwhelm" "$rootdir/test/nvmf/target/srq_overwhelm.sh" "${TEST_ARGS[@]}" 00:42:41.894 00:23:04.738 80 fi 00:42:41.894 00:23:04.738 81 run_test "nvmf_shutdown" $rootdir/test/nvmf/target/shutdown.sh "${TEST_ARGS[@]}" 00:42:41.894 00:23:04.738 82 fi 00:42:41.894 00:23:04.738 83 00:42:41.894 00:23:04.738 ... 00:42:41.894 00:23:04.738 00:42:41.894 00:23:04.738 ========== Backtrace end ========== 00:42:41.894 00:23:04.738 ========== Backtrace start: ========== 00:42:41.894 00:23:04.738 00:42:41.894 00:23:04.738 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:1111 -> run_test(["nvmf_rdma"],["/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh"],["--transport=rdma"]) 00:42:41.894 00:23:04.738 ... 00:42:41.894 00:23:04.738 1106 timing_enter $test_name 00:42:41.894 00:23:04.738 1107 echo "************************************" 00:42:41.894 00:23:04.738 1108 echo "START TEST $test_name" 00:42:41.894 00:23:04.738 1109 echo "************************************" 00:42:41.894 00:23:04.738 1110 xtrace_restore 00:42:41.894 00:23:04.738 1111 time "$@" 00:42:41.894 00:23:04.738 1112 xtrace_disable 00:42:41.894 00:23:04.738 1113 echo "************************************" 00:42:41.894 00:23:04.738 1114 echo "END TEST $test_name" 00:42:41.894 00:23:04.738 1115 echo "************************************" 00:42:41.894 00:23:04.738 1116 timing_exit $test_name 00:42:41.894 00:23:04.738 ... 00:42:41.894 00:23:04.738 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/autotest.sh:282 -> main(["/var/jenkins/workspace/nvmf-phy-autotest/autorun-spdk.conf"]) 00:42:41.894 00:23:04.738 ... 00:42:41.894 00:23:04.738 277 if [ $SPDK_TEST_NVMF -eq 1 ]; then 00:42:41.894 00:23:04.738 278 export NET_TYPE 00:42:41.894 00:23:04.738 279 # The NVMe-oF run test cases are split out like this so that the parser that compiles the 00:42:41.894 00:23:04.738 280 # list of all tests can properly differentiate them. Please do not merge them into one line. 00:42:41.894 00:23:04.738 281 if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then 00:42:41.894 00:23:04.738 => 282 run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:42:41.894 00:23:04.738 283 run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:42:41.894 00:23:04.738 284 elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then 00:42:41.894 00:23:04.738 285 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:42:41.894 00:23:04.738 286 if [[ $SPDK_TEST_URING -eq 0 ]]; then 00:42:41.894 00:23:04.738 287 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:42:41.894 00:23:04.738 ... 00:42:41.894 00:23:04.738 00:42:41.894 00:23:04.738 ========== Backtrace end ==========' 00:42:41.894 + [[ -n 00:23:04.727 ========== Backtrace start: ========== 00:42:41.894 00:23:04.727 00:42:41.895 00:23:04.727 in test/nvmf/target/device_removal.sh:116 -> stop_bdevperf([]) 00:42:41.895 00:23:04.727 ... 00:42:41.895 00:23:04.727 111 00:42:41.895 00:23:04.727 112 sleep 5 00:42:41.895 00:23:04.727 113 } 00:42:41.895 00:23:04.727 114 00:42:41.895 00:23:04.727 115 function stop_bdevperf() { 00:42:41.895 00:23:04.727 => 116 wait $bdevperf_rpc_pid 00:42:41.895 00:23:04.727 117 00:42:41.895 00:23:04.727 118 killprocess $bdevperf_pid 00:42:41.895 00:23:04.727 119 bdevperf_pid= 00:42:41.895 00:23:04.727 120 00:42:41.895 00:23:04.727 121 cat $testdir/try.txt 00:42:41.895 00:23:04.727 ... 00:42:41.895 00:23:04.727 in test/nvmf/target/device_removal.sh:200 -> test_remove_and_rescan(["--no-srq"]) 00:42:41.895 00:23:04.727 ... 00:42:41.895 00:23:04.727 195 fi 00:42:41.895 00:23:04.727 196 sleep 2 00:42:41.895 00:23:04.727 197 done 00:42:41.895 00:23:04.727 198 done 00:42:41.895 00:23:04.727 199 00:42:41.895 00:23:04.727 => 200 stop_bdevperf 00:42:41.895 00:23:04.727 201 00:42:41.895 00:23:04.727 202 killprocess $nvmfpid 00:42:41.895 00:23:04.727 203 nvmfpid= 00:42:41.895 00:23:04.727 204 00:42:41.895 00:23:04.727 205 return 0 00:42:41.895 00:23:04.727 ... 00:42:41.895 00:23:04.727 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:1111 -> run_test(["nvmf_device_removal_pci_remove_no_srq"],["test_remove_and_rescan"],["--no-srq"]) 00:42:41.895 00:23:04.727 ... 00:42:41.895 00:23:04.727 1106 timing_enter $test_name 00:42:41.895 00:23:04.727 1107 echo "************************************" 00:42:41.895 00:23:04.727 1108 echo "START TEST $test_name" 00:42:41.895 00:23:04.727 1109 echo "************************************" 00:42:41.895 00:23:04.727 1110 xtrace_restore 00:42:41.895 00:23:04.727 1111 time "$@" 00:42:41.895 00:23:04.727 1112 xtrace_disable 00:42:41.895 00:23:04.727 1113 echo "************************************" 00:42:41.895 00:23:04.727 1114 echo "END TEST $test_name" 00:42:41.895 00:23:04.727 1115 echo "************************************" 00:42:41.895 00:23:04.727 1116 timing_exit $test_name 00:42:41.895 00:23:04.727 ... 00:42:41.895 00:23:04.727 in test/nvmf/target/device_removal.sh:311 -> main(["--transport=rdma"]) 00:42:41.895 00:23:04.727 ... 00:42:41.895 00:23:04.727 306 exit 0 00:42:41.895 00:23:04.727 307 fi 00:42:41.895 00:23:04.727 308 test_bonding_slaves_on_nics "${target_nics[@]}" 00:42:41.895 00:23:04.727 309 } 00:42:41.895 00:23:04.727 310 00:42:41.895 00:23:04.727 => 311 run_test "nvmf_device_removal_pci_remove_no_srq" test_remove_and_rescan --no-srq 00:42:41.895 00:23:04.727 312 run_test "nvmf_device_removal_pci_remove" test_remove_and_rescan 00:42:41.895 00:23:04.727 313 # bond slaves case needs lag_master & vport_manager are enabled by mlxconfig 00:42:41.895 00:23:04.727 314 # and not work on CI machine currently. 00:42:41.895 00:23:04.727 315 # run_test "nvmf_device_removal_bond_slaves" test_bond_slaves 00:42:41.895 00:23:04.727 316 00:42:41.895 00:23:04.727 ... 00:42:41.895 00:23:04.727 00:42:41.895 00:23:04.727 ========== Backtrace end ========== 00:42:41.895 00:23:04.738 ========== Backtrace start: ========== 00:42:41.895 00:23:04.738 00:42:41.895 00:23:04.738 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:1111 -> run_test(["nvmf_device_removal"],["test/nvmf/target/device_removal.sh"],["--transport=rdma"]) 00:42:41.895 00:23:04.738 ... 00:42:41.895 00:23:04.738 1106 timing_enter $test_name 00:42:41.895 00:23:04.738 1107 echo "************************************" 00:42:41.895 00:23:04.738 1108 echo "START TEST $test_name" 00:42:41.895 00:23:04.738 1109 echo "************************************" 00:42:41.895 00:23:04.738 1110 xtrace_restore 00:42:41.895 00:23:04.738 1111 time "$@" 00:42:41.895 00:23:04.738 1112 xtrace_disable 00:42:41.895 00:23:04.738 1113 echo "************************************" 00:42:41.895 00:23:04.738 1114 echo "END TEST $test_name" 00:42:41.895 00:23:04.738 1115 echo "************************************" 00:42:41.895 00:23:04.738 1116 timing_exit $test_name 00:42:41.895 00:23:04.738 ... 00:42:41.895 00:23:04.738 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh:78 -> main(["--transport=rdma"]) 00:42:41.895 00:23:04.738 ... 00:42:41.895 00:23:04.738 73 TCP_INTERFACE_LIST=("${net_devs[@]}") 00:42:41.895 00:23:04.738 74 if ((${#TCP_INTERFACE_LIST[@]} > 0)); then 00:42:41.895 00:23:04.738 75 run_test "nvmf_perf_adq" $rootdir/test/nvmf/target/perf_adq.sh "${TEST_ARGS[@]}" 00:42:41.895 00:23:04.738 76 fi 00:42:41.895 00:23:04.738 77 elif [[ $SPDK_TEST_NVMF_TRANSPORT == "rdma" ]]; then 00:42:41.895 00:23:04.738 => 78 run_test "nvmf_device_removal" test/nvmf/target/device_removal.sh "${TEST_ARGS[@]}" 00:42:41.895 00:23:04.738 79 run_test "nvmf_srq_overwhelm" "$rootdir/test/nvmf/target/srq_overwhelm.sh" "${TEST_ARGS[@]}" 00:42:41.895 00:23:04.738 80 fi 00:42:41.895 00:23:04.738 81 run_test "nvmf_shutdown" $rootdir/test/nvmf/target/shutdown.sh "${TEST_ARGS[@]}" 00:42:41.895 00:23:04.738 82 fi 00:42:41.895 00:23:04.738 83 00:42:41.895 00:23:04.738 ... 00:42:41.895 00:23:04.738 00:42:41.895 00:23:04.738 ========== Backtrace end ========== 00:42:41.895 00:23:04.738 ========== Backtrace start: ========== 00:42:41.895 00:23:04.738 00:42:41.895 00:23:04.738 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:1111 -> run_test(["nvmf_rdma"],["/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh"],["--transport=rdma"]) 00:42:41.895 00:23:04.738 ... 00:42:41.895 00:23:04.738 1106 timing_enter $test_name 00:42:41.895 00:23:04.738 1107 echo "************************************" 00:42:41.895 00:23:04.738 1108 echo "START TEST $test_name" 00:42:41.895 00:23:04.738 1109 echo "************************************" 00:42:41.895 00:23:04.738 1110 xtrace_restore 00:42:41.895 00:23:04.738 1111 time "$@" 00:42:41.895 00:23:04.738 1112 xtrace_disable 00:42:41.895 00:23:04.738 1113 echo "************************************" 00:42:41.895 00:23:04.738 1114 echo "END TEST $test_name" 00:42:41.895 00:23:04.738 1115 echo "************************************" 00:42:41.895 00:23:04.738 1116 timing_exit $test_name 00:42:41.895 00:23:04.738 ... 00:42:41.895 00:23:04.738 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/autotest.sh:282 -> main(["/var/jenkins/workspace/nvmf-phy-autotest/autorun-spdk.conf"]) 00:42:41.895 00:23:04.738 ... 00:42:41.895 00:23:04.738 277 if [ $SPDK_TEST_NVMF -eq 1 ]; then 00:42:41.895 00:23:04.738 278 export NET_TYPE 00:42:41.895 00:23:04.738 279 # The NVMe-oF run test cases are split out like this so that the parser that compiles the 00:42:41.895 00:23:04.738 280 # list of all tests can properly differentiate them. Please do not merge them into one line. 00:42:41.895 00:23:04.738 281 if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then 00:42:41.895 00:23:04.738 => 282 run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:42:41.895 00:23:04.738 283 run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:42:41.895 00:23:04.738 284 elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then 00:42:41.895 00:23:04.738 285 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:42:41.895 00:23:04.738 286 if [[ $SPDK_TEST_URING -eq 0 ]]; then 00:42:41.895 00:23:04.738 287 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:42:41.895 00:23:04.738 ... 00:42:41.895 00:23:04.738 00:42:41.895 00:23:04.738 ========== Backtrace end ========== ]] 00:42:41.895 + echo '00:23:04.727 ========== Backtrace start: ========== 00:42:41.895 00:23:04.727 00:42:41.895 00:23:04.727 in test/nvmf/target/device_removal.sh:116 -> stop_bdevperf([]) 00:42:41.895 00:23:04.727 ... 00:42:41.895 00:23:04.727 111 00:42:41.895 00:23:04.727 112 sleep 5 00:42:41.895 00:23:04.727 113 } 00:42:41.895 00:23:04.727 114 00:42:41.895 00:23:04.727 115 function stop_bdevperf() { 00:42:41.895 00:23:04.727 => 116 wait $bdevperf_rpc_pid 00:42:41.895 00:23:04.727 117 00:42:41.895 00:23:04.727 118 killprocess $bdevperf_pid 00:42:41.895 00:23:04.727 119 bdevperf_pid= 00:42:41.895 00:23:04.727 120 00:42:41.895 00:23:04.727 121 cat $testdir/try.txt 00:42:41.895 00:23:04.727 ... 00:42:41.895 00:23:04.727 in test/nvmf/target/device_removal.sh:200 -> test_remove_and_rescan(["--no-srq"]) 00:42:41.895 00:23:04.727 ... 00:42:41.895 00:23:04.727 195 fi 00:42:41.895 00:23:04.727 196 sleep 2 00:42:41.895 00:23:04.727 197 done 00:42:41.895 00:23:04.727 198 done 00:42:41.895 00:23:04.727 199 00:42:41.895 00:23:04.727 => 200 stop_bdevperf 00:42:41.895 00:23:04.727 201 00:42:41.895 00:23:04.727 202 killprocess $nvmfpid 00:42:41.895 00:23:04.727 203 nvmfpid= 00:42:41.895 00:23:04.727 204 00:42:41.895 00:23:04.727 205 return 0 00:42:41.895 00:23:04.727 ... 00:42:41.895 00:23:04.727 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:1111 -> run_test(["nvmf_device_removal_pci_remove_no_srq"],["test_remove_and_rescan"],["--no-srq"]) 00:42:41.895 00:23:04.727 ... 00:42:41.895 00:23:04.727 1106 timing_enter $test_name 00:42:41.895 00:23:04.727 1107 echo "************************************" 00:42:41.895 00:23:04.727 1108 echo "START TEST $test_name" 00:42:41.895 00:23:04.727 1109 echo "************************************" 00:42:41.895 00:23:04.727 1110 xtrace_restore 00:42:41.895 00:23:04.727 1111 time "$@" 00:42:41.895 00:23:04.727 1112 xtrace_disable 00:42:41.895 00:23:04.727 1113 echo "************************************" 00:42:41.895 00:23:04.727 1114 echo "END TEST $test_name" 00:42:41.895 00:23:04.727 1115 echo "************************************" 00:42:41.895 00:23:04.727 1116 timing_exit $test_name 00:42:41.895 00:23:04.727 ... 00:42:41.895 00:23:04.727 in test/nvmf/target/device_removal.sh:311 -> main(["--transport=rdma"]) 00:42:41.895 00:23:04.727 ... 00:42:41.895 00:23:04.727 306 exit 0 00:42:41.895 00:23:04.727 307 fi 00:42:41.895 00:23:04.727 308 test_bonding_slaves_on_nics "${target_nics[@]}" 00:42:41.895 00:23:04.727 309 } 00:42:41.895 00:23:04.727 310 00:42:41.895 00:23:04.727 => 311 run_test "nvmf_device_removal_pci_remove_no_srq" test_remove_and_rescan --no-srq 00:42:41.895 00:23:04.727 312 run_test "nvmf_device_removal_pci_remove" test_remove_and_rescan 00:42:41.896 00:23:04.727 313 # bond slaves case needs lag_master & vport_manager are enabled by mlxconfig 00:42:41.896 00:23:04.727 314 # and not work on CI machine currently. 00:42:41.896 00:23:04.727 315 # run_test "nvmf_device_removal_bond_slaves" test_bond_slaves 00:42:41.896 00:23:04.727 316 00:42:41.896 00:23:04.727 ... 00:42:41.896 00:23:04.727 00:42:41.896 00:23:04.727 ========== Backtrace end ========== 00:42:41.896 00:23:04.738 ========== Backtrace start: ========== 00:42:41.896 00:23:04.738 00:42:41.896 00:23:04.738 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:1111 -> run_test(["nvmf_device_removal"],["test/nvmf/target/device_removal.sh"],["--transport=rdma"]) 00:42:41.896 00:23:04.738 ... 00:42:41.896 00:23:04.738 1106 timing_enter $test_name 00:42:41.896 00:23:04.738 1107 echo "************************************" 00:42:41.896 00:23:04.738 1108 echo "START TEST $test_name" 00:42:41.896 00:23:04.738 1109 echo "************************************" 00:42:41.896 00:23:04.738 1110 xtrace_restore 00:42:41.896 00:23:04.738 1111 time "$@" 00:42:41.896 00:23:04.738 1112 xtrace_disable 00:42:41.896 00:23:04.738 1113 echo "************************************" 00:42:41.896 00:23:04.738 1114 echo "END TEST $test_name" 00:42:41.896 00:23:04.738 1115 echo "************************************" 00:42:41.896 00:23:04.738 1116 timing_exit $test_name 00:42:41.896 00:23:04.738 ... 00:42:41.896 00:23:04.738 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh:78 -> main(["--transport=rdma"]) 00:42:41.896 00:23:04.738 ... 00:42:41.896 00:23:04.738 73 TCP_INTERFACE_LIST=("${net_devs[@]}") 00:42:41.896 00:23:04.738 74 if ((${#TCP_INTERFACE_LIST[@]} > 0)); then 00:42:41.896 00:23:04.738 75 run_test "nvmf_perf_adq" $rootdir/test/nvmf/target/perf_adq.sh "${TEST_ARGS[@]}" 00:42:41.896 00:23:04.738 76 fi 00:42:41.896 00:23:04.738 77 elif [[ $SPDK_TEST_NVMF_TRANSPORT == "rdma" ]]; then 00:42:41.896 00:23:04.738 => 78 run_test "nvmf_device_removal" test/nvmf/target/device_removal.sh "${TEST_ARGS[@]}" 00:42:41.896 00:23:04.738 79 run_test "nvmf_srq_overwhelm" "$rootdir/test/nvmf/target/srq_overwhelm.sh" "${TEST_ARGS[@]}" 00:42:41.896 00:23:04.738 80 fi 00:42:41.896 00:23:04.738 81 run_test "nvmf_shutdown" $rootdir/test/nvmf/target/shutdown.sh "${TEST_ARGS[@]}" 00:42:41.896 00:23:04.738 82 fi 00:42:41.896 00:23:04.738 83 00:42:41.896 00:23:04.738 ... 00:42:41.896 00:23:04.738 00:42:41.896 00:23:04.738 ========== Backtrace end ========== 00:42:41.896 00:23:04.738 ========== Backtrace start: ========== 00:42:41.896 00:23:04.738 00:42:41.896 00:23:04.738 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh:1111 -> run_test(["nvmf_rdma"],["/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh"],["--transport=rdma"]) 00:42:41.896 00:23:04.738 ... 00:42:41.896 00:23:04.738 1106 timing_enter $test_name 00:42:41.896 00:23:04.738 1107 echo "************************************" 00:42:41.896 00:23:04.738 1108 echo "START TEST $test_name" 00:42:41.896 00:23:04.738 1109 echo "************************************" 00:42:41.896 00:23:04.738 1110 xtrace_restore 00:42:41.896 00:23:04.738 1111 time "$@" 00:42:41.896 00:23:04.738 1112 xtrace_disable 00:42:41.896 00:23:04.738 1113 echo "************************************" 00:42:41.896 00:23:04.738 1114 echo "END TEST $test_name" 00:42:41.896 00:23:04.738 1115 echo "************************************" 00:42:41.896 00:23:04.738 1116 timing_exit $test_name 00:42:41.896 00:23:04.738 ... 00:42:41.896 00:23:04.738 in /var/jenkins/workspace/nvmf-phy-autotest/spdk/autotest.sh:282 -> main(["/var/jenkins/workspace/nvmf-phy-autotest/autorun-spdk.conf"]) 00:42:41.896 00:23:04.738 ... 00:42:41.896 00:23:04.738 277 if [ $SPDK_TEST_NVMF -eq 1 ]; then 00:42:41.896 00:23:04.738 278 export NET_TYPE 00:42:41.896 00:23:04.738 279 # The NVMe-oF run test cases are split out like this so that the parser that compiles the 00:42:41.896 00:23:04.738 280 # list of all tests can properly differentiate them. Please do not merge them into one line. 00:42:41.896 00:23:04.738 281 if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then 00:42:41.896 00:23:04.738 => 282 run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:42:41.896 00:23:04.738 283 run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:42:41.896 00:23:04.738 284 elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then 00:42:41.896 00:23:04.738 285 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:42:41.896 00:23:04.738 286 if [[ $SPDK_TEST_URING -eq 0 ]]; then 00:42:41.896 00:23:04.738 287 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:42:41.896 00:23:04.738 ... 00:42:41.896 00:23:04.738 00:42:41.896 00:23:04.738 ========== Backtrace end ==========' 00:42:41.896 + for build in "${build_log_list[@]}" 00:42:41.896 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/valgrind-vg-autotest_48637/build.log 00:42:41.896 + local build_log job_name start_pattern end_pattern backtraces 00:42:41.896 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/valgrind-vg-autotest_48637/build.log 00:42:41.896 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/valgrind-vg-autotest_48637/build.log 00:42:41.896 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/valgrind-vg-autotest_48637 00:42:41.896 + job_name=valgrind-vg-autotest_48637 00:42:41.896 + start_pattern='Backtrace start' 00:42:41.896 + end_pattern='Backtrace end' 00:42:41.896 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/valgrind-vg-autotest_48637/build.log ]] 00:42:41.896 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/valgrind-vg-autotest_48637/build.log 00:42:41.896 + backtraces= 00:42:41.896 + [[ -n '' ]] 00:42:41.896 + for build in "${build_log_list[@]}" 00:42:41.896 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vfio-user-phy-autotest_23128/build.log 00:42:41.896 + local build_log job_name start_pattern end_pattern backtraces 00:42:41.896 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vfio-user-phy-autotest_23128/build.log 00:42:41.896 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vfio-user-phy-autotest_23128/build.log 00:42:41.896 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vfio-user-phy-autotest_23128 00:42:41.896 + job_name=vfio-user-phy-autotest_23128 00:42:41.896 + start_pattern='Backtrace start' 00:42:41.896 + end_pattern='Backtrace end' 00:42:41.896 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vfio-user-phy-autotest_23128/build.log ]] 00:42:41.896 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vfio-user-phy-autotest_23128/build.log 00:42:41.896 + backtraces= 00:42:41.896 + [[ -n '' ]] 00:42:41.896 + for build in "${build_log_list[@]}" 00:42:41.896 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-initiator-vg-autotest_74326/build.log 00:42:41.896 + local build_log job_name start_pattern end_pattern backtraces 00:42:41.896 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-initiator-vg-autotest_74326/build.log 00:42:41.896 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-initiator-vg-autotest_74326/build.log 00:42:41.896 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-initiator-vg-autotest_74326 00:42:41.896 + job_name=vhost-initiator-vg-autotest_74326 00:42:41.896 + start_pattern='Backtrace start' 00:42:41.896 + end_pattern='Backtrace end' 00:42:41.896 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-initiator-vg-autotest_74326/build.log ]] 00:42:41.896 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-initiator-vg-autotest_74326/build.log 00:42:41.896 + backtraces= 00:42:41.896 + [[ -n '' ]] 00:42:41.896 + for build in "${build_log_list[@]}" 00:42:41.896 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/autobuild-vg-autotest_62867/build.log 00:42:41.896 + local build_log job_name start_pattern end_pattern backtraces 00:42:41.896 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/autobuild-vg-autotest_62867/build.log 00:42:41.896 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/autobuild-vg-autotest_62867/build.log 00:42:41.896 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/autobuild-vg-autotest_62867 00:42:41.896 + job_name=autobuild-vg-autotest_62867 00:42:41.896 + start_pattern='Backtrace start' 00:42:41.896 + end_pattern='Backtrace end' 00:42:41.896 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/autobuild-vg-autotest_62867/build.log ]] 00:42:41.896 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/autobuild-vg-autotest_62867/build.log 00:42:41.896 + backtraces= 00:42:41.896 + [[ -n '' ]] 00:42:41.896 + for build in "${build_log_list[@]}" 00:42:41.896 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/clang-vg-autotest_57073/build.log 00:42:41.896 + local build_log job_name start_pattern end_pattern backtraces 00:42:41.896 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/clang-vg-autotest_57073/build.log 00:42:41.896 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/clang-vg-autotest_57073/build.log 00:42:41.896 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/clang-vg-autotest_57073 00:42:41.896 + job_name=clang-vg-autotest_57073 00:42:41.896 + start_pattern='Backtrace start' 00:42:41.896 + end_pattern='Backtrace end' 00:42:41.896 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/clang-vg-autotest_57073/build.log ]] 00:42:41.896 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/clang-vg-autotest_57073/build.log 00:42:41.896 + backtraces= 00:42:41.896 + [[ -n '' ]] 00:42:41.896 + for build in "${build_log_list[@]}" 00:42:41.896 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-vg-autotest_74305/build.log 00:42:41.896 + local build_log job_name start_pattern end_pattern backtraces 00:42:41.896 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-vg-autotest_74305/build.log 00:42:41.896 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-vg-autotest_74305/build.log 00:42:41.896 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-vg-autotest_74305 00:42:41.896 + job_name=nvme-vg-autotest_74305 00:42:41.896 + start_pattern='Backtrace start' 00:42:41.896 + end_pattern='Backtrace end' 00:42:41.896 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-vg-autotest_74305/build.log ]] 00:42:41.896 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-vg-autotest_74305/build.log 00:42:41.896 + backtraces= 00:42:41.897 + [[ -n '' ]] 00:42:41.897 + for build in "${build_log_list[@]}" 00:42:41.897 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-vg-autotest_74342/build.log 00:42:41.897 + local build_log job_name start_pattern end_pattern backtraces 00:42:41.897 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-vg-autotest_74342/build.log 00:42:41.897 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-vg-autotest_74342/build.log 00:42:41.897 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-vg-autotest_74342 00:42:41.897 + job_name=iscsi-vg-autotest_74342 00:42:41.897 + start_pattern='Backtrace start' 00:42:41.897 + end_pattern='Backtrace end' 00:42:41.897 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-vg-autotest_74342/build.log ]] 00:42:41.897 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-vg-autotest_74342/build.log 00:42:41.897 + backtraces= 00:42:41.897 + [[ -n '' ]] 00:42:41.897 + for build in "${build_log_list[@]}" 00:42:41.897 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu22-vg-autotest_34895/build.log 00:42:41.897 + local build_log job_name start_pattern end_pattern backtraces 00:42:41.897 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu22-vg-autotest_34895/build.log 00:42:41.897 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu22-vg-autotest_34895/build.log 00:42:41.897 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu22-vg-autotest_34895 00:42:41.897 + job_name=ubuntu22-vg-autotest_34895 00:42:41.897 + start_pattern='Backtrace start' 00:42:41.897 + end_pattern='Backtrace end' 00:42:41.897 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu22-vg-autotest_34895/build.log ]] 00:42:41.897 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu22-vg-autotest_34895/build.log 00:42:41.897 + backtraces= 00:42:41.897 + [[ -n '' ]] 00:42:41.897 + for build in "${build_log_list[@]}" 00:42:41.897 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-uring-vg-autotest_74226/build.log 00:42:41.897 + local build_log job_name start_pattern end_pattern backtraces 00:42:41.897 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-uring-vg-autotest_74226/build.log 00:42:41.897 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-uring-vg-autotest_74226/build.log 00:42:41.897 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-uring-vg-autotest_74226 00:42:41.897 + job_name=nvmf-tcp-uring-vg-autotest_74226 00:42:41.897 + start_pattern='Backtrace start' 00:42:41.897 + end_pattern='Backtrace end' 00:42:41.897 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-uring-vg-autotest_74226/build.log ]] 00:42:41.897 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-uring-vg-autotest_74226/build.log 00:42:41.897 + backtraces='00:20:57.947 ========== Backtrace start: ========== 00:42:41.897 00:20:57.947 00:42:41.897 00:20:57.947 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1338 -> fio_plugin(["/home/vagrant/spdk_repo/spdk/build/fio/spdk_bdev"],["--ioengine=spdk_bdev"],["--spdk_json_conf"],["/dev/fd/62"],["/dev/fd/61"]) 00:42:41.897 00:20:57.947 ... 00:42:41.897 00:20:57.947 1333 break 00:42:41.897 00:20:57.947 1334 fi 00:42:41.897 00:20:57.947 1335 done 00:42:41.897 00:20:57.947 1336 00:42:41.897 00:20:57.947 1337 # Preload the sanitizer library to fio if fio_plugin was compiled with it 00:42:41.897 00:20:57.947 1338 LD_PRELOAD="$asan_lib $plugin" "$fio_dir"/fio "$@" 00:42:41.897 00:20:57.947 1339 } 00:42:41.897 00:20:57.947 1340 00:42:41.897 00:20:57.947 1341 function fio_bdev() { 00:42:41.897 00:20:57.947 1342 fio_plugin "$rootdir/build/fio/spdk_bdev" "$@" 00:42:41.897 00:20:57.948 1343 } 00:42:41.897 00:20:57.948 ... 00:42:41.897 00:20:57.948 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1342 -> fio_bdev(["--ioengine=spdk_bdev"],["--spdk_json_conf"],["/dev/fd/62"],["/dev/fd/61"]) 00:42:41.897 00:20:57.948 ... 00:42:41.897 00:20:57.948 1337 # Preload the sanitizer library to fio if fio_plugin was compiled with it 00:42:41.897 00:20:57.948 1338 LD_PRELOAD="$asan_lib $plugin" "$fio_dir"/fio "$@" 00:42:41.897 00:20:57.948 1339 } 00:42:41.897 00:20:57.948 1340 00:42:41.897 00:20:57.948 1341 function fio_bdev() { 00:42:41.897 00:20:57.948 1342 fio_plugin "$rootdir/build/fio/spdk_bdev" "$@" 00:42:41.897 00:20:57.948 1343 } 00:42:41.897 00:20:57.948 1344 00:42:41.897 00:20:57.948 1345 function fio_nvme() { 00:42:41.897 00:20:57.948 1346 fio_plugin "$rootdir/build/fio/spdk_nvme" "$@" 00:42:41.897 00:20:57.948 1347 } 00:42:41.897 00:20:57.948 ... 00:42:41.897 00:20:57.948 in /home/vagrant/spdk_repo/spdk/test/nvmf/target/dif.sh:82 -> fio(["/dev/fd/62"]) 00:42:41.897 00:20:57.948 ... 00:42:41.897 00:20:57.948 77 FIO 00:42:41.897 00:20:57.948 78 done 00:42:41.897 00:20:57.948 79 } 00:42:41.897 00:20:57.948 80 00:42:41.897 00:20:57.948 81 fio() { 00:42:41.897 00:20:57.948 => 82 fio_bdev --ioengine=spdk_bdev --spdk_json_conf "$@" <(gen_fio_conf) 00:42:41.897 00:20:57.948 83 } 00:42:41.897 00:20:57.948 84 00:42:41.897 00:20:57.948 85 fio_dif_1() { 00:42:41.897 00:20:57.948 86 create_subsystems 0 00:42:41.897 00:20:57.948 87 fio <(create_json_sub_conf 0) 00:42:41.897 00:20:57.948 ... 00:42:41.897 00:20:57.948 in /home/vagrant/spdk_repo/spdk/test/nvmf/target/dif.sh:112 -> fio_dif_rand_params([]) 00:42:41.897 00:20:57.948 ... 00:42:41.897 00:20:57.948 107 destroy_subsystems 0 00:42:41.897 00:20:57.948 108 00:42:41.897 00:20:57.948 109 NULL_DIF=2 bs=4k numjobs=8 iodepth=16 runtime="" files=2 00:42:41.897 00:20:57.948 110 00:42:41.897 00:20:57.948 111 create_subsystems 0 1 2 00:42:41.897 00:20:57.948 => 112 fio <(create_json_sub_conf 0 1 2) 00:42:41.897 00:20:57.948 113 destroy_subsystems 0 1 2 00:42:41.897 00:20:57.948 114 00:42:41.897 00:20:57.948 115 NULL_DIF=1 bs=8k,16k,128k numjobs=2 iodepth=8 runtime=5 files=1 00:42:41.897 00:20:57.948 116 00:42:41.897 00:20:57.948 117 create_subsystems 0 1 00:42:41.897 00:20:57.948 ... 00:42:41.897 00:20:57.948 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1111 -> run_test(["fio_dif_rand_params"],["fio_dif_rand_params"]) 00:42:41.897 00:20:57.948 ... 00:42:41.897 00:20:57.948 1106 timing_enter $test_name 00:42:41.897 00:20:57.948 1107 echo "************************************" 00:42:41.897 00:20:57.948 1108 echo "START TEST $test_name" 00:42:41.897 00:20:57.948 1109 echo "************************************" 00:42:41.897 00:20:57.948 1110 xtrace_restore 00:42:41.897 00:20:57.948 1111 time "$@" 00:42:41.897 00:20:57.948 1112 xtrace_disable 00:42:41.897 00:20:57.948 1113 echo "************************************" 00:42:41.897 00:20:57.948 1114 echo "END TEST $test_name" 00:42:41.897 00:20:57.948 1115 echo "************************************" 00:42:41.897 00:20:57.948 1116 timing_exit $test_name 00:42:41.897 00:20:57.948 ... 00:42:41.897 00:20:57.948 in /home/vagrant/spdk_repo/spdk/test/nvmf/target/dif.sh:143 -> main(["--transport=tcp"],["--iso"]) 00:42:41.897 00:20:57.948 ... 00:42:41.897 00:20:57.948 138 00:42:41.897 00:20:57.948 139 create_transport 00:42:41.897 00:20:57.948 140 00:42:41.897 00:20:57.948 141 run_test "fio_dif_1_default" fio_dif_1 00:42:41.897 00:20:57.948 142 run_test "fio_dif_1_multi_subsystems" fio_dif_1_multi_subsystems 00:42:41.897 00:20:57.948 => 143 run_test "fio_dif_rand_params" fio_dif_rand_params 00:42:41.897 00:20:57.948 144 run_test "fio_dif_digest" fio_dif_digest 00:42:41.897 00:20:57.948 145 00:42:41.897 00:20:57.948 146 trap - SIGINT SIGTERM EXIT 00:42:41.897 00:20:57.948 147 nvmftestfini 00:42:41.897 00:20:57.948 ... 00:42:41.897 00:20:57.948 00:42:41.898 00:20:57.948 ========== Backtrace end ========== 00:42:41.898 00:20:57.948 ========== Backtrace start: ========== 00:42:41.898 00:20:57.948 00:42:41.898 00:20:57.948 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1111 -> run_test(["nvmf_dif"],["/home/vagrant/spdk_repo/spdk/test/nvmf/target/dif.sh"]) 00:42:41.898 00:20:57.948 ... 00:42:41.898 00:20:57.948 1106 timing_enter $test_name 00:42:41.898 00:20:57.948 1107 echo "************************************" 00:42:41.898 00:20:57.948 1108 echo "START TEST $test_name" 00:42:41.898 00:20:57.948 1109 echo "************************************" 00:42:41.898 00:20:57.948 1110 xtrace_restore 00:42:41.898 00:20:57.948 1111 time "$@" 00:42:41.898 00:20:57.948 1112 xtrace_disable 00:42:41.898 00:20:57.948 1113 echo "************************************" 00:42:41.898 00:20:57.948 1114 echo "END TEST $test_name" 00:42:41.898 00:20:57.948 1115 echo "************************************" 00:42:41.898 00:20:57.948 1116 timing_exit $test_name 00:42:41.898 00:20:57.948 ... 00:42:41.898 00:20:57.948 in /home/vagrant/spdk_repo/spdk/autotest.sh:290 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 00:42:41.898 00:20:57.948 ... 00:42:41.898 00:20:57.948 285 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:42:41.898 00:20:57.948 286 if [[ $SPDK_TEST_URING -eq 0 ]]; then 00:42:41.898 00:20:57.948 287 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:42:41.898 00:20:57.948 288 run_test "nvmf_identify_passthru" $rootdir/test/nvmf/target/identify_passthru.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:42:41.898 00:20:57.948 289 fi 00:42:41.898 00:20:57.948 => 290 run_test "nvmf_dif" $rootdir/test/nvmf/target/dif.sh 00:42:41.898 00:20:57.948 291 run_test "nvmf_abort_qd_sizes" $rootdir/test/nvmf/target/abort_qd_sizes.sh 00:42:41.898 00:20:57.948 292 # The keyring tests utilize NVMe/TLS 00:42:41.898 00:20:57.948 293 run_test "keyring_file" "$rootdir/test/keyring/file.sh" 00:42:41.898 00:20:57.948 294 if [[ "$CONFIG_HAVE_KEYUTILS" == y ]]; then 00:42:41.898 00:20:57.948 295 run_test "keyring_linux" "$rootdir/test/keyring/linux.sh" 00:42:41.898 00:20:57.948 ... 00:42:41.898 00:20:57.948 00:42:41.898 00:20:57.948 ========== Backtrace end ==========' 00:42:41.898 + [[ -n 00:20:57.947 ========== Backtrace start: ========== 00:42:41.898 00:20:57.947 00:42:41.898 00:20:57.947 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1338 -> fio_plugin(["/home/vagrant/spdk_repo/spdk/build/fio/spdk_bdev"],["--ioengine=spdk_bdev"],["--spdk_json_conf"],["/dev/fd/62"],["/dev/fd/61"]) 00:42:41.898 00:20:57.947 ... 00:42:41.898 00:20:57.947 1333 break 00:42:41.898 00:20:57.947 1334 fi 00:42:41.898 00:20:57.947 1335 done 00:42:41.898 00:20:57.947 1336 00:42:41.898 00:20:57.947 1337 # Preload the sanitizer library to fio if fio_plugin was compiled with it 00:42:41.898 00:20:57.947 1338 LD_PRELOAD="$asan_lib $plugin" "$fio_dir"/fio "$@" 00:42:41.898 00:20:57.947 1339 } 00:42:41.898 00:20:57.947 1340 00:42:41.898 00:20:57.947 1341 function fio_bdev() { 00:42:41.898 00:20:57.947 1342 fio_plugin "$rootdir/build/fio/spdk_bdev" "$@" 00:42:41.898 00:20:57.948 1343 } 00:42:41.898 00:20:57.948 ... 00:42:41.898 00:20:57.948 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1342 -> fio_bdev(["--ioengine=spdk_bdev"],["--spdk_json_conf"],["/dev/fd/62"],["/dev/fd/61"]) 00:42:41.898 00:20:57.948 ... 00:42:41.898 00:20:57.948 1337 # Preload the sanitizer library to fio if fio_plugin was compiled with it 00:42:41.898 00:20:57.948 1338 LD_PRELOAD="$asan_lib $plugin" "$fio_dir"/fio "$@" 00:42:41.898 00:20:57.948 1339 } 00:42:41.898 00:20:57.948 1340 00:42:41.898 00:20:57.948 1341 function fio_bdev() { 00:42:41.898 00:20:57.948 1342 fio_plugin "$rootdir/build/fio/spdk_bdev" "$@" 00:42:41.898 00:20:57.948 1343 } 00:42:41.898 00:20:57.948 1344 00:42:41.898 00:20:57.948 1345 function fio_nvme() { 00:42:41.898 00:20:57.948 1346 fio_plugin "$rootdir/build/fio/spdk_nvme" "$@" 00:42:41.898 00:20:57.948 1347 } 00:42:41.898 00:20:57.948 ... 00:42:41.898 00:20:57.948 in /home/vagrant/spdk_repo/spdk/test/nvmf/target/dif.sh:82 -> fio(["/dev/fd/62"]) 00:42:41.898 00:20:57.948 ... 00:42:41.898 00:20:57.948 77 FIO 00:42:41.898 00:20:57.948 78 done 00:42:41.898 00:20:57.948 79 } 00:42:41.898 00:20:57.948 80 00:42:41.898 00:20:57.948 81 fio() { 00:42:41.898 00:20:57.948 => 82 fio_bdev --ioengine=spdk_bdev --spdk_json_conf "$@" <(gen_fio_conf) 00:42:41.898 00:20:57.948 83 } 00:42:41.898 00:20:57.948 84 00:42:41.898 00:20:57.948 85 fio_dif_1() { 00:42:41.898 00:20:57.948 86 create_subsystems 0 00:42:41.898 00:20:57.948 87 fio <(create_json_sub_conf 0) 00:42:41.898 00:20:57.948 ... 00:42:41.898 00:20:57.948 in /home/vagrant/spdk_repo/spdk/test/nvmf/target/dif.sh:112 -> fio_dif_rand_params([]) 00:42:41.898 00:20:57.948 ... 00:42:41.898 00:20:57.948 107 destroy_subsystems 0 00:42:41.898 00:20:57.948 108 00:42:41.898 00:20:57.948 109 NULL_DIF=2 bs=4k numjobs=8 iodepth=16 runtime="" files=2 00:42:41.898 00:20:57.948 110 00:42:41.898 00:20:57.948 111 create_subsystems 0 1 2 00:42:41.898 00:20:57.948 => 112 fio <(create_json_sub_conf 0 1 2) 00:42:41.898 00:20:57.948 113 destroy_subsystems 0 1 2 00:42:41.898 00:20:57.948 114 00:42:41.898 00:20:57.948 115 NULL_DIF=1 bs=8k,16k,128k numjobs=2 iodepth=8 runtime=5 files=1 00:42:41.898 00:20:57.948 116 00:42:41.898 00:20:57.948 117 create_subsystems 0 1 00:42:41.898 00:20:57.948 ... 00:42:41.898 00:20:57.948 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1111 -> run_test(["fio_dif_rand_params"],["fio_dif_rand_params"]) 00:42:41.898 00:20:57.948 ... 00:42:41.898 00:20:57.948 1106 timing_enter $test_name 00:42:41.898 00:20:57.948 1107 echo "************************************" 00:42:41.898 00:20:57.948 1108 echo "START TEST $test_name" 00:42:41.898 00:20:57.948 1109 echo "************************************" 00:42:41.898 00:20:57.948 1110 xtrace_restore 00:42:41.898 00:20:57.948 1111 time "$@" 00:42:41.898 00:20:57.948 1112 xtrace_disable 00:42:41.898 00:20:57.948 1113 echo "************************************" 00:42:41.898 00:20:57.948 1114 echo "END TEST $test_name" 00:42:41.898 00:20:57.948 1115 echo "************************************" 00:42:41.898 00:20:57.948 1116 timing_exit $test_name 00:42:41.898 00:20:57.948 ... 00:42:41.898 00:20:57.948 in /home/vagrant/spdk_repo/spdk/test/nvmf/target/dif.sh:143 -> main(["--transport=tcp"],["--iso"]) 00:42:41.898 00:20:57.948 ... 00:42:41.898 00:20:57.948 138 00:42:41.898 00:20:57.948 139 create_transport 00:42:41.898 00:20:57.948 140 00:42:41.898 00:20:57.948 141 run_test "fio_dif_1_default" fio_dif_1 00:42:41.898 00:20:57.948 142 run_test "fio_dif_1_multi_subsystems" fio_dif_1_multi_subsystems 00:42:41.898 00:20:57.948 => 143 run_test "fio_dif_rand_params" fio_dif_rand_params 00:42:41.898 00:20:57.948 144 run_test "fio_dif_digest" fio_dif_digest 00:42:41.898 00:20:57.948 145 00:42:41.898 00:20:57.948 146 trap - SIGINT SIGTERM EXIT 00:42:41.898 00:20:57.948 147 nvmftestfini 00:42:41.898 00:20:57.948 ... 00:42:41.898 00:20:57.948 00:42:41.898 00:20:57.948 ========== Backtrace end ========== 00:42:41.898 00:20:57.948 ========== Backtrace start: ========== 00:42:41.898 00:20:57.948 00:42:41.898 00:20:57.948 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1111 -> run_test(["nvmf_dif"],["/home/vagrant/spdk_repo/spdk/test/nvmf/target/dif.sh"]) 00:42:41.898 00:20:57.948 ... 00:42:41.898 00:20:57.948 1106 timing_enter $test_name 00:42:41.898 00:20:57.948 1107 echo "************************************" 00:42:41.898 00:20:57.948 1108 echo "START TEST $test_name" 00:42:41.898 00:20:57.948 1109 echo "************************************" 00:42:41.898 00:20:57.948 1110 xtrace_restore 00:42:41.898 00:20:57.948 1111 time "$@" 00:42:41.898 00:20:57.948 1112 xtrace_disable 00:42:41.898 00:20:57.948 1113 echo "************************************" 00:42:41.898 00:20:57.948 1114 echo "END TEST $test_name" 00:42:41.898 00:20:57.948 1115 echo "************************************" 00:42:41.898 00:20:57.948 1116 timing_exit $test_name 00:42:41.898 00:20:57.948 ... 00:42:41.898 00:20:57.948 in /home/vagrant/spdk_repo/spdk/autotest.sh:290 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 00:42:41.898 00:20:57.948 ... 00:42:41.898 00:20:57.948 285 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:42:41.898 00:20:57.948 286 if [[ $SPDK_TEST_URING -eq 0 ]]; then 00:42:41.898 00:20:57.948 287 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:42:41.898 00:20:57.948 288 run_test "nvmf_identify_passthru" $rootdir/test/nvmf/target/identify_passthru.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:42:41.898 00:20:57.948 289 fi 00:42:41.898 00:20:57.948 => 290 run_test "nvmf_dif" $rootdir/test/nvmf/target/dif.sh 00:42:41.898 00:20:57.948 291 run_test "nvmf_abort_qd_sizes" $rootdir/test/nvmf/target/abort_qd_sizes.sh 00:42:41.898 00:20:57.948 292 # The keyring tests utilize NVMe/TLS 00:42:41.898 00:20:57.948 293 run_test "keyring_file" "$rootdir/test/keyring/file.sh" 00:42:41.898 00:20:57.948 294 if [[ "$CONFIG_HAVE_KEYUTILS" == y ]]; then 00:42:41.898 00:20:57.948 295 run_test "keyring_linux" "$rootdir/test/keyring/linux.sh" 00:42:41.898 00:20:57.948 ... 00:42:41.898 00:20:57.948 00:42:41.898 00:20:57.948 ========== Backtrace end ========== ]] 00:42:41.898 + echo '00:20:57.947 ========== Backtrace start: ========== 00:42:41.898 00:20:57.947 00:42:41.898 00:20:57.947 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1338 -> fio_plugin(["/home/vagrant/spdk_repo/spdk/build/fio/spdk_bdev"],["--ioengine=spdk_bdev"],["--spdk_json_conf"],["/dev/fd/62"],["/dev/fd/61"]) 00:42:41.898 00:20:57.947 ... 00:42:41.898 00:20:57.947 1333 break 00:42:41.898 00:20:57.947 1334 fi 00:42:41.898 00:20:57.947 1335 done 00:42:41.898 00:20:57.947 1336 00:42:41.898 00:20:57.947 1337 # Preload the sanitizer library to fio if fio_plugin was compiled with it 00:42:41.898 00:20:57.947 1338 LD_PRELOAD="$asan_lib $plugin" "$fio_dir"/fio "$@" 00:42:41.898 00:20:57.947 1339 } 00:42:41.898 00:20:57.947 1340 00:42:41.898 00:20:57.947 1341 function fio_bdev() { 00:42:41.898 00:20:57.947 1342 fio_plugin "$rootdir/build/fio/spdk_bdev" "$@" 00:42:41.898 00:20:57.948 1343 } 00:42:41.898 00:20:57.948 ... 00:42:41.899 00:20:57.948 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1342 -> fio_bdev(["--ioengine=spdk_bdev"],["--spdk_json_conf"],["/dev/fd/62"],["/dev/fd/61"]) 00:42:41.899 00:20:57.948 ... 00:42:41.899 00:20:57.948 1337 # Preload the sanitizer library to fio if fio_plugin was compiled with it 00:42:41.899 00:20:57.948 1338 LD_PRELOAD="$asan_lib $plugin" "$fio_dir"/fio "$@" 00:42:41.899 00:20:57.948 1339 } 00:42:41.899 00:20:57.948 1340 00:42:41.899 00:20:57.948 1341 function fio_bdev() { 00:42:41.899 00:20:57.948 1342 fio_plugin "$rootdir/build/fio/spdk_bdev" "$@" 00:42:41.899 00:20:57.948 1343 } 00:42:41.899 00:20:57.948 1344 00:42:41.899 00:20:57.948 1345 function fio_nvme() { 00:42:41.899 00:20:57.948 1346 fio_plugin "$rootdir/build/fio/spdk_nvme" "$@" 00:42:41.899 00:20:57.948 1347 } 00:42:41.899 00:20:57.948 ... 00:42:41.899 00:20:57.948 in /home/vagrant/spdk_repo/spdk/test/nvmf/target/dif.sh:82 -> fio(["/dev/fd/62"]) 00:42:41.899 00:20:57.948 ... 00:42:41.899 00:20:57.948 77 FIO 00:42:41.899 00:20:57.948 78 done 00:42:41.899 00:20:57.948 79 } 00:42:41.899 00:20:57.948 80 00:42:41.899 00:20:57.948 81 fio() { 00:42:41.899 00:20:57.948 => 82 fio_bdev --ioengine=spdk_bdev --spdk_json_conf "$@" <(gen_fio_conf) 00:42:41.899 00:20:57.948 83 } 00:42:41.899 00:20:57.948 84 00:42:41.899 00:20:57.948 85 fio_dif_1() { 00:42:41.899 00:20:57.948 86 create_subsystems 0 00:42:41.899 00:20:57.948 87 fio <(create_json_sub_conf 0) 00:42:41.899 00:20:57.948 ... 00:42:41.899 00:20:57.948 in /home/vagrant/spdk_repo/spdk/test/nvmf/target/dif.sh:112 -> fio_dif_rand_params([]) 00:42:41.899 00:20:57.948 ... 00:42:41.899 00:20:57.948 107 destroy_subsystems 0 00:42:41.899 00:20:57.948 108 00:42:41.899 00:20:57.948 109 NULL_DIF=2 bs=4k numjobs=8 iodepth=16 runtime="" files=2 00:42:41.899 00:20:57.948 110 00:42:41.899 00:20:57.948 111 create_subsystems 0 1 2 00:42:41.899 00:20:57.948 => 112 fio <(create_json_sub_conf 0 1 2) 00:42:41.899 00:20:57.948 113 destroy_subsystems 0 1 2 00:42:41.899 00:20:57.948 114 00:42:41.899 00:20:57.948 115 NULL_DIF=1 bs=8k,16k,128k numjobs=2 iodepth=8 runtime=5 files=1 00:42:41.899 00:20:57.948 116 00:42:41.899 00:20:57.948 117 create_subsystems 0 1 00:42:41.899 00:20:57.948 ... 00:42:41.899 00:20:57.948 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1111 -> run_test(["fio_dif_rand_params"],["fio_dif_rand_params"]) 00:42:41.899 00:20:57.948 ... 00:42:41.899 00:20:57.948 1106 timing_enter $test_name 00:42:41.899 00:20:57.948 1107 echo "************************************" 00:42:41.899 00:20:57.948 1108 echo "START TEST $test_name" 00:42:41.899 00:20:57.948 1109 echo "************************************" 00:42:41.899 00:20:57.948 1110 xtrace_restore 00:42:41.899 00:20:57.948 1111 time "$@" 00:42:41.899 00:20:57.948 1112 xtrace_disable 00:42:41.899 00:20:57.948 1113 echo "************************************" 00:42:41.899 00:20:57.948 1114 echo "END TEST $test_name" 00:42:41.899 00:20:57.948 1115 echo "************************************" 00:42:41.899 00:20:57.948 1116 timing_exit $test_name 00:42:41.899 00:20:57.948 ... 00:42:41.899 00:20:57.948 in /home/vagrant/spdk_repo/spdk/test/nvmf/target/dif.sh:143 -> main(["--transport=tcp"],["--iso"]) 00:42:41.899 00:20:57.948 ... 00:42:41.899 00:20:57.948 138 00:42:41.899 00:20:57.948 139 create_transport 00:42:41.899 00:20:57.948 140 00:42:41.899 00:20:57.948 141 run_test "fio_dif_1_default" fio_dif_1 00:42:41.899 00:20:57.948 142 run_test "fio_dif_1_multi_subsystems" fio_dif_1_multi_subsystems 00:42:41.899 00:20:57.948 => 143 run_test "fio_dif_rand_params" fio_dif_rand_params 00:42:41.899 00:20:57.948 144 run_test "fio_dif_digest" fio_dif_digest 00:42:41.899 00:20:57.948 145 00:42:41.899 00:20:57.948 146 trap - SIGINT SIGTERM EXIT 00:42:41.899 00:20:57.948 147 nvmftestfini 00:42:41.899 00:20:57.948 ... 00:42:41.899 00:20:57.948 00:42:41.899 00:20:57.948 ========== Backtrace end ========== 00:42:41.899 00:20:57.948 ========== Backtrace start: ========== 00:42:41.899 00:20:57.948 00:42:41.899 00:20:57.948 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1111 -> run_test(["nvmf_dif"],["/home/vagrant/spdk_repo/spdk/test/nvmf/target/dif.sh"]) 00:42:41.899 00:20:57.948 ... 00:42:41.899 00:20:57.948 1106 timing_enter $test_name 00:42:41.899 00:20:57.948 1107 echo "************************************" 00:42:41.899 00:20:57.948 1108 echo "START TEST $test_name" 00:42:41.899 00:20:57.948 1109 echo "************************************" 00:42:41.899 00:20:57.948 1110 xtrace_restore 00:42:41.899 00:20:57.948 1111 time "$@" 00:42:41.899 00:20:57.948 1112 xtrace_disable 00:42:41.899 00:20:57.948 1113 echo "************************************" 00:42:41.899 00:20:57.948 1114 echo "END TEST $test_name" 00:42:41.899 00:20:57.948 1115 echo "************************************" 00:42:41.899 00:20:57.948 1116 timing_exit $test_name 00:42:41.899 00:20:57.948 ... 00:42:41.899 00:20:57.948 in /home/vagrant/spdk_repo/spdk/autotest.sh:290 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 00:42:41.899 00:20:57.948 ... 00:42:41.899 00:20:57.948 285 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:42:41.899 00:20:57.948 286 if [[ $SPDK_TEST_URING -eq 0 ]]; then 00:42:41.899 00:20:57.948 287 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:42:41.899 00:20:57.948 288 run_test "nvmf_identify_passthru" $rootdir/test/nvmf/target/identify_passthru.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:42:41.899 00:20:57.948 289 fi 00:42:41.899 00:20:57.948 => 290 run_test "nvmf_dif" $rootdir/test/nvmf/target/dif.sh 00:42:41.899 00:20:57.948 291 run_test "nvmf_abort_qd_sizes" $rootdir/test/nvmf/target/abort_qd_sizes.sh 00:42:41.899 00:20:57.948 292 # The keyring tests utilize NVMe/TLS 00:42:41.899 00:20:57.948 293 run_test "keyring_file" "$rootdir/test/keyring/file.sh" 00:42:41.899 00:20:57.948 294 if [[ "$CONFIG_HAVE_KEYUTILS" == y ]]; then 00:42:41.899 00:20:57.948 295 run_test "keyring_linux" "$rootdir/test/keyring/linux.sh" 00:42:41.899 00:20:57.948 ... 00:42:41.899 00:20:57.948 00:42:41.899 00:20:57.948 ========== Backtrace end ==========' 00:42:41.899 + for build in "${build_log_list[@]}" 00:42:41.899 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vmd-phy-autotest_1958/build.log 00:42:41.899 + local build_log job_name start_pattern end_pattern backtraces 00:42:41.899 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vmd-phy-autotest_1958/build.log 00:42:41.899 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vmd-phy-autotest_1958/build.log 00:42:41.899 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vmd-phy-autotest_1958 00:42:41.899 + job_name=vmd-phy-autotest_1958 00:42:41.899 + start_pattern='Backtrace start' 00:42:41.899 + end_pattern='Backtrace end' 00:42:41.899 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vmd-phy-autotest_1958/build.log ]] 00:42:41.899 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vmd-phy-autotest_1958/build.log 00:42:41.899 + backtraces= 00:42:41.899 + [[ -n '' ]] 00:42:41.899 + for build in "${build_log_list[@]}" 00:42:41.899 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/zns-vg-autotest_73407/build.log 00:42:41.899 + local build_log job_name start_pattern end_pattern backtraces 00:42:41.899 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/zns-vg-autotest_73407/build.log 00:42:41.899 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/zns-vg-autotest_73407/build.log 00:42:41.899 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/zns-vg-autotest_73407 00:42:41.899 + job_name=zns-vg-autotest_73407 00:42:41.899 + start_pattern='Backtrace start' 00:42:41.899 + end_pattern='Backtrace end' 00:42:41.899 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/zns-vg-autotest_73407/build.log ]] 00:42:41.899 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/zns-vg-autotest_73407/build.log 00:42:41.899 + backtraces= 00:42:41.899 + [[ -n '' ]] 00:42:41.899 + for build in "${build_log_list[@]}" 00:42:41.899 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-cmb-pmr-vg-autotest_75427/build.log 00:42:41.899 + local build_log job_name start_pattern end_pattern backtraces 00:42:41.899 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-cmb-pmr-vg-autotest_75427/build.log 00:42:41.899 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-cmb-pmr-vg-autotest_75427/build.log 00:42:41.899 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-cmb-pmr-vg-autotest_75427 00:42:41.899 + job_name=nvme-cmb-pmr-vg-autotest_75427 00:42:41.899 + start_pattern='Backtrace start' 00:42:41.899 + end_pattern='Backtrace end' 00:42:41.899 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-cmb-pmr-vg-autotest_75427/build.log ]] 00:42:41.899 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-cmb-pmr-vg-autotest_75427/build.log 00:42:41.899 + backtraces= 00:42:41.899 + [[ -n '' ]] 00:42:41.899 + for build in "${build_log_list[@]}" 00:42:41.899 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-vg-autotest_74293/build.log 00:42:41.899 + local build_log job_name start_pattern end_pattern backtraces 00:42:41.899 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-vg-autotest_74293/build.log 00:42:41.899 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-vg-autotest_74293/build.log 00:42:41.899 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-vg-autotest_74293 00:42:41.899 + job_name=nvmf-tcp-vg-autotest_74293 00:42:41.899 + start_pattern='Backtrace start' 00:42:41.899 + end_pattern='Backtrace end' 00:42:41.899 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-vg-autotest_74293/build.log ]] 00:42:41.899 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-vg-autotest_74293/build.log 00:42:41.899 + backtraces= 00:42:41.899 + [[ -n '' ]] 00:42:41.899 + run_flamegraph 00:42:41.899 + create_timing_file 00:42:41.899 + local array file 00:42:41.899 + array=($(find $WORKSPACE -type f -name 'timing.txt')) 00:42:41.899 ++ find /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11 -type f -name timing.txt 00:42:42.158 + timing_dir=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/post_process 00:42:42.158 + mkdir -p /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/post_process 00:42:42.158 + timing_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/post_process/total_timing.txt 00:42:42.158 + for file in "${array[@]}" 00:42:42.158 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/rocky9-vg-autotest_13173/timing.txt 00:42:42.158 + local job_file job_name 00:42:42.158 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/rocky9-vg-autotest_13173/timing.txt 00:42:42.158 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/rocky9-vg-autotest_13173/timing.txt 00:42:42.158 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/rocky9-vg-autotest_13173 00:42:42.158 + job_name=rocky9-vg-autotest_13173 00:42:42.158 + sed 's/^/rocky9-vg-autotest_13173;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/rocky9-vg-autotest_13173/timing.txt 00:42:42.158 + for file in "${array[@]}" 00:42:42.158 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/dsa-phy-autotest_2498/timing.txt 00:42:42.158 + local job_file job_name 00:42:42.158 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/dsa-phy-autotest_2498/timing.txt 00:42:42.158 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/dsa-phy-autotest_2498/timing.txt 00:42:42.158 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/dsa-phy-autotest_2498 00:42:42.158 + job_name=dsa-phy-autotest_2498 00:42:42.158 + sed 's/^/dsa-phy-autotest_2498;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/dsa-phy-autotest_2498/timing.txt 00:42:42.158 + for file in "${array[@]}" 00:42:42.158 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-uring-vg-autotest_74207/timing.txt 00:42:42.158 + local job_file job_name 00:42:42.158 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-uring-vg-autotest_74207/timing.txt 00:42:42.158 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-uring-vg-autotest_74207/timing.txt 00:42:42.158 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-uring-vg-autotest_74207 00:42:42.158 + job_name=iscsi-uring-vg-autotest_74207 00:42:42.158 + sed 's/^/iscsi-uring-vg-autotest_74207;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-uring-vg-autotest_74207/timing.txt 00:42:42.158 + for file in "${array[@]}" 00:42:42.158 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-vg-autotest_62827/timing.txt 00:42:42.158 + local job_file job_name 00:42:42.158 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-vg-autotest_62827/timing.txt 00:42:42.158 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-vg-autotest_62827/timing.txt 00:42:42.158 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-vg-autotest_62827 00:42:42.158 + job_name=unittest-vg-autotest_62827 00:42:42.158 + sed 's/^/unittest-vg-autotest_62827;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-vg-autotest_62827/timing.txt 00:42:42.158 + for file in "${array[@]}" 00:42:42.158 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/centos7-vg-autotest_70801/timing.txt 00:42:42.158 + local job_file job_name 00:42:42.158 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/centos7-vg-autotest_70801/timing.txt 00:42:42.158 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/centos7-vg-autotest_70801/timing.txt 00:42:42.158 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/centos7-vg-autotest_70801 00:42:42.158 + job_name=centos7-vg-autotest_70801 00:42:42.159 + sed 's/^/centos7-vg-autotest_70801;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/centos7-vg-autotest_70801/timing.txt 00:42:42.159 + for file in "${array[@]}" 00:42:42.159 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/lvol-vg-autotest_74253/timing.txt 00:42:42.159 + local job_file job_name 00:42:42.159 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/lvol-vg-autotest_74253/timing.txt 00:42:42.159 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/lvol-vg-autotest_74253/timing.txt 00:42:42.159 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/lvol-vg-autotest_74253 00:42:42.159 + job_name=lvol-vg-autotest_74253 00:42:42.159 + sed 's/^/lvol-vg-autotest_74253;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/lvol-vg-autotest_74253/timing.txt 00:42:42.159 + for file in "${array[@]}" 00:42:42.159 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/scanbuild-vg-autotest_62825/timing.txt 00:42:42.159 + local job_file job_name 00:42:42.159 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/scanbuild-vg-autotest_62825/timing.txt 00:42:42.159 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/scanbuild-vg-autotest_62825/timing.txt 00:42:42.159 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/scanbuild-vg-autotest_62825 00:42:42.159 + job_name=scanbuild-vg-autotest_62825 00:42:42.159 + sed 's/^/scanbuild-vg-autotest_62825;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/scanbuild-vg-autotest_62825/timing.txt 00:42:42.159 + for file in "${array[@]}" 00:42:42.159 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-phy-autotest_69288/timing.txt 00:42:42.159 + local job_file job_name 00:42:42.159 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-phy-autotest_69288/timing.txt 00:42:42.159 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-phy-autotest_69288/timing.txt 00:42:42.159 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-phy-autotest_69288 00:42:42.159 + job_name=nvme-phy-autotest_69288 00:42:42.159 + sed 's/^/nvme-phy-autotest_69288;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-phy-autotest_69288/timing.txt 00:42:42.159 + for file in "${array[@]}" 00:42:42.159 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu20-vg-autotest_70883/timing.txt 00:42:42.159 + local job_file job_name 00:42:42.159 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu20-vg-autotest_70883/timing.txt 00:42:42.159 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu20-vg-autotest_70883/timing.txt 00:42:42.159 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu20-vg-autotest_70883 00:42:42.159 + job_name=ubuntu20-vg-autotest_70883 00:42:42.159 + sed 's/^/ubuntu20-vg-autotest_70883;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu20-vg-autotest_70883/timing.txt 00:42:42.159 + for file in "${array[@]}" 00:42:42.159 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-phy-autotest_23143/timing.txt 00:42:42.159 + local job_file job_name 00:42:42.159 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-phy-autotest_23143/timing.txt 00:42:42.159 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-phy-autotest_23143/timing.txt 00:42:42.159 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-phy-autotest_23143 00:42:42.159 + job_name=vhost-phy-autotest_23143 00:42:42.159 + sed 's/^/vhost-phy-autotest_23143;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-phy-autotest_23143/timing.txt 00:42:42.159 + for file in "${array[@]}" 00:42:42.159 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-phy-autotest_69251/timing.txt 00:42:42.159 + local job_file job_name 00:42:42.159 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-phy-autotest_69251/timing.txt 00:42:42.159 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-phy-autotest_69251/timing.txt 00:42:42.159 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-phy-autotest_69251 00:42:42.159 + job_name=nvmf-tcp-phy-autotest_69251 00:42:42.159 + sed 's/^/nvmf-tcp-phy-autotest_69251;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-phy-autotest_69251/timing.txt 00:42:42.159 + for file in "${array[@]}" 00:42:42.159 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/BlobFS-phy-autotest_23122/timing.txt 00:42:42.159 + local job_file job_name 00:42:42.159 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/BlobFS-phy-autotest_23122/timing.txt 00:42:42.159 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/BlobFS-phy-autotest_23122/timing.txt 00:42:42.159 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/BlobFS-phy-autotest_23122 00:42:42.159 + job_name=BlobFS-phy-autotest_23122 00:42:42.159 + sed 's/^/BlobFS-phy-autotest_23122;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/BlobFS-phy-autotest_23122/timing.txt 00:42:42.159 + for file in "${array[@]}" 00:42:42.159 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/short-fuzz-phy-autotest_23116/timing.txt 00:42:42.159 + local job_file job_name 00:42:42.159 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/short-fuzz-phy-autotest_23116/timing.txt 00:42:42.159 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/short-fuzz-phy-autotest_23116/timing.txt 00:42:42.159 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/short-fuzz-phy-autotest_23116 00:42:42.159 + job_name=short-fuzz-phy-autotest_23116 00:42:42.159 + sed 's/^/short-fuzz-phy-autotest_23116;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/short-fuzz-phy-autotest_23116/timing.txt 00:42:42.159 + for file in "${array[@]}" 00:42:42.159 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/crypto-phy-autotest_23120/timing.txt 00:42:42.159 + local job_file job_name 00:42:42.159 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/crypto-phy-autotest_23120/timing.txt 00:42:42.159 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/crypto-phy-autotest_23120/timing.txt 00:42:42.159 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/crypto-phy-autotest_23120 00:42:42.159 + job_name=crypto-phy-autotest_23120 00:42:42.159 + sed 's/^/crypto-phy-autotest_23120;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/crypto-phy-autotest_23120/timing.txt 00:42:42.159 + for file in "${array[@]}" 00:42:42.159 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-phy-autotest_69362/timing.txt 00:42:42.159 + local job_file job_name 00:42:42.159 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-phy-autotest_69362/timing.txt 00:42:42.159 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-phy-autotest_69362/timing.txt 00:42:42.159 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-phy-autotest_69362 00:42:42.159 + job_name=nvmf-phy-autotest_69362 00:42:42.159 + sed 's/^/nvmf-phy-autotest_69362;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-phy-autotest_69362/timing.txt 00:42:42.159 + for file in "${array[@]}" 00:42:42.159 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/valgrind-vg-autotest_48637/timing.txt 00:42:42.159 + local job_file job_name 00:42:42.159 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/valgrind-vg-autotest_48637/timing.txt 00:42:42.159 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/valgrind-vg-autotest_48637/timing.txt 00:42:42.159 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/valgrind-vg-autotest_48637 00:42:42.159 + job_name=valgrind-vg-autotest_48637 00:42:42.159 + sed 's/^/valgrind-vg-autotest_48637;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/valgrind-vg-autotest_48637/timing.txt 00:42:42.159 + for file in "${array[@]}" 00:42:42.159 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vfio-user-phy-autotest_23128/timing.txt 00:42:42.159 + local job_file job_name 00:42:42.159 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vfio-user-phy-autotest_23128/timing.txt 00:42:42.159 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vfio-user-phy-autotest_23128/timing.txt 00:42:42.159 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vfio-user-phy-autotest_23128 00:42:42.159 + job_name=vfio-user-phy-autotest_23128 00:42:42.159 + sed 's/^/vfio-user-phy-autotest_23128;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vfio-user-phy-autotest_23128/timing.txt 00:42:42.159 + for file in "${array[@]}" 00:42:42.159 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-initiator-vg-autotest_74326/timing.txt 00:42:42.159 + local job_file job_name 00:42:42.159 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-initiator-vg-autotest_74326/timing.txt 00:42:42.159 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-initiator-vg-autotest_74326/timing.txt 00:42:42.159 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-initiator-vg-autotest_74326 00:42:42.159 + job_name=vhost-initiator-vg-autotest_74326 00:42:42.159 + sed 's/^/vhost-initiator-vg-autotest_74326;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-initiator-vg-autotest_74326/timing.txt 00:42:42.159 + for file in "${array[@]}" 00:42:42.159 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/autobuild-vg-autotest_62867/timing.txt 00:42:42.159 + local job_file job_name 00:42:42.159 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/autobuild-vg-autotest_62867/timing.txt 00:42:42.159 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/autobuild-vg-autotest_62867/timing.txt 00:42:42.159 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/autobuild-vg-autotest_62867 00:42:42.159 + job_name=autobuild-vg-autotest_62867 00:42:42.159 + sed 's/^/autobuild-vg-autotest_62867;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/autobuild-vg-autotest_62867/timing.txt 00:42:42.159 + for file in "${array[@]}" 00:42:42.159 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/clang-vg-autotest_57073/timing.txt 00:42:42.159 + local job_file job_name 00:42:42.159 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/clang-vg-autotest_57073/timing.txt 00:42:42.159 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/clang-vg-autotest_57073/timing.txt 00:42:42.159 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/clang-vg-autotest_57073 00:42:42.159 + job_name=clang-vg-autotest_57073 00:42:42.159 + sed 's/^/clang-vg-autotest_57073;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/clang-vg-autotest_57073/timing.txt 00:42:42.159 + for file in "${array[@]}" 00:42:42.159 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-vg-autotest_74305/timing.txt 00:42:42.159 + local job_file job_name 00:42:42.159 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-vg-autotest_74305/timing.txt 00:42:42.159 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-vg-autotest_74305/timing.txt 00:42:42.159 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-vg-autotest_74305 00:42:42.160 + job_name=nvme-vg-autotest_74305 00:42:42.160 + sed 's/^/nvme-vg-autotest_74305;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-vg-autotest_74305/timing.txt 00:42:42.160 + for file in "${array[@]}" 00:42:42.160 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-vg-autotest_74342/timing.txt 00:42:42.160 + local job_file job_name 00:42:42.160 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-vg-autotest_74342/timing.txt 00:42:42.160 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-vg-autotest_74342/timing.txt 00:42:42.160 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-vg-autotest_74342 00:42:42.160 + job_name=iscsi-vg-autotest_74342 00:42:42.160 + sed 's/^/iscsi-vg-autotest_74342;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-vg-autotest_74342/timing.txt 00:42:42.160 + for file in "${array[@]}" 00:42:42.160 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu22-vg-autotest_34895/timing.txt 00:42:42.160 + local job_file job_name 00:42:42.160 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu22-vg-autotest_34895/timing.txt 00:42:42.160 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu22-vg-autotest_34895/timing.txt 00:42:42.160 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu22-vg-autotest_34895 00:42:42.160 + job_name=ubuntu22-vg-autotest_34895 00:42:42.160 + sed 's/^/ubuntu22-vg-autotest_34895;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu22-vg-autotest_34895/timing.txt 00:42:42.160 + for file in "${array[@]}" 00:42:42.160 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-uring-vg-autotest_74226/timing.txt 00:42:42.160 + local job_file job_name 00:42:42.160 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-uring-vg-autotest_74226/timing.txt 00:42:42.160 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-uring-vg-autotest_74226/timing.txt 00:42:42.160 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-uring-vg-autotest_74226 00:42:42.160 + job_name=nvmf-tcp-uring-vg-autotest_74226 00:42:42.160 + sed 's/^/nvmf-tcp-uring-vg-autotest_74226;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-uring-vg-autotest_74226/timing.txt 00:42:42.160 + for file in "${array[@]}" 00:42:42.160 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vmd-phy-autotest_1958/timing.txt 00:42:42.160 + local job_file job_name 00:42:42.160 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vmd-phy-autotest_1958/timing.txt 00:42:42.160 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vmd-phy-autotest_1958/timing.txt 00:42:42.160 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vmd-phy-autotest_1958 00:42:42.160 + job_name=vmd-phy-autotest_1958 00:42:42.160 + sed 's/^/vmd-phy-autotest_1958;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vmd-phy-autotest_1958/timing.txt 00:42:42.160 + for file in "${array[@]}" 00:42:42.160 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/zns-vg-autotest_73407/timing.txt 00:42:42.160 + local job_file job_name 00:42:42.160 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/zns-vg-autotest_73407/timing.txt 00:42:42.160 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/zns-vg-autotest_73407/timing.txt 00:42:42.160 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/zns-vg-autotest_73407 00:42:42.160 + job_name=zns-vg-autotest_73407 00:42:42.160 + sed 's/^/zns-vg-autotest_73407;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/zns-vg-autotest_73407/timing.txt 00:42:42.160 + for file in "${array[@]}" 00:42:42.160 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-cmb-pmr-vg-autotest_75427/timing.txt 00:42:42.160 + local job_file job_name 00:42:42.160 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-cmb-pmr-vg-autotest_75427/timing.txt 00:42:42.160 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-cmb-pmr-vg-autotest_75427/timing.txt 00:42:42.160 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-cmb-pmr-vg-autotest_75427 00:42:42.160 + job_name=nvme-cmb-pmr-vg-autotest_75427 00:42:42.160 + sed 's/^/nvme-cmb-pmr-vg-autotest_75427;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-cmb-pmr-vg-autotest_75427/timing.txt 00:42:42.160 + for file in "${array[@]}" 00:42:42.160 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-vg-autotest_74293/timing.txt 00:42:42.160 + local job_file job_name 00:42:42.160 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-vg-autotest_74293/timing.txt 00:42:42.160 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-vg-autotest_74293/timing.txt 00:42:42.160 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-vg-autotest_74293 00:42:42.160 + job_name=nvmf-tcp-vg-autotest_74293 00:42:42.160 + sed 's/^/nvmf-tcp-vg-autotest_74293;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-vg-autotest_74293/timing.txt 00:42:42.160 + /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/post_process/total_timing.txt 00:42:42.160 + run_autorun_post 00:42:42.160 + s_opt= 00:42:42.160 + [[ '' == true ]] 00:42:42.160 + spdk/autorun_post.py -d ./ -r ./spdk 00:42:52.121 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/module/blobfs/bdev/blobfs_bdev.c:254 00:42:53.150 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/lib/util/crc16.c:628 00:42:53.150 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/lib/util/crc16.c:634 00:42:53.407 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/lib/util/crc64.c:165 00:42:53.693 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/lib/util/crc32c.c:21 00:42:53.693 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/lib/util/xor.c:120 00:43:12.569 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/module/blobfs/bdev/blobfs_bdev.c:254 00:43:19.220 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/module/blobfs/bdev/blobfs_bdev.c:254 00:43:58.275 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/module/bdev/nvme/bdev_mdns_client.c:561 00:43:58.275 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/module/bdev/nvme/bdev_mdns_client.c:456 00:43:58.275 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/module/bdev/nvme/bdev_mdns_client.c:613 00:43:58.275 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/module/bdev/nvme/bdev_mdns_client.c:582 00:44:13.137 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/mmio.h! 00:44:13.137 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/nvme.h! 00:44:13.137 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/nvme_spec.h! 00:44:13.137 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/histogram_data.h! 00:44:13.137 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/thread.h! 00:44:13.137 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/trace.h! 00:44:13.137 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/util.h! 00:44:13.137 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/endian.h! 00:44:13.137 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/base64.h! 00:44:13.137 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/nvmf_transport.h! 00:44:13.137 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/bdev_module.h! 00:44:14.511 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/histogram_data.h/histogram_ut.c! 00:44:16.418 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/lib/env_ocf/include/ocf/ocf_mngt.h! 00:44:16.418 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/lib/env_ocf/include/ocf/ocf_io.h! 00:44:16.418 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/spdk/lib/env_ocf/include/ocf/ocf_core.h! 00:44:34.489 -----Begin Post Process Script------ 00:44:34.489 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/rocky9-vg-autotest_13173/cov_total.info 00:44:34.489 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/dsa-phy-autotest_2498/cov_total.info 00:44:34.489 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-uring-vg-autotest_74207/cov_total.info 00:44:34.489 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/unittest-vg-autotest_62827/cov_total.info 00:44:34.489 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/centos7-vg-autotest_70801/cov_total.info 00:44:34.489 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/lvol-vg-autotest_74253/cov_total.info 00:44:34.489 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-phy-autotest_69288/cov_total.info 00:44:34.489 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu20-vg-autotest_70883/cov_total.info 00:44:34.489 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-phy-autotest_23143/cov_total.info 00:44:34.489 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-phy-autotest_69251/cov_total.info 00:44:34.489 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/BlobFS-phy-autotest_23122/cov_total.info 00:44:34.489 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/crypto-phy-autotest_23120/cov_total.info 00:44:34.489 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/valgrind-vg-autotest_48637/cov_total.info 00:44:34.489 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vfio-user-phy-autotest_23128/cov_total.info 00:44:34.489 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vhost-initiator-vg-autotest_74326/cov_total.info 00:44:34.489 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-vg-autotest_74305/cov_total.info 00:44:34.489 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/iscsi-vg-autotest_74342/cov_total.info 00:44:34.489 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/ubuntu22-vg-autotest_34895/cov_total.info 00:44:34.489 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/vmd-phy-autotest_1958/cov_total.info 00:44:34.489 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/zns-vg-autotest_73407/cov_total.info 00:44:34.489 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvme-cmb-pmr-vg-autotest_75427/cov_total.info 00:44:34.489 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/nvmf-tcp-vg-autotest_74293/cov_total.info 00:44:34.489 00:44:34.489 00:44:34.489 -----Tests Executed in Build------ 00:44:34.489 accel 00:44:34.489 accel_assign_opcode 00:44:34.489 accel_cdev_comp 00:44:34.489 accel_cdev_decmop_full 00:44:34.489 accel_cdev_decomp 00:44:34.489 accel_cdev_decomp_full_mcore 00:44:34.489 accel_cdev_decomp_mcore 00:44:34.489 accel_cdev_decomp_mthread 00:44:34.489 accel_cdev_deomp_full_mthread 00:44:34.489 accel_comp 00:44:34.489 accel_compare 00:44:34.489 accel_compress_verify 00:44:34.489 accel_copy 00:44:34.489 accel_copy_crc32c 00:44:34.489 accel_copy_crc32c_C2 00:44:34.489 accel_crc32c 00:44:34.489 accel_crc32c_C2 00:44:34.489 accel_decmop_full 00:44:34.489 accel_decomp 00:44:34.489 accel_decomp_full_mcore 00:44:34.489 accel_decomp_mcore 00:44:34.489 accel_decomp_mthread 00:44:34.489 accel_deomp_full_mthread 00:44:34.489 accel_dif_functional_tests 00:44:34.489 accel_dif_generate 00:44:34.489 accel_dif_generate_copy 00:44:34.489 accel_dif_verify 00:44:34.489 accel_dualcast 00:44:34.489 accel_fill 00:44:34.489 accel_help 00:44:34.489 accel_missing_filename 00:44:34.489 accel_negative_buffers 00:44:34.489 accel_rpc 00:44:34.489 accel_scan_dsa_modules 00:44:34.489 accel_scan_iaa_modules 00:44:34.489 accel_wrong_workload 00:44:34.489 accel_xor 00:44:34.489 acl 00:44:34.489 alias_rpc 00:44:34.489 allowed 00:44:34.489 app_cmdline 00:44:34.489 app_repeat 00:44:34.489 asan 00:44:34.489 autobuild 00:44:34.489 autobuild_build_doc 00:44:34.489 autobuild_check_dpdk_pci_api 00:44:34.489 autobuild_check_format 00:44:34.489 autobuild_check_so_deps 00:44:34.489 autobuild_external_code 00:44:34.489 autobuild_generated_files_check 00:44:34.489 autobuild_generated_files_check_post_clean 00:44:34.489 autobuild_header_dependency_check 00:44:34.489 autobuild_llvm_precompile 00:44:34.489 autobuild_make_install 00:44:34.489 autobuild_make_uninstall 00:44:34.489 autobuild_ocf_precompile 00:44:34.489 bdev_bounds 00:44:34.489 bdev_crypto_enomem 00:44:34.489 bdev_error 00:44:34.489 bdev_fio 00:44:34.489 bdev_fio_rw_verify 00:44:34.489 bdev_fio_trim 00:44:34.489 bdev_gpt_uuid 00:44:34.489 bdev_hello_world 00:44:34.489 bdev_json_nonarray 00:44:34.489 bdev_json_nonenclosed 00:44:34.489 bdev_nbd 00:44:34.489 bdev_nvme_reset_stuck_adm_cmd 00:44:34.489 bdev_qd_sampling 00:44:34.489 bdev_qos 00:44:34.489 bdev_qos_bw 00:44:34.489 bdev_qos_iops 00:44:34.489 bdev_qos_ro_bw 00:44:34.489 bdev_raid 00:44:34.489 bdev_stat 00:44:34.489 bdev_verify 00:44:34.489 bdev_verify_big_io 00:44:34.489 bdev_write_zeroes 00:44:34.489 bdevperf_config 00:44:34.489 blob_io_wait 00:44:34.489 blobfs 00:44:34.489 blobfs_mkfs 00:44:34.489 blobstore 00:44:34.489 blobstore_grow 00:44:34.489 blockdev_crypto_aesni 00:44:34.489 blockdev_crypto_qat 00:44:34.489 blockdev_crypto_sw 00:44:34.489 blockdev_general 00:44:34.489 blockdev_nvme 00:44:34.489 blockdev_nvme_gpt 00:44:34.489 blockdev_raid5f 00:44:34.489 blockdev_rbd 00:44:34.489 blockdev_xnvme 00:44:34.489 build_native_dpdk 00:44:34.489 build_rpm_from_gen_spec 00:44:34.489 build_shared_native_dpdk_rpm 00:44:34.489 build_shared_rpm 00:44:34.489 build_shared_rpm_with_rpmed_dpdk 00:44:34.489 chaining 00:44:34.489 check_header_filenames 00:44:34.489 cmb_copy 00:44:34.489 compress_compdev 00:44:34.489 compress_isal 00:44:34.489 confirm_abi_deps 00:44:34.489 confirm_makefile_deps 00:44:34.489 cpu_locks 00:44:34.489 custom_alloc 00:44:34.489 dd_bs_lt_native_bs 00:44:34.489 dd_copy_to_out_bdev 00:44:34.489 dd_double_input 00:44:34.489 dd_double_output 00:44:34.489 dd_flag_append 00:44:34.489 dd_flag_append_forced_aio 00:44:34.489 dd_flag_directory 00:44:34.489 dd_flag_directory_forced_aio 00:44:34.489 dd_flag_noatime 00:44:34.489 dd_flag_noatime_forced_aio 00:44:34.489 dd_flag_nofollow 00:44:34.489 dd_flag_nofollow_forced_aio 00:44:34.489 dd_flags_misc 00:44:34.489 dd_flags_misc_forced_aio 00:44:34.489 dd_inflate_file 00:44:34.489 dd_invalid_arguments 00:44:34.489 dd_invalid_count 00:44:34.489 dd_invalid_iflag 00:44:34.489 dd_invalid_json 00:44:34.489 dd_invalid_oflag 00:44:34.489 dd_malloc_copy 00:44:34.489 dd_no_input 00:44:34.489 dd_no_output 00:44:34.489 dd_offset_magic 00:44:34.489 dd_rw 00:44:34.489 dd_rw_offset 00:44:34.489 dd_smaller_blocksize 00:44:34.489 dd_sparse_bdev_to_file 00:44:34.489 dd_sparse_file_to_bdev 00:44:34.489 dd_sparse_file_to_file 00:44:34.489 dd_unknown_flag 00:44:34.489 dd_uring_copy 00:44:34.489 dd_wrong_blocksize 00:44:34.489 default_locks 00:44:34.489 default_locks_via_rpc 00:44:34.489 default_setup 00:44:34.489 denied 00:44:34.489 devices 00:44:34.489 dm_mount 00:44:34.489 dma 00:44:34.489 dpdk_governor 00:44:34.489 dpdk_mem_utility 00:44:34.489 driver 00:44:34.489 env 00:44:34.489 env_dpdk_post_init 00:44:34.489 env_mem_callbacks 00:44:34.489 env_memory 00:44:34.489 env_pci 00:44:34.489 env_vtophys 00:44:34.489 even_2G_alloc 00:44:34.489 event 00:44:34.489 event_perf 00:44:34.489 event_reactor 00:44:34.489 event_reactor_perf 00:44:34.489 event_scheduler 00:44:34.489 exit_on_failed_rpc_init 00:44:34.489 external_make_accel_driver_shared 00:44:34.489 external_make_accel_driver_static 00:44:34.489 external_make_accel_module_shared 00:44:34.489 external_make_accel_module_static 00:44:34.489 external_make_hello_bdev_shared_combo 00:44:34.489 external_make_hello_bdev_shared_iso 00:44:34.489 external_make_hello_bdev_static 00:44:34.490 external_make_hello_no_bdev_shared_combo 00:44:34.490 external_make_hello_no_bdev_shared_iso 00:44:34.490 external_make_hello_no_bdev_static 00:44:34.490 external_make_nvme_shared 00:44:34.490 external_make_nvme_static 00:44:34.490 external_run_accel_driver_shared 00:44:34.490 external_run_accel_driver_static 00:44:34.490 external_run_accel_module_shared 00:44:34.490 external_run_accel_module_static 00:44:34.490 external_run_hello_bdev_shared_combo 00:44:34.490 external_run_hello_bdev_shared_iso 00:44:34.490 external_run_hello_bdev_static 00:44:34.490 external_run_hello_no_bdev_shared_combo 00:44:34.490 external_run_hello_no_bdev_shared_iso 00:44:34.490 external_run_hello_no_bdev_static 00:44:34.490 external_run_nvme_shared 00:44:34.490 external_run_nvme_static 00:44:34.490 filesystem_btrfs 00:44:34.490 filesystem_ext4 00:44:34.490 filesystem_in_capsule_btrfs 00:44:34.490 filesystem_in_capsule_ext4 00:44:34.490 filesystem_in_capsule_xfs 00:44:34.490 filesystem_xfs 00:44:34.490 fio_dif_1_default 00:44:34.490 fio_dif_1_multi_subsystems 00:44:34.490 fio_dif_digest 00:44:34.490 fio_dif_rand_params 00:44:34.490 ftl 00:44:34.490 ftl_bdevperf 00:44:34.490 ftl_dirty_shutdown 00:44:34.490 ftl_fio_basic 00:44:34.490 ftl_restore 00:44:34.490 ftl_trim 00:44:34.490 ftl_upgrade_shutdown 00:44:34.490 go_rpc 00:44:34.490 guess_driver 00:44:34.490 hello_blob 00:44:34.490 hugepages 00:44:34.490 idle 00:44:34.490 interrupt_mode 00:44:34.490 ioat 00:44:34.490 ioat_perf 00:44:34.490 ioat_verify 00:44:34.490 is_zoned 00:44:34.490 iscsi_tgt 00:44:34.490 iscsi_tgt_bdev_io_wait 00:44:34.490 iscsi_tgt_calsoft 00:44:34.490 iscsi_tgt_digest 00:44:34.490 iscsi_tgt_digests 00:44:34.490 iscsi_tgt_ext4test 00:44:34.490 iscsi_tgt_filesystem 00:44:34.490 iscsi_tgt_filesystem_btrfs 00:44:34.490 iscsi_tgt_filesystem_ext4 00:44:34.490 iscsi_tgt_filesystem_xfs 00:44:34.490 iscsi_tgt_fio 00:44:34.490 iscsi_tgt_fuzz 00:44:34.490 iscsi_tgt_initiator 00:44:34.490 iscsi_tgt_ip_migration 00:44:34.490 iscsi_tgt_iscsi_lvol 00:44:34.490 iscsi_tgt_login_redirection 00:44:34.490 iscsi_tgt_multiconnection 00:44:34.490 iscsi_tgt_qos 00:44:34.490 iscsi_tgt_rbd 00:44:34.490 iscsi_tgt_reset 00:44:34.490 iscsi_tgt_resize 00:44:34.490 iscsi_tgt_rpc_config 00:44:34.490 iscsi_tgt_sock 00:44:34.490 iscsi_tgt_trace_record 00:44:34.490 json_config 00:44:34.490 json_config_extra_key 00:44:34.490 kernel_target_abort 00:44:34.490 keyring_file 00:44:34.490 llvm_fuzz 00:44:34.490 locking_app_on_locked_coremask 00:44:34.490 locking_app_on_unlocked_coremask 00:44:34.490 locking_overlapped_coremask 00:44:34.490 locking_overlapped_coremask_via_rpc 00:44:34.490 lvol 00:44:34.490 lvol_basic 00:44:34.490 lvol_esnap 00:44:34.490 lvol_external_snapshot 00:44:34.490 lvol_hotremove 00:44:34.490 lvol_provisioning 00:44:34.490 lvol_rename 00:44:34.490 lvol_resize 00:44:34.490 lvol_snapshot_clone 00:44:34.490 lvol_tasting 00:44:34.490 lvs_grow_clean 00:44:34.490 lvs_grow_dirty 00:44:34.490 make 00:44:34.490 no_shrink_alloc 00:44:34.490 non_locking_app_on_locked_coremask 00:44:34.490 nvme 00:44:34.490 nvme_arbitration 00:44:34.490 nvme_cli_cuse 00:44:34.490 nvme_cli_plugin 00:44:34.490 nvme_cmb 00:44:34.490 nvme_cuse 00:44:34.490 nvme_cuse_app 00:44:34.490 nvme_cuse_rpc 00:44:34.490 nvme_doorbell_aers 00:44:34.490 nvme_e2edp 00:44:34.490 nvme_err_injection 00:44:34.490 nvme_fdp 00:44:34.490 nvme_fio 00:44:34.490 nvme_flexible_data_placement 00:44:34.490 nvme_hello_world 00:44:34.490 nvme_identify 00:44:34.490 nvme_mount 00:44:34.490 nvme_multi_aen 00:44:34.490 nvme_multi_secondary 00:44:34.490 nvme_ns_manage_cuse 00:44:34.490 nvme_overhead 00:44:34.490 nvme_perf 00:44:34.490 nvme_pmr 00:44:34.490 nvme_pmr_persistence 00:44:34.490 nvme_reserve 00:44:34.490 nvme_reset 00:44:34.490 nvme_rpc 00:44:34.490 nvme_rpc_timeouts 00:44:34.490 nvme_scc 00:44:34.490 nvme_sgl 00:44:34.490 nvme_simple_copy 00:44:34.490 nvme_single_aen 00:44:34.490 nvme_smartctl_cuse 00:44:34.490 nvme_startup 00:44:34.490 nvme_xnvme 00:44:34.490 nvme_zns 00:44:34.490 nvmf_abort 00:44:34.490 nvmf_abort_qd_sizes 00:44:34.490 nvmf_aer 00:44:34.490 nvmf_async_init 00:44:34.490 nvmf_auth 00:44:34.490 nvmf_bdev_io_wait 00:44:34.490 nvmf_bdevio 00:44:34.490 nvmf_bdevio_no_huge 00:44:34.490 nvmf_bdevperf 00:44:34.490 nvmf_connect_disconnect 00:44:34.490 nvmf_connect_stress 00:44:34.490 nvmf_delete_subsystem 00:44:34.490 nvmf_dif 00:44:34.490 nvmf_digest 00:44:34.490 nvmf_digest_clean 00:44:34.490 nvmf_digest_error 00:44:34.490 nvmf_discovery 00:44:34.490 nvmf_discovery_remove_ifc 00:44:34.490 nvmf_example 00:44:34.490 nvmf_failover 00:44:34.490 nvmf_filesystem 00:44:34.490 nvmf_filesystem_in_capsule 00:44:34.490 nvmf_filesystem_no_in_capsule 00:44:34.490 nvmf_fio_host 00:44:34.490 nvmf_fio_target 00:44:34.490 nvmf_fips 00:44:34.490 nvmf_fused_ordering 00:44:34.490 nvmf_fuzz 00:44:34.490 nvmf_host_management 00:44:34.490 nvmf_identify 00:44:34.490 nvmf_identify_kernel_target 00:44:34.490 nvmf_identify_passthru 00:44:34.490 nvmf_initiator_timeout 00:44:34.490 nvmf_invalid 00:44:34.490 nvmf_lvol 00:44:34.490 nvmf_lvs_grow 00:44:34.490 nvmf_mdns_discovery 00:44:34.490 nvmf_multiconnection 00:44:34.490 nvmf_multicontroller 00:44:34.490 nvmf_multipath 00:44:34.490 nvmf_multitarget 00:44:34.490 nvmf_nmic 00:44:34.490 nvmf_ns_hotplug_stress 00:44:34.490 nvmf_ns_masking 00:44:34.490 nvmf_nvme_cli 00:44:34.490 nvmf_perf 00:44:34.490 nvmf_perf_adq 00:44:34.490 nvmf_queue_depth 00:44:34.490 nvmf_referrals 00:44:34.490 nvmf_rpc 00:44:34.490 nvmf_shutdown 00:44:34.490 nvmf_shutdown_tc1 00:44:34.490 nvmf_shutdown_tc2 00:44:34.490 nvmf_shutdown_tc3 00:44:34.490 nvmf_target_disconnect 00:44:34.490 nvmf_target_disconnect_tc1 00:44:34.490 nvmf_target_disconnect_tc2 00:44:34.490 nvmf_tcp 00:44:34.490 nvmf_timeout 00:44:34.490 nvmf_tls 00:44:34.490 nvmf_vfio_user 00:44:34.490 nvmf_vfio_user_fuzz 00:44:34.490 nvmf_vfio_user_nvme_compliance 00:44:34.490 nvmf_vhost 00:44:34.490 nvmf_zcopy 00:44:34.490 ocf 00:44:34.490 ocf_bdevperf_iotypes 00:44:34.490 ocf_configuration_change 00:44:34.490 ocf_create_destruct 00:44:34.490 ocf_fio_modes 00:44:34.490 ocf_flush 00:44:34.490 ocf_multicore 00:44:34.490 ocf_remove 00:44:34.490 ocf_stats 00:44:34.490 odd_alloc 00:44:34.490 packaging 00:44:34.490 per_node_1G_alloc 00:44:34.490 raid0_resize_test 00:44:34.490 raid5f_rebuild_test 00:44:34.490 raid5f_rebuild_test_sb 00:44:34.490 raid5f_state_function_test 00:44:34.490 raid5f_state_function_test_sb 00:44:34.490 raid5f_superblock_test 00:44:34.490 raid_function_test_concat 00:44:34.490 raid_function_test_raid0 00:44:34.490 raid_rebuild_test 00:44:34.490 raid_rebuild_test_io 00:44:34.490 raid_rebuild_test_sb 00:44:34.490 raid_rebuild_test_sb_io 00:44:34.490 raid_state_function_test 00:44:34.490 raid_state_function_test_sb 00:44:34.490 raid_superblock_test 00:44:34.490 reactor_set_interrupt 00:44:34.490 reap_unregistered_poller 00:44:34.490 rocksdb 00:44:34.490 rocksdb_insert 00:44:34.490 rocksdb_overwrite 00:44:34.490 rocksdb_randread 00:44:34.490 rocksdb_readwrite 00:44:34.490 rocksdb_writesync 00:44:34.490 rpc 00:44:34.490 rpc_client 00:44:34.490 rpc_daemon_integrity 00:44:34.490 rpc_integrity 00:44:34.490 rpc_plugins 00:44:34.490 rpc_trace_cmd_test 00:44:34.490 rpm_packaging 00:44:34.490 scanbuild_make 00:44:34.490 scheduler 00:44:34.490 scheduler_create_thread 00:44:34.490 setup.sh 00:44:34.490 skip_rpc 00:44:34.490 skip_rpc_with_delay 00:44:34.490 skip_rpc_with_json 00:44:34.490 sma 00:44:34.490 sma_crypto 00:44:34.490 sma_discovery 00:44:34.490 sma_nvmf_tcp 00:44:34.490 sma_plugins 00:44:34.490 sma_qos 00:44:34.490 sma_vfiouser_qemu 00:44:34.490 sma_vhost 00:44:34.490 spdk_dd 00:44:34.490 spdk_dd_basic_rw 00:44:34.490 spdk_dd_bdev_to_bdev 00:44:34.490 spdk_dd_malloc 00:44:34.490 spdk_dd_negative 00:44:34.490 spdk_dd_posix 00:44:34.490 spdk_dd_sparse 00:44:34.490 spdk_dd_uring 00:44:34.490 spdk_target_abort 00:44:34.490 spdkcli_iscsi 00:44:34.490 spdkcli_nvmf_tcp 00:44:34.490 spdkcli_raid 00:44:34.490 spdkcli_rbd 00:44:34.490 spdkcli_tcp 00:44:34.490 spdkcli_vhost 00:44:34.490 spdkcli_virtio 00:44:34.490 sw_hotplug 00:44:34.490 test_bdev_lvol_delete_lvstore_with_clones 00:44:34.490 test_bdev_lvol_delete_ordering 00:44:34.490 test_clone_decouple_parent 00:44:34.490 test_clone_inflate 00:44:34.490 test_clone_snapshot_relations 00:44:34.490 test_construct_lvol 00:44:34.490 test_construct_lvol_alias_conflict 00:44:34.490 test_construct_lvol_fio_clear_method_none 00:44:34.490 test_construct_lvol_fio_clear_method_unmap 00:44:34.490 test_construct_lvol_full_lvs 00:44:34.490 test_construct_lvol_inexistent_lvs 00:44:34.490 test_construct_lvols_conflict_alias 00:44:34.490 test_construct_lvs 00:44:34.490 test_construct_lvs_clear_methods 00:44:34.490 test_construct_lvs_conflict_alias 00:44:34.490 test_construct_lvs_different_cluster_size 00:44:34.490 test_construct_lvs_nonexistent_bdev 00:44:34.490 test_construct_multi_lvols 00:44:34.490 test_construct_nested_lvol 00:44:34.490 test_construct_two_lvs_on_the_same_bdev 00:44:34.491 test_create_multi_ublk 00:44:34.491 test_create_snapshot_of_snapshot 00:44:34.491 test_create_snapshot_with_io 00:44:34.491 test_create_ublk 00:44:34.491 test_delete_lvol_store_persistent_positive 00:44:34.491 test_delete_snapshot_with_clone 00:44:34.491 test_delete_snapshot_with_snapshot 00:44:34.491 test_destroy_after_bdev_lvol_resize_positive 00:44:34.491 test_esnap_clones 00:44:34.491 test_esnap_late_arrival 00:44:34.491 test_esnap_reload 00:44:34.491 test_esnap_remove_degraded 00:44:34.491 test_hotremove_lvol_store 00:44:34.491 test_hotremove_lvol_store_base 00:44:34.491 test_hotremove_lvol_store_base_with_lvols 00:44:34.491 test_hotremove_lvol_store_multiple_lvols 00:44:34.491 test_lvol_bdev_readonly 00:44:34.491 test_lvol_list 00:44:34.491 test_lvol_rename_negative 00:44:34.491 test_rename_lvs_negative 00:44:34.491 test_rename_positive 00:44:34.491 test_resize_lvol 00:44:34.491 test_resize_lvol_negative 00:44:34.491 test_resize_lvol_with_io_traffic 00:44:34.491 test_save_ublk_config 00:44:34.491 test_sigterm 00:44:34.491 test_snapshot_compare_with_lvol_bdev 00:44:34.491 test_tasting 00:44:34.491 test_thin_lvol_check_integrity 00:44:34.491 test_thin_lvol_check_space 00:44:34.491 test_thin_lvol_check_zeroes 00:44:34.491 test_thin_lvol_resize 00:44:34.491 test_thin_overprovisioning 00:44:34.491 test_unregister_lvol_bdev 00:44:34.491 thread 00:44:34.491 thread_poller_perf 00:44:34.491 thread_spdk_lock 00:44:34.491 ublk 00:44:34.491 ublk_recovery 00:44:34.491 ubsan 00:44:34.491 unittest 00:44:34.491 unittest_accel 00:44:34.491 unittest_bdev 00:44:34.491 unittest_bdev_compress 00:44:34.491 unittest_bdev_crypto 00:44:34.491 unittest_bdev_raid5f 00:44:34.491 unittest_blob_blobfs 00:44:34.491 unittest_build 00:44:34.491 unittest_dma 00:44:34.491 unittest_dpdk_compressdev 00:44:34.491 unittest_event 00:44:34.491 unittest_ftl 00:44:34.491 unittest_idxd_user 00:44:34.491 unittest_include 00:44:34.491 unittest_init 00:44:34.491 unittest_ioat 00:44:34.491 unittest_iobuf 00:44:34.491 unittest_iscsi 00:44:34.491 unittest_json 00:44:34.491 unittest_keyring 00:44:34.491 unittest_lib_reduce 00:44:34.491 unittest_log 00:44:34.491 unittest_lvol 00:44:34.491 unittest_notify 00:44:34.491 unittest_nvme 00:44:34.491 unittest_nvme_cuse 00:44:34.491 unittest_nvme_rdma 00:44:34.491 unittest_nvmf 00:44:34.491 unittest_nvmf_rdma 00:44:34.491 unittest_nvmf_transport 00:44:34.491 unittest_nvmf_vfio_user 00:44:34.491 unittest_pci_event 00:44:34.491 unittest_rdma 00:44:34.491 unittest_rpc 00:44:34.491 unittest_scsi 00:44:34.491 unittest_sock 00:44:34.491 unittest_thread 00:44:34.491 unittest_util 00:44:34.491 unittest_vhost 00:44:34.491 valgrind 00:44:34.491 version 00:44:34.491 vfio_fuzz 00:44:34.491 vfio_user_nvme_fio 00:44:34.491 vfio_user_nvme_restart_vm 00:44:34.491 vfio_user_qemu 00:44:34.491 vfio_user_virtio_bdevperf 00:44:34.491 vfio_user_virtio_blk_restart_vm 00:44:34.491 vfio_user_virtio_scsi_restart_vm 00:44:34.491 vhost 00:44:34.491 vhost_blk_cores_2ctrl 00:44:34.491 vhost_blk_fs_integrity 00:44:34.491 vhost_blk_integrity 00:44:34.491 vhost_blk_lvol_integrity 00:44:34.491 vhost_blk_packed_ring_integrity 00:44:34.491 vhost_blockdev 00:44:34.491 vhost_boot 00:44:34.491 vhost_fuzz 00:44:34.491 vhost_migration 00:44:34.491 vhost_migration_tc1 00:44:34.491 vhost_migration_tc2 00:44:34.491 vhost_negative 00:44:34.491 vhost_readonly 00:44:34.491 vhost_scsi_cores_2ctrl 00:44:34.491 vhost_scsi_fs_integrity 00:44:34.491 vhost_scsi_integrity 00:44:34.491 vhost_scsi_lvol_integrity 00:44:34.491 vhost_shared 00:44:34.491 vmd 00:44:34.491 vmd_bdev_svc 00:44:34.491 vmd_fio 00:44:34.491 vmd_hello_world 00:44:34.491 vmd_identify 00:44:34.491 vmd_perf 00:44:34.491 xnvme_bdevperf 00:44:34.491 xnvme_to_malloc_dd_copy 00:44:34.491 zoned_fio 00:44:34.491 00:44:34.491 00:44:34.491 -----Tests Missing From Build------ 00:44:34.491 balanced 00:44:34.491 busy 00:44:34.491 core_load 00:44:34.491 ftl_fio_extended 00:44:34.491 ftl_fio_nightly 00:44:34.491 ftl_restore_fast 00:44:34.491 ftl_write_after_write 00:44:34.491 iscsi_tgt_data_digest 00:44:34.491 iscsi_tgt_fio_remote_nvme 00:44:34.491 keyring_linux 00:44:34.491 nvme_boot_partition 00:44:34.491 nvme_bp 00:44:34.491 nvme_opal 00:44:34.491 nvme_opal_bdevio 00:44:34.491 nvme_opal_bdevperf 00:44:34.491 nvme_opal_spdk_tgt 00:44:34.491 nvmf_device_removal 00:44:34.491 nvmf_device_removal_pci_remove 00:44:34.491 nvmf_device_removal_pci_remove_no_srq 00:44:34.491 nvmf_digest_dsa_initiator 00:44:34.491 nvmf_digest_dsa_target 00:44:34.491 nvmf_fc 00:44:34.491 nvmf_rdma 00:44:34.491 nvmf_srq_overwhelm 00:44:34.491 nvmf_target_disconnect_tc3 00:44:34.491 spdkcli_nvmf_fc 00:44:34.491 spdkcli_nvmf_rdma 00:44:34.491 unittest_nvmf_fc 00:44:34.491 unittest_nvmf_fc_ls 00:44:34.491 vhost_blk_hot_remove 00:44:34.491 vhost_hotplug 00:44:34.491 vhost_scsi_hot_remove 00:44:34.491 00:44:34.491 00:44:34.491 -----Tests Missing ASAN------ 00:44:34.491 accel_cdev_comp 00:44:34.491 accel_cdev_decmop_full 00:44:34.491 accel_cdev_decomp 00:44:34.491 accel_cdev_decomp_full_mcore 00:44:34.491 accel_cdev_decomp_mcore 00:44:34.491 accel_cdev_decomp_mthread 00:44:34.491 accel_cdev_deomp_full_mthread 00:44:34.491 autobuild_llvm_precompile 00:44:34.491 balanced 00:44:34.491 bdev_crypto_enomem 00:44:34.491 blockdev_crypto_aesni 00:44:34.491 blockdev_crypto_qat 00:44:34.491 blockdev_crypto_sw 00:44:34.491 blockdev_rbd 00:44:34.491 busy 00:44:34.491 chaining 00:44:34.491 cmb_copy 00:44:34.491 compress_compdev 00:44:34.491 compress_isal 00:44:34.491 core_load 00:44:34.491 dd_uring_copy 00:44:34.491 dma 00:44:34.491 dpdk_governor 00:44:34.491 filesystem_btrfs 00:44:34.491 filesystem_ext4 00:44:34.491 filesystem_in_capsule_btrfs 00:44:34.491 filesystem_in_capsule_ext4 00:44:34.491 filesystem_in_capsule_xfs 00:44:34.491 filesystem_xfs 00:44:34.491 fio_dif_1_default 00:44:34.491 fio_dif_1_multi_subsystems 00:44:34.491 fio_dif_digest 00:44:34.491 fio_dif_rand_params 00:44:34.491 ftl_fio_extended 00:44:34.491 ftl_fio_nightly 00:44:34.491 ftl_restore_fast 00:44:34.491 ftl_write_after_write 00:44:34.491 go_rpc 00:44:34.491 idle 00:44:34.491 interrupt_mode 00:44:34.491 ioat 00:44:34.491 ioat_perf 00:44:34.491 ioat_verify 00:44:34.491 is_zoned 00:44:34.491 iscsi_tgt 00:44:34.491 iscsi_tgt_bdev_io_wait 00:44:34.491 iscsi_tgt_calsoft 00:44:34.491 iscsi_tgt_data_digest 00:44:34.491 iscsi_tgt_digest 00:44:34.491 iscsi_tgt_digests 00:44:34.491 iscsi_tgt_ext4test 00:44:34.491 iscsi_tgt_filesystem 00:44:34.491 iscsi_tgt_filesystem_btrfs 00:44:34.491 iscsi_tgt_filesystem_ext4 00:44:34.491 iscsi_tgt_filesystem_xfs 00:44:34.491 iscsi_tgt_fio 00:44:34.491 iscsi_tgt_fio_remote_nvme 00:44:34.491 iscsi_tgt_fuzz 00:44:34.491 iscsi_tgt_initiator 00:44:34.491 iscsi_tgt_ip_migration 00:44:34.491 iscsi_tgt_iscsi_lvol 00:44:34.491 iscsi_tgt_login_redirection 00:44:34.491 iscsi_tgt_multiconnection 00:44:34.491 iscsi_tgt_qos 00:44:34.491 iscsi_tgt_rbd 00:44:34.491 iscsi_tgt_reset 00:44:34.491 iscsi_tgt_resize 00:44:34.491 iscsi_tgt_rpc_config 00:44:34.491 iscsi_tgt_sock 00:44:34.491 iscsi_tgt_trace_record 00:44:34.491 kernel_target_abort 00:44:34.491 keyring_file 00:44:34.491 keyring_linux 00:44:34.491 llvm_fuzz 00:44:34.491 lvs_grow_clean 00:44:34.491 lvs_grow_dirty 00:44:34.491 nvme_boot_partition 00:44:34.491 nvme_bp 00:44:34.491 nvme_cli_cuse 00:44:34.491 nvme_cli_plugin 00:44:34.491 nvme_cmb 00:44:34.491 nvme_cuse 00:44:34.491 nvme_cuse_app 00:44:34.491 nvme_cuse_rpc 00:44:34.491 nvme_ns_manage_cuse 00:44:34.491 nvme_opal 00:44:34.491 nvme_opal_bdevio 00:44:34.491 nvme_opal_bdevperf 00:44:34.491 nvme_opal_spdk_tgt 00:44:34.491 nvme_pmr 00:44:34.491 nvme_pmr_persistence 00:44:34.491 nvme_smartctl_cuse 00:44:34.491 nvme_zns 00:44:34.491 nvmf_abort 00:44:34.491 nvmf_abort_qd_sizes 00:44:34.491 nvmf_aer 00:44:34.491 nvmf_async_init 00:44:34.491 nvmf_auth 00:44:34.491 nvmf_bdev_io_wait 00:44:34.491 nvmf_bdevio 00:44:34.491 nvmf_bdevio_no_huge 00:44:34.491 nvmf_bdevperf 00:44:34.491 nvmf_connect_disconnect 00:44:34.491 nvmf_connect_stress 00:44:34.491 nvmf_delete_subsystem 00:44:34.491 nvmf_device_removal 00:44:34.491 nvmf_device_removal_pci_remove 00:44:34.491 nvmf_device_removal_pci_remove_no_srq 00:44:34.491 nvmf_dif 00:44:34.491 nvmf_digest 00:44:34.491 nvmf_digest_clean 00:44:34.491 nvmf_digest_dsa_initiator 00:44:34.491 nvmf_digest_dsa_target 00:44:34.491 nvmf_digest_error 00:44:34.491 nvmf_discovery 00:44:34.491 nvmf_discovery_remove_ifc 00:44:34.491 nvmf_example 00:44:34.491 nvmf_failover 00:44:34.491 nvmf_fc 00:44:34.491 nvmf_filesystem 00:44:34.491 nvmf_filesystem_in_capsule 00:44:34.491 nvmf_filesystem_no_in_capsule 00:44:34.491 nvmf_fio_host 00:44:34.491 nvmf_fio_target 00:44:34.491 nvmf_fips 00:44:34.491 nvmf_fused_ordering 00:44:34.491 nvmf_fuzz 00:44:34.491 nvmf_host_management 00:44:34.491 nvmf_identify 00:44:34.491 nvmf_identify_kernel_target 00:44:34.491 nvmf_identify_passthru 00:44:34.491 nvmf_initiator_timeout 00:44:34.491 nvmf_invalid 00:44:34.491 nvmf_lvol 00:44:34.491 nvmf_lvs_grow 00:44:34.491 nvmf_mdns_discovery 00:44:34.492 nvmf_multiconnection 00:44:34.492 nvmf_multicontroller 00:44:34.492 nvmf_multipath 00:44:34.492 nvmf_multitarget 00:44:34.492 nvmf_nmic 00:44:34.492 nvmf_ns_hotplug_stress 00:44:34.492 nvmf_ns_masking 00:44:34.492 nvmf_nvme_cli 00:44:34.492 nvmf_perf 00:44:34.492 nvmf_perf_adq 00:44:34.492 nvmf_queue_depth 00:44:34.492 nvmf_rdma 00:44:34.492 nvmf_referrals 00:44:34.492 nvmf_rpc 00:44:34.492 nvmf_shutdown 00:44:34.492 nvmf_shutdown_tc1 00:44:34.492 nvmf_shutdown_tc2 00:44:34.492 nvmf_shutdown_tc3 00:44:34.492 nvmf_srq_overwhelm 00:44:34.492 nvmf_target_disconnect 00:44:34.492 nvmf_target_disconnect_tc1 00:44:34.492 nvmf_target_disconnect_tc2 00:44:34.492 nvmf_target_disconnect_tc3 00:44:34.492 nvmf_tcp 00:44:34.492 nvmf_timeout 00:44:34.492 nvmf_tls 00:44:34.492 nvmf_vfio_user 00:44:34.492 nvmf_vfio_user_fuzz 00:44:34.492 nvmf_vfio_user_nvme_compliance 00:44:34.492 nvmf_zcopy 00:44:34.492 ocf 00:44:34.492 ocf_bdevperf_iotypes 00:44:34.492 ocf_configuration_change 00:44:34.492 ocf_create_destruct 00:44:34.492 ocf_fio_modes 00:44:34.492 ocf_flush 00:44:34.492 ocf_multicore 00:44:34.492 ocf_remove 00:44:34.492 ocf_stats 00:44:34.492 scheduler 00:44:34.492 spdk_dd_uring 00:44:34.492 spdk_target_abort 00:44:34.492 spdkcli_iscsi 00:44:34.492 spdkcli_nvmf_fc 00:44:34.492 spdkcli_nvmf_rdma 00:44:34.492 spdkcli_nvmf_tcp 00:44:34.492 spdkcli_raid 00:44:34.492 spdkcli_rbd 00:44:34.492 spdkcli_virtio 00:44:34.492 sw_hotplug 00:44:34.492 unittest_nvmf_fc 00:44:34.492 unittest_nvmf_fc_ls 00:44:34.492 valgrind 00:44:34.492 vfio_fuzz 00:44:34.492 vhost_blk_hot_remove 00:44:34.492 vhost_blockdev 00:44:34.492 vhost_fuzz 00:44:34.492 vhost_hotplug 00:44:34.492 vhost_scsi_hot_remove 00:44:34.492 vhost_shared 00:44:34.492 zoned_fio 00:44:34.492 00:44:34.492 00:44:34.492 -----Tests Missing UBSAN------ 00:44:34.492 balanced 00:44:34.492 busy 00:44:34.492 cmb_copy 00:44:34.492 core_load 00:44:34.492 ftl_fio_extended 00:44:34.492 ftl_fio_nightly 00:44:34.492 ftl_restore_fast 00:44:34.492 ftl_write_after_write 00:44:34.492 is_zoned 00:44:34.492 iscsi_tgt_data_digest 00:44:34.492 iscsi_tgt_fio_remote_nvme 00:44:34.492 keyring_linux 00:44:34.492 nvme_boot_partition 00:44:34.492 nvme_bp 00:44:34.492 nvme_cmb 00:44:34.492 nvme_opal 00:44:34.492 nvme_opal_bdevio 00:44:34.492 nvme_opal_bdevperf 00:44:34.492 nvme_opal_spdk_tgt 00:44:34.492 nvme_pmr 00:44:34.492 nvme_pmr_persistence 00:44:34.492 nvme_zns 00:44:34.492 nvmf_device_removal 00:44:34.492 nvmf_device_removal_pci_remove 00:44:34.492 nvmf_device_removal_pci_remove_no_srq 00:44:34.492 nvmf_digest_dsa_initiator 00:44:34.492 nvmf_digest_dsa_target 00:44:34.492 nvmf_fc 00:44:34.492 nvmf_rdma 00:44:34.492 nvmf_srq_overwhelm 00:44:34.492 nvmf_target_disconnect_tc3 00:44:34.492 spdkcli_nvmf_fc 00:44:34.492 spdkcli_nvmf_rdma 00:44:34.492 unittest_nvmf_fc 00:44:34.492 unittest_nvmf_fc_ls 00:44:34.492 vhost_blk_hot_remove 00:44:34.492 vhost_hotplug 00:44:34.492 vhost_scsi_hot_remove 00:44:34.492 zoned_fio 00:44:34.492 Not all tests were run. Failing the build. 00:44:34.492 ['nvmf_rdma', 'nvmf_srq_overwhelm', 'nvmf_target_disconnect_tc3', 'spdkcli_nvmf_rdma'] 00:44:34.492 + compress_coverage_and_docs 00:44:34.492 + echo 'Start compress coverage and docs' 00:44:34.492 Start compress coverage and docs 00:44:34.492 + tar -C coverage -czf coverage_autotest-spdk-master-vs-dpdk-v23.11_314.tar.gz ./ --remove-files 00:44:34.492 + tar -C ut_coverage -czf ut_coverage_autotest-spdk-master-vs-dpdk-v23.11_314.tar.gz ./ --remove-files 00:44:34.492 + tar -C doc -czf doc_autotest-spdk-master-vs-dpdk-v23.11_314.tar.gz ./ --remove-files 00:44:34.750 + [[ -d llvm ]] 00:44:34.750 + true 00:44:34.750 + echo 'End compress coverage and docs' 00:44:34.750 End compress coverage and docs 00:44:34.750 + remove_partial_coverage_files 00:44:34.750 + find . -name 'cov_*.info' -delete 00:44:35.007 + echo 'End stage post_gen_coverage.sh' 00:44:35.007 End stage post_gen_coverage.sh 00:44:35.024 [Pipeline] } 00:44:35.027 ERROR: script returned exit code 1 00:44:35.058 [Pipeline] // catchError 00:44:35.067 [Pipeline] catchError 00:44:35.069 [Pipeline] { 00:44:35.090 [Pipeline] dir 00:44:35.090 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v23.11/post_process 00:44:35.092 [Pipeline] {