00:00:00.001 Started by upstream project "nightly-trigger" build number 3086 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.012 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/autotest-spdk-master-vs-dpdk-v22.11_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-upstream/autotest.groovy 00:00:00.013 The recommended git tool is: git 00:00:00.013 using credential 00000000-0000-0000-0000-000000000002 00:00:00.015 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/autotest-spdk-master-vs-dpdk-v22.11_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.028 Fetching changes from the remote Git repository 00:00:00.029 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.042 Using shallow fetch with depth 1 00:00:00.042 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.042 > git --version # timeout=10 00:00:00.053 > git --version # 'git version 2.39.2' 00:00:00.053 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.054 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.054 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:02.273 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:02.284 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:02.296 Checking out Revision 10da8f6d99838e411e4e94523ded0bfebf3e7100 (FETCH_HEAD) 00:00:02.296 > git config core.sparsecheckout # timeout=10 00:00:02.306 > git read-tree -mu HEAD # timeout=10 00:00:02.324 > git checkout -f 10da8f6d99838e411e4e94523ded0bfebf3e7100 # timeout=5 00:00:02.344 Commit message: "scripts/create_git_mirror: Update path to xnvme submodule" 00:00:02.344 > git rev-list --no-walk 10da8f6d99838e411e4e94523ded0bfebf3e7100 # timeout=10 00:00:02.813 [Pipeline] Start of Pipeline 00:00:02.827 [Pipeline] library 00:00:02.829 Loading library shm_lib@master 00:00:02.829 Library shm_lib@master is cached. Copying from home. 00:00:02.849 [Pipeline] node 00:00:02.853 Running on ME2 in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11 00:00:02.860 [Pipeline] { 00:00:02.874 [Pipeline] cleanWs 00:00:02.884 [WS-CLEANUP] Deleting project workspace... 00:00:02.884 [WS-CLEANUP] Deferred wipeout is used... 00:00:02.891 [WS-CLEANUP] done 00:00:02.895 [Pipeline] stage 00:00:02.899 [Pipeline] { (Prologue) 00:00:02.993 [Pipeline] withCredentials 00:00:03.004 > git --version # timeout=10 00:00:03.016 > git --version # 'git version 2.39.2' 00:00:03.035 Masking supported pattern matches of $GIT_USERNAME or $GIT_PASSWORD or $GIT_ASKPASS 00:00:03.037 [Pipeline] { 00:00:03.045 [Pipeline] retry 00:00:03.047 [Pipeline] { 00:00:03.248 [Pipeline] sh 00:00:03.530 + git ls-remote https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master 00:00:05.456 [Pipeline] } 00:00:05.478 [Pipeline] // retry 00:00:05.483 [Pipeline] } 00:00:05.504 [Pipeline] // withCredentials 00:00:05.512 [Pipeline] nodesByLabel 00:00:05.513 Found a total of 1 nodes with the 'sorcerer' label 00:00:05.525 [Pipeline] httpRequest 00:00:05.530 HttpMethod: GET 00:00:05.531 URL: http://10.211.164.101/packages/jbp_10da8f6d99838e411e4e94523ded0bfebf3e7100.tar.gz 00:00:05.531 Sending request to url: http://10.211.164.101/packages/jbp_10da8f6d99838e411e4e94523ded0bfebf3e7100.tar.gz 00:00:05.539 Response Code: HTTP/1.1 200 OK 00:00:05.540 Success: Status code 200 is in the accepted range: 200,404 00:00:05.540 Saving response body to /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/jbp_10da8f6d99838e411e4e94523ded0bfebf3e7100.tar.gz 00:00:10.936 [Pipeline] sh 00:00:11.219 + tar --no-same-owner -xf jbp_10da8f6d99838e411e4e94523ded0bfebf3e7100.tar.gz 00:00:11.240 [Pipeline] withCredentials 00:00:11.252 > git --version # timeout=10 00:00:11.264 > git --version # 'git version 2.39.2' 00:00:11.284 Masking supported pattern matches of $GIT_USERNAME or $GIT_PASSWORD or $GIT_ASKPASS 00:00:11.286 [Pipeline] { 00:00:11.294 [Pipeline] retry 00:00:11.296 [Pipeline] { 00:00:11.312 [Pipeline] sh 00:00:11.595 + git ls-remote https://review.spdk.io/gerrit/a/spdk/spdk refs/heads/master 00:00:16.896 [Pipeline] } 00:00:16.920 [Pipeline] // retry 00:00:16.926 [Pipeline] } 00:00:16.948 [Pipeline] // withCredentials 00:00:16.961 [Pipeline] httpRequest 00:00:16.965 HttpMethod: GET 00:00:16.966 URL: http://10.211.164.101/packages/spdk_4506c0c368f63ba9b9b013ecff216cef6ee8d0a4.tar.gz 00:00:16.967 Sending request to url: http://10.211.164.101/packages/spdk_4506c0c368f63ba9b9b013ecff216cef6ee8d0a4.tar.gz 00:00:16.971 Response Code: HTTP/1.1 200 OK 00:00:16.972 Success: Status code 200 is in the accepted range: 200,404 00:00:16.973 Saving response body to /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/spdk_4506c0c368f63ba9b9b013ecff216cef6ee8d0a4.tar.gz 00:00:27.217 [Pipeline] sh 00:00:27.500 + tar --no-same-owner -xf spdk_4506c0c368f63ba9b9b013ecff216cef6ee8d0a4.tar.gz 00:00:30.036 [Pipeline] sh 00:00:30.315 + git -C spdk log --oneline -n5 00:00:30.315 4506c0c36 test/common: Enable inherit_errexit 00:00:30.315 b24df7cfa test: Drop superfluous calls to print_backtrace() 00:00:30.315 7b52e4c17 test/scheduler: Meassure utime of $spdk_pid threads as a fallback 00:00:30.315 1dc065205 test/scheduler: Calculate median of the cpu load samples 00:00:30.315 b22f1b34d test/scheduler: Enhance lookup of the $old_cgroup in move_proc() 00:00:30.327 [Pipeline] sh 00:00:30.597 + git -C spdk show -s --format=%s 4506c0c368f63ba9b9b013ecff216cef6ee8d0a4 00:00:30.610 [Pipeline] setCustomBuildProperty 00:00:30.617 [Pipeline] setCustomBuildProperty 00:00:30.635 [Pipeline] withCredentials 00:00:30.642 > git --version # timeout=10 00:00:30.653 > git --version # 'git version 2.39.2' 00:00:30.664 Masking supported pattern matches of $GIT_PASSWORD or $GIT_ASKPASS 00:00:30.666 [Pipeline] { 00:00:30.674 [Pipeline] retry 00:00:30.675 [Pipeline] { 00:00:30.692 [Pipeline] sh 00:00:30.968 + git ls-remote http://dpdk.org/git/dpdk-stable v22.11.4 00:00:31.236 [Pipeline] } 00:00:31.254 [Pipeline] // retry 00:00:31.258 [Pipeline] } 00:00:31.274 [Pipeline] // withCredentials 00:00:31.285 [Pipeline] httpRequest 00:00:31.289 HttpMethod: GET 00:00:31.289 URL: http://10.211.164.101/packages/dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:00:31.290 Sending request to url: http://10.211.164.101/packages/dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:00:31.291 Response Code: HTTP/1.1 200 OK 00:00:31.291 Success: Status code 200 is in the accepted range: 200,404 00:00:31.291 Saving response body to /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:00:32.543 [Pipeline] sh 00:00:32.828 + tar --no-same-owner -xf dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:00:33.811 [Pipeline] sh 00:00:34.082 + git -C dpdk log --oneline -n5 00:00:34.082 caf0f5d395 version: 22.11.4 00:00:34.082 7d6f1cc05f Revert "net/iavf: fix abnormal disable HW interrupt" 00:00:34.082 dc9c799c7d vhost: fix missing spinlock unlock 00:00:34.082 4307659a90 net/mlx5: fix LACP redirection in Rx domain 00:00:34.082 6ef77f2a5e net/gve: fix RX buffer size alignment 00:00:34.092 [Pipeline] catchError 00:00:34.094 [Pipeline] { 00:00:34.111 [Pipeline] readJSON 00:00:34.123 [Pipeline] } 00:00:34.142 [Pipeline] // catchError 00:00:34.147 [Pipeline] } 00:00:34.169 [Pipeline] // stage 00:00:34.186 [Pipeline] catchError 00:00:34.187 [Pipeline] { 00:00:34.206 [Pipeline] stage 00:00:34.208 [Pipeline] { (Tests) 00:00:34.363 [Pipeline] parallel 00:00:34.419 [Pipeline] { (Branch: unittest-vg-autotest) 00:00:34.419 [Pipeline] { (Branch: valgrind-vg-autotest) 00:00:34.420 [Pipeline] { (Branch: autobuild-vg-autotest) 00:00:34.421 [Pipeline] { (Branch: scanbuild-vg-autotest) 00:00:34.422 [Pipeline] { (Branch: lvol-vg-autotest) 00:00:34.423 [Pipeline] { (Branch: vhost-initiator-vg-autotest) 00:00:34.424 [Pipeline] { (Branch: nvmf-tcp-vg-autotest) 00:00:34.425 [Pipeline] { (Branch: nvmf-tcp-uring-vg-autotest) 00:00:34.425 [Pipeline] { (Branch: nvme-vg-autotest) 00:00:34.426 [Pipeline] { (Branch: centos7-vg-autotest) 00:00:34.427 [Pipeline] { (Branch: rocky9-vg-autotest) 00:00:34.427 [Pipeline] { (Branch: ubuntu20-vg-autotest) 00:00:34.429 [Pipeline] { (Branch: ubuntu22-vg-autotest) 00:00:34.430 [Pipeline] { (Branch: iscsi-vg-autotest) 00:00:34.431 [Pipeline] { (Branch: iscsi-uring-vg-autotest) 00:00:34.431 [Pipeline] { (Branch: zns-vg-autotest) 00:00:34.432 [Pipeline] { (Branch: clang-vg-autotest) 00:00:34.433 [Pipeline] { (Branch: nvme-cmb-pmr-vg-autotest) 00:00:34.434 [Pipeline] { (Branch: BlobFS-phy-autotest) 00:00:34.435 [Pipeline] { (Branch: crypto-phy-autotest) 00:00:34.436 [Pipeline] { (Branch: vhost-phy-autotest) 00:00:34.438 [Pipeline] { (Branch: nvmf-phy-autotest) 00:00:34.439 [Pipeline] { (Branch: nvmf-tcp-phy-autotest) 00:00:34.439 [Pipeline] { (Branch: nvme-phy-autotest) 00:00:34.440 [Pipeline] { (Branch: vfio-user-phy-autotest) 00:00:34.441 [Pipeline] { (Branch: short-fuzz-phy-autotest) 00:00:34.442 [Pipeline] { (Branch: dsa-phy-autotest) 00:00:34.442 [Pipeline] { (Branch: vmd-phy-autotest) 00:00:34.464 [Pipeline] retry 00:00:34.465 [Pipeline] { 00:00:34.467 [Pipeline] retry 00:00:34.468 [Pipeline] { 00:00:34.471 [Pipeline] retry 00:00:34.472 [Pipeline] { 00:00:34.474 [Pipeline] retry 00:00:34.476 [Pipeline] { 00:00:34.479 [Pipeline] retry 00:00:34.480 [Pipeline] { 00:00:34.483 [Pipeline] retry 00:00:34.484 [Pipeline] { 00:00:34.486 [Pipeline] retry 00:00:34.487 [Pipeline] { 00:00:34.491 [Pipeline] retry 00:00:34.492 [Pipeline] { 00:00:34.495 [Pipeline] retry 00:00:34.496 [Pipeline] { 00:00:34.499 [Pipeline] retry 00:00:34.500 [Pipeline] { 00:00:34.502 [Pipeline] retry 00:00:34.503 [Pipeline] { 00:00:34.505 [Pipeline] retry 00:00:34.507 [Pipeline] { 00:00:34.509 [Pipeline] retry 00:00:34.510 [Pipeline] { 00:00:34.512 [Pipeline] retry 00:00:34.513 [Pipeline] { 00:00:34.515 [Pipeline] retry 00:00:34.516 [Pipeline] { 00:00:34.518 [Pipeline] retry 00:00:34.519 [Pipeline] { 00:00:34.523 [Pipeline] retry 00:00:34.524 [Pipeline] { 00:00:34.528 [Pipeline] retry 00:00:34.530 [Pipeline] { 00:00:34.532 [Pipeline] retry 00:00:34.533 [Pipeline] { 00:00:34.536 [Pipeline] retry 00:00:34.537 [Pipeline] { 00:00:34.539 [Pipeline] retry 00:00:34.540 [Pipeline] { 00:00:34.543 [Pipeline] retry 00:00:34.544 [Pipeline] { 00:00:34.546 [Pipeline] retry 00:00:34.547 [Pipeline] { 00:00:34.550 [Pipeline] retry 00:00:34.551 [Pipeline] { 00:00:34.554 [Pipeline] retry 00:00:34.555 [Pipeline] { 00:00:34.557 [Pipeline] retry 00:00:34.558 [Pipeline] { 00:00:34.561 [Pipeline] retry 00:00:34.562 [Pipeline] { 00:00:34.564 [Pipeline] retry 00:00:34.565 [Pipeline] { 00:00:34.585 [Pipeline] build 00:00:34.587 Scheduling project: unittest-vg-autotest 00:00:34.593 [Pipeline] build 00:00:34.595 Scheduling project: valgrind-vg-autotest 00:00:34.599 [Pipeline] build 00:00:34.600 Scheduling project: autobuild-vg-autotest 00:00:34.604 [Pipeline] build 00:00:34.606 Scheduling project: scanbuild-vg-autotest 00:00:34.609 [Pipeline] build 00:00:34.611 Scheduling project: lvol-vg-autotest 00:00:34.615 [Pipeline] build 00:00:34.616 Scheduling project: vhost-initiator-vg-autotest 00:00:34.620 [Pipeline] build 00:00:34.621 Scheduling project: nvmf-tcp-vg-autotest 00:00:34.625 [Pipeline] build 00:00:34.627 Scheduling project: nvmf-tcp-uring-vg-autotest 00:00:34.631 [Pipeline] build 00:00:34.633 Scheduling project: nvme-vg-autotest 00:00:34.637 [Pipeline] build 00:00:34.638 Scheduling project: centos7-vg-autotest 00:00:34.642 [Pipeline] build 00:00:34.643 Scheduling project: rocky9-vg-autotest 00:00:34.647 [Pipeline] build 00:00:34.648 Scheduling project: ubuntu20-vg-autotest 00:00:34.652 [Pipeline] build 00:00:34.653 Scheduling project: ubuntu22-vg-autotest 00:00:34.657 [Pipeline] build 00:00:34.659 Scheduling project: iscsi-vg-autotest 00:00:34.663 [Pipeline] build 00:00:34.664 Scheduling project: iscsi-uring-vg-autotest 00:00:34.668 [Pipeline] build 00:00:34.670 Scheduling project: zns-vg-autotest 00:00:34.674 [Pipeline] build 00:00:34.675 Scheduling project: clang-vg-autotest 00:00:34.679 [Pipeline] build 00:00:34.681 Scheduling project: nvme-cmb-pmr-vg-autotest 00:00:34.685 [Pipeline] build 00:00:34.686 Scheduling project: BlobFS-phy-autotest 00:00:34.691 [Pipeline] build 00:00:34.692 Scheduling project: crypto-phy-autotest 00:00:34.696 [Pipeline] build 00:00:34.698 Scheduling project: vhost-phy-autotest 00:00:34.702 [Pipeline] build 00:00:34.703 Scheduling project: nvmf-phy-autotest 00:00:34.707 [Pipeline] build 00:00:34.709 Scheduling project: nvmf-tcp-phy-autotest 00:00:34.713 [Pipeline] build 00:00:34.714 Scheduling project: nvme-phy-autotest 00:00:34.718 [Pipeline] build 00:00:34.720 Scheduling project: vfio-user-phy-autotest 00:00:34.724 [Pipeline] build 00:00:34.725 Scheduling project: short-fuzz-phy-autotest 00:00:34.729 [Pipeline] build 00:00:34.731 Scheduling project: dsa-phy-autotest 00:00:34.735 [Pipeline] build 00:00:34.736 Scheduling project: vmd-phy-autotest 00:00:40.069 Starting building: vmd-phy-autotest #2613 00:00:40.072 Starting building: vhost-phy-autotest #26169 00:00:40.074 Starting building: dsa-phy-autotest #4844 00:00:40.077 Starting building: BlobFS-phy-autotest #26150 00:00:40.079 Starting building: crypto-phy-autotest #26144 00:00:40.081 Starting building: rocky9-vg-autotest #16034 00:00:40.083 Starting building: short-fuzz-phy-autotest #26141 00:00:40.087 Starting building: ubuntu22-vg-autotest #37757 00:00:40.090 Starting building: nvme-phy-autotest #72316 00:00:40.092 Starting building: centos7-vg-autotest #73603 00:00:40.096 Starting building: nvme-cmb-pmr-vg-autotest #78547 00:00:40.097 Starting building: vfio-user-phy-autotest #26152 00:00:40.100 Starting building: nvmf-tcp-phy-autotest #72275 00:00:40.103 Starting building: vhost-initiator-vg-autotest #77444 00:00:40.105 Starting building: valgrind-vg-autotest #49186 00:00:40.115 Starting building: nvmf-phy-autotest #72388 00:00:40.119 Starting building: iscsi-vg-autotest #77462 00:00:40.121 Starting building: nvmf-tcp-uring-vg-autotest #77349 00:00:40.124 Starting building: ubuntu20-vg-autotest #73743 00:00:40.127 Starting building: autobuild-vg-autotest #63412 00:00:40.149 Starting building: scanbuild-vg-autotest #63371 00:00:40.150 Starting building: lvol-vg-autotest #77373 00:00:40.153 Starting building: zns-vg-autotest #76530 00:00:40.157 Starting building: clang-vg-autotest #57620 00:00:40.160 Starting building: nvme-vg-autotest #77424 00:00:40.163 Starting building: iscsi-uring-vg-autotest #77329 00:00:40.165 Starting building: nvmf-tcp-vg-autotest #77415 00:00:40.168 Starting building: unittest-vg-autotest #63369 00:08:19.532 Build short-fuzz-phy-autotest #26141 completed: SUCCESS 00:08:19.536 [Pipeline] } 00:08:19.582 [Pipeline] // retry 00:08:19.587 [Pipeline] } 00:11:12.780 Build dsa-phy-autotest #4844 completed: SUCCESS 00:11:12.783 [Pipeline] } 00:11:12.829 [Pipeline] // retry 00:11:12.836 [Pipeline] } 00:11:27.344 Build vhost-initiator-vg-autotest #77444 completed: SUCCESS 00:11:27.347 [Pipeline] } 00:11:27.402 [Pipeline] // retry 00:11:27.408 [Pipeline] } 00:14:13.539 Build vmd-phy-autotest #2613 completed: SUCCESS 00:14:13.542 [Pipeline] } 00:14:13.590 [Pipeline] // retry 00:14:13.597 [Pipeline] } 00:15:03.912 Build zns-vg-autotest #76530 completed: SUCCESS 00:15:03.914 [Pipeline] } 00:15:03.960 [Pipeline] // retry 00:15:03.966 [Pipeline] } 00:15:22.658 Build nvme-cmb-pmr-vg-autotest #78547 completed: SUCCESS 00:15:22.661 [Pipeline] } 00:15:22.708 [Pipeline] // retry 00:15:22.714 [Pipeline] } 00:15:31.988 Build nvme-vg-autotest #77424 completed: FAILURE 00:15:32.770 [Pipeline] echo 00:15:32.771 No retry patterns found. 00:15:32.771 [Pipeline] } 00:15:32.795 [Pipeline] // retry 00:15:32.803 [Pipeline] error 00:15:32.812 [Pipeline] } 00:15:32.819 Failed in branch nvme-vg-autotest 00:15:36.771 Build scanbuild-vg-autotest #63371 completed: SUCCESS 00:15:36.774 [Pipeline] } 00:15:36.821 [Pipeline] // retry 00:15:36.828 [Pipeline] } 00:17:15.701 Build lvol-vg-autotest #77373 completed: SUCCESS 00:17:15.703 [Pipeline] } 00:17:15.749 [Pipeline] // retry 00:17:15.754 [Pipeline] } 00:20:12.547 Build vfio-user-phy-autotest #26152 completed: SUCCESS 00:20:12.550 [Pipeline] } 00:20:12.594 [Pipeline] // retry 00:20:12.600 [Pipeline] } 00:22:18.378 Build BlobFS-phy-autotest #26150 completed: SUCCESS 00:22:18.380 [Pipeline] } 00:22:18.424 [Pipeline] // retry 00:22:18.430 [Pipeline] } 00:24:52.796 Build nvme-phy-autotest #72316 completed: SUCCESS 00:24:52.799 [Pipeline] } 00:24:52.831 [Pipeline] // retry 00:24:52.836 [Pipeline] } 00:31:07.987 Build unittest-vg-autotest #63369 completed: SUCCESS 00:31:07.989 [Pipeline] } 00:31:08.037 [Pipeline] // retry 00:31:08.043 [Pipeline] } 00:31:25.430 Build vhost-phy-autotest #26169 completed: SUCCESS 00:31:25.432 [Pipeline] } 00:31:25.475 [Pipeline] // retry 00:31:25.480 [Pipeline] } 00:31:31.991 Build centos7-vg-autotest #73603 completed: SUCCESS 00:31:31.994 [Pipeline] } 00:31:32.026 [Pipeline] // retry 00:31:32.029 [Pipeline] } 00:32:24.625 Build autobuild-vg-autotest #63412 completed: SUCCESS 00:32:24.627 [Pipeline] } 00:32:24.662 [Pipeline] // retry 00:32:24.666 [Pipeline] } 00:34:06.583 Build nvmf-tcp-uring-vg-autotest #77349 completed: SUCCESS 00:34:06.585 [Pipeline] } 00:34:06.633 [Pipeline] // retry 00:34:06.637 [Pipeline] } 00:34:44.356 Build iscsi-uring-vg-autotest #77329 completed: SUCCESS 00:34:44.358 [Pipeline] } 00:34:44.402 [Pipeline] // retry 00:34:44.408 [Pipeline] } 00:34:58.747 Build crypto-phy-autotest #26144 completed: SUCCESS 00:34:58.750 [Pipeline] } 00:34:58.793 [Pipeline] // retry 00:34:58.799 [Pipeline] } 00:38:00.499 Build nvmf-tcp-phy-autotest #72275 completed: SUCCESS 00:38:00.502 [Pipeline] } 00:38:00.548 [Pipeline] // retry 00:38:00.554 [Pipeline] } 00:39:20.803 Build nvmf-tcp-vg-autotest #77415 completed: SUCCESS 00:39:20.806 [Pipeline] } 00:39:20.849 [Pipeline] // retry 00:39:20.854 [Pipeline] } 00:40:28.260 Build iscsi-vg-autotest #77462 completed: SUCCESS 00:40:28.263 [Pipeline] } 00:40:28.308 [Pipeline] // retry 00:40:28.314 [Pipeline] } 00:40:47.249 Build clang-vg-autotest #57620 completed: SUCCESS 00:40:47.252 [Pipeline] } 00:40:47.297 [Pipeline] // retry 00:40:47.302 [Pipeline] } 00:41:43.323 Build nvmf-phy-autotest #72388 completed: ABORTED 00:41:44.857 [Pipeline] echo 00:41:44.858 No retry patterns found. 00:41:44.859 [Pipeline] } 00:41:44.888 [Pipeline] // retry 00:41:44.894 [Pipeline] error 00:41:44.899 [Pipeline] } 00:41:44.903 Failed in branch nvmf-phy-autotest 00:44:56.503 Build ubuntu20-vg-autotest #73743 completed: FAILURE 00:44:58.487 [Pipeline] echo 00:44:58.488 No retry patterns found. 00:44:58.489 [Pipeline] } 00:44:58.519 [Pipeline] // retry 00:44:58.528 [Pipeline] error 00:44:58.535 [Pipeline] } 00:44:58.541 Failed in branch ubuntu20-vg-autotest 00:46:02.114 Build valgrind-vg-autotest #49186 completed: SUCCESS 00:46:02.117 [Pipeline] } 00:46:02.166 [Pipeline] // retry 00:46:02.172 [Pipeline] } 00:47:24.961 Build rocky9-vg-autotest #16034 completed: SUCCESS 00:47:24.964 [Pipeline] } 00:47:25.005 [Pipeline] // retry 00:47:25.011 [Pipeline] } 00:54:11.012 Build ubuntu22-vg-autotest #37757 completed: SUCCESS 00:54:11.014 [Pipeline] } 00:54:11.055 [Pipeline] // retry 00:54:11.061 [Pipeline] } 00:54:11.249 [Pipeline] // parallel 00:54:11.255 [Pipeline] } 00:54:11.282 [Pipeline] // stage 00:54:11.292 [Pipeline] } 00:54:11.300 ERROR: Build nvme-vg-autotest #77424 failed 00:54:11.324 [Pipeline] // catchError 00:54:11.333 [Pipeline] stage 00:54:11.335 [Pipeline] { (Autorun Post and Coverage) 00:54:11.363 [Pipeline] setCustomBuildProperty 00:54:11.862 [Pipeline] dir 00:54:11.862 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/short-fuzz-phy-autotest_26141 00:54:11.864 [Pipeline] { 00:54:11.909 [Pipeline] copyArtifacts 00:54:12.018 Copied 10 artifacts from "short-fuzz-phy-autotest" build number 26141 00:54:12.021 [Pipeline] writeFile 00:54:12.217 [Pipeline] } 00:54:12.319 [Pipeline] // dir 00:54:12.692 [Pipeline] dir 00:54:12.692 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/dsa-phy-autotest_4844 00:54:12.693 [Pipeline] { 00:54:12.725 [Pipeline] copyArtifacts 00:54:12.943 Copied 12 artifacts from "dsa-phy-autotest" build number 4844 00:54:12.946 [Pipeline] writeFile 00:54:13.082 [Pipeline] } 00:54:13.150 [Pipeline] // dir 00:54:13.442 [Pipeline] dir 00:54:13.442 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vhost-initiator-vg-autotest_77444 00:54:13.443 [Pipeline] { 00:54:13.476 [Pipeline] copyArtifacts 00:54:13.769 Copied 15 artifacts from "vhost-initiator-vg-autotest" build number 77444 00:54:13.774 [Pipeline] writeFile 00:54:13.921 [Pipeline] } 00:54:13.997 [Pipeline] // dir 00:54:14.323 [Pipeline] dir 00:54:14.323 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vmd-phy-autotest_2613 00:54:14.324 [Pipeline] { 00:54:14.361 [Pipeline] copyArtifacts 00:54:14.577 Copied 12 artifacts from "vmd-phy-autotest" build number 2613 00:54:14.583 [Pipeline] writeFile 00:54:14.712 [Pipeline] } 00:54:14.808 [Pipeline] // dir 00:54:15.133 [Pipeline] dir 00:54:15.134 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/zns-vg-autotest_76530 00:54:15.135 [Pipeline] { 00:54:15.173 [Pipeline] copyArtifacts 00:54:15.397 Copied 12 artifacts from "zns-vg-autotest" build number 76530 00:54:15.402 [Pipeline] writeFile 00:54:15.556 [Pipeline] } 00:54:15.656 [Pipeline] // dir 00:54:16.045 [Pipeline] dir 00:54:16.045 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-cmb-pmr-vg-autotest_78547 00:54:16.046 [Pipeline] { 00:54:16.092 [Pipeline] copyArtifacts 00:54:16.315 Copied 12 artifacts from "nvme-cmb-pmr-vg-autotest" build number 78547 00:54:16.318 [Pipeline] writeFile 00:54:16.498 [Pipeline] } 00:54:16.606 [Pipeline] // dir 00:54:17.130 [Pipeline] dir 00:54:17.130 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-vg-autotest_77424 00:54:17.131 [Pipeline] { 00:54:17.178 [Pipeline] copyArtifacts 00:54:17.733 Copied 11 artifacts from "nvme-vg-autotest" build number 77424 00:54:17.737 [Pipeline] writeFile 00:54:17.962 [Pipeline] } 00:54:18.111 [Pipeline] // dir 00:54:18.228 [Pipeline] dir 00:54:18.229 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/scanbuild-vg-autotest_63371 00:54:18.230 [Pipeline] { 00:54:18.256 [Pipeline] copyArtifacts 00:54:18.848 Copied 13 artifacts from "scanbuild-vg-autotest" build number 63371 00:54:18.852 [Pipeline] writeFile 00:54:18.912 [Pipeline] } 00:54:18.941 [Pipeline] // dir 00:54:19.484 [Pipeline] dir 00:54:19.484 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/lvol-vg-autotest_77373 00:54:19.485 [Pipeline] { 00:54:19.540 [Pipeline] copyArtifacts 00:54:19.723 Copied 12 artifacts from "lvol-vg-autotest" build number 77373 00:54:19.727 [Pipeline] writeFile 00:54:20.038 [Pipeline] } 00:54:20.181 [Pipeline] // dir 00:54:20.647 [Pipeline] dir 00:54:20.647 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vfio-user-phy-autotest_26152 00:54:20.648 [Pipeline] { 00:54:20.700 [Pipeline] copyArtifacts 00:54:20.890 Copied 12 artifacts from "vfio-user-phy-autotest" build number 26152 00:54:20.895 [Pipeline] writeFile 00:54:21.096 [Pipeline] } 00:54:21.232 [Pipeline] // dir 00:54:21.553 [Pipeline] dir 00:54:21.553 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/BlobFS-phy-autotest_26150 00:54:21.554 [Pipeline] { 00:54:21.593 [Pipeline] copyArtifacts 00:54:21.979 Copied 28 artifacts from "BlobFS-phy-autotest" build number 26150 00:54:21.983 [Pipeline] writeFile 00:54:22.114 [Pipeline] } 00:54:22.214 [Pipeline] // dir 00:54:22.784 [Pipeline] dir 00:54:22.784 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-phy-autotest_72316 00:54:22.785 [Pipeline] { 00:54:22.834 [Pipeline] copyArtifacts 00:54:23.107 Copied 12 artifacts from "nvme-phy-autotest" build number 72316 00:54:23.110 [Pipeline] writeFile 00:54:23.404 [Pipeline] } 00:54:23.516 [Pipeline] // dir 00:54:23.771 [Pipeline] dir 00:54:23.772 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/unittest-vg-autotest_63369 00:54:23.773 [Pipeline] { 00:54:23.807 [Pipeline] copyArtifacts 00:54:24.203 Copied 13 artifacts from "unittest-vg-autotest" build number 63369 00:54:24.208 [Pipeline] writeFile 00:54:24.332 [Pipeline] } 00:54:24.438 [Pipeline] // dir 00:54:25.059 [Pipeline] dir 00:54:25.060 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vhost-phy-autotest_26169 00:54:25.061 [Pipeline] { 00:54:25.116 [Pipeline] copyArtifacts 00:54:25.375 Copied 13 artifacts from "vhost-phy-autotest" build number 26169 00:54:25.380 [Pipeline] writeFile 00:54:25.662 [Pipeline] } 00:54:25.826 [Pipeline] // dir 00:54:26.718 [Pipeline] dir 00:54:26.718 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/centos7-vg-autotest_73603 00:54:26.719 [Pipeline] { 00:54:26.777 [Pipeline] copyArtifacts 00:54:27.138 Copied 13 artifacts from "centos7-vg-autotest" build number 73603 00:54:27.142 [Pipeline] writeFile 00:54:27.526 [Pipeline] } 00:54:27.728 [Pipeline] // dir 00:54:27.917 [Pipeline] dir 00:54:27.917 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/autobuild-vg-autotest_63412 00:54:27.919 [Pipeline] { 00:54:27.950 [Pipeline] copyArtifacts 00:54:28.192 Copied 9 artifacts from "autobuild-vg-autotest" build number 63412 00:54:28.197 [Pipeline] writeFile 00:54:28.269 [Pipeline] } 00:54:28.334 [Pipeline] // dir 00:54:29.226 [Pipeline] dir 00:54:29.227 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-uring-vg-autotest_77349 00:54:29.228 [Pipeline] { 00:54:29.305 [Pipeline] copyArtifacts 00:54:29.529 Copied 14 artifacts from "nvmf-tcp-uring-vg-autotest" build number 77349 00:54:29.532 [Pipeline] writeFile 00:54:29.952 [Pipeline] } 00:54:30.102 [Pipeline] // dir 00:54:31.890 [Pipeline] dir 00:54:31.890 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/iscsi-uring-vg-autotest_77329 00:54:31.891 [Pipeline] { 00:54:32.060 [Pipeline] copyArtifacts 00:54:35.126 Copied 17 artifacts from "iscsi-uring-vg-autotest" build number 77329 00:54:35.130 [Pipeline] writeFile 00:54:36.260 [Pipeline] } 00:54:36.757 [Pipeline] // dir 00:54:38.154 [Pipeline] dir 00:54:38.155 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/crypto-phy-autotest_26144 00:54:38.156 [Pipeline] { 00:54:38.251 [Pipeline] copyArtifacts 00:54:38.444 Copied 12 artifacts from "crypto-phy-autotest" build number 26144 00:54:38.448 [Pipeline] writeFile 00:54:39.097 [Pipeline] } 00:54:39.387 [Pipeline] // dir 00:54:40.806 [Pipeline] dir 00:54:40.806 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-phy-autotest_72275 00:54:40.808 [Pipeline] { 00:54:40.912 [Pipeline] copyArtifacts 00:54:41.211 Copied 14 artifacts from "nvmf-tcp-phy-autotest" build number 72275 00:54:41.215 [Pipeline] writeFile 00:54:41.805 [Pipeline] } 00:54:42.068 [Pipeline] // dir 00:54:42.915 [Pipeline] dir 00:54:42.916 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-vg-autotest_77415 00:54:42.916 [Pipeline] { 00:54:42.991 [Pipeline] copyArtifacts 00:54:43.206 Copied 14 artifacts from "nvmf-tcp-vg-autotest" build number 77415 00:54:43.211 [Pipeline] writeFile 00:54:43.648 [Pipeline] } 00:54:43.885 [Pipeline] // dir 00:54:45.847 [Pipeline] dir 00:54:45.848 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/iscsi-vg-autotest_77462 00:54:45.849 [Pipeline] { 00:54:46.017 [Pipeline] copyArtifacts 00:54:48.580 Copied 17 artifacts from "iscsi-vg-autotest" build number 77462 00:54:48.584 [Pipeline] writeFile 00:54:49.774 [Pipeline] } 00:54:50.207 [Pipeline] // dir 00:54:50.495 [Pipeline] dir 00:54:50.495 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/clang-vg-autotest_57620 00:54:50.496 [Pipeline] { 00:54:50.562 [Pipeline] copyArtifacts 00:54:50.663 Copied 10 artifacts from "clang-vg-autotest" build number 57620 00:54:50.667 [Pipeline] writeFile 00:54:50.809 [Pipeline] } 00:54:50.899 [Pipeline] // dir 00:54:51.789 [Pipeline] dir 00:54:51.789 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-phy-autotest_72388 00:54:51.790 [Pipeline] { 00:54:51.850 [Pipeline] copyArtifacts 00:54:52.505 Copied 12 artifacts from "nvmf-phy-autotest" build number 72388 00:54:52.510 [Pipeline] writeFile 00:54:52.946 [Pipeline] } 00:54:53.157 [Pipeline] // dir 00:54:54.504 [Pipeline] dir 00:54:54.504 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/ubuntu20-vg-autotest_73743 00:54:54.505 [Pipeline] { 00:54:54.600 [Pipeline] copyArtifacts 00:54:55.341 Copied 12 artifacts from "ubuntu20-vg-autotest" build number 73743 00:54:55.345 [Pipeline] writeFile 00:54:55.879 [Pipeline] } 00:54:56.163 [Pipeline] // dir 00:54:56.793 [Pipeline] dir 00:54:56.794 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/valgrind-vg-autotest_49186 00:54:56.795 [Pipeline] { 00:54:56.858 [Pipeline] copyArtifacts 00:54:57.276 Copied 14 artifacts from "valgrind-vg-autotest" build number 49186 00:54:57.281 [Pipeline] writeFile 00:54:57.636 [Pipeline] } 00:54:57.790 [Pipeline] // dir 00:54:59.045 [Pipeline] dir 00:54:59.045 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/rocky9-vg-autotest_16034 00:54:59.046 [Pipeline] { 00:54:59.153 [Pipeline] copyArtifacts 00:54:59.544 Copied 13 artifacts from "rocky9-vg-autotest" build number 16034 00:54:59.548 [Pipeline] writeFile 00:55:00.112 [Pipeline] } 00:55:00.355 [Pipeline] // dir 00:55:01.529 [Pipeline] dir 00:55:01.530 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/ubuntu22-vg-autotest_37757 00:55:01.530 [Pipeline] { 00:55:01.623 [Pipeline] copyArtifacts 00:55:01.968 Copied 13 artifacts from "ubuntu22-vg-autotest" build number 37757 00:55:01.973 [Pipeline] writeFile 00:55:02.432 [Pipeline] } 00:55:02.675 [Pipeline] // dir 00:55:02.684 [Pipeline] catchError 00:55:02.686 [Pipeline] { 00:55:02.710 [Pipeline] sh 00:55:02.986 + jbp/jenkins/jjb-config/jobs/scripts/post_gen_coverage.sh 00:55:02.987 + shopt -s globstar nullglob 00:55:02.987 + echo 'Start stage post_gen_coverage.sh' 00:55:02.987 Start stage post_gen_coverage.sh 00:55:02.987 + cd /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11 00:55:02.987 + rm -rf /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/spdk/doc 00:55:02.987 + trap 'compress_coverage_and_docs; remove_partial_coverage_files && echo '\''End stage post_gen_coverage.sh'\''' EXIT 00:55:02.987 + move_artifacts 00:55:02.987 + local out_dirs 00:55:02.987 + out_dirs=(./**/output/) 00:55:02.987 + for dir in "${out_dirs[@]}" 00:55:02.987 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:02.987 + [[ -f ./autobuild-vg-autotest_63412/output//doc.tar.xz ]] 00:55:02.987 + tar -C ./autobuild-vg-autotest_63412/output/ -xf ./autobuild-vg-autotest_63412/output//doc.tar.xz 00:55:03.244 + rm ./autobuild-vg-autotest_63412/output//doc.tar.xz 00:55:03.244 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.244 + [[ -f ./autobuild-vg-autotest_63412/output//ut_coverage.tar.xz ]] 00:55:03.244 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.244 + [[ -f ./autobuild-vg-autotest_63412/output//llvm.tar.xz ]] 00:55:03.244 + mv ./autobuild-vg-autotest_63412/output//build-pkg-manifest.txt ./autobuild-vg-autotest_63412/output//build-repo-manifest.txt ./autobuild-vg-autotest_63412/output//dmesg.init.log ./autobuild-vg-autotest_63412/output//dmesg.log ./autobuild-vg-autotest_63412/output//doc ./autobuild-vg-autotest_63412/output//power.tar.xz ./autobuild-vg-autotest_63412/output//test_completions.txt ./autobuild-vg-autotest_63412/output//timing.svg ./autobuild-vg-autotest_63412/output//timing.txt ./autobuild-vg-autotest_63412/output//.. 00:55:03.244 + rmdir ./autobuild-vg-autotest_63412/output/ 00:55:03.244 + for dir in "${out_dirs[@]}" 00:55:03.244 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.244 + [[ -f ./BlobFS-phy-autotest_26150/output//doc.tar.xz ]] 00:55:03.244 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.244 + [[ -f ./BlobFS-phy-autotest_26150/output//ut_coverage.tar.xz ]] 00:55:03.244 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.244 + [[ -f ./BlobFS-phy-autotest_26150/output//llvm.tar.xz ]] 00:55:03.244 + mv ./BlobFS-phy-autotest_26150/output//all_tests.txt ./BlobFS-phy-autotest_26150/output//build-pkg-manifest.txt ./BlobFS-phy-autotest_26150/output//build-repo-manifest.txt ./BlobFS-phy-autotest_26150/output//cov_base.info.xz ./BlobFS-phy-autotest_26150/output//cov_test.info.xz ./BlobFS-phy-autotest_26150/output//cov_total.info.xz ./BlobFS-phy-autotest_26150/output//dmesg.init.log ./BlobFS-phy-autotest_26150/output//dmesg.log ./BlobFS-phy-autotest_26150/output//power.tar.xz ./BlobFS-phy-autotest_26150/output//rocksdb ./BlobFS-phy-autotest_26150/output//test_completions.txt ./BlobFS-phy-autotest_26150/output//timing.svg ./BlobFS-phy-autotest_26150/output//timing.txt ./BlobFS-phy-autotest_26150/output//.. 00:55:03.244 + rmdir ./BlobFS-phy-autotest_26150/output/ 00:55:03.244 + for dir in "${out_dirs[@]}" 00:55:03.244 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.244 + [[ -f ./centos7-vg-autotest_73603/output//doc.tar.xz ]] 00:55:03.244 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.244 + [[ -f ./centos7-vg-autotest_73603/output//ut_coverage.tar.xz ]] 00:55:03.244 + tar -C ./centos7-vg-autotest_73603/output/ -xf ./centos7-vg-autotest_73603/output//ut_coverage.tar.xz 00:55:03.503 + rm ./centos7-vg-autotest_73603/output//ut_coverage.tar.xz 00:55:03.503 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.503 + [[ -f ./centos7-vg-autotest_73603/output//llvm.tar.xz ]] 00:55:03.503 + mv ./centos7-vg-autotest_73603/output//all_tests.txt ./centos7-vg-autotest_73603/output//build-pkg-manifest.txt ./centos7-vg-autotest_73603/output//build-repo-manifest.txt ./centos7-vg-autotest_73603/output//cov_base.info.xz ./centos7-vg-autotest_73603/output//cov_test.info.xz ./centos7-vg-autotest_73603/output//cov_total.info.xz ./centos7-vg-autotest_73603/output//dmesg.init.log ./centos7-vg-autotest_73603/output//dmesg.log ./centos7-vg-autotest_73603/output//power.tar.xz ./centos7-vg-autotest_73603/output//test_completions.txt ./centos7-vg-autotest_73603/output//timing.svg ./centos7-vg-autotest_73603/output//timing.txt ./centos7-vg-autotest_73603/output//ut_coverage ./centos7-vg-autotest_73603/output//.. 00:55:03.503 + rmdir ./centos7-vg-autotest_73603/output/ 00:55:03.503 + for dir in "${out_dirs[@]}" 00:55:03.503 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.503 + [[ -f ./clang-vg-autotest_57620/output//doc.tar.xz ]] 00:55:03.503 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.503 + [[ -f ./clang-vg-autotest_57620/output//ut_coverage.tar.xz ]] 00:55:03.503 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.503 + [[ -f ./clang-vg-autotest_57620/output//llvm.tar.xz ]] 00:55:03.503 + mv ./clang-vg-autotest_57620/output//all_tests.txt ./clang-vg-autotest_57620/output//build-kernel-manifest.txt ./clang-vg-autotest_57620/output//build-pkg-manifest.txt ./clang-vg-autotest_57620/output//build-repo-manifest.txt ./clang-vg-autotest_57620/output//dmesg.init.log ./clang-vg-autotest_57620/output//dmesg.log ./clang-vg-autotest_57620/output//power.tar.xz ./clang-vg-autotest_57620/output//test_completions.txt ./clang-vg-autotest_57620/output//timing.svg ./clang-vg-autotest_57620/output//timing.txt ./clang-vg-autotest_57620/output//.. 00:55:03.503 + rmdir ./clang-vg-autotest_57620/output/ 00:55:03.503 + for dir in "${out_dirs[@]}" 00:55:03.503 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.503 + [[ -f ./crypto-phy-autotest_26144/output//doc.tar.xz ]] 00:55:03.503 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.503 + [[ -f ./crypto-phy-autotest_26144/output//ut_coverage.tar.xz ]] 00:55:03.503 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.503 + [[ -f ./crypto-phy-autotest_26144/output//llvm.tar.xz ]] 00:55:03.503 + mv ./crypto-phy-autotest_26144/output//all_tests.txt ./crypto-phy-autotest_26144/output//build-pkg-manifest.txt ./crypto-phy-autotest_26144/output//build-repo-manifest.txt ./crypto-phy-autotest_26144/output//cov_base.info.xz ./crypto-phy-autotest_26144/output//cov_test.info.xz ./crypto-phy-autotest_26144/output//cov_total.info.xz ./crypto-phy-autotest_26144/output//dmesg.init.log ./crypto-phy-autotest_26144/output//dmesg.log ./crypto-phy-autotest_26144/output//power.tar.xz ./crypto-phy-autotest_26144/output//test_completions.txt ./crypto-phy-autotest_26144/output//timing.svg ./crypto-phy-autotest_26144/output//timing.txt ./crypto-phy-autotest_26144/output//.. 00:55:03.503 + rmdir ./crypto-phy-autotest_26144/output/ 00:55:03.503 + for dir in "${out_dirs[@]}" 00:55:03.503 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.503 + [[ -f ./dsa-phy-autotest_4844/output//doc.tar.xz ]] 00:55:03.503 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.503 + [[ -f ./dsa-phy-autotest_4844/output//ut_coverage.tar.xz ]] 00:55:03.503 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.503 + [[ -f ./dsa-phy-autotest_4844/output//llvm.tar.xz ]] 00:55:03.503 + mv ./dsa-phy-autotest_4844/output//all_tests.txt ./dsa-phy-autotest_4844/output//build-pkg-manifest.txt ./dsa-phy-autotest_4844/output//build-repo-manifest.txt ./dsa-phy-autotest_4844/output//cov_base.info.xz ./dsa-phy-autotest_4844/output//cov_test.info.xz ./dsa-phy-autotest_4844/output//cov_total.info.xz ./dsa-phy-autotest_4844/output//dmesg.init.log ./dsa-phy-autotest_4844/output//dmesg.log ./dsa-phy-autotest_4844/output//power.tar.xz ./dsa-phy-autotest_4844/output//test_completions.txt ./dsa-phy-autotest_4844/output//timing.svg ./dsa-phy-autotest_4844/output//timing.txt ./dsa-phy-autotest_4844/output//.. 00:55:03.503 + rmdir ./dsa-phy-autotest_4844/output/ 00:55:03.503 + for dir in "${out_dirs[@]}" 00:55:03.503 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.503 + [[ -f ./iscsi-uring-vg-autotest_77329/output//doc.tar.xz ]] 00:55:03.503 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.503 + [[ -f ./iscsi-uring-vg-autotest_77329/output//ut_coverage.tar.xz ]] 00:55:03.503 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.503 + [[ -f ./iscsi-uring-vg-autotest_77329/output//llvm.tar.xz ]] 00:55:03.503 + mv ./iscsi-uring-vg-autotest_77329/output//all_tests.txt ./iscsi-uring-vg-autotest_77329/output//build-kernel-manifest.txt ./iscsi-uring-vg-autotest_77329/output//build-pkg-manifest.txt ./iscsi-uring-vg-autotest_77329/output//build-repo-manifest.txt ./iscsi-uring-vg-autotest_77329/output//calsoft.json ./iscsi-uring-vg-autotest_77329/output//calsoft.tar.xz ./iscsi-uring-vg-autotest_77329/output//cov_base.info.xz ./iscsi-uring-vg-autotest_77329/output//cov_test.info.xz ./iscsi-uring-vg-autotest_77329/output//cov_total.info.xz ./iscsi-uring-vg-autotest_77329/output//dmesg.init.log ./iscsi-uring-vg-autotest_77329/output//dmesg.log ./iscsi-uring-vg-autotest_77329/output//iscsi_autofuzz_logs.txt ./iscsi-uring-vg-autotest_77329/output//iscsi_autofuzz_tgt_output.txt ./iscsi-uring-vg-autotest_77329/output//power.tar.xz ./iscsi-uring-vg-autotest_77329/output//test_completions.txt ./iscsi-uring-vg-autotest_77329/output//timing.svg ./iscsi-uring-vg-autotest_77329/output//timing.txt ./iscsi-uring-vg-autotest_77329/output//.. 00:55:03.503 + rmdir ./iscsi-uring-vg-autotest_77329/output/ 00:55:03.503 + for dir in "${out_dirs[@]}" 00:55:03.503 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.503 + [[ -f ./iscsi-vg-autotest_77462/output//doc.tar.xz ]] 00:55:03.503 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.503 + [[ -f ./iscsi-vg-autotest_77462/output//ut_coverage.tar.xz ]] 00:55:03.503 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.503 + [[ -f ./iscsi-vg-autotest_77462/output//llvm.tar.xz ]] 00:55:03.503 + mv ./iscsi-vg-autotest_77462/output//all_tests.txt ./iscsi-vg-autotest_77462/output//build-kernel-manifest.txt ./iscsi-vg-autotest_77462/output//build-pkg-manifest.txt ./iscsi-vg-autotest_77462/output//build-repo-manifest.txt ./iscsi-vg-autotest_77462/output//calsoft.json ./iscsi-vg-autotest_77462/output//calsoft.tar.xz ./iscsi-vg-autotest_77462/output//cov_base.info.xz ./iscsi-vg-autotest_77462/output//cov_test.info.xz ./iscsi-vg-autotest_77462/output//cov_total.info.xz ./iscsi-vg-autotest_77462/output//dmesg.init.log ./iscsi-vg-autotest_77462/output//dmesg.log ./iscsi-vg-autotest_77462/output//iscsi_autofuzz_logs.txt ./iscsi-vg-autotest_77462/output//iscsi_autofuzz_tgt_output.txt ./iscsi-vg-autotest_77462/output//power.tar.xz ./iscsi-vg-autotest_77462/output//test_completions.txt ./iscsi-vg-autotest_77462/output//timing.svg ./iscsi-vg-autotest_77462/output//timing.txt ./iscsi-vg-autotest_77462/output//.. 00:55:03.503 + rmdir ./iscsi-vg-autotest_77462/output/ 00:55:03.503 + for dir in "${out_dirs[@]}" 00:55:03.503 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.503 + [[ -f ./lvol-vg-autotest_77373/output//doc.tar.xz ]] 00:55:03.503 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.503 + [[ -f ./lvol-vg-autotest_77373/output//ut_coverage.tar.xz ]] 00:55:03.503 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.503 + [[ -f ./lvol-vg-autotest_77373/output//llvm.tar.xz ]] 00:55:03.503 + mv ./lvol-vg-autotest_77373/output//all_tests.txt ./lvol-vg-autotest_77373/output//build-pkg-manifest.txt ./lvol-vg-autotest_77373/output//build-repo-manifest.txt ./lvol-vg-autotest_77373/output//cov_base.info.xz ./lvol-vg-autotest_77373/output//cov_test.info.xz ./lvol-vg-autotest_77373/output//cov_total.info.xz ./lvol-vg-autotest_77373/output//dmesg.init.log ./lvol-vg-autotest_77373/output//dmesg.log ./lvol-vg-autotest_77373/output//power.tar.xz ./lvol-vg-autotest_77373/output//test_completions.txt ./lvol-vg-autotest_77373/output//timing.svg ./lvol-vg-autotest_77373/output//timing.txt ./lvol-vg-autotest_77373/output//.. 00:55:03.503 + rmdir ./lvol-vg-autotest_77373/output/ 00:55:03.503 + for dir in "${out_dirs[@]}" 00:55:03.503 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.503 + [[ -f ./nvme-cmb-pmr-vg-autotest_78547/output//doc.tar.xz ]] 00:55:03.503 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.503 + [[ -f ./nvme-cmb-pmr-vg-autotest_78547/output//ut_coverage.tar.xz ]] 00:55:03.503 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.503 + [[ -f ./nvme-cmb-pmr-vg-autotest_78547/output//llvm.tar.xz ]] 00:55:03.504 + mv ./nvme-cmb-pmr-vg-autotest_78547/output//all_tests.txt ./nvme-cmb-pmr-vg-autotest_78547/output//build-pkg-manifest.txt ./nvme-cmb-pmr-vg-autotest_78547/output//build-repo-manifest.txt ./nvme-cmb-pmr-vg-autotest_78547/output//cov_base.info.xz ./nvme-cmb-pmr-vg-autotest_78547/output//cov_test.info.xz ./nvme-cmb-pmr-vg-autotest_78547/output//cov_total.info.xz ./nvme-cmb-pmr-vg-autotest_78547/output//dmesg.init.log ./nvme-cmb-pmr-vg-autotest_78547/output//dmesg.log ./nvme-cmb-pmr-vg-autotest_78547/output//power.tar.xz ./nvme-cmb-pmr-vg-autotest_78547/output//test_completions.txt ./nvme-cmb-pmr-vg-autotest_78547/output//timing.svg ./nvme-cmb-pmr-vg-autotest_78547/output//timing.txt ./nvme-cmb-pmr-vg-autotest_78547/output//.. 00:55:03.504 + rmdir ./nvme-cmb-pmr-vg-autotest_78547/output/ 00:55:03.504 + for dir in "${out_dirs[@]}" 00:55:03.504 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.504 + [[ -f ./nvme-phy-autotest_72316/output//doc.tar.xz ]] 00:55:03.504 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.504 + [[ -f ./nvme-phy-autotest_72316/output//ut_coverage.tar.xz ]] 00:55:03.504 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.504 + [[ -f ./nvme-phy-autotest_72316/output//llvm.tar.xz ]] 00:55:03.504 + mv ./nvme-phy-autotest_72316/output//all_tests.txt ./nvme-phy-autotest_72316/output//build-pkg-manifest.txt ./nvme-phy-autotest_72316/output//build-repo-manifest.txt ./nvme-phy-autotest_72316/output//cov_base.info.xz ./nvme-phy-autotest_72316/output//cov_test.info.xz ./nvme-phy-autotest_72316/output//cov_total.info.xz ./nvme-phy-autotest_72316/output//dmesg.init.log ./nvme-phy-autotest_72316/output//dmesg.log ./nvme-phy-autotest_72316/output//power.tar.xz ./nvme-phy-autotest_72316/output//test_completions.txt ./nvme-phy-autotest_72316/output//timing.svg ./nvme-phy-autotest_72316/output//timing.txt ./nvme-phy-autotest_72316/output//.. 00:55:03.504 + rmdir ./nvme-phy-autotest_72316/output/ 00:55:03.504 + for dir in "${out_dirs[@]}" 00:55:03.504 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.504 + [[ -f ./nvme-vg-autotest_77424/output//doc.tar.xz ]] 00:55:03.504 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.504 + [[ -f ./nvme-vg-autotest_77424/output//ut_coverage.tar.xz ]] 00:55:03.504 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.504 + [[ -f ./nvme-vg-autotest_77424/output//llvm.tar.xz ]] 00:55:03.504 + mv ./nvme-vg-autotest_77424/output//all_tests.txt ./nvme-vg-autotest_77424/output//build-pkg-manifest.txt ./nvme-vg-autotest_77424/output//build-repo-manifest.txt ./nvme-vg-autotest_77424/output//cov_base.info.xz ./nvme-vg-autotest_77424/output//dmesg.init.log ./nvme-vg-autotest_77424/output//dmesg.log ./nvme-vg-autotest_77424/output//power.tar.xz ./nvme-vg-autotest_77424/output//proc_list.txt ./nvme-vg-autotest_77424/output//test_completions.txt ./nvme-vg-autotest_77424/output//timing.txt ./nvme-vg-autotest_77424/output//udev.log ./nvme-vg-autotest_77424/output//.. 00:55:03.504 + rmdir ./nvme-vg-autotest_77424/output/ 00:55:03.504 + for dir in "${out_dirs[@]}" 00:55:03.504 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.504 + [[ -f ./nvmf-phy-autotest_72388/output//doc.tar.xz ]] 00:55:03.504 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.504 + [[ -f ./nvmf-phy-autotest_72388/output//ut_coverage.tar.xz ]] 00:55:03.504 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.504 + [[ -f ./nvmf-phy-autotest_72388/output//llvm.tar.xz ]] 00:55:03.504 + mv ./nvmf-phy-autotest_72388/output//all_tests.txt ./nvmf-phy-autotest_72388/output//build-pkg-manifest.txt ./nvmf-phy-autotest_72388/output//build-repo-manifest.txt ./nvmf-phy-autotest_72388/output//cov_base.info.xz ./nvmf-phy-autotest_72388/output//dmesg.init.log ./nvmf-phy-autotest_72388/output//dmesg.log ./nvmf-phy-autotest_72388/output//nvmf_fuzz_tgt_output.txt ./nvmf-phy-autotest_72388/output//nvmf_trace.0_shm.tar.gz ./nvmf-phy-autotest_72388/output//power.tar.xz ./nvmf-phy-autotest_72388/output//test_completions.txt ./nvmf-phy-autotest_72388/output//timing.txt ./nvmf-phy-autotest_72388/output//udev.log ./nvmf-phy-autotest_72388/output//.. 00:55:03.504 + rmdir ./nvmf-phy-autotest_72388/output/ 00:55:03.504 + for dir in "${out_dirs[@]}" 00:55:03.504 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.504 + [[ -f ./nvmf-tcp-phy-autotest_72275/output//doc.tar.xz ]] 00:55:03.504 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.504 + [[ -f ./nvmf-tcp-phy-autotest_72275/output//ut_coverage.tar.xz ]] 00:55:03.504 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.504 + [[ -f ./nvmf-tcp-phy-autotest_72275/output//llvm.tar.xz ]] 00:55:03.504 + mv ./nvmf-tcp-phy-autotest_72275/output//all_tests.txt ./nvmf-tcp-phy-autotest_72275/output//build-pkg-manifest.txt ./nvmf-tcp-phy-autotest_72275/output//build-repo-manifest.txt ./nvmf-tcp-phy-autotest_72275/output//cov_base.info.xz ./nvmf-tcp-phy-autotest_72275/output//cov_test.info.xz ./nvmf-tcp-phy-autotest_72275/output//cov_total.info.xz ./nvmf-tcp-phy-autotest_72275/output//dmesg.init.log ./nvmf-tcp-phy-autotest_72275/output//dmesg.log ./nvmf-tcp-phy-autotest_72275/output//nvmf_fuzz_tgt_output.txt ./nvmf-tcp-phy-autotest_72275/output//nvmf_trace.0_shm.tar.gz ./nvmf-tcp-phy-autotest_72275/output//power.tar.xz ./nvmf-tcp-phy-autotest_72275/output//test_completions.txt ./nvmf-tcp-phy-autotest_72275/output//timing.svg ./nvmf-tcp-phy-autotest_72275/output//timing.txt ./nvmf-tcp-phy-autotest_72275/output//.. 00:55:03.504 + rmdir ./nvmf-tcp-phy-autotest_72275/output/ 00:55:03.504 + for dir in "${out_dirs[@]}" 00:55:03.504 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.504 + [[ -f ./nvmf-tcp-uring-vg-autotest_77349/output//doc.tar.xz ]] 00:55:03.504 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.504 + [[ -f ./nvmf-tcp-uring-vg-autotest_77349/output//ut_coverage.tar.xz ]] 00:55:03.504 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.504 + [[ -f ./nvmf-tcp-uring-vg-autotest_77349/output//llvm.tar.xz ]] 00:55:03.504 + mv ./nvmf-tcp-uring-vg-autotest_77349/output//all_tests.txt ./nvmf-tcp-uring-vg-autotest_77349/output//build-pkg-manifest.txt ./nvmf-tcp-uring-vg-autotest_77349/output//build-repo-manifest.txt ./nvmf-tcp-uring-vg-autotest_77349/output//cov_base.info.xz ./nvmf-tcp-uring-vg-autotest_77349/output//cov_test.info.xz ./nvmf-tcp-uring-vg-autotest_77349/output//cov_total.info.xz ./nvmf-tcp-uring-vg-autotest_77349/output//dmesg.init.log ./nvmf-tcp-uring-vg-autotest_77349/output//dmesg.log ./nvmf-tcp-uring-vg-autotest_77349/output//nvmf_fuzz_tgt_output.txt ./nvmf-tcp-uring-vg-autotest_77349/output//nvmf_trace.0_shm.tar.gz ./nvmf-tcp-uring-vg-autotest_77349/output//power.tar.xz ./nvmf-tcp-uring-vg-autotest_77349/output//test_completions.txt ./nvmf-tcp-uring-vg-autotest_77349/output//timing.svg ./nvmf-tcp-uring-vg-autotest_77349/output//timing.txt ./nvmf-tcp-uring-vg-autotest_77349/output//.. 00:55:03.504 + rmdir ./nvmf-tcp-uring-vg-autotest_77349/output/ 00:55:03.504 + for dir in "${out_dirs[@]}" 00:55:03.504 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.504 + [[ -f ./nvmf-tcp-vg-autotest_77415/output//doc.tar.xz ]] 00:55:03.504 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.504 + [[ -f ./nvmf-tcp-vg-autotest_77415/output//ut_coverage.tar.xz ]] 00:55:03.504 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.504 + [[ -f ./nvmf-tcp-vg-autotest_77415/output//llvm.tar.xz ]] 00:55:03.504 + mv ./nvmf-tcp-vg-autotest_77415/output//all_tests.txt ./nvmf-tcp-vg-autotest_77415/output//build-pkg-manifest.txt ./nvmf-tcp-vg-autotest_77415/output//build-repo-manifest.txt ./nvmf-tcp-vg-autotest_77415/output//cov_base.info.xz ./nvmf-tcp-vg-autotest_77415/output//cov_test.info.xz ./nvmf-tcp-vg-autotest_77415/output//cov_total.info.xz ./nvmf-tcp-vg-autotest_77415/output//dmesg.init.log ./nvmf-tcp-vg-autotest_77415/output//dmesg.log ./nvmf-tcp-vg-autotest_77415/output//nvmf_fuzz_tgt_output.txt ./nvmf-tcp-vg-autotest_77415/output//nvmf_trace.0_shm.tar.gz ./nvmf-tcp-vg-autotest_77415/output//power.tar.xz ./nvmf-tcp-vg-autotest_77415/output//test_completions.txt ./nvmf-tcp-vg-autotest_77415/output//timing.svg ./nvmf-tcp-vg-autotest_77415/output//timing.txt ./nvmf-tcp-vg-autotest_77415/output//.. 00:55:03.504 + rmdir ./nvmf-tcp-vg-autotest_77415/output/ 00:55:03.504 + for dir in "${out_dirs[@]}" 00:55:03.504 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.504 + [[ -f ./rocky9-vg-autotest_16034/output//doc.tar.xz ]] 00:55:03.504 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.504 + [[ -f ./rocky9-vg-autotest_16034/output//ut_coverage.tar.xz ]] 00:55:03.504 + tar -C ./rocky9-vg-autotest_16034/output/ -xf ./rocky9-vg-autotest_16034/output//ut_coverage.tar.xz 00:55:03.504 + rm ./rocky9-vg-autotest_16034/output//ut_coverage.tar.xz 00:55:03.504 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.504 + [[ -f ./rocky9-vg-autotest_16034/output//llvm.tar.xz ]] 00:55:03.504 + mv ./rocky9-vg-autotest_16034/output//all_tests.txt ./rocky9-vg-autotest_16034/output//build-pkg-manifest.txt ./rocky9-vg-autotest_16034/output//build-repo-manifest.txt ./rocky9-vg-autotest_16034/output//cov_base.info.xz ./rocky9-vg-autotest_16034/output//cov_test.info.xz ./rocky9-vg-autotest_16034/output//cov_total.info.xz ./rocky9-vg-autotest_16034/output//dmesg.init.log ./rocky9-vg-autotest_16034/output//dmesg.log ./rocky9-vg-autotest_16034/output//power.tar.xz ./rocky9-vg-autotest_16034/output//test_completions.txt ./rocky9-vg-autotest_16034/output//timing.svg ./rocky9-vg-autotest_16034/output//timing.txt ./rocky9-vg-autotest_16034/output//ut_coverage ./rocky9-vg-autotest_16034/output//.. 00:55:03.504 + rmdir ./rocky9-vg-autotest_16034/output/ 00:55:03.504 + for dir in "${out_dirs[@]}" 00:55:03.504 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.504 + [[ -f ./scanbuild-vg-autotest_63371/output//doc.tar.xz ]] 00:55:03.504 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.504 + [[ -f ./scanbuild-vg-autotest_63371/output//ut_coverage.tar.xz ]] 00:55:03.504 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.504 + [[ -f ./scanbuild-vg-autotest_63371/output//llvm.tar.xz ]] 00:55:03.504 + mv ./scanbuild-vg-autotest_63371/output//all_c_files.txt ./scanbuild-vg-autotest_63371/output//build-kernel-manifest.txt ./scanbuild-vg-autotest_63371/output//build_output.txt ./scanbuild-vg-autotest_63371/output//build-pkg-manifest.txt ./scanbuild-vg-autotest_63371/output//build-repo-manifest.txt ./scanbuild-vg-autotest_63371/output//built_c_files.txt ./scanbuild-vg-autotest_63371/output//dmesg.init.log ./scanbuild-vg-autotest_63371/output//dmesg.log ./scanbuild-vg-autotest_63371/output//power.tar.xz ./scanbuild-vg-autotest_63371/output//test_completions.txt ./scanbuild-vg-autotest_63371/output//timing.svg ./scanbuild-vg-autotest_63371/output//timing.txt ./scanbuild-vg-autotest_63371/output//unbuilt_c_files.txt ./scanbuild-vg-autotest_63371/output//.. 00:55:03.504 + rmdir ./scanbuild-vg-autotest_63371/output/ 00:55:03.504 + for dir in "${out_dirs[@]}" 00:55:03.504 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.504 + [[ -f ./short-fuzz-phy-autotest_26141/output//doc.tar.xz ]] 00:55:03.504 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.504 + [[ -f ./short-fuzz-phy-autotest_26141/output//ut_coverage.tar.xz ]] 00:55:03.504 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.504 + [[ -f ./short-fuzz-phy-autotest_26141/output//llvm.tar.xz ]] 00:55:03.504 + tar -C ./short-fuzz-phy-autotest_26141/output/ -xf ./short-fuzz-phy-autotest_26141/output//llvm.tar.xz 00:55:03.504 + rm ./short-fuzz-phy-autotest_26141/output//llvm.tar.xz 00:55:03.504 + mv ./short-fuzz-phy-autotest_26141/output//all_tests.txt ./short-fuzz-phy-autotest_26141/output//build-pkg-manifest.txt ./short-fuzz-phy-autotest_26141/output//build-repo-manifest.txt ./short-fuzz-phy-autotest_26141/output//dmesg.init.log ./short-fuzz-phy-autotest_26141/output//dmesg.log ./short-fuzz-phy-autotest_26141/output//llvm ./short-fuzz-phy-autotest_26141/output//power.tar.xz ./short-fuzz-phy-autotest_26141/output//test_completions.txt ./short-fuzz-phy-autotest_26141/output//timing.svg ./short-fuzz-phy-autotest_26141/output//timing.txt ./short-fuzz-phy-autotest_26141/output//.. 00:55:03.504 + rmdir ./short-fuzz-phy-autotest_26141/output/ 00:55:03.504 + for dir in "${out_dirs[@]}" 00:55:03.504 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.504 + [[ -f ./ubuntu20-vg-autotest_73743/output//doc.tar.xz ]] 00:55:03.504 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.504 + [[ -f ./ubuntu20-vg-autotest_73743/output//ut_coverage.tar.xz ]] 00:55:03.504 + tar -C ./ubuntu20-vg-autotest_73743/output/ -xf ./ubuntu20-vg-autotest_73743/output//ut_coverage.tar.xz 00:55:03.762 + rm ./ubuntu20-vg-autotest_73743/output//ut_coverage.tar.xz 00:55:03.762 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.762 + [[ -f ./ubuntu20-vg-autotest_73743/output//llvm.tar.xz ]] 00:55:03.762 + mv ./ubuntu20-vg-autotest_73743/output//all_tests.txt ./ubuntu20-vg-autotest_73743/output//build-pkg-manifest.txt ./ubuntu20-vg-autotest_73743/output//build-repo-manifest.txt ./ubuntu20-vg-autotest_73743/output//cov_base.info.xz ./ubuntu20-vg-autotest_73743/output//dmesg.init.log ./ubuntu20-vg-autotest_73743/output//dmesg.log ./ubuntu20-vg-autotest_73743/output//power.tar.xz ./ubuntu20-vg-autotest_73743/output//proc_list.txt ./ubuntu20-vg-autotest_73743/output//test_completions.txt ./ubuntu20-vg-autotest_73743/output//timing.txt ./ubuntu20-vg-autotest_73743/output//udev.log ./ubuntu20-vg-autotest_73743/output//ut_coverage ./ubuntu20-vg-autotest_73743/output//.. 00:55:03.762 + rmdir ./ubuntu20-vg-autotest_73743/output/ 00:55:03.762 + for dir in "${out_dirs[@]}" 00:55:03.762 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.762 + [[ -f ./ubuntu22-vg-autotest_37757/output//doc.tar.xz ]] 00:55:03.762 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:03.762 + [[ -f ./ubuntu22-vg-autotest_37757/output//ut_coverage.tar.xz ]] 00:55:03.762 + tar -C ./ubuntu22-vg-autotest_37757/output/ -xf ./ubuntu22-vg-autotest_37757/output//ut_coverage.tar.xz 00:55:04.020 + rm ./ubuntu22-vg-autotest_37757/output//ut_coverage.tar.xz 00:55:04.020 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:04.020 + [[ -f ./ubuntu22-vg-autotest_37757/output//llvm.tar.xz ]] 00:55:04.020 + mv ./ubuntu22-vg-autotest_37757/output//all_tests.txt ./ubuntu22-vg-autotest_37757/output//build-pkg-manifest.txt ./ubuntu22-vg-autotest_37757/output//build-repo-manifest.txt ./ubuntu22-vg-autotest_37757/output//cov_base.info.xz ./ubuntu22-vg-autotest_37757/output//cov_test.info.xz ./ubuntu22-vg-autotest_37757/output//cov_total.info.xz ./ubuntu22-vg-autotest_37757/output//dmesg.init.log ./ubuntu22-vg-autotest_37757/output//dmesg.log ./ubuntu22-vg-autotest_37757/output//power.tar.xz ./ubuntu22-vg-autotest_37757/output//test_completions.txt ./ubuntu22-vg-autotest_37757/output//timing.svg ./ubuntu22-vg-autotest_37757/output//timing.txt ./ubuntu22-vg-autotest_37757/output//ut_coverage ./ubuntu22-vg-autotest_37757/output//.. 00:55:04.020 + rmdir ./ubuntu22-vg-autotest_37757/output/ 00:55:04.020 + for dir in "${out_dirs[@]}" 00:55:04.020 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:04.020 + [[ -f ./unittest-vg-autotest_63369/output//doc.tar.xz ]] 00:55:04.020 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:04.020 + [[ -f ./unittest-vg-autotest_63369/output//ut_coverage.tar.xz ]] 00:55:04.020 + tar -C ./unittest-vg-autotest_63369/output/ -xf ./unittest-vg-autotest_63369/output//ut_coverage.tar.xz 00:55:04.277 + rm ./unittest-vg-autotest_63369/output//ut_coverage.tar.xz 00:55:04.277 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:04.277 + [[ -f ./unittest-vg-autotest_63369/output//llvm.tar.xz ]] 00:55:04.277 + mv ./unittest-vg-autotest_63369/output//all_tests.txt ./unittest-vg-autotest_63369/output//build-pkg-manifest.txt ./unittest-vg-autotest_63369/output//build-repo-manifest.txt ./unittest-vg-autotest_63369/output//cov_base.info.xz ./unittest-vg-autotest_63369/output//cov_test.info.xz ./unittest-vg-autotest_63369/output//cov_total.info.xz ./unittest-vg-autotest_63369/output//dmesg.init.log ./unittest-vg-autotest_63369/output//dmesg.log ./unittest-vg-autotest_63369/output//power.tar.xz ./unittest-vg-autotest_63369/output//test_completions.txt ./unittest-vg-autotest_63369/output//timing.svg ./unittest-vg-autotest_63369/output//timing.txt ./unittest-vg-autotest_63369/output//ut_coverage ./unittest-vg-autotest_63369/output//.. 00:55:04.277 + rmdir ./unittest-vg-autotest_63369/output/ 00:55:04.277 + for dir in "${out_dirs[@]}" 00:55:04.277 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:04.277 + [[ -f ./valgrind-vg-autotest_49186/output//doc.tar.xz ]] 00:55:04.277 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:04.277 + [[ -f ./valgrind-vg-autotest_49186/output//ut_coverage.tar.xz ]] 00:55:04.277 + tar -C ./valgrind-vg-autotest_49186/output/ -xf ./valgrind-vg-autotest_49186/output//ut_coverage.tar.xz 00:55:04.535 + rm ./valgrind-vg-autotest_49186/output//ut_coverage.tar.xz 00:55:04.535 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:04.535 + [[ -f ./valgrind-vg-autotest_49186/output//llvm.tar.xz ]] 00:55:04.535 + mv ./valgrind-vg-autotest_49186/output//all_tests.txt ./valgrind-vg-autotest_49186/output//build-kernel-manifest.txt ./valgrind-vg-autotest_49186/output//build-pkg-manifest.txt ./valgrind-vg-autotest_49186/output//build-repo-manifest.txt ./valgrind-vg-autotest_49186/output//cov_base.info.xz ./valgrind-vg-autotest_49186/output//cov_test.info.xz ./valgrind-vg-autotest_49186/output//cov_total.info.xz ./valgrind-vg-autotest_49186/output//dmesg.init.log ./valgrind-vg-autotest_49186/output//dmesg.log ./valgrind-vg-autotest_49186/output//power.tar.xz ./valgrind-vg-autotest_49186/output//test_completions.txt ./valgrind-vg-autotest_49186/output//timing.svg ./valgrind-vg-autotest_49186/output//timing.txt ./valgrind-vg-autotest_49186/output//ut_coverage ./valgrind-vg-autotest_49186/output//.. 00:55:04.535 + rmdir ./valgrind-vg-autotest_49186/output/ 00:55:04.535 + for dir in "${out_dirs[@]}" 00:55:04.535 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:04.535 + [[ -f ./vfio-user-phy-autotest_26152/output//doc.tar.xz ]] 00:55:04.535 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:04.535 + [[ -f ./vfio-user-phy-autotest_26152/output//ut_coverage.tar.xz ]] 00:55:04.535 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:04.535 + [[ -f ./vfio-user-phy-autotest_26152/output//llvm.tar.xz ]] 00:55:04.535 + mv ./vfio-user-phy-autotest_26152/output//all_tests.txt ./vfio-user-phy-autotest_26152/output//build-pkg-manifest.txt ./vfio-user-phy-autotest_26152/output//build-repo-manifest.txt ./vfio-user-phy-autotest_26152/output//cov_base.info.xz ./vfio-user-phy-autotest_26152/output//cov_test.info.xz ./vfio-user-phy-autotest_26152/output//cov_total.info.xz ./vfio-user-phy-autotest_26152/output//dmesg.init.log ./vfio-user-phy-autotest_26152/output//dmesg.log ./vfio-user-phy-autotest_26152/output//power.tar.xz ./vfio-user-phy-autotest_26152/output//test_completions.txt ./vfio-user-phy-autotest_26152/output//timing.svg ./vfio-user-phy-autotest_26152/output//timing.txt ./vfio-user-phy-autotest_26152/output//.. 00:55:04.535 + rmdir ./vfio-user-phy-autotest_26152/output/ 00:55:04.535 + for dir in "${out_dirs[@]}" 00:55:04.535 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:04.535 + [[ -f ./vhost-initiator-vg-autotest_77444/output//doc.tar.xz ]] 00:55:04.535 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:04.535 + [[ -f ./vhost-initiator-vg-autotest_77444/output//ut_coverage.tar.xz ]] 00:55:04.535 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:04.535 + [[ -f ./vhost-initiator-vg-autotest_77444/output//llvm.tar.xz ]] 00:55:04.535 + mv ./vhost-initiator-vg-autotest_77444/output//all_tests.txt ./vhost-initiator-vg-autotest_77444/output//build-pkg-manifest.txt ./vhost-initiator-vg-autotest_77444/output//build-repo-manifest.txt ./vhost-initiator-vg-autotest_77444/output//cov_base.info.xz ./vhost-initiator-vg-autotest_77444/output//cov_test.info.xz ./vhost-initiator-vg-autotest_77444/output//cov_total.info.xz ./vhost-initiator-vg-autotest_77444/output//dmesg.init.log ./vhost-initiator-vg-autotest_77444/output//dmesg.log ./vhost-initiator-vg-autotest_77444/output//power.tar.xz ./vhost-initiator-vg-autotest_77444/output//test_completions.txt ./vhost-initiator-vg-autotest_77444/output//timing.svg ./vhost-initiator-vg-autotest_77444/output//timing.txt ./vhost-initiator-vg-autotest_77444/output//vhost_fuzz_output1.txt.xz ./vhost-initiator-vg-autotest_77444/output//vhost_fuzz_output2.txt.xz ./vhost-initiator-vg-autotest_77444/output//vhost_fuzz_tgt_output.txt.xz ./vhost-initiator-vg-autotest_77444/output//.. 00:55:04.535 + rmdir ./vhost-initiator-vg-autotest_77444/output/ 00:55:04.535 + for dir in "${out_dirs[@]}" 00:55:04.535 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:04.535 + [[ -f ./vhost-phy-autotest_26169/output//doc.tar.xz ]] 00:55:04.535 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:04.535 + [[ -f ./vhost-phy-autotest_26169/output//ut_coverage.tar.xz ]] 00:55:04.535 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:04.535 + [[ -f ./vhost-phy-autotest_26169/output//llvm.tar.xz ]] 00:55:04.535 + mv ./vhost-phy-autotest_26169/output//all_tests.txt ./vhost-phy-autotest_26169/output//build-pkg-manifest.txt ./vhost-phy-autotest_26169/output//build-repo-manifest.txt ./vhost-phy-autotest_26169/output//cov_base.info.xz ./vhost-phy-autotest_26169/output//cov_test.info.xz ./vhost-phy-autotest_26169/output//cov_total.info.xz ./vhost-phy-autotest_26169/output//dmesg.init.log ./vhost-phy-autotest_26169/output//dmesg.log ./vhost-phy-autotest_26169/output//nvmf_trace.0_shm.tar.gz ./vhost-phy-autotest_26169/output//power.tar.xz ./vhost-phy-autotest_26169/output//test_completions.txt ./vhost-phy-autotest_26169/output//timing.svg ./vhost-phy-autotest_26169/output//timing.txt ./vhost-phy-autotest_26169/output//.. 00:55:04.535 + rmdir ./vhost-phy-autotest_26169/output/ 00:55:04.535 + for dir in "${out_dirs[@]}" 00:55:04.535 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:04.535 + [[ -f ./vmd-phy-autotest_2613/output//doc.tar.xz ]] 00:55:04.535 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:04.535 + [[ -f ./vmd-phy-autotest_2613/output//ut_coverage.tar.xz ]] 00:55:04.535 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:04.535 + [[ -f ./vmd-phy-autotest_2613/output//llvm.tar.xz ]] 00:55:04.535 + mv ./vmd-phy-autotest_2613/output//all_tests.txt ./vmd-phy-autotest_2613/output//build-pkg-manifest.txt ./vmd-phy-autotest_2613/output//build-repo-manifest.txt ./vmd-phy-autotest_2613/output//cov_base.info.xz ./vmd-phy-autotest_2613/output//cov_test.info.xz ./vmd-phy-autotest_2613/output//cov_total.info.xz ./vmd-phy-autotest_2613/output//dmesg.init.log ./vmd-phy-autotest_2613/output//dmesg.log ./vmd-phy-autotest_2613/output//power.tar.xz ./vmd-phy-autotest_2613/output//test_completions.txt ./vmd-phy-autotest_2613/output//timing.svg ./vmd-phy-autotest_2613/output//timing.txt ./vmd-phy-autotest_2613/output//.. 00:55:04.535 + rmdir ./vmd-phy-autotest_2613/output/ 00:55:04.535 + for dir in "${out_dirs[@]}" 00:55:04.535 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:04.535 + [[ -f ./zns-vg-autotest_76530/output//doc.tar.xz ]] 00:55:04.535 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:04.535 + [[ -f ./zns-vg-autotest_76530/output//ut_coverage.tar.xz ]] 00:55:04.535 + for archive in "${dir}"/{doc,ut_coverage,llvm}.tar.xz 00:55:04.535 + [[ -f ./zns-vg-autotest_76530/output//llvm.tar.xz ]] 00:55:04.535 + mv ./zns-vg-autotest_76530/output//all_tests.txt ./zns-vg-autotest_76530/output//build-pkg-manifest.txt ./zns-vg-autotest_76530/output//build-repo-manifest.txt ./zns-vg-autotest_76530/output//cov_base.info.xz ./zns-vg-autotest_76530/output//cov_test.info.xz ./zns-vg-autotest_76530/output//cov_total.info.xz ./zns-vg-autotest_76530/output//dmesg.init.log ./zns-vg-autotest_76530/output//dmesg.log ./zns-vg-autotest_76530/output//power.tar.xz ./zns-vg-autotest_76530/output//test_completions.txt ./zns-vg-autotest_76530/output//timing.svg ./zns-vg-autotest_76530/output//timing.txt ./zns-vg-autotest_76530/output//.. 00:55:04.535 + rmdir ./zns-vg-autotest_76530/output/ 00:55:04.535 + unpack_cov_files 00:55:04.535 + local info_files 00:55:04.535 + info_files=(*/cov_*.info.xz) 00:55:04.535 + xargs -P0 -r -n1 xz -d 00:55:04.535 + printf '%s\n' BlobFS-phy-autotest_26150/cov_base.info.xz BlobFS-phy-autotest_26150/cov_test.info.xz BlobFS-phy-autotest_26150/cov_total.info.xz centos7-vg-autotest_73603/cov_base.info.xz centos7-vg-autotest_73603/cov_test.info.xz centos7-vg-autotest_73603/cov_total.info.xz crypto-phy-autotest_26144/cov_base.info.xz crypto-phy-autotest_26144/cov_test.info.xz crypto-phy-autotest_26144/cov_total.info.xz dsa-phy-autotest_4844/cov_base.info.xz dsa-phy-autotest_4844/cov_test.info.xz dsa-phy-autotest_4844/cov_total.info.xz iscsi-uring-vg-autotest_77329/cov_base.info.xz iscsi-uring-vg-autotest_77329/cov_test.info.xz iscsi-uring-vg-autotest_77329/cov_total.info.xz iscsi-vg-autotest_77462/cov_base.info.xz iscsi-vg-autotest_77462/cov_test.info.xz iscsi-vg-autotest_77462/cov_total.info.xz lvol-vg-autotest_77373/cov_base.info.xz lvol-vg-autotest_77373/cov_test.info.xz lvol-vg-autotest_77373/cov_total.info.xz nvme-cmb-pmr-vg-autotest_78547/cov_base.info.xz nvme-cmb-pmr-vg-autotest_78547/cov_test.info.xz nvme-cmb-pmr-vg-autotest_78547/cov_total.info.xz nvme-phy-autotest_72316/cov_base.info.xz nvme-phy-autotest_72316/cov_test.info.xz nvme-phy-autotest_72316/cov_total.info.xz nvme-vg-autotest_77424/cov_base.info.xz nvmf-phy-autotest_72388/cov_base.info.xz nvmf-tcp-phy-autotest_72275/cov_base.info.xz nvmf-tcp-phy-autotest_72275/cov_test.info.xz nvmf-tcp-phy-autotest_72275/cov_total.info.xz nvmf-tcp-uring-vg-autotest_77349/cov_base.info.xz nvmf-tcp-uring-vg-autotest_77349/cov_test.info.xz nvmf-tcp-uring-vg-autotest_77349/cov_total.info.xz nvmf-tcp-vg-autotest_77415/cov_base.info.xz nvmf-tcp-vg-autotest_77415/cov_test.info.xz nvmf-tcp-vg-autotest_77415/cov_total.info.xz rocky9-vg-autotest_16034/cov_base.info.xz rocky9-vg-autotest_16034/cov_test.info.xz rocky9-vg-autotest_16034/cov_total.info.xz ubuntu20-vg-autotest_73743/cov_base.info.xz ubuntu22-vg-autotest_37757/cov_base.info.xz ubuntu22-vg-autotest_37757/cov_test.info.xz ubuntu22-vg-autotest_37757/cov_total.info.xz unittest-vg-autotest_63369/cov_base.info.xz unittest-vg-autotest_63369/cov_test.info.xz unittest-vg-autotest_63369/cov_total.info.xz valgrind-vg-autotest_49186/cov_base.info.xz valgrind-vg-autotest_49186/cov_test.info.xz valgrind-vg-autotest_49186/cov_total.info.xz vfio-user-phy-autotest_26152/cov_base.info.xz vfio-user-phy-autotest_26152/cov_test.info.xz vfio-user-phy-autotest_26152/cov_total.info.xz vhost-initiator-vg-autotest_77444/cov_base.info.xz vhost-initiator-vg-autotest_77444/cov_test.info.xz vhost-initiator-vg-autotest_77444/cov_total.info.xz vhost-phy-autotest_26169/cov_base.info.xz vhost-phy-autotest_26169/cov_test.info.xz vhost-phy-autotest_26169/cov_total.info.xz vmd-phy-autotest_2613/cov_base.info.xz vmd-phy-autotest_2613/cov_test.info.xz vmd-phy-autotest_2613/cov_total.info.xz zns-vg-autotest_76530/cov_base.info.xz zns-vg-autotest_76530/cov_test.info.xz zns-vg-autotest_76530/cov_total.info.xz 00:55:05.100 + fix_downstream_job_paths 00:55:05.100 + sed -i -e 's#^SF:/.\+/spdk/#SF:/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/spdk/#g' BlobFS-phy-autotest_26150/cov_total.info centos7-vg-autotest_73603/cov_total.info crypto-phy-autotest_26144/cov_total.info dsa-phy-autotest_4844/cov_total.info iscsi-uring-vg-autotest_77329/cov_total.info iscsi-vg-autotest_77462/cov_total.info lvol-vg-autotest_77373/cov_total.info nvme-cmb-pmr-vg-autotest_78547/cov_total.info nvme-phy-autotest_72316/cov_total.info nvmf-tcp-phy-autotest_72275/cov_total.info nvmf-tcp-uring-vg-autotest_77349/cov_total.info nvmf-tcp-vg-autotest_77415/cov_total.info rocky9-vg-autotest_16034/cov_total.info ubuntu22-vg-autotest_37757/cov_total.info unittest-vg-autotest_63369/cov_total.info valgrind-vg-autotest_49186/cov_total.info vfio-user-phy-autotest_26152/cov_total.info vhost-initiator-vg-autotest_77444/cov_total.info vhost-phy-autotest_26169/cov_total.info vmd-phy-autotest_2613/cov_total.info zns-vg-autotest_76530/cov_total.info 00:55:06.033 + ignore_ocf_headers 00:55:06.033 + sed -i 's#--show-details#--show-details --ignore-errors source#g' spdk/autorun_post.py 00:55:06.033 + create_errtrace_files_for_all_builds 00:55:06.033 + local build_log_list 00:55:06.033 + build_log_list=($(find "$WORKSPACE" -type f -name 'build.log')) 00:55:06.033 ++ find /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11 -type f -name build.log 00:55:06.033 + for build in "${build_log_list[@]}" 00:55:06.033 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/lvol-vg-autotest_77373/build.log 00:55:06.033 + local build_log job_name start_pattern end_pattern backtraces 00:55:06.033 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/lvol-vg-autotest_77373/build.log 00:55:06.033 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/lvol-vg-autotest_77373/build.log 00:55:06.033 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/lvol-vg-autotest_77373 00:55:06.033 + job_name=lvol-vg-autotest_77373 00:55:06.033 + start_pattern='Backtrace start' 00:55:06.033 + end_pattern='Backtrace end' 00:55:06.033 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/lvol-vg-autotest_77373/build.log ]] 00:55:06.033 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/lvol-vg-autotest_77373/build.log 00:55:06.033 + backtraces= 00:55:06.033 + [[ -n '' ]] 00:55:06.033 + for build in "${build_log_list[@]}" 00:55:06.033 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-uring-vg-autotest_77349/build.log 00:55:06.033 + local build_log job_name start_pattern end_pattern backtraces 00:55:06.033 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-uring-vg-autotest_77349/build.log 00:55:06.033 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-uring-vg-autotest_77349/build.log 00:55:06.033 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-uring-vg-autotest_77349 00:55:06.033 + job_name=nvmf-tcp-uring-vg-autotest_77349 00:55:06.033 + start_pattern='Backtrace start' 00:55:06.033 + end_pattern='Backtrace end' 00:55:06.033 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-uring-vg-autotest_77349/build.log ]] 00:55:06.033 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-uring-vg-autotest_77349/build.log 00:55:06.033 + backtraces= 00:55:06.033 + [[ -n '' ]] 00:55:06.033 + for build in "${build_log_list[@]}" 00:55:06.033 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/iscsi-vg-autotest_77462/build.log 00:55:06.033 + local build_log job_name start_pattern end_pattern backtraces 00:55:06.033 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/iscsi-vg-autotest_77462/build.log 00:55:06.033 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/iscsi-vg-autotest_77462/build.log 00:55:06.033 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/iscsi-vg-autotest_77462 00:55:06.033 + job_name=iscsi-vg-autotest_77462 00:55:06.033 + start_pattern='Backtrace start' 00:55:06.033 + end_pattern='Backtrace end' 00:55:06.033 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/iscsi-vg-autotest_77462/build.log ]] 00:55:06.033 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/iscsi-vg-autotest_77462/build.log 00:55:06.033 + backtraces= 00:55:06.033 + [[ -n '' ]] 00:55:06.033 + for build in "${build_log_list[@]}" 00:55:06.033 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/iscsi-uring-vg-autotest_77329/build.log 00:55:06.033 + local build_log job_name start_pattern end_pattern backtraces 00:55:06.033 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/iscsi-uring-vg-autotest_77329/build.log 00:55:06.033 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/iscsi-uring-vg-autotest_77329/build.log 00:55:06.033 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/iscsi-uring-vg-autotest_77329 00:55:06.033 + job_name=iscsi-uring-vg-autotest_77329 00:55:06.033 + start_pattern='Backtrace start' 00:55:06.033 + end_pattern='Backtrace end' 00:55:06.033 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/iscsi-uring-vg-autotest_77329/build.log ]] 00:55:06.033 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/iscsi-uring-vg-autotest_77329/build.log 00:55:06.033 + backtraces= 00:55:06.033 + [[ -n '' ]] 00:55:06.033 + for build in "${build_log_list[@]}" 00:55:06.033 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/crypto-phy-autotest_26144/build.log 00:55:06.033 + local build_log job_name start_pattern end_pattern backtraces 00:55:06.033 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/crypto-phy-autotest_26144/build.log 00:55:06.033 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/crypto-phy-autotest_26144/build.log 00:55:06.033 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/crypto-phy-autotest_26144 00:55:06.033 + job_name=crypto-phy-autotest_26144 00:55:06.033 + start_pattern='Backtrace start' 00:55:06.033 + end_pattern='Backtrace end' 00:55:06.033 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/crypto-phy-autotest_26144/build.log ]] 00:55:06.033 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/crypto-phy-autotest_26144/build.log 00:55:06.033 + backtraces= 00:55:06.033 + [[ -n '' ]] 00:55:06.033 + for build in "${build_log_list[@]}" 00:55:06.033 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/valgrind-vg-autotest_49186/build.log 00:55:06.033 + local build_log job_name start_pattern end_pattern backtraces 00:55:06.033 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/valgrind-vg-autotest_49186/build.log 00:55:06.033 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/valgrind-vg-autotest_49186/build.log 00:55:06.033 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/valgrind-vg-autotest_49186 00:55:06.033 + job_name=valgrind-vg-autotest_49186 00:55:06.033 + start_pattern='Backtrace start' 00:55:06.033 + end_pattern='Backtrace end' 00:55:06.033 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/valgrind-vg-autotest_49186/build.log ]] 00:55:06.033 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/valgrind-vg-autotest_49186/build.log 00:55:06.033 + backtraces= 00:55:06.033 + [[ -n '' ]] 00:55:06.033 + for build in "${build_log_list[@]}" 00:55:06.033 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/zns-vg-autotest_76530/build.log 00:55:06.033 + local build_log job_name start_pattern end_pattern backtraces 00:55:06.033 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/zns-vg-autotest_76530/build.log 00:55:06.033 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/zns-vg-autotest_76530/build.log 00:55:06.033 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/zns-vg-autotest_76530 00:55:06.033 + job_name=zns-vg-autotest_76530 00:55:06.033 + start_pattern='Backtrace start' 00:55:06.033 + end_pattern='Backtrace end' 00:55:06.033 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/zns-vg-autotest_76530/build.log ]] 00:55:06.033 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/zns-vg-autotest_76530/build.log 00:55:06.033 + backtraces= 00:55:06.033 + [[ -n '' ]] 00:55:06.033 + for build in "${build_log_list[@]}" 00:55:06.033 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/centos7-vg-autotest_73603/build.log 00:55:06.033 + local build_log job_name start_pattern end_pattern backtraces 00:55:06.033 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/centos7-vg-autotest_73603/build.log 00:55:06.033 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/centos7-vg-autotest_73603/build.log 00:55:06.033 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/centos7-vg-autotest_73603 00:55:06.033 + job_name=centos7-vg-autotest_73603 00:55:06.033 + start_pattern='Backtrace start' 00:55:06.033 + end_pattern='Backtrace end' 00:55:06.033 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/centos7-vg-autotest_73603/build.log ]] 00:55:06.033 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/centos7-vg-autotest_73603/build.log 00:55:06.033 + backtraces= 00:55:06.033 + [[ -n '' ]] 00:55:06.033 + for build in "${build_log_list[@]}" 00:55:06.033 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vmd-phy-autotest_2613/build.log 00:55:06.033 + local build_log job_name start_pattern end_pattern backtraces 00:55:06.033 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vmd-phy-autotest_2613/build.log 00:55:06.033 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vmd-phy-autotest_2613/build.log 00:55:06.033 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vmd-phy-autotest_2613 00:55:06.033 + job_name=vmd-phy-autotest_2613 00:55:06.033 + start_pattern='Backtrace start' 00:55:06.033 + end_pattern='Backtrace end' 00:55:06.033 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vmd-phy-autotest_2613/build.log ]] 00:55:06.033 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vmd-phy-autotest_2613/build.log 00:55:06.295 + backtraces= 00:55:06.295 + [[ -n '' ]] 00:55:06.295 + for build in "${build_log_list[@]}" 00:55:06.295 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-vg-autotest_77415/build.log 00:55:06.295 + local build_log job_name start_pattern end_pattern backtraces 00:55:06.295 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-vg-autotest_77415/build.log 00:55:06.295 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-vg-autotest_77415/build.log 00:55:06.295 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-vg-autotest_77415 00:55:06.295 + job_name=nvmf-tcp-vg-autotest_77415 00:55:06.295 + start_pattern='Backtrace start' 00:55:06.295 + end_pattern='Backtrace end' 00:55:06.295 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-vg-autotest_77415/build.log ]] 00:55:06.295 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-vg-autotest_77415/build.log 00:55:06.295 + backtraces= 00:55:06.295 + [[ -n '' ]] 00:55:06.295 + for build in "${build_log_list[@]}" 00:55:06.295 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-phy-autotest_72316/build.log 00:55:06.295 + local build_log job_name start_pattern end_pattern backtraces 00:55:06.295 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-phy-autotest_72316/build.log 00:55:06.295 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-phy-autotest_72316/build.log 00:55:06.296 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-phy-autotest_72316 00:55:06.296 + job_name=nvme-phy-autotest_72316 00:55:06.296 + start_pattern='Backtrace start' 00:55:06.296 + end_pattern='Backtrace end' 00:55:06.296 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-phy-autotest_72316/build.log ]] 00:55:06.296 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-phy-autotest_72316/build.log 00:55:06.296 + backtraces= 00:55:06.296 + [[ -n '' ]] 00:55:06.296 + for build in "${build_log_list[@]}" 00:55:06.296 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/short-fuzz-phy-autotest_26141/build.log 00:55:06.296 + local build_log job_name start_pattern end_pattern backtraces 00:55:06.296 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/short-fuzz-phy-autotest_26141/build.log 00:55:06.296 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/short-fuzz-phy-autotest_26141/build.log 00:55:06.296 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/short-fuzz-phy-autotest_26141 00:55:06.296 + job_name=short-fuzz-phy-autotest_26141 00:55:06.296 + start_pattern='Backtrace start' 00:55:06.296 + end_pattern='Backtrace end' 00:55:06.296 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/short-fuzz-phy-autotest_26141/build.log ]] 00:55:06.296 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/short-fuzz-phy-autotest_26141/build.log 00:55:06.296 + backtraces= 00:55:06.296 + [[ -n '' ]] 00:55:06.296 + for build in "${build_log_list[@]}" 00:55:06.296 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-vg-autotest_77424/build.log 00:55:06.296 + local build_log job_name start_pattern end_pattern backtraces 00:55:06.296 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-vg-autotest_77424/build.log 00:55:06.296 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-vg-autotest_77424/build.log 00:55:06.296 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-vg-autotest_77424 00:55:06.296 + job_name=nvme-vg-autotest_77424 00:55:06.296 + start_pattern='Backtrace start' 00:55:06.296 + end_pattern='Backtrace end' 00:55:06.296 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-vg-autotest_77424/build.log ]] 00:55:06.296 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-vg-autotest_77424/build.log 00:55:06.296 + backtraces='00:14:09.073 23:42:32 sw_hotplug -- common/autotest_common.sh@715 -- # time='\''========== Backtrace start: ========== 00:55:06.296 00:14:09.073 00:55:06.296 00:14:09.073 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:55:06.296 00:14:09.073 ... 00:55:06.296 00:14:09.073 710 00:55:06.296 00:14:09.073 711 # We redirect cmd'\''\'\'''\''s std{out,err} to a separate fd dup'\''\'\'''\''ed to stdin'\''\'\'''\''s device (or /dev/null) to 00:55:06.296 00:14:09.073 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 00:55:06.296 00:14:09.073 713 # but $() will return just the time'\''\'\'''\''s data, hence making it possible to just do: 00:55:06.296 00:14:09.073 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:55:06.296 00:14:09.073 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:55:06.296 00:14:09.073 716 00:55:06.296 00:14:09.073 717 echo "$time" 00:55:06.296 00:14:09.073 718 ) 00:55:06.296 00:14:09.073 719 00:55:06.296 00:14:09.073 720 function timing_enter() { 00:55:06.296 00:14:09.073 ... 00:55:06.296 00:14:09.073 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:55:06.296 00:14:09.073 ... 00:55:06.296 00:14:09.073 11 # Pci bus hotplug 00:55:06.296 00:14:09.073 12 # Helper function to remove/attach cotrollers 00:55:06.296 00:14:09.073 13 debug_remove_attach_helper() { 00:55:06.296 00:14:09.073 14 local helper_time=0 00:55:06.296 00:14:09.073 15 00:55:06.296 00:14:09.073 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:55:06.296 00:14:09.073 17 printf '\''\'\'''\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\''\'\'''\'' \ 00:55:06.296 00:14:09.073 18 "$helper_time" "$nvme_count" >&2 00:55:06.296 00:14:09.073 19 } 00:55:06.296 00:14:09.073 20 00:55:06.296 00:14:09.073 21 remove_attach_helper() { 00:55:06.296 00:14:09.073 ... 00:55:06.296 00:14:09.073 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:55:06.296 00:14:09.073 ... 00:55:06.296 00:14:09.073 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:55:06.296 00:14:09.073 106 done 00:55:06.296 00:14:09.073 107 00:55:06.296 00:14:09.073 108 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.296 00:14:09.073 109 00:55:06.296 00:14:09.073 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.296 00:14:09.073 111 # Verify reregistering hotplug poller 00:55:06.296 00:14:09.073 112 rpc_cmd bdev_nvme_set_hotplug -d 00:55:06.296 00:14:09.073 113 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.296 00:14:09.073 114 00:55:06.296 00:14:09.073 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.296 00:14:09.073 ... 00:55:06.296 00:14:09.073 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:55:06.296 00:14:09.073 ... 00:55:06.296 00:14:09.073 133 00:55:06.296 00:14:09.073 134 # Run pci bus hotplug test 00:55:06.296 00:14:09.073 135 run_hotplug 00:55:06.296 00:14:09.073 136 00:55:06.296 00:14:09.073 137 # Run SPDK target based hotplug 00:55:06.296 00:14:09.073 => 138 tgt_run_hotplug 00:55:06.296 00:14:09.073 ... 00:55:06.296 00:14:09.073 00:55:06.296 00:14:09.073 ========== Backtrace end =========='\'' 00:55:06.296 00:14:09.073 ========== Backtrace start: ========== 00:55:06.296 00:14:09.073 00:55:06.296 00:14:09.073 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:55:06.296 00:14:09.073 ... 00:55:06.296 00:14:09.073 710 00:55:06.296 00:14:09.073 711 # We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to 00:55:06.296 00:14:09.073 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 00:55:06.296 00:14:09.073 713 # but $() will return just the time'\''s data, hence making it possible to just do: 00:55:06.296 00:14:09.073 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:55:06.296 00:14:09.073 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:55:06.296 00:14:09.073 716 00:55:06.296 00:14:09.073 717 echo "$time" 00:55:06.296 00:14:09.073 718 ) 00:55:06.296 00:14:09.073 719 00:55:06.296 00:14:09.073 720 function timing_enter() { 00:55:06.296 00:14:09.073 ... 00:55:06.296 00:14:09.073 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:55:06.296 00:14:09.073 ... 00:55:06.296 00:14:09.073 11 # Pci bus hotplug 00:55:06.296 00:14:09.073 12 # Helper function to remove/attach cotrollers 00:55:06.296 00:14:09.073 13 debug_remove_attach_helper() { 00:55:06.296 00:14:09.073 14 local helper_time=0 00:55:06.296 00:14:09.073 15 00:55:06.296 00:14:09.073 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:55:06.296 00:14:09.073 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 00:55:06.296 00:14:09.073 18 "$helper_time" "$nvme_count" >&2 00:55:06.296 00:14:09.073 19 } 00:55:06.296 00:14:09.073 20 00:55:06.296 00:14:09.073 21 remove_attach_helper() { 00:55:06.296 00:14:09.073 ... 00:55:06.296 00:14:09.073 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:55:06.296 00:14:09.073 ... 00:55:06.296 00:14:09.073 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:55:06.296 00:14:09.073 106 done 00:55:06.296 00:14:09.073 107 00:55:06.296 00:14:09.073 108 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.296 00:14:09.073 109 00:55:06.296 00:14:09.073 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.296 00:14:09.073 111 # Verify reregistering hotplug poller 00:55:06.296 00:14:09.073 112 rpc_cmd bdev_nvme_set_hotplug -d 00:55:06.296 00:14:09.073 113 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.296 00:14:09.073 114 00:55:06.296 00:14:09.073 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.296 00:14:09.073 ... 00:55:06.296 00:14:09.073 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:55:06.296 00:14:09.073 ... 00:55:06.296 00:14:09.073 133 00:55:06.296 00:14:09.073 134 # Run pci bus hotplug test 00:55:06.296 00:14:09.073 135 run_hotplug 00:55:06.296 00:14:09.073 136 00:55:06.296 00:14:09.073 137 # Run SPDK target based hotplug 00:55:06.296 00:14:09.073 => 138 tgt_run_hotplug 00:55:06.296 00:14:09.073 ... 00:55:06.296 00:14:09.073 00:55:06.296 00:14:09.073 ========== Backtrace end ========== 00:55:06.296 00:14:09.073 ========== Backtrace start: ========== 00:55:06.296 00:14:09.073 00:55:06.296 00:14:09.073 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:55:06.296 00:14:09.073 ... 00:55:06.296 00:14:09.073 713 # but $() will return just the time'\''s data, hence making it possible to just do: 00:55:06.296 00:14:09.073 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:55:06.296 00:14:09.073 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:55:06.296 00:14:09.073 716 00:55:06.296 00:14:09.073 717 echo "$time" 00:55:06.296 00:14:09.073 => 718 ) 00:55:06.296 00:14:09.073 719 00:55:06.296 00:14:09.073 720 function timing_enter() { 00:55:06.297 00:14:09.073 721 xtrace_disable 00:55:06.297 00:14:09.073 722 timing "enter" "$1" 00:55:06.297 00:14:09.073 723 xtrace_restore 00:55:06.297 00:14:09.073 ... 00:55:06.297 00:14:09.073 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:55:06.297 00:14:09.073 ... 00:55:06.297 00:14:09.073 11 # Pci bus hotplug 00:55:06.297 00:14:09.073 12 # Helper function to remove/attach cotrollers 00:55:06.297 00:14:09.073 13 debug_remove_attach_helper() { 00:55:06.297 00:14:09.073 14 local helper_time=0 00:55:06.297 00:14:09.073 15 00:55:06.297 00:14:09.073 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:55:06.297 00:14:09.073 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 00:55:06.297 00:14:09.073 18 "$helper_time" "$nvme_count" >&2 00:55:06.297 00:14:09.073 19 } 00:55:06.297 00:14:09.073 20 00:55:06.297 00:14:09.073 21 remove_attach_helper() { 00:55:06.297 00:14:09.073 ... 00:55:06.297 00:14:09.073 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:55:06.297 00:14:09.073 ... 00:55:06.297 00:14:09.073 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:55:06.297 00:14:09.073 106 done 00:55:06.297 00:14:09.073 107 00:55:06.297 00:14:09.073 108 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.297 00:14:09.073 109 00:55:06.297 00:14:09.073 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.297 00:14:09.073 111 # Verify reregistering hotplug poller 00:55:06.297 00:14:09.073 112 rpc_cmd bdev_nvme_set_hotplug -d 00:55:06.297 00:14:09.073 113 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.297 00:14:09.073 114 00:55:06.297 00:14:09.073 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.297 00:14:09.073 ... 00:55:06.297 00:14:09.073 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:55:06.297 00:14:09.073 ... 00:55:06.297 00:14:09.073 133 00:55:06.297 00:14:09.073 134 # Run pci bus hotplug test 00:55:06.297 00:14:09.073 135 run_hotplug 00:55:06.297 00:14:09.073 136 00:55:06.297 00:14:09.073 137 # Run SPDK target based hotplug 00:55:06.297 00:14:09.073 => 138 tgt_run_hotplug 00:55:06.297 00:14:09.073 ... 00:55:06.297 00:14:09.073 00:55:06.297 00:14:09.074 ========== Backtrace end ========== 00:55:06.297 00:14:09.074 ========== Backtrace start: ========== 00:55:06.297 00:14:09.074 00:55:06.297 00:14:09.074 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:55:06.297 00:14:09.074 ... 00:55:06.297 00:14:09.074 11 # Pci bus hotplug 00:55:06.297 00:14:09.074 12 # Helper function to remove/attach cotrollers 00:55:06.297 00:14:09.074 13 debug_remove_attach_helper() { 00:55:06.297 00:14:09.074 14 local helper_time=0 00:55:06.297 00:14:09.074 15 00:55:06.297 00:14:09.074 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:55:06.297 00:14:09.074 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 00:55:06.297 00:14:09.074 18 "$helper_time" "$nvme_count" >&2 00:55:06.297 00:14:09.074 19 } 00:55:06.297 00:14:09.074 20 00:55:06.297 00:14:09.074 21 remove_attach_helper() { 00:55:06.297 00:14:09.074 ... 00:55:06.297 00:14:09.074 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:55:06.297 00:14:09.074 ... 00:55:06.297 00:14:09.074 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:55:06.297 00:14:09.074 106 done 00:55:06.297 00:14:09.074 107 00:55:06.297 00:14:09.074 108 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.297 00:14:09.074 109 00:55:06.297 00:14:09.074 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.297 00:14:09.074 111 # Verify reregistering hotplug poller 00:55:06.297 00:14:09.074 112 rpc_cmd bdev_nvme_set_hotplug -d 00:55:06.297 00:14:09.074 113 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.297 00:14:09.074 114 00:55:06.297 00:14:09.074 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.297 00:14:09.074 ... 00:55:06.297 00:14:09.074 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:55:06.297 00:14:09.074 ... 00:55:06.297 00:14:09.074 133 00:55:06.297 00:14:09.074 134 # Run pci bus hotplug test 00:55:06.297 00:14:09.074 135 run_hotplug 00:55:06.297 00:14:09.074 136 00:55:06.297 00:14:09.074 137 # Run SPDK target based hotplug 00:55:06.297 00:14:09.074 => 138 tgt_run_hotplug 00:55:06.297 00:14:09.074 ... 00:55:06.297 00:14:09.074 00:55:06.297 00:14:09.074 ========== Backtrace end ========== 00:55:06.297 00:14:09.642 ========== Backtrace start: ========== 00:55:06.297 00:14:09.642 00:55:06.297 00:14:09.642 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh"]) 00:55:06.297 00:14:09.642 ... 00:55:06.297 00:14:09.642 1117 timing_enter $test_name 00:55:06.297 00:14:09.642 1118 echo "************************************" 00:55:06.297 00:14:09.642 1119 echo "START TEST $test_name" 00:55:06.297 00:14:09.642 1120 echo "************************************" 00:55:06.297 00:14:09.642 1121 xtrace_restore 00:55:06.297 00:14:09.642 1122 time "$@" 00:55:06.297 00:14:09.642 1123 xtrace_disable 00:55:06.297 00:14:09.642 1124 echo "************************************" 00:55:06.297 00:14:09.642 1125 echo "END TEST $test_name" 00:55:06.297 00:14:09.642 1126 echo "************************************" 00:55:06.297 00:14:09.642 1127 timing_exit $test_name 00:55:06.297 00:14:09.642 ... 00:55:06.297 00:14:09.642 in /home/vagrant/spdk_repo/spdk/autotest.sh:240 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 00:55:06.297 00:14:09.642 ... 00:55:06.297 00:14:09.642 235 00:55:06.297 00:14:09.642 236 run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh 00:55:06.297 00:14:09.642 237 run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh 00:55:06.297 00:14:09.642 238 00:55:06.297 00:14:09.642 239 if [ $(uname -s) = Linux ]; then 00:55:06.297 00:14:09.642 => 240 run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh 00:55:06.297 00:14:09.642 241 fi 00:55:06.297 00:14:09.642 242 00:55:06.297 00:14:09.642 243 if [[ $SPDK_TEST_XNVME -eq 1 ]]; then 00:55:06.297 00:14:09.642 244 run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh 00:55:06.297 00:14:09.642 245 run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme" 00:55:06.297 00:14:09.642 ... 00:55:06.297 00:14:09.642 00:55:06.297 00:14:09.642 ========== Backtrace end ==========' 00:55:06.297 + [[ -n 00:14:09.073 23:42:32 sw_hotplug -- common/autotest_common.sh@715 -- # time='========== Backtrace start: ========== 00:55:06.297 00:14:09.073 00:55:06.297 00:14:09.073 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:55:06.297 00:14:09.073 ... 00:55:06.297 00:14:09.073 710 00:55:06.297 00:14:09.073 711 # We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to 00:55:06.297 00:14:09.073 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 00:55:06.297 00:14:09.073 713 # but $() will return just the time'\''s data, hence making it possible to just do: 00:55:06.297 00:14:09.073 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:55:06.297 00:14:09.073 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:55:06.297 00:14:09.073 716 00:55:06.297 00:14:09.073 717 echo "$time" 00:55:06.297 00:14:09.073 718 ) 00:55:06.297 00:14:09.073 719 00:55:06.297 00:14:09.073 720 function timing_enter() { 00:55:06.297 00:14:09.073 ... 00:55:06.297 00:14:09.073 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:55:06.297 00:14:09.073 ... 00:55:06.297 00:14:09.073 11 # Pci bus hotplug 00:55:06.297 00:14:09.073 12 # Helper function to remove/attach cotrollers 00:55:06.297 00:14:09.073 13 debug_remove_attach_helper() { 00:55:06.297 00:14:09.073 14 local helper_time=0 00:55:06.297 00:14:09.073 15 00:55:06.297 00:14:09.073 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:55:06.297 00:14:09.073 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 00:55:06.297 00:14:09.073 18 "$helper_time" "$nvme_count" >&2 00:55:06.297 00:14:09.073 19 } 00:55:06.297 00:14:09.073 20 00:55:06.297 00:14:09.073 21 remove_attach_helper() { 00:55:06.297 00:14:09.073 ... 00:55:06.297 00:14:09.073 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:55:06.297 00:14:09.073 ... 00:55:06.297 00:14:09.073 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:55:06.297 00:14:09.073 106 done 00:55:06.297 00:14:09.073 107 00:55:06.297 00:14:09.073 108 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.297 00:14:09.073 109 00:55:06.297 00:14:09.073 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.297 00:14:09.073 111 # Verify reregistering hotplug poller 00:55:06.297 00:14:09.073 112 rpc_cmd bdev_nvme_set_hotplug -d 00:55:06.297 00:14:09.073 113 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.297 00:14:09.073 114 00:55:06.297 00:14:09.073 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.297 00:14:09.073 ... 00:55:06.297 00:14:09.073 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:55:06.297 00:14:09.073 ... 00:55:06.297 00:14:09.073 133 00:55:06.297 00:14:09.073 134 # Run pci bus hotplug test 00:55:06.297 00:14:09.073 135 run_hotplug 00:55:06.297 00:14:09.073 136 00:55:06.297 00:14:09.073 137 # Run SPDK target based hotplug 00:55:06.297 00:14:09.073 => 138 tgt_run_hotplug 00:55:06.297 00:14:09.073 ... 00:55:06.297 00:14:09.073 00:55:06.298 00:14:09.073 ========== Backtrace end ==========' 00:55:06.298 00:14:09.073 ========== Backtrace start: ========== 00:55:06.298 00:14:09.073 00:55:06.298 00:14:09.073 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:55:06.298 00:14:09.073 ... 00:55:06.298 00:14:09.073 710 00:55:06.298 00:14:09.073 711 # We redirect cmd's std{out,err} to a separate fd dup'ed to stdin's device (or /dev/null) to 00:55:06.298 00:14:09.073 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 00:55:06.298 00:14:09.073 713 # but $() will return just the time's data, hence making it possible to just do: 00:55:06.298 00:14:09.073 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:55:06.298 00:14:09.073 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:55:06.298 00:14:09.073 716 00:55:06.298 00:14:09.073 717 echo "$time" 00:55:06.298 00:14:09.073 718 ) 00:55:06.298 00:14:09.073 719 00:55:06.298 00:14:09.073 720 function timing_enter() { 00:55:06.298 00:14:09.073 ... 00:55:06.298 00:14:09.073 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:55:06.298 00:14:09.073 ... 00:55:06.298 00:14:09.073 11 # Pci bus hotplug 00:55:06.298 00:14:09.073 12 # Helper function to remove/attach cotrollers 00:55:06.298 00:14:09.073 13 debug_remove_attach_helper() { 00:55:06.298 00:14:09.073 14 local helper_time=0 00:55:06.298 00:14:09.073 15 00:55:06.298 00:14:09.073 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:55:06.298 00:14:09.073 17 printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \ 00:55:06.298 00:14:09.073 18 "$helper_time" "$nvme_count" >&2 00:55:06.298 00:14:09.073 19 } 00:55:06.298 00:14:09.073 20 00:55:06.298 00:14:09.073 21 remove_attach_helper() { 00:55:06.298 00:14:09.073 ... 00:55:06.298 00:14:09.073 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:55:06.298 00:14:09.073 ... 00:55:06.298 00:14:09.073 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:55:06.298 00:14:09.073 106 done 00:55:06.298 00:14:09.073 107 00:55:06.298 00:14:09.073 108 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.298 00:14:09.073 109 00:55:06.298 00:14:09.073 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.298 00:14:09.073 111 # Verify reregistering hotplug poller 00:55:06.298 00:14:09.073 112 rpc_cmd bdev_nvme_set_hotplug -d 00:55:06.298 00:14:09.073 113 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.298 00:14:09.073 114 00:55:06.298 00:14:09.073 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.298 00:14:09.073 ... 00:55:06.298 00:14:09.073 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:55:06.298 00:14:09.073 ... 00:55:06.298 00:14:09.073 133 00:55:06.298 00:14:09.073 134 # Run pci bus hotplug test 00:55:06.298 00:14:09.073 135 run_hotplug 00:55:06.298 00:14:09.073 136 00:55:06.298 00:14:09.073 137 # Run SPDK target based hotplug 00:55:06.298 00:14:09.073 => 138 tgt_run_hotplug 00:55:06.298 00:14:09.073 ... 00:55:06.298 00:14:09.073 00:55:06.298 00:14:09.073 ========== Backtrace end ========== 00:55:06.298 00:14:09.073 ========== Backtrace start: ========== 00:55:06.298 00:14:09.073 00:55:06.298 00:14:09.073 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:55:06.298 00:14:09.073 ... 00:55:06.298 00:14:09.073 713 # but $() will return just the time's data, hence making it possible to just do: 00:55:06.298 00:14:09.073 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:55:06.298 00:14:09.073 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:55:06.298 00:14:09.073 716 00:55:06.298 00:14:09.073 717 echo "$time" 00:55:06.298 00:14:09.073 => 718 ) 00:55:06.298 00:14:09.073 719 00:55:06.298 00:14:09.073 720 function timing_enter() { 00:55:06.298 00:14:09.073 721 xtrace_disable 00:55:06.298 00:14:09.073 722 timing "enter" "$1" 00:55:06.298 00:14:09.073 723 xtrace_restore 00:55:06.298 00:14:09.073 ... 00:55:06.298 00:14:09.073 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:55:06.298 00:14:09.073 ... 00:55:06.298 00:14:09.073 11 # Pci bus hotplug 00:55:06.298 00:14:09.073 12 # Helper function to remove/attach cotrollers 00:55:06.298 00:14:09.073 13 debug_remove_attach_helper() { 00:55:06.298 00:14:09.073 14 local helper_time=0 00:55:06.298 00:14:09.073 15 00:55:06.298 00:14:09.073 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:55:06.298 00:14:09.073 17 printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \ 00:55:06.298 00:14:09.073 18 "$helper_time" "$nvme_count" >&2 00:55:06.298 00:14:09.073 19 } 00:55:06.298 00:14:09.073 20 00:55:06.298 00:14:09.073 21 remove_attach_helper() { 00:55:06.298 00:14:09.073 ... 00:55:06.298 00:14:09.073 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:55:06.298 00:14:09.073 ... 00:55:06.298 00:14:09.073 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:55:06.298 00:14:09.073 106 done 00:55:06.298 00:14:09.073 107 00:55:06.298 00:14:09.073 108 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.298 00:14:09.073 109 00:55:06.298 00:14:09.073 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.298 00:14:09.073 111 # Verify reregistering hotplug poller 00:55:06.298 00:14:09.073 112 rpc_cmd bdev_nvme_set_hotplug -d 00:55:06.298 00:14:09.073 113 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.298 00:14:09.073 114 00:55:06.298 00:14:09.073 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.298 00:14:09.073 ... 00:55:06.298 00:14:09.073 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:55:06.298 00:14:09.073 ... 00:55:06.298 00:14:09.073 133 00:55:06.298 00:14:09.073 134 # Run pci bus hotplug test 00:55:06.298 00:14:09.073 135 run_hotplug 00:55:06.298 00:14:09.073 136 00:55:06.298 00:14:09.073 137 # Run SPDK target based hotplug 00:55:06.298 00:14:09.073 => 138 tgt_run_hotplug 00:55:06.298 00:14:09.073 ... 00:55:06.298 00:14:09.073 00:55:06.298 00:14:09.074 ========== Backtrace end ========== 00:55:06.298 00:14:09.074 ========== Backtrace start: ========== 00:55:06.298 00:14:09.074 00:55:06.298 00:14:09.074 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:55:06.298 00:14:09.074 ... 00:55:06.298 00:14:09.074 11 # Pci bus hotplug 00:55:06.298 00:14:09.074 12 # Helper function to remove/attach cotrollers 00:55:06.298 00:14:09.074 13 debug_remove_attach_helper() { 00:55:06.298 00:14:09.074 14 local helper_time=0 00:55:06.298 00:14:09.074 15 00:55:06.298 00:14:09.074 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:55:06.298 00:14:09.074 17 printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \ 00:55:06.298 00:14:09.074 18 "$helper_time" "$nvme_count" >&2 00:55:06.298 00:14:09.074 19 } 00:55:06.298 00:14:09.074 20 00:55:06.298 00:14:09.074 21 remove_attach_helper() { 00:55:06.298 00:14:09.074 ... 00:55:06.298 00:14:09.074 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:55:06.298 00:14:09.074 ... 00:55:06.298 00:14:09.074 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:55:06.298 00:14:09.074 106 done 00:55:06.298 00:14:09.074 107 00:55:06.298 00:14:09.074 108 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.298 00:14:09.074 109 00:55:06.298 00:14:09.074 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.298 00:14:09.074 111 # Verify reregistering hotplug poller 00:55:06.298 00:14:09.074 112 rpc_cmd bdev_nvme_set_hotplug -d 00:55:06.298 00:14:09.074 113 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.298 00:14:09.074 114 00:55:06.298 00:14:09.074 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.298 00:14:09.074 ... 00:55:06.298 00:14:09.074 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:55:06.298 00:14:09.074 ... 00:55:06.298 00:14:09.074 133 00:55:06.298 00:14:09.074 134 # Run pci bus hotplug test 00:55:06.298 00:14:09.074 135 run_hotplug 00:55:06.298 00:14:09.074 136 00:55:06.298 00:14:09.074 137 # Run SPDK target based hotplug 00:55:06.298 00:14:09.074 => 138 tgt_run_hotplug 00:55:06.298 00:14:09.074 ... 00:55:06.298 00:14:09.074 00:55:06.298 00:14:09.074 ========== Backtrace end ========== 00:55:06.298 00:14:09.642 ========== Backtrace start: ========== 00:55:06.298 00:14:09.642 00:55:06.299 00:14:09.642 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh"]) 00:55:06.299 00:14:09.642 ... 00:55:06.299 00:14:09.642 1117 timing_enter $test_name 00:55:06.299 00:14:09.642 1118 echo "************************************" 00:55:06.299 00:14:09.642 1119 echo "START TEST $test_name" 00:55:06.299 00:14:09.642 1120 echo "************************************" 00:55:06.299 00:14:09.642 1121 xtrace_restore 00:55:06.299 00:14:09.642 1122 time "$@" 00:55:06.299 00:14:09.642 1123 xtrace_disable 00:55:06.299 00:14:09.642 1124 echo "************************************" 00:55:06.299 00:14:09.642 1125 echo "END TEST $test_name" 00:55:06.299 00:14:09.642 1126 echo "************************************" 00:55:06.299 00:14:09.642 1127 timing_exit $test_name 00:55:06.299 00:14:09.642 ... 00:55:06.299 00:14:09.642 in /home/vagrant/spdk_repo/spdk/autotest.sh:240 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 00:55:06.299 00:14:09.642 ... 00:55:06.299 00:14:09.642 235 00:55:06.299 00:14:09.642 236 run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh 00:55:06.299 00:14:09.642 237 run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh 00:55:06.299 00:14:09.642 238 00:55:06.299 00:14:09.642 239 if [ $(uname -s) = Linux ]; then 00:55:06.299 00:14:09.642 => 240 run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh 00:55:06.299 00:14:09.642 241 fi 00:55:06.299 00:14:09.642 242 00:55:06.299 00:14:09.642 243 if [[ $SPDK_TEST_XNVME -eq 1 ]]; then 00:55:06.299 00:14:09.642 244 run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh 00:55:06.299 00:14:09.642 245 run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme" 00:55:06.299 00:14:09.642 ... 00:55:06.299 00:14:09.642 00:55:06.299 00:14:09.642 ========== Backtrace end ========== ]] 00:55:06.299 + echo '00:14:09.073 23:42:32 sw_hotplug -- common/autotest_common.sh@715 -- # time='\''========== Backtrace start: ========== 00:55:06.299 00:14:09.073 00:55:06.299 00:14:09.073 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:55:06.299 00:14:09.073 ... 00:55:06.299 00:14:09.073 710 00:55:06.299 00:14:09.073 711 # We redirect cmd'\''\'\'''\''s std{out,err} to a separate fd dup'\''\'\'''\''ed to stdin'\''\'\'''\''s device (or /dev/null) to 00:55:06.299 00:14:09.073 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 00:55:06.299 00:14:09.073 713 # but $() will return just the time'\''\'\'''\''s data, hence making it possible to just do: 00:55:06.299 00:14:09.073 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:55:06.299 00:14:09.073 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:55:06.299 00:14:09.073 716 00:55:06.299 00:14:09.073 717 echo "$time" 00:55:06.299 00:14:09.073 718 ) 00:55:06.299 00:14:09.073 719 00:55:06.299 00:14:09.073 720 function timing_enter() { 00:55:06.299 00:14:09.073 ... 00:55:06.299 00:14:09.073 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:55:06.299 00:14:09.073 ... 00:55:06.299 00:14:09.073 11 # Pci bus hotplug 00:55:06.299 00:14:09.073 12 # Helper function to remove/attach cotrollers 00:55:06.299 00:14:09.073 13 debug_remove_attach_helper() { 00:55:06.299 00:14:09.073 14 local helper_time=0 00:55:06.299 00:14:09.073 15 00:55:06.299 00:14:09.073 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:55:06.299 00:14:09.073 17 printf '\''\'\'''\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\''\'\'''\'' \ 00:55:06.299 00:14:09.073 18 "$helper_time" "$nvme_count" >&2 00:55:06.299 00:14:09.073 19 } 00:55:06.299 00:14:09.073 20 00:55:06.299 00:14:09.073 21 remove_attach_helper() { 00:55:06.299 00:14:09.073 ... 00:55:06.299 00:14:09.073 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:55:06.299 00:14:09.073 ... 00:55:06.299 00:14:09.073 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:55:06.299 00:14:09.073 106 done 00:55:06.299 00:14:09.073 107 00:55:06.299 00:14:09.073 108 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.299 00:14:09.073 109 00:55:06.299 00:14:09.073 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.299 00:14:09.073 111 # Verify reregistering hotplug poller 00:55:06.299 00:14:09.073 112 rpc_cmd bdev_nvme_set_hotplug -d 00:55:06.299 00:14:09.073 113 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.299 00:14:09.073 114 00:55:06.299 00:14:09.073 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.299 00:14:09.073 ... 00:55:06.299 00:14:09.073 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:55:06.299 00:14:09.073 ... 00:55:06.299 00:14:09.073 133 00:55:06.299 00:14:09.073 134 # Run pci bus hotplug test 00:55:06.299 00:14:09.073 135 run_hotplug 00:55:06.299 00:14:09.073 136 00:55:06.299 00:14:09.073 137 # Run SPDK target based hotplug 00:55:06.299 00:14:09.073 => 138 tgt_run_hotplug 00:55:06.299 00:14:09.073 ... 00:55:06.299 00:14:09.073 00:55:06.299 00:14:09.073 ========== Backtrace end =========='\'' 00:55:06.299 00:14:09.073 ========== Backtrace start: ========== 00:55:06.299 00:14:09.073 00:55:06.299 00:14:09.073 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:55:06.299 00:14:09.073 ... 00:55:06.299 00:14:09.073 710 00:55:06.299 00:14:09.073 711 # We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to 00:55:06.299 00:14:09.073 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 00:55:06.299 00:14:09.073 713 # but $() will return just the time'\''s data, hence making it possible to just do: 00:55:06.299 00:14:09.073 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:55:06.299 00:14:09.073 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:55:06.299 00:14:09.073 716 00:55:06.299 00:14:09.073 717 echo "$time" 00:55:06.299 00:14:09.073 718 ) 00:55:06.299 00:14:09.073 719 00:55:06.299 00:14:09.073 720 function timing_enter() { 00:55:06.299 00:14:09.073 ... 00:55:06.299 00:14:09.073 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:55:06.299 00:14:09.073 ... 00:55:06.299 00:14:09.073 11 # Pci bus hotplug 00:55:06.299 00:14:09.073 12 # Helper function to remove/attach cotrollers 00:55:06.299 00:14:09.073 13 debug_remove_attach_helper() { 00:55:06.299 00:14:09.073 14 local helper_time=0 00:55:06.299 00:14:09.073 15 00:55:06.299 00:14:09.073 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:55:06.299 00:14:09.073 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 00:55:06.299 00:14:09.073 18 "$helper_time" "$nvme_count" >&2 00:55:06.299 00:14:09.073 19 } 00:55:06.299 00:14:09.073 20 00:55:06.299 00:14:09.073 21 remove_attach_helper() { 00:55:06.299 00:14:09.073 ... 00:55:06.299 00:14:09.073 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:55:06.299 00:14:09.073 ... 00:55:06.299 00:14:09.073 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:55:06.299 00:14:09.073 106 done 00:55:06.299 00:14:09.073 107 00:55:06.299 00:14:09.073 108 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.299 00:14:09.073 109 00:55:06.299 00:14:09.073 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.299 00:14:09.073 111 # Verify reregistering hotplug poller 00:55:06.299 00:14:09.073 112 rpc_cmd bdev_nvme_set_hotplug -d 00:55:06.299 00:14:09.073 113 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.299 00:14:09.073 114 00:55:06.299 00:14:09.073 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.299 00:14:09.073 ... 00:55:06.299 00:14:09.073 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:55:06.299 00:14:09.073 ... 00:55:06.299 00:14:09.073 133 00:55:06.299 00:14:09.073 134 # Run pci bus hotplug test 00:55:06.299 00:14:09.073 135 run_hotplug 00:55:06.299 00:14:09.073 136 00:55:06.299 00:14:09.073 137 # Run SPDK target based hotplug 00:55:06.299 00:14:09.073 => 138 tgt_run_hotplug 00:55:06.299 00:14:09.073 ... 00:55:06.299 00:14:09.073 00:55:06.299 00:14:09.073 ========== Backtrace end ========== 00:55:06.299 00:14:09.073 ========== Backtrace start: ========== 00:55:06.299 00:14:09.073 00:55:06.299 00:14:09.073 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:55:06.299 00:14:09.073 ... 00:55:06.299 00:14:09.073 713 # but $() will return just the time'\''s data, hence making it possible to just do: 00:55:06.299 00:14:09.073 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:55:06.299 00:14:09.073 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:55:06.299 00:14:09.073 716 00:55:06.299 00:14:09.073 717 echo "$time" 00:55:06.299 00:14:09.073 => 718 ) 00:55:06.299 00:14:09.073 719 00:55:06.299 00:14:09.073 720 function timing_enter() { 00:55:06.299 00:14:09.073 721 xtrace_disable 00:55:06.299 00:14:09.073 722 timing "enter" "$1" 00:55:06.299 00:14:09.073 723 xtrace_restore 00:55:06.299 00:14:09.073 ... 00:55:06.300 00:14:09.073 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:55:06.300 00:14:09.073 ... 00:55:06.300 00:14:09.073 11 # Pci bus hotplug 00:55:06.300 00:14:09.073 12 # Helper function to remove/attach cotrollers 00:55:06.300 00:14:09.073 13 debug_remove_attach_helper() { 00:55:06.300 00:14:09.073 14 local helper_time=0 00:55:06.300 00:14:09.073 15 00:55:06.300 00:14:09.073 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:55:06.300 00:14:09.073 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 00:55:06.300 00:14:09.073 18 "$helper_time" "$nvme_count" >&2 00:55:06.300 00:14:09.073 19 } 00:55:06.300 00:14:09.073 20 00:55:06.300 00:14:09.073 21 remove_attach_helper() { 00:55:06.300 00:14:09.073 ... 00:55:06.300 00:14:09.073 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:55:06.300 00:14:09.073 ... 00:55:06.300 00:14:09.073 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:55:06.300 00:14:09.073 106 done 00:55:06.300 00:14:09.073 107 00:55:06.300 00:14:09.073 108 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.300 00:14:09.073 109 00:55:06.300 00:14:09.073 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.300 00:14:09.073 111 # Verify reregistering hotplug poller 00:55:06.300 00:14:09.073 112 rpc_cmd bdev_nvme_set_hotplug -d 00:55:06.300 00:14:09.073 113 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.300 00:14:09.073 114 00:55:06.300 00:14:09.073 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.300 00:14:09.073 ... 00:55:06.300 00:14:09.073 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:55:06.300 00:14:09.073 ... 00:55:06.300 00:14:09.073 133 00:55:06.300 00:14:09.073 134 # Run pci bus hotplug test 00:55:06.300 00:14:09.073 135 run_hotplug 00:55:06.300 00:14:09.073 136 00:55:06.300 00:14:09.073 137 # Run SPDK target based hotplug 00:55:06.300 00:14:09.073 => 138 tgt_run_hotplug 00:55:06.300 00:14:09.073 ... 00:55:06.300 00:14:09.073 00:55:06.300 00:14:09.074 ========== Backtrace end ========== 00:55:06.300 00:14:09.074 ========== Backtrace start: ========== 00:55:06.300 00:14:09.074 00:55:06.300 00:14:09.074 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:55:06.300 00:14:09.074 ... 00:55:06.300 00:14:09.074 11 # Pci bus hotplug 00:55:06.300 00:14:09.074 12 # Helper function to remove/attach cotrollers 00:55:06.300 00:14:09.074 13 debug_remove_attach_helper() { 00:55:06.300 00:14:09.074 14 local helper_time=0 00:55:06.300 00:14:09.074 15 00:55:06.300 00:14:09.074 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:55:06.300 00:14:09.074 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 00:55:06.300 00:14:09.074 18 "$helper_time" "$nvme_count" >&2 00:55:06.300 00:14:09.074 19 } 00:55:06.300 00:14:09.074 20 00:55:06.300 00:14:09.074 21 remove_attach_helper() { 00:55:06.300 00:14:09.074 ... 00:55:06.300 00:14:09.074 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:55:06.300 00:14:09.074 ... 00:55:06.300 00:14:09.074 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:55:06.300 00:14:09.074 106 done 00:55:06.300 00:14:09.074 107 00:55:06.300 00:14:09.074 108 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.300 00:14:09.074 109 00:55:06.300 00:14:09.074 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.300 00:14:09.074 111 # Verify reregistering hotplug poller 00:55:06.300 00:14:09.074 112 rpc_cmd bdev_nvme_set_hotplug -d 00:55:06.300 00:14:09.074 113 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.300 00:14:09.074 114 00:55:06.300 00:14:09.074 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.300 00:14:09.074 ... 00:55:06.300 00:14:09.074 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:55:06.300 00:14:09.074 ... 00:55:06.300 00:14:09.074 133 00:55:06.300 00:14:09.074 134 # Run pci bus hotplug test 00:55:06.300 00:14:09.074 135 run_hotplug 00:55:06.300 00:14:09.074 136 00:55:06.300 00:14:09.074 137 # Run SPDK target based hotplug 00:55:06.300 00:14:09.074 => 138 tgt_run_hotplug 00:55:06.300 00:14:09.074 ... 00:55:06.300 00:14:09.074 00:55:06.300 00:14:09.074 ========== Backtrace end ========== 00:55:06.300 00:14:09.642 ========== Backtrace start: ========== 00:55:06.300 00:14:09.642 00:55:06.300 00:14:09.642 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh"]) 00:55:06.300 00:14:09.642 ... 00:55:06.300 00:14:09.642 1117 timing_enter $test_name 00:55:06.300 00:14:09.642 1118 echo "************************************" 00:55:06.300 00:14:09.642 1119 echo "START TEST $test_name" 00:55:06.300 00:14:09.642 1120 echo "************************************" 00:55:06.300 00:14:09.642 1121 xtrace_restore 00:55:06.300 00:14:09.642 1122 time "$@" 00:55:06.300 00:14:09.642 1123 xtrace_disable 00:55:06.300 00:14:09.642 1124 echo "************************************" 00:55:06.300 00:14:09.642 1125 echo "END TEST $test_name" 00:55:06.300 00:14:09.642 1126 echo "************************************" 00:55:06.300 00:14:09.642 1127 timing_exit $test_name 00:55:06.300 00:14:09.642 ... 00:55:06.300 00:14:09.642 in /home/vagrant/spdk_repo/spdk/autotest.sh:240 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 00:55:06.300 00:14:09.642 ... 00:55:06.300 00:14:09.642 235 00:55:06.300 00:14:09.642 236 run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh 00:55:06.300 00:14:09.642 237 run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh 00:55:06.300 00:14:09.642 238 00:55:06.300 00:14:09.642 239 if [ $(uname -s) = Linux ]; then 00:55:06.300 00:14:09.642 => 240 run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh 00:55:06.300 00:14:09.642 241 fi 00:55:06.300 00:14:09.642 242 00:55:06.300 00:14:09.642 243 if [[ $SPDK_TEST_XNVME -eq 1 ]]; then 00:55:06.300 00:14:09.642 244 run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh 00:55:06.300 00:14:09.642 245 run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme" 00:55:06.300 00:14:09.642 ... 00:55:06.300 00:14:09.642 00:55:06.300 00:14:09.642 ========== Backtrace end ==========' 00:55:06.300 + for build in "${build_log_list[@]}" 00:55:06.300 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vhost-phy-autotest_26169/build.log 00:55:06.300 + local build_log job_name start_pattern end_pattern backtraces 00:55:06.300 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vhost-phy-autotest_26169/build.log 00:55:06.300 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vhost-phy-autotest_26169/build.log 00:55:06.300 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vhost-phy-autotest_26169 00:55:06.300 + job_name=vhost-phy-autotest_26169 00:55:06.300 + start_pattern='Backtrace start' 00:55:06.300 + end_pattern='Backtrace end' 00:55:06.300 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vhost-phy-autotest_26169/build.log ]] 00:55:06.300 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vhost-phy-autotest_26169/build.log 00:55:06.300 + backtraces= 00:55:06.300 + [[ -n '' ]] 00:55:06.300 + for build in "${build_log_list[@]}" 00:55:06.300 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/autobuild-vg-autotest_63412/build.log 00:55:06.300 + local build_log job_name start_pattern end_pattern backtraces 00:55:06.300 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/autobuild-vg-autotest_63412/build.log 00:55:06.300 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/autobuild-vg-autotest_63412/build.log 00:55:06.300 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/autobuild-vg-autotest_63412 00:55:06.300 + job_name=autobuild-vg-autotest_63412 00:55:06.300 + start_pattern='Backtrace start' 00:55:06.300 + end_pattern='Backtrace end' 00:55:06.300 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/autobuild-vg-autotest_63412/build.log ]] 00:55:06.300 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/autobuild-vg-autotest_63412/build.log 00:55:06.300 + backtraces= 00:55:06.300 + [[ -n '' ]] 00:55:06.300 + for build in "${build_log_list[@]}" 00:55:06.300 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/rocky9-vg-autotest_16034/build.log 00:55:06.300 + local build_log job_name start_pattern end_pattern backtraces 00:55:06.300 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/rocky9-vg-autotest_16034/build.log 00:55:06.300 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/rocky9-vg-autotest_16034/build.log 00:55:06.300 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/rocky9-vg-autotest_16034 00:55:06.300 + job_name=rocky9-vg-autotest_16034 00:55:06.300 + start_pattern='Backtrace start' 00:55:06.300 + end_pattern='Backtrace end' 00:55:06.300 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/rocky9-vg-autotest_16034/build.log ]] 00:55:06.300 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/rocky9-vg-autotest_16034/build.log 00:55:06.300 + backtraces= 00:55:06.300 + [[ -n '' ]] 00:55:06.300 + for build in "${build_log_list[@]}" 00:55:06.300 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-phy-autotest_72275/build.log 00:55:06.300 + local build_log job_name start_pattern end_pattern backtraces 00:55:06.301 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-phy-autotest_72275/build.log 00:55:06.301 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-phy-autotest_72275/build.log 00:55:06.301 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-phy-autotest_72275 00:55:06.301 + job_name=nvmf-tcp-phy-autotest_72275 00:55:06.301 + start_pattern='Backtrace start' 00:55:06.301 + end_pattern='Backtrace end' 00:55:06.301 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-phy-autotest_72275/build.log ]] 00:55:06.301 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-phy-autotest_72275/build.log 00:55:06.301 + backtraces= 00:55:06.301 + [[ -n '' ]] 00:55:06.301 + for build in "${build_log_list[@]}" 00:55:06.301 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/ubuntu22-vg-autotest_37757/build.log 00:55:06.301 + local build_log job_name start_pattern end_pattern backtraces 00:55:06.301 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/ubuntu22-vg-autotest_37757/build.log 00:55:06.301 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/ubuntu22-vg-autotest_37757/build.log 00:55:06.301 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/ubuntu22-vg-autotest_37757 00:55:06.301 + job_name=ubuntu22-vg-autotest_37757 00:55:06.301 + start_pattern='Backtrace start' 00:55:06.301 + end_pattern='Backtrace end' 00:55:06.301 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/ubuntu22-vg-autotest_37757/build.log ]] 00:55:06.301 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/ubuntu22-vg-autotest_37757/build.log 00:55:06.301 + backtraces= 00:55:06.301 + [[ -n '' ]] 00:55:06.301 + for build in "${build_log_list[@]}" 00:55:06.301 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/unittest-vg-autotest_63369/build.log 00:55:06.301 + local build_log job_name start_pattern end_pattern backtraces 00:55:06.301 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/unittest-vg-autotest_63369/build.log 00:55:06.301 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/unittest-vg-autotest_63369/build.log 00:55:06.301 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/unittest-vg-autotest_63369 00:55:06.301 + job_name=unittest-vg-autotest_63369 00:55:06.301 + start_pattern='Backtrace start' 00:55:06.301 + end_pattern='Backtrace end' 00:55:06.301 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/unittest-vg-autotest_63369/build.log ]] 00:55:06.301 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/unittest-vg-autotest_63369/build.log 00:55:06.301 + backtraces= 00:55:06.301 + [[ -n '' ]] 00:55:06.301 + for build in "${build_log_list[@]}" 00:55:06.301 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/ubuntu20-vg-autotest_73743/build.log 00:55:06.301 + local build_log job_name start_pattern end_pattern backtraces 00:55:06.301 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/ubuntu20-vg-autotest_73743/build.log 00:55:06.301 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/ubuntu20-vg-autotest_73743/build.log 00:55:06.301 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/ubuntu20-vg-autotest_73743 00:55:06.301 + job_name=ubuntu20-vg-autotest_73743 00:55:06.301 + start_pattern='Backtrace start' 00:55:06.301 + end_pattern='Backtrace end' 00:55:06.301 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/ubuntu20-vg-autotest_73743/build.log ]] 00:55:06.301 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/ubuntu20-vg-autotest_73743/build.log 00:55:06.301 + backtraces='00:43:27.181 00:11:49 sw_hotplug -- common/autotest_common.sh@715 -- # time='\''========== Backtrace start: ========== 00:55:06.301 00:43:27.181 00:55:06.301 00:43:27.181 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:55:06.301 00:43:27.181 ... 00:55:06.301 00:43:27.181 710 00:55:06.301 00:43:27.181 711 # We redirect cmd'\''\'\'''\''s std{out,err} to a separate fd dup'\''\'\'''\''ed to stdin'\''\'\'''\''s device (or /dev/null) to 00:55:06.301 00:43:27.181 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 00:55:06.301 00:43:27.181 713 # but $() will return just the time'\''\'\'''\''s data, hence making it possible to just do: 00:55:06.301 00:43:27.181 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:55:06.301 00:43:27.181 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:55:06.301 00:43:27.181 716 00:55:06.301 00:43:27.181 717 echo "$time" 00:55:06.301 00:43:27.181 718 ) 00:55:06.301 00:43:27.181 719 00:55:06.301 00:43:27.181 720 function timing_enter() { 00:55:06.301 00:43:27.181 ... 00:55:06.301 00:43:27.181 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:55:06.301 00:43:27.181 ... 00:55:06.301 00:43:27.181 11 # Pci bus hotplug 00:55:06.301 00:43:27.181 12 # Helper function to remove/attach cotrollers 00:55:06.301 00:43:27.181 13 debug_remove_attach_helper() { 00:55:06.301 00:43:27.181 14 local helper_time=0 00:55:06.301 00:43:27.181 15 00:55:06.301 00:43:27.181 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:55:06.301 00:43:27.181 17 printf '\''\'\'''\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\''\'\'''\'' \ 00:55:06.301 00:43:27.181 18 "$helper_time" "$nvme_count" >&2 00:55:06.301 00:43:27.181 19 } 00:55:06.301 00:43:27.181 20 00:55:06.301 00:43:27.181 21 remove_attach_helper() { 00:55:06.301 00:43:27.181 ... 00:55:06.301 00:43:27.181 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:55:06.301 00:43:27.181 ... 00:55:06.301 00:43:27.181 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:55:06.301 00:43:27.181 106 done 00:55:06.301 00:43:27.181 107 00:55:06.301 00:43:27.181 108 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.301 00:43:27.181 109 00:55:06.301 00:43:27.181 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.301 00:43:27.181 111 # Verify reregistering hotplug poller 00:55:06.301 00:43:27.181 112 rpc_cmd bdev_nvme_set_hotplug -d 00:55:06.301 00:43:27.181 113 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.301 00:43:27.181 114 00:55:06.301 00:43:27.181 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.301 00:43:27.181 ... 00:55:06.301 00:43:27.181 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:55:06.301 00:43:27.181 ... 00:55:06.301 00:43:27.181 133 00:55:06.301 00:43:27.181 134 # Run pci bus hotplug test 00:55:06.301 00:43:27.181 135 run_hotplug 00:55:06.301 00:43:27.181 136 00:55:06.301 00:43:27.181 137 # Run SPDK target based hotplug 00:55:06.301 00:43:27.181 => 138 tgt_run_hotplug 00:55:06.301 00:43:27.181 ... 00:55:06.301 00:43:27.181 00:55:06.301 00:43:27.181 ========== Backtrace end ========== 00:55:06.301 00:43:27.181 ========== Backtrace start: ========== 00:55:06.301 00:43:27.181 00:55:06.301 00:43:27.181 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:55:06.301 00:43:27.181 ... 00:55:06.301 00:43:27.181 710 00:55:06.301 00:43:27.181 711 # We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to 00:55:06.301 00:43:27.181 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 00:55:06.301 00:43:27.181 713 # but $() will return just the time'\''s data, hence making it possible to just do: 00:55:06.301 00:43:27.181 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:55:06.301 00:43:27.181 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:55:06.301 00:43:27.181 716 00:55:06.301 00:43:27.181 717 echo "$time" 00:55:06.301 00:43:27.181 718 ) 00:55:06.301 00:43:27.181 719 00:55:06.301 00:43:27.181 720 function timing_enter() { 00:55:06.301 00:43:27.181 ... 00:55:06.302 00:43:27.181 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:55:06.302 00:43:27.181 ... 00:55:06.302 00:43:27.181 11 # Pci bus hotplug 00:55:06.302 00:43:27.181 12 # Helper function to remove/attach cotrollers 00:55:06.302 00:43:27.181 13 debug_remove_attach_helper() { 00:55:06.302 00:43:27.181 14 local helper_time=0 00:55:06.302 00:43:27.181 15 00:55:06.302 00:43:27.181 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:55:06.302 00:43:27.181 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 00:55:06.302 00:43:27.181 18 "$helper_time" "$nvme_count" >&2 00:55:06.302 00:43:27.181 19 } 00:55:06.302 00:43:27.181 20 00:55:06.302 00:43:27.181 21 remove_attach_helper() { 00:55:06.302 00:43:27.181 ... 00:55:06.302 00:43:27.181 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:55:06.302 00:43:27.181 ... 00:55:06.302 00:43:27.181 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:55:06.302 00:43:27.181 106 done 00:55:06.302 00:43:27.181 107 00:55:06.302 00:43:27.181 108 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.302 00:43:27.181 109 00:55:06.302 00:43:27.181 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.302 00:43:27.181 111 # Verify reregistering hotplug poller 00:55:06.302 00:43:27.182 112 rpc_cmd bdev_nvme_set_hotplug -d 00:55:06.302 00:43:27.182 113 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.302 00:43:27.182 114 00:55:06.302 00:43:27.182 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.302 00:43:27.182 ... 00:55:06.302 00:43:27.182 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:55:06.302 00:43:27.182 ... 00:55:06.302 00:43:27.182 133 00:55:06.302 00:43:27.182 134 # Run pci bus hotplug test 00:55:06.302 00:43:27.182 135 run_hotplug 00:55:06.302 00:43:27.182 136 00:55:06.302 00:43:27.182 137 # Run SPDK target based hotplug 00:55:06.302 00:43:27.182 => 138 tgt_run_hotplug 00:55:06.302 00:43:27.182 ... 00:55:06.302 00:43:27.182 00:55:06.302 00:43:27.182 ========== Backtrace end ========== 00:55:06.302 00:43:27.182 ========== Backtrace start: ========== 00:55:06.302 00:43:27.182 00:55:06.302 00:43:27.182 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:55:06.302 00:43:27.182 ... 00:55:06.302 00:43:27.182 713 # but $() will return just the time'\''s data, hence making it possible to just do: 00:55:06.302 00:43:27.182 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:55:06.302 00:43:27.182 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:55:06.302 00:43:27.182 716 00:55:06.302 00:43:27.182 717 echo "$time" 00:55:06.302 00:43:27.182 => 718 ) 00:55:06.302 00:43:27.182 719 00:55:06.302 00:43:27.182 720 function timing_enter() { 00:55:06.302 00:43:27.182 721 xtrace_disable 00:55:06.302 00:43:27.182 722 timing "enter" "$1" 00:55:06.302 00:43:27.182 723 xtrace_restore 00:55:06.302 00:43:27.182 ... 00:55:06.302 00:43:27.182 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:55:06.302 00:43:27.182 ... 00:55:06.302 00:43:27.182 11 # Pci bus hotplug 00:55:06.302 00:43:27.182 12 # Helper function to remove/attach cotrollers 00:55:06.302 00:43:27.182 13 debug_remove_attach_helper() { 00:55:06.302 00:43:27.182 14 local helper_time=0 00:55:06.302 00:43:27.182 15 00:55:06.302 00:43:27.182 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:55:06.302 00:43:27.182 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 00:55:06.302 00:43:27.182 18 "$helper_time" "$nvme_count" >&2 00:55:06.302 00:43:27.182 19 } 00:55:06.302 00:43:27.182 20 00:55:06.302 00:43:27.182 21 remove_attach_helper() { 00:55:06.302 00:43:27.182 ... 00:55:06.302 00:43:27.182 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:55:06.302 00:43:27.182 ... 00:55:06.302 00:43:27.182 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:55:06.302 00:43:27.182 106 done 00:55:06.302 00:43:27.182 107 00:55:06.302 00:43:27.182 108 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.302 00:43:27.182 109 00:55:06.302 00:43:27.182 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.302 00:43:27.182 111 # Verify reregistering hotplug poller 00:55:06.302 00:43:27.182 112 rpc_cmd bdev_nvme_set_hotplug -d 00:55:06.302 00:43:27.182 113 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.302 00:43:27.182 114 00:55:06.302 00:43:27.182 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.302 00:43:27.182 ... 00:55:06.302 00:43:27.182 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:55:06.302 00:43:27.182 ... 00:55:06.302 00:43:27.182 133 00:55:06.302 00:43:27.182 134 # Run pci bus hotplug test 00:55:06.302 00:43:27.182 135 run_hotplug 00:55:06.302 00:43:27.182 136 00:55:06.302 00:43:27.182 137 # Run SPDK target based hotplug 00:55:06.302 00:43:27.182 => 138 tgt_run_hotplug 00:55:06.302 00:43:27.182 ... 00:55:06.302 00:43:27.182 00:55:06.302 00:43:27.182 ========== Backtrace end ========== 00:55:06.302 00:43:27.182 ========== Backtrace start: ========== 00:55:06.302 00:43:27.182 00:55:06.302 00:43:27.182 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:55:06.302 00:43:27.182 ... 00:55:06.302 00:43:27.182 11 # Pci bus hotplug 00:55:06.302 00:43:27.182 12 # Helper function to remove/attach cotrollers 00:55:06.302 00:43:27.182 13 debug_remove_attach_helper() { 00:55:06.302 00:43:27.182 14 local helper_time=0 00:55:06.302 00:43:27.182 15 00:55:06.302 00:43:27.182 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:55:06.302 00:43:27.182 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 00:55:06.302 00:43:27.182 18 "$helper_time" "$nvme_count" >&2 00:55:06.302 00:43:27.182 19 } 00:55:06.302 00:43:27.182 20 00:55:06.302 00:43:27.182 21 remove_attach_helper() { 00:55:06.302 00:43:27.182 ... 00:55:06.302 00:43:27.182 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:55:06.302 00:43:27.182 ... 00:55:06.302 00:43:27.182 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:55:06.302 00:43:27.182 106 done 00:55:06.302 00:43:27.182 107 00:55:06.302 00:43:27.182 108 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.302 00:43:27.182 109 00:55:06.302 00:43:27.182 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.302 00:43:27.182 111 # Verify reregistering hotplug poller 00:55:06.302 00:43:27.182 112 rpc_cmd bdev_nvme_set_hotplug -d 00:55:06.302 00:43:27.182 113 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.302 00:43:27.182 114 00:55:06.302 00:43:27.182 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.302 00:43:27.182 ... 00:55:06.302 00:43:27.182 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:55:06.302 00:43:27.182 ... 00:55:06.302 00:43:27.182 133 00:55:06.302 00:43:27.182 134 # Run pci bus hotplug test 00:55:06.302 00:43:27.182 135 run_hotplug 00:55:06.302 00:43:27.182 136 00:55:06.302 00:43:27.182 137 # Run SPDK target based hotplug 00:55:06.302 00:43:27.182 => 138 tgt_run_hotplug 00:55:06.302 00:43:27.182 ... 00:55:06.302 00:43:27.182 00:55:06.302 00:43:27.182 ========== Backtrace end ========== 00:55:06.302 00:43:27.182 ========== Backtrace start: ========== 00:55:06.302 00:43:27.182 00:55:06.302 00:43:27.182 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh"]) 00:55:06.302 00:43:27.182 ... 00:55:06.302 00:43:27.182 1117 timing_enter $test_name 00:55:06.302 00:43:27.182 1118 echo "************************************" 00:55:06.302 00:43:27.182 1119 echo "START TEST $test_name" 00:55:06.302 00:43:27.182 1120 echo "************************************" 00:55:06.302 00:43:27.182 1121 xtrace_restore 00:55:06.302 00:43:27.182 1122 time "$@" 00:55:06.302 00:43:27.182 1123 xtrace_disable 00:55:06.302 00:43:27.182 1124 echo "************************************" 00:55:06.302 00:43:27.182 1125 echo "END TEST $test_name" 00:55:06.302 00:43:27.182 1126 echo "************************************" 00:55:06.302 00:43:27.182 1127 timing_exit $test_name 00:55:06.302 00:43:27.182 ... 00:55:06.302 00:43:27.182 in /home/vagrant/spdk_repo/spdk/autotest.sh:240 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 00:55:06.302 00:43:27.182 ... 00:55:06.302 00:43:27.182 235 00:55:06.302 00:43:27.182 236 run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh 00:55:06.302 00:43:27.182 237 run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh 00:55:06.302 00:43:27.182 238 00:55:06.302 00:43:27.182 239 if [ $(uname -s) = Linux ]; then 00:55:06.302 00:43:27.182 => 240 run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh 00:55:06.302 00:43:27.182 241 fi 00:55:06.302 00:43:27.182 242 00:55:06.302 00:43:27.182 243 if [[ $SPDK_TEST_XNVME -eq 1 ]]; then 00:55:06.302 00:43:27.182 244 run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh 00:55:06.302 00:43:27.182 245 run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme" 00:55:06.302 00:43:27.182 ... 00:55:06.302 00:43:27.182 00:55:06.302 00:43:27.182 ========== Backtrace end ==========' 00:55:06.303 + [[ -n 00:43:27.181 00:11:49 sw_hotplug -- common/autotest_common.sh@715 -- # time='========== Backtrace start: ========== 00:55:06.303 00:43:27.181 00:55:06.303 00:43:27.181 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:55:06.303 00:43:27.181 ... 00:55:06.303 00:43:27.181 710 00:55:06.303 00:43:27.181 711 # We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to 00:55:06.303 00:43:27.181 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 00:55:06.303 00:43:27.181 713 # but $() will return just the time'\''s data, hence making it possible to just do: 00:55:06.303 00:43:27.181 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:55:06.303 00:43:27.181 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:55:06.303 00:43:27.181 716 00:55:06.303 00:43:27.181 717 echo "$time" 00:55:06.303 00:43:27.181 718 ) 00:55:06.303 00:43:27.181 719 00:55:06.303 00:43:27.181 720 function timing_enter() { 00:55:06.303 00:43:27.181 ... 00:55:06.303 00:43:27.181 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:55:06.303 00:43:27.181 ... 00:55:06.303 00:43:27.181 11 # Pci bus hotplug 00:55:06.303 00:43:27.181 12 # Helper function to remove/attach cotrollers 00:55:06.303 00:43:27.181 13 debug_remove_attach_helper() { 00:55:06.303 00:43:27.181 14 local helper_time=0 00:55:06.303 00:43:27.181 15 00:55:06.303 00:43:27.181 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:55:06.303 00:43:27.181 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 00:55:06.303 00:43:27.181 18 "$helper_time" "$nvme_count" >&2 00:55:06.303 00:43:27.181 19 } 00:55:06.303 00:43:27.181 20 00:55:06.303 00:43:27.181 21 remove_attach_helper() { 00:55:06.303 00:43:27.181 ... 00:55:06.303 00:43:27.181 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:55:06.303 00:43:27.181 ... 00:55:06.303 00:43:27.181 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:55:06.303 00:43:27.181 106 done 00:55:06.303 00:43:27.181 107 00:55:06.303 00:43:27.181 108 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.303 00:43:27.181 109 00:55:06.303 00:43:27.181 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.303 00:43:27.181 111 # Verify reregistering hotplug poller 00:55:06.303 00:43:27.181 112 rpc_cmd bdev_nvme_set_hotplug -d 00:55:06.303 00:43:27.181 113 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.303 00:43:27.181 114 00:55:06.303 00:43:27.181 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.303 00:43:27.181 ... 00:55:06.303 00:43:27.181 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:55:06.303 00:43:27.181 ... 00:55:06.303 00:43:27.181 133 00:55:06.303 00:43:27.181 134 # Run pci bus hotplug test 00:55:06.303 00:43:27.181 135 run_hotplug 00:55:06.303 00:43:27.181 136 00:55:06.303 00:43:27.181 137 # Run SPDK target based hotplug 00:55:06.303 00:43:27.181 => 138 tgt_run_hotplug 00:55:06.303 00:43:27.181 ... 00:55:06.303 00:43:27.181 00:55:06.303 00:43:27.181 ========== Backtrace end ========== 00:55:06.303 00:43:27.181 ========== Backtrace start: ========== 00:55:06.303 00:43:27.181 00:55:06.303 00:43:27.181 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:55:06.303 00:43:27.181 ... 00:55:06.303 00:43:27.181 710 00:55:06.303 00:43:27.181 711 # We redirect cmd's std{out,err} to a separate fd dup'ed to stdin's device (or /dev/null) to 00:55:06.303 00:43:27.181 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 00:55:06.303 00:43:27.181 713 # but $() will return just the time's data, hence making it possible to just do: 00:55:06.303 00:43:27.181 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:55:06.303 00:43:27.181 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:55:06.303 00:43:27.181 716 00:55:06.303 00:43:27.181 717 echo "$time" 00:55:06.303 00:43:27.181 718 ) 00:55:06.303 00:43:27.181 719 00:55:06.303 00:43:27.181 720 function timing_enter() { 00:55:06.303 00:43:27.181 ... 00:55:06.303 00:43:27.181 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:55:06.303 00:43:27.181 ... 00:55:06.303 00:43:27.181 11 # Pci bus hotplug 00:55:06.303 00:43:27.181 12 # Helper function to remove/attach cotrollers 00:55:06.303 00:43:27.181 13 debug_remove_attach_helper() { 00:55:06.303 00:43:27.181 14 local helper_time=0 00:55:06.303 00:43:27.181 15 00:55:06.303 00:43:27.181 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:55:06.303 00:43:27.181 17 printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \ 00:55:06.303 00:43:27.181 18 "$helper_time" "$nvme_count" >&2 00:55:06.303 00:43:27.181 19 } 00:55:06.303 00:43:27.181 20 00:55:06.303 00:43:27.181 21 remove_attach_helper() { 00:55:06.303 00:43:27.181 ... 00:55:06.303 00:43:27.181 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:55:06.303 00:43:27.181 ... 00:55:06.303 00:43:27.181 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:55:06.303 00:43:27.181 106 done 00:55:06.303 00:43:27.181 107 00:55:06.303 00:43:27.181 108 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.303 00:43:27.181 109 00:55:06.303 00:43:27.181 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.303 00:43:27.181 111 # Verify reregistering hotplug poller 00:55:06.303 00:43:27.182 112 rpc_cmd bdev_nvme_set_hotplug -d 00:55:06.303 00:43:27.182 113 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.303 00:43:27.182 114 00:55:06.303 00:43:27.182 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.303 00:43:27.182 ... 00:55:06.303 00:43:27.182 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:55:06.303 00:43:27.182 ... 00:55:06.303 00:43:27.182 133 00:55:06.303 00:43:27.182 134 # Run pci bus hotplug test 00:55:06.303 00:43:27.182 135 run_hotplug 00:55:06.303 00:43:27.182 136 00:55:06.303 00:43:27.182 137 # Run SPDK target based hotplug 00:55:06.303 00:43:27.182 => 138 tgt_run_hotplug 00:55:06.303 00:43:27.182 ... 00:55:06.303 00:43:27.182 00:55:06.303 00:43:27.182 ========== Backtrace end ========== 00:55:06.303 00:43:27.182 ========== Backtrace start: ========== 00:55:06.303 00:43:27.182 00:55:06.303 00:43:27.182 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:55:06.303 00:43:27.182 ... 00:55:06.303 00:43:27.182 713 # but $() will return just the time's data, hence making it possible to just do: 00:55:06.303 00:43:27.182 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:55:06.303 00:43:27.182 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:55:06.303 00:43:27.182 716 00:55:06.303 00:43:27.182 717 echo "$time" 00:55:06.303 00:43:27.182 => 718 ) 00:55:06.303 00:43:27.182 719 00:55:06.303 00:43:27.182 720 function timing_enter() { 00:55:06.303 00:43:27.182 721 xtrace_disable 00:55:06.303 00:43:27.182 722 timing "enter" "$1" 00:55:06.303 00:43:27.182 723 xtrace_restore 00:55:06.303 00:43:27.182 ... 00:55:06.303 00:43:27.182 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:55:06.303 00:43:27.182 ... 00:55:06.303 00:43:27.182 11 # Pci bus hotplug 00:55:06.303 00:43:27.182 12 # Helper function to remove/attach cotrollers 00:55:06.303 00:43:27.182 13 debug_remove_attach_helper() { 00:55:06.303 00:43:27.182 14 local helper_time=0 00:55:06.303 00:43:27.182 15 00:55:06.303 00:43:27.182 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:55:06.303 00:43:27.182 17 printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \ 00:55:06.303 00:43:27.182 18 "$helper_time" "$nvme_count" >&2 00:55:06.303 00:43:27.182 19 } 00:55:06.303 00:43:27.182 20 00:55:06.303 00:43:27.182 21 remove_attach_helper() { 00:55:06.303 00:43:27.182 ... 00:55:06.303 00:43:27.182 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:55:06.303 00:43:27.182 ... 00:55:06.303 00:43:27.182 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:55:06.303 00:43:27.182 106 done 00:55:06.303 00:43:27.182 107 00:55:06.303 00:43:27.182 108 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.303 00:43:27.182 109 00:55:06.303 00:43:27.182 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.303 00:43:27.182 111 # Verify reregistering hotplug poller 00:55:06.304 00:43:27.182 112 rpc_cmd bdev_nvme_set_hotplug -d 00:55:06.304 00:43:27.182 113 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.304 00:43:27.182 114 00:55:06.304 00:43:27.182 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.304 00:43:27.182 ... 00:55:06.304 00:43:27.182 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:55:06.304 00:43:27.182 ... 00:55:06.304 00:43:27.182 133 00:55:06.304 00:43:27.182 134 # Run pci bus hotplug test 00:55:06.304 00:43:27.182 135 run_hotplug 00:55:06.304 00:43:27.182 136 00:55:06.304 00:43:27.182 137 # Run SPDK target based hotplug 00:55:06.304 00:43:27.182 => 138 tgt_run_hotplug 00:55:06.304 00:43:27.182 ... 00:55:06.304 00:43:27.182 00:55:06.304 00:43:27.182 ========== Backtrace end ========== 00:55:06.304 00:43:27.182 ========== Backtrace start: ========== 00:55:06.304 00:43:27.182 00:55:06.304 00:43:27.182 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:55:06.304 00:43:27.182 ... 00:55:06.304 00:43:27.182 11 # Pci bus hotplug 00:55:06.304 00:43:27.182 12 # Helper function to remove/attach cotrollers 00:55:06.304 00:43:27.182 13 debug_remove_attach_helper() { 00:55:06.304 00:43:27.182 14 local helper_time=0 00:55:06.304 00:43:27.182 15 00:55:06.304 00:43:27.182 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:55:06.304 00:43:27.182 17 printf 'remove_attach_helper took %ss to complete (handling %u nvme drive(s))' \ 00:55:06.304 00:43:27.182 18 "$helper_time" "$nvme_count" >&2 00:55:06.304 00:43:27.182 19 } 00:55:06.304 00:43:27.182 20 00:55:06.304 00:43:27.182 21 remove_attach_helper() { 00:55:06.304 00:43:27.182 ... 00:55:06.304 00:43:27.182 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:55:06.304 00:43:27.182 ... 00:55:06.304 00:43:27.182 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:55:06.304 00:43:27.182 106 done 00:55:06.304 00:43:27.182 107 00:55:06.304 00:43:27.182 108 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.304 00:43:27.182 109 00:55:06.304 00:43:27.182 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.304 00:43:27.182 111 # Verify reregistering hotplug poller 00:55:06.304 00:43:27.182 112 rpc_cmd bdev_nvme_set_hotplug -d 00:55:06.304 00:43:27.182 113 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.304 00:43:27.182 114 00:55:06.304 00:43:27.182 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.304 00:43:27.182 ... 00:55:06.304 00:43:27.182 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:55:06.304 00:43:27.182 ... 00:55:06.304 00:43:27.182 133 00:55:06.304 00:43:27.182 134 # Run pci bus hotplug test 00:55:06.304 00:43:27.182 135 run_hotplug 00:55:06.304 00:43:27.182 136 00:55:06.304 00:43:27.182 137 # Run SPDK target based hotplug 00:55:06.304 00:43:27.182 => 138 tgt_run_hotplug 00:55:06.304 00:43:27.182 ... 00:55:06.304 00:43:27.182 00:55:06.304 00:43:27.182 ========== Backtrace end ========== 00:55:06.304 00:43:27.182 ========== Backtrace start: ========== 00:55:06.304 00:43:27.182 00:55:06.304 00:43:27.182 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh"]) 00:55:06.304 00:43:27.182 ... 00:55:06.304 00:43:27.182 1117 timing_enter $test_name 00:55:06.304 00:43:27.182 1118 echo "************************************" 00:55:06.304 00:43:27.182 1119 echo "START TEST $test_name" 00:55:06.304 00:43:27.182 1120 echo "************************************" 00:55:06.304 00:43:27.182 1121 xtrace_restore 00:55:06.304 00:43:27.182 1122 time "$@" 00:55:06.304 00:43:27.182 1123 xtrace_disable 00:55:06.304 00:43:27.182 1124 echo "************************************" 00:55:06.304 00:43:27.182 1125 echo "END TEST $test_name" 00:55:06.304 00:43:27.182 1126 echo "************************************" 00:55:06.304 00:43:27.182 1127 timing_exit $test_name 00:55:06.304 00:43:27.182 ... 00:55:06.304 00:43:27.182 in /home/vagrant/spdk_repo/spdk/autotest.sh:240 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 00:55:06.304 00:43:27.182 ... 00:55:06.304 00:43:27.182 235 00:55:06.304 00:43:27.182 236 run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh 00:55:06.304 00:43:27.182 237 run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh 00:55:06.304 00:43:27.182 238 00:55:06.304 00:43:27.182 239 if [ $(uname -s) = Linux ]; then 00:55:06.304 00:43:27.182 => 240 run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh 00:55:06.304 00:43:27.182 241 fi 00:55:06.304 00:43:27.182 242 00:55:06.304 00:43:27.182 243 if [[ $SPDK_TEST_XNVME -eq 1 ]]; then 00:55:06.304 00:43:27.182 244 run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh 00:55:06.304 00:43:27.182 245 run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme" 00:55:06.304 00:43:27.182 ... 00:55:06.304 00:43:27.182 00:55:06.304 00:43:27.182 ========== Backtrace end ========== ]] 00:55:06.304 + echo '00:43:27.181 00:11:49 sw_hotplug -- common/autotest_common.sh@715 -- # time='\''========== Backtrace start: ========== 00:55:06.304 00:43:27.181 00:55:06.304 00:43:27.181 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:55:06.304 00:43:27.181 ... 00:55:06.304 00:43:27.181 710 00:55:06.304 00:43:27.181 711 # We redirect cmd'\''\'\'''\''s std{out,err} to a separate fd dup'\''\'\'''\''ed to stdin'\''\'\'''\''s device (or /dev/null) to 00:55:06.304 00:43:27.181 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 00:55:06.304 00:43:27.181 713 # but $() will return just the time'\''\'\'''\''s data, hence making it possible to just do: 00:55:06.304 00:43:27.181 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:55:06.304 00:43:27.181 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:55:06.304 00:43:27.181 716 00:55:06.304 00:43:27.181 717 echo "$time" 00:55:06.304 00:43:27.181 718 ) 00:55:06.304 00:43:27.181 719 00:55:06.304 00:43:27.181 720 function timing_enter() { 00:55:06.304 00:43:27.181 ... 00:55:06.304 00:43:27.181 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:55:06.304 00:43:27.181 ... 00:55:06.304 00:43:27.181 11 # Pci bus hotplug 00:55:06.304 00:43:27.181 12 # Helper function to remove/attach cotrollers 00:55:06.304 00:43:27.181 13 debug_remove_attach_helper() { 00:55:06.304 00:43:27.181 14 local helper_time=0 00:55:06.304 00:43:27.181 15 00:55:06.304 00:43:27.181 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:55:06.304 00:43:27.181 17 printf '\''\'\'''\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\''\'\'''\'' \ 00:55:06.304 00:43:27.181 18 "$helper_time" "$nvme_count" >&2 00:55:06.304 00:43:27.181 19 } 00:55:06.304 00:43:27.181 20 00:55:06.304 00:43:27.181 21 remove_attach_helper() { 00:55:06.304 00:43:27.181 ... 00:55:06.304 00:43:27.181 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:55:06.304 00:43:27.181 ... 00:55:06.304 00:43:27.181 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:55:06.304 00:43:27.181 106 done 00:55:06.304 00:43:27.181 107 00:55:06.304 00:43:27.181 108 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.304 00:43:27.181 109 00:55:06.304 00:43:27.181 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.304 00:43:27.181 111 # Verify reregistering hotplug poller 00:55:06.304 00:43:27.181 112 rpc_cmd bdev_nvme_set_hotplug -d 00:55:06.304 00:43:27.181 113 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.304 00:43:27.181 114 00:55:06.304 00:43:27.181 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.304 00:43:27.181 ... 00:55:06.304 00:43:27.181 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:55:06.304 00:43:27.181 ... 00:55:06.304 00:43:27.181 133 00:55:06.304 00:43:27.181 134 # Run pci bus hotplug test 00:55:06.304 00:43:27.181 135 run_hotplug 00:55:06.304 00:43:27.181 136 00:55:06.304 00:43:27.181 137 # Run SPDK target based hotplug 00:55:06.304 00:43:27.181 => 138 tgt_run_hotplug 00:55:06.304 00:43:27.181 ... 00:55:06.304 00:43:27.181 00:55:06.304 00:43:27.181 ========== Backtrace end ========== 00:55:06.304 00:43:27.181 ========== Backtrace start: ========== 00:55:06.304 00:43:27.181 00:55:06.304 00:43:27.181 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:715 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:55:06.304 00:43:27.181 ... 00:55:06.304 00:43:27.181 710 00:55:06.304 00:43:27.181 711 # We redirect cmd'\''s std{out,err} to a separate fd dup'\''ed to stdin'\''s device (or /dev/null) to 00:55:06.304 00:43:27.181 712 # catch only output from the time builtin - output from the actual cmd would be still visible, 00:55:06.305 00:43:27.181 713 # but $() will return just the time'\''s data, hence making it possible to just do: 00:55:06.305 00:43:27.181 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:55:06.305 00:43:27.181 => 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:55:06.305 00:43:27.181 716 00:55:06.305 00:43:27.181 717 echo "$time" 00:55:06.305 00:43:27.181 718 ) 00:55:06.305 00:43:27.181 719 00:55:06.305 00:43:27.181 720 function timing_enter() { 00:55:06.305 00:43:27.181 ... 00:55:06.305 00:43:27.181 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:55:06.305 00:43:27.181 ... 00:55:06.305 00:43:27.181 11 # Pci bus hotplug 00:55:06.305 00:43:27.181 12 # Helper function to remove/attach cotrollers 00:55:06.305 00:43:27.181 13 debug_remove_attach_helper() { 00:55:06.305 00:43:27.181 14 local helper_time=0 00:55:06.305 00:43:27.181 15 00:55:06.305 00:43:27.181 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:55:06.305 00:43:27.181 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 00:55:06.305 00:43:27.181 18 "$helper_time" "$nvme_count" >&2 00:55:06.305 00:43:27.181 19 } 00:55:06.305 00:43:27.181 20 00:55:06.305 00:43:27.181 21 remove_attach_helper() { 00:55:06.305 00:43:27.181 ... 00:55:06.305 00:43:27.181 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:55:06.305 00:43:27.181 ... 00:55:06.305 00:43:27.181 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:55:06.305 00:43:27.181 106 done 00:55:06.305 00:43:27.181 107 00:55:06.305 00:43:27.181 108 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.305 00:43:27.181 109 00:55:06.305 00:43:27.181 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.305 00:43:27.181 111 # Verify reregistering hotplug poller 00:55:06.305 00:43:27.182 112 rpc_cmd bdev_nvme_set_hotplug -d 00:55:06.305 00:43:27.182 113 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.305 00:43:27.182 114 00:55:06.305 00:43:27.182 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.305 00:43:27.182 ... 00:55:06.305 00:43:27.182 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:55:06.305 00:43:27.182 ... 00:55:06.305 00:43:27.182 133 00:55:06.305 00:43:27.182 134 # Run pci bus hotplug test 00:55:06.305 00:43:27.182 135 run_hotplug 00:55:06.305 00:43:27.182 136 00:55:06.305 00:43:27.182 137 # Run SPDK target based hotplug 00:55:06.305 00:43:27.182 => 138 tgt_run_hotplug 00:55:06.305 00:43:27.182 ... 00:55:06.305 00:43:27.182 00:55:06.305 00:43:27.182 ========== Backtrace end ========== 00:55:06.305 00:43:27.182 ========== Backtrace start: ========== 00:55:06.305 00:43:27.182 00:55:06.305 00:43:27.182 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:718 -> timing_cmd(["remove_attach_helper"],["3"],["6"],["true"]) 00:55:06.305 00:43:27.182 ... 00:55:06.305 00:43:27.182 713 # but $() will return just the time'\''s data, hence making it possible to just do: 00:55:06.305 00:43:27.182 714 # time_of_super_verbose_cmd=$(timing_cmd super_verbose_cmd) 00:55:06.305 00:43:27.182 715 time=$({ time "$@" >&"$cmd_out" 2>&1; } 2>&1) 00:55:06.305 00:43:27.182 716 00:55:06.305 00:43:27.182 717 echo "$time" 00:55:06.305 00:43:27.182 => 718 ) 00:55:06.305 00:43:27.182 719 00:55:06.305 00:43:27.182 720 function timing_enter() { 00:55:06.305 00:43:27.182 721 xtrace_disable 00:55:06.305 00:43:27.182 722 timing "enter" "$1" 00:55:06.305 00:43:27.182 723 xtrace_restore 00:55:06.305 00:43:27.182 ... 00:55:06.305 00:43:27.182 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:55:06.305 00:43:27.182 ... 00:55:06.305 00:43:27.182 11 # Pci bus hotplug 00:55:06.305 00:43:27.182 12 # Helper function to remove/attach cotrollers 00:55:06.305 00:43:27.182 13 debug_remove_attach_helper() { 00:55:06.305 00:43:27.182 14 local helper_time=0 00:55:06.305 00:43:27.182 15 00:55:06.305 00:43:27.182 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:55:06.305 00:43:27.182 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 00:55:06.305 00:43:27.182 18 "$helper_time" "$nvme_count" >&2 00:55:06.305 00:43:27.182 19 } 00:55:06.305 00:43:27.182 20 00:55:06.305 00:43:27.182 21 remove_attach_helper() { 00:55:06.305 00:43:27.182 ... 00:55:06.305 00:43:27.182 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:55:06.305 00:43:27.182 ... 00:55:06.305 00:43:27.182 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:55:06.305 00:43:27.182 106 done 00:55:06.305 00:43:27.182 107 00:55:06.305 00:43:27.182 108 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.305 00:43:27.182 109 00:55:06.305 00:43:27.182 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.305 00:43:27.182 111 # Verify reregistering hotplug poller 00:55:06.305 00:43:27.182 112 rpc_cmd bdev_nvme_set_hotplug -d 00:55:06.305 00:43:27.182 113 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.305 00:43:27.182 114 00:55:06.305 00:43:27.182 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.305 00:43:27.182 ... 00:55:06.305 00:43:27.182 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:55:06.305 00:43:27.182 ... 00:55:06.305 00:43:27.182 133 00:55:06.305 00:43:27.182 134 # Run pci bus hotplug test 00:55:06.305 00:43:27.182 135 run_hotplug 00:55:06.305 00:43:27.182 136 00:55:06.305 00:43:27.182 137 # Run SPDK target based hotplug 00:55:06.305 00:43:27.182 => 138 tgt_run_hotplug 00:55:06.305 00:43:27.182 ... 00:55:06.305 00:43:27.182 00:55:06.305 00:43:27.182 ========== Backtrace end ========== 00:55:06.305 00:43:27.182 ========== Backtrace start: ========== 00:55:06.305 00:43:27.182 00:55:06.305 00:43:27.182 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:16 -> debug_remove_attach_helper(["3"],["6"],["true"]) 00:55:06.305 00:43:27.182 ... 00:55:06.305 00:43:27.182 11 # Pci bus hotplug 00:55:06.305 00:43:27.182 12 # Helper function to remove/attach cotrollers 00:55:06.305 00:43:27.182 13 debug_remove_attach_helper() { 00:55:06.305 00:43:27.182 14 local helper_time=0 00:55:06.305 00:43:27.182 15 00:55:06.305 00:43:27.182 => 16 helper_time=$(timing_cmd remove_attach_helper "$@") 00:55:06.305 00:43:27.182 17 printf '\''remove_attach_helper took %ss to complete (handling %u nvme drive(s))'\'' \ 00:55:06.305 00:43:27.182 18 "$helper_time" "$nvme_count" >&2 00:55:06.305 00:43:27.182 19 } 00:55:06.305 00:43:27.182 20 00:55:06.305 00:43:27.182 21 remove_attach_helper() { 00:55:06.305 00:43:27.182 ... 00:55:06.305 00:43:27.182 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:110 -> tgt_run_hotplug([]) 00:55:06.305 00:43:27.182 ... 00:55:06.305 00:43:27.182 105 waitforbdev "Nvme0${dev}n1" "$hotplug_wait" 00:55:06.305 00:43:27.182 106 done 00:55:06.305 00:43:27.182 107 00:55:06.305 00:43:27.182 108 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.305 00:43:27.182 109 00:55:06.305 00:43:27.182 => 110 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.305 00:43:27.182 111 # Verify reregistering hotplug poller 00:55:06.305 00:43:27.182 112 rpc_cmd bdev_nvme_set_hotplug -d 00:55:06.305 00:43:27.182 113 rpc_cmd bdev_nvme_set_hotplug -e 00:55:06.305 00:43:27.182 114 00:55:06.305 00:43:27.182 115 debug_remove_attach_helper "$hotplug_events" "$hotplug_wait" true 00:55:06.305 00:43:27.182 ... 00:55:06.305 00:43:27.182 in /home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh:138 -> main([]) 00:55:06.305 00:43:27.182 ... 00:55:06.305 00:43:27.182 133 00:55:06.305 00:43:27.182 134 # Run pci bus hotplug test 00:55:06.305 00:43:27.182 135 run_hotplug 00:55:06.305 00:43:27.182 136 00:55:06.305 00:43:27.182 137 # Run SPDK target based hotplug 00:55:06.305 00:43:27.182 => 138 tgt_run_hotplug 00:55:06.305 00:43:27.182 ... 00:55:06.305 00:43:27.182 00:55:06.305 00:43:27.182 ========== Backtrace end ========== 00:55:06.305 00:43:27.182 ========== Backtrace start: ========== 00:55:06.305 00:43:27.182 00:55:06.305 00:43:27.182 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1122 -> run_test(["sw_hotplug"],["/home/vagrant/spdk_repo/spdk/test/nvme/sw_hotplug.sh"]) 00:55:06.305 00:43:27.182 ... 00:55:06.305 00:43:27.182 1117 timing_enter $test_name 00:55:06.305 00:43:27.182 1118 echo "************************************" 00:55:06.305 00:43:27.182 1119 echo "START TEST $test_name" 00:55:06.305 00:43:27.182 1120 echo "************************************" 00:55:06.305 00:43:27.182 1121 xtrace_restore 00:55:06.305 00:43:27.182 1122 time "$@" 00:55:06.305 00:43:27.182 1123 xtrace_disable 00:55:06.305 00:43:27.182 1124 echo "************************************" 00:55:06.305 00:43:27.182 1125 echo "END TEST $test_name" 00:55:06.305 00:43:27.182 1126 echo "************************************" 00:55:06.305 00:43:27.182 1127 timing_exit $test_name 00:55:06.305 00:43:27.182 ... 00:55:06.305 00:43:27.182 in /home/vagrant/spdk_repo/spdk/autotest.sh:240 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 00:55:06.305 00:43:27.182 ... 00:55:06.305 00:43:27.182 235 00:55:06.305 00:43:27.182 236 run_test "nvme_rpc" $rootdir/test/nvme/nvme_rpc.sh 00:55:06.305 00:43:27.182 237 run_test "nvme_rpc_timeouts" $rootdir/test/nvme/nvme_rpc_timeouts.sh 00:55:06.305 00:43:27.182 238 00:55:06.305 00:43:27.182 239 if [ $(uname -s) = Linux ]; then 00:55:06.305 00:43:27.182 => 240 run_test "sw_hotplug" $rootdir/test/nvme/sw_hotplug.sh 00:55:06.305 00:43:27.182 241 fi 00:55:06.305 00:43:27.182 242 00:55:06.305 00:43:27.182 243 if [[ $SPDK_TEST_XNVME -eq 1 ]]; then 00:55:06.305 00:43:27.182 244 run_test "nvme_xnvme" $rootdir/test/nvme/xnvme/xnvme.sh 00:55:06.306 00:43:27.182 245 run_test "blockdev_xnvme" $rootdir/test/bdev/blockdev.sh "xnvme" 00:55:06.306 00:43:27.182 ... 00:55:06.306 00:43:27.182 00:55:06.306 00:43:27.182 ========== Backtrace end ==========' 00:55:06.306 + for build in "${build_log_list[@]}" 00:55:06.306 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-phy-autotest_72388/build.log 00:55:06.306 + local build_log job_name start_pattern end_pattern backtraces 00:55:06.306 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-phy-autotest_72388/build.log 00:55:06.306 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-phy-autotest_72388/build.log 00:55:06.306 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-phy-autotest_72388 00:55:06.306 + job_name=nvmf-phy-autotest_72388 00:55:06.306 + start_pattern='Backtrace start' 00:55:06.306 + end_pattern='Backtrace end' 00:55:06.306 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-phy-autotest_72388/build.log ]] 00:55:06.306 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-phy-autotest_72388/build.log 00:55:06.306 + backtraces= 00:55:06.306 + [[ -n '' ]] 00:55:06.306 + for build in "${build_log_list[@]}" 00:55:06.306 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/clang-vg-autotest_57620/build.log 00:55:06.306 + local build_log job_name start_pattern end_pattern backtraces 00:55:06.306 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/clang-vg-autotest_57620/build.log 00:55:06.306 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/clang-vg-autotest_57620/build.log 00:55:06.306 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/clang-vg-autotest_57620 00:55:06.306 + job_name=clang-vg-autotest_57620 00:55:06.306 + start_pattern='Backtrace start' 00:55:06.306 + end_pattern='Backtrace end' 00:55:06.306 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/clang-vg-autotest_57620/build.log ]] 00:55:06.306 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/clang-vg-autotest_57620/build.log 00:55:06.306 + backtraces= 00:55:06.306 + [[ -n '' ]] 00:55:06.306 + for build in "${build_log_list[@]}" 00:55:06.306 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/dsa-phy-autotest_4844/build.log 00:55:06.306 + local build_log job_name start_pattern end_pattern backtraces 00:55:06.306 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/dsa-phy-autotest_4844/build.log 00:55:06.306 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/dsa-phy-autotest_4844/build.log 00:55:06.306 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/dsa-phy-autotest_4844 00:55:06.306 + job_name=dsa-phy-autotest_4844 00:55:06.306 + start_pattern='Backtrace start' 00:55:06.306 + end_pattern='Backtrace end' 00:55:06.306 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/dsa-phy-autotest_4844/build.log ]] 00:55:06.306 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/dsa-phy-autotest_4844/build.log 00:55:06.306 + backtraces= 00:55:06.306 + [[ -n '' ]] 00:55:06.306 + for build in "${build_log_list[@]}" 00:55:06.306 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/scanbuild-vg-autotest_63371/build.log 00:55:06.306 + local build_log job_name start_pattern end_pattern backtraces 00:55:06.306 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/scanbuild-vg-autotest_63371/build.log 00:55:06.306 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/scanbuild-vg-autotest_63371/build.log 00:55:06.306 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/scanbuild-vg-autotest_63371 00:55:06.306 + job_name=scanbuild-vg-autotest_63371 00:55:06.306 + start_pattern='Backtrace start' 00:55:06.306 + end_pattern='Backtrace end' 00:55:06.306 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/scanbuild-vg-autotest_63371/build.log ]] 00:55:06.306 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/scanbuild-vg-autotest_63371/build.log 00:55:06.306 + backtraces= 00:55:06.306 + [[ -n '' ]] 00:55:06.306 + for build in "${build_log_list[@]}" 00:55:06.306 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vhost-initiator-vg-autotest_77444/build.log 00:55:06.306 + local build_log job_name start_pattern end_pattern backtraces 00:55:06.306 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vhost-initiator-vg-autotest_77444/build.log 00:55:06.306 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vhost-initiator-vg-autotest_77444/build.log 00:55:06.306 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vhost-initiator-vg-autotest_77444 00:55:06.306 + job_name=vhost-initiator-vg-autotest_77444 00:55:06.306 + start_pattern='Backtrace start' 00:55:06.306 + end_pattern='Backtrace end' 00:55:06.306 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vhost-initiator-vg-autotest_77444/build.log ]] 00:55:06.306 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vhost-initiator-vg-autotest_77444/build.log 00:55:06.306 + backtraces= 00:55:06.306 + [[ -n '' ]] 00:55:06.306 + for build in "${build_log_list[@]}" 00:55:06.306 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vfio-user-phy-autotest_26152/build.log 00:55:06.306 + local build_log job_name start_pattern end_pattern backtraces 00:55:06.306 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vfio-user-phy-autotest_26152/build.log 00:55:06.306 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vfio-user-phy-autotest_26152/build.log 00:55:06.306 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vfio-user-phy-autotest_26152 00:55:06.306 + job_name=vfio-user-phy-autotest_26152 00:55:06.306 + start_pattern='Backtrace start' 00:55:06.306 + end_pattern='Backtrace end' 00:55:06.306 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vfio-user-phy-autotest_26152/build.log ]] 00:55:06.306 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vfio-user-phy-autotest_26152/build.log 00:55:06.306 + backtraces= 00:55:06.306 + [[ -n '' ]] 00:55:06.306 + for build in "${build_log_list[@]}" 00:55:06.306 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-cmb-pmr-vg-autotest_78547/build.log 00:55:06.306 + local build_log job_name start_pattern end_pattern backtraces 00:55:06.306 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-cmb-pmr-vg-autotest_78547/build.log 00:55:06.306 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-cmb-pmr-vg-autotest_78547/build.log 00:55:06.306 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-cmb-pmr-vg-autotest_78547 00:55:06.306 + job_name=nvme-cmb-pmr-vg-autotest_78547 00:55:06.306 + start_pattern='Backtrace start' 00:55:06.306 + end_pattern='Backtrace end' 00:55:06.306 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-cmb-pmr-vg-autotest_78547/build.log ]] 00:55:06.306 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-cmb-pmr-vg-autotest_78547/build.log 00:55:06.306 + backtraces= 00:55:06.306 + [[ -n '' ]] 00:55:06.306 + for build in "${build_log_list[@]}" 00:55:06.306 + create_errtrace_file /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/BlobFS-phy-autotest_26150/build.log 00:55:06.306 + local build_log job_name start_pattern end_pattern backtraces 00:55:06.306 + build_log=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/BlobFS-phy-autotest_26150/build.log 00:55:06.306 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/BlobFS-phy-autotest_26150/build.log 00:55:06.306 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/BlobFS-phy-autotest_26150 00:55:06.306 + job_name=BlobFS-phy-autotest_26150 00:55:06.306 + start_pattern='Backtrace start' 00:55:06.307 + end_pattern='Backtrace end' 00:55:06.307 + [[ -f /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/BlobFS-phy-autotest_26150/build.log ]] 00:55:06.307 ++ sed -n '/Backtrace start/,/Backtrace end/p' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/BlobFS-phy-autotest_26150/build.log 00:55:06.307 + backtraces= 00:55:06.307 + [[ -n '' ]] 00:55:06.307 + run_flamegraph 00:55:06.307 + create_timing_file 00:55:06.307 + local array file 00:55:06.307 + array=($(find $WORKSPACE -type f -name 'timing.txt')) 00:55:06.307 ++ find /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11 -type f -name timing.txt 00:55:06.565 + timing_dir=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/post_process 00:55:06.565 + mkdir -p /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/post_process 00:55:06.565 + timing_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/post_process/total_timing.txt 00:55:06.565 + for file in "${array[@]}" 00:55:06.565 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/lvol-vg-autotest_77373/timing.txt 00:55:06.565 + local job_file job_name 00:55:06.565 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/lvol-vg-autotest_77373/timing.txt 00:55:06.565 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/lvol-vg-autotest_77373/timing.txt 00:55:06.565 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/lvol-vg-autotest_77373 00:55:06.565 + job_name=lvol-vg-autotest_77373 00:55:06.565 + sed 's/^/lvol-vg-autotest_77373;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/lvol-vg-autotest_77373/timing.txt 00:55:06.565 + for file in "${array[@]}" 00:55:06.565 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-uring-vg-autotest_77349/timing.txt 00:55:06.565 + local job_file job_name 00:55:06.565 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-uring-vg-autotest_77349/timing.txt 00:55:06.565 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-uring-vg-autotest_77349/timing.txt 00:55:06.565 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-uring-vg-autotest_77349 00:55:06.565 + job_name=nvmf-tcp-uring-vg-autotest_77349 00:55:06.565 + sed 's/^/nvmf-tcp-uring-vg-autotest_77349;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-uring-vg-autotest_77349/timing.txt 00:55:06.565 + for file in "${array[@]}" 00:55:06.565 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/iscsi-vg-autotest_77462/timing.txt 00:55:06.565 + local job_file job_name 00:55:06.565 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/iscsi-vg-autotest_77462/timing.txt 00:55:06.565 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/iscsi-vg-autotest_77462/timing.txt 00:55:06.565 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/iscsi-vg-autotest_77462 00:55:06.565 + job_name=iscsi-vg-autotest_77462 00:55:06.565 + sed 's/^/iscsi-vg-autotest_77462;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/iscsi-vg-autotest_77462/timing.txt 00:55:06.565 + for file in "${array[@]}" 00:55:06.565 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/iscsi-uring-vg-autotest_77329/timing.txt 00:55:06.565 + local job_file job_name 00:55:06.565 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/iscsi-uring-vg-autotest_77329/timing.txt 00:55:06.565 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/iscsi-uring-vg-autotest_77329/timing.txt 00:55:06.565 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/iscsi-uring-vg-autotest_77329 00:55:06.565 + job_name=iscsi-uring-vg-autotest_77329 00:55:06.565 + sed 's/^/iscsi-uring-vg-autotest_77329;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/iscsi-uring-vg-autotest_77329/timing.txt 00:55:06.565 + for file in "${array[@]}" 00:55:06.565 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/crypto-phy-autotest_26144/timing.txt 00:55:06.565 + local job_file job_name 00:55:06.565 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/crypto-phy-autotest_26144/timing.txt 00:55:06.565 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/crypto-phy-autotest_26144/timing.txt 00:55:06.565 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/crypto-phy-autotest_26144 00:55:06.565 + job_name=crypto-phy-autotest_26144 00:55:06.565 + sed 's/^/crypto-phy-autotest_26144;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/crypto-phy-autotest_26144/timing.txt 00:55:06.565 + for file in "${array[@]}" 00:55:06.565 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/valgrind-vg-autotest_49186/timing.txt 00:55:06.565 + local job_file job_name 00:55:06.565 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/valgrind-vg-autotest_49186/timing.txt 00:55:06.565 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/valgrind-vg-autotest_49186/timing.txt 00:55:06.565 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/valgrind-vg-autotest_49186 00:55:06.565 + job_name=valgrind-vg-autotest_49186 00:55:06.565 + sed 's/^/valgrind-vg-autotest_49186;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/valgrind-vg-autotest_49186/timing.txt 00:55:06.565 + for file in "${array[@]}" 00:55:06.565 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/zns-vg-autotest_76530/timing.txt 00:55:06.565 + local job_file job_name 00:55:06.565 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/zns-vg-autotest_76530/timing.txt 00:55:06.565 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/zns-vg-autotest_76530/timing.txt 00:55:06.565 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/zns-vg-autotest_76530 00:55:06.565 + job_name=zns-vg-autotest_76530 00:55:06.565 + sed 's/^/zns-vg-autotest_76530;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/zns-vg-autotest_76530/timing.txt 00:55:06.565 + for file in "${array[@]}" 00:55:06.565 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/centos7-vg-autotest_73603/timing.txt 00:55:06.565 + local job_file job_name 00:55:06.565 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/centos7-vg-autotest_73603/timing.txt 00:55:06.565 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/centos7-vg-autotest_73603/timing.txt 00:55:06.565 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/centos7-vg-autotest_73603 00:55:06.565 + job_name=centos7-vg-autotest_73603 00:55:06.565 + sed 's/^/centos7-vg-autotest_73603;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/centos7-vg-autotest_73603/timing.txt 00:55:06.565 + for file in "${array[@]}" 00:55:06.565 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vmd-phy-autotest_2613/timing.txt 00:55:06.565 + local job_file job_name 00:55:06.565 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vmd-phy-autotest_2613/timing.txt 00:55:06.565 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vmd-phy-autotest_2613/timing.txt 00:55:06.565 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vmd-phy-autotest_2613 00:55:06.565 + job_name=vmd-phy-autotest_2613 00:55:06.565 + sed 's/^/vmd-phy-autotest_2613;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vmd-phy-autotest_2613/timing.txt 00:55:06.565 + for file in "${array[@]}" 00:55:06.566 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-vg-autotest_77415/timing.txt 00:55:06.566 + local job_file job_name 00:55:06.566 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-vg-autotest_77415/timing.txt 00:55:06.566 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-vg-autotest_77415/timing.txt 00:55:06.566 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-vg-autotest_77415 00:55:06.566 + job_name=nvmf-tcp-vg-autotest_77415 00:55:06.566 + sed 's/^/nvmf-tcp-vg-autotest_77415;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-vg-autotest_77415/timing.txt 00:55:06.566 + for file in "${array[@]}" 00:55:06.566 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-phy-autotest_72316/timing.txt 00:55:06.566 + local job_file job_name 00:55:06.566 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-phy-autotest_72316/timing.txt 00:55:06.566 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-phy-autotest_72316/timing.txt 00:55:06.566 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-phy-autotest_72316 00:55:06.566 + job_name=nvme-phy-autotest_72316 00:55:06.566 + sed 's/^/nvme-phy-autotest_72316;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-phy-autotest_72316/timing.txt 00:55:06.566 + for file in "${array[@]}" 00:55:06.566 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/short-fuzz-phy-autotest_26141/timing.txt 00:55:06.566 + local job_file job_name 00:55:06.566 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/short-fuzz-phy-autotest_26141/timing.txt 00:55:06.566 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/short-fuzz-phy-autotest_26141/timing.txt 00:55:06.566 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/short-fuzz-phy-autotest_26141 00:55:06.566 + job_name=short-fuzz-phy-autotest_26141 00:55:06.566 + sed 's/^/short-fuzz-phy-autotest_26141;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/short-fuzz-phy-autotest_26141/timing.txt 00:55:06.566 + for file in "${array[@]}" 00:55:06.566 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-vg-autotest_77424/timing.txt 00:55:06.566 + local job_file job_name 00:55:06.566 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-vg-autotest_77424/timing.txt 00:55:06.566 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-vg-autotest_77424/timing.txt 00:55:06.566 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-vg-autotest_77424 00:55:06.566 + job_name=nvme-vg-autotest_77424 00:55:06.566 + sed 's/^/nvme-vg-autotest_77424;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-vg-autotest_77424/timing.txt 00:55:06.566 + for file in "${array[@]}" 00:55:06.566 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vhost-phy-autotest_26169/timing.txt 00:55:06.566 + local job_file job_name 00:55:06.566 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vhost-phy-autotest_26169/timing.txt 00:55:06.566 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vhost-phy-autotest_26169/timing.txt 00:55:06.566 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vhost-phy-autotest_26169 00:55:06.566 + job_name=vhost-phy-autotest_26169 00:55:06.566 + sed 's/^/vhost-phy-autotest_26169;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vhost-phy-autotest_26169/timing.txt 00:55:06.566 + for file in "${array[@]}" 00:55:06.566 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/autobuild-vg-autotest_63412/timing.txt 00:55:06.566 + local job_file job_name 00:55:06.566 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/autobuild-vg-autotest_63412/timing.txt 00:55:06.566 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/autobuild-vg-autotest_63412/timing.txt 00:55:06.566 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/autobuild-vg-autotest_63412 00:55:06.566 + job_name=autobuild-vg-autotest_63412 00:55:06.566 + sed 's/^/autobuild-vg-autotest_63412;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/autobuild-vg-autotest_63412/timing.txt 00:55:06.566 + for file in "${array[@]}" 00:55:06.566 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/rocky9-vg-autotest_16034/timing.txt 00:55:06.566 + local job_file job_name 00:55:06.566 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/rocky9-vg-autotest_16034/timing.txt 00:55:06.566 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/rocky9-vg-autotest_16034/timing.txt 00:55:06.566 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/rocky9-vg-autotest_16034 00:55:06.566 + job_name=rocky9-vg-autotest_16034 00:55:06.566 + sed 's/^/rocky9-vg-autotest_16034;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/rocky9-vg-autotest_16034/timing.txt 00:55:06.566 + for file in "${array[@]}" 00:55:06.566 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-phy-autotest_72275/timing.txt 00:55:06.566 + local job_file job_name 00:55:06.566 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-phy-autotest_72275/timing.txt 00:55:06.566 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-phy-autotest_72275/timing.txt 00:55:06.566 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-phy-autotest_72275 00:55:06.566 + job_name=nvmf-tcp-phy-autotest_72275 00:55:06.566 + sed 's/^/nvmf-tcp-phy-autotest_72275;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-phy-autotest_72275/timing.txt 00:55:06.566 + for file in "${array[@]}" 00:55:06.566 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/ubuntu22-vg-autotest_37757/timing.txt 00:55:06.566 + local job_file job_name 00:55:06.566 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/ubuntu22-vg-autotest_37757/timing.txt 00:55:06.566 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/ubuntu22-vg-autotest_37757/timing.txt 00:55:06.566 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/ubuntu22-vg-autotest_37757 00:55:06.566 + job_name=ubuntu22-vg-autotest_37757 00:55:06.566 + sed 's/^/ubuntu22-vg-autotest_37757;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/ubuntu22-vg-autotest_37757/timing.txt 00:55:06.566 + for file in "${array[@]}" 00:55:06.566 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/unittest-vg-autotest_63369/timing.txt 00:55:06.566 + local job_file job_name 00:55:06.566 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/unittest-vg-autotest_63369/timing.txt 00:55:06.566 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/unittest-vg-autotest_63369/timing.txt 00:55:06.566 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/unittest-vg-autotest_63369 00:55:06.566 + job_name=unittest-vg-autotest_63369 00:55:06.566 + sed 's/^/unittest-vg-autotest_63369;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/unittest-vg-autotest_63369/timing.txt 00:55:06.566 + for file in "${array[@]}" 00:55:06.566 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/ubuntu20-vg-autotest_73743/timing.txt 00:55:06.566 + local job_file job_name 00:55:06.566 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/ubuntu20-vg-autotest_73743/timing.txt 00:55:06.566 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/ubuntu20-vg-autotest_73743/timing.txt 00:55:06.566 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/ubuntu20-vg-autotest_73743 00:55:06.566 + job_name=ubuntu20-vg-autotest_73743 00:55:06.566 + sed 's/^/ubuntu20-vg-autotest_73743;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/ubuntu20-vg-autotest_73743/timing.txt 00:55:06.566 + for file in "${array[@]}" 00:55:06.566 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-phy-autotest_72388/timing.txt 00:55:06.566 + local job_file job_name 00:55:06.566 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-phy-autotest_72388/timing.txt 00:55:06.566 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-phy-autotest_72388/timing.txt 00:55:06.566 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-phy-autotest_72388 00:55:06.566 + job_name=nvmf-phy-autotest_72388 00:55:06.566 + sed 's/^/nvmf-phy-autotest_72388;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-phy-autotest_72388/timing.txt 00:55:06.566 + for file in "${array[@]}" 00:55:06.566 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/clang-vg-autotest_57620/timing.txt 00:55:06.566 + local job_file job_name 00:55:06.566 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/clang-vg-autotest_57620/timing.txt 00:55:06.566 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/clang-vg-autotest_57620/timing.txt 00:55:06.566 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/clang-vg-autotest_57620 00:55:06.566 + job_name=clang-vg-autotest_57620 00:55:06.566 + sed 's/^/clang-vg-autotest_57620;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/clang-vg-autotest_57620/timing.txt 00:55:06.566 + for file in "${array[@]}" 00:55:06.566 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/dsa-phy-autotest_4844/timing.txt 00:55:06.566 + local job_file job_name 00:55:06.566 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/dsa-phy-autotest_4844/timing.txt 00:55:06.566 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/dsa-phy-autotest_4844/timing.txt 00:55:06.566 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/dsa-phy-autotest_4844 00:55:06.566 + job_name=dsa-phy-autotest_4844 00:55:06.566 + sed 's/^/dsa-phy-autotest_4844;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/dsa-phy-autotest_4844/timing.txt 00:55:06.566 + for file in "${array[@]}" 00:55:06.566 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/scanbuild-vg-autotest_63371/timing.txt 00:55:06.566 + local job_file job_name 00:55:06.566 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/scanbuild-vg-autotest_63371/timing.txt 00:55:06.566 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/scanbuild-vg-autotest_63371/timing.txt 00:55:06.566 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/scanbuild-vg-autotest_63371 00:55:06.566 + job_name=scanbuild-vg-autotest_63371 00:55:06.566 + sed 's/^/scanbuild-vg-autotest_63371;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/scanbuild-vg-autotest_63371/timing.txt 00:55:06.566 + for file in "${array[@]}" 00:55:06.566 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vhost-initiator-vg-autotest_77444/timing.txt 00:55:06.566 + local job_file job_name 00:55:06.566 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vhost-initiator-vg-autotest_77444/timing.txt 00:55:06.566 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vhost-initiator-vg-autotest_77444/timing.txt 00:55:06.566 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vhost-initiator-vg-autotest_77444 00:55:06.566 + job_name=vhost-initiator-vg-autotest_77444 00:55:06.566 + sed 's/^/vhost-initiator-vg-autotest_77444;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vhost-initiator-vg-autotest_77444/timing.txt 00:55:06.566 + for file in "${array[@]}" 00:55:06.566 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vfio-user-phy-autotest_26152/timing.txt 00:55:06.566 + local job_file job_name 00:55:06.566 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vfio-user-phy-autotest_26152/timing.txt 00:55:06.566 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vfio-user-phy-autotest_26152/timing.txt 00:55:06.566 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vfio-user-phy-autotest_26152 00:55:06.566 + job_name=vfio-user-phy-autotest_26152 00:55:06.566 + sed 's/^/vfio-user-phy-autotest_26152;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vfio-user-phy-autotest_26152/timing.txt 00:55:06.566 + for file in "${array[@]}" 00:55:06.567 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-cmb-pmr-vg-autotest_78547/timing.txt 00:55:06.567 + local job_file job_name 00:55:06.567 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-cmb-pmr-vg-autotest_78547/timing.txt 00:55:06.567 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-cmb-pmr-vg-autotest_78547/timing.txt 00:55:06.567 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-cmb-pmr-vg-autotest_78547 00:55:06.567 + job_name=nvme-cmb-pmr-vg-autotest_78547 00:55:06.567 + sed 's/^/nvme-cmb-pmr-vg-autotest_78547;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-cmb-pmr-vg-autotest_78547/timing.txt 00:55:06.567 + for file in "${array[@]}" 00:55:06.567 + add_sub_job_timing /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/BlobFS-phy-autotest_26150/timing.txt 00:55:06.567 + local job_file job_name 00:55:06.567 + job_file=/var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/BlobFS-phy-autotest_26150/timing.txt 00:55:06.567 +++ dirname /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/BlobFS-phy-autotest_26150/timing.txt 00:55:06.567 ++ basename /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/BlobFS-phy-autotest_26150 00:55:06.567 + job_name=BlobFS-phy-autotest_26150 00:55:06.567 + sed 's/^/BlobFS-phy-autotest_26150;autorun;/' /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/BlobFS-phy-autotest_26150/timing.txt 00:55:06.567 + /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/post_process/total_timing.txt 00:55:06.567 + run_autorun_post 00:55:06.567 + s_opt= 00:55:06.567 + [[ '' == true ]] 00:55:06.567 + spdk/autorun_post.py -d ./ -r ./spdk 00:55:21.427 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/spdk/module/blobfs/bdev/blobfs_bdev.c:254 00:55:25.606 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/spdk/lib/util/crc32c.c:21 00:55:25.606 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/spdk/lib/util/crc64.c:165 00:55:25.865 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/spdk/lib/util/crc16.c:634 00:55:25.865 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/spdk/lib/util/crc16.c:628 00:55:25.865 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/spdk/lib/util/xor.c:120 00:55:32.419 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/spdk/module/bdev/nvme/bdev_mdns_client.c:613 00:55:32.419 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/spdk/module/bdev/nvme/bdev_mdns_client.c:456 00:55:32.420 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/spdk/module/bdev/nvme/bdev_mdns_client.c:561 00:55:32.420 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/spdk/module/bdev/nvme/bdev_mdns_client.c:582 00:55:54.328 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/spdk/module/blobfs/bdev/blobfs_bdev.c:254 00:56:12.403 lcov: WARNING: function data mismatch at /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/spdk/module/blobfs/bdev/blobfs_bdev.c:254 00:56:27.264 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/spdk/thread.h! 00:56:27.264 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/spdk/mmio.h! 00:56:27.264 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/spdk/nvmf_transport.h! 00:56:27.520 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/spdk/histogram_data.h! 00:56:27.520 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/spdk/endian.h! 00:56:27.520 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/spdk/util.h! 00:56:27.520 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/spdk/nvme_spec.h! 00:56:27.520 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/spdk/bdev_module.h! 00:56:27.520 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/spdk/nvme.h! 00:56:27.520 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/spdk/trace.h! 00:56:27.520 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/spdk/base64.h! 00:56:28.893 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/spdk/histogram_data.h/histogram_ut.c! 00:56:30.791 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/spdk/lib/env_ocf/include/ocf/ocf_core.h! 00:56:30.791 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/spdk/lib/env_ocf/include/ocf/ocf_io.h! 00:56:30.791 genhtml: WARNING: cannot read /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/spdk/lib/env_ocf/include/ocf/ocf_mngt.h! 00:56:45.663 -----Begin Post Process Script------ 00:56:45.663 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/lvol-vg-autotest_77373/cov_total.info 00:56:45.663 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-uring-vg-autotest_77349/cov_total.info 00:56:45.663 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/iscsi-vg-autotest_77462/cov_total.info 00:56:45.663 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/iscsi-uring-vg-autotest_77329/cov_total.info 00:56:45.663 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/crypto-phy-autotest_26144/cov_total.info 00:56:45.663 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/valgrind-vg-autotest_49186/cov_total.info 00:56:45.663 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/zns-vg-autotest_76530/cov_total.info 00:56:45.663 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/centos7-vg-autotest_73603/cov_total.info 00:56:45.663 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vmd-phy-autotest_2613/cov_total.info 00:56:45.663 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-vg-autotest_77415/cov_total.info 00:56:45.663 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-phy-autotest_72316/cov_total.info 00:56:45.663 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vhost-phy-autotest_26169/cov_total.info 00:56:45.663 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/rocky9-vg-autotest_16034/cov_total.info 00:56:45.663 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvmf-tcp-phy-autotest_72275/cov_total.info 00:56:45.663 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/ubuntu22-vg-autotest_37757/cov_total.info 00:56:45.663 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/unittest-vg-autotest_63369/cov_total.info 00:56:45.663 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/dsa-phy-autotest_4844/cov_total.info 00:56:45.663 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vhost-initiator-vg-autotest_77444/cov_total.info 00:56:45.663 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/vfio-user-phy-autotest_26152/cov_total.info 00:56:45.663 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/nvme-cmb-pmr-vg-autotest_78547/cov_total.info 00:56:45.663 /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/BlobFS-phy-autotest_26150/cov_total.info 00:56:45.663 00:56:45.663 00:56:45.663 -----Tests Executed in Build------ 00:56:45.663 accel 00:56:45.663 accel_assign_opcode 00:56:45.663 accel_cdev_comp 00:56:45.663 accel_cdev_decmop_full 00:56:45.663 accel_cdev_decomp 00:56:45.663 accel_cdev_decomp_full_mcore 00:56:45.663 accel_cdev_decomp_full_mthread 00:56:45.663 accel_cdev_decomp_mcore 00:56:45.663 accel_cdev_decomp_mthread 00:56:45.663 accel_comp 00:56:45.663 accel_compare 00:56:45.663 accel_compress_verify 00:56:45.663 accel_copy 00:56:45.663 accel_copy_crc32c 00:56:45.663 accel_copy_crc32c_C2 00:56:45.663 accel_crc32c 00:56:45.663 accel_crc32c_C2 00:56:45.663 accel_decmop_full 00:56:45.663 accel_decomp 00:56:45.663 accel_decomp_full_mcore 00:56:45.663 accel_decomp_full_mthread 00:56:45.663 accel_decomp_mcore 00:56:45.663 accel_decomp_mthread 00:56:45.663 accel_dif_functional_tests 00:56:45.663 accel_dif_generate 00:56:45.663 accel_dif_generate_copy 00:56:45.663 accel_dif_verify 00:56:45.663 accel_dualcast 00:56:45.663 accel_fill 00:56:45.663 accel_help 00:56:45.663 accel_missing_filename 00:56:45.663 accel_negative_buffers 00:56:45.663 accel_rpc 00:56:45.663 accel_scan_dsa_modules 00:56:45.663 accel_scan_iaa_modules 00:56:45.663 accel_wrong_workload 00:56:45.663 accel_xor 00:56:45.663 acl 00:56:45.663 alias_rpc 00:56:45.663 allowed 00:56:45.663 app_cmdline 00:56:45.663 app_repeat 00:56:45.663 asan 00:56:45.663 autobuild 00:56:45.663 autobuild_build_doc 00:56:45.663 autobuild_check_dpdk_pci_api 00:56:45.663 autobuild_check_format 00:56:45.663 autobuild_check_so_deps 00:56:45.663 autobuild_external_code 00:56:45.663 autobuild_generated_files_check 00:56:45.663 autobuild_generated_files_check_post_clean 00:56:45.663 autobuild_header_dependency_check 00:56:45.663 autobuild_llvm_precompile 00:56:45.663 autobuild_make_install 00:56:45.663 autobuild_make_uninstall 00:56:45.663 autobuild_ocf_precompile 00:56:45.663 bdev_bounds 00:56:45.663 bdev_crypto_enomem 00:56:45.663 bdev_error 00:56:45.663 bdev_fio 00:56:45.663 bdev_fio_rw_verify 00:56:45.663 bdev_fio_trim 00:56:45.663 bdev_gpt_uuid 00:56:45.663 bdev_hello_world 00:56:45.663 bdev_json_nonarray 00:56:45.663 bdev_json_nonenclosed 00:56:45.663 bdev_nbd 00:56:45.663 bdev_nvme_reset_stuck_adm_cmd 00:56:45.663 bdev_qd_sampling 00:56:45.663 bdev_qos 00:56:45.663 bdev_qos_bw 00:56:45.663 bdev_qos_iops 00:56:45.663 bdev_qos_ro_bw 00:56:45.663 bdev_raid 00:56:45.663 bdev_stat 00:56:45.663 bdev_verify 00:56:45.663 bdev_verify_big_io 00:56:45.663 bdev_write_zeroes 00:56:45.663 bdevperf_config 00:56:45.663 blob_io_wait 00:56:45.663 blobfs 00:56:45.663 blobfs_mkfs 00:56:45.663 blobstore 00:56:45.663 blobstore_grow 00:56:45.663 blockdev_crypto_aesni 00:56:45.663 blockdev_crypto_qat 00:56:45.663 blockdev_crypto_sw 00:56:45.663 blockdev_general 00:56:45.663 blockdev_nvme 00:56:45.663 blockdev_nvme_gpt 00:56:45.663 blockdev_raid5f 00:56:45.663 blockdev_rbd 00:56:45.663 build_native_dpdk 00:56:45.663 build_rpm_from_gen_spec 00:56:45.663 build_shared_native_dpdk_rpm 00:56:45.663 build_shared_rpm 00:56:45.663 build_shared_rpm_with_rpmed_dpdk 00:56:45.663 chaining 00:56:45.663 check_header_filenames 00:56:45.663 cmb_copy 00:56:45.663 compress_compdev 00:56:45.663 compress_isal 00:56:45.663 confirm_abi_deps 00:56:45.663 confirm_makefile_deps 00:56:45.663 cpu_locks 00:56:45.663 custom_alloc 00:56:45.663 dd_bs_lt_native_bs 00:56:45.663 dd_copy_to_out_bdev 00:56:45.663 dd_double_input 00:56:45.663 dd_double_output 00:56:45.663 dd_flag_append 00:56:45.663 dd_flag_append_forced_aio 00:56:45.663 dd_flag_directory 00:56:45.663 dd_flag_directory_forced_aio 00:56:45.663 dd_flag_noatime 00:56:45.663 dd_flag_noatime_forced_aio 00:56:45.663 dd_flag_nofollow 00:56:45.663 dd_flag_nofollow_forced_aio 00:56:45.663 dd_flags_misc 00:56:45.663 dd_flags_misc_forced_aio 00:56:45.663 dd_inflate_file 00:56:45.663 dd_invalid_arguments 00:56:45.663 dd_invalid_count 00:56:45.663 dd_invalid_iflag 00:56:45.663 dd_invalid_json 00:56:45.663 dd_invalid_oflag 00:56:45.663 dd_malloc_copy 00:56:45.663 dd_no_input 00:56:45.663 dd_no_output 00:56:45.663 dd_offset_magic 00:56:45.663 dd_rw 00:56:45.663 dd_rw_offset 00:56:45.663 dd_smaller_blocksize 00:56:45.663 dd_sparse_bdev_to_file 00:56:45.663 dd_sparse_file_to_bdev 00:56:45.663 dd_sparse_file_to_file 00:56:45.663 dd_unknown_flag 00:56:45.663 dd_uring_copy 00:56:45.663 dd_wrong_blocksize 00:56:45.663 default_locks 00:56:45.663 default_locks_via_rpc 00:56:45.663 default_setup 00:56:45.663 denied 00:56:45.663 devices 00:56:45.663 dm_mount 00:56:45.663 dma 00:56:45.663 dpdk_governor 00:56:45.663 dpdk_mem_utility 00:56:45.663 driver 00:56:45.663 env 00:56:45.663 env_dpdk_post_init 00:56:45.663 env_mem_callbacks 00:56:45.663 env_memory 00:56:45.663 env_pci 00:56:45.663 env_vtophys 00:56:45.663 even_2G_alloc 00:56:45.663 event 00:56:45.663 event_perf 00:56:45.663 event_reactor 00:56:45.663 event_reactor_perf 00:56:45.663 event_scheduler 00:56:45.663 exit_on_failed_rpc_init 00:56:45.663 external_make_accel_driver_shared 00:56:45.663 external_make_accel_driver_static 00:56:45.663 external_make_accel_module_shared 00:56:45.663 external_make_accel_module_static 00:56:45.663 external_make_hello_bdev_shared_combo 00:56:45.663 external_make_hello_bdev_shared_iso 00:56:45.663 external_make_hello_bdev_static 00:56:45.663 external_make_hello_no_bdev_shared_combo 00:56:45.663 external_make_hello_no_bdev_shared_iso 00:56:45.663 external_make_hello_no_bdev_static 00:56:45.663 external_make_nvme_shared 00:56:45.663 external_make_nvme_static 00:56:45.663 external_run_accel_driver_shared 00:56:45.663 external_run_accel_driver_static 00:56:45.663 external_run_accel_module_shared 00:56:45.663 external_run_accel_module_static 00:56:45.663 external_run_hello_bdev_shared_combo 00:56:45.663 external_run_hello_bdev_shared_iso 00:56:45.663 external_run_hello_bdev_static 00:56:45.664 external_run_hello_no_bdev_shared_combo 00:56:45.664 external_run_hello_no_bdev_shared_iso 00:56:45.664 external_run_hello_no_bdev_static 00:56:45.664 external_run_nvme_shared 00:56:45.664 external_run_nvme_static 00:56:45.664 filesystem_btrfs 00:56:45.664 filesystem_ext4 00:56:45.664 filesystem_in_capsule_btrfs 00:56:45.664 filesystem_in_capsule_ext4 00:56:45.664 filesystem_in_capsule_xfs 00:56:45.664 filesystem_xfs 00:56:45.664 fio_dif_1_default 00:56:45.664 fio_dif_1_multi_subsystems 00:56:45.664 fio_dif_digest 00:56:45.664 fio_dif_rand_params 00:56:45.664 go_rpc 00:56:45.664 guess_driver 00:56:45.664 hello_blob 00:56:45.664 hugepages 00:56:45.664 idle 00:56:45.664 interrupt_mode 00:56:45.664 ioat 00:56:45.664 ioat_perf 00:56:45.664 ioat_verify 00:56:45.664 is_zoned 00:56:45.664 iscsi_tgt 00:56:45.664 iscsi_tgt_bdev_io_wait 00:56:45.664 iscsi_tgt_calsoft 00:56:45.664 iscsi_tgt_digest 00:56:45.664 iscsi_tgt_digests 00:56:45.664 iscsi_tgt_ext4test 00:56:45.664 iscsi_tgt_filesystem 00:56:45.664 iscsi_tgt_filesystem_btrfs 00:56:45.664 iscsi_tgt_filesystem_ext4 00:56:45.664 iscsi_tgt_filesystem_xfs 00:56:45.664 iscsi_tgt_fio 00:56:45.664 iscsi_tgt_fuzz 00:56:45.664 iscsi_tgt_initiator 00:56:45.664 iscsi_tgt_ip_migration 00:56:45.664 iscsi_tgt_iscsi_lvol 00:56:45.664 iscsi_tgt_login_redirection 00:56:45.664 iscsi_tgt_multiconnection 00:56:45.664 iscsi_tgt_qos 00:56:45.664 iscsi_tgt_rbd 00:56:45.664 iscsi_tgt_reset 00:56:45.664 iscsi_tgt_resize 00:56:45.664 iscsi_tgt_rpc_config 00:56:45.664 iscsi_tgt_sock 00:56:45.664 iscsi_tgt_trace_record 00:56:45.664 json_config 00:56:45.664 json_config_extra_key 00:56:45.664 kernel_target_abort 00:56:45.664 keyring_file 00:56:45.664 llvm_fuzz 00:56:45.664 locking_app_on_locked_coremask 00:56:45.664 locking_app_on_unlocked_coremask 00:56:45.664 locking_overlapped_coremask 00:56:45.664 locking_overlapped_coremask_via_rpc 00:56:45.664 lvol 00:56:45.664 lvol_basic 00:56:45.664 lvol_esnap 00:56:45.664 lvol_external_copy 00:56:45.664 lvol_external_snapshot 00:56:45.664 lvol_hotremove 00:56:45.664 lvol_provisioning 00:56:45.664 lvol_rename 00:56:45.664 lvol_resize 00:56:45.664 lvol_snapshot_clone 00:56:45.664 lvol_tasting 00:56:45.664 lvs_grow_clean 00:56:45.664 lvs_grow_dirty 00:56:45.664 make 00:56:45.664 no_shrink_alloc 00:56:45.664 non_locking_app_on_locked_coremask 00:56:45.664 nvme 00:56:45.664 nvme_arbitration 00:56:45.664 nvme_cli_cuse 00:56:45.664 nvme_cli_plugin 00:56:45.664 nvme_cmb 00:56:45.664 nvme_cuse 00:56:45.664 nvme_cuse_app 00:56:45.664 nvme_cuse_rpc 00:56:45.664 nvme_doorbell_aers 00:56:45.664 nvme_e2edp 00:56:45.664 nvme_err_injection 00:56:45.664 nvme_fdp 00:56:45.664 nvme_fio 00:56:45.664 nvme_flexible_data_placement 00:56:45.664 nvme_hello_world 00:56:45.664 nvme_identify 00:56:45.664 nvme_mount 00:56:45.664 nvme_multi_aen 00:56:45.664 nvme_multi_secondary 00:56:45.664 nvme_ns_manage_cuse 00:56:45.664 nvme_overhead 00:56:45.664 nvme_perf 00:56:45.664 nvme_pmr 00:56:45.664 nvme_pmr_persistence 00:56:45.664 nvme_reserve 00:56:45.664 nvme_reset 00:56:45.664 nvme_rpc 00:56:45.664 nvme_rpc_timeouts 00:56:45.664 nvme_scc 00:56:45.664 nvme_sgl 00:56:45.664 nvme_simple_copy 00:56:45.664 nvme_single_aen 00:56:45.664 nvme_smartctl_cuse 00:56:45.664 nvme_startup 00:56:45.664 nvme_zns 00:56:45.664 nvmf_abort 00:56:45.664 nvmf_abort_qd_sizes 00:56:45.664 nvmf_aer 00:56:45.664 nvmf_async_init 00:56:45.664 nvmf_auth_host 00:56:45.664 nvmf_auth_target 00:56:45.664 nvmf_bdev_io_wait 00:56:45.664 nvmf_bdevio 00:56:45.664 nvmf_bdevio_no_huge 00:56:45.664 nvmf_bdevperf 00:56:45.664 nvmf_connect_disconnect 00:56:45.664 nvmf_connect_stress 00:56:45.664 nvmf_delete_subsystem 00:56:45.664 nvmf_device_removal 00:56:45.664 nvmf_device_removal_pci_remove 00:56:45.664 nvmf_device_removal_pci_remove_no_srq 00:56:45.664 nvmf_dif 00:56:45.664 nvmf_digest 00:56:45.664 nvmf_digest_clean 00:56:45.664 nvmf_digest_error 00:56:45.664 nvmf_discovery_remove_ifc 00:56:45.664 nvmf_example 00:56:45.664 nvmf_failover 00:56:45.664 nvmf_filesystem 00:56:45.664 nvmf_filesystem_in_capsule 00:56:45.664 nvmf_filesystem_no_in_capsule 00:56:45.664 nvmf_fio_host 00:56:45.664 nvmf_fio_target 00:56:45.664 nvmf_fips 00:56:45.664 nvmf_fused_ordering 00:56:45.664 nvmf_fuzz 00:56:45.664 nvmf_host_discovery 00:56:45.664 nvmf_host_management 00:56:45.664 nvmf_host_multipath 00:56:45.664 nvmf_host_multipath_status 00:56:45.664 nvmf_identify 00:56:45.664 nvmf_identify_kernel_target 00:56:45.664 nvmf_identify_passthru 00:56:45.664 nvmf_initiator_timeout 00:56:45.664 nvmf_invalid 00:56:45.664 nvmf_lvol 00:56:45.664 nvmf_lvs_grow 00:56:45.664 nvmf_mdns_discovery 00:56:45.664 nvmf_multiconnection 00:56:45.664 nvmf_multicontroller 00:56:45.664 nvmf_multitarget 00:56:45.664 nvmf_nmic 00:56:45.664 nvmf_ns_hotplug_stress 00:56:45.664 nvmf_ns_masking 00:56:45.664 nvmf_nvme_cli 00:56:45.664 nvmf_perf 00:56:45.664 nvmf_perf_adq 00:56:45.664 nvmf_queue_depth 00:56:45.664 nvmf_rdma 00:56:45.664 nvmf_referrals 00:56:45.664 nvmf_rpc 00:56:45.664 nvmf_shutdown 00:56:45.664 nvmf_shutdown_tc1 00:56:45.664 nvmf_shutdown_tc2 00:56:45.664 nvmf_shutdown_tc3 00:56:45.664 nvmf_srq_overwhelm 00:56:45.664 nvmf_target_disconnect 00:56:45.664 nvmf_target_disconnect_tc1 00:56:45.664 nvmf_target_disconnect_tc2 00:56:45.664 nvmf_target_disconnect_tc3 00:56:45.664 nvmf_target_discovery 00:56:45.664 nvmf_target_multipath 00:56:45.664 nvmf_tcp 00:56:45.664 nvmf_timeout 00:56:45.664 nvmf_tls 00:56:45.664 nvmf_vfio_user 00:56:45.664 nvmf_vfio_user_fuzz 00:56:45.664 nvmf_vfio_user_nvme_compliance 00:56:45.664 nvmf_vhost 00:56:45.664 nvmf_zcopy 00:56:45.664 ocf 00:56:45.664 ocf_bdevperf_iotypes 00:56:45.664 ocf_configuration_change 00:56:45.664 ocf_create_destruct 00:56:45.664 ocf_fio_modes 00:56:45.664 ocf_flush 00:56:45.664 ocf_multicore 00:56:45.664 ocf_remove 00:56:45.664 ocf_stats 00:56:45.664 odd_alloc 00:56:45.664 packaging 00:56:45.664 per_node_1G_alloc 00:56:45.664 raid0_resize_test 00:56:45.664 raid5f_rebuild_test 00:56:45.664 raid5f_rebuild_test_sb 00:56:45.664 raid5f_state_function_test 00:56:45.664 raid5f_state_function_test_sb 00:56:45.664 raid5f_superblock_test 00:56:45.664 raid_function_test_concat 00:56:45.664 raid_function_test_raid0 00:56:45.664 raid_rebuild_test 00:56:45.664 raid_rebuild_test_io 00:56:45.664 raid_rebuild_test_sb 00:56:45.664 raid_rebuild_test_sb_4k 00:56:45.664 raid_rebuild_test_sb_io 00:56:45.664 raid_rebuild_test_sb_md_interleaved 00:56:45.664 raid_rebuild_test_sb_md_separate 00:56:45.664 raid_state_function_test 00:56:45.664 raid_state_function_test_sb 00:56:45.664 raid_state_function_test_sb_4k 00:56:45.664 raid_state_function_test_sb_md_interleaved 00:56:45.664 raid_state_function_test_sb_md_separate 00:56:45.664 raid_superblock_test 00:56:45.664 raid_superblock_test_4k 00:56:45.664 raid_superblock_test_md_interleaved 00:56:45.664 raid_superblock_test_md_separate 00:56:45.664 reactor_set_interrupt 00:56:45.664 reap_unregistered_poller 00:56:45.664 rocksdb 00:56:45.664 rocksdb_insert 00:56:45.664 rocksdb_overwrite 00:56:45.664 rocksdb_randread 00:56:45.664 rocksdb_readwrite 00:56:45.664 rocksdb_writesync 00:56:45.664 rpc 00:56:45.664 rpc_client 00:56:45.664 rpc_daemon_integrity 00:56:45.664 rpc_integrity 00:56:45.664 rpc_plugins 00:56:45.664 rpc_trace_cmd_test 00:56:45.664 rpm_packaging 00:56:45.664 scanbuild_make 00:56:45.664 scheduler 00:56:45.664 scheduler_create_thread 00:56:45.664 setup.sh 00:56:45.664 skip_rpc 00:56:45.664 skip_rpc_with_delay 00:56:45.664 skip_rpc_with_json 00:56:45.664 sma 00:56:45.664 sma_crypto 00:56:45.664 sma_discovery 00:56:45.664 sma_nvmf_tcp 00:56:45.664 sma_plugins 00:56:45.664 sma_qos 00:56:45.664 sma_vfiouser_qemu 00:56:45.664 sma_vhost 00:56:45.664 spdk_dd 00:56:45.664 spdk_dd_basic_rw 00:56:45.664 spdk_dd_bdev_to_bdev 00:56:45.664 spdk_dd_malloc 00:56:45.664 spdk_dd_negative 00:56:45.664 spdk_dd_posix 00:56:45.664 spdk_dd_sparse 00:56:45.664 spdk_dd_uring 00:56:45.664 spdk_target_abort 00:56:45.664 spdkcli_iscsi 00:56:45.664 spdkcli_nvmf_tcp 00:56:45.664 spdkcli_raid 00:56:45.664 spdkcli_rbd 00:56:45.664 spdkcli_tcp 00:56:45.664 spdkcli_vhost 00:56:45.664 spdkcli_virtio 00:56:45.664 sw_hotplug 00:56:45.664 test_bdev_lvol_delete_lvstore_with_clones 00:56:45.664 test_bdev_lvol_delete_ordering 00:56:45.664 test_clone_decouple_parent 00:56:45.664 test_clone_inflate 00:56:45.664 test_clone_snapshot_relations 00:56:45.664 test_construct_lvol 00:56:45.664 test_construct_lvol_alias_conflict 00:56:45.664 test_construct_lvol_fio_clear_method_none 00:56:45.664 test_construct_lvol_fio_clear_method_unmap 00:56:45.664 test_construct_lvol_full_lvs 00:56:45.664 test_construct_lvol_inexistent_lvs 00:56:45.664 test_construct_lvols_conflict_alias 00:56:45.664 test_construct_lvs 00:56:45.664 test_construct_lvs_clear_methods 00:56:45.664 test_construct_lvs_conflict_alias 00:56:45.664 test_construct_lvs_different_cluster_size 00:56:45.664 test_construct_lvs_nonexistent_bdev 00:56:45.664 test_construct_multi_lvols 00:56:45.664 test_construct_nested_lvol 00:56:45.664 test_construct_two_lvs_on_the_same_bdev 00:56:45.664 test_create_snapshot_of_snapshot 00:56:45.664 test_create_snapshot_with_io 00:56:45.664 test_delete_lvol_store_persistent_positive 00:56:45.665 test_delete_snapshot_with_clone 00:56:45.665 test_delete_snapshot_with_snapshot 00:56:45.665 test_destroy_after_bdev_lvol_resize_positive 00:56:45.665 test_esnap_clones 00:56:45.665 test_esnap_late_arrival 00:56:45.665 test_esnap_reload 00:56:45.665 test_esnap_remove_degraded 00:56:45.665 test_hotremove_lvol_store 00:56:45.665 test_hotremove_lvol_store_base 00:56:45.665 test_hotremove_lvol_store_base_with_lvols 00:56:45.665 test_hotremove_lvol_store_multiple_lvols 00:56:45.665 test_lvol_bdev_readonly 00:56:45.665 test_lvol_list 00:56:45.665 test_lvol_rename_negative 00:56:45.665 test_rename_lvs_negative 00:56:45.665 test_rename_positive 00:56:45.665 test_resize_lvol 00:56:45.665 test_resize_lvol_negative 00:56:45.665 test_resize_lvol_with_io_traffic 00:56:45.665 test_shallow_copy_compare 00:56:45.665 test_sigterm 00:56:45.665 test_snapshot_compare_with_lvol_bdev 00:56:45.665 test_tasting 00:56:45.665 test_thin_lvol_check_integrity 00:56:45.665 test_thin_lvol_check_space 00:56:45.665 test_thin_lvol_check_zeroes 00:56:45.665 test_thin_lvol_resize 00:56:45.665 test_thin_overprovisioning 00:56:45.665 test_unregister_lvol_bdev 00:56:45.665 thread 00:56:45.665 thread_poller_perf 00:56:45.665 thread_spdk_lock 00:56:45.665 ubsan 00:56:45.665 unittest 00:56:45.665 unittest_accel 00:56:45.665 unittest_bdev 00:56:45.665 unittest_bdev_compress 00:56:45.665 unittest_bdev_crypto 00:56:45.665 unittest_bdev_raid5f 00:56:45.665 unittest_blob_blobfs 00:56:45.665 unittest_build 00:56:45.665 unittest_dma 00:56:45.665 unittest_dpdk_compressdev 00:56:45.665 unittest_event 00:56:45.665 unittest_ftl 00:56:45.665 unittest_idxd_user 00:56:45.665 unittest_include 00:56:45.665 unittest_init 00:56:45.665 unittest_ioat 00:56:45.665 unittest_iobuf 00:56:45.665 unittest_iscsi 00:56:45.665 unittest_json 00:56:45.665 unittest_keyring 00:56:45.665 unittest_lib_reduce 00:56:45.665 unittest_log 00:56:45.665 unittest_lvol 00:56:45.665 unittest_notify 00:56:45.665 unittest_nvme 00:56:45.665 unittest_nvme_cuse 00:56:45.665 unittest_nvme_rdma 00:56:45.665 unittest_nvmf 00:56:45.665 unittest_nvmf_rdma 00:56:45.665 unittest_nvmf_transport 00:56:45.665 unittest_nvmf_vfio_user 00:56:45.665 unittest_pci_event 00:56:45.665 unittest_rdma 00:56:45.665 unittest_rpc 00:56:45.665 unittest_scsi 00:56:45.665 unittest_sock 00:56:45.665 unittest_thread 00:56:45.665 unittest_util 00:56:45.665 unittest_vhost 00:56:45.665 valgrind 00:56:45.665 version 00:56:45.665 vfio_fuzz 00:56:45.665 vfio_user_nvme_fio 00:56:45.665 vfio_user_nvme_restart_vm 00:56:45.665 vfio_user_qemu 00:56:45.665 vfio_user_virtio_bdevperf 00:56:45.665 vfio_user_virtio_blk_restart_vm 00:56:45.665 vfio_user_virtio_scsi_restart_vm 00:56:45.665 vhost 00:56:45.665 vhost_blk_cores_2ctrl 00:56:45.665 vhost_blk_fs_integrity 00:56:45.665 vhost_blk_integrity 00:56:45.665 vhost_blk_lvol_integrity 00:56:45.665 vhost_blk_packed_ring_integrity 00:56:45.665 vhost_blockdev 00:56:45.665 vhost_boot 00:56:45.665 vhost_fuzz 00:56:45.665 vhost_migration 00:56:45.665 vhost_migration_tc1 00:56:45.665 vhost_migration_tc2 00:56:45.665 vhost_negative 00:56:45.665 vhost_readonly 00:56:45.665 vhost_scsi_cores_2ctrl 00:56:45.665 vhost_scsi_fs_integrity 00:56:45.665 vhost_scsi_integrity 00:56:45.665 vhost_scsi_lvol_integrity 00:56:45.665 vhost_shared 00:56:45.665 vmd 00:56:45.665 vmd_bdev_svc 00:56:45.665 vmd_fio 00:56:45.665 vmd_hello_world 00:56:45.665 vmd_identify 00:56:45.665 vmd_perf 00:56:45.665 zoned_fio 00:56:45.665 00:56:45.665 00:56:45.665 -----Tests Missing From Build------ 00:56:45.665 balanced 00:56:45.665 blockdev_xnvme 00:56:45.665 busy 00:56:45.665 core_load 00:56:45.665 ftl 00:56:45.665 ftl_bdevperf 00:56:45.665 ftl_dirty_shutdown 00:56:45.665 ftl_fio_basic 00:56:45.665 ftl_restore 00:56:45.665 ftl_restore_fast 00:56:45.665 ftl_trim 00:56:45.665 ftl_upgrade_shutdown 00:56:45.665 iscsi_tgt_data_digest 00:56:45.665 keyring_linux 00:56:45.665 nvme_boot_partition 00:56:45.665 nvme_bp 00:56:45.665 nvme_opal 00:56:45.665 nvme_opal_bdevio 00:56:45.665 nvme_opal_bdevperf 00:56:45.665 nvme_opal_spdk_tgt 00:56:45.665 nvme_xnvme 00:56:45.665 nvmf_digest_dsa_initiator 00:56:45.665 nvmf_digest_dsa_target 00:56:45.665 nvmf_fc 00:56:45.665 spdkcli_nvmf_fc 00:56:45.665 spdkcli_nvmf_rdma 00:56:45.665 test_create_multi_ublk 00:56:45.665 test_create_ublk 00:56:45.665 test_save_ublk_config 00:56:45.665 ublk 00:56:45.665 ublk_recovery 00:56:45.665 unittest_nvmf_fc 00:56:45.665 unittest_nvmf_fc_ls 00:56:45.665 vhost_blk_hot_remove 00:56:45.665 vhost_hotplug 00:56:45.665 vhost_scsi_hot_remove 00:56:45.665 xnvme_bdevperf 00:56:45.665 xnvme_to_malloc_dd_copy 00:56:45.665 00:56:45.665 00:56:45.665 -----Tests Missing ASAN------ 00:56:45.665 accel_cdev_comp 00:56:45.665 accel_cdev_decmop_full 00:56:45.665 accel_cdev_decomp 00:56:45.665 accel_cdev_decomp_full_mcore 00:56:45.665 accel_cdev_decomp_full_mthread 00:56:45.665 accel_cdev_decomp_mcore 00:56:45.665 accel_cdev_decomp_mthread 00:56:45.665 autobuild_llvm_precompile 00:56:45.665 balanced 00:56:45.665 bdev_crypto_enomem 00:56:45.665 blockdev_crypto_aesni 00:56:45.665 blockdev_crypto_qat 00:56:45.665 blockdev_crypto_sw 00:56:45.665 blockdev_rbd 00:56:45.665 blockdev_xnvme 00:56:45.665 busy 00:56:45.665 chaining 00:56:45.665 cmb_copy 00:56:45.665 compress_compdev 00:56:45.665 compress_isal 00:56:45.665 core_load 00:56:45.665 dd_uring_copy 00:56:45.665 dma 00:56:45.665 dpdk_governor 00:56:45.665 filesystem_btrfs 00:56:45.665 filesystem_ext4 00:56:45.665 filesystem_in_capsule_btrfs 00:56:45.665 filesystem_in_capsule_ext4 00:56:45.665 filesystem_in_capsule_xfs 00:56:45.665 filesystem_xfs 00:56:45.665 fio_dif_1_default 00:56:45.665 fio_dif_1_multi_subsystems 00:56:45.665 fio_dif_digest 00:56:45.665 fio_dif_rand_params 00:56:45.665 ftl 00:56:45.665 ftl_bdevperf 00:56:45.665 ftl_dirty_shutdown 00:56:45.665 ftl_fio_basic 00:56:45.665 ftl_restore 00:56:45.665 ftl_restore_fast 00:56:45.665 ftl_trim 00:56:45.665 ftl_upgrade_shutdown 00:56:45.665 go_rpc 00:56:45.665 idle 00:56:45.665 interrupt_mode 00:56:45.665 ioat 00:56:45.665 ioat_perf 00:56:45.665 ioat_verify 00:56:45.665 is_zoned 00:56:45.665 iscsi_tgt 00:56:45.665 iscsi_tgt_bdev_io_wait 00:56:45.665 iscsi_tgt_calsoft 00:56:45.665 iscsi_tgt_data_digest 00:56:45.665 iscsi_tgt_digest 00:56:45.665 iscsi_tgt_digests 00:56:45.665 iscsi_tgt_ext4test 00:56:45.665 iscsi_tgt_filesystem 00:56:45.665 iscsi_tgt_filesystem_btrfs 00:56:45.665 iscsi_tgt_filesystem_ext4 00:56:45.665 iscsi_tgt_filesystem_xfs 00:56:45.665 iscsi_tgt_fio 00:56:45.665 iscsi_tgt_fuzz 00:56:45.665 iscsi_tgt_initiator 00:56:45.665 iscsi_tgt_ip_migration 00:56:45.665 iscsi_tgt_iscsi_lvol 00:56:45.665 iscsi_tgt_login_redirection 00:56:45.665 iscsi_tgt_multiconnection 00:56:45.665 iscsi_tgt_qos 00:56:45.665 iscsi_tgt_rbd 00:56:45.665 iscsi_tgt_reset 00:56:45.665 iscsi_tgt_resize 00:56:45.665 iscsi_tgt_rpc_config 00:56:45.665 iscsi_tgt_sock 00:56:45.665 iscsi_tgt_trace_record 00:56:45.665 kernel_target_abort 00:56:45.665 keyring_file 00:56:45.665 keyring_linux 00:56:45.665 llvm_fuzz 00:56:45.665 lvs_grow_clean 00:56:45.665 lvs_grow_dirty 00:56:45.665 nvme_boot_partition 00:56:45.665 nvme_bp 00:56:45.665 nvme_cli_cuse 00:56:45.665 nvme_cli_plugin 00:56:45.665 nvme_cmb 00:56:45.665 nvme_cuse 00:56:45.665 nvme_cuse_app 00:56:45.665 nvme_cuse_rpc 00:56:45.665 nvme_ns_manage_cuse 00:56:45.665 nvme_opal 00:56:45.665 nvme_opal_bdevio 00:56:45.665 nvme_opal_bdevperf 00:56:45.665 nvme_opal_spdk_tgt 00:56:45.665 nvme_pmr 00:56:45.665 nvme_pmr_persistence 00:56:45.665 nvme_smartctl_cuse 00:56:45.665 nvme_xnvme 00:56:45.665 nvme_zns 00:56:45.665 nvmf_abort 00:56:45.665 nvmf_abort_qd_sizes 00:56:45.665 nvmf_aer 00:56:45.665 nvmf_async_init 00:56:45.665 nvmf_auth_host 00:56:45.665 nvmf_auth_target 00:56:45.665 nvmf_bdev_io_wait 00:56:45.665 nvmf_bdevio 00:56:45.665 nvmf_bdevio_no_huge 00:56:45.665 nvmf_bdevperf 00:56:45.665 nvmf_connect_disconnect 00:56:45.665 nvmf_connect_stress 00:56:45.665 nvmf_delete_subsystem 00:56:45.665 nvmf_device_removal 00:56:45.665 nvmf_device_removal_pci_remove 00:56:45.665 nvmf_device_removal_pci_remove_no_srq 00:56:45.665 nvmf_dif 00:56:45.665 nvmf_digest 00:56:45.665 nvmf_digest_clean 00:56:45.665 nvmf_digest_dsa_initiator 00:56:45.665 nvmf_digest_dsa_target 00:56:45.665 nvmf_digest_error 00:56:45.665 nvmf_discovery_remove_ifc 00:56:45.665 nvmf_example 00:56:45.665 nvmf_failover 00:56:45.665 nvmf_fc 00:56:45.665 nvmf_filesystem 00:56:45.665 nvmf_filesystem_in_capsule 00:56:45.665 nvmf_filesystem_no_in_capsule 00:56:45.665 nvmf_fio_host 00:56:45.665 nvmf_fio_target 00:56:45.665 nvmf_fips 00:56:45.665 nvmf_fused_ordering 00:56:45.665 nvmf_fuzz 00:56:45.665 nvmf_host_discovery 00:56:45.665 nvmf_host_management 00:56:45.665 nvmf_host_multipath 00:56:45.665 nvmf_host_multipath_status 00:56:45.665 nvmf_identify 00:56:45.665 nvmf_identify_kernel_target 00:56:45.665 nvmf_identify_passthru 00:56:45.665 nvmf_initiator_timeout 00:56:45.665 nvmf_invalid 00:56:45.665 nvmf_lvol 00:56:45.665 nvmf_lvs_grow 00:56:45.665 nvmf_mdns_discovery 00:56:45.665 nvmf_multiconnection 00:56:45.665 nvmf_multicontroller 00:56:45.665 nvmf_multitarget 00:56:45.666 nvmf_nmic 00:56:46.231 nvmf_ns_hotplug_stress 00:56:46.231 nvmf_ns_masking 00:56:46.231 nvmf_nvme_cli 00:56:46.231 nvmf_perf 00:56:46.231 nvmf_perf_adq 00:56:46.231 nvmf_queue_depth 00:56:46.231 nvmf_rdma 00:56:46.231 nvmf_referrals 00:56:46.231 nvmf_rpc 00:56:46.231 nvmf_shutdown 00:56:46.231 nvmf_shutdown_tc1 00:56:46.231 nvmf_shutdown_tc2 00:56:46.231 nvmf_shutdown_tc3 00:56:46.231 nvmf_srq_overwhelm 00:56:46.231 nvmf_target_disconnect 00:56:46.231 nvmf_target_disconnect_tc1 00:56:46.231 nvmf_target_disconnect_tc2 00:56:46.231 nvmf_target_disconnect_tc3 00:56:46.231 nvmf_target_discovery 00:56:46.231 nvmf_target_multipath 00:56:46.231 nvmf_tcp 00:56:46.231 nvmf_timeout 00:56:46.231 nvmf_tls 00:56:46.231 nvmf_vfio_user 00:56:46.231 nvmf_vfio_user_fuzz 00:56:46.231 nvmf_vfio_user_nvme_compliance 00:56:46.231 nvmf_zcopy 00:56:46.231 ocf 00:56:46.231 ocf_bdevperf_iotypes 00:56:46.231 ocf_configuration_change 00:56:46.231 ocf_create_destruct 00:56:46.231 ocf_fio_modes 00:56:46.231 ocf_flush 00:56:46.231 ocf_multicore 00:56:46.231 ocf_remove 00:56:46.231 ocf_stats 00:56:46.231 scheduler 00:56:46.231 spdk_dd_uring 00:56:46.231 spdk_target_abort 00:56:46.231 spdkcli_iscsi 00:56:46.231 spdkcli_nvmf_fc 00:56:46.231 spdkcli_nvmf_rdma 00:56:46.231 spdkcli_nvmf_tcp 00:56:46.231 spdkcli_raid 00:56:46.231 spdkcli_rbd 00:56:46.231 spdkcli_virtio 00:56:46.231 test_create_multi_ublk 00:56:46.231 test_create_ublk 00:56:46.231 test_save_ublk_config 00:56:46.231 ublk 00:56:46.231 ublk_recovery 00:56:46.231 unittest_nvmf_fc 00:56:46.231 unittest_nvmf_fc_ls 00:56:46.231 valgrind 00:56:46.231 vfio_fuzz 00:56:46.231 vhost_blk_hot_remove 00:56:46.231 vhost_blockdev 00:56:46.231 vhost_fuzz 00:56:46.231 vhost_hotplug 00:56:46.231 vhost_scsi_hot_remove 00:56:46.231 vhost_shared 00:56:46.231 xnvme_bdevperf 00:56:46.231 xnvme_to_malloc_dd_copy 00:56:46.231 zoned_fio 00:56:46.231 00:56:46.231 00:56:46.231 -----Tests Missing UBSAN------ 00:56:46.231 balanced 00:56:46.231 blockdev_xnvme 00:56:46.231 busy 00:56:46.231 cmb_copy 00:56:46.231 core_load 00:56:46.231 ftl 00:56:46.231 ftl_bdevperf 00:56:46.231 ftl_dirty_shutdown 00:56:46.231 ftl_fio_basic 00:56:46.231 ftl_restore 00:56:46.231 ftl_restore_fast 00:56:46.231 ftl_trim 00:56:46.231 ftl_upgrade_shutdown 00:56:46.231 is_zoned 00:56:46.231 iscsi_tgt_data_digest 00:56:46.231 keyring_linux 00:56:46.231 nvme_boot_partition 00:56:46.231 nvme_bp 00:56:46.231 nvme_cmb 00:56:46.231 nvme_opal 00:56:46.231 nvme_opal_bdevio 00:56:46.231 nvme_opal_bdevperf 00:56:46.231 nvme_opal_spdk_tgt 00:56:46.231 nvme_pmr 00:56:46.231 nvme_pmr_persistence 00:56:46.231 nvme_xnvme 00:56:46.231 nvme_zns 00:56:46.231 nvmf_digest_dsa_initiator 00:56:46.231 nvmf_digest_dsa_target 00:56:46.231 nvmf_fc 00:56:46.231 spdkcli_nvmf_fc 00:56:46.231 spdkcli_nvmf_rdma 00:56:46.231 test_create_multi_ublk 00:56:46.231 test_create_ublk 00:56:46.231 test_save_ublk_config 00:56:46.231 ublk 00:56:46.231 ublk_recovery 00:56:46.231 unittest_nvmf_fc 00:56:46.231 unittest_nvmf_fc_ls 00:56:46.231 vhost_blk_hot_remove 00:56:46.231 vhost_hotplug 00:56:46.231 vhost_scsi_hot_remove 00:56:46.231 xnvme_bdevperf 00:56:46.231 xnvme_to_malloc_dd_copy 00:56:46.231 zoned_fio 00:56:46.231 Not all tests were run. Failing the build. 00:56:46.231 ['blockdev_xnvme', 'ftl', 'ftl_bdevperf', 'ftl_dirty_shutdown', 'ftl_fio_basic', 'ftl_restore', 'ftl_trim', 'ftl_upgrade_shutdown', 'nvme_xnvme', 'spdkcli_nvmf_rdma', 'test_create_multi_ublk', 'test_create_ublk', 'test_save_ublk_config', 'ublk', 'ublk_recovery', 'xnvme_bdevperf', 'xnvme_to_malloc_dd_copy'] 00:56:46.231 + compress_coverage_and_docs 00:56:46.231 + echo 'Start compress coverage and docs' 00:56:46.231 Start compress coverage and docs 00:56:46.231 + tar -C coverage -czf coverage_autotest-spdk-master-vs-dpdk-v22.11_1820.tar.gz ./ --remove-files 00:56:47.164 + tar -C ut_coverage -czf ut_coverage_autotest-spdk-master-vs-dpdk-v22.11_1820.tar.gz ./ --remove-files 00:56:48.097 + tar -C doc -czf doc_autotest-spdk-master-vs-dpdk-v22.11_1820.tar.gz ./ --remove-files 00:56:48.356 + [[ -d llvm ]] 00:56:48.356 + true 00:56:48.356 + echo 'End compress coverage and docs' 00:56:48.356 End compress coverage and docs 00:56:48.356 + remove_partial_coverage_files 00:56:48.356 + find . -name 'cov_*.info' -delete 00:56:48.356 + echo 'End stage post_gen_coverage.sh' 00:56:48.356 End stage post_gen_coverage.sh 00:56:48.365 [Pipeline] } 00:56:48.367 ERROR: script returned exit code 1 00:56:48.386 [Pipeline] // catchError 00:56:48.392 [Pipeline] catchError 00:56:48.393 [Pipeline] { 00:56:48.406 [Pipeline] dir 00:56:48.406 Running in /var/jenkins/workspace/autotest-spdk-master-vs-dpdk-v22.11/post_process 00:56:48.407 [Pipeline] {