[Thu Jul 11 22:55:09 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh reset (start)
[Thu Jul 11 22:55:13 2024] pcieport 0000:d7:00.0: bridge window [io  0x1000-0x0fff] to [bus d8] add_size 1000
[Thu Jul 11 22:55:13 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:55:13 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:55:13 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:55:13 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:55:13 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh reset (done)
[Thu Jul 11 22:55:19 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh reset (start)
[Thu Jul 11 22:55:23 2024] pcieport 0000:d7:00.0: bridge window [io  0x1000-0x0fff] to [bus d8] add_size 1000
[Thu Jul 11 22:55:23 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:55:23 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:55:23 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:55:23 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:55:23 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh reset (done)
[Thu Jul 11 22:55:23 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh status (start)
[Thu Jul 11 22:55:26 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh status (done)
[Thu Jul 11 22:55:26 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh config (start)
[Thu Jul 11 22:55:30 2024] ioatdma 0000:00:04.7: Removing dma and dca services
[Thu Jul 11 22:55:30 2024] ioatdma 0000:00:04.6: Removing dma and dca services
[Thu Jul 11 22:55:30 2024] ioatdma 0000:00:04.5: Removing dma and dca services
[Thu Jul 11 22:55:30 2024] ioatdma 0000:00:04.4: Removing dma and dca services
[Thu Jul 11 22:55:30 2024] ioatdma 0000:00:04.3: Removing dma and dca services
[Thu Jul 11 22:55:30 2024] ioatdma 0000:00:04.2: Removing dma and dca services
[Thu Jul 11 22:55:30 2024] ioatdma 0000:00:04.1: Removing dma and dca services
[Thu Jul 11 22:55:30 2024] ioatdma 0000:00:04.0: Removing dma and dca services
[Thu Jul 11 22:55:30 2024] ioatdma 0000:80:04.7: Removing dma and dca services
[Thu Jul 11 22:55:30 2024] ioatdma 0000:80:04.6: Removing dma and dca services
[Thu Jul 11 22:55:30 2024] ioatdma 0000:80:04.5: Removing dma and dca services
[Thu Jul 11 22:55:30 2024] ioatdma 0000:80:04.4: Removing dma and dca services
[Thu Jul 11 22:55:30 2024] ioatdma 0000:80:04.3: Removing dma and dca services
[Thu Jul 11 22:55:30 2024] ioatdma 0000:80:04.2: Removing dma and dca services
[Thu Jul 11 22:55:30 2024] ioatdma 0000:80:04.1: Removing dma and dca services
[Thu Jul 11 22:55:30 2024] ioatdma 0000:80:04.0: Removing dma and dca services
[Thu Jul 11 22:55:30 2024] pcieport 0000:d7:00.0: bridge window [io  0x1000-0x0fff] to [bus d8] add_size 1000
[Thu Jul 11 22:55:30 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:55:30 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:55:30 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:55:30 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:55:30 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh config (done)
[Thu Jul 11 22:55:30 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh reset (start)
[Thu Jul 11 22:55:34 2024] nvme nvme1: pci function 0000:af:00.0
[Thu Jul 11 22:55:34 2024] nvme nvme1: 31/0/0 default/read/poll queues
[Thu Jul 11 22:55:35 2024] nvme nvme2: pci function 0000:b0:00.0
[Thu Jul 11 22:55:35 2024] nvme nvme2: 31/0/0 default/read/poll queues
[Thu Jul 11 22:55:35 2024] pcieport 0000:d7:00.0: bridge window [io  0x1000-0x0fff] to [bus d8] add_size 1000
[Thu Jul 11 22:55:35 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:55:35 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:55:35 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:55:35 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:55:35 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh reset (done)
[Thu Jul 11 22:55:35 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh config (start)
[Thu Jul 11 22:55:41 2024] pcieport 0000:d7:00.0: bridge window [io  0x1000-0x0fff] to [bus d8] add_size 1000
[Thu Jul 11 22:55:41 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:55:41 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:55:41 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:55:41 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:55:41 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh config (done)
[Thu Jul 11 22:55:41 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh reset (start)
[Thu Jul 11 22:55:45 2024] nvme nvme0: pci function 0000:5e:00.0
[Thu Jul 11 22:55:45 2024] nvme nvme0: Shutdown timeout set to 8 seconds
[Thu Jul 11 22:55:45 2024] nvme nvme0: 72/0/0 default/read/poll queues
[Thu Jul 11 22:55:45 2024] pcieport 0000:d7:00.0: bridge window [io  0x1000-0x0fff] to [bus d8] add_size 1000
[Thu Jul 11 22:55:45 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:55:45 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:55:45 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:55:45 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:55:45 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh reset (done)
[Thu Jul 11 22:55:46 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh  (start)
[Thu Jul 11 22:55:49 2024] ioatdma 0000:00:04.7: Removing dma and dca services
[Thu Jul 11 22:55:49 2024] ioatdma 0000:00:04.6: Removing dma and dca services
[Thu Jul 11 22:55:49 2024] ioatdma 0000:00:04.5: Removing dma and dca services
[Thu Jul 11 22:55:49 2024] ioatdma 0000:00:04.4: Removing dma and dca services
[Thu Jul 11 22:55:49 2024] ioatdma 0000:00:04.3: Removing dma and dca services
[Thu Jul 11 22:55:49 2024] ioatdma 0000:00:04.2: Removing dma and dca services
[Thu Jul 11 22:55:49 2024] ioatdma 0000:00:04.1: Removing dma and dca services
[Thu Jul 11 22:55:49 2024] ioatdma 0000:00:04.0: Removing dma and dca services
[Thu Jul 11 22:55:49 2024] ioatdma 0000:80:04.7: Removing dma and dca services
[Thu Jul 11 22:55:49 2024] ioatdma 0000:80:04.6: Removing dma and dca services
[Thu Jul 11 22:55:49 2024] ioatdma 0000:80:04.5: Removing dma and dca services
[Thu Jul 11 22:55:49 2024] ioatdma 0000:80:04.4: Removing dma and dca services
[Thu Jul 11 22:55:49 2024] ioatdma 0000:80:04.3: Removing dma and dca services
[Thu Jul 11 22:55:49 2024] ioatdma 0000:80:04.2: Removing dma and dca services
[Thu Jul 11 22:55:49 2024] ioatdma 0000:80:04.1: Removing dma and dca services
[Thu Jul 11 22:55:49 2024] ioatdma 0000:80:04.0: Removing dma and dca services
[Thu Jul 11 22:55:49 2024] pcieport 0000:d7:00.0: bridge window [io  0x1000-0x0fff] to [bus d8] add_size 1000
[Thu Jul 11 22:55:49 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:55:49 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:55:49 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:55:49 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:55:49 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh  (done)
[Thu Jul 11 22:55:50 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh  (start)
[Thu Jul 11 22:55:53 2024] pcieport 0000:d7:00.0: bridge window [io  0x1000-0x0fff] to [bus d8] add_size 1000
[Thu Jul 11 22:55:53 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:55:53 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:55:53 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:55:53 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:55:53 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh  (done)
[Thu Jul 11 22:55:53 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh  (start)
[Thu Jul 11 22:55:57 2024] pcieport 0000:d7:00.0: bridge window [io  0x1000-0x0fff] to [bus d8] add_size 1000
[Thu Jul 11 22:55:57 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:55:57 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:55:57 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:55:57 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:55:57 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh  (done)
[Thu Jul 11 22:55:57 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh  (start)
[Thu Jul 11 22:56:00 2024] pcieport 0000:d7:00.0: bridge window [io  0x1000-0x0fff] to [bus d8] add_size 1000
[Thu Jul 11 22:56:00 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:56:00 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:56:00 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:56:00 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:56:00 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh  (done)
[Thu Jul 11 22:56:01 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh  (start)
[Thu Jul 11 22:56:04 2024] pcieport 0000:d7:00.0: bridge window [io  0x1000-0x0fff] to [bus d8] add_size 1000
[Thu Jul 11 22:56:04 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:56:04 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:56:04 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:56:04 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:56:04 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh  (done)
[Thu Jul 11 22:56:04 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh  (start)
[Thu Jul 11 22:56:08 2024] pcieport 0000:d7:00.0: bridge window [io  0x1000-0x0fff] to [bus d8] add_size 1000
[Thu Jul 11 22:56:08 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:56:08 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:56:08 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:56:08 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:56:08 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh  (done)
[Thu Jul 11 22:56:08 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh  (start)
[Thu Jul 11 22:56:11 2024] pcieport 0000:d7:00.0: bridge window [io  0x1000-0x0fff] to [bus d8] add_size 1000
[Thu Jul 11 22:56:11 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:56:11 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:56:11 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:56:11 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:56:11 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh  (done)
[Thu Jul 11 22:56:12 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh reset (start)
[Thu Jul 11 22:56:15 2024] nvme nvme0: pci function 0000:5e:00.0
[Thu Jul 11 22:56:15 2024] nvme nvme0: Shutdown timeout set to 8 seconds
[Thu Jul 11 22:56:15 2024] nvme nvme0: 72/0/0 default/read/poll queues
[Thu Jul 11 22:56:16 2024] nvme nvme1: pci function 0000:af:00.0
[Thu Jul 11 22:56:16 2024] nvme nvme1: 31/0/0 default/read/poll queues
[Thu Jul 11 22:56:16 2024] nvme nvme2: pci function 0000:b0:00.0
[Thu Jul 11 22:56:16 2024] nvme nvme2: 31/0/0 default/read/poll queues
[Thu Jul 11 22:56:17 2024] pcieport 0000:d7:00.0: bridge window [io  0x1000-0x0fff] to [bus d8] add_size 1000
[Thu Jul 11 22:56:17 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:56:17 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:56:17 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:56:17 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:56:17 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh reset (done)
[Thu Jul 11 22:56:17 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh config (start)
[Thu Jul 11 22:56:21 2024] ioatdma 0000:00:04.7: Removing dma and dca services
[Thu Jul 11 22:56:21 2024] ioatdma 0000:00:04.6: Removing dma and dca services
[Thu Jul 11 22:56:21 2024] ioatdma 0000:00:04.5: Removing dma and dca services
[Thu Jul 11 22:56:21 2024] ioatdma 0000:00:04.4: Removing dma and dca services
[Thu Jul 11 22:56:21 2024] ioatdma 0000:00:04.3: Removing dma and dca services
[Thu Jul 11 22:56:21 2024] ioatdma 0000:00:04.2: Removing dma and dca services
[Thu Jul 11 22:56:21 2024] ioatdma 0000:00:04.1: Removing dma and dca services
[Thu Jul 11 22:56:21 2024] ioatdma 0000:00:04.0: Removing dma and dca services
[Thu Jul 11 22:56:21 2024] ioatdma 0000:80:04.7: Removing dma and dca services
[Thu Jul 11 22:56:21 2024] ioatdma 0000:80:04.6: Removing dma and dca services
[Thu Jul 11 22:56:21 2024] ioatdma 0000:80:04.5: Removing dma and dca services
[Thu Jul 11 22:56:21 2024] ioatdma 0000:80:04.4: Removing dma and dca services
[Thu Jul 11 22:56:21 2024] ioatdma 0000:80:04.3: Removing dma and dca services
[Thu Jul 11 22:56:21 2024] ioatdma 0000:80:04.2: Removing dma and dca services
[Thu Jul 11 22:56:21 2024] ioatdma 0000:80:04.1: Removing dma and dca services
[Thu Jul 11 22:56:21 2024] ioatdma 0000:80:04.0: Removing dma and dca services
[Thu Jul 11 22:56:21 2024] pcieport 0000:d7:00.0: bridge window [io  0x1000-0x0fff] to [bus d8] add_size 1000
[Thu Jul 11 22:56:21 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:56:21 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:56:21 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:56:21 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:56:21 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh config (done)
[Thu Jul 11 22:56:21 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh reset (start)
[Thu Jul 11 22:56:24 2024] nvme nvme0: pci function 0000:5e:00.0
[Thu Jul 11 22:56:24 2024] nvme nvme0: Shutdown timeout set to 8 seconds
[Thu Jul 11 22:56:24 2024] nvme nvme0: 72/0/0 default/read/poll queues
[Thu Jul 11 22:56:25 2024] nvme nvme1: pci function 0000:af:00.0
[Thu Jul 11 22:56:25 2024] nvme nvme1: 31/0/0 default/read/poll queues
[Thu Jul 11 22:56:25 2024] nvme nvme2: pci function 0000:b0:00.0
[Thu Jul 11 22:56:25 2024] nvme nvme2: 31/0/0 default/read/poll queues
[Thu Jul 11 22:56:26 2024] pcieport 0000:d7:00.0: bridge window [io  0x1000-0x0fff] to [bus d8] add_size 1000
[Thu Jul 11 22:56:26 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:56:26 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:56:26 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:56:26 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:56:26 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh reset (done)
[Thu Jul 11 22:56:26 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh reset (start)
[Thu Jul 11 22:56:31 2024] pcieport 0000:d7:00.0: bridge window [io  0x1000-0x0fff] to [bus d8] add_size 1000
[Thu Jul 11 22:56:31 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:56:31 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:56:31 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:56:31 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:56:31 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh reset (done)
[Thu Jul 11 22:56:33 2024]  nvme0n1: p1
[Thu Jul 11 22:56:33 2024] EXT4-fs (nvme0n1p1): mounted filesystem abc5cd14-4e67-4683-b44c-f75a283da7ab r/w with ordered data mode. Quota mode: none.
[Thu Jul 11 22:56:33 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh config (start)
[Thu Jul 11 22:56:37 2024] pcieport 0000:d7:00.0: bridge window [io  0x1000-0x0fff] to [bus d8] add_size 1000
[Thu Jul 11 22:56:37 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:56:37 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:56:37 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:56:37 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:56:37 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh config (done)
[Thu Jul 11 22:56:37 2024] EXT4-fs (nvme0n1p1): unmounting filesystem abc5cd14-4e67-4683-b44c-f75a283da7ab.
[Thu Jul 11 22:56:37 2024] EXT4-fs (nvme0n1): mounted filesystem 31d2f87e-5157-4b93-be73-df6603f905a9 r/w with ordered data mode. Quota mode: none.
[Thu Jul 11 22:56:37 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh config (start)
[Thu Jul 11 22:56:41 2024] pcieport 0000:d7:00.0: bridge window [io  0x1000-0x0fff] to [bus d8] add_size 1000
[Thu Jul 11 22:56:41 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:56:41 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:56:41 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:56:41 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:56:41 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh config (done)
[Thu Jul 11 22:56:41 2024] EXT4-fs (nvme0n1): unmounting filesystem 31d2f87e-5157-4b93-be73-df6603f905a9.
[Thu Jul 11 22:56:41 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh config (start)
[Thu Jul 11 22:56:44 2024] pcieport 0000:d7:00.0: bridge window [io  0x1000-0x0fff] to [bus d8] add_size 1000
[Thu Jul 11 22:56:44 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:56:44 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:56:44 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:56:44 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:56:44 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh config (done)
[Thu Jul 11 22:56:47 2024]  nvme0n1: p1
[Thu Jul 11 22:56:48 2024]  nvme0n1: p1 p2
[Thu Jul 11 22:56:48 2024] EXT4-fs (dm-0): mounted filesystem 787318a2-d196-4c1f-b9bd-ed57fb40e312 r/w with ordered data mode. Quota mode: none.
[Thu Jul 11 22:56:48 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh config (start)
[Thu Jul 11 22:56:51 2024] pcieport 0000:d7:00.0: bridge window [io  0x1000-0x0fff] to [bus d8] add_size 1000
[Thu Jul 11 22:56:51 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:56:51 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:56:51 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:56:51 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:56:51 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh config (done)
[Thu Jul 11 22:56:51 2024] EXT4-fs (dm-0): unmounting filesystem 787318a2-d196-4c1f-b9bd-ed57fb40e312.
[Thu Jul 11 22:56:51 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh config (start)
[Thu Jul 11 22:56:54 2024] pcieport 0000:d7:00.0: bridge window [io  0x1000-0x0fff] to [bus d8] add_size 1000
[Thu Jul 11 22:56:54 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:56:54 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:56:54 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:56:54 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:56:54 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh config (done)
[Thu Jul 11 22:56:54 2024] Buffer I/O error on dev dm-0, logical block 262128, async page read
[Thu Jul 11 22:56:55 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh status (start)
[Thu Jul 11 22:56:58 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh status (done)
[Thu Jul 11 22:56:58 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh  (start)
[Thu Jul 11 22:57:02 2024] ioatdma 0000:00:04.7: Removing dma and dca services
[Thu Jul 11 22:57:02 2024] ioatdma 0000:00:04.6: Removing dma and dca services
[Thu Jul 11 22:57:02 2024] ioatdma 0000:00:04.5: Removing dma and dca services
[Thu Jul 11 22:57:02 2024] ioatdma 0000:00:04.4: Removing dma and dca services
[Thu Jul 11 22:57:02 2024] ioatdma 0000:00:04.3: Removing dma and dca services
[Thu Jul 11 22:57:02 2024] ioatdma 0000:00:04.2: Removing dma and dca services
[Thu Jul 11 22:57:02 2024] ioatdma 0000:00:04.1: Removing dma and dca services
[Thu Jul 11 22:57:02 2024] ioatdma 0000:00:04.0: Removing dma and dca services
[Thu Jul 11 22:57:02 2024] ioatdma 0000:80:04.7: Removing dma and dca services
[Thu Jul 11 22:57:02 2024] ioatdma 0000:80:04.6: Removing dma and dca services
[Thu Jul 11 22:57:02 2024] ioatdma 0000:80:04.5: Removing dma and dca services
[Thu Jul 11 22:57:02 2024] ioatdma 0000:80:04.4: Removing dma and dca services
[Thu Jul 11 22:57:02 2024] ioatdma 0000:80:04.3: Removing dma and dca services
[Thu Jul 11 22:57:02 2024] ioatdma 0000:80:04.2: Removing dma and dca services
[Thu Jul 11 22:57:02 2024] ioatdma 0000:80:04.1: Removing dma and dca services
[Thu Jul 11 22:57:02 2024] ioatdma 0000:80:04.0: Removing dma and dca services
[Thu Jul 11 22:57:03 2024] pcieport 0000:d7:00.0: bridge window [io  0x1000-0x0fff] to [bus d8] add_size 1000
[Thu Jul 11 22:57:03 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:57:03 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:57:03 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:57:03 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:57:04 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh  (done)
[Thu Jul 11 22:57:05 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh reset (start)
[Thu Jul 11 22:57:08 2024] nvme nvme0: pci function 0000:5e:00.0
[Thu Jul 11 22:57:08 2024] nvme nvme0: Shutdown timeout set to 8 seconds
[Thu Jul 11 22:57:08 2024] nvme nvme0: 72/0/0 default/read/poll queues
[Thu Jul 11 22:57:08 2024] nvme nvme1: pci function 0000:af:00.0
[Thu Jul 11 22:57:08 2024] nvme nvme1: 31/0/0 default/read/poll queues
[Thu Jul 11 22:57:09 2024] nvme nvme2: pci function 0000:b0:00.0
[Thu Jul 11 22:57:09 2024] nvme nvme2: 31/0/0 default/read/poll queues
[Thu Jul 11 22:57:10 2024] pcieport 0000:d7:00.0: bridge window [io  0x1000-0x0fff] to [bus d8] add_size 1000
[Thu Jul 11 22:57:10 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:57:10 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:57:10 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:57:10 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:57:10 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh reset (done)
[Thu Jul 11 22:57:10 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh  (start)
[Thu Jul 11 22:57:13 2024] ioatdma 0000:00:04.7: Removing dma and dca services
[Thu Jul 11 22:57:13 2024] ioatdma 0000:00:04.6: Removing dma and dca services
[Thu Jul 11 22:57:13 2024] ioatdma 0000:00:04.5: Removing dma and dca services
[Thu Jul 11 22:57:13 2024] ioatdma 0000:00:04.4: Removing dma and dca services
[Thu Jul 11 22:57:13 2024] ioatdma 0000:00:04.3: Removing dma and dca services
[Thu Jul 11 22:57:13 2024] ioatdma 0000:00:04.2: Removing dma and dca services
[Thu Jul 11 22:57:13 2024] ioatdma 0000:00:04.1: Removing dma and dca services
[Thu Jul 11 22:57:13 2024] ioatdma 0000:00:04.0: Removing dma and dca services
[Thu Jul 11 22:57:13 2024] ioatdma 0000:80:04.7: Removing dma and dca services
[Thu Jul 11 22:57:14 2024] ioatdma 0000:80:04.6: Removing dma and dca services
[Thu Jul 11 22:57:14 2024] ioatdma 0000:80:04.5: Removing dma and dca services
[Thu Jul 11 22:57:14 2024] ioatdma 0000:80:04.4: Removing dma and dca services
[Thu Jul 11 22:57:14 2024] ioatdma 0000:80:04.3: Removing dma and dca services
[Thu Jul 11 22:57:14 2024] ioatdma 0000:80:04.2: Removing dma and dca services
[Thu Jul 11 22:57:14 2024] ioatdma 0000:80:04.1: Removing dma and dca services
[Thu Jul 11 22:57:14 2024] ioatdma 0000:80:04.0: Removing dma and dca services
[Thu Jul 11 22:57:14 2024] pcieport 0000:d7:00.0: bridge window [io  0x1000-0x0fff] to [bus d8] add_size 1000
[Thu Jul 11 22:57:14 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:57:14 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:57:14 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 22:57:14 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 22:57:14 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh  (done)
[Thu Jul 11 22:59:03 2024] nbd0: detected capacity change from 0 to 131072
[Thu Jul 11 22:59:03 2024] nbd1: detected capacity change from 0 to 131072
[Thu Jul 11 22:59:04 2024] block nbd0: NBD_DISCONNECT
[Thu Jul 11 22:59:04 2024] block nbd0: Disconnected due to user request.
[Thu Jul 11 22:59:04 2024] block nbd1: NBD_DISCONNECT
[Thu Jul 11 22:59:04 2024] block nbd1: Disconnected due to user request.
[Thu Jul 11 22:59:09 2024] nbd0: detected capacity change from 0 to 131072
[Thu Jul 11 22:59:09 2024] nbd1: detected capacity change from 0 to 131072
[Thu Jul 11 22:59:10 2024] block nbd0: NBD_DISCONNECT
[Thu Jul 11 22:59:10 2024] block nbd0: Disconnected due to user request.
[Thu Jul 11 22:59:10 2024] block nbd1: NBD_DISCONNECT
[Thu Jul 11 22:59:10 2024] block nbd1: Disconnected due to user request.
[Thu Jul 11 22:59:15 2024] nbd0: detected capacity change from 0 to 131072
[Thu Jul 11 22:59:15 2024] nbd1: detected capacity change from 0 to 131072
[Thu Jul 11 22:59:16 2024] block nbd0: NBD_DISCONNECT
[Thu Jul 11 22:59:16 2024] block nbd0: Disconnected due to user request.
[Thu Jul 11 22:59:16 2024] block nbd1: NBD_DISCONNECT
[Thu Jul 11 22:59:16 2024] block nbd1: Disconnected due to user request.
[Thu Jul 11 23:02:44 2024] nbd0: detected capacity change from 0 to 40960000
[Thu Jul 11 23:03:14 2024] GPT:Primary header thinks Alt. header is not at the end of the disk.
[Thu Jul 11 23:03:14 2024] GPT:10485759 != 40959999
[Thu Jul 11 23:03:14 2024] GPT:Alternate GPT header not at the end of the disk.
[Thu Jul 11 23:03:14 2024] GPT:10485759 != 40959999
[Thu Jul 11 23:03:14 2024] GPT: Use GNU Parted to correct GPT errors.
[Thu Jul 11 23:03:14 2024]  nbd0: p1 p2 p3 p4 p5
[Thu Jul 11 23:03:14 2024] block nbd0: NBD_DISCONNECT
[Thu Jul 11 23:03:14 2024] block nbd0: Disconnected due to user request.
[Thu Jul 11 23:07:50 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/test/vhost/nvmf/../../../scripts/setup.sh  (start)
[Thu Jul 11 23:07:53 2024] pcieport 0000:d7:00.0: bridge window [io  0x1000-0x0fff] to [bus d8] add_size 1000
[Thu Jul 11 23:07:53 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 23:07:53 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 23:07:53 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 23:07:53 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 23:07:54 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/test/vhost/nvmf/../../../scripts/setup.sh  (done)
[Thu Jul 11 23:08:01 2024] nvmf_init_br: left allmulticast mode
[Thu Jul 11 23:08:01 2024] nvmf_init_br: left promiscuous mode
[Thu Jul 11 23:08:01 2024] nvmf_br: port 1(nvmf_init_br) entered disabled state
[Thu Jul 11 23:08:01 2024] nvmf_br: port 1(nvmf_init_br) entered blocking state
[Thu Jul 11 23:08:01 2024] nvmf_br: port 1(nvmf_init_br) entered disabled state
[Thu Jul 11 23:08:01 2024] nvmf_init_br: entered allmulticast mode
[Thu Jul 11 23:08:01 2024] nvmf_init_br: entered promiscuous mode
[Thu Jul 11 23:08:01 2024] nvmf_br: port 1(nvmf_init_br) entered blocking state
[Thu Jul 11 23:08:01 2024] nvmf_br: port 1(nvmf_init_br) entered forwarding state
[Thu Jul 11 23:08:01 2024] nvmf_br: port 2(nvmf_tgt_br) entered blocking state
[Thu Jul 11 23:08:01 2024] nvmf_br: port 2(nvmf_tgt_br) entered disabled state
[Thu Jul 11 23:08:01 2024] nvmf_tgt_br: entered allmulticast mode
[Thu Jul 11 23:08:01 2024] nvmf_tgt_br: entered promiscuous mode
[Thu Jul 11 23:08:01 2024] nvmf_br: port 2(nvmf_tgt_br) entered blocking state
[Thu Jul 11 23:08:01 2024] nvmf_br: port 2(nvmf_tgt_br) entered forwarding state
[Thu Jul 11 23:08:01 2024] nvmf_br: port 3(nvmf_tgt_br2) entered blocking state
[Thu Jul 11 23:08:01 2024] nvmf_br: port 3(nvmf_tgt_br2) entered disabled state
[Thu Jul 11 23:08:01 2024] nvmf_tgt_br2: entered allmulticast mode
[Thu Jul 11 23:08:01 2024] nvmf_tgt_br2: entered promiscuous mode
[Thu Jul 11 23:08:01 2024] nvmf_br: port 3(nvmf_tgt_br2) entered blocking state
[Thu Jul 11 23:08:01 2024] nvmf_br: port 3(nvmf_tgt_br2) entered forwarding state
[Thu Jul 11 23:08:01 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/test/vhost/nvmf/../../../scripts/setup.sh  (start)
[Thu Jul 11 23:08:05 2024] pcieport 0000:d7:00.0: bridge window [io  0x1000-0x0fff] to [bus d8] add_size 1000
[Thu Jul 11 23:08:05 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 23:08:05 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 23:08:05 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 23:08:05 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 23:08:05 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/test/vhost/nvmf/../../../scripts/setup.sh  (done)
[Thu Jul 11 23:08:05 2024] Key type psk registered
[Thu Jul 11 23:09:08 2024] Key type psk unregistered
[Thu Jul 11 23:09:11 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/test/vhost/nvmf/../../../scripts/setup.sh reset (start)
[Thu Jul 11 23:09:14 2024] nvme nvme0: pci function 0000:5e:00.0
[Thu Jul 11 23:09:14 2024] nvme nvme0: Shutdown timeout set to 8 seconds
[Thu Jul 11 23:09:14 2024] nvme nvme0: 72/0/0 default/read/poll queues
[Thu Jul 11 23:09:14 2024] nvme nvme1: pci function 0000:af:00.0
[Thu Jul 11 23:09:14 2024] nvme nvme1: 31/0/0 default/read/poll queues
[Thu Jul 11 23:09:15 2024] nvme nvme2: pci function 0000:b0:00.0
[Thu Jul 11 23:09:15 2024] nvme nvme2: 31/0/0 default/read/poll queues
[Thu Jul 11 23:09:16 2024] pcieport 0000:d7:00.0: bridge window [io  0x1000-0x0fff] to [bus d8] add_size 1000
[Thu Jul 11 23:09:16 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 23:09:16 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 23:09:16 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 23:09:16 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 23:09:16 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/test/vhost/nvmf/../../../scripts/setup.sh reset (done)
[Thu Jul 11 23:09:16 2024] nvmf_br: port 3(nvmf_tgt_br2) entered disabled state
[Thu Jul 11 23:09:16 2024] nvmf_br: port 2(nvmf_tgt_br) entered disabled state
[Thu Jul 11 23:09:16 2024] nvmf_tgt_br2 (unregistering): left allmulticast mode
[Thu Jul 11 23:09:16 2024] nvmf_tgt_br2 (unregistering): left promiscuous mode
[Thu Jul 11 23:09:16 2024] nvmf_br: port 3(nvmf_tgt_br2) entered disabled state
[Thu Jul 11 23:09:16 2024] nvmf_tgt_br (unregistering): left allmulticast mode
[Thu Jul 11 23:09:16 2024] nvmf_tgt_br (unregistering): left promiscuous mode
[Thu Jul 11 23:09:16 2024] nvmf_br: port 2(nvmf_tgt_br) entered disabled state
[Thu Jul 11 23:09:21 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh reset (start)
[Thu Jul 11 23:09:24 2024] pcieport 0000:d7:00.0: bridge window [io  0x1000-0x0fff] to [bus d8] add_size 1000
[Thu Jul 11 23:09:24 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 23:09:24 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 23:09:24 2024] pcieport 0000:d7:00.0: BAR 13: no space for [io  size 0x1000]
[Thu Jul 11 23:09:24 2024] pcieport 0000:d7:00.0: BAR 13: failed to assign [io  size 0x1000]
[Thu Jul 11 23:09:24 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh reset (done)
[Thu Jul 11 23:09:24 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh cleanup (start)
[Thu Jul 11 23:09:28 2024] spdk: /var/jenkins/workspace/vhost-phy-autotest/spdk/scripts/setup.sh cleanup (done)