[Mon Dec 2 16:11:21 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh reset (start) [Mon Dec 2 16:11:24 2024] pcieport 0000:d7:00.0: bridge window [io 0x1000-0x0fff] to [bus d8] add_size 1000 [Mon Dec 2 16:11:24 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space [Mon Dec 2 16:11:24 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign [Mon Dec 2 16:11:24 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space [Mon Dec 2 16:11:24 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign [Mon Dec 2 16:11:24 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh reset (done) [Mon Dec 2 16:11:29 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh status (start) [Mon Dec 2 16:11:32 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh status (done) [Mon Dec 2 16:11:32 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh (start) [Mon Dec 2 16:11:34 2024] ioatdma 0000:00:04.7: Removing dma and dca services [Mon Dec 2 16:11:34 2024] ioatdma 0000:00:04.6: Removing dma and dca services [Mon Dec 2 16:11:34 2024] ioatdma 0000:00:04.5: Removing dma and dca services [Mon Dec 2 16:11:34 2024] ioatdma 0000:00:04.4: Removing dma and dca services [Mon Dec 2 16:11:34 2024] ioatdma 0000:00:04.3: Removing dma and dca services [Mon Dec 2 16:11:34 2024] ioatdma 0000:00:04.2: Removing dma and dca services [Mon Dec 2 16:11:34 2024] ioatdma 0000:00:04.1: Removing dma and dca services [Mon Dec 2 16:11:34 2024] ioatdma 0000:00:04.0: Removing dma and dca services [Mon Dec 2 16:11:34 2024] ioatdma 0000:80:04.7: Removing dma and dca services [Mon Dec 2 16:11:34 2024] ioatdma 0000:80:04.6: Removing dma and dca services [Mon Dec 2 16:11:34 2024] ioatdma 0000:80:04.5: Removing dma and dca services [Mon Dec 2 16:11:34 2024] ioatdma 0000:80:04.4: Removing dma and dca services [Mon Dec 2 16:11:34 2024] ioatdma 0000:80:04.3: Removing dma and dca services [Mon Dec 2 16:11:34 2024] ioatdma 0000:80:04.2: Removing dma and dca services [Mon Dec 2 16:11:34 2024] ioatdma 0000:80:04.1: Removing dma and dca services [Mon Dec 2 16:11:34 2024] ioatdma 0000:80:04.0: Removing dma and dca services [Mon Dec 2 16:11:37 2024] pcieport 0000:d7:00.0: bridge window [io 0x1000-0x0fff] to [bus d8] add_size 1000 [Mon Dec 2 16:11:37 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space [Mon Dec 2 16:11:37 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign [Mon Dec 2 16:11:37 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space [Mon Dec 2 16:11:37 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign [Mon Dec 2 16:11:38 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh (done) [Mon Dec 2 16:11:39 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh reset (start) [Mon Dec 2 16:11:42 2024] nvme nvme0: pci function 0000:d9:00.0 [Mon Dec 2 16:11:42 2024] nvme nvme0: Shutdown timeout set to 15 seconds [Mon Dec 2 16:11:42 2024] nvme nvme0: 96/0/0 default/read/poll queues [Mon Dec 2 16:11:42 2024] nvme nvme0: Ignoring bogus Namespace Identifiers [Mon Dec 2 16:11:42 2024] pcieport 0000:d7:00.0: bridge window [io 0x1000-0x0fff] to [bus d8] add_size 1000 [Mon Dec 2 16:11:42 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space [Mon Dec 2 16:11:42 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign [Mon Dec 2 16:11:42 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space [Mon Dec 2 16:11:42 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign [Mon Dec 2 16:11:42 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh reset (done) [Mon Dec 2 16:11:42 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh (start) [Mon Dec 2 16:11:45 2024] ioatdma 0000:00:04.7: Removing dma and dca services [Mon Dec 2 16:11:45 2024] ioatdma 0000:00:04.6: Removing dma and dca services [Mon Dec 2 16:11:45 2024] ioatdma 0000:00:04.5: Removing dma and dca services [Mon Dec 2 16:11:45 2024] ioatdma 0000:00:04.4: Removing dma and dca services [Mon Dec 2 16:11:45 2024] ioatdma 0000:00:04.3: Removing dma and dca services [Mon Dec 2 16:11:45 2024] ioatdma 0000:00:04.2: Removing dma and dca services [Mon Dec 2 16:11:45 2024] ioatdma 0000:00:04.1: Removing dma and dca services [Mon Dec 2 16:11:45 2024] ioatdma 0000:00:04.0: Removing dma and dca services [Mon Dec 2 16:11:45 2024] ioatdma 0000:80:04.7: Removing dma and dca services [Mon Dec 2 16:11:45 2024] ioatdma 0000:80:04.6: Removing dma and dca services [Mon Dec 2 16:11:45 2024] ioatdma 0000:80:04.5: Removing dma and dca services [Mon Dec 2 16:11:45 2024] ioatdma 0000:80:04.4: Removing dma and dca services [Mon Dec 2 16:11:45 2024] ioatdma 0000:80:04.3: Removing dma and dca services [Mon Dec 2 16:11:45 2024] ioatdma 0000:80:04.2: Removing dma and dca services [Mon Dec 2 16:11:45 2024] ioatdma 0000:80:04.1: Removing dma and dca services [Mon Dec 2 16:11:45 2024] ioatdma 0000:80:04.0: Removing dma and dca services [Mon Dec 2 16:11:48 2024] pcieport 0000:d7:00.0: bridge window [io 0x1000-0x0fff] to [bus d8] add_size 1000 [Mon Dec 2 16:11:48 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space [Mon Dec 2 16:11:48 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign [Mon Dec 2 16:11:48 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space [Mon Dec 2 16:11:48 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign [Mon Dec 2 16:11:49 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh (done) [Mon Dec 2 16:12:04 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh reset (start) [Mon Dec 2 16:12:07 2024] nvme nvme0: pci function 0000:d9:00.0 [Mon Dec 2 16:12:07 2024] nvme nvme0: Shutdown timeout set to 15 seconds [Mon Dec 2 16:12:07 2024] nvme nvme0: 96/0/0 default/read/poll queues [Mon Dec 2 16:12:07 2024] nvme nvme0: Ignoring bogus Namespace Identifiers [Mon Dec 2 16:12:08 2024] pcieport 0000:d7:00.0: bridge window [io 0x1000-0x0fff] to [bus d8] add_size 1000 [Mon Dec 2 16:12:08 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space [Mon Dec 2 16:12:08 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign [Mon Dec 2 16:12:08 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space [Mon Dec 2 16:12:08 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign [Mon Dec 2 16:12:08 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh reset (done) [Mon Dec 2 16:12:08 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh cleanup (start) [Mon Dec 2 16:12:11 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh cleanup (done) [Mon Dec 2 16:12:11 2024] ######## Autotest Cleanup Dump ######## [Mon Dec 2 16:12:11 2024] sysrq: Show backtrace of all active CPUs [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 0 [Mon Dec 2 16:12:11 2024] CPU: 0 PID: 2255927 Comm: bash Tainted: G OE 6.8.9-200.fc39.x86_64 #1 [Mon Dec 2 16:12:11 2024] Hardware name: Intel Corporation S2600WFT/S2600WFT, BIOS SE5C620.86B.02.01.0015.032120220358 03/21/2022 [Mon Dec 2 16:12:11 2024] Call Trace: [Mon Dec 2 16:12:11 2024] [Mon Dec 2 16:12:11 2024] dump_stack_lvl+0x64/0x80 [Mon Dec 2 16:12:11 2024] nmi_cpu_backtrace+0xd6/0x110 [Mon Dec 2 16:12:11 2024] ? __pfx_nmi_raise_cpu_backtrace+0x10/0x10 [Mon Dec 2 16:12:11 2024] nmi_trigger_cpumask_backtrace+0xf3/0x140 [Mon Dec 2 16:12:11 2024] __handle_sysrq+0xe1/0x260 [Mon Dec 2 16:12:11 2024] write_sysrq_trigger+0x59/0x80 [Mon Dec 2 16:12:11 2024] proc_reg_write+0x5a/0xa0 [Mon Dec 2 16:12:11 2024] vfs_write+0xed/0x470 [Mon Dec 2 16:12:11 2024] ksys_write+0x6f/0xf0 [Mon Dec 2 16:12:11 2024] do_syscall_64+0x83/0x170 [Mon Dec 2 16:12:11 2024] ? filp_flush+0x52/0x70 [Mon Dec 2 16:12:11 2024] ? syscall_exit_to_user_mode+0x83/0x230 [Mon Dec 2 16:12:11 2024] ? do_syscall_64+0x90/0x170 [Mon Dec 2 16:12:11 2024] ? filp_flush+0x52/0x70 [Mon Dec 2 16:12:11 2024] ? filp_close+0x1d/0x30 [Mon Dec 2 16:12:11 2024] ? do_dup2+0x88/0xd0 [Mon Dec 2 16:12:11 2024] ? syscall_exit_to_user_mode+0x83/0x230 [Mon Dec 2 16:12:11 2024] ? do_syscall_64+0x90/0x170 [Mon Dec 2 16:12:11 2024] ? ptep_set_access_flags+0x32/0x40 [Mon Dec 2 16:12:11 2024] ? wp_page_reuse+0x8e/0xa0 [Mon Dec 2 16:12:11 2024] ? do_wp_page+0xf8/0xb90 [Mon Dec 2 16:12:11 2024] ? __pte_offset_map+0x1b/0x180 [Mon Dec 2 16:12:11 2024] ? __handle_mm_fault+0xb46/0xe40 [Mon Dec 2 16:12:11 2024] ? __count_memcg_events+0x69/0x100 [Mon Dec 2 16:12:11 2024] ? count_memcg_events.constprop.0+0x1a/0x30 [Mon Dec 2 16:12:11 2024] ? handle_mm_fault+0xa2/0x360 [Mon Dec 2 16:12:11 2024] ? do_user_addr_fault+0x304/0x690 [Mon Dec 2 16:12:11 2024] ? clear_bhb_loop+0x55/0xb0 [Mon Dec 2 16:12:11 2024] ? clear_bhb_loop+0x55/0xb0 [Mon Dec 2 16:12:11 2024] ? clear_bhb_loop+0x55/0xb0 [Mon Dec 2 16:12:11 2024] entry_SYSCALL_64_after_hwframe+0x78/0x80 [Mon Dec 2 16:12:11 2024] RIP: 0033:0x7f51b30fdee4 [Mon Dec 2 16:12:11 2024] Code: c7 00 16 00 00 00 b8 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 f3 0f 1e fa 80 3d 85 74 0d 00 00 74 13 b8 01 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 54 c3 0f 1f 00 55 48 89 e5 48 83 ec 20 48 89 [Mon Dec 2 16:12:11 2024] RSP: 002b:00007ffda246e6a8 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [Mon Dec 2 16:12:11 2024] RAX: ffffffffffffffda RBX: 0000000000000002 RCX: 00007f51b30fdee4 [Mon Dec 2 16:12:11 2024] RDX: 0000000000000002 RSI: 00005559aed91840 RDI: 0000000000000001 [Mon Dec 2 16:12:11 2024] RBP: 00007ffda246e6d0 R08: 0000000000000073 R09: 0000000000000001 [Mon Dec 2 16:12:11 2024] R10: 0000000000000000 R11: 0000000000000202 R12: 0000000000000002 [Mon Dec 2 16:12:11 2024] R13: 00005559aed91840 R14: 00007f51b31ce5c0 R15: 00007f51b31cbf20 [Mon Dec 2 16:12:11 2024] [Mon Dec 2 16:12:11 2024] Sending NMI from CPU 0 to CPUs 1-95: [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 51 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 90 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 88 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 27 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 6 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 28 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 76 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 18 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 34 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 54 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 29 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 85 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 37 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 66 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 36 [Mon Dec 2 16:12:11 2024] CPU: 36 PID: 2256039 Comm: bash Tainted: G OE 6.8.9-200.fc39.x86_64 #1 [Mon Dec 2 16:12:11 2024] Hardware name: Intel Corporation S2600WFT/S2600WFT, BIOS SE5C620.86B.02.01.0015.032120220358 03/21/2022 [Mon Dec 2 16:12:11 2024] RIP: 0033:0x55eead92c34d [Mon Dec 2 16:12:11 2024] Code: ff ff ff 4d 85 c9 0f 84 27 03 00 00 4d 8b 39 4d 85 ff 0f 84 8e 00 00 00 49 c7 01 00 00 00 00 eb 03 49 89 d9 4c 89 fb 4d 8b 3f <4c> 89 0b 4d 85 ff 75 ef f6 85 e4 fe ff ff 10 74 11 8b 0d 10 75 0d [Mon Dec 2 16:12:11 2024] RSP: 002b:00007fffaa5d0fe0 EFLAGS: 00000206 [Mon Dec 2 16:12:11 2024] RAX: 0000000000000050 RBX: 000055eeb03dd300 RCX: 0000000000000051 [Mon Dec 2 16:12:11 2024] RDX: 000055eeaf86ed20 RSI: 000055eeb02d9c80 RDI: 0000000000000007 [Mon Dec 2 16:12:11 2024] RBP: 00007fffaa5d1120 R08: 000055ebf11fb8d9 R09: 000055eeb03e2bb0 [Mon Dec 2 16:12:11 2024] R10: 000055eeb02d9c90 R11: 31d4973b10378f4c R12: 0000000000000000 [Mon Dec 2 16:12:11 2024] R13: 000055eeb031aaf0 R14: 0000100904000001 R15: 000055eeb03ddb00 [Mon Dec 2 16:12:11 2024] FS: 00007faee023f740 GS: 0000000000000000 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 22 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 56 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 32 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 80 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 23 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 95 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 26 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 74 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 7 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 77 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 21 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 82 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 49 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 38 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 86 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 69 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 24 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 72 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 62 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 39 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 87 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 8 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 30 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 63 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 31 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 59 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 92 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 94 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 46 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 48 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 75 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 20 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 47 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 2 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 64 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 4 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 79 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 16 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 68 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 70 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 25 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 11 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 93 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 12 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.082 msecs [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 40 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 52 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.085 msecs [Mon Dec 2 16:12:11 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.110 msecs [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 43 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 71 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 45 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 61 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 73 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.113 msecs [Mon Dec 2 16:12:11 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.133 msecs [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 58 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.200 msecs [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 44 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 55 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 3 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.231 msecs [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 78 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 13 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 50 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 42 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.265 msecs [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 14 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 35 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 83 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.289 msecs [Mon Dec 2 16:12:11 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.303 msecs [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 60 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 81 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 17 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 1 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 33 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 67 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 19 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 10 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 89 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 41 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 9 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 84 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 15 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 91 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 65 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 5 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 57 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] NMI backtrace for cpu 53 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 16:12:11 2024] sysrq: Show Memory [Mon Dec 2 16:12:12 2024] Mem-Info: [Mon Dec 2 16:12:12 2024] active_anon:1997335 inactive_anon:2952 isolated_anon:0 active_file:102991 inactive_file:816633 isolated_file:0 unevictable:768 dirty:0 writeback:0 slab_reclaimable:57836 slab_unreclaimable:153442 mapped:37970 shmem:1866283 pagetables:1956 sec_pagetables:0 bounce:0 kernel_misc_reclaimable:0 free:11534906 free_pcp:105828 free_cma:0 [Mon Dec 2 16:12:12 2024] Node 0 active_anon:3139256kB inactive_anon:0kB active_file:163340kB inactive_file:170512kB unevictable:3072kB isolated(anon):0kB isolated(file):0kB mapped:39320kB dirty:0kB writeback:0kB shmem:2716172kB shmem_thp:0kB shmem_pmdmapped:0kB anon_thp:0kB writeback_tmp:0kB kernel_stack:9928kB pagetables:4708kB sec_pagetables:0kB all_unreclaimable? no [Mon Dec 2 16:12:12 2024] Node 1 active_anon:4852024kB inactive_anon:11808kB active_file:248624kB inactive_file:3096020kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:112560kB dirty:0kB writeback:0kB shmem:4748960kB shmem_thp:0kB shmem_pmdmapped:0kB anon_thp:0kB writeback_tmp:0kB kernel_stack:10840kB pagetables:4940kB sec_pagetables:0kB all_unreclaimable? no [Mon Dec 2 16:12:12 2024] Node 0 DMA free:11264kB boost:0kB min:20kB low:32kB high:44kB reserved_highatomic:0KB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15360kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB [Mon Dec 2 16:12:12 2024] lowmem_reserve[]: 0 1666 31794 31794 31794 [Mon Dec 2 16:12:12 2024] Node 0 DMA32 free:1702868kB boost:0kB min:2552kB low:4256kB high:5960kB reserved_highatomic:0KB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:1772500kB managed:1706964kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB [Mon Dec 2 16:12:12 2024] lowmem_reserve[]: 0 0 30127 30127 30127 [Mon Dec 2 16:12:12 2024] Node 0 Normal free:26333852kB boost:0kB min:46176kB low:77024kB high:107872kB reserved_highatomic:0KB active_anon:3139416kB inactive_anon:0kB active_file:163340kB inactive_file:170512kB unevictable:3072kB writepending:0kB present:31444992kB managed:30859204kB mlocked:0kB bounce:0kB free_pcp:214728kB local_pcp:8316kB free_cma:0kB [Mon Dec 2 16:12:12 2024] lowmem_reserve[]: 0 0 0 0 0 [Mon Dec 2 16:12:12 2024] Node 1 Normal free:18093024kB boost:6144kB min:47496kB low:75124kB high:102752kB reserved_highatomic:0KB active_anon:4854556kB inactive_anon:11808kB active_file:248624kB inactive_file:3096020kB unevictable:0kB writepending:0kB present:28311552kB managed:27701244kB mlocked:0kB bounce:0kB free_pcp:200292kB local_pcp:60kB free_cma:0kB [Mon Dec 2 16:12:12 2024] lowmem_reserve[]: 0 0 0 0 0 [Mon Dec 2 16:12:12 2024] Node 0 DMA: 0*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 2*4096kB (M) = 11264kB [Mon Dec 2 16:12:12 2024] Node 0 DMA32: 9*4kB (UM) 10*8kB (UM) 6*16kB (UM) 6*32kB (UM) 7*64kB (UM) 15*128kB (UM) 11*256kB (UM) 9*512kB (UM) 5*1024kB (UM) 6*2048kB (M) 409*4096kB (M) = 1702868kB [Mon Dec 2 16:12:12 2024] Node 0 Normal: 27588*4kB (UME) 43295*8kB (UME) 36548*16kB (UME) 22190*32kB (UME) 12977*64kB (UME) 8789*128kB (UME) 7834*256kB (UME) 5915*512kB (UME) 3365*1024kB (UME) 2490*2048kB (UME) 2210*4096kB (UM) = 26338504kB [Mon Dec 2 16:12:12 2024] Node 1 Normal: 57213*4kB (UM) 41415*8kB (UME) 31302*16kB (UME) 16629*32kB (UME) 8233*64kB (UME) 9608*128kB (UME) 4967*256kB (UME) 2652*512kB (UME) 1129*1024kB (UME) 605*2048kB (UM) 2373*4096kB (UM) = 18094188kB [Mon Dec 2 16:12:12 2024] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB [Mon Dec 2 16:12:12 2024] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB [Mon Dec 2 16:12:12 2024] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB [Mon Dec 2 16:12:12 2024] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB [Mon Dec 2 16:12:12 2024] 2785910 total pagecache pages [Mon Dec 2 16:12:12 2024] 0 pages in swap cache [Mon Dec 2 16:12:12 2024] Free swap = 8388348kB [Mon Dec 2 16:12:12 2024] Total swap = 8388604kB [Mon Dec 2 16:12:12 2024] 15386256 pages RAM [Mon Dec 2 16:12:12 2024] 0 pages HighMem/MovableOnly [Mon Dec 2 16:12:12 2024] 315563 pages reserved [Mon Dec 2 16:12:12 2024] 0 pages cma reserved [Mon Dec 2 16:12:12 2024] 0 pages hwpoisoned [Mon Dec 2 16:12:12 2024] sysrq: Show Blocked State [Mon Dec 2 16:12:12 2024] task:ipmitool state:D stack:0 pid:2277438 tgid:2277438 ppid:2272941 flags:0x00004002 [Mon Dec 2 16:12:12 2024] Call Trace: [Mon Dec 2 16:12:12 2024] [Mon Dec 2 16:12:12 2024] __schedule+0x413/0x1720 [Mon Dec 2 16:12:12 2024] ? ttwu_do_activate+0x68/0x230 [Mon Dec 2 16:12:12 2024] schedule+0x32/0xd0 [Mon Dec 2 16:12:12 2024] schedule_timeout+0x151/0x160 [Mon Dec 2 16:12:12 2024] wait_for_completion+0x8a/0x160 [Mon Dec 2 16:12:12 2024] __wait_rcu_gp+0x15b/0x170 [Mon Dec 2 16:12:12 2024] synchronize_rcu+0x133/0x150 [Mon Dec 2 16:12:12 2024] ? __pfx_call_rcu_hurry+0x10/0x10 [Mon Dec 2 16:12:12 2024] ? __pfx_wakeme_after_rcu+0x10/0x10 [Mon Dec 2 16:12:12 2024] _ipmi_destroy_user+0x2aa/0x320 [ipmi_msghandler] [Mon Dec 2 16:12:12 2024] ipmi_destroy_user+0x12/0x60 [ipmi_msghandler] [Mon Dec 2 16:12:12 2024] ipmi_release+0x1f/0x60 [ipmi_devintf] [Mon Dec 2 16:12:12 2024] __fput+0x97/0x2c0 [Mon Dec 2 16:12:12 2024] __x64_sys_close+0x3d/0x80 [Mon Dec 2 16:12:12 2024] do_syscall_64+0x83/0x170 [Mon Dec 2 16:12:12 2024] ? do_syscall_64+0x90/0x170 [Mon Dec 2 16:12:12 2024] ? ipmi_ioctl+0x2f1/0x740 [ipmi_devintf] [Mon Dec 2 16:12:12 2024] ? syscall_exit_to_user_mode+0x83/0x230 [Mon Dec 2 16:12:12 2024] ? do_syscall_64+0x90/0x170 [Mon Dec 2 16:12:12 2024] ? i_ipmi_request+0x1e9/0x9a0 [ipmi_msghandler] [Mon Dec 2 16:12:12 2024] ? __pfx_copyout_recv+0x10/0x10 [ipmi_devintf] [Mon Dec 2 16:12:12 2024] ? handle_recv+0x245/0x280 [ipmi_devintf] [Mon Dec 2 16:12:12 2024] ? ipmi_ioctl+0x2f1/0x740 [ipmi_devintf] [Mon Dec 2 16:12:12 2024] ? syscall_exit_to_user_mode+0x83/0x230 [Mon Dec 2 16:12:12 2024] ? do_syscall_64+0x90/0x170 [Mon Dec 2 16:12:12 2024] ? ipmi_ioctl+0x22d/0x740 [ipmi_devintf] [Mon Dec 2 16:12:12 2024] ? syscall_exit_to_user_mode+0x83/0x230 [Mon Dec 2 16:12:12 2024] ? do_syscall_64+0x90/0x170 [Mon Dec 2 16:12:12 2024] ? do_syscall_64+0x90/0x170 [Mon Dec 2 16:12:12 2024] ? clear_bhb_loop+0x55/0xb0 [Mon Dec 2 16:12:12 2024] ? clear_bhb_loop+0x55/0xb0 [Mon Dec 2 16:12:12 2024] ? clear_bhb_loop+0x55/0xb0 [Mon Dec 2 16:12:12 2024] entry_SYSCALL_64_after_hwframe+0x78/0x80 [Mon Dec 2 16:12:12 2024] RIP: 0033:0x7f90e1859804 [Mon Dec 2 16:12:12 2024] RSP: 002b:00007ffd1f34b5f8 EFLAGS: 00000202 ORIG_RAX: 0000000000000003 [Mon Dec 2 16:12:13 2024] RAX: ffffffffffffffda RBX: 000055a9d67b59e0 RCX: 00007f90e1859804 [Mon Dec 2 16:12:13 2024] RDX: 0000000000000003 RSI: 000055a9d892e270 RDI: 0000000000000003 [Mon Dec 2 16:12:13 2024] RBP: 00007ffd1f34b610 R08: 000055ac820f6b3e R09: 0000000000000007 [Mon Dec 2 16:12:13 2024] R10: 000055a9d892e280 R11: 0000000000000202 R12: 0000000000000000 [Mon Dec 2 16:12:13 2024] R13: 0000000000000000 R14: 000055a9d67b59e0 R15: 0000000000000008 [Mon Dec 2 16:12:13 2024] [Mon Dec 2 16:12:13 2024] task:ipmitool state:D stack:0 pid:2277483 tgid:2277483 ppid:2256083 flags:0x00004002 [Mon Dec 2 16:12:13 2024] Call Trace: [Mon Dec 2 16:12:13 2024] [Mon Dec 2 16:12:13 2024] __schedule+0x413/0x1720 [Mon Dec 2 16:12:13 2024] schedule+0x32/0xd0 [Mon Dec 2 16:12:13 2024] schedule_timeout+0x151/0x160 [Mon Dec 2 16:12:13 2024] wait_for_completion+0x8a/0x160 [Mon Dec 2 16:12:13 2024] __wait_rcu_gp+0x15b/0x170 [Mon Dec 2 16:12:13 2024] synchronize_rcu+0x133/0x150 [Mon Dec 2 16:12:13 2024] ? __pfx_call_rcu_hurry+0x10/0x10 [Mon Dec 2 16:12:13 2024] ? __pfx_wakeme_after_rcu+0x10/0x10 [Mon Dec 2 16:12:13 2024] _ipmi_destroy_user+0x2aa/0x320 [ipmi_msghandler] [Mon Dec 2 16:12:13 2024] ipmi_destroy_user+0x12/0x60 [ipmi_msghandler] [Mon Dec 2 16:12:13 2024] ipmi_release+0x1f/0x60 [ipmi_devintf] [Mon Dec 2 16:12:13 2024] __fput+0x97/0x2c0 [Mon Dec 2 16:12:13 2024] __x64_sys_close+0x3d/0x80 [Mon Dec 2 16:12:13 2024] do_syscall_64+0x83/0x170 [Mon Dec 2 16:12:13 2024] ? _copy_to_user+0x24/0x40 [Mon Dec 2 16:12:13 2024] ? cp_new_stat+0x135/0x170 [Mon Dec 2 16:12:13 2024] ? __do_sys_newfstatat+0x4e/0x80 [Mon Dec 2 16:12:13 2024] ? syscall_exit_to_user_mode+0x83/0x230 [Mon Dec 2 16:12:13 2024] ? do_syscall_64+0x90/0x170 [Mon Dec 2 16:12:13 2024] ? handle_mm_fault+0xa2/0x360 [Mon Dec 2 16:12:13 2024] ? do_user_addr_fault+0x304/0x690 [Mon Dec 2 16:12:13 2024] ? clear_bhb_loop+0x55/0xb0 [Mon Dec 2 16:12:13 2024] ? clear_bhb_loop+0x55/0xb0 [Mon Dec 2 16:12:13 2024] ? clear_bhb_loop+0x55/0xb0 [Mon Dec 2 16:12:13 2024] entry_SYSCALL_64_after_hwframe+0x78/0x80 [Mon Dec 2 16:12:13 2024] RIP: 0033:0x7f971f99e804 [Mon Dec 2 16:12:13 2024] RSP: 002b:00007ffef3750548 EFLAGS: 00000202 ORIG_RAX: 0000000000000003 [Mon Dec 2 16:12:13 2024] RAX: ffffffffffffffda RBX: 00005558164889e0 RCX: 00007f971f99e804 [Mon Dec 2 16:12:13 2024] RDX: 0000000000000003 RSI: 0000555817fa82b0 RDI: 0000000000000003 [Mon Dec 2 16:12:13 2024] RBP: 00007ffef3750560 R08: 0000555d427bfdf8 R09: 0000000000000007 [Mon Dec 2 16:12:13 2024] R10: 0000555817fa82c0 R11: 0000000000000202 R12: 0000000000000000 [Mon Dec 2 16:12:13 2024] R13: 0000000000000000 R14: 00005558164889e0 R15: 0000000000000007 [Mon Dec 2 16:12:13 2024]