[Sun Dec 1 06:18:09 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh reset (start) [Sun Dec 1 06:18:12 2024] pcieport 0000:d7:00.0: bridge window [io 0x1000-0x0fff] to [bus d8] add_size 1000 [Sun Dec 1 06:18:12 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space [Sun Dec 1 06:18:12 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign [Sun Dec 1 06:18:12 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space [Sun Dec 1 06:18:12 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign [Sun Dec 1 06:18:12 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh reset (done) [Sun Dec 1 06:18:17 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh status (start) [Sun Dec 1 06:18:20 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh status (done) [Sun Dec 1 06:18:20 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh (start) [Sun Dec 1 06:18:23 2024] ioatdma 0000:00:04.7: Removing dma and dca services [Sun Dec 1 06:18:23 2024] ioatdma 0000:00:04.6: Removing dma and dca services [Sun Dec 1 06:18:23 2024] ioatdma 0000:00:04.5: Removing dma and dca services [Sun Dec 1 06:18:23 2024] ioatdma 0000:00:04.4: Removing dma and dca services [Sun Dec 1 06:18:23 2024] ioatdma 0000:00:04.3: Removing dma and dca services [Sun Dec 1 06:18:23 2024] ioatdma 0000:00:04.2: Removing dma and dca services [Sun Dec 1 06:18:23 2024] ioatdma 0000:00:04.1: Removing dma and dca services [Sun Dec 1 06:18:23 2024] ioatdma 0000:00:04.0: Removing dma and dca services [Sun Dec 1 06:18:23 2024] ioatdma 0000:80:04.7: Removing dma and dca services [Sun Dec 1 06:18:23 2024] ioatdma 0000:80:04.6: Removing dma and dca services [Sun Dec 1 06:18:23 2024] ioatdma 0000:80:04.5: Removing dma and dca services [Sun Dec 1 06:18:23 2024] ioatdma 0000:80:04.4: Removing dma and dca services [Sun Dec 1 06:18:23 2024] ioatdma 0000:80:04.3: Removing dma and dca services [Sun Dec 1 06:18:23 2024] ioatdma 0000:80:04.2: Removing dma and dca services [Sun Dec 1 06:18:23 2024] ioatdma 0000:80:04.1: Removing dma and dca services [Sun Dec 1 06:18:23 2024] ioatdma 0000:80:04.0: Removing dma and dca services [Sun Dec 1 06:18:26 2024] pcieport 0000:d7:00.0: bridge window [io 0x1000-0x0fff] to [bus d8] add_size 1000 [Sun Dec 1 06:18:26 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space [Sun Dec 1 06:18:26 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign [Sun Dec 1 06:18:26 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space [Sun Dec 1 06:18:26 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign [Sun Dec 1 06:18:26 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh (done) [Sun Dec 1 06:18:27 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh reset (start) [Sun Dec 1 06:18:30 2024] nvme nvme0: pci function 0000:d9:00.0 [Sun Dec 1 06:18:30 2024] nvme nvme0: Shutdown timeout set to 15 seconds [Sun Dec 1 06:18:30 2024] nvme nvme0: 96/0/0 default/read/poll queues [Sun Dec 1 06:18:30 2024] nvme nvme0: Ignoring bogus Namespace Identifiers [Sun Dec 1 06:18:31 2024] pcieport 0000:d7:00.0: bridge window [io 0x1000-0x0fff] to [bus d8] add_size 1000 [Sun Dec 1 06:18:31 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space [Sun Dec 1 06:18:31 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign [Sun Dec 1 06:18:31 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space [Sun Dec 1 06:18:31 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign [Sun Dec 1 06:18:31 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh reset (done) [Sun Dec 1 06:18:31 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh (start) [Sun Dec 1 06:18:34 2024] ioatdma 0000:00:04.7: Removing dma and dca services [Sun Dec 1 06:18:34 2024] ioatdma 0000:00:04.6: Removing dma and dca services [Sun Dec 1 06:18:34 2024] ioatdma 0000:00:04.5: Removing dma and dca services [Sun Dec 1 06:18:34 2024] ioatdma 0000:00:04.4: Removing dma and dca services [Sun Dec 1 06:18:34 2024] ioatdma 0000:00:04.3: Removing dma and dca services [Sun Dec 1 06:18:34 2024] ioatdma 0000:00:04.2: Removing dma and dca services [Sun Dec 1 06:18:34 2024] ioatdma 0000:00:04.1: Removing dma and dca services [Sun Dec 1 06:18:34 2024] ioatdma 0000:00:04.0: Removing dma and dca services [Sun Dec 1 06:18:34 2024] ioatdma 0000:80:04.7: Removing dma and dca services [Sun Dec 1 06:18:34 2024] ioatdma 0000:80:04.6: Removing dma and dca services [Sun Dec 1 06:18:34 2024] ioatdma 0000:80:04.5: Removing dma and dca services [Sun Dec 1 06:18:34 2024] ioatdma 0000:80:04.4: Removing dma and dca services [Sun Dec 1 06:18:34 2024] ioatdma 0000:80:04.3: Removing dma and dca services [Sun Dec 1 06:18:34 2024] ioatdma 0000:80:04.2: Removing dma and dca services [Sun Dec 1 06:18:34 2024] ioatdma 0000:80:04.1: Removing dma and dca services [Sun Dec 1 06:18:34 2024] ioatdma 0000:80:04.0: Removing dma and dca services [Sun Dec 1 06:18:37 2024] pcieport 0000:d7:00.0: bridge window [io 0x1000-0x0fff] to [bus d8] add_size 1000 [Sun Dec 1 06:18:37 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space [Sun Dec 1 06:18:37 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign [Sun Dec 1 06:18:37 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space [Sun Dec 1 06:18:37 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign [Sun Dec 1 06:18:37 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh (done) [Sun Dec 1 06:18:53 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh reset (start) [Sun Dec 1 06:18:56 2024] nvme nvme0: pci function 0000:d9:00.0 [Sun Dec 1 06:18:56 2024] nvme nvme0: Shutdown timeout set to 15 seconds [Sun Dec 1 06:18:56 2024] nvme nvme0: 96/0/0 default/read/poll queues [Sun Dec 1 06:18:56 2024] nvme nvme0: Ignoring bogus Namespace Identifiers [Sun Dec 1 06:18:56 2024] pcieport 0000:d7:00.0: bridge window [io 0x1000-0x0fff] to [bus d8] add_size 1000 [Sun Dec 1 06:18:56 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space [Sun Dec 1 06:18:56 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign [Sun Dec 1 06:18:56 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space [Sun Dec 1 06:18:56 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign [Sun Dec 1 06:18:56 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh reset (done) [Sun Dec 1 06:18:56 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh cleanup (start) [Sun Dec 1 06:18:59 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh cleanup (done) [Sun Dec 1 06:18:59 2024] ######## Autotest Cleanup Dump ######## [Sun Dec 1 06:18:59 2024] sysrq: Show backtrace of all active CPUs [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 28 [Sun Dec 1 06:18:59 2024] CPU: 28 PID: 3912380 Comm: bash Tainted: G OE 6.8.9-200.fc39.x86_64 #1 [Sun Dec 1 06:18:59 2024] Hardware name: Intel Corporation S2600WFT/S2600WFT, BIOS SE5C620.86B.02.01.0015.032120220358 03/21/2022 [Sun Dec 1 06:18:59 2024] Call Trace: [Sun Dec 1 06:18:59 2024] [Sun Dec 1 06:18:59 2024] dump_stack_lvl+0x64/0x80 [Sun Dec 1 06:18:59 2024] nmi_cpu_backtrace+0xd6/0x110 [Sun Dec 1 06:18:59 2024] ? __pfx_nmi_raise_cpu_backtrace+0x10/0x10 [Sun Dec 1 06:18:59 2024] nmi_trigger_cpumask_backtrace+0xf3/0x140 [Sun Dec 1 06:18:59 2024] __handle_sysrq+0xe1/0x260 [Sun Dec 1 06:18:59 2024] write_sysrq_trigger+0x59/0x80 [Sun Dec 1 06:18:59 2024] proc_reg_write+0x5a/0xa0 [Sun Dec 1 06:18:59 2024] vfs_write+0xed/0x470 [Sun Dec 1 06:18:59 2024] ? set_close_on_exec+0x32/0x70 [Sun Dec 1 06:18:59 2024] ksys_write+0x6f/0xf0 [Sun Dec 1 06:18:59 2024] do_syscall_64+0x83/0x170 [Sun Dec 1 06:18:59 2024] ? filp_flush+0x52/0x70 [Sun Dec 1 06:18:59 2024] ? filp_flush+0x52/0x70 [Sun Dec 1 06:18:59 2024] ? syscall_exit_to_user_mode+0x83/0x230 [Sun Dec 1 06:18:59 2024] ? do_syscall_64+0x90/0x170 [Sun Dec 1 06:18:59 2024] ? __x64_sys_fcntl+0x94/0xc0 [Sun Dec 1 06:18:59 2024] ? syscall_exit_to_user_mode+0x83/0x230 [Sun Dec 1 06:18:59 2024] ? do_syscall_64+0x90/0x170 [Sun Dec 1 06:18:59 2024] ? syscall_exit_to_user_mode+0x83/0x230 [Sun Dec 1 06:18:59 2024] ? do_syscall_64+0x90/0x170 [Sun Dec 1 06:18:59 2024] ? count_memcg_events.constprop.0+0x1a/0x30 [Sun Dec 1 06:18:59 2024] ? handle_mm_fault+0xa2/0x360 [Sun Dec 1 06:18:59 2024] ? do_user_addr_fault+0x304/0x690 [Sun Dec 1 06:18:59 2024] ? clear_bhb_loop+0x55/0xb0 [Sun Dec 1 06:18:59 2024] ? clear_bhb_loop+0x55/0xb0 [Sun Dec 1 06:18:59 2024] ? clear_bhb_loop+0x55/0xb0 [Sun Dec 1 06:18:59 2024] entry_SYSCALL_64_after_hwframe+0x78/0x80 [Sun Dec 1 06:18:59 2024] RIP: 0033:0x7f189cedcee4 [Sun Dec 1 06:18:59 2024] Code: c7 00 16 00 00 00 b8 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 f3 0f 1e fa 80 3d 85 74 0d 00 00 74 13 b8 01 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 54 c3 0f 1f 00 55 48 89 e5 48 83 ec 20 48 89 [Sun Dec 1 06:18:59 2024] RSP: 002b:00007fffa8d2fe38 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [Sun Dec 1 06:18:59 2024] RAX: ffffffffffffffda RBX: 0000000000000002 RCX: 00007f189cedcee4 [Sun Dec 1 06:18:59 2024] RDX: 0000000000000002 RSI: 00005613b8920840 RDI: 0000000000000001 [Sun Dec 1 06:18:59 2024] RBP: 00007fffa8d2fe60 R08: 0000000000000073 R09: 0000000000000001 [Sun Dec 1 06:18:59 2024] R10: 0000000000000000 R11: 0000000000000202 R12: 0000000000000002 [Sun Dec 1 06:18:59 2024] R13: 00005613b8920840 R14: 00007f189cfad5c0 R15: 00007f189cfaaf20 [Sun Dec 1 06:18:59 2024] [Sun Dec 1 06:18:59 2024] Sending NMI from CPU 28 to CPUs 0-27,29-95: [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 76 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 4 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 39 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 15 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 30 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 71 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 33 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 51 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 44 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 53 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 85 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 52 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 38 [Sun Dec 1 06:18:59 2024] CPU: 38 PID: 3912650 Comm: bash Tainted: G OE 6.8.9-200.fc39.x86_64 #1 [Sun Dec 1 06:18:59 2024] Hardware name: Intel Corporation S2600WFT/S2600WFT, BIOS SE5C620.86B.02.01.0015.032120220358 03/21/2022 [Sun Dec 1 06:18:59 2024] RIP: 0033:0x560a10528bf5 [Sun Dec 1 06:18:59 2024] Code: 66 0f 6f 05 0d 96 0e 00 41 0f 11 04 24 48 63 05 9d 97 11 00 49 8b 55 00 8d 48 01 89 0d 90 97 11 00 4c 89 24 c2 48 85 db 75 b8 <48> 83 c4 08 5b 41 5c 41 5d 5d c3 c3 66 66 2e 0f 1f 84 00 00 00 00 [Sun Dec 1 06:18:59 2024] RSP: 002b:00007fffeff2d940 EFLAGS: 00000246 [Sun Dec 1 06:18:59 2024] RAX: 0000000000000052 RBX: 0000000000000000 RCX: 0000000000000053 [Sun Dec 1 06:18:59 2024] RDX: 0000560a11e6ed20 RSI: 0000560a129eb1b0 RDI: 0000000000000001 [Sun Dec 1 06:18:59 2024] RBP: 00007fffeff2d960 R08: 0000560a11e53010 R09: 0000000000000007 [Sun Dec 1 06:18:59 2024] R10: 0000560a129eb1c0 R11: 2d6a81f2d94726b9 R12: 0000560a129ad320 [Sun Dec 1 06:18:59 2024] R13: 0000560a10642370 R14: 0000100904000001 R15: 0000560a1299a050 [Sun Dec 1 06:18:59 2024] FS: 00007fcb959b5740 GS: 0000000000000000 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 14 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 86 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 17 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 74 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 26 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 50 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 56 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 90 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 35 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 83 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 10 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 27 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 66 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 95 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 7 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 82 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 63 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 40 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 88 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 9 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 84 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 16 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 34 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 3 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 18 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 46 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 6 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 13 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 87 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 55 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 70 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 89 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 12 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 93 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 2 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 47 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 5 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 32 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 20 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 68 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 19 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 49 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 1 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 42 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 92 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 58 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 62 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 36 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 23 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 60 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 78 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 8 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.002 msecs [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 91 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 54 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 80 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.030 msecs [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 67 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.055 msecs [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 59 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.072 msecs [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 11 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.085 msecs [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 0 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.095 msecs [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 73 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 22 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 45 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.125 msecs [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 48 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.147 msecs [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 81 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 69 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.172 msecs [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 57 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.182 msecs [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 75 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 61 [Sun Dec 1 06:18:59 2024] CPU: 61 PID: 0 Comm: swapper/61 Tainted: G OE 6.8.9-200.fc39.x86_64 #1 [Sun Dec 1 06:18:59 2024] Hardware name: Intel Corporation S2600WFT/S2600WFT, BIOS SE5C620.86B.02.01.0015.032120220358 03/21/2022 [Sun Dec 1 06:18:59 2024] RIP: 0010:sched_ttwu_pending+0xcf/0x1a0 [Sun Dec 1 06:18:59 2024] Code: 4c 89 e3 8b 53 34 48 8d 68 c8 49 89 ec 85 d2 0f 85 8a 00 00 00 8b 43 14 41 8b b5 28 0b 00 00 39 c6 75 70 0f b6 93 58 09 00 00 <48> 89 e1 48 89 de 4c 89 ef c1 e2 05 83 e2 20 e8 dd fc ff ff 48 83 [Sun Dec 1 06:18:59 2024] RSP: 0018:ffffb36a8496fe58 EFLAGS: 00000046 [Sun Dec 1 06:18:59 2024] RAX: 000000000000003d RBX: ffff930be891afc0 RCX: 0000000000000000 [Sun Dec 1 06:18:59 2024] RDX: 0000000000000000 RSI: 000000000000003d RDI: ffff930a85b38000 [Sun Dec 1 06:18:59 2024] RBP: ffffffffffffffc8 R08: 0000000000000004 R09: 0000000000054790 [Sun Dec 1 06:18:59 2024] R10: 00000000000927c0 R11: 0000000000000004 R12: ffffffffffffffc8 [Sun Dec 1 06:18:59 2024] R13: ffff9311dfcb4780 R14: ffff930be891aff8 R15: 0000000000000000 [Sun Dec 1 06:18:59 2024] FS: 0000000000000000(0000) GS:ffff9311dfc80000(0000) knlGS:0000000000000000 [Sun Dec 1 06:18:59 2024] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [Sun Dec 1 06:18:59 2024] CR2: 000056356a80fff8 CR3: 00000001141f8004 CR4: 00000000007706f0 [Sun Dec 1 06:18:59 2024] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [Sun Dec 1 06:18:59 2024] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [Sun Dec 1 06:18:59 2024] PKRU: 55555554 [Sun Dec 1 06:18:59 2024] Call Trace: [Sun Dec 1 06:18:59 2024] [Sun Dec 1 06:18:59 2024] ? nmi_cpu_backtrace+0x99/0x110 [Sun Dec 1 06:18:59 2024] ? nmi_cpu_backtrace_handler+0x11/0x20 [Sun Dec 1 06:18:59 2024] ? nmi_handle+0x65/0x170 [Sun Dec 1 06:18:59 2024] ? default_do_nmi+0x40/0x100 [Sun Dec 1 06:18:59 2024] ? exc_nmi+0x125/0x1a0 [Sun Dec 1 06:18:59 2024] ? end_repeat_nmi+0xf/0x60 [Sun Dec 1 06:18:59 2024] ? sched_ttwu_pending+0xcf/0x1a0 [Sun Dec 1 06:18:59 2024] ? sched_ttwu_pending+0xcf/0x1a0 [Sun Dec 1 06:18:59 2024] ? sched_ttwu_pending+0xcf/0x1a0 [Sun Dec 1 06:18:59 2024] [Sun Dec 1 06:18:59 2024] [Sun Dec 1 06:18:59 2024] __flush_smp_call_function_queue+0x146/0x410 [Sun Dec 1 06:18:59 2024] flush_smp_call_function_queue+0x3a/0x70 [Sun Dec 1 06:18:59 2024] do_idle+0x169/0x270 [Sun Dec 1 06:18:59 2024] cpu_startup_entry+0x2a/0x30 [Sun Dec 1 06:18:59 2024] start_secondary+0x12d/0x160 [Sun Dec 1 06:18:59 2024] secondary_startup_64_no_verify+0x184/0x18b [Sun Dec 1 06:18:59 2024] [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 43 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 21 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 25 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 64 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 77 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 65 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 94 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 72 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 24 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 37 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 41 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 29 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 79 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] NMI backtrace for cpu 31 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 1 06:18:59 2024] sysrq: Show Memory [Sun Dec 1 06:19:00 2024] Mem-Info: [Sun Dec 1 06:19:00 2024] active_anon:2023001 inactive_anon:770 isolated_anon:0 active_file:100593 inactive_file:791501 isolated_file:0 unevictable:768 dirty:0 writeback:0 slab_reclaimable:59291 slab_unreclaimable:163430 mapped:39698 shmem:1889381 pagetables:1839 sec_pagetables:0 bounce:0 kernel_misc_reclaimable:0 free:11534636 free_pcp:96854 free_cma:0 [Sun Dec 1 06:19:00 2024] Node 0 active_anon:2715556kB inactive_anon:0kB active_file:248824kB inactive_file:139028kB unevictable:3072kB isolated(anon):0kB isolated(file):0kB mapped:131568kB dirty:0kB writeback:0kB shmem:2408940kB shmem_thp:0kB shmem_pmdmapped:0kB anon_thp:0kB writeback_tmp:0kB kernel_stack:10776kB pagetables:4740kB sec_pagetables:0kB all_unreclaimable? no [Sun Dec 1 06:19:00 2024] Node 1 active_anon:5377432kB inactive_anon:3080kB active_file:153548kB inactive_file:3026976kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:27224kB dirty:0kB writeback:0kB shmem:5148584kB shmem_thp:0kB shmem_pmdmapped:0kB anon_thp:0kB writeback_tmp:0kB kernel_stack:8968kB pagetables:2672kB sec_pagetables:0kB all_unreclaimable? no [Sun Dec 1 06:19:00 2024] Node 0 DMA free:11264kB boost:0kB min:20kB low:32kB high:44kB reserved_highatomic:0KB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15360kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB [Sun Dec 1 06:19:00 2024] lowmem_reserve[]: 0 1666 31794 31794 31794 [Sun Dec 1 06:19:00 2024] Node 0 DMA32 free:1702868kB boost:0kB min:2552kB low:4256kB high:5960kB reserved_highatomic:0KB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:1772500kB managed:1706964kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB [Sun Dec 1 06:19:00 2024] lowmem_reserve[]: 0 0 30127 30127 30127 [Sun Dec 1 06:19:00 2024] Node 0 Normal free:26702444kB boost:0kB min:46176kB low:77024kB high:107872kB reserved_highatomic:0KB active_anon:2717572kB inactive_anon:0kB active_file:248824kB inactive_file:139028kB unevictable:3072kB writepending:0kB present:31444992kB managed:30859204kB mlocked:0kB bounce:0kB free_pcp:130820kB local_pcp:920kB free_cma:0kB [Sun Dec 1 06:19:00 2024] lowmem_reserve[]: 0 0 0 0 0 [Sun Dec 1 06:19:00 2024] Node 1 Normal free:17721492kB boost:6144kB min:47496kB low:75124kB high:102752kB reserved_highatomic:0KB active_anon:5377432kB inactive_anon:3080kB active_file:153548kB inactive_file:3026976kB unevictable:0kB writepending:0kB present:28311552kB managed:27701248kB mlocked:0kB bounce:0kB free_pcp:256740kB local_pcp:2100kB free_cma:0kB [Sun Dec 1 06:19:01 2024] lowmem_reserve[]: 0 0 0 0 0 [Sun Dec 1 06:19:01 2024] Node 0 DMA: 0*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 2*4096kB (M) = 11264kB [Sun Dec 1 06:19:01 2024] Node 0 DMA32: 9*4kB (UM) 10*8kB (UM) 6*16kB (UM) 6*32kB (UM) 7*64kB (UM) 15*128kB (UM) 11*256kB (UM) 9*512kB (UM) 5*1024kB (UM) 6*2048kB (M) 409*4096kB (M) = 1702868kB [Sun Dec 1 06:19:01 2024] Node 0 Normal: 46353*4kB (UME) 53861*8kB (UME) 41532*16kB (UME) 27613*32kB (UME) 25120*64kB (UME) 19549*128kB (UME) 12043*256kB (UME) 6397*512kB (UME) 2416*1024kB (UME) 1539*2048kB (UM) 2061*4096kB (UM) = 26700364kB [Sun Dec 1 06:19:01 2024] Node 1 Normal: 37100*4kB (UM) 42024*8kB (UME) 38076*16kB (UME) 22935*32kB (UME) 9267*64kB (UME) 3589*128kB (UME) 2436*256kB (UME) 1313*512kB (UME) 768*1024kB (UME) 1039*2048kB (UM) 2596*4096kB (UM) = 17723600kB [Sun Dec 1 06:19:01 2024] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB [Sun Dec 1 06:19:01 2024] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB [Sun Dec 1 06:19:01 2024] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB [Sun Dec 1 06:19:01 2024] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB [Sun Dec 1 06:19:01 2024] 2781475 total pagecache pages [Sun Dec 1 06:19:01 2024] 0 pages in swap cache [Sun Dec 1 06:19:01 2024] Free swap = 8388348kB [Sun Dec 1 06:19:01 2024] Total swap = 8388604kB [Sun Dec 1 06:19:01 2024] 15386256 pages RAM [Sun Dec 1 06:19:01 2024] 0 pages HighMem/MovableOnly [Sun Dec 1 06:19:01 2024] 315562 pages reserved [Sun Dec 1 06:19:01 2024] 0 pages cma reserved [Sun Dec 1 06:19:01 2024] 0 pages hwpoisoned [Sun Dec 1 06:19:01 2024] sysrq: Show Blocked State [Sun Dec 1 06:19:01 2024] task:ipmitool state:D stack:0 pid:3934433 tgid:3934433 ppid:3912695 flags:0x00004002 [Sun Dec 1 06:19:01 2024] Call Trace: [Sun Dec 1 06:19:01 2024] [Sun Dec 1 06:19:01 2024] __schedule+0x413/0x1720 [Sun Dec 1 06:19:01 2024] ? ttwu_do_activate+0x68/0x230 [Sun Dec 1 06:19:01 2024] schedule+0x32/0xd0 [Sun Dec 1 06:19:01 2024] schedule_timeout+0x151/0x160 [Sun Dec 1 06:19:01 2024] wait_for_completion+0x8a/0x160 [Sun Dec 1 06:19:01 2024] __wait_rcu_gp+0x15b/0x170 [Sun Dec 1 06:19:01 2024] synchronize_rcu+0x133/0x150 [Sun Dec 1 06:19:01 2024] ? __pfx_call_rcu_hurry+0x10/0x10 [Sun Dec 1 06:19:01 2024] ? __pfx_wakeme_after_rcu+0x10/0x10 [Sun Dec 1 06:19:01 2024] _ipmi_destroy_user+0x2aa/0x320 [ipmi_msghandler] [Sun Dec 1 06:19:01 2024] ipmi_destroy_user+0x12/0x60 [ipmi_msghandler] [Sun Dec 1 06:19:01 2024] ipmi_release+0x1f/0x60 [ipmi_devintf] [Sun Dec 1 06:19:01 2024] __fput+0x97/0x2c0 [Sun Dec 1 06:19:01 2024] __x64_sys_close+0x3d/0x80 [Sun Dec 1 06:19:01 2024] do_syscall_64+0x83/0x170 [Sun Dec 1 06:19:01 2024] ? syscall_exit_to_user_mode+0x83/0x230 [Sun Dec 1 06:19:01 2024] ? do_syscall_64+0x90/0x170 [Sun Dec 1 06:19:01 2024] ? update_load_avg+0x7e/0x800 [Sun Dec 1 06:19:01 2024] ? task_tick_fair+0x40/0x4d0 [Sun Dec 1 06:19:01 2024] ? trigger_load_balance+0x73/0x400 [Sun Dec 1 06:19:01 2024] ? scheduler_tick+0xff/0x330 [Sun Dec 1 06:19:01 2024] ? update_process_times+0x9c/0xb0 [Sun Dec 1 06:19:01 2024] ? tick_sched_handle+0x21/0x60 [Sun Dec 1 06:19:01 2024] ? timerqueue_add+0x98/0xb0 [Sun Dec 1 06:19:01 2024] ? enqueue_hrtimer+0x42/0xa0 [Sun Dec 1 06:19:01 2024] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [Sun Dec 1 06:19:01 2024] ? __hrtimer_run_queues+0x141/0x280 [Sun Dec 1 06:19:01 2024] ? ktime_get+0x44/0xb0 [Sun Dec 1 06:19:01 2024] ? lapic_next_deadline+0x2c/0x40 [Sun Dec 1 06:19:01 2024] ? clockevents_program_event+0x9f/0x110 [Sun Dec 1 06:19:01 2024] ? sched_clock+0x10/0x30 [Sun Dec 1 06:19:01 2024] ? sched_clock_cpu+0x11/0x1b0 [Sun Dec 1 06:19:01 2024] ? irqtime_account_irq+0x40/0xc0 [Sun Dec 1 06:19:01 2024] ? clear_bhb_loop+0x55/0xb0 [Sun Dec 1 06:19:01 2024] ? clear_bhb_loop+0x55/0xb0 [Sun Dec 1 06:19:01 2024] ? clear_bhb_loop+0x55/0xb0 [Sun Dec 1 06:19:01 2024] entry_SYSCALL_64_after_hwframe+0x78/0x80 [Sun Dec 1 06:19:01 2024] RIP: 0033:0x7f1a87727804 [Sun Dec 1 06:19:01 2024] RSP: 002b:00007ffe45298928 EFLAGS: 00000202 ORIG_RAX: 0000000000000003 [Sun Dec 1 06:19:01 2024] RAX: ffffffffffffffda RBX: 000055601bf199e0 RCX: 00007f1a87727804 [Sun Dec 1 06:19:01 2024] RDX: 0000000000000003 RSI: 000055601dd142b0 RDI: 0000000000000003 [Sun Dec 1 06:19:01 2024] RBP: 00007ffe45298940 R08: 000055654bd09f44 R09: 0000000000000007 [Sun Dec 1 06:19:01 2024] R10: 000055601dd142c0 R11: 0000000000000202 R12: 0000000000000000 [Sun Dec 1 06:19:01 2024] R13: 0000000000000000 R14: 000055601bf199e0 R15: 0000000000000007 [Sun Dec 1 06:19:01 2024]