[Sat Dec 7 20:07:10 2024] spdk: /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset (start) [Sat Dec 7 20:07:14 2024] spdk: /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset (done) [Sat Dec 7 20:07:21 2024] spdk: /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh status (start) [Sat Dec 7 20:07:25 2024] spdk: /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh status (done) [Sat Dec 7 20:07:25 2024] spdk: /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh (start) [Sat Dec 7 20:07:28 2024] ioatdma 0000:00:04.7: Removing dma and dca services [Sat Dec 7 20:07:28 2024] ioatdma 0000:00:04.6: Removing dma and dca services [Sat Dec 7 20:07:28 2024] ioatdma 0000:00:04.5: Removing dma and dca services [Sat Dec 7 20:07:28 2024] ioatdma 0000:00:04.4: Removing dma and dca services [Sat Dec 7 20:07:28 2024] ioatdma 0000:00:04.3: Removing dma and dca services [Sat Dec 7 20:07:28 2024] ioatdma 0000:00:04.2: Removing dma and dca services [Sat Dec 7 20:07:28 2024] ioatdma 0000:00:04.1: Removing dma and dca services [Sat Dec 7 20:07:28 2024] ioatdma 0000:00:04.0: Removing dma and dca services [Sat Dec 7 20:07:28 2024] ioatdma 0000:80:04.7: Removing dma and dca services [Sat Dec 7 20:07:28 2024] ioatdma 0000:80:04.6: Removing dma and dca services [Sat Dec 7 20:07:28 2024] ioatdma 0000:80:04.5: Removing dma and dca services [Sat Dec 7 20:07:28 2024] ioatdma 0000:80:04.4: Removing dma and dca services [Sat Dec 7 20:07:28 2024] ioatdma 0000:80:04.3: Removing dma and dca services [Sat Dec 7 20:07:28 2024] ioatdma 0000:80:04.2: Removing dma and dca services [Sat Dec 7 20:07:28 2024] ioatdma 0000:80:04.1: Removing dma and dca services [Sat Dec 7 20:07:28 2024] ioatdma 0000:80:04.0: Removing dma and dca services [Sat Dec 7 20:07:31 2024] spdk: /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh (done) [Sat Dec 7 20:07:32 2024] spdk: /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset (start) [Sat Dec 7 20:07:37 2024] nvme nvme0: pci function 0000:d8:00.0 [Sat Dec 7 20:07:37 2024] nvme nvme0: 112/0/0 default/read/poll queues [Sat Dec 7 20:07:37 2024] nvme nvme0: Ignoring bogus Namespace Identifiers [Sat Dec 7 20:07:37 2024] spdk: /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset (done) [Sat Dec 7 20:07:37 2024] spdk: /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh (start) [Sat Dec 7 20:07:40 2024] ioatdma 0000:00:04.7: Removing dma and dca services [Sat Dec 7 20:07:40 2024] ioatdma 0000:00:04.6: Removing dma and dca services [Sat Dec 7 20:07:40 2024] ioatdma 0000:00:04.5: Removing dma and dca services [Sat Dec 7 20:07:40 2024] ioatdma 0000:00:04.4: Removing dma and dca services [Sat Dec 7 20:07:40 2024] ioatdma 0000:00:04.3: Removing dma and dca services [Sat Dec 7 20:07:40 2024] ioatdma 0000:00:04.2: Removing dma and dca services [Sat Dec 7 20:07:40 2024] ioatdma 0000:00:04.1: Removing dma and dca services [Sat Dec 7 20:07:40 2024] ioatdma 0000:00:04.0: Removing dma and dca services [Sat Dec 7 20:07:40 2024] ioatdma 0000:80:04.7: Removing dma and dca services [Sat Dec 7 20:07:40 2024] ioatdma 0000:80:04.6: Removing dma and dca services [Sat Dec 7 20:07:40 2024] ioatdma 0000:80:04.5: Removing dma and dca services [Sat Dec 7 20:07:40 2024] ioatdma 0000:80:04.4: Removing dma and dca services [Sat Dec 7 20:07:40 2024] ioatdma 0000:80:04.3: Removing dma and dca services [Sat Dec 7 20:07:40 2024] ioatdma 0000:80:04.2: Removing dma and dca services [Sat Dec 7 20:07:40 2024] ioatdma 0000:80:04.1: Removing dma and dca services [Sat Dec 7 20:07:40 2024] ioatdma 0000:80:04.0: Removing dma and dca services [Sat Dec 7 20:07:42 2024] spdk: /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh (done) [Sat Dec 7 20:08:00 2024] spdk: /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset (start) [Sat Dec 7 20:08:05 2024] nvme nvme0: pci function 0000:d8:00.0 [Sat Dec 7 20:08:05 2024] nvme nvme0: 112/0/0 default/read/poll queues [Sat Dec 7 20:08:05 2024] nvme nvme0: Ignoring bogus Namespace Identifiers [Sat Dec 7 20:08:05 2024] spdk: /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset (done) [Sat Dec 7 20:08:05 2024] spdk: /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh cleanup (start) [Sat Dec 7 20:08:08 2024] spdk: /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh cleanup (done) [Sat Dec 7 20:08:08 2024] ######## Autotest Cleanup Dump ######## [Sat Dec 7 20:08:08 2024] sysrq: Show backtrace of all active CPUs [Sat Dec 7 20:08:08 2024] NMI backtrace for cpu 93 [Sat Dec 7 20:08:08 2024] CPU: 93 PID: 1201308 Comm: bash Tainted: G OE 6.8.9-200.fc39.x86_64 #1 [Sat Dec 7 20:08:08 2024] Hardware name: Intel Corporation S2600WFQ/S2600WFQ, BIOS SE5C620.86B.00.01.0014.070920180847 07/09/2018 [Sat Dec 7 20:08:08 2024] Call Trace: [Sat Dec 7 20:08:08 2024] [Sat Dec 7 20:08:08 2024] dump_stack_lvl+0x64/0x80 [Sat Dec 7 20:08:08 2024] nmi_cpu_backtrace+0xd6/0x110 [Sat Dec 7 20:08:08 2024] ? __pfx_nmi_raise_cpu_backtrace+0x10/0x10 [Sat Dec 7 20:08:08 2024] nmi_trigger_cpumask_backtrace+0xf3/0x140 [Sat Dec 7 20:08:08 2024] __handle_sysrq+0xe1/0x260 [Sat Dec 7 20:08:08 2024] write_sysrq_trigger+0x59/0x80 [Sat Dec 7 20:08:08 2024] proc_reg_write+0x5a/0xa0 [Sat Dec 7 20:08:08 2024] vfs_write+0xed/0x470 [Sat Dec 7 20:08:08 2024] ? get_close_on_exec+0x36/0x40 [Sat Dec 7 20:08:08 2024] ksys_write+0x6f/0xf0 [Sat Dec 7 20:08:08 2024] do_syscall_64+0x83/0x170 [Sat Dec 7 20:08:09 2024] ? filp_flush+0x52/0x70 [Sat Dec 7 20:08:09 2024] ? filp_close+0x1d/0x30 [Sat Dec 7 20:08:09 2024] ? do_dup2+0x88/0xd0 [Sat Dec 7 20:08:09 2024] ? syscall_exit_to_user_mode+0x83/0x230 [Sat Dec 7 20:08:09 2024] ? do_syscall_64+0x90/0x170 [Sat Dec 7 20:08:09 2024] ? alloc_fd+0xb5/0x170 [Sat Dec 7 20:08:09 2024] ? f_dupfd+0x4b/0x60 [Sat Dec 7 20:08:09 2024] ? do_fcntl+0x5ce/0x6a0 [Sat Dec 7 20:08:09 2024] ? filp_flush+0x52/0x70 [Sat Dec 7 20:08:09 2024] ? syscall_exit_to_user_mode+0x83/0x230 [Sat Dec 7 20:08:09 2024] ? do_syscall_64+0x90/0x170 [Sat Dec 7 20:08:09 2024] ? do_syscall_64+0x90/0x170 [Sat Dec 7 20:08:09 2024] ? get_close_on_exec+0x36/0x40 [Sat Dec 7 20:08:09 2024] ? do_fcntl+0x89/0x6a0 [Sat Dec 7 20:08:09 2024] ? __x64_sys_fcntl+0x94/0xc0 [Sat Dec 7 20:08:09 2024] ? syscall_exit_to_user_mode+0x83/0x230 [Sat Dec 7 20:08:09 2024] ? do_syscall_64+0x90/0x170 [Sat Dec 7 20:08:09 2024] ? exc_page_fault+0x7f/0x180 [Sat Dec 7 20:08:09 2024] entry_SYSCALL_64_after_hwframe+0x78/0x80 [Sat Dec 7 20:08:09 2024] RIP: 0033:0x7f6b4f035ee4 [Sat Dec 7 20:08:09 2024] Code: c7 00 16 00 00 00 b8 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 f3 0f 1e fa 80 3d 85 74 0d 00 00 74 13 b8 01 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 54 c3 0f 1f 00 55 48 89 e5 48 83 ec 20 48 89 [Sat Dec 7 20:08:09 2024] RSP: 002b:00007fff9a12bdb8 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [Sat Dec 7 20:08:09 2024] RAX: ffffffffffffffda RBX: 0000000000000002 RCX: 00007f6b4f035ee4 [Sat Dec 7 20:08:09 2024] RDX: 0000000000000002 RSI: 0000563168326a80 RDI: 0000000000000001 [Sat Dec 7 20:08:09 2024] RBP: 00007fff9a12bde0 R08: 0000000000000073 R09: 0000000000000001 [Sat Dec 7 20:08:09 2024] R10: 0000000000000000 R11: 0000000000000202 R12: 0000000000000002 [Sat Dec 7 20:08:09 2024] R13: 0000563168326a80 R14: 00007f6b4f1065c0 R15: 00007f6b4f103f20 [Sat Dec 7 20:08:09 2024] [Sat Dec 7 20:08:09 2024] Sending NMI from CPU 93 to CPUs 0-92,94-111: [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 0 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 1 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 2 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 3 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 4 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 5 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 6 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 8 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 7 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 9 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 10 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 11 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 12 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 13 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 14 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 15 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 16 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 18 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 17 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 20 [Sat Dec 7 20:08:09 2024] CPU: 20 PID: 2058 Comm: systemd-journal Tainted: G OE 6.8.9-200.fc39.x86_64 #1 [Sat Dec 7 20:08:09 2024] Hardware name: Intel Corporation S2600WFQ/S2600WFQ, BIOS SE5C620.86B.00.01.0014.070920180847 07/09/2018 [Sat Dec 7 20:08:09 2024] RIP: 0010:update_sd_lb_stats.constprop.0+0x17e/0xb90 [Sat Dec 7 20:08:09 2024] Code: 00 20 00 00 0f 83 23 09 00 00 4c 8b 7c 24 08 8b 3c 24 31 c9 31 f6 4e 03 3c f5 a0 3c c0 84 ba ff ff ff ff 49 8b 87 a0 01 00 00 <48> 01 43 08 48 89 44 24 40 e8 74 02 ff ff 48 01 43 18 49 8b 87 a8 [Sat Dec 7 20:08:09 2024] RSP: 0018:ffffb48c093bf5f8 EFLAGS: 00000082 [Sat Dec 7 20:08:09 2024] RAX: 0000000000000000 RBX: ffffb48c093bf678 RCX: 0000000000000000 [Sat Dec 7 20:08:09 2024] RDX: 00000000ffffffff RSI: 0000000000000000 RDI: 0000000000000031 [Sat Dec 7 20:08:09 2024] RBP: 0000000000000031 R08: ffff9466878918a8 R09: fffe000000000000 [Sat Dec 7 20:08:09 2024] R10: 0000000000000000 R11: ffff946687891880 R12: ffffb48c093bf8a0 [Sat Dec 7 20:08:09 2024] R13: 0000000000000000 R14: 0000000000000031 R15: ffff9475d4eb4780 [Sat Dec 7 20:08:09 2024] FS: 00007f009822e980(0000) GS:ffff946ddf000000(0000) knlGS:0000000000000000 [Sat Dec 7 20:08:09 2024] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [Sat Dec 7 20:08:09 2024] CR2: 00007f008dae5000 CR3: 0000000106b14006 CR4: 00000000007706f0 [Sat Dec 7 20:08:09 2024] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [Sat Dec 7 20:08:09 2024] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [Sat Dec 7 20:08:09 2024] PKRU: 55555554 [Sat Dec 7 20:08:09 2024] Call Trace: [Sat Dec 7 20:08:09 2024] [Sat Dec 7 20:08:09 2024] ? nmi_cpu_backtrace+0x99/0x110 [Sat Dec 7 20:08:09 2024] ? nmi_cpu_backtrace_handler+0x11/0x20 [Sat Dec 7 20:08:09 2024] ? nmi_handle+0x65/0x170 [Sat Dec 7 20:08:09 2024] ? default_do_nmi+0x40/0x100 [Sat Dec 7 20:08:09 2024] ? exc_nmi+0x125/0x1a0 [Sat Dec 7 20:08:09 2024] ? end_repeat_nmi+0xf/0x60 [Sat Dec 7 20:08:09 2024] ? update_sd_lb_stats.constprop.0+0x17e/0xb90 [Sat Dec 7 20:08:09 2024] ? update_sd_lb_stats.constprop.0+0x17e/0xb90 [Sat Dec 7 20:08:09 2024] ? update_sd_lb_stats.constprop.0+0x17e/0xb90 [Sat Dec 7 20:08:09 2024] [Sat Dec 7 20:08:09 2024] [Sat Dec 7 20:08:09 2024] find_busiest_group+0x42/0x4e0 [Sat Dec 7 20:08:09 2024] load_balance+0x167/0x1290 [Sat Dec 7 20:08:09 2024] ? sched_clock+0x10/0x30 [Sat Dec 7 20:08:09 2024] newidle_balance+0x1e0/0x480 [Sat Dec 7 20:08:09 2024] pick_next_task_fair+0x45/0x5c0 [Sat Dec 7 20:08:09 2024] __schedule+0x194/0x1720 [Sat Dec 7 20:08:09 2024] ? _prb_read_valid+0x294/0x310 [Sat Dec 7 20:08:09 2024] schedule+0x32/0xd0 [Sat Dec 7 20:08:09 2024] schedule_hrtimeout_range_clock+0x134/0x140 [Sat Dec 7 20:08:09 2024] do_epoll_wait+0x657/0x7b0 [Sat Dec 7 20:08:09 2024] ? __pfx_ep_autoremove_wake_function+0x10/0x10 [Sat Dec 7 20:08:09 2024] __x64_sys_epoll_wait+0x73/0x110 [Sat Dec 7 20:08:09 2024] do_syscall_64+0x83/0x170 [Sat Dec 7 20:08:09 2024] ? syscall_exit_to_user_mode+0x83/0x230 [Sat Dec 7 20:08:09 2024] ? do_syscall_64+0x90/0x170 [Sat Dec 7 20:08:09 2024] ? vfs_read+0x2b7/0x380 [Sat Dec 7 20:08:09 2024] ? vfs_read+0x2b7/0x380 [Sat Dec 7 20:08:09 2024] ? __seccomp_filter+0x32c/0x4f0 [Sat Dec 7 20:08:09 2024] ? ksys_read+0x6f/0xf0 [Sat Dec 7 20:08:09 2024] ? syscall_exit_to_user_mode+0x83/0x230 [Sat Dec 7 20:08:09 2024] ? do_syscall_64+0x90/0x170 [Sat Dec 7 20:08:09 2024] ? do_syscall_64+0x90/0x170 [Sat Dec 7 20:08:09 2024] ? do_syscall_64+0x90/0x170 [Sat Dec 7 20:08:09 2024] ? do_faccessat+0x1c4/0x2f0 [Sat Dec 7 20:08:09 2024] ? syscall_exit_to_user_mode+0x83/0x230 [Sat Dec 7 20:08:09 2024] ? do_syscall_64+0x90/0x170 [Sat Dec 7 20:08:09 2024] ? __x64_sys_epoll_wait+0x73/0x110 [Sat Dec 7 20:08:09 2024] ? syscall_exit_to_user_mode+0x83/0x230 [Sat Dec 7 20:08:09 2024] ? do_syscall_64+0x90/0x170 [Sat Dec 7 20:08:09 2024] ? exc_page_fault+0x7f/0x180 [Sat Dec 7 20:08:09 2024] entry_SYSCALL_64_after_hwframe+0x78/0x80 [Sat Dec 7 20:08:09 2024] RIP: 0033:0x7f0098c4ae62 [Sat Dec 7 20:08:09 2024] Code: 89 55 f8 48 89 75 f0 89 7d fc 89 4d ec e8 c6 4b f7 ff 44 8b 55 ec 8b 55 f8 41 89 c0 48 8b 75 f0 8b 7d fc b8 e8 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 2e 44 89 c7 89 45 fc e8 1b 4c f7 ff 8b 45 fc [Sat Dec 7 20:08:09 2024] RSP: 002b:00007ffe9b1dea90 EFLAGS: 00000293 ORIG_RAX: 00000000000000e8 [Sat Dec 7 20:08:09 2024] RAX: ffffffffffffffda RBX: 0000000000000046 RCX: 00007f0098c4ae62 [Sat Dec 7 20:08:09 2024] RDX: 0000000000000046 RSI: 0000557c0cde4830 RDI: 0000000000000008 [Sat Dec 7 20:08:09 2024] RBP: 00007ffe9b1deab0 R08: 0000000000000000 R09: 0000000000000008 [Sat Dec 7 20:08:09 2024] R10: 00000000ffffffff R11: 0000000000000293 R12: 0000557c0cde4830 [Sat Dec 7 20:08:09 2024] R13: 0000000000000023 R14: 0000557c0cdadf00 R15: ffffffffffffffff [Sat Dec 7 20:08:09 2024] [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 25 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 24 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 26 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 23 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 21 [Sat Dec 7 20:08:09 2024] CPU: 21 PID: 1120174 Comm: dmesg Tainted: G OE 6.8.9-200.fc39.x86_64 #1 [Sat Dec 7 20:08:09 2024] Hardware name: Intel Corporation S2600WFQ/S2600WFQ, BIOS SE5C620.86B.00.01.0014.070920180847 07/09/2018 [Sat Dec 7 20:08:09 2024] RIP: 0033:0x7f5a4dd14989 [Sat Dec 7 20:08:09 2024] Code: 00 f3 0f 1e fa 31 c0 48 85 d2 0f 84 31 01 00 00 55 48 89 e5 41 57 41 56 41 55 49 89 f5 41 54 49 89 d4 53 48 89 fb 48 83 ec 18 <8b> 03 48 8b 7f 28 f7 d0 f6 c4 0a 74 52 48 8b 53 30 48 39 d7 73 69 [Sat Dec 7 20:08:09 2024] RSP: 002b:00007ffede8c6dd0 EFLAGS: 00000202 [Sat Dec 7 20:08:09 2024] RAX: 0000000000000000 RBX: 00007f5a4de675c0 RCX: 00007f5a4de675c0 [Sat Dec 7 20:08:09 2024] RDX: 0000000000000001 RSI: 0000563186a86110 RDI: 00007f5a4de675c0 [Sat Dec 7 20:08:09 2024] RBP: 00007ffede8c6e10 R08: 0000563186a86110 R09: 00007ffede8c6e9c [Sat Dec 7 20:08:09 2024] R10: 00007ffede8c6e9c R11: 0000563186a86110 R12: 0000000000000001 [Sat Dec 7 20:08:09 2024] R13: 0000563186a86110 R14: 0000000000000001 R15: 0000563186a86110 [Sat Dec 7 20:08:09 2024] FS: 00007f5a4dc8b740 GS: 0000000000000000 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 28 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 22 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 29 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 27 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 30 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 19 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 31 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 32 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 33 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 34 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 35 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 36 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 37 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 38 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 39 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 41 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 40 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 42 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 43 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 44 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 45 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 46 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 47 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 48 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 49 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 50 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 51 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 52 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 53 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 54 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 55 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 56 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 57 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 59 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 58 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 61 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 60 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 63 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 62 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 65 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 64 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 67 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 66 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 69 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 68 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 70 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 71 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 72 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 73 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 74 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 75 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 77 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 76 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 78 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 79 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 80 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 81 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 82 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 83 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 84 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 85 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 86 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 87 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 88 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 89 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 90 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 91 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 92 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 94 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 95 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 96 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 97 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 98 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 99 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 100 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 101 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 102 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 103 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 104 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 105 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 106 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 107 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 108 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 109 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 110 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] NMI backtrace for cpu 111 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Sat Dec 7 20:08:09 2024] sysrq: Show Memory [Sat Dec 7 20:08:10 2024] Mem-Info: [Sat Dec 7 20:08:10 2024] active_anon:1947313 inactive_anon:0 isolated_anon:0 active_file:98471 inactive_file:923200 isolated_file:0 unevictable:768 dirty:0 writeback:0 slab_reclaimable:62466 slab_unreclaimable:193519 mapped:50168 shmem:1825680 pagetables:3473 sec_pagetables:0 bounce:0 kernel_misc_reclaimable:0 free:11185749 free_pcp:100502 free_cma:0 [Sat Dec 7 20:08:10 2024] Node 0 active_anon:6072304kB inactive_anon:0kB active_file:277836kB inactive_file:3622048kB unevictable:3072kB isolated(anon):0kB isolated(file):0kB mapped:136652kB dirty:0kB writeback:0kB shmem:5671644kB shmem_thp:0kB shmem_pmdmapped:0kB anon_thp:0kB writeback_tmp:0kB kernel_stack:14232kB pagetables:9560kB sec_pagetables:0kB all_unreclaimable? no [Sat Dec 7 20:08:10 2024] Node 1 active_anon:1716948kB inactive_anon:0kB active_file:116048kB inactive_file:70752kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:64020kB dirty:0kB writeback:0kB shmem:1631076kB shmem_thp:0kB shmem_pmdmapped:0kB anon_thp:0kB writeback_tmp:0kB kernel_stack:9480kB pagetables:4332kB sec_pagetables:0kB all_unreclaimable? no [Sat Dec 7 20:08:10 2024] Node 0 DMA free:11264kB boost:0kB min:20kB low:32kB high:44kB reserved_highatomic:0KB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15972kB managed:15360kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB [Sat Dec 7 20:08:10 2024] lowmem_reserve[]: 0 1673 31798 31798 31798 [Sat Dec 7 20:08:10 2024] Node 0 DMA32 free:1709428kB boost:0kB min:2564kB low:4276kB high:5988kB reserved_highatomic:0KB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:1779060kB managed:1713524kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB [Sat Dec 7 20:08:10 2024] lowmem_reserve[]: 0 0 30125 30125 30125 [Sat Dec 7 20:08:10 2024] Node 0 Normal free:19731552kB boost:0kB min:46172kB low:77020kB high:107868kB reserved_highatomic:0KB active_anon:6072304kB inactive_anon:0kB active_file:277836kB inactive_file:3622048kB unevictable:3072kB writepending:0kB present:31444992kB managed:30856484kB mlocked:0kB bounce:0kB free_pcp:197332kB local_pcp:28kB free_cma:0kB [Sat Dec 7 20:08:10 2024] lowmem_reserve[]: 0 0 0 0 0 [Sat Dec 7 20:08:10 2024] Node 1 Normal free:23291256kB boost:0kB min:41348kB low:68972kB high:96596kB reserved_highatomic:0KB active_anon:1716948kB inactive_anon:0kB active_file:116048kB inactive_file:70752kB unevictable:0kB writepending:0kB present:28311552kB managed:27698396kB mlocked:0kB bounce:0kB free_pcp:204368kB local_pcp:4916kB free_cma:0kB [Sat Dec 7 20:08:10 2024] lowmem_reserve[]: 0 0 0 0 0 [Sat Dec 7 20:08:10 2024] Node 0 DMA: 0*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 2*4096kB (M) = 11264kB [Sat Dec 7 20:08:10 2024] Node 0 DMA32: 11*4kB (UM) 9*8kB (UM) 8*16kB (UM) 10*32kB (UM) 5*64kB (UM) 4*128kB (UM) 6*256kB (UM) 7*512kB (UM) 7*1024kB (UM) 6*2048kB (M) 411*4096kB (M) = 1709428kB [Sat Dec 7 20:08:10 2024] Node 0 Normal: 31641*4kB (UME) 38777*8kB (UME) 28909*16kB (UME) 19140*32kB (UME) 11768*64kB (UME) 5143*128kB (UME) 1614*256kB (UME) 439*512kB (UME) 105*1024kB (UME) 37*2048kB (UME) 3904*4096kB (UME) = 19735292kB [Sat Dec 7 20:08:10 2024] Node 1 Normal: 46029*4kB (UME) 38054*8kB (UME) 30597*16kB (UME) 15784*32kB (UME) 9916*64kB (UME) 3713*128kB (UME) 1021*256kB (UME) 200*512kB (UM) 55*1024kB (UME) 121*2048kB (UM) 4891*4096kB (UM) = 23294516kB [Sat Dec 7 20:08:10 2024] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB [Sat Dec 7 20:08:10 2024] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB [Sat Dec 7 20:08:10 2024] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB [Sat Dec 7 20:08:10 2024] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB [Sat Dec 7 20:08:10 2024] 2847351 total pagecache pages [Sat Dec 7 20:08:10 2024] 0 pages in swap cache [Sat Dec 7 20:08:10 2024] Free swap = 8388604kB [Sat Dec 7 20:08:10 2024] Total swap = 8388604kB [Sat Dec 7 20:08:10 2024] 15387894 pages RAM [Sat Dec 7 20:08:10 2024] 0 pages HighMem/MovableOnly [Sat Dec 7 20:08:10 2024] 316953 pages reserved [Sat Dec 7 20:08:10 2024] 0 pages cma reserved [Sat Dec 7 20:08:10 2024] 0 pages hwpoisoned [Sat Dec 7 20:08:10 2024] sysrq: Show Blocked State [Sat Dec 7 20:08:10 2024] task:ipmitool state:D stack:0 pid:1225902 tgid:1225902 ppid:1201463 flags:0x00004002 [Sat Dec 7 20:08:10 2024] Call Trace: [Sat Dec 7 20:08:10 2024] [Sat Dec 7 20:08:10 2024] __schedule+0x413/0x1720 [Sat Dec 7 20:08:10 2024] ? ttwu_do_activate+0x68/0x230 [Sat Dec 7 20:08:10 2024] schedule+0x32/0xd0 [Sat Dec 7 20:08:10 2024] schedule_timeout+0x151/0x160 [Sat Dec 7 20:08:10 2024] wait_for_completion+0x8a/0x160 [Sat Dec 7 20:08:10 2024] __wait_rcu_gp+0x15b/0x170 [Sat Dec 7 20:08:10 2024] synchronize_rcu+0x133/0x150 [Sat Dec 7 20:08:10 2024] ? __pfx_call_rcu_hurry+0x10/0x10 [Sat Dec 7 20:08:10 2024] ? __pfx_wakeme_after_rcu+0x10/0x10 [Sat Dec 7 20:08:10 2024] _ipmi_destroy_user+0x2aa/0x320 [ipmi_msghandler] [Sat Dec 7 20:08:10 2024] ipmi_destroy_user+0x12/0x60 [ipmi_msghandler] [Sat Dec 7 20:08:10 2024] ipmi_release+0x1f/0x60 [ipmi_devintf] [Sat Dec 7 20:08:10 2024] __fput+0x97/0x2c0 [Sat Dec 7 20:08:10 2024] __x64_sys_close+0x3d/0x80 [Sat Dec 7 20:08:10 2024] do_syscall_64+0x83/0x170 [Sat Dec 7 20:08:10 2024] ? do_pselect.constprop.0+0xfd/0x180 [Sat Dec 7 20:08:10 2024] ? __count_memcg_events+0x69/0x100 [Sat Dec 7 20:08:10 2024] ? count_memcg_events.constprop.0+0x1a/0x30 [Sat Dec 7 20:08:10 2024] ? handle_mm_fault+0xa2/0x360 [Sat Dec 7 20:08:10 2024] ? do_user_addr_fault+0x304/0x690 [Sat Dec 7 20:08:10 2024] ? exc_page_fault+0x7f/0x180 [Sat Dec 7 20:08:10 2024] entry_SYSCALL_64_after_hwframe+0x78/0x80 [Sat Dec 7 20:08:10 2024] RIP: 0033:0x7fe3dbfd3804 [Sat Dec 7 20:08:10 2024] RSP: 002b:00007ffdcfdfa928 EFLAGS: 00000202 ORIG_RAX: 0000000000000003 [Sat Dec 7 20:08:11 2024] RAX: ffffffffffffffda RBX: 00005606e2efe9e0 RCX: 00007fe3dbfd3804 [Sat Dec 7 20:08:11 2024] RDX: 0000000000000003 RSI: 00005606e4a66cc0 RDI: 0000000000000003 [Sat Dec 7 20:08:11 2024] RBP: 00007ffdcfdfa940 R08: 0000560384c82606 R09: 0000000000000007 [Sat Dec 7 20:08:11 2024] R10: 00005606e4a66cd0 R11: 0000000000000202 R12: 0000000000000000 [Sat Dec 7 20:08:11 2024] R13: 0000000000000000 R14: 00005606e2efe9e0 R15: 0000000000000007 [Sat Dec 7 20:08:11 2024]