[Sun Dec 8 03:19:55 2024] spdk: /var/jenkins/workspace/vfio-user-phy-autotest/spdk/scripts/setup.sh reset (start) [Sun Dec 8 03:19:56 2024] pcieport 0000:00:1c.0: Enabling MPC IRBNCE [Sun Dec 8 03:19:56 2024] pcieport 0000:00:1c.0: Intel PCH root port ACS workaround enabled [Sun Dec 8 03:19:56 2024] spdk: /var/jenkins/workspace/vfio-user-phy-autotest/spdk/scripts/setup.sh reset (done) [Sun Dec 8 03:19:58 2024] spdk: /var/jenkins/workspace/vfio-user-phy-autotest/spdk/scripts/setup.sh status (start) [Sun Dec 8 03:19:59 2024] spdk: /var/jenkins/workspace/vfio-user-phy-autotest/spdk/scripts/setup.sh status (done) [Sun Dec 8 03:19:59 2024] spdk: /var/jenkins/workspace/vfio-user-phy-autotest/spdk/scripts/setup.sh (start) [Sun Dec 8 03:20:01 2024] ioatdma 0000:00:04.7: Removing dma and dca services [Sun Dec 8 03:20:01 2024] igb 0000:03:00.0: DCA disabled [Sun Dec 8 03:20:01 2024] igb 0000:03:00.3: DCA disabled [Sun Dec 8 03:20:01 2024] ioatdma 0000:00:04.6: Removing dma and dca services [Sun Dec 8 03:20:01 2024] ioatdma 0000:00:04.5: Removing dma and dca services [Sun Dec 8 03:20:01 2024] ioatdma 0000:00:04.4: Removing dma and dca services [Sun Dec 8 03:20:01 2024] ioatdma 0000:00:04.3: Removing dma and dca services [Sun Dec 8 03:20:01 2024] ioatdma 0000:00:04.2: Removing dma and dca services [Sun Dec 8 03:20:01 2024] ioatdma 0000:00:04.1: Removing dma and dca services [Sun Dec 8 03:20:01 2024] ioatdma 0000:00:04.0: Removing dma and dca services [Sun Dec 8 03:20:01 2024] ioatdma 0000:80:04.7: Removing dma and dca services [Sun Dec 8 03:20:01 2024] ioatdma 0000:80:04.6: Removing dma and dca services [Sun Dec 8 03:20:01 2024] ioatdma 0000:80:04.5: Removing dma and dca services [Sun Dec 8 03:20:01 2024] ioatdma 0000:80:04.4: Removing dma and dca services [Sun Dec 8 03:20:01 2024] ioatdma 0000:80:04.3: Removing dma and dca services [Sun Dec 8 03:20:01 2024] ioatdma 0000:80:04.2: Removing dma and dca services [Sun Dec 8 03:20:01 2024] ioatdma 0000:80:04.1: Removing dma and dca services [Sun Dec 8 03:20:01 2024] ioatdma 0000:80:04.0: Removing dma and dca services [Sun Dec 8 03:20:02 2024] pcieport 0000:00:1c.0: Enabling MPC IRBNCE [Sun Dec 8 03:20:02 2024] pcieport 0000:00:1c.0: Intel PCH root port ACS workaround enabled [Sun Dec 8 03:20:02 2024] spdk: /var/jenkins/workspace/vfio-user-phy-autotest/spdk/scripts/setup.sh (done) [Sun Dec 8 03:20:03 2024] spdk: /var/jenkins/workspace/vfio-user-phy-autotest/spdk/scripts/setup.sh reset (start) [Sun Dec 8 03:20:04 2024] igb 0000:03:00.0: DCA enabled [Sun Dec 8 03:20:04 2024] igb 0000:03:00.3: DCA enabled [Sun Dec 8 03:20:05 2024] nvme nvme0: pci function 0000:0d:00.0 [Sun Dec 8 03:20:05 2024] nvme nvme0: 88/0/0 default/read/poll queues [Sun Dec 8 03:20:05 2024] nvme nvme0: Ignoring bogus Namespace Identifiers [Sun Dec 8 03:20:05 2024] pcieport 0000:00:1c.0: Enabling MPC IRBNCE [Sun Dec 8 03:20:05 2024] pcieport 0000:00:1c.0: Intel PCH root port ACS workaround enabled [Sun Dec 8 03:20:05 2024] spdk: /var/jenkins/workspace/vfio-user-phy-autotest/spdk/scripts/setup.sh reset (done) [Sun Dec 8 03:20:05 2024] spdk: /var/jenkins/workspace/vfio-user-phy-autotest/spdk/scripts/setup.sh (start) [Sun Dec 8 03:20:06 2024] ioatdma 0000:00:04.7: Removing dma and dca services [Sun Dec 8 03:20:06 2024] igb 0000:03:00.0: DCA disabled [Sun Dec 8 03:20:06 2024] igb 0000:03:00.3: DCA disabled [Sun Dec 8 03:20:06 2024] ioatdma 0000:00:04.6: Removing dma and dca services [Sun Dec 8 03:20:06 2024] ioatdma 0000:00:04.5: Removing dma and dca services [Sun Dec 8 03:20:06 2024] ioatdma 0000:00:04.4: Removing dma and dca services [Sun Dec 8 03:20:06 2024] ioatdma 0000:00:04.3: Removing dma and dca services [Sun Dec 8 03:20:06 2024] ioatdma 0000:00:04.2: Removing dma and dca services [Sun Dec 8 03:20:06 2024] ioatdma 0000:00:04.1: Removing dma and dca services [Sun Dec 8 03:20:06 2024] ioatdma 0000:00:04.0: Removing dma and dca services [Sun Dec 8 03:20:06 2024] ioatdma 0000:80:04.7: Removing dma and dca services [Sun Dec 8 03:20:06 2024] ioatdma 0000:80:04.6: Removing dma and dca services [Sun Dec 8 03:20:06 2024] ioatdma 0000:80:04.5: Removing dma and dca services [Sun Dec 8 03:20:06 2024] ioatdma 0000:80:04.4: Removing dma and dca services [Sun Dec 8 03:20:06 2024] ioatdma 0000:80:04.3: Removing dma and dca services [Sun Dec 8 03:20:06 2024] ioatdma 0000:80:04.2: Removing dma and dca services [Sun Dec 8 03:20:06 2024] ioatdma 0000:80:04.1: Removing dma and dca services [Sun Dec 8 03:20:06 2024] ioatdma 0000:80:04.0: Removing dma and dca services [Sun Dec 8 03:20:08 2024] pcieport 0000:00:1c.0: Enabling MPC IRBNCE [Sun Dec 8 03:20:08 2024] pcieport 0000:00:1c.0: Intel PCH root port ACS workaround enabled [Sun Dec 8 03:20:08 2024] spdk: /var/jenkins/workspace/vfio-user-phy-autotest/spdk/scripts/setup.sh (done) [Sun Dec 8 03:20:20 2024] spdk: /var/jenkins/workspace/vfio-user-phy-autotest/spdk/scripts/setup.sh reset (start) [Sun Dec 8 03:20:21 2024] igb 0000:03:00.0: DCA enabled [Sun Dec 8 03:20:21 2024] igb 0000:03:00.3: DCA enabled [Sun Dec 8 03:20:22 2024] nvme nvme0: pci function 0000:0d:00.0 [Sun Dec 8 03:20:22 2024] nvme nvme0: 88/0/0 default/read/poll queues [Sun Dec 8 03:20:22 2024] nvme nvme0: Ignoring bogus Namespace Identifiers [Sun Dec 8 03:20:23 2024] pcieport 0000:00:1c.0: Enabling MPC IRBNCE [Sun Dec 8 03:20:23 2024] pcieport 0000:00:1c.0: Intel PCH root port ACS workaround enabled [Sun Dec 8 03:20:23 2024] spdk: /var/jenkins/workspace/vfio-user-phy-autotest/spdk/scripts/setup.sh reset (done) [Sun Dec 8 03:20:23 2024] spdk: /var/jenkins/workspace/vfio-user-phy-autotest/spdk/scripts/setup.sh cleanup (start) [Sun Dec 8 03:20:24 2024] spdk: /var/jenkins/workspace/vfio-user-phy-autotest/spdk/scripts/setup.sh cleanup (done) [Sun Dec 8 03:20:24 2024] ######## Autotest Cleanup Dump ######## [Sun Dec 8 03:20:24 2024] sysrq: Show backtrace of all active CPUs [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 25 [Sun Dec 8 03:20:24 2024] CPU: 25 PID: 1920355 Comm: bash Tainted: G OE 6.8.9-200.fc39.x86_64 #1 [Sun Dec 8 03:20:24 2024] Hardware name: Intel Corporation S2600WT2/S2600WT2, BIOS SE5C610.86B.01.01.0016.033120161139 03/31/2016 [Sun Dec 8 03:20:24 2024] Call Trace: [Sun Dec 8 03:20:24 2024] [Sun Dec 8 03:20:24 2024] dump_stack_lvl+0x64/0x80 [Sun Dec 8 03:20:24 2024] nmi_cpu_backtrace+0xd6/0x110 [Sun Dec 8 03:20:24 2024] ? __pfx_nmi_raise_cpu_backtrace+0x10/0x10 [Sun Dec 8 03:20:24 2024] nmi_trigger_cpumask_backtrace+0xf3/0x140 [Sun Dec 8 03:20:24 2024] __handle_sysrq+0xe4/0x260 [Sun Dec 8 03:20:24 2024] write_sysrq_trigger+0x59/0x80 [Sun Dec 8 03:20:24 2024] proc_reg_write+0x5d/0xa0 [Sun Dec 8 03:20:24 2024] vfs_write+0xf0/0x470 [Sun Dec 8 03:20:24 2024] ksys_write+0x6f/0xf0 [Sun Dec 8 03:20:24 2024] do_syscall_64+0x83/0x170 [Sun Dec 8 03:20:24 2024] ? syscall_exit_to_user_mode+0x83/0x230 [Sun Dec 8 03:20:24 2024] ? do_syscall_64+0x90/0x170 [Sun Dec 8 03:20:24 2024] ? __x64_sys_fcntl+0x94/0xc0 [Sun Dec 8 03:20:24 2024] ? syscall_exit_to_user_mode+0x83/0x230 [Sun Dec 8 03:20:24 2024] ? do_syscall_64+0x90/0x170 [Sun Dec 8 03:20:24 2024] ? do_syscall_64+0x90/0x170 [Sun Dec 8 03:20:24 2024] ? do_user_addr_fault+0x304/0x690 [Sun Dec 8 03:20:24 2024] ? exc_page_fault+0x7f/0x180 [Sun Dec 8 03:20:24 2024] entry_SYSCALL_64_after_hwframe+0x78/0x80 [Sun Dec 8 03:20:24 2024] RIP: 0033:0x7f81499f4ee4 [Sun Dec 8 03:20:24 2024] Code: c7 00 16 00 00 00 b8 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 f3 0f 1e fa 80 3d 85 74 0d 00 00 74 13 b8 01 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 54 c3 0f 1f 00 55 48 89 e5 48 83 ec 20 48 89 [Sun Dec 8 03:20:24 2024] RSP: 002b:00007ffec4c196c8 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [Sun Dec 8 03:20:24 2024] RAX: ffffffffffffffda RBX: 0000000000000002 RCX: 00007f81499f4ee4 [Sun Dec 8 03:20:24 2024] RDX: 0000000000000002 RSI: 000055860ab7c1d0 RDI: 0000000000000001 [Sun Dec 8 03:20:24 2024] RBP: 00007ffec4c196f0 R08: 0000000000000073 R09: 0000000000000001 [Sun Dec 8 03:20:24 2024] R10: 0000000000000000 R11: 0000000000000202 R12: 0000000000000002 [Sun Dec 8 03:20:24 2024] R13: 000055860ab7c1d0 R14: 00007f8149ac55c0 R15: 00007f8149ac2f20 [Sun Dec 8 03:20:24 2024] [Sun Dec 8 03:20:24 2024] Sending NMI from CPU 25 to CPUs 0-24,26-87: [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 44 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 0 [Sun Dec 8 03:20:24 2024] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G OE 6.8.9-200.fc39.x86_64 #1 [Sun Dec 8 03:20:24 2024] Hardware name: Intel Corporation S2600WT2/S2600WT2, BIOS SE5C610.86B.01.01.0016.033120161139 03/31/2016 [Sun Dec 8 03:20:24 2024] RIP: 0010:flush_smp_call_function_queue+0x1b/0x70 [Sun Dec 8 03:20:24 2024] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 0f 1f 00 0f 1f 44 00 00 48 c7 c0 80 5a 03 00 65 48 03 05 08 1c de 79 48 8b 00 <48> 85 c0 74 44 53 9c 58 0f 1f 40 00 48 89 c3 fa 0f 1f 44 00 00 bf [Sun Dec 8 03:20:24 2024] RSP: 0018:ffffffff88403e68 EFLAGS: 00000282 [Sun Dec 8 03:20:24 2024] RAX: ffff96e57e8347c0 RBX: ffffffff88411100 RCX: 0000000000000838 [Sun Dec 8 03:20:24 2024] RDX: 7ffffffffffffffd RSI: 000016c8bcc3adf4 RDI: 0000000000000000 [Sun Dec 8 03:20:24 2024] RBP: ffffffff88411100 R08: ffff96e57e824ac0 R09: 0000000000000007 [Sun Dec 8 03:20:24 2024] R10: 0000000000061a80 R11: fffffffffff3f5b4 R12: ffffffff886d6500 [Sun Dec 8 03:20:24 2024] R13: ffff96e57e840fa0 R14: 0000000000000004 R15: 000000207fff4000 [Sun Dec 8 03:20:24 2024] FS: 0000000000000000(0000) GS:ffff96e57e800000(0000) knlGS:0000000000000000 [Sun Dec 8 03:20:24 2024] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [Sun Dec 8 03:20:24 2024] CR2: 00007f1c6a158900 CR3: 00000005b5428002 CR4: 00000000003706f0 [Sun Dec 8 03:20:24 2024] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [Sun Dec 8 03:20:24 2024] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [Sun Dec 8 03:20:24 2024] Call Trace: [Sun Dec 8 03:20:24 2024] [Sun Dec 8 03:20:24 2024] ? nmi_cpu_backtrace+0x99/0x110 [Sun Dec 8 03:20:24 2024] ? nmi_cpu_backtrace_handler+0x11/0x20 [Sun Dec 8 03:20:24 2024] ? nmi_handle+0x68/0x170 [Sun Dec 8 03:20:24 2024] ? default_do_nmi+0x40/0x100 [Sun Dec 8 03:20:24 2024] ? exc_nmi+0x125/0x1a0 [Sun Dec 8 03:20:24 2024] ? end_repeat_nmi+0xf/0x60 [Sun Dec 8 03:20:24 2024] ? flush_smp_call_function_queue+0x1b/0x70 [Sun Dec 8 03:20:24 2024] ? flush_smp_call_function_queue+0x1b/0x70 [Sun Dec 8 03:20:24 2024] ? flush_smp_call_function_queue+0x1b/0x70 [Sun Dec 8 03:20:24 2024] [Sun Dec 8 03:20:24 2024] [Sun Dec 8 03:20:24 2024] do_idle+0x169/0x270 [Sun Dec 8 03:20:24 2024] cpu_startup_entry+0x2a/0x30 [Sun Dec 8 03:20:24 2024] rest_init+0xde/0x110 [Sun Dec 8 03:20:24 2024] ? acpi_enable_subsystem+0x47/0xb0 [Sun Dec 8 03:20:24 2024] arch_call_rest_init+0xe/0x30 [Sun Dec 8 03:20:24 2024] start_kernel+0x716/0xaa0 [Sun Dec 8 03:20:24 2024] x86_64_start_reservations+0x18/0x30 [Sun Dec 8 03:20:24 2024] x86_64_start_kernel+0xbc/0x110 [Sun Dec 8 03:20:24 2024] secondary_startup_64_no_verify+0x184/0x18b [Sun Dec 8 03:20:24 2024] [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 30 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 64 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 20 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 72 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 28 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 55 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 11 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 82 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 38 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 50 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 74 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 6 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 33 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 77 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 14 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 62 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 71 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 27 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 81 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 37 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 53 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 80 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 36 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 12 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 68 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 57 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 84 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 40 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 2 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 46 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 86 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 42 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 78 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 34 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 73 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 29 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 13 [Sun Dec 8 03:20:24 2024] CPU: 13 PID: 2522 Comm: BESClient Tainted: G OE 6.8.9-200.fc39.x86_64 #1 [Sun Dec 8 03:20:24 2024] Hardware name: Intel Corporation S2600WT2/S2600WT2, BIOS SE5C610.86B.01.01.0016.033120161139 03/31/2016 [Sun Dec 8 03:20:24 2024] RIP: 0033:0x7f0ed504edf4 [Sun Dec 8 03:20:24 2024] Code: b7 0c 62 66 85 c9 0f 84 0f ff ff ff 49 8d 7c 24 10 48 8b 04 fa a8 0f 0f 85 89 01 00 00 48 89 c6 83 e9 01 48 c1 ee 0c 48 33 30 <48> 89 34 fa 66 42 89 0c 62 48 c7 40 08 00 00 00 00 48 83 c4 18 5b [Sun Dec 8 03:20:24 2024] RSP: 002b:00007fffd2395c90 EFLAGS: 00000202 [Sun Dec 8 03:20:24 2024] RAX: 0000000004e969a0 RBX: 0000000000000070 RCX: 0000000000000004 [Sun Dec 8 03:20:24 2024] RDX: 000000000375b010 RSI: 000000000398c2e0 RDI: 0000000000000016 [Sun Dec 8 03:20:24 2024] RBP: 00007fffd2395cc0 R08: 00000000037aff70 R09: 000000000181c720 [Sun Dec 8 03:20:24 2024] R10: 0000000000000008 R11: 0000000000000001 R12: 0000000000000006 [Sun Dec 8 03:20:24 2024] R13: ffffffffffffffa0 R14: 00000000037b0ed8 R15: 00000000037b0340 [Sun Dec 8 03:20:24 2024] FS: 00007f0ed4fa7540 GS: 0000000000000000 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 23 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 67 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 79 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 35 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 52 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 24 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 8 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 76 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 32 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 31 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 75 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 43 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 45 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 85 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 41 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 22 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 66 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 39 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 83 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 9 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 87 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 26 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 70 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 58 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 69 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 51 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 65 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 1 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 3 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 47 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 60 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 16 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 7 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 59 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 15 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 17 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 61 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 21 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 5 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 49 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.017 msecs [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 56 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 10 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.028 msecs [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 19 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 18 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.044 msecs [Sun Dec 8 03:20:24 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.054 msecs [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 54 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.061 msecs [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 4 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.142 msecs [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 48 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.153 msecs [Sun Dec 8 03:20:24 2024] NMI backtrace for cpu 63 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 03:20:24 2024] sysrq: Show Memory [Sun Dec 8 03:20:25 2024] Mem-Info: [Sun Dec 8 03:20:25 2024] active_anon:3527944 inactive_anon:0 isolated_anon:0 active_file:122561 inactive_file:930677 isolated_file:0 unevictable:768 dirty:0 writeback:0 slab_reclaimable:59423 slab_unreclaimable:116610 mapped:38493 shmem:3333378 pagetables:3322 sec_pagetables:0 bounce:0 kernel_misc_reclaimable:0 free:26672061 free_pcp:104320 free_cma:0 [Sun Dec 8 03:20:25 2024] Node 0 active_anon:5699588kB inactive_anon:0kB active_file:238676kB inactive_file:207700kB unevictable:3072kB isolated(anon):0kB isolated(file):0kB mapped:74328kB dirty:0kB writeback:0kB shmem:5016308kB shmem_thp:0kB shmem_pmdmapped:0kB anon_thp:0kB writeback_tmp:0kB kernel_stack:11352kB pagetables:10856kB sec_pagetables:0kB all_unreclaimable? no [Sun Dec 8 03:20:25 2024] Node 1 active_anon:8411880kB inactive_anon:0kB active_file:251568kB inactive_file:3515008kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:79668kB dirty:0kB writeback:0kB shmem:8317204kB shmem_thp:0kB shmem_pmdmapped:0kB anon_thp:0kB writeback_tmp:0kB kernel_stack:8264kB pagetables:2424kB sec_pagetables:0kB all_unreclaimable? no [Sun Dec 8 03:20:25 2024] Node 0 DMA free:11264kB boost:0kB min:8kB low:20kB high:32kB reserved_highatomic:0KB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15976kB managed:15360kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB [Sun Dec 8 03:20:25 2024] lowmem_reserve[]: 0 1871 64265 64265 64265 [Sun Dec 8 03:20:25 2024] Node 0 DMA32 free:1912544kB boost:0kB min:1364kB low:3280kB high:5196kB reserved_highatomic:0KB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:1982428kB managed:1916892kB mlocked:0kB bounce:0kB free_pcp:228kB local_pcp:0kB free_cma:0kB [Sun Dec 8 03:20:25 2024] lowmem_reserve[]: 0 0 62393 62393 62393 [Sun Dec 8 03:20:25 2024] Node 0 Normal free:57059080kB boost:0kB min:45516kB low:109404kB high:173292kB reserved_highatomic:0KB active_anon:5694576kB inactive_anon:0kB active_file:238676kB inactive_file:207700kB unevictable:3072kB writepending:0kB present:65011712kB managed:63898876kB mlocked:0kB bounce:0kB free_pcp:199212kB local_pcp:132kB free_cma:0kB [Sun Dec 8 03:20:25 2024] lowmem_reserve[]: 0 0 0 0 0 [Sun Dec 8 03:20:25 2024] Node 1 Normal free:47714620kB boost:0kB min:43216kB low:103876kB high:164536kB reserved_highatomic:0KB active_anon:8411768kB inactive_anon:0kB active_file:251568kB inactive_file:3515008kB unevictable:0kB writepending:0kB present:61865984kB managed:60732784kB mlocked:0kB bounce:0kB free_pcp:208564kB local_pcp:3152kB free_cma:0kB [Sun Dec 8 03:20:25 2024] lowmem_reserve[]: 0 0 0 0 0 [Sun Dec 8 03:20:25 2024] Node 0 DMA: 0*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 2*4096kB (M) = 11264kB [Sun Dec 8 03:20:25 2024] Node 0 DMA32: 0*4kB 2*8kB (UM) 1*16kB (M) 0*32kB 1*64kB (U) 1*128kB (U) 2*256kB (UM) 2*512kB (UM) 2*1024kB (UM) 2*2048kB (UM) 465*4096kB (M) = 1912544kB [Sun Dec 8 03:20:25 2024] Node 0 Normal: 55847*4kB (UM) 91325*8kB (UME) 58917*16kB (UME) 27691*32kB (UME) 9906*64kB (UME) 3742*128kB (UME) 1941*256kB (UME) 657*512kB (UME) 327*1024kB (UME) 192*2048kB (UME) 12599*4096kB (UM) = 57062580kB [Sun Dec 8 03:20:25 2024] Node 1 Normal: 70823*4kB (UME) 62476*8kB (UME) 40015*16kB (UME) 23076*32kB (UME) 9250*64kB (UME) 2307*128kB (UME) 974*256kB (UME) 392*512kB (UM) 230*1024kB (UME) 159*2048kB (UME) 10658*4096kB (UM) = 47715436kB [Sun Dec 8 03:20:25 2024] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB [Sun Dec 8 03:20:25 2024] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB [Sun Dec 8 03:20:25 2024] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB [Sun Dec 8 03:20:25 2024] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB [Sun Dec 8 03:20:26 2024] 4386619 total pagecache pages [Sun Dec 8 03:20:26 2024] 0 pages in swap cache [Sun Dec 8 03:20:26 2024] Free swap = 8388604kB [Sun Dec 8 03:20:26 2024] Total swap = 8388604kB [Sun Dec 8 03:20:26 2024] 32219025 pages RAM [Sun Dec 8 03:20:26 2024] 0 pages HighMem/MovableOnly [Sun Dec 8 03:20:26 2024] 578047 pages reserved [Sun Dec 8 03:20:26 2024] 0 pages cma reserved [Sun Dec 8 03:20:26 2024] 0 pages hwpoisoned [Sun Dec 8 03:20:26 2024] sysrq: Show Blocked State [Sun Dec 8 03:20:26 2024] task:ipmitool state:D stack:0 pid:1937574 tgid:1937574 ppid:1920564 flags:0x00004002 [Sun Dec 8 03:20:26 2024] Call Trace: [Sun Dec 8 03:20:26 2024] [Sun Dec 8 03:20:26 2024] __schedule+0x413/0x1720 [Sun Dec 8 03:20:26 2024] schedule+0x32/0xd0 [Sun Dec 8 03:20:26 2024] schedule_timeout+0x151/0x160 [Sun Dec 8 03:20:26 2024] wait_for_completion+0x8a/0x160 [Sun Dec 8 03:20:26 2024] __wait_rcu_gp+0x15b/0x170 [Sun Dec 8 03:20:26 2024] synchronize_rcu+0x133/0x150 [Sun Dec 8 03:20:26 2024] ? __pfx_call_rcu_hurry+0x10/0x10 [Sun Dec 8 03:20:26 2024] ? __pfx_wakeme_after_rcu+0x10/0x10 [Sun Dec 8 03:20:26 2024] _ipmi_destroy_user+0x2aa/0x320 [ipmi_msghandler] [Sun Dec 8 03:20:26 2024] ipmi_destroy_user+0x12/0x60 [ipmi_msghandler] [Sun Dec 8 03:20:26 2024] ipmi_release+0x1f/0x60 [ipmi_devintf] [Sun Dec 8 03:20:26 2024] __fput+0x9a/0x2c0 [Sun Dec 8 03:20:26 2024] __x64_sys_close+0x3d/0x80 [Sun Dec 8 03:20:26 2024] do_syscall_64+0x83/0x170 [Sun Dec 8 03:20:26 2024] ? do_fault+0x246/0x490 [Sun Dec 8 03:20:26 2024] ? __handle_mm_fault+0x827/0xe40 [Sun Dec 8 03:20:26 2024] ? __count_memcg_events+0x69/0x100 [Sun Dec 8 03:20:26 2024] ? count_memcg_events.constprop.0+0x1a/0x30 [Sun Dec 8 03:20:26 2024] ? handle_mm_fault+0xa2/0x360 [Sun Dec 8 03:20:26 2024] ? do_user_addr_fault+0x304/0x690 [Sun Dec 8 03:20:26 2024] ? exc_page_fault+0x7f/0x180 [Sun Dec 8 03:20:26 2024] entry_SYSCALL_64_after_hwframe+0x78/0x80 [Sun Dec 8 03:20:26 2024] RIP: 0033:0x7fe3bd18c804 [Sun Dec 8 03:20:26 2024] RSP: 002b:00007ffc16021968 EFLAGS: 00000202 ORIG_RAX: 0000000000000003 [Sun Dec 8 03:20:26 2024] RAX: ffffffffffffffda RBX: 000055b2e90969e0 RCX: 00007fe3bd18c804 [Sun Dec 8 03:20:26 2024] RDX: 0000000000000003 RSI: 000055b2ea3065f0 RDI: 0000000000000003 [Sun Dec 8 03:20:26 2024] RBP: 00007ffc16021980 R08: 000055b7b11ec696 R09: 0000000000000007 [Sun Dec 8 03:20:26 2024] R10: 000055b2ea306600 R11: 0000000000000202 R12: 0000000000000000 [Sun Dec 8 03:20:26 2024] R13: 0000000000000000 R14: 000055b2e90969e0 R15: 0000000000000007 [Sun Dec 8 03:20:26 2024]