[Mon Dec 2 02:40:03 2024] spdk: /var/jenkins/workspace/vfio-user-phy-autotest/spdk/scripts/setup.sh reset (start) [Mon Dec 2 02:40:04 2024] pcieport 0000:00:1c.0: Enabling MPC IRBNCE [Mon Dec 2 02:40:04 2024] pcieport 0000:00:1c.0: Intel PCH root port ACS workaround enabled [Mon Dec 2 02:40:04 2024] spdk: /var/jenkins/workspace/vfio-user-phy-autotest/spdk/scripts/setup.sh reset (done) [Mon Dec 2 02:40:06 2024] spdk: /var/jenkins/workspace/vfio-user-phy-autotest/spdk/scripts/setup.sh status (start) [Mon Dec 2 02:40:07 2024] spdk: /var/jenkins/workspace/vfio-user-phy-autotest/spdk/scripts/setup.sh status (done) [Mon Dec 2 02:40:07 2024] spdk: /var/jenkins/workspace/vfio-user-phy-autotest/spdk/scripts/setup.sh (start) [Mon Dec 2 02:40:08 2024] ioatdma 0000:00:04.7: Removing dma and dca services [Mon Dec 2 02:40:08 2024] igb 0000:03:00.0: DCA disabled [Mon Dec 2 02:40:08 2024] igb 0000:03:00.3: DCA disabled [Mon Dec 2 02:40:08 2024] ioatdma 0000:00:04.6: Removing dma and dca services [Mon Dec 2 02:40:08 2024] ioatdma 0000:00:04.5: Removing dma and dca services [Mon Dec 2 02:40:08 2024] ioatdma 0000:00:04.4: Removing dma and dca services [Mon Dec 2 02:40:08 2024] ioatdma 0000:00:04.3: Removing dma and dca services [Mon Dec 2 02:40:08 2024] ioatdma 0000:00:04.2: Removing dma and dca services [Mon Dec 2 02:40:08 2024] ioatdma 0000:00:04.1: Removing dma and dca services [Mon Dec 2 02:40:08 2024] ioatdma 0000:00:04.0: Removing dma and dca services [Mon Dec 2 02:40:08 2024] ioatdma 0000:80:04.7: Removing dma and dca services [Mon Dec 2 02:40:08 2024] ioatdma 0000:80:04.6: Removing dma and dca services [Mon Dec 2 02:40:08 2024] ioatdma 0000:80:04.5: Removing dma and dca services [Mon Dec 2 02:40:08 2024] ioatdma 0000:80:04.4: Removing dma and dca services [Mon Dec 2 02:40:08 2024] ioatdma 0000:80:04.3: Removing dma and dca services [Mon Dec 2 02:40:09 2024] ioatdma 0000:80:04.2: Removing dma and dca services [Mon Dec 2 02:40:09 2024] ioatdma 0000:80:04.1: Removing dma and dca services [Mon Dec 2 02:40:09 2024] ioatdma 0000:80:04.0: Removing dma and dca services [Mon Dec 2 02:40:10 2024] pcieport 0000:00:1c.0: Enabling MPC IRBNCE [Mon Dec 2 02:40:10 2024] pcieport 0000:00:1c.0: Intel PCH root port ACS workaround enabled [Mon Dec 2 02:40:10 2024] spdk: /var/jenkins/workspace/vfio-user-phy-autotest/spdk/scripts/setup.sh (done) [Mon Dec 2 02:40:11 2024] spdk: /var/jenkins/workspace/vfio-user-phy-autotest/spdk/scripts/setup.sh reset (start) [Mon Dec 2 02:40:12 2024] igb 0000:03:00.0: DCA enabled [Mon Dec 2 02:40:12 2024] igb 0000:03:00.3: DCA enabled [Mon Dec 2 02:40:13 2024] nvme nvme0: pci function 0000:0d:00.0 [Mon Dec 2 02:40:13 2024] nvme nvme0: 88/0/0 default/read/poll queues [Mon Dec 2 02:40:13 2024] nvme nvme0: Ignoring bogus Namespace Identifiers [Mon Dec 2 02:40:13 2024] pcieport 0000:00:1c.0: Enabling MPC IRBNCE [Mon Dec 2 02:40:13 2024] pcieport 0000:00:1c.0: Intel PCH root port ACS workaround enabled [Mon Dec 2 02:40:13 2024] spdk: /var/jenkins/workspace/vfio-user-phy-autotest/spdk/scripts/setup.sh reset (done) [Mon Dec 2 02:40:13 2024] spdk: /var/jenkins/workspace/vfio-user-phy-autotest/spdk/scripts/setup.sh (start) [Mon Dec 2 02:40:14 2024] ioatdma 0000:00:04.7: Removing dma and dca services [Mon Dec 2 02:40:14 2024] igb 0000:03:00.0: DCA disabled [Mon Dec 2 02:40:14 2024] igb 0000:03:00.3: DCA disabled [Mon Dec 2 02:40:14 2024] ioatdma 0000:00:04.6: Removing dma and dca services [Mon Dec 2 02:40:14 2024] ioatdma 0000:00:04.5: Removing dma and dca services [Mon Dec 2 02:40:14 2024] ioatdma 0000:00:04.4: Removing dma and dca services [Mon Dec 2 02:40:14 2024] ioatdma 0000:00:04.3: Removing dma and dca services [Mon Dec 2 02:40:14 2024] ioatdma 0000:00:04.2: Removing dma and dca services [Mon Dec 2 02:40:14 2024] ioatdma 0000:00:04.1: Removing dma and dca services [Mon Dec 2 02:40:14 2024] ioatdma 0000:00:04.0: Removing dma and dca services [Mon Dec 2 02:40:14 2024] ioatdma 0000:80:04.7: Removing dma and dca services [Mon Dec 2 02:40:14 2024] ioatdma 0000:80:04.6: Removing dma and dca services [Mon Dec 2 02:40:14 2024] ioatdma 0000:80:04.5: Removing dma and dca services [Mon Dec 2 02:40:14 2024] ioatdma 0000:80:04.4: Removing dma and dca services [Mon Dec 2 02:40:15 2024] ioatdma 0000:80:04.3: Removing dma and dca services [Mon Dec 2 02:40:15 2024] ioatdma 0000:80:04.2: Removing dma and dca services [Mon Dec 2 02:40:15 2024] ioatdma 0000:80:04.1: Removing dma and dca services [Mon Dec 2 02:40:15 2024] ioatdma 0000:80:04.0: Removing dma and dca services [Mon Dec 2 02:40:16 2024] pcieport 0000:00:1c.0: Enabling MPC IRBNCE [Mon Dec 2 02:40:16 2024] pcieport 0000:00:1c.0: Intel PCH root port ACS workaround enabled [Mon Dec 2 02:40:16 2024] spdk: /var/jenkins/workspace/vfio-user-phy-autotest/spdk/scripts/setup.sh (done) [Mon Dec 2 02:40:28 2024] spdk: /var/jenkins/workspace/vfio-user-phy-autotest/spdk/scripts/setup.sh reset (start) [Mon Dec 2 02:40:29 2024] igb 0000:03:00.0: DCA enabled [Mon Dec 2 02:40:29 2024] igb 0000:03:00.3: DCA enabled [Mon Dec 2 02:40:30 2024] nvme nvme0: pci function 0000:0d:00.0 [Mon Dec 2 02:40:30 2024] nvme nvme0: 88/0/0 default/read/poll queues [Mon Dec 2 02:40:30 2024] nvme nvme0: Ignoring bogus Namespace Identifiers [Mon Dec 2 02:40:31 2024] pcieport 0000:00:1c.0: Enabling MPC IRBNCE [Mon Dec 2 02:40:31 2024] pcieport 0000:00:1c.0: Intel PCH root port ACS workaround enabled [Mon Dec 2 02:40:31 2024] spdk: /var/jenkins/workspace/vfio-user-phy-autotest/spdk/scripts/setup.sh reset (done) [Mon Dec 2 02:40:31 2024] spdk: /var/jenkins/workspace/vfio-user-phy-autotest/spdk/scripts/setup.sh cleanup (start) [Mon Dec 2 02:40:32 2024] spdk: /var/jenkins/workspace/vfio-user-phy-autotest/spdk/scripts/setup.sh cleanup (done) [Mon Dec 2 02:40:32 2024] ######## Autotest Cleanup Dump ######## [Mon Dec 2 02:40:32 2024] sysrq: Show backtrace of all active CPUs [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 0 [Mon Dec 2 02:40:32 2024] CPU: 0 PID: 2164183 Comm: bash Tainted: G OE 6.8.9-200.fc39.x86_64 #1 [Mon Dec 2 02:40:32 2024] Hardware name: Intel Corporation S2600WT2/S2600WT2, BIOS SE5C610.86B.01.01.0016.033120161139 03/31/2016 [Mon Dec 2 02:40:32 2024] Call Trace: [Mon Dec 2 02:40:32 2024] [Mon Dec 2 02:40:32 2024] dump_stack_lvl+0x64/0x80 [Mon Dec 2 02:40:32 2024] nmi_cpu_backtrace+0xd6/0x110 [Mon Dec 2 02:40:32 2024] ? __pfx_nmi_raise_cpu_backtrace+0x10/0x10 [Mon Dec 2 02:40:32 2024] nmi_trigger_cpumask_backtrace+0xf3/0x140 [Mon Dec 2 02:40:32 2024] __handle_sysrq+0xe4/0x260 [Mon Dec 2 02:40:32 2024] write_sysrq_trigger+0x59/0x80 [Mon Dec 2 02:40:32 2024] proc_reg_write+0x5d/0xa0 [Mon Dec 2 02:40:32 2024] vfs_write+0xf0/0x470 [Mon Dec 2 02:40:32 2024] ksys_write+0x6f/0xf0 [Mon Dec 2 02:40:32 2024] do_syscall_64+0x83/0x170 [Mon Dec 2 02:40:32 2024] ? filp_close+0x1d/0x30 [Mon Dec 2 02:40:32 2024] ? do_dup2+0x88/0xd0 [Mon Dec 2 02:40:32 2024] ? syscall_exit_to_user_mode+0x83/0x230 [Mon Dec 2 02:40:32 2024] ? do_syscall_64+0x90/0x170 [Mon Dec 2 02:40:32 2024] ? do_sys_openat2+0x97/0xe0 [Mon Dec 2 02:40:32 2024] ? syscall_exit_to_user_mode+0x83/0x230 [Mon Dec 2 02:40:32 2024] ? alloc_fd+0xb5/0x170 [Mon Dec 2 02:40:32 2024] ? set_close_on_exec+0x32/0x70 [Mon Dec 2 02:40:32 2024] ? do_fcntl+0x3b4/0x6a0 [Mon Dec 2 02:40:32 2024] ? do_fcntl+0x5ce/0x6a0 [Mon Dec 2 02:40:32 2024] ? filp_flush+0x52/0x70 [Mon Dec 2 02:40:32 2024] ? syscall_exit_to_user_mode+0x83/0x230 [Mon Dec 2 02:40:32 2024] ? do_syscall_64+0x90/0x170 [Mon Dec 2 02:40:32 2024] ? exc_page_fault+0x7f/0x180 [Mon Dec 2 02:40:32 2024] entry_SYSCALL_64_after_hwframe+0x78/0x80 [Mon Dec 2 02:40:32 2024] RIP: 0033:0x7f00648f7ee4 [Mon Dec 2 02:40:32 2024] Code: c7 00 16 00 00 00 b8 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 f3 0f 1e fa 80 3d 85 74 0d 00 00 74 13 b8 01 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 54 c3 0f 1f 00 55 48 89 e5 48 83 ec 20 48 89 [Mon Dec 2 02:40:32 2024] RSP: 002b:00007fff2496d258 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [Mon Dec 2 02:40:32 2024] RAX: ffffffffffffffda RBX: 0000000000000002 RCX: 00007f00648f7ee4 [Mon Dec 2 02:40:32 2024] RDX: 0000000000000002 RSI: 000055d95c996f40 RDI: 0000000000000001 [Mon Dec 2 02:40:32 2024] RBP: 00007fff2496d280 R08: 0000000000000073 R09: 0000000000000001 [Mon Dec 2 02:40:32 2024] R10: 0000000000000000 R11: 0000000000000202 R12: 0000000000000002 [Mon Dec 2 02:40:32 2024] R13: 000055d95c996f40 R14: 00007f00649c85c0 R15: 00007f00649c5f20 [Mon Dec 2 02:40:32 2024] [Mon Dec 2 02:40:32 2024] Sending NMI from CPU 0 to CPUs 1-87: [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 44 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 13 [Mon Dec 2 02:40:32 2024] CPU: 13 PID: 621224 Comm: kworker/13:2 Tainted: G OE 6.8.9-200.fc39.x86_64 #1 [Mon Dec 2 02:40:32 2024] Hardware name: Intel Corporation S2600WT2/S2600WT2, BIOS SE5C610.86B.01.01.0016.033120161139 03/31/2016 [Mon Dec 2 02:40:32 2024] Workqueue: events drm_fb_helper_damage_work [Mon Dec 2 02:40:32 2024] RIP: 0010:memcpy_toio+0x71/0xb0 [Mon Dec 2 02:40:32 2024] Code: 5c c3 cc cc cc cc 48 85 db 74 f2 40 f6 c5 01 75 45 48 83 fb 01 76 06 40 f6 c5 02 75 25 48 89 d9 48 89 ef 4c 89 e6 48 c1 e9 02 a5 f6 c3 02 74 02 66 a5 f6 c3 01 74 01 a4 5b 5d 41 5c c3 cc cc [Mon Dec 2 02:40:32 2024] RSP: 0018:ffffa18620ae3ad0 EFLAGS: 00010206 [Mon Dec 2 02:40:32 2024] RAX: 0000000000000000 RBX: 0000000000001000 RCX: 00000000000003e8 [Mon Dec 2 02:40:32 2024] RDX: 0000000000001000 RSI: ffffa1860dbad060 RDI: ffffa18621106060 [Mon Dec 2 02:40:32 2024] RBP: ffffa18621106000 R08: ffffa18620ae3ba0 R09: 0000000000000001 [Mon Dec 2 02:40:32 2024] R10: 0000000000000004 R11: ffff92e30ada7908 R12: ffffa1860dbad000 [Mon Dec 2 02:40:32 2024] R13: ffffa1860dbad000 R14: ffff92e15ac80240 R15: 0000000000000014 [Mon Dec 2 02:40:32 2024] FS: 0000000000000000(0000) GS:ffff92f07ee80000(0000) knlGS:0000000000000000 [Mon Dec 2 02:40:32 2024] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [Mon Dec 2 02:40:32 2024] CR2: 000055d95c996f40 CR3: 00000002e9bf2004 CR4: 00000000003706f0 [Mon Dec 2 02:40:32 2024] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [Mon Dec 2 02:40:32 2024] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [Mon Dec 2 02:40:32 2024] Call Trace: [Mon Dec 2 02:40:32 2024] [Mon Dec 2 02:40:32 2024] ? nmi_cpu_backtrace+0x99/0x110 [Mon Dec 2 02:40:32 2024] ? nmi_cpu_backtrace_handler+0x11/0x20 [Mon Dec 2 02:40:32 2024] ? nmi_handle+0x68/0x170 [Mon Dec 2 02:40:32 2024] ? default_do_nmi+0x40/0x100 [Mon Dec 2 02:40:32 2024] ? exc_nmi+0x125/0x1a0 [Mon Dec 2 02:40:32 2024] ? end_repeat_nmi+0xf/0x60 [Mon Dec 2 02:40:32 2024] ? memcpy_toio+0x71/0xb0 [Mon Dec 2 02:40:32 2024] ? memcpy_toio+0x71/0xb0 [Mon Dec 2 02:40:32 2024] ? memcpy_toio+0x71/0xb0 [Mon Dec 2 02:40:32 2024] [Mon Dec 2 02:40:32 2024] [Mon Dec 2 02:40:32 2024] drm_fb_memcpy+0x164/0x220 [Mon Dec 2 02:40:32 2024] ? drm_mode_init+0x81/0xc0 [Mon Dec 2 02:40:32 2024] ? drm_plane_get_damage_clips+0x27/0x80 [Mon Dec 2 02:40:32 2024] mgag200_primary_plane_helper_atomic_update+0xe8/0x2f0 [mgag200] [Mon Dec 2 02:40:32 2024] ? dma_resv_iter_first_unlocked+0x66/0x70 [Mon Dec 2 02:40:32 2024] drm_atomic_helper_commit_planes+0x110/0x310 [Mon Dec 2 02:40:32 2024] drm_atomic_helper_commit_tail+0x48/0x90 [Mon Dec 2 02:40:32 2024] mgag200_mode_config_helper_atomic_commit_tail+0x29/0x40 [mgag200] [Mon Dec 2 02:40:32 2024] commit_tail+0xaf/0x160 [Mon Dec 2 02:40:32 2024] drm_atomic_helper_commit+0x11a/0x140 [Mon Dec 2 02:40:32 2024] drm_atomic_commit+0x9a/0xd0 [Mon Dec 2 02:40:32 2024] ? __pfx___drm_printfn_info+0x10/0x10 [Mon Dec 2 02:40:32 2024] drm_atomic_helper_dirtyfb+0x1ad/0x280 [Mon Dec 2 02:40:32 2024] drm_fbdev_generic_helper_fb_dirty+0x243/0x2f0 [Mon Dec 2 02:40:32 2024] drm_fb_helper_damage_work+0x96/0x170 [Mon Dec 2 02:40:32 2024] process_one_work+0x176/0x340 [Mon Dec 2 02:40:32 2024] worker_thread+0x27b/0x3a0 [Mon Dec 2 02:40:32 2024] ? __pfx_worker_thread+0x10/0x10 [Mon Dec 2 02:40:32 2024] kthread+0xe8/0x120 [Mon Dec 2 02:40:32 2024] ? __pfx_kthread+0x10/0x10 [Mon Dec 2 02:40:32 2024] ret_from_fork+0x34/0x50 [Mon Dec 2 02:40:32 2024] ? __pfx_kthread+0x10/0x10 [Mon Dec 2 02:40:32 2024] ret_from_fork_asm+0x1b/0x30 [Mon Dec 2 02:40:32 2024] [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 57 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 19 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 63 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 49 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 5 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 3 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 47 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 65 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 21 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 50 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 6 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 64 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 67 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 7 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 81 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 37 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 51 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 59 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 15 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 53 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 9 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 10 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 54 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 17 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 61 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 55 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 11 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 52 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 8 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 4 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 48 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 62 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 18 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 1 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 45 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 46 [Mon Dec 2 02:40:32 2024] CPU: 46 PID: 2810 Comm: BESClient Tainted: G OE 6.8.9-200.fc39.x86_64 #1 [Mon Dec 2 02:40:32 2024] Hardware name: Intel Corporation S2600WT2/S2600WT2, BIOS SE5C610.86B.01.01.0016.033120161139 03/31/2016 [Mon Dec 2 02:40:32 2024] RIP: 0010:__list_add_valid_or_report+0x15/0xa0 [Mon Dec 2 02:40:32 2024] Code: 00 0f 1f 40 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 48 89 d0 48 85 f6 74 2a 48 85 d2 74 33 48 8b 52 08 <48> 39 f2 75 38 4c 8b 02 49 39 c0 75 41 48 39 d7 74 53 4c 39 c7 74 [Mon Dec 2 02:40:32 2024] RSP: 0018:ffffa1860c7d78c0 EFLAGS: 00000086 [Mon Dec 2 02:40:32 2024] RAX: ffff92e153df2978 RBX: ffff92e153df2978 RCX: ffff92e153df2978 [Mon Dec 2 02:40:32 2024] RDX: ffff92f07e8352b0 RSI: ffff92f07e8352b0 RDI: ffff92f0d67fd238 [Mon Dec 2 02:40:32 2024] RBP: ffff92f07e8352b0 R08: 0000000000000001 R09: ffffe00000000000 [Mon Dec 2 02:40:32 2024] R10: 0000000000000000 R11: 0000000000000058 R12: 0000000000000000 [Mon Dec 2 02:40:32 2024] R13: ffff92f07e834780 R14: ffffa1860c7d79b0 R15: ffff92f0d67fd238 [Mon Dec 2 02:40:32 2024] FS: 00007f15b92006c0(0000) GS:ffff92f07f400000(0000) knlGS:0000000000000000 [Mon Dec 2 02:40:32 2024] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [Mon Dec 2 02:40:32 2024] CR2: 00007fe9b127c884 CR3: 00000010850a2004 CR4: 00000000003706f0 [Mon Dec 2 02:40:32 2024] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [Mon Dec 2 02:40:32 2024] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [Mon Dec 2 02:40:32 2024] Call Trace: [Mon Dec 2 02:40:32 2024] [Mon Dec 2 02:40:32 2024] ? nmi_cpu_backtrace+0x99/0x110 [Mon Dec 2 02:40:32 2024] ? nmi_cpu_backtrace_handler+0x11/0x20 [Mon Dec 2 02:40:32 2024] ? nmi_handle+0x68/0x170 [Mon Dec 2 02:40:32 2024] ? default_do_nmi+0x40/0x100 [Mon Dec 2 02:40:32 2024] ? exc_nmi+0x125/0x1a0 [Mon Dec 2 02:40:32 2024] ? end_repeat_nmi+0xf/0x60 [Mon Dec 2 02:40:32 2024] ? __list_add_valid_or_report+0x15/0xa0 [Mon Dec 2 02:40:32 2024] ? __list_add_valid_or_report+0x15/0xa0 [Mon Dec 2 02:40:32 2024] ? __list_add_valid_or_report+0x15/0xa0 [Mon Dec 2 02:40:32 2024] [Mon Dec 2 02:40:32 2024] [Mon Dec 2 02:40:32 2024] load_balance+0xa66/0x1290 [Mon Dec 2 02:40:32 2024] newidle_balance+0x1e0/0x480 [Mon Dec 2 02:40:32 2024] pick_next_task_fair+0x45/0x5c0 [Mon Dec 2 02:40:32 2024] __schedule+0x194/0x1720 [Mon Dec 2 02:40:32 2024] ? timerqueue_add+0x66/0xb0 [Mon Dec 2 02:40:32 2024] ? enqueue_hrtimer+0x42/0xa0 [Mon Dec 2 02:40:32 2024] ? hrtimer_start_range_ns+0x25a/0x3a0 [Mon Dec 2 02:40:32 2024] schedule+0x32/0xd0 [Mon Dec 2 02:40:32 2024] do_nanosleep+0x5d/0x150 [Mon Dec 2 02:40:32 2024] hrtimer_nanosleep+0xc0/0x190 [Mon Dec 2 02:40:32 2024] ? __pfx_hrtimer_wakeup+0x10/0x10 [Mon Dec 2 02:40:32 2024] common_nsleep+0x43/0x50 [Mon Dec 2 02:40:32 2024] __x64_sys_clock_nanosleep+0xf8/0x180 [Mon Dec 2 02:40:32 2024] ? finish_task_switch.isra.0+0x94/0x2f0 [Mon Dec 2 02:40:32 2024] do_syscall_64+0x83/0x170 [Mon Dec 2 02:40:32 2024] ? timerqueue_add+0x66/0xb0 [Mon Dec 2 02:40:32 2024] ? enqueue_hrtimer+0x42/0xa0 [Mon Dec 2 02:40:32 2024] ? schedule+0x32/0xd0 [Mon Dec 2 02:40:32 2024] ? do_nanosleep+0x65/0x150 [Mon Dec 2 02:40:32 2024] ? hrtimer_nanosleep+0xc0/0x190 [Mon Dec 2 02:40:32 2024] ? __rseq_handle_notify_resume+0xa9/0x520 [Mon Dec 2 02:40:32 2024] ? __pfx_hrtimer_wakeup+0x10/0x10 [Mon Dec 2 02:40:32 2024] ? syscall_exit_to_user_mode+0x83/0x230 [Mon Dec 2 02:40:32 2024] ? do_syscall_64+0x90/0x170 [Mon Dec 2 02:40:32 2024] ? syscall_exit_to_user_mode+0x83/0x230 [Mon Dec 2 02:40:32 2024] ? do_syscall_64+0x90/0x170 [Mon Dec 2 02:40:32 2024] ? do_syscall_64+0x90/0x170 [Mon Dec 2 02:40:32 2024] ? do_syscall_64+0x90/0x170 [Mon Dec 2 02:40:32 2024] entry_SYSCALL_64_after_hwframe+0x78/0x80 [Mon Dec 2 02:40:32 2024] RIP: 0033:0x7f15b9ebc163 [Mon Dec 2 02:40:32 2024] Code: 89 55 e8 89 75 f4 89 7d f8 48 89 4d e0 e8 c5 18 fb ff 4c 8b 55 e0 48 8b 55 e8 41 89 c0 8b 75 f4 8b 7d f8 b8 e6 00 00 00 0f 05 <44> 89 c7 48 89 45 f8 e8 21 19 fb ff 48 8b 45 f8 c9 f7 d8 c3 66 0f [Mon Dec 2 02:40:32 2024] RSP: 002b:00007f15b91ffe00 EFLAGS: 00000293 ORIG_RAX: 00000000000000e6 [Mon Dec 2 02:40:32 2024] RAX: ffffffffffffffda RBX: 000000000216fa50 RCX: 00007f15b9ebc163 [Mon Dec 2 02:40:32 2024] RDX: 00007f15b91ffe40 RSI: 0000000000000000 RDI: 0000000000000000 [Mon Dec 2 02:40:32 2024] RBP: 00007f15b91ffe20 R08: 0000000000000000 R09: 0000000000000007 [Mon Dec 2 02:40:32 2024] R10: 0000000000000000 R11: 0000000000000293 R12: 00000000000000c8 [Mon Dec 2 02:40:32 2024] R13: ffffffffffffff68 R14: 0000000000000002 R15: 00007ffc79c68e40 [Mon Dec 2 02:40:32 2024] [Mon Dec 2 02:40:32 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.217 msecs [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 2 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.223 msecs [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 20 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 68 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 24 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 14 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 58 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.240 msecs [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 60 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.270 msecs [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 16 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.276 msecs [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 56 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.295 msecs [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 12 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.308 msecs [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 74 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 30 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.314 msecs [Mon Dec 2 02:40:32 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.321 msecs [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 41 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.330 msecs [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 85 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 71 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 27 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 33 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 22 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 66 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 76 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 32 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 80 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 36 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 82 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 78 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 25 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 69 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 38 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 87 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 72 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 23 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 39 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 83 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 31 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 75 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 43 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 79 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 35 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 77 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 84 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 40 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 26 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 70 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 73 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 29 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 34 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 42 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 86 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] NMI backtrace for cpu 28 skipped: idling at intel_idle+0x71/0xe0 [Mon Dec 2 02:40:32 2024] sysrq: Show Memory [Mon Dec 2 02:40:34 2024] Mem-Info: [Mon Dec 2 02:40:34 2024] active_anon:3460053 inactive_anon:0 isolated_anon:0 active_file:122321 inactive_file:929206 isolated_file:0 unevictable:768 dirty:0 writeback:0 slab_reclaimable:59074 slab_unreclaimable:114184 mapped:38748 shmem:3342677 pagetables:3805 sec_pagetables:0 bounce:0 kernel_misc_reclaimable:0 free:26733251 free_pcp:114266 free_cma:0 [Mon Dec 2 02:40:34 2024] Node 0 active_anon:9118300kB inactive_anon:0kB active_file:214944kB inactive_file:3560408kB unevictable:3072kB isolated(anon):0kB isolated(file):0kB mapped:81520kB dirty:0kB writeback:0kB shmem:8722744kB shmem_thp:0kB shmem_pmdmapped:0kB anon_thp:0kB writeback_tmp:0kB kernel_stack:11512kB pagetables:5328kB sec_pagetables:0kB all_unreclaimable? no [Mon Dec 2 02:40:34 2024] Node 1 active_anon:4722416kB inactive_anon:0kB active_file:274340kB inactive_file:156416kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:73472kB dirty:0kB writeback:0kB shmem:4647964kB shmem_thp:0kB shmem_pmdmapped:0kB anon_thp:0kB writeback_tmp:0kB kernel_stack:8744kB pagetables:8884kB sec_pagetables:0kB all_unreclaimable? no [Mon Dec 2 02:40:34 2024] Node 0 DMA free:11264kB boost:0kB min:8kB low:20kB high:32kB reserved_highatomic:0KB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15976kB managed:15360kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB [Mon Dec 2 02:40:34 2024] lowmem_reserve[]: 0 1871 64321 64321 64321 [Mon Dec 2 02:40:34 2024] Node 0 DMA32 free:1912544kB boost:0kB min:1364kB low:3280kB high:5196kB reserved_highatomic:0KB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:1982428kB managed:1916892kB mlocked:0kB bounce:0kB free_pcp:228kB local_pcp:0kB free_cma:0kB [Mon Dec 2 02:40:34 2024] lowmem_reserve[]: 0 0 62449 62449 62449 [Mon Dec 2 02:40:34 2024] Node 0 Normal free:50238548kB boost:0kB min:45556kB low:109500kB high:173444kB reserved_highatomic:0KB active_anon:9118260kB inactive_anon:0kB active_file:214944kB inactive_file:3560408kB unevictable:3072kB writepending:0kB present:65011712kB managed:63947944kB mlocked:0kB bounce:0kB free_pcp:205208kB local_pcp:544kB free_cma:0kB [Mon Dec 2 02:40:34 2024] lowmem_reserve[]: 0 0 0 0 0 [Mon Dec 2 02:40:34 2024] Node 1 Normal free:54762616kB boost:0kB min:43176kB low:103776kB high:164376kB reserved_highatomic:0KB active_anon:4721856kB inactive_anon:0kB active_file:274340kB inactive_file:156416kB unevictable:0kB writepending:0kB present:61865984kB managed:60683768kB mlocked:0kB bounce:0kB free_pcp:256972kB local_pcp:488kB free_cma:0kB [Mon Dec 2 02:40:34 2024] lowmem_reserve[]: 0 0 0 0 0 [Mon Dec 2 02:40:34 2024] Node 0 DMA: 0*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 2*4096kB (M) = 11264kB [Mon Dec 2 02:40:34 2024] Node 0 DMA32: 0*4kB 2*8kB (UM) 1*16kB (M) 0*32kB 1*64kB (U) 1*128kB (U) 2*256kB (UM) 2*512kB (UM) 2*1024kB (UM) 2*2048kB (UM) 465*4096kB (M) = 1912544kB [Mon Dec 2 02:40:34 2024] Node 0 Normal: 55834*4kB (UME) 60695*8kB (UME) 69076*16kB (UME) 32243*32kB (UME) 7897*64kB (UME) 5225*128kB (UME) 1667*256kB (UME) 693*512kB (UM) 435*1024kB (UM) 223*2048kB (UME) 10873*4096kB (UM) = 50239616kB [Mon Dec 2 02:40:34 2024] Node 1 Normal: 59574*4kB (UME) 52986*8kB (UME) 34209*16kB (UME) 20461*32kB (UME) 8473*64kB (ME) 2739*128kB (UME) 943*256kB (UM) 347*512kB (UME) 191*1024kB (UM) 131*2048kB (UM) 12483*4096kB (UM) = 54770456kB [Mon Dec 2 02:40:34 2024] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB [Mon Dec 2 02:40:34 2024] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB [Mon Dec 2 02:40:34 2024] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB [Mon Dec 2 02:40:34 2024] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB [Mon Dec 2 02:40:34 2024] 4394204 total pagecache pages [Mon Dec 2 02:40:34 2024] 0 pages in swap cache [Mon Dec 2 02:40:34 2024] Free swap = 8388604kB [Mon Dec 2 02:40:34 2024] Total swap = 8388604kB [Mon Dec 2 02:40:34 2024] 32219025 pages RAM [Mon Dec 2 02:40:34 2024] 0 pages HighMem/MovableOnly [Mon Dec 2 02:40:34 2024] 578034 pages reserved [Mon Dec 2 02:40:34 2024] 0 pages cma reserved [Mon Dec 2 02:40:34 2024] 0 pages hwpoisoned [Mon Dec 2 02:40:34 2024] sysrq: Show Blocked State [Mon Dec 2 02:40:34 2024] task:ipmitool state:D stack:0 pid:2181537 tgid:2181537 ppid:2164409 flags:0x00004002 [Mon Dec 2 02:40:34 2024] Call Trace: [Mon Dec 2 02:40:34 2024] [Mon Dec 2 02:40:34 2024] __schedule+0x413/0x1720 [Mon Dec 2 02:40:34 2024] ? __schedule+0x41b/0x1720 [Mon Dec 2 02:40:34 2024] schedule+0x32/0xd0 [Mon Dec 2 02:40:34 2024] schedule_timeout+0x151/0x160 [Mon Dec 2 02:40:34 2024] wait_for_completion+0x8a/0x160 [Mon Dec 2 02:40:34 2024] __wait_rcu_gp+0x15b/0x170 [Mon Dec 2 02:40:34 2024] synchronize_rcu+0x133/0x150 [Mon Dec 2 02:40:34 2024] ? __pfx_call_rcu_hurry+0x10/0x10 [Mon Dec 2 02:40:34 2024] ? __pfx_wakeme_after_rcu+0x10/0x10 [Mon Dec 2 02:40:34 2024] _ipmi_destroy_user+0x2aa/0x320 [ipmi_msghandler] [Mon Dec 2 02:40:34 2024] ipmi_destroy_user+0x12/0x60 [ipmi_msghandler] [Mon Dec 2 02:40:34 2024] ipmi_release+0x1f/0x60 [ipmi_devintf] [Mon Dec 2 02:40:34 2024] __fput+0x9a/0x2c0 [Mon Dec 2 02:40:34 2024] __x64_sys_close+0x3d/0x80 [Mon Dec 2 02:40:34 2024] do_syscall_64+0x83/0x170 [Mon Dec 2 02:40:34 2024] ? exc_page_fault+0x7f/0x180 [Mon Dec 2 02:40:34 2024] entry_SYSCALL_64_after_hwframe+0x78/0x80 [Mon Dec 2 02:40:34 2024] RIP: 0033:0x7faa4dc1d804 [Mon Dec 2 02:40:34 2024] RSP: 002b:00007ffda97c86b8 EFLAGS: 00000202 ORIG_RAX: 0000000000000003 [Mon Dec 2 02:40:34 2024] RAX: ffffffffffffffda RBX: 000056524a49c9e0 RCX: 00007faa4dc1d804 [Mon Dec 2 02:40:34 2024] RDX: 0000000000000003 RSI: 000056524c1e05f0 RDI: 0000000000000003 [Mon Dec 2 02:40:34 2024] RBP: 00007ffda97c86d0 R08: 00005657293ac470 R09: 0000000000000007 [Mon Dec 2 02:40:34 2024] R10: 000056524c1e0600 R11: 0000000000000202 R12: 0000000000000000 [Mon Dec 2 02:40:34 2024] R13: 0000000000000000 R14: 000056524a49c9e0 R15: 0000000000000007 [Mon Dec 2 02:40:34 2024]