[Mon Dec 16 15:01:37 2024] spdk: /var/jenkins/workspace/nvme-phy-autotest/spdk/scripts/setup.sh reset (start) [Mon Dec 16 15:01:40 2024] spdk: /var/jenkins/workspace/nvme-phy-autotest/spdk/scripts/setup.sh reset (done) [Mon Dec 16 15:01:46 2024] spdk: /var/jenkins/workspace/nvme-phy-autotest/spdk/scripts/setup.sh status (start) [Mon Dec 16 15:01:49 2024] spdk: /var/jenkins/workspace/nvme-phy-autotest/spdk/scripts/setup.sh status (done) [Mon Dec 16 15:01:49 2024] spdk: /var/jenkins/workspace/nvme-phy-autotest/spdk/scripts/setup.sh (start) [Mon Dec 16 15:01:52 2024] ioatdma 0000:00:04.7: Removing dma and dca services [Mon Dec 16 15:01:52 2024] ioatdma 0000:00:04.6: Removing dma and dca services [Mon Dec 16 15:01:52 2024] ioatdma 0000:00:04.5: Removing dma and dca services [Mon Dec 16 15:01:52 2024] ioatdma 0000:00:04.4: Removing dma and dca services [Mon Dec 16 15:01:52 2024] ioatdma 0000:00:04.3: Removing dma and dca services [Mon Dec 16 15:01:52 2024] ioatdma 0000:00:04.2: Removing dma and dca services [Mon Dec 16 15:01:52 2024] ioatdma 0000:00:04.1: Removing dma and dca services [Mon Dec 16 15:01:52 2024] ioatdma 0000:00:04.0: Removing dma and dca services [Mon Dec 16 15:01:52 2024] ioatdma 0000:80:04.7: Removing dma and dca services [Mon Dec 16 15:01:52 2024] ioatdma 0000:80:04.6: Removing dma and dca services [Mon Dec 16 15:01:52 2024] ioatdma 0000:80:04.5: Removing dma and dca services [Mon Dec 16 15:01:52 2024] ioatdma 0000:80:04.4: Removing dma and dca services [Mon Dec 16 15:01:52 2024] ioatdma 0000:80:04.3: Removing dma and dca services [Mon Dec 16 15:01:52 2024] ioatdma 0000:80:04.2: Removing dma and dca services [Mon Dec 16 15:01:52 2024] ioatdma 0000:80:04.1: Removing dma and dca services [Mon Dec 16 15:01:52 2024] ioatdma 0000:80:04.0: Removing dma and dca services [Mon Dec 16 15:01:55 2024] spdk: /var/jenkins/workspace/nvme-phy-autotest/spdk/scripts/setup.sh (done) [Mon Dec 16 15:01:56 2024] spdk: /var/jenkins/workspace/nvme-phy-autotest/spdk/scripts/setup.sh reset (start) [Mon Dec 16 15:01:59 2024] nvme nvme0: pci function 0000:5e:00.0 [Mon Dec 16 15:01:59 2024] nvme nvme0: Shutdown timeout set to 15 seconds [Mon Dec 16 15:01:59 2024] nvme nvme0: 72/0/0 default/read/poll queues [Mon Dec 16 15:01:59 2024] nvme nvme0: Ignoring bogus Namespace Identifiers [Mon Dec 16 15:02:01 2024] spdk: /var/jenkins/workspace/nvme-phy-autotest/spdk/scripts/setup.sh reset (done) [Mon Dec 16 15:02:01 2024] spdk: /var/jenkins/workspace/nvme-phy-autotest/spdk/scripts/setup.sh (start) [Mon Dec 16 15:02:04 2024] ioatdma 0000:00:04.7: Removing dma and dca services [Mon Dec 16 15:02:04 2024] ioatdma 0000:00:04.6: Removing dma and dca services [Mon Dec 16 15:02:04 2024] ioatdma 0000:00:04.5: Removing dma and dca services [Mon Dec 16 15:02:04 2024] ioatdma 0000:00:04.4: Removing dma and dca services [Mon Dec 16 15:02:04 2024] ioatdma 0000:00:04.3: Removing dma and dca services [Mon Dec 16 15:02:04 2024] ioatdma 0000:00:04.2: Removing dma and dca services [Mon Dec 16 15:02:04 2024] ioatdma 0000:00:04.1: Removing dma and dca services [Mon Dec 16 15:02:04 2024] ioatdma 0000:00:04.0: Removing dma and dca services [Mon Dec 16 15:02:04 2024] ioatdma 0000:80:04.7: Removing dma and dca services [Mon Dec 16 15:02:04 2024] ioatdma 0000:80:04.6: Removing dma and dca services [Mon Dec 16 15:02:04 2024] ioatdma 0000:80:04.5: Removing dma and dca services [Mon Dec 16 15:02:04 2024] ioatdma 0000:80:04.4: Removing dma and dca services [Mon Dec 16 15:02:04 2024] ioatdma 0000:80:04.3: Removing dma and dca services [Mon Dec 16 15:02:04 2024] ioatdma 0000:80:04.2: Removing dma and dca services [Mon Dec 16 15:02:04 2024] ioatdma 0000:80:04.1: Removing dma and dca services [Mon Dec 16 15:02:04 2024] ioatdma 0000:80:04.0: Removing dma and dca services [Mon Dec 16 15:02:08 2024] spdk: /var/jenkins/workspace/nvme-phy-autotest/spdk/scripts/setup.sh (done) [Mon Dec 16 15:02:23 2024] spdk: /var/jenkins/workspace/nvme-phy-autotest/spdk/scripts/setup.sh reset (start) [Mon Dec 16 15:02:26 2024] nvme nvme0: pci function 0000:5e:00.0 [Mon Dec 16 15:02:26 2024] nvme nvme0: Shutdown timeout set to 15 seconds [Mon Dec 16 15:02:26 2024] nvme nvme0: 72/0/0 default/read/poll queues [Mon Dec 16 15:02:26 2024] nvme nvme0: Ignoring bogus Namespace Identifiers [Mon Dec 16 15:02:27 2024] spdk: /var/jenkins/workspace/nvme-phy-autotest/spdk/scripts/setup.sh reset (done) [Mon Dec 16 15:02:27 2024] spdk: /var/jenkins/workspace/nvme-phy-autotest/spdk/scripts/setup.sh cleanup (start) [Mon Dec 16 15:02:30 2024] spdk: /var/jenkins/workspace/nvme-phy-autotest/spdk/scripts/setup.sh cleanup (done) [Mon Dec 16 15:02:31 2024] ######## Autotest Cleanup Dump ######## [Mon Dec 16 15:02:31 2024] sysrq: Show backtrace of all active CPUs [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 17 [Mon Dec 16 15:02:31 2024] CPU: 17 PID: 2335393 Comm: bash Tainted: G OE 6.8.9-200.fc39.x86_64 #1 [Mon Dec 16 15:02:31 2024] Hardware name: Intel Corporation S2600WFQ/S2600WFQ, BIOS SE5C620.86B.02.01.0008.031920191559 03/19/2019 [Mon Dec 16 15:02:31 2024] Call Trace: [Mon Dec 16 15:02:31 2024] [Mon Dec 16 15:02:31 2024] dump_stack_lvl+0x64/0x80 [Mon Dec 16 15:02:31 2024] nmi_cpu_backtrace+0xd6/0x110 [Mon Dec 16 15:02:31 2024] ? __pfx_nmi_raise_cpu_backtrace+0x10/0x10 [Mon Dec 16 15:02:31 2024] nmi_trigger_cpumask_backtrace+0xf3/0x140 [Mon Dec 16 15:02:31 2024] __handle_sysrq+0xe1/0x260 [Mon Dec 16 15:02:31 2024] write_sysrq_trigger+0x59/0x80 [Mon Dec 16 15:02:31 2024] proc_reg_write+0x5a/0xa0 [Mon Dec 16 15:02:31 2024] vfs_write+0xed/0x470 [Mon Dec 16 15:02:31 2024] ksys_write+0x6f/0xf0 [Mon Dec 16 15:02:31 2024] do_syscall_64+0x83/0x170 [Mon Dec 16 15:02:31 2024] ? filp_flush+0x52/0x70 [Mon Dec 16 15:02:31 2024] ? syscall_exit_to_user_mode+0x83/0x230 [Mon Dec 16 15:02:31 2024] ? do_syscall_64+0x90/0x170 [Mon Dec 16 15:02:31 2024] ? syscall_exit_to_user_mode+0x83/0x230 [Mon Dec 16 15:02:31 2024] ? do_syscall_64+0x90/0x170 [Mon Dec 16 15:02:31 2024] ? __count_memcg_events+0x69/0x100 [Mon Dec 16 15:02:31 2024] ? count_memcg_events.constprop.0+0x1a/0x30 [Mon Dec 16 15:02:31 2024] ? handle_mm_fault+0xa2/0x360 [Mon Dec 16 15:02:31 2024] ? do_user_addr_fault+0x304/0x690 [Mon Dec 16 15:02:31 2024] ? exc_page_fault+0x7f/0x180 [Mon Dec 16 15:02:31 2024] entry_SYSCALL_64_after_hwframe+0x78/0x80 [Mon Dec 16 15:02:31 2024] RIP: 0033:0x7f0adeaf8ee4 [Mon Dec 16 15:02:31 2024] Code: c7 00 16 00 00 00 b8 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 f3 0f 1e fa 80 3d 85 74 0d 00 00 74 13 b8 01 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 54 c3 0f 1f 00 55 48 89 e5 48 83 ec 20 48 89 [Mon Dec 16 15:02:31 2024] RSP: 002b:00007ffe14d9e3c8 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [Mon Dec 16 15:02:31 2024] RAX: ffffffffffffffda RBX: 0000000000000002 RCX: 00007f0adeaf8ee4 [Mon Dec 16 15:02:31 2024] RDX: 0000000000000002 RSI: 000055dd4d0a0ac0 RDI: 0000000000000001 [Mon Dec 16 15:02:31 2024] RBP: 00007ffe14d9e3f0 R08: 0000000000000073 R09: 0000000000000001 [Mon Dec 16 15:02:31 2024] R10: 0000000000000000 R11: 0000000000000202 R12: 0000000000000002 [Mon Dec 16 15:02:31 2024] R13: 000055dd4d0a0ac0 R14: 00007f0adebc95c0 R15: 00007f0adebc6f20 [Mon Dec 16 15:02:31 2024] [Mon Dec 16 15:02:31 2024] Sending NMI from CPU 17 to CPUs 0-16,18-71: [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 53 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 30 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 66 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 2 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 4 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 61 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 25 [Mon Dec 16 15:02:31 2024] CPU: 25 PID: 2413 Comm: telegraf Tainted: G OE 6.8.9-200.fc39.x86_64 #1 [Mon Dec 16 15:02:31 2024] Hardware name: Intel Corporation S2600WFQ/S2600WFQ, BIOS SE5C620.86B.02.01.0008.031920191559 03/19/2019 [Mon Dec 16 15:02:31 2024] RIP: 0033:0x45c91a [Mon Dec 16 15:02:31 2024] Code: 8b 74 24 68 e9 10 fd ff ff 48 89 d7 48 89 da 48 89 f3 e9 02 ff ff ff 48 8b 6c 24 70 48 83 c4 78 c3 31 c0 48 87 82 70 16 00 00 <48> 8b 6c 24 70 48 83 c4 78 c3 48 8d 05 21 03 6d 03 48 89 04 24 48 [Mon Dec 16 15:02:31 2024] RSP: 002b:00007efdcf3ffbc0 EFLAGS: 00000246 [Mon Dec 16 15:02:31 2024] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 000000c000152c00 [Mon Dec 16 15:02:31 2024] RDX: 000000c00005e000 RSI: 0000000000000003 RDI: 0000000000000000 [Mon Dec 16 15:02:31 2024] RBP: 00007efdcf3ffc30 R08: 0000000001013c01 R09: 000000c000052060 [Mon Dec 16 15:02:31 2024] R10: 0000000000000000 R11: 000000c000114000 R12: 0000167b8ea6daa5 [Mon Dec 16 15:02:31 2024] R13: 000000c000152c00 R14: 000080c001400000 R15: 0000000000000001 [Mon Dec 16 15:02:31 2024] FS: 00007efdcf4006c0 GS: 0000000000000000 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 39 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 24 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 23 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 26 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 37 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 18 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 54 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 0 [Mon Dec 16 15:02:31 2024] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G OE 6.8.9-200.fc39.x86_64 #1 [Mon Dec 16 15:02:31 2024] Hardware name: Intel Corporation S2600WFQ/S2600WFQ, BIOS SE5C620.86B.02.01.0008.031920191559 03/19/2019 [Mon Dec 16 15:02:31 2024] RIP: 0010:native_write_msr+0xa/0x30 [Mon Dec 16 15:02:31 2024] Code: 09 01 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 89 f0 89 f9 0f 30 <66> 90 c3 cc cc cc cc 48 c1 e2 20 48 89 d6 31 d2 48 09 c6 e9 ce 64 [Mon Dec 16 15:02:31 2024] RSP: 0018:ffffffff9c403db8 EFLAGS: 00000002 [Mon Dec 16 15:02:31 2024] RAX: 000000002d5c80d0 RBX: 001c06a6d4ad6600 RCX: 00000000000006e0 [Mon Dec 16 15:02:31 2024] RDX: 0000000000430202 RSI: 000000002d5c80d0 RDI: 00000000000006e0 [Mon Dec 16 15:02:31 2024] RBP: ffff939210021080 R08: ffff939210024b20 R09: 0000000000000007 [Mon Dec 16 15:02:31 2024] R10: 00000000000927c0 R11: 0000000000000004 R12: 0000000000000001 [Mon Dec 16 15:02:31 2024] R13: 0000000000000001 R14: 0000000000000003 R15: 000000183fff4000 [Mon Dec 16 15:02:31 2024] FS: 0000000000000000(0000) GS:ffff939210000000(0000) knlGS:0000000000000000 [Mon Dec 16 15:02:31 2024] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [Mon Dec 16 15:02:31 2024] CR2: 000055b7bb71a708 CR3: 0000000171428003 CR4: 00000000007706f0 [Mon Dec 16 15:02:31 2024] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [Mon Dec 16 15:02:31 2024] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [Mon Dec 16 15:02:31 2024] PKRU: 55555554 [Mon Dec 16 15:02:31 2024] Call Trace: [Mon Dec 16 15:02:31 2024] [Mon Dec 16 15:02:31 2024] ? nmi_cpu_backtrace+0x99/0x110 [Mon Dec 16 15:02:31 2024] ? nmi_cpu_backtrace_handler+0x11/0x20 [Mon Dec 16 15:02:31 2024] ? nmi_handle+0x65/0x170 [Mon Dec 16 15:02:31 2024] ? default_do_nmi+0x40/0x100 [Mon Dec 16 15:02:31 2024] ? exc_nmi+0x125/0x1a0 [Mon Dec 16 15:02:31 2024] ? end_repeat_nmi+0xf/0x60 [Mon Dec 16 15:02:31 2024] ? native_write_msr+0xa/0x30 [Mon Dec 16 15:02:31 2024] ? native_write_msr+0xa/0x30 [Mon Dec 16 15:02:31 2024] ? native_write_msr+0xa/0x30 [Mon Dec 16 15:02:31 2024] [Mon Dec 16 15:02:31 2024] [Mon Dec 16 15:02:31 2024] lapic_next_deadline+0x2c/0x40 [Mon Dec 16 15:02:31 2024] clockevents_program_event+0x9f/0x110 [Mon Dec 16 15:02:31 2024] hrtimer_try_to_cancel.part.0+0x9b/0xf0 [Mon Dec 16 15:02:31 2024] hrtimer_cancel+0x21/0x40 [Mon Dec 16 15:02:31 2024] tick_nohz_restart_sched_tick+0x35/0xb0 [Mon Dec 16 15:02:31 2024] tick_nohz_idle_exit+0x89/0xf0 [Mon Dec 16 15:02:31 2024] do_idle+0x15f/0x270 [Mon Dec 16 15:02:31 2024] cpu_startup_entry+0x2a/0x30 [Mon Dec 16 15:02:31 2024] rest_init+0xde/0x110 [Mon Dec 16 15:02:31 2024] ? acpi_enable_subsystem+0x47/0xb0 [Mon Dec 16 15:02:31 2024] arch_call_rest_init+0xe/0x30 [Mon Dec 16 15:02:31 2024] start_kernel+0x716/0xaa0 [Mon Dec 16 15:02:31 2024] x86_64_start_reservations+0x18/0x30 [Mon Dec 16 15:02:31 2024] x86_64_start_kernel+0xbc/0x110 [Mon Dec 16 15:02:31 2024] secondary_startup_64_no_verify+0x184/0x18b [Mon Dec 16 15:02:31 2024] [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 67 [Mon Dec 16 15:02:31 2024] CPU: 67 PID: 2355419 Comm: bash Tainted: G OE 6.8.9-200.fc39.x86_64 #1 [Mon Dec 16 15:02:31 2024] Hardware name: Intel Corporation S2600WFQ/S2600WFQ, BIOS SE5C620.86B.02.01.0008.031920191559 03/19/2019 [Mon Dec 16 15:02:31 2024] RIP: 0033:0x556b7c1d7659 [Mon Dec 16 15:02:31 2024] Code: 48 8d 53 01 4c 39 e3 0f 83 04 ff ff ff 8b 05 c6 94 11 00 48 89 d3 e9 66 ff ff ff 66 0f 1f 44 00 00 80 3a ff 0f 84 c7 fe ff ff <4c> 01 f7 80 3f 00 79 4f 48 89 de 4c 29 f6 e8 04 35 09 00 83 f8 ff [Mon Dec 16 15:02:31 2024] RSP: 002b:00007ffc169c0590 EFLAGS: 00000217 [Mon Dec 16 15:02:31 2024] RAX: 0000000000000001 RBX: 0000000000000008 RCX: 0000000000000000 [Mon Dec 16 15:02:31 2024] RDX: 0000556b7dbd07b7 RSI: 0000000000000000 RDI: 0000556b7dbd07b0 [Mon Dec 16 15:02:31 2024] RBP: 00007ffc169c05d0 R08: 0000000000000008 R09: 00007ffc169c08c0 [Mon Dec 16 15:02:31 2024] R10: 0000000000000008 R11: 0000000000000000 R12: 0000000000000022 [Mon Dec 16 15:02:31 2024] R13: 0000000000000007 R14: 0000000000000007 R15: 00000000ffffffff [Mon Dec 16 15:02:31 2024] FS: 00007fcad6f3d740 GS: 0000000000000000 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 1 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 35 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 41 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 55 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 58 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 22 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 36 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 71 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 12 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 7 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 62 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 38 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 27 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 63 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 48 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 33 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 68 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 16 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 59 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 11 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 19 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.033 msecs [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 13 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 43 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 3 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.037 msecs [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 21 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 57 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.091 msecs [Mon Dec 16 15:02:31 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.104 msecs [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 5 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 52 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 60 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 42 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 29 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.176 msecs [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 40 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 31 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.207 msecs [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 34 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.224 msecs [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 50 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 69 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.245 msecs [Mon Dec 16 15:02:31 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.254 msecs [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 49 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 28 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.285 msecs [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 64 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 6 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 32 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 51 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 20 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 56 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 46 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 65 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 45 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 70 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 15 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 9 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 8 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 44 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 14 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 10 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] NMI backtrace for cpu 47 skipped: idling at intel_idle_ibrs+0xa1/0x140 [Mon Dec 16 15:02:31 2024] sysrq: Show Memory [Mon Dec 16 15:02:32 2024] Mem-Info: [Mon Dec 16 15:02:32 2024] active_anon:1931517 inactive_anon:0 isolated_anon:0 active_file:98208 inactive_file:922773 isolated_file:0 unevictable:768 dirty:0 writeback:0 slab_reclaimable:51031 slab_unreclaimable:116236 mapped:40004 shmem:1814115 pagetables:1949 sec_pagetables:0 bounce:0 kernel_misc_reclaimable:0 free:19735845 free_pcp:75237 free_cma:0 [Mon Dec 16 15:02:32 2024] Node 0 active_anon:2805276kB inactive_anon:0kB active_file:169624kB inactive_file:187956kB unevictable:3072kB isolated(anon):0kB isolated(file):0kB mapped:66768kB dirty:0kB writeback:0kB shmem:2430168kB shmem_thp:0kB shmem_pmdmapped:0kB anon_thp:0kB writeback_tmp:0kB kernel_stack:9688kB pagetables:4448kB sec_pagetables:0kB all_unreclaimable? no [Mon Dec 16 15:02:32 2024] Node 1 active_anon:4920792kB inactive_anon:0kB active_file:223208kB inactive_file:3503136kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:93248kB dirty:0kB writeback:0kB shmem:4826292kB shmem_thp:0kB shmem_pmdmapped:0kB anon_thp:0kB writeback_tmp:0kB kernel_stack:6328kB pagetables:3348kB sec_pagetables:0kB all_unreclaimable? no [Mon Dec 16 15:02:32 2024] Node 0 DMA free:11264kB boost:0kB min:12kB low:24kB high:36kB reserved_highatomic:0KB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15360kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB [Mon Dec 16 15:02:32 2024] lowmem_reserve[]: 0 1663 46915 46915 46915 [Mon Dec 16 15:02:32 2024] Node 0 DMA32 free:1699240kB boost:0kB min:1664kB low:3364kB high:5064kB reserved_highatomic:0KB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:1768872kB managed:1703336kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB [Mon Dec 16 15:02:32 2024] lowmem_reserve[]: 0 0 45251 45251 45251 [Mon Dec 16 15:02:32 2024] Node 0 Normal free:42351852kB boost:0kB min:45284kB low:91620kB high:137956kB reserved_highatomic:0KB active_anon:2805088kB inactive_anon:0kB active_file:169624kB inactive_file:187956kB unevictable:3072kB writepending:0kB present:47173632kB managed:46346152kB mlocked:0kB bounce:0kB free_pcp:137528kB local_pcp:1076kB free_cma:0kB [Mon Dec 16 15:02:32 2024] lowmem_reserve[]: 0 0 0 0 0 [Mon Dec 16 15:02:32 2024] Node 1 Normal free:34883736kB boost:0kB min:43144kB low:87292kB high:131440kB reserved_highatomic:0KB active_anon:4922796kB inactive_anon:0kB active_file:223208kB inactive_file:3503136kB unevictable:0kB writepending:0kB present:45088768kB managed:44220576kB mlocked:0kB bounce:0kB free_pcp:159296kB local_pcp:1628kB free_cma:0kB [Mon Dec 16 15:02:32 2024] lowmem_reserve[]: 0 0 0 0 0 [Mon Dec 16 15:02:32 2024] Node 0 DMA: 0*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 2*4096kB (M) = 11264kB [Mon Dec 16 15:02:32 2024] Node 0 DMA32: 12*4kB (UM) 11*8kB (UM) 12*16kB (UM) 11*32kB (UM) 14*64kB (UM) 13*128kB (UM) 9*256kB (UM) 6*512kB (UM) 7*1024kB (UM) 10*2048kB (M) 406*4096kB (M) = 1699240kB [Mon Dec 16 15:02:32 2024] Node 0 Normal: 34729*4kB (UME) 33954*8kB (UM) 21794*16kB (UME) 14956*32kB (UME) 8409*64kB (UME) 2790*128kB (UME) 803*256kB (UME) 313*512kB (UME) 123*1024kB (UME) 49*2048kB (UM) 9675*4096kB (UM) = 42354068kB [Mon Dec 16 15:02:32 2024] Node 1 Normal: 47876*4kB (UM) 40568*8kB (UME) 23101*16kB (UME) 11326*32kB (UME) 3848*64kB (UME) 1109*128kB (UME) 565*256kB (UME) 391*512kB (UME) 252*1024kB (UME) 85*2048kB (UME) 7928*4096kB (UM) = 34886368kB [Mon Dec 16 15:02:32 2024] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB [Mon Dec 16 15:02:32 2024] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB [Mon Dec 16 15:02:32 2024] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB [Mon Dec 16 15:02:32 2024] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB [Mon Dec 16 15:02:32 2024] 2835096 total pagecache pages [Mon Dec 16 15:02:32 2024] 0 pages in swap cache [Mon Dec 16 15:02:32 2024] Free swap = 8388604kB [Mon Dec 16 15:02:32 2024] Total swap = 8388604kB [Mon Dec 16 15:02:32 2024] 23511813 pages RAM [Mon Dec 16 15:02:32 2024] 0 pages HighMem/MovableOnly [Mon Dec 16 15:02:32 2024] 440457 pages reserved [Mon Dec 16 15:02:32 2024] 0 pages cma reserved [Mon Dec 16 15:02:32 2024] 0 pages hwpoisoned [Mon Dec 16 15:02:32 2024] sysrq: Show Blocked State [Mon Dec 16 15:02:32 2024] task:ipmitool state:D stack:0 pid:2355594 tgid:2355594 ppid:2335570 flags:0x00000002 [Mon Dec 16 15:02:32 2024] Call Trace: [Mon Dec 16 15:02:32 2024] [Mon Dec 16 15:02:32 2024] __schedule+0x413/0x1720 [Mon Dec 16 15:02:32 2024] ? __schedule+0x41b/0x1720 [Mon Dec 16 15:02:32 2024] schedule+0x32/0xd0 [Mon Dec 16 15:02:32 2024] schedule_timeout+0x151/0x160 [Mon Dec 16 15:02:32 2024] wait_for_completion+0x8a/0x160 [Mon Dec 16 15:02:32 2024] __wait_rcu_gp+0x15b/0x170 [Mon Dec 16 15:02:32 2024] synchronize_rcu+0x133/0x150 [Mon Dec 16 15:02:32 2024] ? __pfx_call_rcu_hurry+0x10/0x10 [Mon Dec 16 15:02:32 2024] ? __pfx_wakeme_after_rcu+0x10/0x10 [Mon Dec 16 15:02:32 2024] _ipmi_destroy_user+0x2aa/0x320 [ipmi_msghandler] [Mon Dec 16 15:02:32 2024] ipmi_destroy_user+0x12/0x60 [ipmi_msghandler] [Mon Dec 16 15:02:32 2024] ipmi_release+0x1f/0x60 [ipmi_devintf] [Mon Dec 16 15:02:32 2024] __fput+0x97/0x2c0 [Mon Dec 16 15:02:32 2024] __x64_sys_close+0x3d/0x80 [Mon Dec 16 15:02:32 2024] do_syscall_64+0x83/0x170 [Mon Dec 16 15:02:32 2024] ? __count_memcg_events+0x69/0x100 [Mon Dec 16 15:02:32 2024] ? count_memcg_events.constprop.0+0x1a/0x30 [Mon Dec 16 15:02:32 2024] ? handle_mm_fault+0xa2/0x360 [Mon Dec 16 15:02:32 2024] ? do_user_addr_fault+0x304/0x690 [Mon Dec 16 15:02:32 2024] ? exc_page_fault+0x7f/0x180 [Mon Dec 16 15:02:32 2024] entry_SYSCALL_64_after_hwframe+0x78/0x80 [Mon Dec 16 15:02:32 2024] RIP: 0033:0x7fb282c78804 [Mon Dec 16 15:02:32 2024] RSP: 002b:00007ffe32200158 EFLAGS: 00000202 ORIG_RAX: 0000000000000003 [Mon Dec 16 15:02:32 2024] RAX: ffffffffffffffda RBX: 000055f5aeb3b9e0 RCX: 00007fb282c78804 [Mon Dec 16 15:02:32 2024] RDX: 0000000000000003 RSI: 000055f5af04f8f0 RDI: 0000000000000003 [Mon Dec 16 15:02:32 2024] RBP: 00007ffe32200170 R08: 000055f0f05e08df R09: 0000000000000007 [Mon Dec 16 15:02:32 2024] R10: 000055f5af04f900 R11: 0000000000000202 R12: 0000000000000000 [Mon Dec 16 15:02:32 2024] R13: 0000000000000000 R14: 000055f5aeb3b9e0 R15: 0000000000000007 [Mon Dec 16 15:02:32 2024]