[Sun Dec 15 04:42:01 2024] perf: interrupt took too long (3140 > 3137), lowering kernel.perf_event_max_sample_rate to 63000
[Sun Dec 15 04:42:47 2024] sysrq: HELP : loglevel(0-9) reboot(b) crash(c) terminate-all-tasks(e) memory-full-oom-kill(f) kill-all-tasks(i) thaw-filesystems(j) sak(k) show-backtrace-all-active-cpus(l) show-memory-usage(m) nice-all-RT-tasks(n) poweroff(o) show-registers(p) show-all-timers(q) unraw(r) sync(s) show-task-states(t) unmount(u) force-fb(v) show-blocked-tasks(w) dump-ftrace-buffer(z)
[Sun Dec 15 04:43:38 2024] spdk: /var/jenkins/workspace/vmd-phy-autotest/spdk/scripts/setup.sh reset (start)
[Sun Dec 15 04:43:41 2024] spdk: /var/jenkins/workspace/vmd-phy-autotest/spdk/scripts/setup.sh reset (done)
[Sun Dec 15 04:43:46 2024] spdk: /var/jenkins/workspace/vmd-phy-autotest/spdk/scripts/setup.sh status (start)
[Sun Dec 15 04:43:49 2024] spdk: /var/jenkins/workspace/vmd-phy-autotest/spdk/scripts/setup.sh status (done)
[Sun Dec 15 04:43:49 2024] spdk: /var/jenkins/workspace/vmd-phy-autotest/spdk/scripts/setup.sh (start)
[Sun Dec 15 04:43:52 2024] ioatdma 0000:00:04.7: Removing dma and dca services
[Sun Dec 15 04:43:52 2024] ioatdma 0000:00:04.6: Removing dma and dca services
[Sun Dec 15 04:43:52 2024] ttyS ttyS0: 1 input overrun(s)
[Sun Dec 15 04:43:52 2024] ioatdma 0000:00:04.5: Removing dma and dca services
[Sun Dec 15 04:43:52 2024] ioatdma 0000:00:04.4: Removing dma and dca services
[Sun Dec 15 04:43:52 2024] ioatdma 0000:00:04.3: Removing dma and dca services
[Sun Dec 15 04:43:52 2024] ioatdma 0000:00:04.2: Removing dma and dca services
[Sun Dec 15 04:43:52 2024] ioatdma 0000:00:04.1: Removing dma and dca services
[Sun Dec 15 04:43:52 2024] ioatdma 0000:00:04.0: Removing dma and dca services
[Sun Dec 15 04:43:52 2024] ioatdma 0000:80:04.7: Removing dma and dca services
[Sun Dec 15 04:43:52 2024] ioatdma 0000:80:04.6: Removing dma and dca services
[Sun Dec 15 04:43:52 2024] ioatdma 0000:80:04.5: Removing dma and dca services
[Sun Dec 15 04:43:52 2024] ioatdma 0000:80:04.4: Removing dma and dca services
[Sun Dec 15 04:43:52 2024] ioatdma 0000:80:04.3: Removing dma and dca services
[Sun Dec 15 04:43:52 2024] ioatdma 0000:80:04.2: Removing dma and dca services
[Sun Dec 15 04:43:52 2024] ioatdma 0000:80:04.1: Removing dma and dca services
[Sun Dec 15 04:43:53 2024] ioatdma 0000:80:04.0: Removing dma and dca services
[Sun Dec 15 04:43:55 2024] spdk: /var/jenkins/workspace/vmd-phy-autotest/spdk/scripts/setup.sh (done)
[Sun Dec 15 04:43:55 2024] ttyS ttyS0: 12 input overrun(s)
[Sun Dec 15 04:43:56 2024] spdk: /var/jenkins/workspace/vmd-phy-autotest/spdk/scripts/setup.sh reset (start)
[Sun Dec 15 04:43:56 2024] ttyS ttyS0: 2 input overrun(s)
[Sun Dec 15 04:43:59 2024] nvme nvme0: pci function 0000:5e:00.0
[Sun Dec 15 04:43:59 2024] nvme nvme0: 72/0/0 default/read/poll queues
[Sun Dec 15 04:44:01 2024] spdk: /var/jenkins/workspace/vmd-phy-autotest/spdk/scripts/setup.sh reset (done)
[Sun Dec 15 04:44:01 2024] ttyS ttyS0: 2 input overrun(s)
[Sun Dec 15 04:44:01 2024] spdk: /var/jenkins/workspace/vmd-phy-autotest/spdk/scripts/setup.sh (start)
[Sun Dec 15 04:44:04 2024] ioatdma 0000:00:04.7: Removing dma and dca services
[Sun Dec 15 04:44:04 2024] ioatdma 0000:00:04.6: Removing dma and dca services
[Sun Dec 15 04:44:04 2024] ttyS ttyS0: 2 input overrun(s)
[Sun Dec 15 04:44:04 2024] ioatdma 0000:00:04.5: Removing dma and dca services
[Sun Dec 15 04:44:04 2024] ioatdma 0000:00:04.4: Removing dma and dca services
[Sun Dec 15 04:44:04 2024] ioatdma 0000:00:04.3: Removing dma and dca services
[Sun Dec 15 04:44:04 2024] ioatdma 0000:00:04.2: Removing dma and dca services
[Sun Dec 15 04:44:04 2024] ioatdma 0000:00:04.1: Removing dma and dca services
[Sun Dec 15 04:44:04 2024] ioatdma 0000:00:04.0: Removing dma and dca services
[Sun Dec 15 04:44:04 2024] ioatdma 0000:80:04.7: Removing dma and dca services
[Sun Dec 15 04:44:04 2024] ioatdma 0000:80:04.6: Removing dma and dca services
[Sun Dec 15 04:44:04 2024] ioatdma 0000:80:04.5: Removing dma and dca services
[Sun Dec 15 04:44:04 2024] ioatdma 0000:80:04.4: Removing dma and dca services
[Sun Dec 15 04:44:04 2024] ioatdma 0000:80:04.3: Removing dma and dca services
[Sun Dec 15 04:44:04 2024] ioatdma 0000:80:04.2: Removing dma and dca services
[Sun Dec 15 04:44:04 2024] ioatdma 0000:80:04.1: Removing dma and dca services
[Sun Dec 15 04:44:04 2024] ioatdma 0000:80:04.0: Removing dma and dca services
[Sun Dec 15 04:44:05 2024] sysrq: HELP : loglevel(0-9) reboot(b) crash(c) terminate-all-tasks(e) memory-full-oom-kill(f) kill-all-tasks(i) thaw-filesystems(j) sak(k) show-backtrace-all-active-cpus(l) show-memory-usage(m) nice-all-RT-tasks(n) poweroff(o) show-registers(p) show-all-timers(q) unraw(r) sync(s) show-task-states(t) unmount(u) force-fb(v) show-blocked-tasks(w) dump-ftrace-buffer(z)
[Sun Dec 15 04:44:05 2024] sysrq: HELP : loglevel(0-9) reboot(b) crash(c) terminate-all-tasks(e) memory-full-oom-kill(f) kill-all-tasks(i) thaw-filesystems(j) sak(k) show-backtrace-all-active-cpus(l) show-memory-usage(m) nice-all-RT-tasks(n) poweroff(o) show-registers(p) show-all-timers(q) unraw(r) sync(s) show-task-states(t) unmount(u) force-fb(v) show-blocked-tasks(w) dump-ftrace-buffer(z)
[Sun Dec 15 04:44:05 2024] ttyS ttyS0: 11 input overrun(s)
[Sun Dec 15 04:44:07 2024] spdk: /var/jenkins/workspace/vmd-phy-autotest/spdk/scripts/setup.sh (done)
[Sun Dec 15 04:44:22 2024] spdk: /var/jenkins/workspace/vmd-phy-autotest/spdk/scripts/setup.sh reset (start)
[Sun Dec 15 04:44:25 2024] nvme nvme0: pci function 0000:5e:00.0
[Sun Dec 15 04:44:25 2024] nvme nvme0: 72/0/0 default/read/poll queues
[Sun Dec 15 04:44:26 2024] spdk: /var/jenkins/workspace/vmd-phy-autotest/spdk/scripts/setup.sh reset (done)
[Sun Dec 15 04:44:26 2024] spdk: /var/jenkins/workspace/vmd-phy-autotest/spdk/scripts/setup.sh cleanup (start)
[Sun Dec 15 04:44:30 2024] spdk: /var/jenkins/workspace/vmd-phy-autotest/spdk/scripts/setup.sh cleanup (done)
[Sun Dec 15 04:44:30 2024] ######## Autotest Cleanup Dump ########
[Sun Dec 15 04:44:30 2024] sysrq: Show backtrace of all active CPUs
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 48
[Sun Dec 15 04:44:30 2024] CPU: 48 PID: 981332 Comm: bash Tainted: G OE 6.8.9-200.fc39.x86_64 #1
[Sun Dec 15 04:44:30 2024] Hardware name: Intel Corporation S2600WFQ/S2600WFQ, BIOS SE5C620.86B.02.01.0008.031920191559 03/19/2019
[Sun Dec 15 04:44:30 2024] Call Trace:
[Sun Dec 15 04:44:30 2024]
[Sun Dec 15 04:44:30 2024] dump_stack_lvl+0x64/0x80
[Sun Dec 15 04:44:30 2024] nmi_cpu_backtrace+0xd6/0x110
[Sun Dec 15 04:44:30 2024] ? __pfx_nmi_raise_cpu_backtrace+0x10/0x10
[Sun Dec 15 04:44:30 2024] nmi_trigger_cpumask_backtrace+0xf3/0x140
[Sun Dec 15 04:44:30 2024] __handle_sysrq+0xe1/0x260
[Sun Dec 15 04:44:30 2024] write_sysrq_trigger+0x59/0x80
[Sun Dec 15 04:44:30 2024] proc_reg_write+0x5a/0xa0
[Sun Dec 15 04:44:30 2024] vfs_write+0xed/0x470
[Sun Dec 15 04:44:30 2024] ksys_write+0x6f/0xf0
[Sun Dec 15 04:44:30 2024] do_syscall_64+0x83/0x170
[Sun Dec 15 04:44:30 2024] ? filp_flush+0x52/0x70
[Sun Dec 15 04:44:30 2024] ? syscall_exit_to_user_mode+0x83/0x230
[Sun Dec 15 04:44:30 2024] ? do_syscall_64+0x90/0x170
[Sun Dec 15 04:44:30 2024] ? terminate_walk+0xee/0x100
[Sun Dec 15 04:44:30 2024] ? get_close_on_exec+0x36/0x40
[Sun Dec 15 04:44:30 2024] ? get_close_on_exec+0x36/0x40
[Sun Dec 15 04:44:30 2024] ? do_fcntl+0x89/0x6a0
[Sun Dec 15 04:44:30 2024] ? __x64_sys_fcntl+0x94/0xc0
[Sun Dec 15 04:44:30 2024] ? syscall_exit_to_user_mode+0x83/0x230
[Sun Dec 15 04:44:30 2024] ? do_syscall_64+0x90/0x170
[Sun Dec 15 04:44:30 2024] ? f_dupfd+0x4b/0x60
[Sun Dec 15 04:44:30 2024] ? do_fcntl+0x5ce/0x6a0
[Sun Dec 15 04:44:30 2024] ? __x64_sys_fcntl+0x94/0xc0
[Sun Dec 15 04:44:30 2024] ? syscall_exit_to_user_mode+0x83/0x230
[Sun Dec 15 04:44:30 2024] ? do_syscall_64+0x90/0x170
[Sun Dec 15 04:44:30 2024] ? do_sys_openat2+0x97/0xe0
[Sun Dec 15 04:44:30 2024] ? syscall_exit_to_user_mode+0x83/0x230
[Sun Dec 15 04:44:30 2024] ? do_syscall_64+0x90/0x170
[Sun Dec 15 04:44:30 2024] ? syscall_exit_to_user_mode+0x83/0x230
[Sun Dec 15 04:44:30 2024] ? do_syscall_64+0x90/0x170
[Sun Dec 15 04:44:30 2024] ? exc_page_fault+0x7f/0x180
[Sun Dec 15 04:44:30 2024] entry_SYSCALL_64_after_hwframe+0x78/0x80
[Sun Dec 15 04:44:30 2024] RIP: 0033:0x7f20526cfee4
[Sun Dec 15 04:44:30 2024] Code: c7 00 16 00 00 00 b8 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 f3 0f 1e fa 80 3d 85 74 0d 00 00 74 13 b8 01 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 54 c3 0f 1f 00 55 48 89 e5 48 83 ec 20 48 89
[Sun Dec 15 04:44:30 2024] RSP: 002b:00007ffe612cb468 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[Sun Dec 15 04:44:30 2024] RAX: ffffffffffffffda RBX: 0000000000000002 RCX: 00007f20526cfee4
[Sun Dec 15 04:44:30 2024] RDX: 0000000000000002 RSI: 0000564262483990 RDI: 0000000000000001
[Sun Dec 15 04:44:30 2024] RBP: 00007ffe612cb490 R08: 0000000000000073 R09: 0000000000000001
[Sun Dec 15 04:44:30 2024] R10: 0000000000000000 R11: 0000000000000202 R12: 0000000000000002
[Sun Dec 15 04:44:30 2024] R13: 0000564262483990 R14: 00007f20527a05c0 R15: 00007f205279df20
[Sun Dec 15 04:44:30 2024]
[Sun Dec 15 04:44:30 2024] Sending NMI from CPU 48 to CPUs 0-47,49-71:
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 39 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 20 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 43 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 70 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 9 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 60 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 42 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 57 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 27 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 3 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 29 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 2 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 62 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 12 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 54 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 47 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 34 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 52 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 56 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 0 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 31 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 38 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 45 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 33 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 69 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 37 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 24 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 36 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 32 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 1 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 35 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 6 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 25 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 11 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 63 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 7 skipped: idling at intel_idle_irq+0x6f/0xe0
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 26 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 8 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 22 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 13 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 61 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 53 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 64 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 18 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 14 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 68 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 49 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 28 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 41 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 5 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 65 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 4 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 40 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 67
[Sun Dec 15 04:44:30 2024] CPU: 67 PID: 2450 Comm: telegraf Tainted: G OE 6.8.9-200.fc39.x86_64 #1
[Sun Dec 15 04:44:30 2024] Hardware name: Intel Corporation S2600WFQ/S2600WFQ, BIOS SE5C620.86B.02.01.0008.031920191559 03/19/2019
[Sun Dec 15 04:44:30 2024] RIP: 0033:0x4482fd
[Sun Dec 15 04:44:30 2024] Code: f8 ff ff ff 48 8b 48 30 48 83 b9 d0 00 00 00 00 0f 85 ff 00 00 00 48 8b 54 24 38 48 8b 5a 38 48 85 db 75 2a 83 7a 04 00 75 34 <90> 48 89 d3 48 89 91 d0 00 00 00 48 8b 40 30 48 89 43 38 c7 43 04
[Sun Dec 15 04:44:30 2024] RSP: 002b:000000c000cec778 EFLAGS: 00000246
[Sun Dec 15 04:44:30 2024] RAX: 000000c0016acd80 RBX: 0000000000000000 RCX: 000000c00011ec00
[Sun Dec 15 04:44:30 2024] RDX: 000000c000060800 RSI: 000000c00170ec70 RDI: ffffffffffffff9c
[Sun Dec 15 04:44:30 2024] RBP: 000000c000cec7a0 R08: 0000000000000000 R09: 0000000000000000
[Sun Dec 15 04:44:30 2024] R10: 0000000000000000 R11: 0000000000000206 R12: 00000000000000c8
[Sun Dec 15 04:44:30 2024] R13: 00000000000000c7 R14: 0000000000000200 R15: ffffffffffffffff
[Sun Dec 15 04:44:30 2024] FS: 00007fb5d2a006c0 GS: 0000000000000000
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 50 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 44 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 23 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 19 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 15 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 51 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 58 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 21 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 46 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 59 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 16 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 55 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 71 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.010 msecs
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 10 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.021 msecs
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 66
[Sun Dec 15 04:44:30 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.037 msecs
[Sun Dec 15 04:44:30 2024] CPU: 66 PID: 2695 Comm: telegraf Tainted: G OE 6.8.9-200.fc39.x86_64 #1
[Sun Dec 15 04:44:30 2024] Hardware name: Intel Corporation S2600WFQ/S2600WFQ, BIOS SE5C620.86B.02.01.0008.031920191559 03/19/2019
[Sun Dec 15 04:44:30 2024] RIP: 0010:do_syscall_64+0xa6/0x170
[Sun Dec 15 04:44:30 2024] Code: 21 de e8 dd 59 ed fe 49 89 44 24 50 4c 89 e7 e8 b0 6f 00 00 eb 14 cc cc cc 48 8d 65 e8 31 c0 5b 41 5c 41 5d 5d c3 cc cc cc cc <49> 8b 84 24 80 00 00 00 49 39 44 24 58 75 e0 49 8b 94 24 90 00 00
[Sun Dec 15 04:44:30 2024] RSP: 0018:ffffb5634db2bc50 EFLAGS: 00000046
[Sun Dec 15 04:44:30 2024] RAX: 0000000000000000 RBX: ffffffffffffffff RCX: 0000000000000001
[Sun Dec 15 04:44:30 2024] RDX: 0000000000000000 RSI: ffffffffb346f200 RDI: ffffb5634db2bf58
[Sun Dec 15 04:44:30 2024] RBP: ffffb5634db2bf48 R08: 0000000000000000 R09: ffff8c35ea67e588
[Sun Dec 15 04:44:30 2024] R10: 0000000000000000 R11: 0000000000000000 R12: ffffb5634db2bf58
[Sun Dec 15 04:44:30 2024] R13: 00000000000000d9 R14: 0000000000000000 R15: 0000000000000000
[Sun Dec 15 04:44:30 2024] FS: 00007fb5ba0006c0(0000) GS:ffff8c4cfc300000(0000) knlGS:0000000000000000
[Sun Dec 15 04:44:30 2024] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[Sun Dec 15 04:44:30 2024] CR2: 00007fc281bdb884 CR3: 0000000124c86002 CR4: 00000000007706f0
[Sun Dec 15 04:44:30 2024] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[Sun Dec 15 04:44:30 2024] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[Sun Dec 15 04:44:30 2024] PKRU: 55555554
[Sun Dec 15 04:44:30 2024] Call Trace:
[Sun Dec 15 04:44:30 2024]
[Sun Dec 15 04:44:30 2024] ? nmi_cpu_backtrace+0x99/0x110
[Sun Dec 15 04:44:30 2024] ? nmi_cpu_backtrace_handler+0x11/0x20
[Sun Dec 15 04:44:30 2024] ? nmi_handle+0x65/0x170
[Sun Dec 15 04:44:30 2024] ? default_do_nmi+0x40/0x100
[Sun Dec 15 04:44:30 2024] ? exc_nmi+0x125/0x1a0
[Sun Dec 15 04:44:30 2024] ? end_repeat_nmi+0xf/0x60
[Sun Dec 15 04:44:30 2024] ? do_syscall_64+0xa6/0x170
[Sun Dec 15 04:44:30 2024] ? do_syscall_64+0xa6/0x170
[Sun Dec 15 04:44:30 2024] ? do_syscall_64+0xa6/0x170
[Sun Dec 15 04:44:30 2024]
[Sun Dec 15 04:44:30 2024]
[Sun Dec 15 04:44:30 2024] ? atime_needs_update+0x61/0x120
[Sun Dec 15 04:44:30 2024] ? touch_atime+0x1e/0x120
[Sun Dec 15 04:44:30 2024] ? iterate_dir+0x116/0x1f0
[Sun Dec 15 04:44:30 2024] ? __x64_sys_getdents64+0x10a/0x130
[Sun Dec 15 04:44:30 2024] ? __pfx_filldir64+0x10/0x10
[Sun Dec 15 04:44:30 2024] ? syscall_exit_to_user_mode+0x83/0x230
[Sun Dec 15 04:44:30 2024] ? do_syscall_64+0x90/0x170
[Sun Dec 15 04:44:30 2024] ? do_sys_openat2+0x97/0xe0
[Sun Dec 15 04:44:30 2024] ? __fdget+0xb8/0xe0
[Sun Dec 15 04:44:30 2024] ? do_epoll_ctl+0x1ce/0x1000
[Sun Dec 15 04:44:30 2024] ? syscall_exit_to_user_mode+0x83/0x230
[Sun Dec 15 04:44:30 2024] ? do_syscall_64+0x90/0x170
[Sun Dec 15 04:44:30 2024] ? do_syscall_64+0x90/0x170
[Sun Dec 15 04:44:30 2024] ? __x64_sys_epoll_ctl+0x70/0xa0
[Sun Dec 15 04:44:30 2024] ? syscall_exit_to_user_mode+0x83/0x230
[Sun Dec 15 04:44:30 2024] ? do_syscall_64+0x90/0x170
[Sun Dec 15 04:44:30 2024] ? syscall_exit_to_user_mode+0x83/0x230
[Sun Dec 15 04:44:30 2024] ? do_syscall_64+0x90/0x170
[Sun Dec 15 04:44:30 2024] ? syscall_exit_to_user_mode+0x83/0x230
[Sun Dec 15 04:44:30 2024] ? do_syscall_64+0x90/0x170
[Sun Dec 15 04:44:30 2024] ? do_syscall_64+0x90/0x170
[Sun Dec 15 04:44:30 2024] ? __irq_exit_rcu+0x4b/0xc0
[Sun Dec 15 04:44:30 2024] entry_SYSCALL_64_after_hwframe+0x78/0x80
[Sun Dec 15 04:44:30 2024] RIP: 0033:0x48d99b
[Sun Dec 15 04:44:30 2024] Code: fe ff eb bd e8 26 5a fe ff e9 61 ff ff ff cc e8 9b 1e fe ff 48 8b 7c 24 10 48 8b 74 24 18 48 8b 54 24 20 48 8b 44 24 08 0f 05 <48> 3d 01 f0 ff ff 76 20 48 c7 44 24 28 ff ff ff ff 48 c7 44 24 30
[Sun Dec 15 04:44:30 2024] RSP: 002b:000000c00095ea18 EFLAGS: 00000212 ORIG_RAX: 00000000000000d9
[Sun Dec 15 04:44:30 2024] RAX: 0000000000000000 RBX: 000000c00005e000 RCX: 000000000048d99b
[Sun Dec 15 04:44:30 2024] RDX: 0000000000002000 RSI: 000000c00063a000 RDI: 0000000000000008
[Sun Dec 15 04:44:30 2024] RBP: 000000c00095ea68 R08: 0000000000000000 R09: 0000000000000039
[Sun Dec 15 04:44:30 2024] R10: 0000000000000000 R11: 0000000000000212 R12: 0000000000000040
[Sun Dec 15 04:44:30 2024] R13: 000000c001a05000 R14: 0000000000000710 R15: 0000000000000000
[Sun Dec 15 04:44:30 2024]
[Sun Dec 15 04:44:30 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.494 msecs
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 30 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.507 msecs
[Sun Dec 15 04:44:30 2024] NMI backtrace for cpu 17 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Sun Dec 15 04:44:30 2024] sysrq: Show Memory
[Sun Dec 15 04:44:31 2024] ttyS ttyS0: 2 input overrun(s)
[Sun Dec 15 04:44:31 2024] Mem-Info:
[Sun Dec 15 04:44:31 2024] active_anon:1919939 inactive_anon:0 isolated_anon:0
active_file:97162 inactive_file:922661 isolated_file:0
unevictable:768 dirty:0 writeback:0
slab_reclaimable:49117 slab_unreclaimable:104761
mapped:37524 shmem:1793472 pagetables:2594
sec_pagetables:0 bounce:0
kernel_misc_reclaimable:0
free:19752649 free_pcp:81248 free_cma:0
[Sun Dec 15 04:44:34 2024] Node 0 active_anon:6140228kB inactive_anon:0kB active_file:191516kB inactive_file:3589048kB unevictable:3072kB isolated(anon):0kB isolated(file):0kB mapped:85760kB dirty:0kB writeback:0kB shmem:5755452kB shmem_thp:0kB shmem_pmdmapped:0kB anon_thp:0kB writeback_tmp:0kB kernel_stack:8728kB pagetables:3752kB sec_pagetables:0kB all_unreclaimable? no
[Sun Dec 15 04:44:34 2024] Node 1 active_anon:1532816kB inactive_anon:0kB active_file:197132kB inactive_file:101596kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:64152kB dirty:0kB writeback:0kB shmem:1418464kB shmem_thp:0kB shmem_pmdmapped:0kB anon_thp:0kB writeback_tmp:0kB kernel_stack:7224kB pagetables:3288kB sec_pagetables:0kB all_unreclaimable? no
[Sun Dec 15 04:44:34 2024] Node 0 DMA free:11264kB boost:0kB min:12kB low:24kB high:36kB reserved_highatomic:0KB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15360kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
[Sun Dec 15 04:44:34 2024] lowmem_reserve[]: 0 1663 46971 46971 46971
[Sun Dec 15 04:44:34 2024] Node 0 DMA32 free:1699236kB boost:0kB min:1664kB low:3364kB high:5064kB reserved_highatomic:0KB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:1768868kB managed:1703332kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
[Sun Dec 15 04:44:34 2024] lowmem_reserve[]: 0 0 45307 45307 45307
[Sun Dec 15 04:44:34 2024] Node 0 Normal free:35667232kB boost:0kB min:45340kB low:91732kB high:138124kB reserved_highatomic:0KB active_anon:6140212kB inactive_anon:0kB active_file:191516kB inactive_file:3589048kB unevictable:3072kB writepending:0kB present:47173632kB managed:46395220kB mlocked:0kB bounce:0kB free_pcp:125408kB local_pcp:1336kB free_cma:0kB
[Sun Dec 15 04:44:34 2024] ttyS ttyS0: 1 input overrun(s)
[Sun Dec 15 04:44:34 2024] lowmem_reserve[]: 0 0 0 0 0
[Sun Dec 15 04:44:34 2024] Node 1 Normal free:41667052kB boost:0kB min:43088kB low:87176kB high:131264kB reserved_highatomic:0KB active_anon:1536848kB inactive_anon:0kB active_file:197132kB inactive_file:101596kB unevictable:0kB writepending:0kB present:45088768kB managed:44171504kB mlocked:0kB bounce:0kB free_pcp:153712kB local_pcp:1232kB free_cma:0kB
[Sun Dec 15 04:44:34 2024] lowmem_reserve[]: 0 0 0 0 0
[Sun Dec 15 04:44:34 2024] Node 0 DMA: 0*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 2*4096kB (M) = 11264kB
[Sun Dec 15 04:44:34 2024] Node 0 DMA32: 9*4kB (UM) 12*8kB (UM) 14*16kB (UM) 10*32kB (UM) 12*64kB (UM) 10*128kB (UM) 9*256kB (UM) 7*512kB (UM) 7*1024kB (UM) 12*2048kB (M) 405*4096kB (M) = 1699236kB
[Sun Dec 15 04:44:34 2024] Node 0 Normal: 38401*4kB (UM) 43468*8kB (UME) 28075*16kB (UME) 17758*32kB (UME) 6997*64kB (UME) 1797*128kB (UME) 1591*256kB (UME) 674*512kB (UM) 158*1024kB (UME) 60*2048kB (UM) 7919*4096kB (UM) = 35669908kB
[Sun Dec 15 04:44:34 2024] Node 1 Normal: 61742*4kB (UME) 42221*8kB (UME) 25670*16kB (UME) 10238*32kB (UME) 4005*64kB (UME) 1517*128kB (UME) 566*256kB (UME) 227*512kB (UME) 169*1024kB (UM) 144*2048kB (UME) 9562*4096kB (UM) = 41668608kB
[Sun Dec 15 04:44:34 2024] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
[Sun Dec 15 04:44:34 2024] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
[Sun Dec 15 04:44:34 2024] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
[Sun Dec 15 04:44:34 2024] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
[Sun Dec 15 04:44:34 2024] 2813302 total pagecache pages
[Sun Dec 15 04:44:34 2024] 0 pages in swap cache
[Sun Dec 15 04:44:34 2024] Free swap = 8388604kB
[Sun Dec 15 04:44:34 2024] Total swap = 8388604kB
[Sun Dec 15 04:44:34 2024] 23511812 pages RAM
[Sun Dec 15 04:44:34 2024] 0 pages HighMem/MovableOnly
[Sun Dec 15 04:44:35 2024] 440458 pages reserved
[Sun Dec 15 04:44:35 2024] 0 pages cma reserved
[Sun Dec 15 04:44:35 2024] 0 pages hwpoisoned
[Sun Dec 15 04:44:35 2024] sysrq: Show Blocked State
[Sun Dec 15 04:44:35 2024] task:ipmitool state:D stack:0 pid:1000251 tgid:1000251 ppid:981580 flags:0x00004002
[Sun Dec 15 04:44:35 2024] Call Trace:
[Sun Dec 15 04:44:35 2024]
[Sun Dec 15 04:44:35 2024] __schedule+0x413/0x1720
[Sun Dec 15 04:44:35 2024] ? ttwu_do_activate+0x68/0x230
[Sun Dec 15 04:44:35 2024] schedule+0x32/0xd0
[Sun Dec 15 04:44:35 2024] schedule_timeout+0x151/0x160
[Sun Dec 15 04:44:35 2024] wait_for_completion+0x8a/0x160
[Sun Dec 15 04:44:35 2024] __wait_rcu_gp+0x15b/0x170
[Sun Dec 15 04:44:35 2024] synchronize_rcu+0x133/0x150
[Sun Dec 15 04:44:35 2024] ? __pfx_call_rcu_hurry+0x10/0x10
[Sun Dec 15 04:44:35 2024] ? __pfx_wakeme_after_rcu+0x10/0x10
[Sun Dec 15 04:44:35 2024] _ipmi_destroy_user+0x2aa/0x320 [ipmi_msghandler]
[Sun Dec 15 04:44:35 2024] ipmi_destroy_user+0x12/0x60 [ipmi_msghandler]
[Sun Dec 15 04:44:35 2024] ipmi_release+0x1f/0x60 [ipmi_devintf]
[Sun Dec 15 04:44:35 2024] __fput+0x97/0x2c0
[Sun Dec 15 04:44:35 2024] __x64_sys_close+0x3d/0x80
[Sun Dec 15 04:44:35 2024] do_syscall_64+0x83/0x170
[Sun Dec 15 04:44:35 2024] ? do_fault+0x246/0x490
[Sun Dec 15 04:44:35 2024] ? __handle_mm_fault+0x827/0xe40
[Sun Dec 15 04:44:35 2024] ? __count_memcg_events+0x69/0x100
[Sun Dec 15 04:44:35 2024] ? count_memcg_events.constprop.0+0x1a/0x30
[Sun Dec 15 04:44:35 2024] ? handle_mm_fault+0xa2/0x360
[Sun Dec 15 04:44:35 2024] ? do_user_addr_fault+0x304/0x690
[Sun Dec 15 04:44:35 2024] ? exc_page_fault+0x7f/0x180
[Sun Dec 15 04:44:35 2024] entry_SYSCALL_64_after_hwframe+0x78/0x80
[Sun Dec 15 04:44:35 2024] RIP: 0033:0x7f38ffd4e804
[Sun Dec 15 04:44:35 2024] RSP: 002b:00007ffd8a8fda88 EFLAGS: 00000202 ORIG_RAX: 0000000000000003
[Sun Dec 15 04:44:35 2024] RAX: ffffffffffffffda RBX: 0000560846e079e0 RCX: 00007f38ffd4e804
[Sun Dec 15 04:44:35 2024] RDX: 0000000000000003 RSI: 00005608472d79b0 RDI: 0000000000000003
[Sun Dec 15 04:44:35 2024] RBP: 00007ffd8a8fdaa0 R08: 0000560d27a90b87 R09: 0000000000000007
[Sun Dec 15 04:44:35 2024] R10: 00005608472d79c0 R11: 0000000000000202 R12: 0000000000000000
[Sun Dec 15 04:44:35 2024] R13: 0000000000000000 R14: 0000560846e079e0 R15: 0000000000000007
[Sun Dec 15 04:44:35 2024]