[Mon Dec 9 08:12:05 2024] spdk: /var/jenkins/workspace/vmd-phy-autotest/spdk/scripts/setup.sh reset (start)
[Mon Dec 9 08:12:08 2024] pcieport 0000:d7:00.0: bridge window [io 0x1000-0x0fff] to [bus d8] add_size 1000
[Mon Dec 9 08:12:08 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space
[Mon Dec 9 08:12:08 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign
[Mon Dec 9 08:12:08 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space
[Mon Dec 9 08:12:08 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign
[Mon Dec 9 08:12:08 2024] spdk: /var/jenkins/workspace/vmd-phy-autotest/spdk/scripts/setup.sh reset (done)
[Mon Dec 9 08:12:13 2024] spdk: /var/jenkins/workspace/vmd-phy-autotest/spdk/scripts/setup.sh status (start)
[Mon Dec 9 08:12:16 2024] spdk: /var/jenkins/workspace/vmd-phy-autotest/spdk/scripts/setup.sh status (done)
[Mon Dec 9 08:12:16 2024] spdk: /var/jenkins/workspace/vmd-phy-autotest/spdk/scripts/setup.sh (start)
[Mon Dec 9 08:12:18 2024] ioatdma 0000:00:04.7: Removing dma and dca services
[Mon Dec 9 08:12:18 2024] ioatdma 0000:00:04.6: Removing dma and dca services
[Mon Dec 9 08:12:18 2024] ioatdma 0000:00:04.5: Removing dma and dca services
[Mon Dec 9 08:12:18 2024] ioatdma 0000:00:04.4: Removing dma and dca services
[Mon Dec 9 08:12:18 2024] ioatdma 0000:00:04.3: Removing dma and dca services
[Mon Dec 9 08:12:18 2024] ioatdma 0000:00:04.2: Removing dma and dca services
[Mon Dec 9 08:12:18 2024] ioatdma 0000:00:04.1: Removing dma and dca services
[Mon Dec 9 08:12:18 2024] ioatdma 0000:00:04.0: Removing dma and dca services
[Mon Dec 9 08:12:18 2024] ioatdma 0000:80:04.7: Removing dma and dca services
[Mon Dec 9 08:12:18 2024] ioatdma 0000:80:04.6: Removing dma and dca services
[Mon Dec 9 08:12:18 2024] ioatdma 0000:80:04.5: Removing dma and dca services
[Mon Dec 9 08:12:18 2024] ioatdma 0000:80:04.4: Removing dma and dca services
[Mon Dec 9 08:12:18 2024] ioatdma 0000:80:04.3: Removing dma and dca services
[Mon Dec 9 08:12:18 2024] ioatdma 0000:80:04.2: Removing dma and dca services
[Mon Dec 9 08:12:18 2024] ioatdma 0000:80:04.1: Removing dma and dca services
[Mon Dec 9 08:12:18 2024] ioatdma 0000:80:04.0: Removing dma and dca services
[Mon Dec 9 08:12:20 2024] pcieport 0000:d7:00.0: bridge window [io 0x1000-0x0fff] to [bus d8] add_size 1000
[Mon Dec 9 08:12:20 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space
[Mon Dec 9 08:12:20 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign
[Mon Dec 9 08:12:20 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space
[Mon Dec 9 08:12:20 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign
[Mon Dec 9 08:12:20 2024] spdk: /var/jenkins/workspace/vmd-phy-autotest/spdk/scripts/setup.sh (done)
[Mon Dec 9 08:12:21 2024] spdk: /var/jenkins/workspace/vmd-phy-autotest/spdk/scripts/setup.sh reset (start)
[Mon Dec 9 08:12:24 2024] nvme nvme0: pci function 0000:d9:00.0
[Mon Dec 9 08:12:24 2024] nvme nvme0: 112/0/0 default/read/poll queues
[Mon Dec 9 08:12:24 2024] nvme nvme0: Ignoring bogus Namespace Identifiers
[Mon Dec 9 08:12:25 2024] pcieport 0000:d7:00.0: bridge window [io 0x1000-0x0fff] to [bus d8] add_size 1000
[Mon Dec 9 08:12:25 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space
[Mon Dec 9 08:12:25 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign
[Mon Dec 9 08:12:25 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space
[Mon Dec 9 08:12:25 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign
[Mon Dec 9 08:12:25 2024] spdk: /var/jenkins/workspace/vmd-phy-autotest/spdk/scripts/setup.sh reset (done)
[Mon Dec 9 08:12:25 2024] spdk: /var/jenkins/workspace/vmd-phy-autotest/spdk/scripts/setup.sh (start)
[Mon Dec 9 08:12:27 2024] ioatdma 0000:00:04.7: Removing dma and dca services
[Mon Dec 9 08:12:27 2024] ioatdma 0000:00:04.6: Removing dma and dca services
[Mon Dec 9 08:12:27 2024] ioatdma 0000:00:04.5: Removing dma and dca services
[Mon Dec 9 08:12:27 2024] ioatdma 0000:00:04.4: Removing dma and dca services
[Mon Dec 9 08:12:27 2024] ioatdma 0000:00:04.3: Removing dma and dca services
[Mon Dec 9 08:12:27 2024] ioatdma 0000:00:04.2: Removing dma and dca services
[Mon Dec 9 08:12:28 2024] ioatdma 0000:00:04.1: Removing dma and dca services
[Mon Dec 9 08:12:28 2024] ioatdma 0000:00:04.0: Removing dma and dca services
[Mon Dec 9 08:12:28 2024] ioatdma 0000:80:04.7: Removing dma and dca services
[Mon Dec 9 08:12:28 2024] ioatdma 0000:80:04.6: Removing dma and dca services
[Mon Dec 9 08:12:28 2024] ioatdma 0000:80:04.5: Removing dma and dca services
[Mon Dec 9 08:12:28 2024] ioatdma 0000:80:04.4: Removing dma and dca services
[Mon Dec 9 08:12:28 2024] ioatdma 0000:80:04.3: Removing dma and dca services
[Mon Dec 9 08:12:28 2024] ioatdma 0000:80:04.2: Removing dma and dca services
[Mon Dec 9 08:12:28 2024] ioatdma 0000:80:04.1: Removing dma and dca services
[Mon Dec 9 08:12:28 2024] ioatdma 0000:80:04.0: Removing dma and dca services
[Mon Dec 9 08:12:29 2024] pcieport 0000:d7:00.0: bridge window [io 0x1000-0x0fff] to [bus d8] add_size 1000
[Mon Dec 9 08:12:29 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space
[Mon Dec 9 08:12:29 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign
[Mon Dec 9 08:12:29 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space
[Mon Dec 9 08:12:29 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign
[Mon Dec 9 08:12:29 2024] spdk: /var/jenkins/workspace/vmd-phy-autotest/spdk/scripts/setup.sh (done)
[Mon Dec 9 08:12:45 2024] spdk: /var/jenkins/workspace/vmd-phy-autotest/spdk/scripts/setup.sh reset (start)
[Mon Dec 9 08:12:48 2024] nvme nvme0: pci function 0000:d9:00.0
[Mon Dec 9 08:12:48 2024] nvme nvme0: 112/0/0 default/read/poll queues
[Mon Dec 9 08:12:48 2024] nvme nvme0: Ignoring bogus Namespace Identifiers
[Mon Dec 9 08:12:48 2024] pcieport 0000:d7:00.0: bridge window [io 0x1000-0x0fff] to [bus d8] add_size 1000
[Mon Dec 9 08:12:48 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space
[Mon Dec 9 08:12:48 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign
[Mon Dec 9 08:12:48 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space
[Mon Dec 9 08:12:48 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign
[Mon Dec 9 08:12:48 2024] spdk: /var/jenkins/workspace/vmd-phy-autotest/spdk/scripts/setup.sh reset (done)
[Mon Dec 9 08:12:48 2024] spdk: /var/jenkins/workspace/vmd-phy-autotest/spdk/scripts/setup.sh cleanup (start)
[Mon Dec 9 08:12:51 2024] spdk: /var/jenkins/workspace/vmd-phy-autotest/spdk/scripts/setup.sh cleanup (done)
[Mon Dec 9 08:12:51 2024] ######## Autotest Cleanup Dump ########
[Mon Dec 9 08:12:51 2024] sysrq: Show backtrace of all active CPUs
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 0
[Mon Dec 9 08:12:51 2024] CPU: 0 PID: 3474826 Comm: bash Tainted: G OE 6.8.9-200.fc39.x86_64 #1
[Mon Dec 9 08:12:51 2024] Hardware name: Intel Corporation S2600WFT/S2600WFT, BIOS SE5C620.86B.02.01.0017.110620230543 11/06/2023
[Mon Dec 9 08:12:51 2024] Call Trace:
[Mon Dec 9 08:12:51 2024]
[Mon Dec 9 08:12:51 2024] dump_stack_lvl+0x64/0x80
[Mon Dec 9 08:12:51 2024] nmi_cpu_backtrace+0xd6/0x110
[Mon Dec 9 08:12:51 2024] ? __pfx_nmi_raise_cpu_backtrace+0x10/0x10
[Mon Dec 9 08:12:51 2024] nmi_trigger_cpumask_backtrace+0xf3/0x140
[Mon Dec 9 08:12:51 2024] __handle_sysrq+0xe1/0x260
[Mon Dec 9 08:12:51 2024] write_sysrq_trigger+0x59/0x80
[Mon Dec 9 08:12:51 2024] proc_reg_write+0x5a/0xa0
[Mon Dec 9 08:12:51 2024] vfs_write+0xed/0x470
[Mon Dec 9 08:12:51 2024] ksys_write+0x6f/0xf0
[Mon Dec 9 08:12:51 2024] do_syscall_64+0x83/0x170
[Mon Dec 9 08:12:51 2024] ? filp_flush+0x52/0x70
[Mon Dec 9 08:12:51 2024] ? syscall_exit_to_user_mode+0x83/0x230
[Mon Dec 9 08:12:51 2024] ? do_syscall_64+0x90/0x170
[Mon Dec 9 08:12:51 2024] ? filp_flush+0x52/0x70
[Mon Dec 9 08:12:51 2024] ? filp_close+0x1d/0x30
[Mon Dec 9 08:12:51 2024] ? do_dup2+0x88/0xd0
[Mon Dec 9 08:12:51 2024] ? syscall_exit_to_user_mode+0x83/0x230
[Mon Dec 9 08:12:51 2024] ? do_syscall_64+0x90/0x170
[Mon Dec 9 08:12:51 2024] ? count_memcg_events.constprop.0+0x1a/0x30
[Mon Dec 9 08:12:51 2024] ? handle_mm_fault+0xa2/0x360
[Mon Dec 9 08:12:51 2024] ? do_user_addr_fault+0x304/0x690
[Mon Dec 9 08:12:51 2024] ? clear_bhb_loop+0x55/0xb0
[Mon Dec 9 08:12:51 2024] ? clear_bhb_loop+0x55/0xb0
[Mon Dec 9 08:12:51 2024] ? clear_bhb_loop+0x55/0xb0
[Mon Dec 9 08:12:51 2024] entry_SYSCALL_64_after_hwframe+0x78/0x80
[Mon Dec 9 08:12:51 2024] RIP: 0033:0x7fc7dd53cee4
[Mon Dec 9 08:12:51 2024] Code: c7 00 16 00 00 00 b8 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 f3 0f 1e fa 80 3d 85 74 0d 00 00 74 13 b8 01 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 54 c3 0f 1f 00 55 48 89 e5 48 83 ec 20 48 89
[Mon Dec 9 08:12:51 2024] RSP: 002b:00007ffe7b069e68 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[Mon Dec 9 08:12:51 2024] RAX: ffffffffffffffda RBX: 0000000000000002 RCX: 00007fc7dd53cee4
[Mon Dec 9 08:12:51 2024] RDX: 0000000000000002 RSI: 0000555a11376930 RDI: 0000000000000001
[Mon Dec 9 08:12:51 2024] RBP: 00007ffe7b069e90 R08: 0000000000000073 R09: 0000000000000001
[Mon Dec 9 08:12:51 2024] R10: 0000000000000000 R11: 0000000000000202 R12: 0000000000000002
[Mon Dec 9 08:12:51 2024] R13: 0000555a11376930 R14: 00007fc7dd60d5c0 R15: 00007fc7dd60af20
[Mon Dec 9 08:12:51 2024]
[Mon Dec 9 08:12:51 2024] Sending NMI from CPU 0 to CPUs 1-111:
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 2 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 58 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 96 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 1 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 57 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 103 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 47 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 63 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 38 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 37 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 80 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 48 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 102 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 71 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 81 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 60 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 51 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 7 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 24 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 65 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 40
[Mon Dec 9 08:12:51 2024] CPU: 40 PID: 3474937 Comm: bash Tainted: G OE 6.8.9-200.fc39.x86_64 #1
[Mon Dec 9 08:12:51 2024] Hardware name: Intel Corporation S2600WFT/S2600WFT, BIOS SE5C620.86B.02.01.0017.110620230543 11/06/2023
[Mon Dec 9 08:12:51 2024] RIP: 0033:0x7fab1676ea62
[Mon Dec 9 08:12:51 2024] Code: bc c9 f3 a4 c3 0f 1f 00 f3 0f 1e fa 89 f8 62 a1 fd 00 ef c0 25 ff 0f 00 00 3d e0 0f 00 00 0f 87 24 01 00 00 62 f1 7d 20 74 07 fb 93 c0 85 c0 74 16 0f bc c0 c3 66 90 0f bc c0 29 cf 8d 84 07
[Mon Dec 9 08:12:51 2024] RSP: 002b:00007ffd337896a8 EFLAGS: 00000283
[Mon Dec 9 08:12:51 2024] RAX: 00000000000002f0 RBX: 00005616c8ed72f0 RCX: 0000000000000038
[Mon Dec 9 08:12:51 2024] RDX: 0000000000000000 RSI: 00005616c8a28270 RDI: 00005616c8ed72f0
[Mon Dec 9 08:12:51 2024] RBP: 00007ffd33789700 R08: 00005616c8180010 R09: 0000000000000007
[Mon Dec 9 08:12:51 2024] R10: 00005616c8a28280 R11: 04705b7f966b560c R12: 0000000000000031
[Mon Dec 9 08:12:51 2024] R13: 00005616c8f14270 R14: 0000100904000001 R15: 0000000000000000
[Mon Dec 9 08:12:51 2024] FS: 00007fab165fa740 GS: 0000000000000000
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 16 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 94 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 56 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 101 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 72 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 42 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 86 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 25 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 35 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 4 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 33 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 50 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 59 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 74 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 108 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 15 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 9 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 105 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 69 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 19 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 91 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 3 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 45 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 66 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 89 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 98 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 73 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 17 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 41 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 70 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 54 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 10 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 44 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 85 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 64 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 90 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 76 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 52 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 6 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 49 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 93 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 28 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.001 msecs
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 31 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.017 msecs
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 5 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.047 msecs
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 87 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.048 msecs
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 61 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.075 msecs
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 20 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 62 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.098 msecs
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 107 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 26 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 39 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.130 msecs
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 79 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 99 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.164 msecs
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 67 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.245 msecs
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 109 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 75 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 13 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 32 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 68 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.319 msecs
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 100 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 8 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 36 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 23 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 29 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 77 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 43 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 11 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 18 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 97 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 106 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 22 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 104 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 34 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 12 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 92 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 83 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 27 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 88 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 30 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 21 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 53 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 46 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 78 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 82 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 95 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 14 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 55 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 111 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 110 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] NMI backtrace for cpu 84 skipped: idling at intel_idle+0x71/0xe0
[Mon Dec 9 08:12:51 2024] sysrq: Show Memory
[Mon Dec 9 08:12:52 2024] Mem-Info:
[Mon Dec 9 08:12:52 2024] active_anon:1960259 inactive_anon:0 isolated_anon:0
active_file:99297 inactive_file:924845 isolated_file:0
unevictable:768 dirty:0 writeback:0
slab_reclaimable:60824 slab_unreclaimable:157043
mapped:41079 shmem:1821003 pagetables:3722
sec_pagetables:0 bounce:0
kernel_misc_reclaimable:0
free:44320537 free_pcp:120370 free_cma:0
[Mon Dec 9 08:12:52 2024] Node 0 active_anon:3011564kB inactive_anon:0kB active_file:137916kB inactive_file:54196kB unevictable:3072kB isolated(anon):0kB isolated(file):0kB mapped:50996kB dirty:0kB writeback:0kB shmem:2698368kB shmem_thp:0kB shmem_pmdmapped:0kB anon_thp:0kB writeback_tmp:0kB kernel_stack:11064kB pagetables:3360kB sec_pagetables:0kB all_unreclaimable? no
[Mon Dec 9 08:12:52 2024] Node 1 active_anon:4829472kB inactive_anon:0kB active_file:259272kB inactive_file:3645184kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:113324kB dirty:0kB writeback:0kB shmem:4585644kB shmem_thp:0kB shmem_pmdmapped:0kB anon_thp:0kB writeback_tmp:0kB kernel_stack:12536kB pagetables:11528kB sec_pagetables:0kB all_unreclaimable? no
[Mon Dec 9 08:12:52 2024] Node 0 DMA free:11264kB boost:0kB min:4kB low:16kB high:28kB reserved_highatomic:0KB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15360kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
[Mon Dec 9 08:12:52 2024] lowmem_reserve[]: 0 1666 95352 95352 95352
[Mon Dec 9 08:12:52 2024] Node 0 DMA32 free:1702868kB boost:0kB min:804kB low:2508kB high:4212kB reserved_highatomic:0KB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:1772500kB managed:1706964kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
[Mon Dec 9 08:12:52 2024] lowmem_reserve[]: 0 0 93685 93685 93685
[Mon Dec 9 08:12:52 2024] Node 0 Normal free:91665484kB boost:0kB min:45192kB low:141124kB high:237056kB reserved_highatomic:0KB active_anon:3011692kB inactive_anon:0kB active_file:137916kB inactive_file:54196kB unevictable:3072kB writepending:0kB present:97505280kB managed:95933600kB mlocked:0kB bounce:0kB free_pcp:195236kB local_pcp:6056kB free_cma:0kB
[Mon Dec 9 08:12:52 2024] lowmem_reserve[]: 0 0 0 0 0
[Mon Dec 9 08:12:52 2024] Node 1 Normal free:83905168kB boost:0kB min:44104kB low:137732kB high:231360kB reserved_highatomic:0KB active_anon:4829472kB inactive_anon:0kB active_file:259272kB inactive_file:3645184kB unevictable:0kB writepending:0kB present:95420416kB managed:93709236kB mlocked:0kB bounce:0kB free_pcp:283568kB local_pcp:3632kB free_cma:0kB
[Mon Dec 9 08:12:52 2024] lowmem_reserve[]: 0 0 0 0 0
[Mon Dec 9 08:12:52 2024] Node 0 DMA: 0*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 2*4096kB (M) = 11264kB
[Mon Dec 9 08:12:52 2024] Node 0 DMA32: 7*4kB (UM) 13*8kB (UM) 9*16kB (UM) 10*32kB (UM) 8*64kB (UM) 11*128kB (UM) 6*256kB (UM) 10*512kB (UM) 8*1024kB (UM) 5*2048kB (M) 409*4096kB (M) = 1702868kB
[Mon Dec 9 08:12:52 2024] Node 0 Normal: 60989*4kB (UM) 52768*8kB (UME) 26748*16kB (UME) 14372*32kB (UME) 9056*64kB (UME) 3889*128kB (UME) 1372*256kB (UME) 336*512kB (UME) 107*1024kB (UME) 46*2048kB (UM) 21560*4096kB (UM) = 91668148kB
[Mon Dec 9 08:12:53 2024] Node 1 Normal: 53689*4kB (UM) 61101*8kB (UME) 43702*16kB (UME) 22909*32kB (UME) 11224*64kB (UME) 4766*128kB (UME) 1487*256kB (UME) 594*512kB (UME) 262*1024kB (UM) 155*2048kB (UME) 19330*4096kB (UM) = 83910476kB
[Mon Dec 9 08:12:53 2024] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
[Mon Dec 9 08:12:53 2024] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
[Mon Dec 9 08:12:53 2024] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
[Mon Dec 9 08:12:53 2024] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
[Mon Dec 9 08:12:53 2024] 2845145 total pagecache pages
[Mon Dec 9 08:12:53 2024] 0 pages in swap cache
[Mon Dec 9 08:12:53 2024] Free swap = 8388604kB
[Mon Dec 9 08:12:53 2024] Total swap = 8388604kB
[Mon Dec 9 08:12:53 2024] 48678544 pages RAM
[Mon Dec 9 08:12:53 2024] 0 pages HighMem/MovableOnly
[Mon Dec 9 08:12:53 2024] 837254 pages reserved
[Mon Dec 9 08:12:53 2024] 0 pages cma reserved
[Mon Dec 9 08:12:53 2024] 0 pages hwpoisoned
[Mon Dec 9 08:12:53 2024] sysrq: Show Blocked State
[Mon Dec 9 08:12:53 2024] task:ipmitool state:D stack:0 pid:3499033 tgid:3499033 ppid:3474975 flags:0x00004002
[Mon Dec 9 08:12:53 2024] Call Trace:
[Mon Dec 9 08:12:53 2024]
[Mon Dec 9 08:12:53 2024] __schedule+0x413/0x1720
[Mon Dec 9 08:12:53 2024] ? ttwu_do_activate+0x68/0x230
[Mon Dec 9 08:12:53 2024] schedule+0x32/0xd0
[Mon Dec 9 08:12:53 2024] schedule_timeout+0x151/0x160
[Mon Dec 9 08:12:53 2024] wait_for_completion+0x8a/0x160
[Mon Dec 9 08:12:53 2024] __wait_rcu_gp+0x15b/0x170
[Mon Dec 9 08:12:53 2024] synchronize_rcu+0x133/0x150
[Mon Dec 9 08:12:53 2024] ? __pfx_call_rcu_hurry+0x10/0x10
[Mon Dec 9 08:12:53 2024] ? __pfx_wakeme_after_rcu+0x10/0x10
[Mon Dec 9 08:12:53 2024] _ipmi_destroy_user+0x2aa/0x320 [ipmi_msghandler]
[Mon Dec 9 08:12:53 2024] ipmi_destroy_user+0x12/0x60 [ipmi_msghandler]
[Mon Dec 9 08:12:53 2024] ipmi_release+0x1f/0x60 [ipmi_devintf]
[Mon Dec 9 08:12:53 2024] __fput+0x97/0x2c0
[Mon Dec 9 08:12:53 2024] __x64_sys_close+0x3d/0x80
[Mon Dec 9 08:12:53 2024] do_syscall_64+0x83/0x170
[Mon Dec 9 08:12:53 2024] ? __count_memcg_events+0x69/0x100
[Mon Dec 9 08:12:53 2024] ? count_memcg_events.constprop.0+0x1a/0x30
[Mon Dec 9 08:12:53 2024] ? handle_mm_fault+0xa2/0x360
[Mon Dec 9 08:12:53 2024] ? do_user_addr_fault+0x304/0x690
[Mon Dec 9 08:12:53 2024] ? clear_bhb_loop+0x55/0xb0
[Mon Dec 9 08:12:53 2024] ? clear_bhb_loop+0x55/0xb0
[Mon Dec 9 08:12:53 2024] ? clear_bhb_loop+0x55/0xb0
[Mon Dec 9 08:12:53 2024] entry_SYSCALL_64_after_hwframe+0x78/0x80
[Mon Dec 9 08:12:53 2024] RIP: 0033:0x7f38c15b7804
[Mon Dec 9 08:12:53 2024] RSP: 002b:00007ffe2ae2c778 EFLAGS: 00000202 ORIG_RAX: 0000000000000003
[Mon Dec 9 08:12:53 2024] RAX: ffffffffffffffda RBX: 000055cc7270c9e0 RCX: 00007f38c15b7804
[Mon Dec 9 08:12:53 2024] RDX: 0000000000000003 RSI: 000055cc74785d10 RDI: 0000000000000003
[Mon Dec 9 08:12:53 2024] RBP: 00007ffe2ae2c790 R08: 000055c928bf1b35 R09: 0000000000000007
[Mon Dec 9 08:12:53 2024] R10: 000055cc74785d20 R11: 0000000000000202 R12: 0000000000000000
[Mon Dec 9 08:12:53 2024] R13: 0000000000000000 R14: 000055cc7270c9e0 R15: 0000000000000007
[Mon Dec 9 08:12:53 2024]