[Mon Oct 28 18:15:53 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh reset (start)
[Mon Oct 28 18:15:56 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh reset (done)
[Mon Oct 28 18:16:02 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh status (start)
[Mon Oct 28 18:16:05 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh status (done)
[Mon Oct 28 18:16:05 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh  (start)
[Mon Oct 28 18:16:08 2024] ioatdma 0000:00:04.7: Removing dma and dca services
[Mon Oct 28 18:16:08 2024] ioatdma 0000:00:04.6: Removing dma and dca services
[Mon Oct 28 18:16:08 2024] ioatdma 0000:00:04.5: Removing dma and dca services
[Mon Oct 28 18:16:08 2024] ioatdma 0000:00:04.4: Removing dma and dca services
[Mon Oct 28 18:16:08 2024] ioatdma 0000:00:04.3: Removing dma and dca services
[Mon Oct 28 18:16:08 2024] ioatdma 0000:00:04.2: Removing dma and dca services
[Mon Oct 28 18:16:08 2024] ioatdma 0000:00:04.1: Removing dma and dca services
[Mon Oct 28 18:16:08 2024] ioatdma 0000:00:04.0: Removing dma and dca services
[Mon Oct 28 18:16:08 2024] ioatdma 0000:80:04.7: Removing dma and dca services
[Mon Oct 28 18:16:08 2024] ioatdma 0000:80:04.6: Removing dma and dca services
[Mon Oct 28 18:16:08 2024] ioatdma 0000:80:04.5: Removing dma and dca services
[Mon Oct 28 18:16:08 2024] ioatdma 0000:80:04.4: Removing dma and dca services
[Mon Oct 28 18:16:08 2024] ioatdma 0000:80:04.3: Removing dma and dca services
[Mon Oct 28 18:16:08 2024] ioatdma 0000:80:04.2: Removing dma and dca services
[Mon Oct 28 18:16:08 2024] ioatdma 0000:80:04.1: Removing dma and dca services
[Mon Oct 28 18:16:08 2024] ioatdma 0000:80:04.0: Removing dma and dca services
[Mon Oct 28 18:16:13 2024] nvme nvme0: Device not ready; aborting shutdown, CSTS=0x5
[Mon Oct 28 18:16:13 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh  (done)
[Mon Oct 28 18:16:14 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh reset (start)
[Mon Oct 28 18:16:18 2024] nvme nvme0: pci function 0000:5e:00.0
[Mon Oct 28 18:16:18 2024] nvme nvme0: 72/0/0 default/read/poll queues
[Mon Oct 28 18:16:18 2024] nvme nvme0: Ignoring bogus Namespace Identifiers
[Mon Oct 28 18:16:19 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh reset (done)
[Mon Oct 28 18:16:19 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh  (start)
[Mon Oct 28 18:16:22 2024] ioatdma 0000:00:04.7: Removing dma and dca services
[Mon Oct 28 18:16:22 2024] ioatdma 0000:00:04.6: Removing dma and dca services
[Mon Oct 28 18:16:22 2024] ioatdma 0000:00:04.5: Removing dma and dca services
[Mon Oct 28 18:16:22 2024] ioatdma 0000:00:04.4: Removing dma and dca services
[Mon Oct 28 18:16:22 2024] ioatdma 0000:00:04.3: Removing dma and dca services
[Mon Oct 28 18:16:22 2024] ioatdma 0000:00:04.2: Removing dma and dca services
[Mon Oct 28 18:16:22 2024] ioatdma 0000:00:04.1: Removing dma and dca services
[Mon Oct 28 18:16:22 2024] ioatdma 0000:00:04.0: Removing dma and dca services
[Mon Oct 28 18:16:22 2024] ioatdma 0000:80:04.7: Removing dma and dca services
[Mon Oct 28 18:16:22 2024] ioatdma 0000:80:04.6: Removing dma and dca services
[Mon Oct 28 18:16:22 2024] ioatdma 0000:80:04.5: Removing dma and dca services
[Mon Oct 28 18:16:22 2024] ioatdma 0000:80:04.4: Removing dma and dca services
[Mon Oct 28 18:16:22 2024] ioatdma 0000:80:04.3: Removing dma and dca services
[Mon Oct 28 18:16:22 2024] ioatdma 0000:80:04.2: Removing dma and dca services
[Mon Oct 28 18:16:22 2024] ioatdma 0000:80:04.1: Removing dma and dca services
[Mon Oct 28 18:16:22 2024] ioatdma 0000:80:04.0: Removing dma and dca services
[Mon Oct 28 18:16:27 2024] nvme nvme0: Device not ready; aborting shutdown, CSTS=0x5
[Mon Oct 28 18:16:27 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh  (done)
[Mon Oct 28 18:17:13 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh reset (start)
[Mon Oct 28 18:17:17 2024] nvme nvme0: pci function 0000:5e:00.0
[Mon Oct 28 18:17:17 2024] nvme nvme0: 72/0/0 default/read/poll queues
[Mon Oct 28 18:17:17 2024] nvme nvme0: Ignoring bogus Namespace Identifiers
[Mon Oct 28 18:17:18 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh reset (done)
[Mon Oct 28 18:17:18 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh cleanup (start)
[Mon Oct 28 18:17:21 2024] spdk: /var/jenkins/workspace/BlobFS-phy-autotest/spdk/scripts/setup.sh cleanup (done)
[Mon Oct 28 18:17:21 2024] ######## Autotest Cleanup Dump ########
[Mon Oct 28 18:17:21 2024] sysrq: Show backtrace of all active CPUs
[Mon Oct 28 18:17:21 2024] NMI backtrace for cpu 32
[Mon Oct 28 18:17:21 2024] CPU: 32 PID: 1491802 Comm: bash Tainted: G           OE      6.8.9-200.fc39.x86_64 #1
[Mon Oct 28 18:17:21 2024] Hardware name: Intel Corporation S2600WFQ/S2600WFQ, BIOS SE5C620.86B.02.01.0008.031920191559 03/19/2019
[Mon Oct 28 18:17:21 2024] Call Trace:
[Mon Oct 28 18:17:21 2024]  <TASK>
[Mon Oct 28 18:17:21 2024]  dump_stack_lvl+0x64/0x80
[Mon Oct 28 18:17:21 2024]  nmi_cpu_backtrace+0xd6/0x110
[Mon Oct 28 18:17:21 2024]  ? __pfx_nmi_raise_cpu_backtrace+0x10/0x10
[Mon Oct 28 18:17:21 2024]  nmi_trigger_cpumask_backtrace+0xf3/0x140
[Mon Oct 28 18:17:21 2024]  __handle_sysrq+0xe1/0x260
[Mon Oct 28 18:17:21 2024]  write_sysrq_trigger+0x59/0x80
[Mon Oct 28 18:17:21 2024]  proc_reg_write+0x5a/0xa0
[Mon Oct 28 18:17:21 2024]  vfs_write+0xed/0x470
[Mon Oct 28 18:17:21 2024]  ? do_fcntl+0x3b4/0x6a0
[Mon Oct 28 18:17:21 2024]  ksys_write+0x6f/0xf0
[Mon Oct 28 18:17:21 2024]  do_syscall_64+0x83/0x170
[Mon Oct 28 18:17:21 2024]  ? do_syscall_64+0x90/0x170
[Mon Oct 28 18:17:21 2024]  ? syscall_exit_to_user_mode+0x83/0x230
[Mon Oct 28 18:17:21 2024]  ? do_syscall_64+0x90/0x170
[Mon Oct 28 18:17:21 2024]  ? filp_flush+0x52/0x70
[Mon Oct 28 18:17:21 2024]  ? __slab_free+0xdf/0x310
[Mon Oct 28 18:17:21 2024]  ? get_close_on_exec+0x36/0x40
[Mon Oct 28 18:17:21 2024]  ? do_fcntl+0x89/0x6a0
[Mon Oct 28 18:17:21 2024]  ? wp_page_reuse+0x8e/0xa0
[Mon Oct 28 18:17:21 2024]  ? filp_flush+0x52/0x70
[Mon Oct 28 18:17:21 2024]  ? syscall_exit_to_user_mode+0x83/0x230
[Mon Oct 28 18:17:21 2024]  ? do_syscall_64+0x90/0x170
[Mon Oct 28 18:17:21 2024]  ? syscall_exit_to_user_mode+0x83/0x230
[Mon Oct 28 18:17:21 2024]  ? do_syscall_64+0x90/0x170
[Mon Oct 28 18:17:21 2024]  ? do_user_addr_fault+0x304/0x690
[Mon Oct 28 18:17:21 2024]  ? exc_page_fault+0x7f/0x180
[Mon Oct 28 18:17:21 2024]  entry_SYSCALL_64_after_hwframe+0x78/0x80
[Mon Oct 28 18:17:21 2024] RIP: 0033:0x7f5ad0455ee4
[Mon Oct 28 18:17:22 2024] Code: c7 00 16 00 00 00 b8 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 f3 0f 1e fa 80 3d 85 74 0d 00 00 74 13 b8 01 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 54 c3 0f 1f 00 55 48 89 e5 48 83 ec 20 48 89
[Mon Oct 28 18:17:22 2024] RSP: 002b:00007ffc14d430a8 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[Mon Oct 28 18:17:22 2024] RAX: ffffffffffffffda RBX: 0000000000000002 RCX: 00007f5ad0455ee4
[Mon Oct 28 18:17:22 2024] RDX: 0000000000000002 RSI: 000055fa8b180b10 RDI: 0000000000000001
[Mon Oct 28 18:17:22 2024] RBP: 00007ffc14d430d0 R08: 0000000000000073 R09: 0000000000000001
[Mon Oct 28 18:17:22 2024] R10: 0000000000000000 R11: 0000000000000202 R12: 0000000000000002
[Mon Oct 28 18:17:22 2024] R13: 000055fa8b180b10 R14: 00007f5ad05265c0 R15: 00007f5ad0523f20
[Mon Oct 28 18:17:22 2024]  </TASK>
[Mon Oct 28 18:17:22 2024] Sending NMI from CPU 32 to CPUs 0-31,33-71:
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 68 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 26 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 43 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 27 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 5 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 41 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 28 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 44 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 53 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 33 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 3 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 64 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 6 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 61 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 9 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 45 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 31 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 10 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 63 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 2 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 42 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 66 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 11 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 16 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 7 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 15
[Mon Oct 28 18:17:22 2024] CPU: 15 PID: 1514632 Comm: bash Tainted: G           OE      6.8.9-200.fc39.x86_64 #1
[Mon Oct 28 18:17:22 2024] Hardware name: Intel Corporation S2600WFQ/S2600WFQ, BIOS SE5C620.86B.02.01.0008.031920191559 03/19/2019
[Mon Oct 28 18:17:22 2024] RIP: 0010:kvfree_call_rcu+0xd3/0x3d0
[Mon Oct 28 18:17:22 2024] Code: 41 20 48 3d fb 01 00 00 74 7c 48 8d 50 01 48 89 51 20 48 89 6c c1 28 f0 83 44 24 fc 00 48 8b 05 5b ca 37 02 f0 83 44 24 fc 00 <48> 83 c0 07 48 83 e0 fc 48 89 41 10 48 8b 05 f2 e1 3c 02 f0 83 44
[Mon Oct 28 18:17:22 2024] RSP: 0018:ffffa4f22c65fb28 EFLAGS: 00000086
[Mon Oct 28 18:17:22 2024] RAX: 0000000000655155 RBX: ffff8fc96e8fccc0 RCX: ffff8fc6d3ef2000
[Mon Oct 28 18:17:22 2024] RDX: 000000000000002b RSI: 0000000000000000 RDI: ffff8fc96e8fccc0
[Mon Oct 28 18:17:22 2024] RBP: ffff8fc96e8fccc0 R08: ffff8fd21c404d20 R09: ffff8fd253d5d388
[Mon Oct 28 18:17:22 2024] R10: ffff8fd1d07a2018 R11: 0000000000000000 R12: ffff8fd1d07a2130
[Mon Oct 28 18:17:22 2024] R13: 0000000000000286 R14: ffff8fd1d07a2000 R15: 0000000000000000
[Mon Oct 28 18:17:22 2024] FS:  00007ff1c1341740(0000) GS:ffff8fd1d0780000(0000) knlGS:0000000000000000
[Mon Oct 28 18:17:22 2024] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[Mon Oct 28 18:17:22 2024] CR2: 0000555bdb771c70 CR3: 0000000c712d8005 CR4: 00000000007706f0
[Mon Oct 28 18:17:22 2024] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[Mon Oct 28 18:17:22 2024] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[Mon Oct 28 18:17:22 2024] PKRU: 55555554
[Mon Oct 28 18:17:22 2024] Call Trace:
[Mon Oct 28 18:17:22 2024]  <NMI>
[Mon Oct 28 18:17:22 2024]  ? nmi_cpu_backtrace+0x99/0x110
[Mon Oct 28 18:17:22 2024]  ? nmi_cpu_backtrace_handler+0x11/0x20
[Mon Oct 28 18:17:22 2024]  ? nmi_handle+0x65/0x170
[Mon Oct 28 18:17:22 2024]  ? default_do_nmi+0x40/0x100
[Mon Oct 28 18:17:22 2024]  ? exc_nmi+0x125/0x1a0
[Mon Oct 28 18:17:22 2024]  ? end_repeat_nmi+0xf/0x60
[Mon Oct 28 18:17:22 2024]  ? kvfree_call_rcu+0xd3/0x3d0
[Mon Oct 28 18:17:22 2024]  ? kvfree_call_rcu+0xd3/0x3d0
[Mon Oct 28 18:17:22 2024]  ? kvfree_call_rcu+0xd3/0x3d0
[Mon Oct 28 18:17:22 2024]  </NMI>
[Mon Oct 28 18:17:22 2024]  <TASK>
[Mon Oct 28 18:17:22 2024]  kernfs_unlink_open_file+0xef/0x110
[Mon Oct 28 18:17:22 2024]  kernfs_fop_release+0x3d/0xd0
[Mon Oct 28 18:17:22 2024]  __fput+0x97/0x2c0
[Mon Oct 28 18:17:22 2024]  __x64_sys_close+0x3d/0x80
[Mon Oct 28 18:17:22 2024]  do_syscall_64+0x83/0x170
[Mon Oct 28 18:17:22 2024]  ? ksys_read+0x6f/0xf0
[Mon Oct 28 18:17:22 2024]  ? syscall_exit_to_user_mode+0x83/0x230
[Mon Oct 28 18:17:22 2024]  ? do_syscall_64+0x90/0x170
[Mon Oct 28 18:17:22 2024]  ? sprintf+0x62/0x80
[Mon Oct 28 18:17:22 2024]  ? _copy_to_iter+0x8b/0x620
[Mon Oct 28 18:17:22 2024]  ? __pfx___rdmsr_on_cpu+0x10/0x10
[Mon Oct 28 18:17:22 2024]  ? show_temp+0xa9/0x120 [coretemp]
[Mon Oct 28 18:17:22 2024]  ? seq_read_iter+0x208/0x480
[Mon Oct 28 18:17:22 2024]  ? __rseq_handle_notify_resume+0xa9/0x520
[Mon Oct 28 18:17:22 2024]  ? syscall_exit_to_user_mode+0x83/0x230
[Mon Oct 28 18:17:22 2024]  ? do_syscall_64+0x90/0x170
[Mon Oct 28 18:17:22 2024]  ? syscall_exit_to_user_mode+0x83/0x230
[Mon Oct 28 18:17:22 2024]  ? do_syscall_64+0x90/0x170
[Mon Oct 28 18:17:22 2024]  ? exc_page_fault+0x7f/0x180
[Mon Oct 28 18:17:22 2024]  entry_SYSCALL_64_after_hwframe+0x78/0x80
[Mon Oct 28 18:17:22 2024] RIP: 0033:0x7ff1c1447804
[Mon Oct 28 18:17:22 2024] Code: 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 90 f3 0f 1e fa 80 3d 65 cb 0d 00 00 74 13 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3c c3 0f 1f 00 55 48 89 e5 48 83 ec 10 89 7d
[Mon Oct 28 18:17:22 2024] RSP: 002b:00007ffdb4c2ae68 EFLAGS: 00000202 ORIG_RAX: 0000000000000003
[Mon Oct 28 18:17:22 2024] RAX: ffffffffffffffda RBX: 0000555bdb76b600 RCX: 00007ff1c1447804
[Mon Oct 28 18:17:22 2024] RDX: 0000000000000004 RSI: 00007ffdb4c29e20 RDI: 0000000000000003
[Mon Oct 28 18:17:22 2024] RBP: 00007ffdb4c2aff0 R08: 0000555bdb76b600 R09: 00007ffdb4c29e26
[Mon Oct 28 18:17:22 2024] R10: 0000000000000005 R11: 0000000000000202 R12: 0000000000000000
[Mon Oct 28 18:17:22 2024] R13: 0000555bdb76d130 R14: 0000000000000003 R15: 0000555bdb76c961
[Mon Oct 28 18:17:22 2024]  </TASK>
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 23 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 4 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 60 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 24 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 29 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 48 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.007 msecs
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 19 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 25 skipped: idling at intel_idle+0x71/0xe0
[Mon Oct 28 18:17:22 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.044 msecs
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 39 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.050 msecs
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 34 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 62 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.087 msecs
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 46 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.093 msecs
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 67 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 51 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.128 msecs
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 70 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 49 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.152 msecs
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 54 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 18
[Mon Oct 28 18:17:22 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.177 msecs
[Mon Oct 28 18:17:22 2024] CPU: 18 PID: 0 Comm: swapper/18 Tainted: G           OE      6.8.9-200.fc39.x86_64 #1
[Mon Oct 28 18:17:22 2024] Hardware name: Intel Corporation S2600WFQ/S2600WFQ, BIOS SE5C620.86B.02.01.0008.031920191559 03/19/2019
[Mon Oct 28 18:17:22 2024] RIP: 0010:update_blocked_averages+0x6f/0x830
[Mon Oct 28 18:17:22 2024] Code: 24 30 49 8b 86 d8 0a 00 00 48 3d d0 cb 47 bd 74 12 48 85 c0 74 0d 80 3d 2b f8 63 02 00 0f 84 5f 07 00 00 48 8b 05 b1 30 28 02 <4c> 89 f7 49 89 46 18 e8 25 f7 fe ff 41 83 be 48 0a 00 00 01 0f 86
[Mon Oct 28 18:17:22 2024] RSP: 0018:ffffa4f20480fcf8 EFLAGS: 00000046
[Mon Oct 28 18:17:22 2024] RAX: 000000010fffa6e9 RBX: 0000000000000012 RCX: 0000000000000000
[Mon Oct 28 18:17:22 2024] RDX: 0000000000000001 RSI: 0000000000000000 RDI: ffff8fddfb434780
[Mon Oct 28 18:17:22 2024] RBP: 0000000000000012 R08: ffff8fddfb421730 R09: 7fffffffffffffff
[Mon Oct 28 18:17:22 2024] R10: 0000f464a8ce4f80 R11: 000000000000b23f R12: 0000000000000012
[Mon Oct 28 18:17:22 2024] R13: 0000000000034780 R14: ffff8fddfb434780 R15: ffffa4f20480fe68
[Mon Oct 28 18:17:22 2024] FS:  0000000000000000(0000) GS:ffff8fddfb400000(0000) knlGS:0000000000000000
[Mon Oct 28 18:17:22 2024] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[Mon Oct 28 18:17:22 2024] CR2: 00007ff1c1547884 CR3: 00000001a7428005 CR4: 00000000007706f0
[Mon Oct 28 18:17:22 2024] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[Mon Oct 28 18:17:22 2024] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[Mon Oct 28 18:17:22 2024] PKRU: 55555554
[Mon Oct 28 18:17:22 2024] Call Trace:
[Mon Oct 28 18:17:22 2024]  <NMI>
[Mon Oct 28 18:17:22 2024]  ? nmi_cpu_backtrace+0x99/0x110
[Mon Oct 28 18:17:22 2024]  ? nmi_cpu_backtrace_handler+0x11/0x20
[Mon Oct 28 18:17:22 2024]  ? nmi_handle+0x65/0x170
[Mon Oct 28 18:17:22 2024]  ? default_do_nmi+0x40/0x100
[Mon Oct 28 18:17:22 2024]  ? exc_nmi+0x125/0x1a0
[Mon Oct 28 18:17:22 2024]  ? end_repeat_nmi+0xf/0x60
[Mon Oct 28 18:17:22 2024]  ? update_blocked_averages+0x6f/0x830
[Mon Oct 28 18:17:22 2024]  ? update_blocked_averages+0x6f/0x830
[Mon Oct 28 18:17:22 2024]  ? update_blocked_averages+0x6f/0x830
[Mon Oct 28 18:17:22 2024]  </NMI>
[Mon Oct 28 18:17:22 2024]  <TASK>
[Mon Oct 28 18:17:22 2024]  newidle_balance+0x125/0x480
[Mon Oct 28 18:17:22 2024]  pick_next_task_fair+0x45/0x5c0
[Mon Oct 28 18:17:22 2024]  __schedule+0x194/0x1720
[Mon Oct 28 18:17:22 2024]  ? __pfx_nohz_csd_func+0x10/0x10
[Mon Oct 28 18:17:22 2024]  schedule_idle+0x2a/0x40
[Mon Oct 28 18:17:22 2024]  do_idle+0x16e/0x270
[Mon Oct 28 18:17:22 2024]  cpu_startup_entry+0x2a/0x30
[Mon Oct 28 18:17:22 2024]  start_secondary+0x12d/0x160
[Mon Oct 28 18:17:22 2024]  secondary_startup_64_no_verify+0x184/0x18b
[Mon Oct 28 18:17:22 2024]  </TASK>
[Mon Oct 28 18:17:22 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.448 msecs
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 17 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.455 msecs
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 22 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 37 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 52 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 58 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 12 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 40 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 13 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 1 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 59 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 50 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 65 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 8 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 20 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 38 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 35 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 14 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 30 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 0 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 57 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 71 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 47 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 69 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 36 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 55 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 56 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] NMI backtrace for cpu 21 skipped: idling at intel_idle_ibrs+0xa1/0x140
[Mon Oct 28 18:17:22 2024] sysrq: Show Memory
[Mon Oct 28 18:17:23 2024] Mem-Info:
[Mon Oct 28 18:17:23 2024] active_anon:1617705 inactive_anon:0 isolated_anon:0
                            active_file:108578 inactive_file:928793 isolated_file:0
                            unevictable:768 dirty:0 writeback:0
                            slab_reclaimable:46404 slab_unreclaimable:100234
                            mapped:37601 shmem:1462702 pagetables:1820
                            sec_pagetables:0 bounce:0
                            kernel_misc_reclaimable:0
                            free:20056267 free_pcp:69695 free_cma:0
[Mon Oct 28 18:17:23 2024] Node 0 active_anon:5917932kB inactive_anon:0kB active_file:256472kB inactive_file:3640868kB unevictable:3072kB isolated(anon):0kB isolated(file):0kB mapped:85880kB dirty:0kB writeback:0kB shmem:5361384kB shmem_thp:0kB shmem_pmdmapped:0kB anon_thp:0kB writeback_tmp:0kB kernel_stack:10504kB pagetables:6120kB sec_pagetables:0kB all_unreclaimable? no
[Mon Oct 28 18:17:23 2024] Node 1 active_anon:553392kB inactive_anon:0kB active_file:177840kB inactive_file:74304kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:64524kB dirty:0kB writeback:0kB shmem:489424kB shmem_thp:0kB shmem_pmdmapped:0kB anon_thp:0kB writeback_tmp:0kB kernel_stack:6136kB pagetables:2168kB sec_pagetables:0kB all_unreclaimable? no
[Mon Oct 28 18:17:23 2024] Node 0 DMA free:11264kB boost:0kB min:12kB low:24kB high:36kB reserved_highatomic:0KB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15360kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
[Mon Oct 28 18:17:23 2024] lowmem_reserve[]: 0 1663 46915 46915 46915
[Mon Oct 28 18:17:23 2024] Node 0 DMA32 free:1699244kB boost:0kB min:1664kB low:3364kB high:5064kB reserved_highatomic:0KB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:1768876kB managed:1703340kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
[Mon Oct 28 18:17:23 2024] lowmem_reserve[]: 0 0 45251 45251 45251
[Mon Oct 28 18:17:23 2024] Node 0 Normal free:35725680kB boost:0kB min:45284kB low:91620kB high:137956kB reserved_highatomic:0KB active_anon:5919948kB inactive_anon:0kB active_file:256472kB inactive_file:3640868kB unevictable:3072kB writepending:0kB present:47173632kB managed:46346152kB mlocked:0kB bounce:0kB free_pcp:150476kB local_pcp:92kB free_cma:0kB
[Mon Oct 28 18:17:23 2024] lowmem_reserve[]: 0 0 0 0 0
[Mon Oct 28 18:17:23 2024] Node 1 Normal free:42782816kB boost:0kB min:43144kB low:87292kB high:131440kB reserved_highatomic:0KB active_anon:553392kB inactive_anon:0kB active_file:177840kB inactive_file:74304kB unevictable:0kB writepending:0kB present:45088768kB managed:44220580kB mlocked:0kB bounce:0kB free_pcp:130208kB local_pcp:2204kB free_cma:0kB
[Mon Oct 28 18:17:23 2024] lowmem_reserve[]: 0 0 0 0 0
[Mon Oct 28 18:17:23 2024] Node 0 DMA: 0*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 2*4096kB (M) = 11264kB
[Mon Oct 28 18:17:23 2024] Node 0 DMA32: 9*4kB (UM) 11*8kB (UM) 11*16kB (UM) 10*32kB (UM) 13*64kB (UM) 14*128kB (UM) 7*256kB (UM) 7*512kB (UM) 7*1024kB (UM) 12*2048kB (M) 405*4096kB (M) = 1699244kB
[Mon Oct 28 18:17:23 2024] Node 0 Normal: 40733*4kB (UME) 32103*8kB (UME) 25917*16kB (UME) 14776*32kB (UME) 9016*64kB (UME) 4148*128kB (UME) 1402*256kB (UME) 535*512kB (UME) 1391*1024kB (UM) 1188*2048kB (UME) 7036*4096kB (UM) = 35724924kB
[Mon Oct 28 18:17:23 2024] Node 1 Normal: 37874*4kB (UME) 34579*8kB (UME) 23808*16kB (UME) 12586*32kB (UME) 5561*64kB (UME) 2782*128kB (UME) 1280*256kB (UME) 413*512kB (UME) 281*1024kB (UME) 142*2048kB (UME) 9703*4096kB (M) = 42784992kB
[Mon Oct 28 18:17:23 2024] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
[Mon Oct 28 18:17:23 2024] Node 0 hugepages_total=3 hugepages_free=0 hugepages_surp=3 hugepages_size=2048kB
[Mon Oct 28 18:17:23 2024] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
[Mon Oct 28 18:17:23 2024] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
[Mon Oct 28 18:17:23 2024] 2500073 total pagecache pages
[Mon Oct 28 18:17:23 2024] 0 pages in swap cache
[Mon Oct 28 18:17:23 2024] Free swap  = 8388604kB
[Mon Oct 28 18:17:23 2024] Total swap = 8388604kB
[Mon Oct 28 18:17:23 2024] 23511814 pages RAM
[Mon Oct 28 18:17:23 2024] 0 pages HighMem/MovableOnly
[Mon Oct 28 18:17:23 2024] 440456 pages reserved
[Mon Oct 28 18:17:23 2024] 0 pages cma reserved
[Mon Oct 28 18:17:23 2024] 0 pages hwpoisoned
[Mon Oct 28 18:17:23 2024] sysrq: Show Blocked State
[Mon Oct 28 18:17:23 2024] task:ipmitool        state:D stack:0     pid:1514795 tgid:1514795 ppid:1491966 flags:0x00004002
[Mon Oct 28 18:17:23 2024] Call Trace:
[Mon Oct 28 18:17:23 2024]  <TASK>
[Mon Oct 28 18:17:23 2024]  __schedule+0x413/0x1720
[Mon Oct 28 18:17:23 2024]  ? ttwu_do_activate+0x68/0x230
[Mon Oct 28 18:17:23 2024]  schedule+0x32/0xd0
[Mon Oct 28 18:17:23 2024]  schedule_timeout+0x151/0x160
[Mon Oct 28 18:17:23 2024]  wait_for_completion+0x8a/0x160
[Mon Oct 28 18:17:23 2024]  __wait_rcu_gp+0x15b/0x170
[Mon Oct 28 18:17:23 2024]  synchronize_rcu+0x133/0x150
[Mon Oct 28 18:17:23 2024]  ? __pfx_call_rcu_hurry+0x10/0x10
[Mon Oct 28 18:17:23 2024]  ? __pfx_wakeme_after_rcu+0x10/0x10
[Mon Oct 28 18:17:23 2024]  _ipmi_destroy_user+0x2aa/0x320 [ipmi_msghandler]
[Mon Oct 28 18:17:23 2024]  ipmi_destroy_user+0x12/0x60 [ipmi_msghandler]
[Mon Oct 28 18:17:23 2024]  ipmi_release+0x1f/0x60 [ipmi_devintf]
[Mon Oct 28 18:17:23 2024]  __fput+0x97/0x2c0
[Mon Oct 28 18:17:23 2024]  __x64_sys_close+0x3d/0x80
[Mon Oct 28 18:17:23 2024]  do_syscall_64+0x83/0x170
[Mon Oct 28 18:17:23 2024]  ? __count_memcg_events+0x69/0x100
[Mon Oct 28 18:17:23 2024]  ? count_memcg_events.constprop.0+0x1a/0x30
[Mon Oct 28 18:17:23 2024]  ? handle_mm_fault+0xa2/0x360
[Mon Oct 28 18:17:23 2024]  ? do_user_addr_fault+0x304/0x690
[Mon Oct 28 18:17:23 2024]  ? exc_page_fault+0x7f/0x180
[Mon Oct 28 18:17:23 2024]  entry_SYSCALL_64_after_hwframe+0x78/0x80
[Mon Oct 28 18:17:23 2024] RIP: 0033:0x7eff96ce8804
[Mon Oct 28 18:17:23 2024] RSP: 002b:00007ffc438ab848 EFLAGS: 00000202 ORIG_RAX: 0000000000000003
[Mon Oct 28 18:17:23 2024] RAX: ffffffffffffffda RBX: 000055c3099a19e0 RCX: 00007eff96ce8804
[Mon Oct 28 18:17:23 2024] RDX: 0000000000000003 RSI: 000055c30b2be900 RDI: 0000000000000003
[Mon Oct 28 18:17:23 2024] RBP: 00007ffc438ab860 R08: 000055c6571b5a1e R09: 0000000000000007
[Mon Oct 28 18:17:23 2024] R10: 000055c30b2be910 R11: 0000000000000202 R12: 0000000000000000
[Mon Oct 28 18:17:23 2024] R13: 0000000000000000 R14: 000055c3099a19e0 R15: 0000000000000007
[Mon Oct 28 18:17:23 2024]  </TASK>