[Sun Dec 8 08:29:55 2024] spdk: /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh reset (start) [Sun Dec 8 08:29:58 2024] pcieport 0000:d7:00.0: bridge window [io 0x1000-0x0fff] to [bus d8] add_size 1000 [Sun Dec 8 08:29:58 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space [Sun Dec 8 08:29:58 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign [Sun Dec 8 08:29:58 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space [Sun Dec 8 08:29:58 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign [Sun Dec 8 08:29:58 2024] spdk: /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh reset (done) [Sun Dec 8 08:30:04 2024] spdk: /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh status (start) [Sun Dec 8 08:30:08 2024] spdk: /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh status (done) [Sun Dec 8 08:30:08 2024] spdk: /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh (start) [Sun Dec 8 08:30:11 2024] ioatdma 0000:00:04.7: Removing dma and dca services [Sun Dec 8 08:30:11 2024] ioatdma 0000:00:04.6: Removing dma and dca services [Sun Dec 8 08:30:11 2024] ioatdma 0000:00:04.5: Removing dma and dca services [Sun Dec 8 08:30:11 2024] ioatdma 0000:00:04.4: Removing dma and dca services [Sun Dec 8 08:30:11 2024] ioatdma 0000:00:04.3: Removing dma and dca services [Sun Dec 8 08:30:11 2024] ioatdma 0000:00:04.2: Removing dma and dca services [Sun Dec 8 08:30:11 2024] ioatdma 0000:00:04.1: Removing dma and dca services [Sun Dec 8 08:30:11 2024] ioatdma 0000:00:04.0: Removing dma and dca services [Sun Dec 8 08:30:11 2024] ioatdma 0000:80:04.7: Removing dma and dca services [Sun Dec 8 08:30:11 2024] ioatdma 0000:80:04.6: Removing dma and dca services [Sun Dec 8 08:30:11 2024] ioatdma 0000:80:04.5: Removing dma and dca services [Sun Dec 8 08:30:11 2024] ioatdma 0000:80:04.4: Removing dma and dca services [Sun Dec 8 08:30:11 2024] ioatdma 0000:80:04.3: Removing dma and dca services [Sun Dec 8 08:30:11 2024] ioatdma 0000:80:04.2: Removing dma and dca services [Sun Dec 8 08:30:11 2024] ioatdma 0000:80:04.1: Removing dma and dca services [Sun Dec 8 08:30:11 2024] ioatdma 0000:80:04.0: Removing dma and dca services [Sun Dec 8 08:30:12 2024] pcieport 0000:d7:00.0: bridge window [io 0x1000-0x0fff] to [bus d8] add_size 1000 [Sun Dec 8 08:30:12 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space [Sun Dec 8 08:30:12 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign [Sun Dec 8 08:30:12 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space [Sun Dec 8 08:30:12 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign [Sun Dec 8 08:30:12 2024] spdk: /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh (done) [Sun Dec 8 08:30:13 2024] spdk: /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh reset (start) [Sun Dec 8 08:30:17 2024] nvme nvme0: pci function 0000:5e:00.0 [Sun Dec 8 08:30:17 2024] nvme nvme0: 96/0/0 default/read/poll queues [Sun Dec 8 08:30:17 2024] nvme nvme0: Ignoring bogus Namespace Identifiers [Sun Dec 8 08:30:18 2024] pcieport 0000:d7:00.0: bridge window [io 0x1000-0x0fff] to [bus d8] add_size 1000 [Sun Dec 8 08:30:18 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space [Sun Dec 8 08:30:18 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign [Sun Dec 8 08:30:18 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space [Sun Dec 8 08:30:18 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign [Sun Dec 8 08:30:18 2024] spdk: /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh reset (done) [Sun Dec 8 08:30:18 2024] spdk: /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh (start) [Sun Dec 8 08:30:21 2024] ioatdma 0000:00:04.7: Removing dma and dca services [Sun Dec 8 08:30:21 2024] ioatdma 0000:00:04.6: Removing dma and dca services [Sun Dec 8 08:30:21 2024] ioatdma 0000:00:04.5: Removing dma and dca services [Sun Dec 8 08:30:21 2024] ioatdma 0000:00:04.4: Removing dma and dca services [Sun Dec 8 08:30:21 2024] ioatdma 0000:00:04.3: Removing dma and dca services [Sun Dec 8 08:30:21 2024] ioatdma 0000:00:04.2: Removing dma and dca services [Sun Dec 8 08:30:22 2024] ioatdma 0000:00:04.1: Removing dma and dca services [Sun Dec 8 08:30:22 2024] ioatdma 0000:00:04.0: Removing dma and dca services [Sun Dec 8 08:30:22 2024] ioatdma 0000:80:04.7: Removing dma and dca services [Sun Dec 8 08:30:22 2024] ioatdma 0000:80:04.6: Removing dma and dca services [Sun Dec 8 08:30:22 2024] ioatdma 0000:80:04.5: Removing dma and dca services [Sun Dec 8 08:30:22 2024] ioatdma 0000:80:04.4: Removing dma and dca services [Sun Dec 8 08:30:22 2024] ioatdma 0000:80:04.3: Removing dma and dca services [Sun Dec 8 08:30:22 2024] ioatdma 0000:80:04.2: Removing dma and dca services [Sun Dec 8 08:30:22 2024] ioatdma 0000:80:04.1: Removing dma and dca services [Sun Dec 8 08:30:22 2024] ioatdma 0000:80:04.0: Removing dma and dca services [Sun Dec 8 08:30:22 2024] pcieport 0000:d7:00.0: bridge window [io 0x1000-0x0fff] to [bus d8] add_size 1000 [Sun Dec 8 08:30:22 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space [Sun Dec 8 08:30:22 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign [Sun Dec 8 08:30:22 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space [Sun Dec 8 08:30:22 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign [Sun Dec 8 08:30:23 2024] spdk: /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh (done) [Sun Dec 8 08:31:24 2024] infiniband iwp175s0f1: ib_query_port failed (-19) [Sun Dec 8 08:31:24 2024] irdma_dbg_pf_exit: removing debugfs entries [Sun Dec 8 08:31:24 2024] infiniband iwp175s0f0: ib_query_port failed (-19) [Sun Dec 8 08:31:24 2024] irdma_dbg_pf_exit: removing debugfs entries [Sun Dec 8 08:31:24 2024] irdma driver version: 1.14.31 [Sun Dec 8 08:31:24 2024] version mismatch: [Sun Dec 8 08:31:24 2024] expected major ver 1, caller specified major ver 0 [Sun Dec 8 08:31:24 2024] expected minor ver 1, caller specified minor ver 1 [Sun Dec 8 08:31:24 2024] irdma.gen_1: probe of i40e.iwarp.0 failed with error -22 [Sun Dec 8 08:31:24 2024] version mismatch: [Sun Dec 8 08:31:24 2024] expected major ver 1, caller specified major ver 0 [Sun Dec 8 08:31:24 2024] expected minor ver 1, caller specified minor ver 1 [Sun Dec 8 08:31:24 2024] irdma.gen_1: probe of i40e.iwarp.1 failed with error -22 [Sun Dec 8 08:31:24 2024] probe: cdev_info=00000000d5fd76d1, cdev_info->dev.aux_dev.bus->number=175, cdev_info->rdma_active_port=0xff netdev=cvl_0_0 [Sun Dec 8 08:31:24 2024] irdma: Because roce_ena is ENABLED, roce_port_cfg will be ignored. [Sun Dec 8 08:31:24 2024] ice 0000:af:00.0: irdma_fill_device_info: iwdev->lag_mode = 0 [Sun Dec 8 08:31:25 2024] irdma_dbg_prep_dump_buf: irdma_dbg_dump_buf_len = 16384 [Sun Dec 8 08:31:25 2024] INFO: Flow control is disabled for this traffic class (0) on this vsi. [Sun Dec 8 08:31:25 2024] probe: cdev_info=000000006351fb99, cdev_info->dev.aux_dev.bus->number=175, cdev_info->rdma_active_port=0xff netdev=cvl_0_1 [Sun Dec 8 08:31:25 2024] ice 0000:af:00.1: irdma_fill_device_info: iwdev->lag_mode = 0 [Sun Dec 8 08:31:25 2024] INFO: Flow control is disabled for this traffic class (0) on this vsi. [Sun Dec 8 08:32:07 2024] nbd0: detected capacity change from 0 to 131072 [Sun Dec 8 08:32:08 2024] nbd1: detected capacity change from 0 to 131072 [Sun Dec 8 08:32:08 2024] block nbd0: NBD_DISCONNECT [Sun Dec 8 08:32:08 2024] block nbd0: Disconnected due to user request. [Sun Dec 8 08:32:08 2024] block nbd1: NBD_DISCONNECT [Sun Dec 8 08:32:08 2024] block nbd1: Disconnected due to user request. [Sun Dec 8 08:32:13 2024] nbd0: detected capacity change from 0 to 131072 [Sun Dec 8 08:32:13 2024] block nbd0: Other side returned error (5) [Sun Dec 8 08:32:13 2024] I/O error, dev nbd0, sector 0 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 0 [Sun Dec 8 08:32:13 2024] Buffer I/O error on dev nbd0, logical block 0, async page read [Sun Dec 8 08:32:13 2024] nbd1: detected capacity change from 0 to 131072 [Sun Dec 8 08:32:13 2024] block nbd1: Other side returned error (5) [Sun Dec 8 08:32:13 2024] I/O error, dev nbd1, sector 0 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 0 [Sun Dec 8 08:32:13 2024] Buffer I/O error on dev nbd1, logical block 0, async page read [Sun Dec 8 08:32:14 2024] block nbd0: NBD_DISCONNECT [Sun Dec 8 08:32:14 2024] block nbd0: Disconnected due to user request. [Sun Dec 8 08:32:14 2024] block nbd1: NBD_DISCONNECT [Sun Dec 8 08:32:14 2024] block nbd1: Disconnected due to user request. [Sun Dec 8 08:32:18 2024] nbd0: detected capacity change from 0 to 131072 [Sun Dec 8 08:32:19 2024] block nbd0: Other side returned error (5) [Sun Dec 8 08:32:19 2024] I/O error, dev nbd0, sector 0 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 0 [Sun Dec 8 08:32:19 2024] Buffer I/O error on dev nbd0, logical block 0, async page read [Sun Dec 8 08:32:19 2024] nbd1: detected capacity change from 0 to 131072 [Sun Dec 8 08:32:19 2024] block nbd0: NBD_DISCONNECT [Sun Dec 8 08:32:19 2024] block nbd0: Disconnected due to user request. [Sun Dec 8 08:32:20 2024] block nbd1: NBD_DISCONNECT [Sun Dec 8 08:32:20 2024] block nbd1: Disconnected due to user request. [Sun Dec 8 08:34:33 2024] ice 0000:af:00.0 rocep175s0f0: AEQ: abnormal ae_id = 0x50a (Connection error: The max number of retries has been reached), is_qp = 1, qp_id = 1820, ae_source = 5 [Sun Dec 8 08:35:16 2024] spdk: /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh reset (start) [Sun Dec 8 08:35:19 2024] nvme nvme0: pci function 0000:5e:00.0 [Sun Dec 8 08:35:19 2024] nvme nvme0: 96/0/0 default/read/poll queues [Sun Dec 8 08:35:19 2024] nvme nvme0: Ignoring bogus Namespace Identifiers [Sun Dec 8 08:35:21 2024] pcieport 0000:d7:00.0: bridge window [io 0x1000-0x0fff] to [bus d8] add_size 1000 [Sun Dec 8 08:35:21 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space [Sun Dec 8 08:35:21 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign [Sun Dec 8 08:35:21 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: can't assign; no space [Sun Dec 8 08:35:21 2024] pcieport 0000:d7:00.0: bridge window [io size 0x1000]: failed to assign [Sun Dec 8 08:35:22 2024] spdk: /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh reset (done) [Sun Dec 8 08:35:22 2024] spdk: /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh cleanup (start) [Sun Dec 8 08:35:26 2024] spdk: /var/jenkins/workspace/nvmf-cvl-phy-autotest/spdk/scripts/setup.sh cleanup (done) [Sun Dec 8 08:35:26 2024] ######## Autotest Cleanup Dump ######## [Sun Dec 8 08:35:26 2024] sysrq: Show backtrace of all active CPUs [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 0 [Sun Dec 8 08:35:26 2024] CPU: 0 PID: 355270 Comm: bash Tainted: G OE 6.8.9-200.fc39.x86_64 #1 [Sun Dec 8 08:35:26 2024] Hardware name: Intel Corporation S2600WFT/S2600WFT, BIOS SE5C620.86B.02.01.0013.121520200651 12/15/2020 [Sun Dec 8 08:35:26 2024] Call Trace: [Sun Dec 8 08:35:26 2024] [Sun Dec 8 08:35:26 2024] dump_stack_lvl+0x64/0x80 [Sun Dec 8 08:35:26 2024] nmi_cpu_backtrace+0xd6/0x110 [Sun Dec 8 08:35:26 2024] ? __pfx_nmi_raise_cpu_backtrace+0x10/0x10 [Sun Dec 8 08:35:26 2024] nmi_trigger_cpumask_backtrace+0xf3/0x140 [Sun Dec 8 08:35:26 2024] __handle_sysrq+0xe1/0x260 [Sun Dec 8 08:35:26 2024] ? filp_flush+0x52/0x70 [Sun Dec 8 08:35:26 2024] write_sysrq_trigger+0x59/0x80 [Sun Dec 8 08:35:26 2024] proc_reg_write+0x5a/0xa0 [Sun Dec 8 08:35:26 2024] vfs_write+0xed/0x470 [Sun Dec 8 08:35:26 2024] ? do_syscall_64+0x90/0x170 [Sun Dec 8 08:35:26 2024] ? __x64_sys_fcntl+0x94/0xc0 [Sun Dec 8 08:35:26 2024] ksys_write+0x6f/0xf0 [Sun Dec 8 08:35:26 2024] do_syscall_64+0x83/0x170 [Sun Dec 8 08:35:26 2024] ? do_filp_open+0xb3/0x160 [Sun Dec 8 08:35:26 2024] ? get_close_on_exec+0x36/0x40 [Sun Dec 8 08:35:26 2024] ? do_fcntl+0x89/0x6a0 [Sun Dec 8 08:35:26 2024] ? get_close_on_exec+0x36/0x40 [Sun Dec 8 08:35:26 2024] ? do_fcntl+0x89/0x6a0 [Sun Dec 8 08:35:26 2024] ? __x64_sys_fcntl+0x94/0xc0 [Sun Dec 8 08:35:26 2024] ? syscall_exit_to_user_mode+0x83/0x230 [Sun Dec 8 08:35:26 2024] ? do_syscall_64+0x90/0x170 [Sun Dec 8 08:35:26 2024] ? count_memcg_events.constprop.0+0x1a/0x30 [Sun Dec 8 08:35:26 2024] ? handle_mm_fault+0xa2/0x360 [Sun Dec 8 08:35:26 2024] ? do_user_addr_fault+0x304/0x690 [Sun Dec 8 08:35:26 2024] ? clear_bhb_loop+0x55/0xb0 [Sun Dec 8 08:35:26 2024] ? clear_bhb_loop+0x55/0xb0 [Sun Dec 8 08:35:26 2024] ? clear_bhb_loop+0x55/0xb0 [Sun Dec 8 08:35:26 2024] entry_SYSCALL_64_after_hwframe+0x78/0x80 [Sun Dec 8 08:35:26 2024] RIP: 0033:0x7effb3c6aee4 [Sun Dec 8 08:35:26 2024] Code: c7 00 16 00 00 00 b8 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 f3 0f 1e fa 80 3d 85 74 0d 00 00 74 13 b8 01 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 54 c3 0f 1f 00 55 48 89 e5 48 83 ec 20 48 89 [Sun Dec 8 08:35:26 2024] RSP: 002b:00007ffd3a10f048 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [Sun Dec 8 08:35:26 2024] RAX: ffffffffffffffda RBX: 0000000000000002 RCX: 00007effb3c6aee4 [Sun Dec 8 08:35:26 2024] RDX: 0000000000000002 RSI: 0000557a373893a0 RDI: 0000000000000001 [Sun Dec 8 08:35:26 2024] RBP: 00007ffd3a10f070 R08: 0000000000000073 R09: 0000000000000001 [Sun Dec 8 08:35:26 2024] R10: 0000000000000000 R11: 0000000000000202 R12: 0000000000000002 [Sun Dec 8 08:35:26 2024] R13: 0000557a373893a0 R14: 00007effb3d3b5c0 R15: 00007effb3d38f20 [Sun Dec 8 08:35:26 2024] [Sun Dec 8 08:35:26 2024] Sending NMI from CPU 0 to CPUs 1-95: [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 48 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 38 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 10 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 84 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 28 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 76 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 65 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 22 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 91 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 11 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 8 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 37 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 13 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 42 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 90 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 2 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 80 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 51 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 56 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 58 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 81 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 57 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 92 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 61 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 79 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 46 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 52 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 93 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 45 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 23 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 50 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 26 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 60 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 35 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 54 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 32 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 1 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 94 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 12 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 29 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 4 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 21 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 73 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 3 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 88 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 31 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 15 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 20 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 16 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 9 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 78 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 24 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 7 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 55 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 36 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 68 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 69 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 44 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 70 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 18 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 17 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 71 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.026 msecs [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 49 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.039 msecs [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 39 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 5 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 74 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 63 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 30 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.044 msecs [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 89 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 66 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.060 msecs [Sun Dec 8 08:35:26 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.075 msecs [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 72 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.085 msecs [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 64 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.099 msecs [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 27 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.115 msecs [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 59 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.126 msecs [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 43 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 62 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.214 msecs [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 83 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 6 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 87 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 53 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 85 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 14 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 75 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 77 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 34 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 67 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 40 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 19 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 82 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 86 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 33 [Sun Dec 8 08:35:26 2024] CPU: 33 PID: 355394 Comm: bash Tainted: G OE 6.8.9-200.fc39.x86_64 #1 [Sun Dec 8 08:35:26 2024] Hardware name: Intel Corporation S2600WFT/S2600WFT, BIOS SE5C620.86B.02.01.0013.121520200651 12/15/2020 [Sun Dec 8 08:35:26 2024] RIP: 0033:0x561778a3d839 [Sun Dec 8 08:35:26 2024] Code: 00 83 e8 01 48 8b 15 c6 b2 11 00 89 05 cc b2 11 00 48 98 48 8b 1c c2 c7 43 08 00 00 00 00 48 c7 03 00 00 00 00 41 80 3c 24 00 <74> 3d 4c 89 e7 e8 fd e9 fe ff 4c 8d 68 01 4c 89 ef e8 71 ee fe ff [Sun Dec 8 08:35:26 2024] RSP: 002b:00007ffff7397fb0 EFLAGS: 00000206 [Sun Dec 8 08:35:26 2024] RAX: 000056177cee3c80 RBX: 000056177cee3c80 RCX: 0000000000000003 [Sun Dec 8 08:35:26 2024] RDX: 000056177a292010 RSI: 000056177cf0f680 RDI: 0000000000000010 [Sun Dec 8 08:35:26 2024] RBP: 00007ffff7397fd0 R08: 00007fc65af2fac0 R09: 000056177d00c68a [Sun Dec 8 08:35:26 2024] R10: 000056177c7cfa50 R11: 0000000000000010 R12: 000056177cabe070 [Sun Dec 8 08:35:26 2024] R13: 0000561778b58370 R14: 000056177ca9c2b0 R15: 000056177c7cfa50 [Sun Dec 8 08:35:26 2024] FS: 00007fc65ad54740 GS: 0000000000000000 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 25 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 41 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 95 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:26 2024] NMI backtrace for cpu 47 skipped: idling at intel_idle+0x71/0xe0 [Sun Dec 8 08:35:27 2024] sysrq: Show Memory [Sun Dec 8 08:35:27 2024] Mem-Info: [Sun Dec 8 08:35:27 2024] active_anon:1630189 inactive_anon:0 isolated_anon:0 active_file:101123 inactive_file:946665 isolated_file:0 unevictable:768 dirty:0 writeback:0 slab_reclaimable:52580 slab_unreclaimable:129941 mapped:39021 shmem:1483259 pagetables:3425 sec_pagetables:0 bounce:0 kernel_misc_reclaimable:0 free:19884185 free_pcp:91140 free_cma:0 [Sun Dec 8 08:35:27 2024] Node 0 active_anon:5868812kB inactive_anon:0kB active_file:229824kB inactive_file:3643460kB unevictable:3072kB isolated(anon):0kB isolated(file):0kB mapped:85756kB dirty:0kB writeback:0kB shmem:5408176kB shmem_thp:0kB shmem_pmdmapped:0kB anon_thp:0kB writeback_tmp:0kB kernel_stack:11656kB pagetables:4960kB sec_pagetables:0kB all_unreclaimable? no [Sun Dec 8 08:35:27 2024] Node 1 active_anon:653456kB inactive_anon:0kB active_file:174668kB inactive_file:143200kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:70332kB dirty:0kB writeback:0kB shmem:524860kB shmem_thp:0kB shmem_pmdmapped:0kB anon_thp:0kB writeback_tmp:0kB kernel_stack:11128kB pagetables:8236kB sec_pagetables:0kB all_unreclaimable? no [Sun Dec 8 08:35:27 2024] Node 0 DMA free:11264kB boost:0kB min:12kB low:24kB high:36kB reserved_highatomic:0KB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15972kB managed:15360kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB [Sun Dec 8 08:35:27 2024] lowmem_reserve[]: 0 1666 31850 31850 31850 [Sun Dec 8 08:35:27 2024] Node 0 DMA32 free:1702868kB boost:0kB min:1648kB low:3352kB high:5056kB reserved_highatomic:0KB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:1772500kB managed:1706964kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB [Sun Dec 8 08:35:27 2024] lowmem_reserve[]: 0 0 30183 30183 30183 [Sun Dec 8 08:35:27 2024] Node 0 Normal free:19728388kB boost:0kB min:29872kB low:60780kB high:91688kB reserved_highatomic:0KB active_anon:5868660kB inactive_anon:0kB active_file:229824kB inactive_file:3643460kB unevictable:3072kB writepending:0kB present:31444992kB managed:30908272kB mlocked:0kB bounce:0kB free_pcp:167648kB local_pcp:17840kB free_cma:0kB [Sun Dec 8 08:35:27 2024] lowmem_reserve[]: 0 0 0 0 0 [Sun Dec 8 08:35:27 2024] Node 1 Normal free:58091992kB boost:0kB min:58572kB low:119168kB high:179764kB reserved_highatomic:0KB active_anon:653456kB inactive_anon:0kB active_file:174668kB inactive_file:143200kB unevictable:0kB writepending:0kB present:61865984kB managed:60682296kB mlocked:0kB bounce:0kB free_pcp:197560kB local_pcp:2148kB free_cma:0kB [Sun Dec 8 08:35:27 2024] lowmem_reserve[]: 0 0 0 0 0 [Sun Dec 8 08:35:27 2024] Node 0 DMA: 0*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 2*4096kB (M) = 11264kB [Sun Dec 8 08:35:27 2024] Node 0 DMA32: 9*4kB (UM) 12*8kB (UM) 9*16kB (UM) 6*32kB (UM) 6*64kB (UM) 13*128kB (UM) 10*256kB (UM) 10*512kB (UM) 7*1024kB (UM) 7*2048kB (M) 408*4096kB (M) = 1702868kB [Sun Dec 8 08:35:27 2024] Node 0 Normal: 27133*4kB (UME) 29321*8kB (UME) 20815*16kB (UME) 12072*32kB (UME) 6254*64kB (UM) 3090*128kB (UM) 1272*256kB (UME) 427*512kB (UME) 139*1024kB (UM) 49*2048kB (UM) 4171*4096kB (UM) = 19729580kB [Sun Dec 8 08:35:27 2024] Node 1 Normal: 13554*4kB (UME) 38806*8kB (UME) 32859*16kB (UME) 17483*32kB (UME) 9445*64kB (UME) 4731*128kB (UME) 1970*256kB (UME) 1015*512kB (UME) 194*1024kB (UME) 218*2048kB (ME) 13126*4096kB (UME) = 58093128kB [Sun Dec 8 08:35:27 2024] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB [Sun Dec 8 08:35:27 2024] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB [Sun Dec 8 08:35:27 2024] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB [Sun Dec 8 08:35:27 2024] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB [Sun Dec 8 08:35:27 2024] 2531048 total pagecache pages [Sun Dec 8 08:35:27 2024] 0 pages in swap cache [Sun Dec 8 08:35:27 2024] Free swap = 8388604kB [Sun Dec 8 08:35:27 2024] Total swap = 8388604kB [Sun Dec 8 08:35:27 2024] 23774862 pages RAM [Sun Dec 8 08:35:27 2024] 0 pages HighMem/MovableOnly [Sun Dec 8 08:35:27 2024] 446639 pages reserved [Sun Dec 8 08:35:27 2024] 0 pages cma reserved [Sun Dec 8 08:35:27 2024] 0 pages hwpoisoned [Sun Dec 8 08:35:27 2024] sysrq: Show Blocked State [Sun Dec 8 08:35:27 2024] task:ipmitool state:D stack:0 pid:441589 tgid:441589 ppid:355436 flags:0x00004002 [Sun Dec 8 08:35:27 2024] Call Trace: [Sun Dec 8 08:35:27 2024] [Sun Dec 8 08:35:27 2024] __schedule+0x413/0x1720 [Sun Dec 8 08:35:28 2024] ? ttwu_do_activate+0x68/0x230 [Sun Dec 8 08:35:28 2024] schedule+0x32/0xd0 [Sun Dec 8 08:35:28 2024] schedule_timeout+0x151/0x160 [Sun Dec 8 08:35:28 2024] wait_for_completion+0x8a/0x160 [Sun Dec 8 08:35:28 2024] __wait_rcu_gp+0x15b/0x170 [Sun Dec 8 08:35:28 2024] synchronize_rcu+0x133/0x150 [Sun Dec 8 08:35:28 2024] ? __pfx_call_rcu_hurry+0x10/0x10 [Sun Dec 8 08:35:28 2024] ? __pfx_wakeme_after_rcu+0x10/0x10 [Sun Dec 8 08:35:28 2024] _ipmi_destroy_user+0x2aa/0x320 [ipmi_msghandler] [Sun Dec 8 08:35:28 2024] ipmi_destroy_user+0x12/0x60 [ipmi_msghandler] [Sun Dec 8 08:35:28 2024] ipmi_release+0x1f/0x60 [ipmi_devintf] [Sun Dec 8 08:35:28 2024] __fput+0x97/0x2c0 [Sun Dec 8 08:35:28 2024] __x64_sys_close+0x3d/0x80 [Sun Dec 8 08:35:28 2024] do_syscall_64+0x83/0x170 [Sun Dec 8 08:35:28 2024] ? xas_find+0x75/0x1d0 [Sun Dec 8 08:35:28 2024] ? next_uptodate_folio+0xa5/0x2e0 [Sun Dec 8 08:35:28 2024] ? filemap_map_pages+0x474/0x550 [Sun Dec 8 08:35:28 2024] ? _copy_to_user+0x24/0x40 [Sun Dec 8 08:35:28 2024] ? cp_new_stat+0x135/0x170 [Sun Dec 8 08:35:28 2024] ? __do_sys_newfstatat+0x4e/0x80 [Sun Dec 8 08:35:28 2024] ? syscall_exit_to_user_mode+0x83/0x230 [Sun Dec 8 08:35:28 2024] ? do_syscall_64+0x90/0x170 [Sun Dec 8 08:35:28 2024] ? do_user_addr_fault+0x304/0x690 [Sun Dec 8 08:35:28 2024] ? clear_bhb_loop+0x55/0xb0 [Sun Dec 8 08:35:28 2024] ? clear_bhb_loop+0x55/0xb0 [Sun Dec 8 08:35:28 2024] ? clear_bhb_loop+0x55/0xb0 [Sun Dec 8 08:35:28 2024] entry_SYSCALL_64_after_hwframe+0x78/0x80 [Sun Dec 8 08:35:28 2024] RIP: 0033:0x7f0b9cbdf804 [Sun Dec 8 08:35:28 2024] RSP: 002b:00007ffc0a2f5238 EFLAGS: 00000202 ORIG_RAX: 0000000000000003 [Sun Dec 8 08:35:28 2024] RAX: ffffffffffffffda RBX: 000055625e3af9e0 RCX: 00007f0b9cbdf804 [Sun Dec 8 08:35:28 2024] RDX: 0000000000000003 RSI: 000055625ecd2a80 RDI: 0000000000000003 [Sun Dec 8 08:35:28 2024] RBP: 00007ffc0a2f5250 R08: 0000556708e8c6f2 R09: 0000000000000007 [Sun Dec 8 08:35:28 2024] R10: 000055625ecd2a90 R11: 0000000000000202 R12: 0000000000000000 [Sun Dec 8 08:35:28 2024] R13: 0000000000000000 R14: 000055625e3af9e0 R15: 0000000000000007 [Sun Dec 8 08:35:28 2024]