Bugzilla – Bug 1219368
[Build 50.1] kdump_and_crash, after trigger crash `echo c > /proc/sysrq-trigger `, no kdump collected and failed to reboot
Last modified: 2024-02-26 10:06:25 UTC
## Observation openQA test in scenario sle-15-SP6-Online-ppc64le-toolchain_zypper@ppc64le fails in [kdump_and_crash](http://openqa.suse.de/tests/13390840/modules/kdump_and_crash/steps/85) ## Test suite description Maintainer: QE Core, mnowak Install toolchain packages and test the toolchain. Uses a more powerful machine configuration. ## Reproducible Fails since (at least) Build [47.2](http://openqa.suse.de/tests/13318576) ## Expected result Last good: (unknown) (or more recent) ## Further details Always latest result in this scenario: [latest](http://openqa.suse.de/tests/latest?arch=ppc64le&distri=sle&flavor=Online&machine=ppc64le&test=toolchain_zypper&version=15-SP6)
Here comes the serial log after crash: SCRIPT_FINISHEDF0ZS5-0- [ 58.770144][ T2280] sysrq: Trigger a crash [ 58.770220][ T2280] Kernel panic - not syncing: sysrq triggered crash [ 58.770276][ T2280] CPU: 1 PID: 2280 Comm: bash Kdump: loaded Not tainted 6.4.0-150600.5-default #1 SLE15-SP6 377ee2c8b5fe0d2ce4d806e8c8432d1849b12dd1 [ 58.770385][ T2280] Hardware name: IBM pSeries (emulated by qemu) POWER8E (raw) 0x4b0201 0xf000004 of:SLOF,HEAD hv:linux,kvm pSeries [ 58.770485][ T2280] Call Trace: [ 58.770518][ T2280] [c000000014a6ba50] [c000000000f61728] dump_stack_lvl+0x6c/0x9c (unreliable) [ 58.770602][ T2280] [c000000014a6ba80] [c000000000161374] panic+0x16c/0x438 [ 58.770659][ T2280] [c000000014a6bb10] [c000000000a25098] sysrq_handle_crash+0x28/0x30 [ 58.770726][ T2280] [c000000014a6bb70] [c000000000a25960] __handle_sysrq+0xf0/0x2b0 [ 58.770791][ T2280] [c000000014a6bc20] [c000000000a261e8] write_sysrq_trigger+0xc8/0x180 [ 58.770856][ T2280] [c000000014a6bc60] [c00000000067d128] proc_reg_write+0x108/0x1b0 [ 58.770923][ T2280] [c000000014a6bc90] [c0000000005a29a0] vfs_write+0x100/0x440 [ 58.770990][ T2280] [c000000014a6bd50] [c0000000005a2f0c] ksys_write+0xdc/0x130 [ 58.771055][ T2280] [c000000014a6bda0] [c000000000034988] system_call_exception+0x158/0x320 [ 58.771121][ T2280] [c000000014a6be50] [c00000000000d6a0] system_call_common+0x160/0x2c4 [ 58.771187][ T2280] --- interrupt: c00 at 0x7fff83211ac4 [ 58.771240][ T2280] NIP: 00007fff83211ac4 LR: 00007fff83165ba4 CTR: 0000000000000000 [ 58.771304][ T2280] REGS: c000000014a6be80 TRAP: 0c00 Not tainted (6.4.0-150600.5-default) [ 58.771377][ T2280] MSR: 800000000280f033 <SF,VEC,VSX,EE,PR,FP,ME,IR,DR,RI,LE> CR: 22242221 XER: 00000000 [ 58.771472][ T2280] IRQMASK: 0 [ 58.771472][ T2280] GPR00: 0000000000000004 00007fffe43591a0 00007fff83326d00 0000000000000001 [ 58.771472][ T2280] GPR04: 0000010021901020 0000000000000002 0000000000000063 0000000000000000 [ 58.771472][ T2280] GPR08: 00007fffe4359288 0000000000000000 0000000000000000 0000000000000000 [ 58.771472][ T2280] GPR12: 0000000000000000 00007fff8349b8a0 0000000000000000 000000011f5037c0 [ 58.771472][ T2280] GPR16: 000000011f467ed0 0000000000000000 000000011f4add10 0000000000000000 [ 58.771472][ T2280] GPR20: 000000011f4bdb28 0000010021905d90 000000011f507828 000000011f506c70 [ 58.771472][ T2280] GPR24: 000001002190adc0 0000000000000000 00007fffe43593c4 0000010021901020 [ 58.771472][ T2280] GPR28: 0000000000000002 00007fff83321810 0000010021901020 0000000000000002 [ 58.772044][ T2280] NIP [00007fff83211ac4] 0x7fff83211ac4 [ 58.772157][ T2280] LR [00007fff83165ba4] 0x7fff83165ba4 [ 58.772202][ T2280] --- interrupt: c00
More logs: Linux ppc64le #1 SMP Thu Jan 2[ 0.000000][ T0] random: crng init done [ 0.000000][ T0] hash-mmu: Page sizes from device-tree: [ 0.000000][ T0] hash-mmu: base_shift=12: shift=12, sllp=0x0000, avpnm=0x00000000, tlbiel=1, penc=0 [ 0.000000][ T0] hash-mmu: base_shift=16: shift=16, sllp=0x0110, avpnm=0x00000000, tlbiel=1, penc=1 [ 0.000000][ T0] Disabling hardware transactional memory (HTM) [ 0.000000][ T0] Using 1TB segments [ 0.000000][ T0] hash-mmu: Initializing hash mmu with SLB [ 0.000000][ T0] Linux version 6.4.0-150600.5-default (geeko@buildhost) (gcc (SUSE Linux) 7.5.0, GNU ld (GNU Binutils; SUSE Linux Enterprise 15) 2.41.0.20230908-150100.7.46) #1 SMP Thu Jan 25 15:08:05 UTC 2024 (bd9aaa6) [ 0.000000][ T0] Secure boot mode disabled [ 0.000000][ T0] Found initrd at 0xc000000022c90000:0xc000000023f83890 [ 0.000000][ T0] Hardware name: IBM pSeries (emulated by qemu) POWER8E (raw) 0x4b0201 0xf000004 of:SLOF,HEAD hv:linux,kvm pSeries [ 0.000000][ T0] Partition configured for 4 cpus. [ 0.000000][ T0] CPU maps initialized for 1 thread per core [ 0.000000][ T0] numa: disabled by user [ 0.000000][ T0] ----------------------------------------------------- [ 0.000000][ T0] phys_mem_size = 0x60000000 [ 0.000000][ T0] dcache_bsize = 0x80 [ 0.000000][ T0] icache_bsize = 0x80 [ 0.000000][ T0] cpu_features = 0x000002eb8f4d9187 [ 0.000000][ T0] possible = 0x001ffbfbcf5fb187 [ 0.000000][ T0] always = 0x0000000380008181 [ 0.000000][ T0] cpu_user_features = 0xdc0065c2 0xae000000 [ 0.000000][ T0] mmu_features = 0x78006001 [ 0.000000][ T0] firmware_features = 0x00000a85455a445f [ 0.000000][ T0] vmalloc start = 0xc008000000000000 [ 0.000000][ T0] IO start = 0xc00a000000000000 [ 0.000000][ T0] vmemmap start = 0xc00c000000000000 [ 0.000000][ T0] hash-mmu: ppc64_pft_size = 0x19 [ 0.000000][ T0] hash-mmu: htab_hash_mask = 0x3ffff [ 0.000000][ T0] physical_start = 0x20000000 [ 0.000000][ T0] ----------------------------------------------------- [ 0.000000][ T0] numa: NODE_DATA [mem 0x5ffb4280-0x5ffbbfff] [ 0.000000][ T0] rfi-flush: fallback displacement flush available [ 0.000000][ T0] count-cache-flush: flush disabled. [ 0.000000][ T0] link-stack-flush: flush disabled. [ 0.000000][ T0] stf-barrier: hwsync barrier available [ 0.000000][ T0] PPC64 nvram contains 65536 bytes [ 0.000000][ T0] barrier-nospec: using ORI speculation barrier [ 0.000000][ T0] Zone ranges: [ 0.000000][ T0] Normal [mem 0x0000000000000000-0x000000005fffffff] [ 0.000000][ T0] Device empty [ 0.000000][ T0] Movable zone start for each node [ 0.000000][ T0] Early memory node ranges [ 0.000000][ T0] node 0: [mem 0x0000000000000000-0x000000005fffffff] [ 0.000000][ T0] Initmem setup node 0 [mem 0x0000000000000000-0x000000005fffffff] [ 0.000000][ T0] percpu: Embedded 10 pages/cpu s603816 r0 d51544 u1048576 [ 0.000000][ T0] Kernel command line: elfcorehdr=0x22c80000 plymouth.ignore-serial-consoles console=hvc0 console=tty kernel.softlockup_panic=1 security=apparmor mitigations=auto fadump= sysrq=yes reset_devices acpi_no_memhotplug cgroup_disable=memory nokaslr numa=off irqpoll maxcpus=1 root=kdump rootflags=bind rd.udev.children-max=8 panic=1 [ 0.000000][ T0] cgroup: Disabling memory control group subsystem [ 0.000000][ T0] Misrouted IRQ fixup and polling support enabled [ 0.000000][ T0] This may significantly impact system performance [ 0.000000][ T0] Unknown kernel command line parameters "acpi_no_memhotplug nokaslr sysrq=yes", will be passed to user space. [ 0.000000][ T0] Dentry cache hash table entries: 131072 (order: 4, 1048576 bytes, linear) [ 0.000000][ T0] Inode-cache hash table entries: 65536 (order: 3, 524288 bytes, linear) [ 0.000000][ T0] Fallback order for Node 0: 0 [ 0.000000][ T0] Built 1 zonelists, mobility grouping on. Total pages: 24552 [ 0.000000][ T0] Policy zone: Normal [ 0.000000][ T0] mem auto-init: stack:off, heap alloc:off, heap free:off [ 0.000000][ T0] Memory: 0K/1572864K available (16064K kernel code, 3712K rwdata, 16704K rodata, 6400K init, 2578K bss, 596800K reserved, 0K cma-reserved) [ 0.000000][ T0] SLUB: HWalign=128, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000][ T0] ftrace: allocating 40228 entries in 15 pages [ 0.000000][ T0] ftrace: allocated 15 pages with 4 groups [ 0.000000][ T0] trace event string verifier disabled [ 0.000000][ T0] rcu: Hierarchical RCU implementation. [ 0.000000][ T0] rcu: RCU event tracing is enabled. [ 0.000000][ T0] rcu: RCU restricting CPUs from NR_CPUS=2048 to nr_cpu_ids=4. [ 0.000000][ T0] Rude variant of Tasks RCU enabled. [ 0.000000][ T0] Tracing variant of Tasks RCU enabled. [ 0.000000][ T0] rcu: RCU calculated value of scheduler-enlistment delay is 10 jiffies. [ 0.000000][ T0] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000][ T0] NR_IRQS: 512, nr_irqs: 512, preallocated irqs: 16 [ 0.000000][ T0] rcu: srcu_init: Setting srcu_struct sizes based on contention. [ 0.000001][ T0] clocksource: timebase: mask: 0xffffffffffffffff max_cycles: 0x761537d007, max_idle_ns: 440795202126 ns [ 0.000004][ T0] clocksource: timebase mult[1f40000] shift[24] registered [ 0.000166][ T0] Console: colour dummy device 80x25 [ 0.000170][ T0] printk: console [tty0] enabled [ 0.000368][ T0] pid_max: default: 32768 minimum: 301 [ 0.000440][ T0] LSM: initializing lsm=lockdown,capability,apparmor,integrity [ 0.000512][ T0] AppArmor: AppArmor initialized [ 0.000568][ T0] Mount-cache hash table entries: 8192 (order: 0, 65536 bytes, linear) [ 0.000582][ T0] Mountpoint-cache hash table entries: 8192 (order: 0, 65536 bytes, linear) [ 0.001238][ T1] cblist_init_generic: Setting adjustable number of callback queues. [ 0.001242][ T1] cblist_init_generic: Setting shift to 2 and lim to 1. [ 0.001255][ T1] cblist_init_generic: Setting adjustable number of callback queues. [ 0.001259][ T1] cblist_init_generic: Setting shift to 2 and lim to 1. [ 0.001277][ T1] POWER8 performance monitor hardware support registered [ 0.001283][ T1] power8-pmu: PMAO restore workaround active. [ 0.001299][ T1] rcu: Hierarchical SRCU implementation. [ 0.001302][ T1] rcu: Max phase no-delay instances is 1000. [ 0.001988][ T1] smp: Bringing up secondary CPUs ... [ 0.001991][ T1] smp: Brought up 1 node, 1 CPU [ 0.002370][ T18] node 0 deferred pages initialised in 0ms [ 0.002557][ T1] devtmpfs: initialized [ 0.004815][ T1] PCI host bridge /pci@800000020000000 ranges: [ 0.004827][ T1] IO 0x0000200000000000..0x000020000000ffff -> 0x0000000000000000 [ 0.004833][ T1] MEM 0x0000200080000000..0x00002000ffffffff -> 0x0000000080000000 [ 0.004837][ T1] MEM 0x0000210000000000..0x000021ffffffffff -> 0x0000210000000000 [ 0.004867][ T1] PCI: OF: PROBE_ONLY disabled [ 0.004904][ T1] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns [ 0.004912][ T1] futex hash table entries: 1024 (order: 1, 131072 bytes, linear) [ 0.005004][ T1] pinctrl core: initialized pinctrl subsystem [ 0.009946][ T1] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 0.010290][ T1] audit: initializing netlink subsys (disabled) [ 0.010506][ T1] thermal_sys: Registered thermal governor 'fair_share' [ 0.010508][ T1] thermal_sys: Registered thermal governor 'bang_bang' [ 0.010511][ T1] thermal_sys: Registered thermal governor 'step_wise' [ 0.010514][ T1] thermal_sys: Registered thermal governor 'user_space' [ 0.010538][ T21] audit: type=2000 audit(1706670884.010:1): state=initialized audit_enabled=0 res=1 [ 0.010545][ T1] cpuidle: using governor ladder [ 0.010552][ T1] cpuidle: using governor menu [ 0.010790][ T1] pstore: Registered nvram as persistent store backend [ 0.011186][ T1] Issue PHB reset ... [ 0.011219][ T1] EEH: pSeries platform initialized [ 0.011782][ T1] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 0.038148][ T1] iommu: Default domain type: Translated [ 0.038157][ T1] iommu: DMA domain TLB invalidation policy: strict mode [ 0.038477][ T1] pps_core: LinuxPPS API ver. 1 registered [ 0.038481][ T1] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it> [ 0.038487][ T1] PTP clock support registered [ 0.038497][ T1] EDAC MC: Ver: 3.0.0 [ 0.038771][ T1] NetLabel: Initializing [ 0.038774][ T1] NetLabel: domain hash size = 128 [ 0.038776][ T1] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.038795][ T1] NetLabel: unlabeled traffic allowed by default [ 0.038801][ T1] mctp: management component transport protocol core [ 0.038804][ T1] NET: Registered PF_MCTP protocol family [ 0.038813][ T1] PCI: Probing PCI hardware [ 0.038977][ T1] PCI host bridge to bus 0000:00 [ 0.038982][ T1] pci_bus 0000:00: root bus resource [io 0x10000-0x1ffff] (bus address [0x0000-0xffff]) [ 0.038988][ T1] pci_bus 0000:00: root bus resource [mem 0x200080000000-0x2000ffffffff] (bus address [0x80000000-0xffffffff]) [ 0.038993][ T1] pci_bus 0000:00: root bus resource [mem 0x210000000000-0x21ffffffffff 64bit] [ 0.038998][ T1] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.039062][ T1] pci 0000:00:00.0: No hypervisor support for SR-IOV on this device, IOV BARs disabled. [ 0.039253][ T1] pci 0000:00:01.0: No hypervisor support for SR-IOV on this device, IOV BARs disabled. [ 0.039660][ T1] pci 0000:00:02.0: No hypervisor support for SR-IOV on this device, IOV BARs disabled. [ 0.040384][ T1] pci 0000:00:03.0: No hypervisor support for SR-IOV on this device, IOV BARs disabled. [ 0.040997][ T1] pci 0000:00:04.0: No hypervisor support for SR-IOV on this device, IOV BARs disabled. [ 0.041485][ T1] pci 0000:00:05.0: No hypervisor support for SR-IOV on this device, IOV BARs disabled. [ 0.042216][ T1] pci 0000:00:06.0: No hypervisor support for SR-IOV on this device, IOV BARs disabled. [ 0.042948][ T1] pci 0000:00:07.0: No hypervisor support for SR-IOV on this device, IOV BARs disabled. [ 1.932906][ T1] IOMMU table initialized, virtual merging enabled [ 1.933121][ T1] pci_bus 0000:00: resource 4 [io 0x10000-0x1ffff] [ 1.933126][ T1] pci_bus 0000:00: resource 5 [mem 0x200080000000-0x2000ffffffff] [ 1.933131][ T1] pci_bus 0000:00: resource 6 [mem 0x210000000000-0x21ffffffffff 64bit] [ 1.933143][ T1] pci 0000:00:00.0: Adding to iommu group 0 [ 1.933210][ T1] pci 0000:00:01.0: Adding to iommu group 0 [ 1.933356][ T1] pci 0000:00:02.0: Adding to iommu group 0 [ 1.933659][ T1] pci 0000:00:03.0: Adding to iommu group 0 [ 1.933903][ T1] pci 0000:00:04.0: Adding to iommu group 0 [ 1.934071][ T1] pci 0000:00:05.0: Adding to iommu group 0 [ 1.934365][ T1] pci 0000:00:06.0: Adding to iommu group 0 [ 1.934663][ T1] pci 0000:00:07.0: Adding to iommu group 0 [ 1.934957][ T1] EEH: No capable adapters found: recovery disabled. [ 1.935145][ T1] pci 0000:00:00.0: vgaarb: setting as boot VGA device [ 1.935149][ T1] pci 0000:00:00.0: vgaarb: bridge control possible [ 1.935153][ T1] pci 0000:00:00.0: vgaarb: VGA device added: decodes=io+mem,owns=mem,locks=none [ 1.935159][ T1] vgaarb: loaded [ 1.935311][ T1] clocksource: Switched to clocksource timebase [ 1.935703][ T1] VFS: Disk quotas dquot_6.6.0 [ 1.935728][ T1] VFS: Dquot-cache hash table entries: 8192 (order 0, 65536 bytes) [ 1.935885][ T1] hugetlbfs: disabling because there are no supported hugepage sizes [ 1.935988][ T1] AppArmor: AppArmor Filesystem Enabled [ 1.946235][ T1] NET: Registered PF_INET protocol family [ 1.946299][ T1] IP idents hash table entries: 16384 (order: 1, 131072 bytes, linear) [ 1.946669][ T1] tcp_listen_portaddr_hash hash table entries: 4096 (order: 0, 65536 bytes, linear) [ 1.946687][ T1] Table-perturb hash table entries: 65536 (order: 2, 262144 bytes, linear) [ 1.946692][ T1] TCP established hash table entries: 8192 (order: 0, 65536 bytes, linear) [ 1.946716][ T1] TCP bind hash table entries: 8192 (order: 2, 262144 bytes, linear) [ 1.946767][ T1] TCP: Hash tables configured (established 8192 bind 8192) [ 1.946832][ T1] MPTCP token hash table entries: 4096 (order: 0, 98304 bytes, linear) [ 1.946851][ T1] UDP hash table entries: 2048 (order: 0, 65536 bytes, linear) [ 1.946868][ T1] UDP-Lite hash table entries: 2048 (order: 0, 65536 bytes, linear) [ 1.946915][ T1] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 1.946925][ T1] NET: Registered PF_XDP protocol family [ 1.947575][ T1] PCI: CLS 0 bytes, default 128 [ 1.947873][ T26] Trying to unpack rootfs image as initramfs... [ 1.955698][ T1] vas: API is supported only with radix page tables [ 1.956066][ T1] Initialise system trusted keyrings [ 1.956081][ T1] Key type blacklist registered [ 1.956180][ T1] workingset: timestamp_bits=38 max_order=14 bucket_order=0 [ 1.956204][ T1] zbud: loaded [ 1.956422][ T1] integrity: Platform Keyring initialized [ 1.956428][ T1] integrity: Machine keyring initialized [ 1.988364][ T1] Key type asymmetric registered [ 1.988367][ T1] Asymmetric key parser 'x509' registered [ 4.130738][ T26] Freeing initrd memory: 19392K [ 4.136501][ T1] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246) [ 4.136538][ T1] io scheduler mq-deadline registered [ 4.136543][ T1] io scheduler kyber registered [ 4.136561][ T1] io scheduler bfq registered [ 6.447240][ T1] printk: console [hvc0] enabled [ 6.457847][ T1] Serial: 8250/16550 driver, 4 ports, IRQ sharing disabled [ 8.334111][ T1] Non-volatile memory driver v1.3 [ 8.334177][ T1] pseries_rng: Registering IBM pSeries RNG driver [ 8.334252][ T1] Linux agpgart interface v0.103 [ 8.334535][ T1] [drm] Initialized ofdrm 1.0.0 20220501 for of-display on minor 0 [ 8.339872][ T1] Console: switching to colour frame buffer device 128x48 [ 8.342630][ T1] of-display of-display: [drm] fb0: ofdrmdrmfb frame buffer device [ 8.343098][ T1] mousedev: PS/2 mouse device common for all mice [ 8.343265][ T1] ledtrig-cpu: registered to indicate activity on CPUs [ 8.343352][ T1] hid: raw HID events driver (C) Jiri Kosina [ 8.343455][ T1] drop_monitor: Initializing network drop monitor service [ 8.353938][ T1] NET: Registered PF_INET6 protocol family [ 8.359456][ T1] Segment Routing with IPv6 [ 8.359556][ T1] RPL Segment Routing with IPv6 [ 8.359616][ T1] In-situ OAM (IOAM) with IPv6 [ 8.359697][ T1] NET: Registered PF_KEY protocol family [ 8.359977][ T1] secvar-sysfs: Failed to retrieve secvar operations [ 8.360051][ T1] drmem: No dynamic reconfiguration memory found [ 8.361762][ T1] registered taskstats version 1 [ 8.361943][ T1] Loading compiled-in X.509 certificates [ 8.362042][ T1] Loaded X.509 cert 'SUSE Linux Enterprise Secure Boot Signkey: a746b64b6cb71f13385638055f46162bac632acd' [ 8.364074][ T1] page_owner is disabled [ 8.364249][ T1] Key type .fscrypt registered [ 8.364302][ T1] Key type fscrypt-provisioning registered [ 8.365915][ T1] pstore: Using crash dump compression: lzo [ 8.372498][ T1] Key type encrypted registered [ 8.373009][ T1] AppArmor: AppArmor sha1 policy hashing enabled [ 8.373453][ T1] Secure boot mode disabled [ 8.373861][ T1] ima: No TPM chip found, activating TPM-bypass! [ 8.374280][ T1] Loading compiled-in module X.509 certificates [ 8.374734][ T1] Loaded X.509 cert 'SUSE Linux Enterprise Secure Boot Signkey: a746b64b6cb71f13385638055f46162bac632acd' [ 8.375193][ T1] ima: Allocated hash algorithm: sha256 [ 8.375691][ T1] Secure boot mode disabled [ 8.376119][ T1] Trusted boot mode disabled [ 8.376575][ T1] ima: No architecture policies found [ 8.377004][ T1] evm: Initialising EVM extended attributes: [ 8.377426][ T1] evm: security.selinux [ 8.377823][ T1] evm: security.SMACK64 (disabled) [ 8.378224][ T1] evm: security.SMACK64EXEC (disabled) [ 8.378626][ T1] evm: security.SMACK64TRANSMUTE (disabled) [ 8.379039][ T1] evm: security.SMACK64MMAP (disabled) [ 8.379439][ T1] evm: security.apparmor [ 8.379822][ T1] evm: security.ima [ 8.380196][ T1] evm: security.capability [ 8.380576][ T1] evm: HMAC attrs: 0x1 [ 8.563098][ T1] SED: plpks not available [ 8.564975][ T1] clk: Disabling unused clocks [ 8.568667][ T1] Freeing unused kernel image (initmem) memory: 6400K [ 8.596190][ T1] Run /init as init process [ 8.624488][ T1] systemd[1]: systemd 254.5+suse.64.g327b885182 running in system mode (+PAM +AUDIT +SELINUX +APPARMOR +IMA -SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 8.627557][ T1] systemd[1]: Detected virtualization kvm. [ 8.629171][ T1] systemd[1]: Detected architecture ppc64-le. [ 8.629664][ T1] systemd[1]: Running in initrd. [ 8.631833][ T1] systemd[1]: Hostname set to <susetest>. [ 8.745731][ T1] systemd[1]: Queued start job for default target Initrd Default Target. [ 8.765989][ T1] systemd[1]: Created slice Slice /system/systemd-fsck. [ 8.768456][ T1] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. [ 8.769483][ T1] systemd[1]: Reached target Initrd Root Device. [ 8.770474][ T1] systemd[1]: Reached target Initrd /usr File System. [ 8.771430][ T1] systemd[1]: Reached target Path Units. [ 8.772418][ T1] systemd[1]: Reached target Slice Units. [ 8.773371][ T1] systemd[1]: Reached target Swaps. [ 8.774291][ T1] systemd[1]: Reached target Timer Units. [ 8.776656][ T1] systemd[1]: Listening on Journal Socket (/dev/log). [ 8.779937][ T1] systemd[1]: Listening on Journal Socket. [ 8.781107][ T1] systemd[1]: Listening on udev Control Socket. [ 8.782273][ T1] systemd[1]: Listening on udev Kernel Socket. [ 8.783311][ T1] systemd[1]: Reached target Socket Units. [ 8.786880][ T1] systemd[1]: Started Entropy Daemon based on the HAVEGE algorithm. [ 8.791970][ T1] systemd[1]: Starting Create List of Static Device Nodes... [ 8.794671][ T1] systemd[1]: Starting Journal Service... [ 8.808814][ T1] systemd[1]: Load Kernel Modules was skipped because no trigger condition checks were met. [ 8.836043][ T1] systemd[1]: Starting Apply Kernel Variables... [ 8.837940][ T1] systemd[1]: Starting Virtual Console Setup... [ 8.845333][ T1] systemd[1]: Finished Create List of Static Device Nodes. [ 8.851181][ T1] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... [ 8.881530][ T1] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. [ 8.905690][ T1] systemd[1]: Starting Create Static Device Nodes in /dev... [ 8.909093][ T1] systemd[1]: Finished Apply Kernel Variables. [ 8.929777][ T142] systemd-journald[142]: Collecting audit messages is disabled. [ 8.936594][ T1] systemd[1]: Finished Create Static Device Nodes in /dev. [ 8.938029][ T1] systemd[1]: Reached target Preparation for Local File Systems. [ 8.964565][ T1] systemd[1]: Started Journal Service. [ 9.615313][ T256] raid6: vpermxor8 gen() 29643 MB/s [ 9.785316][ T256] raid6: vpermxor4 gen() 25385 MB/s [ 9.955312][ T256] raid6: vpermxor2 gen() 22575 MB/s [ 10.125305][ T256] raid6: vpermxor1 gen() 15944 MB/s [ 10.295319][ T256] raid6: altivecx8 gen() 15986 MB/s [ 10.465324][ T256] raid6: altivecx4 gen() 17960 MB/s [ 10.635320][ T256] raid6: altivecx2 gen() 11400 MB/s [ 10.805331][ T256] raid6: altivecx1 gen() 11036 MB/s [ 10.975331][ T256] raid6: int64x8 gen() 5432 MB/s [ 11.145324][ T256] raid6: int64x4 gen() 5608 MB/s [ 11.315320][ T256] raid6: int64x2 gen() 5273 MB/s [ 11.485337][ T256] raid6: int64x1 gen() 4178 MB/s [ 11.485899][ T256] raid6: using algorithm vpermxor8 gen() 29643 MB/s [ 11.486384][ T256] raid6: using intx1 recovery algorithm [ 11.490480][ T256] xor: measuring software checksum speed [ 11.491645][ T256] 8regs : 16669 MB/sec [ 11.492742][ T256] 8regs_prefetch : 15339 MB/sec [ 11.493811][ T256] 32regs : 16604 MB/sec [ 11.494914][ T256] 32regs_prefetch : 15676 MB/sec [ 11.495714][ T256] altivec : 29591 MB/sec [ 11.496132][ T256] xor: using function: altivec (29591 MB/sec) [ 11.740591][ T256] Btrfs loaded, assert=on, zoned=yes, fsverity=yes [ 11.930677][ T283] synth uevent: /devices/vio: failed to send uevent [ 11.931191][ T283] vio vio: uevent: failed to send synthetic uevent: -19 [ 12.033285][ T285] virtio_blk virtio4: 4/0/0 default/read/poll queues [ 12.084139][ T285] virtio_blk virtio4: [vda] 62914560 512-byte logical blocks (32.2 GB/30.0 GiB) [ 12.280336][ T286] Console: switching to colour dummy device 80x25 [ 12.296347][ T286] [drm] Found bochs VGA, ID 0xb0c5. [ 12.296456][ T286] [drm] Framebuffer size 16384 kB @ 0x200080000000, mmio @ 0x200081000000. [ 12.299152][ T286] [drm] Found EDID data blob. [ 12.299301][ T286] [drm] Initialized bochs-drm 1.0.0 20130925 for 0000:00:00.0 on minor 0 [ 12.303089][ T286] Console: switching to colour frame buffer device 128x48 [ 12.308921][ T286] bochs-drm 0000:00:00.0: [drm] fb0: bochs-drmdrmfb frame buffer device [ 12.317729][ T288] SCSI subsystem initialized [ 12.405526][ T290] usbcore: registered new interface driver usbfs [ 12.405651][ T290] usbcore: registered new interface driver hub [ 12.405730][ T290] usbcore: registered new device driver usb [ 12.453801][ T288] alua: device handler registered [ 12.476798][ T288] rdac: device handler registered [ 12.482738][ T288] emc: device handler registered [ 12.523244][ T288] scsi host0: Virtio SCSI HBA [ 12.709707][ T290] xhci_hcd 0000:00:04.0: xHCI Host Controller [ 12.709817][ T290] xhci_hcd 0000:00:04.0: new USB bus registered, assigned bus number 1 [ 12.710441][ T290] xhci_hcd 0000:00:04.0: hcc params 0x00080001 hci version 0x100 quirks 0x0000000000000014 [ 12.711429][ T290] xhci_hcd 0000:00:04.0: xHCI Host Controller [ 12.711496][ T290] xhci_hcd 0000:00:04.0: new USB bus registered, assigned bus number 2 [ 12.711574][ T290] xhci_hcd 0000:00:04.0: Host supports USB 3.0 SuperSpeed [ 12.725354][ T290] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.04 [ 12.725569][ T290] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 12.725647][ T290] usb usb1: Product: xHCI Host Controller [ 12.726142][ T290] usb usb1: Manufacturer: Linux 6.4.0-150600.5-default xhci-hcd [ 12.726645][ T290] usb usb1: SerialNumber: 0000:00:04.0 [ 12.728315][ T290] hub 1-0:1.0: USB hub found [ 12.729732][ T290] hub 1-0:1.0: 4 ports detected [ 12.731468][ T290] usb usb2: We don't know the algorithms for LPM for this host, disabling LPM. [ 12.732835][ T290] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 6.04 [ 12.733369][ T290] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 12.733884][ T290] usb usb2: Product: xHCI Host Controller [ 12.734357][ T290] usb usb2: Manufacturer: Linux 6.4.0-150600.5-default xhci-hcd [ 12.734849][ T290] usb usb2: SerialNumber: 0000:00:04.0 [ 12.739028][ T290] hub 2-0:1.0: USB hub found [ 12.740508][ T290] hub 2-0:1.0: 4 ports detected [ 13.015317][ T9] usb 1-1: new high-speed USB device number 2 using xhci_hcd [ 13.196416][ T9] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 [ 13.196951][ T9] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 [ 13.197439][ T9] usb 1-1: Product: QEMU USB Tablet [ 13.197898][ T9] usb 1-1: Manufacturer: QEMU [ 13.198354][ T9] usb 1-1: SerialNumber: 28754-pci@800000020000000:04.0-1 [ 13.345329][ T9] usb 1-2: new high-speed USB device number 3 using xhci_hcd [ 13.526314][ T9] usb 1-2: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 [ 13.526856][ T9] usb 1-2: New USB device strings: Mfr=1, Product=4, SerialNumber=11 [ 13.527338][ T9] usb 1-2: Product: QEMU USB Keyboard [ 13.527792][ T9] usb 1-2: Manufacturer: QEMU [ 13.528236][ T9] usb 1-2: SerialNumber: 68284-pci@800000020000000:04.0-2 [ 104.165667][ T1] watchdog: watchdog0: watchdog did not stop! [ 104.171523][ T1] systemd-shutdown[1]: Using hardware watchdog 'pseries-wdt', version 0, device /dev/watchdog0 [ 104.172949][ T1] systemd-shutdown[1]: Watchdog running with a timeout of 10min. [ 104.174785][ T1] systemd-shutdown[1]: Syncing filesystems and block devices. [ 134.177298][ T1] systemd-shutdown[1]: Syncing filesystems and block devices - timed out, issuing SIGKILL to PID 370. [ 134.177894][ T1] systemd-shutdown[1]: Sending SIGTERM to remaining processes... [ 134.184741][ T142] systemd-journald[142]: Received SIGTERM from PID 1 (systemd-shutdow). [ 144.187077][ T1] systemd-shutdown[1]: Waiting for process: 290 ((udev-worker)), 288 ((udev-worker)), 361 ((sd-sync)), 370 ((sd-sync)), 285 ((udev-worker)), 282 (systemd-udevd)
From https://openqa.suse.de/tests/13390840/logfile?filename=serial0.txt we see that during normal boot, three partitions are detected when virtio-blk discovers the disk: [ 3.906412][ T336] virtio_blk virtio4: 4/0/0 default/read/poll queues [ 3.909267][ T336] virtio_blk virtio4: [vda] 62914560 512-byte logical blocks (32.2 GB/30.0 GiB) [ 3.925002][ T336] vda: vda1 vda2 vda3 however, in the kdump boot, no partitions are found after this: [ 12.033285][ T285] virtio_blk virtio4: 4/0/0 default/read/poll queues [ 12.084139][ T285] virtio_blk virtio4: [vda] 62914560 512-byte logical blocks (32.2 GB/30.0 GiB) We might be seeing the problem that this patch series attempts to solve: https://lore.kernel.org/all/20230808104239.146085-1-ming.lei@redhat.com/ In short, virtio-blk fails when maxcpus is set to 1. The first step to verify this is to try kdump with unlimited CPUs, i.e. setting KDUMP_CPUS to 0 in /etc/sysconfig/kdump I'll see if I can reproduce this in a VM with KDUMP_CPUS unset and fix it with KDUMP_CPUS=0.
Similar problem, except with LPFC insteda of virtio-blk is handled in bsc#1218180
Hello David, Could you please update the status of this bug.
Jiri, is this one you can takeover?
(In reply to David Mair from comment #7) > Jiri, is this one you can takeover? Re-reading your comments, I take it this is essentially INVALID as a kdump bug and is a virtio-blk bug where the reporter of this could either join in or they could create another bug reporting it as a virtio-blk.
Could you reduce the issue to a reproducible simple invocation of qemu or libvirt?
(In reply to David Mair from comment #8) > (In reply to David Mair from comment #7) > > Jiri, is this one you can takeover? > > Re-reading your comments, I take it this is essentially INVALID as a kdump > bug and is a virtio-blk bug where the reporter of this could either join in > or they could create another bug reporting it as a virtio-blk. hmm really? If it affects LPFC as well as virtio-blk should it rather be looked at from the kdump side? Or are we thinking about a bug in virtio-blk guest kernel driver or virtio-blk qemu backend? Because if this affects LPFC that seems unlikely.
(In reply to Claudio Fontana from comment #10) > (In reply to David Mair from comment #8) > > (In reply to David Mair from comment #7) > > > Jiri, is this one you can takeover? > > > > Re-reading your comments, I take it this is essentially INVALID as a kdump > > bug and is a virtio-blk bug where the reporter of this could either join in > > or they could create another bug reporting it as a virtio-blk. > > hmm really? If it affects LPFC as well as virtio-blk should it rather be > looked at from the kdump side? > > Or are we thinking about a bug in virtio-blk guest kernel driver or > virtio-blk qemu backend? Because if this affects LPFC that seems unlikely. Comment #4 supports your point. However, the Assignee will need to change, probably t Jiri.
I'll take this; as I said in Comment #4, I believe this is likely a duplicate of bsc#1218180. A fix for nr_cpus on PPC is now merged in the SP6 kernel (5e24f676) An updated version of kdump that makes use of nr_cpus instead of maxcpus is now submitted to SP6 (kdump-2.0.1+git1.gdf8e77c, https://build.suse.de/request/show/321872). Please re-test when the kernel and kdump containing these fixes are available.
Then let's put it as a duplicate *** This bug has been marked as a duplicate of bug 1218180 ***