Bug 1210639 - Kernel 6.2+ fails to boot on Intel Atom x5-Z8300
Summary: Kernel 6.2+ fails to boot on Intel Atom x5-Z8300
Status: RESOLVED FIXED
: 1219628 (view as bug list)
Alias: None
Product: openSUSE Tumbleweed
Classification: openSUSE
Component: Kernel (show other bugs)
Version: Current
Hardware: x86-64 Other
: P5 - None : Normal (vote)
Target Milestone: ---
Assignee: openSUSE Kernel Bugs
QA Contact: E-mail List
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2023-04-19 09:12 UTC by Filippo Bonazzi
Modified: 2024-03-24 02:10 UTC (History)
3 users (show)

See Also:
Found By: ---
Services Priority:
Business Priority:
Blocker: ---
Marketing QA Status: ---
IT Deployment: ---


Attachments
dmesg (70.12 KB, text/plain)
2023-04-19 09:49 UTC, Filippo Bonazzi
Details
hwinfo (461.58 KB, text/plain)
2023-04-19 09:50 UTC, Filippo Bonazzi
Details
dmesg and hwinfo from old and new kernel (664.64 KB, application/zip)
2024-02-07 09:52 UTC, Vojtech Zeisek
Details
log with failed modprobe (458.92 KB, text/plain)
2024-02-07 12:30 UTC, Vojtech Zeisek
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Filippo Bonazzi 2023-04-19 09:12:15 UTC
Ever since the update to kernel 6.2 my MicroOS Desktop install on an old Intel Atom x5-Z8300 netbook fails to boot. It was working fine up to kernels 6.1.X.

This is what I see at boot:

[16.358810][ T587] atomisp-isp2 0000:00:03.0: atomisp: Error -2 while requesting firmware shisp_2401a0_v21.bin
^ this line was present at boot on older kernels too, but it still worked

[16.414042][ T587] atomisp-isp2 0000:00:03.0: IUNIT power-off timeout.
[16.414108][ T587] atomisp-isp2 0000:00:03.0: Failed to switch off ISP

And it just freezes there.

Sometimes I've also seen a line at the end such as this one:
[...] watchdog: BUG: soft lockup - CPU#... stuck for ...s!
but this line is not showing up right now that I'm trying to report it.

This appears to be the same bug that someone else reported for Ubuntu https://bugs.launchpad.net/ubuntu/+source/linux/+bug/2015794
Comment 1 Takashi Iwai 2023-04-19 09:34:23 UTC
Could you try to boot with blacklisting the atomisp driver?
Pass module_blacklist=atomisp boot option.
Comment 2 Takashi Iwai 2023-04-19 09:36:10 UTC
Also, please give the hwinfo and dmesg outputs from the previous working kernel.

If the blacklisting worked, give the hwinfo and dmesg outputs from there, too.
Comment 3 Filippo Bonazzi 2023-04-19 09:49:09 UTC
Created attachment 866400 [details]
dmesg
Comment 4 Filippo Bonazzi 2023-04-19 09:49:53 UTC
Blacklisting the module made the system boot.

Here are the hwinfo and dmesg outputs. There are some more boot errors that I had not seen previously (ov2722).
Comment 5 Filippo Bonazzi 2023-04-19 09:50:10 UTC
Created attachment 866401 [details]
hwinfo
Comment 6 Takashi Iwai 2023-04-19 09:54:40 UTC
OK, then could you try to load atomisp module manually on the running 6.2 kernel?  I guess you'll get the crash, but you might have a better chance to get the Oops.
Comment 7 Filippo Bonazzi 2023-04-19 10:08:00 UTC
$ sudo modprobe atomisp
modprobe: ERROR: could not insert 'atomisp': Operation not permitted
Comment 8 Takashi Iwai 2023-04-21 09:12:42 UTC
I guess it's because you're using MicroOS.  IIRC, you need to fiddle with the temporary rw-mount via the transaction shell for allowing such operations.
Comment 9 Filippo Bonazzi 2023-04-21 09:42:40 UTC
I am physically away from that system now, so I'll have to retry in a few days/weeks. Could it also be secure boot?

In the interest of having a working system, can I then just blacklist atomisp permanently and run with it until a real fix is found (if ever)? This is a hobby system so no big deal.
Comment 10 Takashi Iwai 2023-04-21 10:29:26 UTC
(In reply to Filippo Bonazzi from comment #9)
> I am physically away from that system now, so I'll have to retry in a few
> days/weeks. Could it also be secure boot?

I suspect rather the transactional update.  Of course, it'd be better to turn off Secure Boot; otherwise it'll become difficult to test a new test kernel.

> In the interest of having a working system, can I then just blacklist
> atomisp permanently and run with it until a real fix is found (if ever)?
> This is a hobby system so no big deal.

Sure, that'll work.  The atomisp driver has been often broken, and I don't think you need it at all.
Comment 11 Takashi Iwai 2023-04-24 13:08:39 UTC
In anyway, please try the 6.3 kernel (now available in OBS Kernel:stable repo for non-SecureBoot environment).  If this still shows the problem, we'll need to report this to the upstream.
Comment 12 Vojtech Zeisek 2024-02-07 09:52:31 UTC
Created attachment 872528 [details]
dmesg and hwinfo from old and new kernel
Comment 13 Vojtech Zeisek 2024-02-07 09:54:11 UTC
I have same problem on openSUSE Tumbleweed (see also https://bugzilla.suse.com/show_bug.cgi?id=1219628 ). When I try "sudo modprobe atomisp", the system just freezes.
Comment 14 Takashi Iwai 2024-02-07 10:11:01 UTC
*** Bug 1219628 has been marked as a duplicate of this bug. ***
Comment 15 Takashi Iwai 2024-02-07 10:12:00 UTC
A more interesting part is whether you can get the kernel Oops messages found in the log.  With the later modprobe, it's highly possible that the system runs and keeps the dying message.  Please check the previous boot log.
Comment 16 Vojtech Zeisek 2024-02-07 12:30:43 UTC
Created attachment 872534 [details]
log with failed modprobe

I used "sudo journalctl -b-1" to obtain the log. Failed modprobe I tried ca. 11:12 and hard rebooted ca. 10 min. later. HTH
Comment 17 Takashi Iwai 2024-02-07 13:24:17 UTC
(In reply to Vojtech Zeisek from comment #16)
> Created attachment 872534 [details]
> log with failed modprobe
> 
> I used "sudo journalctl -b-1" to obtain the log. Failed modprobe I tried ca.
> 11:12 and hard rebooted ca. 10 min. later. HTH

Hm, it doesn't show anything about atomisp unlike the previous report.
Didn't you see those messages about the firmware load errors?
Comment 18 Vojtech Zeisek 2024-02-07 19:15:04 UTC
> Didn't you see those messages about the firmware load errors?

Nothing. As soon as I submit the modprobe command, notebook freezes completely and I can do nothing and see nothing.
Comment 19 Takashi Iwai 2024-02-12 13:59:39 UTC
OK, thanks.  Then it's not easy to get the crash log, and without such info, debugging and fixing the problem is hardly possible.

So I decided rather to disable this broken driver from our kernels.  It's been broken over a year, and it's a very rarely used device.

The next kernel should drop the atomisp driver and you can remove the blacklist later, too.