Bug 1219506

Summary: [Build 50.2] openQA test fails in keyboard_layout_gdm
Product: [openSUSE] PUBLIC SUSE Linux Enterprise Server 15 SP6 Reporter: Michael Grifalconi <mgrifalconi>
Component: BasesystemAssignee: E-mail List <gnome-bugs>
Status: NEW --- QA Contact:
Severity: Normal    
Priority: P2 - High CC: mgrifalconi, qzhao, richard.fan, rtsvetkov, santiago.zarate, swayammitra.tripathy
Version: unspecified   
Target Milestone: ---   
Hardware: Other   
OS: Other   
URL: https://openqa.suse.de/tests/13401845/modules/keyboard_layout_gdm/steps/27
See Also: https://bugzilla.suse.com/show_bug.cgi?id=1216681
Whiteboard:
Found By: openQA Services Priority:
Business Priority: Blocker: No
Marketing QA Status: --- IT Deployment: ---

Description Michael Grifalconi 2024-02-02 13:24:52 UTC
Hello, please help me find the correct component if this is wrong.

The test is setting the keyboard layout to German, rebooting and checking that z and y are inverted.
On Gnome login screen, it works as expected, but on the console it does not.

I changed the test for debug reasons: https://github.com/michaelgrifalconi/os-autoinst-distri-opensuse/blob/39b476b283521fb327d9ef38d154882e45f4c1f1/tests/x11/keyboard_layout_gdm.pm#L39

Now we can see that right after the change, the console works as expected, "qwertz is written as qwerty": https://openqa.suse.de/tests/13412515#step/keyboard_layout_gdm/12

After reboot, gnome login screen works as expected: https://openqa.suse.de/tests/13412515#step/keyboard_layout_gdm/16

But console does not anymore: https://openqa.suse.de/tests/13412515#step/keyboard_layout_gdm/23

This only happens on SLE 15 SP6 aarch64. 
x64 instead, works as expected: https://openqa.suse.de/tests/13394144#step/keyboard_layout_gdm/23


Thanks for checking.
=================================

Generated info below:
## Observation

openQA test in scenario sle-15-SP6-Online-aarch64-extra_tests_gnome@aarch64 fails in
[keyboard_layout_gdm](https://openqa.suse.de/tests/13401845/modules/keyboard_layout_gdm/steps/27)

## Test suite description
Maintainer: QE Core, asmorodskyi. Extra tests which were designed to run on gnome , VNC_STALL_THRESHOLD is needed for xen svirt to don't turn off the scrreen after default 4 sec

New version of extra_tests_on_gnome for yaml scheduling


## Reproducible

Fails since (at least) Build [48.2](https://openqa.suse.de/tests/13338887)


## Expected result

Last good: (unknown) (or more recent)


## Further details

Always latest result in this scenario: [latest](https://openqa.suse.de/tests/latest?arch=aarch64&distri=sle&flavor=Online&machine=aarch64&test=extra_tests_gnome&version=15-SP6)
Comment 1 Swayammitra Tripathy 2024-02-12 14:45:30 UTC
Hello Wang,
Could you look into this bug and update the status
Comment 2 xiaoguang wang 2024-02-18 02:57:57 UTC
Sorry for being late, I’m on my vacation.

Hi @Cliff, could you look at this, I think you are the right person for it.
Comment 3 Cliff Zhao 2024-02-19 01:48:19 UTC
I saw that you set the keyboard through "yast keyboard set layout". but the error happens on the console. they are all not controlled by iBUS. You'd better ask Yast team or systemd maintainer to find the reason.
Gnome's keyboard layout is controlled inside the gnome-control-center-> keyboard. If you setting in this field, but desktop applications displays input characters wrong, it is my bug.
Comment 4 Cliff Zhao 2024-02-21 13:39:39 UTC
Hello Swayammitra:
May I ask why you think this is ibus bug?
I saw you assign it to me without any comment, while I didn't see a obvious reason.
Regards!
Comment 5 Radoslav Tzvetkov 2024-02-22 09:47:29 UTC
Clif, Mitra is new to the SLE development. Perhaps you can help her find the proper assignee next time :) Myself I am not sure of the root cause of the problem and can only guess - I setting it back to the gnome team.
Comment 6 Radoslav Tzvetkov 2024-02-22 09:50:31 UTC
Michael, why is this bug set as a blocker? Is this blocking-bug? That is quite serious and means you cannot work because of this bug - your test suite is completely blocked. 
But I see x86 works as expected! Please correct if needed.
Comment 7 Michael Grifalconi 2024-02-22 11:10:58 UTC
Hello Radoslav, I did not actively selected any flags, I got the default settings from the link you get in openQA to open bugs.

My main goal was to make the test failure visible, since it looks a product bug but I am not sure about the impact on 15 SP6, feel free to change it.
Maybe Santi can pitch in as well
Comment 9 Cliff Zhao 2024-02-29 05:18:03 UTC
(In reply to Radoslav Tzvetkov from comment #5)
> Clif, Mitra is new to the SLE development. Perhaps you can help her find the
> proper assignee next time :) Myself I am not sure of the root cause of the
> problem and can only guess - I setting it back to the gnome team.

Okay, I will do the preliminary analysis work.
Comment 10 Cliff Zhao 2024-02-29 05:30:09 UTC
(In reply to Michael Grifalconi from comment #0)
> Hello, please help me find the correct component if this is wrong.
> 
> The test is setting the keyboard layout to German, rebooting and checking
> that z and y are inverted.
> On Gnome login screen, it works as expected, but on the console it does not.
Hi Michael:
While the bug title is " openQA test fails in keyboard_layout_gdm ", but from your description, the gdm(Gnome login screen), is right, but the console is incorrect.
so the bug title is not fit for the test result. Am I right?

> 
> I changed the test for debug reasons:
> https://github.com/michaelgrifalconi/os-autoinst-distri-opensuse/blob/
> 39b476b283521fb327d9ef38d154882e45f4c1f1/tests/x11/keyboard_layout_gdm.pm#L39
> 
> Now we can see that right after the change, the console works as expected,
> "qwertz is written as qwerty":
> https://openqa.suse.de/tests/13412515#step/keyboard_layout_gdm/12
At this moment, based on the previous comment, the gnome login screen works as expected right?
Thank you!

> After reboot, gnome login screen works as expected:
> https://openqa.suse.de/tests/13412515#step/keyboard_layout_gdm/16
> 
> But console does not anymore:
> https://openqa.suse.de/tests/13412515#step/keyboard_layout_gdm/23
Comment 11 Michael Grifalconi 2024-02-29 07:51:29 UTC
(In reply to Cliff Zhao from comment #10)

Hello Cliff,

the title is automatically generated since the openQA test module that fails, is called "keyboard_layout_gdm".

Test code can be found here: https://openqa.suse.de/tests/13641670/modules/keyboard_layout_gdm/steps/1/src

Latest test run can be seen here: https://openqa.suse.de/tests/latest?arch=aarch64&distri=sle&flavor=Online&machine=aarch64&test=extra_tests_gnome&version=15-SP6#
There is also a video available, issue is near the very end: https://openqa.suse.de/tests/13641670/video?filename=video.webm

And yes, the problem is the one stated in the first lines of my first comment: 
The test is setting the keyboard layout to German, rebooting and checking that z and y are inverted.
On Gnome login screen, it works as expected, but on the console it does not.

Please feel free to change the title with something you feel more correct or I can do that on your request.

Thanks!
Comment 12 Cliff Zhao 2024-03-14 13:57:54 UTC
Hi Michael:
Finnally, I downloaded the 15-SP6 iso, and manully re-test it.
I didn't run the script(changekbd.sh), I just login to the tty after I set keyboard to German, reboot and login. I saw the keyboard layout is german charactors as expection. I doubt if the script or testcase need update? My 15-SP6 ISO is SLE-15-SP6-Full-x86_64-PublicBeta-202403-Media1.iso.
This test is related with yast tool, but before we sent the issue to them, we should check the error is still there. Please help me take a look. Thank you so much!
Comment 13 Michael Grifalconi 2024-03-15 14:53:20 UTC
Hello Cliff, thanks for looking into it.

In the first message there is a link for 'Always latest result in this scenario' and the latest from few hours ago is still failing: https://openqa.suse.de/tests/13782972#step/keyboard_layout_gdm/28

Can you confirm that when you tested, you:
- logged in, from console changed to German
- reboot, Gnome login is good (also in the test)
- switch to console and check if also good >> This is where the test fails

I will try to manually reproduce it on Monday and provide more info!
Comment 14 Michael Grifalconi 2024-03-18 14:37:17 UTC
Hello, on x86 is not reproducible which makes sense since the test fails only on aarch64:

x86 latest run: https://openqa.suse.de/tests/13792590
aarch64 latest run: https://openqa.suse.de/tests/13810417#step/keyboard_layout_gdm/28
Comment 15 Cliff Zhao 2024-03-21 08:30:51 UTC
(In reply to Michael Grifalconi from comment #14)
> Hello, on x86 is not reproducible which makes sense since the test fails
> only on aarch64:
> 
> x86 latest run: https://openqa.suse.de/tests/13792590
> aarch64 latest run:
> https://openqa.suse.de/tests/13810417#step/keyboard_layout_gdm/28

I want to say that, I mean the current situation is you and I could not reproduce the case with the manual test, but the openQA test failed, which indicates that the test case has problems. it's better to contact the case maintainer to fix it first. When this test case runs correctly in the x86_64 platform, it is valuable to check other hardware platforms. Thank you!