Bug 1220316 - [Build 58.1] openQA test fails in firefox, journal log 'app-gnome-firefox-24343.scope: Failed with result 'oom-kill'.'
Summary: [Build 58.1] openQA test fails in firefox, journal log 'app-gnome-firefox-24...
Status: VERIFIED FIXED
Alias: None
Product: PUBLIC SUSE Linux Enterprise Server 15 SP6
Classification: openSUSE
Component: GNOME (show other bugs)
Version: unspecified
Hardware: aarch64 Other
: P2 - High : Major
Target Milestone: ---
Assignee: E-mail List
QA Contact:
URL: https://openqa.suse.de/tests/13602468...
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2024-02-26 08:47 UTC by Richard Fan
Modified: 2024-03-27 08:57 UTC (History)
8 users (show)

See Also:
Found By: openQA
Services Priority:
Business Priority:
Blocker: Yes
Marketing QA Status: ---
IT Deployment: ---


Attachments
journal log (908.33 KB, text/x-log)
2024-02-26 08:47 UTC, Richard Fan
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Richard Fan 2024-02-26 08:47:35 UTC
Created attachment 872987 [details]
journal log

##

The firefox test failed due to OOM even with 4GB memory, please see attached file for detail journal log.

## Observation

openQA test in scenario sle-15-SP6-Online-aarch64-gnome+proxy_SCC+allmodules@aarch64 fails in
[firefox](https://openqa.suse.de/tests/13602468/modules/firefox/steps/21)

## Test suite description
Testsuite maintained at https://gitlab.suse.de/qa-maintenance/qam-openqa-yml. Maintainers: QE Core, jrauch
Install all module which are available through ProxySCC
Install as patterns during installation.


## Reproducible

Fails since (at least) Build [58.1](https://openqa.suse.de/tests/13581917)


## Expected result

Last good: [57.1](https://openqa.suse.de/tests/13547538) (or more recent)


## Further details

Always latest result in this scenario: [latest](https://openqa.suse.de/tests/latest?arch=aarch64&distri=sle&flavor=Online&machine=aarch64&test=gnome%2Bproxy_SCC%2Ballmodules&version=15-SP6)
Comment 2 Santiago Zarate 2024-02-26 10:15:40 UTC
bsc#1219359 is also visible in the logs
Comment 3 Radoslav Tzvetkov 2024-02-26 11:01:25 UTC
Can you tell why this bug is blocker and major?
Comment 4 Santiago Zarate 2024-02-26 12:23:17 UTC
(In reply to Radoslav Tzvetkov from comment #3)
> Can you tell why this bug is blocker and major?

Rado, the "Blocker" here means: "Tests cannot continue", so if we were to trigger the full firefox tests, they would not be able to be performed.

It has severity Major because at this stage, a core dump is bad anywhere.

Note that the `SHIP_STOPPER` flag is not set and it isn't a ship stopper (for now).
Comment 7 Richard Fan 2024-03-06 09:14:32 UTC
The issue is still seen with the latest build.

https://openqa.suse.de/tests/13711420
Comment 8 Radoslav Tzvetkov 2024-03-18 10:40:16 UTC
Please retest with the Build64.2
Comment 9 Radoslav Tzvetkov 2024-03-18 10:45:12 UTC
Hello, Gnome team. What is the status of this?
Comment 10 Jia Zhaocong 2024-03-18 11:03:36 UTC
First, this only happens in aarch64.  And this only happen on the "allmodules" installation, not the default gnome install. (@Richard, correct me if I'm wrong.)

The test link has 1GB RAM, but it also fails with 4GB RAM.

I use VNC to login a testing machine in openqa, find that it is not firefox that runs out of memory, but it is "speech-dispatcher".

Not sure how the firefox pulls up "speech-dispatcher" yet.
Comment 12 Richard Fan 2024-03-19 01:31:02 UTC
(In reply to Radoslav Tzvetkov from comment #8)
> Please retest with the Build64.2

The issue can be reproduced with build64.2:

https://openqa.suse.de/tests/13810432#step/firefox/14
Comment 13 Richard Fan 2024-03-19 02:14:08 UTC
(In reply to Jia Zhaocong from comment #10)
> First, this only happens in aarch64.  And this only happen on the
> "allmodules" installation, not the default gnome install. (@Richard, correct
> me if I'm wrong.)
> 
> The test link has 1GB RAM, but it also fails with 4GB RAM.
> 
> I use VNC to login a testing machine in openqa, find that it is not firefox
> that runs out of memory, but it is "speech-dispatcher".
> 
> Not sure how the firefox pulls up "speech-dispatcher" yet.

Thanks Zhaocong,

The issue can be found with default module as well, see https://progress.opensuse.org/issues/156022 and https://progress.opensuse.org/issues/157327. 

The same job can pass if I don't schedule `firefox` test module.
Comment 14 Jia Zhaocong 2024-03-19 04:05:22 UTC
https://openqa.suse.de/tests/13810428#step/firefox/22

Fails on S390x as well.

Let's see if a newer version of speech-dispatcher fixes this.
Comment 15 Jia Zhaocong 2024-03-21 01:27:36 UTC
https://openqa.suse.de/tests/13828729#step/firefox/18

Passed in latest build 67.1.
Comment 16 Guillaume GARDET 2024-03-27 08:20:28 UTC
(In reply to Jia Zhaocong from comment #15)
> https://openqa.suse.de/tests/13828729#step/firefox/18
> 
> Passed in latest build 67.1.

Set to Fixed
Comment 17 Richard Fan 2024-03-27 08:57:27 UTC
Thanks all, the job is green now

https://openqa.suse.de/tests/13876130#next_previous