Bug 1218937

Summary: [Build 20240117-1] openQA test fails in podman_firewall
Product: [openSUSE] PUBLIC SUSE Linux Enterprise Server 15 SP5 Reporter: Pablo Herranz Ramírez <pablo.herranz>
Component: ContainersAssignee: Containers Team <containers-bugowner>
Status: RESOLVED INVALID QA Contact:
Severity: Critical    
Priority: P1 - Urgent CC: anton.smorodskyi, danish.prakash
Version: unspecified   
Target Milestone: ---   
Hardware: Other   
OS: Other   
URL: https://openqa.suse.de/tests/13275440/modules/podman_firewall/steps/41
Whiteboard:
Found By: openQA Services Priority:
Business Priority: Blocker: Yes
Marketing QA Status: --- IT Deployment: ---

Description Pablo Herranz Ramírez 2024-01-18 08:09:25 UTC 
## Observation

openQA test in scenario sle-15-SP5-Server-DVD-Updates-aarch64-podman_tests@aarch64-virtio fails in
[podman_firewall](https://openqa.suse.de/tests/13275440/modules/podman_firewall/steps/41)

## Test suite description
The base test suite is used for job templates defined in YAML documents. It has no settings of its own.


## Reproducible

Fails since (at least) Build [20240117-1](https://openqa.suse.de/tests/13275268)


## Expected result

Last good: [20240116-1](https://openqa.suse.de/tests/13269027) (or more recent)


## Further details

Always latest result in this scenario: [latest](https://openqa.suse.de/tests/latest?arch=aarch64&distri=sle&flavor=Server-DVD-Updates&machine=aarch64-virtio&test=podman_tests&version=15-SP5)


Looks like a problem with CNI again:

```
# wait_serial expected: qr/~xHDp-\d+-/u
# Result:

[33mWARN[0m[0000] Failed to load cached network config: network podman not found in CNI cache, falling back to loading network podman from disk 
[33mWARN[0m[0000] 1 error occurred:
	* plugin type="tuning" failed (delete): failed to find plugin "tuning" in path [/usr/lib/cni]
 
Error: plugin type="bridge" failed (add): failed to find plugin "bridge" in path [/usr/lib/cni]
~xHDp-126-
```
Comment 1 Pablo Herranz Ramírez 2024-01-18 10:01:52 UTC 
After removing `podman_netavark` module the result is:

```
# Test died: script failed with : 
MP~iw
Device "cni-podman0" does not exist.
SCRIPT_FINISHEDMP~iw-1- at /usr/lib/os-autoinst/distribution.pm line 303.
	distribution::script_output(Distribution::Sle::15_current=HASH(0x560847f20b80), "ip a s cni-podman0", "type_command", undef, "timeout", undef, "quiet", 1, ...) called at /usr/lib/os-autoinst/testapi.pm line 1100
	testapi::script_output("ip a s cni-podman0", "timeout", undef, "quiet", 1, "type_command", undef, "proceed_on_failure", ...) called at /usr/lib/os-autoinst/testapi.pm line 1192
	testapi::validate_script_output("ip a s cni-podman0", CODE(0x560848370708)) called at /var/lib/openqa/pool/24/os-autoinst-distri-opensuse/tests/containers/podman_firewall.pm line 39
	podman_firewall::run(podman_firewall=HASH(0x560848370000)) called at /usr/lib/os-autoinst/basetest.pm line 352
	eval {...} called at /usr/lib/os-autoinst/basetest.pm line 346
	basetest::runtest(podman_firewall=HASH(0x560848370000)) called at /usr/lib/os-autoinst/autotest.pm line 415
	eval {...} called at /usr/lib/os-autoinst/autotest.pm line 415
	autotest::runalltests() called at /usr/lib/os-autoinst/autotest.pm line 272
	eval {...} called at /usr/lib/os-autoinst/autotest.pm line 272
	autotest::run_all() called at /usr/lib/os-autoinst/autotest.pm line 323
	autotest::__ANON__(Mojo::IOLoop::ReadWriteProcess=HASH(0x560849045020)) called at /usr/lib/perl5/vendor_perl/5.26.1/Mojo/IOLoop/ReadWriteProcess.pm line 329
	eval {...} called at /usr/lib/perl5/vendor_perl/5.26.1/Mojo/IOLoop/ReadWriteProcess.pm line 329
	Mojo::IOLoop::ReadWriteProcess::_fork(Mojo::IOLoop::ReadWriteProcess=HASH(0x560849045020), CODE(0x56084991d800)) called at /usr/lib/perl5/vendor_perl/5.26.1/Mojo/IOLoop/ReadWriteProcess.pm line 492
	Mojo::IOLoop::ReadWriteProcess::start(Mojo::IOLoop::ReadWriteProcess=HASH(0x560849045020)) called at /usr/lib/os-autoinst/autotest.pm line 325
	autotest::start_process() called at /usr/lib/os-autoinst/OpenQA/Isotovideo/Runner.pm line 94
	OpenQA::Isotovideo::Runner::start_autotest(OpenQA::Isotovideo::Runner=HASH(0x560842f6bcf8)) called at /usr/bin/isotovideo line 192
	eval {...} called at /usr/bin/isotovideo line 181
```
Comment 2 Pablo Herranz Ramírez 2024-01-18 10:20:13 UTC 
https://openqa.suse.de/tests/13276663#step/podman_firewall/43
Comment 4 Pablo Herranz Ramírez 2024-01-19 08:03:31 UTC 
The PR has been merged with the VR failed, and it has caused lots of tests to fail today:

https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/18480
Comment 5 Anton Smorodskyi 2024-01-19 10:14:56 UTC 
It appears to be a test issue