Bug 1223624

Summary: [Build 20240501] podman bats user integration fails test suites
Product: [openSUSE] openSUSE Tumbleweed Reporter: Dominique Leuenberger <dimstar>
Component: OtherAssignee: Danish Prakash <danish.prakash>
Status: NEW --- QA Contact: E-mail List <qa-bugs>
Severity: Normal    
Priority: P5 - None CC: guillaume.gardet, rbranco
Version: Current   
Target Milestone: ---   
Hardware: Other   
OS: Other   
URL: https://openqa.opensuse.org/tests/4145118/modules/bats-user-local_tap/steps/47
Whiteboard:
Found By: openQA Services Priority:
Business Priority: Blocker: Yes
Marketing QA Status: --- IT Deployment: ---

Description Dominique Leuenberger 2024-05-02 07:59:12 UTC
## Observation

Since the latest changes, the tests look better, but not yet completely fixed.
Theese are the current failures:

bats-user-local:

not ok 47 [012] manifest list --add --artifact
# (from function `run_podman' in file test/system/helpers.bash, line 416,
#  from function `manifestListAddArtifactOnce' in file test/system/012-manifest.bats, line 167,
#  in test file test/system/012-manifest.bats, line 262)
#   `manifestListAddArtifactOnce' failed

not ok 367 [200] podman pod cleans cgroup and keeps limits
# (in test file test/system/200-pod.bats, line 750)
#   `assert "$(< $memory_limit_file)" = "268435456" "Contents of $memory_limit_file"' failed


not ok 378 [252] quadlet - basic
# (from function `bail-now' in file test/system/helpers.bash, line 235,
#  from function `assert' in file test/system/helpers.bash, line 929,
#  in test file test/system/252-quadlet.bats, line 174)
#   `assert "$output" == "STARTED CONTAINER" "exact/full match when using the 'passthrough' driver"' failed


not ok 427 [280] podman update - test all options
# tags: distro-integration
# (from function `bail-now' in file test/system/helpers.bash, line 235,
#  from function `die' in file test/system/helpers.bash, line 813,
#  from function `run_podman' in file test/system/helpers.bash, line 423,
#  in test file test/system/280-update.bats, line 109)
#   `run_podman update "${opts[@]}" $cid' failed


not ok 499 [505] No IPv4
# (from function `bail-now' in file test/system/helpers.bash, line 235,
#  from function `die' in file test/system/helpers.bash, line 813,
#  from function `run_podman' in file test/system/helpers.bash, line 423,
#  in test file test/system/505-networking-pasta.bats, line 271)
#   `run_podman run --net=pasta:-6 $IMAGE ip -j -4 address show' failed


not ok 506 [505] IPv6 default route
# (from function `bail-now' in file test/system/helpers.bash, line 235,
#  from function `assert' in file test/system/helpers.bash, line 929,
#  in test file test/system/505-networking-pasta.bats, line 363)
#   `assert "${container_route}" = "${host_route}" \' failed


openQA test in scenario opensuse-Tumbleweed-DVD-x86_64-containers_host_podman_testsuite@64bit fails in
[bats-user-local_tap](https://openqa.opensuse.org/tests/4145118/modules/bats-user-local_tap/steps/47)

## Test suite description
Maintainer: dheidler. Extra tests about CLI software in container module
2023-08-10/dimstar: added QEMURAM=2048 (boo#1212824)


## Reproducible

Fails since (at least) Build [20240308](https://openqa.opensuse.org/tests/3999689)


## Expected result

Last good: [20240307](https://openqa.opensuse.org/tests/3997809) (or more recent)


## Further details

Always latest result in this scenario: [latest](https://openqa.opensuse.org/tests/latest?arch=x86_64&distri=opensuse&flavor=DVD&machine=64bit&test=containers_host_podman_testsuite&version=Tumbleweed)