Bug 1225970

Summary: [sle15sp6], update-test-* packages are still seen after GM in repo 'SLE-Module-Basesystem15-SP6-Updates, is it by design?
Product: [openSUSE] PUBLIC SUSE Linux Enterprise Server 15 SP6 Reporter: Richard Fan <richard.fan>
Component: Media ContentAssignee: E-mail List <maint-coord>
Status: VERIFIED INVALID QA Contact: Radoslav Tzvetkov <rtsvetkov>
Severity: Normal    
Priority: P5 - None CC: jpupava, richard.fan, santiago.zarate, slemke
Version: unspecified   
Target Milestone: ---   
Hardware: Other   
OS: Other   
URL: https://openqa.suse.de/tests/14522056/modules/validate_packages_and_patterns/steps/20
Whiteboard:
Found By: openQA Services Priority:
Business Priority: Blocker: Yes
Marketing QA Status: --- IT Deployment: ---

Description Richard Fan 2024-06-05 03:26:12 UTC
## Description

SLE15SP6 is GM now, however, I can still see the below packages:

># zypper se -s update-test
>Refreshing service 'Basesystem_Module_15_SP6_x86_64'.
>Refreshing service 'Containers_Module_15_SP6_x86_64'.
>Refreshing service 'Desktop_Applications_Module_15_SP6_x86_64'.
>Refreshing service 'Development_Tools_Module_15_SP6_x86_64'.
>Refreshing service 'Legacy_Module_15_SP6_x86_64'.
>Refreshing service 'Public_Cloud_Module_15_SP6_x86_64'.
>Refreshing service 'Python_3_Module_15_SP6_x86_64'.
>Refreshing service 'SUSE_Linux_Enterprise_Server_15_SP6_x86_64'.
>Refreshing service 'SUSE_Linux_Enterprise_Workstation_Extension_15_SP6_x86_64'.
>Refreshing service 'Server_Applications_Module_15_SP6_x86_64'.
>Refreshing service 'Web_and_Scripting_Module_15_SP6_x86_64'.
>Loading repository data...
>Reading installed packages...
>
>S | Name                                | Type       | Version         | Arch   | Repository
>--+-------------------------------------+------------+-----------------+--------+------------------------------------
>  | update-test-32bit-pkg               | package    | 5.1-150200.39.1 | x86_64 | SLE-Module-Basesystem15-SP6-Updates
>  | update-test-32bit-pkg-32bit         | package    | 5.1-150200.39.1 | x86_64 | SLE-Module-Basesystem15-SP6-Updates
>  | update-test-affects-package-manager | package    | 5.1-150200.39.1 | x86_64 | SLE-Module-Basesystem15-SP6-Updates
>  | update-test-affects-package-manager | package    | 5.1-150200.37.1 | x86_64 | SLE-Module-Basesystem15-SP6-Updates
>  | update-test-broken                  | package    | 5.1-150200.39.1 | x86_64 | SLE-Module-Basesystem15-SP6-Updates
>  | update-test-broken                  | package    | 5.1-150200.37.1 | x86_64 | SLE-Module-Basesystem15-SP6-Updates
>  | update-test-feature                 | package    | 5.1-150200.39.1 | x86_64 | SLE-Module-Basesystem15-SP6-Updates
>  | update-test-feature                 | package    | 5.1-150200.37.1 | x86_64 | SLE-Module-Basesystem15-SP6-Updates
>  | update-test-interactive             | package    | 5.1-150200.39.1 | x86_64 | SLE-Module-Basesystem15-SP6-Updates
>  | update-test-interactive             | package    | 5.1-150200.37.1 | x86_64 | SLE-Module-Basesystem15-SP6-Updates
>  | update-test-optional                | package    | 5.1-150200.39.1 | x86_64 | SLE-Module-Basesystem15-SP6-Updates
>  | update-test-optional                | package    | 5.1-150200.37.1 | x86_64 | SLE-Module-Basesystem15-SP6-Updates
>  | update-test-reboot-needed           | package    | 5.1-150200.39.1 | x86_64 | SLE-Module-Basesystem15-SP6-Updates
>  | update-test-reboot-needed           | package    | 5.1-150200.37.1 | x86_64 | SLE-Module-Basesystem15-SP6-Updates
>  | update-test-relogin-suggested       | package    | 5.1-150200.39.1 | x86_64 | SLE-Module-Basesystem15-SP6-Updates
>  | update-test-relogin-suggested       | package    | 5.1-150200.37.1 | x86_64 | SLE-Module-Basesystem15-SP6-Updates
>  | update-test-retracted               | package    | 5.1-150200.39.1 | x86_64 | SLE-Module-Basesystem15-SP6-Updates
>  | update-test-retracted               | package    | 5.1-150200.37.1 | x86_64 | SLE-Module-Basesystem15-SP6-Updates
>  | update-test-security                | package    | 5.1-150200.39.1 | x86_64 | SLE-Module-Basesystem15-SP6-Updates
>  | update-test-security                | package    | 5.1-150200.37.1 | x86_64 | SLE-Module-Basesystem15-SP6-Updates
>  | update-test-trivial                 | package    | 5.1-150200.39.1 | x86_64 | SLE-Module-Basesystem15-SP6-Updates
>  | update-test-trivial                 | package    | 5.1-150200.37.1 | x86_64 | SLE-Module-Basesystem15-SP6-Updates
>  | update-test-trivial                 | srcpackage | 5.1-150200.39.1 | noarch | SLE-Module-Basesystem15-SP6-Updates
>  | update-test-trivial                 | srcpackage | 5.1-150200.37.1 | noarch | SLE-Module-Basesystem15-SP6-Updates

Based on our openQA automation tests. the packages above should not available now.

https://openqa.suse.de/tests/14522056/modules/validate_packages_and_patterns/steps/20

># Test died: Package 'update-test-interactive' found in Basesystem repo, this package should not be present.
>Package 'update-test-trivial' found in Basesystem repo, this package should not be present.
>Package 'update-test-security' found in Basesystem repo, this package should not be present.
>Package 'update-test-feature' found in Basesystem repo, this package should not be present.

Can you please double confirm?

1. Will these packages be removed from sle15sp6 repo?
2. In case the packages need to be removed, do we need wait for 15SP6 FCS phase and run this test?

Please feel free to let me know if you need to access my setup and debug.

## openQA automation tests Observation

openQA test in scenario sle-15-SP6-Server-DVD-Updates-x86_64-mau-extratests-zypper@64bit fails in
[validate_packages_and_patterns](https://openqa.suse.de/tests/14522056/modules/validate_packages_and_patterns/steps/20)

## Test suite description
Testsuite maintained at https://gitlab.suse.de/qa-maintenance/qam-openqa-yml. Run console tests against aggregated test repo


## Reproducible

Fails since (at least) Build [20240509-1](https://openqa.suse.de/tests/14263770)


## Expected result

Last good: [20240505-1](https://openqa.suse.de/tests/14209315) (or more recent)


## Further details

Always latest result in this scenario: [latest](https://openqa.suse.de/tests/latest?arch=x86_64&distri=sle&flavor=Server-DVD-Updates&machine=64bit&test=mau-extratests-zypper&version=15-SP6)
Comment 1 Radoslav Tzvetkov 2024-06-28 07:44:32 UTC
Hello Richard,  
Please,
Do not assign bugs to the release team after the GM! The release team is working on products in development.
Comment 3 Sergio Rafael Lemke 2024-07-10 08:48:11 UTC
Hello,

Those where removed on GA level but maintenance still uses those for updates processing lifecycle checks.
We usually don't removed those after they get released.
Maybe for the next product we could release it only to tools-OBS or even Package HUB to cause less noise.

thanks!
Comment 4 Richard Fan 2024-07-10 08:52:13 UTC
(In reply to Sergio Rafael Lemke from comment #3)
> Hello,
> 
> Those where removed on GA level but maintenance still uses those for updates
> processing lifecycle checks.
> We usually don't removed those after they get released.
> Maybe for the next product we could release it only to tools-OBS or even
> Package HUB to cause less noise.
> 
> thanks!

Thanks much! then we can revise our test code.