Bug 1214592

Summary: [virtualization][factory-first] The repository of NVIDIA is not accessible, failed to validate metadata and load modules during unified_guest_installation XEN and KVM
Product: [openSUSE] openSUSE Tumbleweed Reporter: Varun Kumar Ojha <varun.ojha>
Component: OtherAssignee: E-mail List <screening-team-bugs>
Status: RESOLVED WORKSFORME QA Contact: E-mail List <qa-bugs>
Severity: Normal    
Priority: P5 - None CC: chcao, jcao, qe-virt, santiago.zarate, varun.ojha
Version: CurrentFlags: chcao: needinfo? (varun.ojha)
Target Milestone: ---   
Hardware: x86-64   
OS: openSUSE Tumbleweed   
See Also: https://bugzilla.suse.com/show_bug.cgi?id=1181941
Whiteboard:
Found By: --- Services Priority:
Business Priority: Blocker: ---
Marketing QA Status: --- IT Deployment: ---
Attachments: supportconfig_logs

Description Varun Kumar Ojha 2023-08-24 15:19:05 UTC
Created attachment 868995 [details]
supportconfig_logs

## Description 

The problem arises due to the NVIDIA repository being inaccessible, leading to the failure of metadata validation and module loading within the XEN and KVM environments. 

It appears that the issue is related to a network glitch. On the system "rebel:6," there is a GPU card installed, and certain NVIDIA kernel modules are loaded during system boot. Additionally, an NVIDIA repository has been added at some point.

Upon running the command zypper lr -u, the repository information is listed, including the NVIDIA repository (NVIDIA:repo-non-free) which is accessible at https://download.nvidia.com/opensuse/tumbleweed/.

The repository is available after the test fails. It seems likely that this is an 
issue with the Nvidia repository: Trust and accessibility. The problem persists and is 100% reproducible, we may need to investigate further to determine why the NVIDIA repository is not accessible. In such a case, we could consider reaching out to NVIDIA for assistance in resolving the repository accessibility issue.

For the time being, we have considered halting the loading of NVIDIA modules or packages during system boot until the repository accessibility issue is resolved. This would help ensure the stability of the system while addressing the repository-related problem.

## Test suite description
Conduct autoyast installation and test fails at the unified guest installation.

It seems that the issue is related to the accessibility of the NVIDIA repository, which is affecting the unified guest installation process. The repository verification is failing, possibly due to a temporary network glitch or issues related to the GPU card and its associated modules.

Here's a summarized overview of the situation:

Issue: The NVIDIA repository (NVIDIA:repo-non-free) is not accessible during the unified guest installation process.

Symptoms: Certain NVIDIA kernel modules are loaded during system boot, and there seems to be a network glitch that prevents the repository from being accessed during the test.

Failed Test: The test case is failing with the error message: 'zypper -n in rsyslog' failed with code 106.

Failed zypper logs: The logs indicate that the repository's metadata cannot be validated, and the repository URL (https://download.nvidia.com/opensuse/tumbleweed/) is not accessible at certain points.

## Error and log
# Test died: 'zypper -n in rsyslog' failed with code 106

Related zypper logs:
2023-08-24 04:03:03 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186 MediaCurl.cc(evaluateCurlCode):895 THROW:    File '/media.1/media' not found on medium 'https://download.nvidia.com/opensuse/tumbleweed/'
2023-08-24 04:03:03 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186 MediaCurl.cc(doGetFileCopyFile):1281 RETHROW:  File '/media.1/media' not found on medium 'https://download.nvidia.com/opensuse/tumbleweed/'
2023-08-24 04:03:03 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186 MediaMultiCurl.cc(doGetFileCopy):1381 RETHROW:  File '/media.1/media' not found on medium 'https://download.nvidia.com/opensuse/tumbleweed/'
2023-08-24 04:03:03 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186 MediaCurl.cc(getFileCopy):783 RETHROW:  File '/media.1/media' not found on medium 'https://download.nvidia.com/opensuse/tumbleweed/'
2023-08-24 04:03:03 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186 MediaSetAccess.cc(provide):288 CAUGHT:   File '/media.1/media' not found on medium 'https://download.nvidia.com/opensuse/tumbleweed/'
2023-08-24 04:03:03 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186 MediaSetAccess.cc(provide):321 RETHROW:  File '/media.1/media' not found on medium 'https://download.nvidia.com/opensuse/tumbleweed/'
2023-08-24 04:03:03 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186 Fetcher.cc(provideToDest):564 CAUGHT:   File '/media.1/media' not found on medium 'https://download.nvidia.com/opensuse/tumbleweed/'
2023-08-24 04:03:03 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186 FileChecker.cc(operator()):135 THROW:    Signature verification failed for repomd.xml
2023-08-24 04:03:03 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186 Fetcher.cc(provideToDest):571 RETHROW:  Signature verification failed for repomd.xml
2023-08-24 04:03:03 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186 History:
2023-08-24 04:03:03 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186  - Can't provide /repodata/repomd.xml
2023-08-24 04:03:03 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186 
2023-08-24 04:03:03 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186 RepoManager.cc(refreshMetadata):1273 CAUGHT:   Signature verification failed for repomd.xml
2023-08-24 04:03:03 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186 History:
2023-08-24 04:03:03 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186  - Can't provide /repodata/repomd.xml
2023-08-24 04:03:03 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186 
2023-08-24 04:03:03 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186 RepoManager.cc(refreshMetadata):1287 THROW:    [NVIDIA:repo-non-free|https://download.nvidia.com/opensuse/tumbleweed/] Valid metadata not found at specified URL
2023-08-24 04:03:03 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186 History:
2023-08-24 04:03:03 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186  - Signature verification failed for repomd.xml
2023-08-24 04:03:03 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186  - Can't provide /repodata/repomd.xml
2023-08-24 04:03:03 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186 
2023-08-24 04:03:03 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186 repos.cc(refresh_raw_metadata):384 CAUGHT:   [NVIDIA:repo-non-free|https://download.nvidia.com/opensuse/tumbleweed/] Valid metadata not found at specified URL
2023-08-24 04:03:03 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186 History:
2023-08-24 04:03:03 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186  - Signature verification failed for repomd.xml
2023-08-24 04:03:03 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186  - Can't provide /repodata/repomd.xml
2023-08-24 04:03:03 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186 
2023-08-24 04:03:03 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186 MediaCurl.cc(evaluateCurlCode):895 THROW:    File '/media.1/media' not found on medium 'http://codecs.opensuse.org/openh264/openSUSE_Tumbleweed'
2023-08-24 04:03:03 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186 MediaCurl.cc(doGetFileCopyFile):1281 RETHROW:  File '/media.1/media' not found on medium 'http://codecs.opensuse.org/openh264/openSUSE_Tumbleweed'
2023-08-24 04:03:03 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186 MediaMultiCurl.cc(doGetFileCopy):1381 RETHROW:  File '/media.1/media' not found on medium 'http://codecs.opensuse.org/openh264/openSUSE_Tumbleweed'
2023-08-24 04:03:03 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186 MediaCurl.cc(getFileCopy):783 RETHROW:  File '/media.1/media' not found on medium 'http://codecs.opensuse.org/openh264/openSUSE_Tumbleweed'
2023-08-24 04:03:03 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186 MediaSetAccess.cc(provide):288 CAUGHT:   File '/media.1/media' not found on medium 'http://codecs.opensuse.org/openh264/openSUSE_Tumbleweed'
2023-08-24 04:03:03 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186 MediaSetAccess.cc(provide):321 RETHROW:  File '/media.1/media' not found on medium 'http://codecs.opensuse.org/openh264/openSUSE_Tumbleweed'
2023-08-24 04:03:03 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186 Fetcher.cc(provideToDest):564 CAUGHT:   File '/media.1/media' not found on medium 'http://codecs.opensuse.org/openh264/openSUSE_Tumbleweed'
2023-08-24 04:03:09 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186 MediaCurl.cc(evaluateCurlCode):895 THROW:    File '/media.1/media' not found on medium 'http://cdn.opensuse.org/update/tumbleweed/'
2023-08-24 04:03:09 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186 MediaCurl.cc(doGetFileCopyFile):1281 RETHROW:  File '/media.1/media' not found on medium 'http://cdn.opensuse.org/update/tumbleweed/'
2023-08-24 04:03:09 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186 MediaMultiCurl.cc(doGetFileCopy):1381 RETHROW:  File '/media.1/media' not found on medium 'http://cdn.opensuse.org/update/tumbleweed/'
2023-08-24 04:03:09 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186 MediaCurl.cc(getFileCopy):783 RETHROW:  File '/media.1/media' not found on medium 'http://cdn.opensuse.org/update/tumbleweed/'
2023-08-24 04:03:09 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186 MediaSetAccess.cc(provide):288 CAUGHT:   File '/media.1/media' not found on medium 'http://cdn.opensuse.org/update/tumbleweed/'
2023-08-24 04:03:09 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186 MediaSetAccess.cc(provide):321 RETHROW:  File '/media.1/media' not found on medium 'http://cdn.opensuse.org/update/tumbleweed/'
2023-08-24 04:03:09 <5> amd-zen2-gpu-sut1(2650) [zypp-core] Exception.cc(log):186 Fetcher.cc(provideToDest):564 CAUGHT:   File '/media.1/media' not found on medium 'http://cdn.opensuse.org/update/tumbleweed/' at opensuse/lib/utils.pm line 675.
	utils::zypper_call("in rsyslog") called at opensuse/lib/virt_autotest/utils.pm line 778
	virt_autotest::utils::setup_rsyslog_host("/var/log/guest_installation_and_configuration") called at opensuse/lib/guest_installation_and_configuration_base.pm line 409
	guest_installation_and_configuration_base::prepare_non_transactional_environment(unified_guest_installation=HASH(0x5564fadb7ca8)) called at opensuse/lib/guest_installation_and_configuration_base.pm line 386
	guest_installation_and_configuration_base::prepare_common_environment(unified_guest_installation=HASH(0x5564fadb7ca8)) called at opensuse/lib/guest_installation_and_configuration_base.pm line 1695
	guest_installation_and_configuration_base::prepare_guest_installation(unified_guest_installation=HASH(0x5564fadb7ca8)) called at opensuse/lib/guest_installation_and_configuration_base.pm line 1683
	guest_installation_and_configuration_base::guest_installation_run(unified_guest_installation=HASH(0x5564fadb7ca8)) called at opensuse/lib/concurrent_guest_installations.pm line 113
	concurrent_guest_installations::install_guest_instances(unified_guest_installation=HASH(0x5564f9b27040)) called at opensuse/lib/concurrent_guest_installations.pm line 263
	concurrent_guest_installations::concurrent_guest_installations_run(unified_guest_installation=HASH(0x5564f9b27040), HASH(0x5564f9b48ff8)) called at opensuse/tests/virt_autotest/unified_guest_installation.pm line 102
	unified_guest_installation::run(unified_guest_installation=HASH(0x5564f9b27040)) called at /usr/lib/os-autoinst/basetest.pm line 352
	eval {...} called at /usr/lib/os-autoinst/basetest.pm line 346
	basetest::runtest(unified_guest_installation=HASH(0x5564f9b27040)) called at /usr/lib/os-autoinst/autotest.pm line 397
	eval {...} called at /usr/lib/os-autoinst/autotest.pm line 397
	autotest::runalltests() called at /usr/lib/os-autoinst/autotest.pm line 254
	eval {...} called at /usr/lib/os-autoinst/autotest.pm line 254
	autotest::run_all() called at /usr/lib/os-autoinst/autotest.pm line 305
	autotest::__ANON__(Mojo::IOLoop::ReadWriteProcess=HASH(0x5564fa235b30)) called at /usr/lib/perl5/vendor_perl/5.26.1/Mojo/IOLoop/ReadWriteProcess.pm line 326
	eval {...} called at /usr/lib/perl5/vendor_perl/5.26.1/Mojo/IOLoop/ReadWriteProcess.pm line 326
	Mojo::IOLoop::ReadWriteProcess::_fork(Mojo::IOLoop::ReadWriteProcess=HASH(0x5564fa235b30), CODE(0x5564fa453ff8)) called at /usr/lib/perl5/vendor_perl/5.26.1/Mojo/IOLoop/ReadWriteProcess.pm line 489
	Mojo::IOLoop::ReadWriteProcess::start(Mojo::IOLoop::ReadWriteProcess=HASH(0x5564fa235b30)) called at /usr/lib/os-autoinst/autotest.pm line 307
	autotest::start_process() called at /usr/lib/os-autoinst/OpenQA/Isotovideo/Runner.pm line 94
	OpenQA::Isotovideo::Runner::start_autotest(OpenQA::Isotovideo::Runner=HASH(0x5564f2809540)) called at /usr/bin/isotovideo line 133
	eval {...} called at /usr/bin/isotovideo line 122

## Reproducibility

100%

## Expected result

Last good: (unknown) (or more recent) 
The last good result was before build: 20230811, The issue is seen after this build (20230811) and on all recent builds.

Failed Tests on machine: https://openqa.opensuse.org/admin/workers/578

Snapshots:
KVM
https://openqa.opensuse.org/tests/3501984#step/unified_guest_installation/183
https://openqa.opensuse.org/tests/3520378#step/unified_guest_installation/181
https://openqa.opensuse.org/tests/3520682#step/unified_guest_installation/183

XEN:
https://openqa.opensuse.org/tests/3520683#step/unified_guest_installation/169
https://openqa.opensuse.org/tests/3523493#step/unified_guest_installation/169
https://openqa.opensuse.org/tests/3518993#step/unified_guest_installation/169

## Reproduce steps
1. Install Opensuse TW on a recent build
2. After the boot the repo is not available and `zypper -n in rsyslog` has errors 


## Steps to see Nvidia issue and workaround
amd-zen2-gpu-sut1:~ # lspci | grep NVIDIA
21:00.0 3D controller: NVIDIA Corporation GA102GL [A10] (rev a1)

lsmod|grep nvidia
nvidia_drm             94208  0
nvidia_modeset       1794048  1 nvidia_drm
nvidia_uvm           3608576  0
nvidia               8761344  2 nvidia_uvm,nvidia_modeset
video                  77824  2 dell_wmi,nvidia_modeset

 zypper lr -u1
Repository priorities are without effect. All enabled repositories share the same priority.

# | Alias                      | Name                | Enabled | GPG Check | Refresh | URI
--+----------------------------+---------------------+---------+-----------+---------+------------------------------------------------------------------------------
1 | NVIDIA:repo-non-free       | repo-non-free       | Yes     | ( p) Yes  | Yes     | https://download.nvidia.com/opensuse/tumbleweed/

 zypper -n in rsyslog
Refreshing service 'NVIDIA'.
Refreshing service 'openSUSE'.

New repository or package signing key received:

  Repository:       repo-non-free
  Key Fingerprint:  9B76 3D49 D8A5 C892 FC17 8BAC F511 3243 C66B 6EAE
  Key Name:         NVIDIA Corporation <linux-bugs@nvidia.com>
  Key Algorithm:    DSA 1024
  Key Created:      Thu Jun 15 12:13:18 2006
  Key Expires:      (does not expire)
  Subkey:           F016EEAA03224CDD 2006-06-15 [does not expire]
  Rpm Name:         gpg-pubkey-c66b6eae-4491871e



    Note: Signing data enables the recipient to verify that no modifications occurred after the data
    were signed. Accepting data with no, wrong or unknown signature can lead to a corrupted system
    and in extreme cases even to a system compromise.

    Note: A GPG pubkey is clearly identified by its fingerprint. Do not rely on the key's name. If
    you are not sure whether the presented key is authentic, ask the repository provider or check
    their web site. Many providers maintain a web page showing the fingerprints of the GPG keys they
    are using.

Do you want to reject the key, trust temporarily, or trust always? [r/t/a/?] (r): r
Retrieving repository 'repo-non-free' metadata .....................................................................................................................[error]
Repository 'repo-non-free' is invalid.
[NVIDIA:repo-non-free|https://download.nvidia.com/opensuse/tumbleweed/] Valid metadata not found at specified URL
History:
 - Signature verification failed for repomd.xml
 - Can't provide /repodata/repomd.xml

Please check if the URIs defined for this repository are pointing to a valid repository.
Warning: Skipping repository 'repo-non-free' because of the above error.
Some of the repositories have not been refreshed because of an error.
Loading repository data...
Reading installed packages...
'rsyslog' is already installed.
No update candidate for 'rsyslog-8.2306.0-1.2.x86_64'. The highest available version is already installed.
Resolving package dependencies...
Nothing to do.




test the url with curl
 curl https://download.nvidia.com/opensuse/tumbleweed/
<!-- Auto-generated directory index; do not edit -->
<!-- Generated on Thu Jul 20 04:29:40 PM UTC 2023 -->
<!doctype html>
<html lang="en">
<head>
  <meta charset="utf-8" />
  <title>Index of /opensuse/tumbleweed</title>
  <link rel='stylesheet' type='text/css'
        href='../../style/directory_listing.css' />
</head>
<body>
  <h1>Index of /opensuse/tumbleweed</h1>
  <ul class='directorycontents'>
    <li>
      <span class='dir'><a href='..'>..</a></span>
    </li>
    <li>
      <span class='file'><a href='NVIDIA-LICENSE'>NVIDIA-LICENSE</a></span>
      <span class='size'>8.0KB</span>
      <span class='date'>2023-07-20 16:06</span>
    </li>
    <li>
      <span class='dir'><a href='aarch64/'>aarch64/</a></span>
    </li>
    <li>
      <span class='dir'><a href='i586/'>i586/</a></span>
    </li>
    <li>
      <span class='dir'><a href='repodata/'>repodata/</a></span>
    </li>
    <li>
      <span class='dir'><a href='x86_64/'>x86_64/</a></span>
    </li>
  </ul>
</body>
</html>


Finally trust the repo 
zypper ref

New repository or package signing key received:

  Repository:       repo-non-free
  Key Fingerprint:  9B76 3D49 D8A5 C892 FC17 8BAC F511 3243 C66B 6EAE
  Key Name:         NVIDIA Corporation <linux-bugs@nvidia.com>
  Key Algorithm:    DSA 1024
  Key Created:      Thu Jun 15 12:13:18 2006
  Key Expires:      (does not expire)
  Subkey:           F016EEAA03224CDD 2006-06-15 [does not expire]
  Rpm Name:         gpg-pubkey-c66b6eae-4491871e



    Note: Signing data enables the recipient to verify that no modifications occurred after the data
    were signed. Accepting data with no, wrong or unknown signature can lead to a corrupted system
    and in extreme cases even to a system compromise.

    Note: A GPG pubkey is clearly identified by its fingerprint. Do not rely on the key's name. If
    you are not sure whether the presented key is authentic, ask the repository provider or check
    their web site. Many providers maintain a web page showing the fingerprints of the GPG keys they
    are using.

Do you want to reject the key, trust temporarily, or trust always? [r/t/a/?] (r): a
Retrieving repository 'repo-non-free' metadata ......................................................................................................................[done]
Building repository 'repo-non-free' cache ...........................................................................................................................[done]
Repository 'openSUSE-20230822-0' is up to date.                                                                                                                            
Repository 'repo-non-oss' is up to date.                                                                                                                                   
Repository 'repo-openh264' is up to date.                                                                                                                                  
Repository 'repo-oss' is up to date.                                                                                                                                       
Repository 'update-tumbleweed' is up to date.                                                                                                                              
All repositories have been refreshed.
amd-zen2-gpu-sut1:~ # zypper -n in rsyslog
Refreshing service 'NVIDIA'.
Refreshing service 'openSUSE'.
Loading repository data...
Reading installed packages...
'rsyslog' is already installed.
No update candidate for 'rsyslog-8.2306.0-1.2.x86_64'. The highest available version is already installed.
Resolving package dependencies...
Nothing to do.



## Workaround 

Disable the Nvidia repo in the test script as a workaround until the bug is fixed
1 | NVIDIA:repo-non-free       | repo-non-free       | Yes     | (r ) Yes  | Yes     | https://download.nvidia.com/opensuse/tumbleweed/

sut:~ # zypper mr -d repo-non-free
Repository 'NVIDIA:repo-non-free' has been successfully disabled.


## Environment(optional)

amd-zen2-gpu-sut1:~ # uname -a
Linux amd-zen2-gpu-sut1 6.4.11-1-default #1 SMP PREEMPT_DYNAMIC Thu Aug 17 04:57:43 UTC 2023 (2a5b3f6) x86_64 x86_64 x86_64 GNU/Linux

Machine: https://racktable.suse.de/index.php?page=object&tab=default&object_id=16386

amd-zen2-gpu-sut1.openqanet.opensuse.org (192.168.112.15)
amd-zen2-gpu-sut1-ipmi.openqanet.opensuse.org (192.168.112.16)

This machine is in O3 amd-zen2-gpu-sut1.openqanet.opensuse.org (192.168.112.15)
which will be accessible from the jump server via "ariel". HostName gate.opensuse.org and Port 2214.

CPU_ARCH	x86_64
CPU_MODELNAME	Intel(R) Xeon(R) CPU E5645 @ 2.40GHz
CPU_OPMODE	32-bit, 64-bit
WORKER_CLASS	64bit-ipmi_rebel,64bit-ipmi-large-mem_rebel,64bit-ipmi-amd_rebel,amd-zen2-gpu-sut1_rebel


## Testsuite description(optional, apply for complex scenarios)

Test suit: 
virt-guest-installation-xen@64bit-ipmi
virt-guest-installation-kvm@64bit-ipmi
Comment 1 Varun Kumar Ojha 2023-08-24 15:32:09 UTC
Latest failed test: https://openqa.opensuse.org/tests/3526467#step/unified_guest_installation/184
Comment 2 Julie Cao 2023-08-25 06:49:31 UTC
Thank you @santiago. 

--gpg-auto-import-keys has been used in "zypper ref" just ahead of the failing "zypper in".

     zypper_call("--gpg-auto-import-keys ref");
     zypper_call("in rsyslog");

Hi @Varun, Could you add "--gpg-auto-import-keys" to zypper_call("in rsyslog") also to see if this issue still happens?
Comment 3 Chenzi Cao 2023-08-30 06:29:39 UTC
@Varun, would you please have a try as Comment#2? Thanks.
Comment 4 Varun Kumar Ojha 2023-08-30 16:19:01 UTC
Thanks Chenzi,
Our O3 machines had some blockers,
The verification run https://openqa.opensuse.org/tests/3536968

PR with changes: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/17641

We will keep the ticket open at our end for feedback for some time.
Comment 5 Varun Kumar Ojha 2023-09-04 10:24:24 UTC
Hi,

Tests passing with the merged changes
https://openqa.opensuse.org/tests/3546321

Please close this bug, Thanks!
Comment 6 Chenzi Cao 2023-09-05 09:04:09 UTC
Based on the comment above, I close this bug report now, thanks.