Bugzilla – Bug 1211803
[Virtualization: XEN] Failure in the test for pv guest, 1 of 1 multicall(s) failed: cpu1 during unified_guest_installation
Last modified: 2023-05-30 06:54:43 UTC
## Description [Virtualization: XEN] Failure in the test for pv guest, 1 of 1 multicall(s) failed: cpu1 during unified_guest_installation. The error message "1 of 1 multicall(s) failed: cpu1" indicates that there was an issue with the execution of a multicall on the "cpu1" of the virtual machine. This error can occur for various reasons, such as compatibility issues, resource limitations, or configuration problems. The failure in the test for pv guest could be a product bug. Multicall is a mechanism that allows multiple system calls to be made in a single operation, improving efficiency. It could be related to the operating system, a specific application, or a hardware issue. Tests: https://openqa.opensuse.org/tests/3318567#step/unified_guest_installation/735 https://openqa.opensuse.org/tests/3321105#step/unified_guest_installation/635 ## Reproduce steps (try to be simple, extract key steps) installed a TW xen host with your autoyast profile on one of those 2 SUTs in O3 installed a guest with virt-install and with minimal options. ie. removing unecessary options from our automation test. eg. "virt-install --virt-type xen --paravirt --arch x86_64 --name opensuse-tumbleweed-64-pv-xen --vcpus 2,maxvcpus=4 --memory 2048,maxmemory=4096 --disk path=/var/lib/libvirt/images/opensuse-tumbleweed-64-pv-xen.qcow2,size=16,format=qcow2 --network=bridge=br123,mac=52:54:00:d0:46:fd --location http://openqa.opensuse.org/assets/repo/openSUSE-Tumbleweed-oss-x86_64-CURRENT --autoconsole text --extra-args "sshd=1" --extra-args "sshpassword=nots3cr3t" --extra-args "console=hvc0,115200n8" --extra-args "textmode=1" --extra-args "autoyast=http://192.168.112.13:8666/unattended_installation_opensuse-tumbleweed-64-pv-xen_opensuse_tumbleweed_xen_pv_guest_x86_64.xml" --video xen --graphics vnc --serial pty --debug" virt-install --virt-type xen --paravirt --arch x86_64 --name opensuse-tumbleweed-64-pv-xen --vcpus 2,maxvcpus=4 --memory 2048,maxmemory=4096 --disk path=/var/lib/libvirt/images/opensuse-tumbleweed-64-pv-xen.qcow2,size=16,format=qcow2 --network=bridge=br123,mac=52:54:00:c5:73:35 --location http://openqa.opensuse.org/assets/repo/openSUSE-Tumbleweed-oss-x86_64-CURRENT --autoconsole text --extra-args "sshd=1" --extra-args "sshpassword=nots3cr3t" --extra-args "console=hvc0,115200n8" --extra-args "textmode=1" --extra-args "autoyast=http://amd-zen2-gpu-sut1.openqanet.opensuse.org:8666/unattended_installation_opensuse-tumbleweed-64-pv-xen_opensuse_tumbleweed_xen_pv_guest_x86_64.xml" --video xen --graphics vnc --serial pty --debug --dry-run Able to reproduce on blackbauhinia:~ [192.168.112.13] during opensuse-Tumbleweed-DVD-x86_64-Buildvarunkojha_os-autoinst-distri-opensuse_17072-virt-guest-installation-xen@varunkojha_os-autoinst-distri-opensuse_varunkojha_poo@128675@64bit-ipmi The error reproduced on the machine, at below datetime https://openqa.opensuse.org/tests/3321105/logfile?filename=autoinst-log.txt blackbauhinia:/var/log/YaST2 # date Mon May 29 04:07:50 EDT 2023 blackbauhinia:/var/log/YaST2 # date Mon May 29 04:10:54 EDT 2023 blackbauhinia:/var/log/YaST2 # date Mon May 29 04:38:15 EDT 2023 blackbauhinia:/var/log/YaST2 # date Mon May 29 04:47:17 EDT 2023 blackbauhinia:/var/log/YaST2 # date Mon May 29 05:58:51 EDT 2023 Expected result: The test should pass and, should not encounter 1 of 1 multicall(s) failed: cpu1. Real result: # Test died: The overall result is FAILED because certain guest installation did not succeed. at /var/lib/openqa/pool/6/os-autoinst-distri-opensuse/lib/concurrent_guest_installations.pm line 184. concurrent_guest_installations::validate_guest_installations_results(unified_guest_installation=HASH(0x563bbc47b1f0)) called at /var/lib/openqa/pool/6/os-autoinst-distri-opensuse/lib/concurrent_guest_installations.pm line 264 concurrent_guest_installations::concurrent_guest_installations_run(unified_guest_installation=HASH(0x563bbc47b1f0), HASH(0x563bbd9c0a10)) called at /var/lib/openqa/pool/6/os-autoinst-distri-opensuse/tests/virt_autotest/unified_guest_installation.pm line 102 unified_guest_installation::run(unified_guest_installation=HASH(0x563bbc47b1f0)) called at /usr/lib/os-autoinst/basetest.pm line 339 eval {...} called at /usr/lib/os-autoinst/basetest.pm line 333 basetest::runtest(unified_guest_installation=HASH(0x563bbc47b1f0)) called at /usr/lib/os-autoinst/autotest.pm line 387 eval {...} called at /usr/lib/os-autoinst/autotest.pm line 387 autotest::runalltests() called at /usr/lib/os-autoinst/autotest.pm line 244 eval {...} called at /usr/lib/os-autoinst/autotest.pm line 244 autotest::run_all() called at /usr/lib/os-autoinst/autotest.pm line 295 autotest::__ANON__(Mojo::IOLoop::ReadWriteProcess=HASH(0x563bbe03b6e0)) called at /usr/lib/perl5/vendor_perl/5.26.1/Mojo/IOLoop/ReadWriteProcess.pm line 326 eval {...} called at /usr/lib/perl5/vendor_perl/5.26.1/Mojo/IOLoop/ReadWriteProcess.pm line 326 Mojo::IOLoop::ReadWriteProcess::_fork(Mojo::IOLoop::ReadWriteProcess=HASH(0x563bbe03b6e0), CODE(0x563bbe44bc20)) called at /usr/lib/perl5/vendor_perl/5.26.1/Mojo/IOLoop/ReadWriteProcess.pm line 489 Mojo::IOLoop::ReadWriteProcess::start(Mojo::IOLoop::ReadWriteProcess=HASH(0x563bbe03b6e0)) called at /usr/lib/os-autoinst/autotest.pm line 297 autotest::start_process() called at /usr/lib/os-autoinst/OpenQA/Isotovideo/Runner.pm line 94 OpenQA::Isotovideo::Runner::start_autotest(OpenQA::Isotovideo::Runner=HASH(0x563bb665ce10)) called at /usr/bin/isotovideo line 131 eval {...} called at /usr/bin/isotovideo line 120 ## Reproducibility 100% ## Last good build With KVM and XEN autoyast profile KVM passed: https://openqa.opensuse.org/tests/3320393 Xen failed: https://openqa.opensuse.org/tests/3318567 ## Environment(optional) Linux amd-zen2-gpu-sut1 6.3.2-1-default #1 SMP PREEMPT_DYNAMIC Mon May 15 15:59:38 UTC 2023 (70ea6f6) x86_64 x86_64 x86_64 GNU/Linux Linux blackbauhinia 6.3.2-1-default #1 SMP PREEMPT_DYNAMIC Mon May 15 15:59:38 UTC 2023 (70ea6f6) x86_64 x86_64 x86_64 GNU/Linux ## Testsuite description(optional, apply for complex scenarios) Test suit: virt-guest-installation-xen@64bit-ipmi PR for xen autoyast profile: https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/17072 ## Logs Full logs on: amd-zen2-gpu-sut1 [192.168.112.15] https://openqa.opensuse.org/tests/3318567/logfile?filename=autoinst-log.txt Logs on blackbauhinia [192.168.112.13] https://openqa.opensuse.org/tests/3321105/logfile?filename=autoinst-log.txt Logs at that time [2023-05-29T11:04:06.055069+02:00] [debug] [pid:6774] <<< testapi::type_string(string="screen -d -r 4310.pts-2.blackbauhinia\n", max_interval=250, wait_screen_change=0, wait_still_screen=0, timeout=30, similarity_level=47) [2023-05-29T11:04:07.350194+02:00] [debug] [pid:6774] >>> testapi::wait_screen_change: screen change seen after 1.69277191162109e-05 seconds (similarity: 34.0747673890444) [2023-05-29T11:04:07.545739+02:00] [debug] [pid:6774] tests/virt_autotest/unified_guest_installation.pm:102 called concurrent_guest_installations::concurrent_guest_installations_run -> lib/concurrent_guest_installations.pm:262 called concurrent_guest_installations::monitor_concurrent_guest_installations -> lib/concurrent_guest_installations.pm:148 called guest_installation_and_configuration_base::attach_guest_installation_screen -> lib/guest_installation_and_configuration_base.pm:1953 called guest_installation_and_configuration_base::do_attach_guest_installation_screen -> lib/guest_installation_and_configuration_base.pm:1969 called guest_installation_and_configuration_base::do_attach_guest_installation_screen_with_session -> lib/guest_installation_and_configuration_base.pm:2007 called testapi::check_screen [2023-05-29T11:04:07.545992+02:00] [debug] [pid:6774] <<< testapi::check_screen(mustmatch="text-logged-in-root", timeout=5) [2023-05-29T11:04:07.718739+02:00] [debug] [pid:6774] >>> testapi::_handle_found_needle: found text-logged-in-root-otherfont-20201012, similarity 1.00 @ 106/2 [2023-05-29T11:04:07.719100+02:00] [debug] [pid:6774] tests/virt_autotest/unified_guest_installation.pm:102 called concurrent_guest_installations::concurrent_guest_installations_run -> lib/concurrent_guest_installations.pm:262 called concurrent_guest_installations::monitor_concurrent_guest_installations -> lib/concurrent_guest_installations.pm:148 called guest_installation_and_configuration_base::attach_guest_installation_screen -> lib/guest_installation_and_configuration_base.pm:1953 called guest_installation_and_configuration_base::do_attach_guest_installation_screen -> lib/guest_installation_and_configuration_base.pm:1969 called guest_installation_and_configuration_base::do_attach_guest_installation_screen_with_session -> lib/guest_installation_and_configuration_base.pm:1999 called testapi::wait_screen_change [2023-05-29T11:04:07.719306+02:00] [debug] [pid:6774] <<< testapi::wait_screen_change(timeout=10, similarity_level=50) [2023-05-29T11:04:07.722281+02:00] [debug] [pid:6774] tests/virt_autotest/unified_guest_installation.pm:102 called concurrent_guest_installations::concurrent_guest_installations_run -> lib/concurrent_guest_installations.pm:262 called concurrent_guest_installations::monitor_concurrent_guest_installations -> lib/concurrent_guest_installations.pm:148 called guest_installation_and_configuration_base::attach_guest_installation_screen -> lib/guest_installation_and_configuration_base.pm:1953 called guest_installation_and_configuration_base::do_attach_guest_installation_screen -> lib/guest_installation_and_configuration_base.pm:1969 called guest_installation_and_configuration_base::do_attach_guest_installation_screen_with_session -> lib/guest_installation_and_configuration_base.pm:1999 called testapi::wait_screen_change -> lib/guest_installation_and_configuration_base.pm:1998 called testapi::type_string [2023-05-29T11:04:07.722643+02:00] [debug] [pid:6774] <<< testapi::type_string(string="screen -d -r 4310.pts-2.blackbauhinia\n", max_interval=250, wait_screen_change=0, wait_still_screen=0, timeout=30, similarity_level=47) [2023-05-29T11:04:09.023024+02:00] [debug] [pid:6774] >>> testapi::wait_screen_change: screen change seen after 2.288818359375e-05 seconds (similarity: 35.3879168710378) [2023-05-29T11:04:09.234980+02:00] [debug] [pid:6774] tests/virt_autotest/unified_guest_installation.pm:102 called concurrent_guest_installations::concurrent_guest_installations_run -> lib/concurrent_guest_installations.pm:262 called concurrent_guest_installations::monitor_concurrent_guest_installations -> lib/concurrent_guest_installations.pm:148 called guest_installation_and_configuration_base::attach_guest_installation_screen -> lib/guest_installation_and_configuration_base.pm:1953 called guest_installation_and_configuration_base::do_attach_guest_installation_screen -> lib/guest_installation_and_configuration_base.pm:1969 called guest_installation_and_configuration_base::do_attach_guest_installation_screen_with_session -> lib/guest_installation_and_configuration_base.pm:2007 called testapi::check_screen [2023-05-29T11:04:09.235226+02:00] [debug] [pid:6774] <<< testapi::check_screen(mustmatch="text-logged-in-root", timeout=5) [2023-05-29T11:04:09.258422+02:00] [debug] [pid:6775] no match: 14.9s, best candidate: text-logged-in-root-20170321 (0.47) [2023-05-29T11:04:10.263004+02:00] [debug] [pid:6775] no match: 13.9s, best candidate: text-logged-in-root-20170321 (0.47) [2023-05-29T11:04:11.260787+02:00] [debug] [pid:6775] no match: 12.9s, best candidate: text-logged-in-root-20170321 (0.47) [2023-05-29T11:04:12.262236+02:00] [debug] [pid:6775] no match: 11.9s, best candidate: text-logged-in-root-20170321 (0.47) [2023-05-29T11:04:13.849747+02:00] [warn] [pid:6775] !!! backend::baseclass::check_asserted_screen: check_asserted_screen took 0.61 seconds for 9 candidate needles - make your needles more specific [2023-05-29T11:04:13.850003+02:00] [debug] [pid:6775] no match: 10.9s, best candidate: text-logged-in-root-20170627 (0.88) [2023-05-29T11:04:14.264946+02:00] [debug] [pid:6775] no match: 9.9s, best candidate: text-logged-in-root-20170321 (0.47) [2023-05-29T11:04:15.243787+02:00] [debug] [pid:6775] no change: 8.9s [2023-05-29T11:04:15.262519+02:00] [debug] [pid:6775] no match: 8.9s, best candidate: text-logged-in-root-20170321 (0.47) [2023-05-29T11:04:16.269516+02:00] [debug] [pid:6775] no match: 7.9s, best candidate: text-logged-in-root-20170321 (0.47) [2023-05-29T11:04:17.267604+02:00] [debug] [pid:6775] no match: 6.9s, best candidate: text-logged-in-root-20170321 (0.47) [2023-05-29T11:04:18.853837+02:00] [warn] [pid:6775] !!! backend::baseclass::check_asserted_screen: check_asserted_screen took 0.61 seconds for 9 candidate needles - make your needles more specific [2023-05-29T11:04:18.854099+02:00] [debug] [pid:6775] no match: 5.9s, best candidate: text-logged-in-root-20170627 (0.88) [2023-05-29T11:04:19.247804+02:00] [debug] [pid:6775] no change: 4.9s [2023-05-29T11:04:19.266558+02:00] [debug] [pid:6775] no match: 4.9s, best candidate: text-logged-in-root-20170321 (0.47) [2023-05-29T11:04:20.270215+02:00] [debug] [pid:6775] no match: 3.9s, best candidate: text-logged-in-root-20170321 (0.47) [2023-05-29T11:04:21.271183+02:00] [debug] [pid:6775] no match: 2.9s, best candidate: text-logged-in-root-20170321 (0.47) [2023-05-29T11:04:22.272820+02:00] [debug] [pid:6775] no match: 1.9s, best candidate: text-logged-in-root-20170321 (0.47) [2023-05-29T11:04:23.850706+02:00] [warn] [pid:6775] !!! backend::baseclass::check_asserted_screen: check_asserted_screen took 0.60 seconds for 9 candidate needles - make your needles more specific [2023-05-29T11:04:23.850893+02:00] [debug] [pid:6775] no match: 0.9s, best candidate: text-logged-in-root-20170627 (0.88) [2023-05-29T11:04:24.850179+02:00] [warn] [pid:6775] !!! backend::baseclass::check_asserted_screen: check_asserted_screen took 0.60 seconds for 9 candidate needles - make your needles more specific [2023-05-29T11:04:24.850370+02:00] [debug] [pid:6775] no match: -0.1s, best candidate: text-logged-in-root-20170627 (0.88) [2023-05-29T11:04:25.063396+02:00] [debug] [pid:6774] >>> testapi::_check_backend_response: match=text-logged-in-root timed out after 15 (check_screen) [2023-05-29T11:04:25.199115+02:00] [debug] [pid:6774] tests/virt_autotest/unified_guest_installation.pm:102 called concurrent_guest_installations::concurrent_guest_installations_run -> lib/concurrent_guest_installations.pm:262 called concurrent_guest_installations::monitor_concurrent_guest_installations -> lib/concurrent_guest_installations.pm:148 called guest_installation_and_configuration_base::attach_guest_installation_screen -> lib/guest_installation_and_configuration_base.pm:1953 called guest_installation_and_configuration_base::do_attach_guest_installation_screen -> lib/guest_installation_and_configuration_base.pm:1970 called testapi::check_screen [2023-05-29T11:04:25.199357+02:00] [debug] [pid:6774] <<< testapi::check_screen(mustmatch="text-logged-in-root", timeout=0) [2023-05-29T11:04:25.847340+02:00] [warn] [pid:6775] !!! backend::baseclass::check_asserted_screen: check_asserted_screen took 0.59 seconds for 9 candidate needles - make your needles more specific [2023-05-29T11:04:25.847528+02:00] [debug] [pid:6775] no match: -0.1s, best candidate: text-logged-in-root-20170627 (0.88) [2023-05-29T11:04:25.988134+02:00] [debug] [pid:6774] >>> testapi::_check_backend_response: match=text-logged-in-root timed out after 0 (check_screen) [2023-05-29T11:04:26.023045+02:00] [debug] [pid:6774] tests/virt_autotest/unified_guest_installation.pm:102 called concurrent_guest_installations::concurrent_guest_installations_run -> lib/concurrent_guest_installations.pm:262 called concurrent_guest_installations::monitor_concurrent_guest_installations -> lib/concurrent_guest_installations.pm:148 called guest_installation_and_configuration_base::attach_guest_installation_screen -> lib/guest_installation_and_configuration_base.pm:1953 called guest_installation_and_configuration_base::do_attach_guest_installation_screen -> lib/guest_installation_and_configuration_base.pm:1972 called testapi::record_info [2023-05-29T11:04:26.023311+02:00] [debug] [pid:6774] <<< testapi::record_info(title="Attached opensuse-tumbleweed-64-pv-xen installation screen process 4310.pts-2.blackbauhinia successfully", output="Well done !", result="ok") [2023-05-29T11:04:26.023668+02:00] [debug] [pid:6774] Test execution inside guest_installation_and_configuration_base::monitor_guest_installation. [2023-05-29T11:04:26.128517+02:00] [debug] [pid:6774] tests/virt_autotest/unified_guest_installation.pm:102 called concurrent_guest_installations::concurrent_guest_installations_run -> lib/concurrent_guest_installations.pm:262 called concurrent_guest_installations::monitor_concurrent_guest_installations -> lib/concurrent_guest_installations.pm:149 called guest_installation_and_configuration_base::monitor_guest_installation -> lib/guest_installation_and_configuration_base.pm:1845 called testapi::check_screen [2023-05-29T11:04:26.128823+02:00] [debug] [pid:6774] <<< testapi::check_screen(mustmatch=[ "text-logged-in-root", "guest-installation-in-progress", "guest-installation-failures", "grub2", "linux-login", "text-login", "guest-console-text-login" ], timeout=60) [2023-05-29T11:04:27.397107+02:00] [warn] [pid:6775] !!! backend::baseclass::check_asserted_screen: check_asserted_screen took 1.14 seconds for 76 candidate needles - make your needles more specific [2023-05-29T11:04:27.397297+02:00] [debug] [pid:6775] no match: 179.8s, best candidate: text-logged-in-root-20170321 (0.47) ## Workaround no
Created attachment 867273 [details] support config
Please read https://en.opensuse.org/openSUSE:How_to_Write_a_Good_Bugreport You seem to be reporting a problem with an openQA test. At least according to the initial description. If you believe there is a problem with YaST and/or the Installer, plese report a bug against that component, but describe it in a way that explains what's actually the problem WITH that component, e.g., what that component does in a wrong way. Some hints from the howto: Description must contain all the important/relevant pieces of info to understand the problem in depth - All the information about the environment that is relevant - Brief description of what the reporter believes is a bug, e.g., the expected versus the actual result - Steps to reproduce - If you can't reproduce it, the developer might not be able to do so either Attachments - Logs (mandatory for YaST/Installer/D-Installer/Agama), see more at Report a YaST Bug https://en.opensuse.org/openSUSE:Report_a_YaST_bug Please, don't report failing openQA test-cases, report bugs instead. We debug and fix bugs, we don't debug or fix failing test-cases. An openQA test-case is usually quite a complex scenario with several hidden expectations, dependencies, etc. These must be spelled out or eliminated first.
Noted Lukas Ocilka, closing this. I will open a new one as recommended.