Bug 1210985 - Mirror fails refreshing repo
Summary: Mirror fails refreshing repo
Status: NEW
Alias: None
Product: openSUSE Distribution
Classification: openSUSE
Component: Other (show other bugs)
Version: Leap 15.4
Hardware: x86-64 openSUSE Leap 15.4
: P5 - None : Normal (vote)
Target Milestone: ---
Assignee: Adrian Schröter
QA Contact: E-mail List
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2023-05-02 00:43 UTC by Volker Kuhlmann
Modified: 2023-09-05 01:41 UTC (History)
3 users (show)

See Also:
Found By: ---
Services Priority:
Business Priority:
Blocker: ---
Marketing QA Status: ---
IT Deployment: ---


Attachments
bwayson-zypper_refresh-repo-oss Output (1.33 KB, text/plain)
2023-08-09 23:25 UTC, Bill Wayson
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Volker Kuhlmann 2023-05-02 00:43:00 UTC
For the last 2 days I've been getting a failure downloading one of the repo content files. This seems to be a problem with the mirror(s).

zypper refresh:

Retrieving repository 'Text editors and hex editors for Linux (openSUSE_Leap_15.4)' metadata[error]
Repository 'Text editors and hex editors for Linux (openSUSE_Leap_15.4)' is invalid.
[editors|https://download.opensuse.org/repositories/editors/openSUSE_Leap_15.4/] Valid metadata not found at specified URL
History:
 - File './repodata/ace6805bf6bb50dd67f90babe9edcb13a39fc846fd95b60bf4669eee964e85b4-primary.xml.gz' not found on medium 'https://download.opensuse.org/repositories/editors/openSUSE_Leap_15.4/'
 - Can't provide ./repodata/ace6805bf6bb50dd67f90babe9edcb13a39fc846fd95b60bf4669eee964e85b4-primary.xml.gz


Let's get the file with wget:


wget --no-proxy --proxy-password=none --cache=off --no-cache https://download.opensuse.org/repositories/editors/openSUSE_Leap_15.4/./repodata/ace6805bf6bb50dd67f90babe9edcb13a39fc846fd95b60bf4669eee964e85b4-primary.xml.gz

--2023-05-02 08:50:24--  https://download.opensuse.org/repositories/editors/openSUSE_Leap_15.4/repodata/ace6805bf6bb50dd67f90babe9edcb13a39fc846fd95b60bf4669eee964e85b4-primary.xml.gz
Resolving download.opensuse.org (download.opensuse.org)... 195.135.221.134, 2001:67c:2178:8::13
Connecting to download.opensuse.org (download.opensuse.org)|195.135.221.134|:443... connected.
HTTP request sent, awaiting response... 302 Found
Location: https://mirrorcache-au.opensuse.org/repositories/editors/openSUSE_Leap_15.4/repodata/ace6805bf6bb50dd67f90babe9edcb13a39fc846fd95b60bf4669eee964e85b4-primary.xml.gz [following]
--2023-05-02 08:50:25--  https://mirrorcache-au.opensuse.org/repositories/editors/openSUSE_Leap_15.4/repodata/ace6805bf6bb50dd67f90babe9edcb13a39fc846fd95b60bf4669eee964e85b4-primary.xml.gz
Resolving mirrorcache-au.opensuse.org (mirrorcache-au.opensuse.org)... 172.105.167.90, 2400:8907::f03c:92ff:fe82:7bb
Connecting to mirrorcache-au.opensuse.org (mirrorcache-au.opensuse.org)|172.105.167.90|:443... connected.
HTTP request sent, awaiting response... 302 Found
Location: https://mirror.firstyear.id.au/repositories/editors/openSUSE_Leap_15.4/repodata/ace6805bf6bb50dd67f90babe9edcb13a39fc846fd95b60bf4669eee964e85b4-primary.xml.gz [following]
--2023-05-02 08:50:25--  https://mirror.firstyear.id.au/repositories/editors/openSUSE_Leap_15.4/repodata/ace6805bf6bb50dd67f90babe9edcb13a39fc846fd95b60bf4669eee964e85b4-primary.xml.gz
Resolving mirror.firstyear.id.au (mirror.firstyear.id.au)... 45.79.236.155, 2400:8907::f03c:92ff:fe14:ba3f
Connecting to mirror.firstyear.id.au (mirror.firstyear.id.au)|45.79.236.155|:443... connected.
HTTP request sent, awaiting response... 404 Not Found
2023-05-02 08:50:26 ERROR 404: Not Found.


It is affecting more repos this morning too.
I've had problems in the past with Oceania mirrors not working :-( .
Comment 1 Jesse Harris 2023-05-02 05:37:36 UTC
Just wanted to chime in and confirm the issue is hitting me too.
I've posted in the #openSUSE-mirrors channel to see if anyone can look at it.
Comment 2 Jesse Harris 2023-05-02 05:38:57 UTC
In my case, we cannot sync the repos for Go http://download.opensuse.org/repositories/devel:/languages:/go/15.4
and database
https://download.opensuse.org/repositories/server:/database/SLE_15_SP4/
Comment 3 Volker Kuhlmann 2023-05-02 21:49:04 UTC
Right now all my repos are refreshing again (3 others besides editors were failing when I opened this bug). Checking with wget, the mirror used is still mirror.firstyear.id.au.

It's difficult to debug what the mirror has because it does not provide directory listings.

Is this expected behaviour of the mirror system? Does it show up only when there is a reliance on maybe only one mirror which has a temporary problem with not updating for 2-3 days?
Comment 4 Chenzi Cao 2023-08-03 15:31:48 UTC
Hi Volker, would you please help to check whether the issue is still existing now? Thanks.
Comment 5 Volker Kuhlmann 2023-08-06 08:42:11 UTC
(In reply to Chenzi Cao from comment #4)
> Hi Volker, would you please help to check whether the issue is still
> existing now? Thanks.

It's been working again since, but I don't remember whether there was another similar problem since that resolved itself again overnight.

I don't know what the problem is but thought the mirror system was more resilient. Maybe there's a resource problem with too many users and too few mirrors in this part of the world?
Comment 6 Chenzi Cao 2023-08-07 07:30:34 UTC
Thanks for your reply.

And I assign it to Adrian to see whether we can improve it or not, thanks.
Comment 7 Bill Wayson 2023-08-09 23:25:36 UTC
Created attachment 868732 [details]
bwayson-zypper_refresh-repo-oss Output

I have been receiving similar errors with repositories during updates intermittently for a couple of months or so in both Tumbleweed and Leap 15.5.  Mine are due to a signature validation error (so, maybe a different issue?).  I have attached the output of a zypper refresh of a repository I am having trouble with today under Tumbleweed.  I know the URI is to the new CDN network -- I installed opensuse-repos-Tumbleweed yesterday.  But I was having this issue intermittently using both http://download.opensuse.org/... and http://mirrorcache-us.opensuse.org/... URIs and their HTTPS equivalents.  I am located in southwestern U.S.A.

Accept my apologies if my issue is not related.  I can file a new bug, if I should do that.
Comment 8 Volker Kuhlmann 2023-08-12 03:53:32 UTC
Just after saying it's been OK for the last few months, I get this, at around 2023-08-10 13:26 UTC. It resolved itself within 12 hours.

I'm a bit concerned how the not so tech-savvy might have to deal with it.

--------
Resolving package dependencies...

Problem: nothing provides 'libwebkit2gtk3 = 2.40.5' needed by the to be installed libwebkit2gtk3-lang-2.40.5-150200.78.1.noarch
 Solution 1: deinstallation of libwebkit2gtk3-lang-2.38.6-150200.75.2.noarch
 Solution 2: do not install patch:openSUSE-SLE-15.4-2023-3233-1.noarch
 Solution 3: break libwebkit2gtk3-lang-2.40.5-150200.78.1.noarch by ignoring some of its dependencies

Choose from above solutions by number or cancel [1/2/3/c/d/?] (c):
-------
Comment 9 Volker Kuhlmann 2023-08-25 10:41:49 UTC
For the past 10h I get this. I assume it's a mirror inconsistency. Would the KDE desktop software updater panel applet actually handle this? (I don't use that applet, I find it useless.)

Problem: the installed WebKit2GTK-4.0-lang-2.38.6-150400.4.42.4.noarch requires 'WebKit2GTK-4.0 = 2.38.6', but this requirement cannot be provided
  not installable providers: libwebkit2gtk-4_0-37-2.36.0-150400.2.13.x86_64[repo-oss]
                   libwebkit2gtk-4_0-37-2.36.3-150400.4.3.1.x86_64[repo-sle-update]
                   libwebkit2gtk-4_0-37-2.36.4-150400.4.6.2.x86_64[repo-sle-update]
                   libwebkit2gtk-4_0-37-2.36.5-150400.4.9.1.x86_64[repo-sle-update]
                   libwebkit2gtk-4_0-37-2.36.7-150400.4.12.1.x86_64[repo-sle-update]
                   libwebkit2gtk-4_0-37-2.36.8-150400.4.15.1.x86_64[repo-sle-update]
                   libwebkit2gtk-4_0-37-2.38.2-150400.4.22.1.x86_64[repo-sle-update]
                   libwebkit2gtk-4_0-37-2.38.3-150400.4.25.1.x86_64[repo-sle-update]
                   libwebkit2gtk-4_0-37-2.38.5-150400.4.34.2.x86_64[repo-sle-update]
                   libwebkit2gtk-4_0-37-2.38.6-150400.4.39.1.x86_64[repo-sle-update]
 Solution 1: deinstallation of WebKit2GTK-4.0-lang-2.38.6-150400.4.42.4.noarch
 Solution 2: do not install patch:openSUSE-SLE-15.4-2023-3419-1.noarch
 Solution 3: break WebKit2GTK-4.0-lang-2.38.6-150400.4.42.4.noarch by ignoring some of its dependencies
Choose from above solutions by number or cancel [1/2/3/c/d/?] (c):
Comment 10 Volker Kuhlmann 2023-08-26 02:10:37 UTC
The WebKit2GTK-4.0-lang-2.38.6-150400.4.42.4.noarch patch is now showing errors for over 24 hours. It is now preventing security updates from being installed. Host location is New Zealand.
Comment 11 Volker Kuhlmann 2023-08-28 23:05:41 UTC
The error in #comment9 is still happening now.
(Problem: the installed WebKit2GTK-4.0-lang-2.38.6-150400.4.42.4.noarch requires 'WebKit2GTK-4.0 = 2.38.6', but this requirement cannot be provided)

Patch patch:openSUSE-SLE-15.4-2023-3419-1.noarch has been stuck for about 4 days now. That's ridiculous.
Comment 12 Volker Kuhlmann 2023-09-05 01:29:48 UTC
zypper patch still gives me this, the same as for the past 11 days. The update system has been broken for this long.
Repo http://download.opensuse.org/update/leap/15.4/sle/
looks broken. It has provided packages to update to in the past (around 28 June) that require packages that are not available anywhere.


Problem: the installed WebKit2GTK-4.0-lang-2.38.6-150400.4.42.4.noarch requires 'WebKit2GTK-4.0 = 2.38.6', but this requirement cannot be provided
  not installable providers: libwebkit2gtk-4_0-37-2.36.0-150400.2.13.x86_64[repo-oss]
                   libwebkit2gtk-4_0-37-2.36.3-150400.4.3.1.x86_64[repo-sle-update]
                   libwebkit2gtk-4_0-37-2.36.4-150400.4.6.2.x86_64[repo-sle-update]
                   libwebkit2gtk-4_0-37-2.36.5-150400.4.9.1.x86_64[repo-sle-update]
                   libwebkit2gtk-4_0-37-2.36.7-150400.4.12.1.x86_64[repo-sle-update]
                   libwebkit2gtk-4_0-37-2.36.8-150400.4.15.1.x86_64[repo-sle-update]
                   libwebkit2gtk-4_0-37-2.38.2-150400.4.22.1.x86_64[repo-sle-update]
                   libwebkit2gtk-4_0-37-2.38.3-150400.4.25.1.x86_64[repo-sle-update]
                   libwebkit2gtk-4_0-37-2.38.5-150400.4.34.2.x86_64[repo-sle-update]
                   libwebkit2gtk-4_0-37-2.38.6-150400.4.39.1.x86_64[repo-sle-update]
 Solution 1: deinstallation of WebKit2GTK-4.0-lang-2.38.6-150400.4.42.4.noarch
 Solution 2: do not install patch:openSUSE-SLE-15.4-2023-3419-1.noarch
 Solution 3: break WebKit2GTK-4.0-lang-2.38.6-150400.4.42.4.noarch by ignoring some of its dependencies

Name        : WebKit2GTK-4.0-lang
Version     : 2.38.6
Release     : 150400.4.42.4
Architecture: noarch
Install Date: Wed Jun 28 12:07:11 2023
Distribution: SUSE Linux Enterprise 15
Comment 13 Volker Kuhlmann 2023-09-05 01:41:29 UTC
The package is not required by anything, so
rpm -e WebKit2GTK-4.0-lang
works around the problem.

Patch openSUSE-SLE-15.4-2023-3419 then wants to remove
libwebkit2gtk3-lang
and install
WebKitGTK-4.0-lang (2.40. ...)

Installing that patch brings the system into a consistent state again.

I have this happening on 2 different systems.

It looks like in the past (2 months ago) an update installed a package that now has missing dependencies, and further updating into a consistent state is not possible and everything gets stuck. Isn't that a little ridiculous?