Bug 155442

Summary: rsyncable gzip
Product: [openSUSE] openSUSE 10.2 Reporter: Forgotten User OS1JNCFbCX <forgotten_OS1JNCFbCX>
Component: BasesystemAssignee: Ruediger Oertel <ro>
Status: RESOLVED FIXED QA Contact: E-mail List <qa-bugs>
Severity: Enhancement    
Priority: P5 - None CC: suse-beta
Version: Alpha 5   
Target Milestone: ---   
Hardware: All   
OS: SuSE Linux 10.1   
Whiteboard:
Found By: Beta-Customer Services Priority:
Business Priority: Blocker: ---
Marketing QA Status: --- IT Deployment: ---

Description Forgotten User OS1JNCFbCX 2006-03-06 15:43:14 UTC
What about adding rsyncable gzip support (http://rsync.samba.org/ftp/unpacked/rsync/patches/gzip-rsyncable.diff) to gzip? This would be especially useful for creating ARCHIVES.gz, the repodata and stuff like that in factory because it should decrease rsync times considerably when syncing the factory repository (or any other one). Debian is using this for their packages as well to increase rsync performance.
Comment 1 Ruediger Oertel 2006-03-06 18:19:59 UTC
we are not using gzip in our binary rpms but bzip2
for syncing rpms we supply drpmsync

reassigning to maintainer of gzip
Comment 2 Forgotten User OS1JNCFbCX 2006-03-06 18:38:05 UTC
I was _not_ talking about RPM packages but of files like ARCHIVES.gz and likewise!
Comment 3 Forgotten User OS1JNCFbCX 2006-03-06 21:15:06 UTC
Just to give some numbers:

I rsynced an ARCHIVES.gz from a factory-Snapshot to another one one day later:

Without the patch: 40792412 bytes transfered

With the patch: 6675978 bytes transfered

This is a saving of 84%!
Comment 4 Andreas Schwab 2006-03-13 18:54:29 UTC
Fixed.
Comment 5 Forgotten User OS1JNCFbCX 2006-03-13 19:16:50 UTC
Now it's up to you Ruediger to use this feature with the gzip files synced out to public.

Before just closing this bug again please read comment #2 because your comment #1 made me think that you misunderstood my initial comment in the first place.
Comment 6 Ruediger Oertel 2006-03-21 01:15:34 UTC
already done by now, the servers creating "factory" have the patched
gzip installed.
Comment 7 Forgotten User OS1JNCFbCX 2006-03-23 08:05:56 UTC
Hmm, does not work yet. It is still compressed in non-rsyncable format. Did you forget to add the --rsyncable switch to the gzip call? If you don't gzip will not change its behaviour.
Comment 8 Ruediger Oertel 2006-03-28 23:23:09 UTC
should be fixed by now (at least for ARCHIVES/INDEX/ls-lR files)
Comment 9 Forgotten User OS1JNCFbCX 2006-10-13 07:59:03 UTC
Could we add this to the repodata files as well?
Comment 10 Ruediger Oertel 2006-10-29 23:07:22 UTC
ok, tried something for the install trees, update repos maybe some other time
might take a bit to show up on the servers
Comment 11 Ruediger Oertel 2006-11-02 16:23:13 UTC
should work