Bug 1214831 - [Build 20230830] graphicsMagick fails two tests in openQA
Summary: [Build 20230830] graphicsMagick fails two tests in openQA
Status: RESOLVED FIXED
Alias: None
Product: openSUSE Tumbleweed
Classification: openSUSE
Component: Other (show other bugs)
Version: Current
Hardware: Other Other
: P5 - None : Normal (vote)
Target Milestone: ---
Assignee: Petr Gajdos
QA Contact: E-mail List
URL: https://openqa.opensuse.org/tests/353...
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2023-08-31 14:00 UTC by Dominique Leuenberger
Modified: 2023-09-04 08:23 UTC (History)
1 user (show)

See Also:
Found By: openQA
Services Priority:
Business Priority:
Blocker: Yes
Marketing QA Status: ---
IT Deployment: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Dominique Leuenberger 2023-08-31 14:00:34 UTC
## Observation

graphicsMagick has been updated to version 1.3.41 (SR included two regression patches in plus)

openQA fails all instances of gm tests.

The relevant failures reported are:

85 - KO - gm montage degradation.png logo-primary.png ./85-1.png;montage_compare PAE ./85-1.png montage1.png 0
86 - KO - gm montage -texture noise.gif degradation.png logo-primary.png ./86-1.png;montage_compare PAE ./86-1.png montage2.png 0


OK: 104 , ERRORS: 2


openQA test in scenario opensuse-Tumbleweed-DVD-x86_64-system_performance@64bit fails in
[graphicsMagick](https://openqa.opensuse.org/tests/3538170/modules/graphicsMagick/steps/18)

## Test suite description
Maintainer: QE Core

An explicit system performance test.

https://progress.opensuse.org/issues/36100


## Reproducible

Fails since (at least) Build [20230830](https://openqa.opensuse.org/tests/3538170) (current job)


## Expected result

Last good: [20230828](https://openqa.opensuse.org/tests/3534103) (or more recent)


## Further details

Always latest result in this scenario: [latest](https://openqa.opensuse.org/tests/latest?arch=x86_64&distri=opensuse&flavor=DVD&machine=64bit&test=system_performance&version=Tumbleweed)
Comment 1 Dominique Leuenberger 2023-08-31 14:59:28 UTC
> gm compare -metric PAE ./0-1.png montage1.png
Image Difference (PeakAbsoluteError):
           Normalized    Absolute
          ============  ==========
     Red: 0.0000152590        1.0
   Green: 0.0000152590        1.0
    Blue: 0.0000152590        1.0
   Total: 0.0000152590        1.0


> gm compare -metric PAE ./1-1.png montage2.png
Image Difference (PeakAbsoluteError):
           Normalized    Absolute
          ============  ==========
     Red: 0.0000152590        1.0
   Green: 0.0000152590        1.0
    Blue: 0.0000152590        1.0
   Total: 0.0000152590        1.0
Comment 2 Petr Gajdos 2023-09-01 12:10:59 UTC
So if I understand correctly, basically

$ gm montage degradation.png logo-primary.png ./85-1.png

leads to different result than before as shown with

$ gm compare -metric PAE ./85-1.png montage1.png

(where montage1.png is the previous result)


However, the resulting images look the same for naked eye.


I have tried also:
15sp3/GraphicsMagick (1.3.35):
$ gm montage logo: logo: out.png; md5sum out.png
7a5099d37a6785c57c017224bf80100b  out.png
$
TW/GraphicsMagick (1.3.40):
$ gm montage logo: logo: out.png; md5sum out.png
7a5099d37a6785c57c017224bf80100b  out.png
$
TW/GraphicsMagick (1.3.41):
$ gm montage logo: logo: out.png; md5sum out.png
08c64b70d283466effd924df83bca6a3  out.png
$

$ gm compare -metric PAE out-before.png out.png 
Image Difference (PeakAbsoluteError):
           Normalized    Absolute
          ============  ==========
     Red: 0.0000152590        1.0
   Green: 0.0000152590        1.0
    Blue: 0.0000152590        1.0
   Total: 0.0000152590        1.0
$
Comment 3 Dominique Leuenberger 2023-09-01 12:28:49 UTC
15sp3/GraphicsMagick (1.3.35):
$ gm montage logo: logo: out.png; md5sum out.png
7a5099d37a6785c57c017224bf80100b  out.png
$
TW/GraphicsMagick (1.3.40):
$ gm montage logo: logo: out.png; md5sum out.png
7a5099d37a6785c57c017224bf80100b  out.png
$
TW/GraphicsMagick (1.3.41):
$ gm montage logo: logo: out.png; md5sum out.png
08c64b70d283466effd924df83bca6a3  out.png

so 'something' changed... in previous versions, the picture was even bid-identical.. 

As we likely won't come to a conclusion today, I reverted GM to the previous version in Factory so that we can unblock TW over the weekend.

Once we know what is going on here, we can update again to 1.3.41
Comment 4 Petr Gajdos 2023-09-01 12:54:06 UTC
Created an upstream bug:
https://sourceforge.net/p/graphicsmagick/bugs/723/

I have noticed meanwhile that 1.3.41 release got discarded, so yes, my plan was to revert to 1.3.40, even in develproject.

Have a nice weekend
Comment 6 Petr Gajdos 2023-09-01 13:17:45 UTC
Ah, I have accepted your request because I thought you have solved it. Will revert in devel project again.
Comment 7 Petr Gajdos 2023-09-04 08:23:27 UTC
https://sourceforge.net/p/graphicsmagick/bugs/723/

Factory: reverted to 1.3.40.
In future upstream version this should be fixed.