Bug 303855 – [GTK][WPE] ref-test fast/css/view-transitions-scrolling-position-fixed.html is a flaky failure

• Component: WPE WebKit
• Status: NEW

[Carlos Alberto Lopez Perez]

ref-rest  fast/css/view-transitions-scrolling-position-fixed.html fails randomly on GTK and WPE ports. On the GTK port it fails much more often.


WPE
---
The bot wpe-release completed 1054 runs on the interval [300260@main-304152@main]
Frecuency of results for test: fast/css/view-transitions-scrolling-position-fixed.html
  993 times [94.2%]      ->  NOERROR
  45 times [4.3%]        ->  IMAGE PASS
  14 times [1.3%]        ->  IMAGE
  2 times [0.2%]         ->  TIMEOUT

Of those 1054 runs it didn't match the expectation 61 times [5.8%]
Details of the type and frequency of unmatched expectations:
  45 times [4.3%]        ->  IMAGE PASS (Expected: PASS)
  14 times [1.3%]        ->  IMAGE (Expected: PASS)
  2 times [0.2%]         ->  TIMEOUT (Expected: PASS)

Flakiness factor: 10.2%
    - This test was flaky on 10.2% of the 1054 runs analyzed, either giving different
      results within a single run, or a different result than in the previous run.



GTK
---
The bot gtk-release completed 1026 runs on the interval [300152@main-304151@main]
Frecuency of results for test: fast/css/view-transitions-scrolling-position-fixed.html
  177 times [17.3%]      ->  IMAGE PASS
  475 times [46.3%]      ->  NOERROR
  372 times [36.3%]      ->  IMAGE
  1 times [0.1%]         ->  TIMEOUT IMAGE
  1 times [0.1%]         ->  TIMEOUT

Of those 1026 runs it didn't match the expectation 551 times [53.7%]
Details of the type and frequency of unmatched expectations:
  177 times [17.3%]      ->  IMAGE PASS (Expected: PASS)
  372 times [36.3%]      ->  IMAGE (Expected: PASS)
  1 times [0.1%]         ->  TIMEOUT IMAGE (Expected: PASS)
  1 times [0.1%]         ->  TIMEOUT (Expected: PASS)

Flakiness factor: 55.1%
    - This test was flaky on 55.1% of the 1026 runs analyzed, either giving different
      results within a single run, or a different result than in the previous run.



When it fails the diff looks like this:
 - On GTK https://build.webkit.org/results/GTK-Linux-64-bit-Release-Tests/304139@main%20(22423)/fast/css/view-transitions-scrolling-position-fixed-diffs.html
 - On WPE https://build.webkit.org/results/WPE-Linux-64-bit-Release-Tests/304152@main%20(24192)/fast/css/view-transitions-scrolling-position-fixed-diffs.html

So, looks like the same issue.

It seems related to the scrollbar position that is different sometimes.

Perhaps related with the issue of bug 303208

[Carlos Alberto Lopez Perez]

Test expectations updated on 304176@main