Bug 313037 – [GTK][WPE] webgl/2.0.0/conformance2/textures/video/tex-2d-rgb9_e5-rgb-float.html is a flaky test

• Component: WPE WebKit
• Status: RESOLVED WONTFIX

[Nikolas Zimmermann]

wktesthunter output for this flaky test across affected bots:

>>> gtk-release <<<
311760@main                   UNKNOWN
311761@main                   NOERROR
311762@main                   UNKNOWN
311763@main                   NOERROR
[311764@main-311766@main]     UNKNOWN
311767@main                   NOERROR
[311768@main-311769@main]     UNKNOWN
311770@main                   NOERROR
[311771@main-311773@main]     UNKNOWN
311774@main                   NOERROR
[311775@main-311782@main]     UNKNOWN
311783@main                   NOERROR
[311784@main-311791@main]     UNKNOWN
311792@main                   NOERROR


The bot gtk-release completed 1255 runs on the interval [307792@main-311792@main]
Frequency of results for test: webgl/2.0.0/conformance2/textures/video/tex-2d-rgb9_e5-rgb-float.html
  1240 times [98.8%]     ->  NOERROR
  13 times [1.0%]        ->  TIMEOUT PASS
  2 times [0.2%]         ->  TIMEOUT

Of those 1255 runs it didn't match the expectation 15 times [1.2%]
Details of the type and frequency of unmatched expectations:
  13 times [1.0%]        ->  TIMEOUT PASS (Expected: PASS)
  2 times [0.2%]         ->  TIMEOUT (Expected: PASS)

Flakiness factor: 2.4%
    - This test was flaky on 2.4% of the 1255 runs analyzed, either giving different
      results within a single run, or a different result than in the previous run.

>>> wpe-release <<<
311766@main                   UNKNOWN
311767@main                   NOERROR
[311768@main-311769@main]     UNKNOWN
311770@main                   NOERROR
[311771@main-311772@main]     UNKNOWN
311773@main                   NOERROR
[311774@main-311775@main]     UNKNOWN
311776@main                   NOERROR
[311777@main-311782@main]     UNKNOWN
311783@main                   NOERROR
[311784@main-311791@main]     UNKNOWN
311792@main                   NOERROR
311793@main                   UNKNOWN
311794@main                   NOERROR


The bot wpe-release completed 1389 runs on the interval [307795@main-311794@main]
Frequency of results for test: webgl/2.0.0/conformance2/textures/video/tex-2d-rgb9_e5-rgb-float.html
  1378 times [99.2%]     ->  NOERROR
  2 times [0.1%]         ->  TEXT PASS
  9 times [0.6%]         ->  TIMEOUT PASS

Of those 1389 runs it didn't match the expectation 11 times [0.8%]
Details of the type and frequency of unmatched expectations:
  2 times [0.1%]         ->  TEXT PASS (Expected: PASS)
  9 times [0.6%]         ->  TIMEOUT PASS (Expected: PASS)

Flakiness factor: 1.6%
    - This test was flaky on 1.6% of the 1389 runs analyzed, either giving different
      results within a single run, or a different result than in the previous run.

>>> wpe-arm64-release <<<
[311771@main-311772@main]     UNKNOWN
311773@main                   NOERROR
[311774@main-311775@main]     UNKNOWN
311776@main                   NOERROR
[311777@main-311781@main]     UNKNOWN
[311782@main-311783@main]     NOERROR
[311784@main-311788@main]     UNKNOWN
311789@main                   NOERROR
[311790@main-311793@main]     UNKNOWN
311794@main                   NOERROR


The bot wpe-arm64-release completed 1253 runs on the interval [308164@main-311794@main]
Frequency of results for test: webgl/2.0.0/conformance2/textures/video/tex-2d-rgb9_e5-rgb-float.html
  1237 times [98.7%]     ->  NOERROR
  4 times [0.3%]         ->  TEXT PASS
  4 times [0.3%]         ->  TIMEOUT PASS
  3 times [0.2%]         ->  TEXT
  5 times [0.4%]         ->  TIMEOUT TEXT

Of those 1253 runs it didn't match the expectation 16 times [1.3%]
Details of the type and frequency of unmatched expectations:
  4 times [0.3%]         ->  TEXT PASS (Expected: PASS)
  4 times [0.3%]         ->  TIMEOUT PASS (Expected: PASS)
  3 times [0.2%]         ->  TEXT (Expected: PASS)
  5 times [0.4%]         ->  TIMEOUT TEXT (Expected: PASS)

Flakiness factor: 2.6%
    - This test was flaky on 2.6% of the 1253 runs analyzed, either giving different
      results within a single run, or a different result than in the previous run.

[Nikolas Zimmermann]

Closing: flakiness factor was below the 5% threshold; the TestExpectations entry has been removed in webkit.org/b/313122 (PR https://github.com/WebKit/WebKit/pull/63415).