Bug 313044 – [GTK][WPE] webgl/2.0.0/conformance2/textures/video/tex-2d-r11f_g11f_b10f-rgb-half_float.html is a flaky test

• Component: WPE WebKit
• Status: RESOLVED WONTFIX

[Nikolas Zimmermann]

wktesthunter output for this flaky test across affected bots:

>>> gtk-release <<<
[311754@main-311758@main]     UNKNOWN
311759@main                   NOERROR
311760@main                   UNKNOWN
311761@main                   NOERROR
311762@main                   UNKNOWN
311763@main                   NOERROR
[311764@main-311766@main]     UNKNOWN
311767@main                   NOERROR
[311768@main-311769@main]     UNKNOWN
311770@main                   NOERROR
[311771@main-311773@main]     UNKNOWN
311774@main                   NOERROR
[311775@main-311782@main]     UNKNOWN
311783@main                   TIMEOUT PASS (Expected: PASS)
[311784@main-311791@main]     UNKNOWN
311792@main                   TIMEOUT PASS (Expected: PASS)


The bot gtk-release completed 1255 runs on the interval [307792@main-311792@main]
Frequency of results for test: webgl/2.0.0/conformance2/textures/video/tex-2d-r11f_g11f_b10f-rgb-half_float.html
  1248 times [99.4%]     ->  NOERROR
  7 times [0.6%]         ->  TIMEOUT PASS

Of those 1255 runs it didn't match the expectation 7 times [0.6%]
Details of the type and frequency of unmatched expectations:
  7 times [0.6%]         ->  TIMEOUT PASS (Expected: PASS)

Flakiness factor: 1.0%
    - This test was flaky on 1.0% of the 1255 runs analyzed, either giving different
      results within a single run, or a different result than in the previous run.

>>> wpe-release <<<
311766@main                   UNKNOWN
311767@main                   NOERROR
[311768@main-311769@main]     UNKNOWN
311770@main                   NOERROR
[311771@main-311772@main]     UNKNOWN
311773@main                   NOERROR
[311774@main-311775@main]     UNKNOWN
311776@main                   NOERROR
[311777@main-311782@main]     UNKNOWN
311783@main                   NOERROR
[311784@main-311791@main]     UNKNOWN
311792@main                   NOERROR
311793@main                   UNKNOWN
311794@main                   NOERROR


The bot wpe-release completed 1389 runs on the interval [307795@main-311794@main]
Frequency of results for test: webgl/2.0.0/conformance2/textures/video/tex-2d-r11f_g11f_b10f-rgb-half_float.html
  1382 times [99.5%]     ->  NOERROR
  6 times [0.4%]         ->  TIMEOUT PASS
  1 times [0.1%]         ->  TEXT PASS

Of those 1389 runs it didn't match the expectation 7 times [0.5%]
Details of the type and frequency of unmatched expectations:
  6 times [0.4%]         ->  TIMEOUT PASS (Expected: PASS)
  1 times [0.1%]         ->  TEXT PASS (Expected: PASS)

Flakiness factor: 1.0%
    - This test was flaky on 1.0% of the 1389 runs analyzed, either giving different
      results within a single run, or a different result than in the previous run.

>>> wpe-arm64-release <<<
[311771@main-311772@main]     UNKNOWN
311773@main                   NOERROR
[311774@main-311775@main]     UNKNOWN
311776@main                   NOERROR
[311777@main-311781@main]     UNKNOWN
[311782@main-311783@main]     NOERROR
[311784@main-311788@main]     UNKNOWN
311789@main                   NOERROR
[311790@main-311793@main]     UNKNOWN
311794@main                   NOERROR


The bot wpe-arm64-release completed 1253 runs on the interval [308164@main-311794@main]
Frequency of results for test: webgl/2.0.0/conformance2/textures/video/tex-2d-r11f_g11f_b10f-rgb-half_float.html
  1241 times [99.0%]     ->  NOERROR
  5 times [0.4%]         ->  TEXT PASS
  1 times [0.1%]         ->  TIMEOUT PASS
  5 times [0.4%]         ->  TIMEOUT TEXT
  1 times [0.1%]         ->  TEXT

Of those 1253 runs it didn't match the expectation 12 times [1.0%]
Details of the type and frequency of unmatched expectations:
  5 times [0.4%]         ->  TEXT PASS (Expected: PASS)
  1 times [0.1%]         ->  TIMEOUT PASS (Expected: PASS)
  5 times [0.4%]         ->  TIMEOUT TEXT (Expected: PASS)
  1 times [0.1%]         ->  TEXT (Expected: PASS)

Flakiness factor: 1.9%
    - This test was flaky on 1.9% of the 1253 runs analyzed, either giving different
      results within a single run, or a different result than in the previous run.

[Nikolas Zimmermann]

Closing: flakiness factor was below the 5% threshold; the TestExpectations entry has been removed in webkit.org/b/313122 (PR https://github.com/WebKit/WebKit/pull/63415).