Bug 313058 – [GTK][WPE] media/media-vp8-webm.html is a flaky test

• Status: NEW
• Component: WPE WebKit

[Nikolas Zimmermann]

wktesthunter output for this flaky test across affected bots:

>>> wpe-arm64-release <<<
[311766@main-311767@main]     UNKNOWN
311768@main                   NOERROR
311769@main                   UNKNOWN
311770@main                   NOERROR
[311771@main-311772@main]     UNKNOWN
311773@main                   NOERROR
[311774@main-311775@main]     UNKNOWN
311776@main                   NOERROR
[311777@main-311781@main]     UNKNOWN
[311782@main-311783@main]     NOERROR
[311784@main-311788@main]     UNKNOWN
311789@main                   NOERROR
[311790@main-311793@main]     UNKNOWN
311794@main                   NOERROR


The bot wpe-arm64-release completed 1253 runs on the interval [308164@main-311794@main]
Frequency of results for test: media/media-vp8-webm.html
  1192 times [95.1%]     ->  NOERROR
  31 times [2.5%]        ->  TIMEOUT IMAGE
  30 times [2.4%]        ->  TIMEOUT PASS

Of those 1253 runs it didn't match the expectation 61 times [4.9%]
Details of the type and frequency of unmatched expectations:
  31 times [2.5%]        ->  TIMEOUT IMAGE (Expected: PASS)
  30 times [2.4%]        ->  TIMEOUT PASS (Expected: PASS)

Flakiness factor: 9.3%
    - This test was flaky on 9.3% of the 1253 runs analyzed, either giving different
      results within a single run, or a different result than in the previous run.

>>> wpe-release <<<
[311768@main-311769@main]     UNKNOWN
311770@main                   NOERROR
[311771@main-311772@main]     UNKNOWN
311773@main                   NOERROR
[311774@main-311775@main]     UNKNOWN
311776@main                   NOERROR
[311777@main-311782@main]     UNKNOWN
311783@main                   NOERROR
[311784@main-311791@main]     UNKNOWN
311792@main                   NOERROR
311793@main                   UNKNOWN
311794@main                   NOERROR


The bot wpe-release completed 1389 runs on the interval [307795@main-311794@main]
Frequency of results for test: media/media-vp8-webm.html
  1381 times [99.4%]     ->  NOERROR
  5 times [0.4%]         ->  TIMEOUT IMAGE
  2 times [0.1%]         ->  IMAGE
  1 times [0.1%]         ->  IMAGE PASS

Of those 1389 runs it didn't match the expectation 8 times [0.6%]
Details of the type and frequency of unmatched expectations:
  5 times [0.4%]         ->  TIMEOUT IMAGE (Expected: PASS)
  2 times [0.1%]         ->  IMAGE (Expected: PASS)
  1 times [0.1%]         ->  IMAGE PASS (Expected: PASS)

Flakiness factor: 1.2%
    - This test was flaky on 1.2% of the 1389 runs analyzed, either giving different
      results within a single run, or a different result than in the previous run.

>>> gtk-release <<<
311760@main                   UNKNOWN
311761@main                   NOERROR
311762@main                   UNKNOWN
311763@main                   NOERROR
[311764@main-311766@main]     UNKNOWN
311767@main                   NOERROR
[311768@main-311769@main]     UNKNOWN
311770@main                   NOERROR
[311771@main-311773@main]     UNKNOWN
311774@main                   NOERROR
[311775@main-311782@main]     UNKNOWN
311783@main                   NOERROR
[311784@main-311791@main]     UNKNOWN
311792@main                   NOERROR


The bot gtk-release completed 1255 runs on the interval [307792@main-311792@main]
Frequency of results for test: media/media-vp8-webm.html
  1251 times [99.7%]     ->  NOERROR
  1 times [0.1%]         ->  TIMEOUT PASS
  3 times [0.2%]         ->  TIMEOUT IMAGE

Of those 1255 runs it didn't match the expectation 4 times [0.3%]
Details of the type and frequency of unmatched expectations:
  1 times [0.1%]         ->  TIMEOUT PASS (Expected: PASS)
  3 times [0.2%]         ->  TIMEOUT IMAGE (Expected: PASS)

Flakiness factor: 0.6%
    - This test was flaky on 0.6% of the 1255 runs analyzed, either giving different
      results within a single run, or a different result than in the previous run.