Bug 307032 – [GStreamer] imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-removetrack.https.html is flaky timing out

• Status: REOPENED
• Component: Media

[Lauro Moura]

imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-removetrack.https.html

The bot wpe-release completed 1073 runs on the interval [302753@main-306750@main]
Frecuency of results for test: imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-removetrack.https.html
  70 times [6.5%]        ->  TIMEOUT
  493 times [45.9%]      ->  CRASH
  503 times [46.9%]      ->  NOERROR
  7 times [0.7%]         ->  TIMEOUT PASS

Of those 1073 runs it didn't match the expectation 7 times [0.7%]
Details of the type and frequency of unmatched expectations:
  7 times [0.7%]         ->  TIMEOUT PASS (Expected: PASS)

Flakiness factor: 6.0%
    - This test was flaky on 6.0% of the 1073 runs analyzed, either giving different
      results within a single run, or a different result than in the previous run.

The bot gtk-release completed 995 runs on the interval [302755@main-306751@main]
Frecuency of results for test: imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-removetrack.https.html
  115 times [11.6%]      ->  TIMEOUT
  447 times [44.9%]      ->  CRASH
  20 times [2.0%]        ->  TIMEOUT PASS
  413 times [41.5%]      ->  NOERROR

Of those 995 runs it didn't match the expectation 22 times [2.2%]
Details of the type and frequency of unmatched expectations:
  20 times [2.0%]        ->  TIMEOUT PASS (Expected: PASS)
  1 times [0.1%]         ->  TIMEOUT (Expected: PASS)
  1 times [0.1%]         ->  CRASH (Expected: PASS)

Flakiness factor: 9.9%
    - This test was flaky on 9.9% of the 995 runs analyzed, either giving different
      results within a single run, or a different result than in the previous run.

[Carlos Alberto Lopez Perez]

This tests fails now. See bug 311032

[Philippe Normand]

It's not failing, it's passing and needs a rebaseline.

--- /var/home/phil/WebKit/WebKitBuild/GTK/Debug/layout-test-results/imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-removetrack.https-expected.txt
+++ /var/home/phil/WebKit/WebKitBuild/GTK/Debug/layout-test-results/imported/w3c/web-platform-tests/mediacapture-streams/MediaStream-removetrack.https-actual.txt
@@ -8,5 +8,5 @@

 PASS Tests that a removal from a MediaStream works as expected
 PASS Test that removal from a MediaStream fires ended on media elements (video first)
-FAIL Test that removal from a MediaStream fires ended on media elements (audio first) assert_equals: audio element ended because no more audio tracks expected true but got false
+PASS Test that removal from a MediaStream fires ended on media elements (audio first)

I will do that in bug 311317.

*** This bug has been marked as a duplicate of bug 311317 ***

[Philippe Normand]

In Debug it's ok but not Release, sigh :(