Bug 193399 - REGRESSION: Layout Test media/media-fullscreen-return-to-inline.html is a flaky timeout
Summary: REGRESSION: Layout Test media/media-fullscreen-return-to-inline.html is a fla...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2019-01-14 09:16 PST by Truitt Savell
Modified: 2019-03-11 15:48 PDT (History)
7 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Truitt Savell 2019-01-14 09:16:48 PST
The following layout test is failing on MacOS

media/media-fullscreen-return-to-inline.html

Probable cause:

This test recently became a flakey failure. It is highly intermittent and has no clear regression point. First failure came from a run of r239860. 

Flakiness Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=media%2Fmedia-fullscreen-return-to-inline.html

Diff:
--- /Volumes/Data/slave/highsierra-release-tests-wk2/build/layout-test-results/media/media-fullscreen-return-to-inline-expected.txt
+++ /Volumes/Data/slave/highsierra-release-tests-wk2/build/layout-test-results/media/media-fullscreen-return-to-inline-actual.txt
@@ -12,6 +12,6 @@
 EVENT(webkitfullscreenchange)
 RUN(video.webkitExitFullscreen())
 EVENT(webkitfullscreenchange)
-EXPECTED (video.paused == 'false') OK
+EXPECTED (video.paused == 'false'), OBSERVED 'true' FAIL
 END OF TEST
Comment 1 Truitt Savell 2019-01-23 11:47:55 PST
the behavior of this test seems to have changed around 1/17 around r240124.

the test is not timing out with around the same frequency as the failures. the test is no longer failing.
Comment 2 Truitt Savell 2019-02-04 09:15:07 PST
This test timeout is reproducible with command:
run-webkit-tests --root testbuild-240924 media/media-fullscreen-return-to-inline.html --iterations 500 -f
Comment 3 Radar WebKit Bug Importer 2019-02-12 11:23:28 PST
<rdar://problem/48007955>
Comment 4 Ryan Haddad 2019-03-11 14:56:33 PDT
This is still timing out quite frequently on the bots, so we should consider updating TestExpectations.
Comment 5 Truitt Savell 2019-03-11 15:48:26 PDT
marked test flakey in https://trac.webkit.org/changeset/242744/webkit