Bug 163361 - [mac-wk1] imported/w3c/web-platform-tests/html/webappapis/animation-frames/callback-* tests are flaky
Summary: [mac-wk1] imported/w3c/web-platform-tests/html/webappapis/animation-frames/ca...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2016-10-12 15:04 PDT by Ryan Haddad
Modified: 2016-12-14 15:05 PST (History)
4 users (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Ryan Haddad 2016-10-12 15:04:44 PDT 
These three tests are flaky failures, always failing together on the same run. The text diff shows a timeout error.

imported/w3c/web-platform-tests/html/webappapis/animation-frames/callback-exception.html
imported/w3c/web-platform-tests/html/webappapis/animation-frames/callback-invoked.html
imported/w3c/web-platform-tests/html/webappapis/animation-frames/callback-multicalls.html

http://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fwebappapis%2Fanimation-frames%2Fcallback-exception.html
http://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fwebappapis%2Fanimation-frames%2Fcallback-invoked.html
http://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fwebappapis%2Fanimation-frames%2Fcallback-multicalls.html

--- /Volumes/Data/slave/sierra-release-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/html/webappapis/animation-frames/callback-exception-expected.txt
+++ /Volumes/Data/slave/sierra-release-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/html/webappapis/animation-frames/callback-exception-actual.txt
@@ -1,4 +1,5 @@
-CONSOLE MESSAGE: line 22: Error: requestAnimationFrameException
 
-PASS requestAnimationFrame callback exceptions are reported to error handler 
+Harness Error (TIMEOUT), message = null
 
+TIMEOUT requestAnimationFrame callback exceptions are reported to error handler Test timed out
+
Comment 1 Ryan Haddad 2016-10-19 09:36:11 PDT 
Marked tests as flaky in http://trac.webkit.org/projects/webkit/changeset/207538