Bug 180997 – Layout Test svg/animations/smil-leak-element-instances-noBaseValRef.svg is flaky

• Component: SVG
• Status: RESOLVED CONFIGURATION CHANGED

[Matt Lewis]

The following layout test is flaky on macOS WK1

svg/animations/smil-leak-element-instances-noBaseValRef.svg

Flakiness Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=svg%2Fanimations%2Fsmil-leak-element-instances-noBaseValRef.svg

Diff:

--- /Volumes/Data/slave/sierra-release-tests-wk1/build/layout-test-results/svg/animations/smil-leak-element-instances-noBaseValRef-expected.txt
+++ /Volumes/Data/slave/sierra-release-tests-wk1/build/layout-test-results/svg/animations/smil-leak-element-instances-noBaseValRef-actual.txt
@@ -1 +1 @@
-PASS
+FAIL: -17 extra live node(s)

[Matt Lewis]

Sample builds: 
https://build.webkit.org/results/Apple%20High%20Sierra%20Release%20WK1%20(Tests)/r226180%20(2188)/results.html
https://build.webkit.org/builders/Apple%20High%20Sierra%20Release%20WK1%20(Tests)/builds/2188

[Matt Lewis]

I was able to reproduce the issue with:

run-webkit-tests --no-retry-failures --verbose -1 -g svg/animations/smil-leak-element-instances-noBaseValRef.svg

However it is extremely flaky this way. I was also able to reproduce the issue much further back than what the dashboard indicates as the first failure.

[Matt Lewis]

Marked as flaky in:
https://trac.webkit.org/changeset/226187/webkit

[Radar WebKit Bug Importer]

<rdar://problem/42793017>

[Ryan Haddad]

This test does not appear to be a flaky failure any longer. It has timed out a few times recently, which is probably related to https://bugs.webkit.org/show_bug.cgi?id=187931

[Ryan Haddad]

Removed flaky expectation in https://trac.webkit.org/changeset/234441/webkit