Bug 172255 – imported/w3c/web-platform-tests/html/browsers/windows/browsing-context.html is a flaky failure

• Status: RESOLVED
• Resolution: FIXED
• Component: New Bugs

[Matt Lewis]

The test imported/w3c/web-platform-tests/html/browsers/windows/browsing-context.html is a flaky failure on both Wk1 and wk2 on Sierra Debug.

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fbrowsers%2Fwindows%2Fbrowsing-context.html

https://build.webkit.org/results/Apple%20Sierra%20Debug%20WK2%20(Tests)/r216991%20(1055)/results.html
https://build.webkit.org/builders/Apple%20Sierra%20Debug%20WK2%20(Tests)/builds/1055

diff:
--- /Volumes/Data/slave/sierra-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/html/browsers/windows/browsing-context-expected.txt
+++ /Volumes/Data/slave/sierra-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/html/browsers/windows/browsing-context-actual.txt
@@ -2,5 +2,5 @@
 FAIL Check that browsing context has new, ready HTML document assert_equals: The document's encoding should be 'UTF-8'. expected "UTF-8" but got "windows-1252"
 PASS Check that new document nodes extant, empty 
 PASS Check the document properties corresponding to the creator browsing context 
-FAIL Check the history.length of the created browsing context assert_equals: The history.length should be 1. expected 1 but got 100
+FAIL Check the history.length of the created browsing context assert_equals: The history.length should be 1. expected 1 but got 90
 


I was able to reproduce the failure on Sierra Debug with:

run-webkit-tests imported/w3c/web-platform-tests/html/browsers/windows/browsing-context.html --iterations=100 --no-retry-failure --debug

[Matt Lewis]

This test is actually flaky on all Mac WK1 platforms and only on Debug WK2 per the flakiness dashboard. Right now test is marked as failure on windows in the expectations. 
However the release wk1 have only recently started to fail intermittently as of 5/22/17.
Test was originally brought in with this revision:
https://trac.webkit.org/changeset/213882/webkit

[Alexey Proskuryakov]

*** Bug 172934 has been marked as a duplicate of this bug. ***

[Alexey Proskuryakov]

Looking at the flakiness dashboard, it's very flaky, and it's affecting CQ/EWS. Could you please add an expectation?

[Matt Lewis]

Marked the test as flaky https://trac.webkit.org/changeset/218104/webkit/

[Ms2ger (he/him; ⌚ UTC+1/+2)]

Created attachment 330321 [details]
Patch

[WebKit Commit Bot]

Comment on attachment 330321 [details]
Patch

Clearing flags on attachment: 330321

Committed r226328: <https://trac.webkit.org/changeset/226328>

[WebKit Commit Bot]

All reviewed patches have been landed.  Closing bug.

[Radar WebKit Bug Importer]

<rdar://problem/36260889>