Bug 150806

Summary: [Mac] imported/w3c/web-platform-tests/XMLHttpRequest/send-timeout-events.htm is flaky
Product: WebKit Reporter: Ryan Haddad <ryanhaddad>
Component: Tools / TestsAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Normal CC: ayumi_kojima, lforschler, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=150823
https://bugs.webkit.org/show_bug.cgi?id=153371
https://bugs.webkit.org/show_bug.cgi?id=231337

Description Ryan Haddad 2015-11-02 10:26:30 PST
imported/w3c/web-platform-tests/XMLHttpRequest/send-timeout-events.htm is flaky on Mac

Most recent failure:
<https://build.webkit.org/builders/Apple%20Yosemite%20Debug%20WK1%20(Tests)/builds/8617>

Flakiness dashboard:
<http://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2FXMLHttpRequest%2Fsend-timeout-events.htm>


--- /Volumes/Data/slave/yosemite-debug-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/XMLHttpRequest/send-timeout-events-expected.txt
+++ /Volumes/Data/slave/yosemite-debug-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/XMLHttpRequest/send-timeout-events-actual.txt
@@ -1,3 +1,3 @@
 
-FAIL XMLHttpRequest: The send() method: timeout is not 0  assert_array_equals: lengths differ, expected 6 got 5
+FAIL XMLHttpRequest: The send() method: timeout is not 0  assert_equals: expected 0 but got 736812
Comment 1 ayumi_kojima 2021-10-06 14:28:25 PDT
Now the test is flaky on iOS 15 as well.

History: https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fxhr%2Fsend-timeout-events.htm

Diff:
--- /Volumes/Data/worker/ios-simulator-15-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/xhr/send-timeout-events-expected.txt
+++ /Volumes/Data/worker/ios-simulator-15-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/xhr/send-timeout-events-actual.txt
@@ -1,3 +1,3 @@
 
-PASS XMLHttpRequest: The send() method: timeout is not 0
+FAIL XMLHttpRequest: The send() method: timeout is not 0  assert_equals: expected 0 but got 857098
Comment 2 Radar WebKit Bug Importer 2021-10-06 14:28:42 PDT
<rdar://problem/83951964>
Comment 3 ayumi_kojima 2021-10-06 16:01:27 PDT
Please ignore my comment above. Those are different tests.
Comment 4 ayumi_kojima 2021-11-02 15:14:05 PDT
I think the test has been moved to imported/w3c/web-platform-tests/xhr/send-timeout-events.htm. Will track in https://bugs.webkit.org/show_bug.cgi?id=231337.