Bug 196944

Summary: [iOS Sim] REGRESSION (r244182) Layout Test imported/w3c/web-platform-tests/hr-time/test_cross_frame_start.html is a flaky failure
Product: WebKit Reporter: Shawn Roberts <sroberts>
Component: Tools / TestsAssignee: Nobody <webkit-unassigned>
Status: RESOLVED CONFIGURATION CHANGED    
Severity: Normal CC: lforschler, sabouhallawa, simon.fraser, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   

Description Shawn Roberts 2019-04-15 15:26:13 PDT
The following layout test is flaky on iOS Simulator Release

imported/w3c/web-platform-tests/hr-time/test_cross_frame_start.html

Probable cause:

After changes in https://trac.webkit.org/changeset/244182/webkit the test started showing on the dashboard and is reproducible locally. tests ran with revision before this result in passing results. 

reproduced with:

run-webkit-tests imported/w3c/web-platform-tests/hr-time/test_cross_frame_start.html --iterations 50 -f --ios-simulator

Flakiness Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2Fhr-time%2Ftest_cross_frame_start.html

--- /Volumes/Data/slave/ios-simulator-12-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/hr-time/test_cross_frame_start-expected.txt
+++ /Volumes/Data/slave/ios-simulator-12-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/hr-time/test_cross_frame_start-actual.txt
@@ -6,6 +6,6 @@
 PASS Setup the frame 
 PASS parent performance.now() > 0 
 PASS child performance.now() > 0 
-PASS Child created at least 1 second after parent 
-PASS Child and parent time bases are correct 
+FAIL Child created at least 1 second after parent null is not an object (evaluating 'childWindow.performance.timing.navigationStart')
+FAIL Child and parent time bases are correct null is not an object (evaluating 'childWindow.performance.timing.loadEventStart')
Comment 1 Radar WebKit Bug Importer 2019-04-15 15:29:47 PDT
<rdar://problem/49920460>
Comment 2 Shawn Roberts 2019-04-15 15:35:53 PDT
Marked flaky in https://trac.webkit.org/changeset/244301/webkit while waiting for a fix.
Comment 3 Said Abou-Hallawa 2020-03-23 18:43:04 PDT
Flaky expectation for this test was removed in:

Committed r258895: <https://trac.webkit.org/changeset/258895>.