Bug 196218

Summary: [ iOS Sim] Layout Test performance-api/performance-observer-periodic.html is flaky failure
Product: WebKit Reporter: Shawn Roberts <sroberts>
Component: Tools / TestsAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Normal CC: joepeck, lforschler, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=168136
https://bugs.webkit.org/show_bug.cgi?id=172386

Description Shawn Roberts 2019-03-25 15:06:39 PDT
Test is now a flaky failure on iOS 12 Simulator

Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=performance-api%2Fperformance-observer-periodic.html

First appearance was around r243337 but I was able to reproduce it with r242010 so it appears it's been flaky for as long as the other platforms. Gets about 1 failure in 1000 iterations, highly flaky. 

Test has been marked as flaky for Mac OS in previous bugs. Will link those as well.

Reproducible with :

run-webkit-tests performance-api/performance-observer-periodic.html --ios-simulator --iterations 1000 -f

--- /Volumes/Data/slave/ios-simulator-12-release-tests-wk2/build/layout-test-results/performance-api/performance-observer-periodic-expected.txt
+++ /Volumes/Data/slave/ios-simulator-12-release-tests-wk2/build/layout-test-results/performance-api/performance-observer-periodic-actual.txt
@@ -5,9 +5,6 @@
 
 PerformanceObserver callback fired: 1 entries
 PASS mark1
-PerformanceObserver callback fired: 2 entries
-PASS mark2
-PASS mark3
 PerformanceObserver callback fired: 1 entries
 PASS mark7
 PASS successfullyParsed is true
Comment 1 Radar WebKit Bug Importer 2019-03-25 15:08:17 PDT
<rdar://problem/49231519>
Comment 2 Shawn Roberts 2019-03-25 15:16:23 PDT
Marked test as flaky in https://trac.webkit.org/changeset/243466/webkit