Bug 196218 - [ iOS Sim] Layout Test performance-api/performance-observer-periodic.html is flaky failure
Summary: [ iOS Sim] Layout Test performance-api/performance-observer-periodic.html is ...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2019-03-25 15:06 PDT by Shawn Roberts
Modified: 2019-03-25 15:16 PDT (History)
4 users (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Shawn Roberts 2019-03-25 15:06:39 PDT 
Test is now a flaky failure on iOS 12 Simulator

Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=performance-api%2Fperformance-observer-periodic.html

First appearance was around r243337 but I was able to reproduce it with r242010 so it appears it's been flaky for as long as the other platforms. Gets about 1 failure in 1000 iterations, highly flaky. 

Test has been marked as flaky for Mac OS in previous bugs. Will link those as well.

Reproducible with :

run-webkit-tests performance-api/performance-observer-periodic.html --ios-simulator --iterations 1000 -f

--- /Volumes/Data/slave/ios-simulator-12-release-tests-wk2/build/layout-test-results/performance-api/performance-observer-periodic-expected.txt
+++ /Volumes/Data/slave/ios-simulator-12-release-tests-wk2/build/layout-test-results/performance-api/performance-observer-periodic-actual.txt
@@ -5,9 +5,6 @@
 
 PerformanceObserver callback fired: 1 entries
 PASS mark1
-PerformanceObserver callback fired: 2 entries
-PASS mark2
-PASS mark3
 PerformanceObserver callback fired: 1 entries
 PASS mark7
 PASS successfullyParsed is true
Comment 1 Radar WebKit Bug Importer 2019-03-25 15:08:17 PDT 
<rdar://problem/49231519>
Comment 2 Shawn Roberts 2019-03-25 15:16:23 PDT 
Marked test as flaky in https://trac.webkit.org/changeset/243466/webkit