Bug 154055 - [iOS Simulator] perf/adding-radio-buttons.html is flaky
Summary: [iOS Simulator] perf/adding-radio-buttons.html is flaky
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: iPhone / iPad iOS 9.0
: P2 Normal
Assignee: Nobody
URL:
Keywords:
Depends on:
Blocks: 152130
  Show dependency tree / graph
 
Reported: 2016-02-09 16:25 PST by Ryan Haddad
Modified: 2016-03-29 12:51 PDT (History)
1 user (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Ryan Haddad 2016-02-09 16:25:44 PST 
[iOS Simulator] perf/adding-radio-buttons.html is flaky

<https://build.webkit.org/results/Apple%20iOS%209%20Simulator%20Release%20WK2%20(Tests)/r196342%20(2979)/results.html>
<http://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=perf%2Fadding-radio-buttons.html>

--- /Volumes/Data/slave/ios-simulator-9-release-tests-wk2/build/layout-test-results/perf/adding-radio-buttons-expected.txt
+++ /Volumes/Data/slave/ios-simulator-9-release-tests-wk2/build/layout-test-results/perf/adding-radio-buttons-actual.txt
@@ -1,3 +1,50 @@
 Tests that adding a radio button to a radio button group is linear in the number of radio buttons.
-PASS
+FAIL: got indeterminate result expected O(n)
 
+DEBUG LOG:
+run iteration. magnitude 2 jsObjectCountBefore 27003 jsObjectCountAfter 3625
+run iteration. magnitude 4 jsObjectCountBefore 3625 jsObjectCountAfter 3666
+run iteration. magnitude 8 jsObjectCountBefore 3666 jsObjectCountAfter 3676
+run iteration. magnitude 16 jsObjectCountBefore 3676 jsObjectCountAfter 3691
+run iteration. magnitude 32 jsObjectCountBefore 3691 jsObjectCountAfter 3714
+run iteration. magnitude 64 jsObjectCountBefore 3714 jsObjectCountAfter 3755
+run iteration. magnitude 128 jsObjectCountBefore 3755 jsObjectCountAfter 3826
+run iteration. magnitude 256 jsObjectCountBefore 3826 jsObjectCountAfter 3961
+magnitudes: 2,4,8,16,32,64,128,256
+iterations: 182,163,164,174,161,143,117,117
+numPoints 8 slope 0.0003083047942323102 intercept 0.14838421450299621 rSquared 0.8190959726390741
+numPoints 8 slope 0.015705671658226197 intercept 0.1190501060061572 rSquared 0.7817579422359413
+numPoints 8 slope 0.08998684808093542 intercept -2.0774671952585644 rSquared 0.7976774602112154
+rSquared 0.8190959726390741 rSquaredXLog 0.7817579422359413 rSquaredXYLog 0.7976774602112154
+numTriesLeft: 2
+run iteration. magnitude 2 jsObjectCountBefore 3961 jsObjectCountAfter 3786
+run iteration. magnitude 4 jsObjectCountBefore 3786 jsObjectCountAfter 3796
+run iteration. magnitude 8 jsObjectCountBefore 3796 jsObjectCountAfter 3806
+run iteration. magnitude 16 jsObjectCountBefore 3806 jsObjectCountAfter 3821
+run iteration. magnitude 32 jsObjectCountBefore 3821 jsObjectCountAfter 3844
+run iteration. magnitude 64 jsObjectCountBefore 3844 jsObjectCountAfter 3883
+run iteration. magnitude 128 jsObjectCountBefore 3883 jsObjectCountAfter 3954
+run iteration. magnitude 256 jsObjectCountBefore 3954 jsObjectCountAfter 4094
+magnitudes: 2,4,8,16,32,64,128,256
+iterations: 185,180,179,158,153,144,126,113
+numPoints 8 slope 0.00033082968411293437 intercept 0.14498187226054143 rSquared 0.9087456646328432
+numPoints 8 slope 0.017301270084991095 intercept 0.11210679501491133 rSquared 0.9140594086062277
+numPoints 8 slope 0.10165891171198786 intercept -2.126616628959169 rSquared 0.9422336852960865
+rSquared 0.9087456646328432 rSquaredXLog 0.9140594086062277 rSquaredXYLog 0.9422336852960865
+numTriesLeft: 1
+run iteration. magnitude 2 jsObjectCountBefore 4094 jsObjectCountAfter 3885
+run iteration. magnitude 4 jsObjectCountBefore 3885 jsObjectCountAfter 3895
+run iteration. magnitude 8 jsObjectCountBefore 3895 jsObjectCountAfter 3905
+run iteration. magnitude 16 jsObjectCountBefore 3905 jsObjectCountAfter 3920
+run iteration. magnitude 32 jsObjectCountBefore 3920 jsObjectCountAfter 3943
+run iteration. magnitude 64 jsObjectCountBefore 3943 jsObjectCountAfter 3982
+run iteration. magnitude 128 jsObjectCountBefore 3982 jsObjectCountAfter 4053
+run iteration. magnitude 256 jsObjectCountBefore 4053 jsObjectCountAfter 4188
+magnitudes: 2,4,8,16,32,64,128,256
+iterations: 176,196,181,174,164,129,125,114
+numPoints 8 slope 0.00035112242388917966 intercept 0.14223243328346055 rSquared 0.8183794560817225
+numPoints 8 slope 0.018528429478365978 intercept 0.10682330886729656 rSquared 0.8381077271751465
+numPoints 8 slope 0.10930555255695275 intercept -2.1633586855455547 rSquared 0.8424972165011254
+rSquared 0.8183794560817225 rSquaredXLog 0.8381077271751465 rSquaredXYLog 0.8424972165011254
+
+
Comment 1 Ryan Haddad 2016-02-09 16:27:52 PST 
Marked as flaky on ios-simulator with <https://trac.webkit.org/r196346>
Comment 2 Ryan Haddad 2016-03-29 12:51:52 PDT 
The test also times out intermittently. Updated expectations in r198789.