Bug 154055 – [iOS Simulator] perf/adding-radio-buttons.html is flaky

• Component: New Bugs
• Status: NEW

[Ryan Haddad]

[iOS Simulator] perf/adding-radio-buttons.html is flaky

<https://build.webkit.org/results/Apple%20iOS%209%20Simulator%20Release%20WK2%20(Tests)/r196342%20(2979)/results.html>
<http://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=perf%2Fadding-radio-buttons.html>

--- /Volumes/Data/slave/ios-simulator-9-release-tests-wk2/build/layout-test-results/perf/adding-radio-buttons-expected.txt
+++ /Volumes/Data/slave/ios-simulator-9-release-tests-wk2/build/layout-test-results/perf/adding-radio-buttons-actual.txt
@@ -1,3 +1,50 @@
 Tests that adding a radio button to a radio button group is linear in the number of radio buttons.
-PASS
+FAIL: got indeterminate result expected O(n)
 
+DEBUG LOG:
+run iteration. magnitude 2 jsObjectCountBefore 27003 jsObjectCountAfter 3625
+run iteration. magnitude 4 jsObjectCountBefore 3625 jsObjectCountAfter 3666
+run iteration. magnitude 8 jsObjectCountBefore 3666 jsObjectCountAfter 3676
+run iteration. magnitude 16 jsObjectCountBefore 3676 jsObjectCountAfter 3691
+run iteration. magnitude 32 jsObjectCountBefore 3691 jsObjectCountAfter 3714
+run iteration. magnitude 64 jsObjectCountBefore 3714 jsObjectCountAfter 3755
+run iteration. magnitude 128 jsObjectCountBefore 3755 jsObjectCountAfter 3826
+run iteration. magnitude 256 jsObjectCountBefore 3826 jsObjectCountAfter 3961
+magnitudes: 2,4,8,16,32,64,128,256
+iterations: 182,163,164,174,161,143,117,117
+numPoints 8 slope 0.0003083047942323102 intercept 0.14838421450299621 rSquared 0.8190959726390741
+numPoints 8 slope 0.015705671658226197 intercept 0.1190501060061572 rSquared 0.7817579422359413
+numPoints 8 slope 0.08998684808093542 intercept -2.0774671952585644 rSquared 0.7976774602112154
+rSquared 0.8190959726390741 rSquaredXLog 0.7817579422359413 rSquaredXYLog 0.7976774602112154
+numTriesLeft: 2
+run iteration. magnitude 2 jsObjectCountBefore 3961 jsObjectCountAfter 3786
+run iteration. magnitude 4 jsObjectCountBefore 3786 jsObjectCountAfter 3796
+run iteration. magnitude 8 jsObjectCountBefore 3796 jsObjectCountAfter 3806
+run iteration. magnitude 16 jsObjectCountBefore 3806 jsObjectCountAfter 3821
+run iteration. magnitude 32 jsObjectCountBefore 3821 jsObjectCountAfter 3844
+run iteration. magnitude 64 jsObjectCountBefore 3844 jsObjectCountAfter 3883
+run iteration. magnitude 128 jsObjectCountBefore 3883 jsObjectCountAfter 3954
+run iteration. magnitude 256 jsObjectCountBefore 3954 jsObjectCountAfter 4094
+magnitudes: 2,4,8,16,32,64,128,256
+iterations: 185,180,179,158,153,144,126,113
+numPoints 8 slope 0.00033082968411293437 intercept 0.14498187226054143 rSquared 0.9087456646328432
+numPoints 8 slope 0.017301270084991095 intercept 0.11210679501491133 rSquared 0.9140594086062277
+numPoints 8 slope 0.10165891171198786 intercept -2.126616628959169 rSquared 0.9422336852960865
+rSquared 0.9087456646328432 rSquaredXLog 0.9140594086062277 rSquaredXYLog 0.9422336852960865
+numTriesLeft: 1
+run iteration. magnitude 2 jsObjectCountBefore 4094 jsObjectCountAfter 3885
+run iteration. magnitude 4 jsObjectCountBefore 3885 jsObjectCountAfter 3895
+run iteration. magnitude 8 jsObjectCountBefore 3895 jsObjectCountAfter 3905
+run iteration. magnitude 16 jsObjectCountBefore 3905 jsObjectCountAfter 3920
+run iteration. magnitude 32 jsObjectCountBefore 3920 jsObjectCountAfter 3943
+run iteration. magnitude 64 jsObjectCountBefore 3943 jsObjectCountAfter 3982
+run iteration. magnitude 128 jsObjectCountBefore 3982 jsObjectCountAfter 4053
+run iteration. magnitude 256 jsObjectCountBefore 4053 jsObjectCountAfter 4188
+magnitudes: 2,4,8,16,32,64,128,256
+iterations: 176,196,181,174,164,129,125,114
+numPoints 8 slope 0.00035112242388917966 intercept 0.14223243328346055 rSquared 0.8183794560817225
+numPoints 8 slope 0.018528429478365978 intercept 0.10682330886729656 rSquared 0.8381077271751465
+numPoints 8 slope 0.10930555255695275 intercept -2.1633586855455547 rSquared 0.8424972165011254
+rSquared 0.8183794560817225 rSquaredXLog 0.8381077271751465 rSquaredXYLog 0.8424972165011254
+
+

[Ryan Haddad]

Marked as flaky on ios-simulator with <https://trac.webkit.org/r196346>

[Ryan Haddad]

The test also times out intermittently. Updated expectations in r198789.