Bug 156561 – perf/rel-list-remove.html is very flaky on iOS

• Status: NEW
• Component: Tools / Tests

[Alexey Proskuryakov]

perf/rel-list-remove.html frequently fails on iOS, with timeouts and text failures.

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&revision=199512&tests=perf%2Frel-list-remove.html

@@ -4,5 +4,52 @@
 PASS
 PASS
 PASS
-PASS
+FAIL: got indeterminate result expected O(n)
 
+DEBUG LOG:
+run iteration. magnitude 2 jsObjectCountBefore 6117 jsObjectCountAfter 6069
+run iteration. magnitude 4 jsObjectCountBefore 6069 jsObjectCountAfter 6076
+run iteration. magnitude 8 jsObjectCountBefore 6076 jsObjectCountAfter 6082
+run iteration. magnitude 16 jsObjectCountBefore 6082 jsObjectCountAfter 6089
+run iteration. magnitude 32 jsObjectCountBefore 6089 jsObjectCountAfter 6096
+run iteration. magnitude 64 jsObjectCountBefore 6096 jsObjectCountAfter 6103
+run iteration. magnitude 128 jsObjectCountBefore 6103 jsObjectCountAfter 6110
+run iteration. magnitude 256 jsObjectCountBefore 6110 jsObjectCountAfter 6117
+magnitudes: 2,4,8,16,32,64,128,256
+iterations: 956,1095,992,963,1100,933,777,661
+numPoints 8 slope 0.00005467665830746385 intercept 0.023972225815432215 rSquared 0.8967089684610045
+numPoints 8 slope 0.0022321178575804815 intercept 0.020495524884065662 rSquared 0.5496254952126867
+numPoints 8 slope 0.07469925659228877 intercept -3.841836896597476 rSquared 0.5375987056217681
+rSquared 0.8967089684610045 rSquaredXLog 0.5496254952126867 rSquaredXYLog 0.5375987056217681
+numTriesLeft: 2
+run iteration. magnitude 2 jsObjectCountBefore 6117 jsObjectCountAfter 6162
+run iteration. magnitude 4 jsObjectCountBefore 6162 jsObjectCountAfter 6169
+run iteration. magnitude 8 jsObjectCountBefore 6169 jsObjectCountAfter 6175
+run iteration. magnitude 16 jsObjectCountBefore 6175 jsObjectCountAfter 6182
+run iteration. magnitude 32 jsObjectCountBefore 6182 jsObjectCountAfter 6189
+run iteration. magnitude 64 jsObjectCountBefore 6189 jsObjectCountAfter 6196
+run iteration. magnitude 128 jsObjectCountBefore 6196 jsObjectCountAfter 6203
+run iteration. magnitude 256 jsObjectCountBefore 6203 jsObjectCountAfter 6210
+magnitudes: 2,4,8,16,32,64,128,256
+iterations: 1120,1141,1031,787,1019,812,774,603
+numPoints 8 slope 0.0000677702380151811 intercept 0.024345607597425812 rSquared 0.8038939511940469
+numPoints 8 slope 0.0034057659441322375 intercept 0.018042823492693073 rSquared 0.7466814739526103
+numPoints 8 slope 0.1156322376895952 intercept -3.9351528293313724 rSquared 0.7729376269862793
+rSquared 0.8038939511940469 rSquaredXLog 0.7466814739526103 rSquaredXYLog 0.7729376269862793
+numTriesLeft: 1
+run iteration. magnitude 2 jsObjectCountBefore 6210 jsObjectCountAfter 6255
+run iteration. magnitude 4 jsObjectCountBefore 6255 jsObjectCountAfter 6262
+run iteration. magnitude 8 jsObjectCountBefore 6262 jsObjectCountAfter 6268
+run iteration. magnitude 16 jsObjectCountBefore 6268 jsObjectCountAfter 6275
+run iteration. magnitude 32 jsObjectCountBefore 6275 jsObjectCountAfter 6282
+run iteration. magnitude 64 jsObjectCountBefore 6282 jsObjectCountAfter 6289
+run iteration. magnitude 128 jsObjectCountBefore 6289 jsObjectCountAfter 6296
+run iteration. magnitude 256 jsObjectCountBefore 6296 jsObjectCountAfter 6303
+magnitudes: 2,4,8,16,32,64,128,256
+iterations: 1002,1142,1016,1031,837,831,665,630
+numPoints 8 slope 0.0000678951462000338 intercept 0.024787366799343735 rSquared 0.847000920236957
+numPoints 8 slope 0.00349843236865172 intercept 0.01820350397239823 rSquared 0.827062694296234
+numPoints 8 slope 0.11616164658750211 intercept -3.9197216440030886 rSquared 0.8343164064454823
+rSquared 0.847000920236957 rSquaredXLog 0.827062694296234 rSquaredXYLog 0.8343164064454823
+
+

[Ryan Haddad]

This test is still flaky on ios-simulator. Marked as such in <https://trac.webkit.org/r202649>