[GTK][WPE] Test perf/array-reverse.html is flaky and sometimes it fails

• Component: WPE WebKit
• Status: RESOLVED FIXED

[Carlos Alberto Lopez Perez]

The test perf/array-reverse.html is flaky and sometimes it fails.

When it fails it outputs this diff:


--- /home/buildbot/worker/gtk-linux-64-release-tests/build/layout-test-results/perf/array-reverse-expected.txt
+++ /home/buildbot/worker/gtk-linux-64-release-tests/build/layout-test-results/perf/array-reverse-actual.txt
@@ -1,3 +1,50 @@
 Tests that Array reverse is linear.
-PASS
+FAIL: got indeterminate result expected O(n)
 
+DEBUG LOG:
+run iteration. magnitude 2 jsObjectCountBefore 6246 jsObjectCountAfter 6118
+run iteration. magnitude 4 jsObjectCountBefore 6118 jsObjectCountAfter 6213
+run iteration. magnitude 8 jsObjectCountBefore 6213 jsObjectCountAfter 6217
+run iteration. magnitude 16 jsObjectCountBefore 6217 jsObjectCountAfter 6226
+run iteration. magnitude 32 jsObjectCountBefore 6226 jsObjectCountAfter 6231
+run iteration. magnitude 64 jsObjectCountBefore 6231 jsObjectCountAfter 6240
+run iteration. magnitude 128 jsObjectCountBefore 6240 jsObjectCountAfter 6245
+run iteration. magnitude 256 jsObjectCountBefore 6245 jsObjectCountAfter 6254
+magnitudes: 2,4,8,16,32,64,128,256
+iterations: 138588,142190,160965,196427,163893,106186,92737,79851
+numPoints 8 slope 6.624322015337066e-7 intercept 0.000158949454164166 rSquared 0.8194551468137912
+numPoints 8 slope 0.000028566588563605277 intercept 0.0001120756805670844 rSquared 0.5604593457226044
+numPoints 8 slope 0.12753159936160224 intercept -8.952231647827714 rSquared 0.4866910270634264
+rSquared 0.8194551468137912 rSquaredXLog 0.5604593457226044 rSquaredXYLog 0.4866910270634264
+numTriesLeft: 2
+run iteration. magnitude 2 jsObjectCountBefore 6254 jsObjectCountAfter 6313
+run iteration. magnitude 4 jsObjectCountBefore 6313 jsObjectCountAfter 6319
+run iteration. magnitude 8 jsObjectCountBefore 6319 jsObjectCountAfter 6325
+run iteration. magnitude 16 jsObjectCountBefore 6325 jsObjectCountAfter 6332
+run iteration. magnitude 32 jsObjectCountBefore 6332 jsObjectCountAfter 6339
+run iteration. magnitude 64 jsObjectCountBefore 6339 jsObjectCountAfter 6346
+run iteration. magnitude 128 jsObjectCountBefore 6346 jsObjectCountAfter 6353
+run iteration. magnitude 256 jsObjectCountBefore 6353 jsObjectCountAfter 6360
+magnitudes: 2,4,8,16,32,64,128,256
+iterations: 158983,197293,208237,192643,147731,116492,116325,90031
+numPoints 8 slope 5.777959879283305e-7 intercept 0.00013944358046562451 rSquared 0.8544909521830786
+numPoints 8 slope 0.000027602460203503863 intercept 0.00009018152109646 rSquared 0.7171979668480256
+numPoints 8 slope 0.14822009568462022 intercept -9.146547053987728 rSquared 0.6968083338526331
+rSquared 0.8544909521830786 rSquaredXLog 0.7171979668480256 rSquaredXYLog 0.6968083338526331
+numTriesLeft: 1
+run iteration. magnitude 2 jsObjectCountBefore 6360 jsObjectCountAfter 6404
+run iteration. magnitude 4 jsObjectCountBefore 6404 jsObjectCountAfter 6412
+run iteration. magnitude 8 jsObjectCountBefore 6412 jsObjectCountAfter 6418
+run iteration. magnitude 16 jsObjectCountBefore 6418 jsObjectCountAfter 6426
+run iteration. magnitude 32 jsObjectCountBefore 6426 jsObjectCountAfter 6433
+run iteration. magnitude 64 jsObjectCountBefore 6433 jsObjectCountAfter 6440
+run iteration. magnitude 128 jsObjectCountBefore 6440 jsObjectCountAfter 6447
+run iteration. magnitude 256 jsObjectCountBefore 6447 jsObjectCountAfter 6454
+magnitudes: 2,4,8,16,32,64,128,256
+iterations: 161323,192691,182947,141907,129527,127378,105415,93855
+numPoints 8 slope 4.923829563358623e-7 intercept 0.00015490255354903346 rSquared 0.8371442424018138
+numPoints 8 slope 0.000025978175905383983 intercept 0.00010526181978336223 rSquared 0.8570311713880215
+numPoints 8 slope 0.13714039648798865 intercept -9.04408876278377 rSquared 0.8477190771910439
+rSquared 0.8371442424018138 rSquaredXLog 0.8570311713880215 rSquaredXYLog 0.8477190771910439
+
+


Passing something like "--repeat-each=1000" to run-webkit-tests may help to reproduce the issue

[Carlos Alberto Lopez Perez]

Updated expectations on r275423

[Diego Pino]

The test or tests filed under this bug are not failing anymore. Test expectations updated in https://commits.webkit.org/258724@main.