Bug 224118 - [GTK][WPE] Test perf/array-reverse.html is flaky and sometimes it fails
Summary: [GTK][WPE] Test perf/array-reverse.html is flaky and sometimes it fails
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: WPE WebKit (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2021-04-02 09:36 PDT by Carlos Alberto Lopez Perez
Modified: 2023-01-10 07:46 PST (History)
1 user (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Carlos Alberto Lopez Perez 2021-04-02 09:36:55 PDT 
The test perf/array-reverse.html is flaky and sometimes it fails.

When it fails it outputs this diff:


--- /home/buildbot/worker/gtk-linux-64-release-tests/build/layout-test-results/perf/array-reverse-expected.txt
+++ /home/buildbot/worker/gtk-linux-64-release-tests/build/layout-test-results/perf/array-reverse-actual.txt
@@ -1,3 +1,50 @@
 Tests that Array reverse is linear.
-PASS
+FAIL: got indeterminate result expected O(n)
 
+DEBUG LOG:
+run iteration. magnitude 2 jsObjectCountBefore 6246 jsObjectCountAfter 6118
+run iteration. magnitude 4 jsObjectCountBefore 6118 jsObjectCountAfter 6213
+run iteration. magnitude 8 jsObjectCountBefore 6213 jsObjectCountAfter 6217
+run iteration. magnitude 16 jsObjectCountBefore 6217 jsObjectCountAfter 6226
+run iteration. magnitude 32 jsObjectCountBefore 6226 jsObjectCountAfter 6231
+run iteration. magnitude 64 jsObjectCountBefore 6231 jsObjectCountAfter 6240
+run iteration. magnitude 128 jsObjectCountBefore 6240 jsObjectCountAfter 6245
+run iteration. magnitude 256 jsObjectCountBefore 6245 jsObjectCountAfter 6254
+magnitudes: 2,4,8,16,32,64,128,256
+iterations: 138588,142190,160965,196427,163893,106186,92737,79851
+numPoints 8 slope 6.624322015337066e-7 intercept 0.000158949454164166 rSquared 0.8194551468137912
+numPoints 8 slope 0.000028566588563605277 intercept 0.0001120756805670844 rSquared 0.5604593457226044
+numPoints 8 slope 0.12753159936160224 intercept -8.952231647827714 rSquared 0.4866910270634264
+rSquared 0.8194551468137912 rSquaredXLog 0.5604593457226044 rSquaredXYLog 0.4866910270634264
+numTriesLeft: 2
+run iteration. magnitude 2 jsObjectCountBefore 6254 jsObjectCountAfter 6313
+run iteration. magnitude 4 jsObjectCountBefore 6313 jsObjectCountAfter 6319
+run iteration. magnitude 8 jsObjectCountBefore 6319 jsObjectCountAfter 6325
+run iteration. magnitude 16 jsObjectCountBefore 6325 jsObjectCountAfter 6332
+run iteration. magnitude 32 jsObjectCountBefore 6332 jsObjectCountAfter 6339
+run iteration. magnitude 64 jsObjectCountBefore 6339 jsObjectCountAfter 6346
+run iteration. magnitude 128 jsObjectCountBefore 6346 jsObjectCountAfter 6353
+run iteration. magnitude 256 jsObjectCountBefore 6353 jsObjectCountAfter 6360
+magnitudes: 2,4,8,16,32,64,128,256
+iterations: 158983,197293,208237,192643,147731,116492,116325,90031
+numPoints 8 slope 5.777959879283305e-7 intercept 0.00013944358046562451 rSquared 0.8544909521830786
+numPoints 8 slope 0.000027602460203503863 intercept 0.00009018152109646 rSquared 0.7171979668480256
+numPoints 8 slope 0.14822009568462022 intercept -9.146547053987728 rSquared 0.6968083338526331
+rSquared 0.8544909521830786 rSquaredXLog 0.7171979668480256 rSquaredXYLog 0.6968083338526331
+numTriesLeft: 1
+run iteration. magnitude 2 jsObjectCountBefore 6360 jsObjectCountAfter 6404
+run iteration. magnitude 4 jsObjectCountBefore 6404 jsObjectCountAfter 6412
+run iteration. magnitude 8 jsObjectCountBefore 6412 jsObjectCountAfter 6418
+run iteration. magnitude 16 jsObjectCountBefore 6418 jsObjectCountAfter 6426
+run iteration. magnitude 32 jsObjectCountBefore 6426 jsObjectCountAfter 6433
+run iteration. magnitude 64 jsObjectCountBefore 6433 jsObjectCountAfter 6440
+run iteration. magnitude 128 jsObjectCountBefore 6440 jsObjectCountAfter 6447
+run iteration. magnitude 256 jsObjectCountBefore 6447 jsObjectCountAfter 6454
+magnitudes: 2,4,8,16,32,64,128,256
+iterations: 161323,192691,182947,141907,129527,127378,105415,93855
+numPoints 8 slope 4.923829563358623e-7 intercept 0.00015490255354903346 rSquared 0.8371442424018138
+numPoints 8 slope 0.000025978175905383983 intercept 0.00010526181978336223 rSquared 0.8570311713880215
+numPoints 8 slope 0.13714039648798865 intercept -9.04408876278377 rSquared 0.8477190771910439
+rSquared 0.8371442424018138 rSquaredXLog 0.8570311713880215 rSquaredXYLog 0.8477190771910439
+
+


Passing something like "--repeat-each=1000" to run-webkit-tests may help to reproduce the issue
Comment 1 Carlos Alberto Lopez Perez 2021-04-02 09:55:24 PDT 
Updated expectations on r275423
Comment 2 Diego Pino 2023-01-10 07:46:52 PST 
The test or tests filed under this bug are not failing anymore. Test expectations updated in https://commits.webkit.org/258724@main.