Bug 32946 – [Qt] Flakey tests

• Component: Tools / Tests
• Status: RESOLVED INVALID

[Csaba Osztrogonác]

There are some fluctuating/flakey tests need investigation in the future.
Some of them are a timeouting, crashing or failing test.

[Csaba Osztrogonác]

strange storage tests: 

diff: http://build.webkit.org/results/Qt%20Linux%20Release/r52564%20%285338%29/results.html

storage/database-lock-after-reload.html - empty result
storage/empty-statement.html - result of 1st test
storage/execute-sql-args.html - result of 2nd test
storage/hash-change-with-xhr.html - result of 3rd test

[Csaba Osztrogonác]

http/tests/cookies/simple-cookies-expired.html
diff: http://build.webkit.org/results/Qt%20Linux%20Release/r52563%20%285337%29/results.html

[Csaba Osztrogonác]

Some tests skipped by http://trac.webkit.org/changeset/52565

http/tests/cookies/simple-cookies-expired.html
storage/database-lock-after-reload.html
storage/empty-statement.html
storage/execute-sql-args.html
storage/hash-change-with-xhr.html

[Diego Gonzalez]

I have tested these tests(on 2010-01-08) and they passed for me and the other flakey tests.

The only flakey test that I got failed was:
http/tests/cookies/simple-cookies-max-age.html

The others:
animations/3d/transform-origin-vs-functions.html
animations/change-one-anim.html
fast/frames/sandboxed-iframe-plugins.html
fast/frames/sandboxed-iframe-scripting.html
fast/frames/sandboxed-iframe-storage.html
http/tests/cookies/simple-cookies-expired.html
http/tests/xmlhttprequest/workers/close.html
http/tests/xmlhttprequest/workers/shared-worker-close.html
storage/database-lock-after-reload.html
storage/empty-statement.html
storage/execute-sql-args.html
storage/hash-change-with-xhr.html
transitions/change-values-during-transition.html

have been succeeded

[Csaba Osztrogonác]

(In reply to comment #4)
> I have tested these tests(on 2010-01-08) and they passed for me and the other
> flakey tests.

Flakey tests usually pass, but sometimes fail. We don't know what cause the errors, it is very complicated to find it. Sometimes we can catch it if pass --iterations 1000 to run-webkit-test, etc. These fails can be context free or context sensitive, ...

[Jocelyn Turcotte]

=== Bulk closing of Qt bugs ===

If you believe that this bug report is still relevant for a non-Qt port of webkit.org, please re-open it and remove [Qt] from the summary.

If you believe that this is still an important QtWebKit bug, please fill a new report at https://bugreports.qt-project.org and add a link to this issue. See http://qt-project.org/wiki/ReportingBugsInQt for additional guidelines.