RESOLVED FIXED 105530
[Qt][WK2] almost all plugins test fail with timeout on the pixel bot regularly
https://bugs.webkit.org/show_bug.cgi?id=105530
Summary [Qt][WK2] almost all plugins test fail with timeout on the pixel bot regularly
Csaba Osztrogonác
Reported 2012-12-20 05:52:34 PST
a good run: http://build.webkit.sed.hu/builders/x86-64%20Linux%20Qt%20Release%20WebKit2%20%28Pixel%20Tests%29/builds/1029 a wrong run: http://build.webkit.sed.hu/builders/x86-64%20Linux%20Qt%20Release%20WebKit2%20%28Pixel%20Tests%29/builds/1030 Sometimes they work, sometimes they don't. It is a critical bug, because this flakiness makes the pixel bot unable to catch regressions.
Attachments
Balazs Kelemen
Comment 1 2012-12-20 11:51:18 PST
Your definition of critical is not consistent with the rules stated in http://trac.webkit.org/wiki/QtWebKitBugs (Triaging bugs section). It's not a release blocker. Plugin tests are pretty fragile and not really test what the user will get, and our plugin support basically does not cover more that you can play flash on desktop. Btw I don't see why we can no more catch visual regressions on other areas. I will try to take a look at the bug at some point.
Csaba Osztrogonác
Comment 2 2012-12-20 13:59:47 PST
I don't mark the bug as critical because of plugin tests. Check http://build.webkit.sed.hu/builders/x86-64%20Linux%20Qt%20Release%20WebKit2%20%28Pixel%20Tests%29?numbuilds=200 Do you think if you can catch regressions easily during this kind of flakiness? number of failures: 104, 95, 92, 97, 96, 96, 95, 99, 98, 88, 87, 91, ... I won't check the results one by one and try to find if there is any new regression or not. Until this bot is so flakay, I won't check it at all.
Csaba Osztrogonác
Comment 3 2013-01-14 06:24:18 PST
It works now, it seems it is fixed between r139485-r139553 (during WK2 build fail)
Csaba Osztrogonác
Comment 4 2013-01-14 08:46:52 PST
Unfortunately tests started to fail again - http://build.webkit.sed.hu/builders/x86-64%20Linux%20Qt%20Release%20WebKit2%20%28Pixel%20Tests%29/builds/1450 It seems something is very very unstable here.
Balazs Kelemen
Comment 5 2013-01-27 14:19:58 PST
I don't see those failures now. Can we close it?
Csaba Osztrogonác
Comment 6 2013-01-27 15:12:38 PST
We can play this game again and again. But I bet we will reopen in the near future when plugin tests start to fail again ...
Note You need to log in before you can comment on or make changes to this bug.