Bug 46956 - WebSocket tests are flaky
Summary: WebSocket tests are flaky
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: 528+ (Nightly build)
Hardware: Other OS X 10.5
: P2 Normal
Assignee: Adam Barth
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2010-09-30 19:54 PDT by Adam Barth
Modified: 2010-10-01 17:35 PDT (History)
4 users (show)

See Also:


Attachments
Patch (242.13 KB, patch)
2010-09-30 19:57 PDT, Adam Barth
no flags Details | Formatted Diff | Diff
Patch (234.35 KB, patch)
2010-10-01 11:52 PDT, Adam Barth
eric: review+
Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Adam Barth 2010-09-30 19:54:54 PDT
WebSocket tests are flaky
Comment 1 Adam Barth 2010-09-30 19:57:58 PDT
Created attachment 69416 [details]
Patch
Comment 2 James Robinson 2010-09-30 20:09:50 PDT
Comment on attachment 69416 [details]
Patch

This patch has a ton of file moves but the patchfile doesn't include any SVN metadata.  I would hate to lose the file history and blame information for all these tests.  Can you regenerate using SVN MV instead, or coerce git to produce the metadata?
Comment 3 James Robinson 2010-09-30 20:10:51 PDT
Comment on attachment 69416 [details]
Patch

Just realized I'm probably misreading the raw patch.  Restoring abarth's r?.  Please do confirm that this will preserve history before landing, though.
Comment 4 Adam Barth 2010-09-30 20:18:05 PDT
I think the diff might look different because it's a directory move instead of a file move.  In any case, I did create it with "svn mv".  If I land it from my working copy, the history should be preserved.
Comment 5 Fumitoshi Ukai 2010-09-30 23:55:28 PDT
Comment on attachment 69416 [details]
Patch

I understand this patch tries to serve html files for websocket test by apache on port 8000, and keeps websocket service by pywebsocket server on port 8880. right?
I'm not sure if we really need to move websocket test files under http/test directory. Can't we serve html files in websocket/test by apache on port 8000?
Moving test files would require more changes in chromium test system than just letting html serving by http server.
Comment 6 Adam Barth 2010-10-01 07:33:11 PDT
> I understand this patch tries to serve html files for websocket test by apache on port 8000, and keeps websocket service by pywebsocket server on port 8880. right?

That's correct.

> I'm not sure if we really need to move websocket test files under http/test directory. Can't we serve html files in websocket/test by apache on port 8000?

The problem is that websocket/test is not mapped into the URL space of the Apache server.

> Moving test files would require more changes in chromium test system than just letting html serving by http server.

I've updated new-run-webkit-tests to run them properly from their new location.  We need to be able to move test files around.  It's not a reasonable constraint from the Chromium port that we can't do that.
Comment 7 Eric Seidel (no email) 2010-10-01 11:44:29 PDT
Comment on attachment 69416 [details]
Patch

We shouldn't need to copy the js test pre stuff since we have http://trac.webkit.org/changeset/44020.
Comment 8 Eric Seidel (no email) 2010-10-01 11:45:35 PDT
Comment on attachment 69416 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=69416&action=review

> WebKitTools/Scripts/old-run-webkit-tests:696
> +        if ($test =~ /^http\/tests\/websocket\//) {

This big block really should have been a function.  It's not your fault that it isn't though.
Comment 9 Eric Seidel (no email) 2010-10-01 11:46:04 PDT
Comment on attachment 69416 [details]
Patch

r- for moving to js-test-resources.  Otherwise looks OK.
Comment 10 Adam Barth 2010-10-01 11:52:23 PDT
Created attachment 69494 [details]
Patch
Comment 11 Eric Seidel (no email) 2010-10-01 12:00:34 PDT
Comment on attachment 69494 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=69494&action=review

OK.

> LayoutTests/http/tests/websocket/tests/reload-crash.html:6
> +<link rel="stylesheet" href="../../../js-test-resources/js-test-style.css">
> +<script src="../../../js-test-resources/js-test-pre.js"></script>
> +<script src="../../../js-test-resources/js-test-post-function.js"></script>

These could just be /js-... insetad of ../../, but that's ifne.
Comment 12 Adam Barth 2010-10-01 12:40:28 PDT
Committed r68914: <http://trac.webkit.org/changeset/68914>
Comment 13 WebKit Review Bot 2010-10-01 14:07:47 PDT
http://trac.webkit.org/changeset/68914 might have broken GTK Linux 32-bit Debug