Bug 51613 - Flaky Test: http/tests/xmlhttprequest/basic-auth.html
Summary: Flaky Test: http/tests/xmlhttprequest/basic-auth.html
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: 528+ (Nightly build)
Hardware: Other OS X 10.5
: P2 Normal
Assignee: WebKit Commit Bot
URL:
Keywords:
Depends on: 29939 59651
Blocks: 50856
  Show dependency treegraph
 
Reported: 2010-12-25 16:36 PST by WebKit Commit Bot
Modified: 2011-05-13 12:44 PDT (History)
3 users (show)

See Also:


Attachments
Failure diff from eseidel-sf-cq (727 bytes, text/plain)
2011-01-12 14:56 PST, WebKit Commit Bot
no flags Details
Archive of layout-test-results from cr-jail-3 (22 bytes, application/zip)
2011-01-13 03:45 PST, WebKit Commit Bot
no flags Details
Failure diff from cr-jail-4 (975 bytes, text/plain)
2011-01-14 15:45 PST, WebKit Commit Bot
no flags Details
Failure diff from eseidel-cq-sl (727 bytes, text/plain)
2011-01-19 11:30 PST, WebKit Commit Bot
no flags Details
Failure diff from eseidel-cq-sf (975 bytes, text/plain)
2011-01-27 18:39 PST, WebKit Commit Bot
no flags Details
Failure diff from eseidel-cq-sf (977 bytes, text/plain)
2011-02-24 05:24 PST, WebKit Commit Bot
no flags Details
Failure diff from cr-jail-7 (975 bytes, text/plain)
2011-04-14 02:24 PDT, WebKit Commit Bot
no flags Details
Failure diff from cr-jail-3 (975 bytes, text/plain)
2011-04-14 19:09 PDT, WebKit Commit Bot
no flags Details
Failure diff from cr-jail-8 (545 bytes, text/plain)
2011-04-15 00:08 PDT, WebKit Commit Bot
no flags Details
Failure diff from eseidel-cq-sf (727 bytes, text/plain)
2011-04-15 00:10 PDT, WebKit Commit Bot
no flags Details
Failure diff from cr-jail-3 (975 bytes, text/plain)
2011-04-15 00:53 PDT, WebKit Commit Bot
no flags Details
Failure diff from eseidel-cq-sf (545 bytes, text/plain)
2011-04-15 10:29 PDT, WebKit Commit Bot
no flags Details
Failure diff from cr-jail-4 (975 bytes, text/plain)
2011-04-15 19:15 PDT, WebKit Commit Bot
no flags Details
Failure diff from eseidel-cq-sf (621 bytes, text/plain)
2011-04-19 19:53 PDT, WebKit Commit Bot
no flags Details
Failure diff from cr-jail-4 (919 bytes, text/plain)
2011-04-21 23:44 PDT, WebKit Commit Bot
no flags Details
Failure diff from cr-jail-8 (657 bytes, text/plain)
2011-04-23 00:47 PDT, WebKit Commit Bot
no flags Details
Failure diff from eseidel-cq-sf (919 bytes, text/plain)
2011-04-27 00:01 PDT, WebKit Commit Bot
no flags Details
Failure diff from cr-jail-8 (764 bytes, text/plain)
2011-04-27 00:14 PDT, WebKit Commit Bot
no flags Details
Failure diff from cr-jail-8 (621 bytes, text/plain)
2011-04-27 11:15 PDT, WebKit Commit Bot
no flags Details
Failure diff from eseidel-cq-sf (545 bytes, text/plain)
2011-04-27 13:59 PDT, WebKit Commit Bot
no flags Details
full layout-test-results.zip from processing bug 59377 (203.76 KB, application/zip)
2011-04-27 14:15 PDT, Eric Seidel (no email)
no flags Details
Failure diff from cr-jail-7 (598 bytes, text/plain)
2011-04-28 21:07 PDT, WebKit Commit Bot
no flags Details
Failure diff from cr-jail-4 (632 bytes, text/plain)
2011-05-11 09:04 PDT, WebKit Commit Bot
no flags Details
Failure diff from eseidel-cq-sf (733 bytes, text/plain)
2011-05-13 12:44 PDT, WebKit Commit Bot
no flags Details

Note You need to log in before you can comment on or make changes to this bug.
Description WebKit Commit Bot 2010-12-25 16:36:55 PST
This is an automatically generated bug from the commit-queue.
http/tests/xmlhttprequest/basic-auth.html has been flaky on the commit-queue.

http/tests/xmlhttprequest/basic-auth.html was authored by ap@webkit.org.
http://trac.webkit.org/browser/trunk/LayoutTests/http/tests/xmlhttprequest/basic-auth.html

The commit-queue just saw http/tests/xmlhttprequest/basic-auth.html flake while processing attachment 77437 [details] on bug 51608.
Bot: cr-jail-3  Port: Mac  Platform: Mac OS X 10.6.4

The bots will update this with information from each new failure.

If you believe this bug to be fixed or invalid, feel free to close.  The bots will re-open if the flake re-occurs.

If you would like to track this test fix with another bug, please close this bug as a duplicate.  The bots will follow the duplicate chain when making future comments.
Comment 1 Eric Seidel (no email) 2010-12-25 17:40:43 PST
I suspect this is a timeout, like seen in bug 29939.
Comment 2 Alin S 2010-12-26 01:18:13 PST
looks like a classic timeout to me… i think the bot its self might have a bug.
Comment 3 WebKit Commit Bot 2010-12-29 01:31:02 PST
The commit-queue just saw http/tests/xmlhttprequest/basic-auth.html flake while processing attachment 77576 [details] on bug 51671.
Bot: cr-jail-3  Port: Mac  Platform: Mac OS X 10.6.4
Comment 4 WebKit Commit Bot 2011-01-04 21:29:05 PST
The commit-queue just saw http/tests/xmlhttprequest/basic-auth.html flake while processing attachment 77924 [details] on bug 51723.
Bot: cr-jail-4  Port: Mac  Platform: Mac OS X 10.6.4
Comment 5 WebKit Commit Bot 2011-01-05 05:08:17 PST
The commit-queue just saw http/tests/xmlhttprequest/basic-auth.html flake while processing attachment 77942 [details] on bug 51906.
Bot: cr-jail-3  Port: Mac  Platform: Mac OS X 10.6.4
Comment 6 WebKit Commit Bot 2011-01-11 04:00:25 PST
The commit-queue just saw http/tests/xmlhttprequest/basic-auth.html flake (Test timed out) while processing attachment 78506 [details] on bug 52201.
Bot: cr-jail-3  Port: Mac  Platform: Mac OS X 10.6.4
Comment 7 WebKit Commit Bot 2011-01-12 14:56:02 PST
The commit-queue just saw http/tests/xmlhttprequest/basic-auth.html flake (Text diff mismatch) while processing attachment 78706 [details] on bug 52308.
Bot: eseidel-sf-cq  Port: Mac  Platform: Mac OS X 10.6.4
Comment 8 WebKit Commit Bot 2011-01-12 14:56:04 PST
Created attachment 78737 [details]
Failure diff from eseidel-sf-cq
Comment 9 Eric Seidel (no email) 2011-01-12 15:07:56 PST
Finally diff uploads are working consistently!  Hopefully this will make these failures easy to track down and fix.
Comment 10 WebKit Commit Bot 2011-01-13 03:45:25 PST
The commit-queue just saw http/tests/xmlhttprequest/basic-auth.html flake (Test timed out) while processing attachment 78745 [details] on bug 51249.
Bot: cr-jail-3  Port: Mac  Platform: Mac OS X 10.6.4
Comment 11 WebKit Commit Bot 2011-01-13 03:45:29 PST
Created attachment 78797 [details]
Archive of layout-test-results from cr-jail-3
Comment 12 Eric Seidel (no email) 2011-01-13 12:34:06 PST
Comment on attachment 78797 [details]
Archive of layout-test-results from cr-jail-3

Hmm... clearly I need to work on the zip uploading a bit more.
Comment 13 WebKit Commit Bot 2011-01-14 15:45:12 PST
The commit-queue just saw http/tests/xmlhttprequest/basic-auth.html flake (Text diff mismatch) while processing attachment 79008 [details] on bug 51982.
Bot: cr-jail-4  Port: Mac  Platform: Mac OS X 10.6.4
Comment 14 WebKit Commit Bot 2011-01-14 15:45:16 PST
Created attachment 79017 [details]
Failure diff from cr-jail-4
Comment 15 WebKit Commit Bot 2011-01-19 11:30:48 PST
The commit-queue just saw http/tests/xmlhttprequest/basic-auth.html flake (Text diff mismatch) while processing attachment 79449 [details] on bug 52056.
Bot: eseidel-cq-sl  Port: Mac  Platform: Mac OS X 10.6.6
Comment 16 WebKit Commit Bot 2011-01-19 11:30:51 PST
Created attachment 79456 [details]
Failure diff from eseidel-cq-sl
Comment 17 WebKit Commit Bot 2011-01-27 18:39:09 PST
The commit-queue just saw http/tests/xmlhttprequest/basic-auth.html flake (Text diff mismatch) while processing attachment 80371 [details] on bug 53263.
Bot: eseidel-cq-sf  Port: Mac  Platform: Mac OS X 10.6.4
Comment 18 WebKit Commit Bot 2011-01-27 18:39:12 PST
Created attachment 80396 [details]
Failure diff from eseidel-cq-sf
Comment 19 WebKit Commit Bot 2011-02-24 05:24:24 PST
The commit-queue just saw http/tests/xmlhttprequest/basic-auth.html flake (Text diff mismatch) while processing attachment 83041 [details] on bug 54787.
Bot: eseidel-cq-sf  Port: Mac  Platform: Mac OS X 10.6.4
Comment 20 WebKit Commit Bot 2011-02-24 05:24:26 PST
Created attachment 83640 [details]
Failure diff from eseidel-cq-sf
Comment 21 WebKit Commit Bot 2011-04-14 02:24:11 PDT
The commit-queue just saw http/tests/xmlhttprequest/basic-auth.html flake (Text diff mismatch) while processing attachment 89448 [details] on bug 58383.
Bot: cr-jail-7  Port: Mac  Platform: Mac OS X 10.6.6
Comment 22 WebKit Commit Bot 2011-04-14 02:24:14 PDT
Created attachment 89550 [details]
Failure diff from cr-jail-7
Comment 23 WebKit Commit Bot 2011-04-14 19:09:20 PDT
The commit-queue just saw http/tests/xmlhttprequest/basic-auth.html flake (Text diff mismatch) while processing attachment 89543 [details] on bug 58016.
Bot: cr-jail-3  Port: Mac  Platform: Mac OS X 10.6.6
Comment 24 WebKit Commit Bot 2011-04-14 19:09:24 PDT
Created attachment 89720 [details]
Failure diff from cr-jail-3
Comment 25 WebKit Commit Bot 2011-04-15 00:08:36 PDT
The commit-queue just saw http/tests/xmlhttprequest/basic-auth.html flake (Text diff mismatch) while processing attachment 89620 [details] on bug 58259.
Bot: cr-jail-8  Port: Mac  Platform: Mac OS X 10.6.6
Comment 26 WebKit Commit Bot 2011-04-15 00:08:40 PDT
Created attachment 89746 [details]
Failure diff from cr-jail-8
Comment 27 WebKit Commit Bot 2011-04-15 00:10:42 PDT
The commit-queue just saw http/tests/xmlhttprequest/basic-auth.html flake (Text diff mismatch) while processing attachment 89621 [details] on bug 53556.
Bot: eseidel-cq-sf  Port: Mac  Platform: Mac OS X 10.6.4
Comment 28 WebKit Commit Bot 2011-04-15 00:10:45 PDT
Created attachment 89748 [details]
Failure diff from eseidel-cq-sf
Comment 29 WebKit Commit Bot 2011-04-15 00:53:25 PDT
The commit-queue just saw http/tests/xmlhttprequest/basic-auth.html flake (Text diff mismatch) while processing attachment 89627 [details] on bug 58508.
Bot: cr-jail-3  Port: Mac  Platform: Mac OS X 10.6.6
Comment 30 WebKit Commit Bot 2011-04-15 00:53:29 PDT
Created attachment 89753 [details]
Failure diff from cr-jail-3
Comment 31 Adam Barth 2011-04-15 00:57:58 PDT
(In reply to comment #2)
> looks like a classic timeout to me… i think the bot its self might have a bug.

We see this flake on many different bots.  It's either a problem with the test or with WebKit.
Comment 32 WebKit Commit Bot 2011-04-15 10:29:25 PDT
The commit-queue just saw http/tests/xmlhttprequest/basic-auth.html flake (Text diff mismatch) while processing attachment 89764 [details] on bug 58650.
Bot: eseidel-cq-sf  Port: Mac  Platform: Mac OS X 10.6.4
Comment 33 WebKit Commit Bot 2011-04-15 10:29:27 PDT
Created attachment 89805 [details]
Failure diff from eseidel-cq-sf
Comment 34 WebKit Commit Bot 2011-04-15 19:15:26 PDT
The commit-queue just saw http/tests/xmlhttprequest/basic-auth.html flake (Text diff mismatch) while processing attachment 89668 [details] on bug 58582.
Bot: cr-jail-4  Port: Mac  Platform: Mac OS X 10.6.6
Comment 35 WebKit Commit Bot 2011-04-15 19:15:30 PDT
Created attachment 89905 [details]
Failure diff from cr-jail-4
Comment 36 WebKit Commit Bot 2011-04-19 19:53:19 PDT
The commit-queue just saw http/tests/xmlhttprequest/basic-auth.html flake (Text diff mismatch) while processing attachment 88638 [details] on bug 58044.
Bot: eseidel-cq-sf  Port: Mac  Platform: Mac OS X 10.6.4
Comment 37 WebKit Commit Bot 2011-04-19 19:53:21 PDT
Created attachment 90295 [details]
Failure diff from eseidel-cq-sf
Comment 38 WebKit Commit Bot 2011-04-21 23:44:08 PDT
The commit-queue just saw http/tests/xmlhttprequest/basic-auth.html flake (Text diff mismatch) while processing attachment 90633 [details] on bug 59142.
Bot: cr-jail-4  Port: Mac  Platform: Mac OS X 10.6.6
Comment 39 WebKit Commit Bot 2011-04-21 23:44:11 PDT
Created attachment 90673 [details]
Failure diff from cr-jail-4
Comment 40 WebKit Commit Bot 2011-04-23 00:47:43 PDT
The commit-queue just saw http/tests/xmlhttprequest/basic-auth.html flake (Text diff mismatch) while processing attachment 90784 [details] on bug 59183.
Bot: cr-jail-8  Port: Mac  Platform: Mac OS X 10.6.6
Comment 41 WebKit Commit Bot 2011-04-23 00:47:47 PDT
Created attachment 90849 [details]
Failure diff from cr-jail-8
Comment 42 WebKit Commit Bot 2011-04-27 00:01:36 PDT
The commit-queue just saw http/tests/xmlhttprequest/basic-auth.html flake (Text diff mismatch) while processing attachment 91178 [details] on bug 59377.
Bot: eseidel-cq-sf  Port: Mac  Platform: Mac OS X 10.6.6
Comment 43 WebKit Commit Bot 2011-04-27 00:01:38 PDT
Created attachment 91241 [details]
Failure diff from eseidel-cq-sf
Comment 44 WebKit Commit Bot 2011-04-27 00:14:07 PDT
The commit-queue just saw http/tests/xmlhttprequest/basic-auth.html flake (Text diff mismatch) while processing attachment 91150 [details] on bug 59487.
Bot: cr-jail-8  Port: Mac  Platform: Mac OS X 10.6.6
Comment 45 WebKit Commit Bot 2011-04-27 00:14:11 PDT
Created attachment 91243 [details]
Failure diff from cr-jail-8
Comment 46 WebKit Commit Bot 2011-04-27 11:15:13 PDT
The commit-queue just saw http/tests/xmlhttprequest/basic-auth.html flake (Text diff mismatch) while processing attachment 91291 [details] on bug 59545.
Bot: cr-jail-8  Port: Mac  Platform: Mac OS X 10.6.6
Comment 47 WebKit Commit Bot 2011-04-27 11:15:16 PDT
Created attachment 91314 [details]
Failure diff from cr-jail-8
Comment 48 WebKit Commit Bot 2011-04-27 13:58:58 PDT
The commit-queue just saw http/tests/xmlhttprequest/basic-auth.html flake (Text diff mismatch) while processing attachment 91215 [details] on bug 59484.
Bot: eseidel-cq-sf  Port: Mac  Platform: Mac OS X 10.6.6
Comment 49 WebKit Commit Bot 2011-04-27 13:59:00 PDT
Created attachment 91341 [details]
Failure diff from eseidel-cq-sf
Comment 51 Eric Seidel (no email) 2011-04-27 14:15:28 PDT
Created attachment 91346 [details]
full layout-test-results.zip from processing bug 59377

I'm examining the full results.zip to look at http access logs and see if I can find anything fishy.

So far nothing about /xmlhttprequest/resources/basic-auth/basic-auth.php in the error_log.txt, but some oddities in the access_log.txt.  Still investigating.
Comment 52 Eric Seidel (no email) 2011-04-27 14:24:25 PDT
OK, something *really* fishy is going on the in access_log.txt.

If you look, we see:


127.0.0.1 - - [26/Apr/2011:23:46:01 -0700] "GET /xmlhttprequest/resources/basic-auth/basic-auth.php?uid=sync6 HTTP/1.1" 401 23
127.0.0.1 - sync6 [26/Apr/2011:23:46:01 -0700] "GET /xmlhttprequest/resources/basic-auth/basic-auth.php?uid=sync6 HTTP/1.1" 200 27
127.0.0.1 - - [26/Apr/2011:23:46:01 -0700] "GET /xmlhttprequest/resources/basic-auth/basic-auth.php?uid=sync7 HTTP/1.1" 401 23

Then some 130 intervening requests:
127.0.0.1 - - [26/Apr/2011:23:44:45 -0700] "GET /multipart/resources/multipart.php?interval=0&img1=green-100x100.png&img2=abe.png&wait=100 HTTP/1.1" 200 12616
127.0.0.1 - - [26/Apr/2011:23:46:32 -0700] "GET /xmlhttprequest/binary-x-user-defined.html HTTP/1.1" 200 895

Until it seems to get along to bad-auth.html, when it seems to think that sync7 is currently the user!  Which seems to be bleeding over from basic-auth.html!

127.0.0.1 - - [26/Apr/2011:23:46:33 -0700] "POST /xmlhttprequest/resources/post-echo.cgi HTTP/1.1" 200 7
127.0.0.1 - - [26/Apr/2011:23:46:33 -0700] "GET /xmlhttprequest/failed-auth.html HTTP/1.1" 200 1991
127.0.0.1 - sync7 [26/Apr/2011:23:46:33 -0700] "GET /xmlhttprequest/resources/basic-auth/basic-auth.php?uid=login1 HTTP/1.1" 401 23
127.0.0.1 - sync7 [26/Apr/2011:23:46:33 -0700] "GET /xmlhttprequest/resources/basic-auth/basic-auth.php?uid=login1 HTTP/1.1" 401 23
127.0.0.1 - - [26/Apr/2011:23:46:33 -0700] "GET /xmlhttprequest/resources/basic-auth/basic-auth.php?uid=login2 HTTP/1.1" 401 23
127.0.0.1 - badname [26/Apr/2011:23:46:33 -0700] "GET /xmlhttprequest/resources/basic-auth/basic-auth.php?uid=login2 HTTP/1.1" 401 23


Why we're bleeding between tests?  Why the original request for sync7 seems to have returned from apache, but hit a NETWORK_ERR in our code, I don't know.

@ap, any theories?  (see the access_log.txt in the latest zip I attached above).
Comment 53 Eric Seidel (no email) 2011-04-27 14:36:03 PDT
Looking earlier in the log, I see auth requests which talk to ::1 instead of 127.0.0.1.  I wonder if the ipv6 issue could be biting us here:

127.0.0.1 - - [26/Apr/2011:23:46:01 -0700] "GET /xmlhttprequest/basic-auth-nopassword.html HTTP/1.1" 200 648
::1 - - [26/Apr/2011:23:46:01 -0700] "GET /xmlhttprequest/resources/basic-auth-nouserpass/basic-auth-nouserpass.php HTTP/1.1" 401 23
::1 - user [26/Apr/2011:23:46:01 -0700] "GET /xmlhttprequest/resources/basic-auth-nouserpass/basic-auth-nouserpass.php HTTP/1.1" 200 23
127.0.0.1 - - [26/Apr/2011:23:46:01 -0700] "GET /xmlhttprequest/basic-auth-nouser.html HTTP/1.1" 200 656
::1 - - [26/Apr/2011:23:46:01 -0700] "GET /xmlhttprequest/resources/basic-auth-nouserpass/basic-auth-nouserpass.php HTTP/1.1" 401 23
::1 - "" [26/Apr/2011:23:46:01 -0700] "GET /xmlhttprequest/resources/basic-auth-nouserpass/basic-auth-nouserpass.php HTTP/1.1" 200 27
Comment 54 Eric Seidel (no email) 2011-04-27 15:48:28 PDT
It seems that this test involves the network layer catching a 401 and automatically re-trying.

I think that sometimes it fails to catch the 401 and returns it up to WebCore which then causes the NETWORK_ERR and the test dies (thus possibly polluting later tests).
Comment 55 Eric Seidel (no email) 2011-04-27 16:49:51 PDT
Making this test log more in bug 59651.
Comment 56 WebKit Commit Bot 2011-04-28 21:06:58 PDT
The commit-queue just saw http/tests/xmlhttprequest/basic-auth.html flake (Text diff mismatch) while processing attachment 91592 [details] on bug 26539.
Bot: cr-jail-7  Port: Mac  Platform: Mac OS X 10.6.6
Comment 57 WebKit Commit Bot 2011-04-28 21:07:01 PDT
Created attachment 91630 [details]
Failure diff from cr-jail-7
Comment 58 Eric Seidel (no email) 2011-04-28 21:32:36 PDT
Yup.  It appears sometime the network layer just aborts for no reason:
-sync2: User: sync2, password: 123.
+sync2: req.send raised exception: Error: NETWORK_ERR: XMLHttpRequest Exception 101
+sync2: req.readyState: 4
+sync2: req.status: 0

I suspect if we had the resource load delegate callbacks enabled we would see more.  There may be other flaky tests like this which have those.  Or we could check in a version of this test which does.
Comment 59 WebKit Commit Bot 2011-05-11 09:04:21 PDT
The commit-queue just saw http/tests/xmlhttprequest/basic-auth.html flake (Text diff mismatch) while processing attachment 93009 [details] on bug 60469.
Bot: cr-jail-4  Port: Mac  Platform: Mac OS X 10.6.7
Comment 60 WebKit Commit Bot 2011-05-11 09:04:24 PDT
Created attachment 93128 [details]
Failure diff from cr-jail-4
Comment 61 WebKit Commit Bot 2011-05-13 12:44:27 PDT
The commit-queue just saw http/tests/xmlhttprequest/basic-auth.html flake (Text diff mismatch) while processing attachment 93488 [details] on bug 60738.
Bot: eseidel-cq-sf  Port: Mac  Platform: Mac OS X 10.6.7
Comment 62 WebKit Commit Bot 2011-05-13 12:44:30 PDT
Created attachment 93493 [details]
Failure diff from eseidel-cq-sf