67118 2011-08-29 04:14:41 -0700 [Qt] REGRESSION(r93937): 4 failing and 3 flaky tests 2012-11-21 04:05:31 -0800 1 1 1 Unclassified WebKit Tools / Tests 528+ (Nightly build) PC Linux RESOLVED FIXED P2 Normal --- 65896 79666 1 zoltan vestbo jarred ossy oldest_to_newest 458159 0 zoltan 2011-08-29 04:14:41 -0700 Failed: fast/forms/input-appearance-number-rtl.html fast/forms/input-appearance-spinbutton-disabled-readonly.html fast/forms/input-appearance-spinbutton-layer.html fast/forms/input-appearance-spinbutton-visibility.html Flaky: fast/forms/input-number-large-padding.html fast/forms/input-spinbutton-capturing.html fast/forms/input-number-events.html I'm going to skip them. 458162 1 zoltan 2011-08-29 04:20:44 -0700 Skipped in http://trac.webkit.org/changeset/93968. 458855 2 ossy 2011-08-30 05:28:18 -0700 The following tests passes, they needed new results: fast/forms/input-appearance-number-rtl.html fast/forms/input-appearance-spinbutton-disabled-readonly.html fast/forms/input-appearance-spinbutton-layer.html fast/forms/input-appearance-spinbutton-visibility.html Patch landed in http://trac.webkit.org/changeset/94072 458957 3 jarred 2011-08-30 09:32:55 -0700 I'm not able to produce flaky results for any of the three tests, in OS X, Ubuntu 10.04, nor Q-BAT. 459020 4 ossy 2011-08-30 10:59:19 -0700 Unfortunately these tests only fails when you run all tests with NRWT. (Tools/Scripts/run-webkit-tests) 459027 5 jarred 2011-08-30 11:13:28 -0700 I'm running NRWT, all tests, in parallel (directly w/ new-run-webkit-tests --platform=qt) and serially (run-webkit-tests) and am consistently not getting failures on these tests. I am however getting an occasional failure in fast/forms/search-event-delay, presumably because of a timing reason but I didn't look into it. 459550 6 zoltan 2011-08-31 04:29:37 -0700 (In reply to comment #5) > I'm running NRWT, all tests, in parallel (directly w/ new-run-webkit-tests --platform=qt) and serially (run-webkit-tests) and am consistently not getting failures on these tests. I am however getting an occasional failure in fast/forms/search-event-delay, presumably because of a timing reason but I didn't look into it. Sounds good, if you have time please remove these from Skipped and give it a try on the bots! 459553 7 ossy 2011-08-31 04:43:44 -0700 (In reply to comment #6) > Sounds good, if you have time please remove these from Skipped and give it a try on the bots! Not at all, these flakey tests are still flakey with NRWT (Tools/Scripts/run-webkit-tests without any additional option!) without parallelism. 459588 8 jarred 2011-08-31 06:09:05 -0700 I have been able to reproduce the flaky results once out of 5 runs. I'll submit a patch here and we'll let the bots give it a run. 459738 9 jarred 2011-08-31 10:57:49 -0700 I have to jump onto other issues, but this flakiness is possibly somewhere in DRT. Running the tests singly or in batches of 50, 100, or even 200 results in successful runs; probably for the same reasons that a minimal run (e.g. only fast/forms or the individual tests) or a parallel NRWT run doesn't produce the flaky results. I am able to produce the flakiness with single-worker NRWT running all fast/ tests. Somehow DRT, when permuted across those fast/ tests, corrupts the result of these spinbutton tests. Specifically, eventSender ends up clicking on the down spin button rather than the top spin button. 624073 10 vestbo 2012-05-15 07:40:29 -0700 Investigating this 624244 11 vestbo 2012-05-15 10:32:14 -0700 I'm unable to reproduce this with a run of NRWT fast/ over 10 runs. 772783 12 ossy 2012-11-21 04:05:31 -0800 These test work now, unskip landed in r135381.