10958 2006-09-20 17:43:01 -0700 Buildbots give unreproducible results on layout tests 2006-10-18 20:20:07 -0700 1 1 1 Unclassified WebKit Tools / Tests 420+ Mac OS X 10.4 RESOLVED FIXED http://build.webkit.org/results/post-commit-powerpc-mac-os-x/3383/fast/css/acid2-pixel-diffs.txt P2 Normal --- 10923 11222 1 aroben webkit-unassigned ap ddkilzer mitz timothy oldest_to_newest 56069 0 aroben 2006-09-20 17:43:01 -0700 The diff in the attached URL (and similar ones on a handful of other layout tests) only appear on the buildbots. So far no one has been able to reproduce these failures locally. 56093 1 aroben 2006-09-20 23:49:37 -0700 Here's another diff we can't reproduce: http://build.webkit.org/results/post-commit-powerpc-mac-os-x/3386/fast/js/window-properties-diffs.txt Oddly, I did reproduce this once after building on Leopard, but as the buildbots are all on Tiger, this clearly requires further investigation. 56094 2 aroben 2006-09-21 00:01:39 -0700 Now I'm back on Tiger with a ToT build, and I can get the window-properties test to show the same results as the buildbot only if I run all the layout tests. Running just that one test or even the whole fast/js directory will generate the checked in results (i.e. the test will pass), but running all the layout tests at once will generate the (failed) results that the buildbot gets. 56097 3 adele 2006-09-21 01:11:41 -0700 I can confirm what Adam's seeing. I'm on Tiger, and I see the window-properties test only fail when run with the whole suite of tests. 56100 4 aroben 2006-09-21 01:16:13 -0700 Opened bug 10965 to track the problem with window-properties, since it seems to be a separate issue. This bug can continue to function as a meta-bug tracking the larger issue of the buildbots displaying unreproducible behavior. 56134 5 aroben 2006-09-21 09:00:06 -0700 Setting blocked by bug 10923, which lists the specific tests that the buildbots show the unreproducible "frame * scrolled to *" diff 53795 6 aroben 2006-10-08 13:38:17 -0700 New pieces of evidence: fast/js/window-properties now seems to intermittently report that window.document.location.replace is a function. http://build.webkit.org/results/post-commit-powerpc-mac-os-x/3700/results.html and http://build.webkit.org/results/post-commit-powerpc-mac-os-x/3703/results.html show this, but http://build.webkit.org/results/post-commit-powerpc-mac-os-x/3701/results.html and http://build.webkit.org/results/post-commit-powerpc-mac-os-x/3702/results.html don't. 51937 7 ggaren 2006-10-18 16:16:30 -0700 I don't think this umbrella bug is helpful anymore. Each failure has its own bug, and there doesn't seem to be a link between them. 51908 8 aroben 2006-10-18 20:20:07 -0700 J'agree with ggaren