156436 2016-04-09 09:31:16 -0700 [GTK] fast/harness/sample-fail-mismatch-reftest.html passes flakily 2016-05-24 05:57:57 -0700 1 1 1 Unclassified WebKit WebKitGTK Other PC Linux NEW P2 Normal --- 1 mcatanzaro webkit-unassigned bugs-noreply cgarcia darin mcatanzaro oldest_to_newest 1182454 0 mcatanzaro 2016-04-09 09:31:16 -0700 Layout test fast/harness/sample-fail-mismatch-reftest.html is supposed to always fail, but it has been passing flakily for a while. It's started happening more frequently since r193683. This probably indicates a bug in our test harness. 1182463 1 mcatanzaro 2016-04-09 10:31:58 -0700 Updated expectations in r199270. 1195824 2 cgarcia 2016-05-24 05:57:57 -0700 This is pretty weird because sample-fail-mismatch-reftest.html and sample-fail-mismatch-reftest-expected-mismatch.html are exactly the same file, so they should produce the same output. It just contains a line of text, no html, nor js, so I don't see how r193683 can affect this in any way. But in any case, if it's flaky for whatever reason the right expectations should be [ ImageOnlyFailure Pass ] not [ Failure Pass ]. In this case Pass means it failed and ImageOnlyFailure that it passed. Updated expectations in r201329