Here's an example of the failure diff: http://build.webkit.org/results/Apple%20Lion%20Debug%20WK2%20(Tests)/r126720%20(2830)/fast/forms/validation-message-user-modify-pretty-diff.html When I run the test locally, it fails intermittently. Here's how I run it locally: $ cd oss/webkit oss/webkit $ perl ./Tools/Scripts/run-webkit-tests --no-launch-safari --no-new-test-results --no-sample-on-timeout --results-directory ./layout-test-results --release --webkit-test-runner --no-build fast/forms/validation-message-user-modify.html This test has been consistently failing on the mac bots for many builds now but only on WK2 builds. I wasn't able to isolate the change set that introduced the issue.
This test was skipped for platform mac WK2 in r126724: <http://trac.webkit.org/changeset/126724>.
LayoutTests/platform/wk2/Skipped contains the following lines. # WebKitTestRunner needs support for validation message bubble tests # http://webkit.org/b/57455 fast/forms/validation-message-appearance.html fast/forms/validation-message-clone.html fast/forms/validation-message-on-checkbox.html fast/forms/validation-message-on-listbox.html fast/forms/validation-message-on-menulist.html fast/forms/validation-message-on-radio.html fast/forms/validation-message-on-range.html fast/forms/validation-message-on-textarea.html
These tests run fine for me on Mountain Lion WK2 Debug. This was probably fixed in http://trac.webkit.org/changeset/128030 for https://bugs.webkit.org/show_bug.cgi?id=95936 *** This bug has been marked as a duplicate of bug 95936 ***
Unskipped in http://trac.webkit.org/changeset/148693