Bug 227467

Summary: fast/css/sticky/sticky-left.html is a flaky image failure
Product: WebKit Reporter: Eric Hutchison <ehutchison>
Component: Tools / TestsAssignee: Karl Rackler <rackler>
Status: REOPENED    
Severity: Normal CC: cdumez, ehutchison, mmaxfield, simon.fraser, tsavell, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=198195
https://bugs.webkit.org/show_bug.cgi?id=178963
Attachments:
Description Flags
Patch none

Eric Hutchison
Reported 2021-06-28 15:46:25 PDT
fast/css/sticky/sticky-left.html Failure on Big Sur wk2 ARM64. First appearance 6/3/21 r278415. History: https://results.webkit.org/?suite=layout-tests&test=fast%2Fcss%2Fsticky%2Fsticky-left.html Unable to access diff due to 404 error.
Attachments
Patch (1.44 KB, patch)
2021-06-29 14:14 PDT, Eric Hutchison
no flags
Radar WebKit Bug Importer
Comment 1 2021-06-28 15:46:54 PDT
Eric Hutchison
Comment 2 2021-06-28 18:27:55 PDT
Reproduced test results on build r278417. run-webkit-tests --root 278417 fast/css/sticky/sticky-left.html --iterations 500 --exit-after-n-failures 2
Ryan Haddad
Comment 3 2021-06-28 20:35:16 PDT
13:44:16.831 21360 worker/4 Test marked as failed, ImageDiff crashed because of no data while reading stdout for the server process. 13:44:16.831 21360 worker/4 fast/css/sticky/sticky-left.html : ImageDiff produced stderr output: Error: test and reference images have different sizes. Test image is 800x700, reference image is 800x600 ImageDiff crashed 13:44:16.831 21360 worker/4 Test marked as failed, ImageDiff crashed because of a broken pipe when writing to stdin of the server process. 13:44:16.831 21360 worker/4 ref test mismatch did not produce an image diff. 13:44:16.832 21360 [10756/59269] fast/css/sticky/sticky-left.html failed unexpectedly (reference mismatch) 13:44:16.832 21360 worker/4 fast/css/sticky/sticky-left.html failed: 13:44:16.832 21360 worker/4 reference mismatch
Eric Hutchison
Comment 4 2021-06-29 11:25:35 PDT
Bisected test failure to range of 227412 (results not reproduced) to 227417 (reproduced results).
Truitt Savell
Comment 5 2021-06-29 12:03:59 PDT
(In reply to Eric Hutchison from comment #4) > Bisected test failure to range of 227412 (results not reproduced) to 227417 > (reproduced results). So I revisited the bisection with Eric. It seems that the initial reproduction case was actually reproducing a crash in the test. We have not been able to reproduce this crashing image diff issue that the bot is seeing. But we found that the crash is only happening on the release builds and started on r278417. a debug build of r278417 does not seem to crash. I am uncertain how a version bump in r278417 could have anything to do with this, but our archived builds seem to point to this revision as starting some kind of problem.
Eric Hutchison
Comment 6 2021-06-29 14:14:05 PDT
Truitt Savell
Comment 7 2021-06-29 14:17:22 PDT
Comment on attachment 432530 [details] Patch Clearing flags on attachment: 432530 Committed r279386 (239251@main): <https://commits.webkit.org/239251@main>
Truitt Savell
Comment 8 2021-06-29 14:17:24 PDT
All reviewed patches have been landed. Closing bug.
Truitt Savell
Comment 9 2021-06-29 14:50:45 PDT
reopen bug
Alexey Proskuryakov
Comment 10 2021-06-29 14:59:12 PDT
Probably has something to do with this test, which runs just before sticky-left.html LayoutTests/fast/css/sticky/sticky-left-percentage.html: window.resizeTo(800, 700)
Alexey Proskuryakov
Comment 11 2021-06-29 15:04:56 PDT
Or perhaps even more relevant is sticky-left-percentage-expected.html, which would be the one loaded right before. Note that it performs window.resizeTo(800, 700) from an inline script, before onload. I wonder if this confuses IPC.
Karl Rackler
Comment 12 2022-04-19 09:50:13 PDT
Karl Rackler
Comment 13 2022-04-19 09:56:55 PDT
Adding fast/css/sticky/sticky-left.html is a flaky image failure on [ Monterey Release wk2 arm64 ] as well. Description: fast/css/sticky/sticky-left.html The first failure that I see on the dashboard was 3/18/2022 at r291490 , but this is not relevant to causing this issue. This test seems to have been flaky since the start on Monterey. History: https://results.webkit.org/?suite=layout-tests&test=fast%2Fcss%2Fsticky%2Fsticky-left.html&platform=mac&version_name=Monterey&architecture=arm64&flavor=wk2&style=release&limit=50000 Image Diff: https://build.webkit.org/results/Apple-Monterey-Release-AppleSilicon-WK2-Tests/r249750@main%20(2764)/fast/css/sticky/sticky-left-diffs.html I have marked this test as flaky image failure while this issue is investigated.
EWS
Comment 14 2022-04-19 11:54:58 PDT
Committed r293029 (249768@main): <https://commits.webkit.org/249768@main> Reviewed commits have been landed. Closing PR #316 and removing active labels.
Ryan Haddad
Comment 15 2022-04-19 13:57:11 PDT
Reopening since the landed change was just updating test expectations.
Note You need to log in before you can comment on or make changes to this bug.