Bug 224522 - REGRESSION (2021-04-13): [ BigSur Release wk2 ] 17 fast/forms layout-tests are flakey text failures
Summary: REGRESSION (2021-04-13): [ BigSur Release wk2 ] 17 fast/forms layout-tests ar...
Status: RESOLVED CONFIGURATION CHANGED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Forms (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2021-04-13 18:32 PDT by Robert Jenner
Modified: 2021-04-15 15:58 PDT (History)
6 users (show)

See Also:


Attachments
Text Failure Diffs (24.46 KB, application/zip)
2021-04-13 18:33 PDT, Robert Jenner
no flags Details

Note You need to log in before you can comment on or make changes to this bug.
Description Robert Jenner 2021-04-13 18:32:35 PDT
The following 17 tests are flakey failures on BigSur wk2 Release:

fast/forms/date/date-editable-components/date-editable-components-keyboard-events.html
fast/forms/date/date-editable-components/date-editable-components-mouse-events.html
fast/forms/date/date-editable-components/date-picker-update-on-edit.html
fast/forms/date/date-input-rendering-basic.html
fast/forms/date/date-pseudo-elements.html
fast/forms/datetimelocal/datetimelocal-editable-components/datetimelocal-editable-components-focus-and-blur-events.html
fast/forms/datetimelocal/datetimelocal-editable-components/datetimelocal-editable-components-keyboard-events.html
fast/forms/datetimelocal/datetimelocal-editable-components/datetimelocal-editable-components-mouse-events.html
fast/forms/datetimelocal/datetimelocal-editable-components/datetimelocal-editable-components-second-and-millisecond-field.html
fast/forms/datetimelocal/datetimelocal-editable-components/datetimelocal-picker-update-on-edit.html
fast/forms/time-input-svg-font.html
fast/forms/time/time-editable-components/time-editable-components-focus-and-blur-events.html
fast/forms/time/time-editable-components/time-editable-components-keyboard-events.html
fast/forms/time/time-editable-components/time-editable-components-mouse-events.html
fast/forms/time/time-editable-components/time-editable-components-second-and-millisecond-field.html
fast/forms/time/time-input-rendering-basic.html
fast/text/hyphenate-locale.html

All 17 tests have the same failure history:

HISTORY:
https://results.webkit.org/?platform=mac&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&test=fast%2Fforms%2Fdate%2Fdate-editable-components%2Fdate-editable-components-keyboard-events.html&test=fast%2Fforms%2Fdate%2Fdate-editable-components%2Fdate-editable-components-mouse-events.html&test=fast%2Fforms%2Fdate%2Fdate-editable-components%2Fdate-picker-update-on-edit.html&test=fast%2Fforms%2Fdate%2Fdate-input-rendering-basic.html&test=fast%2Fforms%2Fdate%2Fdate-pseudo-elements.html&test=fast%2Fforms%2Fdatetimelocal%2Fdatetimelocal-editable-components%2Fdatetimelocal-editable-components-focus-and-blur-events.html&test=fast%2Fforms%2Fdatetimelocal%2Fdatetimelocal-editable-components%2Fdatetimelocal-editable-components-keyboard-events.html&test=fast%2Fforms%2Fdatetimelocal%2Fdatetimelocal-editable-components%2Fdatetimelocal-editable-components-mouse-events.html&test=fast%2Fforms%2Fdatetimelocal%2Fdatetimelocal-editable-components%2Fdatetimelocal-editable-components-second-and-millisecond-field.html&test=fast%2Fforms%2Fdatetimelocal%2Fdatetimelocal-editable-components%2Fdatetimelocal-picker-update-on-edit.html&test=fast%2Fforms%2Ftime-input-svg-font.html&test=fast%2Fforms%2Ftime%2Ftime-editable-components%2Ftime-editable-components-focus-and-blur-events.html&test=fast%2Fforms%2Ftime%2Ftime-editable-components%2Ftime-editable-components-keyboard-events.html&test=fast%2Fforms%2Ftime%2Ftime-editable-components%2Ftime-editable-components-mouse-events.html&test=fast%2Fforms%2Ftime%2Ftime-editable-components%2Ftime-editable-components-second-and-millisecond-field.html&test=fast%2Fforms%2Ftime%2Ftime-input-rendering-basic.html&test=fast%2Ftext%2Fhyphenate-locale.html
Comment 1 Robert Jenner 2021-04-13 18:33:45 PDT
Created attachment 425940 [details]
Text Failure Diffs

Attaching all 17 text diffs to this bug.
Comment 2 Radar WebKit Bug Importer 2021-04-13 19:05:32 PDT
<rdar://problem/76622634>
Comment 3 Alexey Proskuryakov 2021-04-15 15:48:55 PDT
Is this some state leaking from a preceding test?

Also, this is a recent regression. What revision did this start with?
Comment 4 Alexey Proskuryakov 2021-04-15 15:55:11 PDT
This looks like a wrong locale being used.

The first failure is https://trac.webkit.org/r275892, but I don't see any obvious culprits landed before it.
Comment 5 Alexey Proskuryakov 2021-04-15 15:58:22 PDT
Looking at ardor comments, I see that one of the bots had system language set to UK English.

This may still be a problem with a test though, as it seem unlikely that anyone did it manually.