Bug 224522

Summary: REGRESSION (2021-04-13): [ BigSur Release wk2 ] 17 fast/forms layout-tests are flakey text failures
Product: WebKit Reporter: Robert Jenner <jenner>
Component: FormsAssignee: Nobody <webkit-unassigned>
Status: RESOLVED CONFIGURATION CHANGED    
Severity: Normal CC: akeerthi, ap, cdumez, webkit-bot-watchers-bugzilla, webkit-bug-importer, wenson_hsieh
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
Attachments:
Description Flags
Text Failure Diffs none

Description Robert Jenner 2021-04-13 18:32:35 PDT 
The following 17 tests are flakey failures on BigSur wk2 Release:

fast/forms/date/date-editable-components/date-editable-components-keyboard-events.html
fast/forms/date/date-editable-components/date-editable-components-mouse-events.html
fast/forms/date/date-editable-components/date-picker-update-on-edit.html
fast/forms/date/date-input-rendering-basic.html
fast/forms/date/date-pseudo-elements.html
fast/forms/datetimelocal/datetimelocal-editable-components/datetimelocal-editable-components-focus-and-blur-events.html
fast/forms/datetimelocal/datetimelocal-editable-components/datetimelocal-editable-components-keyboard-events.html
fast/forms/datetimelocal/datetimelocal-editable-components/datetimelocal-editable-components-mouse-events.html
fast/forms/datetimelocal/datetimelocal-editable-components/datetimelocal-editable-components-second-and-millisecond-field.html
fast/forms/datetimelocal/datetimelocal-editable-components/datetimelocal-picker-update-on-edit.html
fast/forms/time-input-svg-font.html
fast/forms/time/time-editable-components/time-editable-components-focus-and-blur-events.html
fast/forms/time/time-editable-components/time-editable-components-keyboard-events.html
fast/forms/time/time-editable-components/time-editable-components-mouse-events.html
fast/forms/time/time-editable-components/time-editable-components-second-and-millisecond-field.html
fast/forms/time/time-input-rendering-basic.html
fast/text/hyphenate-locale.html

All 17 tests have the same failure history:

HISTORY:
https://results.webkit.org/?platform=mac&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&test=fast%2Fforms%2Fdate%2Fdate-editable-components%2Fdate-editable-components-keyboard-events.html&test=fast%2Fforms%2Fdate%2Fdate-editable-components%2Fdate-editable-components-mouse-events.html&test=fast%2Fforms%2Fdate%2Fdate-editable-components%2Fdate-picker-update-on-edit.html&test=fast%2Fforms%2Fdate%2Fdate-input-rendering-basic.html&test=fast%2Fforms%2Fdate%2Fdate-pseudo-elements.html&test=fast%2Fforms%2Fdatetimelocal%2Fdatetimelocal-editable-components%2Fdatetimelocal-editable-components-focus-and-blur-events.html&test=fast%2Fforms%2Fdatetimelocal%2Fdatetimelocal-editable-components%2Fdatetimelocal-editable-components-keyboard-events.html&test=fast%2Fforms%2Fdatetimelocal%2Fdatetimelocal-editable-components%2Fdatetimelocal-editable-components-mouse-events.html&test=fast%2Fforms%2Fdatetimelocal%2Fdatetimelocal-editable-components%2Fdatetimelocal-editable-components-second-and-millisecond-field.html&test=fast%2Fforms%2Fdatetimelocal%2Fdatetimelocal-editable-components%2Fdatetimelocal-picker-update-on-edit.html&test=fast%2Fforms%2Ftime-input-svg-font.html&test=fast%2Fforms%2Ftime%2Ftime-editable-components%2Ftime-editable-components-focus-and-blur-events.html&test=fast%2Fforms%2Ftime%2Ftime-editable-components%2Ftime-editable-components-keyboard-events.html&test=fast%2Fforms%2Ftime%2Ftime-editable-components%2Ftime-editable-components-mouse-events.html&test=fast%2Fforms%2Ftime%2Ftime-editable-components%2Ftime-editable-components-second-and-millisecond-field.html&test=fast%2Fforms%2Ftime%2Ftime-input-rendering-basic.html&test=fast%2Ftext%2Fhyphenate-locale.html
Comment 1 Robert Jenner 2021-04-13 18:33:45 PDT 
Created attachment 425940 [details]
Text Failure Diffs

Attaching all 17 text diffs to this bug.
Comment 2 Radar WebKit Bug Importer 2021-04-13 19:05:32 PDT 
<rdar://problem/76622634>
Comment 3 Alexey Proskuryakov 2021-04-15 15:48:55 PDT 
Is this some state leaking from a preceding test?

Also, this is a recent regression. What revision did this start with?
Comment 4 Alexey Proskuryakov 2021-04-15 15:55:11 PDT 
This looks like a wrong locale being used.

The first failure is https://trac.webkit.org/r275892, but I don't see any obvious culprits landed before it.
Comment 5 Alexey Proskuryakov 2021-04-15 15:58:22 PDT 
Looking at ardor comments, I see that one of the bots had system language set to UK English.

This may still be a problem with a test though, as it seem unlikely that anyone did it manually.