Bug 237181 - [GTK] The setting WebKitMinimumFontSize is not reset by the testing framework, leading to flaky tests
Summary: [GTK] The setting WebKitMinimumFontSize is not reset by the testing framework...
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: WebKit Nightly Build
Hardware: PC Linux
: P2 Normal
Assignee: Arcady Goldmints-Orlov
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2022-02-24 20:28 PST by Arcady Goldmints-Orlov
Modified: 2022-04-27 12:05 PDT (History)
4 users (show)

See Also:


Attachments
A hotfix (1.03 KB, patch)
2022-04-03 15:21 PDT, ChangSeok Oh
no flags Details | Formatted Diff | Diff
[fast-cq] Patch (1.50 KB, patch)
2022-04-27 11:37 PDT, Arcady Goldmints-Orlov
no flags Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Arcady Goldmints-Orlov 2022-02-24 20:28:58 PST
The test fast/forms/validation-message-minimum-font-size.html uses the setting WebKitMinimumFontSize, which on GTK does not appear to be getting reset between tests, leading to failures in tests that run in the same test runner process, which results in test flakiness. The code to set this setting on GTK was introduced by r288666.
Comment 1 ChangSeok Oh 2022-02-28 16:29:08 PST
(In reply to Arcady Goldmints-Orlov from comment #0)
> The test fast/forms/validation-message-minimum-font-size.html uses the
> setting WebKitMinimumFontSize, which on GTK does not appear to be getting
> reset between tests, leading to failures in tests that run in the same test
> runner process, which results in test flakiness. The code to set this
> setting on GTK was introduced by r288666.

May I ask what tests are flaky in particular?
Comment 2 Arcady Goldmints-Orlov 2022-02-28 16:43:10 PST
If you are looking to reproduce it, the command I have been using is:

Tools/Scripts/run-webkit-tests --no-new --child-processes=1 --no-show fast/forms/validation-message-minimum-font-size.html fast/text/international
Comment 3 ChangSeok Oh 2022-04-03 15:20:50 PDT
(In reply to Arcady Goldmints-Orlov from comment #2)
> If you are looking to reproduce it, the command I have been using is:
> 
> Tools/Scripts/run-webkit-tests --no-new --child-processes=1 --no-show
> fast/forms/validation-message-minimum-font-size.html fast/text/international

Unfortunately, I could not reproduce the issue in two different Linux distributions: Ubuntu 21.10 and Fedora 35.

In my investigation, a WebPreferences instance is ephemeral so each test creates its own WebPreferences rather than sharing one among tests.

Would you test if the attached hotfix resolves your issue?
Comment 4 ChangSeok Oh 2022-04-03 15:21:42 PDT
Created attachment 456521 [details]
A hotfix
Comment 5 Arcady Goldmints-Orlov 2022-04-27 11:14:04 PDT
This was fixed by r292681, I will remove the line from the TestExpectation.
Comment 6 Arcady Goldmints-Orlov 2022-04-27 11:37:10 PDT
Created attachment 458455 [details]
[fast-cq] Patch
Comment 7 EWS 2022-04-27 12:04:23 PDT
Committed r293523 (250054@main): <https://commits.webkit.org/250054@main>

All reviewed patches have been landed. Closing bug and clearing flags on attachment 458455 [details].
Comment 8 Radar WebKit Bug Importer 2022-04-27 12:05:13 PDT
<rdar://problem/92412612>