Bug 225669 - [ Catalina+ wk2 ] imported/w3c/web-platform-tests/css/css-transitions/transition-base-response-002.html (layout-test) is a flaky text failure
Summary: [ Catalina+ wk2 ] imported/w3c/web-platform-tests/css/css-transitions/transit...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: CSS (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2021-05-11 11:52 PDT by Robert Jenner
Modified: 2021-05-12 15:03 PDT (History)
5 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Robert Jenner 2021-05-11 11:52:57 PDT
imported/w3c/web-platform-tests/css/css-transitions/transition-base-response-002.html

is a flaky text failure. History indicates the failures are occurring on BigSur Release wk2 on Apple Silicon, and on Catalina Release wk2 Intel. 

HISTORY:
https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-transitions%2Ftransition-base-response-002.html&limit=50000


TEXT DIFF:
-FAIL Transitioning font-size on root affects rem units assert_equals: expected "15px" but got "16.5px"
+PASS Transitioning font-size on root affects rem units

Failure appears to be the same on both Catalina wk2 Release Intel, and on BigSur wk2 Release arm64.
Comment 1 Radar WebKit Bug Importer 2021-05-11 15:00:23 PDT
<rdar://problem/77866295>
Comment 2 Robert Jenner 2021-05-12 14:56:00 PDT
This test appears to have been flaky since it started running on Catalina. I was able to reproduce the failure on Catalina Debug ToT using the follow test:

run-webkit-tests imported/w3c/web-platform-tests/css/css-transitions/transition-base-response-002.html --iterations 100 -f

There does also appear to be an occasional failure on BigSur Intel. But it mostly occurs
Comment 3 Robert Jenner 2021-05-12 14:58:09 PDT
(In reply to Robert Jenner from comment #2)
> This test appears to have been flaky since it started running on Catalina. I
> was able to reproduce the failure on Catalina Debug ToT using the follow
> test:
> 
> run-webkit-tests
> imported/w3c/web-platform-tests/css/css-transitions/transition-base-response-
> 002.html --iterations 100 -f
> 
> There does also appear to be an occasional failure on BigSur Intel. But it
> mostly occurs

After investigating more, I would actually say this a a flaky failure on Catalina and up on wk2 only, as the history indicates it is occurring on Catalina, and BigSur in Release and Debug on Intel an arm64.
Comment 4 Robert Jenner 2021-05-12 15:03:19 PDT
Updated test expectations to Pass Failure for macOS Release and Debug here:

https://trac.webkit.org/changeset/277394/webkit