Bug 225669 – [ Catalina+ wk2 ] imported/w3c/web-platform-tests/css/css-transitions/transition-base-response-002.html (layout-test) is a flaky text failure

• Status: NEW
• Component: CSS

[Robert Jenner]

imported/w3c/web-platform-tests/css/css-transitions/transition-base-response-002.html

is a flaky text failure. History indicates the failures are occurring on BigSur Release wk2 on Apple Silicon, and on Catalina Release wk2 Intel. 

HISTORY:
https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-transitions%2Ftransition-base-response-002.html&limit=50000


TEXT DIFF:
-FAIL Transitioning font-size on root affects rem units assert_equals: expected "15px" but got "16.5px"
+PASS Transitioning font-size on root affects rem units

Failure appears to be the same on both Catalina wk2 Release Intel, and on BigSur wk2 Release arm64.

[Radar WebKit Bug Importer]

<rdar://problem/77866295>

[Robert Jenner]

This test appears to have been flaky since it started running on Catalina. I was able to reproduce the failure on Catalina Debug ToT using the follow test:

run-webkit-tests imported/w3c/web-platform-tests/css/css-transitions/transition-base-response-002.html --iterations 100 -f

There does also appear to be an occasional failure on BigSur Intel. But it mostly occurs

[Robert Jenner]

(In reply to Robert Jenner from comment #2)
> This test appears to have been flaky since it started running on Catalina. I
> was able to reproduce the failure on Catalina Debug ToT using the follow
> test:
> 
> run-webkit-tests
> imported/w3c/web-platform-tests/css/css-transitions/transition-base-response-
> 002.html --iterations 100 -f
> 
> There does also appear to be an occasional failure on BigSur Intel. But it
> mostly occurs

After investigating more, I would actually say this a a flaky failure on Catalina and up on wk2 only, as the history indicates it is occurring on Catalina, and BigSur in Release and Debug on Intel an arm64.

[Robert Jenner]

Updated test expectations to Pass Failure for macOS Release and Debug here:

https://trac.webkit.org/changeset/277394/webkit