Bug 225669

Summary:	[ Catalina+ wk2 ] imported/w3c/web-platform-tests/css/css-transitions/transition-base-response-002.html (layout-test) is a flaky text failure
Product:	WebKit	Reporter:	Robert Jenner <jenner>
Component:	CSS	Assignee:	Nobody <webkit-unassigned>
Status:	NEW ---
Severity:	Normal	CC:	graouts, mmaxfield, webkit-bot-watchers-bugzilla, webkit-bug-importer, zalan
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Unspecified
OS:	Unspecified

Description Robert Jenner 2021-05-11 11:52:57 PDT

imported/w3c/web-platform-tests/css/css-transitions/transition-base-response-002.html

is a flaky text failure. History indicates the failures are occurring on BigSur Release wk2 on Apple Silicon, and on Catalina Release wk2 Intel. 

HISTORY:
https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-transitions%2Ftransition-base-response-002.html&limit=50000


TEXT DIFF:
-FAIL Transitioning font-size on root affects rem units assert_equals: expected "15px" but got "16.5px"
+PASS Transitioning font-size on root affects rem units

Failure appears to be the same on both Catalina wk2 Release Intel, and on BigSur wk2 Release arm64.

Comment 1 Radar WebKit Bug Importer 2021-05-11 15:00:23 PDT

<rdar://problem/77866295>

Comment 2 Robert Jenner 2021-05-12 14:56:00 PDT

This test appears to have been flaky since it started running on Catalina. I was able to reproduce the failure on Catalina Debug ToT using the follow test:

run-webkit-tests imported/w3c/web-platform-tests/css/css-transitions/transition-base-response-002.html --iterations 100 -f

There does also appear to be an occasional failure on BigSur Intel. But it mostly occurs

Comment 3 Robert Jenner 2021-05-12 14:58:09 PDT

(In reply to Robert Jenner from comment #2)
> This test appears to have been flaky since it started running on Catalina. I
> was able to reproduce the failure on Catalina Debug ToT using the follow
> test:
> 
> run-webkit-tests
> imported/w3c/web-platform-tests/css/css-transitions/transition-base-response-
> 002.html --iterations 100 -f
> 
> There does also appear to be an occasional failure on BigSur Intel. But it
> mostly occurs

After investigating more, I would actually say this a a flaky failure on Catalina and up on wk2 only, as the history indicates it is occurring on Catalina, and BigSur in Release and Debug on Intel an arm64.

Comment 4 Robert Jenner 2021-05-12 15:03:19 PDT

Updated test expectations to Pass Failure for macOS Release and Debug here:

https://trac.webkit.org/changeset/277394/webkit