Bug 239990 – [ iOS ][ macOS ] css3/calc/transitions-dependent.html is a flaky failure

• Status: RESOLVED
• Resolution: CONFIGURATION CHANGED
• Component: Animations

[Karl Rackler]

Description:
css3/calc/transitions-dependent.html

The iOS test on 1/11/2022 at r287874 improved the constant failure to passing on iOS until 3/21/2022 at r291584 where it becomes a flaky failure. 
 
The first failure that I saw on the dashboard for Big Sur was 2/15/2022 at r289815, but this does not appear relevant to causing this issue.  The first failure that I saw on the dashboard for Monterey was 2/15/2022 at r289815.

REPRODUCTION STEPS
I can reproduce this on Tot (r293682), but unable to reproduce to find the regression point.  Also, note you can run this without --iterations and it passes for iOS, but fails with the it.
i.e. 
run-webkit-tests --root 293682 --ios-simulator --device-type iPhone 12 --exit-after-n-failures 1 --exit-after-n-crashes-or-timeouts 1 css3/calc/transitions-dependent.html = Passes
run-webkit-tests --root 293682 --ios-simulator --device-type iPhone 12 --iterations 2 --exit-after-n-failures 1 --exit-after-n-crashes-or-timeouts 1 css3/calc/transitions-dependent.html = Failure

[iOS]
Command:
run-webkit-tests --root 293682 --ios-simulator --device-type iPhone 12 --iterations 2 --exit-after-n-failures 1 --exit-after-n-crashes-or-timeouts 1 css3/calc/transitions-dependent.html = Failure

Result: 
[2/2] css3/calc/transitions-dependent.html failed unexpectedly (text diff)
Exiting early after 2 failures. 2 tests run.

0 tests ran as expected, 2 didn't:

Unexpected flakiness: text-only failures (1)
  css3/calc/transitions-dependent.html [ Failure Pass ]

[macOS]
Command:
run-webkit-tests --root 293682 --exit-after-n-failures 1 --exit-after-n-crashes-or-timeouts 1 --iterations 50 -f --no-retry css3/calc/transitions-dependent.html

Result: 
8 tests ran as expected, 3 didn't (39 didn't run):


Unexpected flakiness: text-only failures (1)
  css3/calc/transitions-dependent.html [ Failure Pass ] 

History:
https://results.webkit.org/?suite=layout-tests&test=css3%2Fcalc%2Ftransitions-dependent.html&platform=mac&platform=ios&limit=50000

Diff:
--- /Volumes/Data/worker/Apple-Monterey-Debug-WK1-Tests/build/layout-test-results/css3/calc/transitions-dependent-expected.txt
+++ /Volumes/Data/worker/Apple-Monterey-Debug-WK1-Tests/build/layout-test-results/css3/calc/transitions-dependent-actual.txt
@@ -1,12 +1,22 @@
+CONSOLE MESSAGE: A transition for property width could not be found
+CONSOLE MESSAGE: A transition for property width could not be found
+CONSOLE MESSAGE: A transition for property width could not be found
+CONSOLE MESSAGE: A transition for property width could not be found
+CONSOLE MESSAGE: A transition for property width could not be found
+CONSOLE MESSAGE: A transition for property width could not be found
+CONSOLE MESSAGE: A transition for property width could not be found
+CONSOLE MESSAGE: A transition for property width could not be found
+CONSOLE MESSAGE: A transition for property width could not be found
+CONSOLE MESSAGE: A transition for property width could not be found
 This tests that calc() expressions depending on transitioning elements behave correctly.
-PASS - "width" property for "inner" element at 0s was: 60
-PASS - "width" property for "inner" element at 0.25s was: 110
-PASS - "width" property for "inner" element at 0.5s was: 160
-PASS - "width" property for "inner" element at 0.75s was: 210
+FAIL - "width" property for "inner" element at 0s expected: 60 but saw: 260
+FAIL - "width" property for "inner" element at 0.25s expected: 110 but saw: 260
+FAIL - "width" property for "inner" element at 0.5s expected: 160 but saw: 260
+FAIL - "width" property for "inner" element at 0.75s expected: 210 but saw: 260
 PASS - "width" property for "inner" element at 1s was: 260
-PASS - "width" property for "innerTransition" element at 0s was: 60
-PASS - "width" property for "innerTransition" element at 0.25s was: 167.5
-PASS - "width" property for "innerTransition" element at 0.5s was: 275
-PASS - "width" property for "innerTransition" element at 0.75s was: 382.5
+FAIL - "width" property for "innerTransition" element at 0s expected: 60 but saw: 490
+FAIL - "width" property for "innerTransition" element at 0.25s expected: 167.5 but saw: 490
+FAIL - "width" property for "innerTransition" element at 0.5s expected: 275 but saw: 490
+FAIL - "width" property for "innerTransition" element at 0.75s expected: 382.5 but saw: 490
 PASS - "width" property for "innerTransition" element at 1s was: 490

[Radar WebKit Bug Importer]

<rdar://problem/92640544>

[Karl Rackler]

I have marked this test as a flaky failure this issue is investigated.

[Karl Rackler]

Pull request: https://github.com/WebKit/WebKit/pull/462

[EWS]

Test gardening commit r293702 (250193@main): <https://commits.webkit.org/250193@main>

Reviewed commits have been landed. Closing PR #462 and removing active labels.

[Karl Rackler]

Pull request: https://github.com/WebKit/WebKit/pull/476

[Karl Rackler]

(In reply to Karl Rackler from comment #5)
> Pull request: https://github.com/WebKit/WebKit/pull/476

This was not meant for this bug, please disregard.

[Cameron McCormack (:heycam)]

Flaky test annotation removed in 313552@main.