Bug 216292

Summary: [ macOS iOS ] imported/w3c/web-platform-tests/css/css-flexbox/quirks-auto-block-size-with-percentage-item.html is a flaky failure
Product: WebKit Reporter: Hector Lopez <hector_i_lopez>
Component: New BugsAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Normal CC: bugs-noreply, lmoura, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   

Description Hector Lopez 2020-09-08 16:31:17 PDT
imported/w3c/web-platform-tests/css/css-flexbox/quirks-auto-block-size-with-percentage-item.html

Test is a flaky failure according to history on macOS wk2 Release. First occurrence of failure is at r 266719.

Was able to reproduce on Catalina:

run-webkit-tests imported/w3c/web-platform-tests/css/css-flexbox/quirks-auto-block-size-with-percentage-item.html  --iterations 100 --exit-after-n-failures 3

[2/100] imported/w3c/web-platform-tests/css/css-flexbox/quirks-auto-block-size-with-percentage-item.html failed unexpectedly (text diff)
[12/100] imported/w3c/web-platform-tests/css/css-flexbox/quirks-auto-block-size-with-percentage-item.html failed unexpectedly (text diff)
[15/100] imported/w3c/web-platform-tests/css/css-flexbox/quirks-auto-block-size-with-percentage-item.html failed unexpectedly (text diff)
Exiting early after 3 failures. 15 tests run.


12 tests ran as expected, 3 didn't (85 didn't run):


Regressions: Unexpected text-only failures (1)
  imported/w3c/web-platform-tests/css/css-flexbox/quirks-auto-block-size-with-percentage-item.html [ Failure ]

Diff:
--- /Volumes/Data/slave/catalina-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/css/css-flexbox/quirks-auto-block-size-with-percentage-item-expected.txt
+++ /Volumes/Data/slave/catalina-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/css/css-flexbox/quirks-auto-block-size-with-percentage-item-actual.txt
@@ -2,5 +2,12 @@
 
 
 
-PASS #container 1 
+FAIL #container 1 assert_equals: 
+<div id="container" style="width:200px; height:456px;">
+  <div style="display:flex; background:blue;" data-expected-height="100">
+    <img style="width:100px; height: 50%;" src="support/1x1-green.png" data-expected-height="100">
+    <div style="width: 50px; height: 100%; background: red;" data-expected-height="0"></div>
+  </div>
+</div>
+height expected 100 but got 0
Comment 1 Radar WebKit Bug Importer 2020-09-08 16:31:37 PDT
<rdar://problem/68537198>
Comment 2 Hector Lopez 2020-09-08 16:40:19 PDT
Test expectation while investigated:

https://trac.webkit.org/changeset/266759/webkit
Comment 3 Hector Lopez 2020-09-14 16:06:26 PDT
Test is now a flaky failure on macOS wk1 Release and iOS wk2 Release according to history.

Test expectations added:

https://trac.webkit.org/changeset/267055/webkit
Comment 5 Hector Lopez 2020-09-15 14:42:02 PDT
Test is also now failing on macOS Debug wk1/2.

Test expectations changed to reflect failures:

https://trac.webkit.org/changeset/267100/webkit
Comment 6 Lauro Moura 2020-09-30 20:10:07 PDT
Same failure happening in GTK/WPE Release bots, but not in the Debug ones, since r266716 (first occurrence).

Expectations updated in r267816.