Bug 153311

Summary:	[iOS Simulator] fast/replaced/preferred-widths.html is flaky
Product:	WebKit	Reporter:	Ryan Haddad <ryanhaddad>
Component:	Layout and Rendering	Assignee:	Nobody <webkit-unassigned>
Status:	NEW ---
Severity:	Normal	CC:	simon.fraser
Priority:	P2
Version:	WebKit Nightly Build
Hardware:	iPhone / iPad
OS:	iOS 9.0
See Also:	https://bugs.webkit.org/show_bug.cgi?id=116621
Bug Depends on:
Bug Blocks:	152130

Description Ryan Haddad 2016-01-21 10:43:58 PST

[iOS Simulator] fast/replaced/preferred-widths.html is flaky

<https://build.webkit.org/results/Apple%20iOS%209%20Simulator%20Release%20WK2%20(Tests)/r195410%20(2450)/results.html>

Flakiness dashboard:
<http://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=fast%2Freplaced%2Fpreferred-widths.html>


--- /Volumes/Data/slave/ios-simulator-9-release-tests-wk2/build/layout-test-results/fast/replaced/preferred-widths-expected.txt
+++ /Volumes/Data/slave/ios-simulator-9-release-tests-wk2/build/layout-test-results/fast/replaced/preferred-widths-actual.txt
@@ -1,12 +1,31 @@
 Test the effect of percentages widths on the preferred widths of replaced elements.
 
 
-PASS
+FAIL:
+Expected 130 for width, but got 40. 
+Expected 130 for height, but got 30. 
+Expected 120 for width, but got 30. 
+Expected 120 for height, but got 20. 
 
-PASS
+<div class="container" data-expected-width="130" data-expected-height="130">
+    <img class="min-content" src="resources/square-blue-100x100.png" style="width: 10px; border: 5px solid black; padding: 5px;" data-expected-width="120" data-expected-height="120">
+</div>
+
+FAIL:
+Expected 130 for width, but got 40. 
+Expected 130 for height, but got 30. 
+Expected 120 for width, but got 30. 
+Expected 120 for height, but got 20. 
+
+<div class="container" data-expected-width="130" data-expected-height="130">
+    <img class="max-content" src="resources/square-blue-100x100.png" style="width: 10px; border: 5px solid black; padding: 5px;" data-expected-width="120" data-expected-height="120">
+</div>
 
 FAIL:
 Expected 130 for width, but got 30. 
+Expected 130 for height, but got 30. 
+Expected 120 for width, but got 40. 
+Expected 120 for height, but got 20. 
 
 <div class="container" data-expected-width="130" data-expected-height="130">
     <img class="min-content" src="resources/square-blue-100x100.png" style="width: 100%; border: 5px solid black; padding: 5px;" data-expected-width="120" data-expected-height="120">
@@ -14,17 +33,53 @@
 
 FAIL:
 Expected 130 for width, but got 30. 
+Expected 130 for height, but got 30. 
+Expected 120 for width, but got 40. 
+Expected 120 for height, but got 20. 
 
 <div class="container" data-expected-width="130" data-expected-height="130">
     <img class="max-content" src="resources/square-blue-100x100.png" style="width: 100%; border: 5px solid black; padding: 5px;" data-expected-width="120" data-expected-height="120">
 </div>
 
-PASS
+FAIL:
+Expected 75 for height, but got 30. 
+Expected 65 for height, but got 20. 
 
-PASS
+<div class="container" data-expected-width="55" data-expected-height="75">
+    <img src="resources/square-blue-100x100.png" style="min-width: 25px; width: 100%; border: 5px solid black; padding: 5px;" data-expected-width="65" data-expected-height="65">
+</div>
 
-PASS
+FAIL:
+Expected 75 for height, but got 30. 
+Expected 65 for height, but got 20. 
 
-PASS
+<div class="container" data-expected-width="55" data-expected-height="75">
+    <img src="resources/square-blue-100x100.png" style="min-width: 25px; width: 100%; border: 5px solid black; padding: 5px;" data-expected-width="65" data-expected-height="65">
+</div>
 
-PASS
+FAIL:
+Expected 50 for height, but got 30. 
+Expected 40 for height, but got 20. 
+
+<div class="container" data-expected-width="30" data-expected-height="50">
+    <img src="resources/square-blue-100x100.png" style="width: 100%; border: 5px solid grey; padding: 5px;" data-expected-width="40" data-expected-height="40">
+</div>
+
+FAIL:
+Expected 50 for height, but got 30. 
+Expected 40 for width, but got 20. 
+Expected 40 for height, but got 20. 
+
+<div class="container" data-expected-width="30" data-expected-height="50">
+    <img src="resources/square-blue-100x100.png" style="max-width: 100%; border: 5px solid grey; padding: 5px;" data-expected-width="40" data-expected-height="40">
+</div>
+
+FAIL:
+Expected 130 for width, but got 30. 
+Expected 150 for height, but got 30. 
+Expected 140 for width, but got 40. 
+Expected 140 for height, but got 20. 
+
+<div class="container" data-expected-width="130" data-expected-height="150">
+    <img src="resources/square-blue-100x100.png" style="min-width: 100%; border: 5px solid grey; padding: 5px;" data-expected-width="140" data-expected-height="140">
+</div>

Comment 1 Ryan Haddad 2016-01-21 11:02:22 PST

Now that we have flakiness dashboard results for iOS simulator results, it looks like this test has only failed once:
<http://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=perf%2Farray-binary-search.html>

Comment 2 Ryan Haddad 2016-01-21 11:03:01 PST

(In reply to comment #1)
> Now that we have flakiness dashboard results for iOS simulator results, it
> looks like this test has only failed once:
> <http://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.
> html#showAllRuns=true&tests=perf%2Farray-binary-search.html>

Disregard. Too many tabs open.

Comment 3 Ryan Haddad 2016-02-01 13:32:15 PST

Marked as flaky with <https://trac.webkit.org/r195977>