Bug 196495 – [ iOS Sim ] Layout Test fast/viewport/ios/viewport-shrink-to-fit-on-new-navigation.html is a flaky failure

• Status: NEW
• Component: Tools / Tests

[Shawn Roberts]

The following layout test is failing on iOS Simulator Release

fast/viewport/ios/viewport-shrink-to-fit-on-new-navigation.html

Probable cause:

Test was added in https://trac.webkit.org/changeset/242069/webkit and is a flaky failure on its entire available history in dashboard. When testing locally it will either fail with a timeout, or a timeout and a text diff. Will get about 5 iterations in and start failing when testing locally.

Test failing is also affecting EWS

Reproduced with: 

run-webkit-tests fast/viewport/ios/viewport-shrink-to-fit-on-new-navigation.html --iterations 100 -f --ios-simulator --exit-after-n-failures=5

Flakiness Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=fast%2Fviewport%2Fios%2Fviewport-shrink-to-fit-on-new-navigation.html

Diff:

--- /Volumes/Data/slave/ios-simulator-12-release-tests-wk2/build/layout-test-results/fast/viewport/ios/viewport-shrink-to-fit-on-new-navigation-expected.txt
+++ /Volumes/Data/slave/ios-simulator-12-release-tests-wk2/build/layout-test-results/fast/viewport/ios/viewport-shrink-to-fit-on-new-navigation-actual.txt
@@ -1,6 +1,6 @@
 ALERT: pageshow - not from cache
 ALERT: pageshow - from cache
-window size: [1008, 1726]
+window size: [320, 548]
 zoom scale: 0.32

[Shawn Roberts]

Marked flaky in https://trac.webkit.org/changeset/243742/webkit while waiting for a fix and to help EWS.

[Radar WebKit Bug Importer]

<rdar://problem/49532510>

[Shawn Roberts]

Test had a recent time out on iOS Simulator. While investigating realized that after marking test as a failure, changes in https://trac.webkit.org/changeset/243961/webkit have made it a constant failure.

It appears that it just needs to be re baselined because of the constant failure. Thought I don't know if r243961 would have done anything for the flakiness.

[Russell Epstein]

This test is no longer a flaky failure, but a consistent one instead.



Diff:
--- /Volumes/Data/slave/ios-simulator-12-debug-tests-wk2/build/layout-test-results/fast/viewport/ios/viewport-shrink-to-fit-on-new-navigation-expected.txt
+++ /Volumes/Data/slave/ios-simulator-12-debug-tests-wk2/build/layout-test-results/fast/viewport/ios/viewport-shrink-to-fit-on-new-navigation-actual.txt
@@ -1,6 +1,6 @@
 ALERT: pageshow - not from cache
 ALERT: pageshow - from cache
 window size: [1008, 1726]
-zoom scale: 0.32
+zoom scale: 1.00

[Ryan Haddad]

New results history link that shows the test is still consistently failing:
https://results.webkit.org/?suite=layout-tests&test=fast%2Fviewport%2Fios%2Fviewport-shrink-to-fit-on-new-navigation.html