[ iOS Sim WK2 ] Layout Test fast/visual-viewport/ios/min-scale-greater-than-one.html is a flaky failure

• Component: Tools / Tests
• Status: RESOLVED DUPLICATE

[Shawn Roberts]

The following layout test is failing on iOS Simulator Release WK2

fast/visual-viewport/ios/min-scale-greater-than-one.html

Probable cause:

Test recently started showing up on the dashboard around r242531 as a flaky failure on iOS Sim Release. Is a very flaky failure on dashboard, when running test locally it fails 10 times in 60 iterations with 1 child process, unsure if it's because I'm running iterations, but I do get the same diff that is on the bots.

I tested with several revisions from when it was made until current, but there appears to be a lot of code changes so I do not get consistent results. 

Reproduced with: 

run-webkit-tests fast/visual-viewport/ios/min-scale-greater-than-one.html --iterations 500 --child-process 1 --ios-simulator --exit-after-n-failures=10 --no-retry

Flakiness Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=fast%2Fvisual-viewport%2Fios%2Fmin-scale-greater-than-one.html

Diff:

--- /Volumes/Data/slave/ios-simulator-12-release-tests-wk2/build/layout-test-results/fast/visual-viewport/ios/min-scale-greater-than-one-expected.txt
+++ /Volumes/Data/slave/ios-simulator-12-release-tests-wk2/build/layout-test-results/fast/visual-viewport/ios/min-scale-greater-than-one-actual.txt
@@ -2,7 +2,6 @@
 Scrolling to bottom
 PASS window.scrollY is expectedTop
 PASS Math.round(boundingClientRect.top) is expectedTop
-Tap dispatched
 Target clicked
 PASS successfullyParsed is true

[Shawn Roberts]

Start with Simon for help since they created the test.

[Radar WebKit Bug Importer]

<rdar://problem/49339115>

[Shawn Roberts]

marked flay in https://trac.webkit.org/changeset/243547/webkit

[Simon Fraser (smfr)]

Dean, did fast tap break this?

[Jon Lee]

Can we combine this with 196236?

[Shawn Roberts]

(In reply to Jon Lee from comment #5)
> Can we combine this with 196236?

I was hesitant because the generally flakiness of the test is addressed here, while the consistency of the Debug failures were isolated to a different revision. 

I can if it makes it easier for tracking however?

[Ryan Haddad]

I'm going to go ahead and dupe this since the diff is the same.

*** This bug has been marked as a duplicate of bug 196236 ***

[Jason Lawrence]

This issue is still occurring, see the diff below.

https://build.webkit.org/results/Apple%20iPadOS%2013%20Simulator%20Release%20WK2%20(Tests)/r256466%20(2139)/fast/visual-viewport/ios/min-scale-greater-than-one-diff.txt
@@ -2,7 +2,6 @@
 Scrolling to bottom
 PASS window.scrollY is expectedTop
 PASS Math.round(boundingClientRect.top) is expectedTop
-Tap dispatched
 Target clicked
 PASS successfullyParsed is true


I have marked this test as failing while this is investigated further.
https://trac.webkit.org/changeset/256486/webkit