fast/hidpi/filters-blur.html fast/hidpi/filters-hue-rotate.html fast/hidpi/filters-invert.html fast/hidpi/filters-multiple.html fast/hidpi/filters-reference.html fast/hidpi/image-set-gradient-multi.html fast/hidpi/pdf-image-scaled.html Are flaky image failing on iOS 15 sim iPhone 12. fast/hidpi/image-srcset-simple-1x.html fast/hidpi/image-srcset-simple-in-variable-1x.html Are flaky text failing on iOS 15 sim Release & Debug iPhone 12. History: https://results.webkit.org/?suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&test=fast%2Fhidpi%2Ffilters-blur.html&test=fast%2Fhidpi%2Ffilters-hue-rotate.html&test=fast%2Fhidpi%2Ffilters-invert.html&test=fast%2Fhidpi%2Ffilters-multiple.html&test=fast%2Fhidpi%2Ffilters-reference.html&test=fast%2Fhidpi%2Fimage-set-gradient-multi.html&test=fast%2Fhidpi%2Fimage-srcset-simple-1x.html&test=fast%2Fhidpi%2Fimage-srcset-simple-in-variable-1x.html&test=fast%2Fhidpi%2Fpdf-image-scaled.html Result page: https://build.webkit.org/results/Apple-iOS-15-Simulator-Debug-WK2-Tests/r284918%20(310)/results.html# Diff: --- /Volumes/Data/worker/ios-simulator-15-debug-tests-wk2/build/layout-test-results/fast/hidpi/image-srcset-simple-1x-expected.txt +++ /Volumes/Data/worker/ios-simulator-15-debug-tests-wk2/build/layout-test-results/fast/hidpi/image-srcset-simple-1x-actual.txt @@ -1,3 +1,3 @@ -PASS document.getElementById("foo").clientWidth==400 is true +FAIL document.getElementById("foo").clientWidth==400 should be true. Was false. This test passes if the image below says 1x with a reddish background when the deviceScaleFactor is 1, and if says 2x with a greenish background when the deviceScaleFactor is 2. fast/inline-block/hidpi-margin-top-with-subpixel-value-and-overflow-hidden.html fast/layers/hidpi-box-positioned-off-by-one-when-transform-is-present.html fast/layers/hidpi-floor-negative-coordinate-values-to-maintain-rounding-direction.html fast/layers/hidpi-nested-layers-with-subpixel-accumulation.html fast/layers/hidpi-transform-on-child-content-is-mispositioned.html Are flaky image failing on iOS 15 sim Debug on iPhone 12. History: https://results.webkit.org/?suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&test=fast%2Finline-block%2Fhidpi-margin-top-with-subpixel-value-and-overflow-hidden.html&test=fast%2Flayers%2Fhidpi-box-positioned-off-by-one-when-transform-is-present.html&test=fast%2Flayers%2Fhidpi-floor-negative-coordinate-values-to-maintain-rounding-direction.html&test=fast%2Flayers%2Fhidpi-nested-layers-with-subpixel-accumulation.html&test=fast%2Flayers%2Fhidpi-transform-on-child-content-is-mispositioned.html Result page: https://build.webkit.org/results/Apple-iOS-15-Simulator-Debug-WK2-Tests/r284918%20(310)/results.html
All those tests seem to have started being flaky somewhere between r284876 - r284887.
<rdar://problem/84714121>
Created attachment 442604 [details] Image diff
I was able to reproduce the failure at TOT on iOS 15 sim using run-webkit-tests --ios-simulator --exit-after-n-failures 500 --child-processes 1 --test-list <test list>.
Created attachment 442619 [details] Test list (reproduced image failures)
Test list that doesn't include fast/events/ios/rotation/ tests didn't reproduce the image failures. Also, the image failures only occur on iPhone 12. When I tried on iPhone SE (2nd gen), I was not able to reproduce the image failures.
Created attachment 442620 [details] Test list (Didn't reproduce the image failure)
The same image failure is seen on macOS (Bug 132766).
This failure is continuing to happen, expectations may need to be set.
(In reply to Matteo Flores from comment #9) > This failure is continuing to happen, expectations may need to be set. Set expectations r291230
I can repro it with run-webkit-test --ios-simulator fast/events/ios/rotation/safe-area-insets-during-safari-type-rotation.html fast/hidpi/image-srcset-simple-1x.html All it needs is just a rotation test.
Apparently we see deviceScaleFactor == 3 in the test (fast/hidpi/image-srcset-simple-1x.html) when the rotation test runs first.
screenScaleFactor(UIScreen *screen) comes back with 3. Test passes fine when this value is hardcoded to 2.
[[UIScreen mainScreen] _setScale:2.0]; is called in TestController::platformInitialize but not in-between tests. diff --git a/Tools/WebKitTestRunner/ios/TestControllerIOS.mm b/Tools/WebKitTestRunner/ios/TestControllerIOS.mm index 13c0e9ba6752..142a2c119530 100644 --- a/Tools/WebKitTestRunner/ios/TestControllerIOS.mm +++ b/Tools/WebKitTestRunner/ios/TestControllerIOS.mm @@ -158,6 +158,7 @@ bool TestController::platformResetStateToConsistentValues(const TestOptions& opt [pasteboardConsistencyEnforcer() clearPasteboard]; [[UIApplication sharedApplication] _cancelAllTouches]; [[UIDevice currentDevice] setOrientation:UIDeviceOrientationPortrait animated:NO]; + [[UIScreen mainScreen] _setScale:2.0]; ^^ fixes the test failure.
Created attachment 457278 [details] Patch
Committed r292749 (249533@main): <https://commits.webkit.org/249533@main> All reviewed patches have been landed. Closing bug and clearing flags on attachment 457278 [details].
*** Bug 232465 has been marked as a duplicate of this bug. ***