Bug 257235 – [ iPhone XS+ ] 3X TestWebKitAPI.WKWebView (API-Tests) are constant failures

• Component: WebKit API
• Status: RESOLVED DUPLICATE

[Robert Jenner]

TestWebKitAPI.WKWebView.SnapshotAfterScreenUpdates
TestWebKitAPI.WKWebView.SnapshotImageBaseCase
TestWebKitAPI.WKWebView.SnapshotWithoutAfterScreenUpdates

are constant failures on iOS 16 Debug when run on iPhone XS simulator and higher. 

HISTORY:
https://results.webkit.org/?suite=api-tests&suite=api-tests&suite=api-tests&test=TestWebKitAPI.WKWebView.SnapshotAfterScreenUpdates&test=TestWebKitAPI.WKWebView.SnapshotImageBaseCase&test=TestWebKitAPI.WKWebView.SnapshotWithoutAfterScreenUpdates

According to the history, these are all passing. However, the simulator we are currently using is iPhone SE (3rd gen). These tests fail on iPhone XS and higher, and we want to change our current simulator for API tests from iPhone SE to iPhone 12. So these tests may need to be adjusted. 

STDIO FAILURE TEXT:
    TestWebKitAPI.WKWebView.SnapshotAfterScreenUpdates
        LEAK: 1 WebProcessPool

        /Volumes/Data/worker/trunk-sydneye-ios-simulator-debug-archive/build/OpenSource/Tools/TestWebKitAPI/Tests/WebKitCocoa/WKWebViewSnapshot.mm:507
        Expected equality of these values:
          0
          rgba[pixelIndex]
            Which is: '\xFF' (255)


        /Volumes/Data/worker/trunk-sydneye-ios-simulator-debug-archive/build/OpenSource/Tools/TestWebKitAPI/Tests/WebKitCocoa/WKWebViewSnapshot.mm:508
        Expected equality of these values:
          0
          rgba[pixelIndex + 1]
            Which is: '\xFF' (255)


    TestWebKitAPI.WKWebView.SnapshotImageBaseCase
        LEAK: 1 WebProcessPool

        /Volumes/Data/worker/trunk-sydneye-ios-simulator-debug-archive/build/OpenSource/Tools/TestWebKitAPI/Tests/WebKitCocoa/WKWebViewSnapshot.mm:292
        Expected equality of these values:
          0
          rgba[pixelIndex]
            Which is: '\xFF' (255)


        /Volumes/Data/worker/trunk-sydneye-ios-simulator-debug-archive/build/OpenSource/Tools/TestWebKitAPI/Tests/WebKitCocoa/WKWebViewSnapshot.mm:294
        Expected equality of these values:
          255
          rgba[pixelIndex + 2]
            Which is: '\0'


    TestWebKitAPI.WKWebView.SnapshotWithoutAfterScreenUpdates
        LEAK: 1 WebProcessPool

        /Volumes/Data/worker/trunk-sydneye-ios-simulator-debug-archive/build/OpenSource/Tools/TestWebKitAPI/Tests/WebKitCocoa/WKWebViewSnapshot.mm:570
        Expected equality of these values:
          0
          rgba[pixelIndex]
            Which is: '\xFF' (255)


        /Volumes/Data/worker/trunk-sydneye-ios-simulator-debug-archive/build/OpenSource/Tools/TestWebKitAPI/Tests/WebKitCocoa/WKWebViewSnapshot.mm:571
        Expected equality of these values:
          0
          rgba[pixelIndex + 1]
            Which is: '\xFF' (255)

[Radar WebKit Bug Importer]

<rdar://problem/109743641>

[Robert Jenner]

These are very easy to reproduce at iOS 16 Debug ToT running the tests as follows:


run-api-tests --iOS-simulator <test_goes_here>

You will specifically need to boot an iPhone XS or higher simulator to reproduce the failure. After you have chosen your booted simulator it will choose to run on that simulated device, and not the one that we have set for our testing.

[Robert Jenner]

*** Bug 257228 has been marked as a duplicate of this bug. ***

[Robert Jenner]

*** Bug 257239 has been marked as a duplicate of this bug. ***

[Robert Jenner]

*** This bug has been marked as a duplicate of bug 257246 ***