Bug 256557 – [GTK][WPE] API tests failing on 9th May 2023

• Component: Tools / Tests
• Status: NEW

[Carlos Alberto Lopez Perez]

The following API tests are failing in GTK:


Unexpected failures (4)
    /WebKitGTK/TestWebKitUserContentManager
        /webkit/WebKitUserContentManager/script-message-received
    /WebKitGTK/TestContextMenu
        /webkit/WebKitWebView/default-menu
    /WebKitGTK/TestWebKitSettings
        /webkit/WebKitSettings/webkit-settings
        /webkit/WebKitSettings/new-with-settings

Unexpected timeouts (2)
    /WebKitGTK/TestWebKitAccessibility
        /webkit/WebKitAccessibility/text/selections
        /webkit/WebKitAccessibility/text/state-changed

Unexpected passes (5)
    /WebKitGTK/TestContextMenu
        /webkit/WebKitWebPage/context-menu
        /webkit/WebKitWebPage/context-menu-node
    /WebKitGTK/TestWebKitWebView
        /webkit/WebKitWebView/terminate-unresponsive-web-process
    /WebKitGTK/TestUIClient
        /webkit/WebKitWebView/mouse-target
        /webkit/WebKitWebView/pointer-lock-permission-request



Checked in 263861@main
Is unknown to me at this moment when this failures were introduced.

[Carlos Alberto Lopez Perez]

And on the same commit, the following are failing on WPE:

Unexpected failures (7)
    /WPE/TestWebKitUserContentManager
        /webkit/WebKitUserContentManager/script-message-received
    /WPE/TestWebsiteData
        /webkit/WebKitWebsiteData/configuration
        /webkit/WebKitWebsiteData/ephemeral
        /webkit/WebKitWebsiteData/hsts
        /webkit/WebKitWebsiteData/handle-corrupted-local-storage
    /WPE/TestWebKitSettings
        /webkit/WebKitSettings/webkit-settings
        /webkit/WebKitSettings/new-with-settings

Unexpected crashes (5)
    /WPEQt/TestLoadHtml
        TestLoadHtml
    /WPEQt/TestLoadRequest
        TestLoadRequest
    /WPEQt/TestLoad
        TestLoad
    /WPEQt/TestRunJavaScript
        TestRunJavaScript
    /TestWebKit
        WebKit.OnDeviceChangeCrash

Unexpected timeouts (3)
    /WPE/TestUIClient
        /webkit/WebKitWebView/geolocation-permission-requests
    /TestWebKit
        WebKit.PrivateBrowsingPushStateNoHistoryCallback
    /TestWTF
        WTF_WordLock.ManyContendedLongSections



Common new failures are this one:

Unexpected failures (3)
    /WPE/TestWebKitUserContentManager
        /webkit/WebKitUserContentManager/script-message-received
    /WPE/TestWebKitSettings
        /webkit/WebKitSettings/webkit-settings
        /webkit/WebKitSettings/new-with-settings

[Carlos Alberto Lopez Perez]

(In reply to Carlos Alberto Lopez Perez from comment #1)
> And on the same commit, the following are failing on WPE:
> 
> Unexpected crashes (5)
>     /WPEQt/TestLoadHtml
>         TestLoadHtml
>     /WPEQt/TestLoadRequest
>         TestLoadRequest
>     /WPEQt/TestLoad
>         TestLoad
>     /WPEQt/TestRunJavaScript
>         TestRunJavaScript
>     /TestWebKit
>         WebKit.OnDeviceChangeCrash
> 


This crashes don't happen on the post-commit bot (runs with a real GPU) but do they happen on my remote dev machine (no GPU).

I can see the following on the logs:

b'Failed to create wl_display (No such file or directory)\nqt.qpa.plugin: Could not load the Qt platform plugin "wayland" in "" even though it was found.\nqt.qpa.plugin: Could not find the Qt platform plugin "xcb" in ""\nThis application failed to start because no Qt platform plugin could be initialized. Reinstalling the application may fix this problem.\n\nAvailable platform plugins are: eglfs, minimal, minimalegl, offscreen, vnc, wayland-egl, wayland.\n\n'
EGLDisplay Initialization failed: EGL_NOT_INITIALIZED
(repeated)

So it is likely that the headless backend of WPE is not good enough to run this WPEQt tests

[Carlos Alberto Lopez Perez]

Expectations updated at 263883@main 

Note: I didn't marked the Qt API tests as expected crashes because those are passing on the post-commit bots (which have a GPU) and we don't have still EWS bots for WPE API tests

[Vitaly Dyackhov]

See also: https://bugs.webkit.org/show_bug.cgi?id=258353

[Amanda Falke]

Fixed (and identified when introduced):

/WPE/TestWebsiteData
        /webkit/WebKitWebsiteData/configuration

In:
https://bugs.webkit.org/show_bug.cgi?id=259427

[Amanda Falke]

Fixed (and identified when introduced):

/WPE/TestWebsiteData
        /webkit/WebKitWebsiteData/ephemeral
In:
https://bugs.webkit.org/show_bug.cgi?id=259543

/WPE/TestWebsiteData
        /webkit/WebKitWebsiteData/hsts
In:
https://bugs.webkit.org/show_bug.cgi?id=259515

[Amanda Falke]

Fixed (and identified when introduced):

/WPE/TestWebsiteData
        /webkit/WebKitWebsiteData/handle-corrupted-local-storage

https://github.com/WebKit/WebKit/pull/16286

[Amanda Falke]

For /TestWTF
        WTF_WordLock.ManyContendedLongSections EWS failures,

See:

https://bugs.webkit.org/show_bug.cgi?id=246603 from late 2022