Bug 209229 - [GTK][WPE] Flatpak error when running run-webkit-tests
Summary: [GTK][WPE] Flatpak error when running run-webkit-tests
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Philippe Normand
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2020-03-18 07:48 PDT by Sergio Villar Senin
Modified: 2020-04-10 04:03 PDT (History)
3 users (show)

See Also:


Attachments
Patch (3.50 KB, patch)
2020-04-08 05:09 PDT, Philippe Normand
zan: review+
Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Sergio Villar Senin 2020-03-18 07:48:23 PDT
I get the following error when trying to run the tests in a directory where all the tests are skipped:

Command '['flatpak', 'build', '--die-with-parent', '--talk-name=org.a11y.Bus', '--talk-name=org.gtk.vfs', '--talk-name=org.gtk.vfs.*', '--bind-mount=/run/shm=/dev/shm', '--bind-mount=/run/host//tmp=/tmp', '--bind-mount=/app/webkit=/home/sergio/checkout/WPE', '--bind-mount=/app/webkit/WebKitBuild/Release=/home/sergio/checkout/WPE/WebKitBuild/WPE/Release', '--device=all', '--device=dri', '--filesystem=host', '--share=ipc', '--share=network', '--socket=pulseaudio', '--socket=system-bus', '--socket=wayland', '--socket=x11', '--system-talk-name=org.a11y.Bus', '--system-talk-name=org.freedesktop.GeoClue2', '--talk-name=org.a11y.Bus', '--talk-name=org.freedesktop.Flatpak', '--env=LANG=en_US.UTF-8', '--env=TZ=PST8PDT', '--env=GTK_MODULES=gail:atk-bridge', '--env=WAYLAND_DISPLAY=wayland-0', '--env=DISPLAY=:0', '--env=WEBKIT_TOP_LEVEL=/app/', '--env=TEST_RUNNER_INJECTED_BUNDLE_FILENAME=/app/webkit/WebKitBuild/Release/lib/libTestRunnerInjectedBundle.so', '/home/sergio/checkout/WPE/WebKitBuild/UserFlatpak', '/app/webkit/Tools/Scripts/run-webkit-tests', '--wpe', 'LayoutTests/imported/w3c/web-platform-tests/webxr/navigator_xr_sameObject.https.html']' returned non-zero exit status 255
Comment 1 Philippe Normand 2020-03-18 07:59:22 PDT
Actually I can't reproduce this issue:

run-webkit-tests --gtk --verbose imported/w3c/web-platform-tests/webxr/navigator_xr_sameObject.https.html
webkitpy.common.system.logutils: [DEBUG] Debug logging enabled.
flatpakutils: [DEBUG] Using flatpak user dir: /home/phil/WebKit/WebKitBuild/UserFlatpak
webkitpy.port.win: [DEBUG] Not running on native Windows.
webkitpy.common.system.executive: [DEBUG] "perl Tools/Scripts/webkit-build-directory --gtk" took 0.12s
flatpakutils: [DEBUG] Running in sandbox: flatpak build --die-with-parent --talk-name=org.a11y.Bus --talk-name=org.gtk.vfs --talk-name=org.gtk.vfs.* --bind-mount=/run/shm=/dev/shm --bind-mount=/run/host//tmp=/tmp --bind-mount=/app/webkit=/home/phil/WebKit --bind-mount=/app/webkit/WebKitBuild/Release=/home/phil/WebKit/WebKitBuild/GTK/Release --device=all --device=dri --filesystem=host --share=ipc --share=network --socket=pulseaudio --socket=system-bus --socket=wayland --socket=x11 --system-talk-name=org.a11y.Bus --system-talk-name=org.freedesktop.GeoClue2 --talk-name=org.a11y.Bus --talk-name=org.freedesktop.Flatpak --env=LANG=en_US.UTF-8 --env=GST_INSPECT_NO_COLORS=1 --env=TZ=PST8PDT --env=GTK_MODULES=gail:atk-bridge --env=WAYLAND_DISPLAY=wayland-0 --env=DISPLAY=:0 --env=WEBKIT_TOP_LEVEL=/app/ --env=NUMBER_OF_PROCESSORS=12 --env=TEST_RUNNER_INJECTED_BUNDLE_FILENAME=/app/webkit/WebKitBuild/Release/lib/libTestRunnerInjectedBundle.so /home/phil/WebKit/WebKitBuild/UserFlatpak /app/webkit/Tools/Scripts/run-webkit-tests --gtk --verbose imported/w3c/web-platform-tests/webxr/navigator_xr_sameObject.https.html

Using port 'gtk-wk2'
Test configuration: <, x86, release>
Placing test results in /app/webkit/WebKitBuild/Release/layout-test-results
Using Release build
Pixel tests disabled
Regular timeout: 15000, slow test timeout: 75000
Command line: /app/webkit/WebKitBuild/Release/bin/WebKitTestRunner -

Found 1 test; running 1, skipping 0.
                                     
Verbose baseline search path: platform/gtk -> platform/wk2 -> generic

Baseline search path: platform/gtk -> platform/wk2 -> generic

Running 1 test

Running 1 WebKitTestRunner.     

Writing new expected result "imported/w3c/web-platform-tests/webxr/navigator_xr_sameObject.https-expected.txt"
[1/1] imported/w3c/web-platform-tests/webxr/navigator_xr_sameObject.https.html failed unexpectedly (-expected.txt was missing)
                                     
0 tests ran as expected, 1 didn't:


Regressions: Unexpected missing results (1)
  imported/w3c/web-platform-tests/webxr/navigator_xr_sameObject.https.html [ Missing ]
Comment 2 Philippe Normand 2020-03-18 08:22:58 PDT
(In reply to Sergio Villar Senin from comment #0)
> I get the following error when trying to run the tests in a directory where
> all the tests are skipped:
> 
> Command '['flatpak', 'build', '--die-with-parent',
> '--talk-name=org.a11y.Bus', '--talk-name=org.gtk.vfs',
> '--talk-name=org.gtk.vfs.*', '--bind-mount=/run/shm=/dev/shm',
> '--bind-mount=/run/host//tmp=/tmp',
> '--bind-mount=/app/webkit=/home/sergio/checkout/WPE',
> '--bind-mount=/app/webkit/WebKitBuild/Release=/home/sergio/checkout/WPE/
> WebKitBuild/WPE/Release', '--device=all', '--device=dri',
> '--filesystem=host', '--share=ipc', '--share=network',
> '--socket=pulseaudio', '--socket=system-bus', '--socket=wayland',
> '--socket=x11', '--system-talk-name=org.a11y.Bus',
> '--system-talk-name=org.freedesktop.GeoClue2', '--talk-name=org.a11y.Bus',
> '--talk-name=org.freedesktop.Flatpak', '--env=LANG=en_US.UTF-8',
> '--env=TZ=PST8PDT', '--env=GTK_MODULES=gail:atk-bridge',
> '--env=WAYLAND_DISPLAY=wayland-0', '--env=DISPLAY=:0',
> '--env=WEBKIT_TOP_LEVEL=/app/',
> '--env=TEST_RUNNER_INJECTED_BUNDLE_FILENAME=/app/webkit/WebKitBuild/Release/
> lib/libTestRunnerInjectedBundle.so',
> '/home/sergio/checkout/WPE/WebKitBuild/UserFlatpak',
> '/app/webkit/Tools/Scripts/run-webkit-tests', '--wpe',
> 'LayoutTests/imported/w3c/web-platform-tests/webxr/navigator_xr_sameObject.
> https.html']' returned non-zero exit status 255

Is this all the command output?
Comment 3 Philippe Normand 2020-03-24 05:27:35 PDT
Hello?
Comment 4 Sergio Villar Senin 2020-04-07 11:54:30 PDT
That's because you're specifying a test. Just use imported/w3c/web-platform-tests/webxr for example.
Comment 5 Philippe Normand 2020-04-08 02:16:57 PDT
Ah OK I understand now that what's bothering you is the "Command...returned non-zero exit status 255" message?

I could display this only for verbose runs if that can help.
Comment 6 Philippe Normand 2020-04-08 05:09:12 PDT
Created attachment 395793 [details]
Patch
Comment 7 Philippe Normand 2020-04-10 04:02:20 PDT
Committed r259862: <https://trac.webkit.org/changeset/259862>
Comment 8 Radar WebKit Bug Importer 2020-04-10 04:03:15 PDT
<rdar://problem/61577006>