Bug 309891 – [WPE][ARM64] dashboard-tests fail

• Component: WPE WebKit
• Status: NEW

[Carlos Alberto Lopez Perez]

Since we deployed the ARM64 bot the dashboard-tests have been failing.

This tests are basically layout tests but with one single test that runs separately.

To run those basically you have to pass the flag "--layout-tests-directory Tools/CISupport/build-webkit-org/public_html/dashboard/Scripts/tests " to run-webkit-tests so then it would use that directory instead of the LayoutTests directory.

And inside that directory there is a single test, named index.html that runs some unit tests related to the WebKit Bot Watcher's Dashboard -> https://build.webkit.org/dashboard/

And I have no idea why, but this test is failing on WPE ARM64 (on WPE x86_64 passes).

It always fails and most of the times (4 of 5) it gives this failure:

--- /sdk/webkit/layout-test-results/dashboard-layout-test-results/index-expected.txt
+++ /sdk/webkit/layout-test-results/dashboard-layout-test-results/index-actual.txt
@@ -1,3 +1,4 @@
+CONSOLE MESSAGE: TypeError: undefined is not an object (evaluating 'popover._content.childNodes[i+numChildrenInEmptyPopoverContent].childNodes')
 WebKit Bot Watcher's Dashboard QUnit Test Runner noglobalsnotrycatch
 Hide passed tests
 BuildBotQueueView: _appendPendingRevisionCount (0, 1, 1)Rerun
@@ -10,7 +11,37 @@
 BuildBotQueueView: _popoverContentForJavaScriptCoreTestRegressions load failure UI test (0, 3, 3)Rerun
 BuildBotQueueView: _presentPopoverForJavaScriptCoreTestRegressions including loading (0, 0, 0)Rerun
 BuildBotQueueView: _createLoadingIndicator (0, 3, 3)Rerun
-BuildBotQueueView: _presentPopoverForJavaScriptCoreTestRegressions already loaded (0, 4, 4)Rerun
+BuildBotQueueView: _presentPopoverForJavaScriptCoreTestRegressions already loaded (2, 4, 6)Rerun
+Number of failures in popover must be equal to number of failed tests
+Expected:	
+3
+Names of failures must match
+Expected:	
+"uno"
+Names of failures must match
+Expected:	
+"dos"
+Names of failures must match
+Expected:	
+"tres"
+Number of failures in popover must be equal to number of failed tests
+Expected:	
+3
+Result:	
+1
+Diff:	
+3 1
+Source:	
+@file:///sdk/webkit/Tools/CISupport/build-webkit-org/public_html/dashboard/Scripts/Utilities.js:77:24
+Names of failures must match
+Expected:	
+"lorem ipsum dolor sit amet"
+Result:	
+"Loading…"
+Diff:	
+"lorem ipsum dolor sit amet" "Loading…"
+Source:	
+@file:///sdk/webkit/Tools/CISupport/build-webkit-org/public_html/dashboard/Scripts/Utilities.js:77:24
 BuildBotQueue: compareIterations by revisions (0, 3, 3)Rerun
 BuildBotQueue: compareIterations by loaded (one revision missing) (0, 2, 2)Rerun
 BuildBotQueue: compareIterations by loaded (same revision) (0, 2, 2)Rerun
@@ -18,7 +49,9 @@
 BuildBotQueue: compareIterations by id (same revision) (0, 3, 3)Rerun
 33022@main
 idbuild #1javascriptcore test failures
-Loading…
+lorem ipsum dolor sit amet
+consectetur adipiscing elit
+sed do eiusmod tempor incididunt ut labore et dolore magna aliqua
 idbuild #1javascriptcore test failures
 uno
 dos


And the other 1 of 5 it gives this other failure:

--- /sdk/webkit/layout-test-results/dashboard-layout-test-results/index-expected.txt
+++ /sdk/webkit/layout-test-results/dashboard-layout-test-results/index-actual.txt
@@ -10,7 +10,7 @@
 BuildBotQueueView: _popoverContentForJavaScriptCoreTestRegressions load failure UI test (0, 3, 3)Rerun
 BuildBotQueueView: _presentPopoverForJavaScriptCoreTestRegressions including loading (0, 0, 0)Rerun
 BuildBotQueueView: _createLoadingIndicator (0, 3, 3)Rerun
-BuildBotQueueView: _presentPopoverForJavaScriptCoreTestRegressions already loaded (0, 4, 4)Rerun
+BuildBotQueueView: _presentPopoverForJavaScriptCoreTestRegressions already loaded (0, 8, 8)Rerun
 BuildBotQueue: compareIterations by revisions (0, 3, 3)Rerun
 BuildBotQueue: compareIterations by loaded (one revision missing) (0, 2, 2)Rerun
 BuildBotQueue: compareIterations by loaded (same revision) (0, 2, 2)Rerun
@@ -18,7 +18,9 @@
 BuildBotQueue: compareIterations by id (same revision) (0, 3, 3)Rerun
 33022@main
 idbuild #1javascriptcore test failures
-Loading…
+lorem ipsum dolor sit amet
+consectetur adipiscing elit
+sed do eiusmod tempor incididunt ut labore et dolore magna aliqua
 idbuild #1javascriptcore test failures
 uno
 dos

[Carlos Alberto Lopez Perez]

Pull request: https://github.com/WebKit/WebKit/pull/60553

[EWS]

Test gardening commit 309197@main (43f04ffb9307): <https://commits.webkit.org/309197@main>

Reviewed commits have been landed. Closing PR #60553 and removing active labels.