Bug 218193 - [ iOS Debug ] Dashboard test failure: index.html is a failure
Summary: [ iOS Debug ] Dashboard test failure: index.html is a failure
Status: RESOLVED CONFIGURATION CHANGED
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2020-10-26 10:05 PDT by Hector Lopez
Modified: 2022-02-11 14:27 PST (History)
5 users (show)

See Also:


Attachments
build#412 stdio dashboard layout tests (17.36 KB, text/html)
2020-10-26 10:26 PDT, Hector Lopez
no flags Details

Note You need to log in before you can comment on or make changes to this bug.
Description Hector Lopez 2020-10-26 10:05:41 PDT
index.html

Dashboard test failure on iPadOS 13 Simulator Debug WK2(Tests) with test index.html flaky failing as seen here: 

https://build.webkit.org/builders/Apple-iOS-14-Simulator-Debug-WK2-Tests?numbuilds=200

Both bots are seeing the flaky failure
bot653:
https://build.webkit.org/buildslaves/bot653 

bot654:
https://build.webkit.org/buildslaves/bot654

Example latest build #412 with failure:
https://build.webkit.org/builders/Apple-iOS-14-Simulator-Debug-WK2-Tests/builds/412

Stdio of failure:
https://build.webkit.org/builders/Apple-iOS-14-Simulator-Debug-WK2-Tests/builds/412/steps/dashboard-tests/logs/stdio

or see attachment

View dashboard test results:
https://build.webkit.org/results/Apple-iOS-14-Simulator-Debug-WK2-Tests/r268970%20(412)/dashboard-layout-test-results/results.html

History of index.html given by dashboard results:
https://results.webkit.org/?suite=layout-tests&test=index.html&platform=ios&style=debug&model=iPad%20(5th%20generation)&limit=50000

Diff for failed test index.html:
--- /Volumes/Data/slave/ios-simulator-14-debug-tests-wk2/build/layout-test-results/dashboard-layout-test-results/index-expected.txt
+++ /Volumes/Data/slave/ios-simulator-14-debug-tests-wk2/build/layout-test-results/dashboard-layout-test-results/index-actual.txt
@@ -1,3 +1,4 @@
+CONSOLE MESSAGE: TypeError: undefined is not an object (evaluating 'popover._content.childNodes[i+numChildrenInEmptyPopoverContent].childNodes')
 WebKit Bot Watcher's Dashboard QUnit Test Runner noglobalsnotrycatch
 Hide passed tests
 Trac: _loaded (0, 8, 8)Rerun
@@ -25,7 +26,37 @@
 BuildBotQueueView: _popoverContentForJavaScriptCoreTestRegressions load failure UI test (0, 3, 3)Rerun
 BuildBotQueueView: _presentPopoverForJavaScriptCoreTestRegressions including loading (0, 0, 0)Rerun
 BuildBotQueueView: _createLoadingIndicator (0, 3, 3)Rerun
-BuildBotQueueView: _presentPopoverForJavaScriptCoreTestRegressions already loaded (0, 4, 4)Rerun
+BuildBotQueueView: _presentPopoverForJavaScriptCoreTestRegressions already loaded (2, 4, 6)Rerun
+Number of failures in popover must be equal to number of failed tests
+Expected:	
+3
+Names of failures must match
+Expected:	
+"uno"
+Names of failures must match
+Expected:	
+"dos"
+Names of failures must match
+Expected:	
+"tres"
+Number of failures in popover must be equal to number of failed tests
+Expected:	
+3
+Result:	
+1
+Diff:	
+3 1
+Source:	
+file:///Volumes/Data/slave/ios-simulator-14-debug-tests-wk2/build/Tools/BuildSlaveSupport/build.webkit.org-config/public_html/dashboard/Scripts/Utilities.js:77:24
+Names of failures must match
+Expected:	
+"lorem ipsum dolor sit amet"
+Result:	
+"Loading…"
+Diff:	
+"lorem ipsum dolor sit amet" "Loading…"
+Source:	
+file:///Volumes/Data/slave/ios-simulator-14-debug-tests-wk2/build/Tools/BuildSlaveSupport/build.webkit.org-config/public_html/dashboard/Scripts/Utilities.js:77:24
 BuildBotQueue: compareIterations by revisions (0, 3, 3)Rerun
 BuildBotQueue: compareIterations by loaded (one revision missing) (0, 2, 2)Rerun
 BuildBotQueue: compareIterations by loaded (same revision) (0, 2, 2)Rerun
@@ -41,7 +72,9 @@
 r33022bob@webkit.orgcommit message
 r33020george@webkit.orgcommit message
 idbuild #1javascriptcore test failures
-Loading…
+lorem ipsum dolor sit amet
+consectetur adipiscing elit
+sed do eiusmod tempor incididunt ut labore et dolore magna aliqua
 idbuild #1javascriptcore test failures
 uno
 dos
Comment 1 Radar WebKit Bug Importer 2020-10-26 10:06:10 PDT
<rdar://problem/70683345>
Comment 2 Hector Lopez 2020-10-26 10:14:22 PDT
Correction: Dashboard test failure is iOS 14 Debug wk 2 test index.html
Comment 4 Hector Lopez 2020-10-26 10:26:55 PDT
Created attachment 412332 [details]
build#412 stdio dashboard layout tests