Bug 207711

Summary: [GTK] Many tests timeouting in Debug mode
Product: WebKit Reporter: Lauro Moura <lmoura>
Component: Tools / TestsAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Normal CC: bugs-noreply, clopez
Priority: P2    
Version: Other   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=208000

Description Lauro Moura 2020-02-13 11:54:23 PST
From: https://build.webkit.org/results/GTK%20Linux%2064-bit%20Debug%20(Tests)/r256499%20(5912)/results.html

* accessibility/roles-exposed.html
* fast/history/page-cache-webdatabase-pending-transaction.html
* fast/selectors/slow-style-sharing-with-long-cousin-list.html
* http/tests/cookies/double-quoted-value-with-semi-colon.html
* http/tests/inspector/network/beacon-type.html
* http/tests/inspector/network/copy-as-curl.html
* http/tests/inspector/network/fetch-network-data.html
* http/tests/inspector/network/har/har-import.html
* http/tests/inspector/network/har/har-page.html
* http/tests/inspector/network/local-resource-override-basic.html
* http/tests/inspector/network/local-resource-override-script-tag.html
* http/tests/inspector/network/resource-initiatorNode.html
* http/tests/inspector/network/resource-mime-type.html
* http/tests/inspector/network/resource-response-source-memory-cache-revalidate-expired-only.html
* http/tests/inspector/network/resource-response-source-memory-cache.html
* http/tests/inspector/network/resource-sizes-disk-cache.html
* http/tests/inspector/network/resource-sizes-memory-cache.html
* http/tests/inspector/network/resource-sizes-network.html
* http/tests/inspector/network/set-resource-caching-disabled-memory-cache.html
* http/tests/inspector/network/x-frame-options.html
* http/tests/inspector/network/xhr-response-body.html
* http/tests/inspector/target/pause-on-inline-debugger-statement.html
* http/tests/inspector/target/provisional-load-cancels-previous-load.html
* http/tests/inspector/target/target-events-for-provisional-page.html
* http/tests/inspector/worker/blob-script-with-cross-domain-imported-scripts.html
* http/tests/multipart/multipart-async-image.html
* http/tests/workers/service/serviceworkerclients-matchAll.https.html
* imported/w3c/web-platform-tests/css/mediaqueries/test_media_queries.html
* imported/w3c/web-platform-tests/encoding/legacy-mb-korean/euc-kr/euckr-decode-cseuckr.html
* imported/w3c/web-platform-tests/encoding/legacy-mb-korean/euc-kr/euckr-decode-iso-ir-149.html
* imported/w3c/web-platform-tests/web-animations/timing-model/animations/sync-start-times.html
* imported/w3c/web-platform-tests/web-animations/timing-model/animations/update-playback-rate-fast.html
* imported/w3c/web-platform-tests/WebCryptoAPI/derive_bits_keys/pbkdf2.https.worker.html
* inspector/controller/runtime-controller-import.html
* inspector/css/add-css-property.html
Comment 1 Lauro Moura 2020-02-14 06:53:22 PST
# More timeouts, from debug build 5916

The revisions mentioned below are the first known revisions from wktesthunter, not from bisecting.
Many tests seems to have a large gap between being introduced and being actually tested, probably due to that timeout+crash>50 circuit breaker.

# Tests good until r238072 but not tested again until in r256571

* inspector/debugger/async-stack-trace-truncate.html
* inspector/debugger/breakpoint-action-eval.html
* inspector/debugger/breakpoint-action-log.html
* inspector/debugger/breakpoint-columns.html
* inspector/debugger/breakpoint-scope.html
* inspector/debugger/command-line-api-exception.html
* inspector/dom/csp-hash.html
* inspector/dom/domutilities-path-dump.html
* inspector/dom/getEventListenersForNode.html
* inspector/model/auditTestCaseResult.html
* inspector/model/auditTestGroup.html
* inspector/model/auditTestGroupResult.html
* inspector/model/color.html
* inspector/model/remote-object/dom.html

# Tests not tested before r256571 (probably skipped due to earlier tests crashes/timeouts)

* inspector/animation/lifecycle-css-animation.html
* inspector/css/modify-inline-style.html
* inspector/model/remote-object/array.html
* inspector/model/remote-object/class.html
* inspector/formatting/source-map-css-1.html
* inspector/dom-debugger/url-breakpoints.html

# Other failures

* http/tests/inspector/dom/didFireEvent.html
	* Since [r238371-r238372]
* http/tests/inspector/network/local-resource-override-main-resource.html
	* Since introduced, first build in r250028
* imported/blink/storage/indexeddb/blob-valid-after-deletion.html
	* Flaky timeouting before, consistent timeout since r238129
* inspector/console/console-count.html
	* More consistent timeout started from [r227192-r227193]
	* Was flaky timeout before
* inspector/console/console-time.html
	* Since r238405
* inspector/console/messageAdded-from-named-evaluations.html
	* Single timeout in r256571
	* Not run in Debug since r238072
* inspector/css/add-rule.html
	* Since r238275
* inspector/css/css-property.html
	* Flaky timeout started r237775
	* Consistent timeout since r238109
* inspector/indexeddb/requestData.html
	* Since r236980
* inspector/indexeddb/requestDatabase.html
	* Since r238395
* inspector/formatting/formatting-javascript.html
	* Since r238432
* inspector/dom-debugger/event-breakpoint-with-navigation.html
	* Since r238371
* inspector/dom-debugger/event-listener-breakpoints.html
	* Since r239819
	* And later r256571
* inspector/css/generateCSSRuleString.html
	* Since introduced, first test in r253920
* inspector/css/modify-css-property-race.html
	* Since introduced, first build in r240970
* inspector/css/modify-css-property.html
	* Since r238371
* inspector/debugger/breakpoints/resolved-dump-each-line.html
	* Since r256504
	* No error until r238072 (last good known build)
Comment 2 Lauro Moura 2020-02-16 19:43:47 PST
# Build 5926

https://build.webkit.org/results/GTK%20Linux%2064-bit%20Debug%20(Tests)/r256707%20(5926)/results.html

# Tests not tested before r256647 (or last debug gardening) (probably skipped due to earlier tests crashes/timeouts)
* inspector/canvas/recording-webgl-full.html
* inspector/console/queryInstances.html
* inspector/css/overridden-property.html
* inspector/css/resolve-variable-value.html
* inspector/formatting/formatting-xml.html
* inspector/formatting/source-map-javascript-1.html
* inspector/model/remote-object/error.html
* inspector/model/remote-object/function.html
* inspector/model/remote-object/iterator-large.html
* inspector/model/remote-object/iterator.html
* inspector/page/setBootstrapScript-main-frame.html
* inspector/timeline/timeline-event-CancelAnimationFrame.html
* inspector/timeline/timeline-event-EventDispatch.html
* inspector/timeline/timeline-event-FireAnimationFrame.html
* inspector/tree-outline/tree-outline-selection.html

# Tests good until r238072 but not tested again until r256647
* inspector/debugger/evaluateOnCallFrame-CommandLineAPI.html
* inspector/dom/pseudo-element-static.html
* inspector/layers/layerTreeDidChange.html
* inspector/model/frame-extra-scripts.html
* inspector/model/gradient.html
* inspector/model/parse-script-syntax-tree.html
* inspector/model/recording.html
* inspector/model/remote-object-get-properties.html
* inspector/model/remote-object/iterators-mutated.html
* inspector/page/searchInResources.html
# The CommandLineAPI test also had a single timeout in r239693
* inspector/runtime/evaluate-CommandLineAPI.html
* inspector/timeline/recording-start-stop-timestamps.html

# Other timeouts in build 5926 but with more detailed info
* http/tests/inspector/network/loadResource-insecure-resource.html
 	* Good until r238072, timeout since r245746
* http/tests/inspector/network/resource-timing.html
 	* Flaky pass/timeout (but not fails) since r241830
* inspector/canvas/context-attributes.html
	* Consistent timeout in debug since r238391
* inspector/console/webcore-logging.html
	* Always timeouted. Tracked failure in bug179174
* inspector/storage/domStorage-events.html
	* Good until r238459
* inspector/table/table-remove-rows.html
	* Good until r238065
* inspector/table/table-selection.html
	* Good until r238669
Comment 3 Carlos Alberto Lopez Perez 2020-02-20 05:11:16 PST
BTW, I have moved the Web inspector slow/timing out test issue in debug to bug 208000