Bug 212776 - REGRESSION: [ Mac wk2 ] inspector/heap/getRemoteObject.html is flaky failing.
Summary: REGRESSION: [ Mac wk2 ] inspector/heap/getRemoteObject.html is flaky failing.
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: Web Inspector (show other bugs)
Version: WebKit Nightly Build
Hardware: Mac macOS 10.15
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2020-06-04 13:25 PDT by Jason Lawrence
Modified: 2020-06-05 09:29 PDT (History)
3 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Jason Lawrence 2020-06-04 13:25:21 PDT
inspector/heap/getRemoteObject.html

Description:
This test is flaky failing on Mac wk2. The flaky failures first appeared in the visible history on 05/08/2020, it began failing more frequently on 05/18/2020.

History:
https://results.webkit.org/?suite=layout-tests&test=inspector%2Fheap%2FgetRemoteObject.html&limit=50000

Diff:
--- /Volumes/Data/slave/catalina-debug-tests-wk2/build/layout-test-results/inspector/heap/getRemoteObject-expected.txt
+++ /Volumes/Data/slave/catalina-debug-tests-wk2/build/layout-test-results/inspector/heap/getRemoteObject-actual.txt
@@ -18,6 +18,8 @@
 -- Running test case: GetRemoteObjectCollectedObject
 PASS: Should not have an error creating a snapshot.
 PASS: Should should include at least one 'Map' instance.
-PASS: Should get an error when object has been collected.
-PASS: No object for identifier, it may have been collected
+FAIL: Should get an error when object has been collected.
+    Expected: truthy
+    Actual: null
+PASS: null
Comment 1 Radar WebKit Bug Importer 2020-06-04 13:25:51 PDT
<rdar://problem/63992744>
Comment 2 Jason Lawrence 2020-06-04 14:05:25 PDT
I can reproduce this issue with r262540 and r261845, but I cannot reproduce it with r261844.

Command:
run-webkit-tests --iterations 199 --exit-after-n-failures 30 --force -f inspector/heap/getRemoteObject.html

r261845:
[18/99] inspector/heap/getRemoteObject.html failed unexpectedly (text diff)
[54/99] inspector/heap/getRemoteObject.html failed unexpectedly (text diff)
[65/99] inspector/heap/getRemoteObject.html failed unexpectedly (text diff)
Exiting early after 3 failures. 62 tests run.

r261844:
[113/199] inspector/heap/getRemoteObject.html failed unexpectedly (com.apple.WebKit.WebContent.Development crashed [pid=55776])
[199/199] inspector/heap/getRemoteObject.html failed unexpectedly (com.apple.WebKit.WebContent.Development crashed [pid=55778])
197 tests ran as expected, 2 didn't:
Comment 3 Jason Lawrence 2020-06-05 07:28:53 PDT
I have marked this test as flaky failing while this issue is investigated.
https://trac.webkit.org/changeset/262617/webkit