Bug 313036 – [WPE] imported/w3c/web-platform-tests/editing/other/copy-elements-with-css-vars.tentative.html is a flaky test

• Status: NEW
• Component: WPE WebKit

[Nikolas Zimmermann]

wktesthunter output for this flaky test across affected bots:

>>> wpe-release <<<
[311774@main-311775@main]     UNKNOWN
311776@main                   NOERROR
[311777@main-311782@main]     UNKNOWN
311783@main                   TEXT PASS (Expected: PASS)
[311784@main-311791@main]     UNKNOWN
311792@main                   NOERROR
311793@main                   UNKNOWN
311794@main                   NOERROR


The bot wpe-release completed 1389 runs on the interval [307795@main-311794@main]
Frequency of results for test: imported/w3c/web-platform-tests/editing/other/copy-elements-with-css-vars.tentative.html
  818 times [58.9%]      ->  NOERROR
  6 times [0.4%]         ->  TEXT CRASH
  359 times [25.8%]      ->  CRASH
  58 times [4.2%]        ->  PASS
  120 times [8.6%]       ->  TEXT
  4 times [0.3%]         ->  TIMEOUT CRASH
  24 times [1.7%]        ->  TEXT PASS

Of those 1389 runs it didn't match the expectation 47 times [3.4%]
Details of the type and frequency of unmatched expectations:
  6 times [0.4%]         ->  TEXT CRASH (Expected: PASS)
  13 times [0.9%]        ->  CRASH (Expected: PASS)
  4 times [0.3%]         ->  TIMEOUT CRASH (Expected: PASS FAIL CRASH)
  24 times [1.7%]        ->  TEXT PASS (Expected: PASS)

Flakiness factor: 23.0%
    - This test was flaky on 23.0% of the 1389 runs analyzed, either giving different
      results within a single run, or a different result than in the previous run.

>>> wpe-arm64-release <<<
311773@main                   TEXT PASS (Expected: PASS)
[311774@main-311775@main]     UNKNOWN
311776@main                   NOERROR
[311777@main-311781@main]     UNKNOWN
311782@main                   TEXT PASS (Expected: PASS)
311783@main                   NOERROR
[311784@main-311788@main]     UNKNOWN
311789@main                   TEXT PASS (Expected: PASS)
[311790@main-311793@main]     UNKNOWN
311794@main                   NOERROR


The bot wpe-arm64-release completed 1253 runs on the interval [308164@main-311794@main]
Frequency of results for test: imported/w3c/web-platform-tests/editing/other/copy-elements-with-css-vars.tentative.html
  660 times [52.7%]      ->  NOERROR
  4 times [0.3%]         ->  TEXT CRASH
  363 times [29.0%]      ->  CRASH
  142 times [11.3%]      ->  TEXT
  57 times [4.5%]        ->  PASS
  27 times [2.2%]        ->  TEXT PASS

Of those 1253 runs it didn't match the expectation 43 times [3.4%]
Details of the type and frequency of unmatched expectations:
  4 times [0.3%]         ->  TEXT CRASH (Expected: PASS)
  12 times [1.0%]        ->  CRASH (Expected: PASS)
  27 times [2.2%]        ->  TEXT PASS (Expected: PASS)

Flakiness factor: 28.0%
    - This test was flaky on 28.0% of the 1253 runs analyzed, either giving different
      results within a single run, or a different result than in the previous run.

[Fujii Hironori]

History: https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fediting%2Fother%2Fcopy-elements-with-css-vars.tentative.html&platform=WPE

[Fujii Hironori]

311564@main fixed the crash issue.

[Fujii Hironori]

https://build.webkit.org/results/WPE-Linux-64-bit-Release-Tests/311904@main%20(26840)/imported/w3c/web-platform-tests/editing/other/copy-elements-with-css-vars.tentative-diff.txt

--- /sdk/webkit/layout-test-results/imported/w3c/web-platform-tests/editing/other/copy-elements-with-css-vars.tentative-expected.txt
+++ /sdk/webkit/layout-test-results/imported/w3c/web-platform-tests/editing/other/copy-elements-with-css-vars.tentative-actual.txt
@@ -1,5 +1,6 @@
 Span text
 Row 1, Cell 1	Row 1, Cell 2
+d
 
 PASS Test serialized html on copy has resolved css values
 FAIL Test for resolving css variables on copy null is not an object (evaluating 'span.style')