Bug 313038
| Summary: | [GTK][WPE] imported/w3c/web-platform-tests/cookies/attributes/expires.html is a flaky test | ||
|---|---|---|---|
| Product: | WebKit | Reporter: | Nikolas Zimmermann <zimmermann> |
| Component: | WPE WebKit | Assignee: | Nobody <webkit-unassigned> |
| Status: | RESOLVED WONTFIX | ||
| Severity: | Normal | CC: | bugs-noreply |
| Priority: | P2 | ||
| Version: | WebKit Nightly Build | ||
| Hardware: | Unspecified | ||
| OS: | Unspecified | ||
Nikolas Zimmermann
wktesthunter output for this flaky test across affected bots:
>>> gtk-release <<<
[311754@main-311758@main] UNKNOWN
311759@main TEXT PASS (Expected: PASS)
311760@main UNKNOWN
311761@main NOERROR
311762@main UNKNOWN
311763@main TEXT PASS (Expected: PASS)
[311764@main-311766@main] UNKNOWN
311767@main NOERROR
[311768@main-311769@main] UNKNOWN
311770@main NOERROR
[311771@main-311773@main] UNKNOWN
311774@main NOERROR
[311775@main-311782@main] UNKNOWN
311783@main NOERROR
[311784@main-311791@main] UNKNOWN
311792@main NOERROR
The bot gtk-release completed 1255 runs on the interval [307792@main-311792@main]
Frequency of results for test: imported/w3c/web-platform-tests/cookies/attributes/expires.html
1239 times [98.7%] -> NOERROR
16 times [1.3%] -> TEXT PASS
Of those 1255 runs it didn't match the expectation 16 times [1.3%]
Details of the type and frequency of unmatched expectations:
16 times [1.3%] -> TEXT PASS (Expected: PASS)
Flakiness factor: 2.5%
- This test was flaky on 2.5% of the 1255 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
>>> wpe-release <<<
311764@main UNKNOWN
311765@main NOERROR
311766@main UNKNOWN
311767@main NOERROR
[311768@main-311769@main] UNKNOWN
311770@main NOERROR
[311771@main-311772@main] UNKNOWN
311773@main NOERROR
[311774@main-311775@main] UNKNOWN
311776@main NOERROR
[311777@main-311782@main] UNKNOWN
311783@main NOERROR
[311784@main-311791@main] UNKNOWN
311792@main NOERROR
311793@main UNKNOWN
311794@main NOERROR
The bot wpe-release completed 1389 runs on the interval [307795@main-311794@main]
Frequency of results for test: imported/w3c/web-platform-tests/cookies/attributes/expires.html
1378 times [99.2%] -> NOERROR
11 times [0.8%] -> TEXT PASS
Of those 1389 runs it didn't match the expectation 11 times [0.8%]
Details of the type and frequency of unmatched expectations:
11 times [0.8%] -> TEXT PASS (Expected: PASS)
Flakiness factor: 1.6%
- This test was flaky on 1.6% of the 1389 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
>>> wpe-arm64-release <<<
[311759@main-311764@main] UNKNOWN
311765@main NOERROR
[311766@main-311767@main] UNKNOWN
311768@main NOERROR
311769@main UNKNOWN
311770@main NOERROR
[311771@main-311772@main] UNKNOWN
311773@main NOERROR
[311774@main-311775@main] UNKNOWN
311776@main NOERROR
[311777@main-311781@main] UNKNOWN
[311782@main-311783@main] NOERROR
[311784@main-311788@main] UNKNOWN
311789@main NOERROR
[311790@main-311793@main] UNKNOWN
311794@main NOERROR
The bot wpe-arm64-release completed 1253 runs on the interval [308164@main-311794@main]
Frequency of results for test: imported/w3c/web-platform-tests/cookies/attributes/expires.html
1224 times [97.7%] -> NOERROR
29 times [2.3%] -> TEXT PASS
Of those 1253 runs it didn't match the expectation 29 times [2.3%]
Details of the type and frequency of unmatched expectations:
29 times [2.3%] -> TEXT PASS (Expected: PASS)
Flakiness factor: 4.6%
- This test was flaky on 4.6% of the 1253 runs analyzed, either giving different
results within a single run, or a different result than in the previous run.
| Attachments | ||
|---|---|---|
| Add attachment proposed patch, testcase, etc. |
Nikolas Zimmermann
Closing: flakiness factor was below the 5% threshold; the TestExpectations entry has been removed in webkit.org/b/313122 (PR https://github.com/WebKit/WebKit/pull/63415).