Bug 261024 - [GTK][WPE] Mark flaky tests on Aug2023
Summary: [GTK][WPE] Mark flaky tests on Aug2023
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: WPE WebKit (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2023-09-01 04:08 PDT by Carlos Alberto Lopez Perez
Modified: 2023-11-11 11:13 PST (History)
2 users (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Carlos Alberto Lopez Perez 2023-09-01 04:08:11 PDT 
With the goal of reducing the number of unexpected flakies I have ran the tool flakyhunter from the repo https://github.com/clopez/webkit-testhunter 

I have told it to parse the last 200 runs from the GTK release bot (range [266631@main-267543@main]) and the last 200 ones from the WPE release bot (range [266990@main-267544@main])

So this is basically almost a whole month of data.
Comment 1 Carlos Alberto Lopez Perez 2023-09-01 04:09:48 PDT 
I have uploaded at https://people.igalia.com/clopez/wkbug/261024/ some text files will all the fine details (which revisions and exact results each test gave in this range)
Comment 2 Amanda Falke 2023-09-25 11:35:42 PDT 
LayoutTest was flaky on WPE as well as GTK; gardened it here: 
https://github.com/WebKit/WebKit/pull/18181
Comment 3 Amanda Falke 2023-09-25 11:53:05 PDT 
(In reply to Amanda Falke from comment #2)
> LayoutTest was flaky on WPE as well as GTK; gardened it here: 
> https://github.com/WebKit/WebKit/pull/18181

Specifically, LayoutTests/webrtc/video-disabled-black.html
Comment 4 EWS 2023-10-06 17:32:20 PDT 
Test gardening commit 269025@main (ede9f3521d97): <https://commits.webkit.org/269025@main>

Reviewed commits have been landed. Closing PR #18786 and removing active labels.