Bug 232947

Summary:	[WebDriver] Make suite exit early after a number of crashes or failures
Product:	WebKit	Reporter:	Lauro Moura <lmoura>
Component:	WebDriver	Assignee:	Nobody <webkit-unassigned>
Status:	NEW ---
Severity:	Normal	CC:	aakash_jain, bburg, bugs-noreply, ryanhaddad, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Unspecified
OS:	Unspecified
See Also:	https://bugs.webkit.org/show_bug.cgi?id=249054

Description Lauro Moura 2021-11-10 09:35:23 PST

Currently, the run-layout-tests script aborts the run if there is a large number of failures (500) or crashes/timeouts (50).

Meanwhile, the run-webdriver-tests script keeps going despite the number of failures. In the GTK4, this makes the webdriver step fill the disk with core dumps.

We should add something similar to '--exit-after-n-crashes-or-timeouts`/`--exit-after-n-failures` to run-webdriver-tests.

Comment 1 Radar WebKit Bug Importer 2021-11-17 09:36:23 PST

<rdar://problem/85507941>

Comment 2 Aakash Jain 2022-12-12 15:58:16 PST

This issue frequently affects buildbot. Due to millions of lines of logs while running webdriver tests, the server goes down (or becomes unresponsive). It happenned recently in https://build.webkit.org/#/builders/730/builds/13

We need to either fix this or stop running webdriver tests on build.webkit.org until this is fixed.