RESOLVED FIXED 253048
REGRESSION(257654@main): [ews-build.webkit.org][GTK][WPE] RunWebKitTestsRedTree sub-classes are overwriting the 'first_run' properties on the retry steps.
https://bugs.webkit.org/show_bug.cgi?id=253048
Summary REGRESSION(257654@main): [ews-build.webkit.org][GTK][WPE] RunWebKitTestsRedTr...
Carlos Alberto Lopez Perez
Reported 2023-02-27 19:26:19 PST
257654@main changed the way the class RunWebKitTests() works: instead of specializing the function buildstep.BuildStep.commandComplete() the function buildstep.BuildStep.runCommand() is specialized. Buildbot first calls runCommand() and then calls commandComplete() The problem is with the subclasses of RunWebKitTests() which were specializing a commandComplete() function: now instead of executing the generic buildstep.BuildStep.runCommand() they execute the specialized RunWebKitTests.runCommand() which was the previous RunWebKitTests.commandComplete() so this has the undesired effect that the properties defined at RunWebKitTests().runCommand() ('first_run_flakies', 'first_run_failures' and 'first_results_exceed_failure_limit') get redefined (overwritten) multiple times with the values generated when running the command of each one of the sub-classes. This is wrong and can causes unexpected issues later when analyzing the results in AnalyzeLayoutTestsResultsRedTree() because the values of the properties 'first_run_flakies' and 'first_run_failures' are not the ones from the first run but the ones from the last retry step executed.
Attachments
Carlos Alberto Lopez Perez
Comment 1 2023-02-27 19:45:49 PST
EWS
Comment 2 2023-03-03 13:45:07 PST
Committed 261167@main (440943ba5b7e): <https://commits.webkit.org/261167@main> Reviewed commits have been landed. Closing PR #10776 and removing active labels.
Radar WebKit Bug Importer
Comment 3 2023-03-03 13:46:16 PST
Note You need to log in before you can comment on or make changes to this bug.