Bug 242230 - REGRESSION(250469@main) svg/animations/animation-leak-list-property-instances.html is randomly failing
Summary: REGRESSION(250469@main) svg/animations/animation-leak-list-property-instances...
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Animations (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Fujii Hironori
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2022-06-30 23:44 PDT by Fujii Hironori
Modified: 2022-07-05 15:06 PDT (History)
8 users (show)

See Also:


Attachments
Patch (4.03 KB, patch)
2022-07-04 14:27 PDT, Fujii Hironori
no flags Details | Formatted Diff | Diff
Patch (4.15 KB, patch)
2022-07-04 21:42 PDT, Fujii Hironori
no flags Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Fujii Hironori 2022-06-30 23:44:44 PDT
REGRESSION(250469@main) svg/animations/animation-leak-list-property-instances.html is randomly failing

https://results.webkit.org/?suite=layout-tests&test=svg%2Fanimations%2Fanimation-leak-list-property-instances.html

Since 250469@main (bug#240112) modified animation-leak-list-property-instances.html.
Comment 1 Fujii Hironori 2022-06-30 23:48:21 PDT
250480@main
Buildbot: builder Apple-BigSur-Debug-WK2-Tests build 6491
https://build.webkit.org/#/builders/23/builds/6491

--- /Volumes/Data/worker/Apple-BigSur-Debug-WK2-Tests/build/layout-test-results/svg/animations/animation-leak-list-property-instances-expected.txt
+++ /Volumes/Data/worker/Apple-BigSur-Debug-WK2-Tests/build/layout-test-results/svg/animations/animation-leak-list-property-instances-actual.txt
@@ -3,5 +3,5 @@
 On success, you will see a series of "PASS" messages, followed by "TEST COMPLETE".
 
 
-PASS 0 is 0
+FAIL -63 should be 0. Was -63.
Comment 2 Fujii Hironori 2022-07-01 23:35:36 PDT
Another test failure.

Buildbot: builder GTK-Linux-64-bit-Release-Skip-Failing-Tests build 6406: 252088@main
https://build.webkit.org/#/builders/199/builds/6406

--- /home/buildbot/worker/GTK-Linux-64-bit-Release-Skip-Failing-Tests/build/layout-test-results/svg/animations/animation-leak-list-property-instances-expected.txt
+++ /home/buildbot/worker/GTK-Linux-64-bit-Release-Skip-Failing-Tests/build/layout-test-results/svg/animations/animation-leak-list-property-instances-actual.txt
@@ -3,8 +3,9 @@
 On success, you will see a series of "PASS" messages, followed by "TEST COMPLETE".
 
 
-PASS 0 is 0
+FAIL -7 should be 0. Was -7.
 PASS successfullyParsed is true
+Some tests failed.
 
 TEST COMPLETE
Comment 3 Alexey Proskuryakov 2022-07-04 11:34:24 PDT
Bug 242231 fixed some obviously mistakes in the test, but now it's failing for apparently more substantial reasons.
Comment 4 Radar WebKit Bug Importer 2022-07-04 11:36:07 PDT
<rdar://problem/96403351>
Comment 5 Fujii Hironori 2022-07-04 14:27:10 PDT
Created attachment 460659 [details]
Patch
Comment 6 Darin Adler 2022-07-04 21:16:11 PDT
Comment on attachment 460659 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=460659&action=review

> LayoutTests/svg/animations/animation-leak-list-property-instances-expected.txt:6
> +PASS 0 is <= 5

This won’t work to make the test less flaky. Because if we have 1 this line will say "Pass 1 is <= 5" and the test will fail.
Comment 7 Darin Adler 2022-07-04 21:16:47 PDT
Comment on attachment 460659 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=460659&action=review

>> LayoutTests/svg/animations/animation-leak-list-property-instances-expected.txt:6
>> +PASS 0 is <= 5
> 
> This won’t work to make the test less flaky. Because if we have 1 this line will say "Pass 1 is <= 5" and the test will fail.

This needs to be changed so that the number of objects is not logged.
Comment 8 Fujii Hironori 2022-07-04 21:25:23 PDT
Comment on attachment 460659 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=460659&action=review

>>> LayoutTests/svg/animations/animation-leak-list-property-instances-expected.txt:6
>>> +PASS 0 is <= 5
>> 
>> This won’t work to make the test less flaky. Because if we have 1 this line will say "Pass 1 is <= 5" and the test will fail.
> 
> This needs to be changed so that the number of objects is not logged.

Good catch. Will fix. Thank you very much.
Comment 9 Fujii Hironori 2022-07-04 21:42:55 PDT
Created attachment 460669 [details]
Patch
Comment 10 Yusuke Suzuki 2022-07-05 12:51:23 PDT
Comment on attachment 460669 [details]
Patch

r=me
Comment 11 EWS 2022-07-05 15:06:24 PDT
Committed 252153@main (1b783a18fdac): <https://commits.webkit.org/252153@main>

All reviewed patches have been landed. Closing bug and clearing flags on attachment 460669 [details].