Bug 231541 - [ iOS macOS Debug ] webgl/1.0.3/conformance/glsl/bugs/long-expressions-should-not-crash.html is a flaky timeout
Summary: [ iOS macOS Debug ] webgl/1.0.3/conformance/glsl/bugs/long-expressions-should...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: WebGL (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2021-10-11 16:22 PDT by ayumi_kojima
Modified: 2021-10-15 13:40 PDT (History)
5 users (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description ayumi_kojima 2021-10-11 16:22:23 PDT 
webgl/1.0.3/conformance/glsl/bugs/long-expressions-should-not-crash.html

Is flaky timing out on iOS Debug and BigSur wk1 Debug.

History: https://results.webkit.org/?suite=layout-tests&test=webgl%2F1.0.3%2Fconformance%2Fglsl%2Fbugs%2Flong-expressions-should-not-crash.html

Result page: https://build.webkit.org/results/Apple-iOS-15-Simulator-Debug-WK2-Tests/r283740%20(86)/results.html

--- /Volumes/Data/worker/ios-simulator-15-debug-tests-wk2/build/layout-test-results/webgl/1.0.3/conformance/glsl/bugs/long-expressions-should-not-crash-expected.txt
+++ /Volumes/Data/worker/ios-simulator-15-debug-tests-wk2/build/layout-test-results/webgl/1.0.3/conformance/glsl/bugs/long-expressions-should-not-crash-actual.txt
@@ -1,5 +1,52 @@
+FAIL: Timed out waiting for notifyDone to be called
+
 This test runs the WebGL Test listed below in an iframe and reports PASS or FAIL.
 
 Test: ../../../resources/webgl_test_files/conformance/glsl/bugs/long-expressions-should-not-crash.html
-[ PASS ] All tests passed
+[ 1: PASS ] shader with 10 [+,-,/,*] operators in expression in multiple lines
+[ 2: PASS ] shader with 10 [+,-,/,*] operators in expression in multiple lines
+[ 3: PASS ] shader with 10 [+,-,/,*] operators in expression in one line
+[ 4: PASS ] shader with 10 [+,-,/,*] operators in expression in one line
+[ 5: PASS ] shader with 10 [+] operators in expression in multiple lines
+[ 6: PASS ] shader with 10 [+] operators in expression in multiple lines
+[ 7: PASS ] shader with 10 [+] operators in expression in one line
+[ 8: PASS ] shader with 10 [+] operators in expression in one line
+[ 9: PASS ] shader with 10 [-] operators in expression in multiple lines
+[ 10: PASS ] shader with 10 [-] operators in expression in multiple lines
+[ 11: PASS ] shader with 10 [-] operators in expression in one line
+[ 12: PASS ] shader with 10 [-] operators in expression in one line
+[ 13: PASS ] shader with 100 [+,-,/,*] operators in expression in multiple lines
+[ 14: PASS ] shader with 100 [+,-,/,*] operators in expression in multiple lines
+[ 15: PASS ] shader with 100 [+,-,/,*] operators in expression in one line
+[ 16: PASS ] shader with 100 [+,-,/,*] operators in expression in one line
+[ 17: PASS ] shader with 100 [+] operators in expression in multiple lines
+[ 18: PASS ] shader with 100 [+] operators in expression in multiple lines
+[ 19: PASS ] shader with 100 [+] operators in expression in one line
+[ 20: PASS ] shader with 100 [+] operators in expression in one line
+[ 21: PASS ] shader with 100 [-] operators in expression in multiple lines
+[ 22: PASS ] shader with 100 [-] operators in expression in multiple lines
+[ 23: PASS ] shader with 100 [-] operators in expression in one line
+[ 24: PASS ] shader with 100 [-] operators in expression in one line
+[ 25: PASS ] shader with 1000 [+,-,/,*] operators in expression in multiple lines
+[ 26: PASS ] shader with 1000 [+,-,/,*] operators in expression in multiple lines
+[ 27: PASS ] shader with 1000 [+,-,/,*] operators in expression in one line
+[ 28: PASS ] shader with 1000 [+,-,/,*] operators in expression in one line
+[ 29: PASS ] shader with 1000 [+] operators in expression in multiple lines
+[ 30: PASS ] shader with 1000 [+] operators in expression in multiple lines
+[ 31: PASS ] shader with 1000 [+] operators in expression in one line
+[ 32: PASS ] shader with 1000 [+] operators in expression in one line
+[ 33: PASS ] shader with 1000 [-] operators in expression in multiple lines
+[ 34: PASS ] shader with 1000 [-] operators in expression in multiple lines
+[ 35: PASS ] shader with 1000 [-] operators in expression in one line
+[ 36: PASS ] shader with 1000 [-] operators in expression in one line
+[ 37: PASS ] shader with 10000 [+,-,/,*] operators in expression in multiple lines
+[ 38: PASS ] shader with 10000 [+,-,/,*] operators in expression in multiple lines
+[ 39: PASS ] shader with 10000 [+,-,/,*] operators in expression in one line
+[ 40: PASS ] shader with 10000 [+,-,/,*] operators in expression in one line
+[ 41: PASS ] shader with 10000 [+] operators in expression in multiple lines
+[ 42: PASS ] shader with 10000 [+] operators in expression in multiple lines
+[ 43: PASS ] shader with 10000 [+] operators in expression in one line
+[ 44: PASS ] shader with 10000 [+] operators in expression in one line
+[ 45: PASS ] shader with 10000 [-] operators in expression in multiple lines
+[ 46: PASS ] shader with 10000 [-] operators in expression in multiple lines
Comment 1 Radar WebKit Bug Importer 2021-10-11 16:28:10 PDT 
<rdar://problem/84121633>
Comment 2 ayumi_kojima 2021-10-11 16:35:58 PDT 
Updated test expectations https://trac.webkit.org/changeset/283948/webkit
Comment 3 ayumi_kojima 2021-10-15 13:40:10 PDT 
I was not able to reproduce the timeout locally on BigSur using run-webkit-tests --force -1 --debug --iterations 50 --exit-after-n-crashes-or-timeouts 1 webgl/1.0.3/conformance/glsl/bugs/long-expressions-should-not-crash.html -f