Bug 231514

Summary: [ BigSur wk1 ] webgl/1.0.3/conformance/uniforms/uniform-default-values.html is flaky timing out
Product: WebKit Reporter: ayumi_kojima
Component: WebGLAssignee: Nobody <webkit-unassigned>
Status: NEW    
Severity: Normal CC: dino, ehutchison, kbr, kkinnunen, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   

ayumi_kojima
Reported 2021-10-11 09:35:54 PDT
webgl/1.0.3/conformance/uniforms/uniform-default-values.html Is flaky timing out on iOS and BigSur wk1. History: https://results.webkit.org/?suite=layout-tests&test=webgl%2F1.0.3%2Fconformance%2Funiforms%2Funiform-default-values.html Result page: https://build.webkit.org/results/Apple-iOS-15-Simulator-Debug-WK2-Tests/r283888%20(121)/results.html Diff: --- /Volumes/Data/worker/ios-simulator-15-debug-tests-wk2/build/layout-test-results/webgl/1.0.3/conformance/uniforms/uniform-default-values-expected.txt +++ /Volumes/Data/worker/ios-simulator-15-debug-tests-wk2/build/layout-test-results/webgl/1.0.3/conformance/uniforms/uniform-default-values-actual.txt @@ -1,3 +1,5 @@ +FAIL: Timed out waiting for notifyDone to be called + This test runs the WebGL Test listed below in an iframe and reports PASS or FAIL. Test: ../../resources/webgl_test_files/conformance/uniforms/uniform-default-values.html Diff: --- /Volumes/Data/worker/bigsur-debug-tests-wk1/build/layout-test-results/webgl/1.0.3/conformance/uniforms/uniform-default-values-expected.txt +++ /Volumes/Data/worker/bigsur-debug-tests-wk1/build/layout-test-results/webgl/1.0.3/conformance/uniforms/uniform-default-values-actual.txt @@ -1,5 +1,245 @@ +FAIL: Timed out waiting for notifyDone to be called This test runs the WebGL Test listed below in an iframe and reports PASS or FAIL. Test: ../../resources/webgl_test_files/conformance/uniforms/uniform-default-values.html -[ PASS ] All tests passed +[ 1: PASS ] uniform is zero +[ 2: PASS ] should be green +[ 3: PASS ] should be red +[ 4: PASS ] should be green +[ 5: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 6: PASS ] uniform is zero +[ 7: PASS ] should be green +[ 8: PASS ] should be red +[ 9: PASS ] should be green +[ 10: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 11: PASS ] uniform is zero +[ 12: PASS ] should be green +[ 13: PASS ] should be red +[ 14: PASS ] should be green +[ 15: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 16: PASS ] uniform is zero +[ 17: PASS ] should be green +[ 18: PASS ] should be red +[ 19: PASS ] should be green +[ 20: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 21: PASS ] uniform is zero +[ 22: PASS ] should be green +[ 23: PASS ] should be red +[ 24: PASS ] should be green +[ 25: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 26: PASS ] uniform is zero +[ 27: PASS ] should be green +[ 28: PASS ] should be red +[ 29: PASS ] should be green +[ 30: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 31: PASS ] uniform is zero +[ 32: PASS ] should be green +[ 33: PASS ] should be red +[ 34: PASS ] should be green +[ 35: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 36: PASS ] uniform is zero +[ 37: PASS ] should be green +[ 38: PASS ] should be red +[ 39: PASS ] should be green +[ 40: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 41: PASS ] uniform is zero +[ 42: PASS ] should be green +[ 43: PASS ] should be red +[ 44: PASS ] should be green +[ 45: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 46: PASS ] uniform is zero +[ 47: PASS ] should be green +[ 48: PASS ] should be red +[ 49: PASS ] should be green +[ 50: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 51: PASS ] uniform is zero +[ 52: PASS ] should be green +[ 53: PASS ] should be red +[ 54: PASS ] should be green +[ 55: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 56: PASS ] uniform is zero +[ 57: PASS ] should be green +[ 58: PASS ] should be red +[ 59: PASS ] should be green +[ 60: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 61: PASS ] uniform is zero +[ 62: PASS ] should be green +[ 63: PASS ] should be red +[ 64: PASS ] should be green +[ 65: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 66: PASS ] uniform is zero +[ 67: PASS ] should be green +[ 68: PASS ] should be red +[ 69: PASS ] should be green +[ 70: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 71: PASS ] uniform is zero +[ 72: PASS ] should be green +[ 73: PASS ] should be red +[ 74: PASS ] should be green +[ 75: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 76: PASS ] uniform is zero +[ 77: PASS ] should be green +[ 78: PASS ] should be red +[ 79: PASS ] should be green +[ 80: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 81: PASS ] uniform is zero +[ 82: PASS ] should be green +[ 83: PASS ] should be red +[ 84: PASS ] should be green +[ 85: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 86: PASS ] uniform is zero +[ 87: PASS ] should be green +[ 88: PASS ] should be red +[ 89: PASS ] should be green +[ 90: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 91: PASS ] uniform is zero +[ 92: PASS ] should be green +[ 93: PASS ] should be red +[ 94: PASS ] should be green +[ 95: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 96: PASS ] uniform is zero +[ 97: PASS ] should be green +[ 98: PASS ] should be red +[ 99: PASS ] should be green +[ 100: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 101: PASS ] uniform is zero +[ 102: PASS ] should be green +[ 103: PASS ] should be red +[ 104: PASS ] should be green +[ 105: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 106: PASS ] uniform is zero +[ 107: PASS ] should be green +[ 108: PASS ] should be red +[ 109: PASS ] should be green +[ 110: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 111: PASS ] uniform is zero +[ 112: PASS ] should be green +[ 113: PASS ] should be red +[ 114: PASS ] should be green +[ 115: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 116: PASS ] uniform is zero +[ 117: PASS ] should be green +[ 118: PASS ] should be red +[ 119: PASS ] should be green +[ 120: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 121: PASS ] uniform is zero +[ 122: PASS ] should be green +[ 123: PASS ] should be red +[ 124: PASS ] should be green +[ 125: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 126: PASS ] uniform is zero +[ 127: PASS ] should be green +[ 128: PASS ] should be red +[ 129: PASS ] should be green +[ 130: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 131: PASS ] uniform is zero +[ 132: PASS ] should be green +[ 133: PASS ] should be red +[ 134: PASS ] should be green +[ 135: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 136: PASS ] uniform is zero +[ 137: PASS ] should be green +[ 138: PASS ] should be red +[ 139: PASS ] should be green +[ 140: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 141: PASS ] uniform is zero +[ 142: PASS ] should be green +[ 143: PASS ] should be red +[ 144: PASS ] should be green +[ 145: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 146: PASS ] uniform is zero +[ 147: PASS ] should be green +[ 148: PASS ] should be red +[ 149: PASS ] should be green +[ 150: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 151: PASS ] uniform is zero +[ 152: PASS ] should be green +[ 153: PASS ] should be red +[ 154: PASS ] should be green +[ 155: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 156: PASS ] uniform is zero +[ 157: PASS ] should be green +[ 158: PASS ] should be red +[ 159: PASS ] should be green +[ 160: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 161: PASS ] uniform is zero +[ 162: PASS ] should be green +[ 163: PASS ] should be red +[ 164: PASS ] should be green +[ 165: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 166: PASS ] uniform is zero +[ 167: PASS ] should be green +[ 168: PASS ] should be red +[ 169: PASS ] should be green +[ 170: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 171: PASS ] uniform is zero +[ 172: PASS ] should be green +[ 173: PASS ] should be red +[ 174: PASS ] should be green +[ 175: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 176: PASS ] uniform is zero +[ 177: PASS ] should be green +[ 178: PASS ] should be red +[ 179: PASS ] should be green +[ 180: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 181: PASS ] uniform is zero +[ 182: PASS ] should be green +[ 183: PASS ] should be red +[ 184: PASS ] should be green +[ 185: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 186: PASS ] uniform is zero +[ 187: PASS ] should be green +[ 188: PASS ] should be red +[ 189: PASS ] should be green +[ 190: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 191: PASS ] uniform is zero +[ 192: PASS ] should be green +[ 193: PASS ] should be red +[ 194: PASS ] should be green +[ 195: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 196: PASS ] uniform is zero +[ 197: PASS ] should be green +[ 198: PASS ] should be red +[ 199: PASS ] should be green +[ 200: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 201: PASS ] uniform is zero +[ 202: PASS ] should be green +[ 203: PASS ] should be red +[ 204: PASS ] should be green +[ 205: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 206: PASS ] uniform is zero +[ 207: PASS ] should be green +[ 208: PASS ] should be red +[ 209: PASS ] should be green +[ 210: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 211: PASS ] uniform is zero +[ 212: PASS ] should be green +[ 213: PASS ] should be red +[ 214: PASS ] should be green +[ 215: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 216: PASS ] uniform is zero +[ 217: PASS ] should be green +[ 218: PASS ] should be red +[ 219: PASS ] should be green +[ 220: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 221: PASS ] uniform is zero +[ 222: PASS ] should be green +[ 223: PASS ] should be red +[ 224: PASS ] should be green +[ 225: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 226: PASS ] uniform is zero +[ 227: PASS ] should be green +[ 228: PASS ] should be red +[ 229: PASS ] should be green +[ 230: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 231: PASS ] uniform is zero +[ 232: PASS ] should be green +[ 233: PASS ] should be red +[ 234: PASS ] should be green +[ 235: PASS ] getError was expected value: NO_ERROR : should be no GL errors +[ 236: PASS ] uniform is zero +[ 237: PASS ] should be green +[ 238: PASS ] should be red +[ 239: PASS ] should be green +[ 240: PASS ] getError was expected value: NO_ERROR : should be no GL errors
Attachments
Add attachment proposed patch, testcase, etc.
Radar WebKit Bug Importer
Comment 1 2021-10-11 12:03:22 PDT
<rdar://problem/84109995>
ayumi_kojima
Comment 2 2021-10-11 12:03:32 PDT
Test was marked slow in Bug 231397, but the test continue timing out. Update the test expectations to pass/timeout: https://trac.webkit.org/changeset/283918/webkit
Eric Hutchison
Comment 3 2021-10-12 15:40:44 PDT
Expectations set in iOS-simulator folder are overriding the pass/timeout expectation that is actually occurring. Updating expectations: https://trac.webkit.org/changeset/284047/webkit
ayumi_kojima
Comment 4 2021-10-28 17:02:31 PDT
I was not able to reproduce the timeout locally on BigSur using run-webkit-tests --force -1 --debug --iterations 100 --exit-after-n-crashes-or-timeouts 1 webgl/1.0.3/conformance/uniforms/uniform-default-values.html
ayumi_kojima
Comment 5 2021-10-28 17:05:32 PDT
Updated test expectations for iOS https://trac.webkit.org/changeset/285008/webkit
Note You need to log in before you can comment on or make changes to this bug.