208005 2020-02-20 07:46:32 -0800 [ Mac wk2 ] webgpu/whlsl/zero-initialize-values.html is flaky failing. 2020-02-20 07:52:22 -0800 1 1 1 Unclassified WebKit WebGPU WebKit Nightly Build Mac macOS 10.15 NEW InRadar P2 Normal --- 1 Lawrence.j webkit-unassigned webkit-bot-watchers-bugzilla webkit-bug-importer oldest_to_newest 1621216 0 391287 Lawrence.j 2020-02-20 07:46:32 -0800 Created attachment 391287 https://build.webkit.org/results/Apple-Catalina-Debug-WK2-Tests/r257050%20(2433)/webgpu/whlsl/zero-initialize-values-diff.png webgpu/whlsl/zero-initialize-values.html Description: This test is flaky failing on Mac. The test is flaky failing throughout the visible history. The oldest diff that I am able to load, r254201, has the same percentage and looks the same. History: https://results.webkit.org/?suite=layout-tests&test=webgpu%2Fwhlsl%2Fzero-initialize-values.html&limit=50000 Diff: https://build.webkit.org/results/Apple-Catalina-Debug-WK2-Tests/r257050%20(2433)/webgpu/whlsl/zero-initialize-values-diff.png 1621218 1 webkit-bug-importer 2020-02-20 07:46:56 -0800 <rdar://problem/59628835> 1621219 2 Lawrence.j 2020-02-20 07:50:43 -0800 I have marked this test as failing while this issue is investigated. https://trac.webkit.org/changeset/257060/webkit 1621220 3 Lawrence.j 2020-02-20 07:52:22 -0800 I can reproduce the issue with r257052 using the command below. run-webkit-tests webgpu/whlsl/zero-initialize-values.html --iterations 4000 --exit-after-n-failures 5 -f --force -g [33/4000] webgpu/whlsl/zero-initialize-values.html failed unexpectedly (reference mismatch) [38/4000] webgpu/whlsl/zero-initialize-values.html failed unexpectedly (reference mismatch) [50/4000] webgpu/whlsl/zero-initialize-values.html failed unexpectedly (reference mismatch) [60/4000] webgpu/whlsl/zero-initialize-values.html failed unexpectedly (reference mismatch) [61/4000] webgpu/whlsl/zero-initialize-values.html failed unexpectedly (reference mismatch) Exiting early after 5 failures. 58 tests run. 53 tests ran as expected, 5 didn't (3942 didn't run): 391287 2020-02-20 07:46:32 -0800 2020-02-20 07:46:32 -0800 https://build.webkit.org/results/Apple-Catalina-Debug-WK2-Tests/r257050%20(2433)/webgpu/whlsl/zero-initialize-values-diff.png zero-initialize-values-diff.png image/png 3557 Lawrence.j iVBORw0KGgoAAAANSUhEUgAAAyAAAAJYCAAAAAC/Hd2sAAAAOGVYSWZNTQAqAAAACAABh2kABAAA AAEAAAAaAAAAAAACoAIABAAAAAEAAAMgoAMABAAAAAEAAAJYAAAAAOGil64AAA1oSURBVHgB7dVB SgRRDEXRVtyPuP9FiDty5NCMgq9fPE4UCn5+ndTFx8MPAQIECBAgQIAAAQIECBAgQIAAAQIECBAg QOCmwMvPa33+/OH3Uwh8PMUtXOIVAQECvwsI5HcbTwg8BOIjIDAICGTA8YiAQHwDBAYBgQw4HhEQ iG+AwCAgkAHHIwIC8Q0QGAQEMuB4REAgvgECg4BABhyPCAjEN0BgEBDIgOMRAYH4BggMAgIZcDwi IBDfAIFBQCADjkcEBOIbIDAICGTA8YiAQHwDBAYBgQw4HhEQiG+AwCAgkAHHIwIC8Q0QGAQEMuB4 REAgvgECg4BABhyPCAjEN0BgEBDIgOMRAYH4BggMAgIZcDwiIBDfAIFBQCADjkcEBOIbIDAICGTA 8YiAQHwDBAYBgQw4HhEQiG+AwCAgkAHHIwIC8Q0QGAQEMuB4REAgvgECg4BABhyPCAjEN0BgEBDI gOMRAYH4BggMAgIZcDwiIBDfAIFBQCADjkcEBOIbIDAICGTA8YiAQHwDBAYBgQw4HhEQiG+AwCAg kAHHIwIC8Q0QGAQEMuB4REAgvgECg4BABhyPCAjEN0BgEBDIgOMRAYH4BggMAgIZcDwiIBDfAIFB QCADjkcEBOIbIDAICGTA8YiAQHwDBAYBgQw4HhEQiG+AwCAgkAHHIwIC8Q0QGAQEMuB4REAgvgEC g4BABhyPCAjEN0BgEBDIgOMRAYH4BggMAgIZcDwiIBDfAIFBQCADjkcEBOIbIDAICGTA8YiAQHwD BAYBgQw4HhEQiG+AwCAgkAHHIwIC8Q0QGAQEMuB4REAgvgECg4BABhyPCAjEN0BgEBDIgOMRAYH4 BggMAgIZcDwiIBDfAIFBQCADjkcEBOIbIDAIvA3P1h+9r5+YOfArM9bUgID/IAF0I3sEBNKzKzcN CAgkgG5kj4BAenblpgEBgQTQjewREEjPrtw0ICCQALqRPQIC6dmVmwYEBBJAN7JHQCA9u3LTgIBA AuhG9ggIpGdXbhoQEEgA3cgeAYH07MpNAwICCaAb2SMgkJ5duWlAQCABdCN7BATSsys3DQgIJIBu ZI+AQHp25aYBAYEE0I3sERBIz67cNCAgkAC6kT0CAunZlZsGBAQSQDeyR0AgPbty04CAQALoRvYI CKRnV24aEBBIAN3IHgGB9OzKTQMCAgmgG9kjIJCeXblpQEAgAXQjewQE0rMrNw0ICCSAbmSPgEB6 duWmAQGBBNCN7BEQSM+u3DQgIJAAupE9AgLp2ZWbBgQEEkA3skdAID27ctOAgEAC6Eb2CAikZ1du GhAQSADdyB4BgfTsyk0DAgIJoBvZIyCQnl25aUBAIAF0I3sEBNKzKzcNCAgkgG5kj4BAenblpgEB gQTQjewREEjPrtw0ICCQALqRPQIC6dmVmwYEBBJAN7JHQCA9u3LTgIBAAuhG9ggIpGdXbhoQEEgA 3cgeAYH07MpNAwICCaAb2SMgkJ5duWlAQCABdCN7BATSsys3DQgIJIBuZI+AQHp25aYBAYEE0I3s ERBIz67cNCAgkAC6kT0CAunZlZsGBAQSQDeyR0AgPbty04CAQALoRvYICKRnV24aEBBIAN3IHgGB 9OzKTQMCAgmgG9kjIJCeXblpQEAgAXQjewQE0rMrNw0ICCSAbmSPgEB6duWmAQGBBNCN7BEQSM+u 3DQgIJAAupE9AgLp2ZWbBgQEEkA3skdAID27ctOAgEAC6Eb2CAikZ1duGhAQSADdyB4BgfTsyk0D AgIJoBvZIyCQnl25aUBAIAF0I3sEBNKzKzcNCAgkgG5kj4BAenblpgEBgQTQjewREEjPrtw0ICCQ ALqRPQIC6dmVmwYEBBJAN7JHQCA9u3LTgIBAAuhG9ggIpGdXbhoQEEgA3cgeAYH07MpNAwICCaAb 2SMgkJ5duWlAQCABdCN7BATSsys3DQgIJIBuZI+AQHp25aYBAYEE0I3sERBIz67cNCAgkAC6kT0C AunZlZsGBAQSQDeyR0AgPbty04CAQALoRvYICKRnV24aEBBIAN3IHgGB9OzKTQMCAgmgG9kjIJCe XblpQEAgAXQjewQE0rMrNw0ICCSAbmSPgEB6duWmAQGBBNCN7BEQSM+u3DQgIJAAupE9AgLp2ZWb BgQEEkA3skdAID27ctOAgEAC6Eb2CAikZ1duGhAQSADdyB4BgfTsyk0DAgIJoBvZIyCQnl25aUBA IAF0I3sEBNKzKzcNCAgkgG5kj4BAenblpgEBgQTQjewREEjPrtw0ICCQALqRPQIC6dmVmwYEBBJA N7JHQCA9u3LTgIBAAuhG9ggIpGdXbhoQEEgA3cgeAYH07MpNAwICCaAb2SMgkJ5duWlAQCABdCN7 BATSsys3DQgIJIBuZI+AQHp25aYBAYEE0I3sERBIz67cNCAgkAC6kT0CAunZlZsGBAQSQDeyR0Ag Pbty04CAQALoRvYICKRnV24aEBBIAN3IHgGB9OzKTQMCAgmgG9kjIJCeXblpQEAgAXQjewQE0rMr Nw0ICCSAbmSPgEB6duWmAQGBBNCN7BEQSM+u3DQgIJAAupE9AgLp2ZWbBgQEEkA3skdAID27ctOA gEAC6Eb2CAikZ1duGhAQSADdyB4BgfTsyk0DAgIJoBvZIyCQnl25aUBAIAF0I3sEBNKzKzcNCAgk gG5kj4BAenblpgEBgQTQjewREEjPrtw0ICCQALqRPQJvf3nVr78cZhaBBQH/QRYQHXFXQCB3d+vN FgQEsoDoiLsCArm7W2+2ICCQBURH3BUQyN3derMFAYEsIDriroBA7u7Wmy0ICGQB0RF3BQRyd7fe bEFAIAuIjrgrIJC7u/VmCwICWUB0xF0BgdzdrTdbEBDIAqIj7goI5O5uvdmCgEAWEB1xV0Agd3fr zRYEBLKA6Ii7AgK5u1tvtiAgkAVER9wVEMjd3XqzBQGBLCA64q6AQO7u1pstCAhkAdERdwUEcne3 3mxBQCALiI64KyCQu7v1ZgsCAllAdMRdAYHc3a03WxAQyAKiI+4KCOTubr3ZgoBAFhAdcVdAIHd3 680WBASygOiIuwICubtbb7YgIJAFREfcFRDI3d16swUBgSwgOuKugEDu7tabLQgIZAHREXcFBHJ3 t95sQUAgC4iOuCsgkLu79WYLAgJZQHTEXQGB3N2tN1sQEMgCoiPuCgjk7m692YKAQBYQHXFXQCB3 d+vNFgQEsoDoiLsCArm7W2+2ICCQBURH3BUQyN3derMFAYEsIDriroBA7u7Wmy0ICGQB0RF3BQRy d7febEFAIAuIjrgrIJC7u/VmCwICWUB0xF0BgdzdrTdbEBDIAqIj7goI5O5uvdmCgEAWEB1xV0Ag d3frzRYEBLKA6Ii7AgK5u1tvtiAgkAVER9wVEMjd3XqzBQGBLCA64q6AQO7u1pstCAhkAdERdwUE cne33mxBQCALiI64KyCQu7v1ZgsCAllAdMRdAYHc3a03WxAQyAKiI+4KCOTubr3ZgoBAFhAdcVdA IHd3680WBASygOiIuwICubtbb7YgIJAFREfcFRDI3d16swUBgSwgOuKugEDu7tabLQgIZAHREXcF BHJ3t95sQUAgC4iOuCsgkLu79WYLAgJZQHTEXQGB3N2tN1sQEMgCoiPuCgjk7m692YKAQBYQHXFX QCB3d+vNFgQEsoDoCAIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAA AQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIE CBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAg QIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAA AQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIE CBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAg QIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAA AQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIE CBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAg QIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAA AQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIE CBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBAgQIAAAQIECBD4 fwLfyC0F9UdS7HUAAAAASUVORK5CYII=