207267 2020-02-05 07:38:14 -0800 [ Mac wk2 ] webgpu/whlsl/ensure-proper-variable-lifetime.html is flaky ImageOnlyFailure. 2020-09-03 17:59:47 -0700 1 1 1 Unclassified WebKit WebGPU WebKit Nightly Build Mac Unspecified NEW https://bugs.webkit.org/show_bug.cgi?id=207199 https://bugs.webkit.org/show_bug.cgi?id=207200 InRadar P2 Normal --- 1 Lawrence.j webkit-unassigned rackler tsavell webkit-bot-watchers-bugzilla webkit-bug-importer oldest_to_newest 1615033 0 Lawrence.j 2020-02-05 07:38:14 -0800 webgpu/whlsl/ensure-proper-variable-lifetime.html Description: This test is flaky failing on Mac wk2. There are other webgpu tests with similar results which I will relate. History: https://results.webkit.org/?suite=layout-tests&test=webgpu%2Fwhlsl%2Fensure-proper-variable-lifetime.html&limit=50000 Diff: https://build.webkit.org/results/Apple-Catalina-Debug-WK2-Tests/r255810%20(2131)/webgpu/whlsl/ensure-proper-variable-lifetime-diff.png 1615034 1 webkit-bug-importer 2020-02-05 07:38:37 -0800 <rdar://problem/59187793> 1615037 2 389806 Lawrence.j 2020-02-05 07:47:58 -0800 Created attachment 389806 Update Test Expectations 1615038 3 389806 tsavell 2020-02-05 07:54:11 -0800 Comment on attachment 389806 Update Test Expectations Clearing flags on attachment: 389806 Committed r255811: <https://trac.webkit.org/changeset/255811> 1615359 4 Lawrence.j 2020-02-05 15:55:51 -0800 I am able to reproduce this issue with the following command: run-webkit-tests xxx webgpu/whlsl/ensure-proper-variable-lifetime.html --iterations 5000 -f --exit-after-n-failures 5 -g --force [106/5000] webgpu/whlsl/ensure-proper-variable-lifetime.html failed unexpectedly (reference mismatch) [212/5000] webgpu/whlsl/ensure-proper-variable-lifetime.html failed unexpectedly (reference mismatch) [259/5000] webgpu/whlsl/ensure-proper-variable-lifetime.html failed unexpectedly (reference mismatch) [290/5000] webgpu/whlsl/ensure-proper-variable-lifetime.html failed unexpectedly (reference mismatch) [617/5000] webgpu/whlsl/ensure-proper-variable-lifetime.html failed unexpectedly (reference mismatch) Exiting early after 5 failures. 614 tests run. 609 tests ran as expected, 5 didn't (4386 didn't run): Regressions: Unexpected image-only failures (1) webgpu/whlsl/ensure-proper-variable-lifetime.html [ ImageOnlyFailure ] 1615361 5 Lawrence.j 2020-02-05 15:56:56 -0800 I was able to reproduce the issue on 255856. 1685522 6 rackler 2020-09-03 17:59:47 -0700 Description: webgpu/whlsl/ensure-proper-variable-lifetime.html This is a flaky imageonlyfailure. The first image failure that I see this on the dashboard was 10/152019 at r251120, but it was not a commit that seemed relevant that would have caused this. It appears the original test expectations were set to failure instead of imageonlyfailure. Modifying/correcting text expectation in https://trac.webkit.org/changeset/266564/webkit I attempted to reproduce the imageonlyfailure using the previously used reproduction steps, but was unable to reproduce using those or other combinations I tried at this time. The test was expecting a blue square outline with white background and center, and received a white square outline with black background and center. History: https://results.webkit.org/?suite=layout-tests&test=webgpu%2Fwhlsl%2Fensure-proper-variable-lifetime.html&limit=50000 Diff: https://build.webkit.org/results/Apple-Catalina-Debug-WK2-Tests/r266535%20(6417)/webgpu/whlsl/ensure-proper-variable-lifetime-diff.png 389806 2020-02-05 07:47:58 -0800 2020-02-05 07:54:11 -0800 Update Test Expectations bug-207267-20200205074757.patch text/plain 1364 Lawrence.j U3VidmVyc2lvbiBSZXZpc2lvbjogMjU1ODEwCmRpZmYgLS1naXQgYS9MYXlvdXRUZXN0cy9DaGFu Z2VMb2cgYi9MYXlvdXRUZXN0cy9DaGFuZ2VMb2cKaW5kZXggODQ3MGM5OWYwNTZmOGJlZTdjYWE3 ZDUxYWQ5NTBmZmFjNzkxMGI5OS4uZDU0NGQ2MWMwZGExZjFiNmFiMWJlM2MyMTg1NjJhNGY2OTNm NmFlYyAxMDA2NDQKLS0tIGEvTGF5b3V0VGVzdHMvQ2hhbmdlTG9nCisrKyBiL0xheW91dFRlc3Rz L0NoYW5nZUxvZwpAQCAtMSwzICsxLDEyIEBACisyMDIwLTAyLTA1ICBKYXNvbiBMYXdyZW5jZSAg PGxhd3JlbmNlLmpAYXBwbGUuY29tPgorCisgICAgICAgIFsgTWFjIHdrMiBdIHdlYmdwdS93aGxz bC9lbnN1cmUtcHJvcGVyLXZhcmlhYmxlLWxpZmV0aW1lLmh0bWwgaXMgZmxha3kgZmFpbGluZy4K KyAgICAgICAgaHR0cHM6Ly9idWdzLndlYmtpdC5vcmcvc2hvd19idWcuY2dpP2lkPTIwNzI2Nwor CisgICAgICAgIFVucmV2aWV3ZWQgdGVzdCBnYXJkZW5pbmcuCisKKyAgICAgICAgKiBwbGF0Zm9y bS9tYWMtd2syL1Rlc3RFeHBlY3RhdGlvbnM6CisKIDIwMjAtMDItMDUgIEFudG9pbmUgUXVpbnQg IDxncmFvdXRzQGFwcGxlLmNvbT4KIAogICAgICAgICBbV2ViIEFuaW1hdGlvbnNdIENhbmNlbGlu ZyBhbiBhY2NlbGVyYXRlZCBhbmltYXRpb24gYmVmb3JlIGl0IHdhcyBjb21taXR0ZWQgZG9lcyBu b3QgcHJldmVudCBpdCBmcm9tIHBsYXlpbmcKZGlmZiAtLWdpdCBhL0xheW91dFRlc3RzL3BsYXRm b3JtL21hYy13azIvVGVzdEV4cGVjdGF0aW9ucyBiL0xheW91dFRlc3RzL3BsYXRmb3JtL21hYy13 azIvVGVzdEV4cGVjdGF0aW9ucwppbmRleCA5OGQ5MDFjNmI5YjU0ODlhMzAwYTllYTMxYmU4N2Zk Yjc3OWYyYzcxLi5lNWNkNGE4MzEyZDkwYTdhYjc4Zjk4YjFmZThhYWZiZmEwNzE5NDk0IDEwMDY0 NAotLS0gYS9MYXlvdXRUZXN0cy9wbGF0Zm9ybS9tYWMtd2syL1Rlc3RFeHBlY3RhdGlvbnMKKysr IGIvTGF5b3V0VGVzdHMvcGxhdGZvcm0vbWFjLXdrMi9UZXN0RXhwZWN0YXRpb25zCkBAIC05ODgs MyArOTg4LDUgQEAgd2Via2l0Lm9yZy9iLzIwNzIwOSBbIFJlbGVhc2UgXSBpbnNwZWN0b3IvaGVh cC9nZXRQcmV2aWV3Lmh0bWwgWyBQYXNzIEZhaWx1cmUgXQogd2Via2l0Lm9yZy9iLzIwNzIyMiB3 ZWJncHUvd2hsc2wvemVyby1pbml0aWFsaXplLXZhbHVlcy0yLmh0bWwgWyBQYXNzIEZhaWx1cmUg XQogCiB3ZWJraXQub3JnL2IvMjA2NjI3IHN0b3JhZ2Uvd2Vic3FsIFsgU2tpcCBdCisKK3dlYmtp dC5vcmcvYi8yMDcyNjcgd2ViZ3B1L3dobHNsL2Vuc3VyZS1wcm9wZXItdmFyaWFibGUtbGlmZXRp bWUuaHRtbCBbIFBhc3MgRmFpbHVyZSBdClwgTm8gbmV3bGluZSBhdCBlbmQgb2YgZmlsZQo=