|Summary:||[Regression] test262.yaml/test262/test/language/statements/try/tco-catch.js.default-strict is failing on Test262 consistently.|
|Product:||WebKit||Reporter:||Matt Lewis <jlewis3>|
|Severity:||Normal||CC:||rmorisset, ryanhaddad, saam|
|Version:||WebKit Nightly Build|
Description Matt Lewis 2017-10-20 10:20:53 PDT
test262.yaml/test262/test/language/statements/try/tco-catch.js.default-strict is failing consistently on the Test262 tester according to the Archived runs. https://build.webkit.org/builders/Apple%20El%20Capitan%20Debug%20Test262%20(Tests)?numbuilds=50 It started failing after https://trac.webkit.org/changeset/223691/webkit failure: test262.yaml/test262/test/language/statements/try/tco-catch.js.default-strict: ERROR: Unexpected exit code: 0 FAIL: test262.yaml/test262/test/language/statements/try/tco-catch.js.default-strict log: https://build.webkit.org/builders/Apple%20El%20Capitan%20Debug%20Test262%20%28Tests%29/builds/3943/steps/test262-test/logs/stdio
Comment 1 Robin Morisset 2017-10-20 10:28:00 PDT
Thanks for reporting it, I will look into it.
Comment 2 Robin Morisset 2017-10-23 05:28:26 PDT
I spent some time trying to reproduce this bug and not understanding why it only triggered when using the testing harness and not when running the program by hand. After looking at JSTests/test262.yaml in more details, I saw that this program was marked :fail, so visibly it was expected that the test would fail, and the testing harness is now complaining that it no longer does. This assumption was last changed in https://bugs.webkit.org/show_bug.cgi?id=177859. Interestingly, increasing the number of iterations to 100000 makes the test fail with stack overflow. This looks possibly related to https://bugs.webkit.org/show_bug.cgi?id=176703.
Comment 3 Ryan Haddad 2017-10-25 10:15:39 PDT
The bot has been red for days due to this issue. Should we go ahead and mark the test as passing?
Comment 4 Ryan Haddad 2017-10-25 10:42:54 PDT
I confirmed with Robin that we should mark the test as passing. Made the change in https://trac.webkit.org/changeset/223961/webkit
Comment 5 Ryan Haddad 2017-10-26 09:41:28 PDT
Reverted r223961 for reason: The change that required this has been rolled out. Committed r224022: <https://trac.webkit.org/changeset/224022>