Bug 185937 - Upgrade test262 to May 24 version
Summary: Upgrade test262 to May 24 version
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Yusuke Suzuki
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2018-05-23 22:18 PDT by Yusuke Suzuki
Modified: 2018-06-03 08:47 PDT (History)
9 users (show)

See Also:


Attachments
Patch (1.17 MB, patch)
2018-05-23 22:19 PDT, Yusuke Suzuki
darin: review+
Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Yusuke Suzuki 2018-05-23 22:18:07 PDT
Upgrade test262 to May 24 version
Comment 1 Yusuke Suzuki 2018-05-23 22:19:22 PDT
Created attachment 341173 [details]
Patch
Comment 2 EWS Watchlist 2018-05-23 22:24:04 PDT
Attachment 341173 [details] did not pass style-queue:


ERROR: Unexpected diff format when parsing a chunk: '", "");'
ERROR: Unexpected diff format when parsing a chunk: "', '');"
ERROR: JSTests/test262/test/language/literals/string/line-continuation-double.js:59:  One or more unexpected \r (^M) found; better to use only a \n  [whitespace/carriage_return] [1]
ERROR: Suppressing further [whitespace/carriage_return] reports for this file.
ERROR: JSTests/test262/test/language/literals/string/line-continuation-single.js:59:  One or more unexpected \r (^M) found; better to use only a \n  [whitespace/carriage_return] [1]
ERROR: Suppressing further [whitespace/carriage_return] reports for this file.
Total errors found: 2 in 265 files


If any of these errors are false positives, please file a bug against check-webkit-style.
Comment 3 Darin Adler 2018-05-25 20:30:15 PDT
Comment on attachment 341173 [details]
Patch

rs=me
Comment 4 Yusuke Suzuki 2018-05-26 03:55:54 PDT
Committed r232224: <https://trac.webkit.org/changeset/232224>
Comment 5 Radar WebKit Bug Importer 2018-05-26 03:56:32 PDT
<rdar://problem/40577943>
Comment 6 David Kilzer (:ddkilzer) 2018-05-28 06:10:05 PDT
The "Debug Tests262 (Tests)" bot started failing after this commit:

<https://build.webkit.org/builders/Apple%20Sierra%20Debug%20Test262%20(Tests)?numbuilds=50>

I wonder if the new test suite is taking too long, or whether one of the tests is now hanging?
Comment 7 David Kilzer (:ddkilzer) 2018-05-28 06:10:52 PDT
(In reply to David Kilzer (:ddkilzer) from comment #6)
> The "Debug Tests262 (Tests)" bot started failing after this commit:
> 
> <https://build.webkit.org/builders/
> Apple%20Sierra%20Debug%20Test262%20(Tests)?numbuilds=50>
> 
> I wonder if the new test suite is taking too long, or whether one of the
> tests is now hanging?

The "Release Test262 (Tests)" bot is doing fine, though:

<https://build.webkit.org/builders/Apple%20Sierra%20Release%20Test262%20(Tests)?numbuilds=50>
Comment 8 Yusuke Suzuki 2018-05-29 05:32:37 PDT
(In reply to David Kilzer (:ddkilzer) from comment #6)
> The "Debug Tests262 (Tests)" bot started failing after this commit:
> 
> <https://build.webkit.org/builders/
> Apple%20Sierra%20Debug%20Test262%20(Tests)?numbuilds=50>
> 
> I wonder if the new test suite is taking too long, or whether one of the
> tests is now hanging?

Can we know what test is hanging / slow from the buildbot log?
Comment 9 Leo Balter 2018-05-30 20:07:12 PDT
We should be able to capture a better report with the changes from Bug 186115
Comment 10 Yusuke Suzuki 2018-05-31 02:51:32 PDT
(In reply to Leo Balter from comment #9)
> We should be able to capture a better report with the changes from Bug 186115

And I think we should have timeout for each test. we can do that by setting environment variable "JSCTEST_timeout".
Comment 11 Leo Balter 2018-05-31 10:34:12 PDT
> And I think we should have timeout for each test. we can do that by setting environment variable "JSCTEST_timeout".

The t262 runner already accepts a --timeout=<ms number> option that relies on the jsc --watchdog.

The main problem here is finding a proper timeout option for the tests. Some of them are slow, but in my dedicated machine none will go over 20 seconds.

Maybe I should also include the execution time for each test in the verbose mode? We already have this in the generated results file.
Comment 12 Yusuke Suzuki 2018-06-03 08:47:16 PDT
It seems that bot becomes fine with logging. Closing this bug.