Bug 161096 - JSC should have a "microbenchmarks" directory instead of "regress" directory
Summary: JSC should have a "microbenchmarks" directory instead of "regress" directory
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: JavaScriptCore (show other bugs)
Version: WebKit Local Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Saam Barati
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2016-08-23 11:08 PDT by Saam Barati
Modified: 2016-08-24 09:50 PDT (History)
14 users (show)

See Also:


Attachments
patch (12.69 MB, patch)
2016-08-23 16:13 PDT, Saam Barati
mark.lam: review+
Details | Formatted Diff | Diff
sane looking patch (6.44 KB, patch)
2016-08-23 16:27 PDT, Saam Barati
no flags Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Saam Barati 2016-08-23 11:08:46 PDT
...
Comment 1 Mark Lam 2016-08-23 11:17:51 PDT
+1
Comment 2 Saam Barati 2016-08-23 16:13:21 PDT
Created attachment 286801 [details]
patch
Comment 3 Mark Lam 2016-08-23 16:15:47 PDT
Comment on attachment 286801 [details]
patch

rs=me
Comment 4 Saam Barati 2016-08-23 16:27:24 PDT
Created attachment 286804 [details]
sane looking patch

This is the part of the patch that is important.
After this, I'm going to do:
```
$ svn mv LayoutTests/js/regress/script-tests JSTests/microbenchmarks
$ svn rm LayoutTests/js/regress
$ prepareChangelog
$ svn commit
```
Comment 5 Saam Barati 2016-08-23 16:41:26 PDT
landed in:
https://trac.webkit.org/changeset/204870
Comment 6 Alexey Proskuryakov 2016-08-24 09:33:34 PDT
js/regress/put-by-id-transition-with-indexing-header.html was the only test that found a recent regression.

Given that it's not failing in jsc tests after the move, looks like this change reduces test coverage.
Comment 7 Alexey Proskuryakov 2016-08-24 09:35:33 PDT
This patch removed an expectation for js/regress-139548.html, but did not remove the test.

So it's now failing on the bots: https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=js%2Fregress-139548.html
Comment 8 Mark Lam 2016-08-24 09:39:18 PDT
(In reply to comment #7)
> This patch removed an expectation for js/regress-139548.html, but did not
> remove the test.
> 
> So it's now failing on the bots:
> https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.
> html#showAllRuns=true&tests=js%2Fregress-139548.html

It was a mistake to remove this expectation.  Ditto for js/regress-141098.html.  I will reinstate the expectations.
Comment 9 Mark Lam 2016-08-24 09:50:35 PDT
Test expectations for js/regress-139548.html and js/regress-141098.html were restored in r204900: <http://trac.webkit.org/r204900>.