Add JSC test results in json format to a buildbot log
Created attachment 277084 [details] Patch
Will be easier to iterate on the front-end component of #156595 once this is up.
This addition to the back-end will make it easier to iterate on the front-end changes in #156595.
Comment on attachment 277084 [details] Patch Rejecting attachment 277084 [details] from commit-queue. svijayaraghavan@apple.com does not have committer permissions according to http://trac.webkit.org/browser/trunk/Tools/Scripts/webkitpy/common/config/contributors.json. - If you do not have committer rights please read http://webkit.org/coding/contributing.html for instructions on how to use bugzilla flags. - If you have committer rights please correct the error in Tools/Scripts/webkitpy/common/config/contributors.json by adding yourself to the file (no review needed). The commit-queue restarts itself every 2 hours. After restart the commit-queue will correctly respect your committer rights.
Comment on attachment 277084 [details] Patch Clearing flags on attachment: 277084 Committed r199916: <http://trac.webkit.org/changeset/199916>
All reviewed patches have been landed. Closing bug.
Re-opened since this is blocked by bug 156989
Comment on attachment 277084 [details] Patch View in context: https://bugs.webkit.org/attachment.cgi?id=277084&action=review > Tools/BuildSlaveSupport/build.webkit.org-config/master.cfg:302 > + command = ["perl", "./Tools/Scripts/run-javascriptcore-tests", "--no-build", WithProperties("--%(configuration)s", "--json-output=%(_jsonFileName)s")] This will either break buildbot or will not have the desired effect because WithProperties() only interpolates BuildBot property names and will try to substitute the value of the non-existent BuildBot property _jsonFileName for %(_jsonFileName)s. That is, WithProperties() will not interpolate the value of the local variable _jsonFileName. > Tools/BuildSlaveSupport/build.webkit.org-config/master.cfg:304 > + logfiles = {"json": _jsonFileName} As mentioned to Srinivasan in-person today (04/25), I do not see the need to add the JSON output files as a log file that is hyperlinked from a Buildbot build page as a human is unlikely to make use of the JSON result. Moreover, we should explicitly upload the JSON output from the slave to the master (say, as part of the layout test results archive) instead of taking advantage of the implicit uploading of log files.
> As mentioned to Srinivasan in-person today (04/25), I do not see the need to add the JSON output files as a log file that is hyperlinked from a Buildbot build page as a human is unlikely to make use of the JSON result. I think that it's valuable to have the link for debugging, if nothing else. > Moreover, we should explicitly upload the JSON output from the slave to the master (say, as part of the layout test results archive) instead of taking advantage of the implicit uploading of log files. This is definitely not part of the layout tests archive, so we would need to devise an entirely new location for it (including a cleanup strategy etc). It seemed like an overkill to me.
Created attachment 277531 [details] Patch
Now using Python's .format() method for interpolation.
Created attachment 277713 [details] Patch
Comment on attachment 277713 [details] Patch View in context: https://bugs.webkit.org/attachment.cgi?id=277713&action=review r=me > Tools/BuildSlaveSupport/build.webkit.org-config/master.cfg:302 > + command = ["perl", "./Tools/Scripts/run-javascriptcore-tests", "--no-build", WithProperties("--%(configuration)s", "--json-output={0}".format(jsonFileName))] This is OK as-is. We could have passed jsonFileName as an explicit argument instead of interpolating it into the --json-output argument as Getopt::Long, used by run-javascriptcore-tests to parse command line arguments, is smart enough to know that the argument that follow the flag --json-output is the value for the flag.
Comment on attachment 277713 [details] Patch Clearing flags on attachment: 277713 Committed r200253: <http://trac.webkit.org/changeset/200253>
Fix on the way!
Created attachment 278150 [details] Patch
Comment on attachment 278150 [details] Patch Clearing flags on attachment: 278150 Committed r200450: <http://trac.webkit.org/changeset/200450>