Bug 179958

Summary: Fast binding generation by batching several files at once
Product: WebKit Reporter: Basuke Suzuki <basuke>
Component: Tools / TestsAssignee: Basuke Suzuki <basuke>
Status: RESOLVED FIXED    
Severity: Normal CC: achristensen, basuke, cdumez, commit-queue, don.olmstead, ews-watchlist, Hironori.Fujii, lforschler, sam, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
Attachments:
Description Flags
patch
none
fix
achristensen: review+, achristensen: commit-queue-
fixed none

Basuke Suzuki
Reported 2017-11-22 15:27:11 PST
Bindings generation spawns sub processes for each idl files, but fork/exec pattern is very slow on Windows. To reduce the process generation, control script can pass several files at once to the process. Here is a statistics for 796 idl files: Current imprementation: 386 secs Batching 10 files: 63 secs Aggressive approach: 36 secs (rest of files / number of process)
Attachments
patch (16.46 KB, patch)
2017-11-22 15:41 PST, Basuke Suzuki
no flags
fix (16.46 KB, patch)
2017-11-27 16:09 PST, Basuke Suzuki
achristensen: review+
achristensen: commit-queue-
fixed (16.42 KB, patch)
2017-12-05 17:28 PST, Basuke Suzuki
no flags
Basuke Suzuki
Comment 1 2017-11-22 15:41:47 PST
Basuke Suzuki
Comment 2 2017-11-27 16:09:58 PST
Alex Christensen
Comment 3 2017-11-28 10:43:33 PST
I'm ok with this as long as Sam doesn't object.
Alex Christensen
Comment 4 2017-11-28 11:19:57 PST
Comment on attachment 327708 [details] fix View in context: https://bugs.webkit.org/attachment.cgi?id=327708&action=review > Source/WebCore/bindings/scripts/generate-bindings-all.pl:167 > + my $batchCount = 30; > + # my $batchCount = int(($totalCount - $currentCount) / $numOfJobs) || 1; Let's not comment out a line. Also, the second line isn't quite right either. As it is it strangely gives smaller batches as work progresses. Let's do something more like $totalCount / $numOfJobs.
Basuke Suzuki
Comment 5 2017-12-05 17:28:03 PST
Created attachment 328537 [details] fixed fixed as Alex reviewed.
WebKit Commit Bot
Comment 6 2017-12-05 19:54:54 PST
Comment on attachment 328537 [details] fixed Clearing flags on attachment: 328537 Committed r225565: <https://trac.webkit.org/changeset/225565>
WebKit Commit Bot
Comment 7 2017-12-05 19:54:56 PST
All reviewed patches have been landed. Closing bug.
Radar WebKit Bug Importer
Comment 8 2017-12-06 16:47:15 PST
Note You need to log in before you can comment on or make changes to this bug.