Bug 189009 - Bundle unified sources more tightly in projects with deep directory structures
Summary: Bundle unified sources more tightly in projects with deep directory structures
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Tim Horton
URL:
Keywords: InRadar
: 189370 (view as bug list)
Depends on:
Blocks:
 
Reported: 2018-08-27 14:48 PDT by Tim Horton
Modified: 2018-09-06 14:43 PDT (History)
8 users (show)

See Also:


Attachments
Patch (33.52 KB, patch)
2018-08-27 14:49 PDT, Tim Horton
no flags Details | Formatted Diff | Diff
Patch (57.21 KB, patch)
2018-08-27 15:23 PDT, Tim Horton
no flags Details | Formatted Diff | Diff
Patch (57.21 KB, patch)
2018-08-27 15:25 PDT, Tim Horton
no flags Details | Formatted Diff | Diff
Patch (60.84 KB, patch)
2018-08-27 15:26 PDT, Tim Horton
no flags Details | Formatted Diff | Diff
Patch (58.44 KB, patch)
2018-08-27 15:28 PDT, Tim Horton
no flags Details | Formatted Diff | Diff
Patch (50.47 KB, patch)
2018-08-27 15:30 PDT, Tim Horton
no flags Details | Formatted Diff | Diff
Patch (53.78 KB, patch)
2018-08-27 15:48 PDT, Tim Horton
no flags Details | Formatted Diff | Diff
Patch (54.27 KB, patch)
2018-08-27 16:04 PDT, Tim Horton
no flags Details | Formatted Diff | Diff
Patch (54.78 KB, patch)
2018-08-27 16:24 PDT, Tim Horton
no flags Details | Formatted Diff | Diff
Patch (54.79 KB, patch)
2018-08-27 16:29 PDT, Tim Horton
no flags Details | Formatted Diff | Diff
Patch (54.76 KB, patch)
2018-08-27 16:45 PDT, Tim Horton
no flags Details | Formatted Diff | Diff
Patch (53.64 KB, patch)
2018-08-27 18:02 PDT, Tim Horton
no flags Details | Formatted Diff | Diff
Patch (54.08 KB, patch)
2018-08-27 18:22 PDT, Tim Horton
no flags Details | Formatted Diff | Diff
Patch (55.08 KB, patch)
2018-08-27 19:03 PDT, Tim Horton
no flags Details | Formatted Diff | Diff
Patch (55.98 KB, patch)
2018-08-27 19:26 PDT, Tim Horton
no flags Details | Formatted Diff | Diff
Patch (56.50 KB, patch)
2018-08-27 19:27 PDT, Tim Horton
no flags Details | Formatted Diff | Diff
Patch (57.68 KB, patch)
2018-08-27 20:40 PDT, Tim Horton
no flags Details | Formatted Diff | Diff
Patch (58.97 KB, patch)
2018-08-27 20:58 PDT, Tim Horton
no flags Details | Formatted Diff | Diff
Patch (59.93 KB, patch)
2018-08-27 21:28 PDT, Tim Horton
no flags Details | Formatted Diff | Diff
Patch (60.49 KB, patch)
2018-08-27 22:42 PDT, Tim Horton
no flags Details | Formatted Diff | Diff
Patch (61.15 KB, patch)
2018-08-28 10:53 PDT, Tim Horton
no flags Details | Formatted Diff | Diff
Patch (61.67 KB, patch)
2018-08-28 11:32 PDT, Tim Horton
no flags Details | Formatted Diff | Diff
Patch (62.34 KB, patch)
2018-08-28 12:45 PDT, Tim Horton
no flags Details | Formatted Diff | Diff
Patch (63.42 KB, patch)
2018-08-29 20:03 PDT, Michael Catanzaro
no flags Details | Formatted Diff | Diff
Patch (63.51 KB, patch)
2018-08-30 11:57 PDT, Tim Horton
no flags Details | Formatted Diff | Diff
Patch (62.88 KB, patch)
2018-08-30 12:11 PDT, Tim Horton
no flags Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Tim Horton 2018-08-27 14:48:21 PDT
Bundle unified sources more tightly in projects with deep directory structures
Comment 1 Tim Horton 2018-08-27 14:49:31 PDT
Created attachment 348203 [details]
Patch
Comment 2 Tim Horton 2018-08-27 15:23:47 PDT
Created attachment 348211 [details]
Patch
Comment 3 Tim Horton 2018-08-27 15:25:12 PDT
Created attachment 348212 [details]
Patch
Comment 4 Alex Christensen 2018-08-27 15:25:58 PDT
Comment on attachment 348212 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=348212&action=review

> Source/WebKit/ChangeLog:50
> +2018-08-27  Tim Horton  <timothy_horton@apple.com>

double change log
Comment 5 Tim Horton 2018-08-27 15:26:48 PDT
Created attachment 348213 [details]
Patch
Comment 6 Tim Horton 2018-08-27 15:28:01 PDT
Created attachment 348214 [details]
Patch
Comment 7 Tim Horton 2018-08-27 15:30:25 PDT
Created attachment 348215 [details]
Patch
Comment 8 Alex Christensen 2018-08-27 15:35:00 PDT
Comment on attachment 348212 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=348212&action=review

> Source/WebCore/page/AlternativeTextClient.h:-34
> -#define USE_DICTATION_ALTERNATIVES 1

There's a FIXME in WebPageProxy.h about this.
Comment 9 Tim Horton 2018-08-27 15:48:55 PDT
Created attachment 348222 [details]
Patch
Comment 10 Tim Horton 2018-08-27 16:04:47 PDT
Created attachment 348228 [details]
Patch
Comment 11 Alex Christensen 2018-08-27 16:07:18 PDT
r=me
Comment 12 Tim Horton 2018-08-27 16:24:12 PDT
Created attachment 348233 [details]
Patch
Comment 13 Tim Horton 2018-08-27 16:29:07 PDT
Created attachment 348234 [details]
Patch
Comment 14 Tim Horton 2018-08-27 16:42:34 PDT
The WPE failure is super weird.
Comment 15 Tim Horton 2018-08-27 16:45:56 PDT
Created attachment 348238 [details]
Patch
Comment 16 Tim Horton 2018-08-27 18:02:50 PDT
Created attachment 348245 [details]
Patch
Comment 17 Tim Horton 2018-08-27 18:22:38 PDT
Created attachment 348248 [details]
Patch
Comment 18 Tim Horton 2018-08-27 19:03:05 PDT
Created attachment 348250 [details]
Patch
Comment 19 Tim Horton 2018-08-27 19:26:40 PDT
Created attachment 348252 [details]
Patch
Comment 20 Tim Horton 2018-08-27 19:27:54 PDT
Created attachment 348254 [details]
Patch
Comment 21 Tim Horton 2018-08-27 20:40:39 PDT
Created attachment 348259 [details]
Patch
Comment 22 Tim Horton 2018-08-27 20:57:57 PDT
Seems like X11 headers are super dirty (at least, have a macro `None`). So I'm de-unifying some GTK things to keep it building.
Comment 23 Tim Horton 2018-08-27 20:58:39 PDT
Created attachment 348261 [details]
Patch
Comment 24 Tim Horton 2018-08-27 21:28:00 PDT
Created attachment 348263 [details]
Patch
Comment 25 Tim Horton 2018-08-27 22:42:09 PDT
Created attachment 348264 [details]
Patch
Comment 26 Michael Catanzaro 2018-08-28 06:06:19 PDT
(In reply to Tim Horton from comment #22)
> Seems like X11 headers are super dirty (at least, have a macro `None`). So
> I'm de-unifying some GTK things to keep it building.

Yeah, that None's pretty infamous. :/ X11 is 80s technology, I'm afraid.
Comment 27 Michael Catanzaro 2018-08-28 06:09:38 PDT
Does this commit lead to a good build speedup? If so, then OK, but otherwise perhaps it's not worth it? It's not surprising that unifying files from different directories is harder.
Comment 28 Michael Catanzaro 2018-08-28 06:18:09 PDT
BTW, I'll try to help with the GTK and WPE builds later today or tomorrow.
Comment 29 Tim Horton 2018-08-28 08:51:11 PDT
(In reply to Michael Catanzaro from comment #27)
> Does this commit lead to a good build speedup? If so, then OK, but otherwise
> perhaps it's not worth it? It's not surprising that unifying files from
> different directories is harder.

In WebKit2 it’s quite sizable. In WebCore there’s impact but less huge.

I think WPE is ok, and Gtk is clooooose.
Comment 30 Tim Horton 2018-08-28 10:40:02 PDT
(In reply to Tim Horton from comment #29)
> (In reply to Michael Catanzaro from comment #27)
> > Does this commit lead to a good build speedup? If so, then OK, but otherwise
> > perhaps it's not worth it? It's not surprising that unifying files from
> > different directories is harder.

ALSO, many of these fixes are errors that have crept in since we turned on unified sources and would affect our ability to build singly, so they're good to fix regardless.

> In WebKit2 it’s quite sizable. In WebCore there’s impact but less huge.
> 
> I think WPE is ok, and Gtk is clooooose.
Comment 31 Tim Horton 2018-08-28 10:53:20 PDT
Created attachment 348311 [details]
Patch
Comment 32 Tim Horton 2018-08-28 11:32:51 PDT
Created attachment 348314 [details]
Patch
Comment 33 Tim Horton 2018-08-28 12:45:22 PDT
Created attachment 348324 [details]
Patch
Comment 34 Tim Horton 2018-08-28 13:01:55 PDT
I'm going to give up until mcatanzaro has a chance to peek at GTK.
Comment 35 Michael Catanzaro 2018-08-28 13:56:50 PDT
OK. Right now I am attempting to figure out which of 235407-235410 (inclusive) has busted the layout tests so badly for GTK. I've never had so much trouble before.

This bug is next!
Comment 36 Michael Catanzaro 2018-08-28 14:09:34 PDT
Oh, just from glancing at EWS, you busted Windows too. :P The Ruby process is crashing. Congrats!


[NOTE]
You may have encountered a bug in the Ruby interpreter or extension libraries.
Bug reports are welcome.
For details: http://www.ruby-lang.org/bugreport.html

      0 [main] ruby 8204 cygwin_exception::open_stackdumpfile: Dumping stack trace to ruby.exe.stackdump
CMake Error at Source/cmake/WebKitMacros.cmake:47 (message):
  generate-unified-source-bundles.rb exited with non-zero status, exiting
Call Stack (most recent call first):
  Source/JavaScriptCore/CMakeLists.txt:1227 (WEBKIT_COMPUTE_SOURCES)
Comment 37 Tim Horton 2018-08-28 14:22:47 PDT
Oddly windows built fine a few patches ago.
Comment 38 Simon Fraser (smfr) 2018-08-28 15:18:44 PDT
(In reply to Michael Catanzaro from comment #35)
> OK. Right now I am attempting to figure out which of 235407-235410
> (inclusive) has busted the layout tests so badly for GTK. I've never had so
> much trouble before.

Did I break it with https://trac.webkit.org/changeset/235408/webkit ?
Comment 39 Michael Catanzaro 2018-08-28 15:33:25 PDT
(In reply to Simon Fraser (smfr) from comment #38)
> Did I break it with https://trac.webkit.org/changeset/235408/webkit ?

Probably either that one or r235409... I wanted to narrow it down to the right commit, for starters. Thanks for your interest. Let's discuss in bug #189009.
Comment 40 Michael Catanzaro 2018-08-28 19:54:24 PDT
Um, I meant bug #189063.

Tim, I'll be back tomorrow to try to get GTK building here.
Comment 41 Michael Catanzaro 2018-08-29 18:36:05 PDT
(In reply to Michael Catanzaro from comment #40)
> Um, I meant bug #189063.
> 
> Tim, I'll be back tomorrow to try to get GTK building here.

Um, tomorrow again, sorry!
Comment 42 Michael Catanzaro 2018-08-29 20:03:17 PDT
Just kidding, tonight!
Comment 43 Michael Catanzaro 2018-08-29 20:03:41 PDT
Created attachment 348474 [details]
Patch
Comment 44 Tim Horton 2018-08-30 11:57:20 PDT
Created attachment 348522 [details]
Patch
Comment 45 Tim Horton 2018-08-30 11:57:36 PDT
Taking a stab at making the ruby slightly worse to not crash on windows.
Comment 46 Tim Horton 2018-08-30 12:11:40 PDT
Created attachment 348525 [details]
Patch
Comment 47 Daniel Bates 2018-09-06 14:39:09 PDT
*** Bug 189370 has been marked as a duplicate of this bug. ***
Comment 48 Radar WebKit Bug Importer 2018-09-06 14:42:25 PDT
<rdar://problem/44198126>
Comment 49 Tim Horton 2018-09-06 14:43:33 PDT
https://trac.webkit.org/changeset/235521/webkit