Bug 206607 - WebKitTestRunner: use ad hoc signing for internal Production builds
Summary: WebKitTestRunner: use ad hoc signing for internal Production builds
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Jiewen Tan
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2020-01-22 12:10 PST by Jiewen Tan
Modified: 2020-01-30 15:59 PST (History)
10 users (show)

See Also:


Attachments
Patch (2.42 KB, patch)
2020-01-22 12:20 PST, Jiewen Tan
jbedard: review+
Details | Formatted Diff | Diff
Patch V2 (3.06 KB, patch)
2020-01-22 15:33 PST, Jiewen Tan
no flags Details | Formatted Diff | Diff
Patch V3 (2.29 KB, patch)
2020-01-22 16:36 PST, Jiewen Tan
no flags Details | Formatted Diff | Diff
Patch V4 (1.58 KB, patch)
2020-01-22 16:51 PST, Jiewen Tan
no flags Details | Formatted Diff | Diff
Patch V5 (1.44 KB, patch)
2020-01-23 15:08 PST, Jiewen Tan
no flags Details | Formatted Diff | Diff
Patch V5 (1.45 KB, patch)
2020-01-23 15:12 PST, Jiewen Tan
jbedard: review+
Details | Formatted Diff | Diff
Another speculative test fix (4.19 KB, patch)
2020-01-30 13:43 PST, Jiewen Tan
ap: review+
Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Jiewen Tan 2020-01-22 12:10:50 PST
WebKitTestRunner: move code sign configurations from WebKitTestRunner.xcconfig to DebugRelease.xcconfig.
Comment 1 Jiewen Tan 2020-01-22 12:11:13 PST
<rdar://problem/56087327>
Comment 2 Jiewen Tan 2020-01-22 12:20:11 PST
Created attachment 388456 [details]
Patch
Comment 3 Alexey Proskuryakov 2020-01-22 12:57:34 PST
Comment on attachment 388456 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=388456&action=review

> Tools/ChangeLog:3
> +        WebKitTestRunner: move code sign configurations from WebKitTestRunner.xcconfig to DebugRelease.xcconfig

This is probably fine, but I don't understand why this changes any behavior. These Xcode settings shouldn't matter for production builds AFAIK.
Comment 4 Jonathan Bedard 2020-01-22 13:05:30 PST
This more closely matches what we've done for JavaScriptCore and WebKit, so even if this doesn't fix Jiewen's problem (and I'm not convinced it will) it does seem more correct than what we were doing previously.
Comment 5 Jonathan Bedard 2020-01-22 13:08:09 PST
Comment on attachment 388456 [details]
Patch

Lets wait for a more authoritative answer from EWS, if this is going to break open source, EWS should catch it.
Comment 6 Jiewen Tan 2020-01-22 15:33:39 PST
Created attachment 388476 [details]
Patch V2
Comment 7 Jiewen Tan 2020-01-22 15:37:38 PST
(In reply to Jiewen Tan from comment #6)
> Created attachment 388476 [details]
> Patch V2

This is an attempt to address those layout test failures.
Comment 8 Jiewen Tan 2020-01-22 16:36:21 PST
Created attachment 388483 [details]
Patch V3
Comment 9 Jiewen Tan 2020-01-22 16:51:35 PST
Created attachment 388486 [details]
Patch V4
Comment 10 Alexey Proskuryakov 2020-01-22 17:04:41 PST
Comment on attachment 388486 [details]
Patch V4

Yes, I think that this is right. May be worth doing a production build locally to be super safe.
Comment 11 Jiewen Tan 2020-01-22 17:09:18 PST
(In reply to Alexey Proskuryakov from comment #10)
> Comment on attachment 388486 [details]
> Patch V4
> 
> Yes, I think that this is right. May be worth doing a production build
> locally to be super safe.

Thanks Alexey for r+ this patch.
Comment 12 Jiewen Tan 2020-01-22 17:32:01 PST
Comment on attachment 388486 [details]
Patch V4

cq+ as mac-wk2 is green.
Comment 13 WebKit Commit Bot 2020-01-22 18:14:59 PST
Comment on attachment 388486 [details]
Patch V4

Clearing flags on attachment: 388486

Committed r254955: <https://trac.webkit.org/changeset/254955>
Comment 14 Jiewen Tan 2020-01-22 20:54:34 PST
Reverted r254955 for reason:

Broke internal builds

Committed r254963: <https://trac.webkit.org/changeset/254963>
Comment 15 Jiewen Tan 2020-01-23 15:08:21 PST
Created attachment 388596 [details]
Patch V5
Comment 16 Jiewen Tan 2020-01-23 15:12:49 PST
Created attachment 388597 [details]
Patch V5
Comment 17 Jonathan Bedard 2020-01-23 15:51:59 PST
Comment on attachment 388597 [details]
Patch V5

Not a super great way to test this one, so we probably need to actually tests this with production builders.

Keith and Jiewen talked about this, and think it will fix our problems.

I'm going to r+ so we can test this, Jiewen said he's going to watch the bots to rollout if everything catches on fire.
Comment 18 Jiewen Tan 2020-01-23 15:55:54 PST
(In reply to Jonathan Bedard from comment #17)
> Comment on attachment 388597 [details]
> Patch V5
> 
> Not a super great way to test this one, so we probably need to actually
> tests this with production builders.
> 
> Keith and Jiewen talked about this, and think it will fix our problems.
> 
> I'm going to r+ so we can test this, Jiewen said he's going to watch the
> bots to rollout if everything catches on fire.

Thank you, Jonathan. Will land it manually to catch things faster.
Comment 19 Jiewen Tan 2020-01-23 15:57:46 PST
Committed r255041: <https://trac.webkit.org/changeset/255041>
Comment 20 Jiewen Tan 2020-01-24 17:28:22 PST
A speculative test fix:
Committed r255111: <https://trac.webkit.org/changeset/255111>
Comment 21 Jiewen Tan 2020-01-27 15:29:14 PST
A build fix after r255111:
Committed r255188: <https://trac.webkit.org/changeset/255188>
Comment 22 Jiewen Tan 2020-01-30 13:43:01 PST
Reopening to attach new patch.
Comment 23 Jiewen Tan 2020-01-30 13:43:02 PST
Created attachment 389282 [details]
Another speculative test fix
Comment 24 Alexey Proskuryakov 2020-01-30 13:47:54 PST
Comment on attachment 389282 [details]
Another speculative test fix

View in context: https://bugs.webkit.org/attachment.cgi?id=389282&action=review

> Source/WebKit/ChangeLog:3
> +        Unreviewed, another speculative test fix after r255041

This says "unreviewed", but the patch is marked for review. Looks reasonable, rs=me with one question.

> Tools/WebKitTestRunner/cocoa/TestControllerCocoa.mm:359
> +        (id)kSecAttrAccessible: (id)kSecAttrAccessibleAfterFirstUnlock,

Why not kSecAttrAccessibleAlways? I don't think that there is a practical difference, but "always" is what we want for testing, so it seems better to request that explicitly.
Comment 25 Jiewen Tan 2020-01-30 13:54:40 PST
Thanks, Alexey.

(In reply to Alexey Proskuryakov from comment #24)
> Comment on attachment 389282 [details]
> Another speculative test fix
> 
> View in context:
> https://bugs.webkit.org/attachment.cgi?id=389282&action=review
> 
> > Source/WebKit/ChangeLog:3
> > +        Unreviewed, another speculative test fix after r255041
> 
> This says "unreviewed", but the patch is marked for review. Looks
> reasonable, rs=me with one question.
> 
> > Tools/WebKitTestRunner/cocoa/TestControllerCocoa.mm:359
> > +        (id)kSecAttrAccessible: (id)kSecAttrAccessibleAfterFirstUnlock,
> 
> Why not kSecAttrAccessibleAlways? I don't think that there is a practical
> difference, but "always" is what we want for testing, so it seems better to
> request that explicitly.

The API is marked as deprecated. I guess we should avoid using deprecated API.
Comment 26 Jiewen Tan 2020-01-30 15:59:46 PST
Committed r255466: <https://trac.webkit.org/changeset/255466>