Bug 181555 - webkitpy: Fix flakey webserver tests
Summary: webkitpy: Fix flakey webserver tests
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: Other
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Jonathan Bedard
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2018-01-11 13:20 PST by Jonathan Bedard
Modified: 2018-01-11 16:23 PST (History)
7 users (show)

See Also:


Attachments
Patch (2.39 KB, patch)
2018-01-11 13:37 PST, Jonathan Bedard
aakash_jain: review+
ews-watchlist: commit-queue-
Details | Formatted Diff | Diff
Archive of layout-test-results from ews100 for mac-sierra (2.38 MB, application/zip)
2018-01-11 15:42 PST, EWS Watchlist
no flags Details
Archive of layout-test-results from ews107 for mac-sierra-wk2 (2.91 MB, application/zip)
2018-01-11 16:13 PST, EWS Watchlist
no flags Details

Note You need to log in before you can comment on or make changes to this bug.
Description Jonathan Bedard 2018-01-11 13:20:19 PST
Our webkitpy unit tests which test the logic behind starting and stopping certain web servers are flakey because they run the actual check to verify if a certain server is running. This is incorrect, we should be mocking out this check.
Comment 1 Radar WebKit Bug Importer 2018-01-11 13:21:58 PST
<rdar://problem/36448273>
Comment 2 Jonathan Bedard 2018-01-11 13:37:54 PST
Created attachment 331110 [details]
Patch
Comment 3 Jonathan Bedard 2018-01-11 14:04:28 PST
webkitpy tests are failing with the following test failure:

webkitpy.layout_tests.controllers.layout_test_runner_unittest.LayoutTestRunnerTests.test_servers_started failed:                      
  Traceback (most recent call last):
    File ".../WebKit/Tools/Scripts/webkitpy/layout_tests/controllers/layout_test_runner_unittest.py", line 178, in test_servers_started
      self.assertEqual(self.http_started, True)
  AssertionError: False != True
Comment 4 EWS Watchlist 2018-01-11 15:42:26 PST
Comment on attachment 331110 [details]
Patch

Attachment 331110 [details] did not pass mac-ews (mac):
Output: http://webkit-queues.webkit.org/results/6041208

New failing tests:
webgl/1.0.2/conformance/uniforms/uniform-default-values.html
Comment 5 EWS Watchlist 2018-01-11 15:42:27 PST
Created attachment 331128 [details]
Archive of layout-test-results from ews100 for mac-sierra

The attached test failures were seen while running run-webkit-tests on the mac-ews.
Bot: ews100  Port: mac-sierra  Platform: Mac OS X 10.12.6
Comment 6 EWS Watchlist 2018-01-11 16:13:22 PST
Comment on attachment 331110 [details]
Patch

Attachment 331110 [details] did not pass mac-wk2-ews (mac-wk2):
Output: http://webkit-queues.webkit.org/results/6041528

New failing tests:
webgl/1.0.2/conformance/uniforms/uniform-default-values.html
Comment 7 EWS Watchlist 2018-01-11 16:13:24 PST
Created attachment 331135 [details]
Archive of layout-test-results from ews107 for mac-sierra-wk2

The attached test failures were seen while running run-webkit-tests on the mac-wk2-ews.
Bot: ews107  Port: mac-sierra-wk2  Platform: Mac OS X 10.12.6
Comment 8 Jonathan Bedard 2018-01-11 16:23:57 PST
Committed r226820: <https://trac.webkit.org/changeset/226820>