Bug 284761

Summary:	[WKTR] imported/w3c/web-platform-tests/screen-orientation/orientation-reading.html is consistently failing, flunking EWS iOS WPT testing.
Product:	WebKit	Reporter:	Ben Schwartz <ben_schwartz>
Component:	Tools / Tests	Assignee:	Nobody <webkit-unassigned>
Status:	NEW
Severity:	Normal	CC:	webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Unspecified
OS:	Unspecified

Ben Schwartz

Reported 2024-12-16 10:22:24 PST

imported/w3c/web-platform-tests/screen-orientation/orientation-reading.html This test is consistently failing, which is flunking iOS WPT layout test runs on EWS. Example runs: - https://ews-build.webkit.org/#/builders/133/builds/426 - https://ews-build.webkit.org/#/builders/133/builds/436 Example error: ``` 09:38:09.786 8671 worker/2 "ruby -I /Volumes/Data/worker/iOS-18-Simulator-WPT-WK2-Tests-EWS/build/Websites/bugs.webkit.org/PrettyPatch /Volumes/Data/worker/iOS-18-Simulator-WPT-WK2-Tests-EWS/build/Websites/bugs.webkit.org/PrettyPatch/prettify.rb /Volumes/Data/worker/iOS-18-Simulator-WPT-WK2-Tests-EWS/build/layout-test-results/imported/w3c/web-platform-tests/screen-orientation/orientation-reading-diff.txt" took 0.10s 09:38:09.786 8671 [29851/34422] imported/w3c/web-platform-tests/screen-orientation/orientation-reading.html failed unexpectedly (text diff) 09:38:09.786 8671 worker/2 imported/w3c/web-platform-tests/screen-orientation/orientation-reading.html failed: 09:38:09.786 8671 worker/2 text diff 09:38:09.786 8671 worker/2 finished test group 09:38:09.786 8671 worker/2 This test marked as a crash because of failure to poll the server process (return code was 1). 09:38:09.792 8671 worker/2 "/usr/libexec/PlistBuddy -c Print CFBundleExecutable /Volumes/Data/worker/iOS-18-Simulator-WPT-WK2-Tests-EWS/build/WebKitBuild/Release-iphonesimulator/WebKitTestRunnerApp.app/Info.plist" took 0.01s 09:38:09.792 8671 worker/2 killing driver ... 09:43:11.607 8671 worker/2 "xcrun simctl launch 6544CE58-644F-4DB4-84BD-66C695858FD7 org.webkit.WebKitTestRunnerApp -" timed out after 300.00s 09:43:11.608 8671 worker/2 Failed to run "['xcrun', 'simctl', 'launch', '6544CE58-644F-4DB4-84BD-66C695858FD7', 'org.webkit.WebKitTestRunnerApp', '-']" exit_code: 255 09:43:11.609 8671 worker/2 simctl launch did not report a pid 09:43:11.620 8671 worker/2 cleaning up 09:43:11.621 8671 worker/2 killing driver 09:43:11.622 8671 worker/2 stopping ... 09:43:27.107 8671 RuntimeError("Timed out waiting for process to open org.webkit.WebKitTestRunnerApp on 6544CE58-644F-4DB4-84BD-66C695858FD7 (from worker/2)") raised, exiting ... RuntimeError raised: Timed out waiting for process to open org.webkit.WebKitTestRunnerApp on 6544CE58-644F-4DB4-84BD-66C695858FD7 (from worker/2) Traceback (most recent call last): File "/Volumes/Data/worker/iOS-18-Simulator-WPT-WK2-Tests-EWS/build/Tools/Scripts/webkitpy/layout_tests/run_webkit_tests.py", line 94, in main run_details = run(port, options, args, stderr) File "/Volumes/Data/worker/iOS-18-Simulator-WPT-WK2-Tests-EWS/build/Tools/Scripts/webkitpy/layout_tests/run_webkit_tests.py", line 574, in run run_details = manager.run(args) File "/Volumes/Data/worker/iOS-18-Simulator-WPT-WK2-Tests-EWS/build/Tools/Scripts/webkitpy/layout_tests/controllers/manager.py", line 450, in run temp_initial_results, temp_retry_results, temp_enabled_pixel_tests_in_retry = self._run_test_subset(test_inputs, device_type=device_type) File "/Volumes/Data/worker/iOS-18-Simulator-WPT-WK2-Tests-EWS/build/Tools/Scripts/webkitpy/layout_tests/controllers/manager.py", line 524, in _run_test_subset initial_results = self._run_tests(test_inputs, self._options.repeat_each, self._options.iterations, int(self._options.child_processes), retrying=False, device_type=device_type) File "/Volumes/Data/worker/iOS-18-Simulator-WPT-WK2-Tests-EWS/build/Tools/Scripts/webkitpy/layout_tests/controllers/manager.py", line 607, in _run_tests return self._runner.run_tests(self._expectations[device_type], new_test_inputs, num_workers, retrying, device_type) File "/Volumes/Data/worker/iOS-18-Simulator-WPT-WK2-Tests-EWS/build/Tools/Scripts/webkitpy/layout_tests/controllers/layout_test_runner.py", line 200, in run_tests pool.wait() File "/Volumes/Data/worker/iOS-18-Simulator-WPT-WK2-Tests-EWS/build/Tools/Scripts/libraries/webkitcorepy/webkitcorepy/task_pool.py", line 497, in wait self.queue.receive()(self) File "/Volumes/Data/worker/iOS-18-Simulator-WPT-WK2-Tests-EWS/build/Tools/Scripts/libraries/webkitcorepy/webkitcorepy/task_pool.py", line 133, in __call__ reraise(*self.exc_info) File "/Volumes/Data/worker/iOS-18-Simulator-WPT-WK2-Tests-EWS/build/Tools/Scripts/libraries/autoinstalled/python-3-arm64/six.py", line 718, in reraise raise value.with_traceback(tb) File "/Volumes/Data/worker/iOS-18-Simulator-WPT-WK2-Tests-EWS/build/Tools/Scripts/libraries/webkitcorepy/webkitcorepy/task_pool.py", line 347, in main queue.send(_Result(value=task(None), id=task.id)) File "/Volumes/Data/worker/iOS-18-Simulator-WPT-WK2-Tests-EWS/build/Tools/Scripts/libraries/webkitcorepy/webkitcorepy/task_pool.py", line 53, in __call__ return self.function(*self.args, **self.kwargs) File "/Volumes/Data/worker/iOS-18-Simulator-WPT-WK2-Tests-EWS/build/Tools/Scripts/webkitpy/layout_tests/controllers/layout_test_runner.py", line 77, in run_shard return Worker.instance.run_tests(shard) File "/Volumes/Data/worker/iOS-18-Simulator-WPT-WK2-Tests-EWS/build/Tools/Scripts/webkitpy/layout_tests/controllers/layout_test_runner.py", line 345, in run_tests Worker.instance.run_test(input, shard.name) File "/Volumes/Data/worker/iOS-18-Simulator-WPT-WK2-Tests-EWS/build/Tools/Scripts/webkitpy/layout_tests/controllers/layout_test_runner.py", line 373, in run_test result = self._run_test_with_or_without_timeout(test_input, test_timeout_sec, stop_when_done) File "/Volumes/Data/worker/iOS-18-Simulator-WPT-WK2-Tests-EWS/build/Tools/Scripts/webkitpy/layout_tests/controllers/layout_test_runner.py", line 430, in _run_test_with_or_without_timeout return self._run_test_in_this_thread(test_input, stop_when_done) File "/Volumes/Data/worker/iOS-18-Simulator-WPT-WK2-Tests-EWS/build/Tools/Scripts/webkitpy/layout_tests/controllers/layout_test_runner.py", line 516, in _run_test_in_this_thread return self._run_single_test(self._driver, test_input, stop_when_done) File "/Volumes/Data/worker/iOS-18-Simulator-WPT-WK2-Tests-EWS/build/Tools/Scripts/webkitpy/layout_tests/controllers/layout_test_runner.py", line 519, in _run_single_test return single_test_runner.run_single_test( File "/Volumes/Data/worker/iOS-18-Simulator-WPT-WK2-Tests-EWS/build/Tools/Scripts/webkitpy/layout_tests/controllers/single_test_runner.py", line 51, in run_single_test return runner.run() File "/Volumes/Data/worker/iOS-18-Simulator-WPT-WK2-Tests-EWS/build/Tools/Scripts/webkitpy/layout_tests/controllers/single_test_runner.py", line 175, in run return self._run_wpt_crash_test() File "/Volumes/Data/worker/iOS-18-Simulator-WPT-WK2-Tests-EWS/build/Tools/Scripts/webkitpy/layout_tests/controllers/single_test_runner.py", line 203, in _run_wpt_crash_test driver_output = self._driver.run_test(self._driver_input(), self._stop_when_done) File "/Volumes/Data/worker/iOS-18-Simulator-WPT-WK2-Tests-EWS/build/Tools/Scripts/webkitpy/port/driver.py", line 888, in run_test return self._driver.run_test(driver_input, stop_when_done) File "/Volumes/Data/worker/iOS-18-Simulator-WPT-WK2-Tests-EWS/build/Tools/Scripts/webkitpy/port/driver.py", line 217, in run_test self.start(driver_input.should_run_pixel_test, driver_input.args) File "/Volumes/Data/worker/iOS-18-Simulator-WPT-WK2-Tests-EWS/build/Tools/Scripts/webkitpy/port/driver.py", line 455, in start self._start(pixel_tests, per_test_args) File "/Volumes/Data/worker/iOS-18-Simulator-WPT-WK2-Tests-EWS/build/Tools/Scripts/webkitpy/port/driver.py", line 531, in _start self._server_process.start() File "/Volumes/Data/worker/iOS-18-Simulator-WPT-WK2-Tests-EWS/build/Tools/Scripts/webkitpy/port/server_process.py", line 389, in start self._start() File "/Volumes/Data/worker/iOS-18-Simulator-WPT-WK2-Tests-EWS/build/Tools/Scripts/webkitpy/port/simulator_process.py", line 106, in _start self._pid = self._target_host.launch_app(self._bundle_id, self._cmd[1:], env=self._env) File "/Volumes/Data/worker/iOS-18-Simulator-WPT-WK2-Tests-EWS/build/Tools/Scripts/webkitpy/port/device.py", line 45, in launch_app return self.platform_device.launch_app(bundle_id, args, env) File "/Volumes/Data/worker/iOS-18-Simulator-WPT-WK2-Tests-EWS/build/Tools/Scripts/webkitpy/xcode/simulated_device.py", line 711, in launch_app output = self.executive.run_command( File "/Volumes/Data/worker/iOS-18-Simulator-WPT-WK2-Tests-EWS/build/Tools/Scripts/webkitpy/common/system/executive.py", line 384, in run_command process = self.popen(args, File "/Volumes/Data/worker/iOS-18-Simulator-WPT-WK2-Tests-EWS/build/Tools/Scripts/webkitpy/common/system/executive.py", line 496, in popen return subprocess.Popen(string_args, env=env, **kwargs) File "/Applications/Xcode.app/Contents/Developer/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/subprocess.py", line 951, in __init__ self._execute_child(args, executable, preexec_fn, close_fds, File "/Applications/Xcode.app/Contents/Developer/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/subprocess.py", line 1754, in _execute_child self.pid = _posixsubprocess.fork_exec( File "/Volumes/Data/worker/iOS-18-Simulator-WPT-WK2-Tests-EWS/build/Tools/Scripts/libraries/webkitcorepy/webkitcorepy/timeout.py", line 133, in handler current.handler(signum, frame) File "/Volumes/Data/worker/iOS-18-Simulator-WPT-WK2-Tests-EWS/build/Tools/Scripts/libraries/webkitcorepy/webkitcorepy/timeout.py", line 160, in exception_handler raise exception RuntimeError: Timed out waiting for process to open org.webkit.WebKitTestRunnerApp on 6544CE58-644F-4DB4-84BD-66C695858FD7 (from worker/2) ```

Attachments
Add attachment proposed patch, testcase, etc.

Radar WebKit Bug Importer

Comment 1 2024-12-16 10:22:37 PST

<rdar://problem/141555356>

EWS

Comment 2 2024-12-16 10:40:04 PST

Test gardening commit 287895@main (4df9e06e4e57): <https://commits.webkit.org/287895@main> Reviewed commits have been landed. Closing PR #38023 and removing active labels.

EWS

Comment 3 2024-12-16 17:58:03 PST

Test gardening commit 283286.601@safari-7620-branch (16bbd5898352): <https://commits.webkit.org/283286.601@safari-7620-branch> Reviewed commits have been landed. Closing PR #2411 and removing active labels.

Note You need to log in before you can comment on or make changes to this bug.