267871 2024-01-22 12:22:01 -0800 AUDIT(267516@main): Inspecting baseline/expectation changes following Sonoma upstream. 2024-05-28 12:30:43 -0700 1 1 1 Unclassified WebKit Tools / Tests WebKit Nightly Build Unspecified Unspecified RESOLVED FIXED InRadar P2 Normal --- 1 ben_schwartz webkit-unassigned webkit-bot-watchers-bugzilla webkit-bug-importer oldest_to_newest 2006617 0 ben_schwartz 2024-01-22 12:22:01 -0800 I will be conducting an audit of the new test baselines and expectations that were set as part of 267516@main to ensure that there are no other failures impacting our test numbers. 2006618 1 webkit-bug-importer 2024-01-22 12:22:18 -0800 <rdar://problem/121387671> 2006667 2 ben_schwartz 2024-01-22 14:48:08 -0800 I have collected data on all of the failing tests whose baselines were modified in 267516@main. I have yet to validate if all of the constant failures are related to 267516@main (flaky failures are unlikely to be a symptom of a failed re-baseline). ___________ The following tests are constantly failing on iOS 17: editing/caret/color-span-inside-editable.html editing/caret/color-span-inside-editable-background.html editing/input/editable-container-with-word-wrap-normal.html editing/inserting/caret-position.html editing/selection/block-cursor-overtype-mode.html editing/selection/caret-in-empty-inline-1.html editing/selection/caret-in-empty-inline-2.html editing/selection/internal-caret-rect.html fast/forms/cursor-at-editable-content-boundary.html fast/forms/input-baseline.html fast/forms/listbox-bidi-align.html fast/text/basic/generic-family-reset.html imported/w3c/web-platform-tests/xhr/open-method-case-sensitive.htm media/media-can-play-h265-video.html media/media-can-play-mpeg4-video.html media/media-can-play-wav-audio.html The following tests are constantly failing on all versions of macOS: fast/css/caret-color-auto.html imported/w3c/web-platform-tests/service-workers/service-worker/fetch-request-redirect.https.html The following tests are constantly failing on macOS Sonoma only: editing/mac/dictionary-lookup/dictionary-lookup.html editing/selection/context-menu-text-selection-lookup.html The following tests are failing on down-level versions of macOS only: scrollingcoordinator/mac/fixed-backgrounds/fixed-background-in-nested-non-cb-overflow.html scrollingcoordinator/mac/fixed-backgrounds/fixed-background-in-nested-overflow.html scrollingcoordinator/mac/fixed-backgrounds/fixed-background-in-nested-overflow2.html scrollingcoordinator/mac/fixed-backgrounds/fixed-background-in-overflow-in-iframe.html (needs expectations update) The following tests are failing on macOS Monterey only: imported/w3c/web-platform-tests/mathml/presentation-markup/tables/table-002.html imported/w3c/web-platform-tests/mathml/presentation-markup/tables/table-003.html imported/w3c/web-platform-tests/mathml/relations/css-styling/floats/not-floating-001.html imported/w3c/web-platform-tests/mathml/relations/css-styling/width-height-001.html imported/w3c/web-platform-tests/mimesniff/media/media-sniff.window.html (needs expectations update) This test is flakily failing on macOS Ventura WK2 Release x86_64 (and needs expectations): editing/caret/color-span-inside-editable-background.html This test is flakily failing on both macOS Ventura WK1 Release x86_64 and iOS (and needs expectations for both): imported/w3c/web-platform-tests/mimesniff/media/media-sniff.window.html (timeout/fail/pass, crash on ios) These tests are flakily failing on macOS WK1 (and both need expectations): http/tests/navigation/javascriptlink-frames.html imported/w3c/web-platform-tests/mathml/relations/html5-tree/dynamic-childlist-002.html 2038248 3 ben_schwartz 2024-05-28 12:25:24 -0700 imported/w3c/web-platform-tests/service-workers/service-worker/fetch-request-redirect.https.html needs a re-baseline. 2038251 4 ews-feeder 2024-05-28 12:30:41 -0700 Committed 279394@main (5592e5d6a572): <https://commits.webkit.org/279394@main> Reviewed commits have been landed. Closing PR #29185 and removing active labels.