RESOLVED FIXED 267871
AUDIT(267516@main): Inspecting baseline/expectation changes following Sonoma upstream. 
https://bugs.webkit.org/show_bug.cgi?id=267871
Summary AUDIT(267516@main): Inspecting baseline/expectation changes following Sonoma ...
Ben Schwartz
Reported 2024-01-22 12:22:01 PST
I will be conducting an audit of the new test baselines and expectations that were set as part of 267516@main to ensure that there are no other failures impacting our test numbers.
Attachments
Add attachment proposed patch, testcase, etc.
Radar WebKit Bug Importer
Comment 1 2024-01-22 12:22:18 PST
<rdar://problem/121387671>
Ben Schwartz
Comment 2 2024-01-22 14:48:08 PST
I have collected data on all of the failing tests whose baselines were modified in 267516@main. I have yet to validate if all of the constant failures are related to 267516@main (flaky failures are unlikely to be a symptom of a failed re-baseline). ___________ The following tests are constantly failing on iOS 17: editing/caret/color-span-inside-editable.html editing/caret/color-span-inside-editable-background.html editing/input/editable-container-with-word-wrap-normal.html editing/inserting/caret-position.html editing/selection/block-cursor-overtype-mode.html editing/selection/caret-in-empty-inline-1.html editing/selection/caret-in-empty-inline-2.html editing/selection/internal-caret-rect.html fast/forms/cursor-at-editable-content-boundary.html fast/forms/input-baseline.html fast/forms/listbox-bidi-align.html fast/text/basic/generic-family-reset.html imported/w3c/web-platform-tests/xhr/open-method-case-sensitive.htm media/media-can-play-h265-video.html media/media-can-play-mpeg4-video.html media/media-can-play-wav-audio.html The following tests are constantly failing on all versions of macOS: fast/css/caret-color-auto.html imported/w3c/web-platform-tests/service-workers/service-worker/fetch-request-redirect.https.html The following tests are constantly failing on macOS Sonoma only: editing/mac/dictionary-lookup/dictionary-lookup.html editing/selection/context-menu-text-selection-lookup.html The following tests are failing on down-level versions of macOS only: scrollingcoordinator/mac/fixed-backgrounds/fixed-background-in-nested-non-cb-overflow.html scrollingcoordinator/mac/fixed-backgrounds/fixed-background-in-nested-overflow.html scrollingcoordinator/mac/fixed-backgrounds/fixed-background-in-nested-overflow2.html scrollingcoordinator/mac/fixed-backgrounds/fixed-background-in-overflow-in-iframe.html (needs expectations update) The following tests are failing on macOS Monterey only: imported/w3c/web-platform-tests/mathml/presentation-markup/tables/table-002.html imported/w3c/web-platform-tests/mathml/presentation-markup/tables/table-003.html imported/w3c/web-platform-tests/mathml/relations/css-styling/floats/not-floating-001.html imported/w3c/web-platform-tests/mathml/relations/css-styling/width-height-001.html imported/w3c/web-platform-tests/mimesniff/media/media-sniff.window.html (needs expectations update) This test is flakily failing on macOS Ventura WK2 Release x86_64 (and needs expectations): editing/caret/color-span-inside-editable-background.html This test is flakily failing on both macOS Ventura WK1 Release x86_64 and iOS (and needs expectations for both): imported/w3c/web-platform-tests/mimesniff/media/media-sniff.window.html (timeout/fail/pass, crash on ios) These tests are flakily failing on macOS WK1 (and both need expectations): http/tests/navigation/javascriptlink-frames.html imported/w3c/web-platform-tests/mathml/relations/html5-tree/dynamic-childlist-002.html
Ben Schwartz
Comment 3 2024-05-28 12:25:24 PDT
imported/w3c/web-platform-tests/service-workers/service-worker/fetch-request-redirect.https.html needs a re-baseline.
EWS
Comment 4 2024-05-28 12:30:41 PDT
Committed 279394@main (5592e5d6a572): <https://commits.webkit.org/279394@main> Reviewed commits have been landed. Closing PR #29185 and removing active labels.
Note You need to log in before you can comment on or make changes to this bug.