| Summary: | AUDIT(267516@main): Inspecting baseline/expectation changes following Sonoma upstream. | ||
|---|---|---|---|
| Product: | WebKit | Reporter: | Ben Schwartz <ben_schwartz> |
| Component: | Tools / Tests | Assignee: | Nobody <webkit-unassigned> |
| Status: | RESOLVED FIXED | ||
| Severity: | Normal | CC: | webkit-bot-watchers-bugzilla, webkit-bug-importer |
| Priority: | P2 | Keywords: | InRadar |
| Version: | WebKit Nightly Build | ||
| Hardware: | Unspecified | ||
| OS: | Unspecified | ||
|
Description
Ben Schwartz
2024-01-22 12:22:01 PST
I have collected data on all of the failing tests whose baselines were modified in 267516@main. I have yet to validate if all of the constant failures are related to 267516@main (flaky failures are unlikely to be a symptom of a failed re-baseline). ___________ The following tests are constantly failing on iOS 17: editing/caret/color-span-inside-editable.html editing/caret/color-span-inside-editable-background.html editing/input/editable-container-with-word-wrap-normal.html editing/inserting/caret-position.html editing/selection/block-cursor-overtype-mode.html editing/selection/caret-in-empty-inline-1.html editing/selection/caret-in-empty-inline-2.html editing/selection/internal-caret-rect.html fast/forms/cursor-at-editable-content-boundary.html fast/forms/input-baseline.html fast/forms/listbox-bidi-align.html fast/text/basic/generic-family-reset.html imported/w3c/web-platform-tests/xhr/open-method-case-sensitive.htm media/media-can-play-h265-video.html media/media-can-play-mpeg4-video.html media/media-can-play-wav-audio.html The following tests are constantly failing on all versions of macOS: fast/css/caret-color-auto.html imported/w3c/web-platform-tests/service-workers/service-worker/fetch-request-redirect.https.html The following tests are constantly failing on macOS Sonoma only: editing/mac/dictionary-lookup/dictionary-lookup.html editing/selection/context-menu-text-selection-lookup.html The following tests are failing on down-level versions of macOS only: scrollingcoordinator/mac/fixed-backgrounds/fixed-background-in-nested-non-cb-overflow.html scrollingcoordinator/mac/fixed-backgrounds/fixed-background-in-nested-overflow.html scrollingcoordinator/mac/fixed-backgrounds/fixed-background-in-nested-overflow2.html scrollingcoordinator/mac/fixed-backgrounds/fixed-background-in-overflow-in-iframe.html (needs expectations update) The following tests are failing on macOS Monterey only: imported/w3c/web-platform-tests/mathml/presentation-markup/tables/table-002.html imported/w3c/web-platform-tests/mathml/presentation-markup/tables/table-003.html imported/w3c/web-platform-tests/mathml/relations/css-styling/floats/not-floating-001.html imported/w3c/web-platform-tests/mathml/relations/css-styling/width-height-001.html imported/w3c/web-platform-tests/mimesniff/media/media-sniff.window.html (needs expectations update) This test is flakily failing on macOS Ventura WK2 Release x86_64 (and needs expectations): editing/caret/color-span-inside-editable-background.html This test is flakily failing on both macOS Ventura WK1 Release x86_64 and iOS (and needs expectations for both): imported/w3c/web-platform-tests/mimesniff/media/media-sniff.window.html (timeout/fail/pass, crash on ios) These tests are flakily failing on macOS WK1 (and both need expectations): http/tests/navigation/javascriptlink-frames.html imported/w3c/web-platform-tests/mathml/relations/html5-tree/dynamic-childlist-002.html imported/w3c/web-platform-tests/service-workers/service-worker/fetch-request-redirect.https.html needs a re-baseline. Committed 279394@main (5592e5d6a572): <https://commits.webkit.org/279394@main> Reviewed commits have been landed. Closing PR #29185 and removing active labels. |