261041 2023-09-01 11:46:05 -0700 REGRESSION(267516@main): [ macOS wk2 ] accessibility/mac/basic-embed-pdf-accessibility.html is a constant failure. 2023-09-22 11:46:33 -0700 1 1 1 Unclassified WebKit Accessibility WebKit Nightly Build Unspecified Unspecified NEW https://bugs.webkit.org/show_bug.cgi?id=259373 https://bugs.webkit.org/show_bug.cgi?id=261048 https://bugs.webkit.org/show_bug.cgi?id=261052 https://bugs.webkit.org/show_bug.cgi?id=261054 InRadar P2 Normal --- 1 ben_schwartz webkit-unassigned andresg_22 Morningstar webkit-bot-watchers-bugzilla webkit-bug-importer oldest_to_newest 1975047 0 ben_schwartz 2023-09-01 11:46:05 -0700 accessibility/mac/basic-embed-pdf-accessibility.html This test is a constant failure on all versions of macOS, wk2. HISTORY: https://results.webkit.org/?suite=layout-tests&test=accessibility%2Fmac%2Fbasic-embed-pdf-accessibility.html TEXT DIFF: This test ensures PDFs loaded in embed tags are exposed in the accessibility tree. -On success, you will see a series of "PASS" messages, followed by "TEST COMPLETE". +PASS: pdfEmbedElement.domIdentifier === 'pdfEmbed' +PASS: pdfEmbedElement.role === 'AXRole: AXGroup' +PASS: pdfEmbedElement.subrole === 'AXSubrole: ' +PASS: pdfEmbedElement.childrenCount === 1 +PASS: pdfAxObject.stringAttributeValue('AXSubrole') === 'AXPDFPluginSubrole' +PASS: pdfAxObject.childrenCount === 1 +PASS: pdfAxObject.parentElement().domIdentifier === 'pdfEmbed' +PASS: pdfLayerController.stringAttributeValue('AXRole') === 'AXGroup' +PASS: pdfLayerController.stringAttributeValue('AXDescription') === 'document' +PASS: pdfTextNode.stringAttributeValue('AXRole') === 'AXStaticText' +PASS: pdfTextNode.stringAttributeValue('AXValue').trimEnd() === 'Welcome to the website for the WebKit Open Source Project!' +PASS: hitTestResult.stringAttributeValue('AXRole') === 'AXGroup' +PASS: hitTestResult.stringAttributeValue('AXDescription') === 'document' +PASS: pdfTextNode.stringAttributeValue('AXRole') === 'AXStaticText' +PASS: pdfTextNode.stringAttributeValue('AXValue').trimEnd() === 'Welcome to the website for the WebKit Open Source Project!' +PASS: searchResultElement.stringAttributeValue('AXSubrole') === 'AXPDFPluginSubrole' - -PASS pdfEmbedElement.domIdentifier is 'pdfEmbed' -PASS pdfEmbedElement.role is 'AXRole: AXGroup' -PASS pdfEmbedElement.subrole is 'AXSubrole: ' -PASS pdfEmbedElement.childrenCount is 1 -PASS pdfAxObject.stringAttributeValue('AXSubrole') is 'AXPDFPluginSubrole' -PASS pdfAxObject.childrenCount is 1 -PASS pdfAxObject.parentElement().domIdentifier is 'pdfEmbed' -PASS pdfLayerController.stringAttributeValue('AXRole') is 'AXGroup' -PASS pdfLayerController.stringAttributeValue('AXDescription') is 'document' -PASS pdfTextNode.stringAttributeValue('AXRole') is 'AXStaticText' -FAIL pdfTextNode.stringAttributeValue('AXValue') should be Welcome to the website for the WebKit Open Source Project!. Was Welcome to the website for the WebKit Open Source Project! -. -PASS hitTestResult.stringAttributeValue('AXRole') is 'AXGroup' -PASS hitTestResult.stringAttributeValue('AXDescription') is 'document' -PASS pdfTextNode.stringAttributeValue('AXRole') is 'AXStaticText' -FAIL pdfTextNode.stringAttributeValue('AXValue') should be Welcome to the website for the WebKit Open Source Project!. Was Welcome to the website for the WebKit Open Source Project! -. -PASS searchResultElement.stringAttributeValue('AXSubrole') is 'AXPDFPluginSubrole' PASS successfullyParsed is true -Some tests failed. TEST COMPLETE DIFF URL: https://build.webkit.org/results/Apple-Ventura-Release-AppleSilicon-WK2-Tests/267553%40main%20(4741)/accessibility/mac/basic-embed-pdf-accessibility-pretty-diff.html REPRODUCIBILITY: I was able to reproduce this bug on macOS Ventura (13.5, 22G74/arm64) ToT using the following command: run-webkit-tests --clobber-old-results --verbose accessibility/mac/basic-embed-pdf-accessibility.html REGRESSION: I was able to identify a clear regression point at 267516@main, as the issue did not reproduce at 267515@main and the test was constantly passing before this point. 1975048 1 webkit-bug-importer 2023-09-01 11:46:18 -0700 <rdar://problem/114831888> 1975050 2 ews-feeder 2023-09-01 11:55:25 -0700 Test gardening commit 267561@main (6c8b6f1dbf9a): <https://commits.webkit.org/267561@main> Reviewed commits have been landed. Closing PR #17352 and removing active labels. 1979405 3 ews-feeder 2023-09-22 11:46:33 -0700 Test gardening commit 268327@main (4f51800d1fbf): <https://commits.webkit.org/268327@main> Reviewed commits have been landed. Closing PR #18093 and removing active labels.