Bug 261041 – REGRESSION(267516@main): [ macOS wk2 ] accessibility/mac/basic-embed-pdf-accessibility.html is a constant failure.

• Component: Accessibility
• Status: NEW

[Ben Schwartz]

accessibility/mac/basic-embed-pdf-accessibility.html

This test is a constant failure on all versions of macOS, wk2.

HISTORY:

https://results.webkit.org/?suite=layout-tests&test=accessibility%2Fmac%2Fbasic-embed-pdf-accessibility.html

TEXT DIFF:

 This test ensures PDFs loaded in embed tags are exposed in the accessibility tree.
 
-On success, you will see a series of "PASS" messages, followed by "TEST COMPLETE".
+PASS: pdfEmbedElement.domIdentifier === 'pdfEmbed'
+PASS: pdfEmbedElement.role === 'AXRole: AXGroup'
+PASS: pdfEmbedElement.subrole === 'AXSubrole: '
+PASS: pdfEmbedElement.childrenCount === 1
+PASS: pdfAxObject.stringAttributeValue('AXSubrole') === 'AXPDFPluginSubrole'
+PASS: pdfAxObject.childrenCount === 1
+PASS: pdfAxObject.parentElement().domIdentifier === 'pdfEmbed'
+PASS: pdfLayerController.stringAttributeValue('AXRole') === 'AXGroup'
+PASS: pdfLayerController.stringAttributeValue('AXDescription') === 'document'
+PASS: pdfTextNode.stringAttributeValue('AXRole') === 'AXStaticText'
+PASS: pdfTextNode.stringAttributeValue('AXValue').trimEnd() === 'Welcome to the website for the WebKit Open Source Project!'
+PASS: hitTestResult.stringAttributeValue('AXRole') === 'AXGroup'
+PASS: hitTestResult.stringAttributeValue('AXDescription') === 'document'
+PASS: pdfTextNode.stringAttributeValue('AXRole') === 'AXStaticText'
+PASS: pdfTextNode.stringAttributeValue('AXValue').trimEnd() === 'Welcome to the website for the WebKit Open Source Project!'
+PASS: searchResultElement.stringAttributeValue('AXSubrole') === 'AXPDFPluginSubrole'
 
-
-PASS pdfEmbedElement.domIdentifier is 'pdfEmbed'
-PASS pdfEmbedElement.role is 'AXRole: AXGroup'
-PASS pdfEmbedElement.subrole is 'AXSubrole: '
-PASS pdfEmbedElement.childrenCount is 1
-PASS pdfAxObject.stringAttributeValue('AXSubrole') is 'AXPDFPluginSubrole'
-PASS pdfAxObject.childrenCount is 1
-PASS pdfAxObject.parentElement().domIdentifier is 'pdfEmbed'
-PASS pdfLayerController.stringAttributeValue('AXRole') is 'AXGroup'
-PASS pdfLayerController.stringAttributeValue('AXDescription') is 'document'
-PASS pdfTextNode.stringAttributeValue('AXRole') is 'AXStaticText'
-FAIL pdfTextNode.stringAttributeValue('AXValue') should be Welcome to the website for the WebKit Open Source Project!. Was Welcome to the website for the WebKit Open Source Project!
-.
-PASS hitTestResult.stringAttributeValue('AXRole') is 'AXGroup'
-PASS hitTestResult.stringAttributeValue('AXDescription') is 'document'
-PASS pdfTextNode.stringAttributeValue('AXRole') is 'AXStaticText'
-FAIL pdfTextNode.stringAttributeValue('AXValue') should be Welcome to the website for the WebKit Open Source Project!. Was Welcome to the website for the WebKit Open Source Project!
-.
-PASS searchResultElement.stringAttributeValue('AXSubrole') is 'AXPDFPluginSubrole'
 PASS successfullyParsed is true
-Some tests failed.
 
 TEST COMPLETE

DIFF URL:

https://build.webkit.org/results/Apple-Ventura-Release-AppleSilicon-WK2-Tests/267553%40main%20(4741)/accessibility/mac/basic-embed-pdf-accessibility-pretty-diff.html

REPRODUCIBILITY:

I was able to reproduce this bug on macOS Ventura (13.5, 22G74/arm64) ToT using the following command:

run-webkit-tests --clobber-old-results --verbose accessibility/mac/basic-embed-pdf-accessibility.html

REGRESSION:

I was able to identify a clear regression point at 267516@main, as the issue did not reproduce at 267515@main and the test was constantly passing before this point.

[Radar WebKit Bug Importer]

<rdar://problem/114831888>

[EWS]

Test gardening commit 267561@main (6c8b6f1dbf9a): <https://commits.webkit.org/267561@main>

Reviewed commits have been landed. Closing PR #17352 and removing active labels.

[EWS]

Test gardening commit 268327@main (4f51800d1fbf): <https://commits.webkit.org/268327@main>

Reviewed commits have been landed. Closing PR #18093 and removing active labels.