Bug 261041

Summary: REGRESSION(267516@main): [ macOS wk2 ] accessibility/mac/basic-embed-pdf-accessibility.html is a constant failure.
Product: WebKit Reporter: Ben Schwartz <ben_schwartz>
Component: AccessibilityAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Normal CC: andresg_22, Morningstar, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=259373
https://bugs.webkit.org/show_bug.cgi?id=261048
https://bugs.webkit.org/show_bug.cgi?id=261052
https://bugs.webkit.org/show_bug.cgi?id=261054

Description Ben Schwartz 2023-09-01 11:46:05 PDT
accessibility/mac/basic-embed-pdf-accessibility.html

This test is a constant failure on all versions of macOS, wk2.

HISTORY:

https://results.webkit.org/?suite=layout-tests&test=accessibility%2Fmac%2Fbasic-embed-pdf-accessibility.html

TEXT DIFF:

 This test ensures PDFs loaded in embed tags are exposed in the accessibility tree.
 
-On success, you will see a series of "PASS" messages, followed by "TEST COMPLETE".
+PASS: pdfEmbedElement.domIdentifier === 'pdfEmbed'
+PASS: pdfEmbedElement.role === 'AXRole: AXGroup'
+PASS: pdfEmbedElement.subrole === 'AXSubrole: '
+PASS: pdfEmbedElement.childrenCount === 1
+PASS: pdfAxObject.stringAttributeValue('AXSubrole') === 'AXPDFPluginSubrole'
+PASS: pdfAxObject.childrenCount === 1
+PASS: pdfAxObject.parentElement().domIdentifier === 'pdfEmbed'
+PASS: pdfLayerController.stringAttributeValue('AXRole') === 'AXGroup'
+PASS: pdfLayerController.stringAttributeValue('AXDescription') === 'document'
+PASS: pdfTextNode.stringAttributeValue('AXRole') === 'AXStaticText'
+PASS: pdfTextNode.stringAttributeValue('AXValue').trimEnd() === 'Welcome to the website for the WebKit Open Source Project!'
+PASS: hitTestResult.stringAttributeValue('AXRole') === 'AXGroup'
+PASS: hitTestResult.stringAttributeValue('AXDescription') === 'document'
+PASS: pdfTextNode.stringAttributeValue('AXRole') === 'AXStaticText'
+PASS: pdfTextNode.stringAttributeValue('AXValue').trimEnd() === 'Welcome to the website for the WebKit Open Source Project!'
+PASS: searchResultElement.stringAttributeValue('AXSubrole') === 'AXPDFPluginSubrole'
 
-
-PASS pdfEmbedElement.domIdentifier is 'pdfEmbed'
-PASS pdfEmbedElement.role is 'AXRole: AXGroup'
-PASS pdfEmbedElement.subrole is 'AXSubrole: '
-PASS pdfEmbedElement.childrenCount is 1
-PASS pdfAxObject.stringAttributeValue('AXSubrole') is 'AXPDFPluginSubrole'
-PASS pdfAxObject.childrenCount is 1
-PASS pdfAxObject.parentElement().domIdentifier is 'pdfEmbed'
-PASS pdfLayerController.stringAttributeValue('AXRole') is 'AXGroup'
-PASS pdfLayerController.stringAttributeValue('AXDescription') is 'document'
-PASS pdfTextNode.stringAttributeValue('AXRole') is 'AXStaticText'
-FAIL pdfTextNode.stringAttributeValue('AXValue') should be Welcome to the website for the WebKit Open Source Project!. Was Welcome to the website for the WebKit Open Source Project!
-.
-PASS hitTestResult.stringAttributeValue('AXRole') is 'AXGroup'
-PASS hitTestResult.stringAttributeValue('AXDescription') is 'document'
-PASS pdfTextNode.stringAttributeValue('AXRole') is 'AXStaticText'
-FAIL pdfTextNode.stringAttributeValue('AXValue') should be Welcome to the website for the WebKit Open Source Project!. Was Welcome to the website for the WebKit Open Source Project!
-.
-PASS searchResultElement.stringAttributeValue('AXSubrole') is 'AXPDFPluginSubrole'
 PASS successfullyParsed is true
-Some tests failed.
 
 TEST COMPLETE

DIFF URL:

https://build.webkit.org/results/Apple-Ventura-Release-AppleSilicon-WK2-Tests/267553%40main%20(4741)/accessibility/mac/basic-embed-pdf-accessibility-pretty-diff.html

REPRODUCIBILITY:

I was able to reproduce this bug on macOS Ventura (13.5, 22G74/arm64) ToT using the following command:

run-webkit-tests --clobber-old-results --verbose accessibility/mac/basic-embed-pdf-accessibility.html

REGRESSION:

I was able to identify a clear regression point at 267516@main, as the issue did not reproduce at 267515@main and the test was constantly passing before this point.
Comment 1 Radar WebKit Bug Importer 2023-09-01 11:46:18 PDT
<rdar://problem/114831888>
Comment 2 EWS 2023-09-01 11:55:25 PDT
Test gardening commit 267561@main (6c8b6f1dbf9a): <https://commits.webkit.org/267561@main>

Reviewed commits have been landed. Closing PR #17352 and removing active labels.
Comment 3 EWS 2023-09-22 11:46:33 PDT
Test gardening commit 268327@main (4f51800d1fbf): <https://commits.webkit.org/268327@main>

Reviewed commits have been landed. Closing PR #18093 and removing active labels.