Bug 301651 – [ New-Tests ][ iOS26 iPhone ] 2X TestWebKitAPI.SmartLists (API-Tests) are constant failures

• Status: RESOLVED
• Resolution: FIXED
• Component: New Bugs

[Robert Jenner]

The following two SmartLists api-tests are constant failures on iOS26 iPhone only. They pass on iPad. We have no data for them running on iOS18:

TestWebKitAPI.SmartLists.InsertingListMergesWithPreviousListIfPossible (introduced at 300101@main)
TestWebKitAPI.SmartLists.InsertingSpaceInsideListElementDoesNotActivateSmartLists (introduced at 300158@main)

HISTORY:
https://results.webkit.org/?suite=api-tests&suite=api-tests&test=TestWebKitAPI.SmartLists.InsertingListMergesWithPreviousListIfPossible&test=TestWebKitAPI.SmartLists.InsertingSpaceInsideListElementDoesNotActivateSmartLists

Failure text:
"name": "TestWebKitAPI.SmartLists.InsertingListMergesWithPreviousListIfPossible",            
"output": "2025-10-29 08:09:58.384 TestWebKitAPI[52762:1186147] Successfully load keyboard extensions\n\n/Volumes/Data/worker/Apple-iOS-26-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/SmartLists.mm:120\nExpected equality of these values:\n  [result expectedRenderTree]\n    Which is: \"layer at (0,0) size 980x735\\n  RenderView at (0,0) size 980x735\\nlayer at (0,0) size 980x735\\n  RenderBlock {HTML} at (0,0) size 980x735\\n    RenderBody {BODY} at (8,8) size 964x711\\n      RenderBlock {OL} at (0,0) size 964x96\\n        RenderListItem {LI} at (40,0) size 924x32\\n          RenderListMarker at (-34,1) size 26x30: \\\"1\\\"\\n          RenderText {#text} at (0,1) size 19x30\\n            text run at (0,1) width 19: \\\"A\\\"\\n        RenderListItem {LI} at (40,32) size 924x32\\n          RenderListMarker at (-34,1) size 26x30: \\\"2\\\"\\n          RenderText {#text} at (0,1) size 18x30\\n            text run at (0,1) width 18: \\\"B\\\"\\n        RenderListItem {LI} at (40,64) size 924x32\\n          RenderListMarker at (-34,1) size 26x30: \\\"3\\\"\\n          RenderText {#text} at (0,1) size 18x30\\n            text run at (0,1) width 18: \\\"C\\\"\\ncaret: position 1 of child 0 {#text} of child 2 {LI} of child 0 {OL} of body\\n\"\n  [result actualRenderTree]\n    Which is: \"layer at (0,0) size 980x735\\n  RenderView at (0,0) size 980x735\\nlayer at (0,0) size 980x735\\n  RenderBlock {HTML} at (0,0) size 980x735\\n    RenderBody {BODY} at (8,8) size 964x711\\n      RenderBlock {OL} at (0,0) size 964x60\\n        RenderListItem {LI} at (40,0) size 924x20\\n          RenderListMarker at (-21,0) size 16x19: \\\"1\\\"\\n          RenderText {#text} at (0,0) size 12x19\\n            text run at (0,0) width 12: \\\"A\\\"\\n        RenderListItem {LI} at (40,20) size 924x20\\n          RenderListMarker at (-21,0) size 16x19: \\\"2\\\"\\n          RenderText {#text} at (0,0) size 11x19\\n            text run at (0,0) width 11: \\\"B\\\"\\n        RenderListItem {LI} at (40,40) size 924x20\\n          RenderListMarker at (-21,0) size 16x19: \\\"3\\\"\\n          RenderText {#text} at (0,0) size 11x19\\n            text run at (0,0) width 11: \\\"C\\\"\\ncaret: position 1 of child 0 {#text} of child 2 {LI} of child 0 {OL} of body\\n\"\nWith diff:\n@@ -4,16 +4,16 @@\n   RenderBlock {HTML} at (0,0) size 980x735\n     RenderBody {BODY} at (8,8) size 964x711\n-      RenderBlock {OL} at (0,0) size 964x96\n-        RenderListItem {LI} at (40,0) size 924x32\n-          RenderListMarker at (-34,1) size 26x30: \\\"1\\\"\n-          RenderText {#text} at (0,1) size 19x30\n-            text run at (0,1) width 19: \\\"A\\\"\n-        RenderListItem {LI} at (40,32) size 924x32\n-          RenderListMarker at (-34,1) size 26x30: \\\"2\\\"\n-          RenderText {#text} at (0,1) size 18x30\n-            text run at (0,1) width 18: \\\"B\\\"\n-        RenderListItem {LI} at (40,64) size 924x32\n-          RenderListMarker at (-34,1) size 26x30: \\\"3\\\"\n-          RenderText {#text} at (0,1) size 18x30\n-            text run at (0,1) width 18: \\\"C\\\"\n+      RenderBlock {OL} at (0,0) size 964x60\n+        RenderListItem {LI} at (40,0) size 924x20\n+          RenderListMarker at (-21,0) size 16x19: \\\"1\\\"\n+          RenderText {#text} at (0,0) size 12x19\n+            text run at (0,0) width 12: \\\"A\\\"\n+        RenderListItem {LI} at (40,20) size 924x20\n+          RenderListMarker at (-21,0) size 16x19: \\\"2\\\"\n+          RenderText {#text} at (0,0) size 11x19\n+            text run at (0,0) width 11: \\\"B\\\"\n+        RenderListItem {LI} at (40,40) size 924x20\n+          RenderListMarker at (-21,0) size 16x19: \\\"3\\\"\n+          RenderText {#text} at (0,0) size 11x19\n+            text run at (0,0) width 11: \\\"C\\\"\n caret: position 1 of child 0 {#text} of child 2 {LI} of child 0 {OL} of body\\n\n\nexpected <body contenteditable=\"\"><ol start=\"1\" style=\"list-style-type: decimal;\" class=\"Apple-decimal-list\"><li>A</li><li>B</li><li>C</li></ol></body> to equal \n    <body>\n        <ol start=\"1\" style=\"list-style-type: decimal;\">\n            <li>A</li>\n            <li>B</li>\n            <li>C</li>\n        </ol>\n    </body>"  

"name": "TestWebKitAPI.SmartLists.InsertingSpaceInsideListElementDoesNotActivateSmartLists",            
"output": "2025-10-29 08:10:14.549 TestWebKitAPI[52840:1186785] Successfully load keyboard extensions\n\n/Volumes/Data/worker/Apple-iOS-26-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/SmartLists.mm:120\nExpected equality of these values:\n  [result expectedRenderTree]\n    Which is: \"layer at (0,0) size 980x735\\n  RenderView at (0,0) size 980x735\\nlayer at (0,0) size 980x735\\n  RenderBlock {HTML} at (0,0) size 980x735\\n    RenderBody {BODY} at (8,8) size 964x711\\n      RenderBlock {UL} at (0,0) size 964x64\\n        RenderListItem {LI} at (40,0) size 924x32\\n          RenderListMarker at (-24,1) size 10x30: bullet\\n          RenderText {#text} at (0,1) size 19x30\\n            text run at (0,1) width 19: \\\"A\\\"\\n        RenderListItem {LI} at (40,32) size 924x32\\n          RenderListMarker at (-24,1) size 10x30: bullet\\n          RenderText {#text} at (0,1) size 52x30\\n            text run at (0,1) width 52: \\\"1. Hi\\\"\\ncaret: position 5 of child 0 {#text} of child 1 {LI} of child 0 {UL} of body\\n\"\n  [result actualRenderTree]\n    Which is: \"layer at (0,0) size 980x735\\n  RenderView at (0,0) size 980x735\\nlayer at (0,0) size 980x735\\n  RenderBlock {HTML} at (0,0) size 980x735\\n    RenderBody {BODY} at (8,8) size 964x711\\n      RenderBlock {UL} at (0,0) size 964x40\\n        RenderListItem {LI} at (40,0) size 924x20\\n          RenderListMarker at (-18,0) size 7x19: bullet\\n          RenderText {#text} at (0,0) size 12x19\\n            text run at (0,0) width 12: \\\"A\\\"\\n        RenderListItem {LI} at (40,20) size 924x20\\n          RenderListMarker at (-18,0) size 7x19: bullet\\n          RenderText {#text} at (0,0) size 32x19\\n            text run at (0,0) width 32: \\\"1. Hi\\\"\\ncaret: position 5 of child 0 {#text} of child 1 {LI} of child 0 {UL} of body\\n\"\nWith diff:\n@@ -4,12 +4,12 @@\n   RenderBlock {HTML} at (0,0) size 980x735\n     RenderBody {BODY} at (8,8) size 964x711\n-      RenderBlock {UL} at (0,0) size 964x64\n-        RenderListItem {LI} at (40,0) size 924x32\n-          RenderListMarker at (-24,1) size 10x30: bullet\n-          RenderText {#text} at (0,1) size 19x30\n-            text run at (0,1) width 19: \\\"A\\\"\n-        RenderListItem {LI} at (40,32) size 924x32\n-          RenderListMarker at (-24,1) size 10x30: bullet\n-          RenderText {#text} at (0,1) size 52x30\n-            text run at (0,1) width 52: \\\"1. Hi\\\"\n+      RenderBlock {UL} at (0,0) size 964x40\n+        RenderListItem {LI} at (40,0) size 924x20\n+          RenderListMarker at (-18,0) size 7x19: bullet\n+          RenderText {#text} at (0,0) size 12x19\n+            text run at (0,0) width 12: \\\"A\\\"\n+        RenderListItem {LI} at (40,20) size 924x20\n+          RenderListMarker at (-18,0) size 7x19: bullet\n+          RenderText {#text} at (0,0) size 32x19\n+            text run at (0,0) width 32: \\\"1. Hi\\\"\n caret: position 5 of child 0 {#text} of child 1 {LI} of child 0 {UL} of body\\n\n\nexpected <body contenteditable=\"\"><ul style=\"list-style-type: disc;\" class=\"Apple-disc-list\"><li>A</li><li>1. Hi</li></ul></body> to equal \n    <body>\n        <ul>\n            <li>A</li>\n            <li>1. Hi</li>\n        </ul>\n    </body>"

[Radar WebKit Bug Importer]

<rdar://problem/163664100>

[Robert Jenner]

I was able to reproduce the test failures on iOS 26 Debug ToT running as follows:

run-api-tests --iOS-simulator <test_goes_here>

There does not appear to be a specific regression point. But rather, these tests appear to fail on iOS26 since their introduction. We have no data for these tests running on iOS18, and they pass on iPad.

[EWS]

Test gardening commit 302309@main (264cc9323a5a): <https://commits.webkit.org/302309@main>

Reviewed commits have been landed. Closing PR #53161 and removing active labels.

[Robert Jenner]

I've disabled these two tests for iOS with the commit above while under investigation.

[Jessica Cheung]

Pull request: https://github.com/WebKit/WebKit/pull/56671

[EWS]

Committed 305898@main (d546e59b9973): <https://commits.webkit.org/305898@main>

Reviewed commits have been landed. Closing PR #56671 and removing active labels.