Created attachment 319886 [details] Delete todo-items in reversed order for inferno suite Inferno case shows a strange behavior when deleting items. The deleteButtons array will be dynamically updated once one todo-item is deleted. For example, after deleteButtons[i].click() executed, deleteButtons[i+1] was copied to deleteButtons[i], deleteButtons[i+2] was copied to deleteButtons[i+1] ... This behavior caused the bug of "don't delete all ToDo items" in https://bugs.webkit.org/show_bug.cgi?id=172341. I tried to delete items in reversed order for Inferno case as the patch did. All the todo-items can be deleted and the results on my PC (Ubuntu Chrome R60) showed 4x score improvement for Inferno case. I think itβs unusual to dynamically update deleteButtons array in the Inferno use case. Maybe we can walk around this by deleting items in reversed order for Inferno case.
No, we don't want to make each test case faster like this. The whole point of this benchmark is to have browser engines optimize DOM API, not measure what they're already fast at.