[GTK] Several css web-platform-tests are flaky

• Component: WebKitGTK
• Status: RESOLVED FIXED

[Miguel Gomez]

imported/w3c/web-platform-tests/css/css-logical/animation-002.html [ Failure Pass ]
imported/w3c/web-platform-tests/css/cssom-view/scroll-behavior-element.html [ Failure Pass ]
imported/w3c/web-platform-tests/css/cssom-view/scroll-behavior-main-frame-root.html [ Failure Pass ]
imported/w3c/web-platform-tests/css/cssom-view/scroll-behavior-main-frame-window.html [ Failure Pass ]
imported/w3c/web-platform-tests/css/cssom-view/scroll-behavior-smooth-positions.html [ Failure Pass ]
imported/w3c/web-platform-tests/css/cssom-view/scroll-behavior-subframe-root.html [ Failure Pass ]
imported/w3c/web-platform-tests/css/cssom-view/scroll-behavior-subframe-window.html [ Failure Pass ]
imported/w3c/web-platform-tests/css/cssom-view/scrollIntoView-smooth.html [ Failure Pass ]

All of the tests may fail on the first run and pass on the second. Checking the diffs, seems that there's a timeout while running them and that's why they fail. These are the diffs:

--- /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/imported/w3c/web-platform-tests/css/css-logical/animation-002-expected.txt
+++ /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/imported/w3c/web-platform-tests/css/css-logical/animation-002-actual.txt
@@ -1,3 +1,5 @@
+
+Harness Error (TIMEOUT), message = null
 
 FAIL Logical properties can be animated assert_equals: expected "50px" but got "0px"
 FAIL Logical properties in animations respect the writing-mode assert_equals: expected "50px" but got "0px"
@@ -8,7 +10,7 @@
 PASS Physical properties and logical properties can be mixed 
 PASS Declaration order is respected on each keyframe individually 
 FAIL Animations update when the writing-mode is changed assert_equals: expected "50px" but got "0px"
-FAIL Filling animations update when the writing-mode is changed assert_equals: expected "100px" but got "0px"
+TIMEOUT Filling animations update when the writing-mode is changed Test timed out
 FAIL The number of interpolating properties can be increased when the writing-mode is changed assert_equals: expected "50px" but got "0px"
 FAIL The number of interpolating properties can be decreased when the writing-mode is changed assert_equals: expected "150px" but got "100px"
 FAIL Animations update when the writing-mode is changed through a CSS variable assert_equals: expected "50px" but got "0px"


--- /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/imported/w3c/web-platform-tests/css/cssom-view/scroll-behavior-element-expected.txt
+++ /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/imported/w3c/web-platform-tests/css/cssom-view/scroll-behavior-element-actual.txt
@@ -1,3 +1,5 @@
+
+Harness Error (TIMEOUT), message = null
 
 PASS Element with auto scroll-behavior ; scroll() with default behavior 
 PASS Element with auto scroll-behavior ; scroll() with auto behavior 
@@ -31,6 +33,6 @@
 FAIL Element with smooth scroll-behavior ; scrollIntoView() with auto behavior assert_less_than: Should not set scrollLeft immediately expected a number less than 500 but got 500
 PASS Element with smooth scroll-behavior ; scrollIntoView() with instant behavior 
 FAIL Element with smooth scroll-behavior ; scrollIntoView() with smooth behavior assert_less_than: Should not set scrollLeft immediately expected a number less than 500 but got 500
-PASS Aborting an ongoing smooth scrolling on an element with another smooth scrolling 
-PASS Aborting an ongoing smooth scrolling on an element with an instant scrolling 
+TIMEOUT Aborting an ongoing smooth scrolling on an element with another smooth scrolling Test timed out
+NOTRUN Aborting an ongoing smooth scrolling on an element with an instant scrolling 
 


--- /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/imported/w3c/web-platform-tests/css/cssom-view/scroll-behavior-main-frame-root-expected.txt
+++ /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/imported/w3c/web-platform-tests/css/cssom-view/scroll-behavior-main-frame-root-actual.txt
@@ -1,3 +1,5 @@
+
+Harness Error (TIMEOUT), message = null
 
 PASS Page loaded 
 PASS Main frame with auto scroll-behavior ; scroll() with default behavior 
@@ -32,6 +34,6 @@
 FAIL Main frame with smooth scroll-behavior ; scrollIntoView() with auto behavior assert_less_than: Should not set scrollLeft immediately expected a number less than 2430 but got 2430
 PASS Main frame with smooth scroll-behavior ; scrollIntoView() with instant behavior 
 FAIL Main frame with smooth scroll-behavior ; scrollIntoView() with smooth behavior assert_less_than: Should not set scrollLeft immediately expected a number less than 2430 but got 2430
-PASS Aborting an ongoing smooth scrolling on the main frame with another smooth scrolling 
-PASS Aborting an ongoing smooth scrolling on the main frame with an instant scrolling 
+TIMEOUT Aborting an ongoing smooth scrolling on the main frame with another smooth scrolling Test timed out
+NOTRUN Aborting an ongoing smooth scrolling on the main frame with an instant scrolling 
 


--- /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/imported/w3c/web-platform-tests/css/cssom-view/scroll-behavior-main-frame-window-expected.txt
+++ /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/imported/w3c/web-platform-tests/css/cssom-view/scroll-behavior-main-frame-window-actual.txt
@@ -1,3 +1,5 @@
+
+Harness Error (TIMEOUT), message = null
 
 PASS Page loaded 
 PASS Main frame with auto scroll-behavior ; scroll() with default behavior 
@@ -24,6 +26,6 @@
 FAIL Main frame with smooth scroll-behavior ; scrollBy() with auto behavior assert_less_than: Should not set scrollLeft immediately expected a number less than 2430 but got 2430
 PASS Main frame with smooth scroll-behavior ; scrollBy() with instant behavior 
 FAIL Main frame with smooth scroll-behavior ; scrollBy() with smooth behavior assert_less_than: Should not set scrollLeft immediately expected a number less than 2430 but got 2430
-PASS Aborting an ongoing smooth scrolling on the main frame with another smooth scrolling 
-PASS Aborting an ongoing smooth scrolling on the main frame with an instant scrolling 
+TIMEOUT Aborting an ongoing smooth scrolling on the main frame with another smooth scrolling Test timed out
+NOTRUN Aborting an ongoing smooth scrolling on the main frame with an instant scrolling 
 


--- /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/imported/w3c/web-platform-tests/css/cssom-view/scroll-behavior-smooth-positions-expected.txt
+++ /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/imported/w3c/web-platform-tests/css/cssom-view/scroll-behavior-smooth-positions-actual.txt
@@ -1,20 +1,22 @@
 
-PASS Scroll positions when performing smooth scrolling from (0, 0) to (500, 250) using scroll()  
-PASS Scroll positions when performing smooth scrolling from (1000, 0) to (500, 250) using scroll()  
-PASS Scroll positions when performing smooth scrolling from (0, 500) to (500, 250) using scroll()  
-PASS Scroll positions when performing smooth scrolling from (1000, 500) to (500, 250) using scroll()  
-PASS Scroll positions when performing smooth scrolling from (0, 0) to (500, 250) using scrollTo()  
-PASS Scroll positions when performing smooth scrolling from (1000, 0) to (500, 250) using scrollTo()  
-PASS Scroll positions when performing smooth scrolling from (0, 500) to (500, 250) using scrollTo()  
-PASS Scroll positions when performing smooth scrolling from (1000, 500) to (500, 250) using scrollTo()  
-PASS Scroll positions when performing smooth scrolling from (0, 0) to (500, 250) using scrollBy()  
-PASS Scroll positions when performing smooth scrolling from (1000, 0) to (500, 250) using scrollBy()  
-PASS Scroll positions when performing smooth scrolling from (0, 500) to (500, 250) using scrollBy()  
-PASS Scroll positions when performing smooth scrolling from (1000, 500) to (500, 250) using scrollBy()  
-PASS Scroll positions when performing smooth scrolling from (0, 0) to (500, 250) using scrollIntoView()  
-PASS Scroll positions when performing smooth scrolling from (1000, 0) to (500, 250) using scrollIntoView()  
-PASS Scroll positions when performing smooth scrolling from (0, 500) to (500, 250) using scrollIntoView()  
-PASS Scroll positions when performing smooth scrolling from (1000, 500) to (500, 250) using scrollIntoView()  
-PASS Scroll positions when aborting a smooth scrolling with another smooth scrolling 
-PASS Scroll positions when aborting a smooth scrolling with an instant scrolling 
+Harness Error (TIMEOUT), message = null
 
+TIMEOUT Scroll positions when performing smooth scrolling from (0, 0) to (500, 250) using scroll()  Test timed out
+NOTRUN Scroll positions when performing smooth scrolling from (1000, 0) to (500, 250) using scroll()  
+NOTRUN Scroll positions when performing smooth scrolling from (0, 500) to (500, 250) using scroll()  
+NOTRUN Scroll positions when performing smooth scrolling from (1000, 500) to (500, 250) using scroll()  
+NOTRUN Scroll positions when performing smooth scrolling from (0, 0) to (500, 250) using scrollTo()  
+NOTRUN Scroll positions when performing smooth scrolling from (1000, 0) to (500, 250) using scrollTo()  
+NOTRUN Scroll positions when performing smooth scrolling from (0, 500) to (500, 250) using scrollTo()  
+NOTRUN Scroll positions when performing smooth scrolling from (1000, 500) to (500, 250) using scrollTo()  
+NOTRUN Scroll positions when performing smooth scrolling from (0, 0) to (500, 250) using scrollBy()  
+NOTRUN Scroll positions when performing smooth scrolling from (1000, 0) to (500, 250) using scrollBy()  
+NOTRUN Scroll positions when performing smooth scrolling from (0, 500) to (500, 250) using scrollBy()  
+NOTRUN Scroll positions when performing smooth scrolling from (1000, 500) to (500, 250) using scrollBy()  
+NOTRUN Scroll positions when performing smooth scrolling from (0, 0) to (500, 250) using scrollIntoView()  
+NOTRUN Scroll positions when performing smooth scrolling from (1000, 0) to (500, 250) using scrollIntoView()  
+NOTRUN Scroll positions when performing smooth scrolling from (0, 500) to (500, 250) using scrollIntoView()  
+NOTRUN Scroll positions when performing smooth scrolling from (1000, 500) to (500, 250) using scrollIntoView()  
+NOTRUN Scroll positions when aborting a smooth scrolling with another smooth scrolling 
+NOTRUN Scroll positions when aborting a smooth scrolling with an instant scrolling 
+


--- /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/imported/w3c/web-platform-tests/css/cssom-view/scroll-behavior-subframe-root-expected.txt
+++ /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/imported/w3c/web-platform-tests/css/cssom-view/scroll-behavior-subframe-root-actual.txt
@@ -1,3 +1,5 @@
+
+Harness Error (TIMEOUT), message = null
 
 PASS iframe loaded 
 PASS Subframe with auto scroll-behavior ; scroll() with default behavior 
@@ -32,6 +34,6 @@
 FAIL Subframe with smooth scroll-behavior ; scrollIntoView() with auto behavior assert_less_than: Should not set scrollLeft immediately expected a number less than 500 but got 500
 PASS Subframe with smooth scroll-behavior ; scrollIntoView() with instant behavior 
 FAIL Subframe with smooth scroll-behavior ; scrollIntoView() with smooth behavior assert_less_than: Should not set scrollLeft immediately expected a number less than 500 but got 500
-PASS Aborting an ongoing smooth scrolling on a subframe with another smooth scrolling 
-PASS Aborting an ongoing smooth scrolling on a subframe with an instant scrolling 
+TIMEOUT Aborting an ongoing smooth scrolling on a subframe with another smooth scrolling Test timed out
+NOTRUN Aborting an ongoing smooth scrolling on a subframe with an instant scrolling 
 


--- /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/imported/w3c/web-platform-tests/css/cssom-view/scroll-behavior-subframe-window-expected.txt
+++ /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/imported/w3c/web-platform-tests/css/cssom-view/scroll-behavior-subframe-window-actual.txt
@@ -1,3 +1,5 @@
+
+Harness Error (TIMEOUT), message = null
 
 PASS iframe loaded 
 PASS Main frame with auto scroll-behavior ; scroll() with default behavior 
@@ -24,6 +26,6 @@
 FAIL Main frame with smooth scroll-behavior ; scrollBy() with auto behavior assert_less_than: Should not set scrollLeft immediately expected a number less than 500 but got 500
 PASS Main frame with smooth scroll-behavior ; scrollBy() with instant behavior 
 FAIL Main frame with smooth scroll-behavior ; scrollBy() with smooth behavior assert_less_than: Should not set scrollLeft immediately expected a number less than 500 but got 500
-PASS Aborting an ongoing smooth scrolling on the main frame with another smooth scrolling 
-PASS Aborting an ongoing smooth scrolling on the main frame with an instant scrolling 
+TIMEOUT Aborting an ongoing smooth scrolling on the main frame with another smooth scrolling Test timed out
+NOTRUN Aborting an ongoing smooth scrolling on the main frame with an instant scrolling 
 


--- /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/imported/w3c/web-platform-tests/css/cssom-view/scrollIntoView-smooth-expected.txt
+++ /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/imported/w3c/web-platform-tests/css/cssom-view/scrollIntoView-smooth-actual.txt
@@ -1,6 +1,8 @@
 
-PASS Smooth scrollIntoView should scroll the element to the 'nearest' position 
-PASS Smooth scrollIntoView should scroll the element to the 'start' position 
-PASS Smooth scrollIntoView should scroll the element to the 'center' position 
-PASS Smooth scrollIntoView should scroll the element to the 'end' position 
+Harness Error (TIMEOUT), message = null
 
+TIMEOUT Smooth scrollIntoView should scroll the element to the 'nearest' position Test timed out
+NOTRUN Smooth scrollIntoView should scroll the element to the 'start' position 
+NOTRUN Smooth scrollIntoView should scroll the element to the 'center' position 
+NOTRUN Smooth scrollIntoView should scroll the element to the 'end' position 
+

[Diego Pino]

The test(s) filed under this bug have been consistently passing for the last 4000 revisions. Marking bug as fixed.

Committed r263254: <https://trac.webkit.org/changeset/263254>