|Summary:||[MotionMark] Increase the warm-up time for each sub-test from 100ms to 1000ms|
|Product:||WebKit||Reporter:||Said Abou-Hallawa <sabouhallawa>|
|Component:||Layout and Rendering||Assignee:||Said Abou-Hallawa <sabouhallawa>|
|Severity:||Normal||CC:||bfulgham, cdumez, ews-watchlist, jbedard, jonlee, rniwa, simon.fraser, webkit-bug-importer, zalan|
|Version:||WebKit Nightly Build|
Description Said Abou-Hallawa 2020-12-17 10:41:25 PST
In macOS Big Sur, the Multiply and the Images sub-tests started to experience bi-modality in their scores especially on newer hardware. This problem is due to a short warmup time. The initial score of a sub-test is crucial in deciding how much the complexity can grow. Because the system may be doing an expensive work only at the beginning of the sub-test (e.g. initializing a cache), drawing a simple object may take much longer than it usually does. MotionMark test harness will be mislead and believe that this drawing operation is always expensive and will not try to increase the complexity of the test much. This complexity is the score of the test. Increasing the warm-up time will allow the system to finish its initialization before the test sampling starts. This should prevent the system initialization work from affecting the sub-test score.