Bug 219984 - [MotionMark] Increase the warm-up time for each sub-test from 100ms to 1000ms
Summary: [MotionMark] Increase the warm-up time for each sub-test from 100ms to 1000ms
Alias: None
Product: WebKit
Classification: Unclassified
Component: Layout and Rendering (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Said Abou-Hallawa
Keywords: InRadar
Depends on:
Reported: 2020-12-17 10:41 PST by Said Abou-Hallawa
Modified: 2020-12-17 15:44 PST (History)
9 users (show)

See Also:

Patch (2.55 KB, patch)
2020-12-17 11:04 PST, Said Abou-Hallawa
no flags Details | Formatted Diff | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Said Abou-Hallawa 2020-12-17 10:41:25 PST
In macOS Big Sur, the Multiply and the Images sub-tests started to experience bi-modality in their scores especially on newer hardware.

This problem is due to a short warmup time. The initial score of a sub-test is crucial in deciding how much the complexity can grow. Because the system may be doing an expensive work only at the beginning of the sub-test (e.g. initializing a cache), drawing a simple object may take much longer than it usually does. MotionMark test harness will be mislead and believe that this drawing operation is always expensive and will not try to increase the complexity of the test much. This complexity is the score of the test.

Increasing the warm-up time will allow the system to finish its initialization before the test sampling starts. This should prevent the system initialization work from affecting the sub-test score.
Comment 1 Said Abou-Hallawa 2020-12-17 10:42:42 PST
Comment 2 Said Abou-Hallawa 2020-12-17 11:04:38 PST
Created attachment 416439 [details]
Comment 3 EWS 2020-12-17 15:44:23 PST
Committed r270959: <https://trac.webkit.org/changeset/270959>

All reviewed patches have been landed. Closing bug and clearing flags on attachment 416439 [details].