219984 2020-12-17 10:41:25 -0800 [MotionMark] Increase the warm-up time for each sub-test from 100ms to 1000ms 2020-12-17 15:44:25 -0800 1 1 1 Unclassified WebKit Layout and Rendering WebKit Nightly Build Unspecified Unspecified RESOLVED FIXED InRadar P2 Normal --- 1 sabouhallawa sabouhallawa bfulgham cdumez ews-watchlist jbedard jonlee rniwa simon.fraser webkit-bug-importer zalan oldest_to_newest 1715440 0 sabouhallawa 2020-12-17 10:41:25 -0800 In macOS Big Sur, the Multiply and the Images sub-tests started to experience bi-modality in their scores especially on newer hardware. This problem is due to a short warmup time. The initial score of a sub-test is crucial in deciding how much the complexity can grow. Because the system may be doing an expensive work only at the beginning of the sub-test (e.g. initializing a cache), drawing a simple object may take much longer than it usually does. MotionMark test harness will be mislead and believe that this drawing operation is always expensive and will not try to increase the complexity of the test much. This complexity is the score of the test. Increasing the warm-up time will allow the system to finish its initialization before the test sampling starts. This should prevent the system initialization work from affecting the sub-test score. 1715441 1 sabouhallawa 2020-12-17 10:42:42 -0800 <rdar://problem/72143661> 1715452 2 416439 sabouhallawa 2020-12-17 11:04:38 -0800 Created attachment 416439 Patch 1715594 3 ews-feeder 2020-12-17 15:44:23 -0800 Committed r270959: <https://trac.webkit.org/changeset/270959> All reviewed patches have been landed. Closing bug and clearing flags on attachment 416439. 416439 2020-12-17 11:04:38 -0800 2020-12-17 15:44:24 -0800 Patch bug-219984-20201217110437.patch text/plain 2609 sabouhallawa U3VidmVyc2lvbiBSZXZpc2lvbjogMjcwOTM1CmRpZmYgLS1naXQgYS9QZXJmb3JtYW5jZVRlc3Rz L0NoYW5nZUxvZyBiL1BlcmZvcm1hbmNlVGVzdHMvQ2hhbmdlTG9nCmluZGV4IGE4YjBkYjkyNzgw N2I3NzY5OTUyM2EzYWNiZjQ1MmY4NjJiOGQ5MGIuLmFkMGY2NDhjZWJkYmRkYmM5YmM1YmQ4N2Jk MDIyYWNiNTQyN2UzNTggMTAwNjQ0Ci0tLSBhL1BlcmZvcm1hbmNlVGVzdHMvQ2hhbmdlTG9nCisr KyBiL1BlcmZvcm1hbmNlVGVzdHMvQ2hhbmdlTG9nCkBAIC0xLDMgKzEsMTkgQEAKKzIwMjAtMTIt MTcgIFNhaWQgQWJvdS1IYWxsYXdhICA8c2FpZEBhcHBsZS5jb20+CisKKyAgICAgICAgW01vdGlv bk1hcmtdIEluY3JlYXNlIHRoZSB3YXJtLXVwIHRpbWUgZm9yIGVhY2ggc3ViLXRlc3QgZnJvbSAx MDBtcyB0byAxMDAwbXMKKyAgICAgICAgaHR0cHM6Ly9idWdzLndlYmtpdC5vcmcvc2hvd19idWcu Y2dpP2lkPTIxOTk4NAorCisgICAgICAgIFJldmlld2VkIGJ5IE5PQk9EWSAoT09QUyEpLgorCisg ICAgICAgIEVuc3VyZSB0aGUgd2FybS11cCB0aW1lIGlzIGVub3VnaCBmb3IgdGhlIHN5c3RlbSB0 byBmaW5pc2ggYW55IGluaXRpYWxpemF0aW9uCisgICAgICAgIHdvcmsgd2hpY2ggbWF5IGJlIHRy aWdnZXJlZCBieSB0aGUgc3ViLXRlc3QgYmVmb3JlIHN0YXJ0aW5nIHRoZSBzYW1wbGluZy4KKyAg ICAgICAgVGhpcyBzaG91bGQgcHJldmVudCBiaS1tb2RhbGl0eSBpbiB0aGUgc2NvcmUgb2YgdGhl IHN1Yi10ZXN0cyBzaW5jZSB0aGUKKyAgICAgICAgaW5pdGlhbCBmcmFtZSByYXRlIGlzIGNydWNp YWwgaW4gZGVjaWRpbmcgaG93IG11Y2ggdGhlIGNvbXBsZXhpdHkgY2FuIGdyb3cuCisKKyAgICAg ICAgKiBNb3Rpb25NYXJrL2RldmVsb3Blci5odG1sOgorICAgICAgICAqIE1vdGlvbk1hcmsvcmVz b3VyY2VzL3J1bm5lci9tb3Rpb25tYXJrLmpzOgorICAgICAgICAodGhpcy5jbGVhcik6CisKIDIw MjAtMTItMTQgIEFudHRpIEtvaXZpc3RvICA8YW50dGlAYXBwbGUuY29tPgogCiAgICAgICAgIEFk ZCBpbmxpbmUtYmxvY2sgbGluZSBsYXlvdXQgbWljcm9iZW5jaApkaWZmIC0tZ2l0IGEvUGVyZm9y bWFuY2VUZXN0cy9Nb3Rpb25NYXJrL2RldmVsb3Blci5odG1sIGIvUGVyZm9ybWFuY2VUZXN0cy9N b3Rpb25NYXJrL2RldmVsb3Blci5odG1sCmluZGV4IDgxM2Y5ZmEwZmNmZmQ2Y2JkMzg4MTI2NTE0 NTBjODJiM2FiMzFkODUuLjcwMmVkYzI3ZTk4MGNkNTk4ZjI5MGE0NDA5NzhhMDlmYWZiOWQyZDkg MTAwNjQ0Ci0tLSBhL1BlcmZvcm1hbmNlVGVzdHMvTW90aW9uTWFyay9kZXZlbG9wZXIuaHRtbAor KysgYi9QZXJmb3JtYW5jZVRlc3RzL01vdGlvbk1hcmsvZGV2ZWxvcGVyLmh0bWwKQEAgLTY1LDcg KzY1LDcgQEAKICAgICAgICAgICAgICAgICAgICAgICAgIDxmb3JtIG5hbWU9ImJlbmNobWFyay1v cHRpb25zIj4KICAgICAgICAgICAgICAgICAgICAgICAgICAgICA8dWw+CiAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgIDxsaT4KLSAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgIDxsYWJlbD5XYXJtdXAgbGVuZ3RoOiA8aW5wdXQgdHlwZT0ibnVtYmVyIiBpZD0id2FybXVw LWxlbmd0aCIgdmFsdWU9IjEwMCI+IG1pbGxpc2Vjb25kczwvbGFiZWw+CisgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICA8bGFiZWw+V2FybXVwIGxlbmd0aDogPGlucHV0IHR5cGU9 Im51bWJlciIgaWQ9Indhcm11cC1sZW5ndGgiIHZhbHVlPSIxMDAwIj4gbWlsbGlzZWNvbmRzPC9s YWJlbD4KICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgPC9saT4KICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgPGxpPgogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgPGxhYmVsPlRlc3QgbGVuZ3RoOiA8aW5wdXQgdHlwZT0ibnVtYmVyIiBpZD0idGVzdC1p bnRlcnZhbCIgdmFsdWU9IjMwIj4gc2Vjb25kcyBlYWNoPC9sYWJlbD4KZGlmZiAtLWdpdCBhL1Bl cmZvcm1hbmNlVGVzdHMvTW90aW9uTWFyay9yZXNvdXJjZXMvcnVubmVyL21vdGlvbm1hcmsuanMg Yi9QZXJmb3JtYW5jZVRlc3RzL01vdGlvbk1hcmsvcmVzb3VyY2VzL3J1bm5lci9tb3Rpb25tYXJr LmpzCmluZGV4IDY5ZDQ4MmVkMWM1NmQzYmEzMjJmYTM2MjRjZjZmYWJjZmYxNmFhZWQuLjBlZmZm NjhiYWJkYzcxNjJmOWI4ZTA4MDBmZDFiODM1YzUzYWVmMzUgMTAwNjQ0Ci0tLSBhL1BlcmZvcm1h bmNlVGVzdHMvTW90aW9uTWFyay9yZXNvdXJjZXMvcnVubmVyL21vdGlvbm1hcmsuanMKKysrIGIv UGVyZm9ybWFuY2VUZXN0cy9Nb3Rpb25NYXJrL3Jlc291cmNlcy9ydW5uZXIvbW90aW9ubWFyay5q cwpAQCAtNDY1LDcgKzQ2NSw3IEBAIHdpbmRvdy5iZW5jaG1hcmtDb250cm9sbGVyID0gewogICAg ICAgICAia2FsbWFuLXByb2Nlc3MtZXJyb3IiOiAxLAogICAgICAgICAia2FsbWFuLW1lYXN1cmVt ZW50LWVycm9yIjogNCwKICAgICAgICAgInRpbWUtbWVhc3VyZW1lbnQiOiAicGVyZm9ybWFuY2Ui LAotICAgICAgICAid2FybXVwLWxlbmd0aCI6IDEwMAorICAgICAgICAid2FybXVwLWxlbmd0aCI6 IDEwMDAKICAgICB9LAogCiAgICAgaW5pdGlhbGl6ZTogZnVuY3Rpb24oKQo=