Bug 229495 - Regression (240345@main): Many ChakraCore.yaml JSC tests are flaky failures on jsc-mips queue
Summary: Regression (240345@main): Many ChakraCore.yaml JSC tests are flaky failures o...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: JavaScriptCore (show other bugs)
Version: Other
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2021-08-25 07:59 PDT by Aakash Jain
Modified: 2021-08-25 08:05 PDT (History)
5 users (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Aakash Jain 2021-08-25 07:59:38 PDT 
Many ChakraCore.yaml JSC tests are flaky failures.

e.g.:
https://ews-build.webkit.org/#/builders/45/builds/6414

Found 149 pre-existing JSC test failures: 
ChakraCore.yaml/ChakraCore/test/Function/argumentsResolution.js.default,
ChakraCore.yaml/ChakraCore/test/Operators/unaryOps.js.default,
stress/for-in-tests.js.default,
ChakraCore.yaml/ChakraCore/test/es6/unicode_whitespace.js.default,
ChakraCore.yaml/ChakraCore/test/UnifiedRegex/class-case.js.default,
stress/for-in-modify-int-loop-var.js.eager-jettison-no-cjit,
stress/has-own-property-structure-for-in-loop-correctness.js.no-llint,
stress/for-in-invalidate-context-weird-assignments.js.no-cjit-collect-continuously,
stress/sloppy-mode-function-hoisting.js.no-cjit-collect-continuously,
microbenchmarks/sorting-benchmark.js.mini-mode ... 

Found flaky tests: 
ChakraCore.yaml/ChakraCore/test/Bugs/blue_1096569.js.default,
ChakraCore.yaml/ChakraCore/test/Error/CallNonFunction.js.default,
ChakraCore.yaml/ChakraCore/test/Error/ErrorCtorProps.js.default,
ChakraCore.yaml/ChakraCore/test/Function/argumentsResolution.js.default,
ChakraCore.yaml/ChakraCore/test/Object/defineProperty.js.default,
ChakraCore.yaml/ChakraCore/test/Operators/unaryOps.js.default,
ChakraCore.yaml/ChakraCore/test/UnifiedRegex/class-case.js.default,
ChakraCore.yaml/ChakraCore/test/es5/enumerable.js.default,
ChakraCore.yaml/ChakraCore/test/es5/hasItem.js.default,
ChakraCore.yaml/ChakraCore/test/es6/unicode_whitespace.js.default


Other examples:
https://ews-build.webkit.org/#/builders/45/builds/6427
https://ews-build.webkit.org/#/builders/45/builds/6375
https://ews-build.webkit.org/#/builders/45/builds/6320
Comment 1 Aakash Jain 2021-08-25 08:04:41 PDT 
Results database points to regressions range of 240344@main - 240347@main for https://results.webkit.org/?suite=javascriptcore-tests&test=ChakraCore.yaml%2FChakraCore%2Ftest%2FBugs%2Fblue_1096569.js.default  

r280760 (240345@main) seems like the one which caused this, corresponding bug was https://bugs.webkit.org/show_bug.cgi?id=227989. On this bug jsc-mips-tests EWS didn't run on latest patch, but did indicate similar failures on previous patch in https://ews-build.webkit.org/#/builders/45/builds/6089