Bug 106069 – Add a script to generate statistics on how many layout tests are passing

• Component: Tools / Tests
• Status: NEW

[Ryosuke Niwa]

Ojan sends weekly emails to chromium-dev like https://groups.google.com/a/chromium.org/forum/?fromgroups=#!topic/chromium-dev/X-NpznP8gC0

It’ll be nice if we had a script to generate summary like this for other ports so that they can keep up with what’s happening with their layout test passing rate.

[Ojan Vafai]

Created attachment 181259 [details]
script

Here's the script I use. It's super hacked together. I'd want it to be cleaned up and have testing before I'd feel comfortable committing it to the repository.

[Zan Dobersek]

I like how the script uses TestExpectations to determine the number of failures and changes in the number of passing tests.

I think it would make sense to have such information available for viewing in the form of a dashboard on the test results page, with the possibility of specifying the bounding revisions as desired.

The stats and timeline dashboards there already show something similar, though they operate on actual test results data, while this works on TestExpectations.