We need to have per platform default --tolerance override for pixel tests. This is required so that The idea is to "copy" the Skipped file implementation.
Thinking more about it, I don't think this is the right solution to our problem. It's not very elegant and not intuitive to maintain.