run-webkit-tests should support sub-platform-specific results for platform-specific tests. Right now, if there is a test in platform/mac, for example, you can't override its results with platform/mac-leopard. This is because the $base variable passed in to expectedDirectoryForTest() contains the "platform/" part of the path.