Bug 102783 - TestExpecations ignores entry with dot in folder name
Summary: TestExpecations ignores entry with dot in folder name
Status: RESOLVED WONTFIX
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: 528+ (Nightly build)
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2012-11-20 02:20 PST by Yury Semikhatsky
Modified: 2012-11-21 00:28 PST (History)
1 user (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Yury Semikhatsky 2012-11-20 02:20:42 PST
Steps to reproduce:

Add the following entry to LayoutTests/platform/chromium/TestExpectations:

webkit.org/b/102724 [ Linux Debug ] svg/carto.net/colourpicker.svg [ Crash ]

and run

./webkit/tools/layout_tests/run_webkit_tests.sh --target Debug svg/carto.net/colourpicker.svg

Expected output:
The test ran as expected.

Actual output:
Regressions: Unexpected crashes (1)
  svg/carto.net/colourpicker.svg [ Crash ]


Renaming svg/carto.net to svg/carto_net fixes the problem.
Comment 1 Dirk Pranke 2012-11-20 13:17:30 PST
There is already a line for svg/carto.net/colourpicker.svg on line 1975; I suspect the newly added line was being ignored (and you were probably getting warnings telling you about this, or at least you should've been). 

I just tested this w/o the duplicate line and it worked fine (and indeed, the original line works fine as well).

Let me know if I've missed something?
Comment 2 Yury Semikhatsky 2012-11-20 23:20:40 PST
(In reply to comment #1)
> There is already a line for svg/carto.net/colourpicker.svg on line 1975; I suspect the newly added line was being ignored (and you were probably getting warnings telling you about this, or at least you should've been). 
> 
I started with fixing duplicate entries that lint complained about and then noticed that the new expectation didn't work.

> I just tested this w/o the duplicate line and it worked fine (and indeed, the original line works fine as well).
> 
> Let me know if I've missed something?

In my scenario I deleted everything but the following line from LayoutTests/platform/chromium/TestExpectations:

webkit.org/b/102724 svg/carto.net/colourpicker.svg [ Crash ]

and than ran single test:
./webkit/tools/layout_tests/run_webkit_tests.sh --target Debug  svg/carto_net/colourpicker.svg

The output was as I described so I don't think the problem is duplicate entries.
Comment 3 Yury Semikhatsky 2012-11-21 00:28:19 PST
(In reply to comment #2)
> (In reply to comment #1)
> > There is already a line for svg/carto.net/colourpicker.svg on line 1975; I suspect the newly added line was being ignored (and you were probably getting warnings telling you about this, or at least you should've been). 
> > 
> I started with fixing duplicate entries that lint complained about and then noticed that the new expectation didn't work.
> 
> > I just tested this w/o the duplicate line and it worked fine (and indeed, the original line works fine as well).
> > 
> > Let me know if I've missed something?
> 
> In my scenario I deleted everything but the following line from LayoutTests/platform/chromium/TestExpectations:
> 
> webkit.org/b/102724 svg/carto.net/colourpicker.svg [ Crash ]
> 
> and than ran single test:
> ./webkit/tools/layout_tests/run_webkit_tests.sh --target Debug  svg/carto_net/colourpicker.svg
> 
> The output was as I described so I don't think the problem is duplicate entries.

After some debugging it turned out that the expectation in LayoutTests/platform/chromium/TestExpectations was overwritten by another one in src/skia/skia_test_expectations.txt I think it would be nice to inform user that expectations in one file are overwritten by another file.