Bug 75131 - Lots of tests are crashing on the SnowLeopard WK2 tests bot
Summary: Lots of tests are crashing on the SnowLeopard WK2 tests bot
Status: RESOLVED WONTFIX
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: 528+ (Nightly build)
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on: 75143 75144 75148 75133 75135 75149
Blocks:
  Show dependency treegraph
 
Reported: 2011-12-22 15:03 PST by Simon Fraser (smfr)
Modified: 2014-01-10 10:52 PST (History)
10 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Simon Fraser (smfr) 2011-12-22 15:03:01 PST
The SL WK2 debug bot shows lots of crashes:
<http://build.webkit.org/results/SnowLeopard%20Intel%20Debug%20(WebKit2%20Tests)/r103579%20(3398)/results.html>

I can repro some of these locally, but only when I run all of /fast:


 8$ $ ./Tools/Scripts/run-webkit-tests -2 --debug LayoutTests/fast/
  fast/backgrounds/size/backgroundSize07.html -> unexpected text diff mismatch
  fast/backgrounds/repeat/negative-offset-repeat.html -> unexpected text diff mismatch
  fast/block/margin-collapse/block-inside-inline/005.html -> unexpected text diff mismatch
  fast/backgrounds/size/backgroundSize08.html -> unexpected DumpRenderTree crash
  fast/backgrounds/repeat/noRepeatCorrectClip.html -> unexpected DumpRenderTree crash
  fast/block/margin-collapse/block-inside-inline/006.html -> unexpected DumpRenderTree crash
  fast/block/float/narrow-after-wide.html -> unexpected text diff mismatch
  fast/body-propagation/background-image/002.html -> unexpected text diff mismatch
  fast/body-propagation/overflow/005-xhtml.xhtml -> unexpected text diff mismatch
  fast/css/bidi-override-in-anonymous-block.html -> unexpected text diff mismatch
  fast/canvas/webgl/webgl-viewport-parameters-preserved.html -> unexpected text diff mismatch
  fast/block/float/negative-margin-clear.html -> unexpected DumpRenderTree crash
  fast/body-propagation/background-image/003-declarative.xhtml -> unexpected DumpRenderTree crash
  fast/block/float/no-overhanging-float-crash.html -> unexpected DumpRenderTree crash
  fast/body-propagation/overflow/005.html -> unexpected DumpRenderTree crash
  fast/block/float/nopaint-after-layer-destruction2.html -> unexpected DumpRenderTree crash
  fast/body-propagation/overflow/006-declarative.xhtml -> unexpected DumpRenderTree crash
  fast/block/float/nopaint-after-layer-destruction.html -> unexpected DumpRenderTree crash
  fast/body-propagation/overflow/006-xhtml.xhtml -> unexpected DumpRenderTree crash
  fast/block/float/nowrap-clear-min-width.html -> unexpected DumpRenderTree crash
  fast/body-propagation/overflow/006.html -> unexpected DumpRenderTree crash
  fast/block/float/overhanging-after-height-decrease-offsets.html -> unexpected DumpRenderTree crash
  fast/canvas/shadow-offset-2.html -> unexpected text diff mismatch
  fast/dom/constructed-objects-prototypes.html -> unexpected text diff mismatch
  fast/dom/css-cached-import-rule.html -> unexpected text diff mismatch
  fast/canvas/shadow-offset-3.html -> unexpected DumpRenderTree crash
  fast/css/css3-nth-tokens-style.html -> unexpected text diff mismatch
  fast/css/getComputedStyle/getComputedStyle-background-position.html -> unexpected text diff mismatch
  fast/css/css3-space-in-nth-and-lang.html -> unexpected DumpRenderTree crash
  fast/css/getComputedStyle/getComputedStyle-background-size.html -> unexpected DumpRenderTree crash
  fast/dom/Element/getClientRects.html -> unexpected text diff mismatch
  fast/dom/Element/hostname-host.html -> unexpected DumpRenderTree crash
  fast/dom/doctype-event-listener-crash.html -> unexpected text diff mismatch
  fast/dom/HTMLElement/set-inner-outer-optimization.html -> unexpected text diff mismatch
  fast/dom/document-all-input.html -> unexpected DumpRenderTree crash
  fast/dom/HTMLElement/set-invalid-value.html -> unexpected DumpRenderTree crash
Exiting early after 20 crashes and 0 timeouts. 2853 tests run.

For some reason I got no crash reports.
Comment 1 Simon Fraser (smfr) 2011-12-22 15:11:45 PST
A big source of crashes is SQLite crashes:

Thread 12 Crashed:  Dispatch queue: com.apple.CFURLCACHE_work_queue
0   libsqlite3.dylib              	0x00007fff8a083c81 sqlite3PagerAcquire + 737
1   libsqlite3.dylib              	0x00007fff8a09016c sqlite3BtreeBeginTrans + 876
2   libsqlite3.dylib              	0x00007fff8a0907a2 btreeCursor + 610
3   libsqlite3.dylib              	0x00007fff8a0fcb19 sqlite3InitOne + 457
4   libsqlite3.dylib              	0x00007fff8a0fd634 sqlite3Init + 132
5   libsqlite3.dylib              	0x00007fff8a1070fa selectExpander + 2330
6   libsqlite3.dylib              	0x00007fff8a07c85d sqlite3WalkSelect + 61
7   libsqlite3.dylib              	0x00007fff8a0c8360 sqlite3Select + 672
8   libsqlite3.dylib              	0x00007fff8a0e9f4c yy_reduce + 14940
9   libsqlite3.dylib              	0x00007fff8a0ecc8d sqlite3Parser + 317
10  libsqlite3.dylib              	0x00007fff8a0ed079 sqlite3RunParser + 473
11  libsqlite3.dylib              	0x00007fff8a0edc53 sqlite3LockAndPrepare + 675
12  libsqlite3.dylib              	0x00007fff8a0fb285 sqlite3_exec + 245
13  libsqlite3.dylib              	0x00007fff8a0fc352 sqlite3_get_table + 306
14  com.apple.CFNetwork           	0x00007fff806d8fa3 __CFURLCache::IsPersistentStoreSchemaCurrent(long) + 83
15  com.apple.CFNetwork           	0x00007fff806d1b45 __CFURLCache::OpenDatabase() + 189
16  com.apple.CFNetwork           	0x00007fff806d162a ProcessCacheTasks(__CFURLCache*) + 582
17  com.apple.CFNetwork           	0x00007fff806d0f66 _CFURLCacheTimerCallback(void*) + 343
18  libSystem.B.dylib             	0x00007fff85428d64 _dispatch_call_block_and_release + 15
19  libSystem.B.dylib             	0x00007fff854078d2 _dispatch_queue_drain + 251
20  libSystem.B.dylib             	0x00007fff85407734 _dispatch_queue_invoke + 57
21  libSystem.B.dylib             	0x00007fff854072de _dispatch_worker_thread2 + 252
22  libSystem.B.dylib             	0x00007fff85406c08 _pthread_wqthread + 353
23  libSystem.B.dylib             	0x00007fff85406aa5 start_wqthread + 13
Comment 2 Brady Eidson 2011-12-22 15:16:57 PST
(In reply to comment #1)
> A big source of crashes is SQLite crashes:
> 
> Thread 12 Crashed:  Dispatch queue: com.apple.CFURLCACHE_work_queue
> 0   libsqlite3.dylib                  0x00007fff8a083c81 sqlite3PagerAcquire + 737
> 1   libsqlite3.dylib                  0x00007fff8a09016c sqlite3BtreeBeginTrans + 876
> 2   libsqlite3.dylib                  0x00007fff8a0907a2 btreeCursor + 610
> 3   libsqlite3.dylib                  0x00007fff8a0fcb19 sqlite3InitOne + 457
> 4   libsqlite3.dylib                  0x00007fff8a0fd634 sqlite3Init + 132
> 5   libsqlite3.dylib                  0x00007fff8a1070fa selectExpander + 2330
> 6   libsqlite3.dylib                  0x00007fff8a07c85d sqlite3WalkSelect + 61
> 7   libsqlite3.dylib                  0x00007fff8a0c8360 sqlite3Select + 672
> 8   libsqlite3.dylib                  0x00007fff8a0e9f4c yy_reduce + 14940
> 9   libsqlite3.dylib                  0x00007fff8a0ecc8d sqlite3Parser + 317
> 10  libsqlite3.dylib                  0x00007fff8a0ed079 sqlite3RunParser + 473
> 11  libsqlite3.dylib                  0x00007fff8a0edc53 sqlite3LockAndPrepare + 675
> 12  libsqlite3.dylib                  0x00007fff8a0fb285 sqlite3_exec + 245
> 13  libsqlite3.dylib                  0x00007fff8a0fc352 sqlite3_get_table + 306
> 14  com.apple.CFNetwork               0x00007fff806d8fa3 __CFURLCache::IsPersistentStoreSchemaCurrent(long) + 83
> 15  com.apple.CFNetwork               0x00007fff806d1b45 __CFURLCache::OpenDatabase() + 189
> 16  com.apple.CFNetwork               0x00007fff806d162a ProcessCacheTasks(__CFURLCache*) + 582
> 17  com.apple.CFNetwork               0x00007fff806d0f66 _CFURLCacheTimerCallback(void*) + 343
> 18  libSystem.B.dylib                 0x00007fff85428d64 _dispatch_call_block_and_release + 15
> 19  libSystem.B.dylib                 0x00007fff854078d2 _dispatch_queue_drain + 251
> 20  libSystem.B.dylib                 0x00007fff85407734 _dispatch_queue_invoke + 57
> 21  libSystem.B.dylib                 0x00007fff854072de _dispatch_worker_thread2 + 252
> 22  libSystem.B.dylib                 0x00007fff85406c08 _pthread_wqthread + 353
> 23  libSystem.B.dylib                 0x00007fff85406aa5 start_wqthread + 13

CFNetwork crash and therefore not a bug for WebKit
Comment 3 Brady Eidson 2011-12-22 15:17:26 PST
<rdar://problem/10621525>
Comment 4 Alexey Proskuryakov 2011-12-22 15:40:10 PST
Not sure if it's closely related, but we had a somewhat similar CFNetwork crasher that turned out to be a WebKit issue in bug 55412.
Comment 5 Nikolas Zimmermann 2012-03-11 04:52:18 PDT
(In reply to comment #4)
> Not sure if it's closely related, but we had a somewhat similar CFNetwork crasher that turned out to be a WebKit issue in bug 55412.

nzimmermann ~/Coding/WebKit > /usr/local/valgrind/bin/valgrind --trace-children=yes /Applications/Safari.app/Contents/MacOS/Safari         
==57946== Memcheck, a memory error detector
==57946== Copyright (C) 2002-2011, and GNU GPL'd, by Julian Seward et al.
==57946== Using Valgrind-3.8.0.SVN and LibVEX; rerun with -h for copyright info
==57946== Command: /Applications/Safari.app/Contents/MacOS/Safari
==57946== 
--57946-- /Users/nzimmermann/Coding/WebKit/WebKitBuild/Debug/JavaScriptCore.framework/Versions/A/JavaScriptCore:
--57946-- dSYM directory is missing; consider using --dsymutil=yes
--57946-- /Users/nzimmermann/Coding/WebKit/WebKitBuild/Debug/WebKit.framework/Versions/A/WebKit:
--57946-- dSYM directory is missing; consider using --dsymutil=yes
--57946-- /Users/nzimmermann/Coding/WebKit/WebKitBuild/Debug/WebKit2.framework/Versions/A/WebKit2:
--57946-- dSYM directory is missing; consider using --dsymutil=yes
--57946-- /Users/nzimmermann/Coding/WebKit/WebKitBuild/Debug/WebCore.framework/Versions/A/WebCore:
--57946-- dSYM directory is missing; consider using --dsymutil=yes
==57946== Warning: set address range perms: large range [0x5a12bb200000, 0x5a12fb202000) (defined)
==57946== 
==57946== Process terminating with default action of signal 11 (SIGSEGV)
==57946==  Bad permissions for mapped region at address 0x0
==57946==    at 0x0: ???
==57946==    by 0x1727A43: sqlite3PageMalloc (in /usr/lib/libsqlite3.dylib)
==57946==    by 0x17277E7: sqlite3PagerSetPagesize (in /usr/lib/libsqlite3.dylib)
==57946==    by 0x1723A4A: sqlite3BtreeOpen (in /usr/lib/libsqlite3.dylib)
==57946==    by 0x171FFC5: openDatabase (in /usr/lib/libsqlite3.dylib)
==57946==    by 0x5AACC7C: __CFURLCache::OpenDatabase() (in /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/CFNetwork.framework/Versions/A/CFNetwork)
==57946==    by 0x5AAC7FF: ProcessCacheTasks(__CFURLCache*, bool) (in /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/CFNetwork.framework/Versions/A/CFNetwork)
==57946==    by 0x5AAC231: _CFURLCacheTimerCallback(void*) (in /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/CFNetwork.framework/Versions/A/CFNetwork)
==57946==    by 0x56A48B9: _dispatch_call_block_and_release (in /usr/lib/system/libdispatch.dylib)
==57946==    by 0x56A6109: _dispatch_queue_drain (in /usr/lib/system/libdispatch.dylib)
==57946==    by 0x56A5F65: _dispatch_queue_invoke (in /usr/lib/system/libdispatch.dylib)
==57946==    by 0x56A575F: _dispatch_worker_thread2 (in /usr/lib/system/libdispatch.dylib)
--57946:0:schedule VG_(sema_down): read returned -4


Same for running valgrind on DRT. This is on my shiny Lion iMac.
Can't use DRT anymore.

I've verified through manual printf() that it enters DumpRenderTree main(), but it stops after we initialized the NSURLCache, at some point, when its thread fires and tries to open the sqlite3 database, it just crashes. No idea why.
Comment 6 Brady Eidson 2012-03-11 22:03:58 PDT
(In reply to comment #5)
> (In reply to comment #4)

> Same for running valgrind on DRT. This is on my shiny Lion iMac.
> Can't use DRT anymore.
> 
> I've verified through manual printf() that it enters DumpRenderTree main(), but it stops after we initialized the NSURLCache, at some point, when its thread fires and tries to open the sqlite3 database, it just crashes. No idea why.

Could you set aside the relevant Cache.db file (from ~/Library/Caches) and see if it goes away?

And if so, could you please attach that Cache.db file?
Comment 7 Nikolas Zimmermann 2012-03-12 02:15:24 PDT
(In reply to comment #6) 
> And if so, could you please attach that Cache.db file?
I've tried that, it did not help. I stopped testing as I discovered that "valgrind sqlite3 foo.dbg" yields the same problem. It turns out my valgrind trunk checkout was dated, with latest ToT valgrind works just great on Lion!
Comment 8 Brent Fulgham 2014-01-10 10:52:54 PST
We no longer maintain SnowLeopard test bots.