CrashKill/2009-09-28

Firefox 3.5.3 top crashes

  • dbaron noted that a small set of binaries may be the cause of many of our crashes, see his blog post on that topic
  • shaver posited that the majority of our crashes are coming from:
    • properly installed software which have incompatible DLLs or other libraries
    • malware or other software causing crashes
    • improperly installed software putting DLLs in our appdir
    • bugs in our code (Cairo, other areas; using valgrind and Purify to find these)
  • need to make sure that when we file a bug, it's got an owner who will drive towards a solution (gather data, find someone to help with analysis, figure out where the problem is, shepherd in a fix, see the bug closed)
  • most crashes are in Windows, so if you need help in figuring out what's the best way to set up a Windows VM, ask
    • action: anyone want to document that on CrashKill?
  • currently reports are throttled to 20% of what's submitted
    • might be able to get more capacity to see more of the actual submissions
    • action: shaver to talk to morgamic about pulling attributes like URLs out for all submissions
  • would be good to have processing categorize crash signatures along the lines shaver posited above
    • somehow mark signatures as "malware" or "external software" or more importantly "totally our code, nothing else loaded"
  • jonas was concerned that we were assuming too much about the cause of crashes, but was convinced that there's no harm to it as long as we continue the Purify and Valgrind investigations
  • dolske wondered if we should be broadcasting the "what caused the crash" piece to users
  • should we spend time telling users that Safe Mode might fix their problem?
    • beltzner felt that we could, but ultimately it's not as satisfying as either the Chrome solution (a crash doesn't take down the entire browser) or having the problem fixed on our side

Triage

  • cooliris19.dll@0x351f2 - jst bug 519039
  • nsCycleCollectingAutoRefCnt::decr(nsISupports*) - dbaron bug 500879
  • nsGlobalWindow::cycleCollection::UnmarkPurple(nsISupports*) - dbaron bug 504392
  • nsEventListenerManager::Release() - smaug bug 513334

5 UserCallWinProcCheckWow 7868 7868 0 0 0 501429, 516182, More Bugs for UserCallWinProcCheckWow

OPEN

       * 501429

DUPLICATE

       * 516182

6 _PR_MD_SEND 7295 7295 0 0 0 489533, More Bugs for _PR_MD_SEND

OPEN

       * 489533

7 RtlpWaitForCriticalSection 6624 6624 0 0 0 8 RtlpWaitOnCriticalSection 5991 5991 0 0 0 9 @0x0 5984 5984 0 0 0 515922, 494107, More Bugs for @0x0

WORKSFORME

       * 515922

FIXED

       * 494107

10 nsStyleSet::FileRules(int (*)(nsIStyleRuleProcessor*, void*), RuleProcessorData*) 5933 5933 0 0 0 492675, More Bugs for nsStyleSet::FileRules(int (*)(nsIStyleRuleProcessor*, void*), RuleProcessorData*)

OPEN

       * 492675

11 _woutput_l 5633 5633 0 0 0 511756, More Bugs for _woutput_l

OPEN

       * 511756

12 KiFastSystemCallRet 5457 5457 0 0 0 514589, 484770, 467910, 513975 More Bugs for KiFastSystemCallRet

OPEN

       * 514589

WORKSFORME

       * 484770
       * 467910

INVALID

       * 513975

13 NPSWF32.dll@0x77bd0 5244 5244 0 0 0 14 GraphWalker::DoWalk(nsDeque&) 5094 5094 0 0 0 500105, More Bugs for GraphWalker::DoWalk(nsDeque&)

OPEN

       * 500105

15 nsWindow::GetParentWindow(int) 4806 4806 0 0 0 470487, More Bugs for nsWindow::GetParentWindow(int)

OPEN

       * 470487

16 NPFFAddOn.dll@0x11867 4693 4693 0 0 0 17 RtlpCoalesceFreeBlocks 4647 4647 0 0 0 514898, More Bugs for RtlpCoalesceFreeBlocks

OPEN

       * 514898

18 memcpy | fillInCell 4311 4311 0 0 0 503770, More Bugs for memcpy | fillInCell

FIXED

       * 503770

19 js_Interpret 4183 4183 0 0 0 517077, 514593, 519129, 518096510996492275506366342952445655451486495636496199489057489004487637487417483483488030516262487445487215515892503286495843467495487563488015493177488802135735 More Bugs for js_Interpret

OPEN

       * 517077
       * 514593
       * 519129
       * 518096
       * 510996

WORKSFORME

       * 492275
       * 506366
       * 342952
       * 445655
       * 451486
       * 495636
       * 496199

DUPLICATE

       * 489057
       * 489004
       * 487637
       * 487417
       * 483483
       * 488030

FIXED

       * 516262
       * 487445
       * 487215
       * 515892
       * 503286
       * 495843
       * 467495
       * 487563
       * 488015
       * 493177
       * 488802

INCOMPLETE

       * 135735

20 PL_DHashTableOperate 4065 4065 0 0 0 516113, 503638, 303511, 389194 More Bugs for PL_DHashTableOperate

OPEN

       * 516113
       * 503638

INCOMPLETE

       * 303511
       * 389194

21 nsPresContext::Release() 3882 3882 0 0 0 22 NPSWF32.dll@0xca950 3831 3831 0 0 0 23 arena_dalloc_small | arena_dalloc | free | XPT_DestroyArena 3772 3772 0 0 0 24 arena_chunk_init 3679 3679 0 0 0 515211, More Bugs for arena_chunk_init

OPEN

       * 515211

25 GoogleDesktopMozilla.dll@0x5512 3550 3550 0 0 0 26 wcslen 3518 3518 0 0 0 27 RtlFreeHeap 3397 3397 0 0 0 512739, More Bugs for RtlFreeHeap

OPEN

       * 512739

28 nsCycleCollector::MarkRoots(GCGraphBuilder&) 2870 2870 0 0 0 437449, More Bugs for nsCycleCollector::MarkRoots(GCGraphBuilder&)

OPEN

       * 437449

29 js_TraceObject 2736 2736 0 0 0 503772, 483482, More Bugs for js_TraceObject

OPEN

       * 503772

DUPLICATE

       * 483482

30 nsScriptLoader::StartLoad(nsScriptLoadRequest*, nsAString_internal const&) 2538 2538 0 0 0 31 memmove | nsTArray_base::ShiftData(unsigned int, unsigned int, unsigned int, unsigned int) 2338 2338 0 0 0 32 RaiseException | _CxxThrowException 2338 2338 0 0 0 33 nsXPConnect::Traverse(void*, nsCycleCollectionTraversalCallback&) 2238 2238 0 0 0 500103, 483480, More Bugs for nsXPConnect::Traverse(void*, nsCycleCollectionTraversalCallback&)

OPEN

       * 500103

DUPLICATE

       * 483480

34 SGPrxy.dll@0x25de 2224 2224 0 0 0 35 RtlReAllocateHeap 2187 2187 0 0 0 36 NPSWF32.dll@0xe6270 2138 2138 0 0 0 37 avgssff.dll@0x9943 2130 2130 0 0 0 38 RtlEnterCriticalSection 2079 2079 0 0 0 39 NPSWF32.dll@0x889af 2009 2009 0 0 0 40 js_GetGCThingTraceKind 1870 1870 0 0 0 427718, 514819, More Bugs for js_GetGCThingTraceKind

OPEN

       * 427718

FIXED

       * 514819

41 GoogleDesktopMozilla.dll@0x5500 1861 1861 0 0 0 42 nsGlobalChromeWindow::Release() 1823 1823 0 0 0 43 DTToolbarFF.dll@0x4bc19 1801 1801 0 0 0 44 nsBaseWidget::Destroy() 1683 1683 0 0 0 470487, 507928, 503196, More Bugs for nsBaseWidget::Destroy()

OPEN

       * 470487
       * 507928
       * 503196

45 nsGenericElement::cycleCollection::Traverse(void*, nsCycleCollectionTraversalCallback&) 1679 1679 0 0 0 46 NPSWF32.dll@0xbc897 1647 1647 0 0 0 47 NoteJSChild 1613 1613 0 0 0 490164, More Bugs for NoteJSChild

OPEN

       * 490164

48 dtoa 1602 1602 0 0 0 466659, More Bugs for dtoa

WORKSFORME

       * 466659

49 nsXULDocument::ResumeWalk() 1580 1580 0 0 0 50 BtwVdpCapFilter.dll@0xa345 1551 1551 0 0 0 51 _PR_MD_RECV 1535 1535 0 0 0 52 JS_TraceChildren 1482 1482 0 0 0 503767, 474080, More Bugs for JS_TraceChildren

OPEN

       * 503767

WORKSFORME

       * 474080

53 LZCharNextA 1468 1468 0 0 0 54 nsPluginHostImpl::TrySetUpPluginInstance(char const*, nsIURI*, nsIPluginInstanceOwner*) 1460 1460 0 0 0 55 NPSWF32.dll@0xa10ff 1443 1443 0 0 0 56 GoogleDesktopNetwork3.dll@0x3dfb 1399 1399 0 0 0 57 NPSWF32.dll@0xca160 1394 1394 0 0 0 58 GCGraphBuilder::NoteXPCOMChild(nsISupports*) 1377 1377 0 0 0 59 nsFrame::BoxReflow(nsBoxLayoutState&, nsPresContext*, nsHTMLReflowMetrics&, nsIRenderingContext*, int, int, int, int, int) 1338 1338 0 0 0 60 InterlockedCompareExchange 1326 1326 0 0 0 61 memcmp | ntdll.dll@0xfff 1322 1322 0 0 0 62 nsJSContext::Release() 1317 1317 0 0 0 63 fun_trace 1309 1309 0 0 0 503650, More Bugs for fun_trace

OPEN

       * 503650

64 nsHTMLDocument::Release() 1298 1298 0 0 0 65 nsPluginInstancePeerImpl::GetDOMElement(nsIDOMElement**) 1279 1279 0 0 0 66 XPCCallContext::XPCCallContext(XPCContext::LangType, JSContext*, JSObject*, JSObject*, int, unsigned int, int*, int*) 1277 1277 0 0 0 67 nsHttpsHandler::GetProtocolFlags(unsigned int*) 1264 1264 0 0 0 68 NPSWF32.dll@0xa8654 1181 1181 0 0 0 69 BaseThreadStart 1164 1164 0 0 0 70 xul.dll@0xa3ef3 1164 1164 0 0 0 71 free | js3250.dll@0x84d85 1149 1149 0 0 0 518283, More Bugs for free | js3250.dll@0x84d85

DUPLICATE

       * 518283

72 nsGlobalWindow::Release() 1131 1131 0 0 0 73 radhslib.dll@0x3b6f 1121 1121 0 0 0 74 NPSWF32.dll@0x1392a6 1080 1080 0 0 0 75 PostThreadMessageW 1080 1080 0 0 0 76 NPSWF32.dll@0x7c6a3 1061 1061 0 0 0 77 cooliris19.dll@0x1b60ea 1061 1061 0 0 0 78 NPSWF32.dll@0x3d7ad 1051 1051 0 0 0 79 ScanBlackWalker::ShouldVisitNode(PtrInfo const*) 1048 1048 0 0 0 80 NPSWF32.dll@0x2e5b9a 1041 1041 0 0 0 81 NPSWF32.dll@0x2e83b7 1021 1021 0 0 0 82 NPSWF32.dll@0xd08dc 1010 1010 0 0 0 83 FreeEEInfoChain(tagExtendedErrorInfo*) 1003 1003 0 0 0 84 NPSWF32.dll@0x2005bd 1002 1002 0 0 0 85 NPSWF32.dll@0x255b 1002 1002 0 0 0 86 _ftol2 983 983 0 0 0 87 nsCOMPtr_base::assign_from_qi(nsQueryInterface, nsID const&) 982 982 0 0 0 88 NPSWF32.dll@0x77540 977 977 0 0 0 89 NPSWF32.dll@0x2e81ff 970 970 0 0 0 90 nsDOMEvent::Release() 962 962 0 0 0 91 nppl3260.dll@0x54bb 961 961 0 0 0 504428, More Bugs for nppl3260.dll@0x54bb

OPEN

       * 504428

92 NPSWF32.dll@0x144dae 930 930 0 0 0 93 WrappedNativeMarker 897 897 0 0 0 94 NPSWF32.dll@0x13c4f3 897 897 0 0 0 95 nsPurpleBuffer::SelectPointers(GCGraphBuilder&) 895 895 0 0 0 96 xul.dll@0x99330 893 893 0 0 0 97 RealDefWindowProcWorker 881 881 0 0 0 98 nsDocShell::EnsureContentViewer() 878 878 0 0 0 99 nsDocShell::SetupNewViewer(nsIContentViewer*) 877 877 0 0 0 514311, 512175, 501424, 504641 More Bugs for nsDocShell::SetupNewViewer(nsIContentViewer*)

DUPLICATE

       * 514311
       * 512175
       * 501424
       * 504641

100 NPSWF32.dll@0x1d3756 877 877 0 0 0