Electrolysis/Test Coverage

01/19/2016

Test Suite	Windows						OSX				Linux
	XP		7		8		10.6		10.10		32-bit		64-bit		asan
	Dbg	Opt	Dbg	Opt	Dbg	Opt	Dbg	Opt	Dbg	Opt	Dbg	Opt	Dbg	Opt
R(J) js-ref tests
R(C) crash tests											99	99	99	99
R(R) ref tests			99	99							99	99	99	99
Cpp	n/a	n/a	n/a	n/a	n/a	n/a	n/a	n/a	n/a	n/a	n/a	n/a	n/a	n/a	n/a
X xpc shell tests	n/a	n/a	n/a	n/a	n/a	n/a	n/a	n/a	n/a	n/a	n/a	n/a	n/a	n/a	n/a
Mn marionette												99
JIT jit tests
Wr web platform reftest									99	99	99	99	99	99
M(oth-a11y)
M(oth-chrome)	n/a	n/a	n/a	n/a	n/a	n/a	n/a	n/a	n/a	n/a	n/a	n/a	n/a	n/a	n/a
M(bc)			49	49		49		48		48	47	48	47	48	48
M(dt)			49	49								49		49
M(gl)			99	99
M(JP) jetpack
M(1-5)				80							85	87	85	87	87
M(p) push
W(1-8) web platform tests									99	99	99	99	99	99

Related Bugs

• bug 1194533 - Run e10s mochitest on OSX
• bug 1215233 - Schedule e10s tests on Windows

Individual Test Issues

Individual tests under currently running suites that need to be investigated.

43 disabled testcases in browser/base/content/test/

.../alerts/ (2)

• [browser_notification_remove_permission.js] - no bug listed
• [browser_notification_tab_switching.js] Bug 1100662 - content access causing uncaught exception - Error: cannot ipc non-cpow object at chrome://mochitests/content/browser/browser/base/content/test/general/browser_notification_tab_switching.js:32 (or in RemoteAddonsChild.jsm)

…/general/ (32)

• [browser_aboutHome.js] - Bug 1093153 - no about:home support yet (difficult)
• [browser_search_favicon.js] - Bug 1212647 (not ready to be turned on)
• [browser_autocomplete_a11y_label.js] Bug 1101993 - times out for unknown reasons when run in the dir (works on its own)
• [browser_beforeunload_duplicate_dialogs.js] - bug 967873 means permitUnload doesn't work in e10s mode (depends on bug 1191143)
• [browser_bug435325.js] - Bug 1099156 - test directly manipulates content
• [browser_bug462289.js] - Bug 1102017 - middle-button mousedown on selected tab2 does not activate tab - Didn't expect [object XULElement], but got it (same 3 tests fail in non-e10s as well)
• [browser_bug517902.js] - bug 1161699 (linux only)
• [browser_bug537013.js] - Bug 1134458 - Find bar doesn't work correctly in a detached tab (5 test failures)
• [browser_bug906190.js] - Bug 1093642 - test manipulates content and relies on content focus, Bug 1212520 - Re-enable on Linux (unable to run scripts internally?)
• [browser_bug1015721.js] - Bug 1159268 - Need a content-process safe version of synthesizeWheel (is this code or test work?)
• [browser_canonizeURL.js] - Bug 1094510 - test hits the network in e10s mode only (WFM on mac)
• [browser_contextSearchTabPosition.js] -bug 1094761 - test hits the network in e10s, causing next test to crash (WFM on Mac)
• [browser_datachoices_notification.js] - bug 1113930 (WFM on Mac)
• [browser_devices_get_user_media_about_urls.js] - Bug 1071623 (one of five tests timed out)
• [browser_devices_get_user_media_in_frame.js] - Bug 1071623 (one of two tests timed out)
• [browser_double_close_tab.js] - no bug listed (test timed out)
• [browser_fullscreen-window-open.js] - Bug 933103 - mochitest's (gTestBrowser.contentWindow.location is undefined) EventUtils.synthesizeMouse functions not e10s friendly. Linux: Intermittent failures - bug 941575.
• [browser_gestureSupport.js] - Bug 863514 - no gesture support.
• [browser_keywordBookmarklets.js] - Bug 1102025 - different principals for the bookmarklet only in e10s mode (unclear if test or 'real' issue)
• [browser_offlineQuotaNotification.js] - Bug 1093603 - test breaks with PopupNotifications.panel.firstElementChild is null (times out)
• [browser_popup_blocker.js] - Frequent bug 1081925 and bug 1125520 failures (WFM on Mac)
• [browser_printpreview.js] - Bug 1101973 - breaks the next test in e10s, and may be responsible for later timeout after logging "Error: Channel closing: too late to send/recv, messages will be lost”
• [browser_save_link-perwindowpb.js] - Bug 933103 - mochitest's (times out) EventUtils.synthesizeMouse functions not e10s friendly
• [browser_save_private_link_perwindowpb.js] - Bug 933103 - mochitest's EventUtils.synthesizeMouse functions not e10s friendly
• [browser_save_link_when_window_navigates.js] - Bug 933103 - mochitest's EventUtils.synthesizeMouse functions not e10s friendly
• [browser_tabMatchesInAwesomebar_perwindowpb.js] - Bug 1093373, bug 1104755 (empty string passed)
• [browser_tabkeynavigation.js] - no bug listed (can’t pass CPOW to native)
• [browser_unloaddialogs.js] - Bug 1100700 - test relies on unload event firing on closed tabs, which it doesn’t (before unload work?)
• [browser_urlbarEnterAfterMouseOver.js] - Bug 1073339 - Investigate autocomplete test unreliability on Linux/e10s (broken on Mac too)
• [browser_zbug569342.js] - Bug 1094240 - has findbar-related failures (code disabled this?)
• [browser_addCertException.js] - Bug 1100687 - test directly manipulates content (content.document.getElementById) (timed out)
• [browser_blockHPKP.js] - bug 1100687 - test directly manipulates content (content.document.getElementById) ("textElement is null”)

…/popupNotifications/ (4)

4 of the 5 test cases in this folder are skipped for e10s

.../social/ (5)

• [browser_addons.js] - Leaking docshells (bug 1150147)
• [browser_blocklist.js] - Leaking docshells (bug 1150147)
• [browser_social_activation.js] - Leaking docshells (bug 1150147)
• [browser_social_chatwindowfocus.js] - tab crash on data url used in this test
• [browser_social_contextmenu.js] - Bug 1072669 context menu relies on target element