Releases/Firefox 33/Test Plan

From MozillaWiki
Jump to: navigation, search

Contents

Schedule

Please consult the Rapid Release Calendar for more information.

  • 2014-06-09: Firefox 33 arrives on Nightly
  • 2014-07-21: Firefox 33 merges to Aurora
  • 2014-07-25: Firefox 33 Aurora updates enabled
  • 2014-09-02: Firefox 33 merges to Beta
  • 2014-09-04: Firefox 33 Beta 1 released

Meetings

Meeting Purpose When Where
Crashkill Raise stability concerns with the Crashkill team 10:00 PST on Monday Vidyo: Stability, IRC: #crashkill
Channel Status Raise quality concerns with the Release Management team 10:00 PST on Tuesday & Thursday Vidyo: ReleaseCoordination, IRC: #planning

Checklist

Priority Check Description Frequency Last Checked
1 Stability Review the stability reports to identify new/rising crash signatures Daily
2 Pushlog Review the pushlog to identify fixed bugs needing verification Daily
3 QA Needed Bugs Review and assign qawanted bugs for investigation At least twice a week
4 Unconfirmed Bugs Triage and test unconfirmed bug reports At least once a week
5 Fixed Bugs Flag fixed bugs for verification At least once a week
6 Verification Needed Bugs Test verifyme bugs to confirm fixed bugs are fixed At least once a week
7 Reported Bugs Document and escalated reported bugs as necessary Every Monday
8 Features Ensure features are owned and on track for release Once a week
9 Automation Ensure automation bugs are owned and on track for resolution Once a week

Features

Please consult the feature testing walkthrough for more information.

Search Provider Top Suggestions(Petruta Rasa)

Full Query
ID Summary Status Resolution
959579 Implement custom styling for the awesomebar suggestion of the search provider RESOLVED INVALID
962490 Add a search field to the new tab page VERIFIED FIXED

2 Total; 0 Open (0%); 1 Resolved (50%); 1 Verified (50%);


Places (Andrei Vaida)

Full Query
ID Summary Status Resolution
610545 Arrowpanel animation VERIFIED FIXED
741050 Downloads initiated by other tabs are misleading NEW
956906 ignore autocomplete="off" when offering to save passwords via the password manager VERIFIED FIXED

3 Total; 1 Open (33.33%); 0 Resolved (0%); 2 Verified (66.67%);


OpenH264 media plugin (Alexandra Lucinet)

Full Query
ID Summary Status Resolution
1009760 Hook up crash reporting for GMP plugins (openh264) VERIFIED FIXED
1009816 Firefox desktop: openh264 updates: check, download, install VERIFIED FIXED
1009909 Firefox desktop: Integrate the openh264 media plugin in the add-ons manager VERIFIED FIXED
1039226 Trigger explicit OpenH264 updates from OpenH264Provider VERIFIED FIXED
1040048 Register the OpenH264 plugin from the OpenH264Provider on startup VERIFIED FIXED
1040937 Open H264 plugin stuck in disabled state after download VERIFIED FIXED
1040941 Non-functional "preference" button for Open H264 plugin (depending on state) VERIFIED FIXED
1041080 Fix OpenH264Provider path registration, default enabled state and logging VERIFIED FIXED
1043531 OpenH264 crash reporting notification not shown VERIFIED FIXED
1044245 GMP with OpenH264 crashes on Windows. VERIFIED FIXED
1045500 Crash reporter notification cuts off OpenH264 plugin name VERIFIED FIXED
1047374 Missing "Submit a crash report" button from OpenH264 crash reporting notification [Windows only] RESOLVED WORKSFORME
1049501 crash in mozilla::gmp::PGMPParent::DeallocShmems() VERIFIED FIXED

13 Total; 0 Open (0%); 1 Resolved (7.69%); 12 Verified (92.31%);


OMTC (Alexandra Lucinet)

https://wiki.mozilla.org/Platform/GFX/OffMainThreadCompositing

Full Query
ID Summary Status Resolution
653064 [meta] e10s front-end tasks tracking bug NEW
879538 [meta] e10s back-end tasks tracking bug RESOLVED FIXED
903892 OMTC on by default everywhere RESOLVED FIXED

3 Total; 1 Open (33.33%); 2 Resolved (66.67%); 0 Verified (0%);


Home/NewTab Search Suggestions (Petruta Rasa)

Full Query
ID Summary Status Resolution
612453 Provide search suggestions on Firefox Start Page (about:home) VERIFIED FIXED
1028985 Provide search suggestions on Firefox new tab page (about:newtab) VERIFIED FIXED

2 Total; 0 Open (0%); 0 Resolved (0%); 2 Verified (100%);


Stability

This section tracks bugs representing the most urgent stability issues. Consult this wiki for more information.

  • Explosive Crashes - ensure new and explosive crashes have actionable bug reports which are in progress
  • Top Crashes - ensure the highest ranked crashes have actionable bug reports which are in progress
  • Untriaged Bugs - ensure bugs are actionable and in the correct component
Full Query
ID Summary Component Op sys Status firefox33
759749 crash in mozilla::dom::CanvasRenderingContext2D::DrawImage @ mozilla::gfx::SourceSurfaceD2DTarget::GetBitmap Graphics: Canvas2D Windows 7 affected
944873 Crash in mozalloc_abort(char const* const) | NS_DebugBreak | nsDebugImpl::Abort(char const*, int) with abort message: ###!!! ABORT: file resource://gre/modules/AsyncShutdown.jsm, line 390) Client: Desktop Windows 8.1 fixed
1009613 crash in mozilla::gl::ReadPixelsIntoDataSurface(mozilla::gl::GLContext*, mozilla::gfx::DataSourceSurface*) Graphics All affected
1012924 Intermittent ERROR: AsyncShutdown timeout in profile-before-change Conditions: [{"name":"Experiments.jsm shutdown","state":"(none)","filename":"resource://app/modules/experiments/Experiments.jsm","lineNumber":408},... Client: Desktop Linux fixed
1025904 Win64 crash in nvwgf2umx.dll@0xa4e4e Graphics Windows NT affected
1029299 Stale pointer in JSObject::TradeGuts() JavaScript Engine All fixed
1041646 crash in mozilla::dom::exceptions::JSStackFrame::GetFilename(nsAString_internal&) DOM: Core & HTML All fixed
1047563 [e10s] mozilla::ipc::MessageChannel::Send crash in responsive design view IPC Windows 7 affected
1057312 AsyncShutdownTimeout "AddonManager: shutting down providers" Add-ons Manager All fixed
1071702 AsyncShutdown crash with "AddonManager: shutting down providers" Add-ons Manager Windows NT affected

10 Total; 10 Open (100%); 0 Resolved (0%); 0 Verified (0%);


Bugs

QA Wanted Bugs

Full Query
ID Summary Status Qa contact Component
945192 The updater.exe loads the bcrypt.dll and other dll's from the working and binary directory when not using the service (Application Update) VERIFIED Kamil Jozwiak [:kjozwiak] Application Update
1062524 When a temporary file is created from the download manager it should be readonly. RESOLVED File Handling

2 Total; 0 Open (0%); 1 Resolved (50%); 1 Verified (50%);


Unconfirmed Bugs

Full Query
ID Summary Component Op sys
847201 Firefox internal downloader app stops working after a few hours Downloads API Linux
1023834 Insert plain text or formatted text in body adds "<br> <pre wrap="">xxx</pre>" Message Compose Window Windows 7
1025915 Bookmark navigation bar icon not active Theme Windows 7
1031871 Right click drop-down text difficult to read. Menus Linux
1034929 Changes to the Zoom feature is needed especially for HiDPI displays. Layout Windows 8.1
1036408 mouseout event fires erroneously when file upload dialog is open DOM: Events macOS
1041156 Firefox Nightly causes second graphics card in a crossfire setup to become very hot and loud. Graphics Windows 7
1043115 infinite loop in _XReply at startup Graphics Linux
1047041 ? issue repeated ? -> 916489UNCONFIRMED --- Unknown silent crash on startup General Windows Vista
1064283 Close buttons not aligned on vertical in addons install notification for some case PopupNotifications and Notification Bars Windows 8.1
1066304 URI encoding not correct for a string with a quoted % symbol Networking Windows 7
1083318 PromiseWorker.js double wrapping on throw Async Tooling Windows 8.1
1083742 Website not displayed correctly when using proxy Networking: HTTP Windows 7
1084070 Frame rate stuttering when screen refresh rate is more than 60 Hz and OMTC enabled Graphics Windows 7
1084336 Browser crashes when a certain page is visited General Windows 7
1085020 setDragImage with data: url image doesn't work immediately / first time DOM: Copy & Paste and Drag & Drop All
1085323 menuAccessKeyFocuses preference frequently gets reset Menus Linux
1085478 download panel, shortcut to the containing folder Downloads Panel All
1085673 Visual glitch semi-randomly renders vertical bars in browser chrome with OMTC+D3D11 enabled (NVIDIA GeForce GTX 560 Ti) Graphics Windows 7
1087467 fontconfig is partially honored Layout: Text and Fonts Linux
1088194 contenteditable div - input box formatting problems DOM: Editor Windows Vista
1088603 404 JavaScript files are reported as html files in the network panel in the devtools Netmonitor Windows 7
1089021 Bookmark Toolbar Padded [GUI] Toolbars and Customization Windows 7
1089164 about:config should allow to change data type of preference (string, boolean...) Preferences Linux
1089321 FF33.0 will delete a saved webpage instead of overwriting changes, when loading from file with a long filename File Handling Windows 7
1089347 Downloads button keeps attention flag after DownloadList.removeFinished() is called Downloads Panel Windows 8.1
1089732 Hardware acceleration turned on while in "Options" is off. Forced in AMD Catalyst 14.9 under 3D settings "firefox.exe" adding to disable Crossfire for Firefox. Firefox 33.0.1 Graphics Windows 7
1091340 Window UI stops updating and moving/resizing the window results in white areas Graphics Windows 8.1
1091470 HP Photosmart 7850 print commands do not work completely Printing: Output Windows 8.1
1091819 New homepage not retained beyond current session in 33.0.2 Settings UI Windows 7
1091857 Firefox does not show certificate selection dialog after installing new certificate Security: PSM Linux
1091859 menus blank/black movies flash black every second after upgrade to 33.0.2 Graphics Windows 7
1092189 Notification of new email is shown as old email OS Integration All
1092694 After display mode changes to a low res and back, with a large amount of tabs, the tab overflow scroll buttons buttons do not ger removed. Tabbed Browser Windows 7
1092709 Fonts aren't smooth in Firefox 33.0.2 Graphics: Text Windows XP
1092878 Feature Request: Faceted Tags Bookmarks & History All
1093736 Firefox crashes while loading page if server is terminated General Linux
1094048 Firefox render SVG-icons different Graphics Windows 7
1094350 Dev tools editor completion panel block first click Style Editor macOS
1094591 Make individual key bindings editable Source Editor macOS
1095273 Duplicate HTTP headers are concatenated in network view Netmonitor Linux
1095966 Graphics Corruption with Firefox 33.0.3 and Intel Mobile Series 4 Graphics, Driver version 8.15.10.2869 Graphics Windows 7
1096087 On OS X, right-click menu thinks it's too short to support all menu items. Obscures bottom item. Menus macOS
1096934 bad font rendering - corrupt anti aliasing Graphics: Text Windows 7
1096943 automatically downloading and installing updates when set not to General Windows Vista
1097508 Firefox caches HTML5 video source URL temporal redirects Audio/Video: Playback Windows 7
1097610 Sometimes a blurry font-icon if shown after text Graphics: Text macOS
1097732 Drag-and-Drop event handler not called for object-tags DOM: Events All
1098026 Cannot import certificate from smtp server/validate preference dialog broken Security All
1098119 Subpixel anti-aliasing inconsistent between chrome and content Graphics: Text Windows 8
1098223 Notification API close to fire too early DOM: Core & HTML All
1098981 [GTK] Firefox is missing characters in fast-typing applications DOM: UI Events & Focus Handling Linux
1099147 Main browser window fails to draw correctly in scaled desktop resolution on Mac Graphics macOS
1099953 Firefox window turns blue have to move mouse around to revel the options beneath and fix it Graphics: Layers Windows 8.1
1100217 Parts of UI text not subpixel-antialiased on Windows XP Graphics: Text Windows XP
1100767 websocket sends large text data Networking: WebSockets Windows 8.1
1100986 Cannot read Web site elements with physical mouse in version 33 while using Window-Eyes screen reader. Disability Access Windows 7
1101114 Incorrect initial rendering of pages, misplacing/not/partially drawing parts of the page on older GPU (NVidia GeForce 4 MX 440) Graphics Linux
1101456 Implement similar feature like "Use a web service to help resolve navigation errors" in Chrome DOM: Navigation All
1101515 FF with apu in dual graphic Graphics Windows 7
1103323 Websites using sync XHR onbeforeunload hang the browser when closing the tab DOM: Core & HTML Windows 7
1103376 Blinking text on web-pages Graphics: Text Linux
1103607 Firefox does not remember the last directory when saving files Downloads API Linux
1103902 Menus appear transparent when hardware acceleration is enabled Graphics Windows 7
1104144 Add relevant context menu items to Go/Reload/Stop button Toolbars and Customization All
1104591 Symbols are occasionally distorted in FireFox Graphics: Layers Linux
1105487 Firefox associated with display glitches on external monitor in Ubuntu Graphics Linux
1105663 Blue Patches visible on address bar while loading or refreshing a page. Graphics Windows 7
1105692 Drag and Drop image into uploading box does not release image handle after the upload is completed DOM: Copy & Paste and Drag & Drop Windows 7
1105713 Fix warnings "Chrome file doesn't exist head.js" in debug test runs Mochitest Linux
1105735 Find as you Type doesn't find links without href Find Backend Linux
1106045 <input>s within <div>s within <a>s create focus cycles Disability Access Linux
1106157 closing tabs doesn't refresh the shown page General Windows 7
1106250 Firefox inverts colors for colored fonts on Linux Graphics: Text Linux
1106253 "Unresponsive Script" dialog should bring owning window to the front over fullscreen video / other windows to allow interaction DOM: Core & HTML Linux
1106469 Downloads icon displays start animation when loading a page Downloads Panel macOS
1106589 Context menu in Downloads Panel is lacking an option to copy the path to the downloaded file. Downloads Panel Linux
1106759 first-letter pseudo selector is not applied on editable content CSS Parsing and Computation Linux
1107985 WheelEvent constructor doesn't set mozMovementX/Y, layerX/Y and mozInputSource DOM: Events Windows 8.1
1108126 Unicode number in un-renderable character doesn't zoom Disability Access Windows 7
1108440 Firefox doesn't honor FlipFlopWheel registry setting on Windows for non-privileged pages Widget: Win32 Windows 7

81 Total; 81 Open (100%); 0 Resolved (0%); 0 Verified (0%);


Fixed Bugs

Review the pushlog and place each Desktop Firefox bug in one of the following categories:

  • A) Tested by the QA Team --> add the verifyme keyword to the bug and set the status-firefox33 flag to fixed
  • B) Tested by a new volunteer --> add the [good first verify] whiteboard tag
  • C) Tested by the bug reporter --> set the needinfo flag to ask the reporter to confirm the bug is fixed
  • D) Not tested at all --> add the [qa-] whiteboard tag

Tips:

  • If you are unsure, set the needinfo flag to the Assignee or QA Contact and ask if the bug needs testing
  • Be sure to set the status-firefox33:fixed flag
  • If the bug includes tests from a developer you can set in-testsuite+
  • Ignore any bugs for non-Desktop platforms, with in-testsuite coverage, or which address test failures

Reported Bugs

Ensure these bugs remain on track to resolve and are verified when fixed.

Bugzilla query error

error, http-bad-status, Array


Bug Fix Verifications

  • Review the bugs below to identify a bug you want to test
  • Make sure you understand the bug before you begin testing it
  • Test on a previously known broken build to make sure you can reproduce the bug
  • Test on the latest build from the branches which are fixed to confirm the bug no longer reproduces
  • Mark the bug VERIFIED FIXED if the bug appears to be fixed and set the appropriate status-firefox flag to verified
  • Reopen the bug if it still reproduces
Full Query
ID Summary Component Severity Op sys
1026919 IonMonkey: (ARM) Simplify the assembler buffer with constant pools. JavaScript Engine: JIT normal All
1045886 Remove Cache directory from Android profiles Networking major All
1073607 Add clever prefs system to enable/disable panic button on per-locale basis for 33, but always enable in 34 beta Toolbars and Customization normal All

3 Total; 3 Open (100%); 0 Resolved (0%); 0 Verified (0%);


Regression Testing

  • Moztrap testrun to cover past regressions, at-risk components, and feature integration tests
  • WebRTC regression test
  • PDF.js and printing
  • Migration on first-run

Milestones

Aurora Migration

Pre-sign-off Checks:

  • {{|}} Automation - document all Mozmill test failures and memory usage regressions
  • {{|}} Features - all scoped features are signed off as ready for Aurora by owners
  • {{|}} Bugs - document and review any reported bugs and issues, nominate them for tracking if serious
  • {{|}} Stability - review crash stats before sign-off to raise any red flags
  • {{|}} L10n - contact :Pike to see if there are any known localization issues

Post-sign-off Checks:

  • {{|}} Updates - previous versions of Aurora update to the new version (check after updates live)
  • {{|}} MM-CI - configure the mozilla-aurora_update testrun on MM-CI to use the aurora channel

Automation

Testrun Reports
Report Test Failures
Add-ons
Functional
Remote
L10n
Updates
Endurance
Memory Usage Report
Platform Min Memory Usage Max Memory Usage Avg Memory Usage Net Compared to Firefox 32
Windows 32-bit
Mac OS X
Linux 32-bit
Linux 64-bit

Memory regression being tracked/investigated in: <bug number>

Features

Feature Owner Aurora Sign-off Status Potential Blockers
OMTC Alexandra Lucinet
Web RTC - bundle in SDP handling

Updates

Platform Source Build Target Build Result
Windows
Mac OS X
Linux


Reported Bugs

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);


Betas

Known Mozmill Failures

Full Query
ID Summary Resolution
864656 Test Failure "Window has been found" in /testAddons_installUninstallHardBlocklistedExtension/test2.js and /testAddons_installUninstallSoftBlocklistedExtension/test2.js INVALID
904610 Test failure "'false' should equal 'true'" in testAddons_changeTheme/test3.js INVALID
931704 Test failure "plainTheme is undefined" in /restartTests/testAddons_changeTheme/test1.js FIXED
942737 Test failure "Suggestions from two search engines are available - '1' should equal '2' " in testSearchSuggestions.js FIXED
945188 Test failure "Auto-complete popup is not visible - got 'false'" in /testFormManager/testClearFormHistory.js INVALID
947885 Test failure 'controller.waitForPageLoad(): Timeout waiting for page loaded.' in /restartTests/testAddons_InstallAddonWithoutEULA/test1.js INVALID
951225 [an] Test failure "The tab with index '0' has been selected" in /testTabbedBrowsing/testOpenInForeground.js FIXED
958068 Test failure "Cookie value is displayed in private mode - 'undefined' should equal 'cookieValue'" in testFlashCookie.js FIXED
974930 Test failure "Add-on has been specified. - got 'undefined'" in restartTests INVALID
999357 Test failure "Context menu has been opened." in testSessionStore\testUndoTab.js FIXED
1050253 [ff, fa] Test failure "node.localName is undefined" in testSafeBrowsingNotificationBar.js FIXED
1057416 Test failure 'aElem is undefined' in testAddons/testInstallAddonWithoutEula.js Remote test FIXED
1062330 Test Failure 'controller.waitForPageLoad(URI=https://www.stopbadware.org/firefox*, readyState=loading)' in /testSecurity/testSafeBrowsingNotificationBar.js INVALID
1069801 Test failure "controller(): Window has been initialized." in testPreferences/testPasswordNotSaved.js INVALID
1071515 Test failure 'The Close button has not been found' in /testSecurity/testSafeBrowsingNotificationBar.js FIXED
1074929 Test failure "Application crashed" in /restartTests/testAddons_uninstallExtension/test3.js INVALID

16 Total; 16 Open (100%); 0 Resolved (0%); 0 Verified (0%);


All open Mozmill test case fail bugs

Beta 1

B1 Build Information

B1 Sign-off Criteria

  • Mozmill functional automation ran without unexpected failures
  • Mozmill update automation ran without unexpected failures
  • New features pass basic smoketests
  • 0 beta blocking regression, stability, or support issues discovered

B1 Testing

  • Manual
    • [DONE] Smoketest new features
      • [DONE] Verify Bug 1059798 - activate Loop and have 1:1 calls with friends (basic dogfooding)
    • [DONE] Verify no HSB builds were generated - PASS
  • Automated (configs)
    • [DONE] Automation Functional tests (report) - PASS
    • [DONE] Updates on betatest channel (report) - PASS
    • [DONE] Updates on releasetest channel (report) - PASS
    • [DONE] Updates on beta channel (report) - PASS

B1 Bugs Reported

Full Query
ID Summary Resolution
1000097 UI issues when tiles are dragged out of the tab then resize (tiles locked at old size/position) WONTFIX
1007993 Unnecessary scrollbar appears temporarily when deleting thumbnail in about:newtab WONTFIX
1008929 Unpinning a tile causes a short "bounce" of the whole grid to the left WONTFIX
1020888 Full screen view of the conversation window needs resizing WORKSFORME
1029861 On Loop (& Social) popped-out window, the right-click context menu seems to have all possible menu-entries WORKSFORME
1043489 Fullscreen video doesn't release wakelock when playback stops FIXED
1056035 Unnecessarily line displayed above Find Updates option for h264 plugin FIXED
1056041 'Change when this add-on runs' button changes size when clicked INACTIVE
1060846 Form history dropdown shows only 2 items in search field of about:home/about:newtab FIXED
1062210 Odd border on the "What's new page?" message DUPLICATE
1062259 OpenH264 plugin is not installing on Firefox 33b1, 34.0a2 and 35.0a1 WORKSFORME
1062270 Misplaced close button for the sponsored pop-up WONTFIX

12 Total; 12 Open (100%); 0 Resolved (0%); 0 Verified (0%);


Beta 2

B2 Build Information

B2 Sign-off Criteria

  • Mozmill functional automation ran without unexpected failures
  • Mozmill update automation ran without unexpected failures
  • 0 beta blocking regression, stability, or support issues discovered

B2 Testing

B2 Bugs Reported

Full Query
ID Summary Resolution
916489 Unknown silent crash on startup INCOMPLETE
989347 crash in mozilla::WebGLTexture::DoDeferredImageInitialization(unsigned int, int) WORKSFORME

2 Total; 2 Open (100%); 0 Resolved (0%); 0 Verified (0%);


Beta 3

B3 Build Information

B3 Sign-off Criteria

  • Mozmill functional automation ran without unexpected failures
  • Mozmill update automation ran without unexpected failures
  • 0 beta blocking regression, stability, or support issues discovered

B3 Testing

B3 Bugs Reported

Full Query
ID Summary Resolution
911164 Current window loses focus temporarily when hovering the pointer over the QuickTime volume button WONTFIX
942130 360p max resolution for WebM HTML5 Videos on Youtube DUPLICATE
974910 Controls bar is moved up for audio files played inline
1000097 UI issues when tiles are dragged out of the tab then resize (tiles locked at old size/position) WONTFIX
1007993 Unnecessary scrollbar appears temporarily when deleting thumbnail in about:newtab WONTFIX
1010976 Hitting the "Hide Controls" option twice causes the container area to disappear FIXED
1053783 New window gets out of focus after exiting full screen mode FIXED
1059726 Hide Controls/Show Controls displays fullscreen button for audio files. DUPLICATE
1066480 The scrolling is laggy on Windows Xp. INVALID

9 Total; 9 Open (100%); 0 Resolved (0%); 0 Verified (0%);


Beta 4

B4 Build Information

B4 Sign-off Criteria

  • Mozmill functional automation ran without unexpected failures
  • Mozmill update automation ran without unexpected failures
  • 0 beta blocking regression, stability, or support issues discovered

B4 Testing

B4 Bugs Reported

Full Query
ID Summary Resolution
947079 Passive mixed content indicator (grey triangle) shows up on full HTTPS sites that have no mixed content FIXED
1000108 Switching videos from sd to hd in quicktime is not working properly in Firefox. INCOMPLETE
1018882 No option to deselect text if all selected in presentation mode FIXED
1052415 [Linux] Videos played using libtotem( quicktime for linux) plugin are glitching over different Firefox tabs. WONTFIX
1059816 [PDF.js] Changing the pages through the input for page number with keyboard UP and DOWN arrow keys loses focus WORKSFORME

5 Total; 5 Open (100%); 0 Resolved (0%); 0 Verified (0%);


Beta 5

B5 Build Information

B5 Sign-off Criteria

  • Mozmill functional automation ran without unexpected failures
  • Mozmill update automation ran without unexpected failures
  • 0 beta blocking regression, stability, or support issues discovered

B5 Testing

  • Manual
  • Automated (configs)
    • [DONE] Automation Functional tests (report) - PASS
    • [DONE] Updates on beta-cdntest channel (report) - PASS
    • [DONE] Updates on beta channel (report) - PASS

B5 Bugs Reported

Full Query
ID Summary Resolution
904673 Canceling master password request when accessing saved password opens password window WONTFIX
1069925 FaceCam microphone appears twice on the doorhanger dropdown INCOMPLETE

2 Total; 2 Open (100%); 0 Resolved (0%); 0 Verified (0%);


Beta 6

B6 Build Information

B6 Sign-off Criteria

  • Mozmill functional automation ran without unexpected failures
  • Mozmill update automation ran without unexpected failures
  • 0 beta blocking regression, stability, or support issues discovered

B6 Testing

  • Manual
  • Automated (configs)
    • [DONE] Automation Functional tests (report) - PASS
    • [DONE] Updates on beta-cdntest channel (report) - PASS
    • [DONE] Updates on beta channel (report) - PASS

B6 Bugs Reported

Note: This section will be updated once QA has finished all testing activities.
Full Query
ID Summary Resolution
1008178 Intermittently, mouse-over on personas doesn't preview the themes INACTIVE
1071558 Middle and right click on search suggestions perform the search in the same tab on about:home/newtab FIXED

2 Total; 2 Open (100%); 0 Resolved (0%); 0 Verified (0%);


Beta 7

B7 Build Information

B7 Sign-off Criteria

  • Mozmill functional automation ran without unexpected failures
  • Mozmill update automation ran without unexpected failures
  • 0 beta blocking regression, stability, or support issues discovered

B7 Testing

  • Manual
    • [DONE] Manual smoketesting: Web compatibility, Add-on compatibility, Secure browsing, Common media format playback, Sync & Persona sign-on.
    • [DONE] Verification of Bug 1069405
  • Automated (configs)
    • [DONE] Automation Functional tests (report) - PASS
    • [DONE] Updates on beta-cdntest channel (report) - PASS
    • [DONE] Updates on beta channel (report) - PASS

B7 Bugs Reported

Note: This section will be updated once QA has finished all testing activities.
Full Query
ID Summary Resolution
942130 360p max resolution for WebM HTML5 Videos on Youtube DUPLICATE
947079 Passive mixed content indicator (grey triangle) shows up on full HTTPS sites that have no mixed content FIXED
1000108 Switching videos from sd to hd in quicktime is not working properly in Firefox. INCOMPLETE
1010976 Hitting the "Hide Controls" option twice causes the container area to disappear FIXED
1059726 Hide Controls/Show Controls displays fullscreen button for audio files. DUPLICATE
1069940 Intermittent browser_600545.js | uncaught exception - NS_ERROR_XPC_BAD_CONVERT_NATIVE: at :0 WORKSFORME

6 Total; 6 Open (100%); 0 Resolved (0%); 0 Verified (0%);


Beta 8

B8 Build Information

B8 Sign-off Criteria

  • Mozmill functional automation ran without unexpected failures
  • Mozmill update automation ran without unexpected failures
  • 0 beta blocking regression, stability, or support issues discovered

B8 Testing

B8 Bugs Reported

Note: This section will be updated once QA has finished all testing activities.
Full Query
ID Summary Resolution
1022458 Nav-bar overflow panel hidden during customize INCOMPLETE

1 Total; 1 Open (100%); 0 Resolved (0%); 0 Verified (0%);


Beta 9

B9 Build Information

B9 Sign-off Criteria

  • Mozmill functional automation ran without unexpected failures
  • Mozmill update automation ran without unexpected failures
  • 0 beta blocking regression, stability, or support issues discovered

B9 Testing

  • Manual
  • Automated (configs)
    • [DONE] Automation Functional tests (report) - PASS
    • [DONE] Updates on beta-cdntest channel (report) - PASS
    • [DONE] Updates on beta channel (report) - PASS

B9 Bugs Reported

Note: This section will be updated once QA has finished all testing activities.
Full Query
ID Summary Resolution
497164 Volume settings (e.g. mute) are not persistent - always 100% after load
942130 360p max resolution for WebM HTML5 Videos on Youtube DUPLICATE
962560 Audio volume UI resets to full volume after toggling the screen size of a video FIXED
1010976 Hitting the "Hide Controls" option twice causes the container area to disappear FIXED
1059726 Hide Controls/Show Controls displays fullscreen button for audio files. DUPLICATE

5 Total; 5 Open (100%); 0 Resolved (0%); 0 Verified (0%);


RC Build 1

RC Build 1 Information

RC Build 1 Sign-off Criteria

  • Mozmill functional automation ran without unexpected failures
  • Mozmill update automation ran without unexpected failures
  • 0 beta blocking regression, stability, or support issues discovered

RC Build 1 Testing

  • Manual
    • [DONE] Verification for disabling of MacOSX disable screensaver feature - PASS
    • [DONE] Exploratory testing covering Web Compatibility, Audio/Video, Secure Browsing - FAIL (bugs 905902, 1079848)
      • Neither of those crashes reported would be considered top crashers, thus not tracked nor blocking release.
    • [DONE] Bug verification with focus on most recent fixes - PASS
  • Automated (configs)
    • [DONE] Automation Functional tests (report) - PASS
    • [DONE] Updates on beta-cdntest channel (report) -
    • [DONE] Updates on beta channel (report) - PASS

RC Build 1 Bugs Reported

Note: This section will be updated once QA has finished all testing activities.
Full Query
ID Summary Resolution
905902 Crash while scrolling complex and big web pages WONTFIX
942130 360p max resolution for WebM HTML5 Videos on Youtube DUPLICATE
947079 Passive mixed content indicator (grey triangle) shows up on full HTTPS sites that have no mixed content FIXED
1010976 Hitting the "Hide Controls" option twice causes the container area to disappear FIXED
1059726 Hide Controls/Show Controls displays fullscreen button for audio files. DUPLICATE
1079848 Large OOM in mozilla::WebGLContext::TexImage2D_base FIXED

6 Total; 6 Open (100%); 0 Resolved (0%); 0 Verified (0%);


RC Build 2

RC Build 2 Information

RC Build 2 Sign-off Criteria

  • Mozmill functional automation ran without unexpected failures
  • Mozmill update automation ran without unexpected failures
  • 0 beta blocking regression, stability, or support issues discovered

RC Build 2 Testing

  • Manual
  • Automated (configs)
    • [DONE] Automation Functional tests (report) - PASS
    • [DONE] Updates on releasetest channel (report) - PASS
    • [DONE] Updates on release channel (report) - PASS

RC Build 2 Bugs Reported

Note: This section will be updated once QA has finished all testing activities.
Full Query
ID Summary Resolution
1079734 [Mac OS X]White lines are drawn during zooming of http://www.versicherungsjournal.de/yellowdot_alt.gif INCOMPLETE

1 Total; 1 Open (100%); 0 Resolved (0%); 0 Verified (0%);


33.0.1 Build 2

note: build 1 was scrapped before it went to release.

33.0.1 Build 2 Information

33.0.1 Build 2 Sign-off Criteria

  • Mozmill functional automation ran without unexpected failures
  • Mozmill update automation ran without unexpected failures
  • 0 beta blocking regression, stability, or support issues discovered

33.0.1 Build 2 Testing

  • Manual
    • [DONE] Exploratory testing around: Web Compatibility, WebGL, WebRTC, Add-ons. etherpad - PASS
  • Automated (configs)
    • [DONE] Automation Functional tests (report) - PASS
    • [DONE] Updates on betatest channel (report) - PASS
    • [DONE] Updates on releasetest channel (report) - PASS
    • [DONE] Updates on release channel (report) - PASS

33.0.1 Build 2 Bugs Reported

Note: This section will be updated once QA has finished all testing activities.
Full Query
ID Summary Resolution
1087932 Some WebGL games/animations fail to work on some Radeon 3000 devices starting with Firefox 32.0.3 WORKSFORME

1 Total; 1 Open (100%); 0 Resolved (0%); 0 Verified (0%);


33.0.2

note: build 1 was scrapped before it went to release.

33.0.2 Build 1 Information

33.0.2 Build 1 Sign-off Criteria

  • Mozmill functional automation ran without unexpected failures
  • Mozmill update automation ran without unexpected failures
  • 0 beta blocking regression, stability, or support issues discovered

33.0.2 Build 1 Testing

  • Manual
    • [DONE] Exploratory testing around: Web Compatibility, WebGL. etherpad - PASS
  • Automated (configs)
    • [DONE] Automation Functional tests (report) - PASS
    • [DONE] Updates on betatest channel (report) - PASS
    • [ON TRACK] Updates on releasetest channel (report) -
    • [ON TRACK] Updates on release channel (report) -

33.0.2 Build 1 Bugs Reported

Note: This section will be updated once QA has finished all testing activities.
Full Query
ID Summary Resolution
1089652 crash in js::jit::OutOfLineCode::bind(js::jit::MacroAssembler*) WORKSFORME
1089682 OOM crash on http://pioul.fr/lolgl/ WebGl game. WORKSFORME

2 Total; 2 Open (100%); 0 Resolved (0%); 0 Verified (0%);


33.0.2 Build 2 Information

33.0.2 Build 2 Sign-off Criteria

  • Mozmill functional automation ran without unexpected failures
  • Mozmill update automation ran without unexpected failures
  • 0 beta blocking regression, stability, or support issues discovered

33.0.2 Build 2 Testing

  • Manual
    • [DONE] Exploratory testing around: Web Compatibility, WebGL. etherpad - PASS
  • Automated (configs)
    • [DONE] Automation Functional tests (report) - PASS
    • [DONE] Updates on betatest channel (report) - PASS
    • [DONE] Updates on releasetest channel (report) - PASS
    • [DONE] Updates on release channel (report) - PASS

33.0.2 Build 2 Bugs Reported

Note: This section will be updated once QA has finished all testing activities.
Full Query
ID Summary Resolution
1085203 Street names won't show in Google Maps in Firefox 33 FIXED
1089652 crash in js::jit::OutOfLineCode::bind(js::jit::MacroAssembler*) WORKSFORME
1089682 OOM crash on http://pioul.fr/lolgl/ WebGl game. WORKSFORME
1090338 Zooming does not work properly and the background is black in Google Maps while HWA is enabled FIXED

4 Total; 4 Open (100%); 0 Resolved (0%); 0 Verified (0%);


33.0.3

note: build 1 was scrapped before it went to release.

33.0.3 Build 2 Information

33.0.3 Build 2 Sign-off Criteria

  • Mozmill functional automation ran without unexpected failures
  • Mozmill update automation ran without unexpected failures
  • 0 beta blocking regression, stability, or support issues discovered

33.0.2 Build 2 Testing

  • Manual
    • [DONE] Exploratory testing around: Web Compatibility, WebGL. etherpad - PASS
  • Automated (configs)
    • [DONE] Automation Functional tests (report) - PASS
    • [DONE] Updates on betatest channel (report) - PASS
    • [ON TRACK] Updates on releasetest channel (report) -
    • [ON TRACK] Updates on release channel (report) -

33.0.3 Build 2 Bugs Reported

Note: This section will be updated once QA has finished all testing activities.
Full Query
ID Summary Resolution
942130 360p max resolution for WebM HTML5 Videos on Youtube DUPLICATE
1087932 Some WebGL games/animations fail to work on some Radeon 3000 devices starting with Firefox 32.0.3 WORKSFORME

2 Total; 2 Open (100%); 0 Resolved (0%); 0 Verified (0%);

Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_33/Test_Plan&oldid=1031312"