Releases/Firefox 46/Test Plan/Beta/4

From MozillaWiki
Jump to navigation Jump to search

«  Firefox 46 Beta 2 | Firefox 46 Beta 4 | Firefox 46 Beta 5  »

Firefox 46.0 Beta 4 Test Plan

QE recommendation regarding the quality of the build

  • Recommendation based on results from manual testing:
Build 1 GOOD FOR RELEASE


Manual Testing summary - Platform Coverage and Areas Tested

  • Testing performed around: video/audio compatibility and the crash reporter.
  • Test Cases executed and results: report

Build 3

Platform Build architecture Assignee Results: report
Windows Vista x86 (nVIDIA GeForce 620) 32-bit Cornel Ionce [DONE]
Windows 10 x64 (Intel HD Graphics 4600) 32-bit Iulia Cristescu [DONE]
Mac OS X 10.8 (ATI Radeon HD 2400 XT 128 MB) 64-bit Bogdan Maris [DONE]
Ubuntu 14.04 x64 (Intel HD 2500) 64-bit Mihai Boldan [DONE]
Tested Area Testing Type Results
Video compatibility Regression Testing PASS
Audio compatibility Regression Testing PASS
Crash reporter Regression Testing PASS

Features

See the Feature Release Tracking gdoc for a general overview


Feature Owner Status Details Test Plan
APZ Petruta Rasa [ON TRACK] Feature targeted for Firefox 46 - final QA sign-off at the end of Beta 46 Test Plan

Results

New bugs

Full Query
ID Summary Status Resolution
1258644 Incorrect version displayed for 46.0b4 builds VERIFIED FIXED
1258690 Videos are not played on last.fm RESOLVED INVALID
1258722 The user should be able to enter/exit full screen via double click event even if video controls are hidden RESOLVED INVALID

3 Total; 0 Open (0%); 2 Resolved (66.67%); 1 Verified (33.33%);


Known Issues - also seen in previous builds

Major issues also seen in previous builds

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1


Low impact issues also seen in previous builds

Full Query
ID Summary Status Resolution
839074 Selected text doesn't stay selected after zoom RESOLVED FIXED
1043280 Bookmark animation not displayed when page is bookmarked from the Context Menu RESOLVED WORKSFORME
1144124 Select all in PDFs also selects text in the pdf.js UI NEW
1159259 [e10s] Link-related commands on context menu on sidebar links doesn't work VERIFIED FIXED
1177382 Error is thrown by controller.jsm each time a URL is dragged onto the Bookmarks Toolbar RESOLVED FIXED
1177385 pdf.js's controls are also affected by the zooming actions initiated from the menu RESOLVED DUPLICATE
1181437 Ctrl-D in about:newtab allows bookmarking the New Tab page, even though the bookmark star button is disabled RESOLVED WONTFIX
1210769 Glitches after opening images via flickr RESOLVED WORKSFORME
1211884 The tools menu from the pdf.js page is not dismissed by clicking on the toolbar VERIFIED FIXED
1224550 Glitches when resizing firefox width on unsplash.com RESOLVED WORKSFORME
1224553 The stats are displayed for one second when opening a picture from unsplash.com RESOLVED INCOMPLETE
1247925 Glitches opening show all bookmarks folders from edit this bookmark RESOLVED INVALID

12 Total; 1 Open (8.33%); 9 Resolved (75%); 2 Verified (16.67%);


Branch Bug Fix Verifications

Full Query
ID Summary Status Resolution
1214261 Crash on the mac while scrolling due to massive scrollbars VERIFIED FIXED

1 Total; 0 Open (0%); 0 Resolved (0%); 1 Verified (100%);

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed