Releases/Firefox 53/Test Plan/Beta/3

From MozillaWiki
Jump to: navigation, search

«  Firefox 53 Beta 2 | Firefox 53 Beta 3 | Firefox 53 Beta 4 »

Firefox 53.0 Beta 3 Test Plan

QE recommendation regarding the quality of the build

  • Recommendation based on results from manual testing:
Build 1 SHIP IT

Manual Testing summary - Platform Coverage and Areas Tested

  • Testing performed on the new features in this version: Mac OS X Signing, Mac OS X 32-bit mode, Printing and Downloads.
  • Test Cases executed and results: report

Build 1

Platform GPU Build architecture Assignee Results: report
Windows 10 x86 Intel HD 5500 32-bit Camelia Badau [DONE]
Windows 7 x64 Intel HD 4600 64-bit Iulia Cristescu [DONE]
Mac OS X 10.10 Intel Iris Pro (1536 MB) 64-bit Mihai Boldan [DONE]
Ubuntu 16.04 x64 Intel HD 2500 64-bit Petruta Rasa [DONE]
Tested Area Testing Type Results
Mac OS X 32-bit mode Smoke Testing PASSED (as in: no longer available)
Mac OS X signing Smoke Testing PASSED
Printing Smoke Testing PASSED
Downloads Smoke Testing PASSED

Features

See the [1] gdoc for a general overview

Feature Owner Testing Pre-Release sign off Details Test Plan
Visual refresh of media controls Iulia Cristescu [ON TRACK] [NOT STARTED] planned to release with Firefox 53; pre-Release sign off planned to be completed by March 31 Test Plan
Sync Bookmarks Tracker Kanchan Kumari (Engineering QA) [ON TRACK] [NOT STARTED] planned to release with Firefox 53; pre-Release sign off planned to be completed by March 31; will be signed off by Engineering QA. Test Plan
Symbol Exporting Cristian Comorasu [ON TRACK] [NOT STARTED] Feature set to release with Firefox 53. Test Plan
Send stacktraces Petruta Rasa [ON TRACK] [NOT STARTED] Feature set to release with Firefox 53. ---
Compact Themes Ciprian Georgiu [ON TRACK] [NOT STARTED] Feature set to release with Firefox 53. Test Plan
Quantum - Compositor Process for Windows Alexandru Simonca [ON TRACK] [NOT STARTED] Feature set to release with Firefox 53. Test Plan
Implement support for WebM Alpha Mihai Boldan [ON TRACK] [NOT STARTED] Feature set to release with Firefox 53. Test Plan
"Show All Downloads" dropmarker Cristian Comorasu [ON TRACK] [NOT STARTED] Plan is to keep this feature enabled in Nightly and Aurora only, per Wesly Huang. Test Plan
Reader Mode Displays Estimated Reading Time Timea Zsoldos [ON TRACK] [NOT STARTED] Feature set to release with Firefox 53. Test Plan
Large-Allocation header Ciprian Georgiu [ON TRACK] [NOT STARTED] Feature set to release with Firefox 53. ---
TURN/TLS support Alexandru Simonca [ON TRACK] [NOT STARTED] Feature set to release with Firefox 53, although the bug that blocks testing (1336507) has not been uplifted to Firefox 53. ---

Results

New bugs

Full Query
ID Summary Status Resolution
1348290 Pause contextual menu option is grayed out after cancelling and resuming a download RESOLVED INVALID

1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);


Known Issues - also seen in previous builds

Major issues also seen in previous builds

Bugzilla query error

error, http-bad-status, Array


Low impact issues also seen in previous builds

Full Query
ID Summary Status Resolution
1161952 [Ubuntu] Low quality when printing a pdf file NEW
1195053 Cancelling a retried download gives NS_BASE_STREAM_CLOSED: Component returned failure code: 0x80470002 NEW
1295375 Drop support for universal Mac builds in Firefox 53 RESOLVED FIXED

3 Total; 2 Open (66.67%); 1 Resolved (33.33%); 0 Verified (0%);


Branch Bug Fix Verifications

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed