Releases/Firefox 53/Test Plan/Beta/1

From MozillaWiki
Jump to: navigation, search

«  Firefox 52 RC1 | Firefox 53 Beta 1 | Firefox 53 Beta 2 »

Firefox 53.0 Beta 1 Test Plan

QE recommendation regarding the quality of the build

  • Recommendation based on results from manual testing:
Build 1 SHIP IT

Manual Testing summary - Platform Coverage and Areas Tested

  • Testing performed on the new features in this version: WebM Alpha support, Compact themes and Quantum Compositor Process for Windows.
  • Test Cases executed and results: report

Build 2

Platform GPU Build architecture Assignee Results: report
Windows 7 x64 AMD Radeon HD 6450 32-bit Bogdan Maris [DONE]
Windows 10 x64 Intel HD Graphics 530 64-bit Emil Ghitta [DONE]
Mac OS X 10.11.6 Intel Iris Pro 64-bit Cristian Comorasu [DONE]
Ubuntu 14.04 x64 Intel HD Graphics 5500 64-bit Timea Zsoldos [DONE]
Tested Area Testing Type Results
WebM Alpha support Smoke Testing PASSED
Compact Themes Smoke Testing PASSED
Compositor Process for Windows Smoke Testing PASSED

Features

See the [1] gdoc for a general overview

Feature Owner Testing Sign off Details Test Plan
Windows Stub Installer Camelia Badau [ON TRACK] NOT STARTED Feature will ship with 64-bit as a non-default option in Fx 53. Test Plan
Visual refresh of media controls Iulia Cristescu [ON TRACK] NOT STARTED Feature set to release with Firefox 53. Test Plan
Sync Bookmarks Tracker Kanchan Kumari (Engineering QA) [ON TRACK] NOT STARTED Feature set to release with Firefox 53. Will be signed off by Engineering QA. Test Plan
Symbol Exporting Cristian Comorasu [ON TRACK] NOT STARTED Feature set to release with Firefox 53. Test Plan
Send stacktraces Petruta Rasa [ON TRACK] NOT STARTED Feature set to release with Firefox 53. ---
Compact Themes Ciprian Georgiu [ON TRACK] NOT STARTED Feature set to release with Firefox 53. Test Plan
Quantum - Compositor Process for Windows Alexandru Simonca [ON TRACK] NOT STARTED Feature set to release with Firefox 53. Test Plan
Implement support for WebM Alpha Mihai Boldan [ON TRACK] NOT STARTED Feature set to release with Firefox 53. Test Plan
"Show All Downloads" dropmarker Cristian Comorasu [ON TRACK] NOT STARTED Plan is to keep this feature enabled in Nightly and Aurora only, per Wesly Huang. Test Plan
Reader Mode Displays Estimated Reading Time Timea Zsoldos [ON TRACK] NOT STARTED Feature set to release with Firefox 53. Test Plan
Large-Allocation header Ciprian Georgiu [ON TRACK] NOT STARTED Feature set to release with Firefox 53. ---
TURN/TLS support --- [AT RISK] NOT STARTED Feature set to release with Firefox 53, although the bug that blocks testing (1336507) has not been uplifted to Firefox 53. ---

Results

New bugs

Full Query
ID Summary Status Resolution
1345473 Changing tab order using Compact themes cause an overlap VERIFIED FIXED

1 Total; 0 Open (0%); 0 Resolved (0%); 1 Verified (100%);


Known Issues - also seen in previous builds

Major issues also seen in previous builds

Bugzilla query error

error, http-bad-status, Array


Low impact issues also seen in previous builds

Full Query
ID Summary Status Resolution
1094532 Tabs should have a more visible hover effect RESOLVED DUPLICATE
1339792 The background changes its color when dismissing the color panel RESOLVED DUPLICATE
1339839 Flickering and bad repainting occur after hitting the "Terminate GPU Process" button NEW
1339859 [meta] Very slow width resize action when multiple tabs are pinned using compact themes RESOLVED FIXED
1343818 Crash when terminating the GPU process while playing a video on social media RESOLVED DUPLICATE

5 Total; 1 Open (20%); 4 Resolved (80%); 0 Verified (0%);


Branch Bug Fix Verifications

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed