Releases/Firefox 53/Test Plan/Beta/2

From MozillaWiki
Jump to: navigation, search

«  Firefox 53 Beta 1 | Firefox 53 Beta 2 | Firefox 53 Beta 3 »

Firefox 53.0 Beta 2 Test Plan

QE recommendation regarding the quality of the build

  • Recommendation based on results from manual testing:
Build 1 SHIP IT

Manual Testing summary - Platform Coverage and Areas Tested

  • Testing performed on the new features in this version: session restore, scroll & zoom, bookmarks.
  • Test Cases executed and results: report

Build 1

Platform GPU Build architecture Assignee Results: report
Windows 7 x86 NVIDIA GeForce 210 32-bit Camelia Badau [DONE]
Windows 8.1 x64 Intel HD 520 32-bit Mihai Boldan [DONE]
macOS 10.12.3 Intel Iris Pro 64-bit Emil Ghitta [DONE]
Ubuntu 14.04 x86 Intel HD 4600 32-bit Iulia Cristescu [DONE]
Tested Area Testing Type Results
Session restore Smoke Testing PASSED
Scroll & zoom Smoke and Exploratory Testing PASSED
Bookmarks Smoke Testing PASSED

Features

See the [1] gdoc for a general overview

Feature Owner Testing Pre-Release sign off Details Test Plan
Visual refresh of media controls Iulia Cristescu [ON TRACK] [NOT STARTED] planned to release with Firefox 53; pre-Release sign off planned to be completed by March 31 Test Plan
Sync Bookmarks Tracker Kanchan Kumari (Engineering QA) [ON TRACK] Template:Mstarted planned to release with Firefox 53; pre-Release sign off planned to be completed by March 31; will be signed off by Engineering QA. Test Plan
Symbol Exporting Cristian Comorasu [ON TRACK] [NOT STARTED] Feature set to release with Firefox 53. Test Plan
Send stacktraces Petruta Rasa [ON TRACK] [NOT STARTED] Feature set to release with Firefox 53. ---
Compact Themes Ciprian Georgiu [ON TRACK] [NOT STARTED] Feature set to release with Firefox 53. Test Plan
Quantum - Compositor Process for Windows Alexandru Simonca [ON TRACK] [NOT STARTED] Feature set to release with Firefox 53. Test Plan
Implement support for WebM Alpha Mihai Boldan [ON TRACK] [NOT STARTED] Feature set to release with Firefox 53. Test Plan
"Show All Downloads" dropmarker Cristian Comorasu [ON TRACK] [NOT STARTED] Plan is to keep this feature enabled in Nightly and Aurora only, per Wesly Huang. Test Plan
Reader Mode Displays Estimated Reading Time Timea Zsoldos [ON TRACK] [NOT STARTED] Feature set to release with Firefox 53. Test Plan
Large-Allocation header Ciprian Georgiu [ON TRACK] [NOT STARTED] Feature set to release with Firefox 53. ---
TURN/TLS support Alexandru Simonca [AT RISK] [NOT STARTED] Feature set to release with Firefox 53, although the bug that blocks testing (1336507) has not been uplifted to Firefox 53. ---

Results

New bugs

Bugzilla query error

error, http-bad-status, Array


Known Issues - also seen in previous builds

Major issues also seen in previous builds

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);


Low impact issues also seen in previous builds

Full Query
ID Summary Status Resolution
423126 favicons aren't backed up to *.json RESOLVED WONTFIX
428378 Synced tabs, bookmarks, and history entries don't have a favicon until the user re-visits that page again NEW
1043280 Bookmark animation not displayed when page is bookmarked from the Context Menu NEW
1177382 Error is thrown by controller.jsm each time a URL is dragged onto the Bookmarks Toolbar RESOLVED FIXED
1243385 Bad repainting while scrolling on gaming.youtube.com REOPENED
1247925 Glitches opening show all bookmarks folders from edit this bookmark NEW
1249000 Using "load in sidebar" with bookmarks to about:reader URLs (pages in Reader mode) don't actually load in the sidebar RESOLVED WONTFIX
1277327 Video on gaming.youtube.com lags behind while scrolling NEW
1338549 "Open All in Tabs" should be unavailable when opening context menu on Recently Bookmarked section header and on other non-bookmark items (in both the main bookmarks menu and the bookmarks toolbar button menu) NEW

9 Total; 6 Open (66.67%); 3 Resolved (33.33%); 0 Verified (0%);


Branch Bug Fix Verifications

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed