Releases/Firefox 53/Test Plan/Beta/6

From MozillaWiki
Jump to: navigation, search

«  Firefox 53 Beta 5 | Firefox 53 Beta 6 | Firefox 53 Beta 7 »

Firefox 53.0 Beta 6 Test Plan

QE recommendation regarding the quality of the build

  • Recommendation based on results from manual testing:
Build 1 SHIP IT

Manual Testing summary - Platform Coverage and Areas Tested

  • Testing performed on the following areas: Migration, Geolocation, Search and Crash reporter.
  • Test Cases executed and results: report

Build 1

Platform GPU Build architecture Assignee Results: report
Windows 7 x64 Intel(R) HD Graphics 5500 32-bit Timea Zsoldos [DONE]
Windows 10 x64 AMD Radeon R7 200 32-bit Paul Silaghi [DONE]
mac OS 10.12 Intel Iris Pro 1536 MB 64-bit Mihai Boldan [DONE]
Ubuntu 16.04 x86 AMD Radeon HD 6450 32-bit Bogdan Maris [DONE]
Tested Area Testing Type Results
Migration Smoke Testing PASSED
Geolocation Smoke Testing PASSED
Search Smoke Testing PASSED
Crash reporter Smoke Testing PASSED

Features

See the [1] gdoc for a general overview

Feature Owner Testing Pre-Release sign off Details Test Plan
Visual refresh of media controls Iulia Cristescu [ON TRACK] [NOT STARTED] planned to release with Firefox 53; pre-Release sign off planned to be completed by March 31 Test Plan
Sync Bookmarks Tracker Kanchan Kumari (Engineering QA) [ON TRACK] [NOT STARTED] planned to release with Firefox 53; pre-Release sign off planned to be completed by March 31; will be signed off by Engineering QA. Test Plan
Symbol Exporting Cristian Comorasu [ON TRACK] [NOT STARTED] Feature set to release with Firefox 53. Test Plan
Send stacktraces Petruta Rasa [ON TRACK] [NOT STARTED] Feature set to release with Firefox 53. ---
Compact Themes Ciprian Georgiu [ON TRACK] [NOT STARTED] Feature set to release with Firefox 53. Test Plan
Quantum - Compositor Process for Windows Alexandru Simonca [ON TRACK] [NOT STARTED] Feature set to release with Firefox 53. Test Plan
Implement support for WebM Alpha Mihai Boldan [ON TRACK] [NOT STARTED] Feature set to release with Firefox 53. Test Plan
"Show All Downloads" dropmarker Cristian Comorasu [ON TRACK] [NOT STARTED] Plan is to keep this feature enabled in Nightly and Aurora only, per Wesly Huang. Test Plan
Reader Mode Displays Estimated Reading Time Timea Zsoldos [ON TRACK] [NOT STARTED] Feature set to release with Firefox 53. Test Plan
Large-Allocation header Ciprian Georgiu [ON TRACK] [NOT STARTED] Feature set to release with Firefox 53. ---
TURN/TLS support Alexandru Simonca [ON TRACK] [NOT STARTED] Feature set to release with Firefox 53. ---

Results

New bugs

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);


Known Issues - also seen in previous builds

Major issues also seen in previous builds

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);


Low impact issues also seen in previous builds

Full Query
ID Summary Status Resolution
326701 Favicons should be imported from Safari VERIFIED FIXED
711995 Favicons should be imported from Chrome VERIFIED FIXED
735183 No Home Page Selection screen on first run import wizard RESOLVED INVALID
1113580 On Mac Crash Reporter is out of focus RESOLVED DUPLICATE
1163165 Decrypt Google Chrome cookies on Windows NEW
1210401 "Home page selection" window does not appear when importing data from Chrome RESOLVED INVALID
1236916 History not imported anymore from Safari 8+ RESOLVED FIXED
1264704 URL Bar loses its focus in about:home during search process RESOLVED WORKSFORME

8 Total; 1 Open (12.5%); 5 Resolved (62.5%); 2 Verified (25%);


Branch Bug Fix Verifications

Full Query
ID Summary Status Resolution
1313595 Lower timeout on HSTS Priming channels VERIFIED FIXED
1319403 deleting session cookies RESOLVED FIXED
1326288 VP9 decoding broken by webrtc.org 49 update - YCbCr pointers are off VERIFIED FIXED
1340163 Origin-unique deviceId persistence (used in enumerateDevices and gUM constraints) is broken VERIFIED FIXED
1343691 RTCP stats missing in FF53 (fallout from webrtc.org 49 update) VERIFIED FIXED

5 Total; 0 Open (0%); 1 Resolved (20%); 4 Verified (80%);

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed