Releases/Firefox 50/Test Plan/Beta/10

From MozillaWiki
Jump to: navigation, search

«  Firefox 50 Beta 9 | Firefox 50 Beta 10 | Firefox 50 Beta 11 »

Firefox 50.0 Beta 10 Test Plan

QE recommendation regarding the quality of the build

  • Recommendation based on results from manual testing:
Build 1 SHIP IT

Manual Testing summary - Platform Coverage and Areas Tested

  • Testing performed around: Download Protection, Sync & FxA (including the newly introduced features: Sign-in Unblock, Device Manager and Service/Apps Manager).
    • [DONE] ⚠ Please note that we're currently waiting for test results on a specific Download Protection test case that requires a 12hrs wait time. We'll make sure to follow up on that, first thing tomorrow.
  • Test Cases executed and results: report

Build 1

Platform Graphics Build architecture Assignee Results: report
Windows 7 x86 AMD Radeon HD 6450 32-bit Camelia Badau [DONE]
Windows 8.1 x64 Intel HD Graphics 64-bit Ciprian Georgiu [DONE]
Mac OS X 10.11 NVIDIA GeForce GT 640M 64-bit Alexandru Simonca [DONE]
Ubuntu 14.04 x86 tbd 32-bit Iulia Cristescu [DONE]
Tested Area Testing Type [testrail_link Results]
DOWNLOAD PROTECTION Smoke Testing PASS
SYNC & FXA Smoke and Exploratory Testing PASS

Features

See the [1] gdoc for a general overview


Feature Owner Status Details Test Plan
Windows Child Mode Iulia Cristescu [ON TRACK] scheduled to release with Firefox 50; pre-release sign off is underway Test Plan
Pointer Lock API Alexandru Simonca [ON TRACK] scheduled to release with Firefox 50; pre-release sign off is underway Test Plan
WebM EME support for Widevine Ciprian Georgiu [INVESTIGATION NEEDED] scheduled to release with Firefox 50; at this point, our concerns revolve around the still unresolved bugs: 1298027, 1298030, 1301423 and the recent issue we noticed on the shaka player demo, under Ubuntu (the latter being currently investigated by Bryce Van Dyk); pre-release sign off is underway Test Plan
Simplify page Bogdan Maris [AT RISK] target milestone changed to Fx51, due to 1306294, 1306299, 1306295. Test Plan

Results

New bugs

Bugzilla query error

error, http-bad-status, Array


Known Issues - also seen in previous builds

Major issues also seen in previous builds

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);


Low impact issues also seen in previous builds

Full Query
ID Summary Status Resolution
428378 Synced tabs, bookmarks, and history entries don't have a favicon until the user re-visits that page again NEW
616629 "Remember Password?" dialog shows too early RESOLVED DUPLICATE
1206736 Firefox should not ask to save an incorrect Firefox Account credential REOPENED
1238955 The light themes are not synced RESOLVED DUPLICATE
1238960 Firefox Accounts preference pane won't close when Back button is pressed RESOLVED FIXED
1246138 The account picture is wrongly displayed when trying to upload a photo from the firstrun page NEW
1287748 Syncing away from lwtheme updates internal state / add-on manager UI, but not the actual browser RESOLVED FIXED

7 Total; 3 Open (42.86%); 4 Resolved (57.14%); 0 Verified (0%);


Branch Bug Fix Verifications

Full Query
ID Summary Status Resolution
1214151 Async scroll adjustment wrong for position:fixed elements inside scrolling position:sticky elements VERIFIED FIXED
1301784 Pref-off Search Reset UI for 50 beta VERIFIED FIXED
1308418 Videos are not working on 32bit MacOS mode VERIFIED FIXED

3 Total; 0 Open (0%); 0 Resolved (0%); 3 Verified (100%);

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed