Releases/Firefox 48/Test Plan/Beta/10

From MozillaWiki
Jump to: navigation, search

«  Firefox 48 Beta 9 | Firefox 48 Beta 10 | Firefox 48 RC1 »

Firefox 48.0 Beta 10 Test Plan

QE recommendation regarding the quality of the build

  • Recommendation based on results from manual testing:
Build 1 SHIP IT

Manual Testing summary - Platform Coverage and Areas Tested

  • Testing performed around: Sync, Mac OS X signing, Mac OS X 32-bit Mode.
  • Test Cases executed and results: report

Build 1

Platform Build architecture Assignee Results: report
Windows 7 x64 (NVIDIA GeForce 210) 64-bit Camelia Badau [DONE]
Windows 10 x64 (AMD Radeon HD 3000D) 32-bit Alexandra Lucinet [DONE]
Mac OS X 10.9.5 (NVIDIA GeForce GT 640M) 64-bit Cristian Comorasu [DONE]
Ubuntu 16.04 LTS x64 (Intel® Ivybridge Desktop ) 64-bit Petruta Rasa [DONE]
Tested Area Testing Type Results
Mac OS X signing Regression Testing PASS
Sync Regression Testing FAIL
Mac OS X 32-bit Mode Regression Testing PASS

Features

See the [1] gdoc for a general overview


Feature Owner Status Details Test Plan
Windows Child Mode Iulia Cristescu [DONE] Feature milestone changed to Firefox 50. Test Plan
New Awesomebar Cornel Ionce [ON TRACK] Feature targeted for Firefox 48 - final QA sign-off at the end of Beta 48 Test Plan

Results

New bugs

Full Query
ID Summary Status Resolution
1288663 User is able to login with an existing account via the Create a FxA page RESOLVED WONTFIX
1288688 Empty username on accounts.firefox.com notification panel after changing the password RESOLVED DUPLICATE
1288712 Forgot password: can enter another account's email, but it does not reset RESOLVED WONTFIX
1288721 Password manager uses old password as username when changing password on accounts.firefox.com VERIFIED FIXED
1288729 Wrong message appears when enabling themes if user is signed into Sync NEW

5 Total; 1 Open (20%); 3 Resolved (60%); 1 Verified (20%);


Known Issues - also seen in previous builds

Major issues also seen in previous builds

Bugzilla query error

error, http-bad-status, Array


Low impact issues also seen in previous builds

Full Query
ID Summary Status Resolution
428378 Synced tabs, bookmarks, and history entries don't have a favicon until the user re-visits that page again NEW
1192204 Scrollbar is overlapping the Quality entries via Youtube high resolution videos RESOLVED WORKSFORME
1206736 Firefox should not ask to save an incorrect Firefox Account credential REOPENED
1210769 Glitches after opening images via flickr NEW
1230678 youtube shows black line 720p & 1080p videos in normal view mode VERIFIED FIXED
1233359 Glitches after opening images in facebook NEW
1238955 The light themes are not synced RESOLVED DUPLICATE
1238960 Firefox Accounts preference pane won't close when Back button is pressed RESOLVED FIXED
1288120 "Switch to tab" still appears after the user closes the initial tab RESOLVED DUPLICATE

9 Total; 4 Open (44.44%); 4 Resolved (44.44%); 1 Verified (11.11%);


Branch Bug Fix Verifications

Full Query
ID Summary Status Resolution
1138638 browser_mozLoop_sharingListeners.js doesn't work in e10s mode VERIFIED FIXED
1212356 crash in js::PreliminaryObjectArray::sweep() VERIFIED FIXED
1261048 Selected area in timeline goes insane when I toggle Devtools docking mode VERIFIED FIXED
1276717 Print Preview and output much smaller than original/document size in one profile VERIFIED FIXED
1278818 Firefox 47 does not stay on the monitor when video is switched to fullscreen VERIFIED FIXED
1285974 Land version 1.4.3 of the Loop system add-on in mozilla-central VERIFIED FIXED

6 Total; 0 Open (0%); 0 Resolved (0%); 6 Verified (100%);

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed