Releases/Firefox 41/Test Plan/Beta/1

From MozillaWiki
Jump to: navigation, search

«  Firefox 40.0.2 | Firefox 41 Beta 1 | Firefox 41 Beta 2  »

Firefox 41.0 Beta 1 (build 1) Test Plan

QE recommendation regarding the quality of the build

Recommendation based on results from manual testing GOOD FOR RELEASE

Manual Testing summary - Platform Coverage and Areas Tested

  • Testing is performed around new features that entered Beta 1
  • Test Cases executed and results: report
Platform Assignee Results: report
Windows 7 x86 (Intel HD 2500) Camelia Badau [DONE]
Windows 10 x64 (nVIDIA GeForce 620) Cornel Ionce [DONE]
Mac OS X 10.9.5 (AMD Radeon HD 6630M 256) Florin Mezei [DONE]
Ubuntu 14.04 x86 (Intel HD 2500) Petruta Rasa [DONE]
Tested Area Testing Type Results
FIREFOX ACCOUNTS & SYNC Regression Testing PASS
ADD-ONS SIGNING Regression Testing CONDITIONAL PASS
HELLO - TEXT CHAT Regression Testing PASS

Features

See the Feature Release Tracking gdoc for a general overview


Feature Owner Status Details Test Plan
New Add-on Signing Vasilica Mihasca [ON TRACK] Feature dropped from Firefox 39 & 40 (not enough add-ons signed) - final QA sign-off at the end of Beta 41 Test Plan
Hello - Text Chat Bogdan Maris [ON TRACK] New feature targeted for Firefox 41 - final QA sign-off at the end of Beta 41 Test Plan
Unified telemetry/FHR TBD (waiting for test details) [NOT STARTED] New feature targeted for Firefox 41 - final QA sign-off at the end of Beta 41 [hhttps://wiki.mozilla.org/Unified_Telemetry#Client_Testing Test Plan]

Results

New bugs

Full Query
ID Summary Status Resolution
1193680 Post-sign-in notification displays behind the hamburger menu (when menu is already open) RESOLVED WORKSFORME
1193685 The "Sync enabled" notification stays on during and after sync RESOLVED WORKSFORME
1193763 Conversation window is slow to detach and resize when there are large amounts of text chat RESOLVED INCOMPLETE

3 Total; 0 Open (0%); 3 Resolved (100%); 0 Verified (0%);


Known Issues - also seen in previous builds

Major issues also seen in previous builds

    NONE     

Low impact issues also seen in previous builds

Full Query
ID Summary Status Resolution
1150218 Misaligned close button when there is more than one in new all-doorhanger flow for addons website install RESOLVED DUPLICATE
1157171 User does not have a chance to read the install confirmation doorhanger, if the extension opens a new Tab on startup NEW
1158067 Add-ons installed from about:addons search list does not follow the New UI Install flow RESOLVED WONTFIX
1163975 The incompatible add-on icon does not disappear from location bar RESOLVED WORKSFORME
1166754 Confusing approval message for add-on install process via drag&drop RESOLVED INACTIVE
1171636 Allow displaying multiple simultaneous add-on installs RESOLVED DUPLICATE
1173359 History items are duplicated after reenabling history sync VERIFIED FIXED
1175917 ”Check for updates” link from add-on details tab does not return any message for an up to date add-on NEW
1184296 aborted installation of addon won't install second time RESOLVED INVALID

9 Total; 2 Open (22.22%); 6 Resolved (66.67%); 1 Verified (11.11%);


Branch Bug Fix Verifications

    NONE     

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed