Releases/Firefox 40/Test Plan/Beta/6

From MozillaWiki
Jump to: navigation, search

«  Firefox 40 Beta 5 | Firefox 40 Beta 6 | Firefox 40 Beta 7  »

Firefox 40 Beta 6 (build 1) Test Plan

QE recommendation regarding the quality of the build

Recommendation based on results from manual testing CONDITIONAL PASS (multiple known issues)

Manual Testing summary - Platform Coverage and Areas Tested

  • Testing is performed around areas most affected by fixes since the previous Beta (in cases when there are no Regression tests to cover these areas, or those tests have already been run as part of the Full Beta Regression set)
  • Test Cases executed and results: report

PLATFORM MATRIX

Platform Assignee Results: report
Windows 8.1 x64 (NVIDIA GeForce 210) Alexandra Lucinet [DONE]
Windows 10 x86 (AMD Radeon HD 7700 Series) Cornel Ionce [DONE]
Mac OS X 10.10 (Intel Iris Pro 1536 MB) Bogdan Maris [DONE]
Ubuntu 14.04 x86 (ATI Radeon 3000) Vasilica Mihasca [DONE]

AREAS TESTED

Tested Area Testing Type Results
ADD-ON COMPATIBILITY Regression Testing CONDITIONAL PASS
HELLO CONTEXT Regression Testing CONDITIONAL PASS
OS X SIGNING Regression Testing PASS
OS X 32-BIT MODE Regression Testing PASS

Features

See the Feature Release Tracking gdoc for a general overview


Feature Owner Status Details Test Plan
Async plugin init Catalin Varga [ON TRACK] Feature is in Beta 40, but still disabled by default - potential final QA sign-off at the end of Beta 40 -
First Run for 40 release Catalin Varga [NOT STARTED] New feature targeted for Firefox 40 (not yet implemented) - final QA sign-off at the end of Beta 40 -
Suggested tiles: Sponsored Cornel Ionce [ON TRACK] Feature dropped from Firefox 39 - final QA sign-off at the end of Beta 40 Test Plan
New Add-on Signing Vasilica Mihasca DROPPED FROM 40 Feature dropped from Firefox 39 & 40 (not enough add-ons signed) -
Unified telemetry/FHR Stuart Philp DROPPED FROM 40 Testing performed is tracked in bug 1169037 -
OMTC by default on Linux Alexandra Lucinet [ON TRACK] New feature targeted for Firefox 40 - final QA sign-off at the end of Beta 40 -
Hello - Context Bogdan Maris [AT RISK] New feature targeted for Firefox 40 - final QA sign-off at the end of Beta 40 -
Windows 10 support Andrei Vaida / Cornel Ionce [AT RISK] New feature targeted for Firefox 40 - final QA sign-off at the end of Beta 40 -

Results

New bugs

Full Query
ID Summary Status Resolution
1185968 [HiDPI] Hello conversation window is cut-off when several calls are listed RESOLVED INCOMPLETE
1185977 A Scroll Bar is displayed in Loop Panel for a long Conversation Name RESOLVED WORKSFORME

2 Total; 0 Open (0%); 2 Resolved (100%); 0 Verified (0%);


Known Issues - also seen in previous builds

Major issues also seen in previous builds

Full Query
ID Summary Status Resolution
1164510 Context needs a default favicon for the panel room list VERIFIED FIXED
1171148 Broken add-on install displayed in the add-ons manager after installs are cancelled by closing the original window/tab RESOLVED WONTFIX
1171925 Clicking the title or favicon for context (in the conversation/standalone windows) should appear to be part of the link and open the webpage VERIFIED FIXED
1174132 Context shows the opengraph title instead of the document title, sometimes leading to shortened descriptions of urls RESOLVED FIXED
1174702 Unnecessary scroll while editing context. RESOLVED FIXED
1175833 Buttons from conversation window are gone after adding/editing context VERIFIED FIXED
1175841 [Linux] Inconsistent font size in context edit screen RESOLVED WORKSFORME
1180700 Favicon missing from StandaloneUI context, when comments field contains long word, more then 20 characters VERIFIED FIXED
1184296 aborted installation of addon won't install second time RESOLVED INVALID

9 Total; 0 Open (0%); 5 Resolved (55.56%); 4 Verified (44.44%);


Low impact issues also seen in previous builds

Full Query
ID Summary Status Resolution
591893 Undo or cancel the installation of add-ons in search pane doesn't list them anymore in "Available Add-ons" RESOLVED WONTFIX
1150218 Misaligned close button when there is more than one in new all-doorhanger flow for addons website install RESOLVED DUPLICATE
1157171 User does not have a chance to read the install confirmation doorhanger, if the extension opens a new Tab on startup RESOLVED WORKSFORME
1158067 Add-ons installed from about:addons search list does not follow the New UI Install flow RESOLVED WONTFIX
1163975 The incompatible add-on icon does not disappear from location bar RESOLVED WORKSFORME
1166754 Confusing approval message for add-on install process via drag&drop RESOLVED INACTIVE
1166949 Display an in-content UI for add-ons installed by drag and drop from the local filesystem RESOLVED WONTFIX
1171636 Allow displaying multiple simultaneous add-on installs RESOLVED DUPLICATE
1180655 Context shown for some about: pages RESOLVED INVALID

9 Total; 0 Open (0%); 9 Resolved (100%); 0 Verified (0%);


Branch Bug Fix Verifications

Full Query
ID Summary Status Resolution
1128238 [e10s] Facebook's Flash video player does not respond to mouse input VERIFIED FIXED
1144107 crash in [@ stagefright::SampleTable::isValid() ] with h264 mp4 RESOLVED FIXED
1151412 Question mark icons in conversation window VERIFIED FIXED
1170627 Save Context button doesn't exit screen VERIFIED FIXED
1172847 'Let’s Talk About' hard to see in conversation window after someone joins the conversation due to its color VERIFIED FIXED
1174950 NukeCrossCompartmentWrappers should nuke wrappers from expanded principals RESOLVED FIXED
1178307 Darker Hello icon needed for Windows 10 toolbar VERIFIED FIXED
1181130 Broken selection system inside of a nested contenteditable element RESOLVED FIXED
1182444 Volume option is displayed as disabled although is enabled VERIFIED FIXED
1184333 [EME] GMP loading fails if Chinese characters in GMP dir path VERIFIED FIXED

10 Total; 0 Open (0%); 3 Resolved (30%); 7 Verified (70%);


Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed