Releases/Firefox 41/Test Plan/Beta/5

From MozillaWiki
Jump to: navigation, search

«  Firefox 41 Beta 4 | Firefox 41 Beta 5 | Firefox 41 Beta 6  »

Firefox 41.0 Beta 5 (build 1) Test Plan

QE recommendation regarding the quality of the build

Recommendation based on results from manual testing CONDITIONAL SIGN OFF

Manual Testing summary - Platform Coverage and Areas Tested

    • Testing is performed around areas most affected by fixes since the previous Beta, or areas that are mandatory to test in the Beta cycle
  • Test Cases executed and results: report
Platform Assignee Results: report
Windows XP x86 (AMD Radeon HD 8500) Paul Silaghi [DONE]
Windows 7 x64 (NVIDIA GeForce GT 610) Florin Mezei [DONE]
Mac OS X 10.10 (NVIDIA GeForce GT 640M) Paul Silaghi [DONE]
Ubuntu 12.04 x86 (nVIDIA GeForce 620) Cornel Ionce [DONE]
Tested Area Testing Type Results
ADD-ON COMPATIBILITY Regression Testing CONDITIONAL PASS
GRAPHICS Regression Testing PASS
VIDEO COMPATIBILITY Regression Testing PASS
AUDIO COMPATIBILITY Regression Testing PASS

Features

See the Feature Release Tracking gdoc for a general overview


Feature Owner Status Details Test Plan
Async plugin init Petruta Rasa [ON TRACK] Feature released in Beta 40, but disabled due to reported issues -
New Add-on Signing Vasilica Mihasca [ON TRACK] Feature dropped from Firefox 39 & 40 (not enough add-ons signed) - final QA sign-off at the end of Beta 41 Test Plan
Hello - Text Chat Bogdan Maris [ON TRACK] New feature targeted for Firefox 41 - final QA sign-off at the end of Beta 41 Test Plan
Unified telemetry/FHR Alexandra Lucinet / Andrei Vaida [ON TRACK] New feature targeted for Firefox 41 - final QA sign-off at the end of Beta 41 Test Plan

Results

New bugs

Full Query
ID Summary Status Resolution
1199594 Local Music Player add-on no longer plays music RESOLVED WONTFIX
1199638 FF doesn't play mp4 files on Win XP RESOLVED INVALID

2 Total; 0 Open (0%); 2 Resolved (100%); 0 Verified (0%);


Known Issues - also seen in previous builds

Major issues also seen in previous builds

    NONE     

Low impact issues also seen in previous builds

Full Query
ID Summary Status Resolution
962560 Audio volume UI resets to full volume after toggling the screen size of a video RESOLVED FIXED
1010976 Hitting the "Hide Controls" option twice causes the container area to disappear VERIFIED FIXED
1113633 WebGL game "Barfight" no longer displays some textures (errors in shader.js) RESOLVED WONTFIX
1113637 Blank display for some WebGL games (Could not initialise shader error) RESOLVED INVALID
1124427 Microsoft WebGL Stress Test crashes Firefox RESOLVED WORKSFORME
1142752 (NS_NOINTERFACE) [nsIWebProgress.DOMWindow] exception in_docShellsToWindows when opening customize mode RESOLVED FIXED
1142945 Always deny fullscreen should not be a possible input RESOLVED FIXED
1150218 Misaligned close button when there is more than one in new all-doorhanger flow for addons website install RESOLVED DUPLICATE
1157171 User does not have a chance to read the install confirmation doorhanger, if the extension opens a new Tab on startup RESOLVED WORKSFORME
1158067 Add-ons installed from about:addons search list does not follow the New UI Install flow RESOLVED WONTFIX
1163975 The incompatible add-on icon does not disappear from location bar RESOLVED WORKSFORME
1166754 Confusing approval message for add-on install process via drag&drop RESOLVED INACTIVE
1171636 Allow displaying multiple simultaneous add-on installs RESOLVED DUPLICATE
1175917 ”Check for updates” link from add-on details tab does not return any message for an up to date add-on NEW
1176218 [Youtube][HTML5] 8K videos do not work at all, or Audio only VERIFIED FIXED
1180214 Wrong video duration when using GStreamer0.10 RESOLVED FIXED
1182606 Context menu for video elements should check .mozHasAudio property NEW
1184296 aborted installation of addon won't install second time RESOLVED INVALID
1189748 The values of a google 3d graph can't be modified RESOLVED DUPLICATE
1192204 Scrollbar is overlapping the Quality entries via Youtube high resolution videos RESOLVED WORKSFORME
1194214 [HTML5] Several side effects using the context menu options on Youtube NEW
1194241 [Ubuntu] Pause option is not displayed in context menu while the audio sample is played RESOLVED WORKSFORME
1195438 YouTube's HTML player controls are not shown when Firefox enters full screen mode from "Full Screen" context menu command RESOLVED INVALID

23 Total; 3 Open (13.04%); 18 Resolved (78.26%); 2 Verified (8.7%);


Branch Bug Fix Verifications

Full Query
ID Summary Status Resolution
1145230 Segfault in mozilla::GStreamerReader::ElementAddedCb VERIFIED FIXED
1159366 youtube live stream: switching resolution causes high cpu & memory use VERIFIED FIXED
1175761 crash in IsMarkedInternalCommon<T> when visiting ReadWriteWeb article, with Gecko Profiler Add-on installed & e10s disabled VERIFIED FIXED
1195683 Restore "fr" preferences for non-US Yahoo! searchplugins VERIFIED FIXED
1195761 Unity Web Player game is not downloaded with dom.ipc.plugins.asyncInit true RESOLVED DUPLICATE
1196398 Video file > 3Gb doesn't play VERIFIED FIXED

6 Total; 0 Open (0%); 1 Resolved (16.67%); 5 Verified (83.33%);


Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed