Releases/Firefox 40/Test Plan/Beta/9

From MozillaWiki
Jump to: navigation, search

«  Firefox 40 Beta 8 | Firefox 40 Beta 9 | Firefox 40 RC  »

Firefox 40 Beta 9 (build 1) Test Plan

QE recommendation regarding the quality of the build

Recommendation based on results from manual testing CONDITIONAL PASS

Manual Testing summary - Platform Coverage and Areas Tested

  • Testing is performed around areas most affected by fixes since the previous Beta (in cases when there are no Regression tests to cover these areas, or those tests have already been run as part of the Full Beta Regression set)
  • Test Cases executed and results: report

PLATFORM MATRIX

Platform Assignee Results: report
Windows 8 x86 (Graphics: NVIDIA GeForce 210) Alexandra Lucinet [DONE]
Windows 10 x64 (Graphics: ATI Radeon HD 3000) Camelia Badau [DONE]
Mac OS X 10.9.5 (Graphics: Intel Iris Pro 1536 MB) Bogdan Maris [DONE]
Ubuntu 12.04 x64 (Graphics: AMD Radeon 3000) Andrei Vaida [DONE]

AREAS TESTED

Tested Area Testing Type Results
GRAPHICS Regression Testing CONDITIONAL PASS
WEB COMPATIBILITY Regression Testing PASS
SCROLL & ZOOM Regression Testing PASS
SECURE BROWSING Regression Testing PASS
VERIFY UPDATE APPLIES WITH ROOT OWNED FILES Regression Testing PASS

Features

See the Feature Release Tracking gdoc for a general overview


Feature Owner Status Details Test Plan
Async plugin init Catalin Varga [DONE] SIGNED OFF -
First Run for 40 release Catalin Varga [ON TRACK] New feature targeted for Firefox 40 (not yet implemented) - no sign-off (helping with testing) -
Suggested tiles: Sponsored Cornel Ionce [DONE] SIGNED OFF Test Plan
Suggested tiles: Affiliate Cornel Ionce [DONE] SIGNED OFF Test Plan
New Add-on Signing Vasilica Mihasca DROPPED FROM 40 Feature dropped from Firefox 39 & 40 (not enough add-ons signed) -
Unified telemetry/FHR Stuart Philp DROPPED FROM 40 Testing performed is tracked in bug 1169037 -
OMTC by default on Linux Alexandra Lucinet [DONE] SIGNED OFF -
Hello - Context Bogdan Maris [DONE] SIGNED OFF Test Plan
Windows 10 support Andrei Vaida / Cornel Ionce [AT RISK] New feature targeted for Firefox 40 - weekly status reports (NO final sign-off) -

Results

New bugs

Full Query
ID Summary Status Resolution
1189715 crash in gfxContext::gfxContext(mozilla::gfx::DrawTarget*, mozilla::gfx::PointTyped<T> const&) RESOLVED FIXED
1189742 [Win10] Some WebGL games don't work properly NEW
1189748 The values of a google 3d graph can't be modified RESOLVED DUPLICATE

3 Total; 1 Open (33.33%); 2 Resolved (66.67%); 0 Verified (0%);


Known Issues - also seen in previous builds

Major issues also seen in previous builds

Full Query
ID Summary Status Resolution
1151736 Crash @ mozilla::WebGLTexture::EnsureNoUninitializedImageData(StrongGLenum<TexImageTargetDetails>, int) RESOLVED FIXED

1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);


Low impact issues also seen in previous builds

Full Query
ID Summary Status Resolution
942130 360p max resolution for WebM HTML5 Videos on Youtube RESOLVED DUPLICATE
1096357 "Unable to run script because scripts are blocked internally" JS error appear in browser console while browsing google plus NEW
1113633 WebGL game "Barfight" no longer displays some textures (errors in shader.js) RESOLVED WONTFIX
1142752 (NS_NOINTERFACE) [nsIWebProgress.DOMWindow] exception in_docShellsToWindows when opening customize mode RESOLVED FIXED
1142945 Always deny fullscreen should not be a possible input RESOLVED FIXED
1142992 Youtube video stops after some minutes (with 1080p) RESOLVED WORKSFORME
1168101 Reader View icon is shown on some Youtube pages RESOLVED WORKSFORME
1178271 crash in mozilla::dom::Promise::Settle(JS::Handle<T>, mozilla::dom::Promise::PromiseState) RESOLVED DUPLICATE
1184459 crash in @0x0 | update_textures RESOLVED WONTFIX

9 Total; 1 Open (11.11%); 8 Resolved (88.89%); 0 Verified (0%);


Branch Bug Fix Verifications

Full Query
ID Summary Status Resolution
1173734 Make the separator for the menu / hamburger button (more) solid VERIFIED FIXED
1183725 Windows 10 not recognized in the downloadable blocklist RESOLVED FIXED

2 Total; 0 Open (0%); 1 Resolved (50%); 1 Verified (50%);


Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed