Releases/Firefox 40/Test Plan/Beta/40.0.1
From MozillaWiki
« Firefox 40 RC build 5 | Firefox 40.0.1 build 2 | Firefox 40.0.2 »
Firefox 40.0.1 (build 2) Test Plan
- Release Week: Aug 10th, 2015. Plan is to ship this build on Wednesday Aug 12th 2015 (Release Calendar)
- QA Contacts: Robert Kaiser; Florin Mezei; Andrei Vaida
- IRC: irc://irc.mozilla.org#qa ping kairo; FlorinMezei; avaida
- Build 4: Firefox 40.0.1 build 2 | changeset | (ID: 20150811223153)
QE recommendation regarding the quality of the build
Recommendation based on results from manual testing | GOOD FOR RELEASE |
---|
Manual Testing summary - Platform Coverage and Areas Tested
- Testing is performed around areas most affected by fixes since the previous Beta (in cases when there are no Regression tests to cover these areas, or those tests have already been run as part of the Full Beta Regression set)
- Test Cases executed and results: report
PLATFORM MATRIX
Platform | Assignee | Results: report |
Windows 7 x64 (AMD Radeon HD 3000) | Andrei Vaida | [DONE] |
Windows 10 x86 (AMD Radeon HD 7700) | Alexandra Lucinet | [DONE] |
Mac OS X 10.10.4 (Intel Iris Pro 1536 MB) | Bogdan Maris | [DONE] |
Ubuntu 14.04 x86 (AMD Radeon HD 3000) | Vasilica Mihasca | [DONE] |
AREAS TESTED
Tested Area | Testing Type | Results |
WEB COMPATIBILITY | Smoke Testing | PASS |
Features
See the Feature Release Tracking gdoc for a general overview
Feature | Owner | Status | Details | Test Plan |
---|---|---|---|---|
Async plugin init | Catalin Varga | [DONE] | SIGNED OFF | - |
First Run for 40 release | Catalin Varga | [DONE] | NO sign-off (helping with testing) - VERIFIED | - |
Suggested tiles: Sponsored | Cornel Ionce | [DONE] | SIGNED OFF | Test Plan |
Suggested tiles: Affiliate | Cornel Ionce | [DONE] | SIGNED OFF | Test Plan |
New Add-on Signing | Vasilica Mihasca | DROPPED FROM 40 | Feature dropped from Firefox 39 & 40 (not enough add-ons signed) | - |
Unified telemetry/FHR | Stuart Philp | DROPPED FROM 40 | Testing performed is tracked in bug 1169037 | - |
OMTC by default on Linux | Alexandra Lucinet | [DONE] | SIGNED OFF | - |
Hello - Context | Bogdan Maris | [DONE] | SIGNED OFF | Test Plan |
Windows 10 support | Andrei Vaida / Cornel Ionce | [DONE] | New feature targeted for Firefox 40 - weekly status reports (major issues were reported) | - |
Results
New bugs
ID | Summary | Status | Resolution |
---|---|---|---|
1193723 | Two different designs for Firstrun page | RESOLVED | INVALID |
1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);
Known Issues - also seen in previous builds
Major issues also seen in previous builds
NONE
Low impact issues also seen in previous builds
ID | Summary | Status | Resolution |
---|---|---|---|
942130 | 360p max resolution for WebM HTML5 Videos on Youtube | RESOLVED | DUPLICATE |
1096357 | "Unable to run script because scripts are blocked internally" JS error appear in browser console while browsing facebook and youtube on MacOS | RESOLVED | INCOMPLETE |
1142945 | Always deny fullscreen should not be a possible input | RESOLVED | FIXED |
1143988 | Make YouTube 360° videos work well | RESOLVED | WORKSFORME |
1168101 | Reader View icon is shown on some Youtube pages | RESOLVED | WORKSFORME |
1192204 | Scrollbar is overlapping the Quality entries via Youtube high resolution videos | RESOLVED | WORKSFORME |
6 Total; 0 Open (0%); 6 Resolved (100%); 0 Verified (0%);
Branch Bug Fix Verifications
- Verification of build drivers
Status tags
- [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
- [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
- [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
- [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
- [IN PROGRESS] - {{mprog}} - actively being tested on
- [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed