Releases/Firefox 38/Test Plan/38.0.5/Beta/1
From MozillaWiki
« Firefox 38 RC | Firefox 38.0.5 Beta 1 | Firefox 38.0.5 Beta 2 »
Firefox 38.0.5 Beta 1 (build 1) Test Plan
- Release Week: May 4th, 2015. The plan is to be shipped on Friday May 8th 2015 (Release Calendar)
- QA Contact: Robert Kaiser; Florin Mezei
- IRC: irc://irc.mozilla.org#qa ping kairo; FlorinMezei
- Build 1: Firefox 38.0.5 Beta 1 build 1 | changeset | (ID: 20150510205200)
- Build 2: Firefox 38.0.5 Beta 1 build 2 | changeset | (ID: 20150511143336)
QE recommendation regarding the quality of the build
| Recommendation based on results from manual testing | CONDITIONAL SIGN OFF (many issues) |
|---|
Risks with this Beta and ways to mitigate them through testing
Please list any risks related to the quality of this release.
- 1. Reading List disabling
- The Reading List feature is no longer a part of the 38.0.5 release
- Testing to make sure that the feature is not enabled
- Will be covered by Sanity testing
- 2. Suggested Tiles disabling
- The Suggested Tiles feature was backed out into Firefox 39
- Testing to make sure that the feature is not enabled
- Will be covered by Sanity testing
- 3. Reader View
- Important feature for the 38.0.5 Release
- Testing to ensure that the Reader View feature is stable enough to be tested
- Will be covered by Exploratory testing
- 4. Pocket
- Important feature for the 38.0.5 Release
- Testing to ensure that the Pocket integration feature is stable enough to be tested
- Will be covered by Exploratory testing
- 5. Screensharing
- Important feature for the 38.0.5 Release
- Testing to ensure that the Hello Screensharing feature has no major issues
- Will be covered by Exploratory testing
Features
See the Feature Release Tracking gdoc for a general overview
| Feature | Owner | Status | Details | Test Plan |
|---|---|---|---|---|
| Reader View | Andrei Vaida | [AT RISK] | New feature in Firefox 38.0.5 | Test Plan |
| Pocket Integration | Andrei Vaida | [AT RISK] | New feature in Firefox 38.0.5 | Test Plan |
| Hello screensharing | Bogdan Maris | [AT RISK] | New feature in Firefox 38.0.5 | Test Plan |
Results
New bugs
15 Total; 0 Open (0%); 10 Resolved (66.67%); 5 Verified (33.33%);
New bugs to this Beta
15 Total; 0 Open (0%); 10 Resolved (66.67%); 5 Verified (33.33%);
Known Issues
- Major issues
| ID | Summary | Status | Resolution |
|---|---|---|---|
| 1133623 | crash in mozilla::layers::CompositorD3D11::BeginFrame | RESOLVED | FIXED |
| 1137602 | Windows only - Global indicator does not call any pop-ups from Firefox | RESOLVED | INCOMPLETE |
| 1145106 | crash in atidxx32.dll@0x196f7 | RESOLVED | WORKSFORME |
| 1160577 | Error message is no longer shown when a page isn't readable | VERIFIED | FIXED |
| 1163931 | "View Pocket List" prevents going back to previous page due to server redirects | NEW |
5 Total; 1 Open (20%); 3 Resolved (60%); 1 Verified (20%);
- Low impact issues
18 Total; 2 Open (11.11%); 16 Resolved (88.89%); 0 Verified (0%);
Regression Tests
- There will be NO Regression Set for 38.0.5 BETA
- Regression testing will be performed as needed for the new features in Firefox 38.0.5
Exploratory Testing
- Testing is performed around areas most affected by fixes since the previous Beta (in cases when there are no Regression tests to cover these areas, or those tests have already been run as part of the Full Beta Regression set)
| Platform | Assignee | Result: report |
| Windows 7 64-bit (GPU: AMD Radeon HD 6450) | Bogdan Maris | [DONE] |
| Windows 8.1 32-bit (GPU: nVIDIA GeForce 620) | Cornel Ionce | [DONE] |
| Mac OS X 10.9.5 (GPU: Intel Iris Pro 1024 MB) | Alexandra Lucinet | [DONE] |
| Ubuntu 14.04 64-bit (GPU: AMD Radeon 3000) | Andrei Vaida | [DONE] |
| Tested Area | Testing Type | Results (report) |
| Reading List disabling | Sanity testing | PASS |
| Suggested Tiles disabling | Sanity testing | PASS |
| Reader View | Exploratory testing | CONDITIONAL PASS |
| Exploratory testing | CONDITIONAL PASS | |
| Screensharing | Exploratory testing | CONDITIONAL PASS |
Branch Bug Fix Verifications
- Verified bugs
| ID | Summary | Status | Resolution |
|---|---|---|---|
| 1157197 | Please enable reader view for 38.0.5 | VERIFIED | FIXED |
| 1157682 | Should ignore query string / hashes for checking for "home page" | VERIFIED | FIXED |
| 1158281 | Match Pocket's Reader View Sepia Theme | VERIFIED | FIXED |
| 1158322 | Sidebar affects a page while printing | VERIFIED | FIXED |
| 1160076 | Broken in-content preferences Search tab with browser.search.showOneOffButtons = false | VERIFIED | FIXED |
| 1160577 | Error message is no longer shown when a page isn't readable | VERIFIED | FIXED |
| 1160578 | Odd empty door hanger panel when you're on an internal Firefox page | VERIFIED | FIXED |
| 1161504 | The "Save" button from the Pocket panel appears to have a visited styling applied | VERIFIED | FIXED |
| 1161881 | Enable Pocket by default (in supported locales) | VERIFIED | FIXED |
| 1162147 | "View Pocket List" menuitem should be at top of bookmarks menu | VERIFIED | FIXED |
| 1163319 | Pocket button in hamburger menu breaks layout | VERIFIED | FIXED |
| 1163349 | "View Pocket List" menuitem not working | VERIFIED | FIXED |
12 Total; 0 Open (0%); 0 Resolved (0%); 12 Verified (100%);
Status tags
- [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
- [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
- [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
- [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
- [IN PROGRESS] - {{mprog}} - actively being tested on
- [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed
