Releases/Firefox 38/Test Plan/38.0.5/RC/1
From MozillaWiki
« Firefox 38.0.5 Beta 3 | Firefox 38.0.5 RC | Firefox 39 Beta 1 »
Firefox 38.0.5 RC (build 3) Test Plan
- Release Week: May 18th, 2015. The plan is to be shipped on Friday May 22nd 2015 (Release Calendar)
- QA Contact: Robert Kaiser; Andrei Vaida
- IRC: irc://irc.mozilla.org#qa ping kairo; avaida
- Build 1: Firefox 38.0.5 RC build 3 | changeset | (ID: 20150521175336)
QE recommendation regarding the quality of the build
| Recommendation based on results from manual testing | CONDITIONAL SIGN OFF (many issues) |
|---|
Risks with this Beta and ways to mitigate them through testing
Please list any risks related to the quality of this release.
- 1. Pocket
- Important feature for the 38.0.5 Release - the bulk of fixes in this build were for Pocket
- Testing to ensure that Pocket integration works without major issues caused by the fixes landed in this build
- Will be covered by Smoke and Exploratory testing
- 2. Hello with Screensharing
- Important feature for the 38.0.5 Release
- Testing to ensure that Screensharing works without major issues caused by the fixes landed in this build
- Will be covered by Smoke and Exploratory testing
- 3. Reader View
- Important feature for the 38.0.5 Release
- Testing to ensure that Reader View works without major issues caused by the fixes landed in this build
- Will be covered by Smoke and Exploratory testing
Features
See the Feature Release Tracking gdoc for a general overview
| Feature | Owner | Status | Details | Test Plan |
|---|---|---|---|---|
| Pocket Integration | Andrei Vaida | [AT RISK] | New feature in Firefox 38.0.5 | Test Plan |
| Hello screensharing | Bogdan Maris | [AT RISK] | New feature in Firefox 38.0.5 | Test Plan |
| Reader View | Andrei Vaida | [AT RISK] | New feature in Firefox 38.0.5 | Test Plan |
Results
New bugs
| ID | Summary | Status | Resolution |
|---|---|---|---|
| 1167568 | Reader View displays only the first part of specific articles from ehow.com | RESOLVED | FIXED |
| 1167569 | Missing gallery photos and text from wikipedia.org specific page | RESOLVED | WORKSFORME |
| 1167572 | [Linux] Youtube video content is not visible when tabs are shared | RESOLVED | WONTFIX |
| 1167573 | Reader View shows different content on Firefox for Android page in Google Play | RESOLVED | WORKSFORME |
| 1167585 | Different or no onboarding experience offered for users signing up with FxA instead of regular email | RESOLVED | INACTIVE |
| 1167587 | The welcome tour from getpocket.com cannot be dismissed | RESOLVED | WORKSFORME |
6 Total; 0 Open (0%); 6 Resolved (100%); 0 Verified (0%);
Known Issues
- Major issues
11 Total; 3 Open (27.27%); 8 Resolved (72.73%); 0 Verified (0%);
- Low impact issues
16 Total; 2 Open (12.5%); 14 Resolved (87.5%); 0 Verified (0%);
Github Issues
- https://github.com/mozilla/readability/issues/228
- https://github.com/mozilla/readability/issues/113
- https://github.com/mozilla/readability/issues/218
- https://github.com/mozilla/readability/issues/219
Regression Tests
- There will be NO Regression Set for 38.0.5 BETA
- Regression testing will be performed as needed for the new features in Firefox 38.0.5
Exploratory Testing
- Testing is performed around areas most affected by fixes since the previous Beta (in cases when there are no Regression tests to cover these areas, or those tests have already been run as part of the Full Beta Regression set)
| Platform | Assignee | Result: report |
| Windows 7 x64 (Intel HD Graphics 2500) | Camelia Badau | [DONE] |
| Windows 8.1 x86 (AMD Radeon HD 3000) | Vasilica Mihasca | [DONE] |
| Mac OS X 10.9.5 (Intel Iris Pro 1024 MB) | Petruta Rasa | [DONE] |
| Ubuntu x64 (AMD Radeon HD 5450) | Viorel Varga | [DONE] |
| Tested Area | Testing Type | Results (report) |
| Smoke and Exploratory testing | CONDITIONAL PASS | |
| Hello screensharing | Sanity testing | CONDITIONAL PASS |
| Reader View | spot check high-traffic websites for Readability issues | CONDITIONAL PASS |
Branch Bug Fix Verifications
- Verified bugs
| ID | Summary | Status | Resolution |
|---|---|---|---|
| 1166240 | Missing Pocket icon in reader view mode | VERIFIED | FIXED |
| 1166771 | pushstate for reader mode should reset browser.isArticle to false if the new page isn't readerable | VERIFIED | FIXED |
| 1167096 | Pocket Icon reappears in the toolbar after removal on a clean profile (or at least one with no saved state) | VERIFIED | FIXED |
3 Total; 0 Open (0%); 0 Resolved (0%); 3 Verified (100%);
Status tags
- [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
- [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
- [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
- [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
- [IN PROGRESS] - {{mprog}} - actively being tested on
- [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed
