Releases/Firefox 40/Test Plan/Beta/RC: Difference between revisions
Jump to navigation
Jump to search
Otilia.anica (talk | contribs) |
Otilia.anica (talk | contribs) |
||
| Line 17: | Line 17: | ||
* Testing is performed around areas most affected by fixes since the previous Beta (in cases when there are no Regression tests to cover these areas, or those tests have already been run as part of the Full Beta Regression set) | * Testing is performed around areas most affected by fixes since the previous Beta (in cases when there are no Regression tests to cover these areas, or those tests have already been run as part of the Full Beta Regression set) | ||
* Test Cases executed and results: [https://docs.google.com/spreadsheets/d/1ZGOcdnEVy8RC1OPf2YPzKNPY3Df9lLmrdKarwjPcbFA/edit#gid= | * Test Cases executed and results: [https://docs.google.com/spreadsheets/d/1ZGOcdnEVy8RC1OPf2YPzKNPY3Df9lLmrdKarwjPcbFA/edit#gid=211402700 report] | ||
=== PLATFORM MATRIX === | === PLATFORM MATRIX === | ||
| Line 24: | Line 24: | ||
| class="header" style="width:20%; text-align:center;" | Platform | | class="header" style="width:20%; text-align:center;" | Platform | ||
| class="header" style="width:20%; text-align:center;" | Assignee | | class="header" style="width:20%; text-align:center;" | Assignee | ||
| class="header" style="width:20%; text-align:center;" | Results: [https://docs.google.com/spreadsheets/d/1ZGOcdnEVy8RC1OPf2YPzKNPY3Df9lLmrdKarwjPcbFA/edit#gid= | | class="header" style="width:20%; text-align:center;" | Results: [https://docs.google.com/spreadsheets/d/1ZGOcdnEVy8RC1OPf2YPzKNPY3Df9lLmrdKarwjPcbFA/edit#gid=211402700 report] | ||
|- | |- | ||
| (Graphics: ) | | Windows 7 x64 (Graphics: ) | ||
| | | Florin Mezei | ||
| style="text-align:center;" | {{|}} | | style="text-align:center;" | {{|}} | ||
|- | |- | ||
| (Graphics: ) | | Windows 10 x64 (Graphics: ) | ||
| | | Cornel Ionce | ||
| style="text-align:center;" | {{|}} | | style="text-align:center;" | {{|}} | ||
|- | |- | ||
| (Graphics: ) | | Mac OS X 10.10 (Graphics: ) | ||
| | | Alexandra Lucinet | ||
| style="text-align:center;" | {{|}} | | style="text-align:center;" | {{|}} | ||
|- | |- | ||
| (Graphics: ) | | Ubuntu x86 (Graphics: ) | ||
| | | Bogdan Maris | ||
| style="text-align:center;" | {{|}} | | style="text-align:center;" | {{|}} | ||
|} | |} | ||
| Line 50: | Line 50: | ||
| class="header" style="width:20%; text-align:center;" | Results | | class="header" style="width:20%; text-align:center;" | Results | ||
|- | |- | ||
| | | IMAGE SUPPORT | ||
| Regression Testing | | Regression Testing | ||
| style="background:#FFA500; text-align:center;" | | | style="background:#FFA500; text-align:center;" | | ||
|- | |- | ||
| | | WEB COMPATIBILITY | ||
| Regression Testing | | Regression Testing | ||
| style="background:#9D9; text-align:center;" | | | style="background:#9D9; text-align:center;" | | ||
Revision as of 06:49, 4 August 2015
« Firefox 40 Beta 9 | Firefox 40 RC | Firefox 41 Beta 1 »
Firefox 40 RC (build 1) Test Plan
- Release Week: Aug 3rd, 2015. Plan is to ship this build on Tuesday Aug 4th 2015 (Release Calendar)
- QA Contacts: Robert Kaiser; Florin Mezei; Andrei Vaida
- IRC: irc://irc.mozilla.org#qa ping kairo; FlorinMezei; avaida
- Build 1: Firefox 40 RC build 1 | changeset | (ID: TBD)
QE recommendation regarding the quality of the build
| Recommendation based on results from manual testing | CONDITIONAL PASS |
|---|
Manual Testing summary - Platform Coverage and Areas Tested
- Testing is performed around areas most affected by fixes since the previous Beta (in cases when there are no Regression tests to cover these areas, or those tests have already been run as part of the Full Beta Regression set)
- Test Cases executed and results: report
PLATFORM MATRIX
| Platform | Assignee | Results: report |
| Windows 7 x64 (Graphics: ) | Florin Mezei | {{|}} |
| Windows 10 x64 (Graphics: ) | Cornel Ionce | {{|}} |
| Mac OS X 10.10 (Graphics: ) | Alexandra Lucinet | {{|}} |
| Ubuntu x86 (Graphics: ) | Bogdan Maris | {{|}} |
AREAS TESTED
| Tested Area | Testing Type | Results |
| IMAGE SUPPORT | Regression Testing | |
| WEB COMPATIBILITY | Regression Testing |
Features
See the Feature Release Tracking gdoc for a general overview
| Feature | Owner | Status | Details | Test Plan |
|---|---|---|---|---|
| Async plugin init | Catalin Varga | [DONE] | SIGNED OFF | - |
| First Run for 40 release | Catalin Varga | [ON TRACK] | New feature targeted for Firefox 40 (not yet implemented) - no sign-off (helping with testing) | - |
| Suggested tiles: Sponsored | Cornel Ionce | [DONE] | SIGNED OFF | Test Plan |
| Suggested tiles: Affiliate | Cornel Ionce | [DONE] | SIGNED OFF | Test Plan |
| New Add-on Signing | Vasilica Mihasca | DROPPED FROM 40 | Feature dropped from Firefox 39 & 40 (not enough add-ons signed) | - |
| Unified telemetry/FHR | Stuart Philp | DROPPED FROM 40 | Testing performed is tracked in bug 1169037 | - |
| OMTC by default on Linux | Alexandra Lucinet | [DONE] | SIGNED OFF | - |
| Hello - Context | Bogdan Maris | [DONE] | SIGNED OFF | - |
| Windows 10 support | Andrei Vaida / Cornel Ionce | [AT RISK] | New feature targeted for Firefox 40 - weekly status reports (NO final sign-off) | - |
Results
New bugs
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1
Known Issues - also seen in previous builds
Major issues also seen in previous builds
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1
Low impact issues also seen in previous builds
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1
Branch Bug Fix Verifications
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1
Status tags
- [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
- [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
- [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
- [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
- [IN PROGRESS] - {{mprog}} - actively being tested on
- [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed