Releases/Firefox 52/Test Plan/Beta/52.0.1
From MozillaWiki
« Firefox 52 RC 1 | Firefox 52.0.1 »
Firefox 52.0.1 Beta RC Test Plan
- Release Week: Mar 13th, 2017. Plan is to ship this build on Fri, 17th 2017 (Release Calendar)
- QA Contacts: Florin Mezei; Andrei Vaida; Cornel Ionce
- IRC: irc://irc.mozilla.org#qa ping FlorinMezei; avaida; cornel_ionce
- Build 2: 52.0.1-build2 | 2f2b4a119565 | (ID: 20170316213829)
QE recommendation regarding the quality of the build
- Recommendation based on results from manual testing:
| Build 1 | SHIP IT |
|---|
Manual Testing summary - Platform Coverage and Areas Tested
- Testing performed around Web Compatibility.
- Test Cases executed and results: report
Build 1
| Platform | GPU | Build architecture | Assignee | Results: report |
|---|---|---|---|---|
| Windows 10 x64 | Intel(R) HD Graphics 530 | 64-bit | Cristian Comorasu | [DONE] |
| Windows 7 x64 | AMD Radeon R7 200 | 32-bit | Paul Silaghi | [DONE] |
| Mac OS X 10.11 | Intel Iris Pro | 64-bit | Timea Zsoldos | [DONE] |
| Ubuntu 14.04 x64 | Intel HD 5500 | 64-bit | Camelia Badau | [DONE] |
| Tested Area | Testing Type | Results |
|---|---|---|
| Web compatibility | Exploratory Testing | PASSED |
Features
See the [1] gdoc for a general overview
| Feature | Owner | Testing | Sign off | Details | Test Plan |
|---|---|---|---|---|---|
| Touch events in APZ | Petruta Rasa | [DONE] | [DONE] | Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is YELLOW. | Test Plan |
| New Responsive Design Mode | Mihai Boldan | [AT RISK] | [DONE] | Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is RED because there are 26 open bugs still affecting it | Test Plan |
| Partner Search | Paul Silaghi | [DONE] | [DONE] | Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. | Test Plan |
| Device Permissions (Screen Sharing) | Cornel Ionce | [DONE] | [DONE] | Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. | Test Plan |
| Skia Content for Windows (Compositor Process) | Mihai Boldan | [DONE] | [DONE] | Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. | Test Plan |
| Ship DTMF support in Firefox | Cornel Ionce | [DONE] | [DONE] | Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. | Test Plan |
| Restartless System Add-ons | Alexandru Simonca, Cristian Comorasu | [DONE] | [DONE] | Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. | Test Plan |
| CSS Grid, CSS Grid Inspector | Bogdan Maris, Paul Silaghi | [AT RISK] | [DONE] | Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is RED because there are 2 bugs severely affecting it and several high impact issues were encountered during sign-off. | --- |
| mediaDevices.ondevicechange in MediaStream | Alexandru Simonca | [DONE] | [DONE] | Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. | Test Plan |
| Improvements to <select> element | Petruta Rasa | [DONE] | [DONE] | Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. | --- |
| First-party isolation (Tor) | Bogdan Maris (assisting only) | [DONE] | --- | Feature set to release with Firefox 52. Will not be signed off by our team but a pre-Release test report for the parts our team tested was sent on Feb 27. | --- |
| Automatic Captive Portal detection | Camelia Badau | [DONE] | [DONE] | Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is YELLOW. | Test Plan |
| Insecure Password Manager | Iulia Cristescu | [DONE] | [DONE] | Feature set to release with Firefox 52. Pre-Release sign off completed, the feature is GREEN. | Test Plan |
| Introduce word (and sentence?) tracking in Narrate | Camelia Badau | [DONE] | --- | Feature set to release with Firefox 52. Release QA will not be signing off on this, as we've only got notice of it at the end of the cycle. We did make sure that the most basic functionality associated to it is intact, though (see results). | --- |
Results
New bugs
Bugzilla query error
error, http-bad-status, Array
Known Issues - also seen in previous builds
Major issues also seen in previous builds
No results.
0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);
Low impact issues also seen in previous builds
7 Total; 3 Open (42.86%); 4 Resolved (57.14%); 0 Verified (0%);
Branch Bug Fix Verifications
No results.
0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);
Status tags
- [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
- [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
- [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
- [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
- [IN PROGRESS] - {{mprog}} - actively being tested on
- [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed
