Releases/Firefox 52/Test Plan/Beta/5
From MozillaWiki
« Firefox 52 Beta 4 | Firefox 52 Beta 5 | Firefox 52 Beta 6 »
Contents
Firefox 52.0 Beta 5 Test Plan
- Release Week: Feb 6th, 2017. Plan is to ship this build on Fri, Feb 10th 2017 (Release Calendar)
- QA Contacts: Florin Mezei; Andrei Vaida; Cornel Ionce
- IRC: irc://irc.mozilla.org#qa ping FlorinMezei; avaida; cornel_ionce
- Build 1: 52.0b5-build1 | 49b3ad9f467d | (ID: 20170209120619)
QE recommendation regarding the quality of the build
- Recommendation based on results from manual testing:
Build 1 | SHIP IT |
---|
Manual Testing summary - Platform Coverage and Areas Tested
- Testing performed around Geolocation, Search, and Bookmarks.
- Test Cases executed and results: report
Build 1
Platform | GPU | Build architecture | Assignee | Results: report |
---|---|---|---|---|
Windows 8.1 x64 | Intel HD 520 | 32-bit | Mihai Boldan | [DONE] |
Windows 10 x64 | Intel HD 2500 | 64-bit | Petruta Rasa | [DONE] |
Mac OS X 10.11 | Intel Iris Pro 1536 MB | 64-bit | Camelia Badau | [DONE] |
Ubuntu LTS x64 | AMD Radeon HD 3000 | 64-bit | Timea Zsoldos | [DONE] |
Tested Area | Testing Type | Results |
---|---|---|
Geolocation | Smoke and Exploratory Testing | PASS |
Search | Smoke and Exploratory Testing | PASS |
Bookmarks | Smoke and Exploratory Testing | PASS |
Features
See the [1] gdoc for a general overview
Feature | Owner | Testing | Sign off | Details | Test Plan |
---|---|---|---|---|---|
Touch events in APZ | Petruta Rasa | [ON TRACK] | [NOT STARTED] | Feature set to release with Firefox 52. | Test Plan |
New Responsive Design Mode | Mihai Boldan | [ON TRACK] | [NOT STARTED] | Feature set to release with Firefox 52. | Test Plan |
Partner Search | Paul Silaghi | [ON TRACK] | [NOT STARTED] | Feature set to release with Firefox 52. | Test Plan |
Device Permissions (Screen Sharing) | Cornel Ionce | [ON TRACK] | [NOT STARTED] | Feature set to release with Firefox 52. | Test Plan |
Skia Content for Windows (Compositor Process) | Mihai Boldan | [ON TRACK] | [NOT STARTED] | Feature set to release with Firefox 52. | Test Plan |
Ship DTMF support in Firefox | Cornel Ionce | [ON TRACK] | [NOT STARTED] | Feature set to release with Firefox 52. | Test Plan |
Restartless System Add-ons | Alexandru Simonca, Cristian Comorasu | [ON TRACK] | [NOT STARTED] | Feature set to release with Firefox 52. | --- |
CSS Grid, CSS Grid Inspector | Bogdan Maris, Paul Silaghi | [ON TRACK] | [NOT STARTED] | Feature set to release with Firefox 52. | --- |
mediaDevices.ondevicechange in MediaStream | Alexandru Simonca | [ON TRACK] | [NOT STARTED] | Feature set to release with Firefox 52. | --- |
Improvements to <select> element | Petruta Rasa | [ON TRACK] | [NOT STARTED] | Feature set to release with Firefox 52. | --- |
First-party isolation (Tor) | Bogdan Maris (assisting only) | [ON TRACK] | --- | Feature set to release with Firefox 52. Will not be signed off by our team. | --- |
Automatic Captive Portal detection | Adrian Florinescu (Engineering QA) | [ON TRACK] | [NOT STARTED] | Feature set to release with Firefox 52. | --- |
Insecure Password Manager | Adrian Florinescu (Engineering QA) | [ON TRACK] | [NOT STARTED] | Feature set to release with Firefox 52. | --- |
Results
New bugs
1 Total; 1 Open (100%); 0 Resolved (0%); 0 Verified (0%);
Known Issues - also seen in previous builds
Major issues also seen in previous builds
none
Low impact issues also seen in previous builds
8 Total; 1 Open (12.5%); 6 Resolved (75%); 1 Verified (12.5%);
Branch Bug Fix Verifications
Full Query ID Summary Status Resolution 1311420 Consider notifications to users about plugin deprecation VERIFIED FIXED 1317167 Crash in nsContentUtils::IsCallerChrome when playing MP3 with media.autoplay.enabled=false VERIFIED FIXED 1320192 [a11y] Flash player crashes on 51.0b2 32bitwith e10s when Windows10 Narrator is activated RESOLVED FIXED 1323520 zh-CN Firefox should be using Google with no codes RESOLVED FIXED 1330998 NPAPI plugins can still be enabled in Nightly 53 VERIFIED FIXED 5 Total; 0 Open (0%); 2 Resolved (40%); 3 Verified (60%);
Status tags
- [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
- [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
- [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
- [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
- [IN PROGRESS] - {{mprog}} - actively being tested on
- [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed