Releases/Firefox 51/Test Plan/Beta/1
From MozillaWiki
« Firefox 50 RC2 | Firefox 51 Beta 1 | [[Releases/Firefox 51/Test Plan/Beta/2 | Firefox 51 Beta 2] »
Contents
Firefox 51.0 Beta 1 Test Plan
- Release Week: Nov 14th, 2016. Plan is to ship this build on Wednesday, Nov 16th 2016 (Release Calendar)
- QA Contacts: Florin Mezei; Andrei Vaida
- IRC: irc://irc.mozilla.org#qa ping FlorinMezei; avaida
- Build 1: 51.0b1-build1 | f455459b2ae5 | (ID: 20161114042748)
- Build 2: 51.0b1-build2 | 749a8d32b74e | (ID: 20161115182233)
QE recommendation regarding the quality of the build
- Recommendation based on results from manual testing:
| Build 2 | SHIP IT |
|---|
Manual Testing summary - Platform Coverage and Areas Tested
- Testing performed around Web Compatibility and the new features in this version: WebGL2, Support for FLAC, Indicator for Streaming Permissions and Zoom Indicator.
- Test Cases executed and results: report
Build 2
| Platform | GPU | Build architecture | Assignee | Results: report |
|---|---|---|---|---|
| Windows 7 x64 | NVIDIA GeForce 210 | 32-bit | Camelia Badau | [DONE] |
| Windows 10 x64 | ATI Radeon HD 3000 | 64-bit | Ciprian Georgiu | [DONE] |
| Mac OS X 10.11.6 | NVIDIA GeForce 640M | 64-bit | Camelia Badau | [DONE] |
| Ubuntu 16.04 x64 | Intel HD 2500 | 64-bit | Petruta Rasa | [DONE] |
| Tested Area | Testing Type | Results |
|---|---|---|
| WebGL2 | Smoke and Exploratory Testing | PASSED |
| Support for FLAC | Smoke and Exploratory Testing | PASSED |
| Indicator for Device Permissions | Smoke and Exploratory Testing | PASSED |
| Zoom Indicator | Smoke and Exploratory Testing | FAILED (see 1317686) |
| Web Compatibility | Smoke and Exploratory Testing | PASSED |
Features
See the [1] gdoc for a general overview
| Feature | Owner | Status | Details | Test Plan |
|---|---|---|---|---|
| WebGL2 | Bogdan Maris | [ON TRACK] | Feature set to release with Firefox 51. | Test Plan |
| Indicator for Streaming or Permissions | Cornel Ionce | [ON TRACK] | Feature set to release with Firefox 51. | Test Plan |
| Support for FLAC | Ciprian Georgiu | [ON TRACK] | Feature set to release with Firefox 51. | Test Plan |
| Zoom Indicator | Iulia Cristescu | [ON TRACK] | Feature set to release with Firefox 51. | Test Plan |
| ICE candidate generation control and user authorization | Iulia Cristescu | [ON TRACK] | Feature set to release with Firefox 51. | [n/a Test Plan] |
| Support VP9 for WebRTC | Iulia Cristescu | [ON TRACK] | Feature set to release with Firefox 51. | [n/a Test Plan] |
Results
New bugs
| ID | Summary | Status | Resolution |
|---|---|---|---|
| 1090742 | [meta] Support VP9 for WebRTC | NEW |
1 Total; 1 Open (100%); 0 Resolved (0%); 0 Verified (0%);
Known Issues - also seen in previous builds
Major issues also seen in previous builds
No results.
0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);
Low impact issues also seen in previous builds
19 Total; 3 Open (15.79%); 13 Resolved (68.42%); 3 Verified (15.79%);
Branch Bug Fix Verifications
Full Query ID Summary Status Resolution 1263171 Identity box text for internal pages is unreadable on dark themes in Nightly/Aurora VERIFIED FIXED 1282070 New Find locates strings on partially loaded pages and doesn't notice when the position changes VERIFIED FIXED 1282689 Show an alert mark on badges if there are exceptional status to download files. VERIFIED FIXED 1299998 "Share this page" button for twitter opens odd tab(s) VERIFIED FIXED 1300869 Dimmed highlighting mode on sometimes wraps the text line of the text being searched for VERIFIED FIXED 5 Total; 0 Open (0%); 0 Resolved (0%); 5 Verified (100%);
Status tags
- [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
- [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
- [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
- [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
- [IN PROGRESS] - {{mprog}} - actively being tested on
- [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed
