Releases/Firefox 51/Test Plan/Beta/RC1
« Firefox 51 Beta 13 | Firefox 51 Beta 14 | Firefox 51 RC1 »
Firefox 51.0 RC1 Test Plan
- Release Week: Jan 16, 2017. Plan is to ship this build on Tuesday, Jan 24th 2017 (Release Calendar)
- QA Contacts: Florin Mezei; Andrei Vaida; Cornel Ionce
- IRC: irc://irc.mozilla.org#qa ping FlorinMezei; avaida; ionce.cornel
- Build 1: 51.0-build1 | 85d16b0be539 | (ID: 20170116133120)
QE recommendation regarding the quality of the build
- Recommendation based on results from manual testing:
| Build 1 | SHIP IT |
|---|
Manual Testing summary - Platform Coverage and Areas Tested
- Testing performed around Web compatibility.
- Test Cases executed and results: report
Build 1
| Platform | GPU | Build architecture | Assignee | Results: report |
|---|---|---|---|---|
| Windows 7 x64 | Intel HD Graphics 4600 | 32-bit | Iulia Cristescu | [DONE] |
| Windows 10 x64 | Intel HD Graphics 2500 | 64-bit | Petruta Rasa | [DONE] |
| Mac OS X 10.11.6 | Intel Iris Pro (1536 MB) | 64-bit | Camelia Badau | [DONE] |
| Ubuntu 16.04 x64 | ATI Radeon HD 3000 | 64-bit | Ciprian Georgiu | [DONE] |
| Tested Area | Testing Type | Results |
|---|---|---|
| Web compatibility | Exploratory Testing | FAILED |
Features
See the [1] gdoc for a general overview
| Feature | Owner | Testing | Sign off | Details | Test Plan |
|---|---|---|---|---|---|
| WebGL2 | Bogdan Maris | [DONE] | YELLOW | Feature set to release with Firefox 51, pre-Release sign off completed. Yellow because of the new bugs encountered during sign off (1330333, 1330334) and the large number of conformance test failures (test runner). | Test Plan |
| Indicator for Streaming or Permissions | Cornel Ionce | [DONE] | GREEN | Feature set to release with Firefox 51, pre-Release sign off completed. | Test Plan |
| Support for FLAC | Ciprian Georgiu | [DONE] | GREEN | Feature set to release with Firefox 51, pre-Release sign off completed. | Test Plan |
| Zoom Indicator | Iulia Cristescu | [DONE] | YELLOW | Feature set to release with Firefox 51, pre-Release sign off completed. Yellow because of 1310758 and 1300376. | Test Plan |
| ICE candidate generation control and user authorization | Iulia Cristescu | [AT RISK] | AT RISK | Feature set to release with Firefox 51, pre-Release sign off currently blocked. At risk because we're still waiting for clarifications from engineering on a few of our test results. | Test Plan |
| Support VP9 for WebRTC | Iulia Cristescu | --- | --- | Feature set to release with Firefox 51, but won't be tracked by our team. | --- |
Results
New bugs
| ID | Summary | Status | Resolution |
|---|---|---|---|
| 1331637 | DnD uploads empty folders on onedrive.com | RESOLVED | DUPLICATE |
1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);
Known Issues - also seen in previous builds
Major issues also seen in previous builds
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1
Low impact issues also seen in previous builds
| ID | Summary | Status | Resolution |
|---|---|---|---|
| 616629 | "Remember Password?" dialog shows too early | RESOLVED | DUPLICATE |
| 1191290 | Glitches after opening images in tumblr | RESOLVED | WORKSFORME |
| 1210769 | Glitches after opening images via flickr | RESOLVED | WORKSFORME |
| 1233359 | Glitches after opening images in facebook | NEW | |
| 1305744 | Twitter profile picture glitches when the page is scrolled in maximized window | RESOLVED | WORKSFORME |
| 1309534 | Glitches when zoom in .jpg files from Wikipedia | RESOLVED | WORKSFORME |
| 1320598 | Crash in mozilla::ipc::FatalError | mozilla::dom::PContentParent::OnMessageReceived | RESOLVED | WORKSFORME |
7 Total; 1 Open (14.29%); 6 Resolved (85.71%); 0 Verified (0%);
Branch Bug Fix Verifications
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1
Status tags
- [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
- [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
- [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
- [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
- [IN PROGRESS] - {{mprog}} - actively being tested on
- [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed