Releases/Firefox 49/Test Plan/Beta/8: Difference between revisions
Jump to navigation
Jump to search
Full Query
Full Query
Andrei.vaida (talk | contribs) (-) |
Andrei.vaida (talk | contribs) m (-) |
||
(One intermediate revision by the same user not shown) | |||
Line 12: | Line 12: | ||
{| class="wikitable" width=50% | {| class="wikitable" width=50% | ||
! Build 1 | ! Build 1 | ||
| style="background:green; color:white; text-align:center;" | ''' | | style="background:green; color:white; text-align:center;" | '''SHIP IT''' | ||
|} | |} | ||
== Manual Testing summary - Platform Coverage and Areas Tested == | == Manual Testing summary - Platform Coverage and Areas Tested == | ||
* Testing performed around downloads, bookmarks and the PDF Viewer. | * Testing performed around downloads, bookmarks and the PDF Viewer. | ||
* Test Cases executed and results: [https://testrail.stage.mozaws.net/index.php?/reports/view/ | * Test Cases executed and results: [https://testrail.stage.mozaws.net/index.php?/reports/view/47 report] | ||
=== Build 1 === | === Build 1 === | ||
Line 25: | Line 25: | ||
! Build architecture | ! Build architecture | ||
! Assignee | ! Assignee | ||
! Results: [https://testrail.stage.mozaws.net/index.php?/reports/view/ | ! Results: [https://testrail.stage.mozaws.net/index.php?/reports/view/47 report] | ||
|- | |- | ||
| Windows XP SP3 x64 ( | | Windows XP SP3 x64 (AMD Radeon HD 7700) | ||
| 32-bit | | 32-bit | ||
| Andrei Vaida | | Andrei Vaida | ||
| style="text-align:center;" | {{mdone|}} | | style="text-align:center;" | {{mdone|}} | ||
|- | |- | ||
| Windows 7 x64 ( | | Windows 7 x64 (AMD 760G) | ||
| 64-bit | | 64-bit | ||
| Ciprian Georgiu | | Ciprian Georgiu | ||
| style="text-align:center;" | {{mdone|}} | | style="text-align:center;" | {{mdone|}} | ||
|- | |- | ||
| Mac OS X 10.10 ( | | Mac OS X 10.10 (Intel Iris Pro (1536 MB)) | ||
| 64-bit | | 64-bit | ||
| Mihai Boldan | | Mihai Boldan | ||
| style="text-align:center;" | {{mdone|}} | | style="text-align:center;" | {{mdone|}} | ||
|- | |- | ||
| Ubuntu 14.04 x86 ( | | Ubuntu 14.04 x86 (AMD RS780) | ||
| 32-bit | | 32-bit | ||
| Iulia Cristescu | | Iulia Cristescu | ||
Line 52: | Line 52: | ||
! Tested Area | ! Tested Area | ||
! Testing Type | ! Testing Type | ||
! [https://testrail.stage.mozaws.net/index.php?/reports/view/ | ! [https://testrail.stage.mozaws.net/index.php?/reports/view/47 Results] | ||
|- | |- | ||
| Downloads | | Downloads | ||
| Exploratory Testing | | Exploratory Testing | ||
| style="background: | | style="background:red; color: white; text-align:center;" | '''FAILED''' (reason: [https://bugzilla.mozilla.org/show_bug.cgi?id=1299170 1299170]) | ||
|- | |- | ||
| Bookmarks | | Bookmarks | ||
| Smoke & Exploratory Testing | | Smoke & Exploratory Testing | ||
| style="background:green; color: white; text-align:center;" | ''' | | style="background:green; color: white; text-align:center;" | '''PASSED''' | ||
|- | |- | ||
| PDF Viewer | | PDF Viewer | ||
| Smoke & Exploratory Testing | | Smoke & Exploratory Testing | ||
| style="background: | | style="background:red; color: white; text-align:center;" | '''FAILED''' (reason [https://bugzilla.mozilla.org/show_bug.cgi?id=1299138 1299138]) | ||
|- | |- | ||
|} | |} | ||
Line 100: | Line 100: | ||
= Results = | = Results = | ||
* [https://testrail.stage.mozaws.net/index.php?/reports/view/ | * [https://testrail.stage.mozaws.net/index.php?/reports/view/47 Found bugs - new and known] | ||
== New bugs == | == New bugs == | ||
<bugzilla> | <bugzilla> | ||
{ | { | ||
"id":"", | "id":"1299138, 1299170", | ||
"include_fields":"id,summary,status,resolution" | "include_fields":"id,summary,status,resolution" | ||
} | } | ||
Line 122: | Line 122: | ||
<bugzilla> | <bugzilla> | ||
{ | { | ||
"id":"", | "id":"839074, 1144124, 1161952, 1109080, 1037792, 1020271, 836732, 767382, 428378, 1253624, 432370", | ||
"include_fields":"id,summary,status,resolution" | "include_fields":"id,summary,status,resolution" | ||
} | } |
Latest revision as of 15:02, 30 August 2016
« Firefox 49 Beta 7 | Firefox 49 Beta 8 | Firefox 49 Beta 9 »
Firefox 49.0 Beta 8 Test Plan
- Release Week: Aug 29th, 2016. Plan is to ship this build on Tuesday, Aug 30th 2016 (Release Calendar)
- QA Contacts: Florin Mezei; Andrei Vaida
- IRC: irc://irc.mozilla.org#qa ping FlorinMezei; avaida
- Build 1: 49.0b8-build1 | 68d24e6f784c | (ID: 20160829102229)
QE recommendation regarding the quality of the build
- Recommendation based on results from manual testing:
Build 1 | SHIP IT |
---|
Manual Testing summary - Platform Coverage and Areas Tested
- Testing performed around downloads, bookmarks and the PDF Viewer.
- Test Cases executed and results: report
Build 1
Platform | Build architecture | Assignee | Results: report |
---|---|---|---|
Windows XP SP3 x64 (AMD Radeon HD 7700) | 32-bit | Andrei Vaida | [DONE] |
Windows 7 x64 (AMD 760G) | 64-bit | Ciprian Georgiu | [DONE] |
Mac OS X 10.10 (Intel Iris Pro (1536 MB)) | 64-bit | Mihai Boldan | [DONE] |
Ubuntu 14.04 x86 (AMD RS780) | 32-bit | Iulia Cristescu | [DONE] |
Tested Area | Testing Type | Results |
---|---|---|
Downloads | Exploratory Testing | FAILED (reason: 1299170) |
Bookmarks | Smoke & Exploratory Testing | PASSED |
PDF Viewer | Smoke & Exploratory Testing | FAILED (reason 1299138) |
Features
See the [1] gdoc for a general overview
Feature | Owner | Status | Details | Test Plan |
---|---|---|---|---|
Text to Speech on Desktop | Camelia Badau | [ON TRACK] | Feature set to release with Firefox 49. Pre-release sign off currently in progress. | Test Plan |
Text to Speech in Reader View | Camelia Badau | [ON TRACK] | Feature set to release with Firefox 49. Pre-release sign off currently in progress. | Test Plan |
Mac elevated updates | Bogdan Maris | [ON TRACK] | Feature set to release with Firefox 49. Pre-release sign off currently in progress. | Test Plan |
Results
New bugs
ID | Summary | Status | Resolution |
---|---|---|---|
1299138 | The Presentation mode button is missing from the PDF files | VERIFIED | FIXED |
1299170 | Malicious sample file is not blocked by Firefox | RESOLVED | WORKSFORME |
2 Total; 0 Open (0%); 1 Resolved (50%); 1 Verified (50%);
Known Issues - also seen in previous builds
Major issues also seen in previous builds
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1
Low impact issues also seen in previous builds
11 Total; 3 Open (27.27%); 8 Resolved (72.73%); 0 Verified (0%);
Branch Bug Fix Verifications
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1
Status tags
- [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
- [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
- [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
- [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
- [IN PROGRESS] - {{mprog}} - actively being tested on
- [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed