Releases/Firefox 50/Test Plan/Beta/8: Difference between revisions
Jump to navigation
Jump to search
Andrei.vaida (talk | contribs) m (-) |
Andrei.vaida (talk | contribs) m (-) |
||
| Line 5: | Line 5: | ||
* QA Contacts: [mailto:florin.mezei@softvisioninc.eu Florin Mezei]; [mailto:andrei.vaida@softvision.ro Andrei Vaida] | * QA Contacts: [mailto:florin.mezei@softvisioninc.eu Florin Mezei]; [mailto:andrei.vaida@softvision.ro Andrei Vaida] | ||
* IRC: irc://irc.mozilla.org#qa ping FlorinMezei; avaida | * IRC: irc://irc.mozilla.org#qa ping FlorinMezei; avaida | ||
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/50. | * Build 1: [https://archive.mozilla.org/pub/firefox/candidates/50.0b8-candidates/build1/ 50.0b8-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/b7adb2f10487 b7adb2f10487] | (ID: 20161017130949) | ||
== QE recommendation regarding the quality of the build == | == QE recommendation regarding the quality of the build == | ||
| Line 17: | Line 17: | ||
== Manual Testing summary - Platform Coverage and Areas Tested == | == Manual Testing summary - Platform Coverage and Areas Tested == | ||
* Testing performed around: Customization, Search and Safe Browsing. | * Testing performed around: Customization, Search and Safe Browsing. | ||
** ⚠ Please note that we're currently waiting for test results on a specific Safe Browsing test case that requires a 14hrs wait time. | ** {{mdone|}} ⚠ Please note that we're currently waiting for test results on a specific Safe Browsing test case that requires a 14hrs wait time. | ||
* Test Cases executed and results: [https://testrail.stage.mozaws.net/index.php?/reports/view/95 report] | * Test Cases executed and results: [https://testrail.stage.mozaws.net/index.php?/reports/view/95 report] | ||
| Line 65: | Line 65: | ||
| SAFE BROWSING | | SAFE BROWSING | ||
| Smoke Testing | | Smoke Testing | ||
| style="background: | | style="background:green; color: white; text-align:center;" | '''PASS''' | ||
|- | |- | ||
|} | |} | ||
Latest revision as of 08:19, 20 October 2016
« Firefox 50 Beta 7 | Firefox 50 Beta 8 | Firefox 50 Beta 9 »
Firefox 50.0 Beta 8 Test Plan
- Release Week: Oct 17th, 2016. Plan is to ship this build on Tuesday, Oct 18th 2016 (Release Calendar)
- QA Contacts: Florin Mezei; Andrei Vaida
- IRC: irc://irc.mozilla.org#qa ping FlorinMezei; avaida
- Build 1: 50.0b8-build1 | b7adb2f10487 | (ID: 20161017130949)
QE recommendation regarding the quality of the build
- Recommendation based on results from manual testing:
| Build 1 | SHIP IT |
|---|
Manual Testing summary - Platform Coverage and Areas Tested
- Testing performed around: Customization, Search and Safe Browsing.
- [DONE] ⚠ Please note that we're currently waiting for test results on a specific Safe Browsing test case that requires a 14hrs wait time.
- Test Cases executed and results: report
Build 1
| Platform | Build architecture | Assignee | Results: report |
|---|---|---|---|
| Windows 8.1 x64 (Intel HD 520) | 32-bit | Mihai Boldan | [DONE] |
| Windows 7 x64 (AMD 760G) | 64-bit | Ciprian Georgiu | [DONE] |
| Mac OS X 10.9.5 (Intel Iris Pro (1024 MB)) | 64-bit | Camelia Badau | [DONE] |
| Ubuntu 14.04 x86 (Intel HD 4600) | 32-bit | Iulia Cristescu | [DONE] |
| Tested Area | Testing Type | Results |
|---|---|---|
| CUSTOMIZATION | Smoke and Exploratory Testing | PASS |
| SEARCH | Smoke Testing | PASS |
| SAFE BROWSING | Smoke Testing | PASS |
Features
See the [1] gdoc for a general overview
| Feature | Owner | Status | Details | Test Plan |
|---|---|---|---|---|
| Windows Child Mode | Iulia Cristescu | [ON TRACK] | Feature set to release with Firefox 50. There are no concerns at this time, regarding this feature's quality. | Test Plan |
| Pointer Lock API | Alexandru Simonca | [INVESTIGATION NEEDED] | Feature set to release with Firefox 50. At this point, we're mostly concerned about the relatively large number of still unresolved bugs affecting this feature, especially 1287104 and 853160 | Test Plan |
| WebM EME support for Widevine | Ciprian Georgiu | [INVESTIGATION NEEDED] | Feature set to release with Firefox 50. At this point, our concerns revolve around the still unresolved bugs: 1298027, 1298030, 1301423 and the recent issue we noticed on the shaka player demo, under Ubuntu (the latter being currently investigated by Bryce Van Dyk). | Test Plan |
| Simplify page | Bogdan Maris | [AT RISK] | Target milestone changed to Fx51, due to 1306294, 1306299, 1306295. | Test Plan |
Results
New bugs
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1
Known Issues - also seen in previous builds
Major issues also seen in previous builds
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1
Low impact issues also seen in previous builds
Bugzilla query error
Query options must be valid JSON.1
Branch Bug Fix Verifications
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1
Status tags
- [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
- [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
- [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
- [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
- [IN PROGRESS] - {{mprog}} - actively being tested on
- [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed