Releases/Firefox 51/Test Plan/Beta/12

From MozillaWiki
Jump to navigation Jump to search

«  Firefox 51 Beta 11 | Firefox 51 Beta 12 | Firefox 51 Beta 13 »

Firefox 51.0 Beta 12 Test Plan

QE recommendation regarding the quality of the build

  • Recommendation based on results from manual testing:
Build 1 SHIP IT

Manual Testing summary - Platform Coverage and Areas Tested

  • Testing performed around Search, Add-on compatibility, Printing and Customization.
    • Part of our efforts were also focused on making sure that:
      • [DONE] the changes introduced by 1322718 (funnelcake) did not affect the first run experience on beta
      • [DONE] the changes introduced by 1325501 (TLS 1.3 experiment) did not affect telemetry, add-on updates and blocklist updates on beta (see this etherpad)
  • Test Cases executed and results: report

Build 1

Platform GPU Build architecture Assignee Results: report
Windows 7 x64 NVIDIA GeForce 210 32-bit Camelia Badau [DONE]
Windows 8.1 x64 AMD Radeon HD 3000 64-bit Ciprian Georgiu [DONE]
macOS 10.12 Intel Iris Graphics 6100 64-bit Iulia Cristescu [DONE]
Ubuntu 14.04 x86 Intel HD 2500 32-bit Petruta Rasa [DONE]
Tested Area Testing Type Results
Search Smoke and Exploratory Testing PASS
Add-on Compatibility Exploratory Testing PASS
Printing Smoke Testing PASS
Customization Smoke and Exploratory Testing PASS

Features

See the [1] gdoc for a general overview

Feature Owner Status Details Test Plan
WebGL2 Bogdan Maris [ON TRACK] Feature set to release with Firefox 51. Test Plan
Indicator for Streaming or Permissions Cornel Ionce [ON TRACK] Feature set to release with Firefox 51. Test Plan
Support for FLAC Ciprian Georgiu [ON TRACK] Feature set to release with Firefox 51. Test Plan
Zoom Indicator Iulia Cristescu [ON TRACK] Feature set to release with Firefox 51. Test Plan
ICE candidate generation control and user authorization Iulia Cristescu [ON TRACK] Feature set to release with Firefox 51. [n/a Test Plan]
Support VP9 for WebRTC Iulia Cristescu --- Feature set to release with Firefox 51, but won't be tracked by our team. ---

Results

New bugs

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1


Known Issues - also seen in previous builds

Major issues also seen in previous builds

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1


Low impact issues also seen in previous builds

Full Query
ID Summary Status Resolution
538844 When the Bookmarks Toolbar is moved to the Menu line, its original space is left blank NEW
972658 Undo 'restore defaults' does not restore toolbar visibility (bookmarks / menu toolbar ) NEW
1161952 [Ubuntu] Low quality when printing a pdf file RESOLVED WORKSFORME
1171636 Allow displaying multiple simultaneous add-on installs RESOLVED DUPLICATE
1182473 "None" word should be removed from theme details tab in about:addons RESOLVED INACTIVE
1199731 If some add-ons are being installed simultaneously, there's many close buttons in notification popup, and they do the same action RESOLVED WORKSFORME
1202654 “Restart now” and “Undo” buttons should not appear for Default theme in about:addons RESOLVED INACTIVE
1212515 Add-on doorhanger UI is broken with more than one add-on RESOLVED WORKSFORME
1252975 If there is no installation confirmation, the same add-on is listed multiple times in Add-ons Manager RESOLVED INACTIVE
1253624 When you want to cut and paste a bookmark from Bookmarks Toolbar, it will remain selected RESOLVED DUPLICATE
1264704 URL Bar loses its focus in about:home during search process RESOLVED WORKSFORME

11 Total; 2 Open (18.18%); 9 Resolved (81.82%); 0 Verified (0%);


Branch Bug Fix Verifications

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed
Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_51/Test_Plan/Beta/12&oldid=1158737"