Releases/Firefox 51/Test Plan/Beta/3

From MozillaWiki
Jump to: navigation, search

«  Firefox 51 Beta 2 | Firefox 51 Beta 3 | Firefox 51 Beta 4 »

Firefox 51.0 Beta 3 Test Plan

QE recommendation regarding the quality of the build

  • Recommendation based on results from manual testing:
Build 1 SHIP IT

Manual Testing summary - Platform Coverage and Areas Tested

  • Testing performed around Bookmarks, Mac OS X 32-bit mode and Mac OS X signing.
  • Test Cases executed and results: report

Build 1

Platform GPU Build architecture Assignee Results: report
Windows 7 x86 AMD Radeon R7 200 32-bit Paul Silaghi [DONE]
Windows 10 x64 NVIDIA GeForce 210 32-bit Camelia Badau [DONE]
Mac OS X 10.10 NVIDIA GeForce GT 640M 64-bit Cristian Comorasu [DONE]
Ubuntu 16.04 x64 Intel HD 2500 32-bit Petruta Rasa [DONE]
Tested Area Testing Type Results
Bookmarks Smoke and Exploratory Testing PASS
Mac OS X 32-bit mode Smoke and Exploratory Testing PASS
Mac OS X signing Smoke and Exploratory Testing PASS

Features

See the [1] gdoc for a general overview

Feature Owner Status Details Test Plan
WebGL2 Bogdan Maris [ON TRACK] Feature set to release with Firefox 51. Test Plan
Indicator for Streaming or Permissions Cornel Ionce [ON TRACK] Feature set to release with Firefox 51. Test Plan
Support for FLAC Ciprian Georgiu [ON TRACK] Feature set to release with Firefox 51. Test Plan
Zoom Indicator Iulia Cristescu [ON TRACK] Feature set to release with Firefox 51. Test Plan
ICE candidate generation control and user authorization Iulia Cristescu [ON TRACK] Feature set to release with Firefox 51. [n/a Test Plan]
Support VP9 for WebRTC Iulia Cristescu [ON TRACK] Feature set to release with Firefox 51. [n/a Test Plan]

Results

New bugs

  • none

Known Issues - also seen in previous builds

Major issues also seen in previous builds

Bugzilla query error

error, http-bad-status, Array


Low impact issues also seen in previous builds

Full Query
ID Summary Status Resolution
336948 figure out undo/redo model for bookmarks RESOLVED INACTIVE
420446 Duplicates make Most Visited useless, we should show only typed in addresses RESOLVED INACTIVE
423126 favicons aren't backed up to *.json RESOLVED WONTFIX
428378 Synced tabs, bookmarks, and history entries don't have a favicon until the user re-visits that page again REOPENED
432370 Drag and drop of root folders in Bookmarks Sidebar into other root folder will duplicate folders RESOLVED INACTIVE
616629 "Remember Password?" dialog shows too early RESOLVED DUPLICATE
755195 Bookmarks icon not updated until the link is visited again RESOLVED WORKSFORME
1043280 Bookmark animation not displayed when page is bookmarked from the Context Menu RESOLVED WORKSFORME
1061672 Import json-file from Firefox (or even from SeaMonkey) do not work RESOLVED INCOMPLETE
1160453 Facebook-emojis are cut off in text-input-field, on Windows only, due to dependence on font metrics of ideographic space (U+3000) RESOLVED FIXED
1176218 [Youtube][HTML5] 8K videos do not work at all, or Audio only VERIFIED FIXED
1177382 Error is thrown by controller.jsm each time a URL is dragged onto the Bookmarks Toolbar RESOLVED FIXED
1181437 Ctrl-D in about:newtab allows bookmarking the New Tab page, even though the bookmark star button is disabled RESOLVED WONTFIX
1191290 Glitches after opening images in tumblr RESOLVED WORKSFORME
1192204 Scrollbar is overlapping the Quality entries via Youtube high resolution videos RESOLVED WORKSFORME
1209518 The pasted bookmark keeps the styling of a cut one VERIFIED FIXED
1210769 Glitches after opening images via flickr RESOLVED WORKSFORME
1230678 youtube shows black line 720p & 1080p videos in normal view mode VERIFIED FIXED
1233359 Glitches after opening images in facebook NEW
1247925 Glitches opening show all bookmarks folders from edit this bookmark RESOLVED INVALID
1249000 Using "load in sidebar" with bookmarks to about:reader URLs (pages in Reader mode) don't actually load in the sidebar RESOLVED WONTFIX
1253624 When you want to cut and paste a bookmark from Bookmarks Toolbar, it will remain selected RESOLVED DUPLICATE

22 Total; 2 Open (9.09%); 17 Resolved (77.27%); 3 Verified (13.64%);


Branch Bug Fix Verifications

Full Query
ID Summary Status Resolution
1296322 X button is vertically misaligned on the permission dropdown VERIFIED FIXED
1317641 http redirect to data: inherits principal (SVG image cookie setting; object XSS) RESOLVED FIXED

2 Total; 0 Open (0%); 1 Resolved (50%); 1 Verified (50%);

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed