Releases/Firefox 51/Test Plan/Beta/1

From MozillaWiki
Jump to: navigation, search

«  Firefox 50 RC2 | Firefox 51 Beta 1 | [[Releases/Firefox 51/Test Plan/Beta/2 | Firefox 51 Beta 2] »

Firefox 51.0 Beta 1 Test Plan

QE recommendation regarding the quality of the build

  • Recommendation based on results from manual testing:
Build 2 SHIP IT

Manual Testing summary - Platform Coverage and Areas Tested

  • Testing performed around Web Compatibility and the new features in this version: WebGL2, Support for FLAC, Indicator for Streaming Permissions and Zoom Indicator.
  • Test Cases executed and results: report

Build 2

Platform GPU Build architecture Assignee Results: report
Windows 7 x64 NVIDIA GeForce 210 32-bit Camelia Badau [DONE]
Windows 10 x64 ATI Radeon HD 3000 64-bit Ciprian Georgiu [DONE]
Mac OS X 10.11.6 NVIDIA GeForce 640M 64-bit Camelia Badau [DONE]
Ubuntu 16.04 x64 Intel HD 2500 64-bit Petruta Rasa [DONE]
Tested Area Testing Type Results
WebGL2 Smoke and Exploratory Testing PASSED
Support for FLAC Smoke and Exploratory Testing PASSED
Indicator for Device Permissions Smoke and Exploratory Testing PASSED
Zoom Indicator Smoke and Exploratory Testing FAILED (see 1317686)
Web Compatibility Smoke and Exploratory Testing PASSED

Features

See the [1] gdoc for a general overview

Feature Owner Status Details Test Plan
WebGL2 Bogdan Maris [ON TRACK] Feature set to release with Firefox 51. Test Plan
Indicator for Streaming or Permissions Cornel Ionce [ON TRACK] Feature set to release with Firefox 51. Test Plan
Support for FLAC Ciprian Georgiu [ON TRACK] Feature set to release with Firefox 51. Test Plan
Zoom Indicator Iulia Cristescu [ON TRACK] Feature set to release with Firefox 51. Test Plan
ICE candidate generation control and user authorization Iulia Cristescu [ON TRACK] Feature set to release with Firefox 51. [n/a Test Plan]
Support VP9 for WebRTC Iulia Cristescu [ON TRACK] Feature set to release with Firefox 51. [n/a Test Plan]

Results

New bugs

Full Query
ID Summary Status Resolution
1090742 [meta] Support VP9 for WebRTC NEW

1 Total; 1 Open (100%); 0 Resolved (0%); 0 Verified (0%);


Known Issues - also seen in previous builds

Major issues also seen in previous builds

Bugzilla query error

error, http-bad-status, Array


Low impact issues also seen in previous builds

Full Query
ID Summary Status Resolution
616629 "Remember Password?" dialog shows too early RESOLVED DUPLICATE
1191290 Glitches after opening images in tumblr RESOLVED WORKSFORME
1192204 Scrollbar is overlapping the Quality entries via Youtube high resolution videos RESOLVED WORKSFORME
1210769 Glitches after opening images via flickr RESOLVED WORKSFORME
1223391 [Linux] Audio jumps when I'm right clicking in different places on the time bar RESOLVED WORKSFORME
1233359 Glitches after opening images in facebook NEW
1282075 Selecting the "Hide Controls" option causes the container area to disappear (for audio files played inline) NEW
1297041 After you block the camera there is no way to unblock it from the iframes. RESOLVED FIXED
1297047 Denying a video/audio stream with 'remember this decision' checked should stop existing streams for the same domain NEW
1297970 When moving a tab from the other window. TypeError: win is null URLBarZoom.jsm:24:7 VERIFIED FIXED
1299809 After refresh some buttons become inactive RESOLVED DUPLICATE
1300064 Permissions details are not displayed when "Never share" Video is selected in Iframe RESOLVED DUPLICATE
1300376 Zoom indicator (urlbar-zoom-button) is gone when moved to new window VERIFIED FIXED
1305029 [FLAC sample] The audio progress bar skips final seconds NEW
1305744 Twitter profile picture glitches when the page is scrolled in maximized window RESOLVED WORKSFORME
1309534 Glitches when zoom in .jpg files from Wikipedia NEW
1310758 Zoom indicator doesn't always update on tab switching for some sites VERIFIED FIXED
1316310 WebGL 2.0 sample http://webglsamples.org/WebGL2Samples/#draw_primitive_restart is not working RESOLVED FIXED
1316319 WebGL2 transform_feedback demos are not displayed RESOLVED DUPLICATE

19 Total; 5 Open (26.32%); 11 Resolved (57.89%); 3 Verified (15.79%);


Branch Bug Fix Verifications

Full Query
ID Summary Status Resolution
1263171 Identity box text for internal pages is unreadable on dark themes in Nightly/Aurora VERIFIED FIXED
1282070 New Find locates strings on partially loaded pages and doesn't notice when the position changes VERIFIED FIXED
1282689 Show an alert mark on badges if there are exceptional status to download files. VERIFIED FIXED
1299998 "Share this page" button for twitter opens odd tab(s) VERIFIED FIXED
1300869 Dimmed highlighting mode on sometimes wraps the text line of the text being searched for VERIFIED FIXED

5 Total; 0 Open (0%); 0 Resolved (0%); 5 Verified (100%);

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed
Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_51/Test_Plan/Beta/1&oldid=1154944"