Releases/Firefox 50/Test Plan/Beta/1

From MozillaWiki
Jump to: navigation, search

«  Firefox 49 RC3 | Firefox 50 Beta 1 | [[Releases/Firefox 50/Test Plan/Beta/2 | Firefox 50 Beta 2] »

Firefox 50.0 Beta 1 Test Plan

QE recommendation regarding the quality of the build

  • Recommendation based on results from manual testing:
Build 1 SHIP IT

Manual Testing summary - Platform Coverage and Areas Tested

  • Testing performed around the new features in this version: WebM EME support for Widevine and Pointer Lock API.
  • Test Cases executed and results: report

Build 1

Platform Build architecture Assignee Results: report
Windows 7 x64 (Intel HD 4600) 32-bit Iulia Cristescu [DONE]
Windows 10 x64 (Intel HD 530) 64-bit Cristian Comorasu [DONE]
Mac OS X 10.11 (Intel Iris Pro 1536 MB) 64-bit Camelia Badau [DONE]
Ubuntu 16.04 x64 (Intel HD 530) 64-bit Cornel Ionce [DONE]
Tested Area Testing Type Results
WebM EME support for Widevine Smoke and Exploratory Testing PASSED
Pointer Lock APi Smoke and Exploratory Testing PASSED

Features

See the [1] gdoc for a general overview


Feature Owner Status Details Test Plan
Windows Child Mode Iulia Cristescu [ON TRACK] Feature set to release with Firefox 50. Test Plan
Pointer Lock API Alexandru Simonca [ON TRACK] Feature set to release with Firefox 50. Test Plan
WebM EME support for Widevine Ciprian Georgiu [ON TRACK] Feature set to release with Firefox 50. Test Plan

Results

New bugs

Full Query
ID Summary Status Resolution
1304692 [Mac] PointerLock doesn't work properly while in Full Screen on MacBook Pro Retina RESOLVED FIXED

1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);


Known Issues - also seen in previous builds

Major issues also seen in previous builds

Bugzilla query error

error, http-bad-status, Array


Low impact issues also seen in previous builds

Full Query
ID Summary Status Resolution
713608 HTML5 Video controls are missing in Fullscreen NEW
853160 Mouse cursor can break outside the window bounds while pointer is locked with Pointer Lock API NEW
1124171 Video and audio play speed resets to normal after pausing and resuming a recording RESOLVED WORKSFORME
1254047 Pointer appears at the top-left corner of screen or window when exiting pointer lock NEW
1287104 PointerLock demo can't be enabled after changing focus RESOLVED WORKSFORME
1288692 After Web Console is opened - full screen is entered on a PointerLock demo instead of just entering PointerLock RESOLVED INVALID
1289403 [e10s] PointerLock works very slow on Nightly and Aurora with this site http://mdn.github.io/pointer-lock-demo/ VERIFIED FIXED
1298027 [EME] Video playback fails when page with EME video is moved into new window RESOLVED FIXED
1301423 [EME] Manually forwarding the video to it's end, gives an error which is thrown on top of the video NEW

9 Total; 4 Open (44.44%); 4 Resolved (44.44%); 1 Verified (11.11%);


Branch Bug Fix Verifications

Full Query
ID Summary Status Resolution
1200524 Using "Save Image as" on a large canvas doesn't work VERIFIED FIXED
1287827 Remove Firefox Hello from FF49 VERIFIED FIXED
1292048 Move Geometry editor icon to make it less confusing VERIFIED FIXED
1294480 inspector-searchbox focus behavior is gone VERIFIED FIXED
1301772 Turn on Insecure Password Warning in Firefox Beta VERIFIED FIXED
1303043 Missing tooltips in window host (dock buttons, frame chooser etc...) VERIFIED FIXED

6 Total; 0 Open (0%); 0 Resolved (0%); 6 Verified (100%);

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed