Releases/Firefox 49/Test Plan/Beta/49.0.2

From MozillaWiki
Jump to: navigation, search

«  Firefox 49.0.1 | Firefox 49.0.2 | Firefox 49.0.3 »

Firefox 49.0.2 Test Plan

QE recommendation regarding the quality of the build

  • Recommendation based on results from manual testing:
Build 1 DON'T SHIP IT
Build 2 SHIP IT

Manual Testing summary - Platform Coverage and Areas Tested

  • Build 1:
    • Testing performed around Web compatibility, Plug-in compatibility (Async Plug-in Rendering) and Graphics (DirectX compatibility).
    • Test Cases executed and results: report
  • Build 2:
    • Testing performed around Web compatibility.
    • Test Cases executed and results: report

Build 1

Platform Graphics Build architecture Assignee Results: report
Windows 7 x64 NVIDIA GeForce 210 32-bit Camelia Badau [DONE]
Windows 10 x64 Intel HD 4600 64-bit Iulia Cristescu [DONE]
Mac OS X 10.11.6 Intel Iris Pro (1536 MB) 64-bit Mihai Boldan [DONE]
Ubuntu 16.04 x64 Intel HD 520 64-bit Ciprian Georgiu [DONE]
Tested Area Testing Type Results
Web compatibility Smoke and Exploratory Testing PASSED
Plug-in compatibility (Async Plug-in Rendering) Smoke and Exploratory Testing FAILED
Graphics (DirectX compatibility) Smoke and Exploratory Testing FAILED

Build 2

Platform Graphics Build architecture Assignee Results: report
Windows 7 x64 NVIDIA GeForce 210 32-bit Camelia Badau [DONE]
Windows 10 x64 Intel HD 4600 64-bit Iulia Cristescu [DONE]
Mac OS X 10.11.6 Intel Iris Pro (1536 MB) 64-bit Mihai Boldan [DONE]
Ubuntu 16.04 x64 Intel HD 520 64-bit Ciprian Georgiu [DONE]
Tested Area Testing Type Results
Web compatibility Smoke and Exploratory Testing PASSED


Features

See the [1] gdoc for a general overview


Feature Owner Status Details Test Plan
Text to Speech on Desktop Camelia Badau [DONE] Feature set to release with Firefox 49. Pre-release sign off completed. Test Plan
Text to Speech in Reader View Camelia Badau [DONE] Feature set to release with Firefox 49. Pre-release sign off completed. Test Plan
Mac elevated updates Bogdan Maris [DONE] Feature set to release with Firefox 49. Pre-release sign off completed. Test Plan

Results

New bugs

  • Build 1:
Full Query
ID Summary Status Resolution
1311368 Video content is not always loaded on NASA Television VERIFIED FIXED
1311374 Video fails to update after exiting full screen and scrolling the video in and out of view RESOLVED WORKSFORME
1311381 [Windows] Calls and Video Calls can't be initiated on https://web.skype.com/ RESOLVED WONTFIX

3 Total; 0 Open (0%); 2 Resolved (66.67%); 1 Verified (33.33%);


  • Build 2:

Bugzilla query error

error, http-bad-status, Array


Known Issues - also seen in previous builds

Major issues also seen in previous builds

  • Build 1:

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);


  • Build 2:
Full Query
ID Summary Status Resolution
1311374 Video fails to update after exiting full screen and scrolling the video in and out of view RESOLVED WORKSFORME

1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);


Low impact issues also seen in previous builds

  • Build 1:
Full Query
ID Summary Status Resolution
1096357 "Unable to run script because scripts are blocked internally" JS error appear in browser console while browsing facebook and youtube on MacOS RESOLVED INCOMPLETE
1192204 Scrollbar is overlapping the Quality entries via Youtube high resolution videos RESOLVED WORKSFORME
1194214 [HTML5] Several side effects using the context menu options on Youtube NEW
1207567 [Ubuntu] Glitches when scrolling on pages with Flash content RESOLVED WORKSFORME
1210769 Glitches after opening images via flickr RESOLVED WORKSFORME
1230678 youtube shows black line 720p & 1080p videos in normal view mode VERIFIED FIXED
1233073 [Linux] Youtube videos have a short flicker while going into fullscreen VERIFIED FIXED
1233359 Glitches after opening images in facebook NEW
1300411 user reports excessive load spinning when switching tabs with e10s in 48.0.2 release RESOLVED WORKSFORME
1305028 gaming.youtube.com - The vertical scrollbar displayed for the main pane is partially overlapped by the video itself RESOLVED FIXED

10 Total; 2 Open (20%); 6 Resolved (60%); 2 Verified (20%);


  • Build 2:
Full Query
ID Summary Status Resolution
1096357 "Unable to run script because scripts are blocked internally" JS error appear in browser console while browsing facebook and youtube on MacOS RESOLVED INCOMPLETE
1191290 Glitches after opening images in tumblr RESOLVED WORKSFORME
1210769 Glitches after opening images via flickr RESOLVED WORKSFORME
1233073 [Linux] Youtube videos have a short flicker while going into fullscreen VERIFIED FIXED
1233359 Glitches after opening images in facebook NEW
1305028 gaming.youtube.com - The vertical scrollbar displayed for the main pane is partially overlapped by the video itself RESOLVED FIXED
1309534 Glitches when zoom in .jpg files from Wikipedia RESOLVED WORKSFORME
1311368 Video content is not always loaded on NASA Television VERIFIED FIXED
1616629 Unable to use a Matrix handle instead of IRC handle in my profile NEW

9 Total; 2 Open (22.22%); 5 Resolved (55.56%); 2 Verified (22.22%);


Branch Bug Fix Verifications

Full Query
ID Summary Status Resolution
1301518 Opus 255 channel mapping family not playable VERIFIED FIXED
1305436 Firefox 49 won't start after installation RESOLVED FIXED
1306472 No load event for iframe with javascript: URI that doesn't return a string VERIFIED FIXED

3 Total; 0 Open (0%); 1 Resolved (33.33%); 2 Verified (66.67%);

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed