Releases/Firefox 44/Test Plan/Beta/RC

From MozillaWiki
Jump to: navigation, search

«  Firefox 44.0 Beta 9 | Firefox 44 RC

Firefox 44.0 RC Test Plan

QE recommendation regarding the quality of the build

  • Recommendation based on results from manual testing:
Build 1 GOOD FOR RELEASE
Build 2 CONDITIONAL SIGN OFF
Build 3 GOOD FOR RELEASE

Manual Testing summary - Platform Coverage and Areas Tested

Build 1

  • Testing performed around: Web Compatibility and the Location Bar.
  • Test Cases executed and results: report
Platform Build architecture Assignee Results: report
Windows 7 x64 (AMD Radeon HD 3000) 32-bit Alexandra Lucinet [DONE]
Windows 10 x86 (Intel HD 2500) 32-bit Mihai Boldan [DONE]
Mac OS X 10.9.5 (Intel Iris Pro 1024 MB) 64-bit Petruta Rasa [DONE]
Ubuntu 14.04 x86 (AMD Radeon HD 6450) 32-bit Bogdan Maris [DONE]
Tested Area Testing Type Results
WEB COMPATIBILITY Regression Testing PASS
LOCATION BAR Regression Testing PASS

Build 2

  • Testing performed around: Web Compatibility and Default Browser Settings.
  • Test Cases executed and results: report
Platform Build architecture Assignee Results: report
Windows 8.1 x64 (AMD Radeon HD 3000) 32-bit Alexandra Lucinet [DONE]
Windows 10 x86 (Intel HD 2500) 32-bit Mihai Boldan [DONE]
Mac OS X 10.9.5 (AMD Radeon HD 6630M) 64-bit Camelia Badau [DONE]
Ubuntu 14.04 x86 (AMD Radeon HD 6450) 32-bit Bogdan Maris [DONE]
Tested Area Testing Type Results
WEB COMPATIBILITY Regression Testing PASS
DEFAULT BROWSER SETTINGS Regression Testing FAIL

Build 3

  • Testing performed around: Web Compatibility.
  • Test Cases executed and results: report
Platform Build architecture Assignee Results: report
Windows 7 x64 (Intel HD 2500) 32-bit Mihai Boldan [DONE]
Windows 10 x86 (nVIDIA GeForce 620) 32-bit Cornel Ionce [DONE]
Mac OS X 10.9.5 (Intel Iris Pro) 64-bit Andrei Vaida [DONE]
Ubuntu 14.04 x86 (AMD Radeon HD 3000) 32-bit Alexandra Lucinet [DONE]
Tested Area Testing Type Results
WEB COMPATIBILITY Regression Testing PASS

Features

 n/a

See the Feature Release Tracking gdoc for a general overview


Results

New bugs

Build 1

Full Query
ID Summary Status Resolution
1240695 Flicker in Default Search Engine drop-down on deleting engines from about:preferences#search NEW
1240727 Capital letters keywords are not recognized when showing which of the search engine will be used in the next search VERIFIED FIXED
1240729 No favicon displayed for baidu.com in Search bar panel after adding the engine RESOLVED FIXED

3 Total; 1 Open (33.33%); 1 Resolved (33.33%); 1 Verified (33.33%);


Build 2

Full Query
ID Summary Status Resolution
1241471 [Ubuntu] Unable to make Firefox the default browser RESOLVED DUPLICATE
1241484 crash in mozilla::layers::TextureChild::WaitForCompositorRecycle | mozilla::layers::CanvasClientSharedSurface::Updated RESOLVED FIXED

2 Total; 0 Open (0%); 2 Resolved (100%); 0 Verified (0%);


Build 3

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);


Known Issues - also seen in previous builds

Major issues also seen in previous builds

Build 1

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);


Build 2

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);


Build 3

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);


Low impact issues also seen in previous builds

Build 1

Full Query
ID Summary Status Resolution
1168101 Reader View icon is shown on some Youtube pages RESOLVED WORKSFORME
1176218 [Youtube][HTML5] 8K videos do not work at all, or Audio only VERIFIED FIXED
1192169 Search Panel suggestion flickers when the last search term is deleted NEW
1192204 Scrollbar is overlapping the Quality entries via Youtube high resolution videos RESOLVED WORKSFORME
1194214 [HTML5] Several side effects using the context menu options on Youtube NEW
1210769 Glitches after opening images via flickr NEW
1224552 Awesome bar with search suggestions enabled flickers with some search engines RESOLVED WORKSFORME
1233359 Glitches after opening images in facebook NEW
1234513 Gif tweets not detaching from timeline properly at one click and comments are hidden RESOLVED FIXED

9 Total; 4 Open (44.44%); 4 Resolved (44.44%); 1 Verified (11.11%);


Build 2

Full Query
ID Summary Status Resolution
1176218 [Youtube][HTML5] 8K videos do not work at all, or Audio only VERIFIED FIXED
1191290 Glitches after opening images in tumblr NEW
1192204 Scrollbar is overlapping the Quality entries via Youtube high resolution videos RESOLVED WORKSFORME
1209499 Inactive sign in button on https://www.linkedin.com after credentials are autofilled NEW
1210769 Glitches after opening images via flickr NEW
1218746 Suppress "ERROR ClientID::getCachedClientID - invalid client id in preference" on fresh profiles RESOLVED FIXED
1233359 Glitches after opening images in facebook NEW
1234513 Gif tweets not detaching from timeline properly at one click and comments are hidden RESOLVED FIXED
1240729 No favicon displayed for baidu.com in Search bar panel after adding the engine RESOLVED FIXED

9 Total; 4 Open (44.44%); 4 Resolved (44.44%); 1 Verified (11.11%);


Build 3

Full Query
ID Summary Status Resolution
1096357 "Unable to run script because scripts are blocked internally" JS error appear in browser console while browsing google plus NEW
1176218 [Youtube][HTML5] 8K videos do not work at all, or Audio only VERIFIED FIXED
1191290 Glitches after opening images in tumblr NEW
1210769 Glitches after opening images via flickr NEW
1234513 Gif tweets not detaching from timeline properly at one click and comments are hidden RESOLVED FIXED

5 Total; 3 Open (60%); 1 Resolved (20%); 1 Verified (20%);


Branch Bug Fix Verifications

Build 1

Full Query
ID Summary Status Resolution
1110511 Implement about:tabcrashed spec VERIFIED FIXED
1202696 crash in _cairo_surface_get_extents VERIFIED FIXED
1239015 Stops working open a new tab from a search suggestion in locationbar(with Ctrl+click or with wheel mouse button) VERIFIED FIXED

3 Total; 0 Open (0%); 0 Resolved (0%); 3 Verified (100%);


Build 2

Full Query
ID Summary Status Resolution
1240528 Unable to read text on Linux notifications - blank, white bar displayed VERIFIED FIXED

1 Total; 0 Open (0%); 0 Resolved (0%); 1 Verified (100%);


Build 3

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);


Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed