Releases/Firefox 41/Test Plan/Beta/3

From MozillaWiki
Jump to: navigation, search

«  Firefox 41 Beta 2 | Firefox 41 Beta 3 | Firefox 41 Beta 4  »

Firefox 41.0 Beta 3 (build 1) Test Plan

QE recommendation regarding the quality of the build

Recommendation based on results from manual testing GOOD FOR RELEASE

Manual Testing summary - Platform Coverage and Areas Tested

  • * Testing is performed around areas most affected by fixes since the previous Beta, or areas that are mandatory to test in the Beta cycle
  • Test Cases executed and results: report
Platform Assignee Results: report
Windows 8.1 x64 (Intel HD 2500) Camelia Badau [DONE]
Windows 10 x86 (AMD Radeon HD 7700) Alexandra Lucinet [DONE]
Mac OS X 10.9.5 (Intel Iris Pro 1024 MB) Cornel Ionce [DONE]
Ubuntu 13.04 x86 (AMD Radeon HD 8500 Series) Paul Silaghi [DONE]
Tested Area Testing Type Results
VIDEO COMPATIBILITY Regression Testing CONDITIONAL PASS
AUDIO COMPATIBILITY Regression Testing PASS
SEARCH Regression Testing PASS

Features

See the Feature Release Tracking gdoc for a general overview


Feature Owner Status Details Test Plan
Async plugin init TBD (disabled in Fx 40 release) [AT RISK] Feature released in Beta 40, but disabled due to reported issues -
New Add-on Signing Vasilica Mihasca [ON TRACK] Feature dropped from Firefox 39 & 40 (not enough add-ons signed) - final QA sign-off at the end of Beta 41 Test Plan
Hello - Text Chat Bogdan Maris [ON TRACK] New feature targeted for Firefox 41 - final QA sign-off at the end of Beta 41 Test Plan
Unified telemetry/FHR Alexandra Lucinet [NOT STARTED] New feature targeted for Firefox 41 - final QA sign-off at the end of Beta 41 Test Plan

Results

New bugs

Full Query
ID Summary Status Resolution
1197160 Seeking forward on youtube switches from HTML5 to Flash RESOLVED DUPLICATE

1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);


Known Issues - also seen in previous builds

Major issues also seen in previous builds

Full Query
ID Summary Status Resolution
1196696 crash in mozilla::MediaFormatReader::DecoderData::ResetDemuxer() RESOLVED FIXED

1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);


Low impact issues also seen in previous builds

Full Query
ID Summary Status Resolution
962560 Audio volume UI resets to full volume after toggling the screen size of a video RESOLVED FIXED
974910 Controls bar is moved up for audio files played inline RESOLVED WORKSFORME
1010976 Hitting the "Hide Controls" option twice causes the container area to disappear VERIFIED FIXED
1142945 Always deny fullscreen should not be a possible input RESOLVED FIXED
1147363 [Youtube][HTML5] Settings set after having clicked "Next" are lost when exiting fullscreen RESOLVED WORKSFORME
1168101 Reader View icon is shown on some Youtube pages RESOLVED WORKSFORME
1176218 [Youtube][HTML5] 8K videos do not work at all, or Audio only VERIFIED FIXED
1182606 Context menu for video elements should check .mozHasAudio property NEW
1192169 Search Panel suggestion flickers when the last search term is deleted RESOLVED WORKSFORME
1192204 Scrollbar is overlapping the Quality entries via Youtube high resolution videos RESOLVED WORKSFORME

10 Total; 1 Open (10%); 7 Resolved (70%); 2 Verified (20%);


Branch Bug Fix Verifications

Full Query
ID Summary Status Resolution
1033090 crash in OOM | large | NS_ABORT_OOM(unsigned int) | AppendUTF8toUTF16(nsACString_internal const&, nsAString_internal&) VERIFIED FIXED
1150534 Favicons no longer displayed in jump list VERIFIED FIXED
1167652 Turn on extension signing requirements by default VERIFIED FIXED
1172282 Warning: Unknown pseudo-class or pseudo-element 'moz-any('. Ruleset ignored due to bad selector. VERIFIED FIXED
1172768 Tip for import contact(s) for loop is not correctly shown VERIFIED FIXED
1174030 [e10s] Spinner on Tab keeps spinning, page never load VERIFIED FIXED
1180417 Significant perf regression, Entering a lot of rows at once into a textarea is horrendously slow on FF compared to Chrome VERIFIED FIXED
1193764 Direct calls hang if the contact hasn't connected to the server at all VERIFIED FIXED
1193765 Share Link doesn't work from the user unavailable screen of direct calls VERIFIED FIXED

9 Total; 0 Open (0%); 0 Resolved (0%); 9 Verified (100%);


Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed