Releases/Firefox 40/Test Plan/Beta/RC2

From MozillaWiki
Jump to: navigation, search

«  Firefox 40 RC | Firefox 40 RC build 4 | Firefox 40 RC build 5  »

Firefox 40 RC (build 4) Test Plan

QE recommendation regarding the quality of the build

Recommendation based on results from manual testing GOOD FOR RELEASE


Manual Testing summary - Platform Coverage and Areas Tested

  • Testing is performed around areas most affected by fixes since the previous Beta (in cases when there are no Regression tests to cover these areas, or those tests have already been run as part of the Full Beta Regression set)
  • Test Cases executed and results: report

PLATFORM MATRIX

Platform Assignee Results: report
Windows 7 x64 (NVIDIA GeForce 210) Alexandra Lucinet [DONE]
Windows 8.1 x86 (AMD Radeon HD 5450) Catalin Varga [DONE]
Mac OS X 10.9.5 (Intel Iris Pro 1024 MB) Bogdan Maris [DONE]
Ubuntu 14.04 x64 (nVIDIA GeForce 620) Cornel Ionce [DONE]

AREAS TESTED

Tested Area Testing Type Results
PDF COMPATIBILITY Smoke Testing PASS
ADD-ON COMPATIBILITY Smoke Testing PASS
BROWSER CUSTOMIZATION (THEMES) Smoke Testing PASS
VIDEO COMPATIBILITY Smoke Testing CONDITIONAL PASS
AUDIO COMPATIBILITY Smoke Testing PASS
SEARCH Smoke Testing CONDITIONAL PASS

Features

See the Feature Release Tracking gdoc for a general overview


Feature Owner Status Details Test Plan
Async plugin init Catalin Varga [DONE] SIGNED OFF -
First Run for 40 release Catalin Varga [AT RISK] NO sign-off (helping with testing) - issues found during testing -
Suggested tiles: Sponsored Cornel Ionce [DONE] SIGNED OFF Test Plan
Suggested tiles: Affiliate Cornel Ionce [DONE] SIGNED OFF Test Plan
New Add-on Signing Vasilica Mihasca DROPPED FROM 40 Feature dropped from Firefox 39 & 40 (not enough add-ons signed) -
Unified telemetry/FHR Stuart Philp DROPPED FROM 40 Testing performed is tracked in bug 1169037 -
OMTC by default on Linux Alexandra Lucinet [DONE] SIGNED OFF -
Hello - Context Bogdan Maris [DONE] SIGNED OFF Test Plan
Windows 10 support Andrei Vaida / Cornel Ionce [AT RISK] New feature targeted for Firefox 40 - weekly status reports (NO final sign-off) -

Results

New bugs

Full Query
ID Summary Status Resolution
1192169 Search Panel suggestion flickers when the last search term is deleted NEW
1192204 Scrollbar is overlapping the Quality entries via Youtube high resolution videos RESOLVED WORKSFORME
1192221 [intermittent] Glitches visible via getUserMedia test page NEW

3 Total; 2 Open (66.67%); 1 Resolved (33.33%); 0 Verified (0%);


Known Issues - also seen in previous builds

Major issues also seen in previous builds

    NONE     

Low impact issues also seen in previous builds

Full Query
ID Summary Status Resolution
839074 With pdf.js enabled, selected text doesn't stay selected after zoom NEW
843218 pdf.js key binding for MAC RESOLVED INCOMPLETE
911131 Unable to print PDF from within the PDF viewer NEW
942130 360p max resolution for WebM HTML5 Videos on Youtube RESOLVED DUPLICATE
962560 Audio volume UI resets to full volume after toggling the screen size of a video RESOLVED FIXED
974910 Controls bar is moved up for audio files played inline NEW
1008178 Intermittently, mouse-over on personas doesn't preview the themes RESOLVED INACTIVE
1010976 Hitting the "Hide Controls" option twice causes the container area to disappear VERIFIED FIXED
1132860 Error printing when trying to print a pdf file after exiting 'Presentation Mode' NEW
1142945 Always deny fullscreen should not be a possible input RESOLVED FIXED
1143988 Make YouTube 360° videos work well RESOLVED WORKSFORME
1144124 Select all in pdf has strange behavior NEW
1157288 Printing PDF Causes "Unexpected Error" (Affected By Zoom Level) NEW
1159745 Firefox says mp3 is corrupt, but it downloads and plays just fine NEW
1168101 Reader View icon is shown on some Youtube pages RESOLVED WORKSFORME
1181060 Themes 2row titles are overlapped by the "+ Add" button on hover VERIFIED FIXED
1182606 Context menu for video elements should check .mozHasAudio property NEW
1186842 Unresponsive keyboard buttons using a PDF file VERIFIED FIXED
1191725 [HTML5] Some Youtube context menu options don't work in the new Controls UI RESOLVED WORKSFORME
1191827 Extra white space on top of the page after printing pdf NEW

20 Total; 9 Open (45%); 8 Resolved (40%); 3 Verified (15%);


Branch Bug Fix Verifications

Full Query
ID Summary Status Resolution
1191408 [zh-TW] Update Yahoo TW and add HK regional plugin RESOLVED FIXED

1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);


Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed