Releases/Firefox 40/Test Plan/Beta/2

From MozillaWiki
Jump to: navigation, search

«  Firefox 40 Beta 1 | Firefox 40 Beta 2 | Firefox 40 Beta 3  »

Firefox 40 Beta 2 (build 1) Test Plan

QE recommendation regarding the quality of the build

Recommendation based on results from manual testing GOOD FOR RELEASE

Manual Testing summary - Platform Coverage and Areas Tested

  • Testing is performed around areas most affected by fixes since the previous Beta (in cases when there are no Regression tests to cover these areas, or those tests have already been run as part of the Full Beta Regression set)
  • Test Cases executed and results: report
Platform Assignee Results: report
Windows 7 x64 (Intel HD Graphics 2500) Petruta Rasa [DONE]
Windows 8.1 x86 (ATI Radeon 3000) Vasilica Mihasca [DONE]
Mac OS X 10.10.4 (Intel Iris Pro 1024 MB) Cornel Ionce [DONE]
Ubuntu 14.04 x64 (ATI Radeon 3000) Andrei Vaida [DONE]
Tested Area Testing Type Results
BROWSER CUSTOMIZATION Regression Testing PASS
EME Regression Testing PASS

Features

See the Feature Release Tracking gdoc for a general overview


Feature Owner Status Details Test Plan
Async plugin init Catalin Varga [ON TRACK] Feature is in Beta 40, but still disabled by default - potential final QA sign-off at the end of Beta 40 -
First Run for 40 release Catalin Varga [NOT STARTED] New feature targeted for Firefox 40 (not yet implemented) - final QA sign-off at the end of Beta 40 -
Suggested tiles: Sponsored Cornel Ionce [ON TRACK] Feature dropped from Firefox 39 - final QA sign-off at the end of Beta 40 Test Plan
New Add-on Signing Vasilica Mihasca [ON TRACK] Feature dropped from Firefox 39 (not enough add-ons signed) - final QA sign-off at the end of Beta 40 -
Unified telemetry/FHR - [AT RISK] New feature targeted for Firefox 40 (no testing details received yet) - potential final QA sign-off at the end of Beta 40 -
OMTC by default on Linux Alexandra Lucinet [ON TRACK] New feature targeted for Firefox 40 - final QA sign-off at the end of Beta 40 -
Hello - Context Bogdan Maris [ON TRACK] New feature targeted for Firefox 40 - final QA sign-off at the end of Beta 40 -

Results

New bugs

Full Query
ID Summary Status Resolution
1181059 Intermittently, theme preview remains blocked NEW
1181060 Themes 2row titles are overlapped by the "+ Add" button on hover VERIFIED FIXED

2 Total; 1 Open (50%); 0 Resolved (0%); 1 Verified (50%);


Known Issues - also seen in previous builds

Major issues also seen in previous builds

    NONE     

Low impact issues also seen in previous builds

Full Query
ID Summary Status Resolution
962560 Audio volume UI resets to full volume after toggling the screen size of a video RESOLVED FIXED
972658 Undo 'restore defaults' does not restore toolbar visibility (bookmarks / menu toolbar ) NEW
1008178 Intermittently, mouse-over on personas doesn't preview the themes RESOLVED INACTIVE
1144722 Hello button cannot be positioned at the top of Menu panel RESOLVED INCOMPLETE
1177382 Error is thrown by controller.jsm each time a URL is dragged onto the Bookmarks Toolbar RESOLVED FIXED
1179739 Errors are thrown in the Browser Console each time the user enters Customize RESOLVED DUPLICATE

6 Total; 1 Open (16.67%); 5 Resolved (83.33%); 0 Verified (0%);


Branch Bug Fix Verifications

Full Query
ID Summary Status Resolution
1023604 Add HiDPI webrtc notification icons for Windows and Linux VERIFIED FIXED
1023607 Implement Windows HiDPI theme for other icons and tiny widgets VERIFIED FIXED
1153306 The Loop/Hello icon is blurry in HiDPI mode on Windows VERIFIED FIXED
1153309 Use a @2x menuPanel.png on Windows for basic hidpi support VERIFIED FIXED
1153529 Download indicator icon is blurry after clicking in HiDPI mode on Windows VERIFIED FIXED
1169981 listitem and treechildren have a radius and are no more flat after bug 1166867 VERIFIED FIXED
1173730 Use solid tab separator image on Windows 8 and 10 VERIFIED FIXED
1173736 Increase URL and search bar height and text size on Windows 10 VERIFIED FIXED
1173747 URL and search bar autocomplete popup's border should be lighter on Windows 10 VERIFIED FIXED
1173749 URLs in the URL bar's autocomplete popup should use a lighter blue VERIFIED FIXED
1176252 Use a white magnifying glass icon in the awesomebar when an entry is highlighted VERIFIED FIXED

11 Total; 0 Open (0%); 0 Resolved (0%); 11 Verified (100%);


Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed