Releases/Firefox 43/Test Plan/Beta/1

From MozillaWiki
Jump to: navigation, search

«  Firefox 42.0 RC build2 | Firefox 43 Beta 1 | Firefox 43 Beta 2  »

Firefox 43.0 Beta 1 (build 2) Test Plan

QE recommendation regarding the quality of the build

Recommendation based on results from manual testing GOOD FOR RELEASE

Manual Testing summary - Platform Coverage and Areas Tested

  • Testing is performed around new features that entered Beta 1: Add-on Signing, Search Suggestions, Unified Autocomplete
  • Test Cases executed and results: report
Platform Assignee Results: report
Windows 7 x86 (Intel HD 2500) Camelia Badau [DONE]
Windows 8 x64 (AMD Radeon HD 7700) Vasilica Mihasca [DONE]
Mac OS X 10.10.4 (Intel Iris Pro) Alexandra Lucinet [DONE]
Ubuntu 14.04 x86 (Intel HD 2500) Petruta Rasa [DONE]
Tested Area Testing Type Results
ADD-ON SIGNING Smoke Testing PASS
SEARCH SUGGESTIONS Smoke Testing PASS
UNIFIED AUTOCOMPLETE Smoke Testing PASS

Features

See the Feature Release Tracking gdoc for a general overview


Feature Owner Status Details Test Plan
New Add-on Signing Vasilica Mihasca [ON TRACK] Feature targeted for Firefox 43 - final QA sign-off at the end of Beta 43 Test Plan
Unified Autocomplete Petruta Rasa [ON TRACK] Feature targeted for Firefox 43 - final QA sign-off at the end of Beta 43 Test Plan
Search Suggestions Petruta Rasa [ON TRACK] Feature targeted for Firefox 43 - final QA sign-off at the end of Beta 43 ---
Windows on-screen keyboard Vasilica Mihasca [ON TRACK] Feature targeted for Firefox 43 - final QA sign-off at the end of Beta 43 ---

Results

New bugs

Full Query
ID Summary Status Resolution
1221489 Back button is enabled on FirstRun page RESOLVED FIXED
1221560 http://localhost/ on a machine with no webserver shows a blank page instead of a network error RESOLVED INVALID

2 Total; 0 Open (0%); 2 Resolved (100%); 0 Verified (0%);


Known Issues - also seen in previous builds

Major issues also seen in previous builds

    NONE     

Low impact issues also seen in previous builds

Full Query
ID Summary Status Resolution
591893 Undo or cancel the installation of add-ons in search pane doesn't list them anymore in "Available Add-ons" RESOLVED WONTFIX
1150218 Misaligned close button when there is more than one in new all-doorhanger flow for addons website install RESOLVED DUPLICATE
1157171 User does not have a chance to read the install confirmation doorhanger, if the extension opens a new Tab on startup RESOLVED WORKSFORME
1158067 Add-ons installed from about:addons search list does not follow the New UI Install flow RESOLVED WONTFIX
1163975 The incompatible add-on icon does not disappear from location bar RESOLVED WORKSFORME
1166754 Confusing approval message for add-on install process via drag&drop RESOLVED INACTIVE
1171148 Broken add-on install displayed in the add-ons manager after installs are cancelled by closing the original window/tab RESOLVED WONTFIX
1171359 Selecting "Not now" button which correspond with Restart option makes the add-on icon from location bar to disappear RESOLVED WONTFIX
1171636 Allow displaying multiple simultaneous add-on installs RESOLVED DUPLICATE
1172835 The warning triangle misses from “Some extensions could not be verified” button VERIFIED FIXED
1176664 [Mac] "Not now" option from Add-on Restart doorhanger is bigger than the other buttons RESOLVED WONTFIX
1186471 Highlighted result in the Awesomebar-results-pane flickers, when deleting letters from the Location-bar via Delete key RESOLVED WORKSFORME

12 Total; 0 Open (0%); 11 Resolved (91.67%); 1 Verified (8.33%);


Branch Bug Fix Verifications

Full Query
ID Summary Status Resolution
1139655 mouse over search engine changes search engine (too easy to inadvertently use different engine for searches) VERIFIED FIXED
1174141 [UX] Update Jump List icons VERIFIED FIXED
1192505 location bar suggestions disappear if mouse moves VERIFIED FIXED
1207542 The Control Center panel remains in focus after the user navigates to a previous page VERIFIED FIXED
1218157 Seeking forward during streaming audio causes unreasonable caching and glitches. VERIFIED FIXED

5 Total; 0 Open (0%); 0 Resolved (0%); 5 Verified (100%);

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed