Releases/Firefox 45/Test Plan/Beta/1

From MozillaWiki
Jump to: navigation, search

«  Firefox 44.0 RC | Firefox 45 Beta 1 | Firefox 45 Beta 2  »

Firefox 45.0 Beta 1 (build 1) Test Plan

QE recommendation regarding the quality of the build

  • Recommendation based on results from manual testing:
Build 1 GOOD FOR RELEASE


Manual Testing summary - Platform Coverage and Areas Tested

  • Testing performed around the new features in this version: Synced Tabs Menu, Text to Speech, Search Refactoring and Tab Groups Migration.
  • Test Cases executed and results: report
Platform Build architecture Assignee Results: report
Windows XP x86 (nVIDIA GeForce 620) 32-bit Cornel Ionce [DONE]
Windows 10 x64 (Intel HD 4400) 64-bit Vasilica Mihasca [DONE]
Mac OS X 10.9.5 (Intel Iris Pro 1536 MB) 64-bit Petruta Rasa [DONE]
Ubuntu 14.04 x64 (AMD Radeon HD 6450) 64-bit Bogdan Maris [DONE]
Tested Area Testing Type Results
SYNCED TABS MENU Smoke Testing PASS
TEXT TO SPEECH Smoke Testing CONDITIONAL PASS
SEARCH REFACTORING Smoke Testing PASS
TAB GROUPS MIGRATION Smoke Testing PASS

Features

See the Feature Release Tracking gdoc for a general overview


Feature Owner Status Details Test Plan
Text to Speech Camelia Badau [ON TRACK] Feature targeted for Firefox 45 - final QA sign-off at the end of Beta 45 Test Plan
Search Refactoring Petruta Rasa [ON TRACK] Feature targeted for Firefox 45 - final QA sign-off at the end of Beta 45 Test Plan
Tab Groups Migration Paul Silaghi [ON TRACK] Feature targeted for Firefox 45 - final QA sign-off at the end of Beta 45 Test Plan
Sync Tabs Menu Vasilica Mihasca [ON TRACK] Feature targeted for Firefox 45 - final QA sign-off at the end of Beta 45 Test Plan


Results

New bugs

Full Query
ID Summary Status Resolution
1243712 crash in XUL@0x17555ec | _dispatch_client_callout RESOLVED WONTFIX
1243753 Hand tool not displayed while hovering over Sign in to Sync from Sync tabs panel RESOLVED WONTFIX

2 Total; 0 Open (0%); 2 Resolved (100%); 0 Verified (0%);


Known Issues - also seen in previous builds

Major issues also seen in previous builds

Full Query
ID Summary Status Resolution
1230428 Crash [@ SpeechTaskCallback::OnWillSpeakWord] RESOLVED FIXED
1241851 “Fetching Synced Tabs” panel is continuously displayed VERIFIED FIXED

2 Total; 0 Open (0%); 1 Resolved (50%); 1 Verified (50%);


Low impact issues also seen in previous builds

Full Query
ID Summary Status Resolution
428378 Synced tabs, bookmarks, and history entries don't have a favicon until the user re-visits that page again NEW
1211485 Default search engine can still be set as default using the contextual menu VERIFIED FIXED
1221443 Speech synthesis doesn't stop when tab is muted NEW
1230533 Speech synthesis doesn't stop when the page is reloaded VERIFIED FIXED
1234205 Synced tabs icon needs inverted variant for menuPanel VERIFIED FIXED
1237941 Synced Tabs panel only shows up to 15 tabs from each remote device VERIFIED FIXED
1237942 Android and iOS links are not opened using the mouse wheel RESOLVED WORKSFORME
1237945 Synced Tabs panel is not closed while Android/iOS pages are opened VERIFIED FIXED
1238522 Intermittently, the speech synthesis doesn't start after changing the Pitch VERIFIED FIXED
1238566 Synced Tabs signed out state is not visually centered VERIFIED FIXED
1240727 Capital letters keywords are not recognized when showing which of the search engine will be used in the next search VERIFIED FIXED
1240729 No favicon displayed for baidu.com in Search bar panel after adding the engine RESOLVED FIXED
1241141 Synced tabs panel height changes when it is accessed from History (Panel Menu) VERIFIED FIXED
1241431 [Ubuntu] Panel Menu is incorrectly positioned after accessing Synced Tabs RESOLVED FIXED
1241860 Interrupted line in “Synced tabs” panel RESOLVED FIXED

15 Total; 2 Open (13.33%); 4 Resolved (26.67%); 9 Verified (60%);


Branch Bug Fix Verifications

Bugzilla query error

error, http-bad-status, Array

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed