Releases/Firefox 52/Test Plan/Beta/5

From MozillaWiki
Jump to: navigation, search

«  Firefox 52 Beta 4 | Firefox 52 Beta 5 | Firefox 52 Beta 6 »

Firefox 52.0 Beta 5 Test Plan

QE recommendation regarding the quality of the build

  • Recommendation based on results from manual testing:
Build 1 SHIP IT

Manual Testing summary - Platform Coverage and Areas Tested

  • Testing performed around Geolocation, Search, and Bookmarks.
  • Test Cases executed and results: report

Build 1

Platform GPU Build architecture Assignee Results: report
Windows 8.1 x64 Intel HD 520 32-bit Mihai Boldan [DONE]
Windows 10 x64 Intel HD 2500 64-bit Petruta Rasa [DONE]
Mac OS X 10.11 Intel Iris Pro 1536 MB 64-bit Camelia Badau [DONE]
Ubuntu LTS x64 AMD Radeon HD 3000 64-bit Timea Zsoldos [DONE]
Tested Area Testing Type Results
Geolocation Smoke and Exploratory Testing PASS
Search Smoke and Exploratory Testing PASS
Bookmarks Smoke and Exploratory Testing PASS

Features

See the [1] gdoc for a general overview

Feature Owner Testing Sign off Details Test Plan
Touch events in APZ Petruta Rasa [ON TRACK] [NOT STARTED] Feature set to release with Firefox 52. Test Plan
New Responsive Design Mode Mihai Boldan [ON TRACK] [NOT STARTED] Feature set to release with Firefox 52. Test Plan
Partner Search Paul Silaghi [ON TRACK] [NOT STARTED] Feature set to release with Firefox 52. Test Plan
Device Permissions (Screen Sharing) Cornel Ionce [ON TRACK] [NOT STARTED] Feature set to release with Firefox 52. Test Plan
Skia Content for Windows (Compositor Process) Mihai Boldan [ON TRACK] [NOT STARTED] Feature set to release with Firefox 52. Test Plan
Ship DTMF support in Firefox Cornel Ionce [ON TRACK] [NOT STARTED] Feature set to release with Firefox 52. Test Plan
Restartless System Add-ons Alexandru Simonca, Cristian Comorasu [ON TRACK] [NOT STARTED] Feature set to release with Firefox 52. ---
CSS Grid, CSS Grid Inspector Bogdan Maris, Paul Silaghi [ON TRACK] [NOT STARTED] Feature set to release with Firefox 52. ---
mediaDevices.ondevicechange in MediaStream Alexandru Simonca [ON TRACK] [NOT STARTED] Feature set to release with Firefox 52. ---
Improvements to <select> element Petruta Rasa [ON TRACK] [NOT STARTED] Feature set to release with Firefox 52. ---
First-party isolation (Tor) Bogdan Maris (assisting only) [ON TRACK] --- Feature set to release with Firefox 52. Will not be signed off by our team. ---
Automatic Captive Portal detection Adrian Florinescu (Engineering QA) [ON TRACK] [NOT STARTED] Feature set to release with Firefox 52. ---
Insecure Password Manager Adrian Florinescu (Engineering QA) [ON TRACK] [NOT STARTED] Feature set to release with Firefox 52. ---

Results

New bugs

Full Query
ID Summary Status Resolution
1338549 "Open All in Tabs" should be unavailable when opening context menu on Recently Bookmarked section header and on other non-bookmark items (in both the main bookmarks menu and the bookmarks toolbar button menu) NEW

1 Total; 1 Open (100%); 0 Resolved (0%); 0 Verified (0%);


Known Issues - also seen in previous builds

Major issues also seen in previous builds

none  

Low impact issues also seen in previous builds

Full Query
ID Summary Status Resolution
428378 Synced tabs, bookmarks, and history entries don't have a favicon until the user re-visits that page again REOPENED
1043280 Bookmark animation not displayed when page is bookmarked from the Context Menu RESOLVED WORKSFORME
1143280 Android build fails with updated support library (22) and/or new API level (22) RESOLVED FIXED
1177382 Error is thrown by controller.jsm each time a URL is dragged onto the Bookmarks Toolbar RESOLVED FIXED
1209518 The pasted bookmark keeps the styling of a cut one VERIFIED FIXED
1247925 Glitches opening show all bookmarks folders from edit this bookmark RESOLVED INVALID
1249000 Using "load in sidebar" with bookmarks to about:reader URLs (pages in Reader mode) don't actually load in the sidebar RESOLVED WONTFIX
1264704 URL Bar loses its focus in about:home during search process RESOLVED WORKSFORME

8 Total; 1 Open (12.5%); 6 Resolved (75%); 1 Verified (12.5%);


Branch Bug Fix Verifications

Full Query
ID Summary Status Resolution
1311420 Consider notifications to users about plugin deprecation VERIFIED FIXED
1317167 Crash in nsContentUtils::IsCallerChrome when playing MP3 with media.autoplay.enabled=false VERIFIED FIXED
1320192 [a11y] Flash player crashes on 51.0b2 32bitwith e10s when Windows10 Narrator is activated RESOLVED FIXED
1323520 zh-CN Firefox should be using Google with no codes RESOLVED FIXED
1330998 NPAPI plugins can still be enabled in Nightly 53 VERIFIED FIXED

5 Total; 0 Open (0%); 2 Resolved (40%); 3 Verified (60%);

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed