Releases/Firefox 54/Test Plan/Beta/4

From MozillaWiki
Jump to: navigation, search

«  Firefox 54 Beta 3 | Firefox 54 Beta 4 | Firefox 54 Beta 5 »

Firefox 54.0 Beta 4 Test Plan

QE recommendation regarding the quality of the build

  • Recommendation based on results from manual testing:
Build 1 SHIP IT

Manual Testing summary - Platform Coverage and Areas Tested

  • Testing performed on the following areas: Safe browsing, Download manager, Download protection.
  • Test Cases executed and results: report

Build 1

Platform GPU Build architecture Assignee Results: report
Windows 8.1 x86 AMD Radeon HD 7700 32-bit Mihai Boldan [DONE]
Windows 10 x64 Intel HD 5500 32-bit Camelia Badau [DONE]
macOS 10.12 Intel Iris Pro 64-bit Cristian Comorasu [DONE]
Ubuntu 16.04 x86 AMD Radeon HD 6450 32-bit Emil Ghitta [DONE]
Tested Area Testing Type Results
Safe browsing Smoke Testing YELLOW (Bug 1361288)
Download protection Smoke Testing GREEN
Download manager Smoke Testing GREEN

Features

See the [1] gdoc for a general overview

Feature Owner Status Sign off Details Test Plan
client-side stackwalking: ping sender Iulia Cristescu [ON TRACK] [NOT STARTED] on track Test Plan
Firefox Screenshots system add-on Iulia Cristescu [ON TRACK] [NOT STARTED] on track Test Plan
Download Panel UX Redesign Cristian Comorasu [ON TRACK] [NOT STARTED] on track Test Plan
Net Monitor MVP Ciprian Georgiu [ON TRACK] [NOT STARTED] on track Test Plan
ICE TCP Iulia Cristescu [ON TRACK] [NOT STARTED] on track ---
Flash async drawing Stefan Georgiev (Engineering QA) [AT RISK] [NOT STARTED] at risk per Trello Test Plan
Mobile bookmarks Kanchan Kumari (Engineering QA) [ON TRACK] [NOT STARTED] on track Test Plan

Results

New bugs

Full Query
ID Summary Status Resolution
1361288 The Advanced button from the "Unable to Connect Securely" neterror page is not working VERIFIED FIXED

1 Total; 0 Open (0%); 0 Resolved (0%); 1 Verified (100%);


Known Issues - also seen in previous builds

Major issues also seen in previous builds

Bugzilla query error

error, http-bad-status, Array


Low impact issues also seen in previous builds

Full Query
ID Summary Status Resolution
1126762 Open containing folder not working on paused downloads. NEW
1311671 Download panel glitches after clearing downloads from Library VERIFIED FIXED
1312020 Download Panel Glitches when removing an item from History VERIFIED FIXED
1312024 Visual notifications that indicate Pause / Resume are slow as download progress advances NEW
1348290 Pause contextual menu option is grayed out after cancelling and resuming a download RESOLVED INVALID

5 Total; 2 Open (40%); 1 Resolved (20%); 2 Verified (40%);


Branch Bug Fix Verifications

Full Query
ID Summary Status Resolution
1301056 [e10s] Link with target="_blank" to download a file leaves a about:blank window/tab open after the download VERIFIED FIXED
1325049 Global sharing indicator doesn't work correctly with e10s multi VERIFIED FIXED
1326626 Clicking background url doesn't work if devtools were initially opened in separate window VERIFIED FIXED
1329294 Windows content temp dir not in LocalLow for parent on new profile VERIFIED FIXED
1339155 Add device UI doesn't fit modal on Windows / Linux VERIFIED FIXED
1340885 crash in print preview [@ GetCorrectedParent ][@ nsFrame::DoGetParentStyleContext const ] VERIFIED FIXED
1350932 [Mac] BBC videos take too long to play or fails to play at all VERIFIED FIXED
1355340 mouse scroll slow, inaccurate, dropping ticks, jumping VERIFIED FIXED

8 Total; 0 Open (0%); 0 Resolved (0%); 8 Verified (100%);

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed