Releases/Firefox 48/Test Plan/Beta/3

From MozillaWiki
< Releases‎ | Firefox 48/Test Plan
Revision as of 14:40, 24 June 2016 by Andrei.vaida (talk | contribs) (-)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

«  Firefox 48 Beta 2 | Firefox 48 Beta 3 | Firefox 48 Beta 4 »

Firefox 48.0 Beta 3 Test Plan

QE recommendation regarding the quality of the build

  • Recommendation based on results from manual testing:
Build 1 SHIP IT

Manual Testing summary - Platform Coverage and Areas Tested

  • Testing performed around: Audio Compatibility and Toolbar Customization.
  • Test Cases executed and results: report

Build 1

Platform Build architecture Assignee Results: report
Windows 7 x86 (NVIDIA GeForce 210) 32-bit Camelia Badau [DONE]
Windows 10 x64 (Intel HD 4600) 64-bit Iulia Cristescu [DONE]
Mac OS X 10.11 (Intel Iris Pro 1536 MB) 64-bit Bogdan Maris [DONE]
Ubuntu 14.04 LTS x86 (Intel HD 530) 64-bit Alexandru Simonca, Cristian Comorasu [DONE]
Tested Area Testing Type Results
AUDIO COMPATIBILITY Regression Testing PASS
TOOLBAR CUSTOMIZATION Regression Testing PASS

Features

See the [1] gdoc for a general overview


Feature Owner Status Details Test Plan
Windows Child Mode Iulia Cristescu [ON TRACK] Feature targeted for Firefox 48 - final QA sign-off at the end of Beta 48 Test Plan
New Awesomebar Cornel Ionce [ON TRACK] Feature targeted for Firefox 48 - final QA sign-off at the end of Beta 48 Test Plan

Results

New bugs

Full Query
ID Summary Status Resolution
1282075 Selecting the "Hide Controls" option causes the container area to disappear (for audio files played inline) NEW
1282082 Several side effects using the context menu options on https://www.yahoo.com/music/ VERIFIED FIXED

2 Total; 1 Open (50%); 0 Resolved (0%); 1 Verified (50%);


Known Issues - also seen in previous builds

Major issues also seen in previous builds

Bugzilla query error

Array ( [type] => error [message] => http-timed-out [params] => Array ( [0] => https://bugzilla.mozilla.org/bzapi/bug?id=&include_fields=id&include_fields=summary&include_fields=status&include_fields=resolution ) ) 1


Low impact issues also seen in previous builds

Bugzilla query error

Array ( [type] => error [message] => http-timed-out [params] => Array ( [0] => https://bugzilla.mozilla.org/bzapi/bug?id=1010976%2C+1194214%2C+1280642%2C+1061747%2C+1266073%2C+538844%2C+1253624%2C+972658%2C+1192204%2C+1176218%2C+1028850%2C+1194241%2C+1124171%2C+1223391%2C+974910%2C+1222970&include_fields=id&include_fields=summary&include_fields=status&include_fields=resolution ) ) 1


Branch Bug Fix Verifications

Full Query
ID Summary Status Resolution
1253959 [e10s] Various media tests timeout on WinXP debug RESOLVED FIXED
1277937 https has an underline instead of a strikethrough when mixed active content is loaded VERIFIED FIXED

2 Total; 0 Open (0%); 1 Resolved (50%); 1 Verified (50%);

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed