Releases/Firefox 46/Test Plan/Beta/11: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(Created page with "<small> « Firefox 46 Beta 10 | Firefox 46 Beta 11 | Releases/Firefox 46/Test Plan/...")
 
 
(3 intermediate revisions by the same user not shown)
Line 1: Line 1:
<small> « [[Releases/Firefox 46/Test Plan/Beta/10 | Firefox 46 Beta 10 ]] | [[Releases/Firefox 46/Test Plan/Beta/11 | Firefox 46 Beta 11]]  | [[Releases/Firefox 46/Test Plan/Beta/RC | Firefox 46 RC]]  »</small>
<small> « [[Releases/Firefox 46/Test Plan/Beta/10 | Firefox 46 Beta 10 ]] | [[Releases/Firefox 46/Test Plan/Beta/11 | Firefox 46 Beta 11]]  | [[Releases/Firefox 46/Test Plan/Beta/RC1 | Firefox 46 RC1]]  »</small>


= Firefox 46.0 Beta 11 Test Plan =
= Firefox 46.0 Beta 11 Test Plan =
Line 12: Line 12:
{| class="wikitable" width=50%
{| class="wikitable" width=50%
  ! Build 1
  ! Build 1
  | style="background:green; color:white; text-align:center;" | '''SIGN-OFF'''
  | style="background:yellow; color:black; text-align:center;" | '''CONDITIONAL SIGN-OFF'''
|}
|}
** Because testing was done on Treeherder builds, later promoted to Beta 11
** Crash encountered for Video Playback tests


== Manual Testing summary - Platform Coverage and Areas Tested ==
== Manual Testing summary - Platform Coverage and Areas Tested ==
* Testing performed around: Sync, Default browser settings and Hello (Loop).  
* Testing performed around: Video playback.  
* Test Cases executed and results: [https://goo.gl/fSUC4i report]
* Test Cases executed and results: [https://docs.google.com/spreadsheets/d/1XIeNS_gl-PitOy-lzlPGoIo1dUBQjsfOAOWeCdqUb8c/edit?pref=2&pli=1#gid=276552732 report]


=== Build 1 ===
=== Build 1 ===
Line 25: Line 27:
  | class="header" style="width:5%; text-align:center;" | Build  architecture
  | class="header" style="width:5%; text-align:center;" | Build  architecture
  | class="header" style="width:20%; text-align:center;" | Assignee
  | class="header" style="width:20%; text-align:center;" | Assignee
  | class="header" style="width:10%; text-align:center;" | Results: [https://goo.gl/fSUC4i report]
  | class="header" style="width:10%; text-align:center;" | Results: [https://docs.google.com/spreadsheets/d/1XIeNS_gl-PitOy-lzlPGoIo1dUBQjsfOAOWeCdqUb8c/edit?pref=2&pli=1#gid=276552732 report]
  |-
  |-
  | Windows XP x64 (AMD Radeon HD 3000)
  | Windows 7 x64 (Intel HD 2500)
  | 32-bit
  | 64-bit
  | Cornel Ionce
  | Mihai Boldan
  | style="text-align:center;" | {{mdone|}}
  | style="text-align:center;" | {{mdone|}}
  |-
  |-
  | Windows 8.1 x86 (Intel HD 4400)
  | Windows 10 x64 (Intel HD 4600)
  | 32-bit
  | 32-bit
  | Iulia Cristescu
  | Iulia Cristescu
  | style="text-align:center;" | {{mdone|}}
  | style="text-align:center;" | {{mdone|}}
  |-
  |-
  | Mac OS X 10.8 (ATI Radeon HD 2400 XT)
  | Mac OS X 10.10 (AMD Radeon HD 6750M)
  | 64-bit
  | 64-bit
  | Mihai Boldan
  | Bogdan Maris
  | style="text-align:center;" | {{mdone|}}
  | style="text-align:center;" | {{mdone|}}
  |-
  |-
  | Ubuntu 12.04 x64 (AMD Radeon HD 3000)
  | Ubuntu 12.04 x86 (NVidia GeForce 620)
  | 64-bit
  | 32-bit
  | Alexandra Lucinet
  | Paul Silaghi
  | style="text-align:center;" | {{mdone|}}
  | style="text-align:center;" | {{mdone|}}
  |}
  |}
Line 52: Line 54:
  | class="header" style="width:20%; text-align:center;" | Tested Area
  | class="header" style="width:20%; text-align:center;" | Tested Area
  | class="header" style="width:20%; text-align:center;" | Testing Type
  | class="header" style="width:20%; text-align:center;" | Testing Type
  | class="header" style="width:20%; text-align:center;" | [https://goo.gl/fSUC4i Results]
  | class="header" style="width:20%; text-align:center;" | [https://docs.google.com/spreadsheets/d/1XIeNS_gl-PitOy-lzlPGoIo1dUBQjsfOAOWeCdqUb8c/edit?pref=2&pli=1#gid=276552732 Results]
  |-
  |-
  | SYNC
  | Video Playback - bug 1255281
  | Regression Testing
  | Regression Testing
  | style="background:yellow; color:black; text-align:center;" | CONDITIONAL PASS
  | style="background:yellow; color:black; text-align:center;" | CONDITIONAL PASS
|-
| Default Browser
| Regression Testing
| style="background:green; color:white; text-align:center;" | PASS
|-
| Hello
| Regression Testing
| style="background:green; color:white; text-align:center;" | PASS
  |-
  |-
  |}
  |}
Line 93: Line 87:
<bugzilla>
<bugzilla>
{
{
  "id":"1263896, 1263897",
  "id":"1264969",
  "include_fields":"id,summary,status,resolution"
  "include_fields":"id,summary,status,resolution"
}
}
Line 110: Line 104:
<bugzilla>
<bugzilla>
{
{
  "id":"1195569, 1238940, 428378, 1238955, 1238961, 1238960, 1206736, 1246148, 1229749, 1246138, 1209048, 1257846, 1263124, 1261849, 1257834, 1252439, 1262821, 1261753, 1093856, 1221980, 1261845",
  "id":"468855,962560,1010976,1124171,1192204,1194214,1194358,1241875",
  "include_fields":"id,summary,status,resolution"
  "include_fields":"id,summary,status,resolution"
}
}
Line 120: Line 114:
<bugzilla>
<bugzilla>
{
{
  "id":"1251431,1168263",
  "id":"1255281,1259811",
  "include_fields":"id,summary,status,resolution"
  "include_fields":"id,summary,status,resolution"
}
}

Latest revision as of 09:15, 19 April 2016

«  Firefox 46 Beta 10 | Firefox 46 Beta 11 | Firefox 46 RC1  »

Firefox 46.0 Beta 11 Test Plan

QE recommendation regarding the quality of the build

  • Recommendation based on results from manual testing:
Build 1 CONDITIONAL SIGN-OFF
    • Because testing was done on Treeherder builds, later promoted to Beta 11
    • Crash encountered for Video Playback tests

Manual Testing summary - Platform Coverage and Areas Tested

  • Testing performed around: Video playback.
  • Test Cases executed and results: report

Build 1

Platform Build architecture Assignee Results: report
Windows 7 x64 (Intel HD 2500) 64-bit Mihai Boldan [DONE]
Windows 10 x64 (Intel HD 4600) 32-bit Iulia Cristescu [DONE]
Mac OS X 10.10 (AMD Radeon HD 6750M) 64-bit Bogdan Maris [DONE]
Ubuntu 12.04 x86 (NVidia GeForce 620) 32-bit Paul Silaghi [DONE]
Tested Area Testing Type Results
Video Playback - bug 1255281 Regression Testing CONDITIONAL PASS

Features

See the Feature Release Tracking gdoc for a general overview


Feature Owner Status Details Test Plan
APZ Petruta Rasa [YELLOW] Feature targeted for Firefox 47 - there won't be a pre-release sign off sent for this feature on Fx46 Test Plan

Results

New bugs

Full Query
ID Summary Status Resolution
1264969 crash in av_buffer_unref RESOLVED WORKSFORME

1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);


Known Issues - also seen in previous builds

Major issues also seen in previous builds

Full Query
ID Summary Status Resolution
1262280 "Attempt Limit Exceeded" on First Try When Creating an Account RESOLVED FIXED

1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);


Low impact issues also seen in previous builds

Full Query
ID Summary Status Resolution
468855 Bringing up a context-menu on a Flash video player pauses the video RESOLVED INCOMPLETE
962560 Audio volume UI resets to full volume after toggling the screen size of a video RESOLVED FIXED
1010976 Hitting the "Hide Controls" option twice causes the container area to disappear VERIFIED FIXED
1124171 Video and audio play speed resets to normal after pausing and resuming a recording RESOLVED WORKSFORME
1192204 Scrollbar is overlapping the Quality entries via Youtube high resolution videos RESOLVED WORKSFORME
1194214 [HTML5] Several side effects using the context menu options on Youtube NEW
1194358 OMTC causes multiple tab display refresh problems on Linux RESOLVED INCOMPLETE
1241875 crash in mozilla::layers::TextureClient::Destroy RESOLVED DUPLICATE

8 Total; 1 Open (12.5%); 6 Resolved (75%); 1 Verified (12.5%);


Branch Bug Fix Verifications

Full Query
ID Summary Status Resolution
1255281 Add pixman fast path for bilinear x888_8888_SRC RESOLVED FIXED
1259811 crash in @0x0 | mozilla::gl::GLContext::InitWithPrefix VERIFIED FIXED

2 Total; 0 Open (0%); 1 Resolved (50%); 1 Verified (50%);

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed
Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_46/Test_Plan/Beta/11&oldid=1128281"