Releases/Firefox 49/Test Plan/Beta/8: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(-)
 
m (-)
 
(One intermediate revision by the same user not shown)
Line 12: Line 12:
{| class="wikitable" width=50%
{| class="wikitable" width=50%
  ! Build 1
  ! Build 1
  | style="background:green; color:white; text-align:center;" | '''---'''
  | style="background:green; color:white; text-align:center;" | '''SHIP IT'''
|}
|}


== Manual Testing summary - Platform Coverage and Areas Tested ==
== Manual Testing summary - Platform Coverage and Areas Tested ==
* Testing performed around downloads, bookmarks and the PDF Viewer.
* Testing performed around downloads, bookmarks and the PDF Viewer.
* Test Cases executed and results: [https://testrail.stage.mozaws.net/index.php?/reports/view/## report]
* Test Cases executed and results: [https://testrail.stage.mozaws.net/index.php?/reports/view/47 report]


=== Build 1 ===
=== Build 1 ===
Line 25: Line 25:
  ! Build  architecture
  ! Build  architecture
  ! Assignee
  ! Assignee
  ! Results: [https://testrail.stage.mozaws.net/index.php?/reports/view/## report]
  ! Results: [https://testrail.stage.mozaws.net/index.php?/reports/view/47 report]
  |-
  |-
  | Windows XP SP3 x64 (##)
  | Windows XP SP3 x64 (AMD Radeon HD 7700)
  | 32-bit
  | 32-bit
  | Andrei Vaida
  | Andrei Vaida
  | style="text-align:center;" | {{mdone|}}
  | style="text-align:center;" | {{mdone|}}
  |-
  |-
  | Windows 7 x64 (##)
  | Windows 7 x64 (AMD 760G)
  | 64-bit
  | 64-bit
  | Ciprian Georgiu
  | Ciprian Georgiu
  | style="text-align:center;" | {{mdone|}}
  | style="text-align:center;" | {{mdone|}}
  |-
  |-
  | Mac OS X 10.10 (##)
  | Mac OS X 10.10 (Intel Iris Pro (1536 MB))
  | 64-bit
  | 64-bit
  | Mihai Boldan
  | Mihai Boldan
  | style="text-align:center;" | {{mdone|}}
  | style="text-align:center;" | {{mdone|}}
  |-
  |-
  | Ubuntu 14.04 x86 (##)
  | Ubuntu 14.04 x86 (AMD RS780)
  | 32-bit
  | 32-bit
  | Iulia Cristescu
  | Iulia Cristescu
Line 52: Line 52:
  ! Tested Area
  ! Tested Area
  ! Testing Type
  ! Testing Type
  ! [https://testrail.stage.mozaws.net/index.php?/reports/view/43 Results]
  ! [https://testrail.stage.mozaws.net/index.php?/reports/view/47 Results]
  |-
  |-
  | Downloads
  | Downloads
  | Exploratory Testing
  | Exploratory Testing
  | style="background:green; color: white; text-align:center;" | '''---'''
  | style="background:red; color: white; text-align:center;" | '''FAILED''' (reason: [https://bugzilla.mozilla.org/show_bug.cgi?id=1299170 1299170])
  |-
  |-
  | Bookmarks
  | Bookmarks
  | Smoke & Exploratory Testing
  | Smoke & Exploratory Testing
  | style="background:green; color: white; text-align:center;" | '''---'''
  | style="background:green; color: white; text-align:center;" | '''PASSED'''  
  |-
  |-
  | PDF Viewer
  | PDF Viewer
  | Smoke & Exploratory Testing
  | Smoke & Exploratory Testing
  | style="background:green; color: white; text-align:center;" | '''---'''
  | style="background:red; color: white; text-align:center;" | '''FAILED''' (reason [https://bugzilla.mozilla.org/show_bug.cgi?id=1299138 1299138])
  |-
  |-
  |}
  |}
Line 100: Line 100:


= Results =
= Results =
* [https://testrail.stage.mozaws.net/index.php?/reports/view/43 Found bugs - new and known]
* [https://testrail.stage.mozaws.net/index.php?/reports/view/47 Found bugs - new and known]


== New bugs ==  
== New bugs ==  
<bugzilla>
<bugzilla>
{
{
  "id":"",
  "id":"1299138, 1299170",
  "include_fields":"id,summary,status,resolution"
  "include_fields":"id,summary,status,resolution"
}
}
Line 122: Line 122:
<bugzilla>
<bugzilla>
{
{
  "id":"",
  "id":"839074, 1144124, 1161952, 1109080, 1037792, 1020271, 836732, 767382, 428378, 1253624, 432370",
  "include_fields":"id,summary,status,resolution"
  "include_fields":"id,summary,status,resolution"
}
}

Latest revision as of 15:02, 30 August 2016

«  Firefox 49 Beta 7 | Firefox 49 Beta 8 | Firefox 49 Beta 9 »

Firefox 49.0 Beta 8 Test Plan

QE recommendation regarding the quality of the build

  • Recommendation based on results from manual testing:
Build 1 SHIP IT

Manual Testing summary - Platform Coverage and Areas Tested

  • Testing performed around downloads, bookmarks and the PDF Viewer.
  • Test Cases executed and results: report

Build 1

Platform Build architecture Assignee Results: report
Windows XP SP3 x64 (AMD Radeon HD 7700) 32-bit Andrei Vaida [DONE]
Windows 7 x64 (AMD 760G) 64-bit Ciprian Georgiu [DONE]
Mac OS X 10.10 (Intel Iris Pro (1536 MB)) 64-bit Mihai Boldan [DONE]
Ubuntu 14.04 x86 (AMD RS780) 32-bit Iulia Cristescu [DONE]
Tested Area Testing Type Results
Downloads Exploratory Testing FAILED (reason: 1299170)
Bookmarks Smoke & Exploratory Testing PASSED
PDF Viewer Smoke & Exploratory Testing FAILED (reason 1299138)

Features

See the [1] gdoc for a general overview


Feature Owner Status Details Test Plan
Text to Speech on Desktop Camelia Badau [ON TRACK] Feature set to release with Firefox 49. Pre-release sign off currently in progress. Test Plan
Text to Speech in Reader View Camelia Badau [ON TRACK] Feature set to release with Firefox 49. Pre-release sign off currently in progress. Test Plan
Mac elevated updates Bogdan Maris [ON TRACK] Feature set to release with Firefox 49. Pre-release sign off currently in progress. Test Plan

Results

New bugs

Full Query
ID Summary Status Resolution
1299138 The Presentation mode button is missing from the PDF files VERIFIED FIXED
1299170 Malicious sample file is not blocked by Firefox RESOLVED WORKSFORME

2 Total; 0 Open (0%); 1 Resolved (50%); 1 Verified (50%);


Known Issues - also seen in previous builds

Major issues also seen in previous builds

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1


Low impact issues also seen in previous builds

Full Query
ID Summary Status Resolution
428378 Synced tabs, bookmarks, and history entries don't have a favicon until the user re-visits that page again REOPENED
432370 Drag and drop of root folders in Bookmarks Sidebar into other root folder will duplicate folders RESOLVED INACTIVE
767382 Clarify "Current view (copy or open in new window)" bookmark button tooltip RESOLVED FIXED
836732 Buttons in pdf.js remain in hover state after selection RESOLVED FIXED
839074 Selected text doesn't stay selected after zoom RESOLVED FIXED
1020271 Right Click on the "Current View" button offers the option to search for "Current View" RESOLVED WORKSFORME
1037792 Cannot scroll by dragging the scrollbar thumb after doing Ctrl+A (Select All) NEW
1109080 treeView.js:158 throws an error in the Browser Console after selecting 'Cut' the second time from the sidebar's contextual menu RESOLVED WORKSFORME
1144124 Select all in PDFs also selects text in the pdf.js UI NEW
1161952 [Ubuntu] Low quality when printing a pdf file RESOLVED WORKSFORME
1253624 When you want to cut and paste a bookmark from Bookmarks Toolbar, it will remain selected RESOLVED DUPLICATE

11 Total; 3 Open (27.27%); 8 Resolved (72.73%); 0 Verified (0%);


Branch Bug Fix Verifications

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed