Releases/Firefox 45/Test Plan/Beta/2: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(-)
 
m (-)
 
Line 5: Line 5:
* QA Contacts: [mailto:kairo@mozilla.com Robert Kaiser]; [mailto:florin.mezei@softvisioninc.eu Florin Mezei]; [mailto:andrei.vaida@softvision.ro Andrei Vaida]
* QA Contacts: [mailto:kairo@mozilla.com Robert Kaiser]; [mailto:florin.mezei@softvisioninc.eu Florin Mezei]; [mailto:andrei.vaida@softvision.ro Andrei Vaida]
* IRC: irc://irc.mozilla.org#qa ping kairo; FlorinMezei; avaida
* IRC: irc://irc.mozilla.org#qa ping kairo; FlorinMezei; avaida
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/45.0b2-candidates/build1/ 45.0b2-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/76fdbc5ce8ea 76fdbc5ce8ea] | (ID: 20160127070712)
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/45.0b2-candidates/build1/ 45.0b2-build1] | [https://hg.mozilla.org/releases/mozilla-beta/rev/6c89dbce18b2 6c89dbce18b2] | (ID: 20160201143558)


== QE recommendation regarding the quality of the build ==
== QE recommendation regarding the quality of the build ==
Line 12: Line 12:
{| class="wikitable" width=50%
{| class="wikitable" width=50%
  ! Build 1
  ! Build 1
  | style="background:#9D9; text-align:center;" | '''TBD'''
  | style="background:#9D9; text-align:center;" | '''GOOD FOR RELEASE'''
|}
|}


Line 27: Line 27:
  | class="header" style="width:10%; text-align:center;" | Results: [https://goo.gl/odifbM report]
  | class="header" style="width:10%; text-align:center;" | Results: [https://goo.gl/odifbM report]
  |-
  |-
  | Windows 76 x64 (AMD Radeon R7 200)
  | Windows 7 x64 (AMD Radeon R7 200)
  | 32-bit
  | 32-bit
  | Paul Silaghi
  | Paul Silaghi
  | style="text-align:center;" | {{mok|}}
  | style="text-align:center;" | {{mdone|}}
  |-
  |-
  | Windows 8 x86 (AMD Radeon HD 7700)
  | Windows 8 x86 (AMD Radeon HD 7700)
  | 32-bit
  | 32-bit
  | Mihai Boldan
  | Mihai Boldan
  | style="text-align:center;" | {{mok|}}
  | style="text-align:center;" | {{mdone|}}
  |-
  |-
  | Mac OS X 10.11.1 (Intel Iris Pro 1536 MB)
  | Mac OS X 10.11.1 (Intel Iris Pro 1536 MB)
  | 64-bit
  | 64-bit
  | Camelia Badau
  | Camelia Badau
  | style="text-align:center;" | {{mok|}}
  | style="text-align:center;" | {{mdone|}}
  |-
  |-
  | Ubuntu 12.04 x64 (Intel HD 4400)
  | Ubuntu 12.04 x64 (Intel HD 4400)
  | 64-bit
  | 64-bit
  | Vasilica Mihasca
  | Vasilica Mihasca
  | style="text-align:center;" | {{mok|}}
  | style="text-align:center;" | {{mdone|}}
  |}
  |}


Line 55: Line 55:
  |-
  |-
  | WEB COMPATIBILITY
  | WEB COMPATIBILITY
  | Smoke Testing
  | Regression Testing
  | style="background:#9D9; text-align:center;" | TBD
  | style="background:#9D9; text-align:center;" | PASS
  |-
  |-
  | VIDEO COMPATIBILITY
  | VIDEO COMPATIBILITY
  | Smoke Testing
  | Regression Testing
  | style="background:#ff9e3c; text-align:center;" | TBD
  | style="background:#9D9; text-align:center;" | PASS
  |-
  |-
  | CRASH REPORTER
  | CRASH REPORTER
  | Smoke Testing
  | Regression Testing
  | style="background:#9D9; text-align:center;" | TBD
  | style="background:#9D9; text-align:center;" | PASS
  |-
  |-
  |}
  |}
Line 121: Line 121:
<bugzilla>
<bugzilla>
{
{
  "id":" ",
  "id":"",
  "include_fields":"id,summary,status,resolution"
  "include_fields":"id,summary,status,resolution"
}
}
Line 129: Line 129:
<bugzilla>
<bugzilla>
{
{
  "id":" "
  "id":"1233359,1210769,1211892,1168101,1192204,1194241,962560,1194214,1240729,1176218,1182606,1234513,1124171"
}
}
</bugzilla>
</bugzilla>
Line 138: Line 138:
<bugzilla>
<bugzilla>
{
{
  "id":" ",
  "id":"1230668",
  "include_fields":"id,summary,status,resolution"
  "include_fields":"id,summary,status,resolution"
}
}

Latest revision as of 15:33, 2 February 2016

«  Firefox 45 Beta 1 | Firefox 45 Beta 2 | Firefox 45 Beta 3  »

Firefox 45.0 Beta 2 (build 1) Test Plan

QE recommendation regarding the quality of the build

  • Recommendation based on results from manual testing:
Build 1 GOOD FOR RELEASE


Manual Testing summary - Platform Coverage and Areas Tested

  • Testing performed around: Web Compatibility, Video Compatibility and the Crash Reporter.
  • Test Cases executed and results: report
Platform Build architecture Assignee Results: report
Windows 7 x64 (AMD Radeon R7 200) 32-bit Paul Silaghi [DONE]
Windows 8 x86 (AMD Radeon HD 7700) 32-bit Mihai Boldan [DONE]
Mac OS X 10.11.1 (Intel Iris Pro 1536 MB) 64-bit Camelia Badau [DONE]
Ubuntu 12.04 x64 (Intel HD 4400) 64-bit Vasilica Mihasca [DONE]
Tested Area Testing Type Results
WEB COMPATIBILITY Regression Testing PASS
VIDEO COMPATIBILITY Regression Testing PASS
CRASH REPORTER Regression Testing PASS

Features

See the Feature Release Tracking gdoc for a general overview


Feature Owner Status Details Test Plan
Text to Speech Camelia Badau [ON TRACK] Feature targeted for Firefox 45 - final QA sign-off at the end of Beta 45 Test Plan
Search Refactoring Petruta Rasa [ON TRACK] Feature targeted for Firefox 45 - final QA sign-off at the end of Beta 45 Test Plan
Tab Groups Migration Paul Silaghi [ON TRACK] Feature targeted for Firefox 45 - final QA sign-off at the end of Beta 45 Test Plan
Sync Tabs Menu Vasilica Mihasca [ON TRACK] Feature targeted for Firefox 45 - final QA sign-off at the end of Beta 45 Test Plan


Results

New bugs

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1


Known Issues - also seen in previous builds

Major issues also seen in previous builds

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1


Low impact issues also seen in previous builds

Full Query
ID Summary Priority Status
962560 Audio volume UI resets to full volume after toggling the screen size of a video -- RESOLVED
1124171 Video and audio play speed resets to normal after pausing and resuming a recording -- RESOLVED
1168101 Reader View icon is shown on some Youtube pages -- RESOLVED
1176218 [Youtube][HTML5] 8K videos do not work at all, or Audio only P3 VERIFIED
1182606 Context menu for video elements should check .mozHasAudio property -- NEW
1192204 Scrollbar is overlapping the Quality entries via Youtube high resolution videos -- RESOLVED
1194214 [HTML5] Several side effects using the context menu options on Youtube P5 NEW
1194241 [Ubuntu] Pause option is not displayed in context menu while the audio sample is played P3 RESOLVED
1210769 Glitches after opening images via flickr -- RESOLVED
1211892 [gtk3, Ubuntu] Borders/Separators thickness is too pronounced -- VERIFIED
1233359 Glitches after opening images in facebook -- NEW
1234513 Gif tweets not detaching from timeline properly at one click and comments are hidden -- RESOLVED
1240729 No favicon displayed for baidu.com in Search bar panel after adding the engine -- RESOLVED

13 Total; 3 Open (23.08%); 8 Resolved (61.54%); 2 Verified (15.38%);


Branch Bug Fix Verifications

Full Query
ID Summary Status Resolution
1230668 Heap-use-after-free [@ nsStyleContext::~nsStyleContext] VERIFIED FIXED

1 Total; 0 Open (0%); 0 Resolved (0%); 1 Verified (100%);

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed
Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_45/Test_Plan/Beta/2&oldid=1115436"