Releases/Firefox 44/Test Plan/Beta/RC: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(2 intermediate revisions by the same user not shown)
Line 1: Line 1:
<small> « [[Releases/Firefox_44/Test_Plan/Beta/9 | Firefox 44.0 Beta 9 ]] | [[Releases/Firefox 44/Test Plan/Beta/RC | Firefox 44 RC (build 1)]] | [[Releases/Firefox 44/Test Plan/Beta/RC | Firefox 44.0 (build 2)]]  »</small>
<small> « [[Releases/Firefox_44/Test_Plan/Beta/9 | Firefox 44.0 Beta 9 ]] | [[Releases/Firefox 44/Test Plan/Beta/RC | Firefox 44 RC]] </small>


= Firefox 44.0 Beta 9 (build 1) Test Plan =
= Firefox 44.0 RC Test Plan =
* Release Week: Jan 11th, 2015. Plan is to ship this build on Friday, Jan 15th 2015 ([https://www.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Calendar])
* Release Week: Jan 18th, 2016. Plan is to ship this build on Friday, Jan 22nd 2016 ([https://www.google.com/calendar/embed?src=bW96aWxsYS5jb21fZGJxODRhbnI5aTh0Y25taGFiYXRzdHY1Y29AZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ Release Calendar])
* QA Contacts: [mailto:kairo@mozilla.com Robert Kaiser]; [mailto:florin.mezei@softvisioninc.eu Florin Mezei]; [mailto:andrei.vaida@softvision.ro Andrei Vaida]
* QA Contacts: [mailto:kairo@mozilla.com Robert Kaiser]; [mailto:florin.mezei@softvisioninc.eu Florin Mezei]; [mailto:andrei.vaida@softvision.ro Andrei Vaida]
* IRC: irc://irc.mozilla.org#qa ping kairo; FlorinMezei; avaida
* IRC: irc://irc.mozilla.org#qa ping kairo; FlorinMezei; avaida
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/44.0-candidates/build1/ 44.0-build1] | [https://hg.mozilla.org/releases/mozilla-release/rev/0000b160918f 0000b160918f] | (ID: 20160118143821)
* Build 1: [https://archive.mozilla.org/pub/firefox/candidates/44.0-candidates/build1/ 44.0-build1] | [https://hg.mozilla.org/releases/mozilla-release/rev/0000b160918f 0000b160918f] | (ID: 20160118143821)
* Build 2: [https://archive.mozilla.org/pub/firefox/candidates/44.0-candidates/build2/ 44.0-build2] | [https://hg.mozilla.org/releases/mozilla-release/rev/45a3e4181f46 45a3e4181f46] | (ID: 20160120154102)
* Build 3: [https://archive.mozilla.org/pub/firefox/candidates/44.0-candidates/build3/ 44.0-build3] | [https://hg.mozilla.org/releases/mozilla-release/rev/7eabe4d30cde 7eabe4d30cde] | (ID: 20160123151951)


== QE recommendation regarding the quality of the build ==
== QE recommendation regarding the quality of the build ==
Line 14: Line 16:
  | style="background:#9D9; text-align:center;" | '''GOOD FOR RELEASE'''
  | style="background:#9D9; text-align:center;" | '''GOOD FOR RELEASE'''
|}
|}
 
<onlyinclude>
{| class="wikitable" width=50%
! Build 2
| style="background:yellow; text-align:center;" | '''CONDITIONAL SIGN OFF'''
|}
<onlyinclude>
{| class="wikitable" width=50%
! Build 3
| style="background:#9D9; text-align:center;" | '''GOOD FOR RELEASE'''
|}


== Manual Testing summary - Platform Coverage and Areas Tested ==
== Manual Testing summary - Platform Coverage and Areas Tested ==
=== Build 1 ===
* Testing performed around: Web Compatibility and the Location Bar.
* Testing performed around: Web Compatibility and the Location Bar.
* Test Cases executed and results: [https://goo.gl/NPULSX report]
* Test Cases executed and results: [https://goo.gl/NPULSX report]
Line 59: Line 71:
  |-
  |-
  | LOCATION BAR
  | LOCATION BAR
| Regression Testing
| style="background:#9D9; text-align:center;" | PASS
|-
|}
=== Build 2 ===
* Testing performed around: Web Compatibility and Default Browser Settings.
* Test Cases executed and results: [https://goo.gl/SXqrji report]
{|class="wikitable" style="width:60%"
|-
| class="header" style="width:25%; text-align:center;" | Platform
| class="header" style="width:5%; text-align:center;" | Build  architecture
| class="header" style="width:20%; text-align:center;" | Assignee
| class="header" style="width:10%; text-align:center;" | Results: [https://goo.gl/SXqrji report]
|-
| Windows 8.1 x64 (AMD Radeon HD 3000)
| 32-bit
| Alexandra Lucinet
| style="text-align:center;" | {{mdone|}}
|-
| Windows 10 x86 (Intel HD 2500)
| 32-bit
| Mihai Boldan
| style="text-align:center;" | {{mdone|}}
|-
| Mac OS X 10.9.5 (AMD Radeon HD 6630M)
| 64-bit
| Camelia Badau
| style="text-align:center;" | {{mdone|}}
|-
| Ubuntu 14.04 x86 (AMD Radeon HD 6450)
| 32-bit
| Bogdan Maris
| style="text-align:center;" | {{mdone|}}
|}
{|class="wikitable" style="width:60%"
|-
| class="header" style="width:20%; text-align:center;" | Tested Area
| class="header" style="width:20%; text-align:center;" | Testing Type
| class="header" style="width:20%; text-align:center;" | Results
|-
| WEB COMPATIBILITY
| Regression Testing
| style="background:#9D9; text-align:center;" | PASS
|-
| DEFAULT BROWSER SETTINGS
| Regression Testing
| style="background:red; text-align:center;color:white;" | FAIL
|-
|}
=== Build 3 ===
* Testing performed around: Web Compatibility.
* Test Cases executed and results: [https://goo.gl/kkvvND report]
{|class="wikitable" style="width:60%"
|-
| class="header" style="width:25%; text-align:center;" | Platform
| class="header" style="width:5%; text-align:center;" | Build  architecture
| class="header" style="width:20%; text-align:center;" | Assignee
| class="header" style="width:10%; text-align:center;" | Results: [https://goo.gl/kkvvND report]
|-
| Windows 7 x64 (Intel HD 2500)
| 32-bit
| Mihai Boldan
| style="text-align:center;" | {{mdone|}}
|-
| Windows 10 x86 (nVIDIA GeForce 620)
| 32-bit
| Cornel Ionce
| style="text-align:center;" | {{mdone|}}
|-
| Mac OS X 10.9.5 (Intel Iris Pro)
| 64-bit
| Andrei Vaida
| style="text-align:center;" | {{mdone|}}
|-
| Ubuntu 14.04 x86 (AMD Radeon HD 3000)
| 32-bit
| Alexandra Lucinet
| style="text-align:center;" | {{mdone|}}
|}
{|class="wikitable" style="width:60%"
|-
| class="header" style="width:20%; text-align:center;" | Tested Area
| class="header" style="width:20%; text-align:center;" | Testing Type
| class="header" style="width:20%; text-align:center;" | Results
|-
| WEB COMPATIBILITY
  | Regression Testing
  | Regression Testing
  | style="background:#9D9; text-align:center;" | PASS
  | style="background:#9D9; text-align:center;" | PASS
Line 73: Line 177:


== New bugs ==  
== New bugs ==  
=== Build 1 ===
<bugzilla>
<bugzilla>
{
{
  "id":"1240727,1240695,1240729",
  "id":"1240727,1240695,1240729",
"include_fields":"id,summary,status,resolution"
}
</bugzilla>
=== Build 2 ===
<bugzilla>
{
"id":"1241484,1241471",
"include_fields":"id,summary,status,resolution"
}
</bugzilla>
=== Build 3 ===
<bugzilla>
{
"id":"",
  "include_fields":"id,summary,status,resolution"
  "include_fields":"id,summary,status,resolution"
}
}
Line 82: Line 203:
== Known Issues - also seen in previous builds ==  
== Known Issues - also seen in previous builds ==  
===''Major issues also seen in previous builds''===
===''Major issues also seen in previous builds''===
==== Build 1 ====
<bugzilla>
<bugzilla>
{
{
Line 88: Line 210:
}
}
</bugzilla>     
</bugzilla>     
==== Build 2 ====
<bugzilla>
{
"id":"",
"include_fields":"id,summary,status,resolution"
}
</bugzilla>
==== Build 3 ====
<bugzilla>
{
"id":"",
"include_fields":"id,summary,status,resolution"
}
</bugzilla>
    
    
===''Low impact issues also seen in previous builds''===
===''Low impact issues also seen in previous builds''===
==== Build 1 ====
<bugzilla>
<bugzilla>
{
{
  "id":"1224552,1192169,1234513,1233359,1192204,1176218,1168101,1210769,1194214",
  "id":"1224552,1192169,1234513,1233359,1192204,1176218,1168101,1210769,1194214",
"include_fields":"id,summary,status,resolution"
}
</bugzilla>
==== Build 2 ====
<bugzilla>
{
"id":"1218746,1240729,1233359,1176218,1192204,1209499,1191290,1234513,1210769",
"include_fields":"id,summary,status,resolution"
}
</bugzilla>
==== Build 3 ====
<bugzilla>
{
"id":"1191290,1210769,1234513,1176218,1096357",
  "include_fields":"id,summary,status,resolution"
  "include_fields":"id,summary,status,resolution"
}
}
Line 99: Line 254:
== Branch Bug Fix Verifications ==
== Branch Bug Fix Verifications ==
* '''[https://goo.gl/ayAet6  Firefox (44) Bugs]'''
* '''[https://goo.gl/ayAet6  Firefox (44) Bugs]'''
<blockquote>
=== Build 1 ===
<bugzilla>
<bugzilla>
{
{
Line 106: Line 261:
}
}
</bugzilla>
</bugzilla>
</blockquote>
 
=== Build 2 ===
<bugzilla>
{
"id":"1240528",
"include_fields":"id,summary,status,resolution"
}
</bugzilla>
 
=== Build 3 ===
<bugzilla>
{
"id":"",
"include_fields":"id,summary,status,resolution"
}
</bugzilla>


Status tags
Status tags

Latest revision as of 13:58, 25 January 2016

«  Firefox 44.0 Beta 9 | Firefox 44 RC

Firefox 44.0 RC Test Plan

QE recommendation regarding the quality of the build

  • Recommendation based on results from manual testing:
Build 1 GOOD FOR RELEASE
Build 2 CONDITIONAL SIGN OFF
Build 3 GOOD FOR RELEASE

Manual Testing summary - Platform Coverage and Areas Tested

Build 1

  • Testing performed around: Web Compatibility and the Location Bar.
  • Test Cases executed and results: report
Platform Build architecture Assignee Results: report
Windows 7 x64 (AMD Radeon HD 3000) 32-bit Alexandra Lucinet [DONE]
Windows 10 x86 (Intel HD 2500) 32-bit Mihai Boldan [DONE]
Mac OS X 10.9.5 (Intel Iris Pro 1024 MB) 64-bit Petruta Rasa [DONE]
Ubuntu 14.04 x86 (AMD Radeon HD 6450) 32-bit Bogdan Maris [DONE]
Tested Area Testing Type Results
WEB COMPATIBILITY Regression Testing PASS
LOCATION BAR Regression Testing PASS

Build 2

  • Testing performed around: Web Compatibility and Default Browser Settings.
  • Test Cases executed and results: report
Platform Build architecture Assignee Results: report
Windows 8.1 x64 (AMD Radeon HD 3000) 32-bit Alexandra Lucinet [DONE]
Windows 10 x86 (Intel HD 2500) 32-bit Mihai Boldan [DONE]
Mac OS X 10.9.5 (AMD Radeon HD 6630M) 64-bit Camelia Badau [DONE]
Ubuntu 14.04 x86 (AMD Radeon HD 6450) 32-bit Bogdan Maris [DONE]
Tested Area Testing Type Results
WEB COMPATIBILITY Regression Testing PASS
DEFAULT BROWSER SETTINGS Regression Testing FAIL

Build 3

  • Testing performed around: Web Compatibility.
  • Test Cases executed and results: report
Platform Build architecture Assignee Results: report
Windows 7 x64 (Intel HD 2500) 32-bit Mihai Boldan [DONE]
Windows 10 x86 (nVIDIA GeForce 620) 32-bit Cornel Ionce [DONE]
Mac OS X 10.9.5 (Intel Iris Pro) 64-bit Andrei Vaida [DONE]
Ubuntu 14.04 x86 (AMD Radeon HD 3000) 32-bit Alexandra Lucinet [DONE]
Tested Area Testing Type Results
WEB COMPATIBILITY Regression Testing PASS

Features

 n/a

See the Feature Release Tracking gdoc for a general overview


Results

New bugs

Build 1

Full Query
ID Summary Status Resolution
1240695 Flicker in Default Search Engine drop-down on deleting engines from about:preferences#search RESOLVED WORKSFORME
1240727 Capital letters keywords are not recognized when showing which of the search engine will be used in the next search VERIFIED FIXED
1240729 No favicon displayed for baidu.com in Search bar panel after adding the engine RESOLVED FIXED

3 Total; 0 Open (0%); 2 Resolved (66.67%); 1 Verified (33.33%);


Build 2

Full Query
ID Summary Status Resolution
1241471 [Ubuntu] Unable to make Firefox the default browser RESOLVED DUPLICATE
1241484 crash in mozilla::layers::TextureChild::WaitForCompositorRecycle | mozilla::layers::CanvasClientSharedSurface::Updated RESOLVED FIXED

2 Total; 0 Open (0%); 2 Resolved (100%); 0 Verified (0%);


Build 3

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1


Known Issues - also seen in previous builds

Major issues also seen in previous builds

Build 1

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1


Build 2

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1


Build 3

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1


Low impact issues also seen in previous builds

Build 1

Full Query
ID Summary Status Resolution
1168101 Reader View icon is shown on some Youtube pages RESOLVED WORKSFORME
1176218 [Youtube][HTML5] 8K videos do not work at all, or Audio only VERIFIED FIXED
1192169 Search Panel suggestion flickers when the last search term is deleted RESOLVED WORKSFORME
1192204 Scrollbar is overlapping the Quality entries via Youtube high resolution videos RESOLVED WORKSFORME
1194214 [HTML5] Several side effects using the context menu options on Youtube NEW
1210769 Glitches after opening images via flickr RESOLVED WORKSFORME
1224552 Awesome bar with search suggestions enabled flickers with some search engines RESOLVED WORKSFORME
1233359 Glitches after opening images in facebook NEW
1234513 Gif tweets not detaching from timeline properly at one click and comments are hidden RESOLVED FIXED

9 Total; 2 Open (22.22%); 6 Resolved (66.67%); 1 Verified (11.11%);


Build 2

Full Query
ID Summary Status Resolution
1176218 [Youtube][HTML5] 8K videos do not work at all, or Audio only VERIFIED FIXED
1191290 Glitches after opening images in tumblr RESOLVED WORKSFORME
1192204 Scrollbar is overlapping the Quality entries via Youtube high resolution videos RESOLVED WORKSFORME
1209499 Inactive sign in button on https://www.linkedin.com after credentials are autofilled RESOLVED WORKSFORME
1210769 Glitches after opening images via flickr RESOLVED WORKSFORME
1218746 Suppress "ERROR ClientID::getCachedClientID - invalid client id in preference" on fresh profiles RESOLVED FIXED
1233359 Glitches after opening images in facebook NEW
1234513 Gif tweets not detaching from timeline properly at one click and comments are hidden RESOLVED FIXED
1240729 No favicon displayed for baidu.com in Search bar panel after adding the engine RESOLVED FIXED

9 Total; 1 Open (11.11%); 7 Resolved (77.78%); 1 Verified (11.11%);


Build 3

Full Query
ID Summary Status Resolution
1096357 "Unable to run script because scripts are blocked internally" JS error appear in browser console while browsing facebook and youtube on MacOS RESOLVED INCOMPLETE
1176218 [Youtube][HTML5] 8K videos do not work at all, or Audio only VERIFIED FIXED
1191290 Glitches after opening images in tumblr RESOLVED WORKSFORME
1210769 Glitches after opening images via flickr RESOLVED WORKSFORME
1234513 Gif tweets not detaching from timeline properly at one click and comments are hidden RESOLVED FIXED

5 Total; 0 Open (0%); 4 Resolved (80%); 1 Verified (20%);


Branch Bug Fix Verifications

Build 1

Full Query
ID Summary Status Resolution
1110511 Implement about:tabcrashed spec VERIFIED FIXED
1202696 crash in _cairo_surface_get_extents VERIFIED FIXED
1239015 Stops working open a new tab from a search suggestion in locationbar(with Ctrl+click or with wheel mouse button) VERIFIED FIXED

3 Total; 0 Open (0%); 0 Resolved (0%); 3 Verified (100%);


Build 2

Full Query
ID Summary Status Resolution
1240528 Unable to read text on Linux notifications - blank, white bar displayed VERIFIED FIXED

1 Total; 0 Open (0%); 0 Resolved (0%); 1 Verified (100%);


Build 3

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1


Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed
Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_44/Test_Plan/Beta/RC&oldid=1114156"