Latest revision as of 13:58, 25 January 2016

Firefox 44.0 RC Test Plan

Release Week: Jan 18th, 2016. Plan is to ship this build on Friday, Jan 22nd 2016 (Release Calendar)
QA Contacts: Robert Kaiser; Florin Mezei; Andrei Vaida
IRC: irc://irc.mozilla.org#qa ping kairo; FlorinMezei; avaida
Build 1: 44.0-build1 | 0000b160918f | (ID: 20160118143821)
Build 2: 44.0-build2 | 45a3e4181f46 | (ID: 20160120154102)
Build 3: 44.0-build3 | 7eabe4d30cde | (ID: 20160123151951)

QE recommendation regarding the quality of the build

Recommendation based on results from manual testing:

Build 1	GOOD FOR RELEASE

Build 2	CONDITIONAL SIGN OFF

Build 3	GOOD FOR RELEASE

Manual Testing summary - Platform Coverage and Areas Tested

Build 1

Testing performed around: Web Compatibility and the Location Bar.
Test Cases executed and results: report

Platform	Build architecture	Assignee	Results: report
Windows 7 x64 (AMD Radeon HD 3000)	32-bit	Alexandra Lucinet	[DONE]
Windows 10 x86 (Intel HD 2500)	32-bit	Mihai Boldan	[DONE]
Mac OS X 10.9.5 (Intel Iris Pro 1024 MB)	64-bit	Petruta Rasa	[DONE]
Ubuntu 14.04 x86 (AMD Radeon HD 6450)	32-bit	Bogdan Maris	[DONE]

Tested Area	Testing Type	Results
WEB COMPATIBILITY	Regression Testing	PASS
LOCATION BAR	Regression Testing	PASS

Build 2

Testing performed around: Web Compatibility and Default Browser Settings.
Test Cases executed and results: report

Platform	Build architecture	Assignee	Results: report
Windows 8.1 x64 (AMD Radeon HD 3000)	32-bit	Alexandra Lucinet	[DONE]
Windows 10 x86 (Intel HD 2500)	32-bit	Mihai Boldan	[DONE]
Mac OS X 10.9.5 (AMD Radeon HD 6630M)	64-bit	Camelia Badau	[DONE]
Ubuntu 14.04 x86 (AMD Radeon HD 6450)	32-bit	Bogdan Maris	[DONE]

Tested Area	Testing Type	Results
WEB COMPATIBILITY	Regression Testing	PASS
DEFAULT BROWSER SETTINGS	Regression Testing	FAIL

Build 3

Testing performed around: Web Compatibility.
Test Cases executed and results: report

Platform	Build architecture	Assignee	Results: report
Windows 7 x64 (Intel HD 2500)	32-bit	Mihai Boldan	[DONE]
Windows 10 x86 (nVIDIA GeForce 620)	32-bit	Cornel Ionce	[DONE]
Mac OS X 10.9.5 (Intel Iris Pro)	64-bit	Andrei Vaida	[DONE]
Ubuntu 14.04 x86 (AMD Radeon HD 3000)	32-bit	Alexandra Lucinet	[DONE]

Tested Area	Testing Type	Results
WEB COMPATIBILITY	Regression Testing	PASS

Features

n/a

See the Feature Release Tracking gdoc for a general overview

Results

Found bugs - new and known

New bugs

Build 1

Full Query

ID	Summary	Status	Resolution
1240695	Flicker in Default Search Engine drop-down on deleting engines from about:preferences#search	RESOLVED	WORKSFORME
1240727	Capital letters keywords are not recognized when showing which of the search engine will be used in the next search	VERIFIED	FIXED
1240729	No favicon displayed for baidu.com in Search bar panel after adding the engine	RESOLVED	FIXED

3 Total; 0 Open (0%); 2 Resolved (66.67%); 1 Verified (33.33%);

Build 2

Full Query

ID	Summary	Status	Resolution
1241471	[Ubuntu] Unable to make Firefox the default browser	RESOLVED	DUPLICATE
1241484	crash in mozilla::layers::TextureChild::WaitForCompositorRecycle \| mozilla::layers::CanvasClientSharedSurface::Updated	RESOLVED	FIXED

2 Total; 0 Open (0%); 2 Resolved (100%); 0 Verified (0%);

Build 3

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1

Known Issues - also seen in previous builds

Major issues also seen in previous builds

Build 1

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1

Build 2

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1

Build 3

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1

Low impact issues also seen in previous builds

Build 1

Full Query

ID	Summary	Status	Resolution
1168101	Reader View icon is shown on some Youtube pages	RESOLVED	WORKSFORME
1176218	[Youtube][HTML5] 8K videos do not work at all, or Audio only	VERIFIED	FIXED
1192169	Search Panel suggestion flickers when the last search term is deleted	RESOLVED	WORKSFORME
1192204	Scrollbar is overlapping the Quality entries via Youtube high resolution videos	RESOLVED	WORKSFORME
1194214	[HTML5] Several side effects using the context menu options on Youtube	NEW
1210769	Glitches after opening images via flickr	RESOLVED	WORKSFORME
1224552	Awesome bar with search suggestions enabled flickers with some search engines	RESOLVED	WORKSFORME
1233359	Glitches after opening images in facebook	NEW
1234513	Gif tweets not detaching from timeline properly at one click and comments are hidden	RESOLVED	FIXED

9 Total; 2 Open (22.22%); 6 Resolved (66.67%); 1 Verified (11.11%);

Build 2

Full Query

ID	Summary	Status	Resolution
1176218	[Youtube][HTML5] 8K videos do not work at all, or Audio only	VERIFIED	FIXED
1191290	Glitches after opening images in tumblr	RESOLVED	WORKSFORME
1192204	Scrollbar is overlapping the Quality entries via Youtube high resolution videos	RESOLVED	WORKSFORME
1209499	Inactive sign in button on https://www.linkedin.com after credentials are autofilled	RESOLVED	WORKSFORME
1210769	Glitches after opening images via flickr	RESOLVED	WORKSFORME
1218746	Suppress "ERROR ClientID::getCachedClientID - invalid client id in preference" on fresh profiles	RESOLVED	FIXED
1233359	Glitches after opening images in facebook	NEW
1234513	Gif tweets not detaching from timeline properly at one click and comments are hidden	RESOLVED	FIXED
1240729	No favicon displayed for baidu.com in Search bar panel after adding the engine	RESOLVED	FIXED

9 Total; 1 Open (11.11%); 7 Resolved (77.78%); 1 Verified (11.11%);

Build 3

Full Query

ID	Summary	Status	Resolution
1096357	"Unable to run script because scripts are blocked internally" JS error appear in browser console while browsing facebook and youtube on MacOS	RESOLVED	INCOMPLETE
1176218	[Youtube][HTML5] 8K videos do not work at all, or Audio only	VERIFIED	FIXED
1191290	Glitches after opening images in tumblr	RESOLVED	WORKSFORME
1210769	Glitches after opening images via flickr	RESOLVED	WORKSFORME
1234513	Gif tweets not detaching from timeline properly at one click and comments are hidden	RESOLVED	FIXED

5 Total; 0 Open (0%); 4 Resolved (80%); 1 Verified (20%);

Branch Bug Fix Verifications

Firefox (44) Bugs

Build 1

Full Query

ID	Summary	Status	Resolution
1110511	Implement about:tabcrashed spec	VERIFIED	FIXED
1202696	crash in _cairo_surface_get_extents	VERIFIED	FIXED
1239015	Stops working open a new tab from a search suggestion in locationbar(with Ctrl+click or with wheel mouse button)	VERIFIED	FIXED

3 Total; 0 Open (0%); 0 Resolved (0%); 3 Verified (100%);

Build 2

Full Query

ID	Summary	Status	Resolution
1240528	Unable to read text on Linux notifications - blank, white bar displayed	VERIFIED	FIXED

1 Total; 0 Open (0%); 0 Resolved (0%); 1 Verified (100%);

Build 3

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 400 [1] => Bad Request ) ) 1

Status tags

[NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
[ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
[DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
[AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
[IN PROGRESS] - {{mprog}} - actively being tested on
[INVESTIGATION NEEDED] - {{minvest}} - more investigation needed

@@ Line 7: / Line 7: @@
 * Build 1: [https://archive.mozilla.org/pub/firefox/candidates/44.0-candidates/build1/ 44.0-build1] | [https://hg.mozilla.org/releases/mozilla-release/rev/0000b160918f 0000b160918f] | (ID: 20160118143821)
 * Build 2: [https://archive.mozilla.org/pub/firefox/candidates/44.0-candidates/build2/ 44.0-build2] | [https://hg.mozilla.org/releases/mozilla-release/rev/45a3e4181f46 45a3e4181f46] | (ID: 20160120154102)
+* Build 3: [https://archive.mozilla.org/pub/firefox/candidates/44.0-candidates/build3/ 44.0-build3] | [https://hg.mozilla.org/releases/mozilla-release/rev/7eabe4d30cde 7eabe4d30cde] | (ID: 20160123151951)
 == QE recommendation regarding the quality of the build ==
@@ Line 15: / Line 16: @@
   | style="background:#9D9; text-align:center;" | '''GOOD FOR RELEASE'''
 |}
 <onlyinclude>
 {| class="wikitable" width=50%
@@ Line 21: / Line 21: @@
   | style="background:yellow; text-align:center;" | '''CONDITIONAL SIGN OFF'''
 |}
+<onlyinclude>
+{| class="wikitable" width=50%
+ ! Build 3
+ | style="background:#9D9; text-align:center;" | '''GOOD FOR RELEASE'''
+|}
 == Manual Testing summary - Platform Coverage and Areas Tested ==
@@ Line 117: / Line 121: @@
   | Regression Testing
   | style="background:red; text-align:center;color:white;" | FAIL
+ |-
+ |}
+=== Build 3 ===
+* Testing performed around: Web Compatibility.
+* Test Cases executed and results: [https://goo.gl/kkvvND report]
+{|class="wikitable" style="width:60%"
+ |-
+ | class="header" style="width:25%; text-align:center;" | Platform
+ | class="header" style="width:5%; text-align:center;" | Build  architecture
+ | class="header" style="width:20%; text-align:center;" | Assignee
+ | class="header" style="width:10%; text-align:center;" | Results: [https://goo.gl/kkvvND report]
+ |-
+ | Windows 7 x64 (Intel HD 2500)
+ | 32-bit
+ | Mihai Boldan
+ | style="text-align:center;" | {{mdone|}}
+ |-
+ | Windows 10 x86 (nVIDIA GeForce 620)
+ | 32-bit
+ | Cornel Ionce
+ | style="text-align:center;" | {{mdone|}}
+ |-
+ | Mac OS X 10.9.5 (Intel Iris Pro)
+ | 64-bit
+ | Andrei Vaida
+ | style="text-align:center;" | {{mdone|}}
+ |-
+ | Ubuntu 14.04 x86 (AMD Radeon HD 3000)
+ | 32-bit
+ | Alexandra Lucinet
+ | style="text-align:center;" | {{mdone|}}
+ |}
+{|class="wikitable" style="width:60%"
+ |-
+ | class="header" style="width:20%; text-align:center;" | Tested Area
+ | class="header" style="width:20%; text-align:center;" | Testing Type
+ | class="header" style="width:20%; text-align:center;" | Results
+ |-
+ | WEB COMPATIBILITY
+ | Regression Testing
+ | style="background:#9D9; text-align:center;" | PASS
   |-
   |}
@@ Line 141: / Line 189: @@
 {
   "id":"1241484,1241471",
+ "include_fields":"id,summary,status,resolution"
+}
+</bugzilla>
+=== Build 3 ===
+<bugzilla>
+{
+ "id":"",
   "include_fields":"id,summary,status,resolution"
 }
@@ Line 156: / Line 212: @@
 ==== Build 2 ====
+<bugzilla>
+{
+ "id":"",
+ "include_fields":"id,summary,status,resolution"
+}
+</bugzilla>
+==== Build 3 ====
 <bugzilla>
 {
@@ Line 176: / Line 240: @@
 {
   "id":"1218746,1240729,1233359,1176218,1192204,1209499,1191290,1234513,1210769",
+ "include_fields":"id,summary,status,resolution"
+}
+</bugzilla>
+==== Build 3 ====
+<bugzilla>
+{
+ "id":"1191290,1210769,1234513,1176218,1096357",
   "include_fields":"id,summary,status,resolution"
 }
@@ Line 194: / Line 266: @@
 {
   "id":"1240528",
+ "include_fields":"id,summary,status,resolution"
+}
+</bugzilla>
+=== Build 3 ===
+<bugzilla>
+{
+ "id":"",
   "include_fields":"id,summary,status,resolution"
 }

Releases/Firefox 44/Test Plan/Beta/RC: Difference between revisions

Latest revision as of 13:58, 25 January 2016

Contents

Firefox 44.0 RC Test Plan

QE recommendation regarding the quality of the build

Manual Testing summary - Platform Coverage and Areas Tested

Build 1

Build 2

Build 3

Features

Results

New bugs

Build 1

Build 2

Build 3

Bugzilla query error

Known Issues - also seen in previous builds

Major issues also seen in previous builds

Build 1

Bugzilla query error

Build 2

Bugzilla query error

Build 3

Bugzilla query error

Low impact issues also seen in previous builds

Build 1

Build 2

Build 3

Branch Bug Fix Verifications

Build 1

Build 2

Build 3

Bugzilla query error

Navigation menu

Releases/Firefox 44/Test Plan/Beta/RC: Difference between revisions

Latest revision as of 13:58, 25 January 2016

Firefox 44.0 RC Test Plan

QE recommendation regarding the quality of the build

Manual Testing summary - Platform Coverage and Areas Tested

Build 1

Build 2

Build 3

Features

Results

New bugs

Build 1

Build 2

Build 3

Bugzilla query error

Known Issues - also seen in previous builds

Major issues also seen in previous builds

Build 1

Bugzilla query error

Build 2

Bugzilla query error

Build 3

Bugzilla query error

Low impact issues also seen in previous builds

Build 1

Build 2

Build 3

Branch Bug Fix Verifications

Build 1

Build 2

Build 3

Bugzilla query error

Navigation menu

Search