Releases/Firefox 50/Test Plan: Difference between revisions

Releases/Firefox 50/Test Plan (view source)

Revision as of 21:53, 8 December 2016

3,159 bytes added , 8 December 2016

m

→‎Release Candidates

Florin.Mezei

Confirmed users

2,482

edits

@@ Line 447: / Line 447: @@
 * Manual - [https://wiki.mozilla.org/Releases/Firefox_50/Test_Plan/Beta/50.1.0 Firefox 50.1.0]
 ** {{mdone|}} Exploratory Testing with focus on: Web compatibility.
-*** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/reports/view/1533 in TestRail] (requires access rights) or [https://drive.google.com/open?id=xxxxxxxxx as a pdf].
+*** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/reports/view/1533 in TestRail] (requires access rights) or [https://drive.google.com/open?id=0BzOV3ybvBASXZHVjYzBUSnBrSFE as a pdf].
 ** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit?pli=1#gid=580110488 Bug verification]
 * Automated ([[QA/Desktop_Firefox/Releases/Configs/Fx50.1.0|configs]] for [http://mm-ci-production.qa.scl3.mozilla.com:8080/job/trigger-ondemand/build?delay=0sec ondemand])
-** {{mok|}} Updates on ''release-localtest'' channel ([https://treeherder.mozilla.org/#/jobs?repo=mozilla-release&revision=1a8bbd6f7e21&group_state=expanded&filter-tier=3&filter-searchStr=Fxup-release-localtest( report])
+** {{mdone|}} Updates on ''release-localtest'' channel ([https://treeherder.mozilla.org/#/jobs?repo=mozilla-release&revision=1a8bbd6f7e21&group_state=expanded&filter-tier=3&filter-searchStr=Fxup-release-localtest( report])
 ** {{mnotstarted|}} Updates on ''release-cdntest'' channel ([https://treeherder.mozilla.org/#/jobs?repo=mozilla-release&revision=1a8bbd6f7e21&group_state=expanded&filter-tier=3&filter-searchStr=Fxup-release-cdntest( report])
 ** {{mnotstarted|}} Updates on ''release'' channel ([https://treeherder.mozilla.org/#/jobs?repo=mozilla-release&revision=1a8bbd6f7e21&group_state=expanded&filter-tier=3&filter-searchStr=Fxup-release( report])
+** Throttle Testing (see [[QA/Desktop_Firefox/Walkthroughs/Release_Coordination#Update_Throttling|Walkthrough]] for details)
+*** Used commands:
+*** ./throttle.sh https://aus3.mozilla.org/update/3/Firefox/50.0.2/20161129200601/WINNT_x86-msvc/en-US/release/Windows_NT%206.3/default/default/update.xml
+*** ./throttle.sh https://aus3.mozilla.org/update/3/Firefox/50.0.2/20161129200601/WINNT_x86_64-msvc/en-US/release/Windows_NT%2010.0/default/default/update.xml
+*** ./throttle.sh https://aus3.mozilla.org/update/3/Firefox/50.0.2/20161129200601/Darwin_x86_64-gcc3-u-i386-x86_64/en-US/release/Darwin%2013.4.0/default/default/update.xml
+*** ./throttle.sh https://aus3.mozilla.org/update/3/Firefox/50.0.2/20161129200601/Linux_x86-gcc3/en-US/release/Linux%203.13.0-45-generic%20%28GTK%202.24.23%29/default/default/update.xml
+*** ./throttle.sh https://aus3.mozilla.org/update/3/Firefox/50.0.2/20161129200601/Linux_x86_64-gcc3/en-US/release/Linux%203.16.0-30-generic%20%28GTK%202.24.25%29/default/default/update.xml
+*** Results:
+**** After release push (expected to be @ 25%), 2016-12-13: '''Win32: % - Win64: % - Mac: % - Linux32: % - Linux64: %'''
+**** After disabling updates (expected to be @ 0%), 2016-12-14: '''Win32: % - Win64: % - Mac: % - Linux32: % - Linux64: %'''
+**** After fully enabling updates (expected to be @ 100%): 2016-12-16: '''Win32: % - Win64: % - Mac: % - Linux32: % - Linux64: %'''
+* '''Testing stopped as Build 2 is created to include fix for [https://bugzilla.mozilla.org/show_bug.cgi?id=1287912 bug 1287912]'''
+=== 50.1.0 Build 2 ===
+==== Build Information ====
+* Build 2: [https://archive.mozilla.org/pub/firefox/candidates/50.1.0-candidates/build2/ 50.1.0-build2] | [https://hg.mozilla.org/releases/mozilla-release/rev/xxxxxxxxxxxx xxxxxxxxxxxx] | (ID: 20161208xxxxxx)
+* Manual - [https://wiki.mozilla.org/Releases/Firefox_50/Test_Plan/Beta/50.1.0 Firefox 50.1.0]
+** {{mnotstarted|}} Exploratory Testing with focus on: Web compatibility (TBD).
+*** Detailed test results: [https://testrail.stage.mozaws.net/index.php?/reports/view/xxxx in TestRail] (requires access rights) or [https://drive.google.com/open?id=xxxxxxxxx as a pdf].
+** {{mnotstarted|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit?pli=1#gid=580110488 Bug verification]
+* Automated ([[QA/Desktop_Firefox/Releases/Configs/Fx50.1.0|configs]] for [http://mm-ci-production.qa.scl3.mozilla.com:8080/job/trigger-ondemand/build?delay=0sec ondemand])
+** {{mnotstarted|}} Updates on ''release-localtest'' channel ([https://treeherder.mozilla.org/#/jobs?repo=mozilla-release&revision=xxxxxxxxxxxx&group_state=expanded&filter-tier=3&filter-searchStr=Fxup-release-localtest( report])
+** {{mnotstarted|}} Updates on ''release-cdntest'' channel ([https://treeherder.mozilla.org/#/jobs?repo=mozilla-release&revision=xxxxxxxxxxxx&group_state=expanded&filter-tier=3&filter-searchStr=Fxup-release-cdntest( report])
+** {{mnotstarted|}} Updates on ''release'' channel ([https://treeherder.mozilla.org/#/jobs?repo=mozilla-release&revision=xxxxxxxxxxxx&group_state=expanded&filter-tier=3&filter-searchStr=Fxup-release( report])
 ** Throttle Testing (see [[QA/Desktop_Firefox/Walkthroughs/Release_Coordination#Update_Throttling|Walkthrough]] for details)
 *** Used commands: