Releases/Firefox 72/Test Plan: Difference between revisions
| (37 intermediate revisions by 7 users not shown) | |||
| Line 1: | Line 1: | ||
= Summary = | = Summary = | ||
The purpose of this page is to track the testing of Firefox | The purpose of this page is to track the testing of Firefox 72 from Nightly to Release, and post Release if needed. | ||
== Release schedule == | == Release schedule == | ||
| Line 85: | Line 85: | ||
== QA activities == | == QA activities == | ||
=== New feature readiness === | === New feature readiness === | ||
All new features tested by QA and shipping with Firefox | All new features tested by QA and shipping with Firefox 72 are available [https://docs.google.com/spreadsheets/d/1px85HjaQHgpfq68bdMBbhusIsEZXmP_Ig3_KlAoyFRc/edit#gid=0 here]. | ||
The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here]. | The feature testing process followed by QA is available [https://wiki.mozilla.org/QA/Feature_Testing_v2 here]. | ||
| Line 160: | Line 160: | ||
<div style="font-weight:bold;line-height:1.6;">DevEd 72.0b4</div> | <div style="font-weight:bold;line-height:1.6;">DevEd 72.0b4</div> | ||
<div class="mw-collapsible-content"> | <div class="mw-collapsible-content"> | ||
* '''Build''': 72.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8919727c131ee5a5389d28f2f951b6c3ef9953e0 8919727c131ee5a5389d28f2f951b6c3ef9953e0], 20191206183317) - <font style="color:green; font-weight:bold;"> | * '''Build''': 72.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8919727c131ee5a5389d28f2f951b6c3ef9953e0 8919727c131ee5a5389d28f2f951b6c3ef9953e0], 20191206183317) - <font style="color:green; font-weight:bold;">GREEN</font> | ||
** '''Functional tests (manual)''': | ** '''Functional tests (manual)''': | ||
*** {{mdone|}} Smoke, Regression and Exploratory testing on '''Build Branding''' , '''Build Configuration''' , '''User Profile''' , '''Build interface''' , '''Build stability and functionality ''' , '''Sync''' , '''Default Browser''', '''Webextensions''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23408 TestRail] | *** {{mdone|}} Smoke, Regression and Exploratory testing on '''Build Branding''' , '''Build Configuration''' , '''User Profile''' , '''Build interface''' , '''Build stability and functionality ''' , '''Sync''' , '''Default Browser''', '''Webextensions''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23408 TestRail] | ||
| Line 171: | Line 171: | ||
* '''Build''': 72.0b1-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/fbd5649f1f88e90e56313ac26b9346af7115dccf fbd5649f1f88], 20191202142314) - <font style="color:green; font-weight:bold;">GREEN</font> | * '''Build''': 72.0b1-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/fbd5649f1f88e90e56313ac26b9346af7115dccf fbd5649f1f88], 20191202142314) - <font style="color:green; font-weight:bold;">GREEN</font> | ||
** '''Functional tests (manual)''': | ** '''Functional tests (manual)''': | ||
*** {{mdone|}} Smoke | *** {{mdone|}} Smoke testing on '''Installer''', '''Startup and Profile''' and '''Downloads''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22900 TestRail] | ||
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification] | *** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification] | ||
** '''Update tests (manual)''': | ** '''Update tests (manual)''': | ||
| Line 183: | Line 183: | ||
* '''Build''': 72.0b2-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/1157109d19758a726b282b24ab772fce98e5b3b4 1157109d1975], 20191203141951) - <font style="color:green; font-weight:bold;">GREEN</font> | * '''Build''': 72.0b2-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/1157109d19758a726b282b24ab772fce98e5b3b4 1157109d1975], 20191203141951) - <font style="color:green; font-weight:bold;">GREEN</font> | ||
** '''Functional tests (manual)''': | ** '''Functional tests (manual)''': | ||
*** {{mdone|}} Smoke | *** {{mdone|}} Smoke testing on '''Address Bar and Search''', '''Audio/Video''', '''Graphics''', '''Crash Reporting''' and '''Plug-ins''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/22990 TestRail] | ||
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification] | *** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification] | ||
** '''Update tests (manual)''': | ** '''Update tests (manual)''': | ||
| Line 195: | Line 195: | ||
* '''Build''': 72.0b3-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/229d39ef27112e05308a8cad984332724e0109e1 229d39ef2711], 20191205201734) - <font style="color:green; font-weight:bold;">GREEN</font> | * '''Build''': 72.0b3-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/229d39ef27112e05308a8cad984332724e0109e1 229d39ef2711], 20191205201734) - <font style="color:green; font-weight:bold;">GREEN</font> | ||
** '''Functional tests (manual)''': | ** '''Functional tests (manual)''': | ||
*** {{mdone|}} Smoke | *** {{mdone|}} Smoke testing on '''Uninstaller''' and '''Pocket New Tab''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23074 TestRail] | ||
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification] | *** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification] | ||
** '''Update tests (manual)''': | ** '''Update tests (manual)''': | ||
| Line 206: | Line 206: | ||
* '''Build''': 72.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8919727c131ee5a5389d28f2f951b6c3ef9953e0 229d39ef2711], 20191206183317) - <font style="color:green; font-weight:bold;">GREEN</font> | * '''Build''': 72.0b4-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/8919727c131ee5a5389d28f2f951b6c3ef9953e0 229d39ef2711], 20191206183317) - <font style="color:green; font-weight:bold;">GREEN</font> | ||
** '''Functional tests (manual)''': | ** '''Functional tests (manual)''': | ||
*** {{mdone|}} Smoke | *** {{mdone|}} Smoke testing on '''Security and Privacy''' ,'''Drag and Drop''', '''Scrolling, Panning and Zooming ''' and '''Geolocation''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23142 TestRail] | ||
*** {{mprog|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification] | *** {{mprog|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification] | ||
** '''Update tests (manual)''': | ** '''Update tests (manual)''': | ||
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1jGtZbkvb_WoaoWmDqgNkIoXCsJl3FVxkjiqIhaBBRv0/edit#gid=850719639 report] | *** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1jGtZbkvb_WoaoWmDqgNkIoXCsJl3FVxkjiqIhaBBRv0/edit#gid=850719639 report] | ||
</div></div> | |||
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"> | |||
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b5</div> | |||
<div class="mw-collapsible-content"> | |||
* '''Build''': 72.0b5-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/ebe06d4050d9c073aebc01e894c906c9b3e51230 ebe06d4050d9], 20191210230245) - <font style="color:green; font-weight:bold;">GREEN</font> | |||
** '''Functional tests (manual)''': | |||
*** {{mdone|}} Smoke testing on '''Security and Privacy''' ,'''Theme and Toolbar Customization''', '''PDF Viewer ''' and '''Images''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23440 TestRail] | |||
*** {{mprog|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification] | |||
** '''Update tests (manual)''': | |||
*** {{mprog|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1aYOgBr40UWzk45Roaa9y2AGBJVl6e4TN4ZutMqnNl-0/edit#gid=850719639 report] | |||
</div></div> | |||
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"> | |||
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b6</div> | |||
<div class="mw-collapsible-content"> | |||
* '''Build''': 72.0b6-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/baa895188e29e42b40da98720ed3d06a7970adb3 baa895188e29], 20191212210843) - <font style="color:green; font-weight:bold;">GREEN</font> | |||
** '''Functional tests (manual)''': | |||
*** {{mdone|}} Smoke testing on '''Printing''' ,'''Security and Privacy''', '''Browser Window ''' , '''Autocomplete & Autofill''' and '''Tab Bar options'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23550 TestRail] | |||
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=962766787 Bug fix verification] | |||
** '''Update tests (manual)''': | |||
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1eKyOXpDjoAWlsJcWbDt5jpd5NuzTDCzhYx7_vsZ3DQA/edit?usp=sharing report] | |||
</div></div> | |||
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"> | |||
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b7</div> | |||
<div class="mw-collapsible-content"> | |||
* '''Build''': 72.0b7-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/cd6d215cb8fa8d2aba4c4a105a0df668a22965cc cd6d215cb8fa], 20191213132525) - <font style="color:green; font-weight:bold;">GREEN</font> | |||
** '''Functional tests (manual)''': | |||
*** {{mdone|}} Smoke testing on '''Session Restore''' ,'''Bookmarks and History''' and '''Form Autofill''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23677 TestRail] | |||
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification] | |||
** '''Update tests (manual)''': | |||
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1C9Mi9eD03hZosmgEBs5pC7ryyahXLxwo-lNe-4mTF_E/edit#gid=850719639 report] | |||
</div></div> | |||
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"> | |||
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b8</div> | |||
<div class="mw-collapsible-content"> | |||
* '''Build''': 72.0b8-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/d54b88a700c047f6f0c7a680290df1eebb899f4f], 20191218033533) - <font style="color:green; font-weight:bold;">GREEN</font> | |||
** '''Functional tests (manual)''': | |||
*** {{mdone|}} Smoke testing on '''Form Autofill''' ,'''Password Manager''','''Preferences''' and '''OS Integration'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23729 TestRail] | |||
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification] | |||
** '''Update tests (manual)''': | |||
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1MyWMsLfn-mSCTbAF_5CwSx4-OELl1OFsdpTlBBN8RNo/edit#gid=850719639 report] | |||
</div></div> | |||
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"> | |||
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b9</div> | |||
<div class="mw-collapsible-content"> | |||
* '''Build''': 72.0b9-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/a15c8d0d512ed93453a712b8f83bdebe502fd64f a15c8d0d512e], 20191219234059) - <font style="color:green; font-weight:bold;">GREEN</font> | |||
** '''Functional tests (manual)''': | |||
*** {{mdone|}} Smoke testing on '''Password Manager''', '''Preferences''', '''Data Migration''' and '''Sync & Firefox Account'''→ [https://testrail.stage.mozaws.net/index.php?/plans/view/23831 TestRail] | |||
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification] | |||
** '''Update tests (manual)''': | |||
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/18d6_24vlXxFHvOLs_lMhxTgk7eGNLAPhJVdfCNVG9lo/edit#gid=850719639 report] | |||
</div></div> | |||
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"> | |||
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b10</div> | |||
<div class="mw-collapsible-content"> | |||
* '''Build''': 72.0b10-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/0941e84243b2 0941e84243b2], 20191221003008) - <font style="color:green; font-weight:bold;">GREEN</font> | |||
** '''Functional tests (manual)''': | |||
*** {{mdone|}} Smoke testing on '''OS Integration''', '''Notifications, Push Notifications and Alerts''' and '''Menus''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23624 TestRail] | |||
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification] | |||
** '''Update tests (manual)''': | |||
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1hiTb6ogb9wpGEdogo2qWseMzKbU3TclYuY8_TPolE0w/edit#gid=850719639 report] | |||
</div></div> | |||
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"> | |||
<div style="font-weight:bold;line-height:1.6;">Beta 72.0b11</div> | |||
<div class="mw-collapsible-content"> | |||
* '''Build''': 72.0b11-build1 ([https://hg.mozilla.org/releases/mozilla-beta/rev/d5822b0bc63d d5822b0bc63d], 20191227034945) - <font style="color:green; font-weight:bold;">GREEN</font> | |||
** '''Functional tests (manual)''': | |||
*** {{mdone|}} Smoke testing on '''Tabbed Browser''', '''Password Manager''' , '''Preferences''' , '''Menus''' and '''Firefox Screenshots''' → [https://testrail.stage.mozaws.net/index.php?/plans/view/23637 TestRail] | |||
*** {{mdone|}} [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug fix verification] | |||
** '''Update tests (manual)''': | |||
*** {{mdone|}} beta, aurora → [https://docs.google.com/spreadsheets/d/1af4R89RIjABPnU1bGXyKxoO7KMbp3uNZEmARxBPWH_0/edit#gid=850719639 report] | |||
</div></div> | |||
=== Release 72 build readiness === | |||
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"> | |||
<div style="font-weight:bold;line-height:1.6;">RC1 72.0</div> | |||
<div class="mw-collapsible-content"> | |||
* Build: 72.0-build2 ([https://https://hg.mozilla.org/releases/mozilla-release/rev/e3f0d87af6e18f61793650fabb96562d105a1f5d e3f0d87af6e18f61793650fabb96562d105a1f5d], 20191230161130) - <font style="color:green; font-weight:bold;">GREEN</font> | |||
*** {{mdone|}} Smoke, regression, exploratory → [https://testrail.stage.mozaws.net/index.php?/plans/view/23653 TestRail] | |||
*** {{mdone|}} Smoke testing on Ubuntu snap package → Installation | |||
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=1360074389 Bug list] | |||
** '''Update tests (manual)''': | |||
*** {{mdone|}} beta → [https://docs.google.com/spreadsheets/d/1cs5I8IgWNtZ8IR_oXQnWBJzRAX5d-TKKqNYFAI55Gfw/edit#gid=850719639 report] | |||
*** {{mdone|}} release-localtest → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report] | |||
*** {{mnotstarted|}} release-cdntest → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report] | |||
*** {{mnotstarted|}} release → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report] | |||
</div></div> | |||
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"> | |||
<div style="font-weight:bold;line-height:1.6;">RC2 72.0</div> | |||
<div class="mw-collapsible-content"> | |||
* Build: 72.0-build3 (https://hg.mozilla.org/releases/mozilla-release/rev/d88c5f2e59dccf2bfd345e66e548f2f245561a00 d88c5f2e59dccf2bfd345e66e548f2f245561a00], 20200102182448) - <font style="color:green; font-weight:bold;">GREEN</font> | |||
*** {{mdone|}} Smoke, regression, exploratory → [https://testrail.stage.mozaws.net/index.php?/plans/view/23975 TestRail] | |||
*** {{mdone|}} Smoke testing on Ubuntu snap package → Installation | |||
*** {{mdone|}} Bug fix verification – [https://docs.google.com/spreadsheets/d/12Dc8SHzJK5E4PoLzuCdsQ5DGx_oKLsajBCR3pm91RXA/edit#gid=914556339 Bug list] | |||
** '''Update tests (manual)''': | |||
*** {{notstarted|}} release-cdntest, beta-cdntest → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report] | |||
*** {{mdone|}} release → [https://drive.google.com/open?id=1750v087PYtfxaiev26WChcNnUYGHpUl4NWu9gIn786A report] | |||
</div></div> | |||
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"> | |||
<div style="font-weight:bold;line-height:1.6;">72.0.1</div> | |||
<div class="mw-collapsible-content"> | |||
* Build: 72.0.1-build1 ([https://hg.mozilla.org/releases/mozilla-release/rev/8260da04c9b1 8260da04c9b1], 20200107212822) - <font style="color:green; font-weight:bold;">GREEN</font> | |||
*** {{mdone|}} Smoke, regression, exploratory → [https://testrail.stage.mozaws.net/index.php?/plans/view/24161 TestRail] | |||
*** {{mdone|}} Smoke testing on Ubuntu snap package → Installation | |||
*** {{mdone|}} Bug fix verification – [https://bugzilla.mozilla.org/show_bug.cgi?id=1607443 Chempsill bug] | |||
** '''Update tests (manual)''': | |||
*** {{mdone|}} release-cdntest → [https://docs.google.com/spreadsheets/u/1/d/1U4qR2J3wh-ntiFZjtb-Fvct54Q2jO6M4Suj-NK0uoss/edit?usp=drive_web&ouid=1025689521899394819 report] | |||
*** {{mdone|}} release → [https://docs.google.com/spreadsheets/u/1/d/1U4qR2J3wh-ntiFZjtb-Fvct54Q2jO6M4Suj-NK0uoss/edit?usp=drive_web&ouid=1025689521899394819 report] | |||
</div></div> | |||
<div class="toccolours mw-collapsible mw-collapsed" style="width:auto; overflow:auto;"> | |||
<div style="font-weight:bold;line-height:1.6;">72.0.2</div> | |||
<div class="mw-collapsible-content"> | |||
* Build: 72.0.2-build1 ([https://hg.mozilla.org/releases/mozilla-release/rev/25e0edbb0a613c3bf794c93ba3aa0985d29d5ef4 25e0edbb0a613c3bf794c93ba3aa0985d29d5ef4], 20200117190643) - <font style="color:green; font-weight:bold;">GREEN</font> | |||
*** {{mdone|}} Smoke, regression, exploratory → [https://testrail.stage.mozaws.net/index.php?/plans/view/24655 TestRail] | |||
*** {{mdone|}} Smoke testing on Ubuntu snap package → Installation | |||
*** {{mdone|}} Bug fix verification – [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1601905%201602726%201604249%201604490%201607494%201608478&list_id=15077106 Driver bugs] | |||
** '''Update tests (manual)''': | |||
*** {{mdone|}} release-cdntest → [https://docs.google.com/spreadsheets/d/1b-z9PvqohA47-DiUUi9fZbDv8B_nxk2hUlyDjfhyqlw/edit#gid=850719639 report] | |||
*** {{mdone|}} release → [https://docs.google.com/spreadsheets/d/1b-z9PvqohA47-DiUUi9fZbDv8B_nxk2hUlyDjfhyqlw/edit#gid=850719639 report] | |||
</div></div> | </div></div> | ||
Latest revision as of 07:16, 21 January 2020
Summary
The purpose of this page is to track the testing of Firefox 72 from Nightly to Release, and post Release if needed.
Release schedule
- Release Scheduling calendar
- Rapid Release calendar
Status meetings
The Channel Status meeting is used to raise quality concerns with the Release Management team.
- When: every Tuesday (10:00 AM Pacific) and Thursday (08:00 AM Pacific)
- Where: ReleaseCoordination (Zoom)
- IRC backchannel: #planning
- Meeting notes: notes archive
QA points of contact
Communication channels
- Slack: #qa-coordination
Firefox for Desktop
- Reporting to: Tom Grabowski, Tania Maity
- Softvision Manager: Rares Bologa
- Team Leads: Brindusa Tot
- Offices: Romania (EEST), Argentina (GMT-3)
- Responsible for: new feature testing, Nightly build readiness, Nightly build regression testing, bug triage, bug verification, bug investigation
- Reporting to: Tom Grabowski, Tania Maity
- Softvision Manager: Andrei Vaida
- Team Leads: Bogdan Maris, Cornel Ionce
- Office: Romania (EEST)
- Responsible for: new feature testing, Beta build readiness, Developer Edition build readiness, ESR build readiness, RC build readiness, Dot release build readiness, Chemspill build readiness, bug verification, bug investigation
Firefox for Mobile
- Reporting to: No-Jun Park
- Softvision Manager: Ioana Chiorean
- Team Lead: Sorina Florean
- Office: Romania (EEST)
- Responsible for: todo
- Reporting to: No-Jun Park
- Softvision Manager: Ioana Chiorean
- Team Lead: Catalin Suciu
- Office: Romania (EEST)
- Responsible for: todo
AMO, WebExtensions
- Reporting to: Krupa Raj
- Softvision Manager: Rares Bologa
- Team Leads: Victor Carciu, Madalin Cotetiu
- Office: Romania (EEST)
- Responsible for: AMO feature testing, AMO weekly release, AMO Sanity, AMO bug verification, Webextensions features, Webextensions bug triage and verification, Telemetry
Experiments, Normandy, Subscription services, and other Firefox features
- Reporting to: Krupa Raj
- Softvision Manager: Rares Bologa
- Team Leads: Paul Oiegas
- Office: Romania (EEST)
- Responsible for: testing Experiments, Normandy, Experimenter website, Activity Stream, Screenshots, Send (Web & Android) and Lockbox Desktop.
QA activities
New feature readiness
All new features tested by QA and shipping with Firefox 72 are available here.
The feature testing process followed by QA is available here.
Bug fix verification
- Daily verification of uplifted bugs - these are uplifts, triaged daily and verified under ~48hrs
- Ongoing verification of Nightly bugs - this is the general bug verification done throughout the Nightly cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of
qe-verify?bugs - Ongoing verification of Beta bugs - this is the general bug verification done throughout the Beta cycle; it sometimes overlaps with uplifts verification; also involves active monitoring of
qe-verify?bugs - On-demand verification of bugs - these are special requests (ideally coming in through PI, but also through Bugzilla
needinfo?, chat or emails) - Periodical verification of security bugs - these are post-critsmash bugs, triaged and verified ~every 2wks
Unconfirmed bug triage
This is the triage conducted by Engineering QA.
Security bug triage
This is the post-CritSmash triage conducted by Engineering QA (on Nightly) and Release QA (on Beta, Release, ESR).
Bug investigation
This is the daily check and investigation of new regressionwindow-wanted bugs, conducted by Engineering QA and Release QA.
Nightly 72 milestones
[early/mid cycle] Nightly build readiness
Scope: assess build readiness for shipping to Beta by testing Nightly periodically and providing a list of issues (if any) that need to be addressed before the merge (more on this).
- Build: 72.0a1 (commit, ID) - NOT STARTED
- [DONE] Functional testing (manual) → report
- New bugs
- Regressions: --
- Non-regressions: --
- Known bugs
- High-impact: --
- Low/medium-impact: [link bug list]
- New bugs
- [DONE] Functional testing (manual) → report
- Build: 72.0a1 (commit, ID) - GREEN
- [DONE] Functional testing (manual) → report
- New bugs
- Regressions: --
- Non-regressions: --
- Known bugs
- High-impact: --
- Low/medium-impact: [link bug list]
- New bugs
- [DONE] Functional testing (manual) → report
[prior to merge] Nightly regression testing
- Build: 73.0a1 (commit, ID) - Sign off_Status
- [NOT STARTED] Regression testing (manual) → [report]
- New bugs
- Regressions: ID1, ID2, IDn
- Non-regressions: ID1, ID2, IDn
- Known bugs
- High-impact: ID1, ID2, IDn
- Low/medium-impact: [bug list]
- New bugs
- [NOT STARTED] Regression testing (manual) → [report]
[optional] [prior to merge] Nightly new feature smoke testing
Note: this is optional, based on available QA bandwidth.
Beta 72 milestones
Beta/DevEdition build readiness
Developer Edition build readiness
- Build: 72.0b4-build1 (8919727c131ee5a5389d28f2f951b6c3ef9953e0, 20191206183317) - GREEN
- Functional tests (manual):
- [DONE] Smoke, Regression and Exploratory testing on Build Branding , Build Configuration , User Profile , Build interface , Build stability and functionality , Sync , Default Browser, Webextensions → TestRail
- Functional tests (manual):
Beta build readiness
- Build: 72.0b1-build1 (fbd5649f1f88, 20191202142314) - GREEN
- Functional tests (manual):
- [DONE] Smoke testing on Installer, Startup and Profile and Downloads → TestRail
- [DONE] Bug fix verification
- Update tests (manual):
- Functional tests (manual):
- Build: 72.0b2-build1 (1157109d1975, 20191203141951) - GREEN
- Functional tests (manual):
- [DONE] Smoke testing on Address Bar and Search, Audio/Video, Graphics, Crash Reporting and Plug-ins → TestRail
- [DONE] Bug fix verification
- Update tests (manual):
- Functional tests (manual):
- Build: 72.0b3-build1 (229d39ef2711, 20191205201734) - GREEN
- Functional tests (manual):
- [DONE] Smoke testing on Uninstaller and Pocket New Tab → TestRail
- [DONE] Bug fix verification
- Update tests (manual):
- [DONE] beta, aurora → report
- Functional tests (manual):
- Build: 72.0b4-build1 (229d39ef2711, 20191206183317) - GREEN
- Functional tests (manual):
- [DONE] Smoke testing on Security and Privacy ,Drag and Drop, Scrolling, Panning and Zooming and Geolocation → TestRail
- [IN PROGRESS] Bug fix verification
- Update tests (manual):
- [DONE] beta, aurora → report
- Functional tests (manual):
- Build: 72.0b5-build1 (ebe06d4050d9, 20191210230245) - GREEN
- Functional tests (manual):
- [DONE] Smoke testing on Security and Privacy ,Theme and Toolbar Customization, PDF Viewer and Images → TestRail
- [IN PROGRESS] Bug fix verification
- Update tests (manual):
- [IN PROGRESS] beta, aurora → report
- Functional tests (manual):
- Build: 72.0b6-build1 (baa895188e29, 20191212210843) - GREEN
- Functional tests (manual):
- [DONE] Smoke testing on Printing ,Security and Privacy, Browser Window , Autocomplete & Autofill and Tab Bar options→ TestRail
- [DONE] Bug fix verification
- Update tests (manual):
- [DONE] beta, aurora → report
- Functional tests (manual):
- Build: 72.0b7-build1 (cd6d215cb8fa, 20191213132525) - GREEN
- Functional tests (manual):
- [DONE] Smoke testing on Session Restore ,Bookmarks and History and Form Autofill → TestRail
- [DONE] Bug fix verification
- Update tests (manual):
- [DONE] beta, aurora → report
- Functional tests (manual):
- Build: 72.0b8-build1 ([1], 20191218033533) - GREEN
- Functional tests (manual):
- [DONE] Smoke testing on Form Autofill ,Password Manager,Preferences and OS Integration→ TestRail
- [DONE] Bug fix verification
- Update tests (manual):
- [DONE] beta, aurora → report
- Functional tests (manual):
- Build: 72.0b9-build1 (a15c8d0d512e, 20191219234059) - GREEN
- Functional tests (manual):
- [DONE] Smoke testing on Password Manager, Preferences, Data Migration and Sync & Firefox Account→ TestRail
- [DONE] Bug fix verification
- Update tests (manual):
- [DONE] beta, aurora → report
- Functional tests (manual):
- Build: 72.0b10-build1 (0941e84243b2, 20191221003008) - GREEN
- Functional tests (manual):
- [DONE] Smoke testing on OS Integration, Notifications, Push Notifications and Alerts and Menus → TestRail
- [DONE] Bug fix verification
- Update tests (manual):
- [DONE] beta, aurora → report
- Functional tests (manual):
- Build: 72.0b11-build1 (d5822b0bc63d, 20191227034945) - GREEN
- Functional tests (manual):
- [DONE] Smoke testing on Tabbed Browser, Password Manager , Preferences , Menus and Firefox Screenshots → TestRail
- [DONE] Bug fix verification
- Update tests (manual):
- [DONE] beta, aurora → report
- Functional tests (manual):
Release 72 build readiness
- Build: 72.0-build2 (e3f0d87af6e18f61793650fabb96562d105a1f5d, 20191230161130) - GREEN
- Build: 72.0-build3 (https://hg.mozilla.org/releases/mozilla-release/rev/d88c5f2e59dccf2bfd345e66e548f2f245561a00 d88c5f2e59dccf2bfd345e66e548f2f245561a00], 20200102182448) - GREEN
- Build: 72.0.1-build1 (8260da04c9b1, 20200107212822) - GREEN
- [DONE] Smoke, regression, exploratory → TestRail
- [DONE] Smoke testing on Ubuntu snap package → Installation
- [DONE] Bug fix verification – Chempsill bug
- Update tests (manual):
- Build: 72.0.2-build1 (25e0edbb0a613c3bf794c93ba3aa0985d29d5ef4, 20200117190643) - GREEN
- [DONE] Smoke, regression, exploratory → TestRail
- [DONE] Smoke testing on Ubuntu snap package → Installation
- [DONE] Bug fix verification – Driver bugs
- Update tests (manual):